2024-09-12T02:12:08.561 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T02:12:08.586 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T02:12:08.680 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901613 branch: squid description: fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/ffsb}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7901613' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: fs: - name: a - name: b session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mon client directed command retry: 5 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds osd ms inject socket failures: 2500 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 filestore flush min: 0 mon client directed command retry: 5 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds ms inject socket failures: 2500 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub - overall HEALTH_ - \(MON_DOWN\) - SLOW_OPS - slow request sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: cephfs_name: a client.1: cephfs_name: b install: ceph: flavor: default sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc kclient: client.0: cephfs_name: a client.1: cephfs_name: b selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 481 sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc sleep_before_teardown: 0 subset: 57/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi060.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBfYGznE3a3V5d16cEJ5QduO/QsIZCR7QNyalnBw7/kepJLw/lGauJzdXfteq5EcFQxvnXzNN1J3Lu2gPNmAhbU= smithi105.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD6VZadNlKu7N0JukTC+f/gds6MpTddgCT6sQ4VqJRpjmLeOV/qDnSZqq5zRh1bqcdXTge7SsjmN7ANwZLbGtwE= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - mon_thrash: check_mds_failover: true revive_delay: 20 thrash_delay: 10 - workunit: clients: all: - suites/ffsb.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T02:12:08.681 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa; will attempt to use it 2024-09-12T02:12:08.682 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks 2024-09-12T02:12:08.682 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T02:12:08.683 INFO:teuthology.task.internal:Checking packages... 2024-09-12T02:12:08.705 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc' 2024-09-12T02:12:08.706 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T02:12:08.706 INFO:teuthology.packaging:ref: None 2024-09-12T02:12:08.706 INFO:teuthology.packaging:tag: None 2024-09-12T02:12:08.706 INFO:teuthology.packaging:branch: squid 2024-09-12T02:12:08.706 INFO:teuthology.packaging:sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:12:08.706 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-12T02:12:08.915 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-314.g086c737f 2024-09-12T02:12:08.916 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T02:12:08.922 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T02:12:08.922 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T02:12:08.963 INFO:teuthology.task.internal:Saving configuration 2024-09-12T02:12:08.983 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T02:12:09.003 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T02:12:09.031 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi060.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901613', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 02:07:10.100587', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBfYGznE3a3V5d16cEJ5QduO/QsIZCR7QNyalnBw7/kepJLw/lGauJzdXfteq5EcFQxvnXzNN1J3Lu2gPNmAhbU='} 2024-09-12T02:12:09.063 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi105.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901613', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 02:07:10.098647', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD6VZadNlKu7N0JukTC+f/gds6MpTddgCT6sQ4VqJRpjmLeOV/qDnSZqq5zRh1bqcdXTge7SsjmN7ANwZLbGtwE='} 2024-09-12T02:12:09.064 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T02:12:09.070 INFO:teuthology.task.internal:roles: ubuntu@smithi060.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-09-12T02:12:09.070 INFO:teuthology.task.internal:roles: ubuntu@smithi105.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2024-09-12T02:12:09.070 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T02:12:09.147 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f47240e3be0>, signals=[15]) 2024-09-12T02:12:09.147 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T02:12:09.153 INFO:teuthology.task.internal:Opening connections... 2024-09-12T02:12:09.153 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi060.front.sepia.ceph.com 2024-09-12T02:12:09.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:12:09.251 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi105.front.sepia.ceph.com 2024-09-12T02:12:09.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:12:09.345 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T02:12:09.352 DEBUG:teuthology.orchestra.run.smithi060:> uname -m 2024-09-12T02:12:09.370 INFO:teuthology.orchestra.run.smithi060.stdout:x86_64 2024-09-12T02:12:09.370 DEBUG:teuthology.orchestra.run.smithi060:> cat /etc/os-release 2024-09-12T02:12:09.428 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="CentOS Stream" 2024-09-12T02:12:09.428 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="9" 2024-09-12T02:12:09.428 INFO:teuthology.orchestra.run.smithi060.stdout:ID="centos" 2024-09-12T02:12:09.428 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE="rhel fedora" 2024-09-12T02:12:09.428 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="9" 2024-09-12T02:12:09.429 INFO:teuthology.orchestra.run.smithi060.stdout:PLATFORM_ID="platform:el9" 2024-09-12T02:12:09.429 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T02:12:09.429 INFO:teuthology.orchestra.run.smithi060.stdout:ANSI_COLOR="0;31" 2024-09-12T02:12:09.429 INFO:teuthology.orchestra.run.smithi060.stdout:LOGO="fedora-logo-icon" 2024-09-12T02:12:09.429 INFO:teuthology.orchestra.run.smithi060.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T02:12:09.429 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://centos.org/" 2024-09-12T02:12:09.429 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T02:12:09.429 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T02:12:09.429 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T02:12:09.430 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server 2024-09-12T02:12:09.457 DEBUG:teuthology.orchestra.run.smithi105:> uname -m 2024-09-12T02:12:09.476 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64 2024-09-12T02:12:09.476 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2024-09-12T02:12:09.535 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Stream" 2024-09-12T02:12:09.535 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="9" 2024-09-12T02:12:09.535 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos" 2024-09-12T02:12:09.535 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora" 2024-09-12T02:12:09.535 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="9" 2024-09-12T02:12:09.535 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el9" 2024-09-12T02:12:09.535 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T02:12:09.535 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2024-09-12T02:12:09.536 INFO:teuthology.orchestra.run.smithi105.stdout:LOGO="fedora-logo-icon" 2024-09-12T02:12:09.536 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T02:12:09.536 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://centos.org/" 2024-09-12T02:12:09.536 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T02:12:09.536 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T02:12:09.536 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T02:12:09.536 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2024-09-12T02:12:09.565 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T02:12:09.574 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T02:12:09.605 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T02:12:09.605 DEBUG:teuthology.orchestra.run.smithi060:> test '!' -e /home/ubuntu/cephtest 2024-09-12T02:12:09.608 DEBUG:teuthology.orchestra.run.smithi105:> test '!' -e /home/ubuntu/cephtest 2024-09-12T02:12:09.625 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T02:12:09.674 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T02:12:09.674 DEBUG:teuthology.orchestra.run.smithi060:> test -z $(ls -A /var/lib/ceph) 2024-09-12T02:12:09.677 DEBUG:teuthology.orchestra.run.smithi105:> test -z $(ls -A /var/lib/ceph) 2024-09-12T02:12:09.744 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T02:12:09.819 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T02:12:09.836 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-12T02:12:09.836 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-12T02:12:09.836 DEBUG:teuthology.orchestra.run.smithi060:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T02:12:09.837 DEBUG:teuthology.orchestra.run.smithi105:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T02:12:09.854 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:12:09.854 DEBUG:teuthology.orchestra.run.smithi060:> uname -r 2024-09-12T02:12:09.855 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:12:09.856 DEBUG:teuthology.orchestra.run.smithi105:> uname -r 2024-09-12T02:12:09.913 INFO:teuthology.orchestra.run.smithi060.stdout:5.14.0-503.el9.x86_64 2024-09-12T02:12:09.913 INFO:teuthology.task.kernel:Running kernel on smithi060: 5.14.0-503.el9.x86_64 2024-09-12T02:12:09.914 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum install -y kernel 2024-09-12T02:12:09.915 INFO:teuthology.orchestra.run.smithi105.stdout:5.14.0-503.el9.x86_64 2024-09-12T02:12:09.915 INFO:teuthology.task.kernel:Running kernel on smithi105: 5.14.0-503.el9.x86_64 2024-09-12T02:12:09.915 DEBUG:teuthology.orchestra.run.smithi105:> sudo yum install -y kernel 2024-09-12T02:12:12.313 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.2 MB 00:00 2024-09-12T02:12:13.524 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 8.2 MB 00:01 2024-09-12T02:12:15.442 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS Stream 9 - AppStream 26 MB/s | 20 MB 00:00 2024-09-12T02:12:15.614 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - AppStream 9.6 MB/s | 20 MB 00:02 2024-09-12T02:12:19.792 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-12T02:12:20.165 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-12T02:12:21.218 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS Stream 9 - Extras packages 86 kB/s | 19 kB 00:00 2024-09-12T02:12:21.574 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - Extras packages 112 kB/s | 19 kB 00:00 2024-09-12T02:12:22.114 INFO:teuthology.orchestra.run.smithi105.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-12T02:12:22.737 INFO:teuthology.orchestra.run.smithi060.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-12T02:12:27.603 INFO:teuthology.orchestra.run.smithi105.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-12T02:12:28.409 INFO:teuthology.orchestra.run.smithi060.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-12T02:12:29.693 INFO:teuthology.orchestra.run.smithi105.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T02:12:29.693 INFO:teuthology.orchestra.run.smithi105.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T02:12:29.796 INFO:teuthology.orchestra.run.smithi105.stdout:Dependencies resolved. 2024-09-12T02:12:29.803 INFO:teuthology.orchestra.run.smithi105.stdout:================================================================================ 2024-09-12T02:12:29.803 INFO:teuthology.orchestra.run.smithi105.stdout: Package Architecture Version Repository Size 2024-09-12T02:12:29.803 INFO:teuthology.orchestra.run.smithi105.stdout:================================================================================ 2024-09-12T02:12:29.803 INFO:teuthology.orchestra.run.smithi105.stdout:Installing: 2024-09-12T02:12:29.803 INFO:teuthology.orchestra.run.smithi105.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T02:12:29.803 INFO:teuthology.orchestra.run.smithi105.stdout:Installing dependencies: 2024-09-12T02:12:29.803 INFO:teuthology.orchestra.run.smithi105.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T02:12:29.803 INFO:teuthology.orchestra.run.smithi105.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T02:12:29.803 INFO:teuthology.orchestra.run.smithi105.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T02:12:29.804 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:12:29.804 INFO:teuthology.orchestra.run.smithi105.stdout:Transaction Summary 2024-09-12T02:12:29.804 INFO:teuthology.orchestra.run.smithi105.stdout:================================================================================ 2024-09-12T02:12:29.804 INFO:teuthology.orchestra.run.smithi105.stdout:Install 4 Packages 2024-09-12T02:12:29.804 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:12:29.804 INFO:teuthology.orchestra.run.smithi105.stdout:Total download size: 79 M 2024-09-12T02:12:29.805 INFO:teuthology.orchestra.run.smithi105.stdout:Installed size: 126 M 2024-09-12T02:12:29.805 INFO:teuthology.orchestra.run.smithi105.stdout:Downloading Packages: 2024-09-12T02:12:30.413 INFO:teuthology.orchestra.run.smithi105.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 39 kB/s | 23 kB 00:00 2024-09-12T02:12:30.516 INFO:teuthology.orchestra.run.smithi060.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T02:12:30.516 INFO:teuthology.orchestra.run.smithi060.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T02:12:30.608 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-12T02:12:30.623 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-12T02:12:30.623 INFO:teuthology.orchestra.run.smithi060.stdout: Package Architecture Version Repository Size 2024-09-12T02:12:30.623 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-12T02:12:30.623 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-09-12T02:12:30.623 INFO:teuthology.orchestra.run.smithi060.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T02:12:30.623 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2024-09-12T02:12:30.623 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T02:12:30.623 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T02:12:30.623 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T02:12:30.623 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:12:30.623 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-09-12T02:12:30.624 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-12T02:12:30.624 INFO:teuthology.orchestra.run.smithi060.stdout:Install 4 Packages 2024-09-12T02:12:30.624 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:12:30.624 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 79 M 2024-09-12T02:12:30.624 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 126 M 2024-09-12T02:12:30.624 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-09-12T02:12:30.919 INFO:teuthology.orchestra.run.smithi060.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 133 kB/s | 23 kB 00:00 2024-09-12T02:12:31.838 INFO:teuthology.orchestra.run.smithi105.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 7.8 MB/s | 16 MB 00:02 2024-09-12T02:12:32.688 INFO:teuthology.orchestra.run.smithi105.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 13 MB/s | 29 MB 00:02 2024-09-12T02:12:33.489 INFO:teuthology.orchestra.run.smithi105.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 9.4 MB/s | 35 MB 00:03 2024-09-12T02:12:33.489 INFO:teuthology.orchestra.run.smithi105.stdout:-------------------------------------------------------------------------------- 2024-09-12T02:12:33.489 INFO:teuthology.orchestra.run.smithi105.stdout:Total 21 MB/s | 79 MB 00:03 2024-09-12T02:12:34.174 INFO:teuthology.orchestra.run.smithi105.stdout:Running transaction check 2024-09-12T02:12:34.547 INFO:teuthology.orchestra.run.smithi105.stdout:Transaction check succeeded. 2024-09-12T02:12:34.547 INFO:teuthology.orchestra.run.smithi105.stdout:Running transaction test 2024-09-12T02:12:35.513 INFO:teuthology.orchestra.run.smithi105.stdout:Transaction test succeeded. 2024-09-12T02:12:35.513 INFO:teuthology.orchestra.run.smithi105.stdout:Running transaction 2024-09-12T02:12:35.735 INFO:teuthology.orchestra.run.smithi060.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 3.1 MB/s | 16 MB 00:04 2024-09-12T02:12:37.950 INFO:teuthology.orchestra.run.smithi105.stdout: Preparing : 1/1 2024-09-12T02:12:38.252 INFO:teuthology.orchestra.run.smithi060.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 3.9 MB/s | 29 MB 00:07 2024-09-12T02:12:38.637 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T02:12:38.713 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T02:12:39.053 INFO:teuthology.orchestra.run.smithi060.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 4.2 MB/s | 35 MB 00:08 2024-09-12T02:12:39.053 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-09-12T02:12:39.053 INFO:teuthology.orchestra.run.smithi060.stdout:Total 9.3 MB/s | 79 MB 00:08 2024-09-12T02:12:39.764 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-09-12T02:12:40.122 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-09-12T02:12:40.123 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-09-12T02:12:41.124 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-09-12T02:12:41.125 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-09-12T02:12:41.510 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T02:12:41.634 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T02:12:43.695 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-09-12T02:12:44.365 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T02:12:44.447 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T02:12:46.468 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T02:12:46.509 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:12:47.233 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T02:12:47.366 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T02:12:51.433 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:12:52.495 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T02:12:52.534 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:12:57.683 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:13:29.507 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:13:29.545 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:13:29.840 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:13:29.840 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T02:13:29.840 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T02:13:29.840 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T02:13:30.695 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:13:30.695 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:13:30.695 INFO:teuthology.orchestra.run.smithi105.stdout:Installed: 2024-09-12T02:13:30.695 INFO:teuthology.orchestra.run.smithi105.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T02:13:30.695 INFO:teuthology.orchestra.run.smithi105.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T02:13:30.695 INFO:teuthology.orchestra.run.smithi105.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T02:13:30.695 INFO:teuthology.orchestra.run.smithi105.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T02:13:30.696 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:13:30.696 INFO:teuthology.orchestra.run.smithi105.stdout:Complete! 2024-09-12T02:13:31.061 DEBUG:teuthology.orchestra.run.smithi105:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T02:13:31.151 INFO:teuthology.orchestra.run.smithi105.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T02:13:31.151 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T02:13:31.151 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T02:13:31.151 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T02:13:31.151 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T02:13:31.151 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-12T02:13:31.152 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi105.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T02:13:31.152 DEBUG:teuthology.orchestra.run.smithi105:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T02:13:31.212 INFO:teuthology.orchestra.run.smithi105.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T02:13:31.212 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T02:13:31.212 DEBUG:teuthology.orchestra.run.smithi105:> sudo rpm -qi grub2-tools 2024-09-12T02:13:31.247 INFO:teuthology.orchestra.run.smithi105.stdout:Name : grub2-tools 2024-09-12T02:13:31.247 INFO:teuthology.orchestra.run.smithi105.stdout:Epoch : 1 2024-09-12T02:13:31.247 INFO:teuthology.orchestra.run.smithi105.stdout:Version : 2.06 2024-09-12T02:13:31.248 INFO:teuthology.orchestra.run.smithi105.stdout:Release : 82.el9 2024-09-12T02:13:31.248 INFO:teuthology.orchestra.run.smithi105.stdout:Architecture: x86_64 2024-09-12T02:13:31.248 INFO:teuthology.orchestra.run.smithi105.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T02:13:31.248 INFO:teuthology.orchestra.run.smithi105.stdout:Group : Unspecified 2024-09-12T02:13:31.248 INFO:teuthology.orchestra.run.smithi105.stdout:Size : 8274670 2024-09-12T02:13:31.248 INFO:teuthology.orchestra.run.smithi105.stdout:License : GPLv3+ 2024-09-12T02:13:31.248 INFO:teuthology.orchestra.run.smithi105.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T02:13:31.248 INFO:teuthology.orchestra.run.smithi105.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T02:13:31.248 INFO:teuthology.orchestra.run.smithi105.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T02:13:31.248 INFO:teuthology.orchestra.run.smithi105.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T02:13:31.248 INFO:teuthology.orchestra.run.smithi105.stdout:Packager : builder@centos.org 2024-09-12T02:13:31.248 INFO:teuthology.orchestra.run.smithi105.stdout:Vendor : CentOS 2024-09-12T02:13:31.248 INFO:teuthology.orchestra.run.smithi105.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T02:13:31.248 INFO:teuthology.orchestra.run.smithi105.stdout:Summary : Support tools for GRUB. 2024-09-12T02:13:31.249 INFO:teuthology.orchestra.run.smithi105.stdout:Description : 2024-09-12T02:13:31.249 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:13:31.249 INFO:teuthology.orchestra.run.smithi105.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T02:13:31.249 INFO:teuthology.orchestra.run.smithi105.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T02:13:31.249 INFO:teuthology.orchestra.run.smithi105.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T02:13:31.249 INFO:teuthology.orchestra.run.smithi105.stdout:hardware devices. 2024-09-12T02:13:31.249 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:13:31.249 INFO:teuthology.orchestra.run.smithi105.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T02:13:31.250 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T02:13:31.250 INFO:teuthology.task.kernel:Updating grub on smithi105 to boot 5.14.0-505.el9.x86_64 2024-09-12T02:13:31.250 DEBUG:teuthology.orchestra.run.smithi105:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T02:13:31.860 INFO:teuthology.orchestra.run.smithi105.stderr:Generating grub configuration file ... 2024-09-12T02:13:33.209 INFO:teuthology.orchestra.run.smithi105.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T02:13:33.233 INFO:teuthology.orchestra.run.smithi105.stderr:done 2024-09-12T02:13:33.236 DEBUG:teuthology.orchestra.run.smithi105:> mktemp 2024-09-12T02:13:33.251 INFO:teuthology.orchestra.run.smithi105.stdout:/tmp/tmp.vs8cH9WI7f 2024-09-12T02:13:33.251 DEBUG:teuthology.orchestra.run.smithi105:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.vs8cH9WI7f 2024-09-12T02:13:33.317 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 0666 /tmp/tmp.vs8cH9WI7f 2024-09-12T02:13:33.455 DEBUG:teuthology.orchestra.remote:smithi105:/tmp/tmp.vs8cH9WI7f is 6KB 2024-09-12T02:13:33.503 DEBUG:teuthology.orchestra.run.smithi105:> rm -fr /tmp/tmp.vs8cH9WI7f 2024-09-12T02:13:33.518 DEBUG:teuthology.orchestra.run.smithi105:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T02:13:33.581 INFO:teuthology.orchestra.run.smithi105.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T02:13:33.581 INFO:teuthology.orchestra.run.smithi105.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T02:13:33.581 INFO:teuthology.orchestra.run.smithi105.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T02:13:33.581 INFO:teuthology.orchestra.run.smithi105.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T02:13:33.583 DEBUG:teuthology.orchestra.run.smithi105:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T02:13:33.736 DEBUG:teuthology.orchestra.run.smithi105:> sudo shutdown -r now 2024-09-12T02:13:36.938 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:13:36.980 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:13:37.325 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:13:37.325 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T02:13:37.326 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T02:13:37.326 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T02:13:38.142 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T02:13:38.142 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:13:38.142 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-09-12T02:13:38.142 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T02:13:38.142 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T02:13:38.142 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T02:13:38.142 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T02:13:38.142 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:13:38.142 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-12T02:13:38.471 DEBUG:teuthology.orchestra.run.smithi060:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T02:13:38.598 INFO:teuthology.orchestra.run.smithi060.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T02:13:38.598 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T02:13:38.598 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T02:13:38.598 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T02:13:38.598 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T02:13:38.599 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-12T02:13:38.599 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi060.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T02:13:38.599 DEBUG:teuthology.orchestra.run.smithi060:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T02:13:38.657 INFO:teuthology.orchestra.run.smithi060.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T02:13:38.657 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T02:13:38.657 DEBUG:teuthology.orchestra.run.smithi060:> sudo rpm -qi grub2-tools 2024-09-12T02:13:38.689 INFO:teuthology.orchestra.run.smithi060.stdout:Name : grub2-tools 2024-09-12T02:13:38.689 INFO:teuthology.orchestra.run.smithi060.stdout:Epoch : 1 2024-09-12T02:13:38.689 INFO:teuthology.orchestra.run.smithi060.stdout:Version : 2.06 2024-09-12T02:13:38.689 INFO:teuthology.orchestra.run.smithi060.stdout:Release : 82.el9 2024-09-12T02:13:38.689 INFO:teuthology.orchestra.run.smithi060.stdout:Architecture: x86_64 2024-09-12T02:13:38.689 INFO:teuthology.orchestra.run.smithi060.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T02:13:38.689 INFO:teuthology.orchestra.run.smithi060.stdout:Group : Unspecified 2024-09-12T02:13:38.689 INFO:teuthology.orchestra.run.smithi060.stdout:Size : 8274670 2024-09-12T02:13:38.690 INFO:teuthology.orchestra.run.smithi060.stdout:License : GPLv3+ 2024-09-12T02:13:38.690 INFO:teuthology.orchestra.run.smithi060.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T02:13:38.690 INFO:teuthology.orchestra.run.smithi060.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T02:13:38.690 INFO:teuthology.orchestra.run.smithi060.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T02:13:38.690 INFO:teuthology.orchestra.run.smithi060.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T02:13:38.690 INFO:teuthology.orchestra.run.smithi060.stdout:Packager : builder@centos.org 2024-09-12T02:13:38.690 INFO:teuthology.orchestra.run.smithi060.stdout:Vendor : CentOS 2024-09-12T02:13:38.690 INFO:teuthology.orchestra.run.smithi060.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T02:13:38.690 INFO:teuthology.orchestra.run.smithi060.stdout:Summary : Support tools for GRUB. 2024-09-12T02:13:38.690 INFO:teuthology.orchestra.run.smithi060.stdout:Description : 2024-09-12T02:13:38.690 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:13:38.690 INFO:teuthology.orchestra.run.smithi060.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T02:13:38.690 INFO:teuthology.orchestra.run.smithi060.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T02:13:38.690 INFO:teuthology.orchestra.run.smithi060.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T02:13:38.690 INFO:teuthology.orchestra.run.smithi060.stdout:hardware devices. 2024-09-12T02:13:38.691 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:13:38.691 INFO:teuthology.orchestra.run.smithi060.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T02:13:38.691 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T02:13:38.692 INFO:teuthology.task.kernel:Updating grub on smithi060 to boot 5.14.0-505.el9.x86_64 2024-09-12T02:13:38.692 DEBUG:teuthology.orchestra.run.smithi060:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T02:13:39.309 INFO:teuthology.orchestra.run.smithi060.stderr:Generating grub configuration file ... 2024-09-12T02:13:40.546 INFO:teuthology.orchestra.run.smithi060.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T02:13:40.574 INFO:teuthology.orchestra.run.smithi060.stderr:done 2024-09-12T02:13:40.576 DEBUG:teuthology.orchestra.run.smithi060:> mktemp 2024-09-12T02:13:40.591 INFO:teuthology.orchestra.run.smithi060.stdout:/tmp/tmp.vxGKmhQCNq 2024-09-12T02:13:40.592 DEBUG:teuthology.orchestra.run.smithi060:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.vxGKmhQCNq 2024-09-12T02:13:40.665 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 0666 /tmp/tmp.vxGKmhQCNq 2024-09-12T02:13:40.798 DEBUG:teuthology.orchestra.remote:smithi060:/tmp/tmp.vxGKmhQCNq is 6KB 2024-09-12T02:13:40.847 DEBUG:teuthology.orchestra.run.smithi060:> rm -fr /tmp/tmp.vxGKmhQCNq 2024-09-12T02:13:40.861 DEBUG:teuthology.orchestra.run.smithi060:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T02:13:40.923 INFO:teuthology.orchestra.run.smithi060.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T02:13:40.923 INFO:teuthology.orchestra.run.smithi060.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T02:13:40.924 INFO:teuthology.orchestra.run.smithi060.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T02:13:40.924 INFO:teuthology.orchestra.run.smithi060.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T02:13:40.925 DEBUG:teuthology.orchestra.run.smithi060:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T02:13:41.069 DEBUG:teuthology.orchestra.run.smithi060:> sudo shutdown -r now 2024-09-12T02:14:03.761 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-12T02:14:03.762 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-09-12T02:14:03.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:14:11.077 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-12T02:14:11.077 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-09-12T02:14:11.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:14:22.273 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-09-12T02:14:29.437 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.60 2024-09-12T02:14:31.275 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-09-12T02:14:31.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:14:34.365 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-09-12T02:14:38.442 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-09-12T02:14:38.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:14:46.374 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-09-12T02:14:46.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:15:18.603 DEBUG:teuthology.orchestra.run.smithi105:> true 2024-09-12T02:15:18.953 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-09-12T02:15:18.953 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-505.el9.x86_64"... 2024-09-12T02:15:18.953 DEBUG:teuthology.orchestra.run.smithi105:> uname -r 2024-09-12T02:15:18.968 INFO:teuthology.orchestra.run.smithi105.stdout:5.14.0-505.el9.x86_64 2024-09-12T02:15:18.968 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T02:15:18.968 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T02:15:18.968 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T02:15:19.970 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-12T02:15:19.970 DEBUG:teuthology.orchestra.run.smithi105:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T02:15:20.035 INFO:teuthology.orchestra.run.smithi105.stdout:ttyS1 2024-09-12T02:15:20.059 DEBUG:teuthology.parallel:result is None 2024-09-12T02:15:38.453 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T02:15:50.455 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-09-12T02:15:50.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:15:50.826 DEBUG:teuthology.orchestra.run.smithi060:> true 2024-09-12T02:15:51.189 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-09-12T02:15:51.189 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-12T02:15:51.190 DEBUG:teuthology.orchestra.run.smithi060:> uname -r 2024-09-12T02:15:51.208 INFO:teuthology.orchestra.run.smithi060.stdout:5.14.0-505.el9.x86_64 2024-09-12T02:15:51.209 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T02:15:51.209 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T02:15:51.209 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T02:15:52.210 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-12T02:15:52.211 DEBUG:teuthology.orchestra.run.smithi060:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T02:15:52.280 INFO:teuthology.orchestra.run.smithi060.stdout:ttyS1 2024-09-12T02:15:52.299 DEBUG:teuthology.parallel:result is None 2024-09-12T02:15:52.300 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T02:15:52.317 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T02:15:52.317 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T02:15:52.320 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T02:15:52.338 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T02:15:52.372 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T02:15:52.426 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T02:15:52.426 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T02:15:52.428 DEBUG:teuthology.orchestra.run.smithi105:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T02:15:52.457 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T02:15:52.474 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T02:15:52.474 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T02:15:52.491 DEBUG:teuthology.orchestra.run.smithi105:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T02:15:52.531 INFO:teuthology.orchestra.run.smithi105.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T02:15:52.532 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T02:15:52.542 INFO:teuthology.orchestra.run.smithi105.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T02:15:52.544 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T02:15:52.546 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T02:15:52.588 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T02:15:52.589 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T02:15:52.592 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T02:15:52.618 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T02:15:52.641 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T02:15:52.641 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T02:15:52.660 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T02:15:52.677 DEBUG:teuthology.orchestra.run.smithi060:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T02:15:52.766 DEBUG:teuthology.orchestra.run.smithi060:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T02:15:52.806 DEBUG:teuthology.orchestra.run.smithi060:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T02:15:52.899 DEBUG:teuthology.orchestra.run.smithi060:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T02:15:52.931 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T02:15:52.932 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T02:15:52.998 DEBUG:teuthology.orchestra.run.smithi105:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T02:15:53.050 DEBUG:teuthology.orchestra.run.smithi105:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T02:15:53.100 DEBUG:teuthology.orchestra.run.smithi105:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T02:15:53.192 DEBUG:teuthology.orchestra.run.smithi105:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T02:15:53.223 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T02:15:53.224 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T02:15:53.289 DEBUG:teuthology.orchestra.run.smithi060:> sudo service rsyslog restart 2024-09-12T02:15:53.292 DEBUG:teuthology.orchestra.run.smithi105:> sudo service rsyslog restart 2024-09-12T02:15:53.340 INFO:teuthology.orchestra.run.smithi060.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:15:53.373 INFO:teuthology.orchestra.run.smithi105.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:15:53.671 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T02:15:53.684 INFO:teuthology.task.internal:Starting timer... 2024-09-12T02:15:53.684 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T02:15:53.739 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T02:15:53.785 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-12T02:15:53.786 DEBUG:teuthology.orchestra.run.smithi060:> sudo service auditd rotate 2024-09-12T02:15:53.842 INFO:teuthology.orchestra.run.smithi060.stdout:Rotating logs: 2024-09-12T02:15:53.844 DEBUG:teuthology.orchestra.run.smithi105:> sudo service auditd rotate 2024-09-12T02:15:53.896 INFO:teuthology.orchestra.run.smithi105.stdout:Rotating logs: 2024-09-12T02:15:53.898 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T02:15:53.898 DEBUG:teuthology.orchestra.run.smithi060:> /usr/sbin/getenforce 2024-09-12T02:15:53.923 INFO:teuthology.orchestra.run.smithi060.stdout:Permissive 2024-09-12T02:15:53.923 DEBUG:teuthology.orchestra.run.smithi105:> /usr/sbin/getenforce 2024-09-12T02:15:53.978 INFO:teuthology.orchestra.run.smithi105.stdout:Permissive 2024-09-12T02:15:53.978 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi060.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi105.front.sepia.ceph.com': 'permissive'} 2024-09-12T02:15:53.978 DEBUG:teuthology.orchestra.run.smithi060:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:15:54.006 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:15:54.007 DEBUG:teuthology.orchestra.run.smithi105:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:15:54.031 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:15:54.032 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T02:15:54.032 DEBUG:teuthology.orchestra.run.smithi060:> sudo /usr/sbin/setenforce permissive 2024-09-12T02:15:54.080 DEBUG:teuthology.orchestra.run.smithi105:> sudo /usr/sbin/setenforce permissive 2024-09-12T02:15:54.110 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T02:15:54.120 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-12T02:15:54.124 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-12T02:15:54.299 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T02:15:54.313 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T02:15:54.314 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi060.front.sepia.ceph.com,smithi105.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T02:19:39.523 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi060.front.sepia.ceph.com'), Remote(name='ubuntu@smithi105.front.sepia.ceph.com')] 2024-09-12T02:19:39.525 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-09-12T02:19:39.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:19:39.613 DEBUG:teuthology.orchestra.run.smithi060:> true 2024-09-12T02:19:39.694 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-09-12T02:19:39.694 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-09-12T02:19:39.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:19:39.777 DEBUG:teuthology.orchestra.run.smithi105:> true 2024-09-12T02:19:39.856 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-09-12T02:19:39.857 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T02:19:39.867 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T02:19:39.867 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T02:19:39.868 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:19:39.871 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T02:19:39.871 DEBUG:teuthology.orchestra.run.smithi105:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:19:39.902 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T02:19:39.919 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T02:19:39.927 INFO:teuthology.orchestra.run.smithi105.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T02:19:39.942 INFO:teuthology.orchestra.run.smithi105.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T02:19:39.946 INFO:teuthology.orchestra.run.smithi060.stderr:sudo: ntpd: command not found 2024-09-12T02:19:39.958 INFO:teuthology.orchestra.run.smithi060.stdout:506 Cannot talk to daemon 2024-09-12T02:19:39.967 INFO:teuthology.orchestra.run.smithi105.stderr:sudo: ntpd: command not found 2024-09-12T02:19:39.974 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T02:19:39.977 INFO:teuthology.orchestra.run.smithi105.stdout:506 Cannot talk to daemon 2024-09-12T02:19:39.989 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T02:19:39.992 INFO:teuthology.orchestra.run.smithi105.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T02:19:40.006 INFO:teuthology.orchestra.run.smithi105.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T02:19:40.045 INFO:teuthology.orchestra.run.smithi060.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:19:40.048 INFO:teuthology.orchestra.run.smithi060.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:19:40.048 INFO:teuthology.orchestra.run.smithi060.stdout:=============================================================================== 2024-09-12T02:19:40.048 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:19:40.048 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:19:40.048 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:19:40.049 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:19:40.059 INFO:teuthology.orchestra.run.smithi105.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:19:40.062 INFO:teuthology.orchestra.run.smithi105.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:19:40.062 INFO:teuthology.orchestra.run.smithi105.stdout:=============================================================================== 2024-09-12T02:19:40.062 INFO:teuthology.orchestra.run.smithi105.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:19:40.062 INFO:teuthology.orchestra.run.smithi105.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:19:40.062 INFO:teuthology.orchestra.run.smithi105.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:19:40.062 INFO:teuthology.orchestra.run.smithi105.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:19:40.063 INFO:teuthology.run_tasks:Running task install... 2024-09-12T02:19:40.072 DEBUG:teuthology.task.install:project ceph 2024-09-12T02:19:40.072 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}} 2024-09-12T02:19:40.072 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'} 2024-09-12T02:19:40.072 INFO:teuthology.task.install:Using flavor: default 2024-09-12T02:19:40.079 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T02:19:40.079 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-12T02:19:40.079 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T02:19:40.080 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:19:40.082 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T02:19:40.082 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:19:40.228 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T02:19:40.228 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T02:19:40.244 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T02:19:40.244 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T02:19:40.343 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T02:19:40.343 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T02:19:40.343 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T02:19:40.353 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T02:19:40.354 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T02:19:40.354 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T02:19:40.371 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T02:19:40.371 DEBUG:teuthology.orchestra.run.smithi060:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T02:19:40.380 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T02:19:40.380 DEBUG:teuthology.orchestra.run.smithi105:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T02:19:40.437 DEBUG:teuthology.orchestra.run.smithi060:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T02:19:40.447 DEBUG:teuthology.orchestra.run.smithi105:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T02:19:40.514 DEBUG:teuthology.orchestra.run.smithi060:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T02:19:40.523 DEBUG:teuthology.orchestra.run.smithi105:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T02:19:40.580 INFO:teuthology.orchestra.run.smithi060.stdout:check_obsoletes = 1 2024-09-12T02:19:40.582 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum clean all 2024-09-12T02:19:40.587 INFO:teuthology.orchestra.run.smithi105.stdout:check_obsoletes = 1 2024-09-12T02:19:40.589 DEBUG:teuthology.orchestra.run.smithi105:> sudo yum clean all 2024-09-12T02:19:40.821 INFO:teuthology.orchestra.run.smithi105.stdout:45 files removed 2024-09-12T02:19:40.836 INFO:teuthology.orchestra.run.smithi060.stdout:45 files removed 2024-09-12T02:19:40.848 DEBUG:teuthology.orchestra.run.smithi105:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T02:19:40.863 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T02:19:41.400 INFO:teuthology.orchestra.run.smithi105.stdout:ceph packages for x86_64 310 kB/s | 84 kB 00:00 2024-09-12T02:19:41.428 INFO:teuthology.orchestra.run.smithi060.stdout:ceph packages for x86_64 316 kB/s | 84 kB 00:00 2024-09-12T02:19:41.675 INFO:teuthology.orchestra.run.smithi105.stdout:ceph noarch packages 51 kB/s | 12 kB 00:00 2024-09-12T02:19:41.720 INFO:teuthology.orchestra.run.smithi060.stdout:ceph noarch packages 48 kB/s | 12 kB 00:00 2024-09-12T02:19:41.934 INFO:teuthology.orchestra.run.smithi105.stdout:ceph source packages 8.5 kB/s | 1.9 kB 00:00 2024-09-12T02:19:41.995 INFO:teuthology.orchestra.run.smithi060.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-12T02:19:42.526 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.2 MB 00:00 2024-09-12T02:19:44.779 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - BaseOS 3.0 MB/s | 8.2 MB 00:02 2024-09-12T02:19:52.063 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - AppStream 3.3 MB/s | 20 MB 00:06 2024-09-12T02:19:58.439 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - CRB 2.9 MB/s | 6.5 MB 00:02 2024-09-12T02:19:59.977 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - Extras packages 99 kB/s | 19 kB 00:00 2024-09-12T02:20:00.185 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 20 MB 00:16 2024-09-12T02:20:00.743 INFO:teuthology.orchestra.run.smithi060.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-12T02:20:04.444 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.5 MB 00:00 2024-09-12T02:20:06.627 INFO:teuthology.orchestra.run.smithi060.stdout:lab-extras 40 kB/s | 1.7 kB 00:00 2024-09-12T02:20:06.819 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 19 kB 00:01 2024-09-12T02:20:07.724 INFO:teuthology.orchestra.run.smithi105.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-12T02:20:09.054 INFO:teuthology.orchestra.run.smithi060.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T02:20:09.055 INFO:teuthology.orchestra.run.smithi060.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T02:20:09.069 INFO:teuthology.orchestra.run.smithi060.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T02:20:09.070 INFO:teuthology.orchestra.run.smithi060.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T02:20:09.071 INFO:teuthology.orchestra.run.smithi060.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T02:20:09.072 INFO:teuthology.orchestra.run.smithi060.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T02:20:09.074 INFO:teuthology.orchestra.run.smithi060.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T02:20:09.077 INFO:teuthology.orchestra.run.smithi060.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T02:20:09.078 INFO:teuthology.orchestra.run.smithi060.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T02:20:09.146 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-12T02:20:09.167 INFO:teuthology.orchestra.run.smithi060.stdout:====================================================================================== 2024-09-12T02:20:09.167 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2024-09-12T02:20:09.167 INFO:teuthology.orchestra.run.smithi060.stdout:====================================================================================== 2024-09-12T02:20:09.168 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-09-12T02:20:09.168 INFO:teuthology.orchestra.run.smithi060.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T02:20:09.168 INFO:teuthology.orchestra.run.smithi060.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T02:20:09.168 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T02:20:09.168 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T02:20:09.168 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T02:20:09.168 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T02:20:09.169 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T02:20:09.169 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T02:20:09.169 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T02:20:09.169 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T02:20:09.169 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T02:20:09.169 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T02:20:09.170 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T02:20:09.170 INFO:teuthology.orchestra.run.smithi060.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T02:20:09.170 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T02:20:09.170 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T02:20:09.170 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T02:20:09.170 INFO:teuthology.orchestra.run.smithi060.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T02:20:09.170 INFO:teuthology.orchestra.run.smithi060.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T02:20:09.171 INFO:teuthology.orchestra.run.smithi060.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T02:20:09.171 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T02:20:09.171 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T02:20:09.171 INFO:teuthology.orchestra.run.smithi060.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T02:20:09.171 INFO:teuthology.orchestra.run.smithi060.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T02:20:09.171 INFO:teuthology.orchestra.run.smithi060.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T02:20:09.171 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T02:20:09.172 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T02:20:09.172 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T02:20:09.172 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T02:20:09.172 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T02:20:09.172 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T02:20:09.172 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T02:20:09.172 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T02:20:09.172 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T02:20:09.173 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T02:20:09.173 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T02:20:09.173 INFO:teuthology.orchestra.run.smithi060.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T02:20:09.173 INFO:teuthology.orchestra.run.smithi060.stdout:Upgrading: 2024-09-12T02:20:09.173 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T02:20:09.173 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T02:20:09.174 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T02:20:09.174 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T02:20:09.174 INFO:teuthology.orchestra.run.smithi060.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T02:20:09.174 INFO:teuthology.orchestra.run.smithi060.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T02:20:09.174 INFO:teuthology.orchestra.run.smithi060.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T02:20:09.174 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T02:20:09.174 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2024-09-12T02:20:09.175 INFO:teuthology.orchestra.run.smithi060.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T02:20:09.175 INFO:teuthology.orchestra.run.smithi060.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T02:20:09.175 INFO:teuthology.orchestra.run.smithi060.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T02:20:09.175 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T02:20:09.175 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T02:20:09.175 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T02:20:09.175 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T02:20:09.175 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T02:20:09.175 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T02:20:09.175 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T02:20:09.175 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T02:20:09.175 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T02:20:09.175 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T02:20:09.176 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T02:20:09.176 INFO:teuthology.orchestra.run.smithi060.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T02:20:09.176 INFO:teuthology.orchestra.run.smithi060.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T02:20:09.176 INFO:teuthology.orchestra.run.smithi060.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T02:20:09.176 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T02:20:09.176 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T02:20:09.176 INFO:teuthology.orchestra.run.smithi060.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T02:20:09.177 INFO:teuthology.orchestra.run.smithi060.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T02:20:09.177 INFO:teuthology.orchestra.run.smithi060.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T02:20:09.177 INFO:teuthology.orchestra.run.smithi060.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T02:20:09.177 INFO:teuthology.orchestra.run.smithi060.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T02:20:09.177 INFO:teuthology.orchestra.run.smithi060.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T02:20:09.177 INFO:teuthology.orchestra.run.smithi060.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T02:20:09.178 INFO:teuthology.orchestra.run.smithi060.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T02:20:09.178 INFO:teuthology.orchestra.run.smithi060.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T02:20:09.178 INFO:teuthology.orchestra.run.smithi060.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T02:20:09.178 INFO:teuthology.orchestra.run.smithi060.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T02:20:09.178 INFO:teuthology.orchestra.run.smithi060.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T02:20:09.178 INFO:teuthology.orchestra.run.smithi060.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T02:20:09.179 INFO:teuthology.orchestra.run.smithi060.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T02:20:09.179 INFO:teuthology.orchestra.run.smithi060.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T02:20:09.179 INFO:teuthology.orchestra.run.smithi060.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T02:20:09.179 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T02:20:09.179 INFO:teuthology.orchestra.run.smithi060.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T02:20:09.179 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T02:20:09.179 INFO:teuthology.orchestra.run.smithi060.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T02:20:09.179 INFO:teuthology.orchestra.run.smithi060.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T02:20:09.180 INFO:teuthology.orchestra.run.smithi060.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T02:20:09.180 INFO:teuthology.orchestra.run.smithi060.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T02:20:09.180 INFO:teuthology.orchestra.run.smithi060.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T02:20:09.180 INFO:teuthology.orchestra.run.smithi060.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T02:20:09.180 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T02:20:09.181 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T02:20:09.181 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T02:20:09.181 INFO:teuthology.orchestra.run.smithi060.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T02:20:09.181 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T02:20:09.181 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T02:20:09.181 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T02:20:09.181 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T02:20:09.181 INFO:teuthology.orchestra.run.smithi060.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T02:20:09.181 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T02:20:09.181 INFO:teuthology.orchestra.run.smithi060.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T02:20:09.182 INFO:teuthology.orchestra.run.smithi060.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T02:20:09.182 INFO:teuthology.orchestra.run.smithi060.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T02:20:09.182 INFO:teuthology.orchestra.run.smithi060.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T02:20:09.182 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T02:20:09.182 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T02:20:09.182 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T02:20:09.182 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T02:20:09.182 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T02:20:09.185 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T02:20:09.185 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T02:20:09.185 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T02:20:09.185 INFO:teuthology.orchestra.run.smithi060.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T02:20:09.185 INFO:teuthology.orchestra.run.smithi060.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T02:20:09.185 INFO:teuthology.orchestra.run.smithi060.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T02:20:09.185 INFO:teuthology.orchestra.run.smithi060.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T02:20:09.185 INFO:teuthology.orchestra.run.smithi060.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T02:20:09.185 INFO:teuthology.orchestra.run.smithi060.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T02:20:09.185 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T02:20:09.186 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T02:20:09.186 INFO:teuthology.orchestra.run.smithi060.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T02:20:09.186 INFO:teuthology.orchestra.run.smithi060.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T02:20:09.186 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T02:20:09.186 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T02:20:09.186 INFO:teuthology.orchestra.run.smithi060.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T02:20:09.186 INFO:teuthology.orchestra.run.smithi060.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T02:20:09.186 INFO:teuthology.orchestra.run.smithi060.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T02:20:09.186 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T02:20:09.186 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T02:20:09.186 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T02:20:09.186 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T02:20:09.187 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T02:20:09.187 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T02:20:09.187 INFO:teuthology.orchestra.run.smithi060.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T02:20:09.187 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T02:20:09.187 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T02:20:09.187 INFO:teuthology.orchestra.run.smithi060.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T02:20:09.187 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T02:20:09.187 INFO:teuthology.orchestra.run.smithi060.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T02:20:09.187 INFO:teuthology.orchestra.run.smithi060.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T02:20:09.187 INFO:teuthology.orchestra.run.smithi060.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T02:20:09.187 INFO:teuthology.orchestra.run.smithi060.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T02:20:09.187 INFO:teuthology.orchestra.run.smithi060.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T02:20:09.187 INFO:teuthology.orchestra.run.smithi060.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T02:20:09.188 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T02:20:09.188 INFO:teuthology.orchestra.run.smithi060.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T02:20:09.188 INFO:teuthology.orchestra.run.smithi060.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T02:20:09.188 INFO:teuthology.orchestra.run.smithi060.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T02:20:09.188 INFO:teuthology.orchestra.run.smithi060.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T02:20:09.188 INFO:teuthology.orchestra.run.smithi060.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T02:20:09.188 INFO:teuthology.orchestra.run.smithi060.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T02:20:09.188 INFO:teuthology.orchestra.run.smithi060.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T02:20:09.188 INFO:teuthology.orchestra.run.smithi060.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T02:20:09.188 INFO:teuthology.orchestra.run.smithi060.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T02:20:09.188 INFO:teuthology.orchestra.run.smithi060.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T02:20:09.188 INFO:teuthology.orchestra.run.smithi060.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T02:20:09.189 INFO:teuthology.orchestra.run.smithi060.stdout:Installing weak dependencies: 2024-09-12T02:20:09.189 INFO:teuthology.orchestra.run.smithi060.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T02:20:09.189 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:20:09.189 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-09-12T02:20:09.189 INFO:teuthology.orchestra.run.smithi060.stdout:====================================================================================== 2024-09-12T02:20:09.189 INFO:teuthology.orchestra.run.smithi060.stdout:Install 148 Packages 2024-09-12T02:20:09.189 INFO:teuthology.orchestra.run.smithi060.stdout:Upgrade 8 Packages 2024-09-12T02:20:09.189 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:20:09.190 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 226 M 2024-09-12T02:20:09.190 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-09-12T02:20:09.734 INFO:teuthology.orchestra.run.smithi060.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 53 kB/s | 6.5 kB 00:00 2024-09-12T02:20:09.943 INFO:teuthology.orchestra.run.smithi060.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 4.2 MB/s | 897 kB 00:00 2024-09-12T02:20:10.043 INFO:teuthology.orchestra.run.smithi060.stdout:(3/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 13 MB/s | 5.4 MB 00:00 2024-09-12T02:20:10.068 INFO:teuthology.orchestra.run.smithi060.stdout:(4/156): ceph-immutable-object-cache-19.1.1-298 1.1 MB/s | 145 kB 00:00 2024-09-12T02:20:10.152 INFO:teuthology.orchestra.run.smithi060.stdout:(5/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 22 MB/s | 2.4 MB 00:00 2024-09-12T02:20:10.210 INFO:teuthology.orchestra.run.smithi060.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 11 MB/s | 1.5 MB 00:00 2024-09-12T02:20:10.344 INFO:teuthology.orchestra.run.smithi060.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 25 MB/s | 4.7 MB 00:00 2024-09-12T02:20:10.753 INFO:teuthology.orchestra.run.smithi060.stdout:(8/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9. 26 MB/s | 11 MB 00:00 2024-09-12T02:20:10.803 INFO:teuthology.orchestra.run.smithi060.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 506 kB/s | 25 kB 00:00 2024-09-12T02:20:11.261 INFO:teuthology.orchestra.run.smithi060.stdout:(10/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 16 MB/s | 17 MB 00:01 2024-09-12T02:20:11.311 INFO:teuthology.orchestra.run.smithi060.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 4.5 MB/s | 228 kB 00:00 2024-09-12T02:20:11.379 INFO:teuthology.orchestra.run.smithi060.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 404 kB/s | 27 kB 00:00 2024-09-12T02:20:11.437 INFO:teuthology.orchestra.run.smithi060.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 544 kB/s | 32 kB 00:00 2024-09-12T02:20:11.529 INFO:teuthology.orchestra.run.smithi060.stdout:(14/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 8.0 MB/s | 752 kB 00:00 2024-09-12T02:20:11.588 INFO:teuthology.orchestra.run.smithi060.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.7 MB/s | 163 kB 00:00 2024-09-12T02:20:11.655 INFO:teuthology.orchestra.run.smithi060.stdout:(16/156): librados-devel-19.1.1-298.gb53b6d3e.e 1.9 MB/s | 127 kB 00:00 2024-09-12T02:20:11.730 INFO:teuthology.orchestra.run.smithi060.stdout:(17/156): libradosstriper1-19.1.1-298.gb53b6d3e 6.6 MB/s | 506 kB 00:00 2024-09-12T02:20:12.105 INFO:teuthology.orchestra.run.smithi060.stdout:(18/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 14 MB/s | 5.3 MB 00:00 2024-09-12T02:20:12.156 INFO:teuthology.orchestra.run.smithi060.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 906 kB/s | 45 kB 00:00 2024-09-12T02:20:12.381 INFO:teuthology.orchestra.run.smithi060.stdout:(20/156): ceph-common-19.1.1-298.gb53b6d3e.el9. 7.7 MB/s | 21 MB 00:02 2024-09-12T02:20:12.406 INFO:teuthology.orchestra.run.smithi060.stdout:(21/156): python3-ceph-common-19.1.1-298.gb53b6 543 kB/s | 136 kB 00:00 2024-09-12T02:20:12.431 INFO:teuthology.orchestra.run.smithi060.stdout:(22/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 3.2 MB/s | 162 kB 00:00 2024-09-12T02:20:12.457 INFO:teuthology.orchestra.run.smithi060.stdout:(23/156): python3-rados-19.1.1-298.gb53b6d3e.el 6.3 MB/s | 321 kB 00:00 2024-09-12T02:20:12.482 INFO:teuthology.orchestra.run.smithi060.stdout:(24/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 5.9 MB/s | 301 kB 00:00 2024-09-12T02:20:12.507 INFO:teuthology.orchestra.run.smithi060.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.9 MB/s | 100 kB 00:00 2024-09-12T02:20:12.532 INFO:teuthology.orchestra.run.smithi060.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-12T02:20:12.966 INFO:teuthology.orchestra.run.smithi060.stdout:(27/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 23 MB/s | 49 MB 00:02 2024-09-12T02:20:12.992 INFO:teuthology.orchestra.run.smithi060.stdout:(28/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 373 kB/s | 171 kB 00:00 2024-09-12T02:20:13.008 INFO:teuthology.orchestra.run.smithi060.stdout:(29/156): ceph-grafana-dashboards-19.1.1-298.gb 767 kB/s | 32 kB 00:00 2024-09-12T02:20:13.042 INFO:teuthology.orchestra.run.smithi060.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.8 MB/s | 146 kB 00:00 2024-09-12T02:20:13.071 INFO:teuthology.orchestra.run.smithi105.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-12T02:20:13.092 INFO:teuthology.orchestra.run.smithi060.stdout:(31/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 5.3 MB/s | 3.1 MB 00:00 2024-09-12T02:20:13.159 INFO:teuthology.orchestra.run.smithi060.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 3.7 MB/s | 249 kB 00:00 2024-09-12T02:20:13.209 INFO:teuthology.orchestra.run.smithi060.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 988 kB/s | 49 kB 00:00 2024-09-12T02:20:13.268 INFO:teuthology.orchestra.run.smithi060.stdout:(34/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 14 MB/s | 3.6 MB 00:00 2024-09-12T02:20:13.318 INFO:teuthology.orchestra.run.smithi060.stdout:(35/156): ceph-prometheus-alerts-19.1.1-298.gb5 152 kB/s | 16 kB 00:00 2024-09-12T02:20:13.344 INFO:teuthology.orchestra.run.smithi060.stdout:(36/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 3.7 MB/s | 285 kB 00:00 2024-09-12T02:20:13.402 INFO:teuthology.orchestra.run.smithi060.stdout:(37/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 9.0 MB/s | 765 kB 00:00 2024-09-12T02:20:13.427 INFO:teuthology.orchestra.run.smithi060.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 219 kB/s | 18 kB 00:00 2024-09-12T02:20:13.552 INFO:teuthology.orchestra.run.smithi060.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 640 kB/s | 80 kB 00:00 2024-09-12T02:20:13.665 INFO:teuthology.orchestra.run.smithi060.stdout:(40/156): ceph-mgr-diskprediction-local-19.1.1- 12 MB/s | 7.4 MB 00:00 2024-09-12T02:20:13.686 INFO:teuthology.orchestra.run.smithi060.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 191 kB 00:00 2024-09-12T02:20:13.786 INFO:teuthology.orchestra.run.smithi060.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 801 kB 00:00 2024-09-12T02:20:13.829 INFO:teuthology.orchestra.run.smithi060.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 8.6 MB/s | 1.2 MB 00:00 2024-09-12T02:20:13.854 INFO:teuthology.orchestra.run.smithi060.stdout:(44/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.3 MB/s | 253 kB 00:00 2024-09-12T02:20:13.889 INFO:teuthology.orchestra.run.smithi060.stdout:(45/156): python3-ply-3.11-14.el9.noarch.rpm 1.0 MB/s | 106 kB 00:00 2024-09-12T02:20:13.921 INFO:teuthology.orchestra.run.smithi060.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 135 kB 00:00 2024-09-12T02:20:13.938 INFO:teuthology.orchestra.run.smithi060.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-09-12T02:20:13.964 INFO:teuthology.orchestra.run.smithi060.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-12T02:20:14.447 INFO:teuthology.orchestra.run.smithi060.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 221 kB/s | 107 kB 00:00 2024-09-12T02:20:14.572 INFO:teuthology.orchestra.run.smithi060.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 174 kB/s | 22 kB 00:00 2024-09-12T02:20:14.698 INFO:teuthology.orchestra.run.smithi060.stdout:(51/156): automake-1.16.2-8.el9.noarch.rpm 888 kB/s | 689 kB 00:00 2024-09-12T02:20:14.789 INFO:teuthology.orchestra.run.smithi060.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 1.1 MB/s | 943 kB 00:00 2024-09-12T02:20:14.815 INFO:teuthology.orchestra.run.smithi060.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 280 kB/s | 33 kB 00:00 2024-09-12T02:20:14.857 INFO:teuthology.orchestra.run.smithi060.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 1.1 MB/s | 313 kB 00:00 2024-09-12T02:20:14.923 INFO:teuthology.orchestra.run.smithi060.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 168 kB/s | 18 kB 00:00 2024-09-12T02:20:14.965 INFO:teuthology.orchestra.run.smithi060.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 102 kB/s | 11 kB 00:00 2024-09-12T02:20:15.041 INFO:teuthology.orchestra.run.smithi060.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-09-12T02:20:15.074 INFO:teuthology.orchestra.run.smithi060.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 418 kB/s | 45 kB 00:00 2024-09-12T02:20:15.258 INFO:teuthology.orchestra.run.smithi060.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 3.0 MB/s | 662 kB 00:00 2024-09-12T02:20:15.375 INFO:teuthology.orchestra.run.smithi060.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 1.9 MB/s | 581 kB 00:00 2024-09-12T02:20:15.400 INFO:teuthology.orchestra.run.smithi060.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 172 kB/s | 24 kB 00:00 2024-09-12T02:20:15.431 INFO:teuthology.orchestra.run.smithi105.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T02:20:15.432 INFO:teuthology.orchestra.run.smithi105.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T02:20:15.443 INFO:teuthology.orchestra.run.smithi105.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T02:20:15.444 INFO:teuthology.orchestra.run.smithi105.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T02:20:15.445 INFO:teuthology.orchestra.run.smithi105.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T02:20:15.446 INFO:teuthology.orchestra.run.smithi105.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T02:20:15.447 INFO:teuthology.orchestra.run.smithi105.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T02:20:15.450 INFO:teuthology.orchestra.run.smithi105.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T02:20:15.451 INFO:teuthology.orchestra.run.smithi105.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T02:20:15.492 INFO:teuthology.orchestra.run.smithi060.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 406 kB/s | 47 kB 00:00 2024-09-12T02:20:15.513 INFO:teuthology.orchestra.run.smithi105.stdout:Dependencies resolved. 2024-09-12T02:20:15.517 INFO:teuthology.orchestra.run.smithi060.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-12T02:20:15.528 INFO:teuthology.orchestra.run.smithi105.stdout:====================================================================================== 2024-09-12T02:20:15.528 INFO:teuthology.orchestra.run.smithi105.stdout: Package Arch Version Repository Size 2024-09-12T02:20:15.529 INFO:teuthology.orchestra.run.smithi105.stdout:====================================================================================== 2024-09-12T02:20:15.529 INFO:teuthology.orchestra.run.smithi105.stdout:Installing: 2024-09-12T02:20:15.529 INFO:teuthology.orchestra.run.smithi105.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T02:20:15.529 INFO:teuthology.orchestra.run.smithi105.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T02:20:15.529 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T02:20:15.529 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T02:20:15.529 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T02:20:15.529 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T02:20:15.529 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T02:20:15.529 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T02:20:15.529 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T02:20:15.529 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T02:20:15.530 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T02:20:15.530 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T02:20:15.530 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T02:20:15.530 INFO:teuthology.orchestra.run.smithi105.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T02:20:15.530 INFO:teuthology.orchestra.run.smithi105.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T02:20:15.530 INFO:teuthology.orchestra.run.smithi105.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T02:20:15.530 INFO:teuthology.orchestra.run.smithi105.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T02:20:15.530 INFO:teuthology.orchestra.run.smithi105.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T02:20:15.530 INFO:teuthology.orchestra.run.smithi105.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T02:20:15.530 INFO:teuthology.orchestra.run.smithi105.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T02:20:15.530 INFO:teuthology.orchestra.run.smithi105.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T02:20:15.530 INFO:teuthology.orchestra.run.smithi105.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T02:20:15.530 INFO:teuthology.orchestra.run.smithi105.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T02:20:15.531 INFO:teuthology.orchestra.run.smithi105.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T02:20:15.531 INFO:teuthology.orchestra.run.smithi105.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T02:20:15.531 INFO:teuthology.orchestra.run.smithi105.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T02:20:15.531 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T02:20:15.531 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T02:20:15.531 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T02:20:15.531 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T02:20:15.531 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T02:20:15.531 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T02:20:15.531 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T02:20:15.531 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T02:20:15.531 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T02:20:15.531 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T02:20:15.532 INFO:teuthology.orchestra.run.smithi105.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T02:20:15.532 INFO:teuthology.orchestra.run.smithi105.stdout:Upgrading: 2024-09-12T02:20:15.532 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T02:20:15.532 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T02:20:15.532 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T02:20:15.532 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T02:20:15.532 INFO:teuthology.orchestra.run.smithi105.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T02:20:15.532 INFO:teuthology.orchestra.run.smithi105.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T02:20:15.532 INFO:teuthology.orchestra.run.smithi105.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T02:20:15.532 INFO:teuthology.orchestra.run.smithi105.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T02:20:15.532 INFO:teuthology.orchestra.run.smithi105.stdout:Installing dependencies: 2024-09-12T02:20:15.532 INFO:teuthology.orchestra.run.smithi105.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T02:20:15.532 INFO:teuthology.orchestra.run.smithi105.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T02:20:15.533 INFO:teuthology.orchestra.run.smithi105.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T02:20:15.533 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T02:20:15.533 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T02:20:15.533 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T02:20:15.533 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T02:20:15.533 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T02:20:15.533 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T02:20:15.533 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T02:20:15.533 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T02:20:15.533 INFO:teuthology.orchestra.run.smithi105.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T02:20:15.533 INFO:teuthology.orchestra.run.smithi105.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T02:20:15.533 INFO:teuthology.orchestra.run.smithi105.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T02:20:15.533 INFO:teuthology.orchestra.run.smithi105.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T02:20:15.534 INFO:teuthology.orchestra.run.smithi105.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T02:20:15.534 INFO:teuthology.orchestra.run.smithi105.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T02:20:15.534 INFO:teuthology.orchestra.run.smithi105.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T02:20:15.534 INFO:teuthology.orchestra.run.smithi105.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T02:20:15.534 INFO:teuthology.orchestra.run.smithi105.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T02:20:15.534 INFO:teuthology.orchestra.run.smithi105.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T02:20:15.534 INFO:teuthology.orchestra.run.smithi105.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T02:20:15.534 INFO:teuthology.orchestra.run.smithi105.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T02:20:15.534 INFO:teuthology.orchestra.run.smithi105.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T02:20:15.534 INFO:teuthology.orchestra.run.smithi105.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T02:20:15.534 INFO:teuthology.orchestra.run.smithi105.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T02:20:15.534 INFO:teuthology.orchestra.run.smithi105.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T02:20:15.534 INFO:teuthology.orchestra.run.smithi105.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T02:20:15.535 INFO:teuthology.orchestra.run.smithi105.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T02:20:15.535 INFO:teuthology.orchestra.run.smithi105.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T02:20:15.535 INFO:teuthology.orchestra.run.smithi105.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T02:20:15.535 INFO:teuthology.orchestra.run.smithi105.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T02:20:15.535 INFO:teuthology.orchestra.run.smithi105.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T02:20:15.535 INFO:teuthology.orchestra.run.smithi105.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T02:20:15.535 INFO:teuthology.orchestra.run.smithi105.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T02:20:15.535 INFO:teuthology.orchestra.run.smithi105.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T02:20:15.535 INFO:teuthology.orchestra.run.smithi105.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T02:20:15.535 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T02:20:15.535 INFO:teuthology.orchestra.run.smithi105.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T02:20:15.535 INFO:teuthology.orchestra.run.smithi105.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T02:20:15.535 INFO:teuthology.orchestra.run.smithi105.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T02:20:15.535 INFO:teuthology.orchestra.run.smithi105.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T02:20:15.536 INFO:teuthology.orchestra.run.smithi105.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T02:20:15.536 INFO:teuthology.orchestra.run.smithi105.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T02:20:15.536 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T02:20:15.536 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T02:20:15.536 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T02:20:15.536 INFO:teuthology.orchestra.run.smithi105.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T02:20:15.536 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T02:20:15.536 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T02:20:15.536 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T02:20:15.536 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T02:20:15.536 INFO:teuthology.orchestra.run.smithi105.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T02:20:15.536 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T02:20:15.537 INFO:teuthology.orchestra.run.smithi105.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T02:20:15.537 INFO:teuthology.orchestra.run.smithi105.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T02:20:15.537 INFO:teuthology.orchestra.run.smithi105.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T02:20:15.537 INFO:teuthology.orchestra.run.smithi105.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T02:20:15.537 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T02:20:15.537 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T02:20:15.537 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T02:20:15.537 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T02:20:15.537 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T02:20:15.537 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T02:20:15.538 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T02:20:15.538 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T02:20:15.538 INFO:teuthology.orchestra.run.smithi105.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T02:20:15.538 INFO:teuthology.orchestra.run.smithi105.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T02:20:15.538 INFO:teuthology.orchestra.run.smithi105.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T02:20:15.538 INFO:teuthology.orchestra.run.smithi105.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T02:20:15.538 INFO:teuthology.orchestra.run.smithi105.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T02:20:15.538 INFO:teuthology.orchestra.run.smithi105.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T02:20:15.538 INFO:teuthology.orchestra.run.smithi105.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T02:20:15.538 INFO:teuthology.orchestra.run.smithi105.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T02:20:15.538 INFO:teuthology.orchestra.run.smithi105.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T02:20:15.538 INFO:teuthology.orchestra.run.smithi105.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T02:20:15.539 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T02:20:15.539 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T02:20:15.539 INFO:teuthology.orchestra.run.smithi105.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T02:20:15.539 INFO:teuthology.orchestra.run.smithi105.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T02:20:15.539 INFO:teuthology.orchestra.run.smithi105.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T02:20:15.539 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T02:20:15.539 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T02:20:15.539 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T02:20:15.540 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T02:20:15.540 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T02:20:15.540 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T02:20:15.540 INFO:teuthology.orchestra.run.smithi105.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T02:20:15.540 INFO:teuthology.orchestra.run.smithi105.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T02:20:15.540 INFO:teuthology.orchestra.run.smithi105.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T02:20:15.540 INFO:teuthology.orchestra.run.smithi105.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T02:20:15.540 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T02:20:15.540 INFO:teuthology.orchestra.run.smithi105.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T02:20:15.540 INFO:teuthology.orchestra.run.smithi105.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T02:20:15.540 INFO:teuthology.orchestra.run.smithi105.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T02:20:15.540 INFO:teuthology.orchestra.run.smithi105.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T02:20:15.540 INFO:teuthology.orchestra.run.smithi105.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T02:20:15.540 INFO:teuthology.orchestra.run.smithi105.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T02:20:15.541 INFO:teuthology.orchestra.run.smithi105.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T02:20:15.541 INFO:teuthology.orchestra.run.smithi105.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T02:20:15.541 INFO:teuthology.orchestra.run.smithi105.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T02:20:15.541 INFO:teuthology.orchestra.run.smithi105.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T02:20:15.541 INFO:teuthology.orchestra.run.smithi105.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T02:20:15.541 INFO:teuthology.orchestra.run.smithi105.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T02:20:15.541 INFO:teuthology.orchestra.run.smithi105.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T02:20:15.541 INFO:teuthology.orchestra.run.smithi105.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T02:20:15.541 INFO:teuthology.orchestra.run.smithi105.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T02:20:15.541 INFO:teuthology.orchestra.run.smithi105.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T02:20:15.541 INFO:teuthology.orchestra.run.smithi105.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T02:20:15.541 INFO:teuthology.orchestra.run.smithi105.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T02:20:15.541 INFO:teuthology.orchestra.run.smithi105.stdout:Installing weak dependencies: 2024-09-12T02:20:15.542 INFO:teuthology.orchestra.run.smithi105.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T02:20:15.542 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:20:15.542 INFO:teuthology.orchestra.run.smithi105.stdout:Transaction Summary 2024-09-12T02:20:15.542 INFO:teuthology.orchestra.run.smithi105.stdout:====================================================================================== 2024-09-12T02:20:15.542 INFO:teuthology.orchestra.run.smithi105.stdout:Install 148 Packages 2024-09-12T02:20:15.542 INFO:teuthology.orchestra.run.smithi105.stdout:Upgrade 8 Packages 2024-09-12T02:20:15.542 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:20:15.542 INFO:teuthology.orchestra.run.smithi105.stdout:Total download size: 226 M 2024-09-12T02:20:15.543 INFO:teuthology.orchestra.run.smithi105.stdout:Downloading Packages: 2024-09-12T02:20:15.609 INFO:teuthology.orchestra.run.smithi060.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-12T02:20:15.626 INFO:teuthology.orchestra.run.smithi060.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 355 kB/s | 38 kB 00:00 2024-09-12T02:20:16.056 INFO:teuthology.orchestra.run.smithi105.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 47 kB/s | 6.5 kB 00:00 2024-09-12T02:20:16.241 INFO:teuthology.orchestra.run.smithi060.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.1 MB/s | 3.0 MB 00:01 2024-09-12T02:20:16.272 INFO:teuthology.orchestra.run.smithi105.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 4.0 MB/s | 897 kB 00:00 2024-09-12T02:20:16.348 INFO:teuthology.orchestra.run.smithi105.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 1.9 MB/s | 145 kB 00:00 2024-09-12T02:20:16.681 INFO:teuthology.orchestra.run.smithi105.stdout:(4/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 7.1 MB/s | 5.4 MB 00:00 2024-09-12T02:20:16.732 INFO:teuthology.orchestra.run.smithi105.stdout:(5/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 6.2 MB/s | 2.4 MB 00:00 2024-09-12T02:20:16.799 INFO:teuthology.orchestra.run.smithi105.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 13 MB/s | 1.5 MB 00:00 2024-09-12T02:20:16.999 INFO:teuthology.orchestra.run.smithi105.stdout:(7/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 20 MB/s | 21 MB 00:01 2024-09-12T02:20:17.107 INFO:teuthology.orchestra.run.smithi105.stdout:(8/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 13 MB/s | 4.7 MB 00:00 2024-09-12T02:20:17.158 INFO:teuthology.orchestra.run.smithi105.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 504 kB/s | 25 kB 00:00 2024-09-12T02:20:17.385 INFO:teuthology.orchestra.run.smithi060.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 2.8 MB/s | 4.9 MB 00:01 2024-09-12T02:20:17.491 INFO:teuthology.orchestra.run.smithi105.stdout:(10/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 22 MB/s | 11 MB 00:00 2024-09-12T02:20:17.550 INFO:teuthology.orchestra.run.smithi105.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 3.8 MB/s | 228 kB 00:00 2024-09-12T02:20:17.742 INFO:teuthology.orchestra.run.smithi105.stdout:(12/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 18 MB/s | 17 MB 00:00 2024-09-12T02:20:17.767 INFO:teuthology.orchestra.run.smithi105.stdout:(13/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 124 kB/s | 27 kB 00:00 2024-09-12T02:20:17.792 INFO:teuthology.orchestra.run.smithi105.stdout:(14/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 633 kB/s | 32 kB 00:00 2024-09-12T02:20:17.834 INFO:teuthology.orchestra.run.smithi105.stdout:(15/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 11 MB/s | 752 kB 00:00 2024-09-12T02:20:17.860 INFO:teuthology.orchestra.run.smithi105.stdout:(16/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.4 MB/s | 163 kB 00:00 2024-09-12T02:20:17.885 INFO:teuthology.orchestra.run.smithi105.stdout:(17/156): librados-devel-19.1.1-298.gb53b6d3e.e 2.4 MB/s | 127 kB 00:00 2024-09-12T02:20:17.919 INFO:teuthology.orchestra.run.smithi105.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 8.4 MB/s | 506 kB 00:00 2024-09-12T02:20:17.986 INFO:teuthology.orchestra.run.smithi105.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 677 kB/s | 45 kB 00:00 2024-09-12T02:20:18.053 INFO:teuthology.orchestra.run.smithi105.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 2.0 MB/s | 136 kB 00:00 2024-09-12T02:20:18.128 INFO:teuthology.orchestra.run.smithi105.stdout:(21/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 22 MB/s | 5.3 MB 00:00 2024-09-12T02:20:18.153 INFO:teuthology.orchestra.run.smithi105.stdout:(22/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 1.6 MB/s | 162 kB 00:00 2024-09-12T02:20:18.178 INFO:teuthology.orchestra.run.smithi105.stdout:(23/156): python3-rados-19.1.1-298.gb53b6d3e.el 6.3 MB/s | 321 kB 00:00 2024-09-12T02:20:18.204 INFO:teuthology.orchestra.run.smithi105.stdout:(24/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 5.9 MB/s | 301 kB 00:00 2024-09-12T02:20:18.227 INFO:teuthology.orchestra.run.smithi060.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 1.7 MB/s | 4.4 MB 00:02 2024-09-12T02:20:18.229 INFO:teuthology.orchestra.run.smithi105.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.9 MB/s | 100 kB 00:00 2024-09-12T02:20:18.254 INFO:teuthology.orchestra.run.smithi105.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-12T02:20:18.321 INFO:teuthology.orchestra.run.smithi105.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 2.5 MB/s | 171 kB 00:00 2024-09-12T02:20:18.388 INFO:teuthology.orchestra.run.smithi105.stdout:(28/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 20 MB/s | 3.1 MB 00:00 2024-09-12T02:20:18.422 INFO:teuthology.orchestra.run.smithi105.stdout:(29/156): ceph-grafana-dashboards-19.1.1-298.gb 317 kB/s | 32 kB 00:00 2024-09-12T02:20:18.472 INFO:teuthology.orchestra.run.smithi105.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 1.7 MB/s | 146 kB 00:00 2024-09-12T02:20:18.527 INFO:teuthology.orchestra.run.smithi060.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 458 kB/s | 137 kB 00:00 2024-09-12T02:20:18.602 INFO:teuthology.orchestra.run.smithi060.stdout:(70/156): postgresql-13.16-1.el9.x86_64.rpm 688 kB/s | 1.6 MB 00:02 2024-09-12T02:20:18.614 INFO:teuthology.orchestra.run.smithi105.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 19 MB/s | 3.6 MB 00:00 2024-09-12T02:20:18.673 INFO:teuthology.orchestra.run.smithi105.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 4.2 MB/s | 249 kB 00:00 2024-09-12T02:20:18.731 INFO:teuthology.orchestra.run.smithi105.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 848 kB/s | 49 kB 00:00 2024-09-12T02:20:18.736 INFO:teuthology.orchestra.run.smithi060.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 674 kB/s | 910 kB 00:01 2024-09-12T02:20:18.816 INFO:teuthology.orchestra.run.smithi105.stdout:(34/156): ceph-mgr-diskprediction-local-19.1.1- 22 MB/s | 7.4 MB 00:00 2024-09-12T02:20:18.840 INFO:teuthology.orchestra.run.smithi105.stdout:(35/156): ceph-prometheus-alerts-19.1.1-298.gb5 151 kB/s | 16 kB 00:00 2024-09-12T02:20:18.874 INFO:teuthology.orchestra.run.smithi105.stdout:(36/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 4.8 MB/s | 285 kB 00:00 2024-09-12T02:20:18.916 INFO:teuthology.orchestra.run.smithi105.stdout:(37/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 10 MB/s | 765 kB 00:00 2024-09-12T02:20:18.936 INFO:teuthology.orchestra.run.smithi060.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 438 kB/s | 87 kB 00:00 2024-09-12T02:20:18.941 INFO:teuthology.orchestra.run.smithi105.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 273 kB/s | 18 kB 00:00 2024-09-12T02:20:19.808 INFO:teuthology.orchestra.run.smithi105.stdout:(39/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 18 MB/s | 49 MB 00:02 2024-09-12T02:20:19.833 INFO:teuthology.orchestra.run.smithi105.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 87 kB/s | 80 kB 00:00 2024-09-12T02:20:20.120 INFO:teuthology.orchestra.run.smithi060.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 681 kB/s | 1.0 MB 00:01 2024-09-12T02:20:20.231 INFO:teuthology.orchestra.run.smithi060.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 567 kB/s | 61 kB 00:00 2024-09-12T02:20:20.604 INFO:teuthology.orchestra.run.smithi060.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 653 kB/s | 245 kB 00:00 2024-09-12T02:20:20.617 INFO:teuthology.orchestra.run.smithi105.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 236 kB/s | 191 kB 00:00 2024-09-12T02:20:20.725 INFO:teuthology.orchestra.run.smithi105.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 284 kB/s | 253 kB 00:00 2024-09-12T02:20:20.967 INFO:teuthology.orchestra.run.smithi105.stdout:(43/156): libgfortran-11.5.0-2.el9.x86_64.rpm 395 kB/s | 801 kB 00:02 2024-09-12T02:20:20.979 INFO:teuthology.orchestra.run.smithi060.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 662 kB/s | 248 kB 00:00 2024-09-12T02:20:21.087 INFO:teuthology.orchestra.run.smithi060.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 237 kB/s | 26 kB 00:00 2024-09-12T02:20:21.196 INFO:teuthology.orchestra.run.smithi060.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 177 kB/s | 19 kB 00:00 2024-09-12T02:20:21.488 INFO:teuthology.orchestra.run.smithi060.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 591 kB/s | 172 kB 00:00 2024-09-12T02:20:21.492 INFO:teuthology.orchestra.run.smithi105.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 139 kB/s | 106 kB 00:00 2024-09-12T02:20:21.605 INFO:teuthology.orchestra.run.smithi060.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 298 kB/s | 35 kB 00:00 2024-09-12T02:20:21.668 INFO:teuthology.orchestra.run.smithi105.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 195 kB/s | 135 kB 00:00 2024-09-12T02:20:21.710 INFO:teuthology.orchestra.run.smithi105.stdout:(46/156): python3-cryptography-36.0.1-4.el9.x86 1.1 MB/s | 1.2 MB 00:01 2024-09-12T02:20:21.885 INFO:teuthology.orchestra.run.smithi105.stdout:(47/156): automake-1.16.2-8.el9.noarch.rpm 4.0 MB/s | 689 kB 00:00 2024-09-12T02:20:21.952 INFO:teuthology.orchestra.run.smithi105.stdout:(48/156): bison-3.7.4-5.el9.x86_64.rpm 14 MB/s | 943 kB 00:00 2024-09-12T02:20:21.994 INFO:teuthology.orchestra.run.smithi105.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 107 kB 00:00 2024-09-12T02:20:22.036 INFO:teuthology.orchestra.run.smithi105.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 528 kB/s | 22 kB 00:00 2024-09-12T02:20:22.078 INFO:teuthology.orchestra.run.smithi105.stdout:(51/156): flex-2.6.4-9.el9.x86_64.rpm 7.4 MB/s | 313 kB 00:00 2024-09-12T02:20:22.120 INFO:teuthology.orchestra.run.smithi105.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 789 kB/s | 33 kB 00:00 2024-09-12T02:20:22.212 INFO:teuthology.orchestra.run.smithi105.stdout:(53/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 33 MB/s | 3.0 MB 00:00 2024-09-12T02:20:22.237 INFO:teuthology.orchestra.run.smithi105.stdout:(54/156): python3-requests-2.25.1-8.el9.noarch. 168 kB/s | 125 kB 00:00 2024-09-12T02:20:22.262 INFO:teuthology.orchestra.run.smithi105.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 364 kB/s | 18 kB 00:00 2024-09-12T02:20:22.329 INFO:teuthology.orchestra.run.smithi105.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 121 kB/s | 11 kB 00:00 2024-09-12T02:20:22.354 INFO:teuthology.orchestra.run.smithi105.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-09-12T02:20:22.388 INFO:teuthology.orchestra.run.smithi105.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 774 kB/s | 45 kB 00:00 2024-09-12T02:20:22.422 INFO:teuthology.orchestra.run.smithi105.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-09-12T02:20:22.464 INFO:teuthology.orchestra.run.smithi105.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 590 kB/s | 24 kB 00:00 2024-09-12T02:20:22.489 INFO:teuthology.orchestra.run.smithi105.stdout:(61/156): python3-urllib3-1.26.5-6.el9.noarch.r 262 kB/s | 215 kB 00:00 2024-09-12T02:20:22.514 INFO:teuthology.orchestra.run.smithi105.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-09-12T02:20:22.548 INFO:teuthology.orchestra.run.smithi105.stdout:(63/156): libtool-2.4.6-46.el9.x86_64.rpm 3.6 MB/s | 581 kB 00:00 2024-09-12T02:20:22.573 INFO:teuthology.orchestra.run.smithi105.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-09-12T02:20:22.598 INFO:teuthology.orchestra.run.smithi105.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 768 kB/s | 38 kB 00:00 2024-09-12T02:20:22.690 INFO:teuthology.orchestra.run.smithi105.stdout:(66/156): openblas-openmp-0.3.26-2.el9.x86_64.r 42 MB/s | 4.9 MB 00:00 2024-09-12T02:20:22.716 INFO:teuthology.orchestra.run.smithi105.stdout:(67/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.3 MB/s | 292 kB 00:00 2024-09-12T02:20:22.766 INFO:teuthology.orchestra.run.smithi105.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-12T02:20:22.833 INFO:teuthology.orchestra.run.smithi105.stdout:(69/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 19 MB/s | 4.4 MB 00:00 2024-09-12T02:20:22.858 INFO:teuthology.orchestra.run.smithi105.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.5 MB/s | 137 kB 00:00 2024-09-12T02:20:22.900 INFO:teuthology.orchestra.run.smithi105.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 4.8 MB/s | 910 kB 00:00 2024-09-12T02:20:22.933 INFO:teuthology.orchestra.run.smithi105.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-09-12T02:20:22.950 INFO:teuthology.orchestra.run.smithi105.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-09-12T02:20:22.984 INFO:teuthology.orchestra.run.smithi105.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.8 MB/s | 61 kB 00:00 2024-09-12T02:20:23.059 INFO:teuthology.orchestra.run.smithi105.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 26 MB/s | 5.8 MB 00:00 2024-09-12T02:20:23.085 INFO:teuthology.orchestra.run.smithi105.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-12T02:20:23.118 INFO:teuthology.orchestra.run.smithi105.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.1 MB/s | 248 kB 00:00 2024-09-12T02:20:23.144 INFO:teuthology.orchestra.run.smithi105.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 437 kB/s | 26 kB 00:00 2024-09-12T02:20:23.169 INFO:teuthology.orchestra.run.smithi105.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-09-12T02:20:23.195 INFO:teuthology.orchestra.run.smithi105.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-12T02:20:23.219 INFO:teuthology.orchestra.run.smithi105.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 692 kB/s | 35 kB 00:00 2024-09-12T02:20:23.295 INFO:teuthology.orchestra.run.smithi105.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-09-12T02:20:23.320 INFO:teuthology.orchestra.run.smithi105.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-09-12T02:20:23.345 INFO:teuthology.orchestra.run.smithi105.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-12T02:20:23.371 INFO:teuthology.orchestra.run.smithi105.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-12T02:20:23.396 INFO:teuthology.orchestra.run.smithi105.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 842 kB/s | 42 kB 00:00 2024-09-12T02:20:23.421 INFO:teuthology.orchestra.run.smithi105.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-12T02:20:23.446 INFO:teuthology.orchestra.run.smithi105.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-12T02:20:23.472 INFO:teuthology.orchestra.run.smithi105.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-12T02:20:23.497 INFO:teuthology.orchestra.run.smithi105.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-12T02:20:23.522 INFO:teuthology.orchestra.run.smithi105.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-12T02:20:23.598 INFO:teuthology.orchestra.run.smithi105.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 5.1 MB 00:00 2024-09-12T02:20:23.623 INFO:teuthology.orchestra.run.smithi105.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 415 kB/s | 42 kB 00:00 2024-09-12T02:20:23.648 INFO:teuthology.orchestra.run.smithi105.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 884 kB/s | 44 kB 00:00 2024-09-12T02:20:23.674 INFO:teuthology.orchestra.run.smithi105.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-12T02:20:23.699 INFO:teuthology.orchestra.run.smithi105.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 715 kB/s | 36 kB 00:00 2024-09-12T02:20:23.724 INFO:teuthology.orchestra.run.smithi105.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-12T02:20:23.749 INFO:teuthology.orchestra.run.smithi105.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-12T02:20:23.775 INFO:teuthology.orchestra.run.smithi105.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-12T02:20:23.800 INFO:teuthology.orchestra.run.smithi105.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-12T02:20:23.825 INFO:teuthology.orchestra.run.smithi105.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-12T02:20:23.850 INFO:teuthology.orchestra.run.smithi105.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 893 kB/s | 45 kB 00:00 2024-09-12T02:20:24.076 INFO:teuthology.orchestra.run.smithi105.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 28 MB/s | 16 MB 00:00 2024-09-12T02:20:24.101 INFO:teuthology.orchestra.run.smithi105.stdout:(104/156): lua-devel-5.4.4-4.el9.x86_64.rpm 81 kB/s | 22 kB 00:00 2024-09-12T02:20:24.151 INFO:teuthology.orchestra.run.smithi105.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 7.2 MB/s | 548 kB 00:00 2024-09-12T02:20:24.185 INFO:teuthology.orchestra.run.smithi105.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 578 kB/s | 19 kB 00:00 2024-09-12T02:20:24.219 INFO:teuthology.orchestra.run.smithi105.stdout:(107/156): gperftools-libs-2.9.1-2.el9.x86_64.r 2.6 MB/s | 309 kB 00:00 2024-09-12T02:20:24.244 INFO:teuthology.orchestra.run.smithi105.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T02:20:24.269 INFO:teuthology.orchestra.run.smithi105.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T02:20:24.294 INFO:teuthology.orchestra.run.smithi105.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-12T02:20:24.328 INFO:teuthology.orchestra.run.smithi105.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-09-12T02:20:24.378 INFO:teuthology.orchestra.run.smithi105.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-12T02:20:24.420 INFO:teuthology.orchestra.run.smithi105.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-12T02:20:24.445 INFO:teuthology.orchestra.run.smithi105.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-12T02:20:24.471 INFO:teuthology.orchestra.run.smithi105.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-12T02:20:24.496 INFO:teuthology.orchestra.run.smithi105.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 571 kB/s | 14 kB 00:00 2024-09-12T02:20:24.563 INFO:teuthology.orchestra.run.smithi105.stdout:(117/156): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-12T02:20:24.597 INFO:teuthology.orchestra.run.smithi105.stdout:(118/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.1 MB/s | 863 kB 00:00 2024-09-12T02:20:24.622 INFO:teuthology.orchestra.run.smithi105.stdout:(119/156): python3-cheroot-8.6.0-4.el9.noarch.r 1.3 MB/s | 172 kB 00:00 2024-09-12T02:20:24.656 INFO:teuthology.orchestra.run.smithi105.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-09-12T02:20:24.681 INFO:teuthology.orchestra.run.smithi105.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.2 MB/s | 220 kB 00:00 2024-09-12T02:20:24.714 INFO:teuthology.orchestra.run.smithi105.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-12T02:20:24.739 INFO:teuthology.orchestra.run.smithi105.stdout:(123/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.1 MB/s | 303 kB 00:00 2024-09-12T02:20:24.765 INFO:teuthology.orchestra.run.smithi105.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 212 kB/s | 11 kB 00:00 2024-09-12T02:20:24.790 INFO:teuthology.orchestra.run.smithi105.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 351 kB/s | 18 kB 00:00 2024-09-12T02:20:24.816 INFO:teuthology.orchestra.run.smithi105.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-09-12T02:20:24.841 INFO:teuthology.orchestra.run.smithi105.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-12T02:20:24.866 INFO:teuthology.orchestra.run.smithi105.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-12T02:20:24.891 INFO:teuthology.orchestra.run.smithi105.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T02:20:24.917 INFO:teuthology.orchestra.run.smithi105.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T02:20:24.942 INFO:teuthology.orchestra.run.smithi105.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T02:20:24.975 INFO:teuthology.orchestra.run.smithi105.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-12T02:20:25.001 INFO:teuthology.orchestra.run.smithi105.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 657 kB/s | 16 kB 00:00 2024-09-12T02:20:25.026 INFO:teuthology.orchestra.run.smithi105.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.6 MB/s | 90 kB 00:00 2024-09-12T02:20:25.051 INFO:teuthology.orchestra.run.smithi105.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-12T02:20:25.085 INFO:teuthology.orchestra.run.smithi105.stdout:(136/156): python3-kubernetes-26.1.0-2.el9.noar 4.2 MB/s | 1.0 MB 00:00 2024-09-12T02:20:25.110 INFO:teuthology.orchestra.run.smithi105.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 523 kB/s | 31 kB 00:00 2024-09-12T02:20:25.152 INFO:teuthology.orchestra.run.smithi105.stdout:(138/156): python3-grpcio-1.46.7-10.el9.x86_64. 4.1 MB/s | 2.0 MB 00:00 2024-09-12T02:20:25.178 INFO:teuthology.orchestra.run.smithi105.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 883 kB/s | 59 kB 00:00 2024-09-12T02:20:25.219 INFO:teuthology.orchestra.run.smithi105.stdout:(140/156): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-09-12T02:20:25.245 INFO:teuthology.orchestra.run.smithi105.stdout:(141/156): python3-tempora-5.0.0-2.el9.noarch.r 536 kB/s | 36 kB 00:00 2024-09-12T02:20:25.270 INFO:teuthology.orchestra.run.smithi105.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 809 kB/s | 74 kB 00:00 2024-09-12T02:20:25.295 INFO:teuthology.orchestra.run.smithi105.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-12T02:20:25.321 INFO:teuthology.orchestra.run.smithi105.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-12T02:20:25.346 INFO:teuthology.orchestra.run.smithi105.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-09-12T02:20:25.371 INFO:teuthology.orchestra.run.smithi105.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T02:20:25.396 INFO:teuthology.orchestra.run.smithi105.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-12T02:20:25.438 INFO:teuthology.orchestra.run.smithi105.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-12T02:20:25.647 INFO:teuthology.orchestra.run.smithi105.stdout:(149/156): librados2-19.1.1-298.gb53b6d3e.el9.x 12 MB/s | 3.4 MB 00:00 2024-09-12T02:20:25.698 INFO:teuthology.orchestra.run.smithi105.stdout:(150/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 10 MB/s | 3.2 MB 00:00 2024-09-12T02:20:26.314 INFO:teuthology.orchestra.run.smithi105.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 67 kB/s | 41 kB 00:00 2024-09-12T02:20:27.041 INFO:teuthology.orchestra.run.smithi060.stdout:(81/156): postgresql-server-13.16-1.el9.x86_64. 695 kB/s | 5.8 MB 00:08 2024-09-12T02:20:27.147 INFO:teuthology.orchestra.run.smithi105.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 299 kB/s | 249 kB 00:00 2024-09-12T02:20:27.413 INFO:teuthology.orchestra.run.smithi060.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 672 kB/s | 250 kB 00:00 2024-09-12T02:20:27.580 INFO:teuthology.orchestra.run.smithi060.stdout:(83/156): python3-babel-2.9.1-2.el9.noarch.rpm 706 kB/s | 6.0 MB 00:08 2024-09-12T02:20:27.706 INFO:teuthology.orchestra.run.smithi060.stdout:(84/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 856 kB/s | 5.1 MB 00:06 2024-09-12T02:20:27.814 INFO:teuthology.orchestra.run.smithi060.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 330 kB/s | 77 kB 00:00 2024-09-12T02:20:27.839 INFO:teuthology.orchestra.run.smithi060.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 317 kB/s | 42 kB 00:00 2024-09-12T02:20:27.873 INFO:teuthology.orchestra.run.smithi060.stdout:(87/156): python3-oauthlib-3.1.1-5.el9.noarch.r 484 kB/s | 222 kB 00:00 2024-09-12T02:20:28.123 INFO:teuthology.orchestra.run.smithi060.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 560 kB/s | 159 kB 00:00 2024-09-12T02:20:28.240 INFO:teuthology.orchestra.run.smithi060.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 437 kB/s | 51 kB 00:00 2024-09-12T02:20:28.274 INFO:teuthology.orchestra.run.smithi060.stdout:(90/156): python3-protobuf-3.14.0-13.el9.noarch 586 kB/s | 269 kB 00:00 2024-09-12T02:20:28.323 INFO:teuthology.orchestra.run.smithi105.stdout:(153/156): NetworkManager-libnm-1.49.90-1.el9.x 691 kB/s | 1.8 MB 00:02 2024-09-12T02:20:28.357 INFO:teuthology.orchestra.run.smithi060.stdout:(91/156): python3-pyasn1-modules-0.4.8-6.el9.no 576 kB/s | 279 kB 00:00 2024-09-12T02:20:28.383 INFO:teuthology.orchestra.run.smithi060.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 378 kB/s | 54 kB 00:00 2024-09-12T02:20:28.419 INFO:teuthology.orchestra.run.smithi105.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 1.1 MB/s | 1.4 MB 00:01 2024-09-12T02:20:28.475 INFO:teuthology.orchestra.run.smithi060.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 356 kB/s | 42 kB 00:00 2024-09-12T02:20:28.500 INFO:teuthology.orchestra.run.smithi060.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 378 kB/s | 44 kB 00:00 2024-09-12T02:20:28.531 INFO:teuthology.orchestra.run.smithi105.stdout:(155/156): NetworkManager-1.49.90-1.el9.x86_64. 768 kB/s | 2.3 MB 00:03 2024-09-12T02:20:28.608 INFO:teuthology.orchestra.run.smithi060.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 331 kB/s | 36 kB 00:00 2024-09-12T02:20:28.717 INFO:teuthology.orchestra.run.smithi060.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 438 kB/s | 47 kB 00:00 2024-09-12T02:20:28.851 INFO:teuthology.orchestra.run.smithi060.stdout:(97/156): qatlib-24.02.0-1.el9.x86_64.rpm 588 kB/s | 221 kB 00:00 2024-09-12T02:20:28.959 INFO:teuthology.orchestra.run.smithi060.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 533 kB/s | 58 kB 00:00 2024-09-12T02:20:29.160 INFO:teuthology.orchestra.run.smithi060.stdout:(99/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 479 kB/s | 96 kB 00:00 2024-09-12T02:20:29.185 INFO:teuthology.orchestra.run.smithi060.stdout:(100/156): socat-1.7.4.1-6.el9.x86_64.rpm 651 kB/s | 304 kB 00:00 2024-09-12T02:20:29.285 INFO:teuthology.orchestra.run.smithi060.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 448 kB/s | 45 kB 00:00 2024-09-12T02:20:29.360 INFO:teuthology.orchestra.run.smithi060.stdout:(102/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 317 kB/s | 64 kB 00:00 2024-09-12T02:20:29.386 INFO:teuthology.orchestra.run.smithi060.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 221 kB/s | 22 kB 00:00 2024-09-12T02:20:29.436 INFO:teuthology.orchestra.run.smithi060.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-12T02:20:29.461 INFO:teuthology.orchestra.run.smithi060.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 12 MB/s | 309 kB 00:00 2024-09-12T02:20:29.487 INFO:teuthology.orchestra.run.smithi060.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 775 kB/s | 19 kB 00:00 2024-09-12T02:20:29.537 INFO:teuthology.orchestra.run.smithi060.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 4.8 MB/s | 863 kB 00:00 2024-09-12T02:20:29.573 INFO:teuthology.orchestra.run.smithi105.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 1.9 MB/s | 2.4 MB 00:01 2024-09-12T02:20:29.579 INFO:teuthology.orchestra.run.smithi060.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 624 kB/s | 26 kB 00:00 2024-09-12T02:20:29.580 INFO:teuthology.orchestra.run.smithi105.stdout:-------------------------------------------------------------------------------- 2024-09-12T02:20:29.580 INFO:teuthology.orchestra.run.smithi105.stdout:Total 16 MB/s | 226 MB 00:14 2024-09-12T02:20:29.604 INFO:teuthology.orchestra.run.smithi060.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T02:20:29.629 INFO:teuthology.orchestra.run.smithi060.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-12T02:20:29.713 INFO:teuthology.orchestra.run.smithi060.stdout:(111/156): libarrow-9.0.0-11.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2024-09-12T02:20:29.738 INFO:teuthology.orchestra.run.smithi060.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 1.4 MB/s | 151 kB 00:00 2024-09-12T02:20:29.772 INFO:teuthology.orchestra.run.smithi060.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-12T02:20:29.806 INFO:teuthology.orchestra.run.smithi060.stdout:(114/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-09-12T02:20:29.822 INFO:teuthology.orchestra.run.smithi060.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 868 kB/s | 43 kB 00:00 2024-09-12T02:20:29.840 INFO:teuthology.orchestra.run.smithi060.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 963 kB/s | 32 kB 00:00 2024-09-12T02:20:29.865 INFO:teuthology.orchestra.run.smithi060.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 336 kB/s | 14 kB 00:00 2024-09-12T02:20:29.890 INFO:teuthology.orchestra.run.smithi060.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-12T02:20:29.915 INFO:teuthology.orchestra.run.smithi060.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-12T02:20:29.940 INFO:teuthology.orchestra.run.smithi060.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-12T02:20:29.966 INFO:teuthology.orchestra.run.smithi060.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-12T02:20:29.999 INFO:teuthology.orchestra.run.smithi060.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-12T02:20:30.025 INFO:teuthology.orchestra.run.smithi060.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 427 kB/s | 11 kB 00:00 2024-09-12T02:20:30.050 INFO:teuthology.orchestra.run.smithi060.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 706 kB/s | 18 kB 00:00 2024-09-12T02:20:30.075 INFO:teuthology.orchestra.run.smithi060.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 925 kB/s | 23 kB 00:00 2024-09-12T02:20:30.100 INFO:teuthology.orchestra.run.smithi060.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 775 kB/s | 19 kB 00:00 2024-09-12T02:20:30.126 INFO:teuthology.orchestra.run.smithi060.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 786 kB/s | 20 kB 00:00 2024-09-12T02:20:30.176 INFO:teuthology.orchestra.run.smithi060.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 8.7 MB/s | 2.0 MB 00:00 2024-09-12T02:20:30.201 INFO:teuthology.orchestra.run.smithi060.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T02:20:30.227 INFO:teuthology.orchestra.run.smithi060.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T02:20:30.252 INFO:teuthology.orchestra.run.smithi060.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.2 MB/s | 58 kB 00:00 2024-09-12T02:20:30.286 INFO:teuthology.orchestra.run.smithi060.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 6.4 MB/s | 1.0 MB 00:00 2024-09-12T02:20:30.311 INFO:teuthology.orchestra.run.smithi060.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 657 kB/s | 16 kB 00:00 2024-09-12T02:20:30.336 INFO:teuthology.orchestra.run.smithi060.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-12T02:20:30.362 INFO:teuthology.orchestra.run.smithi060.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-12T02:20:30.387 INFO:teuthology.orchestra.run.smithi060.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 561 kB/s | 28 kB 00:00 2024-09-12T02:20:30.412 INFO:teuthology.orchestra.run.smithi060.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-12T02:20:30.437 INFO:teuthology.orchestra.run.smithi060.stdout:(138/156): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-09-12T02:20:30.463 INFO:teuthology.orchestra.run.smithi060.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-12T02:20:30.488 INFO:teuthology.orchestra.run.smithi060.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-12T02:20:30.513 INFO:teuthology.orchestra.run.smithi060.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-12T02:20:30.538 INFO:teuthology.orchestra.run.smithi060.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-12T02:20:30.564 INFO:teuthology.orchestra.run.smithi060.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-12T02:20:30.589 INFO:teuthology.orchestra.run.smithi060.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 797 kB/s | 20 kB 00:00 2024-09-12T02:20:30.622 INFO:teuthology.orchestra.run.smithi060.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-09-12T02:20:30.648 INFO:teuthology.orchestra.run.smithi060.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-12T02:20:30.698 INFO:teuthology.orchestra.run.smithi060.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-12T02:20:30.759 INFO:teuthology.orchestra.run.smithi105.stdout:Running transaction check 2024-09-12T02:20:30.910 INFO:teuthology.orchestra.run.smithi105.stdout:Transaction check succeeded. 2024-09-12T02:20:30.910 INFO:teuthology.orchestra.run.smithi105.stdout:Running transaction test 2024-09-12T02:20:30.932 INFO:teuthology.orchestra.run.smithi060.stdout:(148/156): librados2-19.1.1-298.gb53b6d3e.el9.x 12 MB/s | 3.4 MB 00:00 2024-09-12T02:20:30.990 INFO:teuthology.orchestra.run.smithi060.stdout:(149/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 11 MB/s | 3.2 MB 00:00 2024-09-12T02:20:31.057 INFO:teuthology.orchestra.run.smithi060.stdout:(150/156): NetworkManager-1.49.90-1.el9.x86_64. 19 MB/s | 2.3 MB 00:00 2024-09-12T02:20:31.091 INFO:teuthology.orchestra.run.smithi060.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 1.2 MB/s | 41 kB 00:00 2024-09-12T02:20:31.141 INFO:teuthology.orchestra.run.smithi060.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 4.9 MB/s | 249 kB 00:00 2024-09-12T02:20:31.208 INFO:teuthology.orchestra.run.smithi060.stdout:(153/156): openssl-3.2.2-6.el9.x86_64.rpm 20 MB/s | 1.4 MB 00:00 2024-09-12T02:20:31.250 INFO:teuthology.orchestra.run.smithi060.stdout:(154/156): NetworkManager-libnm-1.49.90-1.el9.x 7.0 MB/s | 1.8 MB 00:00 2024-09-12T02:20:31.300 INFO:teuthology.orchestra.run.smithi060.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 26 MB/s | 2.4 MB 00:00 2024-09-12T02:20:33.131 INFO:teuthology.orchestra.run.smithi105.stdout:Transaction test succeeded. 2024-09-12T02:20:33.132 INFO:teuthology.orchestra.run.smithi105.stdout:Running transaction 2024-09-12T02:20:39.401 INFO:teuthology.orchestra.run.smithi105.stdout: Preparing : 1/1 2024-09-12T02:20:39.511 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T02:20:39.550 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T02:20:39.605 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T02:20:39.647 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T02:20:39.672 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T02:20:39.740 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T02:20:40.214 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T02:20:40.331 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:20:40.455 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:20:40.482 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:20:40.574 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:20:40.603 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T02:20:40.771 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T02:20:40.825 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T02:20:40.853 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:20:40.966 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:20:40.996 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T02:20:41.064 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T02:20:41.088 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T02:20:41.116 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T02:20:41.307 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T02:20:41.470 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T02:20:41.606 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T02:20:41.728 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:20:41.796 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:20:42.032 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:20:42.144 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T02:20:42.229 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T02:20:42.260 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T02:20:42.294 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T02:20:42.358 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T02:20:42.403 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T02:20:42.435 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T02:20:42.479 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T02:20:42.512 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T02:20:42.540 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T02:20:42.616 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T02:20:42.670 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T02:20:42.702 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T02:20:42.745 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T02:20:42.820 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T02:20:42.855 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T02:20:42.899 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T02:20:42.927 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T02:20:42.989 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T02:20:43.042 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T02:20:43.116 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T02:20:43.257 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T02:20:43.311 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T02:20:43.832 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T02:20:43.915 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T02:20:43.944 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T02:20:43.987 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T02:20:44.033 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T02:20:44.075 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T02:20:44.233 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T02:20:44.287 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T02:20:44.341 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T02:20:44.413 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T02:20:44.446 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T02:20:44.482 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T02:20:44.529 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T02:20:44.565 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T02:20:44.608 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T02:20:44.650 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T02:20:44.784 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T02:20:44.827 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T02:20:44.869 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T02:20:44.970 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T02:20:45.002 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T02:20:45.043 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T02:20:45.068 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-12T02:20:45.093 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T02:20:45.188 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T02:20:45.318 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T02:20:45.511 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T02:20:45.545 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T02:20:45.588 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T02:20:45.630 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T02:20:45.670 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T02:20:45.699 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T02:20:45.734 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T02:20:45.767 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T02:20:45.809 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T02:20:45.843 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T02:20:45.922 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T02:20:45.973 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T02:20:46.004 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T02:20:46.107 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T02:20:46.156 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T02:20:46.872 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T02:20:46.919 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T02:20:46.953 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T02:20:47.054 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T02:20:47.100 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T02:20:47.145 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T02:20:47.232 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T02:20:47.281 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T02:20:47.463 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T02:20:47.495 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T02:20:47.573 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T02:20:48.240 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T02:20:48.360 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T02:20:49.603 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T02:20:49.686 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T02:20:49.713 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T02:20:49.747 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T02:20:50.057 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T02:20:50.093 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T02:20:50.168 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T02:20:50.198 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T02:20:50.235 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T02:20:50.718 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T02:20:50.746 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T02:20:50.817 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T02:20:50.838 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T02:20:51.641 INFO:teuthology.orchestra.run.smithi060.stdout:(156/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 712 kB/s | 16 MB 00:23 2024-09-12T02:20:51.646 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-09-12T02:20:51.646 INFO:teuthology.orchestra.run.smithi060.stdout:Total 5.3 MB/s | 226 MB 00:42 2024-09-12T02:20:52.848 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-09-12T02:20:53.017 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-09-12T02:20:53.017 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-09-12T02:20:53.138 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:20:53.344 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:20:53.891 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:20:53.930 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T02:20:54.025 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T02:20:54.025 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T02:20:54.025 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T02:20:54.025 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:20:54.065 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T02:20:55.361 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-09-12T02:20:55.362 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-09-12T02:21:02.061 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-09-12T02:21:02.153 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T02:21:02.192 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T02:21:02.255 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T02:21:02.296 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T02:21:02.321 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T02:21:02.372 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T02:21:02.736 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T02:21:02.855 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:21:02.965 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:21:02.998 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:21:03.075 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:21:03.103 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T02:21:03.284 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T02:21:03.342 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T02:21:03.369 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:21:03.475 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:21:03.503 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T02:21:03.576 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T02:21:03.604 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T02:21:03.625 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T02:21:03.821 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T02:21:03.986 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T02:21:04.127 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T02:21:04.228 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:21:04.320 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:21:04.564 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:21:04.676 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T02:21:04.775 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T02:21:04.944 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T02:21:04.995 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T02:21:05.086 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T02:21:05.137 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T02:21:05.176 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T02:21:05.229 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T02:21:05.261 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T02:21:05.297 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T02:21:05.368 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T02:21:05.429 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T02:21:05.459 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T02:21:05.502 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T02:21:05.565 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T02:21:05.565 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /sys 2024-09-12T02:21:05.566 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /proc 2024-09-12T02:21:05.566 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /mnt 2024-09-12T02:21:05.566 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /var/tmp 2024-09-12T02:21:05.566 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /home 2024-09-12T02:21:05.566 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /root 2024-09-12T02:21:05.566 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /tmp 2024-09-12T02:21:05.566 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:21:05.580 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T02:21:05.612 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T02:21:05.656 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T02:21:05.684 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T02:21:05.744 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T02:21:05.757 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T02:21:05.760 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T02:21:05.760 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:21:05.760 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T02:21:05.760 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:21:05.807 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T02:21:05.886 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T02:21:06.030 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T02:21:06.086 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T02:21:06.641 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T02:21:06.732 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T02:21:06.767 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T02:21:06.819 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T02:21:06.857 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T02:21:06.899 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T02:21:07.083 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T02:21:07.143 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T02:21:07.199 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T02:21:07.239 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T02:21:07.265 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T02:21:07.265 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:21:07.265 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T02:21:07.265 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T02:21:07.265 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T02:21:07.265 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:21:07.282 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T02:21:07.319 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T02:21:07.355 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T02:21:07.403 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T02:21:07.438 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T02:21:07.481 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T02:21:07.489 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T02:21:07.512 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T02:21:07.513 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:21:07.513 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T02:21:07.513 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T02:21:07.513 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T02:21:07.513 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:21:07.523 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T02:21:07.666 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T02:21:07.715 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T02:21:07.758 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T02:21:07.873 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T02:21:07.908 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T02:21:07.948 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T02:21:07.956 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T02:21:07.981 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T02:21:07.981 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:21:07.982 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T02:21:07.982 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T02:21:07.982 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T02:21:07.982 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:21:07.989 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-12T02:21:08.014 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T02:21:08.087 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T02:21:08.109 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T02:21:08.144 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T02:21:08.199 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T02:21:08.245 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T02:21:08.299 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T02:21:08.333 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T02:21:08.375 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T02:21:08.385 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T02:21:08.425 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T02:21:08.432 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T02:21:08.462 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T02:21:08.492 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T02:21:08.510 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T02:21:08.527 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T02:21:08.563 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T02:21:08.599 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T02:21:08.605 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T02:21:08.639 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T02:21:08.729 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T02:21:08.731 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T02:21:08.779 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T02:21:08.803 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T02:21:08.809 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T02:21:08.839 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T02:21:08.867 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T02:21:08.917 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T02:21:08.978 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T02:21:09.310 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T02:21:09.341 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T02:21:09.372 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T02:21:09.435 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T02:21:09.463 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T02:21:09.739 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T02:21:09.782 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T02:21:09.815 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T02:21:09.918 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T02:21:09.971 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T02:21:10.041 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T02:21:10.131 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T02:21:10.168 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T02:21:10.358 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T02:21:10.390 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T02:21:10.470 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T02:21:10.506 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T02:21:10.541 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T02:21:11.153 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T02:21:11.468 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T02:21:11.505 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T02:21:11.533 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T02:21:11.636 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T02:21:11.803 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T02:21:11.835 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T02:21:11.859 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T02:21:11.859 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:21:11.859 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T02:21:11.859 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T02:21:11.859 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T02:21:11.859 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:21:11.911 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T02:21:11.922 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T02:21:12.019 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T02:21:12.073 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T02:21:12.605 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T02:21:12.695 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T02:21:12.723 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T02:21:12.756 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T02:21:13.002 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T02:21:13.029 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T02:21:13.053 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T02:21:13.053 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:21:13.053 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T02:21:13.053 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:21:13.053 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:21:13.053 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:21:13.091 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T02:21:13.097 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T02:21:13.120 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T02:21:13.120 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:21:13.120 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T02:21:13.120 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:21:13.172 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T02:21:13.195 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T02:21:13.195 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:21:13.196 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T02:21:13.196 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:21:13.196 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:21:13.196 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:21:13.334 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T02:21:13.421 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T02:21:13.451 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T02:21:13.495 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T02:21:13.498 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T02:21:13.521 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T02:21:13.521 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:21:13.522 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T02:21:13.522 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T02:21:13.522 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T02:21:13.522 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:21:14.001 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T02:21:14.023 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T02:21:14.086 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T02:21:14.116 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T02:21:16.507 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:21:16.537 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:21:17.117 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:21:17.166 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T02:21:17.260 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T02:21:17.260 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T02:21:17.260 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T02:21:17.260 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:21:17.300 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T02:21:18.102 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T02:21:18.143 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T02:21:18.184 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T02:21:18.216 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T02:21:18.243 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T02:21:18.448 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T02:21:18.490 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T02:21:18.520 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T02:21:18.550 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T02:21:18.596 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T02:21:19.179 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:21:19.219 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:21:19.238 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:21:20.061 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T02:21:20.149 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T02:21:20.195 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T02:21:20.292 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T02:21:20.327 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T02:21:20.372 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T02:21:20.403 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T02:21:20.403 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T02:21:20.487 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T02:21:20.487 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T02:21:20.571 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T02:21:20.596 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T02:21:20.605 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:21:20.605 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:21:20.781 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:21:20.781 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T02:21:20.874 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T02:21:20.938 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:21:26.476 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:21:26.476 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T02:21:26.476 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T02:21:26.476 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T02:21:26.476 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T02:21:26.477 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T02:21:26.477 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T02:21:26.477 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T02:21:26.477 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:21:26.477 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:21:26.477 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T02:21:26.477 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T02:21:26.477 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T02:21:26.477 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:21:26.477 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T02:21:26.477 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T02:21:26.477 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T02:21:26.477 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T02:21:26.478 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T02:21:26.478 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T02:21:26.478 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T02:21:26.478 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T02:21:26.478 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T02:21:26.478 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T02:21:26.478 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T02:21:26.478 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T02:21:26.478 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T02:21:26.478 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T02:21:26.490 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T02:21:26.490 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T02:21:26.490 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T02:21:26.490 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T02:21:26.490 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T02:21:26.491 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T02:21:26.491 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T02:21:26.491 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T02:21:26.491 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T02:21:26.491 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T02:21:26.491 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T02:21:26.491 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T02:21:26.491 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T02:21:26.491 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T02:21:26.491 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T02:21:26.491 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T02:21:26.491 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T02:21:26.491 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T02:21:26.492 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T02:21:26.492 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T02:21:26.492 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T02:21:26.492 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T02:21:26.492 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T02:21:26.492 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T02:21:26.492 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T02:21:26.492 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T02:21:26.492 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T02:21:26.492 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T02:21:26.492 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T02:21:26.492 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T02:21:26.493 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T02:21:26.493 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T02:21:26.493 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T02:21:26.493 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T02:21:26.493 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T02:21:26.493 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T02:21:26.493 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T02:21:26.493 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T02:21:26.493 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T02:21:26.493 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T02:21:26.493 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T02:21:26.493 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T02:21:26.493 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T02:21:26.493 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T02:21:26.494 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T02:21:26.494 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T02:21:26.494 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T02:21:26.494 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T02:21:26.494 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T02:21:26.494 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T02:21:26.494 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T02:21:26.494 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T02:21:26.494 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T02:21:26.494 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T02:21:26.494 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T02:21:26.494 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T02:21:26.494 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T02:21:26.495 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T02:21:26.495 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T02:21:26.495 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T02:21:26.495 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T02:21:26.495 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T02:21:26.495 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T02:21:26.495 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T02:21:26.495 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T02:21:26.495 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T02:21:26.495 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T02:21:26.495 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T02:21:26.495 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T02:21:26.495 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T02:21:26.496 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T02:21:26.496 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T02:21:26.496 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T02:21:26.496 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T02:21:26.496 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T02:21:26.496 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T02:21:26.496 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T02:21:26.496 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T02:21:26.496 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T02:21:26.496 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-12T02:21:26.496 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T02:21:26.496 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T02:21:26.496 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T02:21:26.497 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T02:21:26.497 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T02:21:26.497 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T02:21:26.497 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T02:21:26.497 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T02:21:26.497 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T02:21:26.497 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T02:21:26.497 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T02:21:26.497 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T02:21:26.497 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T02:21:26.497 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T02:21:26.497 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T02:21:26.498 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T02:21:26.498 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T02:21:26.498 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T02:21:26.498 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T02:21:26.498 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T02:21:26.498 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T02:21:26.498 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T02:21:26.498 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T02:21:26.498 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T02:21:26.498 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T02:21:26.498 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T02:21:26.498 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T02:21:26.498 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T02:21:26.499 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T02:21:26.499 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T02:21:26.499 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T02:21:26.499 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T02:21:26.499 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T02:21:26.499 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T02:21:26.499 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T02:21:26.499 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T02:21:26.499 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T02:21:26.499 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T02:21:26.499 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T02:21:26.499 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T02:21:26.499 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T02:21:26.500 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T02:21:26.500 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T02:21:26.500 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T02:21:26.500 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T02:21:26.500 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T02:21:26.500 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T02:21:26.500 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T02:21:26.500 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T02:21:26.500 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T02:21:26.501 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T02:21:26.501 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T02:21:26.501 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T02:21:26.501 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T02:21:26.501 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T02:21:26.501 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T02:21:29.465 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:21:29.465 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:21:29.465 INFO:teuthology.orchestra.run.smithi105.stdout:Upgraded: 2024-09-12T02:21:29.465 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T02:21:29.466 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T02:21:29.466 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T02:21:29.466 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T02:21:29.466 INFO:teuthology.orchestra.run.smithi105.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:29.466 INFO:teuthology.orchestra.run.smithi105.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:29.466 INFO:teuthology.orchestra.run.smithi105.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T02:21:29.466 INFO:teuthology.orchestra.run.smithi105.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T02:21:29.466 INFO:teuthology.orchestra.run.smithi105.stdout:Installed: 2024-09-12T02:21:29.466 INFO:teuthology.orchestra.run.smithi105.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T02:21:29.466 INFO:teuthology.orchestra.run.smithi105.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T02:21:29.466 INFO:teuthology.orchestra.run.smithi105.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T02:21:29.466 INFO:teuthology.orchestra.run.smithi105.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T02:21:29.466 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:29.466 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:29.467 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:29.467 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:29.467 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:21:29.467 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:29.467 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:29.467 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:29.467 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:21:29.467 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:21:29.467 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:21:29.467 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:21:29.467 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:21:29.467 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:29.467 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:29.468 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:21:29.468 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:29.468 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:29.468 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:29.468 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:21:29.468 INFO:teuthology.orchestra.run.smithi105.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:21:29.468 INFO:teuthology.orchestra.run.smithi105.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:29.468 INFO:teuthology.orchestra.run.smithi105.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:29.468 INFO:teuthology.orchestra.run.smithi105.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:21:29.468 INFO:teuthology.orchestra.run.smithi105.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T02:21:29.468 INFO:teuthology.orchestra.run.smithi105.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T02:21:29.468 INFO:teuthology.orchestra.run.smithi105.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T02:21:29.469 INFO:teuthology.orchestra.run.smithi105.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T02:21:29.469 INFO:teuthology.orchestra.run.smithi105.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T02:21:29.469 INFO:teuthology.orchestra.run.smithi105.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T02:21:29.469 INFO:teuthology.orchestra.run.smithi105.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T02:21:29.469 INFO:teuthology.orchestra.run.smithi105.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T02:21:29.469 INFO:teuthology.orchestra.run.smithi105.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T02:21:29.469 INFO:teuthology.orchestra.run.smithi105.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T02:21:29.469 INFO:teuthology.orchestra.run.smithi105.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T02:21:29.469 INFO:teuthology.orchestra.run.smithi105.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:29.469 INFO:teuthology.orchestra.run.smithi105.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:29.469 INFO:teuthology.orchestra.run.smithi105.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:29.469 INFO:teuthology.orchestra.run.smithi105.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T02:21:29.470 INFO:teuthology.orchestra.run.smithi105.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T02:21:29.470 INFO:teuthology.orchestra.run.smithi105.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T02:21:29.470 INFO:teuthology.orchestra.run.smithi105.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T02:21:29.470 INFO:teuthology.orchestra.run.smithi105.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T02:21:29.470 INFO:teuthology.orchestra.run.smithi105.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:29.470 INFO:teuthology.orchestra.run.smithi105.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:29.470 INFO:teuthology.orchestra.run.smithi105.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T02:21:29.470 INFO:teuthology.orchestra.run.smithi105.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:29.470 INFO:teuthology.orchestra.run.smithi105.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T02:21:29.472 INFO:teuthology.orchestra.run.smithi105.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T02:21:29.472 INFO:teuthology.orchestra.run.smithi105.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T02:21:29.472 INFO:teuthology.orchestra.run.smithi105.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T02:21:29.472 INFO:teuthology.orchestra.run.smithi105.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T02:21:29.472 INFO:teuthology.orchestra.run.smithi105.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T02:21:29.472 INFO:teuthology.orchestra.run.smithi105.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T02:21:29.472 INFO:teuthology.orchestra.run.smithi105.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T02:21:29.472 INFO:teuthology.orchestra.run.smithi105.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T02:21:29.472 INFO:teuthology.orchestra.run.smithi105.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T02:21:29.472 INFO:teuthology.orchestra.run.smithi105.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T02:21:29.473 INFO:teuthology.orchestra.run.smithi105.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T02:21:29.473 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T02:21:29.473 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T02:21:29.473 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T02:21:29.473 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T02:21:29.473 INFO:teuthology.orchestra.run.smithi105.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T02:21:29.473 INFO:teuthology.orchestra.run.smithi105.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T02:21:29.473 INFO:teuthology.orchestra.run.smithi105.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T02:21:29.473 INFO:teuthology.orchestra.run.smithi105.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T02:21:29.473 INFO:teuthology.orchestra.run.smithi105.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T02:21:29.473 INFO:teuthology.orchestra.run.smithi105.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T02:21:29.473 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T02:21:29.473 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:29.474 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:29.474 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:29.474 INFO:teuthology.orchestra.run.smithi105.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T02:21:29.474 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T02:21:29.474 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T02:21:29.474 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T02:21:29.474 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T02:21:29.474 INFO:teuthology.orchestra.run.smithi105.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T02:21:29.474 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T02:21:29.474 INFO:teuthology.orchestra.run.smithi105.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T02:21:29.474 INFO:teuthology.orchestra.run.smithi105.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T02:21:29.474 INFO:teuthology.orchestra.run.smithi105.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T02:21:29.474 INFO:teuthology.orchestra.run.smithi105.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T02:21:29.474 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T02:21:29.475 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T02:21:29.475 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T02:21:29.475 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T02:21:29.475 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T02:21:29.475 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T02:21:29.475 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T02:21:29.475 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T02:21:29.475 INFO:teuthology.orchestra.run.smithi105.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T02:21:29.475 INFO:teuthology.orchestra.run.smithi105.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T02:21:29.475 INFO:teuthology.orchestra.run.smithi105.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T02:21:29.475 INFO:teuthology.orchestra.run.smithi105.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T02:21:29.475 INFO:teuthology.orchestra.run.smithi105.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T02:21:29.475 INFO:teuthology.orchestra.run.smithi105.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T02:21:29.476 INFO:teuthology.orchestra.run.smithi105.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T02:21:29.476 INFO:teuthology.orchestra.run.smithi105.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T02:21:29.476 INFO:teuthology.orchestra.run.smithi105.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T02:21:29.476 INFO:teuthology.orchestra.run.smithi105.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T02:21:29.476 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T02:21:29.476 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T02:21:29.476 INFO:teuthology.orchestra.run.smithi105.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T02:21:29.476 INFO:teuthology.orchestra.run.smithi105.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T02:21:29.476 INFO:teuthology.orchestra.run.smithi105.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T02:21:29.476 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T02:21:29.476 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T02:21:29.476 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T02:21:29.476 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T02:21:29.477 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T02:21:29.477 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T02:21:29.477 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:29.477 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:29.477 INFO:teuthology.orchestra.run.smithi105.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T02:21:29.477 INFO:teuthology.orchestra.run.smithi105.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T02:21:29.477 INFO:teuthology.orchestra.run.smithi105.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T02:21:29.477 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:29.477 INFO:teuthology.orchestra.run.smithi105.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T02:21:29.477 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T02:21:29.477 INFO:teuthology.orchestra.run.smithi105.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T02:21:29.477 INFO:teuthology.orchestra.run.smithi105.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T02:21:29.477 INFO:teuthology.orchestra.run.smithi105.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T02:21:29.477 INFO:teuthology.orchestra.run.smithi105.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T02:21:29.478 INFO:teuthology.orchestra.run.smithi105.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T02:21:29.478 INFO:teuthology.orchestra.run.smithi105.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T02:21:29.478 INFO:teuthology.orchestra.run.smithi105.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T02:21:29.478 INFO:teuthology.orchestra.run.smithi105.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T02:21:29.478 INFO:teuthology.orchestra.run.smithi105.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T02:21:29.478 INFO:teuthology.orchestra.run.smithi105.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T02:21:29.478 INFO:teuthology.orchestra.run.smithi105.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T02:21:29.478 INFO:teuthology.orchestra.run.smithi105.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T02:21:29.478 INFO:teuthology.orchestra.run.smithi105.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T02:21:29.478 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:29.478 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:29.478 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:29.478 INFO:teuthology.orchestra.run.smithi105.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T02:21:29.478 INFO:teuthology.orchestra.run.smithi105.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T02:21:29.479 INFO:teuthology.orchestra.run.smithi105.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T02:21:29.479 INFO:teuthology.orchestra.run.smithi105.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T02:21:29.479 INFO:teuthology.orchestra.run.smithi105.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T02:21:29.479 INFO:teuthology.orchestra.run.smithi105.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T02:21:29.479 INFO:teuthology.orchestra.run.smithi105.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T02:21:29.479 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:21:29.479 INFO:teuthology.orchestra.run.smithi105.stdout:Complete! 2024-09-12T02:21:29.580 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T02:21:29.580 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /sys 2024-09-12T02:21:29.581 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /proc 2024-09-12T02:21:29.581 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /mnt 2024-09-12T02:21:29.581 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /var/tmp 2024-09-12T02:21:29.581 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /home 2024-09-12T02:21:29.581 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /root 2024-09-12T02:21:29.581 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /tmp 2024-09-12T02:21:29.581 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:21:29.754 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T02:21:29.770 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T02:21:29.771 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:21:29.771 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T02:21:29.771 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:21:29.912 DEBUG:teuthology.parallel:result is None 2024-09-12T02:21:31.332 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T02:21:31.360 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T02:21:31.360 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:21:31.360 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T02:21:31.360 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T02:21:31.360 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T02:21:31.360 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:21:31.600 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T02:21:31.624 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T02:21:31.624 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:21:31.624 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T02:21:31.624 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T02:21:31.624 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T02:21:31.624 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:21:32.092 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T02:21:32.117 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T02:21:32.117 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:21:32.117 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T02:21:32.117 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T02:21:32.117 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T02:21:32.117 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:21:32.222 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T02:21:32.281 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T02:21:32.344 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T02:21:32.540 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T02:21:32.593 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T02:21:32.673 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T02:21:32.765 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T02:21:32.906 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T02:21:32.952 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T02:21:32.983 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T02:21:33.010 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T02:21:33.463 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T02:21:33.492 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T02:21:33.524 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T02:21:33.588 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T02:21:33.615 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T02:21:34.717 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T02:21:34.758 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T02:21:35.775 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T02:21:35.800 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T02:21:35.908 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T02:21:36.079 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T02:21:36.102 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T02:21:36.127 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T02:21:36.127 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:21:36.127 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T02:21:36.127 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T02:21:36.128 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T02:21:36.128 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:21:36.178 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T02:21:36.190 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T02:21:36.291 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T02:21:36.355 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T02:21:37.331 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T02:21:37.364 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T02:21:37.389 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T02:21:37.389 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:21:37.389 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T02:21:37.389 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:21:37.389 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:21:37.389 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:21:37.431 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T02:21:37.455 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T02:21:37.455 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:21:37.455 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T02:21:37.455 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:21:37.507 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T02:21:37.531 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T02:21:37.531 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:21:37.532 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T02:21:37.532 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:21:37.532 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:21:37.532 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:21:37.849 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T02:21:37.874 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T02:21:37.874 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:21:37.874 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T02:21:37.874 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T02:21:37.874 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T02:21:37.874 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:21:42.720 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T02:21:42.770 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T02:21:42.811 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T02:21:42.843 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T02:21:42.870 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T02:21:43.085 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T02:21:43.142 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T02:21:43.171 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T02:21:43.210 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T02:21:43.248 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T02:21:43.859 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:21:43.903 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:21:43.924 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:21:44.832 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T02:21:44.933 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T02:21:45.001 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T02:21:45.099 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T02:21:45.128 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T02:21:45.154 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T02:21:45.188 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T02:21:45.188 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T02:21:45.263 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T02:21:45.263 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T02:21:45.348 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T02:21:45.373 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T02:21:45.378 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:21:45.379 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:21:45.558 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:21:45.558 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T02:21:45.625 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T02:21:45.693 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:21:51.212 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:21:51.212 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T02:21:51.212 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T02:21:51.212 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T02:21:51.212 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T02:21:51.212 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T02:21:51.212 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T02:21:51.212 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T02:21:51.213 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:21:51.213 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:21:51.213 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T02:21:51.213 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T02:21:51.213 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T02:21:51.213 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:21:51.213 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T02:21:51.213 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T02:21:51.213 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T02:21:51.213 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T02:21:51.213 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T02:21:51.213 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T02:21:51.213 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T02:21:51.214 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T02:21:51.214 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T02:21:51.214 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T02:21:51.214 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T02:21:51.214 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T02:21:51.214 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T02:21:51.214 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T02:21:51.214 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T02:21:51.214 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T02:21:51.214 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T02:21:51.214 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T02:21:51.214 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T02:21:51.215 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T02:21:51.215 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T02:21:51.215 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T02:21:51.215 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T02:21:51.215 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T02:21:51.215 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T02:21:51.215 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T02:21:51.215 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T02:21:51.215 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T02:21:51.215 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T02:21:51.215 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T02:21:51.215 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T02:21:51.216 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T02:21:51.216 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T02:21:51.216 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T02:21:51.216 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T02:21:51.216 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T02:21:51.216 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T02:21:51.216 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T02:21:51.216 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T02:21:51.216 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T02:21:51.216 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T02:21:51.216 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T02:21:51.217 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T02:21:51.217 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T02:21:51.217 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T02:21:51.217 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T02:21:51.217 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T02:21:51.217 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T02:21:51.217 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T02:21:51.217 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T02:21:51.217 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T02:21:51.217 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T02:21:51.217 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T02:21:51.217 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T02:21:51.217 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T02:21:51.218 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T02:21:51.218 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T02:21:51.218 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T02:21:51.218 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T02:21:51.218 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T02:21:51.218 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T02:21:51.218 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T02:21:51.218 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T02:21:51.218 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T02:21:51.218 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T02:21:51.218 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T02:21:51.218 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T02:21:51.218 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T02:21:51.219 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T02:21:51.219 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T02:21:51.219 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T02:21:51.219 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T02:21:51.219 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T02:21:51.219 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T02:21:51.219 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T02:21:51.219 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T02:21:51.219 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T02:21:51.219 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T02:21:51.219 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T02:21:51.219 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T02:21:51.219 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T02:21:51.220 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T02:21:51.220 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T02:21:51.220 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T02:21:51.220 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T02:21:51.220 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T02:21:51.220 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T02:21:51.220 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T02:21:51.220 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T02:21:51.220 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T02:21:51.220 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T02:21:51.220 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T02:21:51.220 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T02:21:51.221 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-12T02:21:51.221 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T02:21:51.221 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T02:21:51.221 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T02:21:51.221 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T02:21:51.221 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T02:21:51.221 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T02:21:51.221 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T02:21:51.221 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T02:21:51.221 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T02:21:51.221 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T02:21:51.221 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T02:21:51.221 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T02:21:51.222 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T02:21:51.222 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T02:21:51.222 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T02:21:51.222 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T02:21:51.222 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T02:21:51.222 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T02:21:51.222 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T02:21:51.222 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T02:21:51.222 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T02:21:51.222 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T02:21:51.222 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T02:21:51.222 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T02:21:51.222 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T02:21:51.223 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T02:21:51.223 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T02:21:51.223 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T02:21:51.223 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T02:21:51.223 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T02:21:51.223 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T02:21:51.223 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T02:21:51.223 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T02:21:51.223 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T02:21:51.223 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T02:21:51.223 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T02:21:51.223 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T02:21:51.223 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T02:21:51.223 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T02:21:51.223 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T02:21:51.224 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T02:21:51.224 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T02:21:51.224 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T02:21:51.224 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T02:21:51.224 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T02:21:51.224 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T02:21:51.224 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T02:21:51.224 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T02:21:51.224 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T02:21:51.224 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T02:21:51.224 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T02:21:51.224 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T02:21:51.224 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T02:21:51.224 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T02:21:51.225 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T02:21:51.225 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T02:21:53.653 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:21:53.653 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:21:53.654 INFO:teuthology.orchestra.run.smithi060.stdout:Upgraded: 2024-09-12T02:21:53.654 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T02:21:53.654 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T02:21:53.654 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T02:21:53.654 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T02:21:53.654 INFO:teuthology.orchestra.run.smithi060.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:53.654 INFO:teuthology.orchestra.run.smithi060.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:53.654 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T02:21:53.654 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T02:21:53.654 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-09-12T02:21:53.654 INFO:teuthology.orchestra.run.smithi060.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T02:21:53.655 INFO:teuthology.orchestra.run.smithi060.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T02:21:53.655 INFO:teuthology.orchestra.run.smithi060.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T02:21:53.655 INFO:teuthology.orchestra.run.smithi060.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T02:21:53.655 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:53.655 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:53.655 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:53.655 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:53.655 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:21:53.655 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:53.655 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:53.655 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:53.655 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:21:53.655 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:21:53.656 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:21:53.656 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:21:53.656 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:21:53.656 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:53.656 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:53.656 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:21:53.656 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:53.656 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:53.656 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:53.656 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:21:53.656 INFO:teuthology.orchestra.run.smithi060.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:21:53.656 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:53.656 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:53.657 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:21:53.657 INFO:teuthology.orchestra.run.smithi060.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T02:21:53.657 INFO:teuthology.orchestra.run.smithi060.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T02:21:53.657 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T02:21:53.657 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T02:21:53.657 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T02:21:53.657 INFO:teuthology.orchestra.run.smithi060.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T02:21:53.657 INFO:teuthology.orchestra.run.smithi060.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T02:21:53.657 INFO:teuthology.orchestra.run.smithi060.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T02:21:53.657 INFO:teuthology.orchestra.run.smithi060.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T02:21:53.657 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T02:21:53.657 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T02:21:53.658 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:53.658 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:53.658 INFO:teuthology.orchestra.run.smithi060.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:53.658 INFO:teuthology.orchestra.run.smithi060.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T02:21:53.658 INFO:teuthology.orchestra.run.smithi060.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T02:21:53.658 INFO:teuthology.orchestra.run.smithi060.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T02:21:53.658 INFO:teuthology.orchestra.run.smithi060.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T02:21:53.658 INFO:teuthology.orchestra.run.smithi060.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T02:21:53.658 INFO:teuthology.orchestra.run.smithi060.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:53.658 INFO:teuthology.orchestra.run.smithi060.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:53.658 INFO:teuthology.orchestra.run.smithi060.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T02:21:53.658 INFO:teuthology.orchestra.run.smithi060.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:53.658 INFO:teuthology.orchestra.run.smithi060.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T02:21:53.659 INFO:teuthology.orchestra.run.smithi060.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T02:21:53.659 INFO:teuthology.orchestra.run.smithi060.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T02:21:53.659 INFO:teuthology.orchestra.run.smithi060.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T02:21:53.659 INFO:teuthology.orchestra.run.smithi060.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T02:21:53.659 INFO:teuthology.orchestra.run.smithi060.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T02:21:53.659 INFO:teuthology.orchestra.run.smithi060.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T02:21:53.659 INFO:teuthology.orchestra.run.smithi060.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T02:21:53.659 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T02:21:53.659 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T02:21:53.659 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T02:21:53.659 INFO:teuthology.orchestra.run.smithi060.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T02:21:53.660 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T02:21:53.660 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T02:21:53.660 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T02:21:53.660 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T02:21:53.660 INFO:teuthology.orchestra.run.smithi060.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T02:21:53.660 INFO:teuthology.orchestra.run.smithi060.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T02:21:53.660 INFO:teuthology.orchestra.run.smithi060.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T02:21:53.660 INFO:teuthology.orchestra.run.smithi060.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T02:21:53.660 INFO:teuthology.orchestra.run.smithi060.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T02:21:53.660 INFO:teuthology.orchestra.run.smithi060.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T02:21:53.660 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T02:21:53.660 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:53.660 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:53.660 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:53.661 INFO:teuthology.orchestra.run.smithi060.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T02:21:53.661 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T02:21:53.661 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T02:21:53.661 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T02:21:53.661 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T02:21:53.661 INFO:teuthology.orchestra.run.smithi060.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T02:21:53.661 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T02:21:53.661 INFO:teuthology.orchestra.run.smithi060.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T02:21:53.661 INFO:teuthology.orchestra.run.smithi060.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T02:21:53.661 INFO:teuthology.orchestra.run.smithi060.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T02:21:53.661 INFO:teuthology.orchestra.run.smithi060.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T02:21:53.661 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T02:21:53.661 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T02:21:53.662 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T02:21:53.662 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T02:21:53.662 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T02:21:53.662 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T02:21:53.662 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T02:21:53.662 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T02:21:53.662 INFO:teuthology.orchestra.run.smithi060.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T02:21:53.662 INFO:teuthology.orchestra.run.smithi060.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T02:21:53.662 INFO:teuthology.orchestra.run.smithi060.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T02:21:53.662 INFO:teuthology.orchestra.run.smithi060.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T02:21:53.662 INFO:teuthology.orchestra.run.smithi060.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T02:21:53.662 INFO:teuthology.orchestra.run.smithi060.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T02:21:53.662 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T02:21:53.663 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T02:21:53.663 INFO:teuthology.orchestra.run.smithi060.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T02:21:53.663 INFO:teuthology.orchestra.run.smithi060.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T02:21:53.663 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T02:21:53.663 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T02:21:53.663 INFO:teuthology.orchestra.run.smithi060.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T02:21:53.663 INFO:teuthology.orchestra.run.smithi060.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T02:21:53.663 INFO:teuthology.orchestra.run.smithi060.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T02:21:53.663 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T02:21:53.663 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T02:21:53.663 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T02:21:53.663 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T02:21:53.663 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T02:21:53.664 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T02:21:53.664 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:53.664 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:53.664 INFO:teuthology.orchestra.run.smithi060.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T02:21:53.664 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T02:21:53.664 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T02:21:53.664 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:53.664 INFO:teuthology.orchestra.run.smithi060.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T02:21:53.664 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T02:21:53.664 INFO:teuthology.orchestra.run.smithi060.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T02:21:53.664 INFO:teuthology.orchestra.run.smithi060.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T02:21:53.664 INFO:teuthology.orchestra.run.smithi060.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T02:21:53.664 INFO:teuthology.orchestra.run.smithi060.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T02:21:53.664 INFO:teuthology.orchestra.run.smithi060.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T02:21:53.665 INFO:teuthology.orchestra.run.smithi060.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T02:21:53.665 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T02:21:53.665 INFO:teuthology.orchestra.run.smithi060.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T02:21:53.665 INFO:teuthology.orchestra.run.smithi060.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T02:21:53.665 INFO:teuthology.orchestra.run.smithi060.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T02:21:53.665 INFO:teuthology.orchestra.run.smithi060.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T02:21:53.665 INFO:teuthology.orchestra.run.smithi060.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T02:21:53.665 INFO:teuthology.orchestra.run.smithi060.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T02:21:53.665 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:53.665 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:53.665 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:21:53.665 INFO:teuthology.orchestra.run.smithi060.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T02:21:53.665 INFO:teuthology.orchestra.run.smithi060.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T02:21:53.666 INFO:teuthology.orchestra.run.smithi060.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T02:21:53.666 INFO:teuthology.orchestra.run.smithi060.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T02:21:53.666 INFO:teuthology.orchestra.run.smithi060.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T02:21:53.666 INFO:teuthology.orchestra.run.smithi060.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T02:21:53.666 INFO:teuthology.orchestra.run.smithi060.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T02:21:53.666 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:21:53.667 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-12T02:21:54.087 DEBUG:teuthology.parallel:result is None 2024-09-12T02:21:54.088 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:21:54.236 DEBUG:teuthology.orchestra.run.smithi060:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T02:21:54.259 INFO:teuthology.orchestra.run.smithi060.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T02:21:54.260 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T02:21:54.260 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T02:21:54.262 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:21:54.401 DEBUG:teuthology.orchestra.run.smithi105:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T02:21:54.428 INFO:teuthology.orchestra.run.smithi105.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T02:21:54.428 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T02:21:54.428 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T02:21:54.430 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T02:21:54.430 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T02:21:54.430 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T02:21:54.459 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T02:21:54.459 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T02:21:54.499 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T02:21:54.500 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T02:21:54.500 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T02:21:54.526 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T02:21:54.594 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T02:21:54.594 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T02:21:54.622 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T02:21:54.690 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T02:21:54.690 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T02:21:54.690 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T02:21:54.716 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T02:21:54.782 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T02:21:54.783 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T02:21:54.809 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T02:21:54.874 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T02:21:54.875 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T02:21:54.875 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T02:21:54.901 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T02:21:54.968 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T02:21:54.968 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T02:21:54.993 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T02:21:55.058 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T02:21:55.143 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T02:21:55.143 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 777 /var/log/ceph 2024-09-12T02:21:55.146 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 777 /var/log/ceph 2024-09-12T02:21:55.170 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T02:21:55.171 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T02:21:55.213 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T02:21:55.238 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T02:21:55.238 DEBUG:teuthology.orchestra.run.smithi060:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T02:21:55.280 DEBUG:teuthology.orchestra.run.smithi105:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T02:21:55.310 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-12T02:21:55.310 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-12T02:21:55.310 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-12T02:21:55.311 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T02:21:55.311 DEBUG:teuthology.orchestra.run.smithi060:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-12T02:21:55.360 DEBUG:teuthology.orchestra.run.smithi060:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-12T02:21:55.468 DEBUG:teuthology.orchestra.run.smithi060:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-12T02:21:55.493 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T02:21:55.494 DEBUG:teuthology.orchestra.run.smithi105:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-12T02:21:55.508 DEBUG:teuthology.orchestra.run.smithi105:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-12T02:21:55.619 DEBUG:teuthology.orchestra.run.smithi105:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-12T02:21:55.648 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T02:21:55.649 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'overall HEALTH_', '\\(MON_DOWN\\)', 'SLOW_OPS', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T02:21:55.649 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901613', 'branch': 'squid', 'description': 'fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/ffsb}}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7901613', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'cephfs': {'fs': [{'name': 'a'}, {'name': 'b'}], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'overall HEALTH_', '\\(MON_DOWN\\)', 'SLOW_OPS', 'slow request'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'ceph-fuse': {'client.0': {'cephfs_name': 'a'}, 'client.1': {'cephfs_name': 'b'}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}}, 'kclient': {'client.0': {'cephfs_name': 'a'}, 'client.1': {'cephfs_name': 'b'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'seed': 481, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'sleep_before_teardown': 0, 'subset': '57/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi060.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBfYGznE3a3V5d16cEJ5QduO/QsIZCR7QNyalnBw7/kepJLw/lGauJzdXfteq5EcFQxvnXzNN1J3Lu2gPNmAhbU=', 'smithi105.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD6VZadNlKu7N0JukTC+f/gds6MpTddgCT6sQ4VqJRpjmLeOV/qDnSZqq5zRh1bqcdXTge7SsjmN7ANwZLbGtwE='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'fs': [{'name': 'a'}, {'name': 'b'}], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'overall HEALTH_', '\\(MON_DOWN\\)', 'SLOW_OPS', 'slow request'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'mon_thrash': {'check_mds_failover': True, 'revive_delay': 20, 'thrash_delay': 10}}, {'workunit': {'clients': {'all': ['suites/ffsb.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-11_21:24:17', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T02:21:55.650 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T02:21:55.652 DEBUG:teuthology.orchestra.run.smithi105:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T02:21:55.699 DEBUG:teuthology.orchestra.run.smithi060:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T02:21:55.709 DEBUG:teuthology.orchestra.run.smithi105:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T02:21:55.764 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T02:21:55.764 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T02:21:55.789 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T02:21:55.789 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_1 2024-09-12T02:21:55.844 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T02:21:55.844 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:21:55.844 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-12T02:21:55.844 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:21:55.844 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:21:55.844 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-09-12 02:21:46.039269088 +0000 2024-09-12T02:21:55.845 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-09-12 02:19:20.879221306 +0000 2024-09-12T02:21:55.845 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-09-12 02:19:20.879221306 +0000 2024-09-12T02:21:55.845 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-09-12 02:19:20.879221306 +0000 2024-09-12T02:21:55.845 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T02:21:55.909 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-09-12T02:21:55.909 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-09-12T02:21:55.909 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000103953 s, 4.9 MB/s 2024-09-12T02:21:55.910 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T02:21:55.967 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_2 2024-09-12T02:21:56.023 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T02:21:56.023 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:21:56.023 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-12T02:21:56.023 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:21:56.023 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:21:56.024 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-09-12 02:21:46.040269078 +0000 2024-09-12T02:21:56.024 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-09-12 02:19:21.224217857 +0000 2024-09-12T02:21:56.024 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-09-12 02:19:21.224217857 +0000 2024-09-12T02:21:56.024 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-09-12 02:19:21.224217857 +0000 2024-09-12T02:21:56.024 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T02:21:56.087 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-09-12T02:21:56.087 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-09-12T02:21:56.087 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000100674 s, 5.1 MB/s 2024-09-12T02:21:56.088 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T02:21:56.145 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_3 2024-09-12T02:21:56.201 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T02:21:56.201 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:21:56.201 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-12T02:21:56.201 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:21:56.201 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:21:56.201 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-09-12 02:21:46.040269078 +0000 2024-09-12T02:21:56.201 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-09-12 02:19:21.566214438 +0000 2024-09-12T02:21:56.201 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-09-12 02:19:21.566214438 +0000 2024-09-12T02:21:56.201 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-09-12 02:19:21.566214438 +0000 2024-09-12T02:21:56.202 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T02:21:56.265 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-09-12T02:21:56.265 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-09-12T02:21:56.265 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 9.7899e-05 s, 5.2 MB/s 2024-09-12T02:21:56.266 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T02:21:56.323 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_4 2024-09-12T02:21:56.378 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T02:21:56.379 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:21:56.379 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-12T02:21:56.379 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:21:56.379 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:21:56.379 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-09-12 02:21:46.041269068 +0000 2024-09-12T02:21:56.379 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-09-12 02:19:21.899211110 +0000 2024-09-12T02:21:56.379 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-09-12 02:19:21.899211110 +0000 2024-09-12T02:21:56.379 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-09-12 02:19:21.899211110 +0000 2024-09-12T02:21:56.379 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T02:21:56.442 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-09-12T02:21:56.442 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-09-12T02:21:56.443 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000100842 s, 5.1 MB/s 2024-09-12T02:21:56.444 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T02:21:56.501 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T02:21:56.501 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T02:21:56.501 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T02:21:56.518 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T02:21:56.518 DEBUG:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_1 2024-09-12T02:21:56.574 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T02:21:56.574 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:21:56.574 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-12T02:21:56.574 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:21:56.574 INFO:teuthology.orchestra.run.smithi105.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:21:56.575 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2024-09-12 02:21:21.264908995 +0000 2024-09-12T02:21:56.575 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2024-09-12 02:19:15.566972483 +0000 2024-09-12T02:21:56.575 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2024-09-12 02:19:15.566972483 +0000 2024-09-12T02:21:56.575 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: 2024-09-12 02:19:15.566972483 +0000 2024-09-12T02:21:56.575 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T02:21:56.638 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2024-09-12T02:21:56.639 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2024-09-12T02:21:56.639 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.000264527 s, 1.9 MB/s 2024-09-12T02:21:56.640 DEBUG:teuthology.orchestra.run.smithi105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T02:21:56.697 DEBUG:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_2 2024-09-12T02:21:56.753 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T02:21:56.753 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:21:56.753 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-12T02:21:56.753 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:21:56.753 INFO:teuthology.orchestra.run.smithi105.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:21:56.753 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2024-09-12 02:21:21.264908995 +0000 2024-09-12T02:21:56.754 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2024-09-12 02:19:15.896965847 +0000 2024-09-12T02:21:56.754 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2024-09-12 02:19:15.896965847 +0000 2024-09-12T02:21:56.754 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: 2024-09-12 02:19:15.896965847 +0000 2024-09-12T02:21:56.754 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T02:21:56.817 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2024-09-12T02:21:56.817 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2024-09-12T02:21:56.817 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.000193186 s, 2.7 MB/s 2024-09-12T02:21:56.818 DEBUG:teuthology.orchestra.run.smithi105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T02:21:56.874 DEBUG:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_3 2024-09-12T02:21:56.930 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T02:21:56.930 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:21:56.930 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-12T02:21:56.930 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:21:56.930 INFO:teuthology.orchestra.run.smithi105.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:21:56.930 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2024-09-12 02:21:21.265908975 +0000 2024-09-12T02:21:56.930 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2024-09-12 02:19:16.225959231 +0000 2024-09-12T02:21:56.930 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2024-09-12 02:19:16.225959231 +0000 2024-09-12T02:21:56.930 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: 2024-09-12 02:19:16.225959231 +0000 2024-09-12T02:21:56.930 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T02:21:56.993 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2024-09-12T02:21:56.994 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2024-09-12T02:21:56.994 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.00019906 s, 2.6 MB/s 2024-09-12T02:21:56.995 DEBUG:teuthology.orchestra.run.smithi105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T02:21:57.051 DEBUG:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_4 2024-09-12T02:21:57.106 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T02:21:57.106 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:21:57.106 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-12T02:21:57.106 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:21:57.107 INFO:teuthology.orchestra.run.smithi105.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:21:57.107 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2024-09-12 02:21:21.265908975 +0000 2024-09-12T02:21:57.107 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2024-09-12 02:19:16.547952757 +0000 2024-09-12T02:21:57.107 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2024-09-12 02:19:16.547952757 +0000 2024-09-12T02:21:57.107 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: 2024-09-12 02:19:16.547952757 +0000 2024-09-12T02:21:57.107 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T02:21:57.169 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2024-09-12T02:21:57.169 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2024-09-12T02:21:57.170 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.000197716 s, 2.6 MB/s 2024-09-12T02:21:57.171 DEBUG:teuthology.orchestra.run.smithi105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T02:21:57.227 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T02:21:57.227 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi060.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi105.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T02:21:57.227 INFO:tasks.ceph:Generating config... 2024-09-12T02:21:57.229 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-12T02:21:57.229 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-09-12T02:21:57.229 INFO:tasks.ceph:[client] debug client = 20 2024-09-12T02:21:57.229 INFO:tasks.ceph:[client] debug ms = 1 2024-09-12T02:21:57.229 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-12T02:21:57.229 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-12T02:21:57.229 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-12T02:21:57.229 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-12T02:21:57.229 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-12T02:21:57.230 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-09-12T02:21:57.230 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-09-12T02:21:57.230 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-09-12T02:21:57.230 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-09-12T02:21:57.230 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-12T02:21:57.230 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-12T02:21:57.230 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-12T02:21:57.230 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-12T02:21:57.230 INFO:tasks.ceph:[mds] mon client directed command retry = 5 2024-09-12T02:21:57.230 INFO:tasks.ceph:[mds] ms inject delay max = 1 2024-09-12T02:21:57.230 INFO:tasks.ceph:[mds] ms inject delay probability = 0.005 2024-09-12T02:21:57.230 INFO:tasks.ceph:[mds] ms inject delay type = client mds osd 2024-09-12T02:21:57.231 INFO:tasks.ceph:[mds] ms inject socket failures = 2500 2024-09-12T02:21:57.231 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-12T02:21:57.231 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-12T02:21:57.231 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-12T02:21:57.231 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-12T02:21:57.231 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T02:21:57.231 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T02:21:57.231 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T02:21:57.231 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T02:21:57.231 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T02:21:57.231 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-12T02:21:57.231 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-12T02:21:57.232 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-12T02:21:57.232 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-12T02:21:57.232 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-12T02:21:57.232 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-12T02:21:57.232 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T02:21:57.232 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T02:21:57.232 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-12T02:21:57.233 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-12T02:21:57.233 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T02:21:57.233 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T02:21:57.233 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-12T02:21:57.233 INFO:tasks.ceph:[osd] filestore flush min = 0 2024-09-12T02:21:57.233 INFO:tasks.ceph:[osd] mon client directed command retry = 5 2024-09-12T02:21:57.233 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T02:21:57.233 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T02:21:57.233 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T02:21:57.233 INFO:tasks.ceph:[osd] ms inject delay max = 1 2024-09-12T02:21:57.234 INFO:tasks.ceph:[osd] ms inject delay probability = 0.005 2024-09-12T02:21:57.234 INFO:tasks.ceph:[osd] ms inject delay type = client mds 2024-09-12T02:21:57.234 INFO:tasks.ceph:[osd] ms inject socket failures = 2500 2024-09-12T02:21:57.234 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-12T02:21:57.234 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T02:21:57.234 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-12T02:21:57.234 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T02:21:57.234 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-12T02:21:57.234 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T02:21:57.234 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T02:21:57.293 INFO:teuthology.orchestra.run.smithi060.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T02:21:57.296 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T02:21:57.342 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T02:21:57.368 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.60'), ('mon.b', '172.21.15.105'), ('mon.c', '[v2:172.21.15.105:3301,v1:172.21.15.105:6790]')] 2024-09-12T02:21:57.369 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.60,172.21.15.105,[v2:172.21.15.105:3301,v1:172.21.15.105:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-12T02:21:57.370 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T02:21:57.370 DEBUG:teuthology.orchestra.run.smithi060:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T02:21:57.425 DEBUG:teuthology.orchestra.run.smithi060:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.60 --add b 172.21.15.105 --addv c '[v2:172.21.15.105:3301,v1:172.21.15.105:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:21:57.515 INFO:teuthology.orchestra.run.smithi060.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:21:57.515 INFO:teuthology.orchestra.run.smithi060.stdout:monmaptool: generated fsid ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1 2024-09-12T02:21:57.515 INFO:teuthology.orchestra.run.smithi060.stdout:setting min_mon_release = quincy 2024-09-12T02:21:57.515 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 0 2024-09-12T02:21:57.516 INFO:teuthology.orchestra.run.smithi060.stdout:fsid ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1 2024-09-12T02:21:57.516 INFO:teuthology.orchestra.run.smithi060.stdout:last_changed 2024-09-12T02:21:57.514264+0000 2024-09-12T02:21:57.516 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-09-12T02:21:57.514264+0000 2024-09-12T02:21:57.516 INFO:teuthology.orchestra.run.smithi060.stdout:min_mon_release 17 (quincy) 2024-09-12T02:21:57.516 INFO:teuthology.orchestra.run.smithi060.stdout:election_strategy: 1 2024-09-12T02:21:57.516 INFO:teuthology.orchestra.run.smithi060.stdout:0: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.a 2024-09-12T02:21:57.516 INFO:teuthology.orchestra.run.smithi060.stdout:1: [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] mon.b 2024-09-12T02:21:57.516 INFO:teuthology.orchestra.run.smithi060.stdout:2: [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] mon.c 2024-09-12T02:21:57.516 INFO:teuthology.orchestra.run.smithi060.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-12T02:21:57.517 DEBUG:teuthology.orchestra.run.smithi060:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T02:21:57.532 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1... 2024-09-12T02:21:57.533 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T02:21:57.574 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T02:21:57.616 INFO:teuthology.orchestra.run.smithi060.stdout:[global] 2024-09-12T02:21:57.616 INFO:teuthology.orchestra.run.smithi060.stdout: chdir = "" 2024-09-12T02:21:57.617 INFO:teuthology.orchestra.run.smithi060.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T02:21:57.617 INFO:teuthology.orchestra.run.smithi060.stdout: auth supported = cephx 2024-09-12T02:21:57.617 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:21:57.617 INFO:teuthology.orchestra.run.smithi060.stdout: filestore xattr use omap = true 2024-09-12T02:21:57.617 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:21:57.617 INFO:teuthology.orchestra.run.smithi060.stdout: mon clock drift allowed = 1.000 2024-09-12T02:21:57.617 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:21:57.617 INFO:teuthology.orchestra.run.smithi060.stdout: osd crush chooseleaf type = 0 2024-09-12T02:21:57.617 INFO:teuthology.orchestra.run.smithi060.stdout: auth debug = true 2024-09-12T02:21:57.617 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:21:57.617 INFO:teuthology.orchestra.run.smithi060.stdout: ms die on old message = true 2024-09-12T02:21:57.617 INFO:teuthology.orchestra.run.smithi060.stdout: ms die on bug = true 2024-09-12T02:21:57.618 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:21:57.618 INFO:teuthology.orchestra.run.smithi060.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T02:21:57.618 INFO:teuthology.orchestra.run.smithi060.stdout: mon pg warn max object skew = 0 2024-09-12T02:21:57.618 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:21:57.618 INFO:teuthology.orchestra.run.smithi060.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T02:21:57.618 INFO:teuthology.orchestra.run.smithi060.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T02:21:57.618 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:21:57.618 INFO:teuthology.orchestra.run.smithi060.stdout: osd pool default size = 2 2024-09-12T02:21:57.618 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:21:57.618 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd allow primary affinity = true 2024-09-12T02:21:57.618 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd allow pg remap = true 2024-09-12T02:21:57.618 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on legacy crush tunables = false 2024-09-12T02:21:57.618 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on crush straw calc version zero = false 2024-09-12T02:21:57.618 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on no sortbitwise = false 2024-09-12T02:21:57.619 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on osd down out interval zero = false 2024-09-12T02:21:57.619 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on too few osds = false 2024-09-12T02:21:57.619 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T02:21:57.619 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T02:21:57.619 INFO:teuthology.orchestra.run.smithi060.stdout: mon_allow_pool_size_one = true 2024-09-12T02:21:57.619 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:21:57.619 INFO:teuthology.orchestra.run.smithi060.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T02:21:57.619 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:21:57.619 INFO:teuthology.orchestra.run.smithi060.stdout: osd default data pool replay window = 5 2024-09-12T02:21:57.619 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:21:57.619 INFO:teuthology.orchestra.run.smithi060.stdout: mon allow pool delete = true 2024-09-12T02:21:57.619 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:21:57.619 INFO:teuthology.orchestra.run.smithi060.stdout: mon cluster log file level = debug 2024-09-12T02:21:57.619 INFO:teuthology.orchestra.run.smithi060.stdout: debug asserts on shutdown = true 2024-09-12T02:21:57.620 INFO:teuthology.orchestra.run.smithi060.stdout: mon health detail to clog = false 2024-09-12T02:21:57.620 INFO:teuthology.orchestra.run.smithi060.stdout: mon host = "172.21.15.60,172.21.15.105,[v2:172.21.15.105:3301,v1:172.21.15.105:6790]" 2024-09-12T02:21:57.620 INFO:teuthology.orchestra.run.smithi060.stdout: fsid = ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1 2024-09-12T02:21:57.620 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:21:57.620 INFO:teuthology.orchestra.run.smithi060.stdout:[osd] 2024-09-12T02:21:57.620 INFO:teuthology.orchestra.run.smithi060.stdout: osd journal size = 100 2024-09-12T02:21:57.620 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:21:57.620 INFO:teuthology.orchestra.run.smithi060.stdout: osd scrub load threshold = 5.0 2024-09-12T02:21:57.620 INFO:teuthology.orchestra.run.smithi060.stdout: osd scrub max interval = 600 2024-09-12T02:21:57.620 INFO:teuthology.orchestra.run.smithi060.stdout: osd mclock profile = high_recovery_ops 2024-09-12T02:21:57.620 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:21:57.620 INFO:teuthology.orchestra.run.smithi060.stdout: osd recover clone overlap = true 2024-09-12T02:21:57.620 INFO:teuthology.orchestra.run.smithi060.stdout: osd recovery max chunk = 1048576 2024-09-12T02:21:57.621 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:21:57.621 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug shutdown = true 2024-09-12T02:21:57.621 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug op order = true 2024-09-12T02:21:57.621 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug verify stray on activate = true 2024-09-12T02:21:57.621 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug trim objects = true 2024-09-12T02:21:57.621 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:21:57.621 INFO:teuthology.orchestra.run.smithi060.stdout: osd open classes on start = true 2024-09-12T02:21:57.621 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug pg log writeout = true 2024-09-12T02:21:57.621 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:21:57.621 INFO:teuthology.orchestra.run.smithi060.stdout: osd deep scrub update digest min age = 30 2024-09-12T02:21:57.621 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:21:57.621 INFO:teuthology.orchestra.run.smithi060.stdout: osd map max advance = 10 2024-09-12T02:21:57.621 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:21:57.621 INFO:teuthology.orchestra.run.smithi060.stdout: journal zero on create = true 2024-09-12T02:21:57.622 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:21:57.622 INFO:teuthology.orchestra.run.smithi060.stdout: filestore ondisk finisher threads = 3 2024-09-12T02:21:57.622 INFO:teuthology.orchestra.run.smithi060.stdout: filestore apply finisher threads = 3 2024-09-12T02:21:57.622 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:21:57.622 INFO:teuthology.orchestra.run.smithi060.stdout: bdev debug aio = true 2024-09-12T02:21:57.622 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug misdirected ops = true 2024-09-12T02:21:57.622 INFO:teuthology.orchestra.run.smithi060.stdout: bdev async discard = True 2024-09-12T02:21:57.622 INFO:teuthology.orchestra.run.smithi060.stdout: bdev enable discard = True 2024-09-12T02:21:57.622 INFO:teuthology.orchestra.run.smithi060.stdout: bluestore allocator = bitmap 2024-09-12T02:21:57.622 INFO:teuthology.orchestra.run.smithi060.stdout: bluestore block size = 96636764160 2024-09-12T02:21:57.622 INFO:teuthology.orchestra.run.smithi060.stdout: bluestore fsck on mount = True 2024-09-12T02:21:57.622 INFO:teuthology.orchestra.run.smithi060.stdout: debug bluefs = 1/20 2024-09-12T02:21:57.622 INFO:teuthology.orchestra.run.smithi060.stdout: debug bluestore = 1/20 2024-09-12T02:21:57.622 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2024-09-12T02:21:57.622 INFO:teuthology.orchestra.run.smithi060.stdout: debug osd = 20 2024-09-12T02:21:57.623 INFO:teuthology.orchestra.run.smithi060.stdout: debug rocksdb = 4/10 2024-09-12T02:21:57.623 INFO:teuthology.orchestra.run.smithi060.stdout: filestore flush min = 0 2024-09-12T02:21:57.623 INFO:teuthology.orchestra.run.smithi060.stdout: mon client directed command retry = 5 2024-09-12T02:21:57.623 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T02:21:57.623 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd full ratio = 0.9 2024-09-12T02:21:57.623 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd nearfull ratio = 0.8 2024-09-12T02:21:57.623 INFO:teuthology.orchestra.run.smithi060.stdout: ms inject delay max = 1 2024-09-12T02:21:57.623 INFO:teuthology.orchestra.run.smithi060.stdout: ms inject delay probability = 0.005 2024-09-12T02:21:57.623 INFO:teuthology.orchestra.run.smithi060.stdout: ms inject delay type = client mds 2024-09-12T02:21:57.623 INFO:teuthology.orchestra.run.smithi060.stdout: ms inject socket failures = 2500 2024-09-12T02:21:57.623 INFO:teuthology.orchestra.run.smithi060.stdout: osd blocked scrub grace period = 3600 2024-09-12T02:21:57.623 INFO:teuthology.orchestra.run.smithi060.stdout: osd failsafe full ratio = 0.95 2024-09-12T02:21:57.623 INFO:teuthology.orchestra.run.smithi060.stdout: osd max markdown count = 1000 2024-09-12T02:21:57.623 INFO:teuthology.orchestra.run.smithi060.stdout: osd objectstore = bluestore 2024-09-12T02:21:57.624 INFO:teuthology.orchestra.run.smithi060.stdout: osd op complaint time = 180 2024-09-12T02:21:57.624 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:21:57.624 INFO:teuthology.orchestra.run.smithi060.stdout:[mgr] 2024-09-12T02:21:57.624 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2024-09-12T02:21:57.624 INFO:teuthology.orchestra.run.smithi060.stdout: debug mgr = 20 2024-09-12T02:21:57.624 INFO:teuthology.orchestra.run.smithi060.stdout: debug mon = 20 2024-09-12T02:21:57.624 INFO:teuthology.orchestra.run.smithi060.stdout: debug auth = 20 2024-09-12T02:21:57.624 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min pgs per osd = 4 2024-09-12T02:21:57.624 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min bytes per osd = 10 2024-09-12T02:21:57.624 INFO:teuthology.orchestra.run.smithi060.stdout: mgr/telemetry/nag = false 2024-09-12T02:21:57.624 INFO:teuthology.orchestra.run.smithi060.stdout: debug client = 20 2024-09-12T02:21:57.624 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:21:57.624 INFO:teuthology.orchestra.run.smithi060.stdout:[mon] 2024-09-12T02:21:57.624 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2024-09-12T02:21:57.625 INFO:teuthology.orchestra.run.smithi060.stdout: debug mon = 20 2024-09-12T02:21:57.625 INFO:teuthology.orchestra.run.smithi060.stdout: debug paxos = 20 2024-09-12T02:21:57.625 INFO:teuthology.orchestra.run.smithi060.stdout: debug auth = 20 2024-09-12T02:21:57.625 INFO:teuthology.orchestra.run.smithi060.stdout: mon data avail warn = 5 2024-09-12T02:21:57.625 INFO:teuthology.orchestra.run.smithi060.stdout: mon mgr mkfs grace = 240 2024-09-12T02:21:57.625 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min pgs per osd = 4 2024-09-12T02:21:57.625 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd reporter subtree level = osd 2024-09-12T02:21:57.625 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd prime pg temp = true 2024-09-12T02:21:57.625 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min bytes per osd = 10 2024-09-12T02:21:57.625 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:21:57.625 INFO:teuthology.orchestra.run.smithi060.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T02:21:57.625 INFO:teuthology.orchestra.run.smithi060.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T02:21:57.625 INFO:teuthology.orchestra.run.smithi060.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T02:21:57.625 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:21:57.626 INFO:teuthology.orchestra.run.smithi060.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T02:21:57.626 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T02:21:57.626 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T02:21:57.626 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:21:57.626 INFO:teuthology.orchestra.run.smithi060.stdout: # 1m isn't quite enough 2024-09-12T02:21:57.626 INFO:teuthology.orchestra.run.smithi060.stdout: mon_down_mkfs_grace = 2m 2024-09-12T02:21:57.626 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:21:57.626 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_filestore_osds = false 2024-09-12T02:21:57.626 INFO:teuthology.orchestra.run.smithi060.stdout: mon down mkfs grace = 300 2024-09-12T02:21:57.626 INFO:teuthology.orchestra.run.smithi060.stdout: mon op complaint time = 120 2024-09-12T02:21:57.626 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on pool no app = False 2024-09-12T02:21:57.626 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:21:57.626 INFO:teuthology.orchestra.run.smithi060.stdout:[client] 2024-09-12T02:21:57.626 INFO:teuthology.orchestra.run.smithi060.stdout: rgw cache enabled = true 2024-09-12T02:21:57.627 INFO:teuthology.orchestra.run.smithi060.stdout: rgw enable ops log = true 2024-09-12T02:21:57.627 INFO:teuthology.orchestra.run.smithi060.stdout: rgw enable usage log = true 2024-09-12T02:21:57.627 INFO:teuthology.orchestra.run.smithi060.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T02:21:57.627 INFO:teuthology.orchestra.run.smithi060.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T02:21:57.627 INFO:teuthology.orchestra.run.smithi060.stdout: client mount timeout = 600 2024-09-12T02:21:57.627 INFO:teuthology.orchestra.run.smithi060.stdout: client_shutdown_timeout = 120 2024-09-12T02:21:57.627 INFO:teuthology.orchestra.run.smithi060.stdout: debug client = 20 2024-09-12T02:21:57.627 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2024-09-12T02:21:57.627 INFO:teuthology.orchestra.run.smithi060.stdout: rados mon op timeout = 900 2024-09-12T02:21:57.627 INFO:teuthology.orchestra.run.smithi060.stdout: rados osd op timeout = 900 2024-09-12T02:21:57.627 INFO:teuthology.orchestra.run.smithi060.stdout:[mon.a] 2024-09-12T02:21:57.627 INFO:teuthology.orchestra.run.smithi060.stdout:[mon.b] 2024-09-12T02:21:57.627 INFO:teuthology.orchestra.run.smithi060.stdout:[mon.c] 2024-09-12T02:21:57.627 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.a] 2024-09-12T02:21:57.628 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.c] 2024-09-12T02:21:57.628 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.b] 2024-09-12T02:21:57.628 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.d] 2024-09-12T02:21:57.628 INFO:teuthology.orchestra.run.smithi060.stdout:[mds] 2024-09-12T02:21:57.628 INFO:teuthology.orchestra.run.smithi060.stdout: debug mds = 20 2024-09-12T02:21:57.628 INFO:teuthology.orchestra.run.smithi060.stdout: debug mds balancer = 20 2024-09-12T02:21:57.628 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2024-09-12T02:21:57.628 INFO:teuthology.orchestra.run.smithi060.stdout: mds bal fragment size max = 10000 2024-09-12T02:21:57.628 INFO:teuthology.orchestra.run.smithi060.stdout: mds bal merge size = 5 2024-09-12T02:21:57.628 INFO:teuthology.orchestra.run.smithi060.stdout: mds bal split bits = 3 2024-09-12T02:21:57.628 INFO:teuthology.orchestra.run.smithi060.stdout: mds bal split size = 100 2024-09-12T02:21:57.628 INFO:teuthology.orchestra.run.smithi060.stdout: mds debug frag = True 2024-09-12T02:21:57.628 INFO:teuthology.orchestra.run.smithi060.stdout: mds debug scatterstat = True 2024-09-12T02:21:57.628 INFO:teuthology.orchestra.run.smithi060.stdout: mds op complaint time = 180 2024-09-12T02:21:57.629 INFO:teuthology.orchestra.run.smithi060.stdout: mds verify scatter = True 2024-09-12T02:21:57.629 INFO:teuthology.orchestra.run.smithi060.stdout: mon client directed command retry = 5 2024-09-12T02:21:57.629 INFO:teuthology.orchestra.run.smithi060.stdout: ms inject delay max = 1 2024-09-12T02:21:57.629 INFO:teuthology.orchestra.run.smithi060.stdout: ms inject delay probability = 0.005 2024-09-12T02:21:57.629 INFO:teuthology.orchestra.run.smithi060.stdout: ms inject delay type = client mds osd 2024-09-12T02:21:57.629 INFO:teuthology.orchestra.run.smithi060.stdout: ms inject socket failures = 2500 2024-09-12T02:21:57.629 INFO:teuthology.orchestra.run.smithi060.stdout: osd op complaint time = 180 2024-09-12T02:21:57.629 INFO:teuthology.orchestra.run.smithi060.stdout: rados mon op timeout = 900 2024-09-12T02:21:57.629 INFO:teuthology.orchestra.run.smithi060.stdout: rados osd op timeout = 900 2024-09-12T02:21:57.631 INFO:teuthology.orchestra.run.smithi105.stdout:[global] 2024-09-12T02:21:57.631 INFO:teuthology.orchestra.run.smithi105.stdout: chdir = "" 2024-09-12T02:21:57.631 INFO:teuthology.orchestra.run.smithi105.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T02:21:57.631 INFO:teuthology.orchestra.run.smithi105.stdout: auth supported = cephx 2024-09-12T02:21:57.631 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:21:57.631 INFO:teuthology.orchestra.run.smithi105.stdout: filestore xattr use omap = true 2024-09-12T02:21:57.631 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:21:57.631 INFO:teuthology.orchestra.run.smithi105.stdout: mon clock drift allowed = 1.000 2024-09-12T02:21:57.632 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:21:57.632 INFO:teuthology.orchestra.run.smithi105.stdout: osd crush chooseleaf type = 0 2024-09-12T02:21:57.632 INFO:teuthology.orchestra.run.smithi105.stdout: auth debug = true 2024-09-12T02:21:57.632 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:21:57.632 INFO:teuthology.orchestra.run.smithi105.stdout: ms die on old message = true 2024-09-12T02:21:57.632 INFO:teuthology.orchestra.run.smithi105.stdout: ms die on bug = true 2024-09-12T02:21:57.632 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:21:57.632 INFO:teuthology.orchestra.run.smithi105.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T02:21:57.632 INFO:teuthology.orchestra.run.smithi105.stdout: mon pg warn max object skew = 0 2024-09-12T02:21:57.632 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:21:57.632 INFO:teuthology.orchestra.run.smithi105.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T02:21:57.632 INFO:teuthology.orchestra.run.smithi105.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T02:21:57.632 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:21:57.633 INFO:teuthology.orchestra.run.smithi105.stdout: osd pool default size = 2 2024-09-12T02:21:57.633 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:21:57.633 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd allow primary affinity = true 2024-09-12T02:21:57.633 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd allow pg remap = true 2024-09-12T02:21:57.633 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on legacy crush tunables = false 2024-09-12T02:21:57.633 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on crush straw calc version zero = false 2024-09-12T02:21:57.633 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on no sortbitwise = false 2024-09-12T02:21:57.633 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on osd down out interval zero = false 2024-09-12T02:21:57.633 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on too few osds = false 2024-09-12T02:21:57.633 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T02:21:57.633 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T02:21:57.633 INFO:teuthology.orchestra.run.smithi105.stdout: mon_allow_pool_size_one = true 2024-09-12T02:21:57.633 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:21:57.633 INFO:teuthology.orchestra.run.smithi105.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T02:21:57.634 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:21:57.634 INFO:teuthology.orchestra.run.smithi105.stdout: osd default data pool replay window = 5 2024-09-12T02:21:57.634 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:21:57.634 INFO:teuthology.orchestra.run.smithi105.stdout: mon allow pool delete = true 2024-09-12T02:21:57.634 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:21:57.634 INFO:teuthology.orchestra.run.smithi105.stdout: mon cluster log file level = debug 2024-09-12T02:21:57.634 INFO:teuthology.orchestra.run.smithi105.stdout: debug asserts on shutdown = true 2024-09-12T02:21:57.634 INFO:teuthology.orchestra.run.smithi105.stdout: mon health detail to clog = false 2024-09-12T02:21:57.634 INFO:teuthology.orchestra.run.smithi105.stdout: mon host = "172.21.15.60,172.21.15.105,[v2:172.21.15.105:3301,v1:172.21.15.105:6790]" 2024-09-12T02:21:57.634 INFO:teuthology.orchestra.run.smithi105.stdout: fsid = ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1 2024-09-12T02:21:57.634 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:21:57.634 INFO:teuthology.orchestra.run.smithi105.stdout:[osd] 2024-09-12T02:21:57.634 INFO:teuthology.orchestra.run.smithi105.stdout: osd journal size = 100 2024-09-12T02:21:57.634 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:21:57.635 INFO:teuthology.orchestra.run.smithi105.stdout: osd scrub load threshold = 5.0 2024-09-12T02:21:57.635 INFO:teuthology.orchestra.run.smithi105.stdout: osd scrub max interval = 600 2024-09-12T02:21:57.635 INFO:teuthology.orchestra.run.smithi105.stdout: osd mclock profile = high_recovery_ops 2024-09-12T02:21:57.635 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:21:57.635 INFO:teuthology.orchestra.run.smithi105.stdout: osd recover clone overlap = true 2024-09-12T02:21:57.635 INFO:teuthology.orchestra.run.smithi105.stdout: osd recovery max chunk = 1048576 2024-09-12T02:21:57.635 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:21:57.635 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug shutdown = true 2024-09-12T02:21:57.635 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug op order = true 2024-09-12T02:21:57.635 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug verify stray on activate = true 2024-09-12T02:21:57.635 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug trim objects = true 2024-09-12T02:21:57.635 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:21:57.635 INFO:teuthology.orchestra.run.smithi105.stdout: osd open classes on start = true 2024-09-12T02:21:57.635 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug pg log writeout = true 2024-09-12T02:21:57.636 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:21:57.636 INFO:teuthology.orchestra.run.smithi105.stdout: osd deep scrub update digest min age = 30 2024-09-12T02:21:57.636 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:21:57.636 INFO:teuthology.orchestra.run.smithi105.stdout: osd map max advance = 10 2024-09-12T02:21:57.636 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:21:57.636 INFO:teuthology.orchestra.run.smithi105.stdout: journal zero on create = true 2024-09-12T02:21:57.636 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:21:57.636 INFO:teuthology.orchestra.run.smithi105.stdout: filestore ondisk finisher threads = 3 2024-09-12T02:21:57.636 INFO:teuthology.orchestra.run.smithi105.stdout: filestore apply finisher threads = 3 2024-09-12T02:21:57.636 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:21:57.636 INFO:teuthology.orchestra.run.smithi105.stdout: bdev debug aio = true 2024-09-12T02:21:57.636 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug misdirected ops = true 2024-09-12T02:21:57.636 INFO:teuthology.orchestra.run.smithi105.stdout: bdev async discard = True 2024-09-12T02:21:57.637 INFO:teuthology.orchestra.run.smithi105.stdout: bdev enable discard = True 2024-09-12T02:21:57.637 INFO:teuthology.orchestra.run.smithi105.stdout: bluestore allocator = bitmap 2024-09-12T02:21:57.637 INFO:teuthology.orchestra.run.smithi105.stdout: bluestore block size = 96636764160 2024-09-12T02:21:57.637 INFO:teuthology.orchestra.run.smithi105.stdout: bluestore fsck on mount = True 2024-09-12T02:21:57.637 INFO:teuthology.orchestra.run.smithi105.stdout: debug bluefs = 1/20 2024-09-12T02:21:57.637 INFO:teuthology.orchestra.run.smithi105.stdout: debug bluestore = 1/20 2024-09-12T02:21:57.637 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2024-09-12T02:21:57.637 INFO:teuthology.orchestra.run.smithi105.stdout: debug osd = 20 2024-09-12T02:21:57.637 INFO:teuthology.orchestra.run.smithi105.stdout: debug rocksdb = 4/10 2024-09-12T02:21:57.637 INFO:teuthology.orchestra.run.smithi105.stdout: filestore flush min = 0 2024-09-12T02:21:57.637 INFO:teuthology.orchestra.run.smithi105.stdout: mon client directed command retry = 5 2024-09-12T02:21:57.637 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T02:21:57.637 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd full ratio = 0.9 2024-09-12T02:21:57.637 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd nearfull ratio = 0.8 2024-09-12T02:21:57.638 INFO:teuthology.orchestra.run.smithi105.stdout: ms inject delay max = 1 2024-09-12T02:21:57.638 INFO:teuthology.orchestra.run.smithi105.stdout: ms inject delay probability = 0.005 2024-09-12T02:21:57.638 INFO:teuthology.orchestra.run.smithi105.stdout: ms inject delay type = client mds 2024-09-12T02:21:57.638 INFO:teuthology.orchestra.run.smithi105.stdout: ms inject socket failures = 2500 2024-09-12T02:21:57.638 INFO:teuthology.orchestra.run.smithi105.stdout: osd blocked scrub grace period = 3600 2024-09-12T02:21:57.638 INFO:teuthology.orchestra.run.smithi105.stdout: osd failsafe full ratio = 0.95 2024-09-12T02:21:57.638 INFO:teuthology.orchestra.run.smithi105.stdout: osd max markdown count = 1000 2024-09-12T02:21:57.638 INFO:teuthology.orchestra.run.smithi105.stdout: osd objectstore = bluestore 2024-09-12T02:21:57.638 INFO:teuthology.orchestra.run.smithi105.stdout: osd op complaint time = 180 2024-09-12T02:21:57.638 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:21:57.638 INFO:teuthology.orchestra.run.smithi105.stdout:[mgr] 2024-09-12T02:21:57.638 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2024-09-12T02:21:57.638 INFO:teuthology.orchestra.run.smithi105.stdout: debug mgr = 20 2024-09-12T02:21:57.638 INFO:teuthology.orchestra.run.smithi105.stdout: debug mon = 20 2024-09-12T02:21:57.639 INFO:teuthology.orchestra.run.smithi105.stdout: debug auth = 20 2024-09-12T02:21:57.639 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min pgs per osd = 4 2024-09-12T02:21:57.639 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min bytes per osd = 10 2024-09-12T02:21:57.639 INFO:teuthology.orchestra.run.smithi105.stdout: mgr/telemetry/nag = false 2024-09-12T02:21:57.639 INFO:teuthology.orchestra.run.smithi105.stdout: debug client = 20 2024-09-12T02:21:57.639 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:21:57.639 INFO:teuthology.orchestra.run.smithi105.stdout:[mon] 2024-09-12T02:21:57.639 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2024-09-12T02:21:57.639 INFO:teuthology.orchestra.run.smithi105.stdout: debug mon = 20 2024-09-12T02:21:57.639 INFO:teuthology.orchestra.run.smithi105.stdout: debug paxos = 20 2024-09-12T02:21:57.639 INFO:teuthology.orchestra.run.smithi105.stdout: debug auth = 20 2024-09-12T02:21:57.639 INFO:teuthology.orchestra.run.smithi105.stdout: mon data avail warn = 5 2024-09-12T02:21:57.639 INFO:teuthology.orchestra.run.smithi105.stdout: mon mgr mkfs grace = 240 2024-09-12T02:21:57.640 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min pgs per osd = 4 2024-09-12T02:21:57.640 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd reporter subtree level = osd 2024-09-12T02:21:57.640 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd prime pg temp = true 2024-09-12T02:21:57.640 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min bytes per osd = 10 2024-09-12T02:21:57.640 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:21:57.640 INFO:teuthology.orchestra.run.smithi105.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T02:21:57.640 INFO:teuthology.orchestra.run.smithi105.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T02:21:57.640 INFO:teuthology.orchestra.run.smithi105.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T02:21:57.640 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:21:57.640 INFO:teuthology.orchestra.run.smithi105.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T02:21:57.640 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T02:21:57.640 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T02:21:57.640 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:21:57.641 INFO:teuthology.orchestra.run.smithi105.stdout: # 1m isn't quite enough 2024-09-12T02:21:57.641 INFO:teuthology.orchestra.run.smithi105.stdout: mon_down_mkfs_grace = 2m 2024-09-12T02:21:57.641 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:21:57.641 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_filestore_osds = false 2024-09-12T02:21:57.641 INFO:teuthology.orchestra.run.smithi105.stdout: mon down mkfs grace = 300 2024-09-12T02:21:57.641 INFO:teuthology.orchestra.run.smithi105.stdout: mon op complaint time = 120 2024-09-12T02:21:57.641 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on pool no app = False 2024-09-12T02:21:57.641 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T02:21:57.641 INFO:teuthology.orchestra.run.smithi105.stdout:[client] 2024-09-12T02:21:57.641 INFO:teuthology.orchestra.run.smithi105.stdout: rgw cache enabled = true 2024-09-12T02:21:57.641 INFO:teuthology.orchestra.run.smithi105.stdout: rgw enable ops log = true 2024-09-12T02:21:57.641 INFO:teuthology.orchestra.run.smithi105.stdout: rgw enable usage log = true 2024-09-12T02:21:57.641 INFO:teuthology.orchestra.run.smithi105.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T02:21:57.641 INFO:teuthology.orchestra.run.smithi105.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T02:21:57.642 INFO:teuthology.orchestra.run.smithi105.stdout: client mount timeout = 600 2024-09-12T02:21:57.642 INFO:teuthology.orchestra.run.smithi105.stdout: client_shutdown_timeout = 120 2024-09-12T02:21:57.642 INFO:teuthology.orchestra.run.smithi105.stdout: debug client = 20 2024-09-12T02:21:57.642 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2024-09-12T02:21:57.642 INFO:teuthology.orchestra.run.smithi105.stdout: rados mon op timeout = 900 2024-09-12T02:21:57.642 INFO:teuthology.orchestra.run.smithi105.stdout: rados osd op timeout = 900 2024-09-12T02:21:57.642 INFO:teuthology.orchestra.run.smithi105.stdout:[mon.a] 2024-09-12T02:21:57.642 INFO:teuthology.orchestra.run.smithi105.stdout:[mon.b] 2024-09-12T02:21:57.642 INFO:teuthology.orchestra.run.smithi105.stdout:[mon.c] 2024-09-12T02:21:57.642 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.a] 2024-09-12T02:21:57.642 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.c] 2024-09-12T02:21:57.642 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.b] 2024-09-12T02:21:57.642 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.d] 2024-09-12T02:21:57.642 INFO:teuthology.orchestra.run.smithi105.stdout:[mds] 2024-09-12T02:21:57.643 INFO:teuthology.orchestra.run.smithi105.stdout: debug mds = 20 2024-09-12T02:21:57.643 INFO:teuthology.orchestra.run.smithi105.stdout: debug mds balancer = 20 2024-09-12T02:21:57.643 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2024-09-12T02:21:57.643 INFO:teuthology.orchestra.run.smithi105.stdout: mds bal fragment size max = 10000 2024-09-12T02:21:57.643 INFO:teuthology.orchestra.run.smithi105.stdout: mds bal merge size = 5 2024-09-12T02:21:57.643 INFO:teuthology.orchestra.run.smithi105.stdout: mds bal split bits = 3 2024-09-12T02:21:57.643 INFO:teuthology.orchestra.run.smithi105.stdout: mds bal split size = 100 2024-09-12T02:21:57.643 INFO:teuthology.orchestra.run.smithi105.stdout: mds debug frag = True 2024-09-12T02:21:57.643 INFO:teuthology.orchestra.run.smithi105.stdout: mds debug scatterstat = True 2024-09-12T02:21:57.643 INFO:teuthology.orchestra.run.smithi105.stdout: mds op complaint time = 180 2024-09-12T02:21:57.643 INFO:teuthology.orchestra.run.smithi105.stdout: mds verify scatter = True 2024-09-12T02:21:57.643 INFO:teuthology.orchestra.run.smithi105.stdout: mon client directed command retry = 5 2024-09-12T02:21:57.643 INFO:teuthology.orchestra.run.smithi105.stdout: ms inject delay max = 1 2024-09-12T02:21:57.644 INFO:teuthology.orchestra.run.smithi105.stdout: ms inject delay probability = 0.005 2024-09-12T02:21:57.644 INFO:teuthology.orchestra.run.smithi105.stdout: ms inject delay type = client mds osd 2024-09-12T02:21:57.644 INFO:teuthology.orchestra.run.smithi105.stdout: ms inject socket failures = 2500 2024-09-12T02:21:57.644 INFO:teuthology.orchestra.run.smithi105.stdout: osd op complaint time = 180 2024-09-12T02:21:57.644 INFO:teuthology.orchestra.run.smithi105.stdout: rados mon op timeout = 900 2024-09-12T02:21:57.644 INFO:teuthology.orchestra.run.smithi105.stdout: rados osd op timeout = 900 2024-09-12T02:21:57.644 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T02:21:57.644 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T02:21:57.727 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T02:21:57.727 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T02:21:57.727 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T02:21:57.743 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T02:21:57.743 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T02:21:57.799 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi060.front.sepia.ceph.com 2024-09-12T02:21:57.799 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T02:21:57.799 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T02:21:57.799 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T02:21:57.875 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T02:21:57.875 DEBUG:teuthology.orchestra.run.smithi060:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:21:57.931 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi105.front.sepia.ceph.com 2024-09-12T02:21:57.931 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T02:21:57.931 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T02:21:57.931 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T02:21:57.968 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T02:21:57.968 DEBUG:teuthology.orchestra.run.smithi105:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:21:58.021 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T02:21:58.021 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T02:21:58.022 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T02:21:58.074 INFO:teuthology.orchestra.run.smithi060.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T02:21:58.077 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T02:21:58.134 INFO:teuthology.orchestra.run.smithi105.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T02:21:58.136 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T02:21:58.137 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-12T02:21:58.190 INFO:teuthology.orchestra.run.smithi060.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-12T02:21:58.193 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-12T02:21:58.219 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-12T02:21:58.312 INFO:teuthology.orchestra.run.smithi060.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-12T02:21:58.314 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-12T02:21:58.340 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-12T02:21:58.392 INFO:teuthology.orchestra.run.smithi105.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-12T02:21:58.395 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-12T02:21:58.420 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-12T02:21:58.511 INFO:teuthology.orchestra.run.smithi105.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-12T02:21:58.513 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-12T02:21:58.538 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T02:21:58.538 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T02:21:58.582 INFO:teuthology.orchestra.run.smithi060.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T02:21:58.595 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-12T02:21:58.636 INFO:teuthology.orchestra.run.smithi105.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-12T02:21:58.648 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T02:21:58.649 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi060.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi105.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T02:21:58.649 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T02:21:58.675 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T02:21:58.675 INFO:tasks.ceph:role: osd.0 2024-09-12T02:21:58.675 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi060.front.sepia.ceph.com 2024-09-12T02:21:58.675 DEBUG:teuthology.orchestra.run.smithi060:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T02:21:58.740 INFO:teuthology.orchestra.run.smithi060.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T02:21:58.740 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T02:21:58.741 INFO:teuthology.orchestra.run.smithi060.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T02:21:58.741 INFO:teuthology.orchestra.run.smithi060.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T02:21:58.741 INFO:teuthology.orchestra.run.smithi060.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T02:21:58.741 INFO:teuthology.orchestra.run.smithi060.stdout: = sunit=0 swidth=0 blks 2024-09-12T02:21:58.741 INFO:teuthology.orchestra.run.smithi060.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T02:21:58.741 INFO:teuthology.orchestra.run.smithi060.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T02:21:58.741 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T02:21:58.741 INFO:teuthology.orchestra.run.smithi060.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T02:21:58.772 INFO:teuthology.orchestra.run.smithi060.stdout:Discarding blocks...Done. 2024-09-12T02:21:58.774 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi060.front.sepia.ceph.com -o noatime 2024-09-12T02:21:58.775 DEBUG:teuthology.orchestra.run.smithi060:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T02:21:58.845 DEBUG:teuthology.orchestra.run.smithi060:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T02:21:58.916 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T02:21:58.982 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T02:21:58.982 INFO:tasks.ceph:role: osd.1 2024-09-12T02:21:58.982 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi060.front.sepia.ceph.com 2024-09-12T02:21:58.982 DEBUG:teuthology.orchestra.run.smithi060:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T02:21:59.047 INFO:teuthology.orchestra.run.smithi060.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T02:21:59.047 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T02:21:59.047 INFO:teuthology.orchestra.run.smithi060.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T02:21:59.047 INFO:teuthology.orchestra.run.smithi060.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T02:21:59.047 INFO:teuthology.orchestra.run.smithi060.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T02:21:59.048 INFO:teuthology.orchestra.run.smithi060.stdout: = sunit=0 swidth=0 blks 2024-09-12T02:21:59.048 INFO:teuthology.orchestra.run.smithi060.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T02:21:59.048 INFO:teuthology.orchestra.run.smithi060.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T02:21:59.048 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T02:21:59.048 INFO:teuthology.orchestra.run.smithi060.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T02:21:59.080 INFO:teuthology.orchestra.run.smithi060.stdout:Discarding blocks...Done. 2024-09-12T02:21:59.081 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi060.front.sepia.ceph.com -o noatime 2024-09-12T02:21:59.082 DEBUG:teuthology.orchestra.run.smithi060:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-12T02:21:59.152 DEBUG:teuthology.orchestra.run.smithi060:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T02:21:59.225 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T02:21:59.291 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T02:21:59.291 INFO:tasks.ceph:role: osd.2 2024-09-12T02:21:59.291 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi060.front.sepia.ceph.com 2024-09-12T02:21:59.291 DEBUG:teuthology.orchestra.run.smithi060:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T02:21:59.356 INFO:teuthology.orchestra.run.smithi060.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T02:21:59.357 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T02:21:59.357 INFO:teuthology.orchestra.run.smithi060.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T02:21:59.357 INFO:teuthology.orchestra.run.smithi060.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T02:21:59.357 INFO:teuthology.orchestra.run.smithi060.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T02:21:59.357 INFO:teuthology.orchestra.run.smithi060.stdout: = sunit=0 swidth=0 blks 2024-09-12T02:21:59.357 INFO:teuthology.orchestra.run.smithi060.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T02:21:59.357 INFO:teuthology.orchestra.run.smithi060.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T02:21:59.357 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T02:21:59.357 INFO:teuthology.orchestra.run.smithi060.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T02:21:59.389 INFO:teuthology.orchestra.run.smithi060.stdout:Discarding blocks...Done. 2024-09-12T02:21:59.391 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi060.front.sepia.ceph.com -o noatime 2024-09-12T02:21:59.391 DEBUG:teuthology.orchestra.run.smithi060:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-12T02:21:59.461 DEBUG:teuthology.orchestra.run.smithi060:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T02:21:59.532 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-12T02:21:59.606 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T02:21:59.606 INFO:tasks.ceph:role: osd.3 2024-09-12T02:21:59.606 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi060.front.sepia.ceph.com 2024-09-12T02:21:59.606 DEBUG:teuthology.orchestra.run.smithi060:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T02:21:59.672 INFO:teuthology.orchestra.run.smithi060.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T02:21:59.672 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T02:21:59.672 INFO:teuthology.orchestra.run.smithi060.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T02:21:59.672 INFO:teuthology.orchestra.run.smithi060.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T02:21:59.672 INFO:teuthology.orchestra.run.smithi060.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T02:21:59.672 INFO:teuthology.orchestra.run.smithi060.stdout: = sunit=0 swidth=0 blks 2024-09-12T02:21:59.672 INFO:teuthology.orchestra.run.smithi060.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T02:21:59.672 INFO:teuthology.orchestra.run.smithi060.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T02:21:59.672 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T02:21:59.672 INFO:teuthology.orchestra.run.smithi060.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T02:21:59.704 INFO:teuthology.orchestra.run.smithi060.stdout:Discarding blocks...Done. 2024-09-12T02:21:59.706 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi060.front.sepia.ceph.com -o noatime 2024-09-12T02:21:59.706 DEBUG:teuthology.orchestra.run.smithi060:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-12T02:21:59.781 DEBUG:teuthology.orchestra.run.smithi060:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-12T02:21:59.851 DEBUG:teuthology.orchestra.run.smithi060:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:21:59.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:21:59.944+0000 7feca460b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T02:21:59.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:21:59.944+0000 7feca460b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T02:21:59.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:21:59.944+0000 7feca460b640 -1 bdev(0x556f495c5800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T02:21:59.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:21:59.945+0000 7feca460b640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T02:22:03.361 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T02:22:03.392 DEBUG:teuthology.orchestra.run.smithi060:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:22:03.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:03.482+0000 7ff63bc11640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T02:22:03.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:03.482+0000 7ff63bc11640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T02:22:03.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:03.482+0000 7ff63bc11640 -1 bdev(0x559cba207800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T02:22:03.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:03.482+0000 7ff63bc11640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T02:22:06.886 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T02:22:06.919 DEBUG:teuthology.orchestra.run.smithi060:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:22:07.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:07.011+0000 7fee89415640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T02:22:07.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:07.011+0000 7fee89415640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T02:22:07.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:07.011+0000 7fee89415640 -1 bdev(0x55f1f9d4b800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T02:22:07.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:07.012+0000 7fee89415640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T02:22:09.943 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T02:22:09.973 DEBUG:teuthology.orchestra.run.smithi060:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:22:10.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:10.065+0000 7fe70603b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-12T02:22:10.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:10.065+0000 7fe70603b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-12T02:22:10.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:10.066+0000 7fe70603b640 -1 bdev(0x5568ca06f800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-12T02:22:10.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:10.066+0000 7fe70603b640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-12T02:22:12.981 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-12T02:22:13.013 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-12T02:22:13.044 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T02:22:13.044 INFO:tasks.ceph:role: osd.4 2024-09-12T02:22:13.044 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi105.front.sepia.ceph.com 2024-09-12T02:22:13.045 DEBUG:teuthology.orchestra.run.smithi105:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T02:22:13.121 INFO:teuthology.orchestra.run.smithi105.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T02:22:13.123 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T02:22:13.123 INFO:teuthology.orchestra.run.smithi105.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T02:22:13.123 INFO:teuthology.orchestra.run.smithi105.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T02:22:13.123 INFO:teuthology.orchestra.run.smithi105.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T02:22:13.123 INFO:teuthology.orchestra.run.smithi105.stdout: = sunit=0 swidth=0 blks 2024-09-12T02:22:13.123 INFO:teuthology.orchestra.run.smithi105.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T02:22:13.123 INFO:teuthology.orchestra.run.smithi105.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T02:22:13.123 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T02:22:13.124 INFO:teuthology.orchestra.run.smithi105.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T02:22:13.628 INFO:teuthology.orchestra.run.smithi105.stdout:Discarding blocks...Done. 2024-09-12T02:22:13.630 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi105.front.sepia.ceph.com -o noatime 2024-09-12T02:22:13.631 DEBUG:teuthology.orchestra.run.smithi105:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-12T02:22:13.778 DEBUG:teuthology.orchestra.run.smithi105:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-12T02:22:13.812 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-12T02:22:13.880 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T02:22:13.880 INFO:tasks.ceph:role: osd.5 2024-09-12T02:22:13.880 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi105.front.sepia.ceph.com 2024-09-12T02:22:13.880 DEBUG:teuthology.orchestra.run.smithi105:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T02:22:13.954 INFO:teuthology.orchestra.run.smithi105.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T02:22:13.955 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T02:22:13.955 INFO:teuthology.orchestra.run.smithi105.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T02:22:13.955 INFO:teuthology.orchestra.run.smithi105.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T02:22:13.955 INFO:teuthology.orchestra.run.smithi105.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T02:22:13.955 INFO:teuthology.orchestra.run.smithi105.stdout: = sunit=0 swidth=0 blks 2024-09-12T02:22:13.955 INFO:teuthology.orchestra.run.smithi105.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T02:22:13.955 INFO:teuthology.orchestra.run.smithi105.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T02:22:13.955 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T02:22:13.955 INFO:teuthology.orchestra.run.smithi105.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T02:22:14.397 INFO:teuthology.orchestra.run.smithi105.stdout:Discarding blocks...Done. 2024-09-12T02:22:14.400 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi105.front.sepia.ceph.com -o noatime 2024-09-12T02:22:14.400 DEBUG:teuthology.orchestra.run.smithi105:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-12T02:22:14.482 DEBUG:teuthology.orchestra.run.smithi105:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-12T02:22:14.551 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-12T02:22:14.615 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T02:22:14.616 INFO:tasks.ceph:role: osd.6 2024-09-12T02:22:14.616 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi105.front.sepia.ceph.com 2024-09-12T02:22:14.616 DEBUG:teuthology.orchestra.run.smithi105:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T02:22:14.688 INFO:teuthology.orchestra.run.smithi105.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T02:22:14.688 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T02:22:14.688 INFO:teuthology.orchestra.run.smithi105.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T02:22:14.688 INFO:teuthology.orchestra.run.smithi105.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T02:22:14.688 INFO:teuthology.orchestra.run.smithi105.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T02:22:14.689 INFO:teuthology.orchestra.run.smithi105.stdout: = sunit=0 swidth=0 blks 2024-09-12T02:22:14.689 INFO:teuthology.orchestra.run.smithi105.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T02:22:14.689 INFO:teuthology.orchestra.run.smithi105.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T02:22:14.689 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T02:22:14.689 INFO:teuthology.orchestra.run.smithi105.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T02:22:15.169 INFO:teuthology.orchestra.run.smithi105.stdout:Discarding blocks...Done. 2024-09-12T02:22:15.172 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi105.front.sepia.ceph.com -o noatime 2024-09-12T02:22:15.172 DEBUG:teuthology.orchestra.run.smithi105:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-12T02:22:15.301 DEBUG:teuthology.orchestra.run.smithi105:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-12T02:22:15.334 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-12T02:22:15.399 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T02:22:15.399 INFO:tasks.ceph:role: osd.7 2024-09-12T02:22:15.399 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi105.front.sepia.ceph.com 2024-09-12T02:22:15.400 DEBUG:teuthology.orchestra.run.smithi105:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T02:22:15.471 INFO:teuthology.orchestra.run.smithi105.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T02:22:15.471 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T02:22:15.471 INFO:teuthology.orchestra.run.smithi105.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T02:22:15.471 INFO:teuthology.orchestra.run.smithi105.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T02:22:15.471 INFO:teuthology.orchestra.run.smithi105.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T02:22:15.471 INFO:teuthology.orchestra.run.smithi105.stdout: = sunit=0 swidth=0 blks 2024-09-12T02:22:15.472 INFO:teuthology.orchestra.run.smithi105.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T02:22:15.472 INFO:teuthology.orchestra.run.smithi105.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T02:22:15.472 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T02:22:15.472 INFO:teuthology.orchestra.run.smithi105.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T02:22:15.990 INFO:teuthology.orchestra.run.smithi105.stdout:Discarding blocks...Done. 2024-09-12T02:22:15.992 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi105.front.sepia.ceph.com -o noatime 2024-09-12T02:22:15.992 DEBUG:teuthology.orchestra.run.smithi105:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-12T02:22:16.143 DEBUG:teuthology.orchestra.run.smithi105:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-12T02:22:16.173 DEBUG:teuthology.orchestra.run.smithi105:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:22:16.272 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:16.271+0000 7f19f02b2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-12T02:22:16.272 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:16.271+0000 7f19f02b2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-12T02:22:16.273 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:16.271+0000 7f19f02b2640 -1 bdev(0x56072c98f800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-12T02:22:16.273 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:16.272+0000 7f19f02b2640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-12T02:22:20.182 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-12T02:22:20.211 DEBUG:teuthology.orchestra.run.smithi105:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:22:20.305 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:20.304+0000 7f9fcd958640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-12T02:22:20.305 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:20.304+0000 7f9fcd958640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-12T02:22:20.305 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:20.304+0000 7f9fcd958640 -1 bdev(0x55f260e01800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-12T02:22:20.305 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:20.304+0000 7f9fcd958640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-12T02:22:24.221 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-12T02:22:24.249 DEBUG:teuthology.orchestra.run.smithi105:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:22:24.338 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:24.337+0000 7f4b4bc0f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-12T02:22:24.338 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:24.338+0000 7f4b4bc0f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-12T02:22:24.338 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:24.338+0000 7f4b4bc0f640 -1 bdev(0x55dbbaca9800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-12T02:22:24.338 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:24.338+0000 7f4b4bc0f640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-12T02:22:25.650 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:22:25.653 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:22:27.990 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-12T02:22:28.020 DEBUG:teuthology.orchestra.run.smithi105:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:22:28.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:28.110+0000 7fa933014640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-12T02:22:28.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:28.110+0000 7fa933014640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-12T02:22:28.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:28.110+0000 7fa933014640 -1 bdev(0x55f25cc97800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-12T02:22:28.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:28.110+0000 7fa933014640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-12T02:22:32.022 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-12T02:22:32.051 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T02:22:32.052 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T02:22:32.052 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-12T02:22:32.084 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T02:22:32.084 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-12T02:22:32.155 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T02:22:32.155 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-12T02:22:32.224 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T02:22:32.224 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T02:22:32.293 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T02:22:32.293 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T02:22:32.361 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T02:22:32.361 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T02:22:32.429 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T02:22:32.429 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-12T02:22:32.498 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T02:22:32.498 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T02:22:32.528 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T02:22:32.528 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-12T02:22:32.597 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T02:22:32.597 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-12T02:22:32.665 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T02:22:32.665 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-12T02:22:32.733 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T02:22:32.733 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-12T02:22:32.799 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T02:22:32.800 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-12T02:22:32.865 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T02:22:32.865 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-12T02:22:32.931 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T02:22:32.931 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T02:22:32.950 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T02:22:32.950 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-12T02:22:32.987 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T02:22:32.987 DEBUG:teuthology.orchestra.run.smithi060:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T02:22:32.992 DEBUG:teuthology.orchestra.run.smithi105:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T02:22:33.030 INFO:teuthology.orchestra.run.smithi060.stdout:[mgr.y] 2024-09-12T02:22:33.031 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQBGUOJmh+92BBAAXNMA+kkbKblUlDGsDdGqZQ== 2024-09-12T02:22:33.031 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.a] 2024-09-12T02:22:33.031 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQBGUOJmOuRpCxAAKYJDS4EZ23cOgKheWI4uFA== 2024-09-12T02:22:33.031 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.c] 2024-09-12T02:22:33.031 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQBGUOJmJMKjEhAASXfJ/zol1WBC8dXi51McOA== 2024-09-12T02:22:33.031 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.0] 2024-09-12T02:22:33.031 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQBHUOJmSINdOBAAjK5HJqz1HxREgtjcGPPdDA== 2024-09-12T02:22:33.031 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.1] 2024-09-12T02:22:33.031 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQBLUOJmoNTJHBAAYMqzv9KS4HFN7/YKaLbRSw== 2024-09-12T02:22:33.031 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.2] 2024-09-12T02:22:33.032 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQBPUOJmd0W/ABAAGNvSUSvwFK52gUYb7+EVNg== 2024-09-12T02:22:33.032 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.3] 2024-09-12T02:22:33.032 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQBSUOJmmaP5AxAAFFY1GfbmtKDz+X1t18kQJA== 2024-09-12T02:22:33.032 INFO:teuthology.orchestra.run.smithi060.stdout:[mgr.x] 2024-09-12T02:22:33.032 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQBGUOJmPZwGCBAAlXXqIbwSiZmSBGg+nB36JQ== 2024-09-12T02:22:33.032 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.b] 2024-09-12T02:22:33.032 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQBGUOJmuypuFxAAiql6vglCAbgIA84WhUMb6w== 2024-09-12T02:22:33.032 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.d] 2024-09-12T02:22:33.032 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQBGUOJmo9p/HhAAckwE+PxwPLbzzT6eq1e2Eg== 2024-09-12T02:22:33.032 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.4] 2024-09-12T02:22:33.032 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQBYUOJmWvs+EBAAXQt9CzgRuX3zWAj+EuayNQ== 2024-09-12T02:22:33.032 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.5] 2024-09-12T02:22:33.032 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQBcUOJmCJ0wEhAA9B25l/W+tCAv2DddtkdYZQ== 2024-09-12T02:22:33.032 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.6] 2024-09-12T02:22:33.033 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQBgUOJmMN0wFBAArF9uosifEvLyl2rD1admrA== 2024-09-12T02:22:33.033 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.7] 2024-09-12T02:22:33.033 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQBkUOJmY8qiBhAAhhXjnV1HDvRD1erBEp70RA== 2024-09-12T02:22:33.033 INFO:teuthology.orchestra.run.smithi060.stdout:[client.0] 2024-09-12T02:22:33.033 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQBGUOJmGOa5IhAAa8bZnpn5bqy40QSt3nU4gw== 2024-09-12T02:22:33.033 INFO:teuthology.orchestra.run.smithi060.stdout:[client.1] 2024-09-12T02:22:33.033 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQBGUOJmYKfxJRAAxiMHFO2EqU3v06oAHv3krQ== 2024-09-12T02:22:33.051 INFO:teuthology.orchestra.run.smithi105.stdout:[mgr.y] 2024-09-12T02:22:33.108 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBGUOJmh+92BBAAXNMA+kkbKblUlDGsDdGqZQ== 2024-09-12T02:22:33.108 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.a] 2024-09-12T02:22:33.108 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBGUOJmOuRpCxAAKYJDS4EZ23cOgKheWI4uFA== 2024-09-12T02:22:33.108 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.c] 2024-09-12T02:22:33.108 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBGUOJmJMKjEhAASXfJ/zol1WBC8dXi51McOA== 2024-09-12T02:22:33.108 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.0] 2024-09-12T02:22:33.108 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBHUOJmSINdOBAAjK5HJqz1HxREgtjcGPPdDA== 2024-09-12T02:22:33.108 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.1] 2024-09-12T02:22:33.108 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBLUOJmoNTJHBAAYMqzv9KS4HFN7/YKaLbRSw== 2024-09-12T02:22:33.108 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.2] 2024-09-12T02:22:33.109 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBPUOJmd0W/ABAAGNvSUSvwFK52gUYb7+EVNg== 2024-09-12T02:22:33.109 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.3] 2024-09-12T02:22:33.109 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBSUOJmmaP5AxAAFFY1GfbmtKDz+X1t18kQJA== 2024-09-12T02:22:33.109 INFO:teuthology.orchestra.run.smithi105.stdout:[mgr.x] 2024-09-12T02:22:33.109 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBGUOJmPZwGCBAAlXXqIbwSiZmSBGg+nB36JQ== 2024-09-12T02:22:33.109 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.b] 2024-09-12T02:22:33.109 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBGUOJmuypuFxAAiql6vglCAbgIA84WhUMb6w== 2024-09-12T02:22:33.109 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.d] 2024-09-12T02:22:33.109 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBGUOJmo9p/HhAAckwE+PxwPLbzzT6eq1e2Eg== 2024-09-12T02:22:33.109 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.4] 2024-09-12T02:22:33.109 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBYUOJmWvs+EBAAXQt9CzgRuX3zWAj+EuayNQ== 2024-09-12T02:22:33.109 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.5] 2024-09-12T02:22:33.109 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBcUOJmCJ0wEhAA9B25l/W+tCAv2DddtkdYZQ== 2024-09-12T02:22:33.110 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.6] 2024-09-12T02:22:33.110 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBgUOJmMN0wFBAArF9uosifEvLyl2rD1admrA== 2024-09-12T02:22:33.110 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.7] 2024-09-12T02:22:33.110 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBkUOJmY8qiBhAAhhXjnV1HDvRD1erBEp70RA== 2024-09-12T02:22:33.110 INFO:teuthology.orchestra.run.smithi105.stdout:[client.0] 2024-09-12T02:22:33.110 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBGUOJmGOa5IhAAa8bZnpn5bqy40QSt3nU4gw== 2024-09-12T02:22:33.110 INFO:teuthology.orchestra.run.smithi105.stdout:[client.1] 2024-09-12T02:22:33.110 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBGUOJmYKfxJRAAxiMHFO2EqU3v06oAHv3krQ== 2024-09-12T02:22:33.111 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T02:22:33.114 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T02:22:33.205 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T02:22:33.207 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T02:22:33.263 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T02:22:33.266 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T02:22:33.320 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:22:33.322 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:22:33.373 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:22:33.375 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:22:33.426 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:22:33.428 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:22:33.479 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:22:33.481 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:22:33.531 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T02:22:33.533 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T02:22:33.584 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T02:22:33.587 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T02:22:33.641 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T02:22:33.644 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T02:22:33.697 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:22:33.699 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:22:33.750 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:22:33.752 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:22:33.803 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:22:33.805 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:22:33.856 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:22:33.858 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:22:33.909 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T02:22:33.911 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T02:22:33.965 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T02:22:33.968 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T02:22:34.021 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T02:22:34.022 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T02:22:34.050 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T02:22:34.147 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T02:22:34.173 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-12T02:22:34.198 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T02:22:34.293 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-12T02:22:34.318 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-12T02:22:34.383 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T02:22:34.479 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-12T02:22:34.504 DEBUG:teuthology.orchestra.run.smithi060:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:22:34.506 DEBUG:teuthology.orchestra.run.smithi105:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:22:34.559 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T02:22:34.560 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T02:22:34.560 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T02:22:34.564 INFO:tasks.ceph.mon.a:Started 2024-09-12T02:22:34.565 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T02:22:34.565 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T02:22:34.603 INFO:tasks.ceph.mon.b:Started 2024-09-12T02:22:34.603 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T02:22:34.604 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T02:22:34.607 INFO:tasks.ceph.mon.c:Started 2024-09-12T02:22:34.607 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T02:22:34.607 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-12T02:22:34.607 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-12T02:22:34.610 INFO:tasks.ceph.mgr.y:Started 2024-09-12T02:22:34.610 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T02:22:34.610 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T02:22:34.612 INFO:tasks.ceph.mgr.x:Started 2024-09-12T02:22:34.612 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T02:22:34.612 DEBUG:teuthology.orchestra.run.smithi060:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T02:22:34.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:34.715+0000 7f34a450a640 1 Processor -- start 2024-09-12T02:22:34.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:34.715+0000 7f34a450a640 1 -- start start 2024-09-12T02:22:34.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:34.716+0000 7f34a450a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f349c1539e0 0x7f349c0c6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:34.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:34.716+0000 7f34a450a640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f349c153dc0 con 0x7f349c0cb6a0 2024-09-12T02:22:34.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:34.716+0000 7f34a450a640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f349c06c7b0 con 0x7f349c0cb280 2024-09-12T02:22:34.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:34.716+0000 7f34a450a640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f349c0cbb10 con 0x7f349c1539e0 2024-09-12T02:22:34.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:34.716+0000 7f34a22a6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f349c1539e0 0x7f349c0c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:34.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:34.716+0000 7f34a22a6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f349c1539e0 0x7f349c0c6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38018/0 (socket says 172.21.15.60:38018) 2024-09-12T02:22:34.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:34.716+0000 7f34a22a6640 1 -- 172.21.15.60:0/1341697324 learned_addr learned my addr 172.21.15.60:0/1341697324 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:22:34.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:34.716+0000 7f34a22a6640 1 -- 172.21.15.60:0/1341697324 >> v2:172.21.15.60:3300/0 conn(0x7f349c1539e0 msgr2=0x7f349c0c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:22:34.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:34.716+0000 7f34a22a6640 1 -- 172.21.15.60:0/1341697324 >> v2:172.21.15.60:3300/0 conn(0x7f349c1539e0 msgr2=0x7f349c0c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:22:34.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:34.716+0000 7f34a22a6640 1 --2- 172.21.15.60:0/1341697324 >> v2:172.21.15.60:3300/0 conn(0x7f349c1539e0 0x7f349c0c6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:22:34.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:34.716+0000 7f34a22a6640 1 --2- 172.21.15.60:0/1341697324 >> v2:172.21.15.60:3300/0 conn(0x7f349c1539e0 0x7f349c0c6910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:22:34.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:34.917+0000 7f34a22a6640 1 --2- 172.21.15.60:0/1341697324 >> v2:172.21.15.60:3300/0 conn(0x7f349c1539e0 0x7f349c0c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:34.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:34.917+0000 7f34a22a6640 1 -- 172.21.15.60:0/1341697324 >> v2:172.21.15.60:3300/0 conn(0x7f349c1539e0 msgr2=0x7f349c0c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:22:34.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:34.917+0000 7f34a22a6640 1 -- 172.21.15.60:0/1341697324 >> v2:172.21.15.60:3300/0 conn(0x7f349c1539e0 msgr2=0x7f349c0c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:22:34.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:34.917+0000 7f34a22a6640 1 --2- 172.21.15.60:0/1341697324 >> v2:172.21.15.60:3300/0 conn(0x7f349c1539e0 0x7f349c0c6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:22:34.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:34.917+0000 7f34a22a6640 1 --2- 172.21.15.60:0/1341697324 >> v2:172.21.15.60:3300/0 conn(0x7f349c1539e0 0x7f349c0c6910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:22:35.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:35.318+0000 7f34a22a6640 1 --2- 172.21.15.60:0/1341697324 >> v2:172.21.15.60:3300/0 conn(0x7f349c1539e0 0x7f349c0c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:35.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:35.318+0000 7f34a22a6640 1 -- 172.21.15.60:0/1341697324 >> v2:172.21.15.60:3300/0 conn(0x7f349c1539e0 msgr2=0x7f349c0c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:22:35.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:35.318+0000 7f34a22a6640 1 -- 172.21.15.60:0/1341697324 >> v2:172.21.15.60:3300/0 conn(0x7f349c1539e0 msgr2=0x7f349c0c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:22:35.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:35.318+0000 7f34a22a6640 1 --2- 172.21.15.60:0/1341697324 >> v2:172.21.15.60:3300/0 conn(0x7f349c1539e0 0x7f349c0c6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:22:35.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:35.318+0000 7f34a22a6640 1 --2- 172.21.15.60:0/1341697324 >> v2:172.21.15.60:3300/0 conn(0x7f349c1539e0 0x7f349c0c6910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:22:36.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:36.119+0000 7f34a22a6640 1 --2- 172.21.15.60:0/1341697324 >> v2:172.21.15.60:3300/0 conn(0x7f349c1539e0 0x7f349c0c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:36.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:36.119+0000 7f34a22a6640 1 -- 172.21.15.60:0/1341697324 >> v2:172.21.15.60:3300/0 conn(0x7f349c1539e0 msgr2=0x7f349c0c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:22:36.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:36.119+0000 7f34a22a6640 1 -- 172.21.15.60:0/1341697324 >> v2:172.21.15.60:3300/0 conn(0x7f349c1539e0 msgr2=0x7f349c0c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:22:36.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:36.119+0000 7f34a22a6640 1 --2- 172.21.15.60:0/1341697324 >> v2:172.21.15.60:3300/0 conn(0x7f349c1539e0 0x7f349c0c6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:22:36.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:36.119+0000 7f34a22a6640 1 --2- 172.21.15.60:0/1341697324 >> v2:172.21.15.60:3300/0 conn(0x7f349c1539e0 0x7f349c0c6910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:22:37.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:37.716+0000 7f3493fff640 1 -- 172.21.15.60:0/1341697324 >> v2:172.21.15.60:3300/0 conn(0x7f349c1539e0 msgr2=0x7f349c0c6910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:22:37.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:37.716+0000 7f3493fff640 1 --2- 172.21.15.60:0/1341697324 >> v2:172.21.15.60:3300/0 conn(0x7f349c1539e0 0x7f349c0c6910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:37.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:37.716+0000 7f3493fff640 1 -- 172.21.15.60:0/1341697324 >> v1:172.21.15.105:6789/0 conn(0x7f349c0cb280 legacy=0x7f349c156760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:37.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:37.716+0000 7f3493fff640 1 -- 172.21.15.60:0/1341697324 >> v1:172.21.15.60:6789/0 conn(0x7f349c0cb6a0 legacy=0x7f349c160d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:37.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:37.716+0000 7f3493fff640 1 --2- 172.21.15.60:0/1341697324 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3480003730 0x7f3480005b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:37.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:37.716+0000 7f3493fff640 1 --2- 172.21.15.60:0/1341697324 >> v2:172.21.15.105:3300/0 conn(0x7f3480006210 0x7f34800086b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:37.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:37.716+0000 7f3493fff640 1 -- 172.21.15.60:0/1341697324 --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f349c0cbb10 con 0x7f3480006210 2024-09-12T02:22:37.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:37.716+0000 7f3493fff640 1 -- 172.21.15.60:0/1341697324 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3480008d60 con 0x7f3480003730 2024-09-12T02:22:37.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:37.716+0000 7f34a22a6640 1 --2- 172.21.15.60:0/1341697324 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3480003730 0x7f3480005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:37.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:37.716+0000 7f34a1aa5640 1 --2- 172.21.15.60:0/1341697324 >> v2:172.21.15.105:3300/0 conn(0x7f3480006210 0x7f34800086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:37.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:37.716+0000 7f34a22a6640 1 -- 172.21.15.60:0/1341697324 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3480003730 msgr2=0x7f3480005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:22:37.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:37.716+0000 7f34a22a6640 1 -- 172.21.15.60:0/1341697324 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3480003730 msgr2=0x7f3480005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:22:37.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:37.716+0000 7f34a22a6640 1 --2- 172.21.15.60:0/1341697324 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3480003730 0x7f3480005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:22:37.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:37.716+0000 7f34a1aa5640 1 -- 172.21.15.60:0/1341697324 >> v2:172.21.15.105:3300/0 conn(0x7f3480006210 msgr2=0x7f34800086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:22:37.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:37.716+0000 7f34a1aa5640 1 -- 172.21.15.60:0/1341697324 >> v2:172.21.15.105:3300/0 conn(0x7f3480006210 msgr2=0x7f34800086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:22:37.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:37.716+0000 7f34a1aa5640 1 --2- 172.21.15.60:0/1341697324 >> v2:172.21.15.105:3300/0 conn(0x7f3480006210 0x7f34800086b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:22:37.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:37.716+0000 7f34a22a6640 1 --2- 172.21.15.60:0/1341697324 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3480003730 0x7f3480005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:22:37.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:37.716+0000 7f34a1aa5640 1 --2- 172.21.15.60:0/1341697324 >> v2:172.21.15.105:3300/0 conn(0x7f3480006210 0x7f34800086b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:22:37.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:37.917+0000 7f34a22a6640 1 --2- 172.21.15.60:0/1341697324 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3480003730 0x7f3480005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:37.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:37.917+0000 7f34a1aa5640 1 --2- 172.21.15.60:0/1341697324 >> v2:172.21.15.105:3300/0 conn(0x7f3480006210 0x7f34800086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:37.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:37.917+0000 7f34a22a6640 1 -- 172.21.15.60:0/1341697324 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3480003730 msgr2=0x7f3480005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:22:37.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:37.917+0000 7f34a1aa5640 1 -- 172.21.15.60:0/1341697324 >> v2:172.21.15.105:3300/0 conn(0x7f3480006210 msgr2=0x7f34800086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:22:37.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:37.917+0000 7f34a22a6640 1 -- 172.21.15.60:0/1341697324 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3480003730 msgr2=0x7f3480005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:22:37.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:37.917+0000 7f34a1aa5640 1 -- 172.21.15.60:0/1341697324 >> v2:172.21.15.105:3300/0 conn(0x7f3480006210 msgr2=0x7f34800086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:22:37.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:37.917+0000 7f34a22a6640 1 --2- 172.21.15.60:0/1341697324 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3480003730 0x7f3480005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:22:37.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:37.917+0000 7f34a1aa5640 1 --2- 172.21.15.60:0/1341697324 >> v2:172.21.15.105:3300/0 conn(0x7f3480006210 0x7f34800086b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:22:37.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:37.917+0000 7f34a22a6640 1 --2- 172.21.15.60:0/1341697324 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3480003730 0x7f3480005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:22:37.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:37.917+0000 7f34a1aa5640 1 --2- 172.21.15.60:0/1341697324 >> v2:172.21.15.105:3300/0 conn(0x7f3480006210 0x7f34800086b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:22:38.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:38.318+0000 7f34a1aa5640 1 --2- 172.21.15.60:0/1341697324 >> v2:172.21.15.105:3300/0 conn(0x7f3480006210 0x7f34800086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:38.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:38.318+0000 7f34a22a6640 1 --2- 172.21.15.60:0/1341697324 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3480003730 0x7f3480005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:38.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:38.318+0000 7f34a1aa5640 1 -- 172.21.15.60:0/1341697324 >> v2:172.21.15.105:3300/0 conn(0x7f3480006210 msgr2=0x7f34800086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:22:38.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:38.318+0000 7f34a1aa5640 1 -- 172.21.15.60:0/1341697324 >> v2:172.21.15.105:3300/0 conn(0x7f3480006210 msgr2=0x7f34800086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:22:38.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:38.318+0000 7f34a1aa5640 1 --2- 172.21.15.60:0/1341697324 >> v2:172.21.15.105:3300/0 conn(0x7f3480006210 0x7f34800086b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:22:38.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:38.318+0000 7f34a22a6640 1 -- 172.21.15.60:0/1341697324 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3480003730 msgr2=0x7f3480005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:22:38.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:38.318+0000 7f34a22a6640 1 -- 172.21.15.60:0/1341697324 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3480003730 msgr2=0x7f3480005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:22:38.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:38.318+0000 7f34a22a6640 1 --2- 172.21.15.60:0/1341697324 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3480003730 0x7f3480005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:22:38.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:38.318+0000 7f34a1aa5640 1 --2- 172.21.15.60:0/1341697324 >> v2:172.21.15.105:3300/0 conn(0x7f3480006210 0x7f34800086b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:22:38.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:38.318+0000 7f34a22a6640 1 --2- 172.21.15.60:0/1341697324 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3480003730 0x7f3480005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:22:39.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:39.120+0000 7f34a22a6640 1 --2- 172.21.15.60:0/1341697324 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3480003730 0x7f3480005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:39.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:39.120+0000 7f34a1aa5640 1 --2- 172.21.15.60:0/1341697324 >> v2:172.21.15.105:3300/0 conn(0x7f3480006210 0x7f34800086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:39.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:39.120+0000 7f34a22a6640 1 -- 172.21.15.60:0/1341697324 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3480003730 msgr2=0x7f3480005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:22:39.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:39.120+0000 7f34a22a6640 1 -- 172.21.15.60:0/1341697324 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3480003730 msgr2=0x7f3480005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:22:39.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:39.120+0000 7f34a22a6640 1 --2- 172.21.15.60:0/1341697324 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3480003730 0x7f3480005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:22:39.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:39.120+0000 7f34a22a6640 1 --2- 172.21.15.60:0/1341697324 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3480003730 0x7f3480005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:22:39.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:39.120+0000 7f34a1aa5640 1 -- 172.21.15.60:0/1341697324 >> v2:172.21.15.105:3300/0 conn(0x7f3480006210 msgr2=0x7f34800086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:22:39.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:39.120+0000 7f34a1aa5640 1 -- 172.21.15.60:0/1341697324 >> v2:172.21.15.105:3300/0 conn(0x7f3480006210 msgr2=0x7f34800086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:22:39.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:39.120+0000 7f34a1aa5640 1 --2- 172.21.15.60:0/1341697324 >> v2:172.21.15.105:3300/0 conn(0x7f3480006210 0x7f34800086b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:22:39.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:39.120+0000 7f34a1aa5640 1 --2- 172.21.15.60:0/1341697324 >> v2:172.21.15.105:3300/0 conn(0x7f3480006210 0x7f34800086b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:22:39.991 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T02:22:39.991+0000 7f1ab6729040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T02:22:39.998 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T02:22:39.998+0000 7fa339b2f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T02:22:40.032 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T02:22:40.032+0000 7f1ab6729040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T02:22:40.042 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T02:22:40.042+0000 7fa339b2f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T02:22:40.170 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T02:22:40.169+0000 7f1ab6729040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T02:22:40.191 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T02:22:40.190+0000 7fa339b2f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T02:22:40.219 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T02:22:40.219+0000 7f1ab6729040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T02:22:40.243 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T02:22:40.243+0000 7fa339b2f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T02:22:40.388 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T02:22:40.388+0000 7f1ab6729040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:22:40.411 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T02:22:40.411+0000 7fa339b2f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:22:40.496 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T02:22:40.495+0000 7f1ab6729040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T02:22:40.526 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T02:22:40.526+0000 7fa339b2f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T02:22:40.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.716+0000 7f3493fff640 1 -- 172.21.15.60:0/1341697324 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3480003730 msgr2=0x7f3480005b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:22:40.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.716+0000 7f3493fff640 1 --2- 172.21.15.60:0/1341697324 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3480003730 0x7f3480005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:40.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.716+0000 7f3493fff640 1 -- 172.21.15.60:0/1341697324 >> v2:172.21.15.105:3300/0 conn(0x7f3480006210 msgr2=0x7f34800086b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:22:40.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.716+0000 7f3493fff640 1 --2- 172.21.15.60:0/1341697324 >> v2:172.21.15.105:3300/0 conn(0x7f3480006210 0x7f34800086b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:40.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.716+0000 7f34a2aa7640 1 -- 172.21.15.60:0/1341697324 reap_dead start 2024-09-12T02:22:40.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.716+0000 7f3493fff640 1 --2- 172.21.15.60:0/1341697324 >> v2:172.21.15.105:3300/0 conn(0x7f3480003b70 0x7f34800066a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:40.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.716+0000 7f3493fff640 1 --2- 172.21.15.60:0/1341697324 >> v2:172.21.15.60:3300/0 conn(0x7f3480006be0 0x7f3480007090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:40.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.716+0000 7f3493fff640 1 -- 172.21.15.60:0/1341697324 --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f349c06ca90 con 0x7f349c0cb6a0 2024-09-12T02:22:40.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.716+0000 7f3493fff640 1 -- 172.21.15.60:0/1341697324 --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f349c0cbb10 con 0x7f3480006be0 2024-09-12T02:22:40.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.716+0000 7f3493fff640 1 -- 172.21.15.60:0/1341697324 --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f3480008d60 con 0x7f3480003b70 2024-09-12T02:22:40.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.716+0000 7f34a2aa7640 1 --2- 172.21.15.60:0/1341697324 >> v2:172.21.15.60:3300/0 conn(0x7f3480006be0 0x7f3480007090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:40.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.716+0000 7f34a1aa5640 1 --2- 172.21.15.60:0/1341697324 >> v2:172.21.15.105:3300/0 conn(0x7f3480003b70 0x7f34800066a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:40.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.716+0000 7f34a2aa7640 1 -- 172.21.15.60:0/1341697324 >> v2:172.21.15.105:3300/0 conn(0x7f3480003b70 msgr2=0x7f34800066a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:22:40.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.716+0000 7f34a2aa7640 1 --2- 172.21.15.60:0/1341697324 >> v2:172.21.15.105:3300/0 conn(0x7f3480003b70 0x7f34800066a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:40.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.716+0000 7f34a2aa7640 1 -- 172.21.15.60:0/1341697324 >> v1:172.21.15.60:6789/0 conn(0x7f349c0cb6a0 legacy=0x7f348000b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:40.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.716+0000 7f34a12a4640 1 -- 172.21.15.60:0/1341697324 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 920481088 0 0) 0x7f349c06ca90 con 0x7f349c0cb6a0 2024-09-12T02:22:40.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.716+0000 7f34a2aa7640 1 -- 172.21.15.60:0/1341697324 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34800087c0 con 0x7f3480006be0 2024-09-12T02:22:40.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.717+0000 7f34a2aa7640 1 --2- 172.21.15.60:0/1341697324 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3480006be0 0x7f3480007090 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f349c0c8760 tx=0x7f349402a0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b787ec131b1abff0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:40.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.717+0000 7f34a12a4640 1 -- 172.21.15.60:0/1341697324 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f349402a9c0 con 0x7f3480006be0 2024-09-12T02:22:40.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.717+0000 7f34a12a4640 1 -- 172.21.15.60:0/1341697324 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f349402e070 con 0x7f3480006be0 2024-09-12T02:22:40.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.717+0000 7f34a12a4640 1 -- 172.21.15.60:0/1341697324 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f349402ad80 con 0x7f3480006be0 2024-09-12T02:22:40.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.718+0000 7f34a450a640 1 -- 172.21.15.60:0/1341697324 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3480006be0 msgr2=0x7f3480007090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:40.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.718+0000 7f34a450a640 1 --2- 172.21.15.60:0/1341697324 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3480006be0 0x7f3480007090 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f349c0c8760 tx=0x7f349402a0c0 comp rx=0 tx=0).stop 2024-09-12T02:22:40.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.718+0000 7f34a450a640 1 -- 172.21.15.60:0/1341697324 shutdown_connections 2024-09-12T02:22:40.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.718+0000 7f34a450a640 1 --2- 172.21.15.60:0/1341697324 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3480006be0 0x7f3480007090 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:40.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.718+0000 7f34a450a640 1 --2- 172.21.15.60:0/1341697324 >> v2:172.21.15.105:3300/0 conn(0x7f3480003b70 0x7f34800066a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:40.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.718+0000 7f34a450a640 1 -- 172.21.15.60:0/1341697324 >> 172.21.15.60:0/1341697324 conn(0x7f349c0c8800 msgr2=0x7f349c0c8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:40.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.718+0000 7f34a450a640 1 -- 172.21.15.60:0/1341697324 shutdown_connections 2024-09-12T02:22:40.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.718+0000 7f34a450a640 1 -- 172.21.15.60:0/1341697324 wait complete. 2024-09-12T02:22:40.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.719+0000 7f34a450a640 1 Processor -- start 2024-09-12T02:22:40.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.720+0000 7f34a450a640 1 -- start start 2024-09-12T02:22:40.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.720+0000 7f34a450a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3480003b70 0x7f349c1ebd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:40.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.720+0000 7f34a450a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3480006be0 0x7f349c14b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:40.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.720+0000 7f34a450a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f349c0cb6a0 0x7f349c159500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:40.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.720+0000 7f34a450a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f349c06d050 con 0x7f3480006be0 2024-09-12T02:22:40.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.720+0000 7f34a450a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f349c06d430 con 0x7f3480003b70 2024-09-12T02:22:40.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.720+0000 7f34a450a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f349c0c93a0 con 0x7f349c0cb6a0 2024-09-12T02:22:40.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.720+0000 7f34a1aa5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3480006be0 0x7f349c14b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:40.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.720+0000 7f34a1aa5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3480006be0 0x7f349c14b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55184/0 (socket says 172.21.15.60:55184) 2024-09-12T02:22:40.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.720+0000 7f34a1aa5640 1 -- 172.21.15.60:0/452602329 learned_addr learned my addr 172.21.15.60:0/452602329 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:22:40.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.721+0000 7f34a2aa7640 1 --2- 172.21.15.60:0/452602329 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f349c0cb6a0 0x7f349c159500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:40.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.721+0000 7f34a22a6640 1 --2- 172.21.15.60:0/452602329 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3480003b70 0x7f349c1ebd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:40.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.721+0000 7f34a1aa5640 1 -- 172.21.15.60:0/452602329 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f349c0cb6a0 msgr2=0x7f349c159500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:40.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.721+0000 7f34a1aa5640 1 --2- 172.21.15.60:0/452602329 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f349c0cb6a0 0x7f349c159500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:40.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.721+0000 7f34a1aa5640 1 -- 172.21.15.60:0/452602329 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3480003b70 msgr2=0x7f349c1ebd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:40.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.721+0000 7f34a1aa5640 1 --2- 172.21.15.60:0/452602329 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3480003b70 0x7f349c1ebd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:40.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.721+0000 7f34a1aa5640 1 -- 172.21.15.60:0/452602329 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f349c1ef360 con 0x7f3480006be0 2024-09-12T02:22:40.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.721+0000 7f34a2aa7640 1 --2- 172.21.15.60:0/452602329 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f349c0cb6a0 0x7f349c159500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:22:40.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.721+0000 7f34a1aa5640 1 --2- 172.21.15.60:0/452602329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3480006be0 0x7f349c14b9f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f348c003f80 tx=0x7f348c001720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:40.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.721+0000 7f3492ffd640 1 -- 172.21.15.60:0/452602329 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348c0177c0 con 0x7f3480006be0 2024-09-12T02:22:40.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.721+0000 7f3492ffd640 1 -- 172.21.15.60:0/452602329 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f348c017960 con 0x7f3480006be0 2024-09-12T02:22:40.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.721+0000 7f34a450a640 1 -- 172.21.15.60:0/452602329 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f349c1ef640 con 0x7f3480006be0 2024-09-12T02:22:40.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.721+0000 7f3492ffd640 1 -- 172.21.15.60:0/452602329 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348c017d10 con 0x7f3480006be0 2024-09-12T02:22:40.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.721+0000 7f34a450a640 1 -- 172.21.15.60:0/452602329 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f349c1efc00 con 0x7f3480006be0 2024-09-12T02:22:40.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.721+0000 7f3492ffd640 1 -- 172.21.15.60:0/452602329 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f348c013070 con 0x7f3480006be0 2024-09-12T02:22:40.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.721+0000 7f3492ffd640 1 -- 172.21.15.60:0/452602329 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f348c016af0 con 0x7f3480006be0 2024-09-12T02:22:40.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.722+0000 7f34a450a640 1 -- 172.21.15.60:0/452602329 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f349c153fc0 con 0x7f3480006be0 2024-09-12T02:22:40.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.724+0000 7f3492ffd640 1 -- 172.21.15.60:0/452602329 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f348c01b020 con 0x7f3480006be0 2024-09-12T02:22:40.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.789+0000 7f34a450a640 1 -- 172.21.15.60:0/452602329 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f349c0c95e0 con 0x7f3480006be0 2024-09-12T02:22:40.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.790+0000 7f3492ffd640 1 -- 172.21.15.60:0/452602329 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f348c016d40 con 0x7f3480006be0 2024-09-12T02:22:40.790 INFO:teuthology.orchestra.run.smithi060.stderr:adjusted tunables profile to default 2024-09-12T02:22:40.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.791+0000 7f34a450a640 1 -- 172.21.15.60:0/452602329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3480006be0 msgr2=0x7f349c14b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:40.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.791+0000 7f34a450a640 1 --2- 172.21.15.60:0/452602329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3480006be0 0x7f349c14b9f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f348c003f80 tx=0x7f348c001720 comp rx=0 tx=0).stop 2024-09-12T02:22:40.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.791+0000 7f34a450a640 1 -- 172.21.15.60:0/452602329 shutdown_connections 2024-09-12T02:22:40.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.791+0000 7f34a450a640 1 --2- 172.21.15.60:0/452602329 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f349c0cb6a0 0x7f349c159500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:40.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.791+0000 7f34a450a640 1 --2- 172.21.15.60:0/452602329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3480006be0 0x7f349c14b9f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:40.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.791+0000 7f34a450a640 1 --2- 172.21.15.60:0/452602329 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3480003b70 0x7f349c1ebd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:40.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.791+0000 7f34a450a640 1 -- 172.21.15.60:0/452602329 >> 172.21.15.60:0/452602329 conn(0x7f349c0c8800 msgr2=0x7f349c154580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:40.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.791+0000 7f34a450a640 1 -- 172.21.15.60:0/452602329 shutdown_connections 2024-09-12T02:22:40.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:40.791+0000 7f34a450a640 1 -- 172.21.15.60:0/452602329 wait complete. 2024-09-12T02:22:40.802 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T02:22:40.802 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T02:22:40.803 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T02:22:40.803 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T02:22:40.828 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T02:22:40.828 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T02:22:40.867 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T02:22:40.867+0000 7f1ab6729040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T02:22:40.874 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T02:22:40.874+0000 7fa339b2f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T02:22:40.894 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T02:22:40.894 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T02:22:40.918 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T02:22:40.918+0000 7f1ab6729040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T02:22:40.929 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T02:22:40.928+0000 7fa339b2f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T02:22:40.954 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T02:22:40.955 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-12T02:22:41.020 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T02:22:41.020 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-12T02:22:41.045 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T02:22:41.045 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-12T02:22:41.068 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T02:22:41.068+0000 7f1ab6729040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T02:22:41.088 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T02:22:41.087+0000 7fa339b2f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T02:22:41.092 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T02:22:41.092 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-12T02:22:41.157 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T02:22:41.157 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-12T02:22:41.222 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new 0f0c7386-002f-47e2-a7a3-6c8a70264cc7 0 2024-09-12T02:22:41.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.360+0000 7f80bda96640 1 Processor -- start 2024-09-12T02:22:41.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.360+0000 7f80bda96640 1 -- start start 2024-09-12T02:22:41.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.361+0000 7f80bda96640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f80b80c4230 0x7f80b8152fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:41.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.361+0000 7f80bda96640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80b81535d0 con 0x7f80b80701e0 2024-09-12T02:22:41.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.361+0000 7f80bda96640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80b81538b0 con 0x7f80b80a8200 2024-09-12T02:22:41.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.361+0000 7f80bda96640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f80b80c5450 con 0x7f80b80c4230 2024-09-12T02:22:41.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.361+0000 7f80b7fff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f80b80c4230 0x7f80b8152fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:41.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.361+0000 7f80b77fe640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f80b80a8200 0x7f80b80c7a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:57314/0 (socket says 172.21.15.105:57314) 2024-09-12T02:22:41.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.361+0000 7f80b77fe640 1 -- 172.21.15.105:0/822970952 learned_addr learned my addr 172.21.15.105:0/822970952 (peer_addr_for_me v1:172.21.15.105:0/0) 2024-09-12T02:22:41.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.361+0000 7f80b7fff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f80b80c4230 0x7f80b8152fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:53572/0 (socket says 172.21.15.105:53572) 2024-09-12T02:22:41.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.361+0000 7f80b7fff640 1 -- 172.21.15.105:0/822970952 >> v1:172.21.15.105:6789/0 conn(0x7f80b80a8200 legacy=0x7f80b80c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:41.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.361+0000 7f80b7fff640 1 -- 172.21.15.105:0/822970952 >> v1:172.21.15.60:6789/0 conn(0x7f80b80701e0 legacy=0x7f80b80c3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:41.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.361+0000 7f80b67fc640 1 -- 172.21.15.105:0/822970952 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1490728126 0 0) 0x7f80b81538b0 con 0x7f80b80a8200 2024-09-12T02:22:41.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.361+0000 7f80b7fff640 1 -- 172.21.15.105:0/822970952 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80b8153b90 con 0x7f80b80c4230 2024-09-12T02:22:41.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.362+0000 7f80b7fff640 1 --2- 172.21.15.105:0/822970952 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80b80c4230 0x7f80b8152fa0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f80b0009d90 tx=0x7f80b002a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10e380ddccb52d26 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:41.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.362+0000 7f80b67fc640 1 -- 172.21.15.105:0/822970952 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b0007740 con 0x7f80b80c4230 2024-09-12T02:22:41.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.362+0000 7f80b67fc640 1 -- 172.21.15.105:0/822970952 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80b00078e0 con 0x7f80b80c4230 2024-09-12T02:22:41.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.362+0000 7f80b67fc640 1 -- 172.21.15.105:0/822970952 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b0007cb0 con 0x7f80b80c4230 2024-09-12T02:22:41.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.363+0000 7f80bda96640 1 -- 172.21.15.105:0/822970952 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80b80c4230 msgr2=0x7f80b8152fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:41.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.363+0000 7f80bda96640 1 --2- 172.21.15.105:0/822970952 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80b80c4230 0x7f80b8152fa0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f80b0009d90 tx=0x7f80b002a6f0 comp rx=0 tx=0).stop 2024-09-12T02:22:41.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.363+0000 7f80bda96640 1 -- 172.21.15.105:0/822970952 shutdown_connections 2024-09-12T02:22:41.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.363+0000 7f80bda96640 1 --2- 172.21.15.105:0/822970952 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80b80c4230 0x7f80b8152fa0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:41.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.363+0000 7f80bda96640 1 -- 172.21.15.105:0/822970952 >> 172.21.15.105:0/822970952 conn(0x7f80b80c5660 msgr2=0x7f80b80c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:41.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.363+0000 7f80bda96640 1 -- 172.21.15.105:0/822970952 shutdown_connections 2024-09-12T02:22:41.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.363+0000 7f80bda96640 1 -- 172.21.15.105:0/822970952 wait complete. 2024-09-12T02:22:41.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.364+0000 7f80bda96640 1 Processor -- start 2024-09-12T02:22:41.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.364+0000 7f80bda96640 1 -- start start 2024-09-12T02:22:41.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.365+0000 7f80bda96640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80b80701e0 0x7f80b814cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:41.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.365+0000 7f80bda96640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80b80a8200 0x7f80b81dd850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:41.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.365+0000 7f80bda96640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80b80c4230 0x7f80b81e97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:41.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.365+0000 7f80bda96640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f80b80a85e0 con 0x7f80b80c4230 2024-09-12T02:22:41.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.365+0000 7f80bda96640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f80b80c3690 con 0x7f80b80a8200 2024-09-12T02:22:41.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.365+0000 7f80bda96640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f80b80c8180 con 0x7f80b80701e0 2024-09-12T02:22:41.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.365+0000 7f80b77fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80b80701e0 0x7f80b814cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:41.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.365+0000 7f80b6ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80b80a8200 0x7f80b81dd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:41.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.365+0000 7f80b77fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80b80701e0 0x7f80b814cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:60282/0 (socket says 172.21.15.105:60282) 2024-09-12T02:22:41.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.365+0000 7f80b77fe640 1 -- 172.21.15.105:0/3806624768 learned_addr learned my addr 172.21.15.105:0/3806624768 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-12T02:22:41.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.365+0000 7f80b7fff640 1 --2- 172.21.15.105:0/3806624768 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80b80c4230 0x7f80b81e97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:41.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.365+0000 7f80b77fe640 1 -- 172.21.15.105:0/3806624768 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80b80a8200 msgr2=0x7f80b81dd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:41.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.365+0000 7f80b77fe640 1 --2- 172.21.15.105:0/3806624768 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80b80a8200 0x7f80b81dd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:41.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.365+0000 7f80b77fe640 1 -- 172.21.15.105:0/3806624768 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80b80c4230 msgr2=0x7f80b81e97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:41.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.365+0000 7f80b77fe640 1 --2- 172.21.15.105:0/3806624768 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80b80c4230 0x7f80b81e97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:41.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.365+0000 7f80b77fe640 1 -- 172.21.15.105:0/3806624768 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80b814cd70 con 0x7f80b80701e0 2024-09-12T02:22:41.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.365+0000 7f80b6ffd640 1 --2- 172.21.15.105:0/3806624768 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80b80a8200 0x7f80b81dd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:22:41.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.365+0000 7f80b77fe640 1 --2- 172.21.15.105:0/3806624768 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80b80701e0 0x7f80b814cfc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f80a800c4a0 tx=0x7f80a800c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:41.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.365+0000 7f809ffff640 1 -- 172.21.15.105:0/3806624768 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a8018070 con 0x7f80b80701e0 2024-09-12T02:22:41.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.365+0000 7f809ffff640 1 -- 172.21.15.105:0/3806624768 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80a80074e0 con 0x7f80b80701e0 2024-09-12T02:22:41.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.365+0000 7f80bda96640 1 -- 172.21.15.105:0/3806624768 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80b814ca90 con 0x7f80b80701e0 2024-09-12T02:22:41.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.365+0000 7f809ffff640 1 -- 172.21.15.105:0/3806624768 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a8004a20 con 0x7f80b80701e0 2024-09-12T02:22:41.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.365+0000 7f80bda96640 1 -- 172.21.15.105:0/3806624768 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f80b81ed0f0 con 0x7f80b80701e0 2024-09-12T02:22:41.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.366+0000 7f809ffff640 1 -- 172.21.15.105:0/3806624768 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f80a801b070 con 0x7f80b80701e0 2024-09-12T02:22:41.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.366+0000 7f809ffff640 1 -- 172.21.15.105:0/3806624768 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f80a8012740 con 0x7f80b80701e0 2024-09-12T02:22:41.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.366+0000 7f80bda96640 1 -- 172.21.15.105:0/3806624768 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80b80ac5e0 con 0x7f80b80701e0 2024-09-12T02:22:41.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.369+0000 7f809ffff640 1 -- 172.21.15.105:0/3806624768 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f80a801d440 con 0x7f80b80701e0 2024-09-12T02:22:41.451 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.450+0000 7f80bda96640 1 -- 172.21.15.105:0/3806624768 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0f0c7386-002f-47e2-a7a3-6c8a70264cc7", "id": 0} v 0) -- 0x7f80b80acab0 con 0x7f80b80701e0 2024-09-12T02:22:41.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.453+0000 7f809ffff640 1 -- 172.21.15.105:0/3806624768 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0f0c7386-002f-47e2-a7a3-6c8a70264cc7", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f80a801d7b0 con 0x7f80b80701e0 2024-09-12T02:22:41.454 INFO:teuthology.orchestra.run.smithi105.stdout:0 2024-09-12T02:22:41.455 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.454+0000 7f80bda96640 1 -- 172.21.15.105:0/3806624768 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80b80701e0 msgr2=0x7f80b814cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:41.455 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.454+0000 7f80bda96640 1 --2- 172.21.15.105:0/3806624768 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80b80701e0 0x7f80b814cfc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f80a800c4a0 tx=0x7f80a800c960 comp rx=0 tx=0).stop 2024-09-12T02:22:41.455 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.454+0000 7f80bda96640 1 -- 172.21.15.105:0/3806624768 shutdown_connections 2024-09-12T02:22:41.455 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.454+0000 7f80bda96640 1 --2- 172.21.15.105:0/3806624768 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80b80c4230 0x7f80b81e97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:41.455 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.454+0000 7f80bda96640 1 --2- 172.21.15.105:0/3806624768 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80b80a8200 0x7f80b81dd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:41.455 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.454+0000 7f80bda96640 1 --2- 172.21.15.105:0/3806624768 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80b80701e0 0x7f80b814cfc0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:41.455 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.454+0000 7f80bda96640 1 -- 172.21.15.105:0/3806624768 >> 172.21.15.105:0/3806624768 conn(0x7f80b80c5660 msgr2=0x7f80b80a8760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:41.455 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.454+0000 7f80bda96640 1 -- 172.21.15.105:0/3806624768 shutdown_connections 2024-09-12T02:22:41.455 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.454+0000 7f80bda96640 1 -- 172.21.15.105:0/3806624768 wait complete. 2024-09-12T02:22:41.465 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new 64be7b84-36fc-43c0-9e70-a617e5b68941 1 2024-09-12T02:22:41.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.564+0000 7f08aa85c640 1 Processor -- start 2024-09-12T02:22:41.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.564+0000 7f08aa85c640 1 -- start start 2024-09-12T02:22:41.566 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.565+0000 7f08aa85c640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f08a41539e0 0x7f08a40c6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:41.566 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.565+0000 7f08aa85c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08a40cb6a0 0x7f08a4156e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:41.566 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.565+0000 7f08aa85c640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08a4153dc0 con 0x7f08a40cb280 2024-09-12T02:22:41.566 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.565+0000 7f08aa85c640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f08a40c6e50 con 0x7f08a41539e0 2024-09-12T02:22:41.567 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.565+0000 7f08aa85c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f08a406d430 con 0x7f08a40cb6a0 2024-09-12T02:22:41.567 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.565+0000 7f08a8df9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08a40cb6a0 0x7f08a4156e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:41.567 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.565+0000 7f08a3fff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f08a41539e0 0x7f08a40c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:41.567 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.565+0000 7f08a8df9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08a40cb6a0 0x7f08a4156e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:60294/0 (socket says 172.21.15.105:60294) 2024-09-12T02:22:41.567 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.565+0000 7f08a8df9640 1 -- 172.21.15.105:0/2452152549 learned_addr learned my addr 172.21.15.105:0/2452152549 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-12T02:22:41.567 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.565+0000 7f08a3fff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f08a41539e0 0x7f08a40c6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:53584/0 (socket says 172.21.15.105:53584) 2024-09-12T02:22:41.567 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.566+0000 7f08a8df9640 1 -- 172.21.15.105:0/2452152549 >> v2:172.21.15.105:3300/0 conn(0x7f08a41539e0 msgr2=0x7f08a40c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:22:41.567 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.566+0000 7f08a8df9640 1 --2- 172.21.15.105:0/2452152549 >> v2:172.21.15.105:3300/0 conn(0x7f08a41539e0 0x7f08a40c6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:41.567 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.566+0000 7f08a8df9640 1 -- 172.21.15.105:0/2452152549 >> v1:172.21.15.60:6789/0 conn(0x7f08a40cb280 legacy=0x7f08a4156760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:41.567 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.566+0000 7f08a8df9640 1 -- 172.21.15.105:0/2452152549 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08a406c7b0 con 0x7f08a40cb6a0 2024-09-12T02:22:41.567 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.566+0000 7f08a3fff640 1 --2- 172.21.15.105:0/2452152549 >> v2:172.21.15.105:3300/0 conn(0x7f08a41539e0 0x7f08a40c6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:22:41.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.566+0000 7f08a8df9640 1 --2- 172.21.15.105:0/2452152549 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08a40cb6a0 0x7f08a4156e70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f089c009e50 tx=0x7f089c02a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=767a925f7856efe1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:41.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.567+0000 7f08a2ffd640 1 -- 172.21.15.105:0/2452152549 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089c036070 con 0x7f08a40cb6a0 2024-09-12T02:22:41.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.567+0000 7f08a2ffd640 1 -- 172.21.15.105:0/2452152549 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f089c031600 con 0x7f08a40cb6a0 2024-09-12T02:22:41.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.567+0000 7f08a2ffd640 1 -- 172.21.15.105:0/2452152549 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089c0319d0 con 0x7f08a40cb6a0 2024-09-12T02:22:41.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.567+0000 7f08aa85c640 1 -- 172.21.15.105:0/2452152549 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08a40cb6a0 msgr2=0x7f08a4156e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:41.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.567+0000 7f08aa85c640 1 --2- 172.21.15.105:0/2452152549 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08a40cb6a0 0x7f08a4156e70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f089c009e50 tx=0x7f089c02a710 comp rx=0 tx=0).stop 2024-09-12T02:22:41.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.567+0000 7f08aa85c640 1 -- 172.21.15.105:0/2452152549 shutdown_connections 2024-09-12T02:22:41.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.567+0000 7f08aa85c640 1 --2- 172.21.15.105:0/2452152549 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08a40cb6a0 0x7f08a4156e70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:41.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.567+0000 7f08aa85c640 1 --2- 172.21.15.105:0/2452152549 >> v2:172.21.15.105:3300/0 conn(0x7f08a41539e0 0x7f08a40c6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:41.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.567+0000 7f08aa85c640 1 -- 172.21.15.105:0/2452152549 >> 172.21.15.105:0/2452152549 conn(0x7f08a40c8800 msgr2=0x7f08a40c8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:41.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.567+0000 7f08aa85c640 1 -- 172.21.15.105:0/2452152549 shutdown_connections 2024-09-12T02:22:41.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.567+0000 7f08aa85c640 1 -- 172.21.15.105:0/2452152549 wait complete. 2024-09-12T02:22:41.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.569+0000 7f08aa85c640 1 Processor -- start 2024-09-12T02:22:41.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.569+0000 7f08aa85c640 1 -- start start 2024-09-12T02:22:41.573 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.570+0000 7f08aa85c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08a40cb280 0x7f08a4158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:41.573 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.570+0000 7f08aa85c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08a40cb6a0 0x7f08a4149b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:41.573 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.570+0000 7f08aa85c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08a41539e0 0x7f08a41e1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:41.573 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.570+0000 7f08aa85c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f08a406d050 con 0x7f08a40cb280 2024-09-12T02:22:41.573 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.570+0000 7f08aa85c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f08a406cd70 con 0x7f08a40cb6a0 2024-09-12T02:22:41.573 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.571+0000 7f08aa85c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f08a40c93a0 con 0x7f08a41539e0 2024-09-12T02:22:41.573 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.571+0000 7f08a37fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08a40cb6a0 0x7f08a4149b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:41.573 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.571+0000 7f08a8df9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08a41539e0 0x7f08a41e1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:41.573 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.571+0000 7f08a8df9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08a41539e0 0x7f08a41e1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:60310/0 (socket says 172.21.15.105:60310) 2024-09-12T02:22:41.573 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.571+0000 7f08a8df9640 1 -- 172.21.15.105:0/697685386 learned_addr learned my addr 172.21.15.105:0/697685386 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-12T02:22:41.573 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.571+0000 7f08a3fff640 1 --2- 172.21.15.105:0/697685386 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08a40cb280 0x7f08a4158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:41.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.571+0000 7f08a37fe640 1 -- 172.21.15.105:0/697685386 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08a41539e0 msgr2=0x7f08a41e1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:41.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.571+0000 7f08a37fe640 1 --2- 172.21.15.105:0/697685386 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08a41539e0 0x7f08a41e1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:41.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.571+0000 7f08a37fe640 1 -- 172.21.15.105:0/697685386 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08a40cb280 msgr2=0x7f08a4158c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:41.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.571+0000 7f08a37fe640 1 --2- 172.21.15.105:0/697685386 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08a40cb280 0x7f08a4158c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:41.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.571+0000 7f08a37fe640 1 -- 172.21.15.105:0/697685386 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08a41516b0 con 0x7f08a40cb6a0 2024-09-12T02:22:41.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.571+0000 7f08a8df9640 1 --2- 172.21.15.105:0/697685386 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08a41539e0 0x7f08a41e1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:22:41.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.571+0000 7f08a37fe640 1 --2- 172.21.15.105:0/697685386 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08a40cb6a0 0x7f08a4149b20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f089400c340 tx=0x7f089400c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:41.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.571+0000 7f08a0ff9640 1 -- 172.21.15.105:0/697685386 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08940052d0 con 0x7f08a40cb6a0 2024-09-12T02:22:41.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.571+0000 7f08a0ff9640 1 -- 172.21.15.105:0/697685386 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0894005490 con 0x7f08a40cb6a0 2024-09-12T02:22:41.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.571+0000 7f08a0ff9640 1 -- 172.21.15.105:0/697685386 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0894007260 con 0x7f08a40cb6a0 2024-09-12T02:22:41.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.571+0000 7f08aa85c640 1 -- 172.21.15.105:0/697685386 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08a41e2190 con 0x7f08a40cb6a0 2024-09-12T02:22:41.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.571+0000 7f08aa85c640 1 -- 172.21.15.105:0/697685386 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08a41e2750 con 0x7f08a40cb6a0 2024-09-12T02:22:41.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.571+0000 7f08a0ff9640 1 -- 172.21.15.105:0/697685386 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0894007400 con 0x7f08a40cb6a0 2024-09-12T02:22:41.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.572+0000 7f08a0ff9640 1 -- 172.21.15.105:0/697685386 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f0894003a50 con 0x7f08a40cb6a0 2024-09-12T02:22:41.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.572+0000 7f08aa85c640 1 -- 172.21.15.105:0/697685386 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08a40caba0 con 0x7f08a40cb6a0 2024-09-12T02:22:41.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.574+0000 7f08a0ff9640 1 -- 172.21.15.105:0/697685386 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f08a40caba0 con 0x7f08a40cb6a0 2024-09-12T02:22:41.643 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.643+0000 7f08aa85c640 1 -- 172.21.15.105:0/697685386 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd new", "uuid": "64be7b84-36fc-43c0-9e70-a617e5b68941", "id": 1} v 0) -- 0x7f08a4153fc0 con 0x7f08a40cb6a0 2024-09-12T02:22:41.646 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.646+0000 7f08a0ff9640 1 -- 172.21.15.105:0/697685386 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "64be7b84-36fc-43c0-9e70-a617e5b68941", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f08a4153dc0 con 0x7f08a40cb6a0 2024-09-12T02:22:41.647 INFO:teuthology.orchestra.run.smithi105.stdout:1 2024-09-12T02:22:41.648 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.647+0000 7f08aa85c640 1 -- 172.21.15.105:0/697685386 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08a40cb6a0 msgr2=0x7f08a4149b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:41.648 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.647+0000 7f08aa85c640 1 --2- 172.21.15.105:0/697685386 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08a40cb6a0 0x7f08a4149b20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f089400c340 tx=0x7f089400c800 comp rx=0 tx=0).stop 2024-09-12T02:22:41.648 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.647+0000 7f08aa85c640 1 -- 172.21.15.105:0/697685386 shutdown_connections 2024-09-12T02:22:41.648 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.647+0000 7f08aa85c640 1 --2- 172.21.15.105:0/697685386 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08a41539e0 0x7f08a41e1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:41.648 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.647+0000 7f08aa85c640 1 --2- 172.21.15.105:0/697685386 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08a40cb6a0 0x7f08a4149b20 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:41.648 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.647+0000 7f08aa85c640 1 --2- 172.21.15.105:0/697685386 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08a40cb280 0x7f08a4158c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:41.648 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.647+0000 7f08aa85c640 1 -- 172.21.15.105:0/697685386 >> 172.21.15.105:0/697685386 conn(0x7f08a40c8800 msgr2=0x7f08a414c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:41.648 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.647+0000 7f08aa85c640 1 -- 172.21.15.105:0/697685386 shutdown_connections 2024-09-12T02:22:41.648 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.647+0000 7f08aa85c640 1 -- 172.21.15.105:0/697685386 wait complete. 2024-09-12T02:22:41.658 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new df00caa1-d45e-4b87-ac1e-8bc098d509d4 2 2024-09-12T02:22:41.756 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.755+0000 7f6d36be8640 1 Processor -- start 2024-09-12T02:22:41.756 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.755+0000 7f6d36be8640 1 -- start start 2024-09-12T02:22:41.757 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.756+0000 7f6d36be8640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d300733d0 0x7f6d30156840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:41.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.756+0000 7f6d36be8640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6d3006d850 0x7f6d30156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:41.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.756+0000 7f6d36be8640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d3006dd50 con 0x7f6d30073ae0 2024-09-12T02:22:41.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.756+0000 7f6d36be8640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f6d3006e030 con 0x7f6d3006d850 2024-09-12T02:22:41.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.756+0000 7f6d36be8640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6d3006e310 con 0x7f6d300733d0 2024-09-12T02:22:41.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.756+0000 7f6d35185640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6d3006d850 0x7f6d30156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:41.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.756+0000 7f6d2ffff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d300733d0 0x7f6d30156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:41.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.756+0000 7f6d2ffff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d300733d0 0x7f6d30156840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:60320/0 (socket says 172.21.15.105:60320) 2024-09-12T02:22:41.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.756+0000 7f6d34984640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f6d30073ae0 0x7f6d30153380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:57322/0 (socket says 172.21.15.105:57322) 2024-09-12T02:22:41.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.756+0000 7f6d35185640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6d3006d850 0x7f6d30156d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:53600/0 (socket says 172.21.15.105:53600) 2024-09-12T02:22:41.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.756+0000 7f6d2ffff640 1 -- 172.21.15.105:0/104765172 learned_addr learned my addr 172.21.15.105:0/104765172 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-12T02:22:41.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.756+0000 7f6d2ffff640 1 -- 172.21.15.105:0/104765172 >> v2:172.21.15.105:3300/0 conn(0x7f6d3006d850 msgr2=0x7f6d30156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:22:41.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.756+0000 7f6d2ffff640 1 --2- 172.21.15.105:0/104765172 >> v2:172.21.15.105:3300/0 conn(0x7f6d3006d850 0x7f6d30156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:41.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.756+0000 7f6d2ffff640 1 -- 172.21.15.105:0/104765172 >> v1:172.21.15.105:6789/0 conn(0x7f6d30073ae0 legacy=0x7f6d30153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:41.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.756+0000 7f6d2ffff640 1 -- 172.21.15.105:0/104765172 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d3006e5f0 con 0x7f6d300733d0 2024-09-12T02:22:41.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.756+0000 7f6d35185640 1 --2- 172.21.15.105:0/104765172 >> v2:172.21.15.105:3300/0 conn(0x7f6d3006d850 0x7f6d30156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:22:41.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.757+0000 7f6d2ffff640 1 --2- 172.21.15.105:0/104765172 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d300733d0 0x7f6d30156840 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6d24009870 tx=0x7f6d2402a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9606ab50479a1c34 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:41.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.757+0000 7f6d2f7fe640 1 -- 172.21.15.105:0/104765172 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d24037070 con 0x7f6d300733d0 2024-09-12T02:22:41.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.757+0000 7f6d2f7fe640 1 -- 172.21.15.105:0/104765172 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d24032440 con 0x7f6d300733d0 2024-09-12T02:22:41.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.757+0000 7f6d2f7fe640 1 -- 172.21.15.105:0/104765172 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d24032810 con 0x7f6d300733d0 2024-09-12T02:22:41.762 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.758+0000 7f6d36be8640 1 -- 172.21.15.105:0/104765172 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d300733d0 msgr2=0x7f6d30156840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:41.762 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.758+0000 7f6d36be8640 1 --2- 172.21.15.105:0/104765172 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d300733d0 0x7f6d30156840 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6d24009870 tx=0x7f6d2402a1c0 comp rx=0 tx=0).stop 2024-09-12T02:22:41.762 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.758+0000 7f6d36be8640 1 -- 172.21.15.105:0/104765172 shutdown_connections 2024-09-12T02:22:41.762 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.758+0000 7f6d36be8640 1 --2- 172.21.15.105:0/104765172 >> v2:172.21.15.105:3300/0 conn(0x7f6d3006d850 0x7f6d30156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:41.762 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.758+0000 7f6d36be8640 1 --2- 172.21.15.105:0/104765172 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d300733d0 0x7f6d30156840 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:41.763 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.758+0000 7f6d36be8640 1 -- 172.21.15.105:0/104765172 >> 172.21.15.105:0/104765172 conn(0x7f6d300c9d80 msgr2=0x7f6d300ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:41.763 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.758+0000 7f6d36be8640 1 -- 172.21.15.105:0/104765172 shutdown_connections 2024-09-12T02:22:41.763 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.758+0000 7f6d36be8640 1 -- 172.21.15.105:0/104765172 wait complete. 2024-09-12T02:22:41.763 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.759+0000 7f6d36be8640 1 Processor -- start 2024-09-12T02:22:41.763 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.759+0000 7f6d36be8640 1 -- start start 2024-09-12T02:22:41.763 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.760+0000 7f6d36be8640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d3006d850 0x7f6d30158e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:41.763 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.760+0000 7f6d36be8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d300733d0 0x7f6d30158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:41.763 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.760+0000 7f6d36be8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d30073ae0 0x7f6d3014ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:41.763 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.760+0000 7f6d36be8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3006edd0 con 0x7f6d300733d0 2024-09-12T02:22:41.763 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.760+0000 7f6d36be8640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3006ec50 con 0x7f6d30073ae0 2024-09-12T02:22:41.763 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.760+0000 7f6d36be8640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6d30153a90 con 0x7f6d3006d850 2024-09-12T02:22:41.763 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.760+0000 7f6d34984640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d3006d850 0x7f6d30158e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:41.763 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.760+0000 7f6d34984640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d3006d850 0x7f6d30158e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:60334/0 (socket says 172.21.15.105:60334) 2024-09-12T02:22:41.764 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.760+0000 7f6d34984640 1 -- 172.21.15.105:0/462343350 learned_addr learned my addr 172.21.15.105:0/462343350 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-12T02:22:41.764 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.760+0000 7f6d35185640 1 --2- 172.21.15.105:0/462343350 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d30073ae0 0x7f6d3014ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:41.764 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.760+0000 7f6d2ffff640 1 --2- 172.21.15.105:0/462343350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d300733d0 0x7f6d30158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:41.764 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.760+0000 7f6d34984640 1 -- 172.21.15.105:0/462343350 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d30073ae0 msgr2=0x7f6d3014ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:41.764 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.760+0000 7f6d34984640 1 --2- 172.21.15.105:0/462343350 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d30073ae0 0x7f6d3014ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:41.764 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.760+0000 7f6d34984640 1 -- 172.21.15.105:0/462343350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d300733d0 msgr2=0x7f6d30158470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:41.764 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.760+0000 7f6d34984640 1 --2- 172.21.15.105:0/462343350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d300733d0 0x7f6d30158470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:41.764 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.760+0000 7f6d34984640 1 -- 172.21.15.105:0/462343350 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d3014e320 con 0x7f6d3006d850 2024-09-12T02:22:41.764 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.760+0000 7f6d2ffff640 1 --2- 172.21.15.105:0/462343350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d300733d0 0x7f6d30158470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:22:41.764 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.760+0000 7f6d35185640 1 --2- 172.21.15.105:0/462343350 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d30073ae0 0x7f6d3014ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:22:41.764 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.760+0000 7f6d34984640 1 --2- 172.21.15.105:0/462343350 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d3006d850 0x7f6d30158e40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6d2000c3f0 tx=0x7f6d2000c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:41.764 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.761+0000 7f6d2d7fa640 1 -- 172.21.15.105:0/462343350 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d200074e0 con 0x7f6d3006d850 2024-09-12T02:22:41.764 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.761+0000 7f6d2d7fa640 1 -- 172.21.15.105:0/462343350 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d20007680 con 0x7f6d3006d850 2024-09-12T02:22:41.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.761+0000 7f6d36be8640 1 -- 172.21.15.105:0/462343350 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d30146b10 con 0x7f6d3006d850 2024-09-12T02:22:41.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.761+0000 7f6d2d7fa640 1 -- 172.21.15.105:0/462343350 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d20004a00 con 0x7f6d3006d850 2024-09-12T02:22:41.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.761+0000 7f6d36be8640 1 -- 172.21.15.105:0/462343350 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d30153150 con 0x7f6d3006d850 2024-09-12T02:22:41.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.761+0000 7f6d2d7fa640 1 -- 172.21.15.105:0/462343350 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6d2001a020 con 0x7f6d3006d850 2024-09-12T02:22:41.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.761+0000 7f6d2d7fa640 1 -- 172.21.15.105:0/462343350 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f6d20012810 con 0x7f6d3006d850 2024-09-12T02:22:41.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.762+0000 7f6d36be8640 1 -- 172.21.15.105:0/462343350 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d30073ec0 con 0x7f6d3006d850 2024-09-12T02:22:41.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.764+0000 7f6d2d7fa640 1 -- 172.21.15.105:0/462343350 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f6d20021070 con 0x7f6d3006d850 2024-09-12T02:22:41.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.833+0000 7f6d36be8640 1 -- 172.21.15.105:0/462343350 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd new", "uuid": "df00caa1-d45e-4b87-ac1e-8bc098d509d4", "id": 2} v 0) -- 0x7f6d30075900 con 0x7f6d3006d850 2024-09-12T02:22:41.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.836+0000 7f6d2d7fa640 1 -- 172.21.15.105:0/462343350 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "df00caa1-d45e-4b87-ac1e-8bc098d509d4", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f6d200125f0 con 0x7f6d3006d850 2024-09-12T02:22:41.837 INFO:teuthology.orchestra.run.smithi105.stdout:2 2024-09-12T02:22:41.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.837+0000 7f6d36be8640 1 -- 172.21.15.105:0/462343350 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d3006d850 msgr2=0x7f6d30158e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:41.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.837+0000 7f6d36be8640 1 --2- 172.21.15.105:0/462343350 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d3006d850 0x7f6d30158e40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6d2000c3f0 tx=0x7f6d2000c7f0 comp rx=0 tx=0).stop 2024-09-12T02:22:41.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.837+0000 7f6d36be8640 1 -- 172.21.15.105:0/462343350 shutdown_connections 2024-09-12T02:22:41.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.837+0000 7f6d36be8640 1 --2- 172.21.15.105:0/462343350 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d30073ae0 0x7f6d3014ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:41.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.837+0000 7f6d36be8640 1 --2- 172.21.15.105:0/462343350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d300733d0 0x7f6d30158470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:41.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.837+0000 7f6d36be8640 1 --2- 172.21.15.105:0/462343350 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d3006d850 0x7f6d30158e40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:41.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.837+0000 7f6d36be8640 1 -- 172.21.15.105:0/462343350 >> 172.21.15.105:0/462343350 conn(0x7f6d300c9d80 msgr2=0x7f6d30151660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:41.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.837+0000 7f6d36be8640 1 -- 172.21.15.105:0/462343350 shutdown_connections 2024-09-12T02:22:41.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.837+0000 7f6d36be8640 1 -- 172.21.15.105:0/462343350 wait complete. 2024-09-12T02:22:41.848 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new f6453471-893a-490b-b0c7-f196a0f574e5 3 2024-09-12T02:22:41.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.946+0000 7f4a7c65e640 1 Processor -- start 2024-09-12T02:22:41.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.946+0000 7f4a7c65e640 1 -- start start 2024-09-12T02:22:41.949 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.947+0000 7f4a7c65e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4a740c6910 0x7f4a74156760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:41.949 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.947+0000 7f4a7c65e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4a74156ca0 0x7f4a74160d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:41.949 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.947+0000 7f4a7c65e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a74153dc0 con 0x7f4a741539e0 2024-09-12T02:22:41.949 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.947+0000 7f4a7c65e640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f4a7406d430 con 0x7f4a74156ca0 2024-09-12T02:22:41.949 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.947+0000 7f4a7c65e640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f4a7406c7b0 con 0x7f4a740c6910 2024-09-12T02:22:41.949 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.947+0000 7f4a79bf9640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4a740c6910 0x7f4a74156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:41.949 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.947+0000 7f4a79bf9640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4a740c6910 0x7f4a74156760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:53616/0 (socket says 172.21.15.105:53616) 2024-09-12T02:22:41.949 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.947+0000 7f4a79bf9640 1 -- 172.21.15.105:0/4029972009 learned_addr learned my addr 172.21.15.105:0/4029972009 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-12T02:22:41.950 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.947+0000 7f4a7abfb640 1 --2- 172.21.15.105:0/4029972009 >> v2:172.21.15.60:3300/0 conn(0x7f4a74156ca0 0x7f4a74160d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:41.950 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.948+0000 7f4a79bf9640 1 -- 172.21.15.105:0/4029972009 >> v2:172.21.15.60:3300/0 conn(0x7f4a74156ca0 msgr2=0x7f4a74160d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:22:41.950 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.948+0000 7f4a79bf9640 1 --2- 172.21.15.105:0/4029972009 >> v2:172.21.15.60:3300/0 conn(0x7f4a74156ca0 0x7f4a74160d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:41.950 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.948+0000 7f4a79bf9640 1 -- 172.21.15.105:0/4029972009 >> v1:172.21.15.60:6789/0 conn(0x7f4a741539e0 legacy=0x7f4a740cb280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:41.950 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.948+0000 7f4a79bf9640 1 -- 172.21.15.105:0/4029972009 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a7406ca90 con 0x7f4a740c6910 2024-09-12T02:22:41.950 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.948+0000 7f4a7abfb640 1 --2- 172.21.15.105:0/4029972009 >> v2:172.21.15.60:3300/0 conn(0x7f4a74156ca0 0x7f4a74160d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:22:41.950 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.948+0000 7f4a79bf9640 1 --2- 172.21.15.105:0/4029972009 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a740c6910 0x7f4a74156760 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4a740cce00 tx=0x7f4a7002a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a3c5801d67c8e45 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:41.950 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.948+0000 7f4a793f8640 1 -- 172.21.15.105:0/4029972009 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a70037070 con 0x7f4a740c6910 2024-09-12T02:22:41.950 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.948+0000 7f4a793f8640 1 -- 172.21.15.105:0/4029972009 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a70032440 con 0x7f4a740c6910 2024-09-12T02:22:41.950 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.948+0000 7f4a793f8640 1 -- 172.21.15.105:0/4029972009 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a70032810 con 0x7f4a740c6910 2024-09-12T02:22:41.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.949+0000 7f4a7c65e640 1 -- 172.21.15.105:0/4029972009 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a740c6910 msgr2=0x7f4a74156760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:41.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.949+0000 7f4a7c65e640 1 --2- 172.21.15.105:0/4029972009 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a740c6910 0x7f4a74156760 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4a740cce00 tx=0x7f4a7002a270 comp rx=0 tx=0).stop 2024-09-12T02:22:41.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.949+0000 7f4a7c65e640 1 -- 172.21.15.105:0/4029972009 shutdown_connections 2024-09-12T02:22:41.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.949+0000 7f4a7c65e640 1 --2- 172.21.15.105:0/4029972009 >> v2:172.21.15.60:3300/0 conn(0x7f4a74156ca0 0x7f4a74160d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:41.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.949+0000 7f4a7c65e640 1 --2- 172.21.15.105:0/4029972009 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a740c6910 0x7f4a74156760 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:41.954 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.949+0000 7f4a7c65e640 1 -- 172.21.15.105:0/4029972009 >> 172.21.15.105:0/4029972009 conn(0x7f4a740c8800 msgr2=0x7f4a740c8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:41.954 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.949+0000 7f4a7c65e640 1 -- 172.21.15.105:0/4029972009 shutdown_connections 2024-09-12T02:22:41.954 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.949+0000 7f4a7c65e640 1 -- 172.21.15.105:0/4029972009 wait complete. 2024-09-12T02:22:41.954 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.950+0000 7f4a7c65e640 1 Processor -- start 2024-09-12T02:22:41.954 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.950+0000 7f4a7c65e640 1 -- start start 2024-09-12T02:22:41.954 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.951+0000 7f4a7c65e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a740c6910 0x7f4a741e24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:41.954 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.951+0000 7f4a7c65e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a741539e0 0x7f4a74157800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:41.954 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.951+0000 7f4a7c65e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4a74156ca0 0x7f4a740b1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:41.954 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.951+0000 7f4a7c65e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4a740c93a0 con 0x7f4a740c6910 2024-09-12T02:22:41.954 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.951+0000 7f4a7c65e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7406d050 con 0x7f4a741539e0 2024-09-12T02:22:41.954 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.951+0000 7f4a7c65e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4a740c6d30 con 0x7f4a74156ca0 2024-09-12T02:22:41.954 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.951+0000 7f4a79bf9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a741539e0 0x7f4a74157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:41.954 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.951+0000 7f4a7abfb640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4a74156ca0 0x7f4a740b1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:41.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.951+0000 7f4a79bf9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a741539e0 0x7f4a74157800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:53628/0 (socket says 172.21.15.105:53628) 2024-09-12T02:22:41.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.951+0000 7f4a79bf9640 1 -- 172.21.15.105:0/3910914886 learned_addr learned my addr 172.21.15.105:0/3910914886 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-12T02:22:41.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.951+0000 7f4a7a3fa640 1 --2- 172.21.15.105:0/3910914886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a740c6910 0x7f4a741e24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:41.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.951+0000 7f4a79bf9640 1 -- 172.21.15.105:0/3910914886 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4a74156ca0 msgr2=0x7f4a740b1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:41.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.951+0000 7f4a79bf9640 1 --2- 172.21.15.105:0/3910914886 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4a74156ca0 0x7f4a740b1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:41.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.951+0000 7f4a79bf9640 1 -- 172.21.15.105:0/3910914886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a740c6910 msgr2=0x7f4a741e24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:41.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.951+0000 7f4a79bf9640 1 --2- 172.21.15.105:0/3910914886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a740c6910 0x7f4a741e24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:41.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.951+0000 7f4a79bf9640 1 -- 172.21.15.105:0/3910914886 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a741e1730 con 0x7f4a741539e0 2024-09-12T02:22:41.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.951+0000 7f4a7a3fa640 1 --2- 172.21.15.105:0/3910914886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a740c6910 0x7f4a741e24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:22:41.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.952+0000 7f4a79bf9640 1 --2- 172.21.15.105:0/3910914886 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a741539e0 0x7f4a74157800 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4a7002a2b0 tx=0x7f4a700046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:41.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.952+0000 7f4a6affd640 1 -- 172.21.15.105:0/3910914886 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a70041020 con 0x7f4a741539e0 2024-09-12T02:22:41.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.952+0000 7f4a6affd640 1 -- 172.21.15.105:0/3910914886 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a700306c0 con 0x7f4a741539e0 2024-09-12T02:22:41.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.952+0000 7f4a6affd640 1 -- 172.21.15.105:0/3910914886 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a70037040 con 0x7f4a741539e0 2024-09-12T02:22:41.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.952+0000 7f4a7c65e640 1 -- 172.21.15.105:0/3910914886 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a741f0160 con 0x7f4a741539e0 2024-09-12T02:22:41.956 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.952+0000 7f4a7c65e640 1 -- 172.21.15.105:0/3910914886 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a741e1cd0 con 0x7f4a741539e0 2024-09-12T02:22:41.956 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.952+0000 7f4a6affd640 1 -- 172.21.15.105:0/3910914886 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4a70044020 con 0x7f4a741539e0 2024-09-12T02:22:41.956 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.952+0000 7f4a6affd640 1 -- 172.21.15.105:0/3910914886 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f4a7003dce0 con 0x7f4a741539e0 2024-09-12T02:22:41.956 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.953+0000 7f4a7c65e640 1 -- 172.21.15.105:0/3910914886 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a74153fc0 con 0x7f4a741539e0 2024-09-12T02:22:41.957 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:41.957+0000 7f4a6affd640 1 -- 172.21.15.105:0/3910914886 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f4a7004b030 con 0x7f4a741539e0 2024-09-12T02:22:42.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.025+0000 7f4a7c65e640 1 -- 172.21.15.105:0/3910914886 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f6453471-893a-490b-b0c7-f196a0f574e5", "id": 3} v 0) -- 0x7f4a740c61b0 con 0x7f4a741539e0 2024-09-12T02:22:42.029 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.028+0000 7f4a6affd640 1 -- 172.21.15.105:0/3910914886 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f6453471-893a-490b-b0c7-f196a0f574e5", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f4a7003d420 con 0x7f4a741539e0 2024-09-12T02:22:42.029 INFO:teuthology.orchestra.run.smithi105.stdout:3 2024-09-12T02:22:42.030 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.029+0000 7f4a7c65e640 1 -- 172.21.15.105:0/3910914886 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a741539e0 msgr2=0x7f4a74157800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:42.030 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.029+0000 7f4a7c65e640 1 --2- 172.21.15.105:0/3910914886 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a741539e0 0x7f4a74157800 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4a7002a2b0 tx=0x7f4a700046c0 comp rx=0 tx=0).stop 2024-09-12T02:22:42.030 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.029+0000 7f4a7c65e640 1 -- 172.21.15.105:0/3910914886 shutdown_connections 2024-09-12T02:22:42.030 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.029+0000 7f4a7c65e640 1 --2- 172.21.15.105:0/3910914886 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4a74156ca0 0x7f4a740b1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:42.030 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.029+0000 7f4a7c65e640 1 --2- 172.21.15.105:0/3910914886 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a741539e0 0x7f4a74157800 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:42.030 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.029+0000 7f4a7c65e640 1 --2- 172.21.15.105:0/3910914886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a740c6910 0x7f4a741e24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:42.030 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.029+0000 7f4a7c65e640 1 -- 172.21.15.105:0/3910914886 >> 172.21.15.105:0/3910914886 conn(0x7f4a740c8800 msgr2=0x7f4a740caf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:42.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.029+0000 7f4a7c65e640 1 -- 172.21.15.105:0/3910914886 shutdown_connections 2024-09-12T02:22:42.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.029+0000 7f4a7c65e640 1 -- 172.21.15.105:0/3910914886 wait complete. 2024-09-12T02:22:42.039 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new 96e908b6-ce3e-466c-b02d-08fc71a1dba6 4 2024-09-12T02:22:42.047 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T02:22:42.046+0000 7fa339b2f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T02:22:42.102 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T02:22:42.101+0000 7fa339b2f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T02:22:42.118 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T02:22:42.118+0000 7f1ab6729040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T02:22:42.139 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.139+0000 7f6c1954b640 1 Processor -- start 2024-09-12T02:22:42.139 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.139+0000 7f6c1954b640 1 -- start start 2024-09-12T02:22:42.140 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.139+0000 7f6c1954b640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6c140c7ff0 0x7f6c14156a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:42.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.139+0000 7f6c1954b640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c140c8440 con 0x7f6c140c7bb0 2024-09-12T02:22:42.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.139+0000 7f6c1954b640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c14156f60 con 0x7f6c14153a40 2024-09-12T02:22:42.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.139+0000 7f6c1954b640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f6c14159900 con 0x7f6c140c7ff0 2024-09-12T02:22:42.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.139+0000 7f6c137fe640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6c140c7ff0 0x7f6c14156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:42.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.140+0000 7f6c12ffd640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f6c14153a40 0x7f6c1406c6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:57338/0 (socket says 172.21.15.105:57338) 2024-09-12T02:22:42.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.140+0000 7f6c12ffd640 1 -- 172.21.15.105:0/1838965363 learned_addr learned my addr 172.21.15.105:0/1838965363 (peer_addr_for_me v1:172.21.15.105:0/0) 2024-09-12T02:22:42.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.140+0000 7f6c137fe640 1 -- 172.21.15.105:0/1838965363 >> v1:172.21.15.105:6789/0 conn(0x7f6c14153a40 legacy=0x7f6c1406c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:42.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.140+0000 7f6c137fe640 1 -- 172.21.15.105:0/1838965363 >> v1:172.21.15.60:6789/0 conn(0x7f6c140c7bb0 legacy=0x7f6c14156310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:42.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.140+0000 7f6c11ffb640 1 -- 172.21.15.105:0/1838965363 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3388673893 0 0) 0x7f6c14156f60 con 0x7f6c14153a40 2024-09-12T02:22:42.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.140+0000 7f6c137fe640 1 -- 172.21.15.105:0/1838965363 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c14159be0 con 0x7f6c140c7ff0 2024-09-12T02:22:42.142 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.140+0000 7f6c137fe640 1 --2- 172.21.15.105:0/1838965363 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c140c7ff0 0x7f6c14156a20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c009d90 tx=0x7f6c0c02a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a7396054b2e8ae0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:42.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.141+0000 7f6c11ffb640 1 -- 172.21.15.105:0/1838965363 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c007740 con 0x7f6c140c7ff0 2024-09-12T02:22:42.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.141+0000 7f6c11ffb640 1 -- 172.21.15.105:0/1838965363 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c0c0078e0 con 0x7f6c140c7ff0 2024-09-12T02:22:42.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.141+0000 7f6c11ffb640 1 -- 172.21.15.105:0/1838965363 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c007cb0 con 0x7f6c140c7ff0 2024-09-12T02:22:42.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.141+0000 7f6c1954b640 1 -- 172.21.15.105:0/1838965363 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c140c7ff0 msgr2=0x7f6c14156a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:42.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.141+0000 7f6c1954b640 1 --2- 172.21.15.105:0/1838965363 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c140c7ff0 0x7f6c14156a20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c009d90 tx=0x7f6c0c02a6f0 comp rx=0 tx=0).stop 2024-09-12T02:22:42.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.141+0000 7f6c1954b640 1 -- 172.21.15.105:0/1838965363 shutdown_connections 2024-09-12T02:22:42.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.141+0000 7f6c1954b640 1 --2- 172.21.15.105:0/1838965363 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c140c7ff0 0x7f6c14156a20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:42.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.141+0000 7f6c1954b640 1 -- 172.21.15.105:0/1838965363 >> 172.21.15.105:0/1838965363 conn(0x7f6c14073310 msgr2=0x7f6c140736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:42.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.141+0000 7f6c1954b640 1 -- 172.21.15.105:0/1838965363 shutdown_connections 2024-09-12T02:22:42.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.141+0000 7f6c1954b640 1 -- 172.21.15.105:0/1838965363 wait complete. 2024-09-12T02:22:42.145 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.143+0000 7f6c1954b640 1 Processor -- start 2024-09-12T02:22:42.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.143+0000 7f6c1954b640 1 -- start start 2024-09-12T02:22:42.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.143+0000 7f6c1954b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c140c7bb0 0x7f6c141ece60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:42.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.143+0000 7f6c1954b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c140c7ff0 0x7f6c141e2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:42.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.143+0000 7f6c1954b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c14153a40 0x7f6c14158f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:42.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.143+0000 7f6c1954b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1415a480 con 0x7f6c140c7bb0 2024-09-12T02:22:42.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.143+0000 7f6c1954b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1415a1a0 con 0x7f6c140c7ff0 2024-09-12T02:22:42.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.143+0000 7f6c1954b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6c140c9270 con 0x7f6c14153a40 2024-09-12T02:22:42.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.143+0000 7f6c127fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c140c7ff0 0x7f6c141e2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:42.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.143+0000 7f6c137fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c14153a40 0x7f6c14158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:42.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.143+0000 7f6c127fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c140c7ff0 0x7f6c141e2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:53634/0 (socket says 172.21.15.105:53634) 2024-09-12T02:22:42.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.143+0000 7f6c137fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c14153a40 0x7f6c14158f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:60364/0 (socket says 172.21.15.105:60364) 2024-09-12T02:22:42.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.143+0000 7f6c127fc640 1 -- 172.21.15.105:0/2322480602 learned_addr learned my addr 172.21.15.105:0/2322480602 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-12T02:22:42.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.143+0000 7f6c12ffd640 1 --2- 172.21.15.105:0/2322480602 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c140c7bb0 0x7f6c141ece60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:42.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.144+0000 7f6c127fc640 1 -- 172.21.15.105:0/2322480602 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c14153a40 msgr2=0x7f6c14158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:42.147 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.144+0000 7f6c127fc640 1 --2- 172.21.15.105:0/2322480602 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c14153a40 0x7f6c14158f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:42.147 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.144+0000 7f6c127fc640 1 -- 172.21.15.105:0/2322480602 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c140c7bb0 msgr2=0x7f6c141ece60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:42.147 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.144+0000 7f6c127fc640 1 --2- 172.21.15.105:0/2322480602 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c140c7bb0 0x7f6c141ece60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:42.147 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.144+0000 7f6c127fc640 1 -- 172.21.15.105:0/2322480602 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c14150ab0 con 0x7f6c140c7ff0 2024-09-12T02:22:42.147 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.144+0000 7f6c127fc640 1 --2- 172.21.15.105:0/2322480602 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c140c7ff0 0x7f6c141e2c40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6c0800c450 tx=0x7f6c0800c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:42.147 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.144+0000 7f6bfb7fe640 1 -- 172.21.15.105:0/2322480602 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c080052d0 con 0x7f6c140c7ff0 2024-09-12T02:22:42.147 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.144+0000 7f6bfb7fe640 1 -- 172.21.15.105:0/2322480602 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c08005470 con 0x7f6c140c7ff0 2024-09-12T02:22:42.147 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.144+0000 7f6c1954b640 1 -- 172.21.15.105:0/2322480602 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c14150610 con 0x7f6c140c7ff0 2024-09-12T02:22:42.147 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.144+0000 7f6bfb7fe640 1 -- 172.21.15.105:0/2322480602 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c08012870 con 0x7f6c140c7ff0 2024-09-12T02:22:42.147 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.144+0000 7f6c1954b640 1 -- 172.21.15.105:0/2322480602 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c141594a0 con 0x7f6c140c7ff0 2024-09-12T02:22:42.147 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.144+0000 7f6bfb7fe640 1 -- 172.21.15.105:0/2322480602 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6c08012a10 con 0x7f6c140c7ff0 2024-09-12T02:22:42.147 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.144+0000 7f6bfb7fe640 1 -- 172.21.15.105:0/2322480602 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f6c08012d00 con 0x7f6c140c7ff0 2024-09-12T02:22:42.147 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.145+0000 7f6c1954b640 1 -- 172.21.15.105:0/2322480602 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c14153e20 con 0x7f6c140c7ff0 2024-09-12T02:22:42.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.149+0000 7f6bfb7fe640 1 -- 172.21.15.105:0/2322480602 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f6c080035f0 con 0x7f6c140c7ff0 2024-09-12T02:22:42.175 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T02:22:42.175+0000 7f1ab6729040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T02:22:42.219 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.218+0000 7f6c1954b640 1 -- 172.21.15.105:0/2322480602 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd new", "uuid": "96e908b6-ce3e-466c-b02d-08fc71a1dba6", "id": 4} v 0) -- 0x7f6c140b11b0 con 0x7f6c140c7ff0 2024-09-12T02:22:42.222 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.222+0000 7f6bfb7fe640 1 -- 172.21.15.105:0/2322480602 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "96e908b6-ce3e-466c-b02d-08fc71a1dba6", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f6c080037d0 con 0x7f6c140c7ff0 2024-09-12T02:22:42.223 INFO:teuthology.orchestra.run.smithi105.stdout:4 2024-09-12T02:22:42.224 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.223+0000 7f6c1954b640 1 -- 172.21.15.105:0/2322480602 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c140c7ff0 msgr2=0x7f6c141e2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:42.224 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.223+0000 7f6c1954b640 1 --2- 172.21.15.105:0/2322480602 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c140c7ff0 0x7f6c141e2c40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6c0800c450 tx=0x7f6c0800c910 comp rx=0 tx=0).stop 2024-09-12T02:22:42.224 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.223+0000 7f6c1954b640 1 -- 172.21.15.105:0/2322480602 shutdown_connections 2024-09-12T02:22:42.224 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.223+0000 7f6c1954b640 1 --2- 172.21.15.105:0/2322480602 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c14153a40 0x7f6c14158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:42.224 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.223+0000 7f6c1954b640 1 --2- 172.21.15.105:0/2322480602 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c140c7ff0 0x7f6c141e2c40 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:42.224 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.223+0000 7f6c1954b640 1 --2- 172.21.15.105:0/2322480602 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c140c7bb0 0x7f6c141ece60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:42.224 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.223+0000 7f6c1954b640 1 -- 172.21.15.105:0/2322480602 >> 172.21.15.105:0/2322480602 conn(0x7f6c14073310 msgr2=0x7f6c14152380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:42.224 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.223+0000 7f6c1954b640 1 -- 172.21.15.105:0/2322480602 shutdown_connections 2024-09-12T02:22:42.224 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.223+0000 7f6c1954b640 1 -- 172.21.15.105:0/2322480602 wait complete. 2024-09-12T02:22:42.234 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new 7ebc26f0-a462-4364-9303-7351f7cba21f 5 2024-09-12T02:22:42.332 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.331+0000 7f237dc65640 1 Processor -- start 2024-09-12T02:22:42.332 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.331+0000 7f237dc65640 1 -- start start 2024-09-12T02:22:42.333 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.332+0000 7f237dc65640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23780701e0 0x7f2378152fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:42.333 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.332+0000 7f237dc65640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23781535d0 con 0x7f23780c3b20 2024-09-12T02:22:42.333 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.332+0000 7f237dc65640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23781538b0 con 0x7f23780a8200 2024-09-12T02:22:42.333 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.332+0000 7f237dc65640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f23780c5450 con 0x7f23780701e0 2024-09-12T02:22:42.333 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.332+0000 7f236ffff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23780701e0 0x7f2378152fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:42.333 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.332+0000 7f23777fe640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f23780a8200 0x7f23780c7a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:57342/0 (socket says 172.21.15.105:57342) 2024-09-12T02:22:42.333 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.332+0000 7f23777fe640 1 -- 172.21.15.105:0/3583738025 learned_addr learned my addr 172.21.15.105:0/3583738025 (peer_addr_for_me v1:172.21.15.105:0/0) 2024-09-12T02:22:42.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.332+0000 7f236ffff640 1 -- 172.21.15.105:0/3583738025 >> v1:172.21.15.105:6789/0 conn(0x7f23780a8200 legacy=0x7f23780c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:42.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.332+0000 7f236ffff640 1 -- 172.21.15.105:0/3583738025 >> v1:172.21.15.60:6789/0 conn(0x7f23780c3b20 legacy=0x7f23780c3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:42.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.332+0000 7f2376ffd640 1 -- 172.21.15.105:0/3583738025 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2322999139 0 0) 0x7f23781538b0 con 0x7f23780a8200 2024-09-12T02:22:42.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.332+0000 7f236ffff640 1 -- 172.21.15.105:0/3583738025 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2378153b90 con 0x7f23780701e0 2024-09-12T02:22:42.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.333+0000 7f236ffff640 1 --2- 172.21.15.105:0/3583738025 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23780701e0 0x7f2378152fa0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f23600097d0 tx=0x7f236002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f17dbc4b25bb77e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:42.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.333+0000 7f2376ffd640 1 -- 172.21.15.105:0/3583738025 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2360037070 con 0x7f23780701e0 2024-09-12T02:22:42.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.333+0000 7f2376ffd640 1 -- 172.21.15.105:0/3583738025 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2360032440 con 0x7f23780701e0 2024-09-12T02:22:42.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.333+0000 7f2376ffd640 1 -- 172.21.15.105:0/3583738025 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2360032810 con 0x7f23780701e0 2024-09-12T02:22:42.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.334+0000 7f237dc65640 1 -- 172.21.15.105:0/3583738025 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23780701e0 msgr2=0x7f2378152fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:42.336 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.334+0000 7f237dc65640 1 --2- 172.21.15.105:0/3583738025 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23780701e0 0x7f2378152fa0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f23600097d0 tx=0x7f236002a180 comp rx=0 tx=0).stop 2024-09-12T02:22:42.336 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.334+0000 7f237dc65640 1 -- 172.21.15.105:0/3583738025 shutdown_connections 2024-09-12T02:22:42.336 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.334+0000 7f237dc65640 1 --2- 172.21.15.105:0/3583738025 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23780701e0 0x7f2378152fa0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:42.336 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.334+0000 7f237dc65640 1 -- 172.21.15.105:0/3583738025 >> 172.21.15.105:0/3583738025 conn(0x7f23780c5660 msgr2=0x7f23780c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:42.336 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.334+0000 7f237dc65640 1 -- 172.21.15.105:0/3583738025 shutdown_connections 2024-09-12T02:22:42.336 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.334+0000 7f237dc65640 1 -- 172.21.15.105:0/3583738025 wait complete. 2024-09-12T02:22:42.336 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.335+0000 7f237dc65640 1 Processor -- start 2024-09-12T02:22:42.336 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.335+0000 7f237dc65640 1 -- start start 2024-09-12T02:22:42.338 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.336+0000 7f237dc65640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23780701e0 0x7f2378149d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:42.338 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.336+0000 7f237dc65640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23780a8200 0x7f23781488c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:42.338 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.336+0000 7f237dc65640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23780c3b20 0x7f2378156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:42.338 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.336+0000 7f237dc65640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f23780a85e0 con 0x7f23780c3b20 2024-09-12T02:22:42.338 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.336+0000 7f237dc65640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f23780c3690 con 0x7f23780a8200 2024-09-12T02:22:42.338 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.336+0000 7f237dc65640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f23780c8180 con 0x7f23780701e0 2024-09-12T02:22:42.339 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.336+0000 7f23777fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23780701e0 0x7f2378149d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:42.339 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.336+0000 7f23777fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23780701e0 0x7f2378149d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:60380/0 (socket says 172.21.15.105:60380) 2024-09-12T02:22:42.339 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.336+0000 7f23777fe640 1 -- 172.21.15.105:0/43584812 learned_addr learned my addr 172.21.15.105:0/43584812 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-12T02:22:42.339 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.336+0000 7f236ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23780a8200 0x7f23781488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:42.339 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.336+0000 7f2377fff640 1 --2- 172.21.15.105:0/43584812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23780c3b20 0x7f2378156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:42.339 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.336+0000 7f23777fe640 1 -- 172.21.15.105:0/43584812 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23780a8200 msgr2=0x7f23781488c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:42.339 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.336+0000 7f23777fe640 1 --2- 172.21.15.105:0/43584812 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23780a8200 0x7f23781488c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:42.339 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.336+0000 7f23777fe640 1 -- 172.21.15.105:0/43584812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23780c3b20 msgr2=0x7f2378156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:42.339 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.336+0000 7f23777fe640 1 --2- 172.21.15.105:0/43584812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23780c3b20 0x7f2378156630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:42.339 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.336+0000 7f23777fe640 1 -- 172.21.15.105:0/43584812 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f237814c5d0 con 0x7f23780701e0 2024-09-12T02:22:42.339 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.336+0000 7f2377fff640 1 --2- 172.21.15.105:0/43584812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23780c3b20 0x7f2378156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:22:42.339 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.336+0000 7f236ffff640 1 --2- 172.21.15.105:0/43584812 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23780a8200 0x7f23781488c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:22:42.339 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.336+0000 7f23777fe640 1 --2- 172.21.15.105:0/43584812 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23780701e0 0x7f2378149d10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f236800c4a0 tx=0x7f236800c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:42.340 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.336+0000 7f2374ff9640 1 -- 172.21.15.105:0/43584812 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2368018070 con 0x7f23780701e0 2024-09-12T02:22:42.340 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.336+0000 7f2374ff9640 1 -- 172.21.15.105:0/43584812 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23680074e0 con 0x7f23780701e0 2024-09-12T02:22:42.340 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.336+0000 7f237dc65640 1 -- 172.21.15.105:0/43584812 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f237814cee0 con 0x7f23780701e0 2024-09-12T02:22:42.340 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.336+0000 7f2374ff9640 1 -- 172.21.15.105:0/43584812 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2368004a20 con 0x7f23780701e0 2024-09-12T02:22:42.340 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.336+0000 7f237dc65640 1 -- 172.21.15.105:0/43584812 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f237814a250 con 0x7f23780701e0 2024-09-12T02:22:42.340 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.337+0000 7f2374ff9640 1 -- 172.21.15.105:0/43584812 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f236801b070 con 0x7f23780701e0 2024-09-12T02:22:42.340 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.337+0000 7f2374ff9640 1 -- 172.21.15.105:0/43584812 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f2368012980 con 0x7f23780701e0 2024-09-12T02:22:42.340 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.337+0000 7f237dc65640 1 -- 172.21.15.105:0/43584812 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23780c5ab0 con 0x7f23780701e0 2024-09-12T02:22:42.340 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.339+0000 7f2374ff9640 1 -- 172.21.15.105:0/43584812 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f23780c5ab0 con 0x7f23780701e0 2024-09-12T02:22:42.409 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.408+0000 7f237dc65640 1 -- 172.21.15.105:0/43584812 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7ebc26f0-a462-4364-9303-7351f7cba21f", "id": 5} v 0) -- 0x7f23780c77f0 con 0x7f23780701e0 2024-09-12T02:22:42.414 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.414+0000 7f2374ff9640 1 -- 172.21.15.105:0/43584812 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7ebc26f0-a462-4364-9303-7351f7cba21f", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f23780c77f0 con 0x7f23780701e0 2024-09-12T02:22:42.415 INFO:teuthology.orchestra.run.smithi105.stdout:5 2024-09-12T02:22:42.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.415+0000 7f237dc65640 1 -- 172.21.15.105:0/43584812 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23780701e0 msgr2=0x7f2378149d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:42.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.415+0000 7f237dc65640 1 --2- 172.21.15.105:0/43584812 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23780701e0 0x7f2378149d10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f236800c4a0 tx=0x7f236800c960 comp rx=0 tx=0).stop 2024-09-12T02:22:42.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.415+0000 7f237dc65640 1 -- 172.21.15.105:0/43584812 shutdown_connections 2024-09-12T02:22:42.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.415+0000 7f237dc65640 1 --2- 172.21.15.105:0/43584812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23780c3b20 0x7f2378156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:42.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.415+0000 7f237dc65640 1 --2- 172.21.15.105:0/43584812 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23780a8200 0x7f23781488c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:42.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.415+0000 7f237dc65640 1 --2- 172.21.15.105:0/43584812 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23780701e0 0x7f2378149d10 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:42.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.415+0000 7f237dc65640 1 -- 172.21.15.105:0/43584812 >> 172.21.15.105:0/43584812 conn(0x7f23780c5660 msgr2=0x7f23780c1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:42.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.415+0000 7f237dc65640 1 -- 172.21.15.105:0/43584812 shutdown_connections 2024-09-12T02:22:42.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.415+0000 7f237dc65640 1 -- 172.21.15.105:0/43584812 wait complete. 2024-09-12T02:22:42.426 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new 49487ea1-9c6d-4090-bbcc-f28b33040eb9 6 2024-09-12T02:22:42.489 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T02:22:42.489+0000 7fa339b2f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T02:22:42.524 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.523+0000 7efcc951f640 1 Processor -- start 2024-09-12T02:22:42.524 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.523+0000 7efcc951f640 1 -- start start 2024-09-12T02:22:42.526 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.524+0000 7efcc951f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efcc4072ec0 0x7efcc41549a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:42.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.524+0000 7efcc951f640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7efcc4155410 0x7efcc40732a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:42.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.524+0000 7efcc951f640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcc406f110 con 0x7efcc40afaf0 2024-09-12T02:22:42.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.524+0000 7efcc951f640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7efcc4155860 con 0x7efcc4072ec0 2024-09-12T02:22:42.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.524+0000 7efcc951f640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7efcc406fa40 con 0x7efcc4155410 2024-09-12T02:22:42.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.524+0000 7efcc37fe640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7efcc4155410 0x7efcc40732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:42.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.524+0000 7efcc27fc640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7efcc40afaf0 0x7efcc406fed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:57344/0 (socket says 172.21.15.105:57344) 2024-09-12T02:22:42.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.524+0000 7efcc27fc640 1 -- 172.21.15.105:0/3470555254 learned_addr learned my addr 172.21.15.105:0/3470555254 (peer_addr_for_me v1:172.21.15.105:0/0) 2024-09-12T02:22:42.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.524+0000 7efcc37fe640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7efcc4155410 0x7efcc40732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:53652/0 (socket says 172.21.15.105:53652) 2024-09-12T02:22:42.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.524+0000 7efcc2ffd640 1 --2- 172.21.15.105:0/3470555254 >> v2:172.21.15.60:3300/0 conn(0x7efcc4072ec0 0x7efcc41549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:42.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.524+0000 7efcc37fe640 1 -- 172.21.15.105:0/3470555254 >> v2:172.21.15.60:3300/0 conn(0x7efcc4072ec0 msgr2=0x7efcc41549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:22:42.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.524+0000 7efcc37fe640 1 --2- 172.21.15.105:0/3470555254 >> v2:172.21.15.60:3300/0 conn(0x7efcc4072ec0 0x7efcc41549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:42.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.524+0000 7efcc37fe640 1 -- 172.21.15.105:0/3470555254 >> v1:172.21.15.105:6789/0 conn(0x7efcc40afaf0 legacy=0x7efcc406fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:42.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.524+0000 7efcc37fe640 1 -- 172.21.15.105:0/3470555254 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc406f3f0 con 0x7efcc4155410 2024-09-12T02:22:42.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.524+0000 7efcc2ffd640 1 --2- 172.21.15.105:0/3470555254 >> v2:172.21.15.60:3300/0 conn(0x7efcc4072ec0 0x7efcc41549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:22:42.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.525+0000 7efcc37fe640 1 --2- 172.21.15.105:0/3470555254 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efcc4155410 0x7efcc40732a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7efcc406f9b0 tx=0x7efcbc02a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a7e6ba639a262fe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:42.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.525+0000 7efcc1ffb640 1 -- 172.21.15.105:0/3470555254 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcbc007740 con 0x7efcc4155410 2024-09-12T02:22:42.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.525+0000 7efcc1ffb640 1 -- 172.21.15.105:0/3470555254 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcbc0078e0 con 0x7efcc4155410 2024-09-12T02:22:42.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.525+0000 7efcc1ffb640 1 -- 172.21.15.105:0/3470555254 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcbc007cb0 con 0x7efcc4155410 2024-09-12T02:22:42.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.526+0000 7efcc951f640 1 -- 172.21.15.105:0/3470555254 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efcc4155410 msgr2=0x7efcc40732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:42.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.526+0000 7efcc951f640 1 --2- 172.21.15.105:0/3470555254 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efcc4155410 0x7efcc40732a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7efcc406f9b0 tx=0x7efcbc02a5f0 comp rx=0 tx=0).stop 2024-09-12T02:22:42.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.526+0000 7efcc951f640 1 -- 172.21.15.105:0/3470555254 shutdown_connections 2024-09-12T02:22:42.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.526+0000 7efcc951f640 1 --2- 172.21.15.105:0/3470555254 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efcc4155410 0x7efcc40732a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:42.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.526+0000 7efcc951f640 1 --2- 172.21.15.105:0/3470555254 >> v2:172.21.15.60:3300/0 conn(0x7efcc4072ec0 0x7efcc41549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:42.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.526+0000 7efcc951f640 1 -- 172.21.15.105:0/3470555254 >> 172.21.15.105:0/3470555254 conn(0x7efcc40c9d80 msgr2=0x7efcc40ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:42.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.526+0000 7efcc951f640 1 -- 172.21.15.105:0/3470555254 shutdown_connections 2024-09-12T02:22:42.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.526+0000 7efcc951f640 1 -- 172.21.15.105:0/3470555254 wait complete. 2024-09-12T02:22:42.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.527+0000 7efcc951f640 1 Processor -- start 2024-09-12T02:22:42.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.527+0000 7efcc951f640 1 -- start start 2024-09-12T02:22:42.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.528+0000 7efcc951f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcc4072ec0 0x7efcc40c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:42.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.528+0000 7efcc951f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efcc40afaf0 0x7efcc4143d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:42.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.528+0000 7efcc951f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efcc4155410 0x7efcc4144280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:42.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.528+0000 7efcc951f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7efcc414a430 con 0x7efcc4072ec0 2024-09-12T02:22:42.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.528+0000 7efcc951f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efcc40705e0 con 0x7efcc4155410 2024-09-12T02:22:42.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.528+0000 7efcc951f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efcc414a5b0 con 0x7efcc40afaf0 2024-09-12T02:22:42.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.528+0000 7efcc27fc640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efcc40afaf0 0x7efcc4143d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:42.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.528+0000 7efcc37fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efcc4155410 0x7efcc4144280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:42.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.528+0000 7efcc37fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efcc4155410 0x7efcc4144280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:53664/0 (socket says 172.21.15.105:53664) 2024-09-12T02:22:42.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.528+0000 7efcc37fe640 1 -- 172.21.15.105:0/1824271915 learned_addr learned my addr 172.21.15.105:0/1824271915 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-12T02:22:42.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.528+0000 7efcc2ffd640 1 --2- 172.21.15.105:0/1824271915 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcc4072ec0 0x7efcc40c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:42.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.528+0000 7efcc37fe640 1 -- 172.21.15.105:0/1824271915 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efcc40afaf0 msgr2=0x7efcc4143d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:42.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.528+0000 7efcc37fe640 1 --2- 172.21.15.105:0/1824271915 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efcc40afaf0 0x7efcc4143d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:42.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.528+0000 7efcc37fe640 1 -- 172.21.15.105:0/1824271915 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcc4072ec0 msgr2=0x7efcc40c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:42.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.528+0000 7efcc37fe640 1 --2- 172.21.15.105:0/1824271915 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcc4072ec0 0x7efcc40c34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:42.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.528+0000 7efcc37fe640 1 -- 172.21.15.105:0/1824271915 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc40c7c70 con 0x7efcc4155410 2024-09-12T02:22:42.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.528+0000 7efcc27fc640 1 --2- 172.21.15.105:0/1824271915 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efcc40afaf0 0x7efcc4143d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:22:42.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.528+0000 7efcc37fe640 1 --2- 172.21.15.105:0/1824271915 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efcc4155410 0x7efcc4144280 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7efcbc009e50 tx=0x7efcbc004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:42.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.529+0000 7efcbb7fe640 1 -- 172.21.15.105:0/1824271915 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcbc03f070 con 0x7efcc4155410 2024-09-12T02:22:42.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.529+0000 7efcbb7fe640 1 -- 172.21.15.105:0/1824271915 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcbc031bf0 con 0x7efcc4155410 2024-09-12T02:22:42.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.529+0000 7efcbb7fe640 1 -- 172.21.15.105:0/1824271915 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcbc044460 con 0x7efcc4155410 2024-09-12T02:22:42.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.529+0000 7efcc951f640 1 -- 172.21.15.105:0/1824271915 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcc406e390 con 0x7efcc4155410 2024-09-12T02:22:42.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.529+0000 7efcc951f640 1 -- 172.21.15.105:0/1824271915 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcc40acc10 con 0x7efcc4155410 2024-09-12T02:22:42.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.529+0000 7efcbb7fe640 1 -- 172.21.15.105:0/1824271915 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7efcbc007790 con 0x7efcc4155410 2024-09-12T02:22:42.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.529+0000 7efcbb7fe640 1 -- 172.21.15.105:0/1824271915 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7efcbc03baa0 con 0x7efcc4155410 2024-09-12T02:22:42.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.530+0000 7efcc951f640 1 -- 172.21.15.105:0/1824271915 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcc40ad6b0 con 0x7efcc4155410 2024-09-12T02:22:42.534 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.532+0000 7efcbb7fe640 1 -- 172.21.15.105:0/1824271915 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7efcbc052080 con 0x7efcc4155410 2024-09-12T02:22:42.562 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T02:22:42.562+0000 7f1ab6729040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T02:22:42.578 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T02:22:42.578+0000 7fa339b2f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T02:22:42.601 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.600+0000 7efcc951f640 1 -- 172.21.15.105:0/1824271915 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd new", "uuid": "49487ea1-9c6d-4090-bbcc-f28b33040eb9", "id": 6} v 0) -- 0x7efcc41549a0 con 0x7efcc4155410 2024-09-12T02:22:42.609 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.608+0000 7efcbb7fe640 1 -- 172.21.15.105:0/1824271915 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "49487ea1-9c6d-4090-bbcc-f28b33040eb9", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7efcbc03bd40 con 0x7efcc4155410 2024-09-12T02:22:42.609 INFO:teuthology.orchestra.run.smithi105.stdout:6 2024-09-12T02:22:42.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.610+0000 7efcc951f640 1 -- 172.21.15.105:0/1824271915 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efcc4155410 msgr2=0x7efcc4144280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:42.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.610+0000 7efcc951f640 1 --2- 172.21.15.105:0/1824271915 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efcc4155410 0x7efcc4144280 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7efcbc009e50 tx=0x7efcbc004a40 comp rx=0 tx=0).stop 2024-09-12T02:22:42.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.610+0000 7efcc951f640 1 -- 172.21.15.105:0/1824271915 shutdown_connections 2024-09-12T02:22:42.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.610+0000 7efcc951f640 1 --2- 172.21.15.105:0/1824271915 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efcc4155410 0x7efcc4144280 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:42.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.610+0000 7efcc951f640 1 --2- 172.21.15.105:0/1824271915 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efcc40afaf0 0x7efcc4143d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:42.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.610+0000 7efcc951f640 1 --2- 172.21.15.105:0/1824271915 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcc4072ec0 0x7efcc40c34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:42.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.610+0000 7efcc951f640 1 -- 172.21.15.105:0/1824271915 >> 172.21.15.105:0/1824271915 conn(0x7efcc40c9d80 msgr2=0x7efcc4075030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:42.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.610+0000 7efcc951f640 1 -- 172.21.15.105:0/1824271915 shutdown_connections 2024-09-12T02:22:42.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.610+0000 7efcc951f640 1 -- 172.21.15.105:0/1824271915 wait complete. 2024-09-12T02:22:42.624 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new 1e3a0aa9-7e29-4785-8506-6b5d3be2be35 7 2024-09-12T02:22:42.655 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T02:22:42.655+0000 7f1ab6729040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T02:22:42.692 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T02:22:42.690+0000 7fa339b2f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:22:42.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.725+0000 7f9e6118d640 1 Processor -- start 2024-09-12T02:22:42.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.726+0000 7f9e6118d640 1 -- start start 2024-09-12T02:22:42.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.727+0000 7f9e6118d640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9e5c0afaf0 0x7f9e5c1549a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:42.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.727+0000 7f9e6118d640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e5c06f110 con 0x7f9e5c072ec0 2024-09-12T02:22:42.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.727+0000 7f9e6118d640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e5c06f3f0 con 0x7f9e5c155410 2024-09-12T02:22:42.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.727+0000 7f9e6118d640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f9e5c155860 con 0x7f9e5c0afaf0 2024-09-12T02:22:42.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.727+0000 7f9e53fff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9e5c0afaf0 0x7f9e5c1549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:42.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.727+0000 7f9e5b59e640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f9e5c155410 0x7f9e5c14a430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:57350/0 (socket says 172.21.15.105:57350) 2024-09-12T02:22:42.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.727+0000 7f9e5b59e640 1 -- 172.21.15.105:0/2578341677 learned_addr learned my addr 172.21.15.105:0/2578341677 (peer_addr_for_me v1:172.21.15.105:0/0) 2024-09-12T02:22:42.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.727+0000 7f9e53fff640 1 -- 172.21.15.105:0/2578341677 >> v1:172.21.15.105:6789/0 conn(0x7f9e5c155410 legacy=0x7f9e5c14a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:42.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.727+0000 7f9e53fff640 1 -- 172.21.15.105:0/2578341677 >> v1:172.21.15.60:6789/0 conn(0x7f9e5c072ec0 legacy=0x7f9e5c06fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:42.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.727+0000 7f9e5a59c640 1 -- 172.21.15.105:0/2578341677 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1351444238 0 0) 0x7f9e5c06f3f0 con 0x7f9e5c155410 2024-09-12T02:22:42.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.727+0000 7f9e53fff640 1 -- 172.21.15.105:0/2578341677 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e5c06f6d0 con 0x7f9e5c0afaf0 2024-09-12T02:22:42.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.728+0000 7f9e53fff640 1 --2- 172.21.15.105:0/2578341677 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e5c0afaf0 0x7f9e5c1549a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9e440097a0 tx=0x7f9e4402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d47e461e0a650920 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:42.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.728+0000 7f9e5a59c640 1 -- 172.21.15.105:0/2578341677 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e44037070 con 0x7f9e5c0afaf0 2024-09-12T02:22:42.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.728+0000 7f9e5a59c640 1 -- 172.21.15.105:0/2578341677 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e44032440 con 0x7f9e5c0afaf0 2024-09-12T02:22:42.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.728+0000 7f9e5a59c640 1 -- 172.21.15.105:0/2578341677 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e44032810 con 0x7f9e5c0afaf0 2024-09-12T02:22:42.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.729+0000 7f9e6118d640 1 -- 172.21.15.105:0/2578341677 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e5c0afaf0 msgr2=0x7f9e5c1549a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:42.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.729+0000 7f9e6118d640 1 --2- 172.21.15.105:0/2578341677 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e5c0afaf0 0x7f9e5c1549a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9e440097a0 tx=0x7f9e4402a1a0 comp rx=0 tx=0).stop 2024-09-12T02:22:42.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.729+0000 7f9e6118d640 1 -- 172.21.15.105:0/2578341677 shutdown_connections 2024-09-12T02:22:42.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.729+0000 7f9e6118d640 1 --2- 172.21.15.105:0/2578341677 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e5c0afaf0 0x7f9e5c1549a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:42.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.729+0000 7f9e6118d640 1 -- 172.21.15.105:0/2578341677 >> 172.21.15.105:0/2578341677 conn(0x7f9e5c0c9d80 msgr2=0x7f9e5c0ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:42.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.729+0000 7f9e6118d640 1 -- 172.21.15.105:0/2578341677 shutdown_connections 2024-09-12T02:22:42.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.729+0000 7f9e6118d640 1 -- 172.21.15.105:0/2578341677 wait complete. 2024-09-12T02:22:42.733 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.730+0000 7f9e6118d640 1 Processor -- start 2024-09-12T02:22:42.733 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.731+0000 7f9e6118d640 1 -- start start 2024-09-12T02:22:42.733 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.731+0000 7f9e6118d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e5c072ec0 0x7f9e5c1ddaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:42.733 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.731+0000 7f9e6118d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9e5c0afaf0 0x7f9e5c142720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:42.734 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.731+0000 7f9e6118d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e5c155410 0x7f9e5c0af1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:42.734 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.731+0000 7f9e6118d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9e5c06fa40 con 0x7f9e5c072ec0 2024-09-12T02:22:42.734 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.731+0000 7f9e6118d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9e5c14ad50 con 0x7f9e5c155410 2024-09-12T02:22:42.734 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.731+0000 7f9e6118d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9e5c0705e0 con 0x7f9e5c0afaf0 2024-09-12T02:22:42.734 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.731+0000 7f9e5b59e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e5c155410 0x7f9e5c0af1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:42.734 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.731+0000 7f9e53fff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9e5c0afaf0 0x7f9e5c142720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:42.734 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.731+0000 7f9e53fff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9e5c0afaf0 0x7f9e5c142720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:60404/0 (socket says 172.21.15.105:60404) 2024-09-12T02:22:42.734 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.731+0000 7f9e53fff640 1 -- 172.21.15.105:0/3293434002 learned_addr learned my addr 172.21.15.105:0/3293434002 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-12T02:22:42.734 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.731+0000 7f9e5ad9d640 1 --2- 172.21.15.105:0/3293434002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e5c072ec0 0x7f9e5c1ddaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:42.734 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.732+0000 7f9e5b59e640 1 -- 172.21.15.105:0/3293434002 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9e5c0afaf0 msgr2=0x7f9e5c142720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:42.734 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.732+0000 7f9e5b59e640 1 --2- 172.21.15.105:0/3293434002 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9e5c0afaf0 0x7f9e5c142720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:42.734 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.732+0000 7f9e5b59e640 1 -- 172.21.15.105:0/3293434002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e5c072ec0 msgr2=0x7f9e5c1ddaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:42.734 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.732+0000 7f9e5b59e640 1 --2- 172.21.15.105:0/3293434002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e5c072ec0 0x7f9e5c1ddaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:42.734 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.732+0000 7f9e5b59e640 1 -- 172.21.15.105:0/3293434002 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e5c1edbe0 con 0x7f9e5c155410 2024-09-12T02:22:42.735 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.732+0000 7f9e53fff640 1 --2- 172.21.15.105:0/3293434002 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9e5c0afaf0 0x7f9e5c142720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:22:42.735 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.732+0000 7f9e5b59e640 1 --2- 172.21.15.105:0/3293434002 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e5c155410 0x7f9e5c0af1e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9e5400c6d0 tx=0x7f9e5400cb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:42.735 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.732+0000 7f9e537fe640 1 -- 172.21.15.105:0/3293434002 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e54018070 con 0x7f9e5c155410 2024-09-12T02:22:42.735 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.732+0000 7f9e537fe640 1 -- 172.21.15.105:0/3293434002 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e54004d60 con 0x7f9e5c155410 2024-09-12T02:22:42.735 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.732+0000 7f9e537fe640 1 -- 172.21.15.105:0/3293434002 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e5400a880 con 0x7f9e5c155410 2024-09-12T02:22:42.735 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.732+0000 7f9e6118d640 1 -- 172.21.15.105:0/3293434002 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e5c1dff40 con 0x7f9e5c155410 2024-09-12T02:22:42.735 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.732+0000 7f9e6118d640 1 -- 172.21.15.105:0/3293434002 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e5c0ac960 con 0x7f9e5c155410 2024-09-12T02:22:42.735 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.732+0000 7f9e537fe640 1 -- 172.21.15.105:0/3293434002 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9e5401b070 con 0x7f9e5c155410 2024-09-12T02:22:42.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.732+0000 7f9e537fe640 1 -- 172.21.15.105:0/3293434002 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f9e54012a60 con 0x7f9e5c155410 2024-09-12T02:22:42.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.733+0000 7f9e6118d640 1 -- 172.21.15.105:0/3293434002 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e5c1dd7c0 con 0x7f9e5c155410 2024-09-12T02:22:42.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.735+0000 7f9e537fe640 1 -- 172.21.15.105:0/3293434002 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f9e5400acd0 con 0x7f9e5c155410 2024-09-12T02:22:42.740 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T02:22:42.739+0000 7fa339b2f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T02:22:42.778 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T02:22:42.778+0000 7f1ab6729040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:22:42.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.815+0000 7f9e6118d640 1 -- 172.21.15.105:0/3293434002 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1e3a0aa9-7e29-4785-8506-6b5d3be2be35", "id": 7} v 0) -- 0x7f9e5c1549a0 con 0x7f9e5c155410 2024-09-12T02:22:42.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.823+0000 7f9e537fe640 1 -- 172.21.15.105:0/3293434002 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1e3a0aa9-7e29-4785-8506-6b5d3be2be35", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f9e54012400 con 0x7f9e5c155410 2024-09-12T02:22:42.824 INFO:teuthology.orchestra.run.smithi105.stdout:7 2024-09-12T02:22:42.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.824+0000 7f9e6118d640 1 -- 172.21.15.105:0/3293434002 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e5c155410 msgr2=0x7f9e5c0af1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:42.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.824+0000 7f9e6118d640 1 --2- 172.21.15.105:0/3293434002 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e5c155410 0x7f9e5c0af1e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9e5400c6d0 tx=0x7f9e5400cb90 comp rx=0 tx=0).stop 2024-09-12T02:22:42.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.824+0000 7f9e6118d640 1 -- 172.21.15.105:0/3293434002 shutdown_connections 2024-09-12T02:22:42.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.824+0000 7f9e6118d640 1 --2- 172.21.15.105:0/3293434002 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e5c155410 0x7f9e5c0af1e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:42.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.824+0000 7f9e6118d640 1 --2- 172.21.15.105:0/3293434002 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9e5c0afaf0 0x7f9e5c142720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:42.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.824+0000 7f9e6118d640 1 --2- 172.21.15.105:0/3293434002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e5c072ec0 0x7f9e5c1ddaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:42.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.824+0000 7f9e6118d640 1 -- 172.21.15.105:0/3293434002 >> 172.21.15.105:0/3293434002 conn(0x7f9e5c0c9d80 msgr2=0x7f9e5c06fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:42.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.824+0000 7f9e6118d640 1 -- 172.21.15.105:0/3293434002 shutdown_connections 2024-09-12T02:22:42.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:22:42.824+0000 7f9e6118d640 1 -- 172.21.15.105:0/3293434002 wait complete. 2024-09-12T02:22:42.827 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T02:22:42.827+0000 7f1ab6729040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T02:22:42.836 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T02:22:42.836 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T02:22:42.840 INFO:tasks.ceph.osd.0:Started 2024-09-12T02:22:42.840 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T02:22:42.840 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T02:22:42.842 INFO:tasks.ceph.osd.1:Started 2024-09-12T02:22:42.842 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T02:22:42.842 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T02:22:42.844 INFO:tasks.ceph.osd.2:Started 2024-09-12T02:22:42.844 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-12T02:22:42.845 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-12T02:22:42.848 INFO:tasks.ceph.osd.3:Started 2024-09-12T02:22:42.848 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-12T02:22:42.848 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-12T02:22:42.861 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T02:22:42.861+0000 7fa339b2f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T02:22:42.878 INFO:tasks.ceph.osd.4:Started 2024-09-12T02:22:42.879 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-12T02:22:42.879 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-12T02:22:42.881 INFO:tasks.ceph.osd.5:Started 2024-09-12T02:22:42.882 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-12T02:22:42.882 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-12T02:22:42.884 INFO:tasks.ceph.osd.6:Started 2024-09-12T02:22:42.884 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-12T02:22:42.885 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-12T02:22:42.887 INFO:tasks.ceph.osd.7:Started 2024-09-12T02:22:42.887 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:22:42.945 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T02:22:42.945+0000 7fa339b2f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T02:22:42.976 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T02:22:42.976+0000 7f1ab6729040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T02:22:42.996 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T02:22:42.996+0000 7fa339b2f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T02:22:43.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.009+0000 7f8e84978640 1 Processor -- start 2024-09-12T02:22:43.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.009+0000 7f8e84978640 1 -- start start 2024-09-12T02:22:43.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.009+0000 7f8e84978640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e800acc30 0x7f8e800c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:43.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.009+0000 7f8e84978640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e80070590 con 0x7f8e800c44b0 2024-09-12T02:22:43.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.009+0000 7f8e84978640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e800a8220 con 0x7f8e800c8180 2024-09-12T02:22:43.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.009+0000 7f8e84978640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8e800c4ea0 con 0x7f8e800acc30 2024-09-12T02:22:43.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.009+0000 7f8e77fff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f8e800c44b0 0x7f8e800c7a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:43926/0 (socket says 172.21.15.60:43926) 2024-09-12T02:22:43.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.010+0000 7f8e77fff640 1 -- 172.21.15.60:0/1878981574 learned_addr learned my addr 172.21.15.60:0/1878981574 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:22:43.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.010+0000 7f8e7e59c640 1 --2- 172.21.15.60:0/1878981574 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e800acc30 0x7f8e800c3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:43.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.010+0000 7f8e7dd9b640 1 -- 172.21.15.60:0/1878981574 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2174528178 0 0) 0x7f8e80070590 con 0x7f8e800c44b0 2024-09-12T02:22:43.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.010+0000 7f8e7dd9b640 1 -- 172.21.15.60:0/1878981574 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e6c003520 con 0x7f8e800c44b0 2024-09-12T02:22:43.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.010+0000 7f8e7dd9b640 1 -- 172.21.15.60:0/1878981574 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4116263190 0 0) 0x7f8e800a8220 con 0x7f8e800c8180 2024-09-12T02:22:43.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.010+0000 7f8e7dd9b640 1 -- 172.21.15.60:0/1878981574 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e80070590 con 0x7f8e800c8180 2024-09-12T02:22:43.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.010+0000 7f8e7e59c640 1 -- 172.21.15.60:0/1878981574 >> v1:172.21.15.105:6789/0 conn(0x7f8e800c8180 legacy=0x7f8e8015dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:43.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.010+0000 7f8e7e59c640 1 -- 172.21.15.60:0/1878981574 >> v1:172.21.15.60:6789/0 conn(0x7f8e800c44b0 legacy=0x7f8e800c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:43.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.010+0000 7f8e7e59c640 1 -- 172.21.15.60:0/1878981574 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e800a84f0 con 0x7f8e800acc30 2024-09-12T02:22:43.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.011+0000 7f8e7e59c640 1 --2- 172.21.15.60:0/1878981574 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e800acc30 0x7f8e800c3f70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8e700097d0 tx=0x7f8e7002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7419e1dc4e10de93 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:43.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.011+0000 7f8e7dd9b640 1 -- 172.21.15.60:0/1878981574 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e70037070 con 0x7f8e800acc30 2024-09-12T02:22:43.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.011+0000 7f8e7dd9b640 1 -- 172.21.15.60:0/1878981574 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e7002ae50 con 0x7f8e800acc30 2024-09-12T02:22:43.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.011+0000 7f8e7dd9b640 1 -- 172.21.15.60:0/1878981574 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e70032660 con 0x7f8e800acc30 2024-09-12T02:22:43.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.012+0000 7f8e84978640 1 -- 172.21.15.60:0/1878981574 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e800acc30 msgr2=0x7f8e800c3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:43.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.012+0000 7f8e84978640 1 --2- 172.21.15.60:0/1878981574 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e800acc30 0x7f8e800c3f70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8e700097d0 tx=0x7f8e7002a100 comp rx=0 tx=0).stop 2024-09-12T02:22:43.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.012+0000 7f8e84978640 1 -- 172.21.15.60:0/1878981574 shutdown_connections 2024-09-12T02:22:43.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.012+0000 7f8e84978640 1 --2- 172.21.15.60:0/1878981574 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e800acc30 0x7f8e800c3f70 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:43.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.012+0000 7f8e84978640 1 -- 172.21.15.60:0/1878981574 >> 172.21.15.60:0/1878981574 conn(0x7f8e800c5660 msgr2=0x7f8e800c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:43.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.012+0000 7f8e84978640 1 -- 172.21.15.60:0/1878981574 shutdown_connections 2024-09-12T02:22:43.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.012+0000 7f8e84978640 1 -- 172.21.15.60:0/1878981574 wait complete. 2024-09-12T02:22:43.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.013+0000 7f8e84978640 1 Processor -- start 2024-09-12T02:22:43.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.013+0000 7f8e84978640 1 -- start start 2024-09-12T02:22:43.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.014+0000 7f8e84978640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e800acc30 0x7f8e800c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:43.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.014+0000 7f8e84978640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e800c44b0 0x7f8e800c21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:43.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.014+0000 7f8e84978640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e800c8180 0x7f8e80154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:43.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.014+0000 7f8e84978640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8e800c5330 con 0x7f8e800c44b0 2024-09-12T02:22:43.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.014+0000 7f8e84978640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8e800702b0 con 0x7f8e800acc30 2024-09-12T02:22:43.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.014+0000 7f8e84978640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8e800c63f0 con 0x7f8e800c8180 2024-09-12T02:22:43.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.014+0000 7f8e77fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e800c44b0 0x7f8e800c21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:43.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.014+0000 7f8e7e59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e800acc30 0x7f8e800c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:43.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.014+0000 7f8e77fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e800c44b0 0x7f8e800c21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55208/0 (socket says 172.21.15.60:55208) 2024-09-12T02:22:43.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.014+0000 7f8e7e59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e800acc30 0x7f8e800c1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:55820/0 (socket says 172.21.15.60:55820) 2024-09-12T02:22:43.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.014+0000 7f8e77fff640 1 -- 172.21.15.60:0/235342797 learned_addr learned my addr 172.21.15.60:0/235342797 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:22:43.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.014+0000 7f8e7ed9d640 1 --2- 172.21.15.60:0/235342797 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e800c8180 0x7f8e80154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:43.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.014+0000 7f8e7e59c640 1 -- 172.21.15.60:0/235342797 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e800c8180 msgr2=0x7f8e80154bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:43.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.014+0000 7f8e7e59c640 1 --2- 172.21.15.60:0/235342797 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e800c8180 0x7f8e80154bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:43.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.014+0000 7f8e7e59c640 1 -- 172.21.15.60:0/235342797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e800c44b0 msgr2=0x7f8e800c21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:43.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.014+0000 7f8e7e59c640 1 --2- 172.21.15.60:0/235342797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e800c44b0 0x7f8e800c21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:43.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.014+0000 7f8e7e59c640 1 -- 172.21.15.60:0/235342797 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e801e75f0 con 0x7f8e800acc30 2024-09-12T02:22:43.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.014+0000 7f8e7ed9d640 1 --2- 172.21.15.60:0/235342797 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e800c8180 0x7f8e80154bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:22:43.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.014+0000 7f8e77fff640 1 --2- 172.21.15.60:0/235342797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e800c44b0 0x7f8e800c21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:22:43.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.014+0000 7f8e7e59c640 1 --2- 172.21.15.60:0/235342797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e800acc30 0x7f8e800c1cb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8e70031000 tx=0x7f8e700046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:43.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.015+0000 7f8e76ffd640 1 -- 172.21.15.60:0/235342797 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e70041070 con 0x7f8e800acc30 2024-09-12T02:22:43.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.015+0000 7f8e76ffd640 1 -- 172.21.15.60:0/235342797 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e7003c460 con 0x7f8e800acc30 2024-09-12T02:22:43.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.015+0000 7f8e76ffd640 1 -- 172.21.15.60:0/235342797 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e70037040 con 0x7f8e800acc30 2024-09-12T02:22:43.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.015+0000 7f8e84978640 1 -- 172.21.15.60:0/235342797 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e801ea860 con 0x7f8e800acc30 2024-09-12T02:22:43.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.015+0000 7f8e84978640 1 -- 172.21.15.60:0/235342797 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e800c2ce0 con 0x7f8e800acc30 2024-09-12T02:22:43.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.015+0000 7f8e76ffd640 1 -- 172.21.15.60:0/235342797 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8e7003a070 con 0x7f8e800acc30 2024-09-12T02:22:43.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.015+0000 7f8e76ffd640 1 -- 172.21.15.60:0/235342797 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f8e700455e0 con 0x7f8e800acc30 2024-09-12T02:22:43.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.016+0000 7f8e84978640 1 -- 172.21.15.60:0/235342797 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e800abc10 con 0x7f8e800acc30 2024-09-12T02:22:43.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.018+0000 7f8e76ffd640 1 -- 172.21.15.60:0/235342797 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f8e7003c830 con 0x7f8e800acc30 2024-09-12T02:22:43.032 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T02:22:43.031+0000 7f1ab6729040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T02:22:43.076 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T02:22:43.076+0000 7f1ab6729040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T02:22:43.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.077+0000 7f8e84978640 1 -- 172.21.15.60:0/235342797 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8e8006c240 con 0x7f8e800acc30 2024-09-12T02:22:43.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.078+0000 7f8e76ffd640 1 -- 172.21.15.60:0/235342797 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f8e7003ca10 con 0x7f8e800acc30 2024-09-12T02:22:43.079 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:22:43.079 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":10,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","created":"2024-09-12T02:22:39.869862+0000","modified":"2024-09-12T02:22:42.817076+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T02:22:42.817076+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0f0c7386-002f-47e2-a7a3-6c8a70264cc7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"64be7b84-36fc-43c0-9e70-a617e5b68941","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"df00caa1-d45e-4b87-ac1e-8bc098d509d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f6453471-893a-490b-b0c7-f196a0f574e5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"96e908b6-ce3e-466c-b02d-08fc71a1dba6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7ebc26f0-a462-4364-9303-7351f7cba21f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"49487ea1-9c6d-4090-bbcc-f28b33040eb9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1e3a0aa9-7e29-4785-8506-6b5d3be2be35","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:22:43.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.079+0000 7f8e84978640 1 -- 172.21.15.60:0/235342797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e800acc30 msgr2=0x7f8e800c1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:43.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.079+0000 7f8e84978640 1 --2- 172.21.15.60:0/235342797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e800acc30 0x7f8e800c1cb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8e70031000 tx=0x7f8e700046c0 comp rx=0 tx=0).stop 2024-09-12T02:22:43.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.079+0000 7f8e84978640 1 -- 172.21.15.60:0/235342797 shutdown_connections 2024-09-12T02:22:43.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.079+0000 7f8e84978640 1 --2- 172.21.15.60:0/235342797 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e800c8180 0x7f8e80154bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:43.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.079+0000 7f8e84978640 1 --2- 172.21.15.60:0/235342797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e800c44b0 0x7f8e800c21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:43.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.079+0000 7f8e84978640 1 --2- 172.21.15.60:0/235342797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e800acc30 0x7f8e800c1cb0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:43.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.079+0000 7f8e84978640 1 -- 172.21.15.60:0/235342797 >> 172.21.15.60:0/235342797 conn(0x7f8e800c5660 msgr2=0x7f8e800c6960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:43.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.079+0000 7f8e84978640 1 -- 172.21.15.60:0/235342797 shutdown_connections 2024-09-12T02:22:43.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:43.079+0000 7f8e84978640 1 -- 172.21.15.60:0/235342797 wait complete. 2024-09-12T02:22:43.090 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T02:22:43.090 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T02:22:43.116 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T02:22:43.116+0000 7fa339b2f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T02:22:43.169 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T02:22:43.168+0000 7fa339b2f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T02:22:43.186 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T02:22:43.186+0000 7f1ab6729040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T02:22:43.223 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T02:22:43.222+0000 7fa339b2f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T02:22:43.236 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T02:22:43.236+0000 7f1ab6729040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T02:22:43.289 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T02:22:43.288+0000 7f1ab6729040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T02:22:43.293 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T02:22:43.293+0000 7fa339b2f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T02:22:43.340 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T02:22:43.340+0000 7fa339b2f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T02:22:43.356 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T02:22:43.355+0000 7f1ab6729040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T02:22:43.386 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T02:22:43.386+0000 7fa339b2f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T02:22:43.400 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T02:22:43.399+0000 7f1ab6729040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T02:22:43.443 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T02:22:43.443+0000 7f1ab6729040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T02:22:43.896 DEBUG:teuthology.orchestra.run.smithi060:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T02:22:43.989 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.988+0000 7fb522e47640 1 Processor -- start 2024-09-12T02:22:43.989 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.989+0000 7fb522e47640 1 -- start start 2024-09-12T02:22:43.991 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.989+0000 7fb522e47640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb51c0afad0 0x7fb51c1535e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:43.991 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.989+0000 7fb522e47640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb51c156ce0 0x7fb51c153b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:43.991 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.989+0000 7fb522e47640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb51c0c5b50 0x7fb51c0702b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:43.991 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.989+0000 7fb522e47640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fb51c1571e0 con 0x7fb51c0c5b50 2024-09-12T02:22:43.991 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.989+0000 7fb522e47640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fb51c0c49f0 con 0x7fb51c0afad0 2024-09-12T02:22:43.992 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.989+0000 7fb522e47640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb51c0c4cd0 con 0x7fb51c156ce0 2024-09-12T02:22:43.992 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.990+0000 7fb5213e4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb51c0c5b50 0x7fb51c0702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:43.992 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.990+0000 7fb5213e4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb51c0c5b50 0x7fb51c0702b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55212/0 (socket says 172.21.15.60:55212) 2024-09-12T02:22:43.992 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.990+0000 7fb5213e4640 1 -- 172.21.15.60:0/2186401744 learned_addr learned my addr 172.21.15.60:0/2186401744 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:22:43.992 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.990+0000 7fb51bfff640 1 --2- 172.21.15.60:0/2186401744 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb51c156ce0 0x7fb51c153b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:43.992 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.990+0000 7fb520be3640 1 --2- 172.21.15.60:0/2186401744 >> v2:172.21.15.105:3300/0 conn(0x7fb51c0afad0 0x7fb51c1535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:43.992 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.990+0000 7fb5213e4640 1 -- 172.21.15.60:0/2186401744 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb51c156ce0 msgr2=0x7fb51c153b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:22:43.992 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.990+0000 7fb5213e4640 1 --2- 172.21.15.60:0/2186401744 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb51c156ce0 0x7fb51c153b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:43.992 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.990+0000 7fb5213e4640 1 -- 172.21.15.60:0/2186401744 >> v2:172.21.15.105:3300/0 conn(0x7fb51c0afad0 msgr2=0x7fb51c1535e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:22:43.992 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.990+0000 7fb5213e4640 1 --2- 172.21.15.60:0/2186401744 >> v2:172.21.15.105:3300/0 conn(0x7fb51c0afad0 0x7fb51c1535e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:43.992 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.990+0000 7fb5213e4640 1 -- 172.21.15.60:0/2186401744 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb51c0c4fb0 con 0x7fb51c0c5b50 2024-09-12T02:22:43.992 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.990+0000 7fb520be3640 1 --2- 172.21.15.60:0/2186401744 >> v2:172.21.15.105:3300/0 conn(0x7fb51c0afad0 0x7fb51c1535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:22:43.992 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.991+0000 7fb5213e4640 1 --2- 172.21.15.60:0/2186401744 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb51c0c5b50 0x7fb51c0702b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb51c0726d0 tx=0x7fb51402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fbcd26dcc458d31 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:43.993 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.991+0000 7fb51b7fe640 1 -- 172.21.15.60:0/2186401744 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb514036070 con 0x7fb51c0c5b50 2024-09-12T02:22:43.993 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.991+0000 7fb51b7fe640 1 -- 172.21.15.60:0/2186401744 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb514031600 con 0x7fb51c0c5b50 2024-09-12T02:22:43.993 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.991+0000 7fb51b7fe640 1 -- 172.21.15.60:0/2186401744 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5140319d0 con 0x7fb51c0c5b50 2024-09-12T02:22:43.996 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.991+0000 7fb522e47640 1 -- 172.21.15.60:0/2186401744 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb51c0c5b50 msgr2=0x7fb51c0702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:43.996 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.991+0000 7fb522e47640 1 --2- 172.21.15.60:0/2186401744 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb51c0c5b50 0x7fb51c0702b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb51c0726d0 tx=0x7fb51402a6a0 comp rx=0 tx=0).stop 2024-09-12T02:22:43.996 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.992+0000 7fb522e47640 1 -- 172.21.15.60:0/2186401744 shutdown_connections 2024-09-12T02:22:43.996 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.992+0000 7fb522e47640 1 --2- 172.21.15.60:0/2186401744 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb51c0c5b50 0x7fb51c0702b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:43.996 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.992+0000 7fb522e47640 1 --2- 172.21.15.60:0/2186401744 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb51c156ce0 0x7fb51c153b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:43.997 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.992+0000 7fb522e47640 1 --2- 172.21.15.60:0/2186401744 >> v2:172.21.15.105:3300/0 conn(0x7fb51c0afad0 0x7fb51c1535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:43.997 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.992+0000 7fb522e47640 1 -- 172.21.15.60:0/2186401744 >> 172.21.15.60:0/2186401744 conn(0x7fb51c0c6a50 msgr2=0x7fb51c0c6e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:43.997 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.992+0000 7fb522e47640 1 -- 172.21.15.60:0/2186401744 shutdown_connections 2024-09-12T02:22:43.997 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.992+0000 7fb522e47640 1 -- 172.21.15.60:0/2186401744 wait complete. 2024-09-12T02:22:43.997 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.993+0000 7fb522e47640 1 Processor -- start 2024-09-12T02:22:43.997 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.993+0000 7fb522e47640 1 -- start start 2024-09-12T02:22:43.997 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.994+0000 7fb522e47640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb51c0afad0 0x7fb51c155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:43.997 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.994+0000 7fb522e47640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb51c0c5b50 0x7fb51c154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:43.997 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.994+0000 7fb522e47640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb51c156ce0 0x7fb51c06ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:43.997 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.994+0000 7fb522e47640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb51c0c5930 con 0x7fb51c0afad0 2024-09-12T02:22:43.997 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.994+0000 7fb522e47640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb51c0c57b0 con 0x7fb51c0c5b50 2024-09-12T02:22:43.998 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.994+0000 7fb522e47640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb51c0c6620 con 0x7fb51c156ce0 2024-09-12T02:22:43.998 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.994+0000 7fb520be3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb51c0afad0 0x7fb51c155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:43.998 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.994+0000 7fb520be3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb51c0afad0 0x7fb51c155d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55228/0 (socket says 172.21.15.60:55228) 2024-09-12T02:22:43.998 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.994+0000 7fb520be3640 1 -- 172.21.15.60:0/2053180318 learned_addr learned my addr 172.21.15.60:0/2053180318 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:22:43.998 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.994+0000 7fb51bfff640 1 --2- 172.21.15.60:0/2053180318 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb51c0c5b50 0x7fb51c154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:43.998 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.994+0000 7fb5213e4640 1 --2- 172.21.15.60:0/2053180318 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb51c156ce0 0x7fb51c06ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:43.998 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.994+0000 7fb520be3640 1 -- 172.21.15.60:0/2053180318 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb51c156ce0 msgr2=0x7fb51c06ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:43.998 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.994+0000 7fb520be3640 1 --2- 172.21.15.60:0/2053180318 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb51c156ce0 0x7fb51c06ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:43.998 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.994+0000 7fb520be3640 1 -- 172.21.15.60:0/2053180318 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb51c0c5b50 msgr2=0x7fb51c154a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:43.998 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.994+0000 7fb520be3640 1 --2- 172.21.15.60:0/2053180318 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb51c0c5b50 0x7fb51c154a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:43.998 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.994+0000 7fb520be3640 1 -- 172.21.15.60:0/2053180318 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb51c152190 con 0x7fb51c0afad0 2024-09-12T02:22:43.999 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.994+0000 7fb51bfff640 1 --2- 172.21.15.60:0/2053180318 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb51c0c5b50 0x7fb51c154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:22:43.999 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.994+0000 7fb520be3640 1 --2- 172.21.15.60:0/2053180318 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb51c0afad0 0x7fb51c155d00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb51000e980 tx=0x7fb51000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:43.999 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.994+0000 7fb5197fa640 1 -- 172.21.15.60:0/2053180318 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb510017070 con 0x7fb51c0afad0 2024-09-12T02:22:43.999 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.995+0000 7fb5197fa640 1 -- 172.21.15.60:0/2053180318 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb51000ca00 con 0x7fb51c0afad0 2024-09-12T02:22:43.999 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.995+0000 7fb522e47640 1 -- 172.21.15.60:0/2053180318 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb51c152470 con 0x7fb51c0afad0 2024-09-12T02:22:43.999 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.995+0000 7fb5197fa640 1 -- 172.21.15.60:0/2053180318 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51000cdd0 con 0x7fb51c0afad0 2024-09-12T02:22:43.999 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.995+0000 7fb522e47640 1 -- 172.21.15.60:0/2053180318 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb51c152a30 con 0x7fb51c0afad0 2024-09-12T02:22:43.999 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.995+0000 7fb5197fa640 1 -- 172.21.15.60:0/2053180318 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb51001a070 con 0x7fb51c0afad0 2024-09-12T02:22:43.999 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.995+0000 7fb5197fa640 1 -- 172.21.15.60:0/2053180318 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fb51001cb60 con 0x7fb51c0afad0 2024-09-12T02:22:43.999 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.996+0000 7fb522e47640 1 -- 172.21.15.60:0/2053180318 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb51c0747a0 con 0x7fb51c0afad0 2024-09-12T02:22:44.000 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:43.998+0000 7fb5197fa640 1 -- 172.21.15.60:0/2053180318 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fb51c0747a0 con 0x7fb51c0afad0 2024-09-12T02:22:44.061 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:44.058+0000 7fb522e47640 1 -- 172.21.15.60:0/2053180318 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb51c0afeb0 con 0x7fb51c0afad0 2024-09-12T02:22:44.062 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:44.059+0000 7fb5197fa640 1 -- 172.21.15.60:0/2053180318 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fb510005990 con 0x7fb51c0afad0 2024-09-12T02:22:44.062 INFO:teuthology.misc.health.smithi060.stdout: 2024-09-12T02:22:44.062 INFO:teuthology.misc.health.smithi060.stdout:{"epoch":10,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","created":"2024-09-12T02:22:39.869862+0000","modified":"2024-09-12T02:22:42.817076+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T02:22:42.817076+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0f0c7386-002f-47e2-a7a3-6c8a70264cc7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"64be7b84-36fc-43c0-9e70-a617e5b68941","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"df00caa1-d45e-4b87-ac1e-8bc098d509d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f6453471-893a-490b-b0c7-f196a0f574e5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"96e908b6-ce3e-466c-b02d-08fc71a1dba6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7ebc26f0-a462-4364-9303-7351f7cba21f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"49487ea1-9c6d-4090-bbcc-f28b33040eb9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1e3a0aa9-7e29-4785-8506-6b5d3be2be35","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:22:44.064 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:44.060+0000 7fb522e47640 1 -- 172.21.15.60:0/2053180318 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb51c0afad0 msgr2=0x7fb51c155d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:44.064 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:44.060+0000 7fb522e47640 1 --2- 172.21.15.60:0/2053180318 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb51c0afad0 0x7fb51c155d00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb51000e980 tx=0x7fb51000ee40 comp rx=0 tx=0).stop 2024-09-12T02:22:44.064 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:44.060+0000 7fb522e47640 1 -- 172.21.15.60:0/2053180318 shutdown_connections 2024-09-12T02:22:44.064 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:44.060+0000 7fb522e47640 1 --2- 172.21.15.60:0/2053180318 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb51c156ce0 0x7fb51c06ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:44.064 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:44.060+0000 7fb522e47640 1 --2- 172.21.15.60:0/2053180318 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb51c0c5b50 0x7fb51c154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:44.064 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:44.060+0000 7fb522e47640 1 --2- 172.21.15.60:0/2053180318 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb51c0afad0 0x7fb51c155d00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:44.065 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:44.060+0000 7fb522e47640 1 -- 172.21.15.60:0/2053180318 >> 172.21.15.60:0/2053180318 conn(0x7fb51c0c6a50 msgr2=0x7fb51c14dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:44.065 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:44.060+0000 7fb522e47640 1 -- 172.21.15.60:0/2053180318 shutdown_connections 2024-09-12T02:22:44.065 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:44.060+0000 7fb522e47640 1 -- 172.21.15.60:0/2053180318 wait complete. 2024-09-12T02:22:44.069 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T02:22:44.078 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T02:22:44.078+0000 7fa339b2f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T02:22:44.105 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T02:22:44.104+0000 7f1ab6729040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T02:22:44.318 INFO:tasks.ceph.osd.3.smithi060.stderr:2024-09-12T02:22:44.317+0000 7fbb53215640 -1 Falling back to public interface 2024-09-12T02:22:44.377 INFO:tasks.ceph.osd.6.smithi105.stderr:2024-09-12T02:22:44.376+0000 7fb7c9c1e640 -1 Falling back to public interface 2024-09-12T02:22:44.555 INFO:tasks.ceph.osd.1.smithi060.stderr:2024-09-12T02:22:44.554+0000 7f37ea943640 -1 Falling back to public interface 2024-09-12T02:22:44.565 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-12T02:22:44.564+0000 7f998cea5640 -1 Falling back to public interface 2024-09-12T02:22:44.597 INFO:tasks.ceph.osd.4.smithi105.stderr:2024-09-12T02:22:44.596+0000 7f2949215640 -1 Falling back to public interface 2024-09-12T02:22:44.798 INFO:tasks.ceph.osd.2.smithi060.stderr:2024-09-12T02:22:44.797+0000 7f80b9789640 -1 Falling back to public interface 2024-09-12T02:22:44.870 INFO:tasks.ceph.osd.7.smithi105.stderr:2024-09-12T02:22:44.870+0000 7faf76c0d640 -1 Falling back to public interface 2024-09-12T02:22:44.879 INFO:tasks.ceph.osd.5.smithi105.stderr:2024-09-12T02:22:44.878+0000 7ffb1d8b4640 -1 Falling back to public interface 2024-09-12T02:22:45.094 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T02:22:45.093+0000 7fa2d9ae8640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T02:22:45.094 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T02:22:45.093+0000 7fa2d9ae8640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T02:22:48.336 INFO:tasks.ceph.osd.1.smithi060.stderr:2024-09-12T02:22:48.335+0000 7f37ea943640 -1 osd.1 0 log_to_monitors true 2024-09-12T02:22:48.376 INFO:tasks.ceph.osd.3.smithi060.stderr:2024-09-12T02:22:48.376+0000 7fbb53215640 -1 osd.3 0 log_to_monitors true 2024-09-12T02:22:48.565 INFO:tasks.ceph.osd.2.smithi060.stderr:2024-09-12T02:22:48.565+0000 7f80b9789640 -1 osd.2 0 log_to_monitors true 2024-09-12T02:22:48.889 INFO:tasks.ceph.osd.7.smithi105.stderr:2024-09-12T02:22:48.889+0000 7faf76c0d640 -1 osd.7 0 log_to_monitors true 2024-09-12T02:22:48.916 INFO:tasks.ceph.osd.6.smithi105.stderr:2024-09-12T02:22:48.916+0000 7fb7c9c1e640 -1 osd.6 0 log_to_monitors true 2024-09-12T02:22:49.078 INFO:tasks.ceph.osd.4.smithi105.stderr:2024-09-12T02:22:49.078+0000 7f2949215640 -1 osd.4 0 log_to_monitors true 2024-09-12T02:22:49.124 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-12T02:22:49.123+0000 7f998cea5640 -1 osd.0 0 log_to_monitors true 2024-09-12T02:22:49.217 INFO:tasks.ceph.osd.5.smithi105.stderr:2024-09-12T02:22:49.216+0000 7ffb1d8b4640 -1 osd.5 0 log_to_monitors true 2024-09-12T02:22:50.394 INFO:tasks.ceph.osd.3.smithi060.stderr:2024-09-12T02:22:50.393+0000 7fbb4e303640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T02:22:50.407 INFO:tasks.ceph.osd.1.smithi060.stderr:2024-09-12T02:22:50.407+0000 7f37e60af640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T02:22:50.422 INFO:tasks.ceph.osd.3.smithi060.stderr:2024-09-12T02:22:50.422+0000 7fbb46935640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:22:50.430 INFO:tasks.ceph.osd.1.smithi060.stderr:2024-09-12T02:22:50.430+0000 7f37de6e1640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:22:50.876 DEBUG:teuthology.orchestra.run.smithi060:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T02:22:51.020 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.019+0000 7f5c0f077640 1 Processor -- start 2024-09-12T02:22:51.020 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.019+0000 7f5c0f077640 1 -- start start 2024-09-12T02:22:51.022 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.020+0000 7f5c0f077640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f5c08073fa0 0x7f5c08070430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:51.022 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.020+0000 7f5c0f077640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c08070970 0x7f5c08155840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:51.022 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.020+0000 7f5c0f077640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c0806efd0 con 0x7f5c08151c80 2024-09-12T02:22:51.022 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.020+0000 7f5c0f077640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f5c0806f240 con 0x7f5c08073fa0 2024-09-12T02:22:51.022 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.020+0000 7f5c0f077640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5c0806f520 con 0x7f5c08070970 2024-09-12T02:22:51.022 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.021+0000 7f5c0ce13640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f5c08151c80 0x7f5c08154dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49556/0 (socket says 172.21.15.60:49556) 2024-09-12T02:22:51.022 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.021+0000 7f5c0ce13640 1 -- 172.21.15.60:0/3636403862 learned_addr learned my addr 172.21.15.60:0/3636403862 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:22:51.022 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.021+0000 7f5c07fff640 1 --2- 172.21.15.60:0/3636403862 >> v2:172.21.15.105:3300/0 conn(0x7f5c08073fa0 0x7f5c08070430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:51.022 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.021+0000 7f5c0d614640 1 --2- 172.21.15.60:0/3636403862 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c08070970 0x7f5c08155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:51.023 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.021+0000 7f5c077fe640 1 -- 172.21.15.60:0/3636403862 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 344222820 0 0) 0x7f5c0806efd0 con 0x7f5c08151c80 2024-09-12T02:22:51.023 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.021+0000 7f5c077fe640 1 -- 172.21.15.60:0/3636403862 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5bf8003520 con 0x7f5c08151c80 2024-09-12T02:22:51.023 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.021+0000 7f5c07fff640 1 -- 172.21.15.60:0/3636403862 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c08070970 msgr2=0x7f5c08155840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:22:51.023 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.021+0000 7f5c07fff640 1 --2- 172.21.15.60:0/3636403862 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c08070970 0x7f5c08155840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:51.023 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.021+0000 7f5c07fff640 1 -- 172.21.15.60:0/3636403862 >> v1:172.21.15.60:6789/0 conn(0x7f5c08151c80 legacy=0x7f5c08154dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:51.023 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.021+0000 7f5c07fff640 1 -- 172.21.15.60:0/3636403862 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c0806f800 con 0x7f5c08073fa0 2024-09-12T02:22:51.024 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.022+0000 7f5c07fff640 1 --2- 172.21.15.60:0/3636403862 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c08073fa0 0x7f5c08070430 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5bf40097a0 tx=0x7f5bf402a0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e13793610a7ef631 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:51.024 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.023+0000 7f5c077fe640 1 -- 172.21.15.60:0/3636403862 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf4037070 con 0x7f5c08073fa0 2024-09-12T02:22:51.024 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.023+0000 7f5c077fe640 1 -- 172.21.15.60:0/3636403862 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bf402ae40 con 0x7f5c08073fa0 2024-09-12T02:22:51.025 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.023+0000 7f5c0f077640 1 -- 172.21.15.60:0/3636403862 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c08073fa0 msgr2=0x7f5c08070430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:51.025 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.023+0000 7f5c0f077640 1 --2- 172.21.15.60:0/3636403862 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c08073fa0 0x7f5c08070430 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5bf40097a0 tx=0x7f5bf402a0f0 comp rx=0 tx=0).stop 2024-09-12T02:22:51.025 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.024+0000 7f5c0f077640 1 -- 172.21.15.60:0/3636403862 shutdown_connections 2024-09-12T02:22:51.025 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.024+0000 7f5c0f077640 1 --2- 172.21.15.60:0/3636403862 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c08070970 0x7f5c08155840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:51.025 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.024+0000 7f5c0f077640 1 --2- 172.21.15.60:0/3636403862 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c08073fa0 0x7f5c08070430 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:51.025 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.024+0000 7f5c0f077640 1 -- 172.21.15.60:0/3636403862 >> 172.21.15.60:0/3636403862 conn(0x7f5c080c6a50 msgr2=0x7f5c080c6e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:51.025 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.024+0000 7f5c0f077640 1 -- 172.21.15.60:0/3636403862 shutdown_connections 2024-09-12T02:22:51.025 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.024+0000 7f5c0f077640 1 -- 172.21.15.60:0/3636403862 wait complete. 2024-09-12T02:22:51.026 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.026+0000 7f5c0f077640 1 Processor -- start 2024-09-12T02:22:51.026 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.026+0000 7f5c0f077640 1 -- start start 2024-09-12T02:22:51.027 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.027+0000 7f5c0f077640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c08070970 0x7f5c081f4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:51.027 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.027+0000 7f5c0f077640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c08073fa0 0x7f5c0806dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:51.028 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.027+0000 7f5c07fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c08073fa0 0x7f5c0806dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:51.028 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.027+0000 7f5c0ce13640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c08070970 0x7f5c081f4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:51.028 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.027+0000 7f5c07fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c08073fa0 0x7f5c0806dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36550/0 (socket says 172.21.15.60:36550) 2024-09-12T02:22:51.028 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.027+0000 7f5c0ce13640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c08070970 0x7f5c081f4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:45418/0 (socket says 172.21.15.60:45418) 2024-09-12T02:22:51.028 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.027+0000 7f5c07fff640 1 -- 172.21.15.60:0/1000973491 learned_addr learned my addr 172.21.15.60:0/1000973491 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:22:51.028 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.027+0000 7f5c0f077640 1 --2- 172.21.15.60:0/1000973491 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c08151c80 0x7f5c08157440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:51.028 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.027+0000 7f5c0f077640 1 -- 172.21.15.60:0/1000973491 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5c08070180 con 0x7f5c08073fa0 2024-09-12T02:22:51.028 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.027+0000 7f5c0f077640 1 -- 172.21.15.60:0/1000973491 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5c08070000 con 0x7f5c08070970 2024-09-12T02:22:51.029 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.027+0000 7f5c0f077640 1 -- 172.21.15.60:0/1000973491 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5c08155d80 con 0x7f5c08151c80 2024-09-12T02:22:51.030 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.028+0000 7f5c0d614640 1 --2- 172.21.15.60:0/1000973491 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c08151c80 0x7f5c08157440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:51.030 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.028+0000 7f5c0ce13640 1 -- 172.21.15.60:0/1000973491 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c08151c80 msgr2=0x7f5c08157440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:51.030 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.028+0000 7f5c0ce13640 1 --2- 172.21.15.60:0/1000973491 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c08151c80 0x7f5c08157440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:51.030 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.028+0000 7f5c0ce13640 1 -- 172.21.15.60:0/1000973491 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c08073fa0 msgr2=0x7f5c0806dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:51.030 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.028+0000 7f5c0ce13640 1 --2- 172.21.15.60:0/1000973491 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c08073fa0 0x7f5c0806dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:51.030 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.028+0000 7f5c0ce13640 1 -- 172.21.15.60:0/1000973491 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c081f0490 con 0x7f5c08070970 2024-09-12T02:22:51.030 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.028+0000 7f5c07fff640 1 --2- 172.21.15.60:0/1000973491 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c08073fa0 0x7f5c0806dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:22:51.030 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.028+0000 7f5c0ce13640 1 --2- 172.21.15.60:0/1000973491 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c08070970 0x7f5c081f4580 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc00c3f0 tx=0x7f5bfc001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:51.030 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.029+0000 7f5c057fa640 1 -- 172.21.15.60:0/1000973491 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc017070 con 0x7f5c08070970 2024-09-12T02:22:51.030 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.029+0000 7f5c057fa640 1 -- 172.21.15.60:0/1000973491 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bfc005ce0 con 0x7f5c08070970 2024-09-12T02:22:51.030 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.029+0000 7f5c0f077640 1 -- 172.21.15.60:0/1000973491 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c081f3aa0 con 0x7f5c08070970 2024-09-12T02:22:51.031 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.029+0000 7f5c057fa640 1 -- 172.21.15.60:0/1000973491 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc0072f0 con 0x7f5c08070970 2024-09-12T02:22:51.031 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.029+0000 7f5c0f077640 1 -- 172.21.15.60:0/1000973491 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c0806e520 con 0x7f5c08070970 2024-09-12T02:22:51.032 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.030+0000 7f5c0f077640 1 -- 172.21.15.60:0/1000973491 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c08155840 con 0x7f5c08070970 2024-09-12T02:22:51.032 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.031+0000 7f5c057fa640 1 -- 172.21.15.60:0/1000973491 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) ==== 90442+0+0 (secure 0 0 0) 0x7f5bfc01a070 con 0x7f5c08070970 2024-09-12T02:22:51.032 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.031+0000 7f5c057fa640 1 --2- 172.21.15.60:0/1000973491 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f5bec06bda0 0x7f5bec06e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:51.032 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.031+0000 7f5c057fa640 1 -- 172.21.15.60:0/1000973491 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2231+0+0 (secure 0 0 0) 0x7f5bfc089180 con 0x7f5c08070970 2024-09-12T02:22:51.032 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.031+0000 7f5c07fff640 1 --2- 172.21.15.60:0/1000973491 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f5bec06bda0 0x7f5bec06e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:51.032 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.032+0000 7f5c07fff640 1 --2- 172.21.15.60:0/1000973491 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f5bec06bda0 0x7f5bec06e260 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5c080c4390 tx=0x7f5bf402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:51.037 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.036+0000 7f5c057fa640 1 -- 172.21.15.60:0/1000973491 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5bfc007e20 con 0x7f5c08070970 2024-09-12T02:22:51.385 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.385+0000 7f5c0f077640 1 -- 172.21.15.60:0/1000973491 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5c08076980 con 0x7f5c08070970 2024-09-12T02:22:51.386 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.386+0000 7f5c057fa640 1 -- 172.21.15.60:0/1000973491 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+7058 (secure 0 0 0) 0x7f5bfc0583e0 con 0x7f5c08070970 2024-09-12T02:22:51.386 INFO:teuthology.misc.health.smithi060.stdout: 2024-09-12T02:22:51.386 INFO:teuthology.misc.health.smithi060.stdout:{"epoch":13,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","created":"2024-09-12T02:22:39.869862+0000","modified":"2024-09-12T02:22:50.392049+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T02:22:42.817076+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0f0c7386-002f-47e2-a7a3-6c8a70264cc7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"64be7b84-36fc-43c0-9e70-a617e5b68941","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"df00caa1-d45e-4b87-ac1e-8bc098d509d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f6453471-893a-490b-b0c7-f196a0f574e5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"96e908b6-ce3e-466c-b02d-08fc71a1dba6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7ebc26f0-a462-4364-9303-7351f7cba21f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"49487ea1-9c6d-4090-bbcc-f28b33040eb9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1e3a0aa9-7e29-4785-8506-6b5d3be2be35","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:22:51.389 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.388+0000 7f5c0f077640 1 -- 172.21.15.60:0/1000973491 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f5bec06bda0 msgr2=0x7f5bec06e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:51.389 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.388+0000 7f5c0f077640 1 --2- 172.21.15.60:0/1000973491 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f5bec06bda0 0x7f5bec06e260 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5c080c4390 tx=0x7f5bf402e000 comp rx=0 tx=0).stop 2024-09-12T02:22:51.389 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.388+0000 7f5c0f077640 1 -- 172.21.15.60:0/1000973491 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c08070970 msgr2=0x7f5c081f4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:51.389 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.388+0000 7f5c0f077640 1 --2- 172.21.15.60:0/1000973491 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c08070970 0x7f5c081f4580 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc00c3f0 tx=0x7f5bfc001e70 comp rx=0 tx=0).stop 2024-09-12T02:22:51.389 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.388+0000 7f5c0f077640 1 -- 172.21.15.60:0/1000973491 shutdown_connections 2024-09-12T02:22:51.390 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.388+0000 7f5c0f077640 1 --2- 172.21.15.60:0/1000973491 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f5bec06bda0 0x7f5bec06e260 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:51.390 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.388+0000 7f5c0f077640 1 --2- 172.21.15.60:0/1000973491 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c08151c80 0x7f5c08157440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:51.390 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.388+0000 7f5c0f077640 1 --2- 172.21.15.60:0/1000973491 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c08073fa0 0x7f5c0806dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:51.390 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.388+0000 7f5c0f077640 1 --2- 172.21.15.60:0/1000973491 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c08070970 0x7f5c081f4580 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:51.390 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.388+0000 7f5c0f077640 1 -- 172.21.15.60:0/1000973491 >> 172.21.15.60:0/1000973491 conn(0x7f5c080c6a50 msgr2=0x7f5c080c5fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:51.390 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.388+0000 7f5c0f077640 1 -- 172.21.15.60:0/1000973491 shutdown_connections 2024-09-12T02:22:51.390 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:51.388+0000 7f5c0f077640 1 -- 172.21.15.60:0/1000973491 wait complete. 2024-09-12T02:22:51.398 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T02:22:51.438 INFO:tasks.ceph.osd.2.smithi060.stderr:2024-09-12T02:22:51.438+0000 7f80b5f2c640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T02:22:51.448 INFO:tasks.ceph.osd.2.smithi060.stderr:2024-09-12T02:22:51.448+0000 7f80ad527640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:22:51.449 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-12T02:22:51.449+0000 7f9988611640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T02:22:51.463 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-12T02:22:51.463+0000 7f9980c43640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:22:52.436 INFO:tasks.ceph.osd.4.smithi105.stderr:2024-09-12T02:22:52.435+0000 7f29442d2640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T02:22:52.450 INFO:tasks.ceph.osd.4.smithi105.stderr:2024-09-12T02:22:52.450+0000 7f293c904640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:22:52.469 INFO:tasks.ceph.osd.6.smithi105.stderr:2024-09-12T02:22:52.469+0000 7fb7c4e3b640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T02:22:52.485 INFO:tasks.ceph.osd.6.smithi105.stderr:2024-09-12T02:22:52.485+0000 7fb7bd46d640 -1 osd.6 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:22:52.487 INFO:tasks.ceph.osd.5.smithi105.stderr:2024-09-12T02:22:52.487+0000 7ffb19020640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T02:22:52.498 INFO:tasks.ceph.osd.5.smithi105.stderr:2024-09-12T02:22:52.498+0000 7ffb11652640 -1 osd.5 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:22:52.520 INFO:tasks.ceph.osd.7.smithi105.stderr:2024-09-12T02:22:52.520+0000 7faf72e5f640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T02:22:52.530 INFO:tasks.ceph.osd.7.smithi105.stderr:2024-09-12T02:22:52.530+0000 7faf6a45a640 -1 osd.7 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:22:55.725 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:22:55.732 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:22:58.206 DEBUG:teuthology.orchestra.run.smithi060:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T02:22:58.312 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.311+0000 7f3983518640 1 Processor -- start 2024-09-12T02:22:58.312 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.312+0000 7f3983518640 1 -- start start 2024-09-12T02:22:58.313 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.312+0000 7f3983518640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f397c073dc0 0x7f397c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:58.313 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.312+0000 7f3983518640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f397c0c4af0 0x7f397c157700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:58.313 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.312+0000 7f3983518640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f397c1581b0 con 0x7f397c1518e0 2024-09-12T02:22:58.314 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.312+0000 7f3983518640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f397c158450 con 0x7f397c073dc0 2024-09-12T02:22:58.314 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.312+0000 7f3983518640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f397c0c42f0 con 0x7f397c0c4af0 2024-09-12T02:22:58.314 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.313+0000 7f3980ab3640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f397c073dc0 0x7f397c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:58.314 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.313+0000 7f3980ab3640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f397c073dc0 0x7f397c06bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36576/0 (socket says 172.21.15.60:36576) 2024-09-12T02:22:58.314 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.313+0000 7f3980ab3640 1 -- 172.21.15.60:0/1296433058 learned_addr learned my addr 172.21.15.60:0/1296433058 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:22:58.314 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.313+0000 7f3981ab5640 1 --2- 172.21.15.60:0/1296433058 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f397c0c4af0 0x7f397c157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:58.314 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.313+0000 7f3980ab3640 1 -- 172.21.15.60:0/1296433058 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f397c0c4af0 msgr2=0x7f397c157700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:22:58.314 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.313+0000 7f3980ab3640 1 --2- 172.21.15.60:0/1296433058 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f397c0c4af0 0x7f397c157700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:58.314 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.313+0000 7f3980ab3640 1 -- 172.21.15.60:0/1296433058 >> v1:172.21.15.105:6789/0 conn(0x7f397c1518e0 legacy=0x7f397c06cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:58.314 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.313+0000 7f3980ab3640 1 -- 172.21.15.60:0/1296433058 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f397c0c45d0 con 0x7f397c073dc0 2024-09-12T02:22:58.315 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.314+0000 7f3980ab3640 1 --2- 172.21.15.60:0/1296433058 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f397c073dc0 0x7f397c06bc10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3970009870 tx=0x7f397002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d72ec10ea051a6e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:58.315 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.314+0000 7f397bfff640 1 -- 172.21.15.60:0/1296433058 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3970037070 con 0x7f397c073dc0 2024-09-12T02:22:58.315 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.314+0000 7f397bfff640 1 -- 172.21.15.60:0/1296433058 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3970032440 con 0x7f397c073dc0 2024-09-12T02:22:58.316 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.314+0000 7f397bfff640 1 -- 172.21.15.60:0/1296433058 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3970032810 con 0x7f397c073dc0 2024-09-12T02:22:58.316 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.315+0000 7f3983518640 1 -- 172.21.15.60:0/1296433058 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f397c073dc0 msgr2=0x7f397c06bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:58.316 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.315+0000 7f3983518640 1 --2- 172.21.15.60:0/1296433058 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f397c073dc0 0x7f397c06bc10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3970009870 tx=0x7f397002a1c0 comp rx=0 tx=0).stop 2024-09-12T02:22:58.316 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.315+0000 7f3983518640 1 -- 172.21.15.60:0/1296433058 shutdown_connections 2024-09-12T02:22:58.316 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.315+0000 7f3983518640 1 --2- 172.21.15.60:0/1296433058 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f397c0c4af0 0x7f397c157700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:58.316 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.315+0000 7f3983518640 1 --2- 172.21.15.60:0/1296433058 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f397c073dc0 0x7f397c06bc10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:58.316 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.315+0000 7f3983518640 1 -- 172.21.15.60:0/1296433058 >> 172.21.15.60:0/1296433058 conn(0x7f397c06ebf0 msgr2=0x7f397c06efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:58.316 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.315+0000 7f3983518640 1 -- 172.21.15.60:0/1296433058 shutdown_connections 2024-09-12T02:22:58.316 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.315+0000 7f3983518640 1 -- 172.21.15.60:0/1296433058 wait complete. 2024-09-12T02:22:58.318 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.316+0000 7f3983518640 1 Processor -- start 2024-09-12T02:22:58.318 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.316+0000 7f3983518640 1 -- start start 2024-09-12T02:22:58.318 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.317+0000 7f3983518640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f397c073dc0 0x7f397c149d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:58.318 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.317+0000 7f3983518640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f397c0c4af0 0x7f397c14a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:58.319 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.317+0000 7f3983518640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f397c1518e0 0x7f397c1eda10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:58.319 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.317+0000 7f3983518640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f397c06cc70 con 0x7f397c073dc0 2024-09-12T02:22:58.319 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.317+0000 7f3983518640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f397c0c4f80 con 0x7f397c0c4af0 2024-09-12T02:22:58.319 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.317+0000 7f3983518640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f397c0aebd0 con 0x7f397c1518e0 2024-09-12T02:22:58.319 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.317+0000 7f39812b4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f397c073dc0 0x7f397c149d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:58.319 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.317+0000 7f39812b4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f397c073dc0 0x7f397c149d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36582/0 (socket says 172.21.15.60:36582) 2024-09-12T02:22:58.319 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.317+0000 7f39812b4640 1 -- 172.21.15.60:0/344246719 learned_addr learned my addr 172.21.15.60:0/344246719 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:22:58.319 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.317+0000 7f3981ab5640 1 --2- 172.21.15.60:0/344246719 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f397c1518e0 0x7f397c1eda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:58.319 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.317+0000 7f3980ab3640 1 --2- 172.21.15.60:0/344246719 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f397c0c4af0 0x7f397c14a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:58.319 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.317+0000 7f39812b4640 1 -- 172.21.15.60:0/344246719 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f397c1518e0 msgr2=0x7f397c1eda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:58.319 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.317+0000 7f39812b4640 1 --2- 172.21.15.60:0/344246719 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f397c1518e0 0x7f397c1eda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:58.319 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.317+0000 7f39812b4640 1 -- 172.21.15.60:0/344246719 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f397c0c4af0 msgr2=0x7f397c14a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:58.319 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.317+0000 7f39812b4640 1 --2- 172.21.15.60:0/344246719 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f397c0c4af0 0x7f397c14a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:58.320 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.317+0000 7f39812b4640 1 -- 172.21.15.60:0/344246719 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f397c0adf20 con 0x7f397c073dc0 2024-09-12T02:22:58.320 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.317+0000 7f39812b4640 1 --2- 172.21.15.60:0/344246719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f397c073dc0 0x7f397c149d40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f396c00c730 tx=0x7f396c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:58.320 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.317+0000 7f3979ffb640 1 -- 172.21.15.60:0/344246719 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f396c016020 con 0x7f397c073dc0 2024-09-12T02:22:58.320 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.317+0000 7f3979ffb640 1 -- 172.21.15.60:0/344246719 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f396c006d50 con 0x7f397c073dc0 2024-09-12T02:22:58.320 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.317+0000 7f3983518640 1 -- 172.21.15.60:0/344246719 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f397c0ae200 con 0x7f397c073dc0 2024-09-12T02:22:58.320 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.317+0000 7f3979ffb640 1 -- 172.21.15.60:0/344246719 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f396c003bb0 con 0x7f397c073dc0 2024-09-12T02:22:58.320 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.318+0000 7f3983518640 1 -- 172.21.15.60:0/344246719 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f397c14a280 con 0x7f397c073dc0 2024-09-12T02:22:58.321 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.319+0000 7f3983518640 1 -- 172.21.15.60:0/344246719 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f397c069390 con 0x7f397c073dc0 2024-09-12T02:22:58.321 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.319+0000 7f3979ffb640 1 -- 172.21.15.60:0/344246719 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f396c00a850 con 0x7f397c073dc0 2024-09-12T02:22:58.321 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.320+0000 7f3979ffb640 1 --2- 172.21.15.60:0/344246719 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f396806be60 0x7f396806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:58.321 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.320+0000 7f3979ffb640 1 -- 172.21.15.60:0/344246719 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f396c08a650 con 0x7f397c073dc0 2024-09-12T02:22:58.322 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.320+0000 7f3980ab3640 1 --2- 172.21.15.60:0/344246719 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f396806be60 0x7f396806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:58.322 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.320+0000 7f3980ab3640 1 --2- 172.21.15.60:0/344246719 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f396806be60 0x7f396806e320 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3970034000 tx=0x7f397002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:58.325 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.325+0000 7f3979ffb640 1 -- 172.21.15.60:0/344246719 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f396c020020 con 0x7f397c073dc0 2024-09-12T02:22:58.501 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.501+0000 7f3983518640 1 -- 172.21.15.60:0/344246719 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f397c06bc10 con 0x7f397c073dc0 2024-09-12T02:22:58.502 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.502+0000 7f3979ffb640 1 -- 172.21.15.60:0/344246719 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12885 (secure 0 0 0) 0x7f396c058cf0 con 0x7f397c073dc0 2024-09-12T02:22:58.502 INFO:teuthology.misc.health.smithi060.stdout: 2024-09-12T02:22:58.503 INFO:teuthology.misc.health.smithi060.stdout:{"epoch":18,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","created":"2024-09-12T02:22:39.869862+0000","modified":"2024-09-12T02:22:55.726216+0000","last_up_change":"2024-09-12T02:22:53.459371+0000","last_in_change":"2024-09-12T02:22:42.817076+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:22:52.130579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0f0c7386-002f-47e2-a7a3-6c8a70264cc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6819","nonce":1789465659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6821","nonce":1789465659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6825","nonce":1789465659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6823","nonce":1789465659}]},"public_addr":"172.21.15.60:6819/1789465659","cluster_addr":"172.21.15.60:6821/1789465659","heartbeat_back_addr":"172.21.15.60:6825/1789465659","heartbeat_front_addr":"172.21.15.60:6823/1789465659","state":["exists","up"]},{"osd":1,"uuid":"64be7b84-36fc-43c0-9e70-a617e5b68941","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6811","nonce":1109822408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6813","nonce":1109822408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6817","nonce":1109822408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6815","nonce":1109822408}]},"public_addr":"172.21.15.60:6811/1109822408","cluster_addr":"172.21.15.60:6813/1109822408","heartbeat_back_addr":"172.21.15.60:6817/1109822408","heartbeat_front_addr":"172.21.15.60:6815/1109822408","state":["exists","up"]},{"osd":2,"uuid":"df00caa1-d45e-4b87-ac1e-8bc098d509d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6827","nonce":278470077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6829","nonce":278470077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6833","nonce":278470077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6831","nonce":278470077}]},"public_addr":"172.21.15.60:6827/278470077","cluster_addr":"172.21.15.60:6829/278470077","heartbeat_back_addr":"172.21.15.60:6833/278470077","heartbeat_front_addr":"172.21.15.60:6831/278470077","state":["exists","up"]},{"osd":3,"uuid":"f6453471-893a-490b-b0c7-f196a0f574e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6803","nonce":3606424156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6805","nonce":3606424156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6809","nonce":3606424156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6807","nonce":3606424156}]},"public_addr":"172.21.15.60:6803/3606424156","cluster_addr":"172.21.15.60:6805/3606424156","heartbeat_back_addr":"172.21.15.60:6809/3606424156","heartbeat_front_addr":"172.21.15.60:6807/3606424156","state":["exists","up"]},{"osd":4,"uuid":"96e908b6-ce3e-466c-b02d-08fc71a1dba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6809","nonce":1581641129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6811","nonce":1581641129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6815","nonce":1581641129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6813","nonce":1581641129}]},"public_addr":"172.21.15.105:6809/1581641129","cluster_addr":"172.21.15.105:6811/1581641129","heartbeat_back_addr":"172.21.15.105:6815/1581641129","heartbeat_front_addr":"172.21.15.105:6813/1581641129","state":["exists","up"]},{"osd":5,"uuid":"7ebc26f0-a462-4364-9303-7351f7cba21f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6825","nonce":1392337793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6827","nonce":1392337793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6831","nonce":1392337793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6829","nonce":1392337793}]},"public_addr":"172.21.15.105:6825/1392337793","cluster_addr":"172.21.15.105:6827/1392337793","heartbeat_back_addr":"172.21.15.105:6831/1392337793","heartbeat_front_addr":"172.21.15.105:6829/1392337793","state":["exists","up"]},{"osd":6,"uuid":"49487ea1-9c6d-4090-bbcc-f28b33040eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6801","nonce":50951309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6803","nonce":50951309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6807","nonce":50951309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6805","nonce":50951309}]},"public_addr":"172.21.15.105:6801/50951309","cluster_addr":"172.21.15.105:6803/50951309","heartbeat_back_addr":"172.21.15.105:6807/50951309","heartbeat_front_addr":"172.21.15.105:6805/50951309","state":["exists","up"]},{"osd":7,"uuid":"1e3a0aa9-7e29-4785-8506-6b5d3be2be35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6817","nonce":3745331251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6819","nonce":3745331251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6823","nonce":3745331251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6821","nonce":3745331251}]},"public_addr":"172.21.15.105:6817/3745331251","cluster_addr":"172.21.15.105:6819/3745331251","heartbeat_back_addr":"172.21.15.105:6823/3745331251","heartbeat_front_addr":"172.21.15.105:6821/3745331251","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:50.112629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.307689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.542851+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.334773+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:50.096967+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:50.259633+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.888988+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.917421+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:22:58.504 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.504+0000 7f3983518640 1 -- 172.21.15.60:0/344246719 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f396806be60 msgr2=0x7f396806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:58.505 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.504+0000 7f3983518640 1 --2- 172.21.15.60:0/344246719 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f396806be60 0x7f396806e320 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3970034000 tx=0x7f397002e000 comp rx=0 tx=0).stop 2024-09-12T02:22:58.505 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.504+0000 7f3983518640 1 -- 172.21.15.60:0/344246719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f397c073dc0 msgr2=0x7f397c149d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:58.505 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.504+0000 7f3983518640 1 --2- 172.21.15.60:0/344246719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f397c073dc0 0x7f397c149d40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f396c00c730 tx=0x7f396c00cbf0 comp rx=0 tx=0).stop 2024-09-12T02:22:58.505 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.504+0000 7f3983518640 1 -- 172.21.15.60:0/344246719 shutdown_connections 2024-09-12T02:22:58.505 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.504+0000 7f3983518640 1 --2- 172.21.15.60:0/344246719 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f396806be60 0x7f396806e320 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:58.505 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.504+0000 7f3983518640 1 --2- 172.21.15.60:0/344246719 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f397c1518e0 0x7f397c1eda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:58.505 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.504+0000 7f3983518640 1 --2- 172.21.15.60:0/344246719 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f397c0c4af0 0x7f397c14a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:58.505 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.504+0000 7f3983518640 1 --2- 172.21.15.60:0/344246719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f397c073dc0 0x7f397c149d40 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:58.505 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.504+0000 7f3983518640 1 -- 172.21.15.60:0/344246719 >> 172.21.15.60:0/344246719 conn(0x7f397c06ebf0 msgr2=0x7f397c150880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:58.505 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.504+0000 7f3983518640 1 -- 172.21.15.60:0/344246719 shutdown_connections 2024-09-12T02:22:58.505 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T02:22:58.504+0000 7f3983518640 1 -- 172.21.15.60:0/344246719 wait complete. 2024-09-12T02:22:58.514 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-12T02:22:58.514 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T02:22:58.514 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T02:22:58.515 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T02:22:58.517 INFO:tasks.ceph.mds.a:Started 2024-09-12T02:22:58.517 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T02:22:58.517 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T02:22:58.519 INFO:tasks.ceph.mds.c:Started 2024-09-12T02:22:58.519 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T02:22:58.519 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T02:22:58.522 INFO:tasks.ceph.mds.b:Started 2024-09-12T02:22:58.522 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T02:22:58.522 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T02:22:58.524 INFO:tasks.ceph.mds.d:Started 2024-09-12T02:22:58.524 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-12T02:22:58.525 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:22:58.595 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2024-09-12T02:22:58.596 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2024-09-12T02:22:58.608 INFO:tasks.ceph.mds.d.smithi105.stdout:starting mds.d at 2024-09-12T02:22:58.609 INFO:tasks.ceph.mds.b.smithi105.stdout:starting mds.b at 2024-09-12T02:22:58.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.633+0000 7f7478080640 1 Processor -- start 2024-09-12T02:22:58.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.634+0000 7f7478080640 1 -- start start 2024-09-12T02:22:58.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.634+0000 7f7478080640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f74700a83f0 0x7f74700c7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:58.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.634+0000 7f7478080640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74700c8440 con 0x7f74700c7f80 2024-09-12T02:22:58.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.634+0000 7f7478080640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74700c6c20 con 0x7f74700adae0 2024-09-12T02:22:58.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.634+0000 7f7478080640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f7470154bb0 con 0x7f74700a83f0 2024-09-12T02:22:58.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.634+0000 7f747561b640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f74700c7f80 0x7f74700a7ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49576/0 (socket says 172.21.15.60:49576) 2024-09-12T02:22:58.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.634+0000 7f747561b640 1 -- 172.21.15.60:0/3871577498 learned_addr learned my addr 172.21.15.60:0/3871577498 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:22:58.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.635+0000 7f747661d640 1 --2- 172.21.15.60:0/3871577498 >> v2:172.21.15.105:3300/0 conn(0x7f74700a83f0 0x7f74700c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:58.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.635+0000 7f7474e1a640 1 -- 172.21.15.60:0/3871577498 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2996160018 0 0) 0x7f74700c8440 con 0x7f74700c7f80 2024-09-12T02:22:58.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.635+0000 7f7474e1a640 1 -- 172.21.15.60:0/3871577498 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f745c005730 con 0x7f74700c7f80 2024-09-12T02:22:58.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.635+0000 7f7474e1a640 1 -- 172.21.15.60:0/3871577498 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3273766869 0 0) 0x7f745c005730 con 0x7f74700c7f80 2024-09-12T02:22:58.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.635+0000 7f7474e1a640 1 -- 172.21.15.60:0/3871577498 >> v2:172.21.15.105:3300/0 conn(0x7f74700a83f0 msgr2=0x7f74700c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:22:58.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.635+0000 7f7474e1a640 1 --2- 172.21.15.60:0/3871577498 >> v2:172.21.15.105:3300/0 conn(0x7f74700a83f0 0x7f74700c7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:58.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.635+0000 7f7474e1a640 1 -- 172.21.15.60:0/3871577498 >> v1:172.21.15.105:6789/0 conn(0x7f74700adae0 legacy=0x7f74701544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:58.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.635+0000 7f7474e1a640 1 -- 172.21.15.60:0/3871577498 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74700c6f00 con 0x7f74700c7f80 2024-09-12T02:22:58.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.635+0000 7f7474e1a640 1 -- 172.21.15.60:0/3871577498 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7f7464001670 con 0x7f74700c7f80 2024-09-12T02:22:58.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.635+0000 7f7474e1a640 1 -- 172.21.15.60:0/3871577498 >> v1:172.21.15.60:6789/0 conn(0x7f74700c7f80 legacy=0x7f74700a7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:58.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.635+0000 7f7474e1a640 1 --2- 172.21.15.60:0/3871577498 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f745c005c10 0x7f745c006030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:58.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.635+0000 7f7474e1a640 1 --2- 172.21.15.60:0/3871577498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f745c006a10 0x7f745c006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:58.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.635+0000 7f7474e1a640 1 --2- 172.21.15.60:0/3871577498 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f745c007420 0x7f745c00dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:58.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.635+0000 7f7474e1a640 1 -- 172.21.15.60:0/3871577498 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7470154bb0 con 0x7f745c006a10 2024-09-12T02:22:58.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.635+0000 7f7474e1a640 1 -- 172.21.15.60:0/3871577498 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f745c00e370 con 0x7f745c005c10 2024-09-12T02:22:58.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.635+0000 7f7474e1a640 1 -- 172.21.15.60:0/3871577498 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f745c00e570 con 0x7f745c007420 2024-09-12T02:22:58.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.635+0000 7f747561b640 1 --2- 172.21.15.60:0/3871577498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f745c006a10 0x7f745c006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:58.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.635+0000 7f7475e1c640 1 --2- 172.21.15.60:0/3871577498 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f745c005c10 0x7f745c006030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:58.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.635+0000 7f747661d640 1 --2- 172.21.15.60:0/3871577498 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f745c007420 0x7f745c00dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:58.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.635+0000 7f747561b640 1 -- 172.21.15.60:0/3871577498 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f745c007420 msgr2=0x7f745c00dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:22:58.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.635+0000 7f747561b640 1 --2- 172.21.15.60:0/3871577498 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f745c007420 0x7f745c00dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:58.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.635+0000 7f747561b640 1 -- 172.21.15.60:0/3871577498 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f745c005c10 msgr2=0x7f745c006030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:22:58.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.635+0000 7f747561b640 1 --2- 172.21.15.60:0/3871577498 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f745c005c10 0x7f745c006030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:58.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.635+0000 7f747561b640 1 -- 172.21.15.60:0/3871577498 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f745c005730 con 0x7f745c006a10 2024-09-12T02:22:58.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.635+0000 7f747661d640 1 -- 172.21.15.60:0/3871577498 reap_dead start 2024-09-12T02:22:58.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.636+0000 7f747561b640 1 --2- 172.21.15.60:0/3871577498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f745c006a10 0x7f745c006e90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f746400c0e0 tx=0x7f745c007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b083699fc50c2a80 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:58.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.636+0000 7f7474e1a640 1 -- 172.21.15.60:0/3871577498 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7464007c40 con 0x7f745c006a10 2024-09-12T02:22:58.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.636+0000 7f7474e1a640 1 -- 172.21.15.60:0/3871577498 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7464005af0 con 0x7f745c006a10 2024-09-12T02:22:58.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.636+0000 7f7474e1a640 1 -- 172.21.15.60:0/3871577498 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7464007070 con 0x7f745c006a10 2024-09-12T02:22:58.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.637+0000 7f7478080640 1 -- 172.21.15.60:0/3871577498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f745c006a10 msgr2=0x7f745c006e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:58.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.637+0000 7f7478080640 1 --2- 172.21.15.60:0/3871577498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f745c006a10 0x7f745c006e90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f746400c0e0 tx=0x7f745c007a40 comp rx=0 tx=0).stop 2024-09-12T02:22:58.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.637+0000 7f7478080640 1 -- 172.21.15.60:0/3871577498 shutdown_connections 2024-09-12T02:22:58.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.637+0000 7f7478080640 1 --2- 172.21.15.60:0/3871577498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f745c006a10 0x7f745c006e90 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:58.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.637+0000 7f7478080640 1 -- 172.21.15.60:0/3871577498 >> 172.21.15.60:0/3871577498 conn(0x7f74700c8bf0 msgr2=0x7f74700c8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:58.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.637+0000 7f7478080640 1 -- 172.21.15.60:0/3871577498 shutdown_connections 2024-09-12T02:22:58.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.637+0000 7f7478080640 1 -- 172.21.15.60:0/3871577498 wait complete. 2024-09-12T02:22:58.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.638+0000 7f7478080640 1 Processor -- start 2024-09-12T02:22:58.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.638+0000 7f7478080640 1 -- start start 2024-09-12T02:22:58.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.639+0000 7f7478080640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f745c006a10 0x7f74700bde80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:58.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.639+0000 7f7478080640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74701570b0 0x7f74701e8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:58.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.639+0000 7f7478080640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74701e8e70 0x7f74701eaa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:58.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.639+0000 7f7478080640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f74700abea0 con 0x7f745c006a10 2024-09-12T02:22:58.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.639+0000 7f7478080640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f74700c8720 con 0x7f74701570b0 2024-09-12T02:22:58.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.639+0000 7f7478080640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f74700adec0 con 0x7f74701e8e70 2024-09-12T02:22:58.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.639+0000 7f7475e1c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f745c006a10 0x7f74700bde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:58.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.639+0000 7f7475e1c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f745c006a10 0x7f74700bde80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36632/0 (socket says 172.21.15.60:36632) 2024-09-12T02:22:58.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.639+0000 7f7475e1c640 1 -- 172.21.15.60:0/751344323 learned_addr learned my addr 172.21.15.60:0/751344323 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:22:58.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.639+0000 7f747561b640 1 --2- 172.21.15.60:0/751344323 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74701570b0 0x7f74701e8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:58.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.639+0000 7f747661d640 1 --2- 172.21.15.60:0/751344323 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74701e8e70 0x7f74701eaa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:58.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.639+0000 7f7475e1c640 1 -- 172.21.15.60:0/751344323 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74701e8e70 msgr2=0x7f74701eaa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:58.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.639+0000 7f7475e1c640 1 --2- 172.21.15.60:0/751344323 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74701e8e70 0x7f74701eaa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:58.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.639+0000 7f7475e1c640 1 -- 172.21.15.60:0/751344323 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74701570b0 msgr2=0x7f74701e8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:58.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.639+0000 7f7475e1c640 1 --2- 172.21.15.60:0/751344323 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74701570b0 0x7f74701e8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:58.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.639+0000 7f7475e1c640 1 -- 172.21.15.60:0/751344323 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74700c6280 con 0x7f745c006a10 2024-09-12T02:22:58.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.639+0000 7f7475e1c640 1 --2- 172.21.15.60:0/751344323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f745c006a10 0x7f74700bde80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f746c00f5d0 tx=0x7f746c00fa90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:58.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.640+0000 7f74627fc640 1 -- 172.21.15.60:0/751344323 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f746c0052e0 con 0x7f745c006a10 2024-09-12T02:22:58.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.640+0000 7f74627fc640 1 -- 172.21.15.60:0/751344323 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f746c018070 con 0x7f745c006a10 2024-09-12T02:22:58.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.640+0000 7f7478080640 1 -- 172.21.15.60:0/751344323 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74700c5fa0 con 0x7f745c006a10 2024-09-12T02:22:58.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.640+0000 7f74627fc640 1 -- 172.21.15.60:0/751344323 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f746c0052e0 con 0x7f745c006a10 2024-09-12T02:22:58.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.640+0000 7f7478080640 1 -- 172.21.15.60:0/751344323 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74701e7920 con 0x7f745c006a10 2024-09-12T02:22:58.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.641+0000 7f7478080640 1 -- 172.21.15.60:0/751344323 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7470069190 con 0x7f745c006a10 2024-09-12T02:22:58.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.641+0000 7f74627fc640 1 -- 172.21.15.60:0/751344323 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f746c0035f0 con 0x7f745c006a10 2024-09-12T02:22:58.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.641+0000 7f74627fc640 1 --2- 172.21.15.60:0/751344323 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f745406c030 0x7f745406e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:22:58.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.642+0000 7f74627fc640 1 -- 172.21.15.60:0/751344323 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f746c05f230 con 0x7f745c006a10 2024-09-12T02:22:58.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.642+0000 7f747561b640 1 --2- 172.21.15.60:0/751344323 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f745406c030 0x7f745406e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:22:58.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.642+0000 7f747561b640 1 --2- 172.21.15.60:0/751344323 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f745406c030 0x7f745406e4f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7464032000 tx=0x7f746402d000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:22:58.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.646+0000 7f74627fc640 1 -- 172.21.15.60:0/751344323 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7470069190 con 0x7f745c006a10 2024-09-12T02:22:58.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.859+0000 7f7478080640 1 -- 172.21.15.60:0/751344323 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f74700c7700 con 0x7f745c006a10 2024-09-12T02:22:58.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.860+0000 7f74627fc640 1 -- 172.21.15.60:0/751344323 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1434 (secure 0 0 0) 0x7f746c058a40 con 0x7f745c006a10 2024-09-12T02:22:58.860 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:22:58.861 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":2,"btime":"2024-09-12T02:22:58:601710+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3208837169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3208837169},{"type":"v1","addr":"172.21.15.60:6836","nonce":3208837169}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T02:22:58.861 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 2 2024-09-12T02:22:58.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.862+0000 7f7478080640 1 -- 172.21.15.60:0/751344323 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f745406c030 msgr2=0x7f745406e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:58.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.862+0000 7f7478080640 1 --2- 172.21.15.60:0/751344323 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f745406c030 0x7f745406e4f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7464032000 tx=0x7f746402d000 comp rx=0 tx=0).stop 2024-09-12T02:22:58.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.862+0000 7f7478080640 1 -- 172.21.15.60:0/751344323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f745c006a10 msgr2=0x7f74700bde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:22:58.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.862+0000 7f7478080640 1 --2- 172.21.15.60:0/751344323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f745c006a10 0x7f74700bde80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f746c00f5d0 tx=0x7f746c00fa90 comp rx=0 tx=0).stop 2024-09-12T02:22:58.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.862+0000 7f7478080640 1 -- 172.21.15.60:0/751344323 shutdown_connections 2024-09-12T02:22:58.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.862+0000 7f7478080640 1 --2- 172.21.15.60:0/751344323 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f745406c030 0x7f745406e4f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:58.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.862+0000 7f7478080640 1 --2- 172.21.15.60:0/751344323 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74701e8e70 0x7f74701eaa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:58.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.862+0000 7f7478080640 1 --2- 172.21.15.60:0/751344323 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74701570b0 0x7f74701e8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:58.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.862+0000 7f7478080640 1 --2- 172.21.15.60:0/751344323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f745c006a10 0x7f74700bde80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:22:58.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.862+0000 7f7478080640 1 -- 172.21.15.60:0/751344323 >> 172.21.15.60:0/751344323 conn(0x7f74700c8bf0 msgr2=0x7f7470153cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:22:58.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.862+0000 7f7478080640 1 -- 172.21.15.60:0/751344323 shutdown_connections 2024-09-12T02:22:58.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:22:58.862+0000 7f7478080640 1 -- 172.21.15.60:0/751344323 wait complete. 2024-09-12T02:23:00.873 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:23:00.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.987+0000 7fdd5b6b7640 1 Processor -- start 2024-09-12T02:23:00.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.988+0000 7fdd5b6b7640 1 -- start start 2024-09-12T02:23:00.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.988+0000 7fdd5b6b7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd54153de0 0x7fdd540ca640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:00.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.988+0000 7fdd5b6b7640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdd541598c0 0x7fdd54159d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:00.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.988+0000 7fdd5b6b7640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd540cab80 con 0x7fdd5406bbe0 2024-09-12T02:23:00.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.988+0000 7fdd5b6b7640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fdd540c9480 con 0x7fdd541598c0 2024-09-12T02:23:00.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.988+0000 7fdd5b6b7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdd540cb620 con 0x7fdd54153de0 2024-09-12T02:23:00.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.989+0000 7fdd59c54640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdd541598c0 0x7fdd54159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:00.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.989+0000 7fdd59c54640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdd541598c0 0x7fdd54159d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56694/0 (socket says 172.21.15.60:56694) 2024-09-12T02:23:00.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.989+0000 7fdd59c54640 1 -- 172.21.15.60:0/1572988784 learned_addr learned my addr 172.21.15.60:0/1572988784 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:00.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.989+0000 7fdd59453640 1 --2- 172.21.15.60:0/1572988784 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd54153de0 0x7fdd540ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:00.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.989+0000 7fdd59c54640 1 -- 172.21.15.60:0/1572988784 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd54153de0 msgr2=0x7fdd540ca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:00.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.989+0000 7fdd59c54640 1 --2- 172.21.15.60:0/1572988784 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd54153de0 0x7fdd540ca640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:00.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.989+0000 7fdd59c54640 1 -- 172.21.15.60:0/1572988784 >> v1:172.21.15.105:6789/0 conn(0x7fdd5406bbe0 legacy=0x7fdd5406c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:00.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.989+0000 7fdd59c54640 1 -- 172.21.15.60:0/1572988784 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd540c6b20 con 0x7fdd541598c0 2024-09-12T02:23:00.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.990+0000 7fdd59c54640 1 --2- 172.21.15.60:0/1572988784 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd541598c0 0x7fdd54159d70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c009870 tx=0x7fdd4c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0584706e5e08339 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:00.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.990+0000 7fdd4bfff640 1 -- 172.21.15.60:0/1572988784 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c037070 con 0x7fdd541598c0 2024-09-12T02:23:00.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.990+0000 7fdd4bfff640 1 -- 172.21.15.60:0/1572988784 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd4c032440 con 0x7fdd541598c0 2024-09-12T02:23:00.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.990+0000 7fdd4bfff640 1 -- 172.21.15.60:0/1572988784 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c032810 con 0x7fdd541598c0 2024-09-12T02:23:00.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.990+0000 7fdd5b6b7640 1 -- 172.21.15.60:0/1572988784 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd541598c0 msgr2=0x7fdd54159d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:00.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.990+0000 7fdd5b6b7640 1 --2- 172.21.15.60:0/1572988784 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd541598c0 0x7fdd54159d70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c009870 tx=0x7fdd4c02a270 comp rx=0 tx=0).stop 2024-09-12T02:23:00.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.990+0000 7fdd5b6b7640 1 -- 172.21.15.60:0/1572988784 shutdown_connections 2024-09-12T02:23:00.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.990+0000 7fdd5b6b7640 1 --2- 172.21.15.60:0/1572988784 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd541598c0 0x7fdd54159d70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:00.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.990+0000 7fdd5b6b7640 1 --2- 172.21.15.60:0/1572988784 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd54153de0 0x7fdd540ca640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:00.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.990+0000 7fdd5b6b7640 1 -- 172.21.15.60:0/1572988784 >> 172.21.15.60:0/1572988784 conn(0x7fdd540c8800 msgr2=0x7fdd540c8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:00.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.991+0000 7fdd5b6b7640 1 -- 172.21.15.60:0/1572988784 shutdown_connections 2024-09-12T02:23:00.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.991+0000 7fdd5b6b7640 1 -- 172.21.15.60:0/1572988784 wait complete. 2024-09-12T02:23:00.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.992+0000 7fdd5b6b7640 1 Processor -- start 2024-09-12T02:23:00.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.992+0000 7fdd5b6b7640 1 -- start start 2024-09-12T02:23:00.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.992+0000 7fdd5b6b7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd5406bbe0 0x7fdd5414e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:00.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.992+0000 7fdd5b6b7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd54153de0 0x7fdd5414a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:00.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.992+0000 7fdd5b6b7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd541598c0 0x7fdd5414a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:00.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.993+0000 7fdd5b6b7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdd540cbab0 con 0x7fdd5406bbe0 2024-09-12T02:23:00.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.993+0000 7fdd5b6b7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdd540c70e0 con 0x7fdd541598c0 2024-09-12T02:23:00.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.993+0000 7fdd5b6b7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdd5415a2b0 con 0x7fdd54153de0 2024-09-12T02:23:00.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.993+0000 7fdd59453640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd5406bbe0 0x7fdd5414e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:00.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.993+0000 7fdd59453640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd5406bbe0 0x7fdd5414e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56700/0 (socket says 172.21.15.60:56700) 2024-09-12T02:23:00.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.993+0000 7fdd59453640 1 -- 172.21.15.60:0/1308705944 learned_addr learned my addr 172.21.15.60:0/1308705944 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:00.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.993+0000 7fdd58c52640 1 --2- 172.21.15.60:0/1308705944 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd54153de0 0x7fdd5414a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:00.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.993+0000 7fdd59c54640 1 --2- 172.21.15.60:0/1308705944 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd541598c0 0x7fdd5414a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:00.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.993+0000 7fdd59453640 1 -- 172.21.15.60:0/1308705944 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd54153de0 msgr2=0x7fdd5414a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:00.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.993+0000 7fdd59453640 1 --2- 172.21.15.60:0/1308705944 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd54153de0 0x7fdd5414a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:00.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.993+0000 7fdd59453640 1 -- 172.21.15.60:0/1308705944 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd541598c0 msgr2=0x7fdd5414a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:00.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.993+0000 7fdd59453640 1 --2- 172.21.15.60:0/1308705944 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd541598c0 0x7fdd5414a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:00.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.993+0000 7fdd59453640 1 -- 172.21.15.60:0/1308705944 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd5414d580 con 0x7fdd5406bbe0 2024-09-12T02:23:00.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.993+0000 7fdd59c54640 1 --2- 172.21.15.60:0/1308705944 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd541598c0 0x7fdd5414a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:23:00.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.993+0000 7fdd59453640 1 --2- 172.21.15.60:0/1308705944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd5406bbe0 0x7fdd5414e200 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdd50007ef0 tx=0x7fdd5000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:00.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.993+0000 7fdd49ffb640 1 -- 172.21.15.60:0/1308705944 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd50014620 con 0x7fdd5406bbe0 2024-09-12T02:23:00.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.993+0000 7fdd49ffb640 1 -- 172.21.15.60:0/1308705944 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd50019070 con 0x7fdd5406bbe0 2024-09-12T02:23:00.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.993+0000 7fdd5b6b7640 1 -- 172.21.15.60:0/1308705944 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd5414c480 con 0x7fdd5406bbe0 2024-09-12T02:23:00.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.993+0000 7fdd49ffb640 1 -- 172.21.15.60:0/1308705944 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd50014a00 con 0x7fdd5406bbe0 2024-09-12T02:23:00.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.994+0000 7fdd5b6b7640 1 -- 172.21.15.60:0/1308705944 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd54159450 con 0x7fdd5406bbe0 2024-09-12T02:23:00.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.995+0000 7fdd5b6b7640 1 -- 172.21.15.60:0/1308705944 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd540ca640 con 0x7fdd5406bbe0 2024-09-12T02:23:00.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.995+0000 7fdd49ffb640 1 -- 172.21.15.60:0/1308705944 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdd50014ba0 con 0x7fdd5406bbe0 2024-09-12T02:23:00.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.995+0000 7fdd49ffb640 1 --2- 172.21.15.60:0/1308705944 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fdd3806be60 0x7fdd3806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:00.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.996+0000 7fdd49ffb640 1 -- 172.21.15.60:0/1308705944 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fdd5008b320 con 0x7fdd5406bbe0 2024-09-12T02:23:00.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.996+0000 7fdd58c52640 1 --2- 172.21.15.60:0/1308705944 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fdd3806be60 0x7fdd3806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:00.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:00.996+0000 7fdd58c52640 1 --2- 172.21.15.60:0/1308705944 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fdd3806be60 0x7fdd3806e320 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdd5406cf40 tx=0x7fdd44009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:01.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.000+0000 7fdd49ffb640 1 -- 172.21.15.60:0/1308705944 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdd5005a010 con 0x7fdd5406bbe0 2024-09-12T02:23:01.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.211+0000 7fdd5b6b7640 1 -- 172.21.15.60:0/1308705944 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdd540c9600 con 0x7fdd5406bbe0 2024-09-12T02:23:01.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.211+0000 7fdd49ffb640 1 -- 172.21.15.60:0/1308705944 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3906 (secure 0 0 0) 0x7fdd50059910 con 0x7fdd5406bbe0 2024-09-12T02:23:01.212 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:23:01.212 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":3,"btime":"2024-09-12T02:22:59:602857+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3208837169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3208837169},{"type":"v1","addr":"172.21.15.60:6836","nonce":3208837169}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/664538827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":664538827},{"type":"v1","addr":"172.21.15.60:6837","nonce":664538827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/248466084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":248466084},{"type":"v1","addr":"172.21.15.105:6834","nonce":248466084}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2854563525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2854563525},{"type":"v1","addr":"172.21.15.105:6835","nonce":2854563525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-12T02:23:01.213 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 3 2024-09-12T02:23:01.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.213+0000 7fdd5b6b7640 1 -- 172.21.15.60:0/1308705944 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fdd3806be60 msgr2=0x7fdd3806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:01.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.213+0000 7fdd5b6b7640 1 --2- 172.21.15.60:0/1308705944 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fdd3806be60 0x7fdd3806e320 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdd5406cf40 tx=0x7fdd44009040 comp rx=0 tx=0).stop 2024-09-12T02:23:01.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.213+0000 7fdd5b6b7640 1 -- 172.21.15.60:0/1308705944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd5406bbe0 msgr2=0x7fdd5414e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:01.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.213+0000 7fdd5b6b7640 1 --2- 172.21.15.60:0/1308705944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd5406bbe0 0x7fdd5414e200 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdd50007ef0 tx=0x7fdd5000e4b0 comp rx=0 tx=0).stop 2024-09-12T02:23:01.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.213+0000 7fdd5b6b7640 1 -- 172.21.15.60:0/1308705944 shutdown_connections 2024-09-12T02:23:01.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.213+0000 7fdd5b6b7640 1 --2- 172.21.15.60:0/1308705944 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fdd3806be60 0x7fdd3806e320 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:01.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.213+0000 7fdd5b6b7640 1 --2- 172.21.15.60:0/1308705944 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd541598c0 0x7fdd5414a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:01.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.213+0000 7fdd5b6b7640 1 --2- 172.21.15.60:0/1308705944 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd54153de0 0x7fdd5414a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:01.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.213+0000 7fdd5b6b7640 1 --2- 172.21.15.60:0/1308705944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd5406bbe0 0x7fdd5414e200 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:01.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.213+0000 7fdd5b6b7640 1 -- 172.21.15.60:0/1308705944 >> 172.21.15.60:0/1308705944 conn(0x7fdd540c8800 msgr2=0x7fdd540c7260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:01.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.214+0000 7fdd5b6b7640 1 -- 172.21.15.60:0/1308705944 shutdown_connections 2024-09-12T02:23:01.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.214+0000 7fdd5b6b7640 1 -- 172.21.15.60:0/1308705944 wait complete. 2024-09-12T02:23:01.225 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T02:23:01.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.326+0000 7ff34388d640 1 Processor -- start 2024-09-12T02:23:01.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.326+0000 7ff34388d640 1 -- start start 2024-09-12T02:23:01.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.327+0000 7ff34388d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff33c06c650 0x7ff33c0c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:01.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.327+0000 7ff34388d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff33c0ca1c0 0x7ff33c160bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:01.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.327+0000 7ff34388d640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff33c15a7c0 con 0x7ff33c150480 2024-09-12T02:23:01.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.327+0000 7ff34388d640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7ff33c06c240 con 0x7ff33c0ca1c0 2024-09-12T02:23:01.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.327+0000 7ff34388d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff33c15a330 con 0x7ff33c06c650 2024-09-12T02:23:01.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.327+0000 7ff341629640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff33c150480 0x7ff33c0c7a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45072/0 (socket says 172.21.15.60:45072) 2024-09-12T02:23:01.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.327+0000 7ff341629640 1 -- 172.21.15.60:0/3773464372 learned_addr learned my addr 172.21.15.60:0/3773464372 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:01.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.327+0000 7ff341e2a640 1 --2- 172.21.15.60:0/3773464372 >> v2:172.21.15.60:3300/0 conn(0x7ff33c0ca1c0 0x7ff33c160bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:01.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.327+0000 7ff340e28640 1 --2- 172.21.15.60:0/3773464372 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff33c06c650 0x7ff33c0c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:01.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.328+0000 7ff33bfff640 1 -- 172.21.15.60:0/3773464372 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4131548299 0 0) 0x7ff33c15a7c0 con 0x7ff33c150480 2024-09-12T02:23:01.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.328+0000 7ff33bfff640 1 -- 172.21.15.60:0/3773464372 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff324003520 con 0x7ff33c150480 2024-09-12T02:23:01.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.328+0000 7ff341e2a640 1 -- 172.21.15.60:0/3773464372 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff33c06c650 msgr2=0x7ff33c0c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:01.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.328+0000 7ff341e2a640 1 --2- 172.21.15.60:0/3773464372 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff33c06c650 0x7ff33c0c9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:01.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.328+0000 7ff341e2a640 1 -- 172.21.15.60:0/3773464372 >> v1:172.21.15.60:6789/0 conn(0x7ff33c150480 legacy=0x7ff33c0c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:01.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.328+0000 7ff341e2a640 1 -- 172.21.15.60:0/3773464372 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff33c159a00 con 0x7ff33c0ca1c0 2024-09-12T02:23:01.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.328+0000 7ff341e2a640 1 --2- 172.21.15.60:0/3773464372 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff33c0ca1c0 0x7ff33c160bf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff32c0097a0 tx=0x7ff32c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d3a179e0ce30a14 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:01.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.329+0000 7ff33bfff640 1 -- 172.21.15.60:0/3773464372 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32c037070 con 0x7ff33c0ca1c0 2024-09-12T02:23:01.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.329+0000 7ff33bfff640 1 -- 172.21.15.60:0/3773464372 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff32c032440 con 0x7ff33c0ca1c0 2024-09-12T02:23:01.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.329+0000 7ff33bfff640 1 -- 172.21.15.60:0/3773464372 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32c0327f0 con 0x7ff33c0ca1c0 2024-09-12T02:23:01.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.329+0000 7ff34388d640 1 -- 172.21.15.60:0/3773464372 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff33c0ca1c0 msgr2=0x7ff33c160bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:01.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.329+0000 7ff34388d640 1 --2- 172.21.15.60:0/3773464372 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff33c0ca1c0 0x7ff33c160bf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff32c0097a0 tx=0x7ff32c02a180 comp rx=0 tx=0).stop 2024-09-12T02:23:01.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.329+0000 7ff34388d640 1 -- 172.21.15.60:0/3773464372 shutdown_connections 2024-09-12T02:23:01.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.329+0000 7ff34388d640 1 --2- 172.21.15.60:0/3773464372 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff33c0ca1c0 0x7ff33c160bf0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:01.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.329+0000 7ff34388d640 1 --2- 172.21.15.60:0/3773464372 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff33c06c650 0x7ff33c0c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:01.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.329+0000 7ff34388d640 1 -- 172.21.15.60:0/3773464372 >> 172.21.15.60:0/3773464372 conn(0x7ff33c068030 msgr2=0x7ff33c073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:01.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.329+0000 7ff34388d640 1 -- 172.21.15.60:0/3773464372 shutdown_connections 2024-09-12T02:23:01.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.329+0000 7ff34388d640 1 -- 172.21.15.60:0/3773464372 wait complete. 2024-09-12T02:23:01.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.330+0000 7ff34388d640 1 Processor -- start 2024-09-12T02:23:01.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.330+0000 7ff34388d640 1 -- start start 2024-09-12T02:23:01.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.331+0000 7ff34388d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff33c06c650 0x7ff33c158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:01.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.331+0000 7ff34388d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff33c0ca1c0 0x7ff33c0cb330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:01.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.331+0000 7ff34388d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff33c150480 0x7ff33c1ef160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:01.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.331+0000 7ff34388d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff33c0ca670 con 0x7ff33c150480 2024-09-12T02:23:01.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.331+0000 7ff34388d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff33c159fc0 con 0x7ff33c0ca1c0 2024-09-12T02:23:01.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.331+0000 7ff34388d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff33c06d270 con 0x7ff33c06c650 2024-09-12T02:23:01.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.331+0000 7ff341e2a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff33c150480 0x7ff33c1ef160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:01.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.331+0000 7ff341e2a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff33c150480 0x7ff33c1ef160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56718/0 (socket says 172.21.15.60:56718) 2024-09-12T02:23:01.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.331+0000 7ff341e2a640 1 -- 172.21.15.60:0/3284092739 learned_addr learned my addr 172.21.15.60:0/3284092739 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:01.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.331+0000 7ff340e28640 1 --2- 172.21.15.60:0/3284092739 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff33c0ca1c0 0x7ff33c0cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:01.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.331+0000 7ff341629640 1 --2- 172.21.15.60:0/3284092739 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff33c06c650 0x7ff33c158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:01.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.332+0000 7ff341e2a640 1 -- 172.21.15.60:0/3284092739 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff33c06c650 msgr2=0x7ff33c158390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:01.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.332+0000 7ff341e2a640 1 --2- 172.21.15.60:0/3284092739 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff33c06c650 0x7ff33c158390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:01.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.332+0000 7ff341e2a640 1 -- 172.21.15.60:0/3284092739 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff33c0ca1c0 msgr2=0x7ff33c0cb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:01.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.332+0000 7ff341e2a640 1 --2- 172.21.15.60:0/3284092739 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff33c0ca1c0 0x7ff33c0cb330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:01.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.332+0000 7ff341e2a640 1 -- 172.21.15.60:0/3284092739 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff33c1588d0 con 0x7ff33c150480 2024-09-12T02:23:01.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.332+0000 7ff341e2a640 1 --2- 172.21.15.60:0/3284092739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff33c150480 0x7ff33c1ef160 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff32c035040 tx=0x7ff32c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:01.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.332+0000 7ff339ffb640 1 -- 172.21.15.60:0/3284092739 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32c037050 con 0x7ff33c150480 2024-09-12T02:23:01.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.332+0000 7ff339ffb640 1 -- 172.21.15.60:0/3284092739 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff32c043070 con 0x7ff33c150480 2024-09-12T02:23:01.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.332+0000 7ff34388d640 1 -- 172.21.15.60:0/3284092739 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff33c0b0a20 con 0x7ff33c150480 2024-09-12T02:23:01.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.332+0000 7ff339ffb640 1 -- 172.21.15.60:0/3284092739 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32c032a30 con 0x7ff33c150480 2024-09-12T02:23:01.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.332+0000 7ff34388d640 1 -- 172.21.15.60:0/3284092739 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff33c149900 con 0x7ff33c150480 2024-09-12T02:23:01.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.333+0000 7ff34388d640 1 -- 172.21.15.60:0/3284092739 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff33c156270 con 0x7ff33c150480 2024-09-12T02:23:01.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.334+0000 7ff339ffb640 1 -- 172.21.15.60:0/3284092739 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff32c032bd0 con 0x7ff33c150480 2024-09-12T02:23:01.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.334+0000 7ff339ffb640 1 --2- 172.21.15.60:0/3284092739 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff32806be30 0x7ff32806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:01.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.334+0000 7ff339ffb640 1 -- 172.21.15.60:0/3284092739 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7ff32c0ab7a0 con 0x7ff33c150480 2024-09-12T02:23:01.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.334+0000 7ff341629640 1 --2- 172.21.15.60:0/3284092739 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff32806be30 0x7ff32806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:01.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.335+0000 7ff341629640 1 --2- 172.21.15.60:0/3284092739 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff32806be30 0x7ff32806e2f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff334005c00 tx=0x7ff334009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:01.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.338+0000 7ff339ffb640 1 -- 172.21.15.60:0/3284092739 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff33c1588d0 con 0x7ff33c150480 2024-09-12T02:23:01.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.514+0000 7ff34388d640 1 -- 172.21.15.60:0/3284092739 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff33c06c430 con 0x7ff33c150480 2024-09-12T02:23:01.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.514+0000 7ff339ffb640 1 -- 172.21.15.60:0/3284092739 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) ==== 84+0+65 (secure 0 0 0) 0x7ff32c07a650 con 0x7ff33c150480 2024-09-12T02:23:01.515 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:23:01.515 INFO:teuthology.orchestra.run.smithi060.stdout:[ 2024-09-12T02:23:01.515 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:01.515 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 1, 2024-09-12T02:23:01.515 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": ".mgr" 2024-09-12T02:23:01.515 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:23:01.515 INFO:teuthology.orchestra.run.smithi060.stdout:] 2024-09-12T02:23:01.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.516+0000 7ff34388d640 1 -- 172.21.15.60:0/3284092739 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff32806be30 msgr2=0x7ff32806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:01.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.516+0000 7ff34388d640 1 --2- 172.21.15.60:0/3284092739 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff32806be30 0x7ff32806e2f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff334005c00 tx=0x7ff334009040 comp rx=0 tx=0).stop 2024-09-12T02:23:01.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.516+0000 7ff34388d640 1 -- 172.21.15.60:0/3284092739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff33c150480 msgr2=0x7ff33c1ef160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:01.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.516+0000 7ff34388d640 1 --2- 172.21.15.60:0/3284092739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff33c150480 0x7ff33c1ef160 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff32c035040 tx=0x7ff32c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:23:01.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.516+0000 7ff34388d640 1 -- 172.21.15.60:0/3284092739 shutdown_connections 2024-09-12T02:23:01.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.516+0000 7ff34388d640 1 --2- 172.21.15.60:0/3284092739 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff32806be30 0x7ff32806e2f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:01.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.516+0000 7ff34388d640 1 --2- 172.21.15.60:0/3284092739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff33c150480 0x7ff33c1ef160 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:01.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.516+0000 7ff34388d640 1 --2- 172.21.15.60:0/3284092739 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff33c0ca1c0 0x7ff33c0cb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:01.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.516+0000 7ff34388d640 1 --2- 172.21.15.60:0/3284092739 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff33c06c650 0x7ff33c158390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:01.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.516+0000 7ff34388d640 1 -- 172.21.15.60:0/3284092739 >> 172.21.15.60:0/3284092739 conn(0x7ff33c068030 msgr2=0x7ff33c073310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:01.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.516+0000 7ff34388d640 1 -- 172.21.15.60:0/3284092739 shutdown_connections 2024-09-12T02:23:01.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.516+0000 7ff34388d640 1 -- 172.21.15.60:0/3284092739 wait complete. 2024-09-12T02:23:01.528 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'a' 2024-09-12T02:23:01.528 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create a_metadata --pg_num_min 64 2024-09-12T02:23:01.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.634+0000 7efd4780e640 1 Processor -- start 2024-09-12T02:23:01.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.634+0000 7efd4780e640 1 -- start start 2024-09-12T02:23:01.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.635+0000 7efd4780e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7efd400c8b10 0x7efd4015a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:01.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.635+0000 7efd4780e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efd4006cd80 0x7efd401534d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:01.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.635+0000 7efd4780e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd400c7070 con 0x7efd40153a10 2024-09-12T02:23:01.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.635+0000 7efd4780e640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7efd4006d210 con 0x7efd400c8b10 2024-09-12T02:23:01.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.635+0000 7efd4780e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efd400c69b0 con 0x7efd4006cd80 2024-09-12T02:23:01.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.635+0000 7efd45dab640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7efd40153a10 0x7efd40156660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45082/0 (socket says 172.21.15.60:45082) 2024-09-12T02:23:01.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.635+0000 7efd45dab640 1 -- 172.21.15.60:0/1305491717 learned_addr learned my addr 172.21.15.60:0/1305491717 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:01.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.635+0000 7efd455aa640 1 --2- 172.21.15.60:0/1305491717 >> v2:172.21.15.105:3300/0 conn(0x7efd400c8b10 0x7efd4015a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:01.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.635+0000 7efd3ffff640 1 -- 172.21.15.60:0/1305491717 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 569032179 0 0) 0x7efd400c7070 con 0x7efd40153a10 2024-09-12T02:23:01.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.635+0000 7efd44da9640 1 --2- 172.21.15.60:0/1305491717 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efd4006cd80 0x7efd401534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:01.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.635+0000 7efd3ffff640 1 -- 172.21.15.60:0/1305491717 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd28003520 con 0x7efd40153a10 2024-09-12T02:23:01.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.636+0000 7efd3ffff640 1 -- 172.21.15.60:0/1305491717 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3032065693 0 0) 0x7efd28003520 con 0x7efd40153a10 2024-09-12T02:23:01.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.636+0000 7efd3ffff640 1 -- 172.21.15.60:0/1305491717 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efd4006cd80 msgr2=0x7efd401534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:01.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.636+0000 7efd3ffff640 1 --2- 172.21.15.60:0/1305491717 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efd4006cd80 0x7efd401534d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:01.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.636+0000 7efd3ffff640 1 -- 172.21.15.60:0/1305491717 >> v2:172.21.15.105:3300/0 conn(0x7efd400c8b10 msgr2=0x7efd4015a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:01.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.636+0000 7efd3ffff640 1 --2- 172.21.15.60:0/1305491717 >> v2:172.21.15.105:3300/0 conn(0x7efd400c8b10 0x7efd4015a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:01.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.636+0000 7efd3ffff640 1 -- 172.21.15.60:0/1305491717 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd400c6c90 con 0x7efd40153a10 2024-09-12T02:23:01.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.636+0000 7efd3ffff640 1 -- 172.21.15.60:0/1305491717 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7efd300019f0 con 0x7efd40153a10 2024-09-12T02:23:01.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.636+0000 7efd3ffff640 1 -- 172.21.15.60:0/1305491717 >> v1:172.21.15.60:6789/0 conn(0x7efd40153a10 legacy=0x7efd40156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:01.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.636+0000 7efd3ffff640 1 --2- 172.21.15.60:0/1305491717 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd280039b0 0x7efd28003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:01.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.636+0000 7efd3ffff640 1 --2- 172.21.15.60:0/1305491717 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efd28004800 0x7efd28004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:01.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.636+0000 7efd3ffff640 1 --2- 172.21.15.60:0/1305491717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd28005180 0x7efd2800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:01.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.636+0000 7efd3ffff640 1 -- 172.21.15.60:0/1305491717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7efd4006d210 con 0x7efd28005180 2024-09-12T02:23:01.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.636+0000 7efd3ffff640 1 -- 172.21.15.60:0/1305491717 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efd400c69b0 con 0x7efd280039b0 2024-09-12T02:23:01.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.636+0000 7efd3ffff640 1 -- 172.21.15.60:0/1305491717 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efd2800bf00 con 0x7efd28004800 2024-09-12T02:23:01.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.636+0000 7efd45dab640 1 --2- 172.21.15.60:0/1305491717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd28005180 0x7efd2800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:01.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.636+0000 7efd455aa640 1 --2- 172.21.15.60:0/1305491717 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd280039b0 0x7efd28003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:01.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.636+0000 7efd44da9640 1 --2- 172.21.15.60:0/1305491717 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efd28004800 0x7efd28004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:01.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.636+0000 7efd45dab640 1 -- 172.21.15.60:0/1305491717 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efd28004800 msgr2=0x7efd28004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:01.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.636+0000 7efd45dab640 1 --2- 172.21.15.60:0/1305491717 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efd28004800 0x7efd28004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:01.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.636+0000 7efd45dab640 1 -- 172.21.15.60:0/1305491717 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd280039b0 msgr2=0x7efd28003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:01.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.636+0000 7efd45dab640 1 --2- 172.21.15.60:0/1305491717 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd280039b0 0x7efd28003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:01.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.636+0000 7efd45dab640 1 -- 172.21.15.60:0/1305491717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd28003520 con 0x7efd28005180 2024-09-12T02:23:01.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.637+0000 7efd45dab640 1 --2- 172.21.15.60:0/1305491717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd28005180 0x7efd2800b9c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efd3000a880 tx=0x7efd28005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=620f7d03457458b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:01.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.637+0000 7efd3ffff640 1 -- 172.21.15.60:0/1305491717 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3000a4a0 con 0x7efd28005180 2024-09-12T02:23:01.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.637+0000 7efd3ffff640 1 -- 172.21.15.60:0/1305491717 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd3002f070 con 0x7efd28005180 2024-09-12T02:23:01.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.637+0000 7efd3ffff640 1 -- 172.21.15.60:0/1305491717 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3002bd00 con 0x7efd28005180 2024-09-12T02:23:01.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.638+0000 7efd4780e640 1 -- 172.21.15.60:0/1305491717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd28005180 msgr2=0x7efd2800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:01.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.638+0000 7efd4780e640 1 --2- 172.21.15.60:0/1305491717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd28005180 0x7efd2800b9c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efd3000a880 tx=0x7efd28005830 comp rx=0 tx=0).stop 2024-09-12T02:23:01.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.638+0000 7efd45dab640 1 -- 172.21.15.60:0/1305491717 reap_dead start 2024-09-12T02:23:01.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.638+0000 7efd4780e640 1 -- 172.21.15.60:0/1305491717 shutdown_connections 2024-09-12T02:23:01.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.638+0000 7efd4780e640 1 -- 172.21.15.60:0/1305491717 >> 172.21.15.60:0/1305491717 conn(0x7efd400adb80 msgr2=0x7efd400adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:01.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.638+0000 7efd4780e640 1 -- 172.21.15.60:0/1305491717 shutdown_connections 2024-09-12T02:23:01.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.638+0000 7efd4780e640 1 -- 172.21.15.60:0/1305491717 wait complete. 2024-09-12T02:23:01.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.639+0000 7efd4780e640 1 Processor -- start 2024-09-12T02:23:01.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.639+0000 7efd4780e640 1 -- start start 2024-09-12T02:23:01.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.640+0000 7efd4780e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efd28005180 0x7efd401ec240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:01.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.640+0000 7efd4780e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd40149f70 0x7efd400acde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:01.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.640+0000 7efd4780e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd401492b0 0x7efd40149730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:01.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.640+0000 7efd4780e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7efd40154020 con 0x7efd401492b0 2024-09-12T02:23:01.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.640+0000 7efd4780e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efd40153ea0 con 0x7efd40149f70 2024-09-12T02:23:01.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.640+0000 7efd4780e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efd400c8ef0 con 0x7efd28005180 2024-09-12T02:23:01.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.640+0000 7efd45dab640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd401492b0 0x7efd40149730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:01.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.640+0000 7efd45dab640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd401492b0 0x7efd40149730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56730/0 (socket says 172.21.15.60:56730) 2024-09-12T02:23:01.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.640+0000 7efd45dab640 1 -- 172.21.15.60:0/1106357466 learned_addr learned my addr 172.21.15.60:0/1106357466 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:01.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.640+0000 7efd455aa640 1 --2- 172.21.15.60:0/1106357466 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efd28005180 0x7efd401ec240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:01.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.640+0000 7efd44da9640 1 --2- 172.21.15.60:0/1106357466 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd40149f70 0x7efd400acde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:01.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.640+0000 7efd45dab640 1 -- 172.21.15.60:0/1106357466 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efd28005180 msgr2=0x7efd401ec240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:01.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.640+0000 7efd45dab640 1 --2- 172.21.15.60:0/1106357466 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efd28005180 0x7efd401ec240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:01.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.640+0000 7efd45dab640 1 -- 172.21.15.60:0/1106357466 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd40149f70 msgr2=0x7efd400acde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:01.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.640+0000 7efd45dab640 1 --2- 172.21.15.60:0/1106357466 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd40149f70 0x7efd400acde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:01.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.640+0000 7efd45dab640 1 -- 172.21.15.60:0/1106357466 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd401ec780 con 0x7efd401492b0 2024-09-12T02:23:01.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.640+0000 7efd45dab640 1 --2- 172.21.15.60:0/1106357466 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd401492b0 0x7efd40149730 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efd30001cf0 tx=0x7efd400c6e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:01.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.640+0000 7efd3dffb640 1 -- 172.21.15.60:0/1106357466 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd30044070 con 0x7efd401492b0 2024-09-12T02:23:01.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.640+0000 7efd3dffb640 1 -- 172.21.15.60:0/1106357466 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd30034470 con 0x7efd401492b0 2024-09-12T02:23:01.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.640+0000 7efd4780e640 1 -- 172.21.15.60:0/1106357466 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd4015a740 con 0x7efd401492b0 2024-09-12T02:23:01.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.640+0000 7efd3dffb640 1 -- 172.21.15.60:0/1106357466 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3000a4a0 con 0x7efd401492b0 2024-09-12T02:23:01.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.641+0000 7efd4780e640 1 -- 172.21.15.60:0/1106357466 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd40150250 con 0x7efd401492b0 2024-09-12T02:23:01.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.641+0000 7efd4780e640 1 -- 172.21.15.60:0/1106357466 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd4014ed10 con 0x7efd401492b0 2024-09-12T02:23:01.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.642+0000 7efd3dffb640 1 -- 172.21.15.60:0/1106357466 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efd30047070 con 0x7efd401492b0 2024-09-12T02:23:01.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.642+0000 7efd3dffb640 1 --2- 172.21.15.60:0/1106357466 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7efd2c06be60 0x7efd2c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:01.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.642+0000 7efd3dffb640 1 -- 172.21.15.60:0/1106357466 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7efd300aaa10 con 0x7efd401492b0 2024-09-12T02:23:01.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.643+0000 7efd455aa640 1 --2- 172.21.15.60:0/1106357466 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7efd2c06be60 0x7efd2c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:01.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.643+0000 7efd455aa640 1 --2- 172.21.15.60:0/1106357466 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7efd2c06be60 0x7efd2c06e320 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efd38009bc0 tx=0x7efd38009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:01.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.647+0000 7efd3dffb640 1 -- 172.21.15.60:0/1106357466 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efd4014ed10 con 0x7efd401492b0 2024-09-12T02:23:01.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:01.823+0000 7efd4780e640 1 -- 172.21.15.60:0/1106357466 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "a_metadata", "pg_num_min": 64} v 0) -- 0x7efd4006cd80 con 0x7efd401492b0 2024-09-12T02:23:02.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.742+0000 7efd3dffb640 1 -- 172.21.15.60:0/1106357466 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "a_metadata", "pg_num_min": 64}]=0 pool 'a_metadata' created v19) ==== 128+0+0 (secure 0 0 0) 0x7efd300797d0 con 0x7efd401492b0 2024-09-12T02:23:02.743 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'a_metadata' created 2024-09-12T02:23:02.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.746+0000 7efd4780e640 1 -- 172.21.15.60:0/1106357466 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7efd2c06be60 msgr2=0x7efd2c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:02.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.746+0000 7efd4780e640 1 --2- 172.21.15.60:0/1106357466 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7efd2c06be60 0x7efd2c06e320 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efd38009bc0 tx=0x7efd38009190 comp rx=0 tx=0).stop 2024-09-12T02:23:02.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.746+0000 7efd4780e640 1 -- 172.21.15.60:0/1106357466 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd401492b0 msgr2=0x7efd40149730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:02.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.746+0000 7efd4780e640 1 --2- 172.21.15.60:0/1106357466 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd401492b0 0x7efd40149730 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efd30001cf0 tx=0x7efd400c6e60 comp rx=0 tx=0).stop 2024-09-12T02:23:02.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.746+0000 7efd4780e640 1 -- 172.21.15.60:0/1106357466 shutdown_connections 2024-09-12T02:23:02.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.746+0000 7efd4780e640 1 --2- 172.21.15.60:0/1106357466 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7efd2c06be60 0x7efd2c06e320 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:02.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.746+0000 7efd4780e640 1 --2- 172.21.15.60:0/1106357466 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd401492b0 0x7efd40149730 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:02.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.746+0000 7efd4780e640 1 --2- 172.21.15.60:0/1106357466 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd40149f70 0x7efd400acde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:02.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.746+0000 7efd4780e640 1 --2- 172.21.15.60:0/1106357466 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efd28005180 0x7efd401ec240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:02.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.746+0000 7efd4780e640 1 -- 172.21.15.60:0/1106357466 >> 172.21.15.60:0/1106357466 conn(0x7efd400adb80 msgr2=0x7efd400ca510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:02.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.746+0000 7efd4780e640 1 -- 172.21.15.60:0/1106357466 shutdown_connections 2024-09-12T02:23:02.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.746+0000 7efd4780e640 1 -- 172.21.15.60:0/1106357466 wait complete. 2024-09-12T02:23:02.765 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create a_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T02:23:02.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.881+0000 7efc17186640 1 Processor -- start 2024-09-12T02:23:02.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.881+0000 7efc17186640 1 -- start start 2024-09-12T02:23:02.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.881+0000 7efc17186640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efc10153b70 0x7efc10157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:02.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.881+0000 7efc17186640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efc10153f50 0x7efc10158cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:02.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.881+0000 7efc17186640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc10157540 con 0x7efc100bf900 2024-09-12T02:23:02.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.881+0000 7efc17186640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7efc10157c30 con 0x7efc10153f50 2024-09-12T02:23:02.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.881+0000 7efc17186640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efc10157f10 con 0x7efc10153b70 2024-09-12T02:23:02.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.882+0000 7efc15723640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efc10153f50 0x7efc10158cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:02.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.882+0000 7efc0ffff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7efc100bf900 0x7efc100ae740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45092/0 (socket says 172.21.15.60:45092) 2024-09-12T02:23:02.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.882+0000 7efc0ffff640 1 -- 172.21.15.60:0/2022865931 learned_addr learned my addr 172.21.15.60:0/2022865931 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:02.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.882+0000 7efc14f22640 1 --2- 172.21.15.60:0/2022865931 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efc10153b70 0x7efc10157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:02.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.882+0000 7efc15723640 1 -- 172.21.15.60:0/2022865931 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efc10153b70 msgr2=0x7efc10157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:02.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.882+0000 7efc15723640 1 --2- 172.21.15.60:0/2022865931 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efc10153b70 0x7efc10157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:02.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.882+0000 7efc15723640 1 -- 172.21.15.60:0/2022865931 >> v1:172.21.15.60:6789/0 conn(0x7efc100bf900 legacy=0x7efc100ae740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:02.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.882+0000 7efc0f7fe640 1 -- 172.21.15.60:0/2022865931 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1940515486 0 0) 0x7efc10157540 con 0x7efc100bf900 2024-09-12T02:23:02.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.882+0000 7efc15723640 1 -- 172.21.15.60:0/2022865931 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc101581f0 con 0x7efc10153f50 2024-09-12T02:23:02.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.882+0000 7efc14f22640 1 --2- 172.21.15.60:0/2022865931 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efc10153b70 0x7efc10157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:23:02.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.883+0000 7efc15723640 1 --2- 172.21.15.60:0/2022865931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc10153f50 0x7efc10158cd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efc08009d90 tx=0x7efc0802a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0adf74f97d9ede6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:02.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.883+0000 7efc0f7fe640 1 -- 172.21.15.60:0/2022865931 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc08007740 con 0x7efc10153f50 2024-09-12T02:23:02.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.883+0000 7efc0f7fe640 1 -- 172.21.15.60:0/2022865931 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc080078e0 con 0x7efc10153f50 2024-09-12T02:23:02.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.883+0000 7efc0f7fe640 1 -- 172.21.15.60:0/2022865931 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc08007cb0 con 0x7efc10153f50 2024-09-12T02:23:02.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.883+0000 7efc17186640 1 -- 172.21.15.60:0/2022865931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc10153f50 msgr2=0x7efc10158cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:02.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.883+0000 7efc17186640 1 --2- 172.21.15.60:0/2022865931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc10153f50 0x7efc10158cd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efc08009d90 tx=0x7efc0802a530 comp rx=0 tx=0).stop 2024-09-12T02:23:02.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.883+0000 7efc17186640 1 -- 172.21.15.60:0/2022865931 shutdown_connections 2024-09-12T02:23:02.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.883+0000 7efc17186640 1 --2- 172.21.15.60:0/2022865931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc10153f50 0x7efc10158cd0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:02.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.883+0000 7efc17186640 1 --2- 172.21.15.60:0/2022865931 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efc10153b70 0x7efc10157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:02.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.883+0000 7efc17186640 1 -- 172.21.15.60:0/2022865931 >> 172.21.15.60:0/2022865931 conn(0x7efc100c6a30 msgr2=0x7efc100c6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:02.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.884+0000 7efc17186640 1 -- 172.21.15.60:0/2022865931 shutdown_connections 2024-09-12T02:23:02.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.884+0000 7efc17186640 1 -- 172.21.15.60:0/2022865931 wait complete. 2024-09-12T02:23:02.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.885+0000 7efc17186640 1 Processor -- start 2024-09-12T02:23:02.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.885+0000 7efc17186640 1 -- start start 2024-09-12T02:23:02.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.885+0000 7efc17186640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efc100bf900 0x7efc101ebab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:02.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.885+0000 7efc17186640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc10153b70 0x7efc100c7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:02.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.885+0000 7efc17186640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc10153f50 0x7efc1006ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:02.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.885+0000 7efc17186640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7efc100aefd0 con 0x7efc10153f50 2024-09-12T02:23:02.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.886+0000 7efc17186640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efc100aee50 con 0x7efc10153b70 2024-09-12T02:23:02.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.886+0000 7efc17186640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efc10159210 con 0x7efc100bf900 2024-09-12T02:23:02.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.886+0000 7efc15723640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc10153f50 0x7efc1006ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:02.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.886+0000 7efc15723640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc10153f50 0x7efc1006ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56746/0 (socket says 172.21.15.60:56746) 2024-09-12T02:23:02.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.886+0000 7efc15723640 1 -- 172.21.15.60:0/2660629836 learned_addr learned my addr 172.21.15.60:0/2660629836 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:02.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.886+0000 7efc14f22640 1 --2- 172.21.15.60:0/2660629836 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efc100bf900 0x7efc101ebab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:02.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.886+0000 7efc0ffff640 1 --2- 172.21.15.60:0/2660629836 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc10153b70 0x7efc100c7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:02.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.886+0000 7efc15723640 1 -- 172.21.15.60:0/2660629836 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efc100bf900 msgr2=0x7efc101ebab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:02.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.886+0000 7efc15723640 1 --2- 172.21.15.60:0/2660629836 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efc100bf900 0x7efc101ebab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:02.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.886+0000 7efc15723640 1 -- 172.21.15.60:0/2660629836 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc10153b70 msgr2=0x7efc100c7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:02.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.886+0000 7efc15723640 1 --2- 172.21.15.60:0/2660629836 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc10153b70 0x7efc100c7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:02.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.886+0000 7efc15723640 1 -- 172.21.15.60:0/2660629836 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc1006ea70 con 0x7efc10153f50 2024-09-12T02:23:02.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.886+0000 7efc15723640 1 --2- 172.21.15.60:0/2660629836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc10153f50 0x7efc1006ef20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efc0802ab20 tx=0x7efc08004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:02.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.886+0000 7efc0d7fa640 1 -- 172.21.15.60:0/2660629836 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc08040070 con 0x7efc10153f50 2024-09-12T02:23:02.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.886+0000 7efc0d7fa640 1 -- 172.21.15.60:0/2660629836 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc08031bc0 con 0x7efc10153f50 2024-09-12T02:23:02.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.886+0000 7efc17186640 1 -- 172.21.15.60:0/2660629836 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc100ab470 con 0x7efc10153f50 2024-09-12T02:23:02.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.886+0000 7efc0d7fa640 1 -- 172.21.15.60:0/2660629836 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc08045460 con 0x7efc10153f50 2024-09-12T02:23:02.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.886+0000 7efc17186640 1 -- 172.21.15.60:0/2660629836 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc101ec6c0 con 0x7efc10153f50 2024-09-12T02:23:02.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.888+0000 7efc17186640 1 -- 172.21.15.60:0/2660629836 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc10068750 con 0x7efc10153f50 2024-09-12T02:23:02.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.888+0000 7efc0d7fa640 1 -- 172.21.15.60:0/2660629836 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efc08039040 con 0x7efc10153f50 2024-09-12T02:23:02.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.889+0000 7efc0d7fa640 1 --2- 172.21.15.60:0/2660629836 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7efbf406be30 0x7efbf406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:02.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.889+0000 7efc0d7fa640 1 -- 172.21.15.60:0/2660629836 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5222+0+0 (secure 0 0 0) 0x7efc080ac530 con 0x7efc10153f50 2024-09-12T02:23:02.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.889+0000 7efc14f22640 1 --2- 172.21.15.60:0/2660629836 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7efbf406be30 0x7efbf406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:02.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.889+0000 7efc14f22640 1 --2- 172.21.15.60:0/2660629836 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7efbf406be30 0x7efbf406e2f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efc0400a990 tx=0x7efc04008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:02.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:02.893+0000 7efc0d7fa640 1 -- 172.21.15.60:0/2660629836 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efc10068750 con 0x7efc10153f50 2024-09-12T02:23:03.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.073+0000 7efc17186640 1 -- 172.21.15.60:0/2660629836 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "a_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7efc101595d0 con 0x7efc10153f50 2024-09-12T02:23:03.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.745+0000 7efc0d7fa640 1 -- 172.21.15.60:0/2660629836 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "a_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'a_data' created v20) ==== 160+0+0 (secure 0 0 0) 0x7efc0807b210 con 0x7efc10153f50 2024-09-12T02:23:03.746 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'a_data' created 2024-09-12T02:23:03.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.749+0000 7efc17186640 1 -- 172.21.15.60:0/2660629836 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7efbf406be30 msgr2=0x7efbf406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:03.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.749+0000 7efc17186640 1 --2- 172.21.15.60:0/2660629836 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7efbf406be30 0x7efbf406e2f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efc0400a990 tx=0x7efc04008040 comp rx=0 tx=0).stop 2024-09-12T02:23:03.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.749+0000 7efc17186640 1 -- 172.21.15.60:0/2660629836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc10153f50 msgr2=0x7efc1006ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:03.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.749+0000 7efc17186640 1 --2- 172.21.15.60:0/2660629836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc10153f50 0x7efc1006ef20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efc0802ab20 tx=0x7efc08004a40 comp rx=0 tx=0).stop 2024-09-12T02:23:03.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.749+0000 7efc17186640 1 -- 172.21.15.60:0/2660629836 shutdown_connections 2024-09-12T02:23:03.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.749+0000 7efc17186640 1 --2- 172.21.15.60:0/2660629836 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7efbf406be30 0x7efbf406e2f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:03.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.749+0000 7efc17186640 1 --2- 172.21.15.60:0/2660629836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc10153f50 0x7efc1006ef20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:03.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.749+0000 7efc17186640 1 --2- 172.21.15.60:0/2660629836 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc10153b70 0x7efc100c7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:03.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.749+0000 7efc17186640 1 --2- 172.21.15.60:0/2660629836 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efc100bf900 0x7efc101ebab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:03.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.749+0000 7efc17186640 1 -- 172.21.15.60:0/2660629836 >> 172.21.15.60:0/2660629836 conn(0x7efc100c6a30 msgr2=0x7efc101597e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:03.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.749+0000 7efc17186640 1 -- 172.21.15.60:0/2660629836 shutdown_connections 2024-09-12T02:23:03.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.750+0000 7efc17186640 1 -- 172.21.15.60:0/2660629836 wait complete. 2024-09-12T02:23:03.778 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new a a_metadata a_data 2024-09-12T02:23:03.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.887+0000 7fb8bc0e4640 1 Processor -- start 2024-09-12T02:23:03.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.888+0000 7fb8bc0e4640 1 -- start start 2024-09-12T02:23:03.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.888+0000 7fb8bc0e4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb8b4153a40 0x7fb8b406c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:03.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.888+0000 7fb8bc0e4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8b406cbe0 0x7fb8b40c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:03.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.888+0000 7fb8bc0e4640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8b4159900 con 0x7fb8b40c80f0 2024-09-12T02:23:03.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.888+0000 7fb8bc0e4640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fb8b4159be0 con 0x7fb8b4153a40 2024-09-12T02:23:03.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.888+0000 7fb8bc0e4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb8b4159ec0 con 0x7fb8b406cbe0 2024-09-12T02:23:03.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.889+0000 7fb8b9e80640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb8b4153a40 0x7fb8b406c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:03.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.889+0000 7fb8b9e80640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb8b4153a40 0x7fb8b406c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56748/0 (socket says 172.21.15.60:56748) 2024-09-12T02:23:03.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.889+0000 7fb8b9e80640 1 -- 172.21.15.60:0/227604846 learned_addr learned my addr 172.21.15.60:0/227604846 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:03.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.889+0000 7fb8b967f640 1 --2- 172.21.15.60:0/227604846 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8b406cbe0 0x7fb8b40c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:03.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.889+0000 7fb8b9e80640 1 -- 172.21.15.60:0/227604846 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8b406cbe0 msgr2=0x7fb8b40c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:03.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.889+0000 7fb8b9e80640 1 --2- 172.21.15.60:0/227604846 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8b406cbe0 0x7fb8b40c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:03.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.889+0000 7fb8b9e80640 1 -- 172.21.15.60:0/227604846 >> v1:172.21.15.105:6789/0 conn(0x7fb8b40c80f0 legacy=0x7fb8b4156310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:03.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.889+0000 7fb8b9e80640 1 -- 172.21.15.60:0/227604846 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8b415a1a0 con 0x7fb8b4153a40 2024-09-12T02:23:03.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.889+0000 7fb8b967f640 1 --2- 172.21.15.60:0/227604846 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8b406cbe0 0x7fb8b40c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:23:03.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.890+0000 7fb8b9e80640 1 --2- 172.21.15.60:0/227604846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8b4153a40 0x7fb8b406c6a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0009870 tx=0x7fb8b002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6192c2164e027b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:03.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.890+0000 7fb8b8e7e640 1 -- 172.21.15.60:0/227604846 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b0037070 con 0x7fb8b4153a40 2024-09-12T02:23:03.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.890+0000 7fb8b8e7e640 1 -- 172.21.15.60:0/227604846 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8b0032440 con 0x7fb8b4153a40 2024-09-12T02:23:03.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.890+0000 7fb8b8e7e640 1 -- 172.21.15.60:0/227604846 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b0032810 con 0x7fb8b4153a40 2024-09-12T02:23:03.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.890+0000 7fb8bc0e4640 1 -- 172.21.15.60:0/227604846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8b4153a40 msgr2=0x7fb8b406c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:03.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.890+0000 7fb8bc0e4640 1 --2- 172.21.15.60:0/227604846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8b4153a40 0x7fb8b406c6a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0009870 tx=0x7fb8b002a270 comp rx=0 tx=0).stop 2024-09-12T02:23:03.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.890+0000 7fb8bc0e4640 1 -- 172.21.15.60:0/227604846 shutdown_connections 2024-09-12T02:23:03.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.890+0000 7fb8bc0e4640 1 --2- 172.21.15.60:0/227604846 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8b406cbe0 0x7fb8b40c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:03.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.890+0000 7fb8bc0e4640 1 --2- 172.21.15.60:0/227604846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8b4153a40 0x7fb8b406c6a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:03.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.890+0000 7fb8bc0e4640 1 -- 172.21.15.60:0/227604846 >> 172.21.15.60:0/227604846 conn(0x7fb8b4073310 msgr2=0x7fb8b40736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:03.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.890+0000 7fb8bc0e4640 1 -- 172.21.15.60:0/227604846 shutdown_connections 2024-09-12T02:23:03.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.890+0000 7fb8bc0e4640 1 -- 172.21.15.60:0/227604846 wait complete. 2024-09-12T02:23:03.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.892+0000 7fb8bc0e4640 1 Processor -- start 2024-09-12T02:23:03.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.892+0000 7fb8bc0e4640 1 -- start start 2024-09-12T02:23:03.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.892+0000 7fb8bc0e4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8b406cbe0 0x7fb8b4158e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:03.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.892+0000 7fb8bc0e4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8b40c80f0 0x7fb8b40b0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:03.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.892+0000 7fb8bc0e4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8b4153a40 0x7fb8b41e9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:03.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.892+0000 7fb8bc0e4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b4153e20 con 0x7fb8b4153a40 2024-09-12T02:23:03.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.892+0000 7fb8bc0e4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b40c9270 con 0x7fb8b40c80f0 2024-09-12T02:23:03.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.892+0000 7fb8bc0e4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb8b4153fa0 con 0x7fb8b406cbe0 2024-09-12T02:23:03.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.892+0000 7fb8ba681640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8b4153a40 0x7fb8b41e9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:03.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.892+0000 7fb8ba681640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8b4153a40 0x7fb8b41e9470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56762/0 (socket says 172.21.15.60:56762) 2024-09-12T02:23:03.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.892+0000 7fb8b9e80640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8b406cbe0 0x7fb8b4158e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:03.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.892+0000 7fb8b967f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8b40c80f0 0x7fb8b40b0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:03.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.892+0000 7fb8ba681640 1 -- 172.21.15.60:0/369607142 learned_addr learned my addr 172.21.15.60:0/369607142 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:03.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.893+0000 7fb8ba681640 1 -- 172.21.15.60:0/369607142 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8b406cbe0 msgr2=0x7fb8b4158e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:03.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.893+0000 7fb8ba681640 1 --2- 172.21.15.60:0/369607142 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8b406cbe0 0x7fb8b4158e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:03.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.893+0000 7fb8ba681640 1 -- 172.21.15.60:0/369607142 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8b40c80f0 msgr2=0x7fb8b40b0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:03.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.893+0000 7fb8ba681640 1 --2- 172.21.15.60:0/369607142 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8b40c80f0 0x7fb8b40b0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:03.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.893+0000 7fb8ba681640 1 -- 172.21.15.60:0/369607142 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8b41ef5a0 con 0x7fb8b4153a40 2024-09-12T02:23:03.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.893+0000 7fb8ba681640 1 --2- 172.21.15.60:0/369607142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8b4153a40 0x7fb8b41e9470 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac00c7a0 tx=0x7fb8ac00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:03.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.893+0000 7fb8aa7fc640 1 -- 172.21.15.60:0/369607142 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac003b70 con 0x7fb8b4153a40 2024-09-12T02:23:03.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.893+0000 7fb8aa7fc640 1 -- 172.21.15.60:0/369607142 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8ac003d30 con 0x7fb8b4153a40 2024-09-12T02:23:03.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.893+0000 7fb8aa7fc640 1 -- 172.21.15.60:0/369607142 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac00aa90 con 0x7fb8b4153a40 2024-09-12T02:23:03.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.893+0000 7fb8bc0e4640 1 -- 172.21.15.60:0/369607142 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8b41ef880 con 0x7fb8b4153a40 2024-09-12T02:23:03.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.893+0000 7fb8bc0e4640 1 -- 172.21.15.60:0/369607142 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8b41efe40 con 0x7fb8b4153a40 2024-09-12T02:23:03.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.894+0000 7fb8bc0e4640 1 -- 172.21.15.60:0/369607142 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8b40c7bb0 con 0x7fb8b4153a40 2024-09-12T02:23:03.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.895+0000 7fb8aa7fc640 1 -- 172.21.15.60:0/369607142 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb8ac00ac30 con 0x7fb8b4153a40 2024-09-12T02:23:03.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.895+0000 7fb8aa7fc640 1 --2- 172.21.15.60:0/369607142 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb89806be30 0x7fb89806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:03.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.896+0000 7fb8aa7fc640 1 -- 172.21.15.60:0/369607142 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5599+0+0 (secure 0 0 0) 0x7fb8ac08ab70 con 0x7fb8b4153a40 2024-09-12T02:23:03.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.896+0000 7fb8b9e80640 1 --2- 172.21.15.60:0/369607142 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb89806be30 0x7fb89806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:03.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.896+0000 7fb8b9e80640 1 --2- 172.21.15.60:0/369607142 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb89806be30 0x7fb89806e2f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0034000 tx=0x7fb8b002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:03.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:03.900+0000 7fb8aa7fc640 1 -- 172.21.15.60:0/369607142 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb8ac058fd0 con 0x7fb8b4153a40 2024-09-12T02:23:04.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.112+0000 7fb8bc0e4640 1 -- 172.21.15.60:0/369607142 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "a", "metadata": "a_metadata", "data": "a_data"} v 0) -- 0x7fb8b40af070 con 0x7fb8b4153a40 2024-09-12T02:23:04.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.761+0000 7fb8aa7fc640 1 -- 172.21.15.60:0/369607142 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "a", "metadata": "a_metadata", "data": "a_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 157+0+0 (secure 0 0 0) 0x7fb8ac05d2d0 con 0x7fb8b4153a40 2024-09-12T02:23:04.762 INFO:teuthology.orchestra.run.smithi060.stderr:new fs with metadata pool 2 and data pool 3 2024-09-12T02:23:04.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.766+0000 7fb8bc0e4640 1 -- 172.21.15.60:0/369607142 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb89806be30 msgr2=0x7fb89806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:04.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.766+0000 7fb8bc0e4640 1 --2- 172.21.15.60:0/369607142 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb89806be30 0x7fb89806e2f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0034000 tx=0x7fb8b002e000 comp rx=0 tx=0).stop 2024-09-12T02:23:04.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.766+0000 7fb8bc0e4640 1 -- 172.21.15.60:0/369607142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8b4153a40 msgr2=0x7fb8b41e9470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:04.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.766+0000 7fb8bc0e4640 1 --2- 172.21.15.60:0/369607142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8b4153a40 0x7fb8b41e9470 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac00c7a0 tx=0x7fb8ac00cc60 comp rx=0 tx=0).stop 2024-09-12T02:23:04.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.766+0000 7fb8bc0e4640 1 -- 172.21.15.60:0/369607142 shutdown_connections 2024-09-12T02:23:04.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.767+0000 7fb8bc0e4640 1 --2- 172.21.15.60:0/369607142 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb89806be30 0x7fb89806e2f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:04.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.767+0000 7fb8bc0e4640 1 --2- 172.21.15.60:0/369607142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8b4153a40 0x7fb8b41e9470 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:04.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.767+0000 7fb8bc0e4640 1 --2- 172.21.15.60:0/369607142 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8b40c80f0 0x7fb8b40b0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:04.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.767+0000 7fb8bc0e4640 1 --2- 172.21.15.60:0/369607142 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8b406cbe0 0x7fb8b4158e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:04.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.767+0000 7fb8bc0e4640 1 -- 172.21.15.60:0/369607142 >> 172.21.15.60:0/369607142 conn(0x7fb8b4073310 msgr2=0x7fb8b40ca5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:04.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.767+0000 7fb8bc0e4640 1 -- 172.21.15.60:0/369607142 shutdown_connections 2024-09-12T02:23:04.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.768+0000 7fb8bc0e4640 1 -- 172.21.15.60:0/369607142 wait complete. 2024-09-12T02:23:04.801 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:23:04.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.907+0000 7f67b9c53640 1 Processor -- start 2024-09-12T02:23:04.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.907+0000 7f67b9c53640 1 -- start start 2024-09-12T02:23:04.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.907+0000 7f67b9c53640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f67b4150480 0x7f67b40c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:04.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.908+0000 7f67b9c53640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f67b40ca390 0x7f67b40c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:04.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.908+0000 7f67b9c53640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67b415a7c0 con 0x7f67b406c650 2024-09-12T02:23:04.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.908+0000 7f67b9c53640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f67b406c240 con 0x7f67b4150480 2024-09-12T02:23:04.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.908+0000 7f67b9c53640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f67b415a330 con 0x7f67b40ca390 2024-09-12T02:23:04.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.908+0000 7f67b37fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f67b4150480 0x7f67b40c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:04.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.908+0000 7f67b37fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f67b4150480 0x7f67b40c7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56772/0 (socket says 172.21.15.60:56772) 2024-09-12T02:23:04.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.908+0000 7f67b37fe640 1 -- 172.21.15.60:0/3137581996 learned_addr learned my addr 172.21.15.60:0/3137581996 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:04.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.908+0000 7f67b3fff640 1 --2- 172.21.15.60:0/3137581996 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f67b40ca390 0x7f67b40c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:04.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.908+0000 7f67b37fe640 1 -- 172.21.15.60:0/3137581996 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f67b40ca390 msgr2=0x7f67b40c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:04.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.908+0000 7f67b37fe640 1 --2- 172.21.15.60:0/3137581996 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f67b40ca390 0x7f67b40c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:04.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.908+0000 7f67b37fe640 1 -- 172.21.15.60:0/3137581996 >> v1:172.21.15.105:6789/0 conn(0x7f67b406c650 legacy=0x7f67b40c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:04.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.908+0000 7f67b37fe640 1 -- 172.21.15.60:0/3137581996 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67b4159a00 con 0x7f67b4150480 2024-09-12T02:23:04.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.909+0000 7f67b37fe640 1 --2- 172.21.15.60:0/3137581996 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67b4150480 0x7f67b40c7a90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f67a4009870 tx=0x7f67a402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d3c55a333447ff0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:04.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.909+0000 7f67b27fc640 1 -- 172.21.15.60:0/3137581996 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a4037070 con 0x7f67b4150480 2024-09-12T02:23:04.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.909+0000 7f67b27fc640 1 -- 172.21.15.60:0/3137581996 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67a4032440 con 0x7f67b4150480 2024-09-12T02:23:04.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.909+0000 7f67b27fc640 1 -- 172.21.15.60:0/3137581996 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a4032810 con 0x7f67b4150480 2024-09-12T02:23:04.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.909+0000 7f67b9c53640 1 -- 172.21.15.60:0/3137581996 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67b4150480 msgr2=0x7f67b40c7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:04.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.909+0000 7f67b9c53640 1 --2- 172.21.15.60:0/3137581996 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67b4150480 0x7f67b40c7a90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f67a4009870 tx=0x7f67a402a270 comp rx=0 tx=0).stop 2024-09-12T02:23:04.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.910+0000 7f67b9c53640 1 -- 172.21.15.60:0/3137581996 shutdown_connections 2024-09-12T02:23:04.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.910+0000 7f67b9c53640 1 --2- 172.21.15.60:0/3137581996 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f67b40ca390 0x7f67b40c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:04.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.910+0000 7f67b9c53640 1 --2- 172.21.15.60:0/3137581996 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67b4150480 0x7f67b40c7a90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:04.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.910+0000 7f67b9c53640 1 -- 172.21.15.60:0/3137581996 >> 172.21.15.60:0/3137581996 conn(0x7f67b4068030 msgr2=0x7f67b4073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:04.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.910+0000 7f67b9c53640 1 -- 172.21.15.60:0/3137581996 shutdown_connections 2024-09-12T02:23:04.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.910+0000 7f67b9c53640 1 -- 172.21.15.60:0/3137581996 wait complete. 2024-09-12T02:23:04.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.911+0000 7f67b9c53640 1 Processor -- start 2024-09-12T02:23:04.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.911+0000 7f67b9c53640 1 -- start start 2024-09-12T02:23:04.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.912+0000 7f67b9c53640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f67b406c650 0x7f67b41f0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:04.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.912+0000 7f67b9c53640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f67b40ca390 0x7f67b414fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:04.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.912+0000 7f67b9c53640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67b4150480 0x7f67b40cb330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:04.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.912+0000 7f67b9c53640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f67b406d270 con 0x7f67b4150480 2024-09-12T02:23:04.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.912+0000 7f67b9c53640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f67b4159fc0 con 0x7f67b406c650 2024-09-12T02:23:04.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.912+0000 7f67b9c53640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f67b4156270 con 0x7f67b40ca390 2024-09-12T02:23:04.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.912+0000 7f67b3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67b4150480 0x7f67b40cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:04.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.912+0000 7f67b37fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f67b406c650 0x7f67b41f0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:04.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.912+0000 7f67b3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67b4150480 0x7f67b40cb330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56784/0 (socket says 172.21.15.60:56784) 2024-09-12T02:23:04.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.912+0000 7f67b37fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f67b406c650 0x7f67b41f0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:47566/0 (socket says 172.21.15.60:47566) 2024-09-12T02:23:04.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.912+0000 7f67b3fff640 1 -- 172.21.15.60:0/3723950299 learned_addr learned my addr 172.21.15.60:0/3723950299 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:04.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.912+0000 7f67b2ffd640 1 --2- 172.21.15.60:0/3723950299 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f67b40ca390 0x7f67b414fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:04.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.912+0000 7f67b3fff640 1 -- 172.21.15.60:0/3723950299 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f67b40ca390 msgr2=0x7f67b414fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:04.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.912+0000 7f67b3fff640 1 --2- 172.21.15.60:0/3723950299 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f67b40ca390 0x7f67b414fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:04.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.912+0000 7f67b3fff640 1 -- 172.21.15.60:0/3723950299 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f67b406c650 msgr2=0x7f67b41f0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:04.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.912+0000 7f67b3fff640 1 --2- 172.21.15.60:0/3723950299 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f67b406c650 0x7f67b41f0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:04.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.912+0000 7f67b3fff640 1 -- 172.21.15.60:0/3723950299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67b4151620 con 0x7f67b4150480 2024-09-12T02:23:04.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.912+0000 7f67b3fff640 1 --2- 172.21.15.60:0/3723950299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67b4150480 0x7f67b40cb330 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f67ac007e60 tx=0x7f67ac00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:04.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.912+0000 7f67abfff640 1 -- 172.21.15.60:0/3723950299 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ac014420 con 0x7f67b4150480 2024-09-12T02:23:04.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.912+0000 7f67abfff640 1 -- 172.21.15.60:0/3723950299 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67ac019070 con 0x7f67b4150480 2024-09-12T02:23:04.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.912+0000 7f67b9c53640 1 -- 172.21.15.60:0/3723950299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67b40cbdc0 con 0x7f67b4150480 2024-09-12T02:23:04.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.912+0000 7f67abfff640 1 -- 172.21.15.60:0/3723950299 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ac014820 con 0x7f67b4150480 2024-09-12T02:23:04.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.913+0000 7f67b9c53640 1 -- 172.21.15.60:0/3723950299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67b4151060 con 0x7f67b4150480 2024-09-12T02:23:04.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.913+0000 7f67b9c53640 1 -- 172.21.15.60:0/3723950299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67b4154060 con 0x7f67b4150480 2024-09-12T02:23:04.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.914+0000 7f67abfff640 1 -- 172.21.15.60:0/3723950299 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f67ac0149c0 con 0x7f67b4150480 2024-09-12T02:23:04.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.914+0000 7f67abfff640 1 --2- 172.21.15.60:0/3723950299 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f679406be30 0x7f679406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:04.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.914+0000 7f67abfff640 1 -- 172.21.15.60:0/3723950299 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5689+0+0 (secure 0 0 0) 0x7f67ac08b470 con 0x7f67b4150480 2024-09-12T02:23:04.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.914+0000 7f67b37fe640 1 --2- 172.21.15.60:0/3723950299 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f679406be30 0x7f679406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:04.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.915+0000 7f67b37fe640 1 --2- 172.21.15.60:0/3723950299 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f679406be30 0x7f679406e2f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f67a4034000 tx=0x7f67a402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:04.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:04.919+0000 7f67abfff640 1 -- 172.21.15.60:0/3723950299 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f67b4151620 con 0x7f67b4150480 2024-09-12T02:23:05.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.094+0000 7f67b9c53640 1 -- 172.21.15.60:0/3723950299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f67b406c430 con 0x7f67b4150480 2024-09-12T02:23:05.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.095+0000 7f67abfff640 1 -- 172.21.15.60:0/3723950299 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16646 (secure 0 0 0) 0x7f67ac059870 con 0x7f67b4150480 2024-09-12T02:23:05.095 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:23:05.096 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":21,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","created":"2024-09-12T02:22:39.869862+0000","modified":"2024-09-12T02:23:04.113595+0000","last_up_change":"2024-09-12T02:22:53.459371+0000","last_in_change":"2024-09-12T02:22:42.817076+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:22:52.130579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-09-12T02:23:01.854763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-09-12T02:23:03.104847+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0f0c7386-002f-47e2-a7a3-6c8a70264cc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6819","nonce":1789465659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6821","nonce":1789465659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6825","nonce":1789465659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6823","nonce":1789465659}]},"public_addr":"172.21.15.60:6819/1789465659","cluster_addr":"172.21.15.60:6821/1789465659","heartbeat_back_addr":"172.21.15.60:6825/1789465659","heartbeat_front_addr":"172.21.15.60:6823/1789465659","state":["exists","up"]},{"osd":1,"uuid":"64be7b84-36fc-43c0-9e70-a617e5b68941","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6811","nonce":1109822408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6813","nonce":1109822408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6817","nonce":1109822408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6815","nonce":1109822408}]},"public_addr":"172.21.15.60:6811/1109822408","cluster_addr":"172.21.15.60:6813/1109822408","heartbeat_back_addr":"172.21.15.60:6817/1109822408","heartbeat_front_addr":"172.21.15.60:6815/1109822408","state":["exists","up"]},{"osd":2,"uuid":"df00caa1-d45e-4b87-ac1e-8bc098d509d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6827","nonce":278470077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6829","nonce":278470077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6833","nonce":278470077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6831","nonce":278470077}]},"public_addr":"172.21.15.60:6827/278470077","cluster_addr":"172.21.15.60:6829/278470077","heartbeat_back_addr":"172.21.15.60:6833/278470077","heartbeat_front_addr":"172.21.15.60:6831/278470077","state":["exists","up"]},{"osd":3,"uuid":"f6453471-893a-490b-b0c7-f196a0f574e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6803","nonce":3606424156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6805","nonce":3606424156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6809","nonce":3606424156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6807","nonce":3606424156}]},"public_addr":"172.21.15.60:6803/3606424156","cluster_addr":"172.21.15.60:6805/3606424156","heartbeat_back_addr":"172.21.15.60:6809/3606424156","heartbeat_front_addr":"172.21.15.60:6807/3606424156","state":["exists","up"]},{"osd":4,"uuid":"96e908b6-ce3e-466c-b02d-08fc71a1dba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6809","nonce":1581641129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6811","nonce":1581641129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6815","nonce":1581641129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6813","nonce":1581641129}]},"public_addr":"172.21.15.105:6809/1581641129","cluster_addr":"172.21.15.105:6811/1581641129","heartbeat_back_addr":"172.21.15.105:6815/1581641129","heartbeat_front_addr":"172.21.15.105:6813/1581641129","state":["exists","up"]},{"osd":5,"uuid":"7ebc26f0-a462-4364-9303-7351f7cba21f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6825","nonce":1392337793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6827","nonce":1392337793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6831","nonce":1392337793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6829","nonce":1392337793}]},"public_addr":"172.21.15.105:6825/1392337793","cluster_addr":"172.21.15.105:6827/1392337793","heartbeat_back_addr":"172.21.15.105:6831/1392337793","heartbeat_front_addr":"172.21.15.105:6829/1392337793","state":["exists","up"]},{"osd":6,"uuid":"49487ea1-9c6d-4090-bbcc-f28b33040eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6801","nonce":50951309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6803","nonce":50951309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6807","nonce":50951309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6805","nonce":50951309}]},"public_addr":"172.21.15.105:6801/50951309","cluster_addr":"172.21.15.105:6803/50951309","heartbeat_back_addr":"172.21.15.105:6807/50951309","heartbeat_front_addr":"172.21.15.105:6805/50951309","state":["exists","up"]},{"osd":7,"uuid":"1e3a0aa9-7e29-4785-8506-6b5d3be2be35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6817","nonce":3745331251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6819","nonce":3745331251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6823","nonce":3745331251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6821","nonce":3745331251}]},"public_addr":"172.21.15.105:6817/3745331251","cluster_addr":"172.21.15.105:6819/3745331251","heartbeat_back_addr":"172.21.15.105:6823/3745331251","heartbeat_front_addr":"172.21.15.105:6821/3745331251","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:50.112629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.307689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.542851+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.334773+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:50.096967+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:50.259633+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.888988+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.917421+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:23:05.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.097+0000 7f67b9c53640 1 -- 172.21.15.60:0/3723950299 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f679406be30 msgr2=0x7f679406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:05.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.097+0000 7f67b9c53640 1 --2- 172.21.15.60:0/3723950299 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f679406be30 0x7f679406e2f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f67a4034000 tx=0x7f67a402e000 comp rx=0 tx=0).stop 2024-09-12T02:23:05.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.097+0000 7f67b9c53640 1 -- 172.21.15.60:0/3723950299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67b4150480 msgr2=0x7f67b40cb330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:05.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.097+0000 7f67b9c53640 1 --2- 172.21.15.60:0/3723950299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67b4150480 0x7f67b40cb330 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f67ac007e60 tx=0x7f67ac00e4b0 comp rx=0 tx=0).stop 2024-09-12T02:23:05.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.097+0000 7f67b9c53640 1 -- 172.21.15.60:0/3723950299 shutdown_connections 2024-09-12T02:23:05.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.097+0000 7f67b9c53640 1 --2- 172.21.15.60:0/3723950299 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f679406be30 0x7f679406e2f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:05.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.097+0000 7f67b9c53640 1 --2- 172.21.15.60:0/3723950299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67b4150480 0x7f67b40cb330 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:05.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.097+0000 7f67b9c53640 1 --2- 172.21.15.60:0/3723950299 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f67b40ca390 0x7f67b414fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:05.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.097+0000 7f67b9c53640 1 --2- 172.21.15.60:0/3723950299 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f67b406c650 0x7f67b41f0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:05.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.097+0000 7f67b9c53640 1 -- 172.21.15.60:0/3723950299 >> 172.21.15.60:0/3723950299 conn(0x7f67b4068030 msgr2=0x7f67b4154af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:05.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.097+0000 7f67b9c53640 1 -- 172.21.15.60:0/3723950299 shutdown_connections 2024-09-12T02:23:05.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.097+0000 7f67b9c53640 1 -- 172.21.15.60:0/3723950299 wait complete. 2024-09-12T02:23:05.108 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:23:05.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.210+0000 7fb5ee1bd640 1 Processor -- start 2024-09-12T02:23:05.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.210+0000 7fb5ee1bd640 1 -- start start 2024-09-12T02:23:05.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.211+0000 7fb5ee1bd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb5e81505f0 0x7fb5e8153910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:05.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.211+0000 7fb5ee1bd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5e80c42b0 0x7fb5e80c46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:05.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.211+0000 7fb5ee1bd640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5e80c5940 con 0x7fb5e80c69c0 2024-09-12T02:23:05.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.211+0000 7fb5ee1bd640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fb5e80c7860 con 0x7fb5e81505f0 2024-09-12T02:23:05.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.211+0000 7fb5ee1bd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb5e80c5c00 con 0x7fb5e80c42b0 2024-09-12T02:23:05.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.211+0000 7fb5e6ffd640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb5e80c69c0 0x7fb5e80c2440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45104/0 (socket says 172.21.15.60:45104) 2024-09-12T02:23:05.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.211+0000 7fb5e6ffd640 1 -- 172.21.15.60:0/1840207507 learned_addr learned my addr 172.21.15.60:0/1840207507 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:05.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.211+0000 7fb5e77fe640 1 --2- 172.21.15.60:0/1840207507 >> v2:172.21.15.105:3300/0 conn(0x7fb5e81505f0 0x7fb5e8153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:05.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.211+0000 7fb5e7fff640 1 --2- 172.21.15.60:0/1840207507 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5e80c42b0 0x7fb5e80c46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:05.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.211+0000 7fb5e67fc640 1 -- 172.21.15.60:0/1840207507 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 185977446 0 0) 0x7fb5e80c5940 con 0x7fb5e80c69c0 2024-09-12T02:23:05.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.211+0000 7fb5e67fc640 1 -- 172.21.15.60:0/1840207507 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5d0003520 con 0x7fb5e80c69c0 2024-09-12T02:23:05.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.211+0000 7fb5e67fc640 1 -- 172.21.15.60:0/1840207507 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 589984101 0 0) 0x7fb5d0003520 con 0x7fb5e80c69c0 2024-09-12T02:23:05.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.211+0000 7fb5e77fe640 1 -- 172.21.15.60:0/1840207507 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5e80c42b0 msgr2=0x7fb5e80c46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:05.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.211+0000 7fb5e77fe640 1 --2- 172.21.15.60:0/1840207507 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5e80c42b0 0x7fb5e80c46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:05.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.211+0000 7fb5e77fe640 1 -- 172.21.15.60:0/1840207507 >> v1:172.21.15.60:6789/0 conn(0x7fb5e80c69c0 legacy=0x7fb5e80c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:05.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.211+0000 7fb5e77fe640 1 -- 172.21.15.60:0/1840207507 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5e80c5ee0 con 0x7fb5e81505f0 2024-09-12T02:23:05.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.212+0000 7fb5e77fe640 1 --2- 172.21.15.60:0/1840207507 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5e81505f0 0x7fb5e8153910 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb5d80097a0 tx=0x7fb5d802a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ac05ba52a808b6f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:05.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.212+0000 7fb5e67fc640 1 -- 172.21.15.60:0/1840207507 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d8037070 con 0x7fb5e81505f0 2024-09-12T02:23:05.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.213+0000 7fb5e67fc640 1 -- 172.21.15.60:0/1840207507 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5d802ab10 con 0x7fb5e81505f0 2024-09-12T02:23:05.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.213+0000 7fb5e67fc640 1 -- 172.21.15.60:0/1840207507 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc001670 con 0x7fb5e81505f0 2024-09-12T02:23:05.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.213+0000 7fb5ee1bd640 1 -- 172.21.15.60:0/1840207507 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5e81505f0 msgr2=0x7fb5e8153910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:05.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.213+0000 7fb5ee1bd640 1 --2- 172.21.15.60:0/1840207507 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5e81505f0 0x7fb5e8153910 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb5d80097a0 tx=0x7fb5d802a080 comp rx=0 tx=0).stop 2024-09-12T02:23:05.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.213+0000 7fb5ee1bd640 1 -- 172.21.15.60:0/1840207507 shutdown_connections 2024-09-12T02:23:05.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.213+0000 7fb5ee1bd640 1 --2- 172.21.15.60:0/1840207507 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5e80c42b0 0x7fb5e80c46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:05.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.213+0000 7fb5ee1bd640 1 --2- 172.21.15.60:0/1840207507 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5e81505f0 0x7fb5e8153910 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:05.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.213+0000 7fb5ee1bd640 1 -- 172.21.15.60:0/1840207507 >> 172.21.15.60:0/1840207507 conn(0x7fb5e80c7a40 msgr2=0x7fb5e80c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:05.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.213+0000 7fb5ee1bd640 1 -- 172.21.15.60:0/1840207507 shutdown_connections 2024-09-12T02:23:05.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.213+0000 7fb5ee1bd640 1 -- 172.21.15.60:0/1840207507 wait complete. 2024-09-12T02:23:05.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.214+0000 7fb5ee1bd640 1 Processor -- start 2024-09-12T02:23:05.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.214+0000 7fb5ee1bd640 1 -- start start 2024-09-12T02:23:05.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.215+0000 7fb5ee1bd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5e80c42b0 0x7fb5e81ec320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:05.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.215+0000 7fb5ee1bd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5e81505f0 0x7fb5e80c10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:05.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.215+0000 7fb5ee1bd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5e80ac610 0x7fb5e80aca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:05.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.215+0000 7fb5ee1bd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e81509d0 con 0x7fb5e81505f0 2024-09-12T02:23:05.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.215+0000 7fb5ee1bd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e80c64a0 con 0x7fb5e80ac610 2024-09-12T02:23:05.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.215+0000 7fb5ee1bd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb5e8150b50 con 0x7fb5e80c42b0 2024-09-12T02:23:05.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.215+0000 7fb5e6ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5e81505f0 0x7fb5e80c10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:05.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.215+0000 7fb5e6ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5e81505f0 0x7fb5e80c10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56786/0 (socket says 172.21.15.60:56786) 2024-09-12T02:23:05.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.215+0000 7fb5e6ffd640 1 -- 172.21.15.60:0/1977392895 learned_addr learned my addr 172.21.15.60:0/1977392895 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:05.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.215+0000 7fb5e7fff640 1 --2- 172.21.15.60:0/1977392895 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5e80ac610 0x7fb5e80aca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:05.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.215+0000 7fb5e77fe640 1 --2- 172.21.15.60:0/1977392895 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5e80c42b0 0x7fb5e81ec320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:05.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.216+0000 7fb5e6ffd640 1 -- 172.21.15.60:0/1977392895 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5e80c42b0 msgr2=0x7fb5e81ec320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:05.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.216+0000 7fb5e6ffd640 1 --2- 172.21.15.60:0/1977392895 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5e80c42b0 0x7fb5e81ec320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:05.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.216+0000 7fb5e6ffd640 1 -- 172.21.15.60:0/1977392895 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5e80ac610 msgr2=0x7fb5e80aca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:05.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.216+0000 7fb5e6ffd640 1 --2- 172.21.15.60:0/1977392895 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5e80ac610 0x7fb5e80aca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:05.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.216+0000 7fb5e6ffd640 1 -- 172.21.15.60:0/1977392895 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5e815ed00 con 0x7fb5e81505f0 2024-09-12T02:23:05.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.216+0000 7fb5e7fff640 1 --2- 172.21.15.60:0/1977392895 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5e80ac610 0x7fb5e80aca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:23:05.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.216+0000 7fb5e77fe640 1 --2- 172.21.15.60:0/1977392895 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5e80c42b0 0x7fb5e81ec320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:23:05.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.216+0000 7fb5e6ffd640 1 --2- 172.21.15.60:0/1977392895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5e81505f0 0x7fb5e80c10e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc00c7b0 tx=0x7fb5dc00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:05.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.216+0000 7fb5cffff640 1 -- 172.21.15.60:0/1977392895 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc017070 con 0x7fb5e81505f0 2024-09-12T02:23:05.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.216+0000 7fb5cffff640 1 -- 172.21.15.60:0/1977392895 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5dc005ad0 con 0x7fb5e81505f0 2024-09-12T02:23:05.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.216+0000 7fb5ee1bd640 1 -- 172.21.15.60:0/1977392895 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5e80abb50 con 0x7fb5e81505f0 2024-09-12T02:23:05.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.216+0000 7fb5cffff640 1 -- 172.21.15.60:0/1977392895 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc007070 con 0x7fb5e81505f0 2024-09-12T02:23:05.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.216+0000 7fb5ee1bd640 1 -- 172.21.15.60:0/1977392895 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5e80ad9e0 con 0x7fb5e81505f0 2024-09-12T02:23:05.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.217+0000 7fb5ee1bd640 1 -- 172.21.15.60:0/1977392895 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5e8153910 con 0x7fb5e81505f0 2024-09-12T02:23:05.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.217+0000 7fb5cffff640 1 -- 172.21.15.60:0/1977392895 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb5dc01a070 con 0x7fb5e81505f0 2024-09-12T02:23:05.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.218+0000 7fb5cffff640 1 --2- 172.21.15.60:0/1977392895 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb5d406be30 0x7fb5d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:05.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.218+0000 7fb5cffff640 1 -- 172.21.15.60:0/1977392895 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5689+0+0 (secure 0 0 0) 0x7fb5dc08a3b0 con 0x7fb5e81505f0 2024-09-12T02:23:05.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.218+0000 7fb5e77fe640 1 --2- 172.21.15.60:0/1977392895 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb5d406be30 0x7fb5d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:05.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.218+0000 7fb5e77fe640 1 --2- 172.21.15.60:0/1977392895 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb5d406be30 0x7fb5d406e2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb5d8034000 tx=0x7fb5d802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:05.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.222+0000 7fb5cffff640 1 -- 172.21.15.60:0/1977392895 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb5e815ed00 con 0x7fb5e81505f0 2024-09-12T02:23:05.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.398+0000 7fb5ee1bd640 1 -- 172.21.15.60:0/1977392895 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb5e80c26b0 con 0x7fb5e81505f0 2024-09-12T02:23:05.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.399+0000 7fb5cffff640 1 -- 172.21.15.60:0/1977392895 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16646 (secure 0 0 0) 0x7fb5dc058d70 con 0x7fb5e81505f0 2024-09-12T02:23:05.400 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:23:05.400 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":21,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","created":"2024-09-12T02:22:39.869862+0000","modified":"2024-09-12T02:23:04.113595+0000","last_up_change":"2024-09-12T02:22:53.459371+0000","last_in_change":"2024-09-12T02:22:42.817076+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:22:52.130579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-09-12T02:23:01.854763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-09-12T02:23:03.104847+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0f0c7386-002f-47e2-a7a3-6c8a70264cc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6819","nonce":1789465659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6821","nonce":1789465659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6825","nonce":1789465659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6823","nonce":1789465659}]},"public_addr":"172.21.15.60:6819/1789465659","cluster_addr":"172.21.15.60:6821/1789465659","heartbeat_back_addr":"172.21.15.60:6825/1789465659","heartbeat_front_addr":"172.21.15.60:6823/1789465659","state":["exists","up"]},{"osd":1,"uuid":"64be7b84-36fc-43c0-9e70-a617e5b68941","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6811","nonce":1109822408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6813","nonce":1109822408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6817","nonce":1109822408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6815","nonce":1109822408}]},"public_addr":"172.21.15.60:6811/1109822408","cluster_addr":"172.21.15.60:6813/1109822408","heartbeat_back_addr":"172.21.15.60:6817/1109822408","heartbeat_front_addr":"172.21.15.60:6815/1109822408","state":["exists","up"]},{"osd":2,"uuid":"df00caa1-d45e-4b87-ac1e-8bc098d509d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6827","nonce":278470077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6829","nonce":278470077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6833","nonce":278470077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6831","nonce":278470077}]},"public_addr":"172.21.15.60:6827/278470077","cluster_addr":"172.21.15.60:6829/278470077","heartbeat_back_addr":"172.21.15.60:6833/278470077","heartbeat_front_addr":"172.21.15.60:6831/278470077","state":["exists","up"]},{"osd":3,"uuid":"f6453471-893a-490b-b0c7-f196a0f574e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6803","nonce":3606424156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6805","nonce":3606424156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6809","nonce":3606424156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6807","nonce":3606424156}]},"public_addr":"172.21.15.60:6803/3606424156","cluster_addr":"172.21.15.60:6805/3606424156","heartbeat_back_addr":"172.21.15.60:6809/3606424156","heartbeat_front_addr":"172.21.15.60:6807/3606424156","state":["exists","up"]},{"osd":4,"uuid":"96e908b6-ce3e-466c-b02d-08fc71a1dba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6809","nonce":1581641129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6811","nonce":1581641129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6815","nonce":1581641129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6813","nonce":1581641129}]},"public_addr":"172.21.15.105:6809/1581641129","cluster_addr":"172.21.15.105:6811/1581641129","heartbeat_back_addr":"172.21.15.105:6815/1581641129","heartbeat_front_addr":"172.21.15.105:6813/1581641129","state":["exists","up"]},{"osd":5,"uuid":"7ebc26f0-a462-4364-9303-7351f7cba21f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6825","nonce":1392337793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6827","nonce":1392337793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6831","nonce":1392337793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6829","nonce":1392337793}]},"public_addr":"172.21.15.105:6825/1392337793","cluster_addr":"172.21.15.105:6827/1392337793","heartbeat_back_addr":"172.21.15.105:6831/1392337793","heartbeat_front_addr":"172.21.15.105:6829/1392337793","state":["exists","up"]},{"osd":6,"uuid":"49487ea1-9c6d-4090-bbcc-f28b33040eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6801","nonce":50951309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6803","nonce":50951309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6807","nonce":50951309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6805","nonce":50951309}]},"public_addr":"172.21.15.105:6801/50951309","cluster_addr":"172.21.15.105:6803/50951309","heartbeat_back_addr":"172.21.15.105:6807/50951309","heartbeat_front_addr":"172.21.15.105:6805/50951309","state":["exists","up"]},{"osd":7,"uuid":"1e3a0aa9-7e29-4785-8506-6b5d3be2be35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6817","nonce":3745331251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6819","nonce":3745331251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6823","nonce":3745331251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6821","nonce":3745331251}]},"public_addr":"172.21.15.105:6817/3745331251","cluster_addr":"172.21.15.105:6819/3745331251","heartbeat_back_addr":"172.21.15.105:6823/3745331251","heartbeat_front_addr":"172.21.15.105:6821/3745331251","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:50.112629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.307689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.542851+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.334773+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:50.096967+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:50.259633+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.888988+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.917421+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:23:05.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.402+0000 7fb5ee1bd640 1 -- 172.21.15.60:0/1977392895 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb5d406be30 msgr2=0x7fb5d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:05.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.402+0000 7fb5ee1bd640 1 --2- 172.21.15.60:0/1977392895 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb5d406be30 0x7fb5d406e2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb5d8034000 tx=0x7fb5d802e000 comp rx=0 tx=0).stop 2024-09-12T02:23:05.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.402+0000 7fb5ee1bd640 1 -- 172.21.15.60:0/1977392895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5e81505f0 msgr2=0x7fb5e80c10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:05.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.402+0000 7fb5ee1bd640 1 --2- 172.21.15.60:0/1977392895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5e81505f0 0x7fb5e80c10e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc00c7b0 tx=0x7fb5dc00cc70 comp rx=0 tx=0).stop 2024-09-12T02:23:05.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.402+0000 7fb5ee1bd640 1 -- 172.21.15.60:0/1977392895 shutdown_connections 2024-09-12T02:23:05.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.402+0000 7fb5ee1bd640 1 --2- 172.21.15.60:0/1977392895 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb5d406be30 0x7fb5d406e2f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:05.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.402+0000 7fb5ee1bd640 1 --2- 172.21.15.60:0/1977392895 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5e80ac610 0x7fb5e80aca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:05.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.402+0000 7fb5ee1bd640 1 --2- 172.21.15.60:0/1977392895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5e81505f0 0x7fb5e80c10e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:05.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.402+0000 7fb5ee1bd640 1 --2- 172.21.15.60:0/1977392895 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5e80c42b0 0x7fb5e81ec320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:05.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.402+0000 7fb5ee1bd640 1 -- 172.21.15.60:0/1977392895 >> 172.21.15.60:0/1977392895 conn(0x7fb5e80c7a40 msgr2=0x7fb5e81526b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:05.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.402+0000 7fb5ee1bd640 1 -- 172.21.15.60:0/1977392895 shutdown_connections 2024-09-12T02:23:05.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.402+0000 7fb5ee1bd640 1 -- 172.21.15.60:0/1977392895 wait complete. 2024-09-12T02:23:05.413 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set a standby_count_wanted 0 2024-09-12T02:23:05.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.517+0000 7f67127ef640 1 Processor -- start 2024-09-12T02:23:05.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.517+0000 7f67127ef640 1 -- start start 2024-09-12T02:23:05.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.518+0000 7f67127ef640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f670c073ae0 0x7f670c153380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:05.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.518+0000 7f67127ef640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f670c0733d0 0x7f670c1538c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:05.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.518+0000 7f67127ef640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f670c06d850 0x7f670c156840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:05.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.518+0000 7f67127ef640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f670c06dd50 con 0x7f670c073ae0 2024-09-12T02:23:05.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.518+0000 7f67127ef640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f670c06e030 con 0x7f670c0733d0 2024-09-12T02:23:05.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.518+0000 7f67127ef640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f670c06e310 con 0x7f670c06d850 2024-09-12T02:23:05.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.518+0000 7f670bfff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f670c073ae0 0x7f670c153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:05.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.518+0000 7f670bfff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f670c073ae0 0x7f670c153380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56794/0 (socket says 172.21.15.60:56794) 2024-09-12T02:23:05.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.518+0000 7f670bfff640 1 -- 172.21.15.60:0/180805578 learned_addr learned my addr 172.21.15.60:0/180805578 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:05.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.519+0000 7f6710d8c640 1 --2- 172.21.15.60:0/180805578 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f670c06d850 0x7f670c156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:05.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.519+0000 7f670b7fe640 1 --2- 172.21.15.60:0/180805578 >> v2:172.21.15.105:3300/0 conn(0x7f670c0733d0 0x7f670c1538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:05.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.519+0000 7f670bfff640 1 -- 172.21.15.60:0/180805578 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f670c06d850 msgr2=0x7f670c156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:05.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.519+0000 7f670bfff640 1 --2- 172.21.15.60:0/180805578 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f670c06d850 0x7f670c156840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:05.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.519+0000 7f670bfff640 1 -- 172.21.15.60:0/180805578 >> v2:172.21.15.105:3300/0 conn(0x7f670c0733d0 msgr2=0x7f670c1538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:05.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.519+0000 7f670bfff640 1 --2- 172.21.15.60:0/180805578 >> v2:172.21.15.105:3300/0 conn(0x7f670c0733d0 0x7f670c1538c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:05.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.519+0000 7f670bfff640 1 -- 172.21.15.60:0/180805578 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f670c06e5f0 con 0x7f670c073ae0 2024-09-12T02:23:05.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.519+0000 7f670b7fe640 1 --2- 172.21.15.60:0/180805578 >> v2:172.21.15.105:3300/0 conn(0x7f670c0733d0 0x7f670c1538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:23:05.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.519+0000 7f670bfff640 1 --2- 172.21.15.60:0/180805578 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f670c073ae0 0x7f670c153380 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f670c0ca980 tx=0x7f66fc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40efa5bc6716658c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:05.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.519+0000 7f670affd640 1 -- 172.21.15.60:0/180805578 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66fc037070 con 0x7f670c073ae0 2024-09-12T02:23:05.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.520+0000 7f670affd640 1 -- 172.21.15.60:0/180805578 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66fc032440 con 0x7f670c073ae0 2024-09-12T02:23:05.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.520+0000 7f670affd640 1 -- 172.21.15.60:0/180805578 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66fc032810 con 0x7f670c073ae0 2024-09-12T02:23:05.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.520+0000 7f67127ef640 1 -- 172.21.15.60:0/180805578 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f670c073ae0 msgr2=0x7f670c153380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:05.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.520+0000 7f67127ef640 1 --2- 172.21.15.60:0/180805578 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f670c073ae0 0x7f670c153380 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f670c0ca980 tx=0x7f66fc02a1e0 comp rx=0 tx=0).stop 2024-09-12T02:23:05.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.520+0000 7f67127ef640 1 -- 172.21.15.60:0/180805578 shutdown_connections 2024-09-12T02:23:05.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.520+0000 7f67127ef640 1 --2- 172.21.15.60:0/180805578 >> v2:172.21.15.105:3300/0 conn(0x7f670c0733d0 0x7f670c1538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:05.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.520+0000 7f67127ef640 1 --2- 172.21.15.60:0/180805578 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f670c06d850 0x7f670c156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:05.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.520+0000 7f67127ef640 1 --2- 172.21.15.60:0/180805578 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f670c073ae0 0x7f670c153380 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:05.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.520+0000 7f67127ef640 1 -- 172.21.15.60:0/180805578 >> 172.21.15.60:0/180805578 conn(0x7f670c0c9d80 msgr2=0x7f670c0ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:05.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.520+0000 7f67127ef640 1 -- 172.21.15.60:0/180805578 shutdown_connections 2024-09-12T02:23:05.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.520+0000 7f67127ef640 1 -- 172.21.15.60:0/180805578 wait complete. 2024-09-12T02:23:05.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.521+0000 7f67127ef640 1 Processor -- start 2024-09-12T02:23:05.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.521+0000 7f67127ef640 1 -- start start 2024-09-12T02:23:05.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.522+0000 7f67127ef640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f670c06d850 0x7f670c1e8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:05.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.522+0000 7f67127ef640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f670c0733d0 0x7f670c1e9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:05.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.522+0000 7f67127ef640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f670c073ae0 0x7f670c1ef190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:05.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.522+0000 7f67127ef640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f670c06edd0 con 0x7f670c073ae0 2024-09-12T02:23:05.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.522+0000 7f67127ef640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f670c06ec50 con 0x7f670c06d850 2024-09-12T02:23:05.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.522+0000 7f67127ef640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f670c073ec0 con 0x7f670c0733d0 2024-09-12T02:23:05.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.522+0000 7f6710d8c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f670c073ae0 0x7f670c1ef190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:05.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.522+0000 7f6710d8c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f670c073ae0 0x7f670c1ef190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56806/0 (socket says 172.21.15.60:56806) 2024-09-12T02:23:05.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.522+0000 7f6710d8c640 1 -- 172.21.15.60:0/518236340 learned_addr learned my addr 172.21.15.60:0/518236340 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:05.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.522+0000 7f670bfff640 1 --2- 172.21.15.60:0/518236340 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f670c06d850 0x7f670c1e8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:05.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.522+0000 7f670b7fe640 1 --2- 172.21.15.60:0/518236340 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f670c0733d0 0x7f670c1e9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:05.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.523+0000 7f6710d8c640 1 -- 172.21.15.60:0/518236340 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f670c0733d0 msgr2=0x7f670c1e9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:05.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.523+0000 7f6710d8c640 1 --2- 172.21.15.60:0/518236340 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f670c0733d0 0x7f670c1e9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:05.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.523+0000 7f6710d8c640 1 -- 172.21.15.60:0/518236340 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f670c06d850 msgr2=0x7f670c1e8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:05.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.523+0000 7f6710d8c640 1 --2- 172.21.15.60:0/518236340 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f670c06d850 0x7f670c1e8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:05.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.523+0000 7f6710d8c640 1 -- 172.21.15.60:0/518236340 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f670c0c03a0 con 0x7f670c073ae0 2024-09-12T02:23:05.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.523+0000 7f6710d8c640 1 --2- 172.21.15.60:0/518236340 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f670c073ae0 0x7f670c1ef190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f670400cb80 tx=0x7f670400a4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:05.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.523+0000 7f6708ff9640 1 -- 172.21.15.60:0/518236340 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6704015070 con 0x7f670c073ae0 2024-09-12T02:23:05.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.523+0000 7f6708ff9640 1 -- 172.21.15.60:0/518236340 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f670400abd0 con 0x7f670c073ae0 2024-09-12T02:23:05.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.523+0000 7f67127ef640 1 -- 172.21.15.60:0/518236340 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f670c0bf080 con 0x7f670c073ae0 2024-09-12T02:23:05.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.523+0000 7f6708ff9640 1 -- 172.21.15.60:0/518236340 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f670400d040 con 0x7f670c073ae0 2024-09-12T02:23:05.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.523+0000 7f67127ef640 1 -- 172.21.15.60:0/518236340 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f670c1581e0 con 0x7f670c073ae0 2024-09-12T02:23:05.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.524+0000 7f67127ef640 1 -- 172.21.15.60:0/518236340 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f670c072c50 con 0x7f670c073ae0 2024-09-12T02:23:05.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.524+0000 7f6708ff9640 1 -- 172.21.15.60:0/518236340 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6704018070 con 0x7f670c073ae0 2024-09-12T02:23:05.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.525+0000 7f6708ff9640 1 --2- 172.21.15.60:0/518236340 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f66f806be30 0x7f66f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:05.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.525+0000 7f6708ff9640 1 -- 172.21.15.60:0/518236340 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5689+0+0 (secure 0 0 0) 0x7f670408a980 con 0x7f670c073ae0 2024-09-12T02:23:05.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.525+0000 7f670bfff640 1 --2- 172.21.15.60:0/518236340 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f66f806be30 0x7f66f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:05.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.525+0000 7f670bfff640 1 --2- 172.21.15.60:0/518236340 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f66f806be30 0x7f66f806e2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f66fc034000 tx=0x7f66fc02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:05.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.529+0000 7f6708ff9640 1 -- 172.21.15.60:0/518236340 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6704058d80 con 0x7f670c073ae0 2024-09-12T02:23:05.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.738+0000 7f67127ef640 1 -- 172.21.15.60:0/518236340 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "a", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f670c150a10 con 0x7f670c073ae0 2024-09-12T02:23:05.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.779+0000 7f6708ff9640 1 -- 172.21.15.60:0/518236340 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "a", "var": "standby_count_wanted", "val": "0"}]=0 v5) ==== 113+0+0 (secure 0 0 0) 0x7f670405d080 con 0x7f670c073ae0 2024-09-12T02:23:05.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.781+0000 7f67127ef640 1 -- 172.21.15.60:0/518236340 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f66f806be30 msgr2=0x7f66f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:05.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.781+0000 7f67127ef640 1 --2- 172.21.15.60:0/518236340 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f66f806be30 0x7f66f806e2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f66fc034000 tx=0x7f66fc02e000 comp rx=0 tx=0).stop 2024-09-12T02:23:05.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.781+0000 7f67127ef640 1 -- 172.21.15.60:0/518236340 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f670c073ae0 msgr2=0x7f670c1ef190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:05.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.781+0000 7f67127ef640 1 --2- 172.21.15.60:0/518236340 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f670c073ae0 0x7f670c1ef190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f670400cb80 tx=0x7f670400a4c0 comp rx=0 tx=0).stop 2024-09-12T02:23:05.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.781+0000 7f67127ef640 1 -- 172.21.15.60:0/518236340 shutdown_connections 2024-09-12T02:23:05.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.781+0000 7f67127ef640 1 --2- 172.21.15.60:0/518236340 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f66f806be30 0x7f66f806e2f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:05.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.781+0000 7f67127ef640 1 --2- 172.21.15.60:0/518236340 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f670c073ae0 0x7f670c1ef190 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:05.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.781+0000 7f67127ef640 1 --2- 172.21.15.60:0/518236340 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f670c0733d0 0x7f670c1e9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:05.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.781+0000 7f67127ef640 1 --2- 172.21.15.60:0/518236340 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f670c06d850 0x7f670c1e8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:05.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.781+0000 7f67127ef640 1 -- 172.21.15.60:0/518236340 >> 172.21.15.60:0/518236340 conn(0x7f670c0c9d80 msgr2=0x7f670c0c5970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:05.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.781+0000 7f67127ef640 1 -- 172.21.15.60:0/518236340 shutdown_connections 2024-09-12T02:23:05.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.781+0000 7f67127ef640 1 -- 172.21.15.60:0/518236340 wait complete. 2024-09-12T02:23:05.793 DEBUG:tasks.cephfs.filesystem:fs_config: {'session_timeout': 300} 2024-09-12T02:23:05.793 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set a allow_standby_replay false 2024-09-12T02:23:05.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.897+0000 7fc8e26a6640 1 Processor -- start 2024-09-12T02:23:05.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.898+0000 7fc8e26a6640 1 -- start start 2024-09-12T02:23:05.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.898+0000 7fc8e26a6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc8dc153a40 0x7fc8dc06c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:05.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.898+0000 7fc8e26a6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8dc156310 0x7fc8dc1567a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:05.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.898+0000 7fc8e26a6640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8dc159900 con 0x7fc8dc06cbe0 2024-09-12T02:23:05.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.898+0000 7fc8e26a6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fc8dc159be0 con 0x7fc8dc153a40 2024-09-12T02:23:05.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.898+0000 7fc8e26a6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc8dc159ec0 con 0x7fc8dc156310 2024-09-12T02:23:05.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.899+0000 7fc8dbfff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc8dc153a40 0x7fc8dc06c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:05.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.899+0000 7fc8dbfff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc8dc153a40 0x7fc8dc06c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56812/0 (socket says 172.21.15.60:56812) 2024-09-12T02:23:05.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.899+0000 7fc8dbfff640 1 -- 172.21.15.60:0/2717443149 learned_addr learned my addr 172.21.15.60:0/2717443149 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:05.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.899+0000 7fc8e0c43640 1 --2- 172.21.15.60:0/2717443149 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8dc156310 0x7fc8dc1567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:05.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.899+0000 7fc8dbfff640 1 -- 172.21.15.60:0/2717443149 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8dc156310 msgr2=0x7fc8dc1567a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:05.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.899+0000 7fc8dbfff640 1 --2- 172.21.15.60:0/2717443149 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8dc156310 0x7fc8dc1567a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:05.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.899+0000 7fc8dbfff640 1 -- 172.21.15.60:0/2717443149 >> v1:172.21.15.105:6789/0 conn(0x7fc8dc06cbe0 legacy=0x7fc8dc0c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:05.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.899+0000 7fc8dbfff640 1 -- 172.21.15.60:0/2717443149 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8dc15a1a0 con 0x7fc8dc153a40 2024-09-12T02:23:05.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.899+0000 7fc8e0c43640 1 --2- 172.21.15.60:0/2717443149 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8dc156310 0x7fc8dc1567a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:23:05.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.900+0000 7fc8dbfff640 1 --2- 172.21.15.60:0/2717443149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8dc153a40 0x7fc8dc06c6a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc009870 tx=0x7fc8cc02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d32cd560fc391e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:05.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.900+0000 7fc8daffd640 1 -- 172.21.15.60:0/2717443149 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc037070 con 0x7fc8dc153a40 2024-09-12T02:23:05.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.900+0000 7fc8daffd640 1 -- 172.21.15.60:0/2717443149 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8cc032440 con 0x7fc8dc153a40 2024-09-12T02:23:05.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.900+0000 7fc8daffd640 1 -- 172.21.15.60:0/2717443149 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc032810 con 0x7fc8dc153a40 2024-09-12T02:23:05.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.900+0000 7fc8e26a6640 1 -- 172.21.15.60:0/2717443149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8dc153a40 msgr2=0x7fc8dc06c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:05.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.900+0000 7fc8e26a6640 1 --2- 172.21.15.60:0/2717443149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8dc153a40 0x7fc8dc06c6a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc009870 tx=0x7fc8cc02a210 comp rx=0 tx=0).stop 2024-09-12T02:23:05.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.900+0000 7fc8e26a6640 1 -- 172.21.15.60:0/2717443149 shutdown_connections 2024-09-12T02:23:05.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.900+0000 7fc8e26a6640 1 --2- 172.21.15.60:0/2717443149 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8dc156310 0x7fc8dc1567a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:05.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.900+0000 7fc8e26a6640 1 --2- 172.21.15.60:0/2717443149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8dc153a40 0x7fc8dc06c6a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:05.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.900+0000 7fc8e26a6640 1 -- 172.21.15.60:0/2717443149 >> 172.21.15.60:0/2717443149 conn(0x7fc8dc073310 msgr2=0x7fc8dc0736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:05.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.900+0000 7fc8e26a6640 1 -- 172.21.15.60:0/2717443149 shutdown_connections 2024-09-12T02:23:05.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.900+0000 7fc8e26a6640 1 -- 172.21.15.60:0/2717443149 wait complete. 2024-09-12T02:23:05.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.901+0000 7fc8e26a6640 1 Processor -- start 2024-09-12T02:23:05.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.902+0000 7fc8e26a6640 1 -- start start 2024-09-12T02:23:05.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.902+0000 7fc8e26a6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8dc06cbe0 0x7fc8dc14d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:05.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.902+0000 7fc8e26a6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8dc153a40 0x7fc8dc0b07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:05.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.902+0000 7fc8e26a6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8dc156310 0x7fc8dc14f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:05.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.902+0000 7fc8e26a6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc8dc153e20 con 0x7fc8dc156310 2024-09-12T02:23:05.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.902+0000 7fc8e26a6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc8dc0c9270 con 0x7fc8dc06cbe0 2024-09-12T02:23:05.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.902+0000 7fc8e26a6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc8dc153fa0 con 0x7fc8dc153a40 2024-09-12T02:23:05.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.902+0000 7fc8e0c43640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8dc156310 0x7fc8dc14f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:05.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.903+0000 7fc8e0c43640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8dc156310 0x7fc8dc14f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56814/0 (socket says 172.21.15.60:56814) 2024-09-12T02:23:05.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.903+0000 7fc8e0c43640 1 -- 172.21.15.60:0/3989151517 learned_addr learned my addr 172.21.15.60:0/3989151517 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:05.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.903+0000 7fc8db7fe640 1 --2- 172.21.15.60:0/3989151517 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8dc153a40 0x7fc8dc0b07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:05.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.903+0000 7fc8dbfff640 1 --2- 172.21.15.60:0/3989151517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8dc06cbe0 0x7fc8dc14d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:05.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.903+0000 7fc8e0c43640 1 -- 172.21.15.60:0/3989151517 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8dc153a40 msgr2=0x7fc8dc0b07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:05.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.903+0000 7fc8e0c43640 1 --2- 172.21.15.60:0/3989151517 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8dc153a40 0x7fc8dc0b07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:05.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.903+0000 7fc8e0c43640 1 -- 172.21.15.60:0/3989151517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8dc06cbe0 msgr2=0x7fc8dc14d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:05.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.903+0000 7fc8e0c43640 1 --2- 172.21.15.60:0/3989151517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8dc06cbe0 0x7fc8dc14d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:05.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.903+0000 7fc8e0c43640 1 -- 172.21.15.60:0/3989151517 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8dc1ebe50 con 0x7fc8dc156310 2024-09-12T02:23:05.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.903+0000 7fc8dbfff640 1 --2- 172.21.15.60:0/3989151517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8dc06cbe0 0x7fc8dc14d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:23:05.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.903+0000 7fc8e0c43640 1 --2- 172.21.15.60:0/3989151517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8dc156310 0x7fc8dc14f990 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc8d400cd50 tx=0x7fc8d400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:05.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.903+0000 7fc8d8ff9640 1 -- 172.21.15.60:0/3989151517 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8d400f680 con 0x7fc8dc156310 2024-09-12T02:23:05.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.903+0000 7fc8d8ff9640 1 -- 172.21.15.60:0/3989151517 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8d400f840 con 0x7fc8dc156310 2024-09-12T02:23:05.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.903+0000 7fc8e26a6640 1 -- 172.21.15.60:0/3989151517 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8dc14dc90 con 0x7fc8dc156310 2024-09-12T02:23:05.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.903+0000 7fc8d8ff9640 1 -- 172.21.15.60:0/3989151517 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8d400fc30 con 0x7fc8dc156310 2024-09-12T02:23:05.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.903+0000 7fc8e26a6640 1 -- 172.21.15.60:0/3989151517 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8dc1ec3f0 con 0x7fc8dc156310 2024-09-12T02:23:05.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.904+0000 7fc8e26a6640 1 -- 172.21.15.60:0/3989151517 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8dc0b2020 con 0x7fc8dc156310 2024-09-12T02:23:05.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.905+0000 7fc8d8ff9640 1 -- 172.21.15.60:0/3989151517 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc8d400e3e0 con 0x7fc8dc156310 2024-09-12T02:23:05.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.905+0000 7fc8d8ff9640 1 --2- 172.21.15.60:0/3989151517 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc8c806be30 0x7fc8c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:05.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.905+0000 7fc8d8ff9640 1 -- 172.21.15.60:0/3989151517 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5689+0+0 (secure 0 0 0) 0x7fc8d408bb60 con 0x7fc8dc156310 2024-09-12T02:23:05.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.905+0000 7fc8dbfff640 1 --2- 172.21.15.60:0/3989151517 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc8c806be30 0x7fc8c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:05.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.906+0000 7fc8dbfff640 1 --2- 172.21.15.60:0/3989151517 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc8c806be30 0x7fc8c806e2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc034000 tx=0x7fc8cc02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:05.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:05.909+0000 7fc8d8ff9640 1 -- 172.21.15.60:0/3989151517 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc8dc0b2020 con 0x7fc8dc156310 2024-09-12T02:23:06.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.122+0000 7fc8e26a6640 1 -- 172.21.15.60:0/3989151517 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "a", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fc8dc0b11b0 con 0x7fc8dc156310 2024-09-12T02:23:06.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.784+0000 7fc8d8ff9640 1 -- 172.21.15.60:0/3989151517 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "a", "var": "allow_standby_replay", "val": "false"}]=0 v6) ==== 117+0+0 (secure 0 0 0) 0x7fc8d4014030 con 0x7fc8dc156310 2024-09-12T02:23:06.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.787+0000 7fc8e26a6640 1 -- 172.21.15.60:0/3989151517 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc8c806be30 msgr2=0x7fc8c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:06.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.787+0000 7fc8e26a6640 1 --2- 172.21.15.60:0/3989151517 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc8c806be30 0x7fc8c806e2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc034000 tx=0x7fc8cc02e000 comp rx=0 tx=0).stop 2024-09-12T02:23:06.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.787+0000 7fc8e26a6640 1 -- 172.21.15.60:0/3989151517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8dc156310 msgr2=0x7fc8dc14f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:06.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.787+0000 7fc8e26a6640 1 --2- 172.21.15.60:0/3989151517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8dc156310 0x7fc8dc14f990 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc8d400cd50 tx=0x7fc8d400a650 comp rx=0 tx=0).stop 2024-09-12T02:23:06.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.787+0000 7fc8e26a6640 1 -- 172.21.15.60:0/3989151517 shutdown_connections 2024-09-12T02:23:06.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.787+0000 7fc8e26a6640 1 --2- 172.21.15.60:0/3989151517 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc8c806be30 0x7fc8c806e2f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:06.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.787+0000 7fc8e26a6640 1 --2- 172.21.15.60:0/3989151517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8dc156310 0x7fc8dc14f990 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:06.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.787+0000 7fc8e26a6640 1 --2- 172.21.15.60:0/3989151517 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8dc153a40 0x7fc8dc0b07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:06.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.787+0000 7fc8e26a6640 1 --2- 172.21.15.60:0/3989151517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8dc06cbe0 0x7fc8dc14d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:06.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.787+0000 7fc8e26a6640 1 -- 172.21.15.60:0/3989151517 >> 172.21.15.60:0/3989151517 conn(0x7fc8dc073310 msgr2=0x7fc8dc155730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:06.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.788+0000 7fc8e26a6640 1 -- 172.21.15.60:0/3989151517 shutdown_connections 2024-09-12T02:23:06.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.788+0000 7fc8e26a6640 1 -- 172.21.15.60:0/3989151517 wait complete. 2024-09-12T02:23:06.801 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set a session_timeout 300 2024-09-12T02:23:06.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.913+0000 7f0ecade4640 1 Processor -- start 2024-09-12T02:23:06.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.913+0000 7f0ecade4640 1 -- start start 2024-09-12T02:23:06.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.914+0000 7f0ecade4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0ec4159b30 0x7f0ec4159f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:06.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.914+0000 7f0ecade4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ec40c9c60 0x7f0ec414feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:06.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.914+0000 7f0ecade4640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ec406cbc0 con 0x7f0ec41503f0 2024-09-12T02:23:06.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.914+0000 7f0ecade4640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f0ec40c66e0 con 0x7f0ec4159b30 2024-09-12T02:23:06.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.914+0000 7f0ecade4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0ec406cea0 con 0x7f0ec40c9c60 2024-09-12T02:23:06.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.914+0000 7f0ec8b80640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0ec4159b30 0x7f0ec4159f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:06.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.914+0000 7f0ec8b80640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0ec4159b30 0x7f0ec4159f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56830/0 (socket says 172.21.15.60:56830) 2024-09-12T02:23:06.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.914+0000 7f0ec8b80640 1 -- 172.21.15.60:0/2861046069 learned_addr learned my addr 172.21.15.60:0/2861046069 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:06.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.915+0000 7f0ec3fff640 1 --2- 172.21.15.60:0/2861046069 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ec40c9c60 0x7f0ec414feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:06.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.915+0000 7f0ec8b80640 1 -- 172.21.15.60:0/2861046069 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ec40c9c60 msgr2=0x7f0ec414feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:06.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.915+0000 7f0ec8b80640 1 --2- 172.21.15.60:0/2861046069 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ec40c9c60 0x7f0ec414feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:06.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.915+0000 7f0ec8b80640 1 -- 172.21.15.60:0/2861046069 >> v1:172.21.15.105:6789/0 conn(0x7f0ec41503f0 legacy=0x7f0ec4067a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:06.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.915+0000 7f0ec8b80640 1 -- 172.21.15.60:0/2861046069 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ec40c6930 con 0x7f0ec4159b30 2024-09-12T02:23:06.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.915+0000 7f0ec3fff640 1 --2- 172.21.15.60:0/2861046069 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ec40c9c60 0x7f0ec414feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:23:06.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.915+0000 7f0ec8b80640 1 --2- 172.21.15.60:0/2861046069 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ec4159b30 0x7f0ec4159f10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4009870 tx=0x7f0eb402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9751ce7e9a52d2d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:06.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.915+0000 7f0ec37fe640 1 -- 172.21.15.60:0/2861046069 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb4037070 con 0x7f0ec4159b30 2024-09-12T02:23:06.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.915+0000 7f0ec37fe640 1 -- 172.21.15.60:0/2861046069 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0eb402ae10 con 0x7f0ec4159b30 2024-09-12T02:23:06.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.916+0000 7f0ec37fe640 1 -- 172.21.15.60:0/2861046069 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb4032660 con 0x7f0ec4159b30 2024-09-12T02:23:06.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.916+0000 7f0ecade4640 1 -- 172.21.15.60:0/2861046069 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ec4159b30 msgr2=0x7f0ec4159f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:06.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.916+0000 7f0ecade4640 1 --2- 172.21.15.60:0/2861046069 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ec4159b30 0x7f0ec4159f10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4009870 tx=0x7f0eb402a100 comp rx=0 tx=0).stop 2024-09-12T02:23:06.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.916+0000 7f0ecade4640 1 -- 172.21.15.60:0/2861046069 shutdown_connections 2024-09-12T02:23:06.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.916+0000 7f0ecade4640 1 --2- 172.21.15.60:0/2861046069 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ec40c9c60 0x7f0ec414feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:06.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.916+0000 7f0ecade4640 1 --2- 172.21.15.60:0/2861046069 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ec4159b30 0x7f0ec4159f10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:06.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.916+0000 7f0ecade4640 1 -- 172.21.15.60:0/2861046069 >> 172.21.15.60:0/2861046069 conn(0x7f0ec40cbd60 msgr2=0x7f0ec40cc170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:06.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.916+0000 7f0ecade4640 1 -- 172.21.15.60:0/2861046069 shutdown_connections 2024-09-12T02:23:06.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.916+0000 7f0ecade4640 1 -- 172.21.15.60:0/2861046069 wait complete. 2024-09-12T02:23:06.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.917+0000 7f0ecade4640 1 Processor -- start 2024-09-12T02:23:06.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.917+0000 7f0ecade4640 1 -- start start 2024-09-12T02:23:06.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.918+0000 7f0ecade4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ec40c9c60 0x7f0ec4155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:06.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.918+0000 7f0ecade4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ec41503f0 0x7f0ec414b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:06.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.918+0000 7f0ecade4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ec4159b30 0x7f0ec414bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:06.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.918+0000 7f0ecade4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec40cca00 con 0x7f0ec41503f0 2024-09-12T02:23:06.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.918+0000 7f0ecade4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec40cc880 con 0x7f0ec4159b30 2024-09-12T02:23:06.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.918+0000 7f0ecade4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0ec415a450 con 0x7f0ec40c9c60 2024-09-12T02:23:06.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.918+0000 7f0ec3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ec41503f0 0x7f0ec414b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:06.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.918+0000 7f0ec3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ec41503f0 0x7f0ec414b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56838/0 (socket says 172.21.15.60:56838) 2024-09-12T02:23:06.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.918+0000 7f0ec3fff640 1 -- 172.21.15.60:0/4073496532 learned_addr learned my addr 172.21.15.60:0/4073496532 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:06.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.918+0000 7f0ec8b80640 1 --2- 172.21.15.60:0/4073496532 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ec40c9c60 0x7f0ec4155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:06.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.918+0000 7f0ec9381640 1 --2- 172.21.15.60:0/4073496532 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ec4159b30 0x7f0ec414bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:06.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.919+0000 7f0ec3fff640 1 -- 172.21.15.60:0/4073496532 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ec40c9c60 msgr2=0x7f0ec4155ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:06.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.919+0000 7f0ec3fff640 1 --2- 172.21.15.60:0/4073496532 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ec40c9c60 0x7f0ec4155ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:06.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.919+0000 7f0ec3fff640 1 -- 172.21.15.60:0/4073496532 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ec4159b30 msgr2=0x7f0ec414bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:06.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.919+0000 7f0ec3fff640 1 --2- 172.21.15.60:0/4073496532 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ec4159b30 0x7f0ec414bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:06.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.919+0000 7f0ec3fff640 1 -- 172.21.15.60:0/4073496532 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ec4158ca0 con 0x7f0ec41503f0 2024-09-12T02:23:06.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.919+0000 7f0ec3fff640 1 --2- 172.21.15.60:0/4073496532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ec41503f0 0x7f0ec414b720 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0eac00cf80 tx=0x7f0eac00a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:06.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.919+0000 7f0ec17fa640 1 -- 172.21.15.60:0/4073496532 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eac01a070 con 0x7f0ec41503f0 2024-09-12T02:23:06.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.919+0000 7f0ec17fa640 1 -- 172.21.15.60:0/4073496532 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0eac00d840 con 0x7f0ec41503f0 2024-09-12T02:23:06.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.919+0000 7f0ec17fa640 1 -- 172.21.15.60:0/4073496532 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eac00dc30 con 0x7f0ec41503f0 2024-09-12T02:23:06.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.919+0000 7f0ecade4640 1 -- 172.21.15.60:0/4073496532 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ec41ec340 con 0x7f0ec41503f0 2024-09-12T02:23:06.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.919+0000 7f0ecade4640 1 -- 172.21.15.60:0/4073496532 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ec414c910 con 0x7f0ec41503f0 2024-09-12T02:23:06.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.920+0000 7f0ecade4640 1 -- 172.21.15.60:0/4073496532 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ec414feb0 con 0x7f0ec41503f0 2024-09-12T02:23:06.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.920+0000 7f0ec17fa640 1 -- 172.21.15.60:0/4073496532 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0eac01d070 con 0x7f0ec41503f0 2024-09-12T02:23:06.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.921+0000 7f0ec17fa640 1 --2- 172.21.15.60:0/4073496532 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0ea406be30 0x7f0ea406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:06.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.921+0000 7f0ec17fa640 1 -- 172.21.15.60:0/4073496532 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5689+0+0 (secure 0 0 0) 0x7f0eac08b680 con 0x7f0ec41503f0 2024-09-12T02:23:06.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.921+0000 7f0ec8b80640 1 --2- 172.21.15.60:0/4073496532 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0ea406be30 0x7f0ea406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:06.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.921+0000 7f0ec8b80640 1 --2- 172.21.15.60:0/4073496532 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0ea406be30 0x7f0ea406e2f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4034000 tx=0x7f0eb402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:06.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:06.925+0000 7f0ec17fa640 1 -- 172.21.15.60:0/4073496532 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0ec4158ca0 con 0x7f0ec41503f0 2024-09-12T02:23:07.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.139+0000 7f0ecade4640 1 -- 172.21.15.60:0/4073496532 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "a", "var": "session_timeout", "val": "300"} v 0) -- 0x7f0ec40acb30 con 0x7f0ec41503f0 2024-09-12T02:23:07.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.785+0000 7f0ec17fa640 1 -- 172.21.15.60:0/4073496532 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "a", "var": "session_timeout", "val": "300"}]=0 v7) ==== 110+0+0 (secure 0 0 0) 0x7f0eac05a0d0 con 0x7f0ec41503f0 2024-09-12T02:23:07.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.788+0000 7f0ecade4640 1 -- 172.21.15.60:0/4073496532 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0ea406be30 msgr2=0x7f0ea406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:07.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.788+0000 7f0ecade4640 1 --2- 172.21.15.60:0/4073496532 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0ea406be30 0x7f0ea406e2f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4034000 tx=0x7f0eb402e000 comp rx=0 tx=0).stop 2024-09-12T02:23:07.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.788+0000 7f0ecade4640 1 -- 172.21.15.60:0/4073496532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ec41503f0 msgr2=0x7f0ec414b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:07.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.788+0000 7f0ecade4640 1 --2- 172.21.15.60:0/4073496532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ec41503f0 0x7f0ec414b720 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0eac00cf80 tx=0x7f0eac00a7d0 comp rx=0 tx=0).stop 2024-09-12T02:23:07.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.789+0000 7f0ecade4640 1 -- 172.21.15.60:0/4073496532 shutdown_connections 2024-09-12T02:23:07.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.789+0000 7f0ecade4640 1 --2- 172.21.15.60:0/4073496532 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0ea406be30 0x7f0ea406e2f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:07.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.789+0000 7f0ecade4640 1 --2- 172.21.15.60:0/4073496532 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ec4159b30 0x7f0ec414bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:07.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.789+0000 7f0ecade4640 1 --2- 172.21.15.60:0/4073496532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ec41503f0 0x7f0ec414b720 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:07.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.789+0000 7f0ecade4640 1 --2- 172.21.15.60:0/4073496532 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ec40c9c60 0x7f0ec4155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:07.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.789+0000 7f0ecade4640 1 -- 172.21.15.60:0/4073496532 >> 172.21.15.60:0/4073496532 conn(0x7f0ec40cbd60 msgr2=0x7f0ec414e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:07.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.789+0000 7f0ecade4640 1 -- 172.21.15.60:0/4073496532 shutdown_connections 2024-09-12T02:23:07.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.789+0000 7f0ecade4640 1 -- 172.21.15.60:0/4073496532 wait complete. 2024-09-12T02:23:07.802 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'a' 2024-09-12T02:23:07.802 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:23:07.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.911+0000 7fb75a4c9640 1 Processor -- start 2024-09-12T02:23:07.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.911+0000 7fb75a4c9640 1 -- start start 2024-09-12T02:23:07.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.912+0000 7fb75a4c9640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb7540c5830 0x7fb7540702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:07.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.912+0000 7fb75a4c9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb754070800 0x7fb754070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:07.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.912+0000 7fb75a4c9640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7540c4320 con 0x7fb754153d60 2024-09-12T02:23:07.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.912+0000 7fb75a4c9640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fb7540c4c90 con 0x7fb7540c5830 2024-09-12T02:23:07.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.912+0000 7fb75a4c9640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb754156f20 con 0x7fb754070800 2024-09-12T02:23:07.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.912+0000 7fb753fff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb754153d60 0x7fb7540c5120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45108/0 (socket says 172.21.15.60:45108) 2024-09-12T02:23:07.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.912+0000 7fb753fff640 1 -- 172.21.15.60:0/4005740672 learned_addr learned my addr 172.21.15.60:0/4005740672 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:07.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.912+0000 7fb7537fe640 1 --2- 172.21.15.60:0/4005740672 >> v2:172.21.15.105:3300/0 conn(0x7fb7540c5830 0x7fb7540702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:07.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.912+0000 7fb758a66640 1 --2- 172.21.15.60:0/4005740672 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb754070800 0x7fb754070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:07.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.912+0000 7fb752ffd640 1 -- 172.21.15.60:0/4005740672 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1321137478 0 0) 0x7fb744001110 con 0x7fb754153d60 2024-09-12T02:23:07.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.912+0000 7fb752ffd640 1 -- 172.21.15.60:0/4005740672 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb740003520 con 0x7fb754153d60 2024-09-12T02:23:07.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.912+0000 7fb752ffd640 1 -- 172.21.15.60:0/4005740672 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 618408633 0 0) 0x7fb740003520 con 0x7fb754153d60 2024-09-12T02:23:07.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.912+0000 7fb752ffd640 1 -- 172.21.15.60:0/4005740672 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb754070800 msgr2=0x7fb754070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:07.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.912+0000 7fb752ffd640 1 --2- 172.21.15.60:0/4005740672 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb754070800 0x7fb754070c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:07.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.912+0000 7fb752ffd640 1 -- 172.21.15.60:0/4005740672 >> v2:172.21.15.105:3300/0 conn(0x7fb7540c5830 msgr2=0x7fb7540702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:07.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.912+0000 7fb752ffd640 1 --2- 172.21.15.60:0/4005740672 >> v2:172.21.15.105:3300/0 conn(0x7fb7540c5830 0x7fb7540702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:07.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.912+0000 7fb752ffd640 1 -- 172.21.15.60:0/4005740672 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb754157200 con 0x7fb754153d60 2024-09-12T02:23:07.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.912+0000 7fb752ffd640 1 -- 172.21.15.60:0/4005740672 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7fb744001840 con 0x7fb754153d60 2024-09-12T02:23:07.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.912+0000 7fb752ffd640 1 -- 172.21.15.60:0/4005740672 >> v1:172.21.15.60:6789/0 conn(0x7fb754153d60 legacy=0x7fb7540c5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:07.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.912+0000 7fb752ffd640 1 --2- 172.21.15.60:0/4005740672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7400039b0 0x7fb740003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:07.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.912+0000 7fb752ffd640 1 --2- 172.21.15.60:0/4005740672 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb754070800 0x7fb740004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:07.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.912+0000 7fb752ffd640 1 --2- 172.21.15.60:0/4005740672 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb740004d40 0x7fb7400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:07.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.913+0000 7fb752ffd640 1 -- 172.21.15.60:0/4005740672 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb7540c4c90 con 0x7fb7400039b0 2024-09-12T02:23:07.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.913+0000 7fb752ffd640 1 -- 172.21.15.60:0/4005740672 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb754156f20 con 0x7fb740004d40 2024-09-12T02:23:07.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.913+0000 7fb752ffd640 1 -- 172.21.15.60:0/4005740672 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb74000b9c0 con 0x7fb754070800 2024-09-12T02:23:07.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.913+0000 7fb753fff640 1 --2- 172.21.15.60:0/4005740672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7400039b0 0x7fb740003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:07.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.913+0000 7fb7537fe640 1 --2- 172.21.15.60:0/4005740672 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb754070800 0x7fb740004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:07.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.913+0000 7fb758a66640 1 --2- 172.21.15.60:0/4005740672 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb740004d40 0x7fb7400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:07.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.913+0000 7fb753fff640 1 -- 172.21.15.60:0/4005740672 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb754070800 msgr2=0x7fb740004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:07.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.913+0000 7fb753fff640 1 --2- 172.21.15.60:0/4005740672 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb754070800 0x7fb740004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:07.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.913+0000 7fb753fff640 1 -- 172.21.15.60:0/4005740672 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb740004d40 msgr2=0x7fb7400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:07.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.913+0000 7fb753fff640 1 --2- 172.21.15.60:0/4005740672 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb740004d40 0x7fb7400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:07.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.913+0000 7fb753fff640 1 -- 172.21.15.60:0/4005740672 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb740003520 con 0x7fb7400039b0 2024-09-12T02:23:07.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.914+0000 7fb753fff640 1 --2- 172.21.15.60:0/4005740672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7400039b0 0x7fb740003dd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb74400c3e0 tx=0x7fb740005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da8614ff478440ff server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:07.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.914+0000 7fb752ffd640 1 -- 172.21.15.60:0/4005740672 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb74400c0e0 con 0x7fb7400039b0 2024-09-12T02:23:07.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.914+0000 7fb752ffd640 1 -- 172.21.15.60:0/4005740672 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb744034070 con 0x7fb7400039b0 2024-09-12T02:23:07.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.914+0000 7fb752ffd640 1 -- 172.21.15.60:0/4005740672 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb744005d10 con 0x7fb7400039b0 2024-09-12T02:23:07.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.914+0000 7fb75a4c9640 1 -- 172.21.15.60:0/4005740672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7400039b0 msgr2=0x7fb740003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:07.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.914+0000 7fb75a4c9640 1 --2- 172.21.15.60:0/4005740672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7400039b0 0x7fb740003dd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb74400c3e0 tx=0x7fb740005830 comp rx=0 tx=0).stop 2024-09-12T02:23:07.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.914+0000 7fb758a66640 1 -- 172.21.15.60:0/4005740672 reap_dead start 2024-09-12T02:23:07.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.914+0000 7fb75a4c9640 1 -- 172.21.15.60:0/4005740672 shutdown_connections 2024-09-12T02:23:07.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.914+0000 7fb75a4c9640 1 -- 172.21.15.60:0/4005740672 >> 172.21.15.60:0/4005740672 conn(0x7fb7540c6980 msgr2=0x7fb7540c6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:07.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.914+0000 7fb75a4c9640 1 -- 172.21.15.60:0/4005740672 shutdown_connections 2024-09-12T02:23:07.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.914+0000 7fb75a4c9640 1 -- 172.21.15.60:0/4005740672 wait complete. 2024-09-12T02:23:07.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.915+0000 7fb75a4c9640 1 Processor -- start 2024-09-12T02:23:07.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.916+0000 7fb75a4c9640 1 -- start start 2024-09-12T02:23:07.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.916+0000 7fb75a4c9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb7400039b0 0x7fb754155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:07.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.916+0000 7fb75a4c9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7541ece40 0x7fb7541549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:07.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.916+0000 7fb75a4c9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb75414cc50 0x7fb754154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:07.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.916+0000 7fb75a4c9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb754073e20 con 0x7fb75414cc50 2024-09-12T02:23:07.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.916+0000 7fb75a4c9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb754073ca0 con 0x7fb7400039b0 2024-09-12T02:23:07.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.916+0000 7fb75a4c9640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb7540c7690 con 0x7fb7541ece40 2024-09-12T02:23:07.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.916+0000 7fb758a66640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb75414cc50 0x7fb754154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:07.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.916+0000 7fb758a66640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb75414cc50 0x7fb754154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56860/0 (socket says 172.21.15.60:56860) 2024-09-12T02:23:07.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.916+0000 7fb758a66640 1 -- 172.21.15.60:0/1636874502 learned_addr learned my addr 172.21.15.60:0/1636874502 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:07.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.917+0000 7fb758a66640 1 -- 172.21.15.60:0/1636874502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7541ece40 msgr2=0x7fb7541549c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:07.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.917+0000 7fb758a66640 1 --2- 172.21.15.60:0/1636874502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7541ece40 0x7fb7541549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:07.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.917+0000 7fb758a66640 1 -- 172.21.15.60:0/1636874502 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb7400039b0 msgr2=0x7fb754155ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:07.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.917+0000 7fb753fff640 1 --2- 172.21.15.60:0/1636874502 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb7400039b0 0x7fb754155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:07.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.917+0000 7fb758a66640 1 --2- 172.21.15.60:0/1636874502 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb7400039b0 0x7fb754155ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:07.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.917+0000 7fb758a66640 1 -- 172.21.15.60:0/1636874502 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7541ed2e0 con 0x7fb75414cc50 2024-09-12T02:23:07.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.917+0000 7fb758a66640 1 --2- 172.21.15.60:0/1636874502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb75414cc50 0x7fb754154f00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb754071440 tx=0x7fb74c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:07.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.917+0000 7fb750ff9640 1 -- 172.21.15.60:0/1636874502 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb74c00fde0 con 0x7fb75414cc50 2024-09-12T02:23:07.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.917+0000 7fb750ff9640 1 -- 172.21.15.60:0/1636874502 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb74c015430 con 0x7fb75414cc50 2024-09-12T02:23:07.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.917+0000 7fb75a4c9640 1 -- 172.21.15.60:0/1636874502 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7540c8f50 con 0x7fb75414cc50 2024-09-12T02:23:07.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.917+0000 7fb750ff9640 1 -- 172.21.15.60:0/1636874502 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb74c015820 con 0x7fb75414cc50 2024-09-12T02:23:07.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.917+0000 7fb75a4c9640 1 -- 172.21.15.60:0/1636874502 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7540c9510 con 0x7fb75414cc50 2024-09-12T02:23:07.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.918+0000 7fb75a4c9640 1 -- 172.21.15.60:0/1636874502 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb75406ed10 con 0x7fb75414cc50 2024-09-12T02:23:07.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.919+0000 7fb750ff9640 1 -- 172.21.15.60:0/1636874502 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb74c0159c0 con 0x7fb75414cc50 2024-09-12T02:23:07.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.919+0000 7fb750ff9640 1 --2- 172.21.15.60:0/1636874502 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb73406be30 0x7fb73406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:07.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.919+0000 7fb750ff9640 1 -- 172.21.15.60:0/1636874502 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5689+0+0 (secure 0 0 0) 0x7fb74c08bcd0 con 0x7fb75414cc50 2024-09-12T02:23:07.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.919+0000 7fb753fff640 1 --2- 172.21.15.60:0/1636874502 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb73406be30 0x7fb73406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:07.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.920+0000 7fb753fff640 1 --2- 172.21.15.60:0/1636874502 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb73406be30 0x7fb73406e2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb744033000 tx=0x7fb744009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:07.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:07.924+0000 7fb750ff9640 1 -- 172.21.15.60:0/1636874502 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb74c019030 con 0x7fb75414cc50 2024-09-12T02:23:08.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.135+0000 7fb75a4c9640 1 -- 172.21.15.60:0/1636874502 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb7540c6370 con 0x7fb75414cc50 2024-09-12T02:23:08.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.136+0000 7fb750ff9640 1 -- 172.21.15.60:0/1636874502 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5213 (secure 0 0 0) 0x7fb74c010040 con 0x7fb75414cc50 2024-09-12T02:23:08.136 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:23:08.137 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":7,"btime":"2024-09-12T02:23:07:785714+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3208837169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3208837169},{"type":"v1","addr":"172.21.15.60:6836","nonce":3208837169}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/664538827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":664538827},{"type":"v1","addr":"172.21.15.60:6837","nonce":664538827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/248466084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":248466084},{"type":"v1","addr":"172.21.15.105:6834","nonce":248466084}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:23:04.113913+0000","modified":"2024-09-12T02:23:07.140885+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/2854563525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2854563525},{"type":"v1","addr":"172.21.15.105:6835","nonce":2854563525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-09-12T02:23:08.137 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 7 2024-09-12T02:23:08.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.138+0000 7fb75a4c9640 1 -- 172.21.15.60:0/1636874502 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb73406be30 msgr2=0x7fb73406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:08.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.138+0000 7fb75a4c9640 1 --2- 172.21.15.60:0/1636874502 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb73406be30 0x7fb73406e2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb744033000 tx=0x7fb744009030 comp rx=0 tx=0).stop 2024-09-12T02:23:08.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.138+0000 7fb75a4c9640 1 -- 172.21.15.60:0/1636874502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb75414cc50 msgr2=0x7fb754154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:08.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.138+0000 7fb75a4c9640 1 --2- 172.21.15.60:0/1636874502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb75414cc50 0x7fb754154f00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb754071440 tx=0x7fb74c00f580 comp rx=0 tx=0).stop 2024-09-12T02:23:08.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.138+0000 7fb75a4c9640 1 -- 172.21.15.60:0/1636874502 shutdown_connections 2024-09-12T02:23:08.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.138+0000 7fb75a4c9640 1 --2- 172.21.15.60:0/1636874502 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb73406be30 0x7fb73406e2f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:08.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.138+0000 7fb75a4c9640 1 --2- 172.21.15.60:0/1636874502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb75414cc50 0x7fb754154f00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:08.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.138+0000 7fb75a4c9640 1 --2- 172.21.15.60:0/1636874502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7541ece40 0x7fb7541549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:08.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.138+0000 7fb75a4c9640 1 --2- 172.21.15.60:0/1636874502 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb7400039b0 0x7fb754155ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:08.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.138+0000 7fb75a4c9640 1 -- 172.21.15.60:0/1636874502 >> 172.21.15.60:0/1636874502 conn(0x7fb7540c6980 msgr2=0x7fb754152d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:08.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.138+0000 7fb75a4c9640 1 -- 172.21.15.60:0/1636874502 shutdown_connections 2024-09-12T02:23:08.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.138+0000 7fb75a4c9640 1 -- 172.21.15.60:0/1636874502 wait complete. 2024-09-12T02:23:08.149 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:23:08.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.250+0000 7f2c92f42640 1 Processor -- start 2024-09-12T02:23:08.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.251+0000 7f2c92f42640 1 -- start start 2024-09-12T02:23:08.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.251+0000 7f2c92f42640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2c8c0c4680 0x7f2c8c156a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:08.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.251+0000 7f2c92f42640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2c8c156fc0 0x7f2c8c157410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:08.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.251+0000 7f2c92f42640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c8c070590 con 0x7f2c8c0acc30 2024-09-12T02:23:08.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.251+0000 7f2c92f42640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f2c8c0c4ea0 con 0x7f2c8c0c4680 2024-09-12T02:23:08.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.251+0000 7f2c92f42640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f2c8c0a8220 con 0x7f2c8c156fc0 2024-09-12T02:23:08.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.251+0000 7f2c8bfff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2c8c0c4680 0x7f2c8c156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:08.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.252+0000 7f2c90cde640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f2c8c0acc30 0x7f2c8c0c3f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45114/0 (socket says 172.21.15.60:45114) 2024-09-12T02:23:08.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.252+0000 7f2c90cde640 1 -- 172.21.15.60:0/1984498624 learned_addr learned my addr 172.21.15.60:0/1984498624 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:08.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.252+0000 7f2c914df640 1 --2- 172.21.15.60:0/1984498624 >> v2:172.21.15.105:3300/0 conn(0x7f2c8c156fc0 0x7f2c8c157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:08.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.252+0000 7f2c8bfff640 1 -- 172.21.15.60:0/1984498624 >> v2:172.21.15.105:3300/0 conn(0x7f2c8c156fc0 msgr2=0x7f2c8c157410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:08.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.252+0000 7f2c8bfff640 1 --2- 172.21.15.60:0/1984498624 >> v2:172.21.15.105:3300/0 conn(0x7f2c8c156fc0 0x7f2c8c157410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:08.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.252+0000 7f2c8bfff640 1 -- 172.21.15.60:0/1984498624 >> v1:172.21.15.60:6789/0 conn(0x7f2c8c0acc30 legacy=0x7f2c8c0c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:08.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.252+0000 7f2c8bfff640 1 -- 172.21.15.60:0/1984498624 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c8c0a84f0 con 0x7f2c8c0c4680 2024-09-12T02:23:08.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.252+0000 7f2c8b7fe640 1 -- 172.21.15.60:0/1984498624 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 690395106 0 0) 0x7f2c8c070590 con 0x7f2c8c0acc30 2024-09-12T02:23:08.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.252+0000 7f2c914df640 1 --2- 172.21.15.60:0/1984498624 >> v2:172.21.15.105:3300/0 conn(0x7f2c8c156fc0 0x7f2c8c157410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:23:08.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.253+0000 7f2c8bfff640 1 --2- 172.21.15.60:0/1984498624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c8c0c4680 0x7f2c8c156a80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c0c6340 tx=0x7f2c7802a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db7a2268f0ed1ef8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:08.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.253+0000 7f2c8b7fe640 1 -- 172.21.15.60:0/1984498624 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c78037070 con 0x7f2c8c0c4680 2024-09-12T02:23:08.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.253+0000 7f2c8b7fe640 1 -- 172.21.15.60:0/1984498624 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c7802add0 con 0x7f2c8c0c4680 2024-09-12T02:23:08.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.253+0000 7f2c8b7fe640 1 -- 172.21.15.60:0/1984498624 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c78032660 con 0x7f2c8c0c4680 2024-09-12T02:23:08.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.253+0000 7f2c92f42640 1 -- 172.21.15.60:0/1984498624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c8c0c4680 msgr2=0x7f2c8c156a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:08.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.253+0000 7f2c92f42640 1 --2- 172.21.15.60:0/1984498624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c8c0c4680 0x7f2c8c156a80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c0c6340 tx=0x7f2c7802a080 comp rx=0 tx=0).stop 2024-09-12T02:23:08.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.253+0000 7f2c92f42640 1 -- 172.21.15.60:0/1984498624 shutdown_connections 2024-09-12T02:23:08.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.253+0000 7f2c92f42640 1 --2- 172.21.15.60:0/1984498624 >> v2:172.21.15.105:3300/0 conn(0x7f2c8c156fc0 0x7f2c8c157410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:08.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.253+0000 7f2c92f42640 1 --2- 172.21.15.60:0/1984498624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c8c0c4680 0x7f2c8c156a80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:08.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.253+0000 7f2c92f42640 1 -- 172.21.15.60:0/1984498624 >> 172.21.15.60:0/1984498624 conn(0x7f2c8c0c5660 msgr2=0x7f2c8c0c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:08.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.253+0000 7f2c92f42640 1 -- 172.21.15.60:0/1984498624 shutdown_connections 2024-09-12T02:23:08.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.253+0000 7f2c92f42640 1 -- 172.21.15.60:0/1984498624 wait complete. 2024-09-12T02:23:08.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.254+0000 7f2c92f42640 1 Processor -- start 2024-09-12T02:23:08.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.254+0000 7f2c92f42640 1 -- start start 2024-09-12T02:23:08.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.255+0000 7f2c92f42640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c8c0acc30 0x7f2c8c06be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:08.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.255+0000 7f2c92f42640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c8c0c4680 0x7f2c8c09ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:08.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.255+0000 7f2c92f42640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c8c156fc0 0x7f2c8c09ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:08.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.255+0000 7f2c92f42640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8c0c5330 con 0x7f2c8c156fc0 2024-09-12T02:23:08.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.255+0000 7f2c92f42640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8c0702b0 con 0x7f2c8c0c4680 2024-09-12T02:23:08.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.255+0000 7f2c92f42640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2c8c0c63f0 con 0x7f2c8c0acc30 2024-09-12T02:23:08.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.255+0000 7f2c914df640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c8c156fc0 0x7f2c8c09ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:08.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.255+0000 7f2c914df640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c8c156fc0 0x7f2c8c09ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56880/0 (socket says 172.21.15.60:56880) 2024-09-12T02:23:08.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.255+0000 7f2c914df640 1 -- 172.21.15.60:0/4067082448 learned_addr learned my addr 172.21.15.60:0/4067082448 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:08.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.256+0000 7f2c8bfff640 1 --2- 172.21.15.60:0/4067082448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c8c0c4680 0x7f2c8c09ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:08.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.256+0000 7f2c90cde640 1 --2- 172.21.15.60:0/4067082448 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c8c0acc30 0x7f2c8c06be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:08.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.256+0000 7f2c914df640 1 -- 172.21.15.60:0/4067082448 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c8c0acc30 msgr2=0x7f2c8c06be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:08.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.256+0000 7f2c914df640 1 --2- 172.21.15.60:0/4067082448 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c8c0acc30 0x7f2c8c06be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:08.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.256+0000 7f2c914df640 1 -- 172.21.15.60:0/4067082448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c8c0c4680 msgr2=0x7f2c8c09ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:08.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.256+0000 7f2c914df640 1 --2- 172.21.15.60:0/4067082448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c8c0c4680 0x7f2c8c09ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:08.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.256+0000 7f2c914df640 1 -- 172.21.15.60:0/4067082448 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c8c1e9820 con 0x7f2c8c156fc0 2024-09-12T02:23:08.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.256+0000 7f2c8bfff640 1 --2- 172.21.15.60:0/4067082448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c8c0c4680 0x7f2c8c09ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:23:08.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.256+0000 7f2c914df640 1 --2- 172.21.15.60:0/4067082448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c8c156fc0 0x7f2c8c09ca00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2c84009fa0 tx=0x7f2c8400d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:08.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.256+0000 7f2c897fa640 1 -- 172.21.15.60:0/4067082448 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c8401a070 con 0x7f2c8c156fc0 2024-09-12T02:23:08.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.256+0000 7f2c897fa640 1 -- 172.21.15.60:0/4067082448 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c84003bb0 con 0x7f2c8c156fc0 2024-09-12T02:23:08.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.256+0000 7f2c92f42640 1 -- 172.21.15.60:0/4067082448 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c8c1e9b00 con 0x7f2c8c156fc0 2024-09-12T02:23:08.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.256+0000 7f2c897fa640 1 -- 172.21.15.60:0/4067082448 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c84004030 con 0x7f2c8c156fc0 2024-09-12T02:23:08.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.256+0000 7f2c92f42640 1 -- 172.21.15.60:0/4067082448 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c8c1ea0c0 con 0x7f2c8c156fc0 2024-09-12T02:23:08.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.257+0000 7f2c92f42640 1 -- 172.21.15.60:0/4067082448 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c8c06c3f0 con 0x7f2c8c156fc0 2024-09-12T02:23:08.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.257+0000 7f2c897fa640 1 -- 172.21.15.60:0/4067082448 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2c8401d070 con 0x7f2c8c156fc0 2024-09-12T02:23:08.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.258+0000 7f2c897fa640 1 --2- 172.21.15.60:0/4067082448 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2c7006be30 0x7f2c7006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:08.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.258+0000 7f2c90cde640 1 --2- 172.21.15.60:0/4067082448 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2c7006be30 0x7f2c7006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:08.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.258+0000 7f2c897fa640 1 -- 172.21.15.60:0/4067082448 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5689+0+0 (secure 0 0 0) 0x7f2c8408b110 con 0x7f2c8c156fc0 2024-09-12T02:23:08.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.258+0000 7f2c90cde640 1 --2- 172.21.15.60:0/4067082448 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2c7006be30 0x7f2c7006e2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2c80000f60 tx=0x7f2c80007c00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:08.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.262+0000 7f2c897fa640 1 -- 172.21.15.60:0/4067082448 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2c84010070 con 0x7f2c8c156fc0 2024-09-12T02:23:08.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.437+0000 7f2c92f42640 1 -- 172.21.15.60:0/4067082448 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2c8c0abc10 con 0x7f2c8c156fc0 2024-09-12T02:23:08.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.438+0000 7f2c897fa640 1 -- 172.21.15.60:0/4067082448 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16633 (secure 0 0 0) 0x7f2c84059b60 con 0x7f2c8c156fc0 2024-09-12T02:23:08.438 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:23:08.439 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":22,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","created":"2024-09-12T02:22:39.869862+0000","modified":"2024-09-12T02:23:05.772435+0000","last_up_change":"2024-09-12T02:22:53.459371+0000","last_in_change":"2024-09-12T02:22:42.817076+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:22:52.130579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-09-12T02:23:01.854763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-09-12T02:23:03.104847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0f0c7386-002f-47e2-a7a3-6c8a70264cc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6819","nonce":1789465659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6821","nonce":1789465659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6825","nonce":1789465659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6823","nonce":1789465659}]},"public_addr":"172.21.15.60:6819/1789465659","cluster_addr":"172.21.15.60:6821/1789465659","heartbeat_back_addr":"172.21.15.60:6825/1789465659","heartbeat_front_addr":"172.21.15.60:6823/1789465659","state":["exists","up"]},{"osd":1,"uuid":"64be7b84-36fc-43c0-9e70-a617e5b68941","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6811","nonce":1109822408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6813","nonce":1109822408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6817","nonce":1109822408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6815","nonce":1109822408}]},"public_addr":"172.21.15.60:6811/1109822408","cluster_addr":"172.21.15.60:6813/1109822408","heartbeat_back_addr":"172.21.15.60:6817/1109822408","heartbeat_front_addr":"172.21.15.60:6815/1109822408","state":["exists","up"]},{"osd":2,"uuid":"df00caa1-d45e-4b87-ac1e-8bc098d509d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6827","nonce":278470077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6829","nonce":278470077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6833","nonce":278470077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6831","nonce":278470077}]},"public_addr":"172.21.15.60:6827/278470077","cluster_addr":"172.21.15.60:6829/278470077","heartbeat_back_addr":"172.21.15.60:6833/278470077","heartbeat_front_addr":"172.21.15.60:6831/278470077","state":["exists","up"]},{"osd":3,"uuid":"f6453471-893a-490b-b0c7-f196a0f574e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6803","nonce":3606424156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6805","nonce":3606424156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6809","nonce":3606424156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6807","nonce":3606424156}]},"public_addr":"172.21.15.60:6803/3606424156","cluster_addr":"172.21.15.60:6805/3606424156","heartbeat_back_addr":"172.21.15.60:6809/3606424156","heartbeat_front_addr":"172.21.15.60:6807/3606424156","state":["exists","up"]},{"osd":4,"uuid":"96e908b6-ce3e-466c-b02d-08fc71a1dba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6809","nonce":1581641129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6811","nonce":1581641129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6815","nonce":1581641129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6813","nonce":1581641129}]},"public_addr":"172.21.15.105:6809/1581641129","cluster_addr":"172.21.15.105:6811/1581641129","heartbeat_back_addr":"172.21.15.105:6815/1581641129","heartbeat_front_addr":"172.21.15.105:6813/1581641129","state":["exists","up"]},{"osd":5,"uuid":"7ebc26f0-a462-4364-9303-7351f7cba21f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6825","nonce":1392337793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6827","nonce":1392337793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6831","nonce":1392337793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6829","nonce":1392337793}]},"public_addr":"172.21.15.105:6825/1392337793","cluster_addr":"172.21.15.105:6827/1392337793","heartbeat_back_addr":"172.21.15.105:6831/1392337793","heartbeat_front_addr":"172.21.15.105:6829/1392337793","state":["exists","up"]},{"osd":6,"uuid":"49487ea1-9c6d-4090-bbcc-f28b33040eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6801","nonce":50951309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6803","nonce":50951309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6807","nonce":50951309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6805","nonce":50951309}]},"public_addr":"172.21.15.105:6801/50951309","cluster_addr":"172.21.15.105:6803/50951309","heartbeat_back_addr":"172.21.15.105:6807/50951309","heartbeat_front_addr":"172.21.15.105:6805/50951309","state":["exists","up"]},{"osd":7,"uuid":"1e3a0aa9-7e29-4785-8506-6b5d3be2be35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6817","nonce":3745331251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6819","nonce":3745331251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6823","nonce":3745331251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6821","nonce":3745331251}]},"public_addr":"172.21.15.105:6817/3745331251","cluster_addr":"172.21.15.105:6819/3745331251","heartbeat_back_addr":"172.21.15.105:6823/3745331251","heartbeat_front_addr":"172.21.15.105:6821/3745331251","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:50.112629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.307689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.542851+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.334773+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:50.096967+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:50.259633+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.888988+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.917421+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:23:08.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.440+0000 7f2c92f42640 1 -- 172.21.15.60:0/4067082448 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2c7006be30 msgr2=0x7f2c7006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:08.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.440+0000 7f2c92f42640 1 --2- 172.21.15.60:0/4067082448 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2c7006be30 0x7f2c7006e2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2c80000f60 tx=0x7f2c80007c00 comp rx=0 tx=0).stop 2024-09-12T02:23:08.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.440+0000 7f2c92f42640 1 -- 172.21.15.60:0/4067082448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c8c156fc0 msgr2=0x7f2c8c09ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:08.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.440+0000 7f2c92f42640 1 --2- 172.21.15.60:0/4067082448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c8c156fc0 0x7f2c8c09ca00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2c84009fa0 tx=0x7f2c8400d560 comp rx=0 tx=0).stop 2024-09-12T02:23:08.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.440+0000 7f2c92f42640 1 -- 172.21.15.60:0/4067082448 shutdown_connections 2024-09-12T02:23:08.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.440+0000 7f2c92f42640 1 --2- 172.21.15.60:0/4067082448 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2c7006be30 0x7f2c7006e2f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:08.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.440+0000 7f2c92f42640 1 --2- 172.21.15.60:0/4067082448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c8c156fc0 0x7f2c8c09ca00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:08.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.440+0000 7f2c92f42640 1 --2- 172.21.15.60:0/4067082448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c8c0c4680 0x7f2c8c09ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:08.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.440+0000 7f2c92f42640 1 --2- 172.21.15.60:0/4067082448 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c8c0acc30 0x7f2c8c06be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:08.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.440+0000 7f2c92f42640 1 -- 172.21.15.60:0/4067082448 >> 172.21.15.60:0/4067082448 conn(0x7f2c8c0c5660 msgr2=0x7f2c8c072300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:08.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.440+0000 7f2c92f42640 1 -- 172.21.15.60:0/4067082448 shutdown_connections 2024-09-12T02:23:08.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.440+0000 7f2c92f42640 1 -- 172.21.15.60:0/4067082448 wait complete. 2024-09-12T02:23:08.451 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T02:23:08.452 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:23:08.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.554+0000 7fcb4f749640 1 Processor -- start 2024-09-12T02:23:08.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.554+0000 7fcb4f749640 1 -- start start 2024-09-12T02:23:08.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.555+0000 7fcb4f749640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fcb48150480 0x7fcb480c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:08.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.555+0000 7fcb4f749640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcb4806c650 0x7fcb480c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:08.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.555+0000 7fcb4f749640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcb480c9c80 0x7fcb480ca130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:08.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.555+0000 7fcb4f749640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fcb4806c240 con 0x7fcb480c9c80 2024-09-12T02:23:08.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.555+0000 7fcb4f749640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fcb4815a330 con 0x7fcb48150480 2024-09-12T02:23:08.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.555+0000 7fcb4f749640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcb4815a7c0 con 0x7fcb4806c650 2024-09-12T02:23:08.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.555+0000 7fcb4dce6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcb480c9c80 0x7fcb480ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:08.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.555+0000 7fcb4dce6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcb480c9c80 0x7fcb480ca130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56890/0 (socket says 172.21.15.60:56890) 2024-09-12T02:23:08.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.555+0000 7fcb4dce6640 1 -- 172.21.15.60:0/922361765 learned_addr learned my addr 172.21.15.60:0/922361765 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:08.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.555+0000 7fcb4d4e5640 1 --2- 172.21.15.60:0/922361765 >> v2:172.21.15.105:3300/0 conn(0x7fcb48150480 0x7fcb480c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:08.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.555+0000 7fcb4cce4640 1 --2- 172.21.15.60:0/922361765 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcb4806c650 0x7fcb480c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:08.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.555+0000 7fcb4dce6640 1 -- 172.21.15.60:0/922361765 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcb4806c650 msgr2=0x7fcb480c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:08.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.555+0000 7fcb4dce6640 1 --2- 172.21.15.60:0/922361765 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcb4806c650 0x7fcb480c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:08.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.555+0000 7fcb4dce6640 1 -- 172.21.15.60:0/922361765 >> v2:172.21.15.105:3300/0 conn(0x7fcb48150480 msgr2=0x7fcb480c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:08.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.555+0000 7fcb4dce6640 1 --2- 172.21.15.60:0/922361765 >> v2:172.21.15.105:3300/0 conn(0x7fcb48150480 0x7fcb480c7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:08.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.555+0000 7fcb4dce6640 1 -- 172.21.15.60:0/922361765 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb48159a00 con 0x7fcb480c9c80 2024-09-12T02:23:08.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.555+0000 7fcb4d4e5640 1 --2- 172.21.15.60:0/922361765 >> v2:172.21.15.105:3300/0 conn(0x7fcb48150480 0x7fcb480c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:23:08.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.555+0000 7fcb4cce4640 1 --2- 172.21.15.60:0/922361765 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcb4806c650 0x7fcb480c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:23:08.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.556+0000 7fcb4dce6640 1 --2- 172.21.15.60:0/922361765 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb480c9c80 0x7fcb480ca130 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcb480ccac0 tx=0x7fcb4002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e32a74e0e418658b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:08.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.556+0000 7fcb3ffff640 1 -- 172.21.15.60:0/922361765 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb40036070 con 0x7fcb480c9c80 2024-09-12T02:23:08.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.556+0000 7fcb3ffff640 1 -- 172.21.15.60:0/922361765 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb40031600 con 0x7fcb480c9c80 2024-09-12T02:23:08.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.556+0000 7fcb3ffff640 1 -- 172.21.15.60:0/922361765 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb400319d0 con 0x7fcb480c9c80 2024-09-12T02:23:08.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.556+0000 7fcb4f749640 1 -- 172.21.15.60:0/922361765 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb480c9c80 msgr2=0x7fcb480ca130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:08.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.556+0000 7fcb4f749640 1 --2- 172.21.15.60:0/922361765 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb480c9c80 0x7fcb480ca130 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcb480ccac0 tx=0x7fcb4002a6a0 comp rx=0 tx=0).stop 2024-09-12T02:23:08.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.557+0000 7fcb4f749640 1 -- 172.21.15.60:0/922361765 shutdown_connections 2024-09-12T02:23:08.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.557+0000 7fcb4f749640 1 --2- 172.21.15.60:0/922361765 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb480c9c80 0x7fcb480ca130 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:08.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.557+0000 7fcb4f749640 1 --2- 172.21.15.60:0/922361765 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcb4806c650 0x7fcb480c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:08.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.557+0000 7fcb4f749640 1 --2- 172.21.15.60:0/922361765 >> v2:172.21.15.105:3300/0 conn(0x7fcb48150480 0x7fcb480c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:08.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.557+0000 7fcb4f749640 1 -- 172.21.15.60:0/922361765 >> 172.21.15.60:0/922361765 conn(0x7fcb48068030 msgr2=0x7fcb48073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:08.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.557+0000 7fcb4f749640 1 -- 172.21.15.60:0/922361765 shutdown_connections 2024-09-12T02:23:08.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.557+0000 7fcb4f749640 1 -- 172.21.15.60:0/922361765 wait complete. 2024-09-12T02:23:08.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.558+0000 7fcb4f749640 1 Processor -- start 2024-09-12T02:23:08.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.558+0000 7fcb4f749640 1 -- start start 2024-09-12T02:23:08.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.558+0000 7fcb4f749640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb4806c650 0x7fcb48157430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:08.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.558+0000 7fcb4f749640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcb480c9c80 0x7fcb481ef340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:08.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.558+0000 7fcb4f749640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcb48150480 0x7fcb48148dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:08.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.558+0000 7fcb4f749640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcb480ca670 con 0x7fcb4806c650 2024-09-12T02:23:08.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.558+0000 7fcb4f749640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcb48159fc0 con 0x7fcb480c9c80 2024-09-12T02:23:08.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.558+0000 7fcb4f749640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcb4806d270 con 0x7fcb48150480 2024-09-12T02:23:08.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.558+0000 7fcb4d4e5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb4806c650 0x7fcb48157430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:08.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.558+0000 7fcb4d4e5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb4806c650 0x7fcb48157430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56896/0 (socket says 172.21.15.60:56896) 2024-09-12T02:23:08.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.558+0000 7fcb4d4e5640 1 -- 172.21.15.60:0/3962489401 learned_addr learned my addr 172.21.15.60:0/3962489401 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:08.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.559+0000 7fcb4d4e5640 1 -- 172.21.15.60:0/3962489401 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcb48150480 msgr2=0x7fcb48148dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:08.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.559+0000 7fcb4d4e5640 1 --2- 172.21.15.60:0/3962489401 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcb48150480 0x7fcb48148dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:08.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.559+0000 7fcb4d4e5640 1 -- 172.21.15.60:0/3962489401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcb480c9c80 msgr2=0x7fcb481ef340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:08.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.559+0000 7fcb4d4e5640 1 --2- 172.21.15.60:0/3962489401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcb480c9c80 0x7fcb481ef340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:08.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.559+0000 7fcb4d4e5640 1 -- 172.21.15.60:0/3962489401 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb481efc80 con 0x7fcb4806c650 2024-09-12T02:23:08.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.559+0000 7fcb4d4e5640 1 --2- 172.21.15.60:0/3962489401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb4806c650 0x7fcb48157430 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400c820 tx=0x7fcb4400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:08.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.559+0000 7fcb3dffb640 1 -- 172.21.15.60:0/3962489401 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb44015070 con 0x7fcb4806c650 2024-09-12T02:23:08.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.559+0000 7fcb3dffb640 1 -- 172.21.15.60:0/3962489401 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb44007a30 con 0x7fcb4806c650 2024-09-12T02:23:08.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.559+0000 7fcb4f749640 1 -- 172.21.15.60:0/3962489401 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb481eec40 con 0x7fcb4806c650 2024-09-12T02:23:08.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.559+0000 7fcb3dffb640 1 -- 172.21.15.60:0/3962489401 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb44007e00 con 0x7fcb4806c650 2024-09-12T02:23:08.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.559+0000 7fcb4f749640 1 -- 172.21.15.60:0/3962489401 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb481ef880 con 0x7fcb4806c650 2024-09-12T02:23:08.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.560+0000 7fcb4f749640 1 -- 172.21.15.60:0/3962489401 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb48156270 con 0x7fcb4806c650 2024-09-12T02:23:08.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.561+0000 7fcb3dffb640 1 -- 172.21.15.60:0/3962489401 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcb44018070 con 0x7fcb4806c650 2024-09-12T02:23:08.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.561+0000 7fcb3dffb640 1 --2- 172.21.15.60:0/3962489401 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcb2c06be30 0x7fcb2c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:08.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.561+0000 7fcb3dffb640 1 -- 172.21.15.60:0/3962489401 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5689+0+0 (secure 0 0 0) 0x7fcb4408adb0 con 0x7fcb4806c650 2024-09-12T02:23:08.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.561+0000 7fcb4cce4640 1 --2- 172.21.15.60:0/3962489401 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcb2c06be30 0x7fcb2c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:08.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.561+0000 7fcb4cce4640 1 --2- 172.21.15.60:0/3962489401 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcb2c06be30 0x7fcb2c06e2f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcb38006b10 tx=0x7fcb38008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:08.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.565+0000 7fcb3dffb640 1 -- 172.21.15.60:0/3962489401 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcb44059800 con 0x7fcb4806c650 2024-09-12T02:23:08.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.739+0000 7fcb4f749640 1 -- 172.21.15.60:0/3962489401 --> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcb4806c430 con 0x7fcb2c06be30 2024-09-12T02:23:08.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.745+0000 7fcb3dffb640 1 -- 172.21.15.60:0/3962489401 <== mgr.4098 v2:172.21.15.60:6800/3549430091 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246230 (secure 0 0 0) 0x7fcb4806c430 con 0x7fcb2c06be30 2024-09-12T02:23:08.749 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:23:08.750 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T02:23:08.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.748+0000 7fcb4f749640 1 -- 172.21.15.60:0/3962489401 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcb2c06be30 msgr2=0x7fcb2c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:08.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.748+0000 7fcb4f749640 1 --2- 172.21.15.60:0/3962489401 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcb2c06be30 0x7fcb2c06e2f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcb38006b10 tx=0x7fcb38008040 comp rx=0 tx=0).stop 2024-09-12T02:23:08.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.748+0000 7fcb4f749640 1 -- 172.21.15.60:0/3962489401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb4806c650 msgr2=0x7fcb48157430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:08.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.748+0000 7fcb4f749640 1 --2- 172.21.15.60:0/3962489401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb4806c650 0x7fcb48157430 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400c820 tx=0x7fcb4400cc20 comp rx=0 tx=0).stop 2024-09-12T02:23:08.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.748+0000 7fcb4f749640 1 -- 172.21.15.60:0/3962489401 shutdown_connections 2024-09-12T02:23:08.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.748+0000 7fcb4f749640 1 --2- 172.21.15.60:0/3962489401 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcb2c06be30 0x7fcb2c06e2f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:08.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.748+0000 7fcb4f749640 1 --2- 172.21.15.60:0/3962489401 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcb48150480 0x7fcb48148dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:08.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.748+0000 7fcb4f749640 1 --2- 172.21.15.60:0/3962489401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcb480c9c80 0x7fcb481ef340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:08.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.748+0000 7fcb4f749640 1 --2- 172.21.15.60:0/3962489401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb4806c650 0x7fcb48157430 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:08.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.748+0000 7fcb4f749640 1 -- 172.21.15.60:0/3962489401 >> 172.21.15.60:0/3962489401 conn(0x7fcb48068030 msgr2=0x7fcb480cbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:08.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.748+0000 7fcb4f749640 1 -- 172.21.15.60:0/3962489401 shutdown_connections 2024-09-12T02:23:08.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.748+0000 7fcb4f749640 1 -- 172.21.15.60:0/3962489401 wait complete. 2024-09-12T02:23:08.759 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-12T02:23:08.087492+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590528,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":165,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":124,"ondisk_log_size":124,"up":160,"acting":160,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":46,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":248020,"kb_used_data":2660,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754726700,"statfs":{"total":773094113280,"available":772840140800,"internally_reserved":0,"allocated":2723840,"data_stored":1676162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.343279"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.754084+0000","last_change":"2024-09-12T02:23:03.754084+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.754084+0000","last_undegraded":"2024-09-12T02:23:03.754084+0000","last_fullsized":"2024-09-12T02:23:03.754084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775715+0000","last_change":"2024-09-12T02:23:04.785821+0000","last_active":"2024-09-12T02:23:05.775715+0000","last_peered":"2024-09-12T02:23:05.775715+0000","last_clean":"2024-09-12T02:23:05.775715+0000","last_became_active":"2024-09-12T02:23:04.785516+0000","last_became_peered":"2024-09-12T02:23:04.785516+0000","last_unstale":"2024-09-12T02:23:05.775715+0000","last_undegraded":"2024-09-12T02:23:05.775715+0000","last_fullsized":"2024-09-12T02:23:05.775715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:42.400040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.757489+0000","last_change":"2024-09-12T02:23:03.757489+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.757489+0000","last_undegraded":"2024-09-12T02:23:03.757489+0000","last_fullsized":"2024-09-12T02:23:03.757489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.752762+0000","last_change":"2024-09-12T02:23:03.752762+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.752762+0000","last_undegraded":"2024-09-12T02:23:03.752762+0000","last_fullsized":"2024-09-12T02:23:03.752762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.757048+0000","last_change":"2024-09-12T02:23:03.757048+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.757048+0000","last_undegraded":"2024-09-12T02:23:03.757048+0000","last_fullsized":"2024-09-12T02:23:03.757048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.752859+0000","last_change":"2024-09-12T02:23:03.752859+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.752859+0000","last_undegraded":"2024-09-12T02:23:03.752859+0000","last_fullsized":"2024-09-12T02:23:03.752859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.971553+0000","last_change":"2024-09-12T02:23:04.779648+0000","last_active":"2024-09-12T02:23:06.971553+0000","last_peered":"2024-09-12T02:23:06.971553+0000","last_clean":"2024-09-12T02:23:06.971553+0000","last_became_active":"2024-09-12T02:23:04.779384+0000","last_became_peered":"2024-09-12T02:23:04.779384+0000","last_unstale":"2024-09-12T02:23:06.971553+0000","last_undegraded":"2024-09-12T02:23:06.971553+0000","last_fullsized":"2024-09-12T02:23:06.971553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:41.491471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.753523+0000","last_change":"2024-09-12T02:23:03.753523+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.753523+0000","last_undegraded":"2024-09-12T02:23:03.753523+0000","last_fullsized":"2024-09-12T02:23:03.753523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.764540+0000","last_change":"2024-09-12T02:23:03.764540+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.764540+0000","last_undegraded":"2024-09-12T02:23:03.764540+0000","last_fullsized":"2024-09-12T02:23:03.764540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.762349+0000","last_change":"2024-09-12T02:23:03.762349+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.762349+0000","last_undegraded":"2024-09-12T02:23:03.762349+0000","last_fullsized":"2024-09-12T02:23:03.762349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.971880+0000","last_change":"2024-09-12T02:23:04.782128+0000","last_active":"2024-09-12T02:23:06.971880+0000","last_peered":"2024-09-12T02:23:06.971880+0000","last_clean":"2024-09-12T02:23:06.971880+0000","last_became_active":"2024-09-12T02:23:04.781101+0000","last_became_peered":"2024-09-12T02:23:04.781101+0000","last_unstale":"2024-09-12T02:23:06.971880+0000","last_undegraded":"2024-09-12T02:23:06.971880+0000","last_fullsized":"2024-09-12T02:23:06.971880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:49.421147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775453+0000","last_change":"2024-09-12T02:23:04.782490+0000","last_active":"2024-09-12T02:23:05.775453+0000","last_peered":"2024-09-12T02:23:05.775453+0000","last_clean":"2024-09-12T02:23:05.775453+0000","last_became_active":"2024-09-12T02:23:04.782183+0000","last_became_peered":"2024-09-12T02:23:04.782183+0000","last_unstale":"2024-09-12T02:23:05.775453+0000","last_undegraded":"2024-09-12T02:23:05.775453+0000","last_fullsized":"2024-09-12T02:23:05.775453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:28.699880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.756668+0000","last_change":"2024-09-12T02:23:03.756668+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.756668+0000","last_undegraded":"2024-09-12T02:23:03.756668+0000","last_fullsized":"2024-09-12T02:23:03.756668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.755180+0000","last_change":"2024-09-12T02:23:03.755180+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.755180+0000","last_undegraded":"2024-09-12T02:23:03.755180+0000","last_fullsized":"2024-09-12T02:23:03.755180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.754603+0000","last_change":"2024-09-12T02:23:03.754603+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.754603+0000","last_undegraded":"2024-09-12T02:23:03.754603+0000","last_fullsized":"2024-09-12T02:23:03.754603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.760816+0000","last_change":"2024-09-12T02:23:03.760816+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.760816+0000","last_undegraded":"2024-09-12T02:23:03.760816+0000","last_fullsized":"2024-09-12T02:23:03.760816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.756587+0000","last_change":"2024-09-12T02:23:03.756587+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.756587+0000","last_undegraded":"2024-09-12T02:23:03.756587+0000","last_fullsized":"2024-09-12T02:23:03.756587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.971740+0000","last_change":"2024-09-12T02:23:04.788624+0000","last_active":"2024-09-12T02:23:06.971740+0000","last_peered":"2024-09-12T02:23:06.971740+0000","last_clean":"2024-09-12T02:23:06.971740+0000","last_became_active":"2024-09-12T02:23:04.788352+0000","last_became_peered":"2024-09-12T02:23:04.788352+0000","last_unstale":"2024-09-12T02:23:06.971740+0000","last_undegraded":"2024-09-12T02:23:06.971740+0000","last_fullsized":"2024-09-12T02:23:06.971740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:13.961110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.756225+0000","last_change":"2024-09-12T02:23:03.756225+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.756225+0000","last_undegraded":"2024-09-12T02:23:03.756225+0000","last_fullsized":"2024-09-12T02:23:03.756225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.972167+0000","last_change":"2024-09-12T02:23:04.787899+0000","last_active":"2024-09-12T02:23:06.972167+0000","last_peered":"2024-09-12T02:23:06.972167+0000","last_clean":"2024-09-12T02:23:06.972167+0000","last_became_active":"2024-09-12T02:23:04.787619+0000","last_became_peered":"2024-09-12T02:23:04.787619+0000","last_unstale":"2024-09-12T02:23:06.972167+0000","last_undegraded":"2024-09-12T02:23:06.972167+0000","last_fullsized":"2024-09-12T02:23:06.972167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:57.732453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.759049+0000","last_change":"2024-09-12T02:23:03.759049+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.759049+0000","last_undegraded":"2024-09-12T02:23:03.759049+0000","last_fullsized":"2024-09-12T02:23:03.759049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775630+0000","last_change":"2024-09-12T02:23:04.776435+0000","last_active":"2024-09-12T02:23:05.775630+0000","last_peered":"2024-09-12T02:23:05.775630+0000","last_clean":"2024-09-12T02:23:05.775630+0000","last_became_active":"2024-09-12T02:23:04.776120+0000","last_became_peered":"2024-09-12T02:23:04.776120+0000","last_unstale":"2024-09-12T02:23:05.775630+0000","last_undegraded":"2024-09-12T02:23:05.775630+0000","last_fullsized":"2024-09-12T02:23:05.775630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:27.985094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.972092+0000","last_change":"2024-09-12T02:23:04.789372+0000","last_active":"2024-09-12T02:23:06.972092+0000","last_peered":"2024-09-12T02:23:06.972092+0000","last_clean":"2024-09-12T02:23:06.972092+0000","last_became_active":"2024-09-12T02:23:04.789090+0000","last_became_peered":"2024-09-12T02:23:04.789090+0000","last_unstale":"2024-09-12T02:23:06.972092+0000","last_undegraded":"2024-09-12T02:23:06.972092+0000","last_fullsized":"2024-09-12T02:23:06.972092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:49.533491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.756132+0000","last_change":"2024-09-12T02:23:03.756132+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.756132+0000","last_undegraded":"2024-09-12T02:23:03.756132+0000","last_fullsized":"2024-09-12T02:23:03.756132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.764086+0000","last_change":"2024-09-12T02:23:03.764086+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.764086+0000","last_undegraded":"2024-09-12T02:23:03.764086+0000","last_fullsized":"2024-09-12T02:23:03.764086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.972043+0000","last_change":"2024-09-12T02:23:03.764310+0000","last_active":"2024-09-12T02:23:06.972043+0000","last_peered":"2024-09-12T02:23:06.972043+0000","last_clean":"2024-09-12T02:23:06.972043+0000","last_became_active":"2024-09-12T02:23:03.764020+0000","last_became_peered":"2024-09-12T02:23:03.764020+0000","last_unstale":"2024-09-12T02:23:06.972043+0000","last_undegraded":"2024-09-12T02:23:06.972043+0000","last_fullsized":"2024-09-12T02:23:06.972043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:25.892874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.770609+0000","last_change":"2024-09-12T02:23:03.768186+0000","last_active":"2024-09-12T02:23:03.770609+0000","last_peered":"2024-09-12T02:23:03.770609+0000","last_clean":"2024-09-12T02:23:03.770609+0000","last_became_active":"2024-09-12T02:23:03.767916+0000","last_became_peered":"2024-09-12T02:23:03.767916+0000","last_unstale":"2024-09-12T02:23:03.770609+0000","last_undegraded":"2024-09-12T02:23:03.770609+0000","last_fullsized":"2024-09-12T02:23:03.770609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:12.165660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.971673+0000","last_change":"2024-09-12T02:23:03.768361+0000","last_active":"2024-09-12T02:23:06.971673+0000","last_peered":"2024-09-12T02:23:06.971673+0000","last_clean":"2024-09-12T02:23:06.971673+0000","last_became_active":"2024-09-12T02:23:03.768137+0000","last_became_peered":"2024-09-12T02:23:03.768137+0000","last_unstale":"2024-09-12T02:23:06.971673+0000","last_undegraded":"2024-09-12T02:23:06.971673+0000","last_fullsized":"2024-09-12T02:23:06.971673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:29.721363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.971707+0000","last_change":"2024-09-12T02:23:04.783317+0000","last_active":"2024-09-12T02:23:06.971707+0000","last_peered":"2024-09-12T02:23:06.971707+0000","last_clean":"2024-09-12T02:23:06.971707+0000","last_became_active":"2024-09-12T02:23:04.783039+0000","last_became_peered":"2024-09-12T02:23:04.783039+0000","last_unstale":"2024-09-12T02:23:06.971707+0000","last_undegraded":"2024-09-12T02:23:06.971707+0000","last_fullsized":"2024-09-12T02:23:06.971707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:17.577991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.767515+0000","last_change":"2024-09-12T02:23:03.762450+0000","last_active":"2024-09-12T02:23:03.767515+0000","last_peered":"2024-09-12T02:23:03.767515+0000","last_clean":"2024-09-12T02:23:03.767515+0000","last_became_active":"2024-09-12T02:23:03.762161+0000","last_became_peered":"2024-09-12T02:23:03.762161+0000","last_unstale":"2024-09-12T02:23:03.767515+0000","last_undegraded":"2024-09-12T02:23:03.767515+0000","last_fullsized":"2024-09-12T02:23:03.767515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:20.943756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775427+0000","last_change":"2024-09-12T02:23:04.776572+0000","last_active":"2024-09-12T02:23:05.775427+0000","last_peered":"2024-09-12T02:23:05.775427+0000","last_clean":"2024-09-12T02:23:05.775427+0000","last_became_active":"2024-09-12T02:23:04.776270+0000","last_became_peered":"2024-09-12T02:23:04.776270+0000","last_unstale":"2024-09-12T02:23:05.775427+0000","last_undegraded":"2024-09-12T02:23:05.775427+0000","last_fullsized":"2024-09-12T02:23:05.775427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:12.807907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.771948+0000","last_change":"2024-09-12T02:23:03.770668+0000","last_active":"2024-09-12T02:23:03.771948+0000","last_peered":"2024-09-12T02:23:03.771948+0000","last_clean":"2024-09-12T02:23:03.771948+0000","last_became_active":"2024-09-12T02:23:03.769302+0000","last_became_peered":"2024-09-12T02:23:03.769302+0000","last_unstale":"2024-09-12T02:23:03.771948+0000","last_undegraded":"2024-09-12T02:23:03.771948+0000","last_fullsized":"2024-09-12T02:23:03.771948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:58.341188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.757235+0000","last_change":"2024-09-12T02:23:03.757235+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.757235+0000","last_undegraded":"2024-09-12T02:23:03.757235+0000","last_fullsized":"2024-09-12T02:23:03.757235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.774780+0000","last_change":"2024-09-12T02:23:03.769710+0000","last_active":"2024-09-12T02:23:03.774780+0000","last_peered":"2024-09-12T02:23:03.774780+0000","last_clean":"2024-09-12T02:23:03.774780+0000","last_became_active":"2024-09-12T02:23:03.769436+0000","last_became_peered":"2024-09-12T02:23:03.769436+0000","last_unstale":"2024-09-12T02:23:03.774780+0000","last_undegraded":"2024-09-12T02:23:03.774780+0000","last_fullsized":"2024-09-12T02:23:03.774780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:05.383995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775627+0000","last_change":"2024-09-12T02:23:03.771271+0000","last_active":"2024-09-12T02:23:05.775627+0000","last_peered":"2024-09-12T02:23:05.775627+0000","last_clean":"2024-09-12T02:23:05.775627+0000","last_became_active":"2024-09-12T02:23:03.769601+0000","last_became_peered":"2024-09-12T02:23:03.769601+0000","last_unstale":"2024-09-12T02:23:05.775627+0000","last_undegraded":"2024-09-12T02:23:05.775627+0000","last_fullsized":"2024-09-12T02:23:05.775627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:22.910072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.770888+0000","last_change":"2024-09-12T02:23:03.768425+0000","last_active":"2024-09-12T02:23:03.770888+0000","last_peered":"2024-09-12T02:23:03.770888+0000","last_clean":"2024-09-12T02:23:03.770888+0000","last_became_active":"2024-09-12T02:23:03.768092+0000","last_became_peered":"2024-09-12T02:23:03.768092+0000","last_unstale":"2024-09-12T02:23:03.770888+0000","last_undegraded":"2024-09-12T02:23:03.770888+0000","last_fullsized":"2024-09-12T02:23:03.770888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:57.887914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.755898+0000","last_change":"2024-09-12T02:23:03.755898+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.755898+0000","last_undegraded":"2024-09-12T02:23:03.755898+0000","last_fullsized":"2024-09-12T02:23:03.755898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:23:02.750891+0000","last_change":"2024-09-12T02:23:02.750891+0000","last_active":"2024-09-12T02:23:02.739281+0000","last_peered":"2024-09-12T02:23:02.739281+0000","last_clean":"2024-09-12T02:23:02.739281+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:02.750891+0000","last_undegraded":"2024-09-12T02:23:02.750891+0000","last_fullsized":"2024-09-12T02:23:02.750891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.769019+0000","last_change":"2024-09-12T02:23:03.767217+0000","last_active":"2024-09-12T02:23:03.769019+0000","last_peered":"2024-09-12T02:23:03.769019+0000","last_clean":"2024-09-12T02:23:03.769019+0000","last_became_active":"2024-09-12T02:23:03.766551+0000","last_became_peered":"2024-09-12T02:23:03.766551+0000","last_unstale":"2024-09-12T02:23:03.769019+0000","last_undegraded":"2024-09-12T02:23:03.769019+0000","last_fullsized":"2024-09-12T02:23:03.769019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:30.824294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.752149+0000","last_change":"2024-09-12T02:23:03.752149+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.752149+0000","last_undegraded":"2024-09-12T02:23:03.752149+0000","last_fullsized":"2024-09-12T02:23:03.752149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.769127+0000","last_change":"2024-09-12T02:23:03.767842+0000","last_active":"2024-09-12T02:23:03.769127+0000","last_peered":"2024-09-12T02:23:03.769127+0000","last_clean":"2024-09-12T02:23:03.769127+0000","last_became_active":"2024-09-12T02:23:03.767066+0000","last_became_peered":"2024-09-12T02:23:03.767066+0000","last_unstale":"2024-09-12T02:23:03.769127+0000","last_undegraded":"2024-09-12T02:23:03.769127+0000","last_fullsized":"2024-09-12T02:23:03.769127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:03.108197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.759935+0000","last_change":"2024-09-12T02:23:03.759935+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.759935+0000","last_undegraded":"2024-09-12T02:23:03.759935+0000","last_fullsized":"2024-09-12T02:23:03.759935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:23:02.748375+0000","last_change":"2024-09-12T02:23:02.748375+0000","last_active":"2024-09-12T02:23:02.739281+0000","last_peered":"2024-09-12T02:23:02.739281+0000","last_clean":"2024-09-12T02:23:02.739281+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:02.748375+0000","last_undegraded":"2024-09-12T02:23:02.748375+0000","last_fullsized":"2024-09-12T02:23:02.748375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.752312+0000","last_change":"2024-09-12T02:23:03.752312+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.752312+0000","last_undegraded":"2024-09-12T02:23:03.752312+0000","last_fullsized":"2024-09-12T02:23:03.752312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:23:02.746308+0000","last_change":"2024-09-12T02:23:02.746308+0000","last_active":"2024-09-12T02:23:02.739281+0000","last_peered":"2024-09-12T02:23:02.739281+0000","last_clean":"2024-09-12T02:23:02.739281+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:02.746308+0000","last_undegraded":"2024-09-12T02:23:02.746308+0000","last_fullsized":"2024-09-12T02:23:02.746308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.753058+0000","last_change":"2024-09-12T02:23:03.753058+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.753058+0000","last_undegraded":"2024-09-12T02:23:03.753058+0000","last_fullsized":"2024-09-12T02:23:03.753058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:23:02.749018+0000","last_change":"2024-09-12T02:23:02.749018+0000","last_active":"2024-09-12T02:23:02.739281+0000","last_peered":"2024-09-12T02:23:02.739281+0000","last_clean":"2024-09-12T02:23:02.739281+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:02.749018+0000","last_undegraded":"2024-09-12T02:23:02.749018+0000","last_fullsized":"2024-09-12T02:23:02.749018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.753029+0000","last_change":"2024-09-12T02:23:03.753029+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.753029+0000","last_undegraded":"2024-09-12T02:23:03.753029+0000","last_fullsized":"2024-09-12T02:23:03.753029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775732+0000","last_change":"2024-09-12T02:23:03.766034+0000","last_active":"2024-09-12T02:23:05.775732+0000","last_peered":"2024-09-12T02:23:05.775732+0000","last_clean":"2024-09-12T02:23:05.775732+0000","last_became_active":"2024-09-12T02:23:03.765735+0000","last_became_peered":"2024-09-12T02:23:03.765735+0000","last_unstale":"2024-09-12T02:23:05.775732+0000","last_undegraded":"2024-09-12T02:23:05.775732+0000","last_fullsized":"2024-09-12T02:23:05.775732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:19.691229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.755917+0000","last_change":"2024-09-12T02:23:03.755917+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.755917+0000","last_undegraded":"2024-09-12T02:23:03.755917+0000","last_fullsized":"2024-09-12T02:23:03.755917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:23:02.748818+0000","last_change":"2024-09-12T02:23:02.748818+0000","last_active":"2024-09-12T02:23:02.739281+0000","last_peered":"2024-09-12T02:23:02.739281+0000","last_clean":"2024-09-12T02:23:02.739281+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:02.748818+0000","last_undegraded":"2024-09-12T02:23:02.748818+0000","last_fullsized":"2024-09-12T02:23:02.748818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.755050+0000","last_change":"2024-09-12T02:23:03.755050+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.755050+0000","last_undegraded":"2024-09-12T02:23:03.755050+0000","last_fullsized":"2024-09-12T02:23:03.755050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":166,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.757667+0000","last_change":"2024-09-12T02:22:55.143869+0000","last_active":"2024-09-12T02:23:03.757667+0000","last_peered":"2024-09-12T02:23:03.757667+0000","last_clean":"2024-09-12T02:23:03.757667+0000","last_became_active":"2024-09-12T02:22:55.142784+0000","last_became_peered":"2024-09-12T02:22:55.142784+0000","last_unstale":"2024-09-12T02:23:03.757667+0000","last_undegraded":"2024-09-12T02:23:03.757667+0000","last_fullsized":"2024-09-12T02:23:03.757667+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:22:52.457979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:22:52.457979+0000","last_clean_scrub_stamp":"2024-09-12T02:22:52.457979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:46.152602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.768867+0000","last_change":"2024-09-12T02:23:03.765100+0000","last_active":"2024-09-12T02:23:03.768867+0000","last_peered":"2024-09-12T02:23:03.768867+0000","last_clean":"2024-09-12T02:23:03.768867+0000","last_became_active":"2024-09-12T02:23:03.764801+0000","last_became_peered":"2024-09-12T02:23:03.764801+0000","last_unstale":"2024-09-12T02:23:03.768867+0000","last_undegraded":"2024-09-12T02:23:03.768867+0000","last_fullsized":"2024-09-12T02:23:03.768867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:29.776974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.971912+0000","last_change":"2024-09-12T02:23:04.781839+0000","last_active":"2024-09-12T02:23:06.971912+0000","last_peered":"2024-09-12T02:23:06.971912+0000","last_clean":"2024-09-12T02:23:06.971912+0000","last_became_active":"2024-09-12T02:23:04.780984+0000","last_became_peered":"2024-09-12T02:23:04.780984+0000","last_unstale":"2024-09-12T02:23:06.971912+0000","last_undegraded":"2024-09-12T02:23:06.971912+0000","last_fullsized":"2024-09-12T02:23:06.971912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:07.692791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.775844+0000","last_change":"2024-09-12T02:23:03.771625+0000","last_active":"2024-09-12T02:23:03.775844+0000","last_peered":"2024-09-12T02:23:03.775844+0000","last_clean":"2024-09-12T02:23:03.775844+0000","last_became_active":"2024-09-12T02:23:03.771163+0000","last_became_peered":"2024-09-12T02:23:03.771163+0000","last_unstale":"2024-09-12T02:23:03.775844+0000","last_undegraded":"2024-09-12T02:23:03.775844+0000","last_fullsized":"2024-09-12T02:23:03.775844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:40.982318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:23:02.748347+0000","last_change":"2024-09-12T02:23:02.748347+0000","last_active":"2024-09-12T02:23:02.739281+0000","last_peered":"2024-09-12T02:23:02.739281+0000","last_clean":"2024-09-12T02:23:02.739281+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:02.748347+0000","last_undegraded":"2024-09-12T02:23:02.748347+0000","last_fullsized":"2024-09-12T02:23:02.748347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775441+0000","last_change":"2024-09-12T02:23:04.773745+0000","last_active":"2024-09-12T02:23:05.775441+0000","last_peered":"2024-09-12T02:23:05.775441+0000","last_clean":"2024-09-12T02:23:05.775441+0000","last_became_active":"2024-09-12T02:23:04.773360+0000","last_became_peered":"2024-09-12T02:23:04.773360+0000","last_unstale":"2024-09-12T02:23:05.775441+0000","last_undegraded":"2024-09-12T02:23:05.775441+0000","last_fullsized":"2024-09-12T02:23:05.775441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:33.097774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.775764+0000","last_change":"2024-09-12T02:23:03.771518+0000","last_active":"2024-09-12T02:23:03.775764+0000","last_peered":"2024-09-12T02:23:03.775764+0000","last_clean":"2024-09-12T02:23:03.775764+0000","last_became_active":"2024-09-12T02:23:03.771063+0000","last_became_peered":"2024-09-12T02:23:03.771063+0000","last_unstale":"2024-09-12T02:23:03.775764+0000","last_undegraded":"2024-09-12T02:23:03.775764+0000","last_fullsized":"2024-09-12T02:23:03.775764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:01.694099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775663+0000","last_change":"2024-09-12T02:23:03.769913+0000","last_active":"2024-09-12T02:23:05.775663+0000","last_peered":"2024-09-12T02:23:05.775663+0000","last_clean":"2024-09-12T02:23:05.775663+0000","last_became_active":"2024-09-12T02:23:03.769444+0000","last_became_peered":"2024-09-12T02:23:03.769444+0000","last_unstale":"2024-09-12T02:23:05.775663+0000","last_undegraded":"2024-09-12T02:23:05.775663+0000","last_fullsized":"2024-09-12T02:23:05.775663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:21.243182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.754756+0000","last_change":"2024-09-12T02:23:03.754756+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.754756+0000","last_undegraded":"2024-09-12T02:23:03.754756+0000","last_fullsized":"2024-09-12T02:23:03.754756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.767766+0000","last_change":"2024-09-12T02:23:03.764093+0000","last_active":"2024-09-12T02:23:03.767766+0000","last_peered":"2024-09-12T02:23:03.767766+0000","last_clean":"2024-09-12T02:23:03.767766+0000","last_became_active":"2024-09-12T02:23:03.763147+0000","last_became_peered":"2024-09-12T02:23:03.763147+0000","last_unstale":"2024-09-12T02:23:03.767766+0000","last_undegraded":"2024-09-12T02:23:03.767766+0000","last_fullsized":"2024-09-12T02:23:03.767766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:59.022658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775631+0000","last_change":"2024-09-12T02:23:04.775876+0000","last_active":"2024-09-12T02:23:05.775631+0000","last_peered":"2024-09-12T02:23:05.775631+0000","last_clean":"2024-09-12T02:23:05.775631+0000","last_became_active":"2024-09-12T02:23:04.775571+0000","last_became_peered":"2024-09-12T02:23:04.775571+0000","last_unstale":"2024-09-12T02:23:05.775631+0000","last_undegraded":"2024-09-12T02:23:05.775631+0000","last_fullsized":"2024-09-12T02:23:05.775631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:05.070528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.772082+0000","last_change":"2024-09-12T02:23:03.769745+0000","last_active":"2024-09-12T02:23:06.772082+0000","last_peered":"2024-09-12T02:23:06.772082+0000","last_clean":"2024-09-12T02:23:06.772082+0000","last_became_active":"2024-09-12T02:23:03.769410+0000","last_became_peered":"2024-09-12T02:23:03.769410+0000","last_unstale":"2024-09-12T02:23:06.772082+0000","last_undegraded":"2024-09-12T02:23:06.772082+0000","last_fullsized":"2024-09-12T02:23:06.772082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:00.414459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.972214+0000","last_change":"2024-09-12T02:23:04.786424+0000","last_active":"2024-09-12T02:23:06.972214+0000","last_peered":"2024-09-12T02:23:06.972214+0000","last_clean":"2024-09-12T02:23:06.972214+0000","last_became_active":"2024-09-12T02:23:04.786136+0000","last_became_peered":"2024-09-12T02:23:04.786136+0000","last_unstale":"2024-09-12T02:23:06.972214+0000","last_undegraded":"2024-09-12T02:23:06.972214+0000","last_fullsized":"2024-09-12T02:23:06.972214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:31.214894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.774760+0000","last_change":"2024-09-12T02:23:03.771259+0000","last_active":"2024-09-12T02:23:03.774760+0000","last_peered":"2024-09-12T02:23:03.774760+0000","last_clean":"2024-09-12T02:23:03.774760+0000","last_became_active":"2024-09-12T02:23:03.770687+0000","last_became_peered":"2024-09-12T02:23:03.770687+0000","last_unstale":"2024-09-12T02:23:03.774760+0000","last_undegraded":"2024-09-12T02:23:03.774760+0000","last_fullsized":"2024-09-12T02:23:03.774760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:40.804626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.768159+0000","last_change":"2024-09-12T02:23:03.764530+0000","last_active":"2024-09-12T02:23:03.768159+0000","last_peered":"2024-09-12T02:23:03.768159+0000","last_clean":"2024-09-12T02:23:03.768159+0000","last_became_active":"2024-09-12T02:23:03.764218+0000","last_became_peered":"2024-09-12T02:23:03.764218+0000","last_unstale":"2024-09-12T02:23:03.768159+0000","last_undegraded":"2024-09-12T02:23:03.768159+0000","last_fullsized":"2024-09-12T02:23:03.768159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:30:36.651697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775580+0000","last_change":"2024-09-12T02:23:03.770581+0000","last_active":"2024-09-12T02:23:05.775580+0000","last_peered":"2024-09-12T02:23:05.775580+0000","last_clean":"2024-09-12T02:23:05.775580+0000","last_became_active":"2024-09-12T02:23:03.769406+0000","last_became_peered":"2024-09-12T02:23:03.769406+0000","last_unstale":"2024-09-12T02:23:05.775580+0000","last_undegraded":"2024-09-12T02:23:05.775580+0000","last_fullsized":"2024-09-12T02:23:05.775580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:20.963819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.971722+0000","last_change":"2024-09-12T02:23:04.783991+0000","last_active":"2024-09-12T02:23:06.971722+0000","last_peered":"2024-09-12T02:23:06.971722+0000","last_clean":"2024-09-12T02:23:06.971722+0000","last_became_active":"2024-09-12T02:23:04.783143+0000","last_became_peered":"2024-09-12T02:23:04.783143+0000","last_unstale":"2024-09-12T02:23:06.971722+0000","last_undegraded":"2024-09-12T02:23:06.971722+0000","last_fullsized":"2024-09-12T02:23:06.971722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:53.940843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775526+0000","last_change":"2024-09-12T02:23:03.771468+0000","last_active":"2024-09-12T02:23:05.775526+0000","last_peered":"2024-09-12T02:23:05.775526+0000","last_clean":"2024-09-12T02:23:05.775526+0000","last_became_active":"2024-09-12T02:23:03.769619+0000","last_became_peered":"2024-09-12T02:23:03.769619+0000","last_unstale":"2024-09-12T02:23:05.775526+0000","last_undegraded":"2024-09-12T02:23:05.775526+0000","last_fullsized":"2024-09-12T02:23:05.775526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:38.422369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.971928+0000","last_change":"2024-09-12T02:23:04.782769+0000","last_active":"2024-09-12T02:23:06.971928+0000","last_peered":"2024-09-12T02:23:06.971928+0000","last_clean":"2024-09-12T02:23:06.971928+0000","last_became_active":"2024-09-12T02:23:04.782472+0000","last_became_peered":"2024-09-12T02:23:04.782472+0000","last_unstale":"2024-09-12T02:23:06.971928+0000","last_undegraded":"2024-09-12T02:23:06.971928+0000","last_fullsized":"2024-09-12T02:23:06.971928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:46.144471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.767373+0000","last_change":"2024-09-12T02:23:03.763423+0000","last_active":"2024-09-12T02:23:03.767373+0000","last_peered":"2024-09-12T02:23:03.767373+0000","last_clean":"2024-09-12T02:23:03.767373+0000","last_became_active":"2024-09-12T02:23:03.762627+0000","last_became_peered":"2024-09-12T02:23:03.762627+0000","last_unstale":"2024-09-12T02:23:03.767373+0000","last_undegraded":"2024-09-12T02:23:03.767373+0000","last_fullsized":"2024-09-12T02:23:03.767373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:57.229819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.763456+0000","last_change":"2024-09-12T02:23:03.763456+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.763456+0000","last_undegraded":"2024-09-12T02:23:03.763456+0000","last_fullsized":"2024-09-12T02:23:03.763456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.755355+0000","last_change":"2024-09-12T02:23:03.755355+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.755355+0000","last_undegraded":"2024-09-12T02:23:03.755355+0000","last_fullsized":"2024-09-12T02:23:03.755355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.767401+0000","last_change":"2024-09-12T02:23:03.763480+0000","last_active":"2024-09-12T02:23:03.767401+0000","last_peered":"2024-09-12T02:23:03.767401+0000","last_clean":"2024-09-12T02:23:03.767401+0000","last_became_active":"2024-09-12T02:23:03.762464+0000","last_became_peered":"2024-09-12T02:23:03.762464+0000","last_unstale":"2024-09-12T02:23:03.767401+0000","last_undegraded":"2024-09-12T02:23:03.767401+0000","last_fullsized":"2024-09-12T02:23:03.767401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:41.711677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.756378+0000","last_change":"2024-09-12T02:23:03.756378+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.756378+0000","last_undegraded":"2024-09-12T02:23:03.756378+0000","last_fullsized":"2024-09-12T02:23:03.756378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.770326+0000","last_change":"2024-09-12T02:23:03.767875+0000","last_active":"2024-09-12T02:23:03.770326+0000","last_peered":"2024-09-12T02:23:03.770326+0000","last_clean":"2024-09-12T02:23:03.770326+0000","last_became_active":"2024-09-12T02:23:03.767596+0000","last_became_peered":"2024-09-12T02:23:03.767596+0000","last_unstale":"2024-09-12T02:23:03.770326+0000","last_undegraded":"2024-09-12T02:23:03.770326+0000","last_fullsized":"2024-09-12T02:23:03.770326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:49.553353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.972111+0000","last_change":"2024-09-12T02:23:03.767076+0000","last_active":"2024-09-12T02:23:06.972111+0000","last_peered":"2024-09-12T02:23:06.972111+0000","last_clean":"2024-09-12T02:23:06.972111+0000","last_became_active":"2024-09-12T02:23:03.766686+0000","last_became_peered":"2024-09-12T02:23:03.766686+0000","last_unstale":"2024-09-12T02:23:06.972111+0000","last_undegraded":"2024-09-12T02:23:06.972111+0000","last_fullsized":"2024-09-12T02:23:06.972111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:45.706208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.972148+0000","last_change":"2024-09-12T02:23:04.790549+0000","last_active":"2024-09-12T02:23:06.972148+0000","last_peered":"2024-09-12T02:23:06.972148+0000","last_clean":"2024-09-12T02:23:06.972148+0000","last_became_active":"2024-09-12T02:23:04.790187+0000","last_became_peered":"2024-09-12T02:23:04.790187+0000","last_unstale":"2024-09-12T02:23:06.972148+0000","last_undegraded":"2024-09-12T02:23:06.972148+0000","last_fullsized":"2024-09-12T02:23:06.972148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:49.656395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:23:02.749985+0000","last_change":"2024-09-12T02:23:02.749985+0000","last_active":"2024-09-12T02:23:02.739281+0000","last_peered":"2024-09-12T02:23:02.739281+0000","last_clean":"2024-09-12T02:23:02.739281+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:02.749985+0000","last_undegraded":"2024-09-12T02:23:02.749985+0000","last_fullsized":"2024-09-12T02:23:02.749985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":94,"acting":94,"num_store_stats":5},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476741,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":774144,"data_stored":647200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476741,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":192512,"data_stored":63092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476742,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":192512,"data_stored":63092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":180224,"data_stored":56832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509443,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31360,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340480,"statfs":{"total":96636764160,"available":96604651520,"internally_reserved":0,"allocated":167936,"data_stored":51025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36104,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335736,"statfs":{"total":96636764160,"available":96599793664,"internally_reserved":0,"allocated":774144,"data_stored":647200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35568,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336272,"statfs":{"total":96636764160,"available":96600342528,"internally_reserved":0,"allocated":217088,"data_stored":71449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35568,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336272,"statfs":{"total":96636764160,"available":96600342528,"internally_reserved":0,"allocated":225280,"data_stored":76272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:23:08.764 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:23:08.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.902+0000 7fe2ec0d9640 1 Processor -- start 2024-09-12T02:23:08.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.902+0000 7fe2ec0d9640 1 -- start start 2024-09-12T02:23:08.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.903+0000 7fe2ec0d9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2e4150480 0x7fe2e40c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:08.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.903+0000 7fe2ec0d9640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe2e406c650 0x7fe2e40c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:08.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.903+0000 7fe2ec0d9640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2e415a7c0 con 0x7fe2e40c9c80 2024-09-12T02:23:08.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.903+0000 7fe2ec0d9640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fe2e406c240 con 0x7fe2e406c650 2024-09-12T02:23:08.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.903+0000 7fe2ec0d9640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe2e415a330 con 0x7fe2e4150480 2024-09-12T02:23:08.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.903+0000 7fe2ea676640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe2e40c9c80 0x7fe2e40ca130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45120/0 (socket says 172.21.15.60:45120) 2024-09-12T02:23:08.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.903+0000 7fe2ea676640 1 -- 172.21.15.60:0/3603022664 learned_addr learned my addr 172.21.15.60:0/3603022664 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:08.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.903+0000 7fe2e8e73640 1 -- 172.21.15.60:0/3603022664 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2240306293 0 0) 0x7fe2e415a7c0 con 0x7fe2e40c9c80 2024-09-12T02:23:08.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.903+0000 7fe2e9674640 1 --2- 172.21.15.60:0/3603022664 >> v2:172.21.15.105:3300/0 conn(0x7fe2e406c650 0x7fe2e40c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:08.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.903+0000 7fe2e8e73640 1 -- 172.21.15.60:0/3603022664 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2d0003520 con 0x7fe2e40c9c80 2024-09-12T02:23:08.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.903+0000 7fe2e9e75640 1 --2- 172.21.15.60:0/3603022664 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2e4150480 0x7fe2e40c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:08.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.903+0000 7fe2e8e73640 1 -- 172.21.15.60:0/3603022664 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1619876677 0 0) 0x7fe2d0003520 con 0x7fe2e40c9c80 2024-09-12T02:23:08.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.903+0000 7fe2e8e73640 1 -- 172.21.15.60:0/3603022664 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2e4150480 msgr2=0x7fe2e40c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:08.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.903+0000 7fe2e8e73640 1 --2- 172.21.15.60:0/3603022664 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2e4150480 0x7fe2e40c7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:08.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.903+0000 7fe2e8e73640 1 -- 172.21.15.60:0/3603022664 >> v2:172.21.15.105:3300/0 conn(0x7fe2e406c650 msgr2=0x7fe2e40c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:08.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.903+0000 7fe2e8e73640 1 --2- 172.21.15.60:0/3603022664 >> v2:172.21.15.105:3300/0 conn(0x7fe2e406c650 0x7fe2e40c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:08.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.903+0000 7fe2e8e73640 1 -- 172.21.15.60:0/3603022664 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2e4159a00 con 0x7fe2e40c9c80 2024-09-12T02:23:08.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.903+0000 7fe2e8e73640 1 -- 172.21.15.60:0/3603022664 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7fe2dc0019f0 con 0x7fe2e40c9c80 2024-09-12T02:23:08.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.904+0000 7fe2e8e73640 1 -- 172.21.15.60:0/3603022664 >> v1:172.21.15.60:6789/0 conn(0x7fe2e40c9c80 legacy=0x7fe2e40ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:08.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.904+0000 7fe2e8e73640 1 --2- 172.21.15.60:0/3603022664 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2d00039b0 0x7fe2d0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:08.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.904+0000 7fe2e8e73640 1 --2- 172.21.15.60:0/3603022664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2d0004800 0x7fe2d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:08.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.904+0000 7fe2e8e73640 1 --2- 172.21.15.60:0/3603022664 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2e4150480 0x7fe2d00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:08.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.904+0000 7fe2e8e73640 1 -- 172.21.15.60:0/3603022664 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e415a330 con 0x7fe2d0004800 2024-09-12T02:23:08.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.904+0000 7fe2e8e73640 1 -- 172.21.15.60:0/3603022664 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d000b9c0 con 0x7fe2d00039b0 2024-09-12T02:23:08.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.904+0000 7fe2e8e73640 1 -- 172.21.15.60:0/3603022664 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe2d000bb40 con 0x7fe2e4150480 2024-09-12T02:23:08.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.904+0000 7fe2e9674640 1 --2- 172.21.15.60:0/3603022664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2d0004800 0x7fe2d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:08.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.904+0000 7fe2e9e75640 1 --2- 172.21.15.60:0/3603022664 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2d00039b0 0x7fe2d0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:08.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.904+0000 7fe2ea676640 1 --2- 172.21.15.60:0/3603022664 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2e4150480 0x7fe2d00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:08.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.904+0000 7fe2e9674640 1 -- 172.21.15.60:0/3603022664 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2e4150480 msgr2=0x7fe2d00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:08.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.904+0000 7fe2e9674640 1 --2- 172.21.15.60:0/3603022664 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2e4150480 0x7fe2d00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:08.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.904+0000 7fe2e9674640 1 -- 172.21.15.60:0/3603022664 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2d00039b0 msgr2=0x7fe2d0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:08.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.904+0000 7fe2e9674640 1 --2- 172.21.15.60:0/3603022664 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2d00039b0 0x7fe2d0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:08.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.904+0000 7fe2e9674640 1 -- 172.21.15.60:0/3603022664 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2d0003520 con 0x7fe2d0004800 2024-09-12T02:23:08.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.905+0000 7fe2e9674640 1 --2- 172.21.15.60:0/3603022664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2d0004800 0x7fe2d0004c80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4009ac0 tx=0x7fe2d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5c28ac77742eb63 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:08.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.905+0000 7fe2e8e73640 1 -- 172.21.15.60:0/3603022664 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d4036070 con 0x7fe2d0004800 2024-09-12T02:23:08.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.905+0000 7fe2e8e73640 1 -- 172.21.15.60:0/3603022664 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2d4031400 con 0x7fe2d0004800 2024-09-12T02:23:08.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.905+0000 7fe2e8e73640 1 -- 172.21.15.60:0/3603022664 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d4009690 con 0x7fe2d0004800 2024-09-12T02:23:08.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.905+0000 7fe2ec0d9640 1 -- 172.21.15.60:0/3603022664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2d0004800 msgr2=0x7fe2d0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:08.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.905+0000 7fe2ec0d9640 1 --2- 172.21.15.60:0/3603022664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2d0004800 0x7fe2d0004c80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4009ac0 tx=0x7fe2d0005830 comp rx=0 tx=0).stop 2024-09-12T02:23:08.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.905+0000 7fe2ea676640 1 -- 172.21.15.60:0/3603022664 reap_dead start 2024-09-12T02:23:08.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.905+0000 7fe2ec0d9640 1 -- 172.21.15.60:0/3603022664 shutdown_connections 2024-09-12T02:23:08.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.905+0000 7fe2ec0d9640 1 -- 172.21.15.60:0/3603022664 >> 172.21.15.60:0/3603022664 conn(0x7fe2e4068030 msgr2=0x7fe2e4073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:08.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.905+0000 7fe2ec0d9640 1 -- 172.21.15.60:0/3603022664 shutdown_connections 2024-09-12T02:23:08.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.905+0000 7fe2ec0d9640 1 -- 172.21.15.60:0/3603022664 wait complete. 2024-09-12T02:23:08.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.907+0000 7fe2ec0d9640 1 Processor -- start 2024-09-12T02:23:08.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.907+0000 7fe2ec0d9640 1 -- start start 2024-09-12T02:23:08.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.907+0000 7fe2ec0d9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2d0004800 0x7fe2e4158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:08.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.907+0000 7fe2ec0d9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2e4157fe0 0x7fe2e41e8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:08.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.907+0000 7fe2ec0d9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2e41e90d0 0x7fe2e4150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:08.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.907+0000 7fe2ec0d9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e406d270 con 0x7fe2e41e90d0 2024-09-12T02:23:08.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.907+0000 7fe2ec0d9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e4159fc0 con 0x7fe2e4157fe0 2024-09-12T02:23:08.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.907+0000 7fe2ec0d9640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe2e4156270 con 0x7fe2d0004800 2024-09-12T02:23:08.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.907+0000 7fe2ea676640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2e41e90d0 0x7fe2e4150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:08.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.907+0000 7fe2ea676640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2e41e90d0 0x7fe2e4150860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56920/0 (socket says 172.21.15.60:56920) 2024-09-12T02:23:08.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.907+0000 7fe2ea676640 1 -- 172.21.15.60:0/3952364381 learned_addr learned my addr 172.21.15.60:0/3952364381 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:08.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.908+0000 7fe2e9e75640 1 --2- 172.21.15.60:0/3952364381 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2d0004800 0x7fe2e4158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:08.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.908+0000 7fe2e9674640 1 --2- 172.21.15.60:0/3952364381 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2e4157fe0 0x7fe2e41e8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:08.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.908+0000 7fe2ea676640 1 -- 172.21.15.60:0/3952364381 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2d0004800 msgr2=0x7fe2e4158a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:08.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.908+0000 7fe2ea676640 1 --2- 172.21.15.60:0/3952364381 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2d0004800 0x7fe2e4158a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:08.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.908+0000 7fe2ea676640 1 -- 172.21.15.60:0/3952364381 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2e4157fe0 msgr2=0x7fe2e41e8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:08.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.908+0000 7fe2ea676640 1 --2- 172.21.15.60:0/3952364381 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2e4157fe0 0x7fe2e41e8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:08.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.908+0000 7fe2ea676640 1 -- 172.21.15.60:0/3952364381 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2e41ec980 con 0x7fe2e41e90d0 2024-09-12T02:23:08.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.908+0000 7fe2e9e75640 1 --2- 172.21.15.60:0/3952364381 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2d0004800 0x7fe2e4158a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:23:08.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.908+0000 7fe2e9674640 1 --2- 172.21.15.60:0/3952364381 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2e4157fe0 0x7fe2e41e8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:23:08.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.908+0000 7fe2ea676640 1 --2- 172.21.15.60:0/3952364381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2e41e90d0 0x7fe2e4150860 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe2e41573e0 tx=0x7fe2dc00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:08.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.908+0000 7fe2da7fc640 1 -- 172.21.15.60:0/3952364381 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc00ee20 con 0x7fe2e41e90d0 2024-09-12T02:23:08.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.908+0000 7fe2da7fc640 1 -- 172.21.15.60:0/3952364381 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2dc014430 con 0x7fe2e41e90d0 2024-09-12T02:23:08.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.908+0000 7fe2ec0d9640 1 -- 172.21.15.60:0/3952364381 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2e414e630 con 0x7fe2e41e90d0 2024-09-12T02:23:08.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.908+0000 7fe2da7fc640 1 -- 172.21.15.60:0/3952364381 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc014820 con 0x7fe2e41e90d0 2024-09-12T02:23:08.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.908+0000 7fe2ec0d9640 1 -- 172.21.15.60:0/3952364381 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2e41ebea0 con 0x7fe2e41e90d0 2024-09-12T02:23:08.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.909+0000 7fe2ec0d9640 1 -- 172.21.15.60:0/3952364381 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2e406c430 con 0x7fe2e41e90d0 2024-09-12T02:23:08.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.910+0000 7fe2da7fc640 1 -- 172.21.15.60:0/3952364381 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe2dc0149c0 con 0x7fe2e41e90d0 2024-09-12T02:23:08.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.910+0000 7fe2da7fc640 1 --2- 172.21.15.60:0/3952364381 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe2c806be60 0x7fe2c806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:08.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.910+0000 7fe2da7fc640 1 -- 172.21.15.60:0/3952364381 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5689+0+0 (secure 0 0 0) 0x7fe2dc08ad70 con 0x7fe2e41e90d0 2024-09-12T02:23:08.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.910+0000 7fe2e9e75640 1 --2- 172.21.15.60:0/3952364381 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe2c806be60 0x7fe2c806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:08.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.911+0000 7fe2e9e75640 1 --2- 172.21.15.60:0/3952364381 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe2c806be60 0x7fe2c806e320 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe2e40cab90 tx=0x7fe2e0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:08.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:08.914+0000 7fe2da7fc640 1 -- 172.21.15.60:0/3952364381 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe2dc059730 con 0x7fe2e41e90d0 2024-09-12T02:23:09.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.087+0000 7fe2ec0d9640 1 -- 172.21.15.60:0/3952364381 --> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe2e414ea50 con 0x7fe2c806be60 2024-09-12T02:23:09.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.093+0000 7fe2da7fc640 1 -- 172.21.15.60:0/3952364381 <== mgr.4098 v2:172.21.15.60:6800/3549430091 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246230 (secure 0 0 0) 0x7fe2e414ea50 con 0x7fe2c806be60 2024-09-12T02:23:09.096 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:23:09.097 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T02:23:09.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.096+0000 7fe2ec0d9640 1 -- 172.21.15.60:0/3952364381 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe2c806be60 msgr2=0x7fe2c806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:09.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.096+0000 7fe2ec0d9640 1 --2- 172.21.15.60:0/3952364381 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe2c806be60 0x7fe2c806e320 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe2e40cab90 tx=0x7fe2e0008040 comp rx=0 tx=0).stop 2024-09-12T02:23:09.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.096+0000 7fe2ec0d9640 1 -- 172.21.15.60:0/3952364381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2e41e90d0 msgr2=0x7fe2e4150860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:09.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.096+0000 7fe2ec0d9640 1 --2- 172.21.15.60:0/3952364381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2e41e90d0 0x7fe2e4150860 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe2e41573e0 tx=0x7fe2dc00e530 comp rx=0 tx=0).stop 2024-09-12T02:23:09.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.096+0000 7fe2ec0d9640 1 -- 172.21.15.60:0/3952364381 shutdown_connections 2024-09-12T02:23:09.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.096+0000 7fe2ec0d9640 1 --2- 172.21.15.60:0/3952364381 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe2c806be60 0x7fe2c806e320 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:09.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.096+0000 7fe2ec0d9640 1 --2- 172.21.15.60:0/3952364381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2e41e90d0 0x7fe2e4150860 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:09.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.096+0000 7fe2ec0d9640 1 --2- 172.21.15.60:0/3952364381 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2e4157fe0 0x7fe2e41e8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:09.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.096+0000 7fe2ec0d9640 1 --2- 172.21.15.60:0/3952364381 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2d0004800 0x7fe2e4158a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:09.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.096+0000 7fe2ec0d9640 1 -- 172.21.15.60:0/3952364381 >> 172.21.15.60:0/3952364381 conn(0x7fe2e4068030 msgr2=0x7fe2e414f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:09.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.096+0000 7fe2ec0d9640 1 -- 172.21.15.60:0/3952364381 shutdown_connections 2024-09-12T02:23:09.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.096+0000 7fe2ec0d9640 1 -- 172.21.15.60:0/3952364381 wait complete. 2024-09-12T02:23:09.107 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-12T02:23:08.087492+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590528,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":165,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":124,"ondisk_log_size":124,"up":160,"acting":160,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":46,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":248020,"kb_used_data":2660,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754726700,"statfs":{"total":773094113280,"available":772840140800,"internally_reserved":0,"allocated":2723840,"data_stored":1676162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.343279"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.754084+0000","last_change":"2024-09-12T02:23:03.754084+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.754084+0000","last_undegraded":"2024-09-12T02:23:03.754084+0000","last_fullsized":"2024-09-12T02:23:03.754084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775715+0000","last_change":"2024-09-12T02:23:04.785821+0000","last_active":"2024-09-12T02:23:05.775715+0000","last_peered":"2024-09-12T02:23:05.775715+0000","last_clean":"2024-09-12T02:23:05.775715+0000","last_became_active":"2024-09-12T02:23:04.785516+0000","last_became_peered":"2024-09-12T02:23:04.785516+0000","last_unstale":"2024-09-12T02:23:05.775715+0000","last_undegraded":"2024-09-12T02:23:05.775715+0000","last_fullsized":"2024-09-12T02:23:05.775715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:42.400040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.757489+0000","last_change":"2024-09-12T02:23:03.757489+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.757489+0000","last_undegraded":"2024-09-12T02:23:03.757489+0000","last_fullsized":"2024-09-12T02:23:03.757489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.752762+0000","last_change":"2024-09-12T02:23:03.752762+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.752762+0000","last_undegraded":"2024-09-12T02:23:03.752762+0000","last_fullsized":"2024-09-12T02:23:03.752762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.757048+0000","last_change":"2024-09-12T02:23:03.757048+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.757048+0000","last_undegraded":"2024-09-12T02:23:03.757048+0000","last_fullsized":"2024-09-12T02:23:03.757048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.752859+0000","last_change":"2024-09-12T02:23:03.752859+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.752859+0000","last_undegraded":"2024-09-12T02:23:03.752859+0000","last_fullsized":"2024-09-12T02:23:03.752859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.971553+0000","last_change":"2024-09-12T02:23:04.779648+0000","last_active":"2024-09-12T02:23:06.971553+0000","last_peered":"2024-09-12T02:23:06.971553+0000","last_clean":"2024-09-12T02:23:06.971553+0000","last_became_active":"2024-09-12T02:23:04.779384+0000","last_became_peered":"2024-09-12T02:23:04.779384+0000","last_unstale":"2024-09-12T02:23:06.971553+0000","last_undegraded":"2024-09-12T02:23:06.971553+0000","last_fullsized":"2024-09-12T02:23:06.971553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:41.491471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.753523+0000","last_change":"2024-09-12T02:23:03.753523+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.753523+0000","last_undegraded":"2024-09-12T02:23:03.753523+0000","last_fullsized":"2024-09-12T02:23:03.753523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.764540+0000","last_change":"2024-09-12T02:23:03.764540+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.764540+0000","last_undegraded":"2024-09-12T02:23:03.764540+0000","last_fullsized":"2024-09-12T02:23:03.764540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.762349+0000","last_change":"2024-09-12T02:23:03.762349+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.762349+0000","last_undegraded":"2024-09-12T02:23:03.762349+0000","last_fullsized":"2024-09-12T02:23:03.762349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.971880+0000","last_change":"2024-09-12T02:23:04.782128+0000","last_active":"2024-09-12T02:23:06.971880+0000","last_peered":"2024-09-12T02:23:06.971880+0000","last_clean":"2024-09-12T02:23:06.971880+0000","last_became_active":"2024-09-12T02:23:04.781101+0000","last_became_peered":"2024-09-12T02:23:04.781101+0000","last_unstale":"2024-09-12T02:23:06.971880+0000","last_undegraded":"2024-09-12T02:23:06.971880+0000","last_fullsized":"2024-09-12T02:23:06.971880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:49.421147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775453+0000","last_change":"2024-09-12T02:23:04.782490+0000","last_active":"2024-09-12T02:23:05.775453+0000","last_peered":"2024-09-12T02:23:05.775453+0000","last_clean":"2024-09-12T02:23:05.775453+0000","last_became_active":"2024-09-12T02:23:04.782183+0000","last_became_peered":"2024-09-12T02:23:04.782183+0000","last_unstale":"2024-09-12T02:23:05.775453+0000","last_undegraded":"2024-09-12T02:23:05.775453+0000","last_fullsized":"2024-09-12T02:23:05.775453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:28.699880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.756668+0000","last_change":"2024-09-12T02:23:03.756668+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.756668+0000","last_undegraded":"2024-09-12T02:23:03.756668+0000","last_fullsized":"2024-09-12T02:23:03.756668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.755180+0000","last_change":"2024-09-12T02:23:03.755180+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.755180+0000","last_undegraded":"2024-09-12T02:23:03.755180+0000","last_fullsized":"2024-09-12T02:23:03.755180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.754603+0000","last_change":"2024-09-12T02:23:03.754603+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.754603+0000","last_undegraded":"2024-09-12T02:23:03.754603+0000","last_fullsized":"2024-09-12T02:23:03.754603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.760816+0000","last_change":"2024-09-12T02:23:03.760816+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.760816+0000","last_undegraded":"2024-09-12T02:23:03.760816+0000","last_fullsized":"2024-09-12T02:23:03.760816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.756587+0000","last_change":"2024-09-12T02:23:03.756587+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.756587+0000","last_undegraded":"2024-09-12T02:23:03.756587+0000","last_fullsized":"2024-09-12T02:23:03.756587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.971740+0000","last_change":"2024-09-12T02:23:04.788624+0000","last_active":"2024-09-12T02:23:06.971740+0000","last_peered":"2024-09-12T02:23:06.971740+0000","last_clean":"2024-09-12T02:23:06.971740+0000","last_became_active":"2024-09-12T02:23:04.788352+0000","last_became_peered":"2024-09-12T02:23:04.788352+0000","last_unstale":"2024-09-12T02:23:06.971740+0000","last_undegraded":"2024-09-12T02:23:06.971740+0000","last_fullsized":"2024-09-12T02:23:06.971740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:13.961110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.756225+0000","last_change":"2024-09-12T02:23:03.756225+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.756225+0000","last_undegraded":"2024-09-12T02:23:03.756225+0000","last_fullsized":"2024-09-12T02:23:03.756225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.972167+0000","last_change":"2024-09-12T02:23:04.787899+0000","last_active":"2024-09-12T02:23:06.972167+0000","last_peered":"2024-09-12T02:23:06.972167+0000","last_clean":"2024-09-12T02:23:06.972167+0000","last_became_active":"2024-09-12T02:23:04.787619+0000","last_became_peered":"2024-09-12T02:23:04.787619+0000","last_unstale":"2024-09-12T02:23:06.972167+0000","last_undegraded":"2024-09-12T02:23:06.972167+0000","last_fullsized":"2024-09-12T02:23:06.972167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:57.732453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.759049+0000","last_change":"2024-09-12T02:23:03.759049+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.759049+0000","last_undegraded":"2024-09-12T02:23:03.759049+0000","last_fullsized":"2024-09-12T02:23:03.759049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775630+0000","last_change":"2024-09-12T02:23:04.776435+0000","last_active":"2024-09-12T02:23:05.775630+0000","last_peered":"2024-09-12T02:23:05.775630+0000","last_clean":"2024-09-12T02:23:05.775630+0000","last_became_active":"2024-09-12T02:23:04.776120+0000","last_became_peered":"2024-09-12T02:23:04.776120+0000","last_unstale":"2024-09-12T02:23:05.775630+0000","last_undegraded":"2024-09-12T02:23:05.775630+0000","last_fullsized":"2024-09-12T02:23:05.775630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:27.985094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.972092+0000","last_change":"2024-09-12T02:23:04.789372+0000","last_active":"2024-09-12T02:23:06.972092+0000","last_peered":"2024-09-12T02:23:06.972092+0000","last_clean":"2024-09-12T02:23:06.972092+0000","last_became_active":"2024-09-12T02:23:04.789090+0000","last_became_peered":"2024-09-12T02:23:04.789090+0000","last_unstale":"2024-09-12T02:23:06.972092+0000","last_undegraded":"2024-09-12T02:23:06.972092+0000","last_fullsized":"2024-09-12T02:23:06.972092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:49.533491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.756132+0000","last_change":"2024-09-12T02:23:03.756132+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.756132+0000","last_undegraded":"2024-09-12T02:23:03.756132+0000","last_fullsized":"2024-09-12T02:23:03.756132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.764086+0000","last_change":"2024-09-12T02:23:03.764086+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.764086+0000","last_undegraded":"2024-09-12T02:23:03.764086+0000","last_fullsized":"2024-09-12T02:23:03.764086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.972043+0000","last_change":"2024-09-12T02:23:03.764310+0000","last_active":"2024-09-12T02:23:06.972043+0000","last_peered":"2024-09-12T02:23:06.972043+0000","last_clean":"2024-09-12T02:23:06.972043+0000","last_became_active":"2024-09-12T02:23:03.764020+0000","last_became_peered":"2024-09-12T02:23:03.764020+0000","last_unstale":"2024-09-12T02:23:06.972043+0000","last_undegraded":"2024-09-12T02:23:06.972043+0000","last_fullsized":"2024-09-12T02:23:06.972043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:25.892874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.770609+0000","last_change":"2024-09-12T02:23:03.768186+0000","last_active":"2024-09-12T02:23:03.770609+0000","last_peered":"2024-09-12T02:23:03.770609+0000","last_clean":"2024-09-12T02:23:03.770609+0000","last_became_active":"2024-09-12T02:23:03.767916+0000","last_became_peered":"2024-09-12T02:23:03.767916+0000","last_unstale":"2024-09-12T02:23:03.770609+0000","last_undegraded":"2024-09-12T02:23:03.770609+0000","last_fullsized":"2024-09-12T02:23:03.770609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:12.165660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.971673+0000","last_change":"2024-09-12T02:23:03.768361+0000","last_active":"2024-09-12T02:23:06.971673+0000","last_peered":"2024-09-12T02:23:06.971673+0000","last_clean":"2024-09-12T02:23:06.971673+0000","last_became_active":"2024-09-12T02:23:03.768137+0000","last_became_peered":"2024-09-12T02:23:03.768137+0000","last_unstale":"2024-09-12T02:23:06.971673+0000","last_undegraded":"2024-09-12T02:23:06.971673+0000","last_fullsized":"2024-09-12T02:23:06.971673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:29.721363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.971707+0000","last_change":"2024-09-12T02:23:04.783317+0000","last_active":"2024-09-12T02:23:06.971707+0000","last_peered":"2024-09-12T02:23:06.971707+0000","last_clean":"2024-09-12T02:23:06.971707+0000","last_became_active":"2024-09-12T02:23:04.783039+0000","last_became_peered":"2024-09-12T02:23:04.783039+0000","last_unstale":"2024-09-12T02:23:06.971707+0000","last_undegraded":"2024-09-12T02:23:06.971707+0000","last_fullsized":"2024-09-12T02:23:06.971707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:17.577991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.767515+0000","last_change":"2024-09-12T02:23:03.762450+0000","last_active":"2024-09-12T02:23:03.767515+0000","last_peered":"2024-09-12T02:23:03.767515+0000","last_clean":"2024-09-12T02:23:03.767515+0000","last_became_active":"2024-09-12T02:23:03.762161+0000","last_became_peered":"2024-09-12T02:23:03.762161+0000","last_unstale":"2024-09-12T02:23:03.767515+0000","last_undegraded":"2024-09-12T02:23:03.767515+0000","last_fullsized":"2024-09-12T02:23:03.767515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:20.943756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775427+0000","last_change":"2024-09-12T02:23:04.776572+0000","last_active":"2024-09-12T02:23:05.775427+0000","last_peered":"2024-09-12T02:23:05.775427+0000","last_clean":"2024-09-12T02:23:05.775427+0000","last_became_active":"2024-09-12T02:23:04.776270+0000","last_became_peered":"2024-09-12T02:23:04.776270+0000","last_unstale":"2024-09-12T02:23:05.775427+0000","last_undegraded":"2024-09-12T02:23:05.775427+0000","last_fullsized":"2024-09-12T02:23:05.775427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:12.807907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.771948+0000","last_change":"2024-09-12T02:23:03.770668+0000","last_active":"2024-09-12T02:23:03.771948+0000","last_peered":"2024-09-12T02:23:03.771948+0000","last_clean":"2024-09-12T02:23:03.771948+0000","last_became_active":"2024-09-12T02:23:03.769302+0000","last_became_peered":"2024-09-12T02:23:03.769302+0000","last_unstale":"2024-09-12T02:23:03.771948+0000","last_undegraded":"2024-09-12T02:23:03.771948+0000","last_fullsized":"2024-09-12T02:23:03.771948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:58.341188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.757235+0000","last_change":"2024-09-12T02:23:03.757235+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.757235+0000","last_undegraded":"2024-09-12T02:23:03.757235+0000","last_fullsized":"2024-09-12T02:23:03.757235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.774780+0000","last_change":"2024-09-12T02:23:03.769710+0000","last_active":"2024-09-12T02:23:03.774780+0000","last_peered":"2024-09-12T02:23:03.774780+0000","last_clean":"2024-09-12T02:23:03.774780+0000","last_became_active":"2024-09-12T02:23:03.769436+0000","last_became_peered":"2024-09-12T02:23:03.769436+0000","last_unstale":"2024-09-12T02:23:03.774780+0000","last_undegraded":"2024-09-12T02:23:03.774780+0000","last_fullsized":"2024-09-12T02:23:03.774780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:05.383995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775627+0000","last_change":"2024-09-12T02:23:03.771271+0000","last_active":"2024-09-12T02:23:05.775627+0000","last_peered":"2024-09-12T02:23:05.775627+0000","last_clean":"2024-09-12T02:23:05.775627+0000","last_became_active":"2024-09-12T02:23:03.769601+0000","last_became_peered":"2024-09-12T02:23:03.769601+0000","last_unstale":"2024-09-12T02:23:05.775627+0000","last_undegraded":"2024-09-12T02:23:05.775627+0000","last_fullsized":"2024-09-12T02:23:05.775627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:22.910072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.770888+0000","last_change":"2024-09-12T02:23:03.768425+0000","last_active":"2024-09-12T02:23:03.770888+0000","last_peered":"2024-09-12T02:23:03.770888+0000","last_clean":"2024-09-12T02:23:03.770888+0000","last_became_active":"2024-09-12T02:23:03.768092+0000","last_became_peered":"2024-09-12T02:23:03.768092+0000","last_unstale":"2024-09-12T02:23:03.770888+0000","last_undegraded":"2024-09-12T02:23:03.770888+0000","last_fullsized":"2024-09-12T02:23:03.770888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:57.887914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.755898+0000","last_change":"2024-09-12T02:23:03.755898+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.755898+0000","last_undegraded":"2024-09-12T02:23:03.755898+0000","last_fullsized":"2024-09-12T02:23:03.755898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:23:02.750891+0000","last_change":"2024-09-12T02:23:02.750891+0000","last_active":"2024-09-12T02:23:02.739281+0000","last_peered":"2024-09-12T02:23:02.739281+0000","last_clean":"2024-09-12T02:23:02.739281+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:02.750891+0000","last_undegraded":"2024-09-12T02:23:02.750891+0000","last_fullsized":"2024-09-12T02:23:02.750891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.769019+0000","last_change":"2024-09-12T02:23:03.767217+0000","last_active":"2024-09-12T02:23:03.769019+0000","last_peered":"2024-09-12T02:23:03.769019+0000","last_clean":"2024-09-12T02:23:03.769019+0000","last_became_active":"2024-09-12T02:23:03.766551+0000","last_became_peered":"2024-09-12T02:23:03.766551+0000","last_unstale":"2024-09-12T02:23:03.769019+0000","last_undegraded":"2024-09-12T02:23:03.769019+0000","last_fullsized":"2024-09-12T02:23:03.769019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:30.824294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.752149+0000","last_change":"2024-09-12T02:23:03.752149+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.752149+0000","last_undegraded":"2024-09-12T02:23:03.752149+0000","last_fullsized":"2024-09-12T02:23:03.752149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.769127+0000","last_change":"2024-09-12T02:23:03.767842+0000","last_active":"2024-09-12T02:23:03.769127+0000","last_peered":"2024-09-12T02:23:03.769127+0000","last_clean":"2024-09-12T02:23:03.769127+0000","last_became_active":"2024-09-12T02:23:03.767066+0000","last_became_peered":"2024-09-12T02:23:03.767066+0000","last_unstale":"2024-09-12T02:23:03.769127+0000","last_undegraded":"2024-09-12T02:23:03.769127+0000","last_fullsized":"2024-09-12T02:23:03.769127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:03.108197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.759935+0000","last_change":"2024-09-12T02:23:03.759935+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.759935+0000","last_undegraded":"2024-09-12T02:23:03.759935+0000","last_fullsized":"2024-09-12T02:23:03.759935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:23:02.748375+0000","last_change":"2024-09-12T02:23:02.748375+0000","last_active":"2024-09-12T02:23:02.739281+0000","last_peered":"2024-09-12T02:23:02.739281+0000","last_clean":"2024-09-12T02:23:02.739281+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:02.748375+0000","last_undegraded":"2024-09-12T02:23:02.748375+0000","last_fullsized":"2024-09-12T02:23:02.748375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.752312+0000","last_change":"2024-09-12T02:23:03.752312+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.752312+0000","last_undegraded":"2024-09-12T02:23:03.752312+0000","last_fullsized":"2024-09-12T02:23:03.752312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:23:02.746308+0000","last_change":"2024-09-12T02:23:02.746308+0000","last_active":"2024-09-12T02:23:02.739281+0000","last_peered":"2024-09-12T02:23:02.739281+0000","last_clean":"2024-09-12T02:23:02.739281+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:02.746308+0000","last_undegraded":"2024-09-12T02:23:02.746308+0000","last_fullsized":"2024-09-12T02:23:02.746308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.753058+0000","last_change":"2024-09-12T02:23:03.753058+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.753058+0000","last_undegraded":"2024-09-12T02:23:03.753058+0000","last_fullsized":"2024-09-12T02:23:03.753058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:23:02.749018+0000","last_change":"2024-09-12T02:23:02.749018+0000","last_active":"2024-09-12T02:23:02.739281+0000","last_peered":"2024-09-12T02:23:02.739281+0000","last_clean":"2024-09-12T02:23:02.739281+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:02.749018+0000","last_undegraded":"2024-09-12T02:23:02.749018+0000","last_fullsized":"2024-09-12T02:23:02.749018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.753029+0000","last_change":"2024-09-12T02:23:03.753029+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.753029+0000","last_undegraded":"2024-09-12T02:23:03.753029+0000","last_fullsized":"2024-09-12T02:23:03.753029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775732+0000","last_change":"2024-09-12T02:23:03.766034+0000","last_active":"2024-09-12T02:23:05.775732+0000","last_peered":"2024-09-12T02:23:05.775732+0000","last_clean":"2024-09-12T02:23:05.775732+0000","last_became_active":"2024-09-12T02:23:03.765735+0000","last_became_peered":"2024-09-12T02:23:03.765735+0000","last_unstale":"2024-09-12T02:23:05.775732+0000","last_undegraded":"2024-09-12T02:23:05.775732+0000","last_fullsized":"2024-09-12T02:23:05.775732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:19.691229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.755917+0000","last_change":"2024-09-12T02:23:03.755917+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.755917+0000","last_undegraded":"2024-09-12T02:23:03.755917+0000","last_fullsized":"2024-09-12T02:23:03.755917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:23:02.748818+0000","last_change":"2024-09-12T02:23:02.748818+0000","last_active":"2024-09-12T02:23:02.739281+0000","last_peered":"2024-09-12T02:23:02.739281+0000","last_clean":"2024-09-12T02:23:02.739281+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:02.748818+0000","last_undegraded":"2024-09-12T02:23:02.748818+0000","last_fullsized":"2024-09-12T02:23:02.748818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.755050+0000","last_change":"2024-09-12T02:23:03.755050+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.755050+0000","last_undegraded":"2024-09-12T02:23:03.755050+0000","last_fullsized":"2024-09-12T02:23:03.755050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":166,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.757667+0000","last_change":"2024-09-12T02:22:55.143869+0000","last_active":"2024-09-12T02:23:03.757667+0000","last_peered":"2024-09-12T02:23:03.757667+0000","last_clean":"2024-09-12T02:23:03.757667+0000","last_became_active":"2024-09-12T02:22:55.142784+0000","last_became_peered":"2024-09-12T02:22:55.142784+0000","last_unstale":"2024-09-12T02:23:03.757667+0000","last_undegraded":"2024-09-12T02:23:03.757667+0000","last_fullsized":"2024-09-12T02:23:03.757667+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:22:52.457979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:22:52.457979+0000","last_clean_scrub_stamp":"2024-09-12T02:22:52.457979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:46.152602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.768867+0000","last_change":"2024-09-12T02:23:03.765100+0000","last_active":"2024-09-12T02:23:03.768867+0000","last_peered":"2024-09-12T02:23:03.768867+0000","last_clean":"2024-09-12T02:23:03.768867+0000","last_became_active":"2024-09-12T02:23:03.764801+0000","last_became_peered":"2024-09-12T02:23:03.764801+0000","last_unstale":"2024-09-12T02:23:03.768867+0000","last_undegraded":"2024-09-12T02:23:03.768867+0000","last_fullsized":"2024-09-12T02:23:03.768867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:29.776974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.971912+0000","last_change":"2024-09-12T02:23:04.781839+0000","last_active":"2024-09-12T02:23:06.971912+0000","last_peered":"2024-09-12T02:23:06.971912+0000","last_clean":"2024-09-12T02:23:06.971912+0000","last_became_active":"2024-09-12T02:23:04.780984+0000","last_became_peered":"2024-09-12T02:23:04.780984+0000","last_unstale":"2024-09-12T02:23:06.971912+0000","last_undegraded":"2024-09-12T02:23:06.971912+0000","last_fullsized":"2024-09-12T02:23:06.971912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:07.692791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.775844+0000","last_change":"2024-09-12T02:23:03.771625+0000","last_active":"2024-09-12T02:23:03.775844+0000","last_peered":"2024-09-12T02:23:03.775844+0000","last_clean":"2024-09-12T02:23:03.775844+0000","last_became_active":"2024-09-12T02:23:03.771163+0000","last_became_peered":"2024-09-12T02:23:03.771163+0000","last_unstale":"2024-09-12T02:23:03.775844+0000","last_undegraded":"2024-09-12T02:23:03.775844+0000","last_fullsized":"2024-09-12T02:23:03.775844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:40.982318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:23:02.748347+0000","last_change":"2024-09-12T02:23:02.748347+0000","last_active":"2024-09-12T02:23:02.739281+0000","last_peered":"2024-09-12T02:23:02.739281+0000","last_clean":"2024-09-12T02:23:02.739281+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:02.748347+0000","last_undegraded":"2024-09-12T02:23:02.748347+0000","last_fullsized":"2024-09-12T02:23:02.748347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775441+0000","last_change":"2024-09-12T02:23:04.773745+0000","last_active":"2024-09-12T02:23:05.775441+0000","last_peered":"2024-09-12T02:23:05.775441+0000","last_clean":"2024-09-12T02:23:05.775441+0000","last_became_active":"2024-09-12T02:23:04.773360+0000","last_became_peered":"2024-09-12T02:23:04.773360+0000","last_unstale":"2024-09-12T02:23:05.775441+0000","last_undegraded":"2024-09-12T02:23:05.775441+0000","last_fullsized":"2024-09-12T02:23:05.775441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:33.097774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.775764+0000","last_change":"2024-09-12T02:23:03.771518+0000","last_active":"2024-09-12T02:23:03.775764+0000","last_peered":"2024-09-12T02:23:03.775764+0000","last_clean":"2024-09-12T02:23:03.775764+0000","last_became_active":"2024-09-12T02:23:03.771063+0000","last_became_peered":"2024-09-12T02:23:03.771063+0000","last_unstale":"2024-09-12T02:23:03.775764+0000","last_undegraded":"2024-09-12T02:23:03.775764+0000","last_fullsized":"2024-09-12T02:23:03.775764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:01.694099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775663+0000","last_change":"2024-09-12T02:23:03.769913+0000","last_active":"2024-09-12T02:23:05.775663+0000","last_peered":"2024-09-12T02:23:05.775663+0000","last_clean":"2024-09-12T02:23:05.775663+0000","last_became_active":"2024-09-12T02:23:03.769444+0000","last_became_peered":"2024-09-12T02:23:03.769444+0000","last_unstale":"2024-09-12T02:23:05.775663+0000","last_undegraded":"2024-09-12T02:23:05.775663+0000","last_fullsized":"2024-09-12T02:23:05.775663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:21.243182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.754756+0000","last_change":"2024-09-12T02:23:03.754756+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.754756+0000","last_undegraded":"2024-09-12T02:23:03.754756+0000","last_fullsized":"2024-09-12T02:23:03.754756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.767766+0000","last_change":"2024-09-12T02:23:03.764093+0000","last_active":"2024-09-12T02:23:03.767766+0000","last_peered":"2024-09-12T02:23:03.767766+0000","last_clean":"2024-09-12T02:23:03.767766+0000","last_became_active":"2024-09-12T02:23:03.763147+0000","last_became_peered":"2024-09-12T02:23:03.763147+0000","last_unstale":"2024-09-12T02:23:03.767766+0000","last_undegraded":"2024-09-12T02:23:03.767766+0000","last_fullsized":"2024-09-12T02:23:03.767766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:59.022658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775631+0000","last_change":"2024-09-12T02:23:04.775876+0000","last_active":"2024-09-12T02:23:05.775631+0000","last_peered":"2024-09-12T02:23:05.775631+0000","last_clean":"2024-09-12T02:23:05.775631+0000","last_became_active":"2024-09-12T02:23:04.775571+0000","last_became_peered":"2024-09-12T02:23:04.775571+0000","last_unstale":"2024-09-12T02:23:05.775631+0000","last_undegraded":"2024-09-12T02:23:05.775631+0000","last_fullsized":"2024-09-12T02:23:05.775631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:05.070528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.772082+0000","last_change":"2024-09-12T02:23:03.769745+0000","last_active":"2024-09-12T02:23:06.772082+0000","last_peered":"2024-09-12T02:23:06.772082+0000","last_clean":"2024-09-12T02:23:06.772082+0000","last_became_active":"2024-09-12T02:23:03.769410+0000","last_became_peered":"2024-09-12T02:23:03.769410+0000","last_unstale":"2024-09-12T02:23:06.772082+0000","last_undegraded":"2024-09-12T02:23:06.772082+0000","last_fullsized":"2024-09-12T02:23:06.772082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:00.414459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.972214+0000","last_change":"2024-09-12T02:23:04.786424+0000","last_active":"2024-09-12T02:23:06.972214+0000","last_peered":"2024-09-12T02:23:06.972214+0000","last_clean":"2024-09-12T02:23:06.972214+0000","last_became_active":"2024-09-12T02:23:04.786136+0000","last_became_peered":"2024-09-12T02:23:04.786136+0000","last_unstale":"2024-09-12T02:23:06.972214+0000","last_undegraded":"2024-09-12T02:23:06.972214+0000","last_fullsized":"2024-09-12T02:23:06.972214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:31.214894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.774760+0000","last_change":"2024-09-12T02:23:03.771259+0000","last_active":"2024-09-12T02:23:03.774760+0000","last_peered":"2024-09-12T02:23:03.774760+0000","last_clean":"2024-09-12T02:23:03.774760+0000","last_became_active":"2024-09-12T02:23:03.770687+0000","last_became_peered":"2024-09-12T02:23:03.770687+0000","last_unstale":"2024-09-12T02:23:03.774760+0000","last_undegraded":"2024-09-12T02:23:03.774760+0000","last_fullsized":"2024-09-12T02:23:03.774760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:40.804626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.768159+0000","last_change":"2024-09-12T02:23:03.764530+0000","last_active":"2024-09-12T02:23:03.768159+0000","last_peered":"2024-09-12T02:23:03.768159+0000","last_clean":"2024-09-12T02:23:03.768159+0000","last_became_active":"2024-09-12T02:23:03.764218+0000","last_became_peered":"2024-09-12T02:23:03.764218+0000","last_unstale":"2024-09-12T02:23:03.768159+0000","last_undegraded":"2024-09-12T02:23:03.768159+0000","last_fullsized":"2024-09-12T02:23:03.768159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:30:36.651697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775580+0000","last_change":"2024-09-12T02:23:03.770581+0000","last_active":"2024-09-12T02:23:05.775580+0000","last_peered":"2024-09-12T02:23:05.775580+0000","last_clean":"2024-09-12T02:23:05.775580+0000","last_became_active":"2024-09-12T02:23:03.769406+0000","last_became_peered":"2024-09-12T02:23:03.769406+0000","last_unstale":"2024-09-12T02:23:05.775580+0000","last_undegraded":"2024-09-12T02:23:05.775580+0000","last_fullsized":"2024-09-12T02:23:05.775580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:20.963819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.971722+0000","last_change":"2024-09-12T02:23:04.783991+0000","last_active":"2024-09-12T02:23:06.971722+0000","last_peered":"2024-09-12T02:23:06.971722+0000","last_clean":"2024-09-12T02:23:06.971722+0000","last_became_active":"2024-09-12T02:23:04.783143+0000","last_became_peered":"2024-09-12T02:23:04.783143+0000","last_unstale":"2024-09-12T02:23:06.971722+0000","last_undegraded":"2024-09-12T02:23:06.971722+0000","last_fullsized":"2024-09-12T02:23:06.971722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:53.940843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775526+0000","last_change":"2024-09-12T02:23:03.771468+0000","last_active":"2024-09-12T02:23:05.775526+0000","last_peered":"2024-09-12T02:23:05.775526+0000","last_clean":"2024-09-12T02:23:05.775526+0000","last_became_active":"2024-09-12T02:23:03.769619+0000","last_became_peered":"2024-09-12T02:23:03.769619+0000","last_unstale":"2024-09-12T02:23:05.775526+0000","last_undegraded":"2024-09-12T02:23:05.775526+0000","last_fullsized":"2024-09-12T02:23:05.775526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:38.422369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.971928+0000","last_change":"2024-09-12T02:23:04.782769+0000","last_active":"2024-09-12T02:23:06.971928+0000","last_peered":"2024-09-12T02:23:06.971928+0000","last_clean":"2024-09-12T02:23:06.971928+0000","last_became_active":"2024-09-12T02:23:04.782472+0000","last_became_peered":"2024-09-12T02:23:04.782472+0000","last_unstale":"2024-09-12T02:23:06.971928+0000","last_undegraded":"2024-09-12T02:23:06.971928+0000","last_fullsized":"2024-09-12T02:23:06.971928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:46.144471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.767373+0000","last_change":"2024-09-12T02:23:03.763423+0000","last_active":"2024-09-12T02:23:03.767373+0000","last_peered":"2024-09-12T02:23:03.767373+0000","last_clean":"2024-09-12T02:23:03.767373+0000","last_became_active":"2024-09-12T02:23:03.762627+0000","last_became_peered":"2024-09-12T02:23:03.762627+0000","last_unstale":"2024-09-12T02:23:03.767373+0000","last_undegraded":"2024-09-12T02:23:03.767373+0000","last_fullsized":"2024-09-12T02:23:03.767373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:57.229819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.763456+0000","last_change":"2024-09-12T02:23:03.763456+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.763456+0000","last_undegraded":"2024-09-12T02:23:03.763456+0000","last_fullsized":"2024-09-12T02:23:03.763456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.755355+0000","last_change":"2024-09-12T02:23:03.755355+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.755355+0000","last_undegraded":"2024-09-12T02:23:03.755355+0000","last_fullsized":"2024-09-12T02:23:03.755355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.767401+0000","last_change":"2024-09-12T02:23:03.763480+0000","last_active":"2024-09-12T02:23:03.767401+0000","last_peered":"2024-09-12T02:23:03.767401+0000","last_clean":"2024-09-12T02:23:03.767401+0000","last_became_active":"2024-09-12T02:23:03.762464+0000","last_became_peered":"2024-09-12T02:23:03.762464+0000","last_unstale":"2024-09-12T02:23:03.767401+0000","last_undegraded":"2024-09-12T02:23:03.767401+0000","last_fullsized":"2024-09-12T02:23:03.767401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:41.711677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.756378+0000","last_change":"2024-09-12T02:23:03.756378+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.756378+0000","last_undegraded":"2024-09-12T02:23:03.756378+0000","last_fullsized":"2024-09-12T02:23:03.756378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.770326+0000","last_change":"2024-09-12T02:23:03.767875+0000","last_active":"2024-09-12T02:23:03.770326+0000","last_peered":"2024-09-12T02:23:03.770326+0000","last_clean":"2024-09-12T02:23:03.770326+0000","last_became_active":"2024-09-12T02:23:03.767596+0000","last_became_peered":"2024-09-12T02:23:03.767596+0000","last_unstale":"2024-09-12T02:23:03.770326+0000","last_undegraded":"2024-09-12T02:23:03.770326+0000","last_fullsized":"2024-09-12T02:23:03.770326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:49.553353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.972111+0000","last_change":"2024-09-12T02:23:03.767076+0000","last_active":"2024-09-12T02:23:06.972111+0000","last_peered":"2024-09-12T02:23:06.972111+0000","last_clean":"2024-09-12T02:23:06.972111+0000","last_became_active":"2024-09-12T02:23:03.766686+0000","last_became_peered":"2024-09-12T02:23:03.766686+0000","last_unstale":"2024-09-12T02:23:06.972111+0000","last_undegraded":"2024-09-12T02:23:06.972111+0000","last_fullsized":"2024-09-12T02:23:06.972111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:45.706208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.972148+0000","last_change":"2024-09-12T02:23:04.790549+0000","last_active":"2024-09-12T02:23:06.972148+0000","last_peered":"2024-09-12T02:23:06.972148+0000","last_clean":"2024-09-12T02:23:06.972148+0000","last_became_active":"2024-09-12T02:23:04.790187+0000","last_became_peered":"2024-09-12T02:23:04.790187+0000","last_unstale":"2024-09-12T02:23:06.972148+0000","last_undegraded":"2024-09-12T02:23:06.972148+0000","last_fullsized":"2024-09-12T02:23:06.972148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:49.656395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:23:02.749985+0000","last_change":"2024-09-12T02:23:02.749985+0000","last_active":"2024-09-12T02:23:02.739281+0000","last_peered":"2024-09-12T02:23:02.739281+0000","last_clean":"2024-09-12T02:23:02.739281+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:02.749985+0000","last_undegraded":"2024-09-12T02:23:02.749985+0000","last_fullsized":"2024-09-12T02:23:02.749985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":94,"acting":94,"num_store_stats":5},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476741,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":774144,"data_stored":647200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476741,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":192512,"data_stored":63092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476742,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":192512,"data_stored":63092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":180224,"data_stored":56832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509443,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31360,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340480,"statfs":{"total":96636764160,"available":96604651520,"internally_reserved":0,"allocated":167936,"data_stored":51025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36104,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335736,"statfs":{"total":96636764160,"available":96599793664,"internally_reserved":0,"allocated":774144,"data_stored":647200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35568,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336272,"statfs":{"total":96636764160,"available":96600342528,"internally_reserved":0,"allocated":217088,"data_stored":71449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35568,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336272,"statfs":{"total":96636764160,"available":96600342528,"internally_reserved":0,"allocated":225280,"data_stored":76272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:23:09.110 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:23:09.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.250+0000 7f14b185e640 1 Processor -- start 2024-09-12T02:23:09.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.250+0000 7f14b185e640 1 -- start start 2024-09-12T02:23:09.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.251+0000 7f14b185e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f14ac156cc0 0x7f14ac0ca720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:09.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.251+0000 7f14b185e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14ac1570e0 con 0x7f14ac067bc0 2024-09-12T02:23:09.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.251+0000 7f14b185e640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14ac06d1c0 con 0x7f14ac0c6190 2024-09-12T02:23:09.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.251+0000 7f14b185e640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f14ac06d460 con 0x7f14ac156cc0 2024-09-12T02:23:09.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.251+0000 7f14aaffd640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f14ac067bc0 0x7f14ac153640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45126/0 (socket says 172.21.15.60:45126) 2024-09-12T02:23:09.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.251+0000 7f14aaffd640 1 -- 172.21.15.60:0/2001596428 learned_addr learned my addr 172.21.15.60:0/2001596428 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:09.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.251+0000 7f14ab7fe640 1 --2- 172.21.15.60:0/2001596428 >> v2:172.21.15.105:3300/0 conn(0x7f14ac156cc0 0x7f14ac0ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:09.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.251+0000 7f14a9ffb640 1 -- 172.21.15.60:0/2001596428 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2900660392 0 0) 0x7f14ac1570e0 con 0x7f14ac067bc0 2024-09-12T02:23:09.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.251+0000 7f14a9ffb640 1 -- 172.21.15.60:0/2001596428 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1498003520 con 0x7f14ac067bc0 2024-09-12T02:23:09.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.252+0000 7f14a9ffb640 1 -- 172.21.15.60:0/2001596428 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2275015955 0 0) 0x7f1498003520 con 0x7f14ac067bc0 2024-09-12T02:23:09.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.252+0000 7f14a9ffb640 1 -- 172.21.15.60:0/2001596428 >> v2:172.21.15.105:3300/0 conn(0x7f14ac156cc0 msgr2=0x7f14ac0ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:09.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.252+0000 7f14a9ffb640 1 --2- 172.21.15.60:0/2001596428 >> v2:172.21.15.105:3300/0 conn(0x7f14ac156cc0 0x7f14ac0ca720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:09.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.252+0000 7f14a9ffb640 1 -- 172.21.15.60:0/2001596428 >> v1:172.21.15.105:6789/0 conn(0x7f14ac0c6190 legacy=0x7f14ac0ca010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:09.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.252+0000 7f14a9ffb640 1 -- 172.21.15.60:0/2001596428 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14ac06d740 con 0x7f14ac067bc0 2024-09-12T02:23:09.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.252+0000 7f14a9ffb640 1 -- 172.21.15.60:0/2001596428 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7f149c0019f0 con 0x7f14ac067bc0 2024-09-12T02:23:09.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.252+0000 7f14a9ffb640 1 -- 172.21.15.60:0/2001596428 >> v1:172.21.15.60:6789/0 conn(0x7f14ac067bc0 legacy=0x7f14ac153640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:09.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.252+0000 7f14a9ffb640 1 --2- 172.21.15.60:0/2001596428 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14980039b0 0x7f1498003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:09.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.252+0000 7f14a9ffb640 1 --2- 172.21.15.60:0/2001596428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1498004800 0x7f1498004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:09.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.252+0000 7f14a9ffb640 1 --2- 172.21.15.60:0/2001596428 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14980051c0 0x7f149800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:09.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.252+0000 7f14a9ffb640 1 -- 172.21.15.60:0/2001596428 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f14ac06d460 con 0x7f1498004800 2024-09-12T02:23:09.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.252+0000 7f14a9ffb640 1 -- 172.21.15.60:0/2001596428 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f149800c160 con 0x7f14980039b0 2024-09-12T02:23:09.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.252+0000 7f14a9ffb640 1 -- 172.21.15.60:0/2001596428 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f149800c360 con 0x7f14980051c0 2024-09-12T02:23:09.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.252+0000 7f14aa7fc640 1 --2- 172.21.15.60:0/2001596428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1498004800 0x7f1498004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:09.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.252+0000 7f14aaffd640 1 --2- 172.21.15.60:0/2001596428 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14980039b0 0x7f1498003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:09.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.252+0000 7f14ab7fe640 1 --2- 172.21.15.60:0/2001596428 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14980051c0 0x7f149800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:09.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.252+0000 7f14aa7fc640 1 -- 172.21.15.60:0/2001596428 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14980051c0 msgr2=0x7f149800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:09.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.252+0000 7f14aa7fc640 1 --2- 172.21.15.60:0/2001596428 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14980051c0 0x7f149800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:09.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.252+0000 7f14aa7fc640 1 -- 172.21.15.60:0/2001596428 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14980039b0 msgr2=0x7f1498003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:09.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.252+0000 7f14aa7fc640 1 --2- 172.21.15.60:0/2001596428 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14980039b0 0x7f1498003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:09.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.252+0000 7f14aa7fc640 1 -- 172.21.15.60:0/2001596428 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1498003520 con 0x7f1498004800 2024-09-12T02:23:09.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.252+0000 7f14ab7fe640 1 -- 172.21.15.60:0/2001596428 reap_dead start 2024-09-12T02:23:09.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.253+0000 7f14aa7fc640 1 --2- 172.21.15.60:0/2001596428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1498004800 0x7f1498004c80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1494001720 tx=0x7f1498005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=384cc60b0f899d3a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:09.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.253+0000 7f14a9ffb640 1 -- 172.21.15.60:0/2001596428 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1494001370 con 0x7f1498004800 2024-09-12T02:23:09.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.253+0000 7f14a9ffb640 1 -- 172.21.15.60:0/2001596428 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14940052d0 con 0x7f1498004800 2024-09-12T02:23:09.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.253+0000 7f14a9ffb640 1 -- 172.21.15.60:0/2001596428 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f149402ab90 con 0x7f1498004800 2024-09-12T02:23:09.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.254+0000 7f14b185e640 1 -- 172.21.15.60:0/2001596428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1498004800 msgr2=0x7f1498004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:09.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.254+0000 7f14b185e640 1 --2- 172.21.15.60:0/2001596428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1498004800 0x7f1498004c80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1494001720 tx=0x7f1498005830 comp rx=0 tx=0).stop 2024-09-12T02:23:09.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.254+0000 7f14b185e640 1 -- 172.21.15.60:0/2001596428 shutdown_connections 2024-09-12T02:23:09.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.254+0000 7f14b185e640 1 --2- 172.21.15.60:0/2001596428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1498004800 0x7f1498004c80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:09.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.254+0000 7f14b185e640 1 -- 172.21.15.60:0/2001596428 >> 172.21.15.60:0/2001596428 conn(0x7f14ac0c87f0 msgr2=0x7f14ac0c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:09.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.254+0000 7f14b185e640 1 -- 172.21.15.60:0/2001596428 shutdown_connections 2024-09-12T02:23:09.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.254+0000 7f14b185e640 1 -- 172.21.15.60:0/2001596428 wait complete. 2024-09-12T02:23:09.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.255+0000 7f14b185e640 1 Processor -- start 2024-09-12T02:23:09.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.255+0000 7f14b185e640 1 -- start start 2024-09-12T02:23:09.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.256+0000 7f14b185e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1498004800 0x7f14ac1e1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:09.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.256+0000 7f14b185e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14ac0c6ee0 0x7f14ac1e07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:09.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.256+0000 7f14b185e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14ac0c7340 0x7f14ac1e0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:09.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.256+0000 7f14b185e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f14ac067fa0 con 0x7f14ac0c7340 2024-09-12T02:23:09.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.256+0000 7f14b185e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f14ac0c67d0 con 0x7f1498004800 2024-09-12T02:23:09.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.256+0000 7f14b185e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f14ac068120 con 0x7f14ac0c6ee0 2024-09-12T02:23:09.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.256+0000 7f14ab7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14ac0c7340 0x7f14ac1e0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:09.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.256+0000 7f14ab7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14ac0c7340 0x7f14ac1e0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56928/0 (socket says 172.21.15.60:56928) 2024-09-12T02:23:09.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.256+0000 7f14aaffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1498004800 0x7f14ac1e1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:09.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.256+0000 7f14ab7fe640 1 -- 172.21.15.60:0/654752995 learned_addr learned my addr 172.21.15.60:0/654752995 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:09.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.256+0000 7f14aa7fc640 1 --2- 172.21.15.60:0/654752995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14ac0c6ee0 0x7f14ac1e07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:09.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.256+0000 7f14ab7fe640 1 -- 172.21.15.60:0/654752995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14ac0c6ee0 msgr2=0x7f14ac1e07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:09.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.256+0000 7f14ab7fe640 1 --2- 172.21.15.60:0/654752995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14ac0c6ee0 0x7f14ac1e07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:09.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.256+0000 7f14ab7fe640 1 -- 172.21.15.60:0/654752995 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1498004800 msgr2=0x7f14ac1e1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:09.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.256+0000 7f14ab7fe640 1 --2- 172.21.15.60:0/654752995 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1498004800 0x7f14ac1e1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:09.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.256+0000 7f14ab7fe640 1 -- 172.21.15.60:0/654752995 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14ac0afad0 con 0x7f14ac0c7340 2024-09-12T02:23:09.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.256+0000 7f14ab7fe640 1 --2- 172.21.15.60:0/654752995 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14ac0c7340 0x7f14ac1e0d20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f14ac0c6570 tx=0x7f14a4011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:09.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.256+0000 7f14a3fff640 1 -- 172.21.15.60:0/654752995 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14a4004240 con 0x7f14ac0c7340 2024-09-12T02:23:09.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.256+0000 7f14a3fff640 1 -- 172.21.15.60:0/654752995 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14a401c070 con 0x7f14ac0c7340 2024-09-12T02:23:09.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.256+0000 7f14b185e640 1 -- 172.21.15.60:0/654752995 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14ac0aed10 con 0x7f14ac0c7340 2024-09-12T02:23:09.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.257+0000 7f14a3fff640 1 -- 172.21.15.60:0/654752995 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14a400f710 con 0x7f14ac0c7340 2024-09-12T02:23:09.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.257+0000 7f14b185e640 1 -- 172.21.15.60:0/654752995 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14ac0af2d0 con 0x7f14ac0c7340 2024-09-12T02:23:09.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.258+0000 7f14b185e640 1 -- 172.21.15.60:0/654752995 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14ac153640 con 0x7f14ac0c7340 2024-09-12T02:23:09.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.258+0000 7f14a3fff640 1 -- 172.21.15.60:0/654752995 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f14a4012040 con 0x7f14ac0c7340 2024-09-12T02:23:09.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.258+0000 7f14a3fff640 1 --2- 172.21.15.60:0/654752995 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f148c06be60 0x7f148c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:09.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.259+0000 7f14a3fff640 1 -- 172.21.15.60:0/654752995 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5689+0+0 (secure 0 0 0) 0x7f14a408aaf0 con 0x7f14ac0c7340 2024-09-12T02:23:09.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.259+0000 7f14aaffd640 1 --2- 172.21.15.60:0/654752995 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f148c06be60 0x7f148c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:09.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.259+0000 7f14aaffd640 1 --2- 172.21.15.60:0/654752995 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f148c06be60 0x7f148c06e320 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f149c001560 tx=0x7f149c006040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:09.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.263+0000 7f14a3fff640 1 -- 172.21.15.60:0/654752995 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f14a4058e60 con 0x7f14ac0c7340 2024-09-12T02:23:09.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.438+0000 7f14b185e640 1 -- 172.21.15.60:0/654752995 --> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f14ac0c7880 con 0x7f148c06be60 2024-09-12T02:23:09.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.443+0000 7f14a3fff640 1 -- 172.21.15.60:0/654752995 <== mgr.4098 v2:172.21.15.60:6800/3549430091 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246230 (secure 0 0 0) 0x7f149c004c40 con 0x7f148c06be60 2024-09-12T02:23:09.446 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:23:09.448 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T02:23:09.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.446+0000 7f14b185e640 1 -- 172.21.15.60:0/654752995 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f148c06be60 msgr2=0x7f148c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:09.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.446+0000 7f14b185e640 1 --2- 172.21.15.60:0/654752995 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f148c06be60 0x7f148c06e320 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f149c001560 tx=0x7f149c006040 comp rx=0 tx=0).stop 2024-09-12T02:23:09.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.446+0000 7f14b185e640 1 -- 172.21.15.60:0/654752995 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14ac0c7340 msgr2=0x7f14ac1e0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:09.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.446+0000 7f14b185e640 1 --2- 172.21.15.60:0/654752995 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14ac0c7340 0x7f14ac1e0d20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f14ac0c6570 tx=0x7f14a4011cf0 comp rx=0 tx=0).stop 2024-09-12T02:23:09.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.447+0000 7f14b185e640 1 -- 172.21.15.60:0/654752995 shutdown_connections 2024-09-12T02:23:09.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.447+0000 7f14b185e640 1 --2- 172.21.15.60:0/654752995 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f148c06be60 0x7f148c06e320 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:09.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.447+0000 7f14b185e640 1 --2- 172.21.15.60:0/654752995 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14ac0c7340 0x7f14ac1e0d20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:09.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.447+0000 7f14b185e640 1 --2- 172.21.15.60:0/654752995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14ac0c6ee0 0x7f14ac1e07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:09.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.447+0000 7f14b185e640 1 --2- 172.21.15.60:0/654752995 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1498004800 0x7f14ac1e1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:09.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.447+0000 7f14b185e640 1 -- 172.21.15.60:0/654752995 >> 172.21.15.60:0/654752995 conn(0x7f14ac0c87f0 msgr2=0x7f14ac0c9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:09.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.447+0000 7f14b185e640 1 -- 172.21.15.60:0/654752995 shutdown_connections 2024-09-12T02:23:09.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.447+0000 7f14b185e640 1 -- 172.21.15.60:0/654752995 wait complete. 2024-09-12T02:23:09.458 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-12T02:23:08.087492+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590528,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":165,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":124,"ondisk_log_size":124,"up":160,"acting":160,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":46,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":248020,"kb_used_data":2660,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754726700,"statfs":{"total":773094113280,"available":772840140800,"internally_reserved":0,"allocated":2723840,"data_stored":1676162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.343279"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.754084+0000","last_change":"2024-09-12T02:23:03.754084+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.754084+0000","last_undegraded":"2024-09-12T02:23:03.754084+0000","last_fullsized":"2024-09-12T02:23:03.754084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775715+0000","last_change":"2024-09-12T02:23:04.785821+0000","last_active":"2024-09-12T02:23:05.775715+0000","last_peered":"2024-09-12T02:23:05.775715+0000","last_clean":"2024-09-12T02:23:05.775715+0000","last_became_active":"2024-09-12T02:23:04.785516+0000","last_became_peered":"2024-09-12T02:23:04.785516+0000","last_unstale":"2024-09-12T02:23:05.775715+0000","last_undegraded":"2024-09-12T02:23:05.775715+0000","last_fullsized":"2024-09-12T02:23:05.775715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:42.400040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.757489+0000","last_change":"2024-09-12T02:23:03.757489+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.757489+0000","last_undegraded":"2024-09-12T02:23:03.757489+0000","last_fullsized":"2024-09-12T02:23:03.757489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.752762+0000","last_change":"2024-09-12T02:23:03.752762+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.752762+0000","last_undegraded":"2024-09-12T02:23:03.752762+0000","last_fullsized":"2024-09-12T02:23:03.752762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.757048+0000","last_change":"2024-09-12T02:23:03.757048+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.757048+0000","last_undegraded":"2024-09-12T02:23:03.757048+0000","last_fullsized":"2024-09-12T02:23:03.757048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.752859+0000","last_change":"2024-09-12T02:23:03.752859+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.752859+0000","last_undegraded":"2024-09-12T02:23:03.752859+0000","last_fullsized":"2024-09-12T02:23:03.752859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.971553+0000","last_change":"2024-09-12T02:23:04.779648+0000","last_active":"2024-09-12T02:23:06.971553+0000","last_peered":"2024-09-12T02:23:06.971553+0000","last_clean":"2024-09-12T02:23:06.971553+0000","last_became_active":"2024-09-12T02:23:04.779384+0000","last_became_peered":"2024-09-12T02:23:04.779384+0000","last_unstale":"2024-09-12T02:23:06.971553+0000","last_undegraded":"2024-09-12T02:23:06.971553+0000","last_fullsized":"2024-09-12T02:23:06.971553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:41.491471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.753523+0000","last_change":"2024-09-12T02:23:03.753523+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.753523+0000","last_undegraded":"2024-09-12T02:23:03.753523+0000","last_fullsized":"2024-09-12T02:23:03.753523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.764540+0000","last_change":"2024-09-12T02:23:03.764540+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.764540+0000","last_undegraded":"2024-09-12T02:23:03.764540+0000","last_fullsized":"2024-09-12T02:23:03.764540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.762349+0000","last_change":"2024-09-12T02:23:03.762349+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.762349+0000","last_undegraded":"2024-09-12T02:23:03.762349+0000","last_fullsized":"2024-09-12T02:23:03.762349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.971880+0000","last_change":"2024-09-12T02:23:04.782128+0000","last_active":"2024-09-12T02:23:06.971880+0000","last_peered":"2024-09-12T02:23:06.971880+0000","last_clean":"2024-09-12T02:23:06.971880+0000","last_became_active":"2024-09-12T02:23:04.781101+0000","last_became_peered":"2024-09-12T02:23:04.781101+0000","last_unstale":"2024-09-12T02:23:06.971880+0000","last_undegraded":"2024-09-12T02:23:06.971880+0000","last_fullsized":"2024-09-12T02:23:06.971880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:49.421147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775453+0000","last_change":"2024-09-12T02:23:04.782490+0000","last_active":"2024-09-12T02:23:05.775453+0000","last_peered":"2024-09-12T02:23:05.775453+0000","last_clean":"2024-09-12T02:23:05.775453+0000","last_became_active":"2024-09-12T02:23:04.782183+0000","last_became_peered":"2024-09-12T02:23:04.782183+0000","last_unstale":"2024-09-12T02:23:05.775453+0000","last_undegraded":"2024-09-12T02:23:05.775453+0000","last_fullsized":"2024-09-12T02:23:05.775453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:28.699880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.756668+0000","last_change":"2024-09-12T02:23:03.756668+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.756668+0000","last_undegraded":"2024-09-12T02:23:03.756668+0000","last_fullsized":"2024-09-12T02:23:03.756668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.755180+0000","last_change":"2024-09-12T02:23:03.755180+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.755180+0000","last_undegraded":"2024-09-12T02:23:03.755180+0000","last_fullsized":"2024-09-12T02:23:03.755180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.754603+0000","last_change":"2024-09-12T02:23:03.754603+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.754603+0000","last_undegraded":"2024-09-12T02:23:03.754603+0000","last_fullsized":"2024-09-12T02:23:03.754603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.760816+0000","last_change":"2024-09-12T02:23:03.760816+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.760816+0000","last_undegraded":"2024-09-12T02:23:03.760816+0000","last_fullsized":"2024-09-12T02:23:03.760816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.756587+0000","last_change":"2024-09-12T02:23:03.756587+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.756587+0000","last_undegraded":"2024-09-12T02:23:03.756587+0000","last_fullsized":"2024-09-12T02:23:03.756587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.971740+0000","last_change":"2024-09-12T02:23:04.788624+0000","last_active":"2024-09-12T02:23:06.971740+0000","last_peered":"2024-09-12T02:23:06.971740+0000","last_clean":"2024-09-12T02:23:06.971740+0000","last_became_active":"2024-09-12T02:23:04.788352+0000","last_became_peered":"2024-09-12T02:23:04.788352+0000","last_unstale":"2024-09-12T02:23:06.971740+0000","last_undegraded":"2024-09-12T02:23:06.971740+0000","last_fullsized":"2024-09-12T02:23:06.971740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:13.961110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.756225+0000","last_change":"2024-09-12T02:23:03.756225+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.756225+0000","last_undegraded":"2024-09-12T02:23:03.756225+0000","last_fullsized":"2024-09-12T02:23:03.756225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.972167+0000","last_change":"2024-09-12T02:23:04.787899+0000","last_active":"2024-09-12T02:23:06.972167+0000","last_peered":"2024-09-12T02:23:06.972167+0000","last_clean":"2024-09-12T02:23:06.972167+0000","last_became_active":"2024-09-12T02:23:04.787619+0000","last_became_peered":"2024-09-12T02:23:04.787619+0000","last_unstale":"2024-09-12T02:23:06.972167+0000","last_undegraded":"2024-09-12T02:23:06.972167+0000","last_fullsized":"2024-09-12T02:23:06.972167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:57.732453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.759049+0000","last_change":"2024-09-12T02:23:03.759049+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.759049+0000","last_undegraded":"2024-09-12T02:23:03.759049+0000","last_fullsized":"2024-09-12T02:23:03.759049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775630+0000","last_change":"2024-09-12T02:23:04.776435+0000","last_active":"2024-09-12T02:23:05.775630+0000","last_peered":"2024-09-12T02:23:05.775630+0000","last_clean":"2024-09-12T02:23:05.775630+0000","last_became_active":"2024-09-12T02:23:04.776120+0000","last_became_peered":"2024-09-12T02:23:04.776120+0000","last_unstale":"2024-09-12T02:23:05.775630+0000","last_undegraded":"2024-09-12T02:23:05.775630+0000","last_fullsized":"2024-09-12T02:23:05.775630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:27.985094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.972092+0000","last_change":"2024-09-12T02:23:04.789372+0000","last_active":"2024-09-12T02:23:06.972092+0000","last_peered":"2024-09-12T02:23:06.972092+0000","last_clean":"2024-09-12T02:23:06.972092+0000","last_became_active":"2024-09-12T02:23:04.789090+0000","last_became_peered":"2024-09-12T02:23:04.789090+0000","last_unstale":"2024-09-12T02:23:06.972092+0000","last_undegraded":"2024-09-12T02:23:06.972092+0000","last_fullsized":"2024-09-12T02:23:06.972092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:49.533491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.756132+0000","last_change":"2024-09-12T02:23:03.756132+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.756132+0000","last_undegraded":"2024-09-12T02:23:03.756132+0000","last_fullsized":"2024-09-12T02:23:03.756132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.764086+0000","last_change":"2024-09-12T02:23:03.764086+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.764086+0000","last_undegraded":"2024-09-12T02:23:03.764086+0000","last_fullsized":"2024-09-12T02:23:03.764086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.972043+0000","last_change":"2024-09-12T02:23:03.764310+0000","last_active":"2024-09-12T02:23:06.972043+0000","last_peered":"2024-09-12T02:23:06.972043+0000","last_clean":"2024-09-12T02:23:06.972043+0000","last_became_active":"2024-09-12T02:23:03.764020+0000","last_became_peered":"2024-09-12T02:23:03.764020+0000","last_unstale":"2024-09-12T02:23:06.972043+0000","last_undegraded":"2024-09-12T02:23:06.972043+0000","last_fullsized":"2024-09-12T02:23:06.972043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:25.892874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.770609+0000","last_change":"2024-09-12T02:23:03.768186+0000","last_active":"2024-09-12T02:23:03.770609+0000","last_peered":"2024-09-12T02:23:03.770609+0000","last_clean":"2024-09-12T02:23:03.770609+0000","last_became_active":"2024-09-12T02:23:03.767916+0000","last_became_peered":"2024-09-12T02:23:03.767916+0000","last_unstale":"2024-09-12T02:23:03.770609+0000","last_undegraded":"2024-09-12T02:23:03.770609+0000","last_fullsized":"2024-09-12T02:23:03.770609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:12.165660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.971673+0000","last_change":"2024-09-12T02:23:03.768361+0000","last_active":"2024-09-12T02:23:06.971673+0000","last_peered":"2024-09-12T02:23:06.971673+0000","last_clean":"2024-09-12T02:23:06.971673+0000","last_became_active":"2024-09-12T02:23:03.768137+0000","last_became_peered":"2024-09-12T02:23:03.768137+0000","last_unstale":"2024-09-12T02:23:06.971673+0000","last_undegraded":"2024-09-12T02:23:06.971673+0000","last_fullsized":"2024-09-12T02:23:06.971673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:29.721363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.971707+0000","last_change":"2024-09-12T02:23:04.783317+0000","last_active":"2024-09-12T02:23:06.971707+0000","last_peered":"2024-09-12T02:23:06.971707+0000","last_clean":"2024-09-12T02:23:06.971707+0000","last_became_active":"2024-09-12T02:23:04.783039+0000","last_became_peered":"2024-09-12T02:23:04.783039+0000","last_unstale":"2024-09-12T02:23:06.971707+0000","last_undegraded":"2024-09-12T02:23:06.971707+0000","last_fullsized":"2024-09-12T02:23:06.971707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:17.577991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.767515+0000","last_change":"2024-09-12T02:23:03.762450+0000","last_active":"2024-09-12T02:23:03.767515+0000","last_peered":"2024-09-12T02:23:03.767515+0000","last_clean":"2024-09-12T02:23:03.767515+0000","last_became_active":"2024-09-12T02:23:03.762161+0000","last_became_peered":"2024-09-12T02:23:03.762161+0000","last_unstale":"2024-09-12T02:23:03.767515+0000","last_undegraded":"2024-09-12T02:23:03.767515+0000","last_fullsized":"2024-09-12T02:23:03.767515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:20.943756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775427+0000","last_change":"2024-09-12T02:23:04.776572+0000","last_active":"2024-09-12T02:23:05.775427+0000","last_peered":"2024-09-12T02:23:05.775427+0000","last_clean":"2024-09-12T02:23:05.775427+0000","last_became_active":"2024-09-12T02:23:04.776270+0000","last_became_peered":"2024-09-12T02:23:04.776270+0000","last_unstale":"2024-09-12T02:23:05.775427+0000","last_undegraded":"2024-09-12T02:23:05.775427+0000","last_fullsized":"2024-09-12T02:23:05.775427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:12.807907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.771948+0000","last_change":"2024-09-12T02:23:03.770668+0000","last_active":"2024-09-12T02:23:03.771948+0000","last_peered":"2024-09-12T02:23:03.771948+0000","last_clean":"2024-09-12T02:23:03.771948+0000","last_became_active":"2024-09-12T02:23:03.769302+0000","last_became_peered":"2024-09-12T02:23:03.769302+0000","last_unstale":"2024-09-12T02:23:03.771948+0000","last_undegraded":"2024-09-12T02:23:03.771948+0000","last_fullsized":"2024-09-12T02:23:03.771948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:58.341188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.757235+0000","last_change":"2024-09-12T02:23:03.757235+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.757235+0000","last_undegraded":"2024-09-12T02:23:03.757235+0000","last_fullsized":"2024-09-12T02:23:03.757235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.774780+0000","last_change":"2024-09-12T02:23:03.769710+0000","last_active":"2024-09-12T02:23:03.774780+0000","last_peered":"2024-09-12T02:23:03.774780+0000","last_clean":"2024-09-12T02:23:03.774780+0000","last_became_active":"2024-09-12T02:23:03.769436+0000","last_became_peered":"2024-09-12T02:23:03.769436+0000","last_unstale":"2024-09-12T02:23:03.774780+0000","last_undegraded":"2024-09-12T02:23:03.774780+0000","last_fullsized":"2024-09-12T02:23:03.774780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:05.383995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775627+0000","last_change":"2024-09-12T02:23:03.771271+0000","last_active":"2024-09-12T02:23:05.775627+0000","last_peered":"2024-09-12T02:23:05.775627+0000","last_clean":"2024-09-12T02:23:05.775627+0000","last_became_active":"2024-09-12T02:23:03.769601+0000","last_became_peered":"2024-09-12T02:23:03.769601+0000","last_unstale":"2024-09-12T02:23:05.775627+0000","last_undegraded":"2024-09-12T02:23:05.775627+0000","last_fullsized":"2024-09-12T02:23:05.775627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:22.910072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.770888+0000","last_change":"2024-09-12T02:23:03.768425+0000","last_active":"2024-09-12T02:23:03.770888+0000","last_peered":"2024-09-12T02:23:03.770888+0000","last_clean":"2024-09-12T02:23:03.770888+0000","last_became_active":"2024-09-12T02:23:03.768092+0000","last_became_peered":"2024-09-12T02:23:03.768092+0000","last_unstale":"2024-09-12T02:23:03.770888+0000","last_undegraded":"2024-09-12T02:23:03.770888+0000","last_fullsized":"2024-09-12T02:23:03.770888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:57.887914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.755898+0000","last_change":"2024-09-12T02:23:03.755898+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.755898+0000","last_undegraded":"2024-09-12T02:23:03.755898+0000","last_fullsized":"2024-09-12T02:23:03.755898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:23:02.750891+0000","last_change":"2024-09-12T02:23:02.750891+0000","last_active":"2024-09-12T02:23:02.739281+0000","last_peered":"2024-09-12T02:23:02.739281+0000","last_clean":"2024-09-12T02:23:02.739281+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:02.750891+0000","last_undegraded":"2024-09-12T02:23:02.750891+0000","last_fullsized":"2024-09-12T02:23:02.750891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.769019+0000","last_change":"2024-09-12T02:23:03.767217+0000","last_active":"2024-09-12T02:23:03.769019+0000","last_peered":"2024-09-12T02:23:03.769019+0000","last_clean":"2024-09-12T02:23:03.769019+0000","last_became_active":"2024-09-12T02:23:03.766551+0000","last_became_peered":"2024-09-12T02:23:03.766551+0000","last_unstale":"2024-09-12T02:23:03.769019+0000","last_undegraded":"2024-09-12T02:23:03.769019+0000","last_fullsized":"2024-09-12T02:23:03.769019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:30.824294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.752149+0000","last_change":"2024-09-12T02:23:03.752149+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.752149+0000","last_undegraded":"2024-09-12T02:23:03.752149+0000","last_fullsized":"2024-09-12T02:23:03.752149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.769127+0000","last_change":"2024-09-12T02:23:03.767842+0000","last_active":"2024-09-12T02:23:03.769127+0000","last_peered":"2024-09-12T02:23:03.769127+0000","last_clean":"2024-09-12T02:23:03.769127+0000","last_became_active":"2024-09-12T02:23:03.767066+0000","last_became_peered":"2024-09-12T02:23:03.767066+0000","last_unstale":"2024-09-12T02:23:03.769127+0000","last_undegraded":"2024-09-12T02:23:03.769127+0000","last_fullsized":"2024-09-12T02:23:03.769127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:03.108197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.759935+0000","last_change":"2024-09-12T02:23:03.759935+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.759935+0000","last_undegraded":"2024-09-12T02:23:03.759935+0000","last_fullsized":"2024-09-12T02:23:03.759935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:23:02.748375+0000","last_change":"2024-09-12T02:23:02.748375+0000","last_active":"2024-09-12T02:23:02.739281+0000","last_peered":"2024-09-12T02:23:02.739281+0000","last_clean":"2024-09-12T02:23:02.739281+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:02.748375+0000","last_undegraded":"2024-09-12T02:23:02.748375+0000","last_fullsized":"2024-09-12T02:23:02.748375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.752312+0000","last_change":"2024-09-12T02:23:03.752312+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.752312+0000","last_undegraded":"2024-09-12T02:23:03.752312+0000","last_fullsized":"2024-09-12T02:23:03.752312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:23:02.746308+0000","last_change":"2024-09-12T02:23:02.746308+0000","last_active":"2024-09-12T02:23:02.739281+0000","last_peered":"2024-09-12T02:23:02.739281+0000","last_clean":"2024-09-12T02:23:02.739281+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:02.746308+0000","last_undegraded":"2024-09-12T02:23:02.746308+0000","last_fullsized":"2024-09-12T02:23:02.746308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.753058+0000","last_change":"2024-09-12T02:23:03.753058+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.753058+0000","last_undegraded":"2024-09-12T02:23:03.753058+0000","last_fullsized":"2024-09-12T02:23:03.753058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:23:02.749018+0000","last_change":"2024-09-12T02:23:02.749018+0000","last_active":"2024-09-12T02:23:02.739281+0000","last_peered":"2024-09-12T02:23:02.739281+0000","last_clean":"2024-09-12T02:23:02.739281+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:02.749018+0000","last_undegraded":"2024-09-12T02:23:02.749018+0000","last_fullsized":"2024-09-12T02:23:02.749018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.753029+0000","last_change":"2024-09-12T02:23:03.753029+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.753029+0000","last_undegraded":"2024-09-12T02:23:03.753029+0000","last_fullsized":"2024-09-12T02:23:03.753029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775732+0000","last_change":"2024-09-12T02:23:03.766034+0000","last_active":"2024-09-12T02:23:05.775732+0000","last_peered":"2024-09-12T02:23:05.775732+0000","last_clean":"2024-09-12T02:23:05.775732+0000","last_became_active":"2024-09-12T02:23:03.765735+0000","last_became_peered":"2024-09-12T02:23:03.765735+0000","last_unstale":"2024-09-12T02:23:05.775732+0000","last_undegraded":"2024-09-12T02:23:05.775732+0000","last_fullsized":"2024-09-12T02:23:05.775732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:19.691229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.755917+0000","last_change":"2024-09-12T02:23:03.755917+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.755917+0000","last_undegraded":"2024-09-12T02:23:03.755917+0000","last_fullsized":"2024-09-12T02:23:03.755917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:23:02.748818+0000","last_change":"2024-09-12T02:23:02.748818+0000","last_active":"2024-09-12T02:23:02.739281+0000","last_peered":"2024-09-12T02:23:02.739281+0000","last_clean":"2024-09-12T02:23:02.739281+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:02.748818+0000","last_undegraded":"2024-09-12T02:23:02.748818+0000","last_fullsized":"2024-09-12T02:23:02.748818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.755050+0000","last_change":"2024-09-12T02:23:03.755050+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.755050+0000","last_undegraded":"2024-09-12T02:23:03.755050+0000","last_fullsized":"2024-09-12T02:23:03.755050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":166,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.757667+0000","last_change":"2024-09-12T02:22:55.143869+0000","last_active":"2024-09-12T02:23:03.757667+0000","last_peered":"2024-09-12T02:23:03.757667+0000","last_clean":"2024-09-12T02:23:03.757667+0000","last_became_active":"2024-09-12T02:22:55.142784+0000","last_became_peered":"2024-09-12T02:22:55.142784+0000","last_unstale":"2024-09-12T02:23:03.757667+0000","last_undegraded":"2024-09-12T02:23:03.757667+0000","last_fullsized":"2024-09-12T02:23:03.757667+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:22:52.457979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:22:52.457979+0000","last_clean_scrub_stamp":"2024-09-12T02:22:52.457979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:46.152602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.768867+0000","last_change":"2024-09-12T02:23:03.765100+0000","last_active":"2024-09-12T02:23:03.768867+0000","last_peered":"2024-09-12T02:23:03.768867+0000","last_clean":"2024-09-12T02:23:03.768867+0000","last_became_active":"2024-09-12T02:23:03.764801+0000","last_became_peered":"2024-09-12T02:23:03.764801+0000","last_unstale":"2024-09-12T02:23:03.768867+0000","last_undegraded":"2024-09-12T02:23:03.768867+0000","last_fullsized":"2024-09-12T02:23:03.768867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:29.776974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.971912+0000","last_change":"2024-09-12T02:23:04.781839+0000","last_active":"2024-09-12T02:23:06.971912+0000","last_peered":"2024-09-12T02:23:06.971912+0000","last_clean":"2024-09-12T02:23:06.971912+0000","last_became_active":"2024-09-12T02:23:04.780984+0000","last_became_peered":"2024-09-12T02:23:04.780984+0000","last_unstale":"2024-09-12T02:23:06.971912+0000","last_undegraded":"2024-09-12T02:23:06.971912+0000","last_fullsized":"2024-09-12T02:23:06.971912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:07.692791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.775844+0000","last_change":"2024-09-12T02:23:03.771625+0000","last_active":"2024-09-12T02:23:03.775844+0000","last_peered":"2024-09-12T02:23:03.775844+0000","last_clean":"2024-09-12T02:23:03.775844+0000","last_became_active":"2024-09-12T02:23:03.771163+0000","last_became_peered":"2024-09-12T02:23:03.771163+0000","last_unstale":"2024-09-12T02:23:03.775844+0000","last_undegraded":"2024-09-12T02:23:03.775844+0000","last_fullsized":"2024-09-12T02:23:03.775844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:40.982318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:23:02.748347+0000","last_change":"2024-09-12T02:23:02.748347+0000","last_active":"2024-09-12T02:23:02.739281+0000","last_peered":"2024-09-12T02:23:02.739281+0000","last_clean":"2024-09-12T02:23:02.739281+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:02.748347+0000","last_undegraded":"2024-09-12T02:23:02.748347+0000","last_fullsized":"2024-09-12T02:23:02.748347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775441+0000","last_change":"2024-09-12T02:23:04.773745+0000","last_active":"2024-09-12T02:23:05.775441+0000","last_peered":"2024-09-12T02:23:05.775441+0000","last_clean":"2024-09-12T02:23:05.775441+0000","last_became_active":"2024-09-12T02:23:04.773360+0000","last_became_peered":"2024-09-12T02:23:04.773360+0000","last_unstale":"2024-09-12T02:23:05.775441+0000","last_undegraded":"2024-09-12T02:23:05.775441+0000","last_fullsized":"2024-09-12T02:23:05.775441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:33.097774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.775764+0000","last_change":"2024-09-12T02:23:03.771518+0000","last_active":"2024-09-12T02:23:03.775764+0000","last_peered":"2024-09-12T02:23:03.775764+0000","last_clean":"2024-09-12T02:23:03.775764+0000","last_became_active":"2024-09-12T02:23:03.771063+0000","last_became_peered":"2024-09-12T02:23:03.771063+0000","last_unstale":"2024-09-12T02:23:03.775764+0000","last_undegraded":"2024-09-12T02:23:03.775764+0000","last_fullsized":"2024-09-12T02:23:03.775764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:01.694099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775663+0000","last_change":"2024-09-12T02:23:03.769913+0000","last_active":"2024-09-12T02:23:05.775663+0000","last_peered":"2024-09-12T02:23:05.775663+0000","last_clean":"2024-09-12T02:23:05.775663+0000","last_became_active":"2024-09-12T02:23:03.769444+0000","last_became_peered":"2024-09-12T02:23:03.769444+0000","last_unstale":"2024-09-12T02:23:05.775663+0000","last_undegraded":"2024-09-12T02:23:05.775663+0000","last_fullsized":"2024-09-12T02:23:05.775663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:21.243182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.754756+0000","last_change":"2024-09-12T02:23:03.754756+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.754756+0000","last_undegraded":"2024-09-12T02:23:03.754756+0000","last_fullsized":"2024-09-12T02:23:03.754756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.767766+0000","last_change":"2024-09-12T02:23:03.764093+0000","last_active":"2024-09-12T02:23:03.767766+0000","last_peered":"2024-09-12T02:23:03.767766+0000","last_clean":"2024-09-12T02:23:03.767766+0000","last_became_active":"2024-09-12T02:23:03.763147+0000","last_became_peered":"2024-09-12T02:23:03.763147+0000","last_unstale":"2024-09-12T02:23:03.767766+0000","last_undegraded":"2024-09-12T02:23:03.767766+0000","last_fullsized":"2024-09-12T02:23:03.767766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:59.022658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775631+0000","last_change":"2024-09-12T02:23:04.775876+0000","last_active":"2024-09-12T02:23:05.775631+0000","last_peered":"2024-09-12T02:23:05.775631+0000","last_clean":"2024-09-12T02:23:05.775631+0000","last_became_active":"2024-09-12T02:23:04.775571+0000","last_became_peered":"2024-09-12T02:23:04.775571+0000","last_unstale":"2024-09-12T02:23:05.775631+0000","last_undegraded":"2024-09-12T02:23:05.775631+0000","last_fullsized":"2024-09-12T02:23:05.775631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:05.070528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.772082+0000","last_change":"2024-09-12T02:23:03.769745+0000","last_active":"2024-09-12T02:23:06.772082+0000","last_peered":"2024-09-12T02:23:06.772082+0000","last_clean":"2024-09-12T02:23:06.772082+0000","last_became_active":"2024-09-12T02:23:03.769410+0000","last_became_peered":"2024-09-12T02:23:03.769410+0000","last_unstale":"2024-09-12T02:23:06.772082+0000","last_undegraded":"2024-09-12T02:23:06.772082+0000","last_fullsized":"2024-09-12T02:23:06.772082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:00.414459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.972214+0000","last_change":"2024-09-12T02:23:04.786424+0000","last_active":"2024-09-12T02:23:06.972214+0000","last_peered":"2024-09-12T02:23:06.972214+0000","last_clean":"2024-09-12T02:23:06.972214+0000","last_became_active":"2024-09-12T02:23:04.786136+0000","last_became_peered":"2024-09-12T02:23:04.786136+0000","last_unstale":"2024-09-12T02:23:06.972214+0000","last_undegraded":"2024-09-12T02:23:06.972214+0000","last_fullsized":"2024-09-12T02:23:06.972214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:31.214894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.774760+0000","last_change":"2024-09-12T02:23:03.771259+0000","last_active":"2024-09-12T02:23:03.774760+0000","last_peered":"2024-09-12T02:23:03.774760+0000","last_clean":"2024-09-12T02:23:03.774760+0000","last_became_active":"2024-09-12T02:23:03.770687+0000","last_became_peered":"2024-09-12T02:23:03.770687+0000","last_unstale":"2024-09-12T02:23:03.774760+0000","last_undegraded":"2024-09-12T02:23:03.774760+0000","last_fullsized":"2024-09-12T02:23:03.774760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:40.804626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.768159+0000","last_change":"2024-09-12T02:23:03.764530+0000","last_active":"2024-09-12T02:23:03.768159+0000","last_peered":"2024-09-12T02:23:03.768159+0000","last_clean":"2024-09-12T02:23:03.768159+0000","last_became_active":"2024-09-12T02:23:03.764218+0000","last_became_peered":"2024-09-12T02:23:03.764218+0000","last_unstale":"2024-09-12T02:23:03.768159+0000","last_undegraded":"2024-09-12T02:23:03.768159+0000","last_fullsized":"2024-09-12T02:23:03.768159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:30:36.651697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775580+0000","last_change":"2024-09-12T02:23:03.770581+0000","last_active":"2024-09-12T02:23:05.775580+0000","last_peered":"2024-09-12T02:23:05.775580+0000","last_clean":"2024-09-12T02:23:05.775580+0000","last_became_active":"2024-09-12T02:23:03.769406+0000","last_became_peered":"2024-09-12T02:23:03.769406+0000","last_unstale":"2024-09-12T02:23:05.775580+0000","last_undegraded":"2024-09-12T02:23:05.775580+0000","last_fullsized":"2024-09-12T02:23:05.775580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:20.963819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.971722+0000","last_change":"2024-09-12T02:23:04.783991+0000","last_active":"2024-09-12T02:23:06.971722+0000","last_peered":"2024-09-12T02:23:06.971722+0000","last_clean":"2024-09-12T02:23:06.971722+0000","last_became_active":"2024-09-12T02:23:04.783143+0000","last_became_peered":"2024-09-12T02:23:04.783143+0000","last_unstale":"2024-09-12T02:23:06.971722+0000","last_undegraded":"2024-09-12T02:23:06.971722+0000","last_fullsized":"2024-09-12T02:23:06.971722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:53.940843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775526+0000","last_change":"2024-09-12T02:23:03.771468+0000","last_active":"2024-09-12T02:23:05.775526+0000","last_peered":"2024-09-12T02:23:05.775526+0000","last_clean":"2024-09-12T02:23:05.775526+0000","last_became_active":"2024-09-12T02:23:03.769619+0000","last_became_peered":"2024-09-12T02:23:03.769619+0000","last_unstale":"2024-09-12T02:23:05.775526+0000","last_undegraded":"2024-09-12T02:23:05.775526+0000","last_fullsized":"2024-09-12T02:23:05.775526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:38.422369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.971928+0000","last_change":"2024-09-12T02:23:04.782769+0000","last_active":"2024-09-12T02:23:06.971928+0000","last_peered":"2024-09-12T02:23:06.971928+0000","last_clean":"2024-09-12T02:23:06.971928+0000","last_became_active":"2024-09-12T02:23:04.782472+0000","last_became_peered":"2024-09-12T02:23:04.782472+0000","last_unstale":"2024-09-12T02:23:06.971928+0000","last_undegraded":"2024-09-12T02:23:06.971928+0000","last_fullsized":"2024-09-12T02:23:06.971928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:46.144471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.767373+0000","last_change":"2024-09-12T02:23:03.763423+0000","last_active":"2024-09-12T02:23:03.767373+0000","last_peered":"2024-09-12T02:23:03.767373+0000","last_clean":"2024-09-12T02:23:03.767373+0000","last_became_active":"2024-09-12T02:23:03.762627+0000","last_became_peered":"2024-09-12T02:23:03.762627+0000","last_unstale":"2024-09-12T02:23:03.767373+0000","last_undegraded":"2024-09-12T02:23:03.767373+0000","last_fullsized":"2024-09-12T02:23:03.767373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:57.229819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.763456+0000","last_change":"2024-09-12T02:23:03.763456+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.763456+0000","last_undegraded":"2024-09-12T02:23:03.763456+0000","last_fullsized":"2024-09-12T02:23:03.763456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.755355+0000","last_change":"2024-09-12T02:23:03.755355+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.755355+0000","last_undegraded":"2024-09-12T02:23:03.755355+0000","last_fullsized":"2024-09-12T02:23:03.755355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.767401+0000","last_change":"2024-09-12T02:23:03.763480+0000","last_active":"2024-09-12T02:23:03.767401+0000","last_peered":"2024-09-12T02:23:03.767401+0000","last_clean":"2024-09-12T02:23:03.767401+0000","last_became_active":"2024-09-12T02:23:03.762464+0000","last_became_peered":"2024-09-12T02:23:03.762464+0000","last_unstale":"2024-09-12T02:23:03.767401+0000","last_undegraded":"2024-09-12T02:23:03.767401+0000","last_fullsized":"2024-09-12T02:23:03.767401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:41.711677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T02:23:03.756378+0000","last_change":"2024-09-12T02:23:03.756378+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.756378+0000","last_undegraded":"2024-09-12T02:23:03.756378+0000","last_fullsized":"2024-09-12T02:23:03.756378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T02:23:03.770326+0000","last_change":"2024-09-12T02:23:03.767875+0000","last_active":"2024-09-12T02:23:03.770326+0000","last_peered":"2024-09-12T02:23:03.770326+0000","last_clean":"2024-09-12T02:23:03.770326+0000","last_became_active":"2024-09-12T02:23:03.767596+0000","last_became_peered":"2024-09-12T02:23:03.767596+0000","last_unstale":"2024-09-12T02:23:03.770326+0000","last_undegraded":"2024-09-12T02:23:03.770326+0000","last_fullsized":"2024-09-12T02:23:03.770326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:49.553353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T02:23:03.743776+0000","last_change":"2024-09-12T02:23:03.743776+0000","last_active":"2024-09-12T02:23:03.743776+0000","last_peered":"2024-09-12T02:23:03.743776+0000","last_clean":"2024-09-12T02:23:03.743776+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:03.743776+0000","last_undegraded":"2024-09-12T02:23:03.743776+0000","last_fullsized":"2024-09-12T02:23:03.743776+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.972111+0000","last_change":"2024-09-12T02:23:03.767076+0000","last_active":"2024-09-12T02:23:06.972111+0000","last_peered":"2024-09-12T02:23:06.972111+0000","last_clean":"2024-09-12T02:23:06.972111+0000","last_became_active":"2024-09-12T02:23:03.766686+0000","last_became_peered":"2024-09-12T02:23:03.766686+0000","last_unstale":"2024-09-12T02:23:06.972111+0000","last_undegraded":"2024-09-12T02:23:06.972111+0000","last_fullsized":"2024-09-12T02:23:06.972111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:45.706208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.972148+0000","last_change":"2024-09-12T02:23:04.790549+0000","last_active":"2024-09-12T02:23:06.972148+0000","last_peered":"2024-09-12T02:23:06.972148+0000","last_clean":"2024-09-12T02:23:06.972148+0000","last_became_active":"2024-09-12T02:23:04.790187+0000","last_became_peered":"2024-09-12T02:23:04.790187+0000","last_unstale":"2024-09-12T02:23:06.972148+0000","last_undegraded":"2024-09-12T02:23:06.972148+0000","last_fullsized":"2024-09-12T02:23:06.972148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:49.656395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-12T02:23:02.749985+0000","last_change":"2024-09-12T02:23:02.749985+0000","last_active":"2024-09-12T02:23:02.739281+0000","last_peered":"2024-09-12T02:23:02.739281+0000","last_clean":"2024-09-12T02:23:02.739281+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T02:23:02.749985+0000","last_undegraded":"2024-09-12T02:23:02.749985+0000","last_fullsized":"2024-09-12T02:23:02.749985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":94,"acting":94,"num_store_stats":5},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476741,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":774144,"data_stored":647200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476741,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":192512,"data_stored":63092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476742,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":192512,"data_stored":63092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":180224,"data_stored":56832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509443,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31360,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340480,"statfs":{"total":96636764160,"available":96604651520,"internally_reserved":0,"allocated":167936,"data_stored":51025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36104,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335736,"statfs":{"total":96636764160,"available":96599793664,"internally_reserved":0,"allocated":774144,"data_stored":647200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35568,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336272,"statfs":{"total":96636764160,"available":96600342528,"internally_reserved":0,"allocated":217088,"data_stored":71449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35568,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336272,"statfs":{"total":96636764160,"available":96600342528,"internally_reserved":0,"allocated":225280,"data_stored":76272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:23:09.465 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3f is not active+clean 2024-09-12T02:23:09.465 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:23:03.754084+0000', 'last_change': '2024-09-12T02:23:03.754084+0000', 'last_active': '2024-09-12T02:23:03.743776+0000', 'last_peered': '2024-09-12T02:23:03.743776+0000', 'last_clean': '2024-09-12T02:23:03.743776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:03.754084+0000', 'last_undegraded': '2024-09-12T02:23:03.754084+0000', 'last_fullsized': '2024-09-12T02:23:03.754084+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T02:23:09.465 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3d is not active+clean 2024-09-12T02:23:09.465 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T02:23:03.743776+0000', 'last_change': '2024-09-12T02:23:03.743776+0000', 'last_active': '2024-09-12T02:23:03.743776+0000', 'last_peered': '2024-09-12T02:23:03.743776+0000', 'last_clean': '2024-09-12T02:23:03.743776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:03.743776+0000', 'last_undegraded': '2024-09-12T02:23:03.743776+0000', 'last_fullsized': '2024-09-12T02:23:03.743776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T02:23:09.465 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3c is not active+clean 2024-09-12T02:23:09.465 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:23:03.757489+0000', 'last_change': '2024-09-12T02:23:03.757489+0000', 'last_active': '2024-09-12T02:23:03.743776+0000', 'last_peered': '2024-09-12T02:23:03.743776+0000', 'last_clean': '2024-09-12T02:23:03.743776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:03.757489+0000', 'last_undegraded': '2024-09-12T02:23:03.757489+0000', 'last_fullsized': '2024-09-12T02:23:03.757489+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T02:23:09.466 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3b is not active+clean 2024-09-12T02:23:09.466 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:23:03.752762+0000', 'last_change': '2024-09-12T02:23:03.752762+0000', 'last_active': '2024-09-12T02:23:03.743776+0000', 'last_peered': '2024-09-12T02:23:03.743776+0000', 'last_clean': '2024-09-12T02:23:03.743776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:03.752762+0000', 'last_undegraded': '2024-09-12T02:23:03.752762+0000', 'last_fullsized': '2024-09-12T02:23:03.752762+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T02:23:09.466 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3a is not active+clean 2024-09-12T02:23:09.466 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:23:03.757048+0000', 'last_change': '2024-09-12T02:23:03.757048+0000', 'last_active': '2024-09-12T02:23:03.743776+0000', 'last_peered': '2024-09-12T02:23:03.743776+0000', 'last_clean': '2024-09-12T02:23:03.743776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:03.757048+0000', 'last_undegraded': '2024-09-12T02:23:03.757048+0000', 'last_fullsized': '2024-09-12T02:23:03.757048+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T02:23:09.466 INFO:tasks.ceph.ceph_manager.ceph:PG 3.39 is not active+clean 2024-09-12T02:23:09.466 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:23:03.752859+0000', 'last_change': '2024-09-12T02:23:03.752859+0000', 'last_active': '2024-09-12T02:23:03.743776+0000', 'last_peered': '2024-09-12T02:23:03.743776+0000', 'last_clean': '2024-09-12T02:23:03.743776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:03.752859+0000', 'last_undegraded': '2024-09-12T02:23:03.752859+0000', 'last_fullsized': '2024-09-12T02:23:03.752859+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T02:23:09.466 INFO:tasks.ceph.ceph_manager.ceph:PG 3.37 is not active+clean 2024-09-12T02:23:09.466 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:23:03.753523+0000', 'last_change': '2024-09-12T02:23:03.753523+0000', 'last_active': '2024-09-12T02:23:03.743776+0000', 'last_peered': '2024-09-12T02:23:03.743776+0000', 'last_clean': '2024-09-12T02:23:03.743776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:03.753523+0000', 'last_undegraded': '2024-09-12T02:23:03.753523+0000', 'last_fullsized': '2024-09-12T02:23:03.753523+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T02:23:09.466 INFO:tasks.ceph.ceph_manager.ceph:PG 3.36 is not active+clean 2024-09-12T02:23:09.466 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:23:03.764540+0000', 'last_change': '2024-09-12T02:23:03.764540+0000', 'last_active': '2024-09-12T02:23:03.743776+0000', 'last_peered': '2024-09-12T02:23:03.743776+0000', 'last_clean': '2024-09-12T02:23:03.743776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:03.764540+0000', 'last_undegraded': '2024-09-12T02:23:03.764540+0000', 'last_fullsized': '2024-09-12T02:23:03.764540+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T02:23:09.466 INFO:tasks.ceph.ceph_manager.ceph:PG 3.35 is not active+clean 2024-09-12T02:23:09.467 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:23:03.762349+0000', 'last_change': '2024-09-12T02:23:03.762349+0000', 'last_active': '2024-09-12T02:23:03.743776+0000', 'last_peered': '2024-09-12T02:23:03.743776+0000', 'last_clean': '2024-09-12T02:23:03.743776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:03.762349+0000', 'last_undegraded': '2024-09-12T02:23:03.762349+0000', 'last_fullsized': '2024-09-12T02:23:03.762349+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T02:23:09.467 INFO:tasks.ceph.ceph_manager.ceph:PG 3.34 is not active+clean 2024-09-12T02:23:09.467 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T02:23:03.743776+0000', 'last_change': '2024-09-12T02:23:03.743776+0000', 'last_active': '2024-09-12T02:23:03.743776+0000', 'last_peered': '2024-09-12T02:23:03.743776+0000', 'last_clean': '2024-09-12T02:23:03.743776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:03.743776+0000', 'last_undegraded': '2024-09-12T02:23:03.743776+0000', 'last_fullsized': '2024-09-12T02:23:03.743776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T02:23:09.467 INFO:tasks.ceph.ceph_manager.ceph:PG 3.32 is not active+clean 2024-09-12T02:23:09.467 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T02:23:03.743776+0000', 'last_change': '2024-09-12T02:23:03.743776+0000', 'last_active': '2024-09-12T02:23:03.743776+0000', 'last_peered': '2024-09-12T02:23:03.743776+0000', 'last_clean': '2024-09-12T02:23:03.743776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:03.743776+0000', 'last_undegraded': '2024-09-12T02:23:03.743776+0000', 'last_fullsized': '2024-09-12T02:23:03.743776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T02:23:09.467 INFO:tasks.ceph.ceph_manager.ceph:PG 3.30 is not active+clean 2024-09-12T02:23:09.467 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:23:03.756668+0000', 'last_change': '2024-09-12T02:23:03.756668+0000', 'last_active': '2024-09-12T02:23:03.743776+0000', 'last_peered': '2024-09-12T02:23:03.743776+0000', 'last_clean': '2024-09-12T02:23:03.743776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:03.756668+0000', 'last_undegraded': '2024-09-12T02:23:03.756668+0000', 'last_fullsized': '2024-09-12T02:23:03.756668+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T02:23:09.467 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2f is not active+clean 2024-09-12T02:23:09.467 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:23:03.755180+0000', 'last_change': '2024-09-12T02:23:03.755180+0000', 'last_active': '2024-09-12T02:23:03.743776+0000', 'last_peered': '2024-09-12T02:23:03.743776+0000', 'last_clean': '2024-09-12T02:23:03.743776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:03.755180+0000', 'last_undegraded': '2024-09-12T02:23:03.755180+0000', 'last_fullsized': '2024-09-12T02:23:03.755180+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T02:23:09.467 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2e is not active+clean 2024-09-12T02:23:09.467 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T02:23:03.743776+0000', 'last_change': '2024-09-12T02:23:03.743776+0000', 'last_active': '2024-09-12T02:23:03.743776+0000', 'last_peered': '2024-09-12T02:23:03.743776+0000', 'last_clean': '2024-09-12T02:23:03.743776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:03.743776+0000', 'last_undegraded': '2024-09-12T02:23:03.743776+0000', 'last_fullsized': '2024-09-12T02:23:03.743776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T02:23:09.468 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2d is not active+clean 2024-09-12T02:23:09.468 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:23:03.754603+0000', 'last_change': '2024-09-12T02:23:03.754603+0000', 'last_active': '2024-09-12T02:23:03.743776+0000', 'last_peered': '2024-09-12T02:23:03.743776+0000', 'last_clean': '2024-09-12T02:23:03.743776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:03.754603+0000', 'last_undegraded': '2024-09-12T02:23:03.754603+0000', 'last_fullsized': '2024-09-12T02:23:03.754603+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T02:23:09.468 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2c is not active+clean 2024-09-12T02:23:09.468 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:23:03.760816+0000', 'last_change': '2024-09-12T02:23:03.760816+0000', 'last_active': '2024-09-12T02:23:03.743776+0000', 'last_peered': '2024-09-12T02:23:03.743776+0000', 'last_clean': '2024-09-12T02:23:03.743776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:03.760816+0000', 'last_undegraded': '2024-09-12T02:23:03.760816+0000', 'last_fullsized': '2024-09-12T02:23:03.760816+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T02:23:09.468 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2b is not active+clean 2024-09-12T02:23:09.468 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T02:23:03.743776+0000', 'last_change': '2024-09-12T02:23:03.743776+0000', 'last_active': '2024-09-12T02:23:03.743776+0000', 'last_peered': '2024-09-12T02:23:03.743776+0000', 'last_clean': '2024-09-12T02:23:03.743776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:03.743776+0000', 'last_undegraded': '2024-09-12T02:23:03.743776+0000', 'last_fullsized': '2024-09-12T02:23:03.743776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T02:23:09.468 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2a is not active+clean 2024-09-12T02:23:09.468 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:23:03.756587+0000', 'last_change': '2024-09-12T02:23:03.756587+0000', 'last_active': '2024-09-12T02:23:03.743776+0000', 'last_peered': '2024-09-12T02:23:03.743776+0000', 'last_clean': '2024-09-12T02:23:03.743776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:03.756587+0000', 'last_undegraded': '2024-09-12T02:23:03.756587+0000', 'last_fullsized': '2024-09-12T02:23:03.756587+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T02:23:09.468 INFO:tasks.ceph.ceph_manager.ceph:PG 3.28 is not active+clean 2024-09-12T02:23:09.468 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:23:03.756225+0000', 'last_change': '2024-09-12T02:23:03.756225+0000', 'last_active': '2024-09-12T02:23:03.743776+0000', 'last_peered': '2024-09-12T02:23:03.743776+0000', 'last_clean': '2024-09-12T02:23:03.743776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:03.756225+0000', 'last_undegraded': '2024-09-12T02:23:03.756225+0000', 'last_fullsized': '2024-09-12T02:23:03.756225+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T02:23:09.468 INFO:tasks.ceph.ceph_manager.ceph:PG 3.26 is not active+clean 2024-09-12T02:23:09.468 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:23:03.759049+0000', 'last_change': '2024-09-12T02:23:03.759049+0000', 'last_active': '2024-09-12T02:23:03.743776+0000', 'last_peered': '2024-09-12T02:23:03.743776+0000', 'last_clean': '2024-09-12T02:23:03.743776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:03.759049+0000', 'last_undegraded': '2024-09-12T02:23:03.759049+0000', 'last_fullsized': '2024-09-12T02:23:03.759049+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T02:23:09.469 INFO:tasks.ceph.ceph_manager.ceph:PG 3.23 is not active+clean 2024-09-12T02:23:09.469 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T02:23:03.743776+0000', 'last_change': '2024-09-12T02:23:03.743776+0000', 'last_active': '2024-09-12T02:23:03.743776+0000', 'last_peered': '2024-09-12T02:23:03.743776+0000', 'last_clean': '2024-09-12T02:23:03.743776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:03.743776+0000', 'last_undegraded': '2024-09-12T02:23:03.743776+0000', 'last_fullsized': '2024-09-12T02:23:03.743776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T02:23:09.469 INFO:tasks.ceph.ceph_manager.ceph:PG 3.22 is not active+clean 2024-09-12T02:23:09.469 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:23:03.756132+0000', 'last_change': '2024-09-12T02:23:03.756132+0000', 'last_active': '2024-09-12T02:23:03.743776+0000', 'last_peered': '2024-09-12T02:23:03.743776+0000', 'last_clean': '2024-09-12T02:23:03.743776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:03.756132+0000', 'last_undegraded': '2024-09-12T02:23:03.756132+0000', 'last_fullsized': '2024-09-12T02:23:03.756132+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T02:23:09.469 INFO:tasks.ceph.ceph_manager.ceph:PG 3.21 is not active+clean 2024-09-12T02:23:09.469 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T02:23:03.743776+0000', 'last_change': '2024-09-12T02:23:03.743776+0000', 'last_active': '2024-09-12T02:23:03.743776+0000', 'last_peered': '2024-09-12T02:23:03.743776+0000', 'last_clean': '2024-09-12T02:23:03.743776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:03.743776+0000', 'last_undegraded': '2024-09-12T02:23:03.743776+0000', 'last_fullsized': '2024-09-12T02:23:03.743776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T02:23:09.469 INFO:tasks.ceph.ceph_manager.ceph:PG 3.20 is not active+clean 2024-09-12T02:23:09.469 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:23:03.764086+0000', 'last_change': '2024-09-12T02:23:03.764086+0000', 'last_active': '2024-09-12T02:23:03.743776+0000', 'last_peered': '2024-09-12T02:23:03.743776+0000', 'last_clean': '2024-09-12T02:23:03.743776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:03.764086+0000', 'last_undegraded': '2024-09-12T02:23:03.764086+0000', 'last_fullsized': '2024-09-12T02:23:03.764086+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T02:23:09.469 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1a is not active+clean 2024-09-12T02:23:09.469 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T02:23:03.743776+0000', 'last_change': '2024-09-12T02:23:03.743776+0000', 'last_active': '2024-09-12T02:23:03.743776+0000', 'last_peered': '2024-09-12T02:23:03.743776+0000', 'last_clean': '2024-09-12T02:23:03.743776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:03.743776+0000', 'last_undegraded': '2024-09-12T02:23:03.743776+0000', 'last_fullsized': '2024-09-12T02:23:03.743776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T02:23:09.470 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1b is not active+clean 2024-09-12T02:23:09.470 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T02:23:03.743776+0000', 'last_change': '2024-09-12T02:23:03.743776+0000', 'last_active': '2024-09-12T02:23:03.743776+0000', 'last_peered': '2024-09-12T02:23:03.743776+0000', 'last_clean': '2024-09-12T02:23:03.743776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:03.743776+0000', 'last_undegraded': '2024-09-12T02:23:03.743776+0000', 'last_fullsized': '2024-09-12T02:23:03.743776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T02:23:09.470 INFO:tasks.ceph.ceph_manager.ceph:PG 3.16 is not active+clean 2024-09-12T02:23:09.470 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:23:03.757235+0000', 'last_change': '2024-09-12T02:23:03.757235+0000', 'last_active': '2024-09-12T02:23:03.743776+0000', 'last_peered': '2024-09-12T02:23:03.743776+0000', 'last_clean': '2024-09-12T02:23:03.743776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:03.757235+0000', 'last_undegraded': '2024-09-12T02:23:03.757235+0000', 'last_fullsized': '2024-09-12T02:23:03.757235+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T02:23:09.470 INFO:tasks.ceph.ceph_manager.ceph:PG 3.17 is not active+clean 2024-09-12T02:23:09.470 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T02:23:03.743776+0000', 'last_change': '2024-09-12T02:23:03.743776+0000', 'last_active': '2024-09-12T02:23:03.743776+0000', 'last_peered': '2024-09-12T02:23:03.743776+0000', 'last_clean': '2024-09-12T02:23:03.743776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:03.743776+0000', 'last_undegraded': '2024-09-12T02:23:03.743776+0000', 'last_fullsized': '2024-09-12T02:23:03.743776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T02:23:09.470 INFO:tasks.ceph.ceph_manager.ceph:PG 3.14 is not active+clean 2024-09-12T02:23:09.470 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T02:23:03.743776+0000', 'last_change': '2024-09-12T02:23:03.743776+0000', 'last_active': '2024-09-12T02:23:03.743776+0000', 'last_peered': '2024-09-12T02:23:03.743776+0000', 'last_clean': '2024-09-12T02:23:03.743776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:03.743776+0000', 'last_undegraded': '2024-09-12T02:23:03.743776+0000', 'last_fullsized': '2024-09-12T02:23:03.743776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T02:23:09.470 INFO:tasks.ceph.ceph_manager.ceph:PG 3.15 is not active+clean 2024-09-12T02:23:09.470 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:23:03.755898+0000', 'last_change': '2024-09-12T02:23:03.755898+0000', 'last_active': '2024-09-12T02:23:03.743776+0000', 'last_peered': '2024-09-12T02:23:03.743776+0000', 'last_clean': '2024-09-12T02:23:03.743776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:03.755898+0000', 'last_undegraded': '2024-09-12T02:23:03.755898+0000', 'last_fullsized': '2024-09-12T02:23:03.755898+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T02:23:09.470 INFO:tasks.ceph.ceph_manager.ceph:PG 2.13 is not active+clean 2024-09-12T02:23:09.470 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:23:02.750891+0000', 'last_change': '2024-09-12T02:23:02.750891+0000', 'last_active': '2024-09-12T02:23:02.739281+0000', 'last_peered': '2024-09-12T02:23:02.739281+0000', 'last_clean': '2024-09-12T02:23:02.739281+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:02.750891+0000', 'last_undegraded': '2024-09-12T02:23:02.750891+0000', 'last_fullsized': '2024-09-12T02:23:02.750891+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:02.739281+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:02.739281+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:02.739281+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T02:23:09.471 INFO:tasks.ceph.ceph_manager.ceph:PG 3.12 is not active+clean 2024-09-12T02:23:09.471 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T02:23:03.743776+0000', 'last_change': '2024-09-12T02:23:03.743776+0000', 'last_active': '2024-09-12T02:23:03.743776+0000', 'last_peered': '2024-09-12T02:23:03.743776+0000', 'last_clean': '2024-09-12T02:23:03.743776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:03.743776+0000', 'last_undegraded': '2024-09-12T02:23:03.743776+0000', 'last_fullsized': '2024-09-12T02:23:03.743776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T02:23:09.471 INFO:tasks.ceph.ceph_manager.ceph:PG 3.13 is not active+clean 2024-09-12T02:23:09.471 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:23:03.752149+0000', 'last_change': '2024-09-12T02:23:03.752149+0000', 'last_active': '2024-09-12T02:23:03.743776+0000', 'last_peered': '2024-09-12T02:23:03.743776+0000', 'last_clean': '2024-09-12T02:23:03.743776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:03.752149+0000', 'last_undegraded': '2024-09-12T02:23:03.752149+0000', 'last_fullsized': '2024-09-12T02:23:03.752149+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T02:23:09.471 INFO:tasks.ceph.ceph_manager.ceph:PG 3.10 is not active+clean 2024-09-12T02:23:09.471 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:23:03.759935+0000', 'last_change': '2024-09-12T02:23:03.759935+0000', 'last_active': '2024-09-12T02:23:03.743776+0000', 'last_peered': '2024-09-12T02:23:03.743776+0000', 'last_clean': '2024-09-12T02:23:03.743776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:03.759935+0000', 'last_undegraded': '2024-09-12T02:23:03.759935+0000', 'last_fullsized': '2024-09-12T02:23:03.759935+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T02:23:09.471 INFO:tasks.ceph.ceph_manager.ceph:PG 2.10 is not active+clean 2024-09-12T02:23:09.471 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:23:02.748375+0000', 'last_change': '2024-09-12T02:23:02.748375+0000', 'last_active': '2024-09-12T02:23:02.739281+0000', 'last_peered': '2024-09-12T02:23:02.739281+0000', 'last_clean': '2024-09-12T02:23:02.739281+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:02.748375+0000', 'last_undegraded': '2024-09-12T02:23:02.748375+0000', 'last_fullsized': '2024-09-12T02:23:02.748375+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:02.739281+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:02.739281+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:02.739281+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T02:23:09.471 INFO:tasks.ceph.ceph_manager.ceph:PG 3.11 is not active+clean 2024-09-12T02:23:09.471 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:23:03.752312+0000', 'last_change': '2024-09-12T02:23:03.752312+0000', 'last_active': '2024-09-12T02:23:03.743776+0000', 'last_peered': '2024-09-12T02:23:03.743776+0000', 'last_clean': '2024-09-12T02:23:03.743776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:03.752312+0000', 'last_undegraded': '2024-09-12T02:23:03.752312+0000', 'last_fullsized': '2024-09-12T02:23:03.752312+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T02:23:09.471 INFO:tasks.ceph.ceph_manager.ceph:PG 2.f is not active+clean 2024-09-12T02:23:09.472 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:23:02.746308+0000', 'last_change': '2024-09-12T02:23:02.746308+0000', 'last_active': '2024-09-12T02:23:02.739281+0000', 'last_peered': '2024-09-12T02:23:02.739281+0000', 'last_clean': '2024-09-12T02:23:02.739281+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:02.746308+0000', 'last_undegraded': '2024-09-12T02:23:02.746308+0000', 'last_fullsized': '2024-09-12T02:23:02.746308+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:02.739281+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:02.739281+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:02.739281+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T02:23:09.472 INFO:tasks.ceph.ceph_manager.ceph:PG 3.e is not active+clean 2024-09-12T02:23:09.472 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:23:03.753058+0000', 'last_change': '2024-09-12T02:23:03.753058+0000', 'last_active': '2024-09-12T02:23:03.743776+0000', 'last_peered': '2024-09-12T02:23:03.743776+0000', 'last_clean': '2024-09-12T02:23:03.743776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:03.753058+0000', 'last_undegraded': '2024-09-12T02:23:03.753058+0000', 'last_fullsized': '2024-09-12T02:23:03.753058+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T02:23:09.472 INFO:tasks.ceph.ceph_manager.ceph:PG 2.e is not active+clean 2024-09-12T02:23:09.472 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:23:02.749018+0000', 'last_change': '2024-09-12T02:23:02.749018+0000', 'last_active': '2024-09-12T02:23:02.739281+0000', 'last_peered': '2024-09-12T02:23:02.739281+0000', 'last_clean': '2024-09-12T02:23:02.739281+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:02.749018+0000', 'last_undegraded': '2024-09-12T02:23:02.749018+0000', 'last_fullsized': '2024-09-12T02:23:02.749018+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:02.739281+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:02.739281+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:02.739281+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T02:23:09.472 INFO:tasks.ceph.ceph_manager.ceph:PG 3.f is not active+clean 2024-09-12T02:23:09.472 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:23:03.753029+0000', 'last_change': '2024-09-12T02:23:03.753029+0000', 'last_active': '2024-09-12T02:23:03.743776+0000', 'last_peered': '2024-09-12T02:23:03.743776+0000', 'last_clean': '2024-09-12T02:23:03.743776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:03.753029+0000', 'last_undegraded': '2024-09-12T02:23:03.753029+0000', 'last_fullsized': '2024-09-12T02:23:03.753029+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T02:23:09.472 INFO:tasks.ceph.ceph_manager.ceph:PG 3.c is not active+clean 2024-09-12T02:23:09.472 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:23:03.755917+0000', 'last_change': '2024-09-12T02:23:03.755917+0000', 'last_active': '2024-09-12T02:23:03.743776+0000', 'last_peered': '2024-09-12T02:23:03.743776+0000', 'last_clean': '2024-09-12T02:23:03.743776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:03.755917+0000', 'last_undegraded': '2024-09-12T02:23:03.755917+0000', 'last_fullsized': '2024-09-12T02:23:03.755917+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T02:23:09.472 INFO:tasks.ceph.ceph_manager.ceph:PG 2.c is not active+clean 2024-09-12T02:23:09.472 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:23:02.748818+0000', 'last_change': '2024-09-12T02:23:02.748818+0000', 'last_active': '2024-09-12T02:23:02.739281+0000', 'last_peered': '2024-09-12T02:23:02.739281+0000', 'last_clean': '2024-09-12T02:23:02.739281+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:02.748818+0000', 'last_undegraded': '2024-09-12T02:23:02.748818+0000', 'last_fullsized': '2024-09-12T02:23:02.748818+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:02.739281+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:02.739281+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:02.739281+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T02:23:09.473 INFO:tasks.ceph.ceph_manager.ceph:PG 3.d is not active+clean 2024-09-12T02:23:09.473 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:23:03.755050+0000', 'last_change': '2024-09-12T02:23:03.755050+0000', 'last_active': '2024-09-12T02:23:03.743776+0000', 'last_peered': '2024-09-12T02:23:03.743776+0000', 'last_clean': '2024-09-12T02:23:03.743776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:03.755050+0000', 'last_undegraded': '2024-09-12T02:23:03.755050+0000', 'last_fullsized': '2024-09-12T02:23:03.755050+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T02:23:09.473 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1 is not active+clean 2024-09-12T02:23:09.473 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T02:23:03.743776+0000', 'last_change': '2024-09-12T02:23:03.743776+0000', 'last_active': '2024-09-12T02:23:03.743776+0000', 'last_peered': '2024-09-12T02:23:03.743776+0000', 'last_clean': '2024-09-12T02:23:03.743776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:03.743776+0000', 'last_undegraded': '2024-09-12T02:23:03.743776+0000', 'last_fullsized': '2024-09-12T02:23:03.743776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T02:23:09.473 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1 is not active+clean 2024-09-12T02:23:09.473 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:23:02.748347+0000', 'last_change': '2024-09-12T02:23:02.748347+0000', 'last_active': '2024-09-12T02:23:02.739281+0000', 'last_peered': '2024-09-12T02:23:02.739281+0000', 'last_clean': '2024-09-12T02:23:02.739281+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:02.748347+0000', 'last_undegraded': '2024-09-12T02:23:02.748347+0000', 'last_fullsized': '2024-09-12T02:23:02.748347+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:02.739281+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:02.739281+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:02.739281+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T02:23:09.473 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3 is not active+clean 2024-09-12T02:23:09.473 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T02:23:03.743776+0000', 'last_change': '2024-09-12T02:23:03.743776+0000', 'last_active': '2024-09-12T02:23:03.743776+0000', 'last_peered': '2024-09-12T02:23:03.743776+0000', 'last_clean': '2024-09-12T02:23:03.743776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:03.743776+0000', 'last_undegraded': '2024-09-12T02:23:03.743776+0000', 'last_fullsized': '2024-09-12T02:23:03.743776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T02:23:09.473 INFO:tasks.ceph.ceph_manager.ceph:PG 3.5 is not active+clean 2024-09-12T02:23:09.473 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:23:03.754756+0000', 'last_change': '2024-09-12T02:23:03.754756+0000', 'last_active': '2024-09-12T02:23:03.743776+0000', 'last_peered': '2024-09-12T02:23:03.743776+0000', 'last_clean': '2024-09-12T02:23:03.743776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:03.754756+0000', 'last_undegraded': '2024-09-12T02:23:03.754756+0000', 'last_fullsized': '2024-09-12T02:23:03.754756+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T02:23:09.473 INFO:tasks.ceph.ceph_manager.ceph:PG 3.6 is not active+clean 2024-09-12T02:23:09.473 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T02:23:03.743776+0000', 'last_change': '2024-09-12T02:23:03.743776+0000', 'last_active': '2024-09-12T02:23:03.743776+0000', 'last_peered': '2024-09-12T02:23:03.743776+0000', 'last_clean': '2024-09-12T02:23:03.743776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:03.743776+0000', 'last_undegraded': '2024-09-12T02:23:03.743776+0000', 'last_fullsized': '2024-09-12T02:23:03.743776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T02:23:09.474 INFO:tasks.ceph.ceph_manager.ceph:PG 3.9 is not active+clean 2024-09-12T02:23:09.474 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T02:23:03.743776+0000', 'last_change': '2024-09-12T02:23:03.743776+0000', 'last_active': '2024-09-12T02:23:03.743776+0000', 'last_peered': '2024-09-12T02:23:03.743776+0000', 'last_clean': '2024-09-12T02:23:03.743776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:03.743776+0000', 'last_undegraded': '2024-09-12T02:23:03.743776+0000', 'last_fullsized': '2024-09-12T02:23:03.743776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T02:23:09.474 INFO:tasks.ceph.ceph_manager.ceph:PG 3.a is not active+clean 2024-09-12T02:23:09.474 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:23:03.763456+0000', 'last_change': '2024-09-12T02:23:03.763456+0000', 'last_active': '2024-09-12T02:23:03.743776+0000', 'last_peered': '2024-09-12T02:23:03.743776+0000', 'last_clean': '2024-09-12T02:23:03.743776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:03.763456+0000', 'last_undegraded': '2024-09-12T02:23:03.763456+0000', 'last_fullsized': '2024-09-12T02:23:03.763456+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T02:23:09.474 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1d is not active+clean 2024-09-12T02:23:09.474 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:23:03.755355+0000', 'last_change': '2024-09-12T02:23:03.755355+0000', 'last_active': '2024-09-12T02:23:03.743776+0000', 'last_peered': '2024-09-12T02:23:03.743776+0000', 'last_clean': '2024-09-12T02:23:03.743776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:03.755355+0000', 'last_undegraded': '2024-09-12T02:23:03.755355+0000', 'last_fullsized': '2024-09-12T02:23:03.755355+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T02:23:09.474 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1c is not active+clean 2024-09-12T02:23:09.474 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:23:03.756378+0000', 'last_change': '2024-09-12T02:23:03.756378+0000', 'last_active': '2024-09-12T02:23:03.743776+0000', 'last_peered': '2024-09-12T02:23:03.743776+0000', 'last_clean': '2024-09-12T02:23:03.743776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:03.756378+0000', 'last_undegraded': '2024-09-12T02:23:03.756378+0000', 'last_fullsized': '2024-09-12T02:23:03.756378+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T02:23:09.474 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1f is not active+clean 2024-09-12T02:23:09.474 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T02:23:03.743776+0000', 'last_change': '2024-09-12T02:23:03.743776+0000', 'last_active': '2024-09-12T02:23:03.743776+0000', 'last_peered': '2024-09-12T02:23:03.743776+0000', 'last_clean': '2024-09-12T02:23:03.743776+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:03.743776+0000', 'last_undegraded': '2024-09-12T02:23:03.743776+0000', 'last_fullsized': '2024-09-12T02:23:03.743776+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:03.743776+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T02:23:09.474 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1f is not active+clean 2024-09-12T02:23:09.475 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-12T02:23:02.749985+0000', 'last_change': '2024-09-12T02:23:02.749985+0000', 'last_active': '2024-09-12T02:23:02.739281+0000', 'last_peered': '2024-09-12T02:23:02.739281+0000', 'last_clean': '2024-09-12T02:23:02.739281+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T02:23:02.749985+0000', 'last_undegraded': '2024-09-12T02:23:02.749985+0000', 'last_fullsized': '2024-09-12T02:23:02.749985+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T02:23:02.739281+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T02:23:02.739281+0000', 'last_clean_scrub_stamp': '2024-09-12T02:23:02.739281+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T02:23:09.475 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T02:23:09.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.599+0000 7fdbfed31640 1 Processor -- start 2024-09-12T02:23:09.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.599+0000 7fdbfed31640 1 -- start start 2024-09-12T02:23:09.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.599+0000 7fdbfed31640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdbf8150480 0x7fdbf80c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:09.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.599+0000 7fdbfed31640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdbf806c650 0x7fdbf80c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:09.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.599+0000 7fdbfed31640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fdbf80c9c80 0x7fdbf80ca130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:09.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.599+0000 7fdbfed31640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fdbf806c240 con 0x7fdbf8150480 2024-09-12T02:23:09.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.599+0000 7fdbfed31640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fdbf815a330 con 0x7fdbf80c9c80 2024-09-12T02:23:09.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.599+0000 7fdbfed31640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdbf815a7c0 con 0x7fdbf806c650 2024-09-12T02:23:09.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.600+0000 7fdbfcacd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdbf8150480 0x7fdbf80c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:09.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.600+0000 7fdbfcacd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdbf8150480 0x7fdbf80c7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38096/0 (socket says 172.21.15.60:38096) 2024-09-12T02:23:09.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.600+0000 7fdbfcacd640 1 -- 172.21.15.60:0/3845974042 learned_addr learned my addr 172.21.15.60:0/3845974042 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:09.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.600+0000 7fdbf7fff640 1 --2- 172.21.15.60:0/3845974042 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdbf806c650 0x7fdbf80c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:09.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.600+0000 7fdbfd2ce640 1 --2- 172.21.15.60:0/3845974042 >> v2:172.21.15.105:3300/0 conn(0x7fdbf80c9c80 0x7fdbf80ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:09.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.600+0000 7fdbfcacd640 1 -- 172.21.15.60:0/3845974042 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdbf806c650 msgr2=0x7fdbf80c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:09.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.600+0000 7fdbfcacd640 1 --2- 172.21.15.60:0/3845974042 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdbf806c650 0x7fdbf80c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:09.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.600+0000 7fdbfcacd640 1 -- 172.21.15.60:0/3845974042 >> v2:172.21.15.105:3300/0 conn(0x7fdbf80c9c80 msgr2=0x7fdbf80ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:09.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.600+0000 7fdbfcacd640 1 --2- 172.21.15.60:0/3845974042 >> v2:172.21.15.105:3300/0 conn(0x7fdbf80c9c80 0x7fdbf80ca130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:09.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.600+0000 7fdbfcacd640 1 -- 172.21.15.60:0/3845974042 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbf8159a00 con 0x7fdbf8150480 2024-09-12T02:23:09.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.601+0000 7fdbfcacd640 1 --2- 172.21.15.60:0/3845974042 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbf8150480 0x7fdbf80c7a90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdbf80c62d0 tx=0x7fdbec02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87aa7c01f4bf3548 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:09.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.601+0000 7fdbf77fe640 1 -- 172.21.15.60:0/3845974042 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbec037070 con 0x7fdbf8150480 2024-09-12T02:23:09.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.601+0000 7fdbf77fe640 1 -- 172.21.15.60:0/3845974042 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbec032440 con 0x7fdbf8150480 2024-09-12T02:23:09.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.601+0000 7fdbf77fe640 1 -- 172.21.15.60:0/3845974042 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbec032810 con 0x7fdbf8150480 2024-09-12T02:23:09.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.601+0000 7fdbfed31640 1 -- 172.21.15.60:0/3845974042 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbf8150480 msgr2=0x7fdbf80c7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:09.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.601+0000 7fdbfed31640 1 --2- 172.21.15.60:0/3845974042 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbf8150480 0x7fdbf80c7a90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdbf80c62d0 tx=0x7fdbec02a1e0 comp rx=0 tx=0).stop 2024-09-12T02:23:09.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.601+0000 7fdbfed31640 1 -- 172.21.15.60:0/3845974042 shutdown_connections 2024-09-12T02:23:09.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.601+0000 7fdbfed31640 1 --2- 172.21.15.60:0/3845974042 >> v2:172.21.15.105:3300/0 conn(0x7fdbf80c9c80 0x7fdbf80ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:09.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.601+0000 7fdbfed31640 1 --2- 172.21.15.60:0/3845974042 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdbf806c650 0x7fdbf80c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:09.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.601+0000 7fdbfed31640 1 --2- 172.21.15.60:0/3845974042 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbf8150480 0x7fdbf80c7a90 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:09.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.601+0000 7fdbfed31640 1 -- 172.21.15.60:0/3845974042 >> 172.21.15.60:0/3845974042 conn(0x7fdbf8068030 msgr2=0x7fdbf8073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:09.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.601+0000 7fdbfed31640 1 -- 172.21.15.60:0/3845974042 shutdown_connections 2024-09-12T02:23:09.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.601+0000 7fdbfed31640 1 -- 172.21.15.60:0/3845974042 wait complete. 2024-09-12T02:23:09.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.602+0000 7fdbfed31640 1 Processor -- start 2024-09-12T02:23:09.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.603+0000 7fdbfed31640 1 -- start start 2024-09-12T02:23:09.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.603+0000 7fdbfed31640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbf806c650 0x7fdbf814f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:09.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.603+0000 7fdbfed31640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdbf80c9c80 0x7fdbf8149770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:09.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.603+0000 7fdbfed31640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbf8150480 0x7fdbf8149cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:09.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.603+0000 7fdbfed31640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf80ca670 con 0x7fdbf8150480 2024-09-12T02:23:09.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.603+0000 7fdbfed31640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf8159fc0 con 0x7fdbf806c650 2024-09-12T02:23:09.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.603+0000 7fdbfed31640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdbf806d270 con 0x7fdbf80c9c80 2024-09-12T02:23:09.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.603+0000 7fdbfd2ce640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbf8150480 0x7fdbf8149cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:09.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.604+0000 7fdbfd2ce640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbf8150480 0x7fdbf8149cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38108/0 (socket says 172.21.15.60:38108) 2024-09-12T02:23:09.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.604+0000 7fdbfcacd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbf806c650 0x7fdbf814f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:09.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.604+0000 7fdbfd2ce640 1 -- 172.21.15.60:0/3919296013 learned_addr learned my addr 172.21.15.60:0/3919296013 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:09.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.604+0000 7fdbf7fff640 1 --2- 172.21.15.60:0/3919296013 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdbf80c9c80 0x7fdbf8149770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:09.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.604+0000 7fdbfd2ce640 1 -- 172.21.15.60:0/3919296013 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdbf80c9c80 msgr2=0x7fdbf8149770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:09.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.604+0000 7fdbfd2ce640 1 --2- 172.21.15.60:0/3919296013 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdbf80c9c80 0x7fdbf8149770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:09.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.604+0000 7fdbfd2ce640 1 -- 172.21.15.60:0/3919296013 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbf806c650 msgr2=0x7fdbf814f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:09.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.604+0000 7fdbfd2ce640 1 --2- 172.21.15.60:0/3919296013 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbf806c650 0x7fdbf814f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:09.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.604+0000 7fdbfd2ce640 1 -- 172.21.15.60:0/3919296013 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbf814a700 con 0x7fdbf8150480 2024-09-12T02:23:09.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.604+0000 7fdbfd2ce640 1 --2- 172.21.15.60:0/3919296013 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbf8150480 0x7fdbf8149cb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdbf0007e40 tx=0x7fdbf000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:09.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.604+0000 7fdbf57fa640 1 -- 172.21.15.60:0/3919296013 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf0014620 con 0x7fdbf8150480 2024-09-12T02:23:09.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.604+0000 7fdbf57fa640 1 -- 172.21.15.60:0/3919296013 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbf0019070 con 0x7fdbf8150480 2024-09-12T02:23:09.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.604+0000 7fdbfed31640 1 -- 172.21.15.60:0/3919296013 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbf81574d0 con 0x7fdbf8150480 2024-09-12T02:23:09.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.604+0000 7fdbf57fa640 1 -- 172.21.15.60:0/3919296013 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf0014a20 con 0x7fdbf8150480 2024-09-12T02:23:09.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.604+0000 7fdbfed31640 1 -- 172.21.15.60:0/3919296013 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbf8157a90 con 0x7fdbf8150480 2024-09-12T02:23:09.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.605+0000 7fdbfed31640 1 -- 172.21.15.60:0/3919296013 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbf8156270 con 0x7fdbf8150480 2024-09-12T02:23:09.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.606+0000 7fdbf57fa640 1 -- 172.21.15.60:0/3919296013 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdbf0014bc0 con 0x7fdbf8150480 2024-09-12T02:23:09.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.606+0000 7fdbf57fa640 1 --2- 172.21.15.60:0/3919296013 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fdbdc06be30 0x7fdbdc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:09.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.606+0000 7fdbf57fa640 1 -- 172.21.15.60:0/3919296013 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5689+0+0 (secure 0 0 0) 0x7fdbf008b4e0 con 0x7fdbf8150480 2024-09-12T02:23:09.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.606+0000 7fdbfcacd640 1 --2- 172.21.15.60:0/3919296013 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fdbdc06be30 0x7fdbdc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:09.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.607+0000 7fdbfcacd640 1 --2- 172.21.15.60:0/3919296013 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fdbdc06be30 0x7fdbdc06e2f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdbec034000 tx=0x7fdbec02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:09.617 INFO:tasks.ceph.mds.b.smithi105.stderr:2024-09-12T02:23:09.610+0000 7f25e5da8640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:23:09.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.611+0000 7fdbf57fa640 1 -- 172.21.15.60:0/3919296013 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdbf00598e0 con 0x7fdbf8150480 2024-09-12T02:23:09.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.851+0000 7fdbfed31640 1 -- 172.21.15.60:0/3919296013 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fdbf806c430 con 0x7fdbf8150480 2024-09-12T02:23:09.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.851+0000 7fdbf57fa640 1 -- 172.21.15.60:0/3919296013 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1213 (secure 0 0 0) 0x7fdbf005dbe0 con 0x7fdbf8150480 2024-09-12T02:23:09.852 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:23:09.852 INFO:teuthology.orchestra.run.smithi060.stdout:{"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":29,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":22,"num_osds":8,"num_up_osds":8,"osd_up_since":1726107773,"num_in_osds":8,"osd_in_since":1726107762,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":43},{"state_name":"creating+peering","count":37},{"state_name":"unknown","count":17}],"num_pgs":97,"num_pools":3,"num_objects":6,"data_bytes":590528,"bytes_used":253972480,"bytes_avail":772840140800,"bytes_total":773094113280,"unknown_pgs_ratio":0.17525772750377655,"inactive_pgs_ratio":0.38144329190254211,"write_bytes_sec":383,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":7,"btime":"2024-09-12T02:23:07:785714+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4281}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-12T02:22:39.871623+0000","services":{}},"progress_events":{}} 2024-09-12T02:23:09.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.853+0000 7fdbfed31640 1 -- 172.21.15.60:0/3919296013 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fdbdc06be30 msgr2=0x7fdbdc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:09.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.853+0000 7fdbfed31640 1 --2- 172.21.15.60:0/3919296013 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fdbdc06be30 0x7fdbdc06e2f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdbec034000 tx=0x7fdbec02e000 comp rx=0 tx=0).stop 2024-09-12T02:23:09.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.853+0000 7fdbfed31640 1 -- 172.21.15.60:0/3919296013 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbf8150480 msgr2=0x7fdbf8149cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:09.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.853+0000 7fdbfed31640 1 --2- 172.21.15.60:0/3919296013 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbf8150480 0x7fdbf8149cb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdbf0007e40 tx=0x7fdbf000e4b0 comp rx=0 tx=0).stop 2024-09-12T02:23:09.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.853+0000 7fdbfed31640 1 -- 172.21.15.60:0/3919296013 shutdown_connections 2024-09-12T02:23:09.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.853+0000 7fdbfed31640 1 --2- 172.21.15.60:0/3919296013 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fdbdc06be30 0x7fdbdc06e2f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:09.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.853+0000 7fdbfed31640 1 --2- 172.21.15.60:0/3919296013 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbf8150480 0x7fdbf8149cb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:09.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.853+0000 7fdbfed31640 1 --2- 172.21.15.60:0/3919296013 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdbf80c9c80 0x7fdbf8149770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:09.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.853+0000 7fdbfed31640 1 --2- 172.21.15.60:0/3919296013 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbf806c650 0x7fdbf814f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:09.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.853+0000 7fdbfed31640 1 -- 172.21.15.60:0/3919296013 >> 172.21.15.60:0/3919296013 conn(0x7fdbf8068030 msgr2=0x7fdbf80c79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:09.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.853+0000 7fdbfed31640 1 -- 172.21.15.60:0/3919296013 shutdown_connections 2024-09-12T02:23:09.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.853+0000 7fdbfed31640 1 -- 172.21.15.60:0/3919296013 wait complete. 2024-09-12T02:23:09.865 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-12T02:23:09.865 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:23:09.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.967+0000 7face9e3c640 1 Processor -- start 2024-09-12T02:23:09.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.967+0000 7face9e3c640 1 -- start start 2024-09-12T02:23:09.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.968+0000 7face9e3c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7face4156ce0 0x7face40cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:09.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.968+0000 7face9e3c640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7face406c610 0x7face40ca750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:09.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.968+0000 7face9e3c640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7face4150690 con 0x7face40caff0 2024-09-12T02:23:09.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.968+0000 7face9e3c640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7face41571e0 con 0x7face406c610 2024-09-12T02:23:09.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.968+0000 7face9e3c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7face40cbb20 con 0x7face4156ce0 2024-09-12T02:23:09.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.968+0000 7face37fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7face40caff0 0x7face40ca040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55632/0 (socket says 172.21.15.60:55632) 2024-09-12T02:23:09.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.968+0000 7face37fe640 1 -- 172.21.15.60:0/3993110402 learned_addr learned my addr 172.21.15.60:0/3993110402 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:09.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.968+0000 7face27fc640 1 -- 172.21.15.60:0/3993110402 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 962659521 0 0) 0x7face4150690 con 0x7face40caff0 2024-09-12T02:23:09.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.968+0000 7face2ffd640 1 --2- 172.21.15.60:0/3993110402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7face4156ce0 0x7face40cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:09.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.968+0000 7face3fff640 1 --2- 172.21.15.60:0/3993110402 >> v2:172.21.15.105:3300/0 conn(0x7face406c610 0x7face40ca750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:09.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.968+0000 7face27fc640 1 -- 172.21.15.60:0/3993110402 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faccc003520 con 0x7face40caff0 2024-09-12T02:23:09.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.968+0000 7face27fc640 1 -- 172.21.15.60:0/3993110402 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3784218338 0 0) 0x7faccc003520 con 0x7face40caff0 2024-09-12T02:23:09.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.968+0000 7face27fc640 1 -- 172.21.15.60:0/3993110402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7face4156ce0 msgr2=0x7face40cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:09.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.968+0000 7face27fc640 1 --2- 172.21.15.60:0/3993110402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7face4156ce0 0x7face40cb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:09.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.968+0000 7face27fc640 1 -- 172.21.15.60:0/3993110402 >> v2:172.21.15.105:3300/0 conn(0x7face406c610 msgr2=0x7face40ca750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:09.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.968+0000 7face27fc640 1 --2- 172.21.15.60:0/3993110402 >> v2:172.21.15.105:3300/0 conn(0x7face406c610 0x7face40ca750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:09.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.968+0000 7face27fc640 1 -- 172.21.15.60:0/3993110402 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7face40cbdc0 con 0x7face40caff0 2024-09-12T02:23:09.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.968+0000 7face27fc640 1 -- 172.21.15.60:0/3993110402 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7facd8001670 con 0x7face40caff0 2024-09-12T02:23:09.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.968+0000 7face27fc640 1 -- 172.21.15.60:0/3993110402 >> v1:172.21.15.60:6789/0 conn(0x7face40caff0 legacy=0x7face40ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:09.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.968+0000 7face27fc640 1 --2- 172.21.15.60:0/3993110402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7face4156ce0 0x7faccc0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:09.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.968+0000 7face27fc640 1 --2- 172.21.15.60:0/3993110402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faccc003f30 0x7faccc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:09.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.968+0000 7face27fc640 1 --2- 172.21.15.60:0/3993110402 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faccc004d40 0x7faccc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:09.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.968+0000 7face27fc640 1 -- 172.21.15.60:0/3993110402 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7face41571e0 con 0x7faccc003f30 2024-09-12T02:23:09.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.968+0000 7face27fc640 1 -- 172.21.15.60:0/3993110402 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7face40cbb20 con 0x7faccc004d40 2024-09-12T02:23:09.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.968+0000 7face27fc640 1 -- 172.21.15.60:0/3993110402 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7faccc00ba10 con 0x7face4156ce0 2024-09-12T02:23:09.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.968+0000 7face2ffd640 1 --2- 172.21.15.60:0/3993110402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faccc003f30 0x7faccc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:09.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.969+0000 7face37fe640 1 --2- 172.21.15.60:0/3993110402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7face4156ce0 0x7faccc0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:09.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.969+0000 7face3fff640 1 --2- 172.21.15.60:0/3993110402 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faccc004d40 0x7faccc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:09.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.969+0000 7face2ffd640 1 -- 172.21.15.60:0/3993110402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7face4156ce0 msgr2=0x7faccc0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:09.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.969+0000 7face2ffd640 1 --2- 172.21.15.60:0/3993110402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7face4156ce0 0x7faccc0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:09.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.969+0000 7face2ffd640 1 -- 172.21.15.60:0/3993110402 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faccc004d40 msgr2=0x7faccc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:09.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.969+0000 7face2ffd640 1 --2- 172.21.15.60:0/3993110402 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faccc004d40 0x7faccc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:09.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.969+0000 7face2ffd640 1 -- 172.21.15.60:0/3993110402 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faccc003520 con 0x7faccc003f30 2024-09-12T02:23:09.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.969+0000 7face2ffd640 1 --2- 172.21.15.60:0/3993110402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faccc003f30 0x7faccc004800 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7facd4009af0 tx=0x7faccc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a341cd75dd765d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:09.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.970+0000 7face27fc640 1 -- 172.21.15.60:0/3993110402 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd4036070 con 0x7faccc003f30 2024-09-12T02:23:09.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.970+0000 7face27fc640 1 -- 172.21.15.60:0/3993110402 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facd4031400 con 0x7faccc003f30 2024-09-12T02:23:09.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.970+0000 7face27fc640 1 -- 172.21.15.60:0/3993110402 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd4009690 con 0x7faccc003f30 2024-09-12T02:23:09.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.970+0000 7face9e3c640 1 -- 172.21.15.60:0/3993110402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faccc003f30 msgr2=0x7faccc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:09.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.970+0000 7face9e3c640 1 --2- 172.21.15.60:0/3993110402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faccc003f30 0x7faccc004800 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7facd4009af0 tx=0x7faccc005830 comp rx=0 tx=0).stop 2024-09-12T02:23:09.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.970+0000 7face3fff640 1 -- 172.21.15.60:0/3993110402 reap_dead start 2024-09-12T02:23:09.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.970+0000 7face9e3c640 1 -- 172.21.15.60:0/3993110402 shutdown_connections 2024-09-12T02:23:09.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.970+0000 7face9e3c640 1 -- 172.21.15.60:0/3993110402 >> 172.21.15.60:0/3993110402 conn(0x7face4068010 msgr2=0x7face4073310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:09.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.970+0000 7face9e3c640 1 -- 172.21.15.60:0/3993110402 shutdown_connections 2024-09-12T02:23:09.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.970+0000 7face9e3c640 1 -- 172.21.15.60:0/3993110402 wait complete. 2024-09-12T02:23:09.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.971+0000 7face9e3c640 1 Processor -- start 2024-09-12T02:23:09.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.972+0000 7face9e3c640 1 -- start start 2024-09-12T02:23:09.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.972+0000 7face9e3c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faccc003f30 0x7face41e1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:09.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.972+0000 7face9e3c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7face41499d0 0x7face41488f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:09.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.972+0000 7face9e3c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7face4148e30 0x7face41dfd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:09.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.972+0000 7face9e3c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7face40cac90 con 0x7face4148e30 2024-09-12T02:23:09.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.972+0000 7face9e3c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7face40cc380 con 0x7face41499d0 2024-09-12T02:23:09.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.972+0000 7face9e3c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7face406bbe0 con 0x7faccc003f30 2024-09-12T02:23:09.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.972+0000 7face3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7face4148e30 0x7face41dfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:09.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.972+0000 7face3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7face4148e30 0x7face41dfd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38126/0 (socket says 172.21.15.60:38126) 2024-09-12T02:23:09.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.972+0000 7face3fff640 1 -- 172.21.15.60:0/3428957345 learned_addr learned my addr 172.21.15.60:0/3428957345 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:09.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.972+0000 7face2ffd640 1 --2- 172.21.15.60:0/3428957345 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7face41499d0 0x7face41488f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:09.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.973+0000 7face37fe640 1 --2- 172.21.15.60:0/3428957345 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faccc003f30 0x7face41e1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:09.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.973+0000 7face3fff640 1 -- 172.21.15.60:0/3428957345 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faccc003f30 msgr2=0x7face41e1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:09.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.973+0000 7face3fff640 1 --2- 172.21.15.60:0/3428957345 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faccc003f30 0x7face41e1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:09.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.973+0000 7face3fff640 1 -- 172.21.15.60:0/3428957345 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7face41499d0 msgr2=0x7face41488f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:09.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.973+0000 7face3fff640 1 --2- 172.21.15.60:0/3428957345 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7face41499d0 0x7face41488f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:09.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.973+0000 7face3fff640 1 -- 172.21.15.60:0/3428957345 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7face41492b0 con 0x7face4148e30 2024-09-12T02:23:09.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.973+0000 7face2ffd640 1 --2- 172.21.15.60:0/3428957345 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7face41499d0 0x7face41488f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:23:09.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.973+0000 7face3fff640 1 --2- 172.21.15.60:0/3428957345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7face4148e30 0x7face41dfd50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7facdc009fd0 tx=0x7facdc00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:09.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.973+0000 7faccbfff640 1 -- 172.21.15.60:0/3428957345 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facdc019070 con 0x7face4148e30 2024-09-12T02:23:09.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.973+0000 7faccbfff640 1 -- 172.21.15.60:0/3428957345 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facdc011e90 con 0x7face4148e30 2024-09-12T02:23:09.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.973+0000 7face9e3c640 1 -- 172.21.15.60:0/3428957345 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7face4149780 con 0x7face4148e30 2024-09-12T02:23:09.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.973+0000 7faccbfff640 1 -- 172.21.15.60:0/3428957345 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facdc003bd0 con 0x7face4148e30 2024-09-12T02:23:09.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.973+0000 7face9e3c640 1 -- 172.21.15.60:0/3428957345 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7face41494a0 con 0x7face4148e30 2024-09-12T02:23:09.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.974+0000 7face9e3c640 1 -- 172.21.15.60:0/3428957345 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7face40cb3d0 con 0x7face4148e30 2024-09-12T02:23:09.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.974+0000 7faccbfff640 1 -- 172.21.15.60:0/3428957345 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7facdc01c070 con 0x7face4148e30 2024-09-12T02:23:09.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.975+0000 7faccbfff640 1 --2- 172.21.15.60:0/3428957345 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7facd006be60 0x7facd006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:09.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.975+0000 7faccbfff640 1 -- 172.21.15.60:0/3428957345 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5689+0+0 (secure 0 0 0) 0x7facdc08b6f0 con 0x7face4148e30 2024-09-12T02:23:09.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.975+0000 7face37fe640 1 --2- 172.21.15.60:0/3428957345 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7facd006be60 0x7facd006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:09.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.975+0000 7face37fe640 1 --2- 172.21.15.60:0/3428957345 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7facd006be60 0x7facd006e320 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7facd8007fd0 tx=0x7facd8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:09.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:09.979+0000 7faccbfff640 1 -- 172.21.15.60:0/3428957345 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7facdc010040 con 0x7face4148e30 2024-09-12T02:23:10.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:10.151+0000 7face9e3c640 1 -- 172.21.15.60:0/3428957345 --> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7face406c3f0 con 0x7facd006be60 2024-09-12T02:23:10.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:10.157+0000 7faccbfff640 1 -- 172.21.15.60:0/3428957345 <== mgr.4098 v2:172.21.15.60:6800/3549430091 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251945 (secure 0 0 0) 0x7face406c3f0 con 0x7facd006be60 2024-09-12T02:23:10.160 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:23:10.161 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T02:23:10.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:10.160+0000 7face9e3c640 1 -- 172.21.15.60:0/3428957345 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7facd006be60 msgr2=0x7facd006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:10.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:10.160+0000 7face9e3c640 1 --2- 172.21.15.60:0/3428957345 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7facd006be60 0x7facd006e320 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7facd8007fd0 tx=0x7facd8009040 comp rx=0 tx=0).stop 2024-09-12T02:23:10.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:10.160+0000 7face9e3c640 1 -- 172.21.15.60:0/3428957345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7face4148e30 msgr2=0x7face41dfd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:10.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:10.160+0000 7face9e3c640 1 --2- 172.21.15.60:0/3428957345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7face4148e30 0x7face41dfd50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7facdc009fd0 tx=0x7facdc00f580 comp rx=0 tx=0).stop 2024-09-12T02:23:10.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:10.160+0000 7face9e3c640 1 -- 172.21.15.60:0/3428957345 shutdown_connections 2024-09-12T02:23:10.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:10.160+0000 7face9e3c640 1 --2- 172.21.15.60:0/3428957345 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7facd006be60 0x7facd006e320 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:10.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:10.160+0000 7face9e3c640 1 --2- 172.21.15.60:0/3428957345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7face4148e30 0x7face41dfd50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:10.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:10.160+0000 7face9e3c640 1 --2- 172.21.15.60:0/3428957345 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7face41499d0 0x7face41488f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:10.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:10.160+0000 7face9e3c640 1 --2- 172.21.15.60:0/3428957345 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faccc003f30 0x7face41e1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:10.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:10.160+0000 7face9e3c640 1 -- 172.21.15.60:0/3428957345 >> 172.21.15.60:0/3428957345 conn(0x7face4068010 msgr2=0x7face4155b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:10.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:10.160+0000 7face9e3c640 1 -- 172.21.15.60:0/3428957345 shutdown_connections 2024-09-12T02:23:10.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:10.160+0000 7face9e3c640 1 -- 172.21.15.60:0/3428957345 wait complete. 2024-09-12T02:23:10.171 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-12T02:23:10.087858+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252444,"kb_used_data":2908,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754722276,"statfs":{"total":773094113280,"available":772835610624,"internally_reserved":0,"allocated":2977792,"data_stored":1788177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.340599"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.780089+0000","last_change":"2024-09-12T02:23:04.791204+0000","last_active":"2024-09-12T02:23:05.780089+0000","last_peered":"2024-09-12T02:23:05.780089+0000","last_clean":"2024-09-12T02:23:05.780089+0000","last_became_active":"2024-09-12T02:23:04.790906+0000","last_became_peered":"2024-09-12T02:23:04.790906+0000","last_unstale":"2024-09-12T02:23:05.780089+0000","last_undegraded":"2024-09-12T02:23:05.780089+0000","last_fullsized":"2024-09-12T02:23:05.780089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:16.336873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775715+0000","last_change":"2024-09-12T02:23:04.785821+0000","last_active":"2024-09-12T02:23:05.775715+0000","last_peered":"2024-09-12T02:23:05.775715+0000","last_clean":"2024-09-12T02:23:05.775715+0000","last_became_active":"2024-09-12T02:23:04.785516+0000","last_became_peered":"2024-09-12T02:23:04.785516+0000","last_unstale":"2024-09-12T02:23:05.775715+0000","last_undegraded":"2024-09-12T02:23:05.775715+0000","last_fullsized":"2024-09-12T02:23:05.775715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:42.400040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.030207+0000","last_change":"2024-09-12T02:23:04.778772+0000","last_active":"2024-09-12T02:23:06.030207+0000","last_peered":"2024-09-12T02:23:06.030207+0000","last_clean":"2024-09-12T02:23:06.030207+0000","last_became_active":"2024-09-12T02:23:04.778445+0000","last_became_peered":"2024-09-12T02:23:04.778445+0000","last_unstale":"2024-09-12T02:23:06.030207+0000","last_undegraded":"2024-09-12T02:23:06.030207+0000","last_fullsized":"2024-09-12T02:23:06.030207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:58.292023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.023596+0000","last_change":"2024-09-12T02:23:04.786772+0000","last_active":"2024-09-12T02:23:06.023596+0000","last_peered":"2024-09-12T02:23:06.023596+0000","last_clean":"2024-09-12T02:23:06.023596+0000","last_became_active":"2024-09-12T02:23:04.786509+0000","last_became_peered":"2024-09-12T02:23:04.786509+0000","last_unstale":"2024-09-12T02:23:06.023596+0000","last_undegraded":"2024-09-12T02:23:06.023596+0000","last_fullsized":"2024-09-12T02:23:06.023596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:01.755827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.779368+0000","last_change":"2024-09-12T02:23:04.777165+0000","last_active":"2024-09-12T02:23:05.779368+0000","last_peered":"2024-09-12T02:23:05.779368+0000","last_clean":"2024-09-12T02:23:05.779368+0000","last_became_active":"2024-09-12T02:23:04.776857+0000","last_became_peered":"2024-09-12T02:23:04.776857+0000","last_unstale":"2024-09-12T02:23:05.779368+0000","last_undegraded":"2024-09-12T02:23:05.779368+0000","last_fullsized":"2024-09-12T02:23:05.779368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:28.309591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.023403+0000","last_change":"2024-09-12T02:23:04.788890+0000","last_active":"2024-09-12T02:23:06.023403+0000","last_peered":"2024-09-12T02:23:06.023403+0000","last_clean":"2024-09-12T02:23:06.023403+0000","last_became_active":"2024-09-12T02:23:04.788617+0000","last_became_peered":"2024-09-12T02:23:04.788617+0000","last_unstale":"2024-09-12T02:23:06.023403+0000","last_undegraded":"2024-09-12T02:23:06.023403+0000","last_fullsized":"2024-09-12T02:23:06.023403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:24.194151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.778801+0000","last_change":"2024-09-12T02:23:04.779265+0000","last_active":"2024-09-12T02:23:05.778801+0000","last_peered":"2024-09-12T02:23:05.778801+0000","last_clean":"2024-09-12T02:23:05.778801+0000","last_became_active":"2024-09-12T02:23:04.778968+0000","last_became_peered":"2024-09-12T02:23:04.778968+0000","last_unstale":"2024-09-12T02:23:05.778801+0000","last_undegraded":"2024-09-12T02:23:05.778801+0000","last_fullsized":"2024-09-12T02:23:05.778801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:53.022598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.971553+0000","last_change":"2024-09-12T02:23:04.779648+0000","last_active":"2024-09-12T02:23:06.971553+0000","last_peered":"2024-09-12T02:23:06.971553+0000","last_clean":"2024-09-12T02:23:06.971553+0000","last_became_active":"2024-09-12T02:23:04.779384+0000","last_became_peered":"2024-09-12T02:23:04.779384+0000","last_unstale":"2024-09-12T02:23:06.971553+0000","last_undegraded":"2024-09-12T02:23:06.971553+0000","last_fullsized":"2024-09-12T02:23:06.971553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:41.491471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.780145+0000","last_change":"2024-09-12T02:23:04.781090+0000","last_active":"2024-09-12T02:23:05.780145+0000","last_peered":"2024-09-12T02:23:05.780145+0000","last_clean":"2024-09-12T02:23:05.780145+0000","last_became_active":"2024-09-12T02:23:04.780740+0000","last_became_peered":"2024-09-12T02:23:04.780740+0000","last_unstale":"2024-09-12T02:23:05.780145+0000","last_undegraded":"2024-09-12T02:23:05.780145+0000","last_fullsized":"2024-09-12T02:23:05.780145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:30.639111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.772845+0000","last_change":"2024-09-12T02:23:04.791929+0000","last_active":"2024-09-12T02:23:06.772845+0000","last_peered":"2024-09-12T02:23:06.772845+0000","last_clean":"2024-09-12T02:23:06.772845+0000","last_became_active":"2024-09-12T02:23:04.791622+0000","last_became_peered":"2024-09-12T02:23:04.791622+0000","last_unstale":"2024-09-12T02:23:06.772845+0000","last_undegraded":"2024-09-12T02:23:06.772845+0000","last_fullsized":"2024-09-12T02:23:06.772845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:35.012685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.772830+0000","last_change":"2024-09-12T02:23:04.785662+0000","last_active":"2024-09-12T02:23:06.772830+0000","last_peered":"2024-09-12T02:23:06.772830+0000","last_clean":"2024-09-12T02:23:06.772830+0000","last_became_active":"2024-09-12T02:23:04.785375+0000","last_became_peered":"2024-09-12T02:23:04.785375+0000","last_unstale":"2024-09-12T02:23:06.772830+0000","last_undegraded":"2024-09-12T02:23:06.772830+0000","last_fullsized":"2024-09-12T02:23:06.772830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:44.295056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.778936+0000","last_change":"2024-09-12T02:23:04.787034+0000","last_active":"2024-09-12T02:23:05.778936+0000","last_peered":"2024-09-12T02:23:05.778936+0000","last_clean":"2024-09-12T02:23:05.778936+0000","last_became_active":"2024-09-12T02:23:04.786044+0000","last_became_peered":"2024-09-12T02:23:04.786044+0000","last_unstale":"2024-09-12T02:23:05.778936+0000","last_undegraded":"2024-09-12T02:23:05.778936+0000","last_fullsized":"2024-09-12T02:23:05.778936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:07.183028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.971880+0000","last_change":"2024-09-12T02:23:04.782128+0000","last_active":"2024-09-12T02:23:06.971880+0000","last_peered":"2024-09-12T02:23:06.971880+0000","last_clean":"2024-09-12T02:23:06.971880+0000","last_became_active":"2024-09-12T02:23:04.781101+0000","last_became_peered":"2024-09-12T02:23:04.781101+0000","last_unstale":"2024-09-12T02:23:06.971880+0000","last_undegraded":"2024-09-12T02:23:06.971880+0000","last_fullsized":"2024-09-12T02:23:06.971880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:49.421147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.030027+0000","last_change":"2024-09-12T02:23:04.787140+0000","last_active":"2024-09-12T02:23:06.030027+0000","last_peered":"2024-09-12T02:23:06.030027+0000","last_clean":"2024-09-12T02:23:06.030027+0000","last_became_active":"2024-09-12T02:23:04.786799+0000","last_became_peered":"2024-09-12T02:23:04.786799+0000","last_unstale":"2024-09-12T02:23:06.030027+0000","last_undegraded":"2024-09-12T02:23:06.030027+0000","last_fullsized":"2024-09-12T02:23:06.030027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:31.639605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775453+0000","last_change":"2024-09-12T02:23:04.782490+0000","last_active":"2024-09-12T02:23:05.775453+0000","last_peered":"2024-09-12T02:23:05.775453+0000","last_clean":"2024-09-12T02:23:05.775453+0000","last_became_active":"2024-09-12T02:23:04.782183+0000","last_became_peered":"2024-09-12T02:23:04.782183+0000","last_unstale":"2024-09-12T02:23:05.775453+0000","last_undegraded":"2024-09-12T02:23:05.775453+0000","last_fullsized":"2024-09-12T02:23:05.775453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:28.699880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.023275+0000","last_change":"2024-09-12T02:23:04.790532+0000","last_active":"2024-09-12T02:23:06.023275+0000","last_peered":"2024-09-12T02:23:06.023275+0000","last_clean":"2024-09-12T02:23:06.023275+0000","last_became_active":"2024-09-12T02:23:04.789229+0000","last_became_peered":"2024-09-12T02:23:04.789229+0000","last_unstale":"2024-09-12T02:23:06.023275+0000","last_undegraded":"2024-09-12T02:23:06.023275+0000","last_fullsized":"2024-09-12T02:23:06.023275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:59.901665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.023994+0000","last_change":"2024-09-12T02:23:04.789439+0000","last_active":"2024-09-12T02:23:06.023994+0000","last_peered":"2024-09-12T02:23:06.023994+0000","last_clean":"2024-09-12T02:23:06.023994+0000","last_became_active":"2024-09-12T02:23:04.787421+0000","last_became_peered":"2024-09-12T02:23:04.787421+0000","last_unstale":"2024-09-12T02:23:06.023994+0000","last_undegraded":"2024-09-12T02:23:06.023994+0000","last_fullsized":"2024-09-12T02:23:06.023994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:44.295056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.871456+0000","last_change":"2024-09-12T02:23:04.791378+0000","last_active":"2024-09-12T02:23:05.871456+0000","last_peered":"2024-09-12T02:23:05.871456+0000","last_clean":"2024-09-12T02:23:05.871456+0000","last_became_active":"2024-09-12T02:23:04.790926+0000","last_became_peered":"2024-09-12T02:23:04.790926+0000","last_unstale":"2024-09-12T02:23:05.871456+0000","last_undegraded":"2024-09-12T02:23:05.871456+0000","last_fullsized":"2024-09-12T02:23:05.871456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:34.764210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.780154+0000","last_change":"2024-09-12T02:23:04.777450+0000","last_active":"2024-09-12T02:23:05.780154+0000","last_peered":"2024-09-12T02:23:05.780154+0000","last_clean":"2024-09-12T02:23:05.780154+0000","last_became_active":"2024-09-12T02:23:04.776825+0000","last_became_peered":"2024-09-12T02:23:04.776825+0000","last_unstale":"2024-09-12T02:23:05.780154+0000","last_undegraded":"2024-09-12T02:23:05.780154+0000","last_fullsized":"2024-09-12T02:23:05.780154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:40.315075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.772612+0000","last_change":"2024-09-12T02:23:04.789575+0000","last_active":"2024-09-12T02:23:06.772612+0000","last_peered":"2024-09-12T02:23:06.772612+0000","last_clean":"2024-09-12T02:23:06.772612+0000","last_became_active":"2024-09-12T02:23:04.789296+0000","last_became_peered":"2024-09-12T02:23:04.789296+0000","last_unstale":"2024-09-12T02:23:06.772612+0000","last_undegraded":"2024-09-12T02:23:06.772612+0000","last_fullsized":"2024-09-12T02:23:06.772612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:13.166139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.030191+0000","last_change":"2024-09-12T02:23:04.785849+0000","last_active":"2024-09-12T02:23:06.030191+0000","last_peered":"2024-09-12T02:23:06.030191+0000","last_clean":"2024-09-12T02:23:06.030191+0000","last_became_active":"2024-09-12T02:23:04.785511+0000","last_became_peered":"2024-09-12T02:23:04.785511+0000","last_unstale":"2024-09-12T02:23:06.030191+0000","last_undegraded":"2024-09-12T02:23:06.030191+0000","last_fullsized":"2024-09-12T02:23:06.030191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:28.670102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.023416+0000","last_change":"2024-09-12T02:23:04.785685+0000","last_active":"2024-09-12T02:23:06.023416+0000","last_peered":"2024-09-12T02:23:06.023416+0000","last_clean":"2024-09-12T02:23:06.023416+0000","last_became_active":"2024-09-12T02:23:04.784945+0000","last_became_peered":"2024-09-12T02:23:04.784945+0000","last_unstale":"2024-09-12T02:23:06.023416+0000","last_undegraded":"2024-09-12T02:23:06.023416+0000","last_fullsized":"2024-09-12T02:23:06.023416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:36.658436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.971740+0000","last_change":"2024-09-12T02:23:04.788624+0000","last_active":"2024-09-12T02:23:06.971740+0000","last_peered":"2024-09-12T02:23:06.971740+0000","last_clean":"2024-09-12T02:23:06.971740+0000","last_became_active":"2024-09-12T02:23:04.788352+0000","last_became_peered":"2024-09-12T02:23:04.788352+0000","last_unstale":"2024-09-12T02:23:06.971740+0000","last_undegraded":"2024-09-12T02:23:06.971740+0000","last_fullsized":"2024-09-12T02:23:06.971740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:13.961110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.023383+0000","last_change":"2024-09-12T02:23:04.787389+0000","last_active":"2024-09-12T02:23:06.023383+0000","last_peered":"2024-09-12T02:23:06.023383+0000","last_clean":"2024-09-12T02:23:06.023383+0000","last_became_active":"2024-09-12T02:23:04.787092+0000","last_became_peered":"2024-09-12T02:23:04.787092+0000","last_unstale":"2024-09-12T02:23:06.023383+0000","last_undegraded":"2024-09-12T02:23:06.023383+0000","last_fullsized":"2024-09-12T02:23:06.023383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:02.924906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.972167+0000","last_change":"2024-09-12T02:23:04.787899+0000","last_active":"2024-09-12T02:23:06.972167+0000","last_peered":"2024-09-12T02:23:06.972167+0000","last_clean":"2024-09-12T02:23:06.972167+0000","last_became_active":"2024-09-12T02:23:04.787619+0000","last_became_peered":"2024-09-12T02:23:04.787619+0000","last_unstale":"2024-09-12T02:23:06.972167+0000","last_undegraded":"2024-09-12T02:23:06.972167+0000","last_fullsized":"2024-09-12T02:23:06.972167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:57.732453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.773009+0000","last_change":"2024-09-12T02:23:04.788827+0000","last_active":"2024-09-12T02:23:06.773009+0000","last_peered":"2024-09-12T02:23:06.773009+0000","last_clean":"2024-09-12T02:23:06.773009+0000","last_became_active":"2024-09-12T02:23:04.788521+0000","last_became_peered":"2024-09-12T02:23:04.788521+0000","last_unstale":"2024-09-12T02:23:06.773009+0000","last_undegraded":"2024-09-12T02:23:06.773009+0000","last_fullsized":"2024-09-12T02:23:06.773009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:24.470245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775630+0000","last_change":"2024-09-12T02:23:04.776435+0000","last_active":"2024-09-12T02:23:05.775630+0000","last_peered":"2024-09-12T02:23:05.775630+0000","last_clean":"2024-09-12T02:23:05.775630+0000","last_became_active":"2024-09-12T02:23:04.776120+0000","last_became_peered":"2024-09-12T02:23:04.776120+0000","last_unstale":"2024-09-12T02:23:05.775630+0000","last_undegraded":"2024-09-12T02:23:05.775630+0000","last_fullsized":"2024-09-12T02:23:05.775630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:27.985094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.972092+0000","last_change":"2024-09-12T02:23:04.789372+0000","last_active":"2024-09-12T02:23:06.972092+0000","last_peered":"2024-09-12T02:23:06.972092+0000","last_clean":"2024-09-12T02:23:06.972092+0000","last_became_active":"2024-09-12T02:23:04.789090+0000","last_became_peered":"2024-09-12T02:23:04.789090+0000","last_unstale":"2024-09-12T02:23:06.972092+0000","last_undegraded":"2024-09-12T02:23:06.972092+0000","last_fullsized":"2024-09-12T02:23:06.972092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:49.533491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.030241+0000","last_change":"2024-09-12T02:23:04.777018+0000","last_active":"2024-09-12T02:23:06.030241+0000","last_peered":"2024-09-12T02:23:06.030241+0000","last_clean":"2024-09-12T02:23:06.030241+0000","last_became_active":"2024-09-12T02:23:04.776736+0000","last_became_peered":"2024-09-12T02:23:04.776736+0000","last_unstale":"2024-09-12T02:23:06.030241+0000","last_undegraded":"2024-09-12T02:23:06.030241+0000","last_fullsized":"2024-09-12T02:23:06.030241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:08.668990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.023652+0000","last_change":"2024-09-12T02:23:04.785920+0000","last_active":"2024-09-12T02:23:06.023652+0000","last_peered":"2024-09-12T02:23:06.023652+0000","last_clean":"2024-09-12T02:23:06.023652+0000","last_became_active":"2024-09-12T02:23:04.785422+0000","last_became_peered":"2024-09-12T02:23:04.785422+0000","last_unstale":"2024-09-12T02:23:06.023652+0000","last_undegraded":"2024-09-12T02:23:06.023652+0000","last_fullsized":"2024-09-12T02:23:06.023652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:55.106703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.871367+0000","last_change":"2024-09-12T02:23:04.780662+0000","last_active":"2024-09-12T02:23:05.871367+0000","last_peered":"2024-09-12T02:23:05.871367+0000","last_clean":"2024-09-12T02:23:05.871367+0000","last_became_active":"2024-09-12T02:23:04.780402+0000","last_became_peered":"2024-09-12T02:23:04.780402+0000","last_unstale":"2024-09-12T02:23:05.871367+0000","last_undegraded":"2024-09-12T02:23:05.871367+0000","last_fullsized":"2024-09-12T02:23:05.871367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:23:00.556487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.772582+0000","last_change":"2024-09-12T02:23:04.788489+0000","last_active":"2024-09-12T02:23:06.772582+0000","last_peered":"2024-09-12T02:23:06.772582+0000","last_clean":"2024-09-12T02:23:06.772582+0000","last_became_active":"2024-09-12T02:23:04.788195+0000","last_became_peered":"2024-09-12T02:23:04.788195+0000","last_unstale":"2024-09-12T02:23:06.772582+0000","last_undegraded":"2024-09-12T02:23:06.772582+0000","last_fullsized":"2024-09-12T02:23:06.772582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:51.352859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.779241+0000","last_change":"2024-09-12T02:23:04.771579+0000","last_active":"2024-09-12T02:23:05.779241+0000","last_peered":"2024-09-12T02:23:05.779241+0000","last_clean":"2024-09-12T02:23:05.779241+0000","last_became_active":"2024-09-12T02:23:04.771310+0000","last_became_peered":"2024-09-12T02:23:04.771310+0000","last_unstale":"2024-09-12T02:23:05.779241+0000","last_undegraded":"2024-09-12T02:23:05.779241+0000","last_fullsized":"2024-09-12T02:23:05.779241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:05.115474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.972043+0000","last_change":"2024-09-12T02:23:03.764310+0000","last_active":"2024-09-12T02:23:06.972043+0000","last_peered":"2024-09-12T02:23:06.972043+0000","last_clean":"2024-09-12T02:23:06.972043+0000","last_became_active":"2024-09-12T02:23:03.764020+0000","last_became_peered":"2024-09-12T02:23:03.764020+0000","last_unstale":"2024-09-12T02:23:06.972043+0000","last_undegraded":"2024-09-12T02:23:06.972043+0000","last_fullsized":"2024-09-12T02:23:06.972043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:25.892874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.030449+0000","last_change":"2024-09-12T02:23:04.793412+0000","last_active":"2024-09-12T02:23:06.030449+0000","last_peered":"2024-09-12T02:23:06.030449+0000","last_clean":"2024-09-12T02:23:06.030449+0000","last_became_active":"2024-09-12T02:23:04.793100+0000","last_became_peered":"2024-09-12T02:23:04.793100+0000","last_unstale":"2024-09-12T02:23:06.030449+0000","last_undegraded":"2024-09-12T02:23:06.030449+0000","last_fullsized":"2024-09-12T02:23:06.030449+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:50.446212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.772522+0000","last_change":"2024-09-12T02:23:03.768186+0000","last_active":"2024-09-12T02:23:06.772522+0000","last_peered":"2024-09-12T02:23:06.772522+0000","last_clean":"2024-09-12T02:23:06.772522+0000","last_became_active":"2024-09-12T02:23:03.767916+0000","last_became_peered":"2024-09-12T02:23:03.767916+0000","last_unstale":"2024-09-12T02:23:06.772522+0000","last_undegraded":"2024-09-12T02:23:06.772522+0000","last_fullsized":"2024-09-12T02:23:06.772522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:04.424540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.971673+0000","last_change":"2024-09-12T02:23:03.768361+0000","last_active":"2024-09-12T02:23:06.971673+0000","last_peered":"2024-09-12T02:23:06.971673+0000","last_clean":"2024-09-12T02:23:06.971673+0000","last_became_active":"2024-09-12T02:23:03.768137+0000","last_became_peered":"2024-09-12T02:23:03.768137+0000","last_unstale":"2024-09-12T02:23:06.971673+0000","last_undegraded":"2024-09-12T02:23:06.971673+0000","last_fullsized":"2024-09-12T02:23:06.971673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:29.721363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.971707+0000","last_change":"2024-09-12T02:23:04.783317+0000","last_active":"2024-09-12T02:23:06.971707+0000","last_peered":"2024-09-12T02:23:06.971707+0000","last_clean":"2024-09-12T02:23:06.971707+0000","last_became_active":"2024-09-12T02:23:04.783039+0000","last_became_peered":"2024-09-12T02:23:04.783039+0000","last_unstale":"2024-09-12T02:23:06.971707+0000","last_undegraded":"2024-09-12T02:23:06.971707+0000","last_fullsized":"2024-09-12T02:23:06.971707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:17.577991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.023501+0000","last_change":"2024-09-12T02:23:03.762450+0000","last_active":"2024-09-12T02:23:06.023501+0000","last_peered":"2024-09-12T02:23:06.023501+0000","last_clean":"2024-09-12T02:23:06.023501+0000","last_became_active":"2024-09-12T02:23:03.762161+0000","last_became_peered":"2024-09-12T02:23:03.762161+0000","last_unstale":"2024-09-12T02:23:06.023501+0000","last_undegraded":"2024-09-12T02:23:06.023501+0000","last_fullsized":"2024-09-12T02:23:06.023501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:42.256395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775427+0000","last_change":"2024-09-12T02:23:04.776572+0000","last_active":"2024-09-12T02:23:05.775427+0000","last_peered":"2024-09-12T02:23:05.775427+0000","last_clean":"2024-09-12T02:23:05.775427+0000","last_became_active":"2024-09-12T02:23:04.776270+0000","last_became_peered":"2024-09-12T02:23:04.776270+0000","last_unstale":"2024-09-12T02:23:05.775427+0000","last_undegraded":"2024-09-12T02:23:05.775427+0000","last_fullsized":"2024-09-12T02:23:05.775427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:12.807907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.772706+0000","last_change":"2024-09-12T02:23:03.770668+0000","last_active":"2024-09-12T02:23:06.772706+0000","last_peered":"2024-09-12T02:23:06.772706+0000","last_clean":"2024-09-12T02:23:06.772706+0000","last_became_active":"2024-09-12T02:23:03.769302+0000","last_became_peered":"2024-09-12T02:23:03.769302+0000","last_unstale":"2024-09-12T02:23:06.772706+0000","last_undegraded":"2024-09-12T02:23:06.772706+0000","last_fullsized":"2024-09-12T02:23:06.772706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:18.948922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.023702+0000","last_change":"2024-09-12T02:23:04.786100+0000","last_active":"2024-09-12T02:23:06.023702+0000","last_peered":"2024-09-12T02:23:06.023702+0000","last_clean":"2024-09-12T02:23:06.023702+0000","last_became_active":"2024-09-12T02:23:04.785795+0000","last_became_peered":"2024-09-12T02:23:04.785795+0000","last_unstale":"2024-09-12T02:23:06.023702+0000","last_undegraded":"2024-09-12T02:23:06.023702+0000","last_fullsized":"2024-09-12T02:23:06.023702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:58.597807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.023734+0000","last_change":"2024-09-12T02:23:03.769710+0000","last_active":"2024-09-12T02:23:06.023734+0000","last_peered":"2024-09-12T02:23:06.023734+0000","last_clean":"2024-09-12T02:23:06.023734+0000","last_became_active":"2024-09-12T02:23:03.769436+0000","last_became_peered":"2024-09-12T02:23:03.769436+0000","last_unstale":"2024-09-12T02:23:06.023734+0000","last_undegraded":"2024-09-12T02:23:06.023734+0000","last_fullsized":"2024-09-12T02:23:06.023734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:11.194147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.030371+0000","last_change":"2024-09-12T02:23:04.779171+0000","last_active":"2024-09-12T02:23:06.030371+0000","last_peered":"2024-09-12T02:23:06.030371+0000","last_clean":"2024-09-12T02:23:06.030371+0000","last_became_active":"2024-09-12T02:23:04.778850+0000","last_became_peered":"2024-09-12T02:23:04.778850+0000","last_unstale":"2024-09-12T02:23:06.030371+0000","last_undegraded":"2024-09-12T02:23:06.030371+0000","last_fullsized":"2024-09-12T02:23:06.030371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:21.746490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775627+0000","last_change":"2024-09-12T02:23:03.771271+0000","last_active":"2024-09-12T02:23:05.775627+0000","last_peered":"2024-09-12T02:23:05.775627+0000","last_clean":"2024-09-12T02:23:05.775627+0000","last_became_active":"2024-09-12T02:23:03.769601+0000","last_became_peered":"2024-09-12T02:23:03.769601+0000","last_unstale":"2024-09-12T02:23:05.775627+0000","last_undegraded":"2024-09-12T02:23:05.775627+0000","last_fullsized":"2024-09-12T02:23:05.775627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:22.910072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.779103+0000","last_change":"2024-09-12T02:23:04.777953+0000","last_active":"2024-09-12T02:23:05.779103+0000","last_peered":"2024-09-12T02:23:05.779103+0000","last_clean":"2024-09-12T02:23:05.779103+0000","last_became_active":"2024-09-12T02:23:04.777081+0000","last_became_peered":"2024-09-12T02:23:04.777081+0000","last_unstale":"2024-09-12T02:23:05.779103+0000","last_undegraded":"2024-09-12T02:23:05.779103+0000","last_fullsized":"2024-09-12T02:23:05.779103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:14.103378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.772811+0000","last_change":"2024-09-12T02:23:03.768425+0000","last_active":"2024-09-12T02:23:06.772811+0000","last_peered":"2024-09-12T02:23:06.772811+0000","last_clean":"2024-09-12T02:23:06.772811+0000","last_became_active":"2024-09-12T02:23:03.768092+0000","last_became_peered":"2024-09-12T02:23:03.768092+0000","last_unstale":"2024-09-12T02:23:06.772811+0000","last_undegraded":"2024-09-12T02:23:06.772811+0000","last_fullsized":"2024-09-12T02:23:06.772811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:18.572070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.779850+0000","last_change":"2024-09-12T02:23:04.780843+0000","last_active":"2024-09-12T02:23:05.779850+0000","last_peered":"2024-09-12T02:23:05.779850+0000","last_clean":"2024-09-12T02:23:05.779850+0000","last_became_active":"2024-09-12T02:23:04.780475+0000","last_became_peered":"2024-09-12T02:23:04.780475+0000","last_unstale":"2024-09-12T02:23:05.779850+0000","last_undegraded":"2024-09-12T02:23:05.779850+0000","last_fullsized":"2024-09-12T02:23:05.779850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:38.074872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.030297+0000","last_change":"2024-09-12T02:23:03.762859+0000","last_active":"2024-09-12T02:23:06.030297+0000","last_peered":"2024-09-12T02:23:06.030297+0000","last_clean":"2024-09-12T02:23:06.030297+0000","last_became_active":"2024-09-12T02:23:03.762557+0000","last_became_peered":"2024-09-12T02:23:03.762557+0000","last_unstale":"2024-09-12T02:23:06.030297+0000","last_undegraded":"2024-09-12T02:23:06.030297+0000","last_fullsized":"2024-09-12T02:23:06.030297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:34.863435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.030120+0000","last_change":"2024-09-12T02:23:04.784379+0000","last_active":"2024-09-12T02:23:06.030120+0000","last_peered":"2024-09-12T02:23:06.030120+0000","last_clean":"2024-09-12T02:23:06.030120+0000","last_became_active":"2024-09-12T02:23:04.784094+0000","last_became_peered":"2024-09-12T02:23:04.784094+0000","last_unstale":"2024-09-12T02:23:06.030120+0000","last_undegraded":"2024-09-12T02:23:06.030120+0000","last_fullsized":"2024-09-12T02:23:06.030120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:22.103008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.023721+0000","last_change":"2024-09-12T02:23:03.767217+0000","last_active":"2024-09-12T02:23:06.023721+0000","last_peered":"2024-09-12T02:23:06.023721+0000","last_clean":"2024-09-12T02:23:06.023721+0000","last_became_active":"2024-09-12T02:23:03.766551+0000","last_became_peered":"2024-09-12T02:23:03.766551+0000","last_unstale":"2024-09-12T02:23:06.023721+0000","last_undegraded":"2024-09-12T02:23:06.023721+0000","last_fullsized":"2024-09-12T02:23:06.023721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:09.963450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.779506+0000","last_change":"2024-09-12T02:23:04.783671+0000","last_active":"2024-09-12T02:23:05.779506+0000","last_peered":"2024-09-12T02:23:05.779506+0000","last_clean":"2024-09-12T02:23:05.779506+0000","last_became_active":"2024-09-12T02:23:04.783399+0000","last_became_peered":"2024-09-12T02:23:04.783399+0000","last_unstale":"2024-09-12T02:23:05.779506+0000","last_undegraded":"2024-09-12T02:23:05.779506+0000","last_fullsized":"2024-09-12T02:23:05.779506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:04.321789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.772461+0000","last_change":"2024-09-12T02:23:03.767842+0000","last_active":"2024-09-12T02:23:06.772461+0000","last_peered":"2024-09-12T02:23:06.772461+0000","last_clean":"2024-09-12T02:23:06.772461+0000","last_became_active":"2024-09-12T02:23:03.767066+0000","last_became_peered":"2024-09-12T02:23:03.767066+0000","last_unstale":"2024-09-12T02:23:06.772461+0000","last_undegraded":"2024-09-12T02:23:06.772461+0000","last_fullsized":"2024-09-12T02:23:06.772461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:50.800749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.772651+0000","last_change":"2024-09-12T02:23:04.785248+0000","last_active":"2024-09-12T02:23:06.772651+0000","last_peered":"2024-09-12T02:23:06.772651+0000","last_clean":"2024-09-12T02:23:06.772651+0000","last_became_active":"2024-09-12T02:23:04.784977+0000","last_became_peered":"2024-09-12T02:23:04.784977+0000","last_unstale":"2024-09-12T02:23:06.772651+0000","last_undegraded":"2024-09-12T02:23:06.772651+0000","last_fullsized":"2024-09-12T02:23:06.772651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:23.273457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.871205+0000","last_change":"2024-09-12T02:23:03.771368+0000","last_active":"2024-09-12T02:23:05.871205+0000","last_peered":"2024-09-12T02:23:05.871205+0000","last_clean":"2024-09-12T02:23:05.871205+0000","last_became_active":"2024-09-12T02:23:03.771061+0000","last_became_peered":"2024-09-12T02:23:03.771061+0000","last_unstale":"2024-09-12T02:23:05.871205+0000","last_undegraded":"2024-09-12T02:23:05.871205+0000","last_fullsized":"2024-09-12T02:23:05.871205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:57.476458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.778963+0000","last_change":"2024-09-12T02:23:04.781856+0000","last_active":"2024-09-12T02:23:05.778963+0000","last_peered":"2024-09-12T02:23:05.778963+0000","last_clean":"2024-09-12T02:23:05.778963+0000","last_became_active":"2024-09-12T02:23:04.781575+0000","last_became_peered":"2024-09-12T02:23:04.781575+0000","last_unstale":"2024-09-12T02:23:05.778963+0000","last_undegraded":"2024-09-12T02:23:05.778963+0000","last_fullsized":"2024-09-12T02:23:05.778963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:26.630558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.779027+0000","last_change":"2024-09-12T02:23:03.769541+0000","last_active":"2024-09-12T02:23:05.779027+0000","last_peered":"2024-09-12T02:23:05.779027+0000","last_clean":"2024-09-12T02:23:05.779027+0000","last_became_active":"2024-09-12T02:23:03.765281+0000","last_became_peered":"2024-09-12T02:23:03.765281+0000","last_unstale":"2024-09-12T02:23:05.779027+0000","last_undegraded":"2024-09-12T02:23:05.779027+0000","last_fullsized":"2024-09-12T02:23:05.779027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:53.409370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.780031+0000","last_change":"2024-09-12T02:23:04.781196+0000","last_active":"2024-09-12T02:23:05.780031+0000","last_peered":"2024-09-12T02:23:05.780031+0000","last_clean":"2024-09-12T02:23:05.780031+0000","last_became_active":"2024-09-12T02:23:04.780893+0000","last_became_peered":"2024-09-12T02:23:04.780893+0000","last_unstale":"2024-09-12T02:23:05.780031+0000","last_undegraded":"2024-09-12T02:23:05.780031+0000","last_fullsized":"2024-09-12T02:23:05.780031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:26.527539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.871461+0000","last_change":"2024-09-12T02:23:03.763327+0000","last_active":"2024-09-12T02:23:05.871461+0000","last_peered":"2024-09-12T02:23:05.871461+0000","last_clean":"2024-09-12T02:23:05.871461+0000","last_became_active":"2024-09-12T02:23:03.763005+0000","last_became_peered":"2024-09-12T02:23:03.763005+0000","last_unstale":"2024-09-12T02:23:05.871461+0000","last_undegraded":"2024-09-12T02:23:05.871461+0000","last_fullsized":"2024-09-12T02:23:05.871461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:09.500459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.780229+0000","last_change":"2024-09-12T02:23:04.791152+0000","last_active":"2024-09-12T02:23:05.780229+0000","last_peered":"2024-09-12T02:23:05.780229+0000","last_clean":"2024-09-12T02:23:05.780229+0000","last_became_active":"2024-09-12T02:23:04.790707+0000","last_became_peered":"2024-09-12T02:23:04.790707+0000","last_unstale":"2024-09-12T02:23:05.780229+0000","last_undegraded":"2024-09-12T02:23:05.780229+0000","last_fullsized":"2024-09-12T02:23:05.780229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:42.798507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775732+0000","last_change":"2024-09-12T02:23:03.766034+0000","last_active":"2024-09-12T02:23:05.775732+0000","last_peered":"2024-09-12T02:23:05.775732+0000","last_clean":"2024-09-12T02:23:05.775732+0000","last_became_active":"2024-09-12T02:23:03.765735+0000","last_became_peered":"2024-09-12T02:23:03.765735+0000","last_unstale":"2024-09-12T02:23:05.775732+0000","last_undegraded":"2024-09-12T02:23:05.775732+0000","last_fullsized":"2024-09-12T02:23:05.775732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:19.691229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.023828+0000","last_change":"2024-09-12T02:23:04.784318+0000","last_active":"2024-09-12T02:23:06.023828+0000","last_peered":"2024-09-12T02:23:06.023828+0000","last_clean":"2024-09-12T02:23:06.023828+0000","last_became_active":"2024-09-12T02:23:04.784012+0000","last_became_peered":"2024-09-12T02:23:04.784012+0000","last_unstale":"2024-09-12T02:23:06.023828+0000","last_undegraded":"2024-09-12T02:23:06.023828+0000","last_fullsized":"2024-09-12T02:23:06.023828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:51.352859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.871317+0000","last_change":"2024-09-12T02:23:03.762507+0000","last_active":"2024-09-12T02:23:05.871317+0000","last_peered":"2024-09-12T02:23:05.871317+0000","last_clean":"2024-09-12T02:23:05.871317+0000","last_became_active":"2024-09-12T02:23:03.762164+0000","last_became_peered":"2024-09-12T02:23:03.762164+0000","last_unstale":"2024-09-12T02:23:05.871317+0000","last_undegraded":"2024-09-12T02:23:05.871317+0000","last_fullsized":"2024-09-12T02:23:05.871317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:34.569630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.779950+0000","last_change":"2024-09-12T02:23:04.783483+0000","last_active":"2024-09-12T02:23:05.779950+0000","last_peered":"2024-09-12T02:23:05.779950+0000","last_clean":"2024-09-12T02:23:05.779950+0000","last_became_active":"2024-09-12T02:23:04.782878+0000","last_became_peered":"2024-09-12T02:23:04.782878+0000","last_unstale":"2024-09-12T02:23:05.779950+0000","last_undegraded":"2024-09-12T02:23:05.779950+0000","last_fullsized":"2024-09-12T02:23:05.779950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:52.335065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.778707+0000","last_change":"2024-09-12T02:22:55.143869+0000","last_active":"2024-09-12T02:23:05.778707+0000","last_peered":"2024-09-12T02:23:05.778707+0000","last_clean":"2024-09-12T02:23:05.778707+0000","last_became_active":"2024-09-12T02:22:55.142784+0000","last_became_peered":"2024-09-12T02:22:55.142784+0000","last_unstale":"2024-09-12T02:23:05.778707+0000","last_undegraded":"2024-09-12T02:23:05.778707+0000","last_fullsized":"2024-09-12T02:23:05.778707+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:22:52.457979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:22:52.457979+0000","last_clean_scrub_stamp":"2024-09-12T02:22:52.457979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:46.152602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.023373+0000","last_change":"2024-09-12T02:23:03.765100+0000","last_active":"2024-09-12T02:23:06.023373+0000","last_peered":"2024-09-12T02:23:06.023373+0000","last_clean":"2024-09-12T02:23:06.023373+0000","last_became_active":"2024-09-12T02:23:03.764801+0000","last_became_peered":"2024-09-12T02:23:03.764801+0000","last_unstale":"2024-09-12T02:23:06.023373+0000","last_undegraded":"2024-09-12T02:23:06.023373+0000","last_fullsized":"2024-09-12T02:23:06.023373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:06.891040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.971912+0000","last_change":"2024-09-12T02:23:04.781839+0000","last_active":"2024-09-12T02:23:06.971912+0000","last_peered":"2024-09-12T02:23:06.971912+0000","last_clean":"2024-09-12T02:23:06.971912+0000","last_became_active":"2024-09-12T02:23:04.780984+0000","last_became_peered":"2024-09-12T02:23:04.780984+0000","last_unstale":"2024-09-12T02:23:06.971912+0000","last_undegraded":"2024-09-12T02:23:06.971912+0000","last_fullsized":"2024-09-12T02:23:06.971912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:07.692791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.778644+0000","last_change":"2024-09-12T02:23:03.771625+0000","last_active":"2024-09-12T02:23:05.778644+0000","last_peered":"2024-09-12T02:23:05.778644+0000","last_clean":"2024-09-12T02:23:05.778644+0000","last_became_active":"2024-09-12T02:23:03.771163+0000","last_became_peered":"2024-09-12T02:23:03.771163+0000","last_unstale":"2024-09-12T02:23:05.778644+0000","last_undegraded":"2024-09-12T02:23:05.778644+0000","last_fullsized":"2024-09-12T02:23:05.778644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:32.772569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.030015+0000","last_change":"2024-09-12T02:23:04.787820+0000","last_active":"2024-09-12T02:23:06.030015+0000","last_peered":"2024-09-12T02:23:06.030015+0000","last_clean":"2024-09-12T02:23:06.030015+0000","last_became_active":"2024-09-12T02:23:04.787523+0000","last_became_peered":"2024-09-12T02:23:04.787523+0000","last_unstale":"2024-09-12T02:23:06.030015+0000","last_undegraded":"2024-09-12T02:23:06.030015+0000","last_fullsized":"2024-09-12T02:23:06.030015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:52.784171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.871306+0000","last_change":"2024-09-12T02:23:03.760700+0000","last_active":"2024-09-12T02:23:05.871306+0000","last_peered":"2024-09-12T02:23:05.871306+0000","last_clean":"2024-09-12T02:23:05.871306+0000","last_became_active":"2024-09-12T02:23:03.760397+0000","last_became_peered":"2024-09-12T02:23:03.760397+0000","last_unstale":"2024-09-12T02:23:05.871306+0000","last_undegraded":"2024-09-12T02:23:05.871306+0000","last_fullsized":"2024-09-12T02:23:05.871306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:36.788864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775441+0000","last_change":"2024-09-12T02:23:04.773745+0000","last_active":"2024-09-12T02:23:05.775441+0000","last_peered":"2024-09-12T02:23:05.775441+0000","last_clean":"2024-09-12T02:23:05.775441+0000","last_became_active":"2024-09-12T02:23:04.773360+0000","last_became_peered":"2024-09-12T02:23:04.773360+0000","last_unstale":"2024-09-12T02:23:05.775441+0000","last_undegraded":"2024-09-12T02:23:05.775441+0000","last_fullsized":"2024-09-12T02:23:05.775441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:33.097774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.023917+0000","last_change":"2024-09-12T02:23:03.771518+0000","last_active":"2024-09-12T02:23:06.023917+0000","last_peered":"2024-09-12T02:23:06.023917+0000","last_clean":"2024-09-12T02:23:06.023917+0000","last_became_active":"2024-09-12T02:23:03.771063+0000","last_became_peered":"2024-09-12T02:23:03.771063+0000","last_unstale":"2024-09-12T02:23:06.023917+0000","last_undegraded":"2024-09-12T02:23:06.023917+0000","last_fullsized":"2024-09-12T02:23:06.023917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:43.974555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.779569+0000","last_change":"2024-09-12T02:23:04.790723+0000","last_active":"2024-09-12T02:23:05.779569+0000","last_peered":"2024-09-12T02:23:05.779569+0000","last_clean":"2024-09-12T02:23:05.779569+0000","last_became_active":"2024-09-12T02:23:04.786877+0000","last_became_peered":"2024-09-12T02:23:04.786877+0000","last_unstale":"2024-09-12T02:23:05.779569+0000","last_undegraded":"2024-09-12T02:23:05.779569+0000","last_fullsized":"2024-09-12T02:23:05.779569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:48.516002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775663+0000","last_change":"2024-09-12T02:23:03.769913+0000","last_active":"2024-09-12T02:23:05.775663+0000","last_peered":"2024-09-12T02:23:05.775663+0000","last_clean":"2024-09-12T02:23:05.775663+0000","last_became_active":"2024-09-12T02:23:03.769444+0000","last_became_peered":"2024-09-12T02:23:03.769444+0000","last_unstale":"2024-09-12T02:23:05.775663+0000","last_undegraded":"2024-09-12T02:23:05.775663+0000","last_fullsized":"2024-09-12T02:23:05.775663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:21.243182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.023818+0000","last_change":"2024-09-12T02:23:04.787557+0000","last_active":"2024-09-12T02:23:06.023818+0000","last_peered":"2024-09-12T02:23:06.023818+0000","last_clean":"2024-09-12T02:23:06.023818+0000","last_became_active":"2024-09-12T02:23:04.786527+0000","last_became_peered":"2024-09-12T02:23:04.786527+0000","last_unstale":"2024-09-12T02:23:06.023818+0000","last_undegraded":"2024-09-12T02:23:06.023818+0000","last_fullsized":"2024-09-12T02:23:06.023818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:23.273457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.780143+0000","last_change":"2024-09-12T02:23:03.764093+0000","last_active":"2024-09-12T02:23:05.780143+0000","last_peered":"2024-09-12T02:23:05.780143+0000","last_clean":"2024-09-12T02:23:05.780143+0000","last_became_active":"2024-09-12T02:23:03.763147+0000","last_became_peered":"2024-09-12T02:23:03.763147+0000","last_unstale":"2024-09-12T02:23:05.780143+0000","last_undegraded":"2024-09-12T02:23:05.780143+0000","last_fullsized":"2024-09-12T02:23:05.780143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:13.317894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775631+0000","last_change":"2024-09-12T02:23:04.775876+0000","last_active":"2024-09-12T02:23:05.775631+0000","last_peered":"2024-09-12T02:23:05.775631+0000","last_clean":"2024-09-12T02:23:05.775631+0000","last_became_active":"2024-09-12T02:23:04.775571+0000","last_became_peered":"2024-09-12T02:23:04.775571+0000","last_unstale":"2024-09-12T02:23:05.775631+0000","last_undegraded":"2024-09-12T02:23:05.775631+0000","last_fullsized":"2024-09-12T02:23:05.775631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:05.070528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.772082+0000","last_change":"2024-09-12T02:23:03.769745+0000","last_active":"2024-09-12T02:23:06.772082+0000","last_peered":"2024-09-12T02:23:06.772082+0000","last_clean":"2024-09-12T02:23:06.772082+0000","last_became_active":"2024-09-12T02:23:03.769410+0000","last_became_peered":"2024-09-12T02:23:03.769410+0000","last_unstale":"2024-09-12T02:23:06.772082+0000","last_undegraded":"2024-09-12T02:23:06.772082+0000","last_fullsized":"2024-09-12T02:23:06.772082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:00.414459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.972214+0000","last_change":"2024-09-12T02:23:04.786424+0000","last_active":"2024-09-12T02:23:06.972214+0000","last_peered":"2024-09-12T02:23:06.972214+0000","last_clean":"2024-09-12T02:23:06.972214+0000","last_became_active":"2024-09-12T02:23:04.786136+0000","last_became_peered":"2024-09-12T02:23:04.786136+0000","last_unstale":"2024-09-12T02:23:06.972214+0000","last_undegraded":"2024-09-12T02:23:06.972214+0000","last_fullsized":"2024-09-12T02:23:06.972214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:31.214894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.772832+0000","last_change":"2024-09-12T02:23:03.771259+0000","last_active":"2024-09-12T02:23:06.772832+0000","last_peered":"2024-09-12T02:23:06.772832+0000","last_clean":"2024-09-12T02:23:06.772832+0000","last_became_active":"2024-09-12T02:23:03.770687+0000","last_became_peered":"2024-09-12T02:23:03.770687+0000","last_unstale":"2024-09-12T02:23:06.772832+0000","last_undegraded":"2024-09-12T02:23:06.772832+0000","last_fullsized":"2024-09-12T02:23:06.772832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:38.516959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.030331+0000","last_change":"2024-09-12T02:23:04.786895+0000","last_active":"2024-09-12T02:23:06.030331+0000","last_peered":"2024-09-12T02:23:06.030331+0000","last_clean":"2024-09-12T02:23:06.030331+0000","last_became_active":"2024-09-12T02:23:04.786591+0000","last_became_peered":"2024-09-12T02:23:04.786591+0000","last_unstale":"2024-09-12T02:23:06.030331+0000","last_undegraded":"2024-09-12T02:23:06.030331+0000","last_fullsized":"2024-09-12T02:23:06.030331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:14.751707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.778547+0000","last_change":"2024-09-12T02:23:03.764530+0000","last_active":"2024-09-12T02:23:05.778547+0000","last_peered":"2024-09-12T02:23:05.778547+0000","last_clean":"2024-09-12T02:23:05.778547+0000","last_became_active":"2024-09-12T02:23:03.764218+0000","last_became_peered":"2024-09-12T02:23:03.764218+0000","last_unstale":"2024-09-12T02:23:05.778547+0000","last_undegraded":"2024-09-12T02:23:05.778547+0000","last_fullsized":"2024-09-12T02:23:05.778547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:55.445619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.778945+0000","last_change":"2024-09-12T02:23:04.780821+0000","last_active":"2024-09-12T02:23:05.778945+0000","last_peered":"2024-09-12T02:23:05.778945+0000","last_clean":"2024-09-12T02:23:05.778945+0000","last_became_active":"2024-09-12T02:23:04.779984+0000","last_became_peered":"2024-09-12T02:23:04.779984+0000","last_unstale":"2024-09-12T02:23:05.778945+0000","last_undegraded":"2024-09-12T02:23:05.778945+0000","last_fullsized":"2024-09-12T02:23:05.778945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:25.724116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775580+0000","last_change":"2024-09-12T02:23:03.770581+0000","last_active":"2024-09-12T02:23:05.775580+0000","last_peered":"2024-09-12T02:23:05.775580+0000","last_clean":"2024-09-12T02:23:05.775580+0000","last_became_active":"2024-09-12T02:23:03.769406+0000","last_became_peered":"2024-09-12T02:23:03.769406+0000","last_unstale":"2024-09-12T02:23:05.775580+0000","last_undegraded":"2024-09-12T02:23:05.775580+0000","last_fullsized":"2024-09-12T02:23:05.775580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:20.963819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.971722+0000","last_change":"2024-09-12T02:23:04.783991+0000","last_active":"2024-09-12T02:23:06.971722+0000","last_peered":"2024-09-12T02:23:06.971722+0000","last_clean":"2024-09-12T02:23:06.971722+0000","last_became_active":"2024-09-12T02:23:04.783143+0000","last_became_peered":"2024-09-12T02:23:04.783143+0000","last_unstale":"2024-09-12T02:23:06.971722+0000","last_undegraded":"2024-09-12T02:23:06.971722+0000","last_fullsized":"2024-09-12T02:23:06.971722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:53.940843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775526+0000","last_change":"2024-09-12T02:23:03.771468+0000","last_active":"2024-09-12T02:23:05.775526+0000","last_peered":"2024-09-12T02:23:05.775526+0000","last_clean":"2024-09-12T02:23:05.775526+0000","last_became_active":"2024-09-12T02:23:03.769619+0000","last_became_peered":"2024-09-12T02:23:03.769619+0000","last_unstale":"2024-09-12T02:23:05.775526+0000","last_undegraded":"2024-09-12T02:23:05.775526+0000","last_fullsized":"2024-09-12T02:23:05.775526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:38.422369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.971928+0000","last_change":"2024-09-12T02:23:04.782769+0000","last_active":"2024-09-12T02:23:06.971928+0000","last_peered":"2024-09-12T02:23:06.971928+0000","last_clean":"2024-09-12T02:23:06.971928+0000","last_became_active":"2024-09-12T02:23:04.782472+0000","last_became_peered":"2024-09-12T02:23:04.782472+0000","last_unstale":"2024-09-12T02:23:06.971928+0000","last_undegraded":"2024-09-12T02:23:06.971928+0000","last_fullsized":"2024-09-12T02:23:06.971928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:46.144471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.779454+0000","last_change":"2024-09-12T02:23:03.763423+0000","last_active":"2024-09-12T02:23:05.779454+0000","last_peered":"2024-09-12T02:23:05.779454+0000","last_clean":"2024-09-12T02:23:05.779454+0000","last_became_active":"2024-09-12T02:23:03.762627+0000","last_became_peered":"2024-09-12T02:23:03.762627+0000","last_unstale":"2024-09-12T02:23:05.779454+0000","last_undegraded":"2024-09-12T02:23:05.779454+0000","last_fullsized":"2024-09-12T02:23:05.779454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:18.090657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.772563+0000","last_change":"2024-09-12T02:23:04.788754+0000","last_active":"2024-09-12T02:23:06.772563+0000","last_peered":"2024-09-12T02:23:06.772563+0000","last_clean":"2024-09-12T02:23:06.772563+0000","last_became_active":"2024-09-12T02:23:04.788350+0000","last_became_peered":"2024-09-12T02:23:04.788350+0000","last_unstale":"2024-09-12T02:23:06.772563+0000","last_undegraded":"2024-09-12T02:23:06.772563+0000","last_fullsized":"2024-09-12T02:23:06.772563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:08.192088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.023782+0000","last_change":"2024-09-12T02:23:04.791109+0000","last_active":"2024-09-12T02:23:06.023782+0000","last_peered":"2024-09-12T02:23:06.023782+0000","last_clean":"2024-09-12T02:23:06.023782+0000","last_became_active":"2024-09-12T02:23:04.790201+0000","last_became_peered":"2024-09-12T02:23:04.790201+0000","last_unstale":"2024-09-12T02:23:06.023782+0000","last_undegraded":"2024-09-12T02:23:06.023782+0000","last_fullsized":"2024-09-12T02:23:06.023782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:13.166139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.779669+0000","last_change":"2024-09-12T02:23:03.763480+0000","last_active":"2024-09-12T02:23:05.779669+0000","last_peered":"2024-09-12T02:23:05.779669+0000","last_clean":"2024-09-12T02:23:05.779669+0000","last_became_active":"2024-09-12T02:23:03.762464+0000","last_became_peered":"2024-09-12T02:23:03.762464+0000","last_unstale":"2024-09-12T02:23:05.779669+0000","last_undegraded":"2024-09-12T02:23:05.779669+0000","last_fullsized":"2024-09-12T02:23:05.779669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:24.308289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.023763+0000","last_change":"2024-09-12T02:23:04.791903+0000","last_active":"2024-09-12T02:23:06.023763+0000","last_peered":"2024-09-12T02:23:06.023763+0000","last_clean":"2024-09-12T02:23:06.023763+0000","last_became_active":"2024-09-12T02:23:04.791635+0000","last_became_peered":"2024-09-12T02:23:04.791635+0000","last_unstale":"2024-09-12T02:23:06.023763+0000","last_undegraded":"2024-09-12T02:23:06.023763+0000","last_fullsized":"2024-09-12T02:23:06.023763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:08.192088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.779997+0000","last_change":"2024-09-12T02:23:03.767875+0000","last_active":"2024-09-12T02:23:05.779997+0000","last_peered":"2024-09-12T02:23:05.779997+0000","last_clean":"2024-09-12T02:23:05.779997+0000","last_became_active":"2024-09-12T02:23:03.767596+0000","last_became_peered":"2024-09-12T02:23:03.767596+0000","last_unstale":"2024-09-12T02:23:05.779997+0000","last_undegraded":"2024-09-12T02:23:05.779997+0000","last_fullsized":"2024-09-12T02:23:05.779997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:22.605725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.030285+0000","last_change":"2024-09-12T02:23:04.782108+0000","last_active":"2024-09-12T02:23:06.030285+0000","last_peered":"2024-09-12T02:23:06.030285+0000","last_clean":"2024-09-12T02:23:06.030285+0000","last_became_active":"2024-09-12T02:23:04.781829+0000","last_became_peered":"2024-09-12T02:23:04.781829+0000","last_unstale":"2024-09-12T02:23:06.030285+0000","last_undegraded":"2024-09-12T02:23:06.030285+0000","last_fullsized":"2024-09-12T02:23:06.030285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:07:33.165742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.972111+0000","last_change":"2024-09-12T02:23:03.767076+0000","last_active":"2024-09-12T02:23:06.972111+0000","last_peered":"2024-09-12T02:23:06.972111+0000","last_clean":"2024-09-12T02:23:06.972111+0000","last_became_active":"2024-09-12T02:23:03.766686+0000","last_became_peered":"2024-09-12T02:23:03.766686+0000","last_unstale":"2024-09-12T02:23:06.972111+0000","last_undegraded":"2024-09-12T02:23:06.972111+0000","last_fullsized":"2024-09-12T02:23:06.972111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:45.706208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.972148+0000","last_change":"2024-09-12T02:23:04.790549+0000","last_active":"2024-09-12T02:23:06.972148+0000","last_peered":"2024-09-12T02:23:06.972148+0000","last_clean":"2024-09-12T02:23:06.972148+0000","last_became_active":"2024-09-12T02:23:04.790187+0000","last_became_peered":"2024-09-12T02:23:04.790187+0000","last_unstale":"2024-09-12T02:23:06.972148+0000","last_undegraded":"2024-09-12T02:23:06.972148+0000","last_fullsized":"2024-09-12T02:23:06.972148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:49.656395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.030340+0000","last_change":"2024-09-12T02:23:03.757848+0000","last_active":"2024-09-12T02:23:06.030340+0000","last_peered":"2024-09-12T02:23:06.030340+0000","last_clean":"2024-09-12T02:23:06.030340+0000","last_became_active":"2024-09-12T02:23:03.757544+0000","last_became_peered":"2024-09-12T02:23:03.757544+0000","last_unstale":"2024-09-12T02:23:06.030340+0000","last_undegraded":"2024-09-12T02:23:06.030340+0000","last_fullsized":"2024-09-12T02:23:06.030340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:43.576128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476742,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":667062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476742,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":77724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476743,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":76202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":229376,"data_stored":76238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35560,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336280,"statfs":{"total":96636764160,"available":96600350720,"internally_reserved":0,"allocated":217088,"data_stored":76112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36160,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335680,"statfs":{"total":96636764160,"available":96599736320,"internally_reserved":0,"allocated":823296,"data_stored":667118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35568,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336272,"statfs":{"total":96636764160,"available":96600342528,"internally_reserved":0,"allocated":217088,"data_stored":71449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35568,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336272,"statfs":{"total":96636764160,"available":96600342528,"internally_reserved":0,"allocated":225280,"data_stored":76272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:23:13.178 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:23:13.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.293+0000 7fac254e6640 1 Processor -- start 2024-09-12T02:23:13.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.293+0000 7fac254e6640 1 -- start start 2024-09-12T02:23:13.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.294+0000 7fac254e6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fac20150480 0x7fac200c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:13.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.294+0000 7fac254e6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac200ca390 0x7fac200c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:13.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.294+0000 7fac254e6640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac2015a7c0 con 0x7fac2006c650 2024-09-12T02:23:13.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.294+0000 7fac254e6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fac2006c240 con 0x7fac20150480 2024-09-12T02:23:13.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.294+0000 7fac254e6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fac2015a330 con 0x7fac200ca390 2024-09-12T02:23:13.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.294+0000 7fac1effd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fac20150480 0x7fac200c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:13.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.294+0000 7fac1effd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fac20150480 0x7fac200c7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38138/0 (socket says 172.21.15.60:38138) 2024-09-12T02:23:13.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.294+0000 7fac1e7fc640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fac2006c650 0x7fac200c9c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55636/0 (socket says 172.21.15.60:55636) 2024-09-12T02:23:13.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.294+0000 7fac1effd640 1 -- 172.21.15.60:0/3498904457 learned_addr learned my addr 172.21.15.60:0/3498904457 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:13.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.294+0000 7fac1f7fe640 1 --2- 172.21.15.60:0/3498904457 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac200ca390 0x7fac200c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:13.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.294+0000 7fac1effd640 1 -- 172.21.15.60:0/3498904457 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac200ca390 msgr2=0x7fac200c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:13.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.294+0000 7fac1effd640 1 --2- 172.21.15.60:0/3498904457 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac200ca390 0x7fac200c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:13.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.294+0000 7fac1effd640 1 -- 172.21.15.60:0/3498904457 >> v1:172.21.15.60:6789/0 conn(0x7fac2006c650 legacy=0x7fac200c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:13.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.294+0000 7fac1dffb640 1 -- 172.21.15.60:0/3498904457 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 259512061 0 0) 0x7fac2015a7c0 con 0x7fac2006c650 2024-09-12T02:23:13.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.294+0000 7fac1effd640 1 -- 172.21.15.60:0/3498904457 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac20159a00 con 0x7fac20150480 2024-09-12T02:23:13.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.295+0000 7fac1effd640 1 --2- 172.21.15.60:0/3498904457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac20150480 0x7fac200c7a90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fac10009e50 tx=0x7fac1002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=204d9191082257 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:13.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.295+0000 7fac1dffb640 1 -- 172.21.15.60:0/3498904457 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac10036070 con 0x7fac20150480 2024-09-12T02:23:13.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.295+0000 7fac1dffb640 1 -- 172.21.15.60:0/3498904457 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac10031600 con 0x7fac20150480 2024-09-12T02:23:13.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.295+0000 7fac1dffb640 1 -- 172.21.15.60:0/3498904457 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac100319d0 con 0x7fac20150480 2024-09-12T02:23:13.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.296+0000 7fac254e6640 1 -- 172.21.15.60:0/3498904457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac20150480 msgr2=0x7fac200c7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:13.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.296+0000 7fac254e6640 1 --2- 172.21.15.60:0/3498904457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac20150480 0x7fac200c7a90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fac10009e50 tx=0x7fac1002a710 comp rx=0 tx=0).stop 2024-09-12T02:23:13.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.296+0000 7fac254e6640 1 -- 172.21.15.60:0/3498904457 shutdown_connections 2024-09-12T02:23:13.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.296+0000 7fac254e6640 1 --2- 172.21.15.60:0/3498904457 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac200ca390 0x7fac200c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:13.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.296+0000 7fac254e6640 1 --2- 172.21.15.60:0/3498904457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac20150480 0x7fac200c7a90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:13.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.296+0000 7fac254e6640 1 -- 172.21.15.60:0/3498904457 >> 172.21.15.60:0/3498904457 conn(0x7fac20068030 msgr2=0x7fac20073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:13.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.296+0000 7fac254e6640 1 -- 172.21.15.60:0/3498904457 shutdown_connections 2024-09-12T02:23:13.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.296+0000 7fac254e6640 1 -- 172.21.15.60:0/3498904457 wait complete. 2024-09-12T02:23:13.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.297+0000 7fac254e6640 1 Processor -- start 2024-09-12T02:23:13.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.297+0000 7fac254e6640 1 -- start start 2024-09-12T02:23:13.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.298+0000 7fac254e6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac2006c650 0x7fac200cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:13.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.298+0000 7fac254e6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac200ca390 0x7fac20151c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:13.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.298+0000 7fac254e6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac20150480 0x7fac201527b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:13.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.298+0000 7fac254e6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fac2006d270 con 0x7fac200ca390 2024-09-12T02:23:13.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.298+0000 7fac254e6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fac20159fc0 con 0x7fac20150480 2024-09-12T02:23:13.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.298+0000 7fac254e6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fac20156270 con 0x7fac2006c650 2024-09-12T02:23:13.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.298+0000 7fac1e7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac200ca390 0x7fac20151c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:13.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.298+0000 7fac1e7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac200ca390 0x7fac20151c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38146/0 (socket says 172.21.15.60:38146) 2024-09-12T02:23:13.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.298+0000 7fac1e7fc640 1 -- 172.21.15.60:0/1060553960 learned_addr learned my addr 172.21.15.60:0/1060553960 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:13.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.298+0000 7fac1effd640 1 --2- 172.21.15.60:0/1060553960 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac2006c650 0x7fac200cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:13.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.298+0000 7fac1f7fe640 1 --2- 172.21.15.60:0/1060553960 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac20150480 0x7fac201527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:13.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.299+0000 7fac1e7fc640 1 -- 172.21.15.60:0/1060553960 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac2006c650 msgr2=0x7fac200cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:13.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.299+0000 7fac1e7fc640 1 --2- 172.21.15.60:0/1060553960 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac2006c650 0x7fac200cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:13.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.299+0000 7fac1e7fc640 1 -- 172.21.15.60:0/1060553960 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac20150480 msgr2=0x7fac201527b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:13.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.299+0000 7fac1e7fc640 1 --2- 172.21.15.60:0/1060553960 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac20150480 0x7fac201527b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:13.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.299+0000 7fac1e7fc640 1 -- 172.21.15.60:0/1060553960 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac2014f9a0 con 0x7fac200ca390 2024-09-12T02:23:13.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.299+0000 7fac1e7fc640 1 --2- 172.21.15.60:0/1060553960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac200ca390 0x7fac20151c60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fac0800c460 tx=0x7fac0800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:13.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.299+0000 7fac177fe640 1 -- 172.21.15.60:0/1060553960 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac08018070 con 0x7fac200ca390 2024-09-12T02:23:13.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.299+0000 7fac177fe640 1 -- 172.21.15.60:0/1060553960 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac08007500 con 0x7fac200ca390 2024-09-12T02:23:13.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.299+0000 7fac254e6640 1 -- 172.21.15.60:0/1060553960 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac201e1970 con 0x7fac200ca390 2024-09-12T02:23:13.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.299+0000 7fac177fe640 1 -- 172.21.15.60:0/1060553960 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac08004a20 con 0x7fac200ca390 2024-09-12T02:23:13.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.299+0000 7fac254e6640 1 -- 172.21.15.60:0/1060553960 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac201df8d0 con 0x7fac200ca390 2024-09-12T02:23:13.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.300+0000 7fac254e6640 1 -- 172.21.15.60:0/1060553960 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac201559a0 con 0x7fac200ca390 2024-09-12T02:23:13.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.301+0000 7fac177fe640 1 -- 172.21.15.60:0/1060553960 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fac0801b070 con 0x7fac200ca390 2024-09-12T02:23:13.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.301+0000 7fac177fe640 1 --2- 172.21.15.60:0/1060553960 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fac0006be30 0x7fac0006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:13.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.301+0000 7fac177fe640 1 -- 172.21.15.60:0/1060553960 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5689+0+0 (secure 0 0 0) 0x7fac0808a090 con 0x7fac200ca390 2024-09-12T02:23:13.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.301+0000 7fac1effd640 1 --2- 172.21.15.60:0/1060553960 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fac0006be30 0x7fac0006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:13.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.302+0000 7fac1effd640 1 --2- 172.21.15.60:0/1060553960 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fac0006be30 0x7fac0006e2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fac10033000 tx=0x7fac10009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:13.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.305+0000 7fac177fe640 1 -- 172.21.15.60:0/1060553960 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fac201559a0 con 0x7fac200ca390 2024-09-12T02:23:13.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.479+0000 7fac254e6640 1 -- 172.21.15.60:0/1060553960 --> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fac200c9c80 con 0x7fac0006be30 2024-09-12T02:23:13.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.485+0000 7fac177fe640 1 -- 172.21.15.60:0/1060553960 <== mgr.4098 v2:172.21.15.60:6800/3549430091 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251945 (secure 0 0 0) 0x7fac200c9c80 con 0x7fac0006be30 2024-09-12T02:23:13.488 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:23:13.489 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T02:23:13.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.488+0000 7fac254e6640 1 -- 172.21.15.60:0/1060553960 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fac0006be30 msgr2=0x7fac0006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:13.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.488+0000 7fac254e6640 1 --2- 172.21.15.60:0/1060553960 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fac0006be30 0x7fac0006e2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fac10033000 tx=0x7fac10009000 comp rx=0 tx=0).stop 2024-09-12T02:23:13.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.488+0000 7fac254e6640 1 -- 172.21.15.60:0/1060553960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac200ca390 msgr2=0x7fac20151c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:13.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.488+0000 7fac254e6640 1 --2- 172.21.15.60:0/1060553960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac200ca390 0x7fac20151c60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fac0800c460 tx=0x7fac0800c920 comp rx=0 tx=0).stop 2024-09-12T02:23:13.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.488+0000 7fac254e6640 1 -- 172.21.15.60:0/1060553960 shutdown_connections 2024-09-12T02:23:13.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.488+0000 7fac254e6640 1 --2- 172.21.15.60:0/1060553960 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fac0006be30 0x7fac0006e2f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:13.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.488+0000 7fac254e6640 1 --2- 172.21.15.60:0/1060553960 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac20150480 0x7fac201527b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:13.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.488+0000 7fac254e6640 1 --2- 172.21.15.60:0/1060553960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac200ca390 0x7fac20151c60 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:13.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.488+0000 7fac254e6640 1 --2- 172.21.15.60:0/1060553960 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac2006c650 0x7fac200cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:13.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.488+0000 7fac254e6640 1 -- 172.21.15.60:0/1060553960 >> 172.21.15.60:0/1060553960 conn(0x7fac20068030 msgr2=0x7fac20154f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:13.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.488+0000 7fac254e6640 1 -- 172.21.15.60:0/1060553960 shutdown_connections 2024-09-12T02:23:13.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.488+0000 7fac254e6640 1 -- 172.21.15.60:0/1060553960 wait complete. 2024-09-12T02:23:13.499 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-12T02:23:12.088273+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252444,"kb_used_data":2908,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754722276,"statfs":{"total":773094113280,"available":772835610624,"internally_reserved":0,"allocated":2977792,"data_stored":1788177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001354"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.780089+0000","last_change":"2024-09-12T02:23:04.791204+0000","last_active":"2024-09-12T02:23:05.780089+0000","last_peered":"2024-09-12T02:23:05.780089+0000","last_clean":"2024-09-12T02:23:05.780089+0000","last_became_active":"2024-09-12T02:23:04.790906+0000","last_became_peered":"2024-09-12T02:23:04.790906+0000","last_unstale":"2024-09-12T02:23:05.780089+0000","last_undegraded":"2024-09-12T02:23:05.780089+0000","last_fullsized":"2024-09-12T02:23:05.780089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:16.336873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775715+0000","last_change":"2024-09-12T02:23:04.785821+0000","last_active":"2024-09-12T02:23:05.775715+0000","last_peered":"2024-09-12T02:23:05.775715+0000","last_clean":"2024-09-12T02:23:05.775715+0000","last_became_active":"2024-09-12T02:23:04.785516+0000","last_became_peered":"2024-09-12T02:23:04.785516+0000","last_unstale":"2024-09-12T02:23:05.775715+0000","last_undegraded":"2024-09-12T02:23:05.775715+0000","last_fullsized":"2024-09-12T02:23:05.775715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:42.400040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.030207+0000","last_change":"2024-09-12T02:23:04.778772+0000","last_active":"2024-09-12T02:23:06.030207+0000","last_peered":"2024-09-12T02:23:06.030207+0000","last_clean":"2024-09-12T02:23:06.030207+0000","last_became_active":"2024-09-12T02:23:04.778445+0000","last_became_peered":"2024-09-12T02:23:04.778445+0000","last_unstale":"2024-09-12T02:23:06.030207+0000","last_undegraded":"2024-09-12T02:23:06.030207+0000","last_fullsized":"2024-09-12T02:23:06.030207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:58.292023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.023596+0000","last_change":"2024-09-12T02:23:04.786772+0000","last_active":"2024-09-12T02:23:06.023596+0000","last_peered":"2024-09-12T02:23:06.023596+0000","last_clean":"2024-09-12T02:23:06.023596+0000","last_became_active":"2024-09-12T02:23:04.786509+0000","last_became_peered":"2024-09-12T02:23:04.786509+0000","last_unstale":"2024-09-12T02:23:06.023596+0000","last_undegraded":"2024-09-12T02:23:06.023596+0000","last_fullsized":"2024-09-12T02:23:06.023596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:01.755827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.779368+0000","last_change":"2024-09-12T02:23:04.777165+0000","last_active":"2024-09-12T02:23:05.779368+0000","last_peered":"2024-09-12T02:23:05.779368+0000","last_clean":"2024-09-12T02:23:05.779368+0000","last_became_active":"2024-09-12T02:23:04.776857+0000","last_became_peered":"2024-09-12T02:23:04.776857+0000","last_unstale":"2024-09-12T02:23:05.779368+0000","last_undegraded":"2024-09-12T02:23:05.779368+0000","last_fullsized":"2024-09-12T02:23:05.779368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:28.309591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.023403+0000","last_change":"2024-09-12T02:23:04.788890+0000","last_active":"2024-09-12T02:23:06.023403+0000","last_peered":"2024-09-12T02:23:06.023403+0000","last_clean":"2024-09-12T02:23:06.023403+0000","last_became_active":"2024-09-12T02:23:04.788617+0000","last_became_peered":"2024-09-12T02:23:04.788617+0000","last_unstale":"2024-09-12T02:23:06.023403+0000","last_undegraded":"2024-09-12T02:23:06.023403+0000","last_fullsized":"2024-09-12T02:23:06.023403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:24.194151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.778801+0000","last_change":"2024-09-12T02:23:04.779265+0000","last_active":"2024-09-12T02:23:05.778801+0000","last_peered":"2024-09-12T02:23:05.778801+0000","last_clean":"2024-09-12T02:23:05.778801+0000","last_became_active":"2024-09-12T02:23:04.778968+0000","last_became_peered":"2024-09-12T02:23:04.778968+0000","last_unstale":"2024-09-12T02:23:05.778801+0000","last_undegraded":"2024-09-12T02:23:05.778801+0000","last_fullsized":"2024-09-12T02:23:05.778801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:53.022598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.971553+0000","last_change":"2024-09-12T02:23:04.779648+0000","last_active":"2024-09-12T02:23:06.971553+0000","last_peered":"2024-09-12T02:23:06.971553+0000","last_clean":"2024-09-12T02:23:06.971553+0000","last_became_active":"2024-09-12T02:23:04.779384+0000","last_became_peered":"2024-09-12T02:23:04.779384+0000","last_unstale":"2024-09-12T02:23:06.971553+0000","last_undegraded":"2024-09-12T02:23:06.971553+0000","last_fullsized":"2024-09-12T02:23:06.971553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:41.491471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.780145+0000","last_change":"2024-09-12T02:23:04.781090+0000","last_active":"2024-09-12T02:23:05.780145+0000","last_peered":"2024-09-12T02:23:05.780145+0000","last_clean":"2024-09-12T02:23:05.780145+0000","last_became_active":"2024-09-12T02:23:04.780740+0000","last_became_peered":"2024-09-12T02:23:04.780740+0000","last_unstale":"2024-09-12T02:23:05.780145+0000","last_undegraded":"2024-09-12T02:23:05.780145+0000","last_fullsized":"2024-09-12T02:23:05.780145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:30.639111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.772845+0000","last_change":"2024-09-12T02:23:04.791929+0000","last_active":"2024-09-12T02:23:06.772845+0000","last_peered":"2024-09-12T02:23:06.772845+0000","last_clean":"2024-09-12T02:23:06.772845+0000","last_became_active":"2024-09-12T02:23:04.791622+0000","last_became_peered":"2024-09-12T02:23:04.791622+0000","last_unstale":"2024-09-12T02:23:06.772845+0000","last_undegraded":"2024-09-12T02:23:06.772845+0000","last_fullsized":"2024-09-12T02:23:06.772845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:35.012685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.772830+0000","last_change":"2024-09-12T02:23:04.785662+0000","last_active":"2024-09-12T02:23:06.772830+0000","last_peered":"2024-09-12T02:23:06.772830+0000","last_clean":"2024-09-12T02:23:06.772830+0000","last_became_active":"2024-09-12T02:23:04.785375+0000","last_became_peered":"2024-09-12T02:23:04.785375+0000","last_unstale":"2024-09-12T02:23:06.772830+0000","last_undegraded":"2024-09-12T02:23:06.772830+0000","last_fullsized":"2024-09-12T02:23:06.772830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:44.295056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.778936+0000","last_change":"2024-09-12T02:23:04.787034+0000","last_active":"2024-09-12T02:23:05.778936+0000","last_peered":"2024-09-12T02:23:05.778936+0000","last_clean":"2024-09-12T02:23:05.778936+0000","last_became_active":"2024-09-12T02:23:04.786044+0000","last_became_peered":"2024-09-12T02:23:04.786044+0000","last_unstale":"2024-09-12T02:23:05.778936+0000","last_undegraded":"2024-09-12T02:23:05.778936+0000","last_fullsized":"2024-09-12T02:23:05.778936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:07.183028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.971880+0000","last_change":"2024-09-12T02:23:04.782128+0000","last_active":"2024-09-12T02:23:06.971880+0000","last_peered":"2024-09-12T02:23:06.971880+0000","last_clean":"2024-09-12T02:23:06.971880+0000","last_became_active":"2024-09-12T02:23:04.781101+0000","last_became_peered":"2024-09-12T02:23:04.781101+0000","last_unstale":"2024-09-12T02:23:06.971880+0000","last_undegraded":"2024-09-12T02:23:06.971880+0000","last_fullsized":"2024-09-12T02:23:06.971880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:49.421147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.030027+0000","last_change":"2024-09-12T02:23:04.787140+0000","last_active":"2024-09-12T02:23:06.030027+0000","last_peered":"2024-09-12T02:23:06.030027+0000","last_clean":"2024-09-12T02:23:06.030027+0000","last_became_active":"2024-09-12T02:23:04.786799+0000","last_became_peered":"2024-09-12T02:23:04.786799+0000","last_unstale":"2024-09-12T02:23:06.030027+0000","last_undegraded":"2024-09-12T02:23:06.030027+0000","last_fullsized":"2024-09-12T02:23:06.030027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:31.639605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775453+0000","last_change":"2024-09-12T02:23:04.782490+0000","last_active":"2024-09-12T02:23:05.775453+0000","last_peered":"2024-09-12T02:23:05.775453+0000","last_clean":"2024-09-12T02:23:05.775453+0000","last_became_active":"2024-09-12T02:23:04.782183+0000","last_became_peered":"2024-09-12T02:23:04.782183+0000","last_unstale":"2024-09-12T02:23:05.775453+0000","last_undegraded":"2024-09-12T02:23:05.775453+0000","last_fullsized":"2024-09-12T02:23:05.775453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:28.699880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.023275+0000","last_change":"2024-09-12T02:23:04.790532+0000","last_active":"2024-09-12T02:23:06.023275+0000","last_peered":"2024-09-12T02:23:06.023275+0000","last_clean":"2024-09-12T02:23:06.023275+0000","last_became_active":"2024-09-12T02:23:04.789229+0000","last_became_peered":"2024-09-12T02:23:04.789229+0000","last_unstale":"2024-09-12T02:23:06.023275+0000","last_undegraded":"2024-09-12T02:23:06.023275+0000","last_fullsized":"2024-09-12T02:23:06.023275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:59.901665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.023994+0000","last_change":"2024-09-12T02:23:04.789439+0000","last_active":"2024-09-12T02:23:06.023994+0000","last_peered":"2024-09-12T02:23:06.023994+0000","last_clean":"2024-09-12T02:23:06.023994+0000","last_became_active":"2024-09-12T02:23:04.787421+0000","last_became_peered":"2024-09-12T02:23:04.787421+0000","last_unstale":"2024-09-12T02:23:06.023994+0000","last_undegraded":"2024-09-12T02:23:06.023994+0000","last_fullsized":"2024-09-12T02:23:06.023994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:44.295056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.871456+0000","last_change":"2024-09-12T02:23:04.791378+0000","last_active":"2024-09-12T02:23:05.871456+0000","last_peered":"2024-09-12T02:23:05.871456+0000","last_clean":"2024-09-12T02:23:05.871456+0000","last_became_active":"2024-09-12T02:23:04.790926+0000","last_became_peered":"2024-09-12T02:23:04.790926+0000","last_unstale":"2024-09-12T02:23:05.871456+0000","last_undegraded":"2024-09-12T02:23:05.871456+0000","last_fullsized":"2024-09-12T02:23:05.871456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:34.764210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.780154+0000","last_change":"2024-09-12T02:23:04.777450+0000","last_active":"2024-09-12T02:23:05.780154+0000","last_peered":"2024-09-12T02:23:05.780154+0000","last_clean":"2024-09-12T02:23:05.780154+0000","last_became_active":"2024-09-12T02:23:04.776825+0000","last_became_peered":"2024-09-12T02:23:04.776825+0000","last_unstale":"2024-09-12T02:23:05.780154+0000","last_undegraded":"2024-09-12T02:23:05.780154+0000","last_fullsized":"2024-09-12T02:23:05.780154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:40.315075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.772612+0000","last_change":"2024-09-12T02:23:04.789575+0000","last_active":"2024-09-12T02:23:06.772612+0000","last_peered":"2024-09-12T02:23:06.772612+0000","last_clean":"2024-09-12T02:23:06.772612+0000","last_became_active":"2024-09-12T02:23:04.789296+0000","last_became_peered":"2024-09-12T02:23:04.789296+0000","last_unstale":"2024-09-12T02:23:06.772612+0000","last_undegraded":"2024-09-12T02:23:06.772612+0000","last_fullsized":"2024-09-12T02:23:06.772612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:13.166139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.030191+0000","last_change":"2024-09-12T02:23:04.785849+0000","last_active":"2024-09-12T02:23:06.030191+0000","last_peered":"2024-09-12T02:23:06.030191+0000","last_clean":"2024-09-12T02:23:06.030191+0000","last_became_active":"2024-09-12T02:23:04.785511+0000","last_became_peered":"2024-09-12T02:23:04.785511+0000","last_unstale":"2024-09-12T02:23:06.030191+0000","last_undegraded":"2024-09-12T02:23:06.030191+0000","last_fullsized":"2024-09-12T02:23:06.030191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:28.670102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.023416+0000","last_change":"2024-09-12T02:23:04.785685+0000","last_active":"2024-09-12T02:23:06.023416+0000","last_peered":"2024-09-12T02:23:06.023416+0000","last_clean":"2024-09-12T02:23:06.023416+0000","last_became_active":"2024-09-12T02:23:04.784945+0000","last_became_peered":"2024-09-12T02:23:04.784945+0000","last_unstale":"2024-09-12T02:23:06.023416+0000","last_undegraded":"2024-09-12T02:23:06.023416+0000","last_fullsized":"2024-09-12T02:23:06.023416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:36.658436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.971740+0000","last_change":"2024-09-12T02:23:04.788624+0000","last_active":"2024-09-12T02:23:06.971740+0000","last_peered":"2024-09-12T02:23:06.971740+0000","last_clean":"2024-09-12T02:23:06.971740+0000","last_became_active":"2024-09-12T02:23:04.788352+0000","last_became_peered":"2024-09-12T02:23:04.788352+0000","last_unstale":"2024-09-12T02:23:06.971740+0000","last_undegraded":"2024-09-12T02:23:06.971740+0000","last_fullsized":"2024-09-12T02:23:06.971740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:13.961110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.023383+0000","last_change":"2024-09-12T02:23:04.787389+0000","last_active":"2024-09-12T02:23:06.023383+0000","last_peered":"2024-09-12T02:23:06.023383+0000","last_clean":"2024-09-12T02:23:06.023383+0000","last_became_active":"2024-09-12T02:23:04.787092+0000","last_became_peered":"2024-09-12T02:23:04.787092+0000","last_unstale":"2024-09-12T02:23:06.023383+0000","last_undegraded":"2024-09-12T02:23:06.023383+0000","last_fullsized":"2024-09-12T02:23:06.023383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:02.924906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.972167+0000","last_change":"2024-09-12T02:23:04.787899+0000","last_active":"2024-09-12T02:23:06.972167+0000","last_peered":"2024-09-12T02:23:06.972167+0000","last_clean":"2024-09-12T02:23:06.972167+0000","last_became_active":"2024-09-12T02:23:04.787619+0000","last_became_peered":"2024-09-12T02:23:04.787619+0000","last_unstale":"2024-09-12T02:23:06.972167+0000","last_undegraded":"2024-09-12T02:23:06.972167+0000","last_fullsized":"2024-09-12T02:23:06.972167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:57.732453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.773009+0000","last_change":"2024-09-12T02:23:04.788827+0000","last_active":"2024-09-12T02:23:06.773009+0000","last_peered":"2024-09-12T02:23:06.773009+0000","last_clean":"2024-09-12T02:23:06.773009+0000","last_became_active":"2024-09-12T02:23:04.788521+0000","last_became_peered":"2024-09-12T02:23:04.788521+0000","last_unstale":"2024-09-12T02:23:06.773009+0000","last_undegraded":"2024-09-12T02:23:06.773009+0000","last_fullsized":"2024-09-12T02:23:06.773009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:24.470245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775630+0000","last_change":"2024-09-12T02:23:04.776435+0000","last_active":"2024-09-12T02:23:05.775630+0000","last_peered":"2024-09-12T02:23:05.775630+0000","last_clean":"2024-09-12T02:23:05.775630+0000","last_became_active":"2024-09-12T02:23:04.776120+0000","last_became_peered":"2024-09-12T02:23:04.776120+0000","last_unstale":"2024-09-12T02:23:05.775630+0000","last_undegraded":"2024-09-12T02:23:05.775630+0000","last_fullsized":"2024-09-12T02:23:05.775630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:27.985094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.972092+0000","last_change":"2024-09-12T02:23:04.789372+0000","last_active":"2024-09-12T02:23:06.972092+0000","last_peered":"2024-09-12T02:23:06.972092+0000","last_clean":"2024-09-12T02:23:06.972092+0000","last_became_active":"2024-09-12T02:23:04.789090+0000","last_became_peered":"2024-09-12T02:23:04.789090+0000","last_unstale":"2024-09-12T02:23:06.972092+0000","last_undegraded":"2024-09-12T02:23:06.972092+0000","last_fullsized":"2024-09-12T02:23:06.972092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:49.533491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.030241+0000","last_change":"2024-09-12T02:23:04.777018+0000","last_active":"2024-09-12T02:23:06.030241+0000","last_peered":"2024-09-12T02:23:06.030241+0000","last_clean":"2024-09-12T02:23:06.030241+0000","last_became_active":"2024-09-12T02:23:04.776736+0000","last_became_peered":"2024-09-12T02:23:04.776736+0000","last_unstale":"2024-09-12T02:23:06.030241+0000","last_undegraded":"2024-09-12T02:23:06.030241+0000","last_fullsized":"2024-09-12T02:23:06.030241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:08.668990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.023652+0000","last_change":"2024-09-12T02:23:04.785920+0000","last_active":"2024-09-12T02:23:06.023652+0000","last_peered":"2024-09-12T02:23:06.023652+0000","last_clean":"2024-09-12T02:23:06.023652+0000","last_became_active":"2024-09-12T02:23:04.785422+0000","last_became_peered":"2024-09-12T02:23:04.785422+0000","last_unstale":"2024-09-12T02:23:06.023652+0000","last_undegraded":"2024-09-12T02:23:06.023652+0000","last_fullsized":"2024-09-12T02:23:06.023652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:55.106703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.871367+0000","last_change":"2024-09-12T02:23:04.780662+0000","last_active":"2024-09-12T02:23:05.871367+0000","last_peered":"2024-09-12T02:23:05.871367+0000","last_clean":"2024-09-12T02:23:05.871367+0000","last_became_active":"2024-09-12T02:23:04.780402+0000","last_became_peered":"2024-09-12T02:23:04.780402+0000","last_unstale":"2024-09-12T02:23:05.871367+0000","last_undegraded":"2024-09-12T02:23:05.871367+0000","last_fullsized":"2024-09-12T02:23:05.871367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:23:00.556487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.772582+0000","last_change":"2024-09-12T02:23:04.788489+0000","last_active":"2024-09-12T02:23:06.772582+0000","last_peered":"2024-09-12T02:23:06.772582+0000","last_clean":"2024-09-12T02:23:06.772582+0000","last_became_active":"2024-09-12T02:23:04.788195+0000","last_became_peered":"2024-09-12T02:23:04.788195+0000","last_unstale":"2024-09-12T02:23:06.772582+0000","last_undegraded":"2024-09-12T02:23:06.772582+0000","last_fullsized":"2024-09-12T02:23:06.772582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:51.352859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.779241+0000","last_change":"2024-09-12T02:23:04.771579+0000","last_active":"2024-09-12T02:23:05.779241+0000","last_peered":"2024-09-12T02:23:05.779241+0000","last_clean":"2024-09-12T02:23:05.779241+0000","last_became_active":"2024-09-12T02:23:04.771310+0000","last_became_peered":"2024-09-12T02:23:04.771310+0000","last_unstale":"2024-09-12T02:23:05.779241+0000","last_undegraded":"2024-09-12T02:23:05.779241+0000","last_fullsized":"2024-09-12T02:23:05.779241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:05.115474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.972043+0000","last_change":"2024-09-12T02:23:03.764310+0000","last_active":"2024-09-12T02:23:06.972043+0000","last_peered":"2024-09-12T02:23:06.972043+0000","last_clean":"2024-09-12T02:23:06.972043+0000","last_became_active":"2024-09-12T02:23:03.764020+0000","last_became_peered":"2024-09-12T02:23:03.764020+0000","last_unstale":"2024-09-12T02:23:06.972043+0000","last_undegraded":"2024-09-12T02:23:06.972043+0000","last_fullsized":"2024-09-12T02:23:06.972043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:25.892874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.030449+0000","last_change":"2024-09-12T02:23:04.793412+0000","last_active":"2024-09-12T02:23:06.030449+0000","last_peered":"2024-09-12T02:23:06.030449+0000","last_clean":"2024-09-12T02:23:06.030449+0000","last_became_active":"2024-09-12T02:23:04.793100+0000","last_became_peered":"2024-09-12T02:23:04.793100+0000","last_unstale":"2024-09-12T02:23:06.030449+0000","last_undegraded":"2024-09-12T02:23:06.030449+0000","last_fullsized":"2024-09-12T02:23:06.030449+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:50.446212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.772522+0000","last_change":"2024-09-12T02:23:03.768186+0000","last_active":"2024-09-12T02:23:06.772522+0000","last_peered":"2024-09-12T02:23:06.772522+0000","last_clean":"2024-09-12T02:23:06.772522+0000","last_became_active":"2024-09-12T02:23:03.767916+0000","last_became_peered":"2024-09-12T02:23:03.767916+0000","last_unstale":"2024-09-12T02:23:06.772522+0000","last_undegraded":"2024-09-12T02:23:06.772522+0000","last_fullsized":"2024-09-12T02:23:06.772522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:04.424540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.971673+0000","last_change":"2024-09-12T02:23:03.768361+0000","last_active":"2024-09-12T02:23:06.971673+0000","last_peered":"2024-09-12T02:23:06.971673+0000","last_clean":"2024-09-12T02:23:06.971673+0000","last_became_active":"2024-09-12T02:23:03.768137+0000","last_became_peered":"2024-09-12T02:23:03.768137+0000","last_unstale":"2024-09-12T02:23:06.971673+0000","last_undegraded":"2024-09-12T02:23:06.971673+0000","last_fullsized":"2024-09-12T02:23:06.971673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:29.721363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.971707+0000","last_change":"2024-09-12T02:23:04.783317+0000","last_active":"2024-09-12T02:23:06.971707+0000","last_peered":"2024-09-12T02:23:06.971707+0000","last_clean":"2024-09-12T02:23:06.971707+0000","last_became_active":"2024-09-12T02:23:04.783039+0000","last_became_peered":"2024-09-12T02:23:04.783039+0000","last_unstale":"2024-09-12T02:23:06.971707+0000","last_undegraded":"2024-09-12T02:23:06.971707+0000","last_fullsized":"2024-09-12T02:23:06.971707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:17.577991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.023501+0000","last_change":"2024-09-12T02:23:03.762450+0000","last_active":"2024-09-12T02:23:06.023501+0000","last_peered":"2024-09-12T02:23:06.023501+0000","last_clean":"2024-09-12T02:23:06.023501+0000","last_became_active":"2024-09-12T02:23:03.762161+0000","last_became_peered":"2024-09-12T02:23:03.762161+0000","last_unstale":"2024-09-12T02:23:06.023501+0000","last_undegraded":"2024-09-12T02:23:06.023501+0000","last_fullsized":"2024-09-12T02:23:06.023501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:42.256395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775427+0000","last_change":"2024-09-12T02:23:04.776572+0000","last_active":"2024-09-12T02:23:05.775427+0000","last_peered":"2024-09-12T02:23:05.775427+0000","last_clean":"2024-09-12T02:23:05.775427+0000","last_became_active":"2024-09-12T02:23:04.776270+0000","last_became_peered":"2024-09-12T02:23:04.776270+0000","last_unstale":"2024-09-12T02:23:05.775427+0000","last_undegraded":"2024-09-12T02:23:05.775427+0000","last_fullsized":"2024-09-12T02:23:05.775427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:12.807907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.772706+0000","last_change":"2024-09-12T02:23:03.770668+0000","last_active":"2024-09-12T02:23:06.772706+0000","last_peered":"2024-09-12T02:23:06.772706+0000","last_clean":"2024-09-12T02:23:06.772706+0000","last_became_active":"2024-09-12T02:23:03.769302+0000","last_became_peered":"2024-09-12T02:23:03.769302+0000","last_unstale":"2024-09-12T02:23:06.772706+0000","last_undegraded":"2024-09-12T02:23:06.772706+0000","last_fullsized":"2024-09-12T02:23:06.772706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:18.948922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.023702+0000","last_change":"2024-09-12T02:23:04.786100+0000","last_active":"2024-09-12T02:23:06.023702+0000","last_peered":"2024-09-12T02:23:06.023702+0000","last_clean":"2024-09-12T02:23:06.023702+0000","last_became_active":"2024-09-12T02:23:04.785795+0000","last_became_peered":"2024-09-12T02:23:04.785795+0000","last_unstale":"2024-09-12T02:23:06.023702+0000","last_undegraded":"2024-09-12T02:23:06.023702+0000","last_fullsized":"2024-09-12T02:23:06.023702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:58.597807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.023734+0000","last_change":"2024-09-12T02:23:03.769710+0000","last_active":"2024-09-12T02:23:06.023734+0000","last_peered":"2024-09-12T02:23:06.023734+0000","last_clean":"2024-09-12T02:23:06.023734+0000","last_became_active":"2024-09-12T02:23:03.769436+0000","last_became_peered":"2024-09-12T02:23:03.769436+0000","last_unstale":"2024-09-12T02:23:06.023734+0000","last_undegraded":"2024-09-12T02:23:06.023734+0000","last_fullsized":"2024-09-12T02:23:06.023734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:11.194147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.030371+0000","last_change":"2024-09-12T02:23:04.779171+0000","last_active":"2024-09-12T02:23:06.030371+0000","last_peered":"2024-09-12T02:23:06.030371+0000","last_clean":"2024-09-12T02:23:06.030371+0000","last_became_active":"2024-09-12T02:23:04.778850+0000","last_became_peered":"2024-09-12T02:23:04.778850+0000","last_unstale":"2024-09-12T02:23:06.030371+0000","last_undegraded":"2024-09-12T02:23:06.030371+0000","last_fullsized":"2024-09-12T02:23:06.030371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:21.746490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775627+0000","last_change":"2024-09-12T02:23:03.771271+0000","last_active":"2024-09-12T02:23:05.775627+0000","last_peered":"2024-09-12T02:23:05.775627+0000","last_clean":"2024-09-12T02:23:05.775627+0000","last_became_active":"2024-09-12T02:23:03.769601+0000","last_became_peered":"2024-09-12T02:23:03.769601+0000","last_unstale":"2024-09-12T02:23:05.775627+0000","last_undegraded":"2024-09-12T02:23:05.775627+0000","last_fullsized":"2024-09-12T02:23:05.775627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:22.910072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.779103+0000","last_change":"2024-09-12T02:23:04.777953+0000","last_active":"2024-09-12T02:23:05.779103+0000","last_peered":"2024-09-12T02:23:05.779103+0000","last_clean":"2024-09-12T02:23:05.779103+0000","last_became_active":"2024-09-12T02:23:04.777081+0000","last_became_peered":"2024-09-12T02:23:04.777081+0000","last_unstale":"2024-09-12T02:23:05.779103+0000","last_undegraded":"2024-09-12T02:23:05.779103+0000","last_fullsized":"2024-09-12T02:23:05.779103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:14.103378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.772811+0000","last_change":"2024-09-12T02:23:03.768425+0000","last_active":"2024-09-12T02:23:06.772811+0000","last_peered":"2024-09-12T02:23:06.772811+0000","last_clean":"2024-09-12T02:23:06.772811+0000","last_became_active":"2024-09-12T02:23:03.768092+0000","last_became_peered":"2024-09-12T02:23:03.768092+0000","last_unstale":"2024-09-12T02:23:06.772811+0000","last_undegraded":"2024-09-12T02:23:06.772811+0000","last_fullsized":"2024-09-12T02:23:06.772811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:18.572070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.779850+0000","last_change":"2024-09-12T02:23:04.780843+0000","last_active":"2024-09-12T02:23:05.779850+0000","last_peered":"2024-09-12T02:23:05.779850+0000","last_clean":"2024-09-12T02:23:05.779850+0000","last_became_active":"2024-09-12T02:23:04.780475+0000","last_became_peered":"2024-09-12T02:23:04.780475+0000","last_unstale":"2024-09-12T02:23:05.779850+0000","last_undegraded":"2024-09-12T02:23:05.779850+0000","last_fullsized":"2024-09-12T02:23:05.779850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:38.074872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.030297+0000","last_change":"2024-09-12T02:23:03.762859+0000","last_active":"2024-09-12T02:23:06.030297+0000","last_peered":"2024-09-12T02:23:06.030297+0000","last_clean":"2024-09-12T02:23:06.030297+0000","last_became_active":"2024-09-12T02:23:03.762557+0000","last_became_peered":"2024-09-12T02:23:03.762557+0000","last_unstale":"2024-09-12T02:23:06.030297+0000","last_undegraded":"2024-09-12T02:23:06.030297+0000","last_fullsized":"2024-09-12T02:23:06.030297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:34.863435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.030120+0000","last_change":"2024-09-12T02:23:04.784379+0000","last_active":"2024-09-12T02:23:06.030120+0000","last_peered":"2024-09-12T02:23:06.030120+0000","last_clean":"2024-09-12T02:23:06.030120+0000","last_became_active":"2024-09-12T02:23:04.784094+0000","last_became_peered":"2024-09-12T02:23:04.784094+0000","last_unstale":"2024-09-12T02:23:06.030120+0000","last_undegraded":"2024-09-12T02:23:06.030120+0000","last_fullsized":"2024-09-12T02:23:06.030120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:22.103008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.023721+0000","last_change":"2024-09-12T02:23:03.767217+0000","last_active":"2024-09-12T02:23:06.023721+0000","last_peered":"2024-09-12T02:23:06.023721+0000","last_clean":"2024-09-12T02:23:06.023721+0000","last_became_active":"2024-09-12T02:23:03.766551+0000","last_became_peered":"2024-09-12T02:23:03.766551+0000","last_unstale":"2024-09-12T02:23:06.023721+0000","last_undegraded":"2024-09-12T02:23:06.023721+0000","last_fullsized":"2024-09-12T02:23:06.023721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:09.963450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.779506+0000","last_change":"2024-09-12T02:23:04.783671+0000","last_active":"2024-09-12T02:23:05.779506+0000","last_peered":"2024-09-12T02:23:05.779506+0000","last_clean":"2024-09-12T02:23:05.779506+0000","last_became_active":"2024-09-12T02:23:04.783399+0000","last_became_peered":"2024-09-12T02:23:04.783399+0000","last_unstale":"2024-09-12T02:23:05.779506+0000","last_undegraded":"2024-09-12T02:23:05.779506+0000","last_fullsized":"2024-09-12T02:23:05.779506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:04.321789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.772461+0000","last_change":"2024-09-12T02:23:03.767842+0000","last_active":"2024-09-12T02:23:06.772461+0000","last_peered":"2024-09-12T02:23:06.772461+0000","last_clean":"2024-09-12T02:23:06.772461+0000","last_became_active":"2024-09-12T02:23:03.767066+0000","last_became_peered":"2024-09-12T02:23:03.767066+0000","last_unstale":"2024-09-12T02:23:06.772461+0000","last_undegraded":"2024-09-12T02:23:06.772461+0000","last_fullsized":"2024-09-12T02:23:06.772461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:50.800749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.772651+0000","last_change":"2024-09-12T02:23:04.785248+0000","last_active":"2024-09-12T02:23:06.772651+0000","last_peered":"2024-09-12T02:23:06.772651+0000","last_clean":"2024-09-12T02:23:06.772651+0000","last_became_active":"2024-09-12T02:23:04.784977+0000","last_became_peered":"2024-09-12T02:23:04.784977+0000","last_unstale":"2024-09-12T02:23:06.772651+0000","last_undegraded":"2024-09-12T02:23:06.772651+0000","last_fullsized":"2024-09-12T02:23:06.772651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:23.273457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.871205+0000","last_change":"2024-09-12T02:23:03.771368+0000","last_active":"2024-09-12T02:23:05.871205+0000","last_peered":"2024-09-12T02:23:05.871205+0000","last_clean":"2024-09-12T02:23:05.871205+0000","last_became_active":"2024-09-12T02:23:03.771061+0000","last_became_peered":"2024-09-12T02:23:03.771061+0000","last_unstale":"2024-09-12T02:23:05.871205+0000","last_undegraded":"2024-09-12T02:23:05.871205+0000","last_fullsized":"2024-09-12T02:23:05.871205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:57.476458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.778963+0000","last_change":"2024-09-12T02:23:04.781856+0000","last_active":"2024-09-12T02:23:05.778963+0000","last_peered":"2024-09-12T02:23:05.778963+0000","last_clean":"2024-09-12T02:23:05.778963+0000","last_became_active":"2024-09-12T02:23:04.781575+0000","last_became_peered":"2024-09-12T02:23:04.781575+0000","last_unstale":"2024-09-12T02:23:05.778963+0000","last_undegraded":"2024-09-12T02:23:05.778963+0000","last_fullsized":"2024-09-12T02:23:05.778963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:26.630558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.779027+0000","last_change":"2024-09-12T02:23:03.769541+0000","last_active":"2024-09-12T02:23:05.779027+0000","last_peered":"2024-09-12T02:23:05.779027+0000","last_clean":"2024-09-12T02:23:05.779027+0000","last_became_active":"2024-09-12T02:23:03.765281+0000","last_became_peered":"2024-09-12T02:23:03.765281+0000","last_unstale":"2024-09-12T02:23:05.779027+0000","last_undegraded":"2024-09-12T02:23:05.779027+0000","last_fullsized":"2024-09-12T02:23:05.779027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:53.409370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.780031+0000","last_change":"2024-09-12T02:23:04.781196+0000","last_active":"2024-09-12T02:23:05.780031+0000","last_peered":"2024-09-12T02:23:05.780031+0000","last_clean":"2024-09-12T02:23:05.780031+0000","last_became_active":"2024-09-12T02:23:04.780893+0000","last_became_peered":"2024-09-12T02:23:04.780893+0000","last_unstale":"2024-09-12T02:23:05.780031+0000","last_undegraded":"2024-09-12T02:23:05.780031+0000","last_fullsized":"2024-09-12T02:23:05.780031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:26.527539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.871461+0000","last_change":"2024-09-12T02:23:03.763327+0000","last_active":"2024-09-12T02:23:05.871461+0000","last_peered":"2024-09-12T02:23:05.871461+0000","last_clean":"2024-09-12T02:23:05.871461+0000","last_became_active":"2024-09-12T02:23:03.763005+0000","last_became_peered":"2024-09-12T02:23:03.763005+0000","last_unstale":"2024-09-12T02:23:05.871461+0000","last_undegraded":"2024-09-12T02:23:05.871461+0000","last_fullsized":"2024-09-12T02:23:05.871461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:09.500459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.780229+0000","last_change":"2024-09-12T02:23:04.791152+0000","last_active":"2024-09-12T02:23:05.780229+0000","last_peered":"2024-09-12T02:23:05.780229+0000","last_clean":"2024-09-12T02:23:05.780229+0000","last_became_active":"2024-09-12T02:23:04.790707+0000","last_became_peered":"2024-09-12T02:23:04.790707+0000","last_unstale":"2024-09-12T02:23:05.780229+0000","last_undegraded":"2024-09-12T02:23:05.780229+0000","last_fullsized":"2024-09-12T02:23:05.780229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:42.798507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775732+0000","last_change":"2024-09-12T02:23:03.766034+0000","last_active":"2024-09-12T02:23:05.775732+0000","last_peered":"2024-09-12T02:23:05.775732+0000","last_clean":"2024-09-12T02:23:05.775732+0000","last_became_active":"2024-09-12T02:23:03.765735+0000","last_became_peered":"2024-09-12T02:23:03.765735+0000","last_unstale":"2024-09-12T02:23:05.775732+0000","last_undegraded":"2024-09-12T02:23:05.775732+0000","last_fullsized":"2024-09-12T02:23:05.775732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:19.691229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.023828+0000","last_change":"2024-09-12T02:23:04.784318+0000","last_active":"2024-09-12T02:23:06.023828+0000","last_peered":"2024-09-12T02:23:06.023828+0000","last_clean":"2024-09-12T02:23:06.023828+0000","last_became_active":"2024-09-12T02:23:04.784012+0000","last_became_peered":"2024-09-12T02:23:04.784012+0000","last_unstale":"2024-09-12T02:23:06.023828+0000","last_undegraded":"2024-09-12T02:23:06.023828+0000","last_fullsized":"2024-09-12T02:23:06.023828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:51.352859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.871317+0000","last_change":"2024-09-12T02:23:03.762507+0000","last_active":"2024-09-12T02:23:05.871317+0000","last_peered":"2024-09-12T02:23:05.871317+0000","last_clean":"2024-09-12T02:23:05.871317+0000","last_became_active":"2024-09-12T02:23:03.762164+0000","last_became_peered":"2024-09-12T02:23:03.762164+0000","last_unstale":"2024-09-12T02:23:05.871317+0000","last_undegraded":"2024-09-12T02:23:05.871317+0000","last_fullsized":"2024-09-12T02:23:05.871317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:34.569630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.779950+0000","last_change":"2024-09-12T02:23:04.783483+0000","last_active":"2024-09-12T02:23:05.779950+0000","last_peered":"2024-09-12T02:23:05.779950+0000","last_clean":"2024-09-12T02:23:05.779950+0000","last_became_active":"2024-09-12T02:23:04.782878+0000","last_became_peered":"2024-09-12T02:23:04.782878+0000","last_unstale":"2024-09-12T02:23:05.779950+0000","last_undegraded":"2024-09-12T02:23:05.779950+0000","last_fullsized":"2024-09-12T02:23:05.779950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:52.335065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.778707+0000","last_change":"2024-09-12T02:22:55.143869+0000","last_active":"2024-09-12T02:23:05.778707+0000","last_peered":"2024-09-12T02:23:05.778707+0000","last_clean":"2024-09-12T02:23:05.778707+0000","last_became_active":"2024-09-12T02:22:55.142784+0000","last_became_peered":"2024-09-12T02:22:55.142784+0000","last_unstale":"2024-09-12T02:23:05.778707+0000","last_undegraded":"2024-09-12T02:23:05.778707+0000","last_fullsized":"2024-09-12T02:23:05.778707+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:22:52.457979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:22:52.457979+0000","last_clean_scrub_stamp":"2024-09-12T02:22:52.457979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:46.152602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.023373+0000","last_change":"2024-09-12T02:23:03.765100+0000","last_active":"2024-09-12T02:23:06.023373+0000","last_peered":"2024-09-12T02:23:06.023373+0000","last_clean":"2024-09-12T02:23:06.023373+0000","last_became_active":"2024-09-12T02:23:03.764801+0000","last_became_peered":"2024-09-12T02:23:03.764801+0000","last_unstale":"2024-09-12T02:23:06.023373+0000","last_undegraded":"2024-09-12T02:23:06.023373+0000","last_fullsized":"2024-09-12T02:23:06.023373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:06.891040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.971912+0000","last_change":"2024-09-12T02:23:04.781839+0000","last_active":"2024-09-12T02:23:06.971912+0000","last_peered":"2024-09-12T02:23:06.971912+0000","last_clean":"2024-09-12T02:23:06.971912+0000","last_became_active":"2024-09-12T02:23:04.780984+0000","last_became_peered":"2024-09-12T02:23:04.780984+0000","last_unstale":"2024-09-12T02:23:06.971912+0000","last_undegraded":"2024-09-12T02:23:06.971912+0000","last_fullsized":"2024-09-12T02:23:06.971912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:07.692791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.778644+0000","last_change":"2024-09-12T02:23:03.771625+0000","last_active":"2024-09-12T02:23:05.778644+0000","last_peered":"2024-09-12T02:23:05.778644+0000","last_clean":"2024-09-12T02:23:05.778644+0000","last_became_active":"2024-09-12T02:23:03.771163+0000","last_became_peered":"2024-09-12T02:23:03.771163+0000","last_unstale":"2024-09-12T02:23:05.778644+0000","last_undegraded":"2024-09-12T02:23:05.778644+0000","last_fullsized":"2024-09-12T02:23:05.778644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:32.772569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.030015+0000","last_change":"2024-09-12T02:23:04.787820+0000","last_active":"2024-09-12T02:23:06.030015+0000","last_peered":"2024-09-12T02:23:06.030015+0000","last_clean":"2024-09-12T02:23:06.030015+0000","last_became_active":"2024-09-12T02:23:04.787523+0000","last_became_peered":"2024-09-12T02:23:04.787523+0000","last_unstale":"2024-09-12T02:23:06.030015+0000","last_undegraded":"2024-09-12T02:23:06.030015+0000","last_fullsized":"2024-09-12T02:23:06.030015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:52.784171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.871306+0000","last_change":"2024-09-12T02:23:03.760700+0000","last_active":"2024-09-12T02:23:05.871306+0000","last_peered":"2024-09-12T02:23:05.871306+0000","last_clean":"2024-09-12T02:23:05.871306+0000","last_became_active":"2024-09-12T02:23:03.760397+0000","last_became_peered":"2024-09-12T02:23:03.760397+0000","last_unstale":"2024-09-12T02:23:05.871306+0000","last_undegraded":"2024-09-12T02:23:05.871306+0000","last_fullsized":"2024-09-12T02:23:05.871306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:36.788864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775441+0000","last_change":"2024-09-12T02:23:04.773745+0000","last_active":"2024-09-12T02:23:05.775441+0000","last_peered":"2024-09-12T02:23:05.775441+0000","last_clean":"2024-09-12T02:23:05.775441+0000","last_became_active":"2024-09-12T02:23:04.773360+0000","last_became_peered":"2024-09-12T02:23:04.773360+0000","last_unstale":"2024-09-12T02:23:05.775441+0000","last_undegraded":"2024-09-12T02:23:05.775441+0000","last_fullsized":"2024-09-12T02:23:05.775441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:33.097774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.023917+0000","last_change":"2024-09-12T02:23:03.771518+0000","last_active":"2024-09-12T02:23:06.023917+0000","last_peered":"2024-09-12T02:23:06.023917+0000","last_clean":"2024-09-12T02:23:06.023917+0000","last_became_active":"2024-09-12T02:23:03.771063+0000","last_became_peered":"2024-09-12T02:23:03.771063+0000","last_unstale":"2024-09-12T02:23:06.023917+0000","last_undegraded":"2024-09-12T02:23:06.023917+0000","last_fullsized":"2024-09-12T02:23:06.023917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:43.974555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.779569+0000","last_change":"2024-09-12T02:23:04.790723+0000","last_active":"2024-09-12T02:23:05.779569+0000","last_peered":"2024-09-12T02:23:05.779569+0000","last_clean":"2024-09-12T02:23:05.779569+0000","last_became_active":"2024-09-12T02:23:04.786877+0000","last_became_peered":"2024-09-12T02:23:04.786877+0000","last_unstale":"2024-09-12T02:23:05.779569+0000","last_undegraded":"2024-09-12T02:23:05.779569+0000","last_fullsized":"2024-09-12T02:23:05.779569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:48.516002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775663+0000","last_change":"2024-09-12T02:23:03.769913+0000","last_active":"2024-09-12T02:23:05.775663+0000","last_peered":"2024-09-12T02:23:05.775663+0000","last_clean":"2024-09-12T02:23:05.775663+0000","last_became_active":"2024-09-12T02:23:03.769444+0000","last_became_peered":"2024-09-12T02:23:03.769444+0000","last_unstale":"2024-09-12T02:23:05.775663+0000","last_undegraded":"2024-09-12T02:23:05.775663+0000","last_fullsized":"2024-09-12T02:23:05.775663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:21.243182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.023818+0000","last_change":"2024-09-12T02:23:04.787557+0000","last_active":"2024-09-12T02:23:06.023818+0000","last_peered":"2024-09-12T02:23:06.023818+0000","last_clean":"2024-09-12T02:23:06.023818+0000","last_became_active":"2024-09-12T02:23:04.786527+0000","last_became_peered":"2024-09-12T02:23:04.786527+0000","last_unstale":"2024-09-12T02:23:06.023818+0000","last_undegraded":"2024-09-12T02:23:06.023818+0000","last_fullsized":"2024-09-12T02:23:06.023818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:23.273457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.780143+0000","last_change":"2024-09-12T02:23:03.764093+0000","last_active":"2024-09-12T02:23:05.780143+0000","last_peered":"2024-09-12T02:23:05.780143+0000","last_clean":"2024-09-12T02:23:05.780143+0000","last_became_active":"2024-09-12T02:23:03.763147+0000","last_became_peered":"2024-09-12T02:23:03.763147+0000","last_unstale":"2024-09-12T02:23:05.780143+0000","last_undegraded":"2024-09-12T02:23:05.780143+0000","last_fullsized":"2024-09-12T02:23:05.780143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:13.317894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775631+0000","last_change":"2024-09-12T02:23:04.775876+0000","last_active":"2024-09-12T02:23:05.775631+0000","last_peered":"2024-09-12T02:23:05.775631+0000","last_clean":"2024-09-12T02:23:05.775631+0000","last_became_active":"2024-09-12T02:23:04.775571+0000","last_became_peered":"2024-09-12T02:23:04.775571+0000","last_unstale":"2024-09-12T02:23:05.775631+0000","last_undegraded":"2024-09-12T02:23:05.775631+0000","last_fullsized":"2024-09-12T02:23:05.775631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:05.070528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.772082+0000","last_change":"2024-09-12T02:23:03.769745+0000","last_active":"2024-09-12T02:23:06.772082+0000","last_peered":"2024-09-12T02:23:06.772082+0000","last_clean":"2024-09-12T02:23:06.772082+0000","last_became_active":"2024-09-12T02:23:03.769410+0000","last_became_peered":"2024-09-12T02:23:03.769410+0000","last_unstale":"2024-09-12T02:23:06.772082+0000","last_undegraded":"2024-09-12T02:23:06.772082+0000","last_fullsized":"2024-09-12T02:23:06.772082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:00.414459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.972214+0000","last_change":"2024-09-12T02:23:04.786424+0000","last_active":"2024-09-12T02:23:06.972214+0000","last_peered":"2024-09-12T02:23:06.972214+0000","last_clean":"2024-09-12T02:23:06.972214+0000","last_became_active":"2024-09-12T02:23:04.786136+0000","last_became_peered":"2024-09-12T02:23:04.786136+0000","last_unstale":"2024-09-12T02:23:06.972214+0000","last_undegraded":"2024-09-12T02:23:06.972214+0000","last_fullsized":"2024-09-12T02:23:06.972214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:31.214894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.772832+0000","last_change":"2024-09-12T02:23:03.771259+0000","last_active":"2024-09-12T02:23:06.772832+0000","last_peered":"2024-09-12T02:23:06.772832+0000","last_clean":"2024-09-12T02:23:06.772832+0000","last_became_active":"2024-09-12T02:23:03.770687+0000","last_became_peered":"2024-09-12T02:23:03.770687+0000","last_unstale":"2024-09-12T02:23:06.772832+0000","last_undegraded":"2024-09-12T02:23:06.772832+0000","last_fullsized":"2024-09-12T02:23:06.772832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:38.516959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.030331+0000","last_change":"2024-09-12T02:23:04.786895+0000","last_active":"2024-09-12T02:23:06.030331+0000","last_peered":"2024-09-12T02:23:06.030331+0000","last_clean":"2024-09-12T02:23:06.030331+0000","last_became_active":"2024-09-12T02:23:04.786591+0000","last_became_peered":"2024-09-12T02:23:04.786591+0000","last_unstale":"2024-09-12T02:23:06.030331+0000","last_undegraded":"2024-09-12T02:23:06.030331+0000","last_fullsized":"2024-09-12T02:23:06.030331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:14.751707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.778547+0000","last_change":"2024-09-12T02:23:03.764530+0000","last_active":"2024-09-12T02:23:05.778547+0000","last_peered":"2024-09-12T02:23:05.778547+0000","last_clean":"2024-09-12T02:23:05.778547+0000","last_became_active":"2024-09-12T02:23:03.764218+0000","last_became_peered":"2024-09-12T02:23:03.764218+0000","last_unstale":"2024-09-12T02:23:05.778547+0000","last_undegraded":"2024-09-12T02:23:05.778547+0000","last_fullsized":"2024-09-12T02:23:05.778547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:55.445619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.778945+0000","last_change":"2024-09-12T02:23:04.780821+0000","last_active":"2024-09-12T02:23:05.778945+0000","last_peered":"2024-09-12T02:23:05.778945+0000","last_clean":"2024-09-12T02:23:05.778945+0000","last_became_active":"2024-09-12T02:23:04.779984+0000","last_became_peered":"2024-09-12T02:23:04.779984+0000","last_unstale":"2024-09-12T02:23:05.778945+0000","last_undegraded":"2024-09-12T02:23:05.778945+0000","last_fullsized":"2024-09-12T02:23:05.778945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:25.724116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775580+0000","last_change":"2024-09-12T02:23:03.770581+0000","last_active":"2024-09-12T02:23:05.775580+0000","last_peered":"2024-09-12T02:23:05.775580+0000","last_clean":"2024-09-12T02:23:05.775580+0000","last_became_active":"2024-09-12T02:23:03.769406+0000","last_became_peered":"2024-09-12T02:23:03.769406+0000","last_unstale":"2024-09-12T02:23:05.775580+0000","last_undegraded":"2024-09-12T02:23:05.775580+0000","last_fullsized":"2024-09-12T02:23:05.775580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:20.963819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.971722+0000","last_change":"2024-09-12T02:23:04.783991+0000","last_active":"2024-09-12T02:23:06.971722+0000","last_peered":"2024-09-12T02:23:06.971722+0000","last_clean":"2024-09-12T02:23:06.971722+0000","last_became_active":"2024-09-12T02:23:04.783143+0000","last_became_peered":"2024-09-12T02:23:04.783143+0000","last_unstale":"2024-09-12T02:23:06.971722+0000","last_undegraded":"2024-09-12T02:23:06.971722+0000","last_fullsized":"2024-09-12T02:23:06.971722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:53.940843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.775526+0000","last_change":"2024-09-12T02:23:03.771468+0000","last_active":"2024-09-12T02:23:05.775526+0000","last_peered":"2024-09-12T02:23:05.775526+0000","last_clean":"2024-09-12T02:23:05.775526+0000","last_became_active":"2024-09-12T02:23:03.769619+0000","last_became_peered":"2024-09-12T02:23:03.769619+0000","last_unstale":"2024-09-12T02:23:05.775526+0000","last_undegraded":"2024-09-12T02:23:05.775526+0000","last_fullsized":"2024-09-12T02:23:05.775526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:38.422369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.971928+0000","last_change":"2024-09-12T02:23:04.782769+0000","last_active":"2024-09-12T02:23:06.971928+0000","last_peered":"2024-09-12T02:23:06.971928+0000","last_clean":"2024-09-12T02:23:06.971928+0000","last_became_active":"2024-09-12T02:23:04.782472+0000","last_became_peered":"2024-09-12T02:23:04.782472+0000","last_unstale":"2024-09-12T02:23:06.971928+0000","last_undegraded":"2024-09-12T02:23:06.971928+0000","last_fullsized":"2024-09-12T02:23:06.971928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:46.144471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.779454+0000","last_change":"2024-09-12T02:23:03.763423+0000","last_active":"2024-09-12T02:23:05.779454+0000","last_peered":"2024-09-12T02:23:05.779454+0000","last_clean":"2024-09-12T02:23:05.779454+0000","last_became_active":"2024-09-12T02:23:03.762627+0000","last_became_peered":"2024-09-12T02:23:03.762627+0000","last_unstale":"2024-09-12T02:23:05.779454+0000","last_undegraded":"2024-09-12T02:23:05.779454+0000","last_fullsized":"2024-09-12T02:23:05.779454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:18.090657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.772563+0000","last_change":"2024-09-12T02:23:04.788754+0000","last_active":"2024-09-12T02:23:06.772563+0000","last_peered":"2024-09-12T02:23:06.772563+0000","last_clean":"2024-09-12T02:23:06.772563+0000","last_became_active":"2024-09-12T02:23:04.788350+0000","last_became_peered":"2024-09-12T02:23:04.788350+0000","last_unstale":"2024-09-12T02:23:06.772563+0000","last_undegraded":"2024-09-12T02:23:06.772563+0000","last_fullsized":"2024-09-12T02:23:06.772563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:08.192088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.023782+0000","last_change":"2024-09-12T02:23:04.791109+0000","last_active":"2024-09-12T02:23:06.023782+0000","last_peered":"2024-09-12T02:23:06.023782+0000","last_clean":"2024-09-12T02:23:06.023782+0000","last_became_active":"2024-09-12T02:23:04.790201+0000","last_became_peered":"2024-09-12T02:23:04.790201+0000","last_unstale":"2024-09-12T02:23:06.023782+0000","last_undegraded":"2024-09-12T02:23:06.023782+0000","last_fullsized":"2024-09-12T02:23:06.023782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:13.166139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.779669+0000","last_change":"2024-09-12T02:23:03.763480+0000","last_active":"2024-09-12T02:23:05.779669+0000","last_peered":"2024-09-12T02:23:05.779669+0000","last_clean":"2024-09-12T02:23:05.779669+0000","last_became_active":"2024-09-12T02:23:03.762464+0000","last_became_peered":"2024-09-12T02:23:03.762464+0000","last_unstale":"2024-09-12T02:23:05.779669+0000","last_undegraded":"2024-09-12T02:23:05.779669+0000","last_fullsized":"2024-09-12T02:23:05.779669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:24.308289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.023763+0000","last_change":"2024-09-12T02:23:04.791903+0000","last_active":"2024-09-12T02:23:06.023763+0000","last_peered":"2024-09-12T02:23:06.023763+0000","last_clean":"2024-09-12T02:23:06.023763+0000","last_became_active":"2024-09-12T02:23:04.791635+0000","last_became_peered":"2024-09-12T02:23:04.791635+0000","last_unstale":"2024-09-12T02:23:06.023763+0000","last_undegraded":"2024-09-12T02:23:06.023763+0000","last_fullsized":"2024-09-12T02:23:06.023763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:08.192088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:05.779997+0000","last_change":"2024-09-12T02:23:03.767875+0000","last_active":"2024-09-12T02:23:05.779997+0000","last_peered":"2024-09-12T02:23:05.779997+0000","last_clean":"2024-09-12T02:23:05.779997+0000","last_became_active":"2024-09-12T02:23:03.767596+0000","last_became_peered":"2024-09-12T02:23:03.767596+0000","last_unstale":"2024-09-12T02:23:05.779997+0000","last_undegraded":"2024-09-12T02:23:05.779997+0000","last_fullsized":"2024-09-12T02:23:05.779997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:22.605725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.030285+0000","last_change":"2024-09-12T02:23:04.782108+0000","last_active":"2024-09-12T02:23:06.030285+0000","last_peered":"2024-09-12T02:23:06.030285+0000","last_clean":"2024-09-12T02:23:06.030285+0000","last_became_active":"2024-09-12T02:23:04.781829+0000","last_became_peered":"2024-09-12T02:23:04.781829+0000","last_unstale":"2024-09-12T02:23:06.030285+0000","last_undegraded":"2024-09-12T02:23:06.030285+0000","last_fullsized":"2024-09-12T02:23:06.030285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:07:33.165742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.972111+0000","last_change":"2024-09-12T02:23:03.767076+0000","last_active":"2024-09-12T02:23:06.972111+0000","last_peered":"2024-09-12T02:23:06.972111+0000","last_clean":"2024-09-12T02:23:06.972111+0000","last_became_active":"2024-09-12T02:23:03.766686+0000","last_became_peered":"2024-09-12T02:23:03.766686+0000","last_unstale":"2024-09-12T02:23:06.972111+0000","last_undegraded":"2024-09-12T02:23:06.972111+0000","last_fullsized":"2024-09-12T02:23:06.972111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:45.706208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.972148+0000","last_change":"2024-09-12T02:23:04.790549+0000","last_active":"2024-09-12T02:23:06.972148+0000","last_peered":"2024-09-12T02:23:06.972148+0000","last_clean":"2024-09-12T02:23:06.972148+0000","last_became_active":"2024-09-12T02:23:04.790187+0000","last_became_peered":"2024-09-12T02:23:04.790187+0000","last_unstale":"2024-09-12T02:23:06.972148+0000","last_undegraded":"2024-09-12T02:23:06.972148+0000","last_fullsized":"2024-09-12T02:23:06.972148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:49.656395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T02:23:06.030340+0000","last_change":"2024-09-12T02:23:03.757848+0000","last_active":"2024-09-12T02:23:06.030340+0000","last_peered":"2024-09-12T02:23:06.030340+0000","last_clean":"2024-09-12T02:23:06.030340+0000","last_became_active":"2024-09-12T02:23:03.757544+0000","last_became_peered":"2024-09-12T02:23:03.757544+0000","last_unstale":"2024-09-12T02:23:06.030340+0000","last_undegraded":"2024-09-12T02:23:06.030340+0000","last_fullsized":"2024-09-12T02:23:06.030340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:43.576128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476742,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":667062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476742,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":77724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476743,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":76202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":229376,"data_stored":76238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35560,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336280,"statfs":{"total":96636764160,"available":96600350720,"internally_reserved":0,"allocated":217088,"data_stored":76112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36160,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335680,"statfs":{"total":96636764160,"available":96599736320,"internally_reserved":0,"allocated":823296,"data_stored":667118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35568,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336272,"statfs":{"total":96636764160,"available":96600342528,"internally_reserved":0,"allocated":217088,"data_stored":71449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35568,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336272,"statfs":{"total":96636764160,"available":96600342528,"internally_reserved":0,"allocated":225280,"data_stored":76272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:23:13.503 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T02:23:13.504 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T02:23:13.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.642+0000 7ff3904e4640 1 Processor -- start 2024-09-12T02:23:13.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.642+0000 7ff3904e4640 1 -- start start 2024-09-12T02:23:13.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.643+0000 7ff3904e4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff388151780 0x7ff388155560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:13.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.643+0000 7ff3904e4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff388154ac0 0x7ff3880708a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:13.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.643+0000 7ff3904e4640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff3880703b0 0x7ff388157660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:13.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.643+0000 7ff3904e4640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7ff388154ff0 con 0x7ff388154ac0 2024-09-12T02:23:13.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.643+0000 7ff3904e4640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff38806f5f0 con 0x7ff3880703b0 2024-09-12T02:23:13.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.643+0000 7ff3904e4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff38806f8d0 con 0x7ff388151780 2024-09-12T02:23:13.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.643+0000 7ff38da7f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff388154ac0 0x7ff3880708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:13.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.644+0000 7ff38da7f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff388154ac0 0x7ff3880708a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38160/0 (socket says 172.21.15.60:38160) 2024-09-12T02:23:13.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.644+0000 7ff38da7f640 1 -- 172.21.15.60:0/2618622866 learned_addr learned my addr 172.21.15.60:0/2618622866 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:13.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.644+0000 7ff38e280640 1 --2- 172.21.15.60:0/2618622866 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff388151780 0x7ff388155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:13.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.644+0000 7ff38ea81640 1 --2- 172.21.15.60:0/2618622866 >> v2:172.21.15.105:3300/0 conn(0x7ff3880703b0 0x7ff388157660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:13.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.644+0000 7ff38da7f640 1 -- 172.21.15.60:0/2618622866 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff388151780 msgr2=0x7ff388155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:13.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.644+0000 7ff38da7f640 1 --2- 172.21.15.60:0/2618622866 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff388151780 0x7ff388155560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:13.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.644+0000 7ff38da7f640 1 -- 172.21.15.60:0/2618622866 >> v2:172.21.15.105:3300/0 conn(0x7ff3880703b0 msgr2=0x7ff388157660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:13.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.644+0000 7ff38da7f640 1 --2- 172.21.15.60:0/2618622866 >> v2:172.21.15.105:3300/0 conn(0x7ff3880703b0 0x7ff388157660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:13.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.644+0000 7ff38da7f640 1 -- 172.21.15.60:0/2618622866 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff38806fbb0 con 0x7ff388154ac0 2024-09-12T02:23:13.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.644+0000 7ff38e280640 1 --2- 172.21.15.60:0/2618622866 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff388151780 0x7ff388155560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:23:13.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.644+0000 7ff38da7f640 1 --2- 172.21.15.60:0/2618622866 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff388154ac0 0x7ff3880708a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff388154070 tx=0x7ff37c02a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edf5a253fb15ae81 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:13.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.645+0000 7ff38d27e640 1 -- 172.21.15.60:0/2618622866 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff37c037070 con 0x7ff388154ac0 2024-09-12T02:23:13.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.645+0000 7ff38d27e640 1 -- 172.21.15.60:0/2618622866 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff37c02ae00 con 0x7ff388154ac0 2024-09-12T02:23:13.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.645+0000 7ff38d27e640 1 -- 172.21.15.60:0/2618622866 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff37c032660 con 0x7ff388154ac0 2024-09-12T02:23:13.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.645+0000 7ff3904e4640 1 -- 172.21.15.60:0/2618622866 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff388154ac0 msgr2=0x7ff3880708a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:13.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.645+0000 7ff3904e4640 1 --2- 172.21.15.60:0/2618622866 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff388154ac0 0x7ff3880708a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff388154070 tx=0x7ff37c02a0b0 comp rx=0 tx=0).stop 2024-09-12T02:23:13.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.645+0000 7ff3904e4640 1 -- 172.21.15.60:0/2618622866 shutdown_connections 2024-09-12T02:23:13.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.645+0000 7ff3904e4640 1 --2- 172.21.15.60:0/2618622866 >> v2:172.21.15.105:3300/0 conn(0x7ff3880703b0 0x7ff388157660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:13.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.645+0000 7ff3904e4640 1 --2- 172.21.15.60:0/2618622866 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff388154ac0 0x7ff3880708a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:13.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.645+0000 7ff3904e4640 1 --2- 172.21.15.60:0/2618622866 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff388151780 0x7ff388155560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:13.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.645+0000 7ff3904e4640 1 -- 172.21.15.60:0/2618622866 >> 172.21.15.60:0/2618622866 conn(0x7ff3880c6980 msgr2=0x7ff3880c6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:13.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.645+0000 7ff3904e4640 1 -- 172.21.15.60:0/2618622866 shutdown_connections 2024-09-12T02:23:13.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.645+0000 7ff3904e4640 1 -- 172.21.15.60:0/2618622866 wait complete. 2024-09-12T02:23:13.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.646+0000 7ff3904e4640 1 Processor -- start 2024-09-12T02:23:13.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.647+0000 7ff3904e4640 1 -- start start 2024-09-12T02:23:13.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.647+0000 7ff3904e4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3880703b0 0x7ff3880c9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:13.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.647+0000 7ff3904e4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff388151780 0x7ff3881ed600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:13.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.647+0000 7ff3904e4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff388154ac0 0x7ff3881492e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:13.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.647+0000 7ff3904e4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff3880740b0 con 0x7ff388154ac0 2024-09-12T02:23:13.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.647+0000 7ff3904e4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff388073f30 con 0x7ff388151780 2024-09-12T02:23:13.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.647+0000 7ff3904e4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff388155aa0 con 0x7ff3880703b0 2024-09-12T02:23:13.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.647+0000 7ff38ea81640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff388154ac0 0x7ff3881492e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:13.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.647+0000 7ff38ea81640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff388154ac0 0x7ff3881492e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38168/0 (socket says 172.21.15.60:38168) 2024-09-12T02:23:13.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.647+0000 7ff38ea81640 1 -- 172.21.15.60:0/79739267 learned_addr learned my addr 172.21.15.60:0/79739267 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:13.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.647+0000 7ff38e280640 1 --2- 172.21.15.60:0/79739267 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3880703b0 0x7ff3880c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:13.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.647+0000 7ff38da7f640 1 --2- 172.21.15.60:0/79739267 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff388151780 0x7ff3881ed600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:13.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.648+0000 7ff38ea81640 1 -- 172.21.15.60:0/79739267 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3880703b0 msgr2=0x7ff3880c9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:13.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.648+0000 7ff38ea81640 1 --2- 172.21.15.60:0/79739267 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3880703b0 0x7ff3880c9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:13.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.648+0000 7ff38ea81640 1 -- 172.21.15.60:0/79739267 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff388151780 msgr2=0x7ff3881ed600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:13.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.648+0000 7ff38ea81640 1 --2- 172.21.15.60:0/79739267 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff388151780 0x7ff3881ed600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:13.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.648+0000 7ff38ea81640 1 -- 172.21.15.60:0/79739267 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3881de080 con 0x7ff388154ac0 2024-09-12T02:23:13.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.648+0000 7ff38da7f640 1 --2- 172.21.15.60:0/79739267 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff388151780 0x7ff3881ed600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:23:13.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.648+0000 7ff38ea81640 1 --2- 172.21.15.60:0/79739267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff388154ac0 0x7ff3881492e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff37800d620 tx=0x7ff37800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:13.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.648+0000 7ff386ffd640 1 -- 172.21.15.60:0/79739267 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff378009600 con 0x7ff388154ac0 2024-09-12T02:23:13.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.648+0000 7ff386ffd640 1 -- 172.21.15.60:0/79739267 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff378019070 con 0x7ff388154ac0 2024-09-12T02:23:13.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.648+0000 7ff3904e4640 1 -- 172.21.15.60:0/79739267 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff38804ffb0 con 0x7ff388154ac0 2024-09-12T02:23:13.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.648+0000 7ff386ffd640 1 -- 172.21.15.60:0/79739267 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff378009a00 con 0x7ff388154ac0 2024-09-12T02:23:13.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.648+0000 7ff3904e4640 1 -- 172.21.15.60:0/79739267 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3880adb30 con 0x7ff388154ac0 2024-09-12T02:23:13.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.649+0000 7ff3904e4640 1 -- 172.21.15.60:0/79739267 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3880af630 con 0x7ff388154ac0 2024-09-12T02:23:13.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.650+0000 7ff386ffd640 1 -- 172.21.15.60:0/79739267 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff378009ba0 con 0x7ff388154ac0 2024-09-12T02:23:13.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.650+0000 7ff386ffd640 1 --2- 172.21.15.60:0/79739267 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff37406be30 0x7ff37406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:13.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.650+0000 7ff38e280640 1 --2- 172.21.15.60:0/79739267 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff37406be30 0x7ff37406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:13.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.650+0000 7ff386ffd640 1 -- 172.21.15.60:0/79739267 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5689+0+0 (secure 0 0 0) 0x7ff37808b100 con 0x7ff388154ac0 2024-09-12T02:23:13.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.651+0000 7ff38e280640 1 --2- 172.21.15.60:0/79739267 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff37406be30 0x7ff37406e2f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff388154490 tx=0x7ff380009890 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:13.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.654+0000 7ff386ffd640 1 -- 172.21.15.60:0/79739267 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff378059b50 con 0x7ff388154ac0 2024-09-12T02:23:13.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.834+0000 7ff3904e4640 1 -- 172.21.15.60:0/79739267 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff3881508f0 con 0x7ff388154ac0 2024-09-12T02:23:13.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.835+0000 7ff386ffd640 1 -- 172.21.15.60:0/79739267 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v22) ==== 84+0+197 (secure 0 0 0) 0x7ff378059450 con 0x7ff388154ac0 2024-09-12T02:23:13.836 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:23:13.836 INFO:teuthology.orchestra.run.smithi060.stdout:[ 2024-09-12T02:23:13.836 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:13.836 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 1, 2024-09-12T02:23:13.836 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": ".mgr" 2024-09-12T02:23:13.836 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:13.836 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:13.837 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 2, 2024-09-12T02:23:13.837 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": "a_metadata" 2024-09-12T02:23:13.837 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:13.837 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:13.837 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 3, 2024-09-12T02:23:13.837 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": "a_data" 2024-09-12T02:23:13.838 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:23:13.838 INFO:teuthology.orchestra.run.smithi060.stdout:] 2024-09-12T02:23:13.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.837+0000 7ff3904e4640 1 -- 172.21.15.60:0/79739267 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff37406be30 msgr2=0x7ff37406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:13.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.837+0000 7ff3904e4640 1 --2- 172.21.15.60:0/79739267 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff37406be30 0x7ff37406e2f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff388154490 tx=0x7ff380009890 comp rx=0 tx=0).stop 2024-09-12T02:23:13.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.837+0000 7ff3904e4640 1 -- 172.21.15.60:0/79739267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff388154ac0 msgr2=0x7ff3881492e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:13.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.837+0000 7ff3904e4640 1 --2- 172.21.15.60:0/79739267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff388154ac0 0x7ff3881492e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff37800d620 tx=0x7ff37800dae0 comp rx=0 tx=0).stop 2024-09-12T02:23:13.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.837+0000 7ff3904e4640 1 -- 172.21.15.60:0/79739267 shutdown_connections 2024-09-12T02:23:13.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.837+0000 7ff3904e4640 1 --2- 172.21.15.60:0/79739267 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff37406be30 0x7ff37406e2f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:13.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.837+0000 7ff3904e4640 1 --2- 172.21.15.60:0/79739267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff388154ac0 0x7ff3881492e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:13.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.837+0000 7ff3904e4640 1 --2- 172.21.15.60:0/79739267 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff388151780 0x7ff3881ed600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:13.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.837+0000 7ff3904e4640 1 --2- 172.21.15.60:0/79739267 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3880703b0 0x7ff3880c9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:13.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.837+0000 7ff3904e4640 1 -- 172.21.15.60:0/79739267 >> 172.21.15.60:0/79739267 conn(0x7ff3880c6980 msgr2=0x7ff388155230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:13.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.837+0000 7ff3904e4640 1 -- 172.21.15.60:0/79739267 shutdown_connections 2024-09-12T02:23:13.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.837+0000 7ff3904e4640 1 -- 172.21.15.60:0/79739267 wait complete. 2024-09-12T02:23:13.849 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'b' 2024-09-12T02:23:13.849 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create b_metadata --pg_num_min 64 2024-09-12T02:23:13.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.955+0000 7f2ea46d0640 1 Processor -- start 2024-09-12T02:23:13.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.955+0000 7f2ea46d0640 1 -- start start 2024-09-12T02:23:13.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.956+0000 7f2ea46d0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e9c073be0 0x7f2e9c15a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:13.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.956+0000 7f2ea46d0640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e9c0c8680 con 0x7f2e9c15a570 2024-09-12T02:23:13.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.956+0000 7f2ea46d0640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e9c0c8960 con 0x7f2e9c0731e0 2024-09-12T02:23:13.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.956+0000 7f2ea46d0640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2e9c0c8430 con 0x7f2e9c073be0 2024-09-12T02:23:13.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.956+0000 7f2ea2c6d640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f2e9c15a570 0x7f2e9c0c5280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55642/0 (socket says 172.21.15.60:55642) 2024-09-12T02:23:13.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.956+0000 7f2ea2c6d640 1 -- 172.21.15.60:0/879999774 learned_addr learned my addr 172.21.15.60:0/879999774 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:13.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.956+0000 7f2ea1c6b640 1 --2- 172.21.15.60:0/879999774 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e9c073be0 0x7f2e9c15a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:13.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.956+0000 7f2ea146a640 1 -- 172.21.15.60:0/879999774 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3852829084 0 0) 0x7f2e9c0c8680 con 0x7f2e9c15a570 2024-09-12T02:23:13.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.956+0000 7f2ea146a640 1 -- 172.21.15.60:0/879999774 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e88003520 con 0x7f2e9c15a570 2024-09-12T02:23:13.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.956+0000 7f2ea146a640 1 -- 172.21.15.60:0/879999774 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1206475636 0 0) 0x7f2e9c0c8960 con 0x7f2e9c0731e0 2024-09-12T02:23:13.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.956+0000 7f2ea146a640 1 -- 172.21.15.60:0/879999774 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e9c0c8680 con 0x7f2e9c0731e0 2024-09-12T02:23:13.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.956+0000 7f2ea1c6b640 1 -- 172.21.15.60:0/879999774 >> v1:172.21.15.105:6789/0 conn(0x7f2e9c0731e0 legacy=0x7f2e9c0c7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:13.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.956+0000 7f2ea1c6b640 1 -- 172.21.15.60:0/879999774 >> v1:172.21.15.60:6789/0 conn(0x7f2e9c15a570 legacy=0x7f2e9c0c5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:13.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.956+0000 7f2ea1c6b640 1 -- 172.21.15.60:0/879999774 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e9c0c8c40 con 0x7f2e9c073be0 2024-09-12T02:23:13.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.957+0000 7f2ea1c6b640 1 --2- 172.21.15.60:0/879999774 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e9c073be0 0x7f2e9c15a030 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2e900097d0 tx=0x7f2e9002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a82a4953bfc1a652 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:13.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.957+0000 7f2ea146a640 1 -- 172.21.15.60:0/879999774 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e90037070 con 0x7f2e9c073be0 2024-09-12T02:23:13.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.957+0000 7f2ea146a640 1 -- 172.21.15.60:0/879999774 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e90032440 con 0x7f2e9c073be0 2024-09-12T02:23:13.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.957+0000 7f2ea146a640 1 -- 172.21.15.60:0/879999774 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e90032810 con 0x7f2e9c073be0 2024-09-12T02:23:13.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.958+0000 7f2ea46d0640 1 -- 172.21.15.60:0/879999774 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e9c073be0 msgr2=0x7f2e9c15a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:13.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.958+0000 7f2ea46d0640 1 --2- 172.21.15.60:0/879999774 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e9c073be0 0x7f2e9c15a030 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2e900097d0 tx=0x7f2e9002a180 comp rx=0 tx=0).stop 2024-09-12T02:23:13.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.958+0000 7f2ea46d0640 1 -- 172.21.15.60:0/879999774 shutdown_connections 2024-09-12T02:23:13.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.958+0000 7f2ea46d0640 1 --2- 172.21.15.60:0/879999774 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e9c073be0 0x7f2e9c15a030 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:13.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.958+0000 7f2ea46d0640 1 -- 172.21.15.60:0/879999774 >> 172.21.15.60:0/879999774 conn(0x7f2e9c0c9c00 msgr2=0x7f2e9c0ca010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:13.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.958+0000 7f2ea46d0640 1 -- 172.21.15.60:0/879999774 shutdown_connections 2024-09-12T02:23:13.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.958+0000 7f2ea46d0640 1 -- 172.21.15.60:0/879999774 wait complete. 2024-09-12T02:23:13.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.959+0000 7f2ea46d0640 1 Processor -- start 2024-09-12T02:23:13.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.959+0000 7f2ea46d0640 1 -- start start 2024-09-12T02:23:13.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.960+0000 7f2ea46d0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e9c0731e0 0x7f2e9c1ec580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:13.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.960+0000 7f2ea46d0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e9c073be0 0x7f2e9c153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:13.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.960+0000 7f2ea46d0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e9c15a570 0x7f2e9c14fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:13.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.960+0000 7f2ea46d0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2e9c073740 con 0x7f2e9c0731e0 2024-09-12T02:23:13.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.960+0000 7f2ea46d0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2e9c0735c0 con 0x7f2e9c15a570 2024-09-12T02:23:13.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.960+0000 7f2ea46d0640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2e9c0c5990 con 0x7f2e9c073be0 2024-09-12T02:23:13.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.960+0000 7f2ea246c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e9c0731e0 0x7f2e9c1ec580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:13.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.960+0000 7f2ea246c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e9c0731e0 0x7f2e9c1ec580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38174/0 (socket says 172.21.15.60:38174) 2024-09-12T02:23:13.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.960+0000 7f2ea246c640 1 -- 172.21.15.60:0/4218470769 learned_addr learned my addr 172.21.15.60:0/4218470769 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:13.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.960+0000 7f2ea2c6d640 1 --2- 172.21.15.60:0/4218470769 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e9c15a570 0x7f2e9c14fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:13.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.960+0000 7f2ea1c6b640 1 --2- 172.21.15.60:0/4218470769 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e9c073be0 0x7f2e9c153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:13.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.960+0000 7f2ea246c640 1 -- 172.21.15.60:0/4218470769 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e9c073be0 msgr2=0x7f2e9c153a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:13.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.960+0000 7f2ea246c640 1 --2- 172.21.15.60:0/4218470769 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e9c073be0 0x7f2e9c153a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:13.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.960+0000 7f2ea246c640 1 -- 172.21.15.60:0/4218470769 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e9c15a570 msgr2=0x7f2e9c14fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:13.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.960+0000 7f2ea246c640 1 --2- 172.21.15.60:0/4218470769 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e9c15a570 0x7f2e9c14fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:13.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.960+0000 7f2ea246c640 1 -- 172.21.15.60:0/4218470769 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e9c06e730 con 0x7f2e9c0731e0 2024-09-12T02:23:13.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.960+0000 7f2ea246c640 1 --2- 172.21.15.60:0/4218470769 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e9c0731e0 0x7f2e9c1ec580 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2e9800c530 tx=0x7f2e9800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:13.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.960+0000 7f2e8effd640 1 -- 172.21.15.60:0/4218470769 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e980052d0 con 0x7f2e9c0731e0 2024-09-12T02:23:13.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.960+0000 7f2e8effd640 1 -- 172.21.15.60:0/4218470769 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e98005490 con 0x7f2e9c0731e0 2024-09-12T02:23:13.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.960+0000 7f2ea46d0640 1 -- 172.21.15.60:0/4218470769 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e9c1ecac0 con 0x7f2e9c0731e0 2024-09-12T02:23:13.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.960+0000 7f2e8effd640 1 -- 172.21.15.60:0/4218470769 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e98012870 con 0x7f2e9c0731e0 2024-09-12T02:23:13.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.961+0000 7f2ea46d0640 1 -- 172.21.15.60:0/4218470769 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e9c06d2d0 con 0x7f2e9c0731e0 2024-09-12T02:23:13.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.962+0000 7f2ea46d0640 1 -- 172.21.15.60:0/4218470769 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e9c0c5d40 con 0x7f2e9c0731e0 2024-09-12T02:23:13.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.962+0000 7f2e8effd640 1 -- 172.21.15.60:0/4218470769 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2e98012a10 con 0x7f2e9c0731e0 2024-09-12T02:23:13.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.962+0000 7f2e8effd640 1 --2- 172.21.15.60:0/4218470769 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2e8006be30 0x7f2e8006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:13.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.963+0000 7f2ea1c6b640 1 --2- 172.21.15.60:0/4218470769 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2e8006be30 0x7f2e8006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:13.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.963+0000 7f2e8effd640 1 -- 172.21.15.60:0/4218470769 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5689+0+0 (secure 0 0 0) 0x7f2e9808a9d0 con 0x7f2e9c0731e0 2024-09-12T02:23:13.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.963+0000 7f2ea1c6b640 1 --2- 172.21.15.60:0/4218470769 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2e8006be30 0x7f2e8006e2f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2e90034000 tx=0x7f2e9002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:13.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:13.967+0000 7f2e8effd640 1 -- 172.21.15.60:0/4218470769 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2e9c1ecac0 con 0x7f2e9c0731e0 2024-09-12T02:23:14.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.144+0000 7f2ea46d0640 1 -- 172.21.15.60:0/4218470769 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "b_metadata", "pg_num_min": 64} v 0) -- 0x7f2e9c156ae0 con 0x7f2e9c0731e0 2024-09-12T02:23:14.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.807+0000 7f2e8effd640 1 -- 172.21.15.60:0/4218470769 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "b_metadata", "pg_num_min": 64}]=0 pool 'b_metadata' created v23) ==== 128+0+0 (secure 0 0 0) 0x7f2e98058d50 con 0x7f2e9c0731e0 2024-09-12T02:23:14.808 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'b_metadata' created 2024-09-12T02:23:14.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.811+0000 7f2ea46d0640 1 -- 172.21.15.60:0/4218470769 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2e8006be30 msgr2=0x7f2e8006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:14.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.811+0000 7f2ea46d0640 1 --2- 172.21.15.60:0/4218470769 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2e8006be30 0x7f2e8006e2f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2e90034000 tx=0x7f2e9002e000 comp rx=0 tx=0).stop 2024-09-12T02:23:14.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.811+0000 7f2ea46d0640 1 -- 172.21.15.60:0/4218470769 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e9c0731e0 msgr2=0x7f2e9c1ec580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:14.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.811+0000 7f2ea46d0640 1 --2- 172.21.15.60:0/4218470769 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e9c0731e0 0x7f2e9c1ec580 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2e9800c530 tx=0x7f2e9800c9f0 comp rx=0 tx=0).stop 2024-09-12T02:23:14.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.811+0000 7f2ea46d0640 1 -- 172.21.15.60:0/4218470769 shutdown_connections 2024-09-12T02:23:14.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.811+0000 7f2ea46d0640 1 --2- 172.21.15.60:0/4218470769 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2e8006be30 0x7f2e8006e2f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:14.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.811+0000 7f2ea46d0640 1 --2- 172.21.15.60:0/4218470769 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e9c15a570 0x7f2e9c14fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:14.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.811+0000 7f2ea46d0640 1 --2- 172.21.15.60:0/4218470769 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e9c073be0 0x7f2e9c153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:14.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.811+0000 7f2ea46d0640 1 --2- 172.21.15.60:0/4218470769 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e9c0731e0 0x7f2e9c1ec580 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:14.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.811+0000 7f2ea46d0640 1 -- 172.21.15.60:0/4218470769 >> 172.21.15.60:0/4218470769 conn(0x7f2e9c0c9c00 msgr2=0x7f2e9c158f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:14.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.812+0000 7f2ea46d0640 1 -- 172.21.15.60:0/4218470769 shutdown_connections 2024-09-12T02:23:14.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.812+0000 7f2ea46d0640 1 -- 172.21.15.60:0/4218470769 wait complete. 2024-09-12T02:23:14.828 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create b_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T02:23:14.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.945+0000 7f24017c4640 1 Processor -- start 2024-09-12T02:23:14.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.945+0000 7f24017c4640 1 -- start start 2024-09-12T02:23:14.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.946+0000 7f24017c4640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f23fc067a50 0x7f23fc067ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:14.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.946+0000 7f24017c4640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23fc06cbc0 con 0x7f23fc159b30 2024-09-12T02:23:14.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.946+0000 7f24017c4640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23fc06cea0 con 0x7f23fc0c9c60 2024-09-12T02:23:14.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.946+0000 7f24017c4640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f23fc0c66e0 con 0x7f23fc067a50 2024-09-12T02:23:14.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.946+0000 7f23faffd640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f23fc159b30 0x7f23fc159f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55654/0 (socket says 172.21.15.60:55654) 2024-09-12T02:23:14.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.946+0000 7f23faffd640 1 -- 172.21.15.60:0/4176044445 learned_addr learned my addr 172.21.15.60:0/4176044445 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:14.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.946+0000 7f23f9ffb640 1 -- 172.21.15.60:0/4176044445 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4024238799 0 0) 0x7f23fc06cbc0 con 0x7f23fc159b30 2024-09-12T02:23:14.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.946+0000 7f23f9ffb640 1 -- 172.21.15.60:0/4176044445 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23e4003520 con 0x7f23fc159b30 2024-09-12T02:23:14.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.946+0000 7f23fb7fe640 1 --2- 172.21.15.60:0/4176044445 >> v2:172.21.15.105:3300/0 conn(0x7f23fc067a50 0x7f23fc067ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:14.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.946+0000 7f23f9ffb640 1 -- 172.21.15.60:0/4176044445 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1053425171 0 0) 0x7f23e4003520 con 0x7f23fc159b30 2024-09-12T02:23:14.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.946+0000 7f23f9ffb640 1 -- 172.21.15.60:0/4176044445 >> v2:172.21.15.105:3300/0 conn(0x7f23fc067a50 msgr2=0x7f23fc067ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:14.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.946+0000 7f23f9ffb640 1 --2- 172.21.15.60:0/4176044445 >> v2:172.21.15.105:3300/0 conn(0x7f23fc067a50 0x7f23fc067ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:14.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.946+0000 7f23f9ffb640 1 -- 172.21.15.60:0/4176044445 >> v1:172.21.15.105:6789/0 conn(0x7f23fc0c9c60 legacy=0x7f23fc14feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:14.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.946+0000 7f23f9ffb640 1 -- 172.21.15.60:0/4176044445 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23fc0c6930 con 0x7f23fc159b30 2024-09-12T02:23:14.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.946+0000 7f23f9ffb640 1 -- 172.21.15.60:0/4176044445 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7f23ec001670 con 0x7f23fc159b30 2024-09-12T02:23:14.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.946+0000 7f23f9ffb640 1 -- 172.21.15.60:0/4176044445 >> v1:172.21.15.60:6789/0 conn(0x7f23fc159b30 legacy=0x7f23fc159f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:14.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.946+0000 7f23f9ffb640 1 --2- 172.21.15.60:0/4176044445 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23e40039b0 0x7f23e4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:14.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.946+0000 7f23f9ffb640 1 --2- 172.21.15.60:0/4176044445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23e4004800 0x7f23e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:14.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.946+0000 7f23f9ffb640 1 --2- 172.21.15.60:0/4176044445 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23e40052e0 0x7f23e400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:14.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.946+0000 7f23f9ffb640 1 -- 172.21.15.60:0/4176044445 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f23fc0c66e0 con 0x7f23e4004800 2024-09-12T02:23:14.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.947+0000 7f23f9ffb640 1 -- 172.21.15.60:0/4176044445 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f23e400c1b0 con 0x7f23e40052e0 2024-09-12T02:23:14.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.947+0000 7f23f9ffb640 1 -- 172.21.15.60:0/4176044445 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f23e400c3b0 con 0x7f23e40039b0 2024-09-12T02:23:14.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.947+0000 7f23fa7fc640 1 --2- 172.21.15.60:0/4176044445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23e4004800 0x7f23e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:14.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.947+0000 7f23faffd640 1 --2- 172.21.15.60:0/4176044445 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23e40039b0 0x7f23e4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:14.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.947+0000 7f23fb7fe640 1 --2- 172.21.15.60:0/4176044445 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23e40052e0 0x7f23e400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:14.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.947+0000 7f23fa7fc640 1 -- 172.21.15.60:0/4176044445 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23e40039b0 msgr2=0x7f23e4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:14.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.947+0000 7f23fa7fc640 1 --2- 172.21.15.60:0/4176044445 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23e40039b0 0x7f23e4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:14.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.947+0000 7f23fa7fc640 1 -- 172.21.15.60:0/4176044445 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23e40052e0 msgr2=0x7f23e400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:14.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.947+0000 7f23fa7fc640 1 --2- 172.21.15.60:0/4176044445 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23e40052e0 0x7f23e400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:14.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.947+0000 7f23fa7fc640 1 -- 172.21.15.60:0/4176044445 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e4003520 con 0x7f23e4004800 2024-09-12T02:23:14.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.947+0000 7f23fb7fe640 1 -- 172.21.15.60:0/4176044445 reap_dead start 2024-09-12T02:23:14.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.947+0000 7f23faffd640 1 --2- 172.21.15.60:0/4176044445 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23e40039b0 0x7f23e4003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:23:14.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.948+0000 7f23fa7fc640 1 --2- 172.21.15.60:0/4176044445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23e4004800 0x7f23e4004c80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f23fc0ca0c0 tx=0x7f23e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d39e4dffadafb3e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:14.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.948+0000 7f23f9ffb640 1 -- 172.21.15.60:0/4176044445 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f0001370 con 0x7f23e4004800 2024-09-12T02:23:14.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.948+0000 7f23f9ffb640 1 -- 172.21.15.60:0/4176044445 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23f00052d0 con 0x7f23e4004800 2024-09-12T02:23:14.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.948+0000 7f23f9ffb640 1 -- 172.21.15.60:0/4176044445 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f002ab70 con 0x7f23e4004800 2024-09-12T02:23:14.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.948+0000 7f24017c4640 1 -- 172.21.15.60:0/4176044445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23e4004800 msgr2=0x7f23e4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:14.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.948+0000 7f24017c4640 1 --2- 172.21.15.60:0/4176044445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23e4004800 0x7f23e4004c80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f23fc0ca0c0 tx=0x7f23e4005830 comp rx=0 tx=0).stop 2024-09-12T02:23:14.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.948+0000 7f24017c4640 1 -- 172.21.15.60:0/4176044445 shutdown_connections 2024-09-12T02:23:14.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.948+0000 7f24017c4640 1 --2- 172.21.15.60:0/4176044445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23e4004800 0x7f23e4004c80 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:14.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.948+0000 7f24017c4640 1 -- 172.21.15.60:0/4176044445 >> 172.21.15.60:0/4176044445 conn(0x7f23fc0cbd60 msgr2=0x7f23fc0cc170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:14.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.948+0000 7f24017c4640 1 -- 172.21.15.60:0/4176044445 shutdown_connections 2024-09-12T02:23:14.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.948+0000 7f24017c4640 1 -- 172.21.15.60:0/4176044445 wait complete. 2024-09-12T02:23:14.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.950+0000 7f24017c4640 1 Processor -- start 2024-09-12T02:23:14.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.950+0000 7f24017c4640 1 -- start start 2024-09-12T02:23:14.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.950+0000 7f24017c4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23e4004800 0x7f23fc0acce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:14.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.950+0000 7f24017c4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23fc14a7d0 0x7f23fc1ef570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:14.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.950+0000 7f24017c4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23fc1efab0 0x7f23fc0afb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:14.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.950+0000 7f24017c4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f23fc0cca00 con 0x7f23fc1efab0 2024-09-12T02:23:14.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.950+0000 7f24017c4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f23fc0cc880 con 0x7f23e4004800 2024-09-12T02:23:14.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.950+0000 7f24017c4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f23fc159f10 con 0x7f23fc14a7d0 2024-09-12T02:23:14.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.950+0000 7f23fb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23fc1efab0 0x7f23fc0afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:14.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.950+0000 7f23fb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23fc1efab0 0x7f23fc0afb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38186/0 (socket says 172.21.15.60:38186) 2024-09-12T02:23:14.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.950+0000 7f23fb7fe640 1 -- 172.21.15.60:0/2883173817 learned_addr learned my addr 172.21.15.60:0/2883173817 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:14.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.951+0000 7f23fa7fc640 1 --2- 172.21.15.60:0/2883173817 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23fc14a7d0 0x7f23fc1ef570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:14.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.951+0000 7f23faffd640 1 --2- 172.21.15.60:0/2883173817 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23e4004800 0x7f23fc0acce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:14.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.951+0000 7f23fb7fe640 1 -- 172.21.15.60:0/2883173817 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23fc14a7d0 msgr2=0x7f23fc1ef570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:14.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.951+0000 7f23fb7fe640 1 --2- 172.21.15.60:0/2883173817 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23fc14a7d0 0x7f23fc1ef570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:14.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.951+0000 7f23fb7fe640 1 -- 172.21.15.60:0/2883173817 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23e4004800 msgr2=0x7f23fc0acce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:14.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.951+0000 7f23fb7fe640 1 --2- 172.21.15.60:0/2883173817 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23e4004800 0x7f23fc0acce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:14.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.951+0000 7f23fb7fe640 1 -- 172.21.15.60:0/2883173817 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23fc0b1230 con 0x7f23fc1efab0 2024-09-12T02:23:14.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.951+0000 7f23faffd640 1 --2- 172.21.15.60:0/2883173817 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23e4004800 0x7f23fc0acce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:23:14.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.951+0000 7f23fb7fe640 1 --2- 172.21.15.60:0/2883173817 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23fc1efab0 0x7f23fc0afb70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f23f4011bf0 tx=0x7f23f400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:14.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.951+0000 7f23e37fe640 1 -- 172.21.15.60:0/2883173817 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f400fdb0 con 0x7f23fc1efab0 2024-09-12T02:23:14.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.951+0000 7f23e37fe640 1 -- 172.21.15.60:0/2883173817 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23f4015430 con 0x7f23fc1efab0 2024-09-12T02:23:14.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.951+0000 7f24017c4640 1 -- 172.21.15.60:0/2883173817 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23fc0b14d0 con 0x7f23fc1efab0 2024-09-12T02:23:14.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.951+0000 7f23e37fe640 1 -- 172.21.15.60:0/2883173817 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f4015820 con 0x7f23fc1efab0 2024-09-12T02:23:14.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.951+0000 7f24017c4640 1 -- 172.21.15.60:0/2883173817 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23fc0ad220 con 0x7f23fc1efab0 2024-09-12T02:23:14.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.952+0000 7f24017c4640 1 -- 172.21.15.60:0/2883173817 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23fc15a2a0 con 0x7f23fc1efab0 2024-09-12T02:23:14.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.953+0000 7f23e37fe640 1 -- 172.21.15.60:0/2883173817 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f23f40159c0 con 0x7f23fc1efab0 2024-09-12T02:23:14.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.953+0000 7f23e37fe640 1 --2- 172.21.15.60:0/2883173817 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f23e806be30 0x7f23e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:14.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.953+0000 7f23e37fe640 1 -- 172.21.15.60:0/2883173817 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6054+0+0 (secure 0 0 0) 0x7f23f408be70 con 0x7f23fc1efab0 2024-09-12T02:23:14.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.953+0000 7f23faffd640 1 --2- 172.21.15.60:0/2883173817 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f23e806be30 0x7f23e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:14.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.954+0000 7f23faffd640 1 --2- 172.21.15.60:0/2883173817 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f23e806be30 0x7f23e806e2f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f23ec001200 tx=0x7f23ec009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:14.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:14.958+0000 7f23e37fe640 1 -- 172.21.15.60:0/2883173817 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f23f4019030 con 0x7f23fc1efab0 2024-09-12T02:23:15.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.135+0000 7f24017c4640 1 -- 172.21.15.60:0/2883173817 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "b_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f23fc1eeeb0 con 0x7f23fc1efab0 2024-09-12T02:23:15.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.810+0000 7f23e37fe640 1 -- 172.21.15.60:0/2883173817 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "b_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'b_data' created v24) ==== 160+0+0 (secure 0 0 0) 0x7f23f4010040 con 0x7f23fc1efab0 2024-09-12T02:23:15.811 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'b_data' created 2024-09-12T02:23:15.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.815+0000 7f24017c4640 1 -- 172.21.15.60:0/2883173817 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f23e806be30 msgr2=0x7f23e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:15.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.815+0000 7f24017c4640 1 --2- 172.21.15.60:0/2883173817 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f23e806be30 0x7f23e806e2f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f23ec001200 tx=0x7f23ec009040 comp rx=0 tx=0).stop 2024-09-12T02:23:15.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.815+0000 7f24017c4640 1 -- 172.21.15.60:0/2883173817 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23fc1efab0 msgr2=0x7f23fc0afb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:15.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.815+0000 7f24017c4640 1 --2- 172.21.15.60:0/2883173817 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23fc1efab0 0x7f23fc0afb70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f23f4011bf0 tx=0x7f23f400f580 comp rx=0 tx=0).stop 2024-09-12T02:23:15.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.816+0000 7f24017c4640 1 -- 172.21.15.60:0/2883173817 shutdown_connections 2024-09-12T02:23:15.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.816+0000 7f24017c4640 1 --2- 172.21.15.60:0/2883173817 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f23e806be30 0x7f23e806e2f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:15.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.816+0000 7f24017c4640 1 --2- 172.21.15.60:0/2883173817 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23fc1efab0 0x7f23fc0afb70 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:15.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.816+0000 7f24017c4640 1 --2- 172.21.15.60:0/2883173817 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23fc14a7d0 0x7f23fc1ef570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:15.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.816+0000 7f24017c4640 1 --2- 172.21.15.60:0/2883173817 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23e4004800 0x7f23fc0acce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:15.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.816+0000 7f24017c4640 1 -- 172.21.15.60:0/2883173817 >> 172.21.15.60:0/2883173817 conn(0x7f23fc0cbd60 msgr2=0x7f23fc147970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:15.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.818+0000 7f24017c4640 1 -- 172.21.15.60:0/2883173817 shutdown_connections 2024-09-12T02:23:15.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.822+0000 7f24017c4640 1 -- 172.21.15.60:0/2883173817 wait complete. 2024-09-12T02:23:15.845 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new b b_metadata b_data 2024-09-12T02:23:15.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.955+0000 7fe5b9726640 1 Processor -- start 2024-09-12T02:23:15.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.955+0000 7fe5b9726640 1 -- start start 2024-09-12T02:23:15.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.956+0000 7fe5b9726640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe5b4153a40 0x7fe5b406c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:15.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.956+0000 7fe5b9726640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5b4156310 0x7fe5b41567a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:15.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.956+0000 7fe5b9726640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5b4159900 con 0x7fe5b406cbe0 2024-09-12T02:23:15.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.956+0000 7fe5b9726640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fe5b4159be0 con 0x7fe5b4153a40 2024-09-12T02:23:15.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.956+0000 7fe5b9726640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe5b4159ec0 con 0x7fe5b4156310 2024-09-12T02:23:15.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.956+0000 7fe5b27fc640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe5b406cbe0 0x7fe5b40c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55656/0 (socket says 172.21.15.60:55656) 2024-09-12T02:23:15.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.956+0000 7fe5b27fc640 1 -- 172.21.15.60:0/1928989632 learned_addr learned my addr 172.21.15.60:0/1928989632 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:15.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.956+0000 7fe5b2ffd640 1 --2- 172.21.15.60:0/1928989632 >> v2:172.21.15.105:3300/0 conn(0x7fe5b4153a40 0x7fe5b406c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:15.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.956+0000 7fe5b37fe640 1 --2- 172.21.15.60:0/1928989632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5b4156310 0x7fe5b41567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:15.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.956+0000 7fe5b1ffb640 1 -- 172.21.15.60:0/1928989632 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3902527043 0 0) 0x7fe5b4159900 con 0x7fe5b406cbe0 2024-09-12T02:23:15.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.956+0000 7fe5b1ffb640 1 -- 172.21.15.60:0/1928989632 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe5a0003520 con 0x7fe5b406cbe0 2024-09-12T02:23:15.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.957+0000 7fe5b1ffb640 1 -- 172.21.15.60:0/1928989632 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3668504775 0 0) 0x7fe5a0003520 con 0x7fe5b406cbe0 2024-09-12T02:23:15.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.957+0000 7fe5b1ffb640 1 -- 172.21.15.60:0/1928989632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5b4156310 msgr2=0x7fe5b41567a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:15.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.957+0000 7fe5b1ffb640 1 --2- 172.21.15.60:0/1928989632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5b4156310 0x7fe5b41567a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:15.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.957+0000 7fe5b1ffb640 1 -- 172.21.15.60:0/1928989632 >> v2:172.21.15.105:3300/0 conn(0x7fe5b4153a40 msgr2=0x7fe5b406c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:15.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.957+0000 7fe5b1ffb640 1 --2- 172.21.15.60:0/1928989632 >> v2:172.21.15.105:3300/0 conn(0x7fe5b4153a40 0x7fe5b406c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:15.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.957+0000 7fe5b1ffb640 1 -- 172.21.15.60:0/1928989632 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5b415a1a0 con 0x7fe5b406cbe0 2024-09-12T02:23:15.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.957+0000 7fe5b1ffb640 1 -- 172.21.15.60:0/1928989632 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7fe59c001670 con 0x7fe5b406cbe0 2024-09-12T02:23:15.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.957+0000 7fe5b2ffd640 1 --2- 172.21.15.60:0/1928989632 >> v2:172.21.15.105:3300/0 conn(0x7fe5b4153a40 0x7fe5b406c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:23:15.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.957+0000 7fe5b1ffb640 1 -- 172.21.15.60:0/1928989632 >> v1:172.21.15.60:6789/0 conn(0x7fe5b406cbe0 legacy=0x7fe5b40c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:15.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.957+0000 7fe5b1ffb640 1 --2- 172.21.15.60:0/1928989632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5a00039b0 0x7fe5a0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:15.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.957+0000 7fe5b1ffb640 1 --2- 172.21.15.60:0/1928989632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5b4156310 0x7fe5a0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:15.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.957+0000 7fe5b1ffb640 1 --2- 172.21.15.60:0/1928989632 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5a0004d40 0x7fe5a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:15.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.957+0000 7fe5b1ffb640 1 -- 172.21.15.60:0/1928989632 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b4159be0 con 0x7fe5a00039b0 2024-09-12T02:23:15.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.957+0000 7fe5b1ffb640 1 -- 172.21.15.60:0/1928989632 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b4159ec0 con 0x7fe5a0004d40 2024-09-12T02:23:15.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.957+0000 7fe5b1ffb640 1 -- 172.21.15.60:0/1928989632 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe5a000b9c0 con 0x7fe5b4156310 2024-09-12T02:23:15.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.957+0000 7fe5b2ffd640 1 --2- 172.21.15.60:0/1928989632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5a00039b0 0x7fe5a0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:15.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.957+0000 7fe5b27fc640 1 --2- 172.21.15.60:0/1928989632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5b4156310 0x7fe5a0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:15.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.957+0000 7fe5b37fe640 1 --2- 172.21.15.60:0/1928989632 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5a0004d40 0x7fe5a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:15.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.957+0000 7fe5b2ffd640 1 -- 172.21.15.60:0/1928989632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5b4156310 msgr2=0x7fe5a0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:15.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.957+0000 7fe5b2ffd640 1 --2- 172.21.15.60:0/1928989632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5b4156310 0x7fe5a0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:15.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.957+0000 7fe5b2ffd640 1 -- 172.21.15.60:0/1928989632 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5a0004d40 msgr2=0x7fe5a00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:15.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.957+0000 7fe5b2ffd640 1 --2- 172.21.15.60:0/1928989632 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5a0004d40 0x7fe5a00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:15.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.957+0000 7fe5b2ffd640 1 -- 172.21.15.60:0/1928989632 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5a0003520 con 0x7fe5a00039b0 2024-09-12T02:23:15.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.958+0000 7fe5b2ffd640 1 --2- 172.21.15.60:0/1928989632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5a00039b0 0x7fe5a0003dd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe5a400e350 tx=0x7fe5a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8daee676747f9ea1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:15.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.958+0000 7fe5b1ffb640 1 -- 172.21.15.60:0/1928989632 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a4009de0 con 0x7fe5a00039b0 2024-09-12T02:23:15.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.958+0000 7fe5b1ffb640 1 -- 172.21.15.60:0/1928989632 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5a402e660 con 0x7fe5a00039b0 2024-09-12T02:23:15.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.958+0000 7fe5b1ffb640 1 -- 172.21.15.60:0/1928989632 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a402ea10 con 0x7fe5a00039b0 2024-09-12T02:23:15.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.959+0000 7fe5b9726640 1 -- 172.21.15.60:0/1928989632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5a00039b0 msgr2=0x7fe5a0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:15.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.959+0000 7fe5b9726640 1 --2- 172.21.15.60:0/1928989632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5a00039b0 0x7fe5a0003dd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe5a400e350 tx=0x7fe5a0005830 comp rx=0 tx=0).stop 2024-09-12T02:23:15.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.959+0000 7fe5b37fe640 1 -- 172.21.15.60:0/1928989632 reap_dead start 2024-09-12T02:23:15.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.959+0000 7fe5b9726640 1 -- 172.21.15.60:0/1928989632 shutdown_connections 2024-09-12T02:23:15.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.959+0000 7fe5b9726640 1 -- 172.21.15.60:0/1928989632 >> 172.21.15.60:0/1928989632 conn(0x7fe5b4073310 msgr2=0x7fe5b40736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:15.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.959+0000 7fe5b9726640 1 -- 172.21.15.60:0/1928989632 shutdown_connections 2024-09-12T02:23:15.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.959+0000 7fe5b9726640 1 -- 172.21.15.60:0/1928989632 wait complete. 2024-09-12T02:23:15.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.960+0000 7fe5b9726640 1 Processor -- start 2024-09-12T02:23:15.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.960+0000 7fe5b9726640 1 -- start start 2024-09-12T02:23:15.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.961+0000 7fe5b9726640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5a00039b0 0x7fe5b41ef2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:15.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.961+0000 7fe5b9726640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5b40b07a0 0x7fe5b41ef810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:15.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.961+0000 7fe5b9726640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5b41efd50 0x7fe5b414bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:15.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.961+0000 7fe5b9726640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b4153e20 con 0x7fe5b41efd50 2024-09-12T02:23:15.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.961+0000 7fe5b9726640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b40c9270 con 0x7fe5a00039b0 2024-09-12T02:23:15.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.961+0000 7fe5b9726640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe5b4153fa0 con 0x7fe5b40b07a0 2024-09-12T02:23:15.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.961+0000 7fe5b37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5b41efd50 0x7fe5b414bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:15.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.961+0000 7fe5b2ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5a00039b0 0x7fe5b41ef2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:15.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.961+0000 7fe5b37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5b41efd50 0x7fe5b414bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38196/0 (socket says 172.21.15.60:38196) 2024-09-12T02:23:15.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.961+0000 7fe5b37fe640 1 -- 172.21.15.60:0/2516469590 learned_addr learned my addr 172.21.15.60:0/2516469590 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:15.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.961+0000 7fe5b2ffd640 1 --2- 172.21.15.60:0/2516469590 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5a00039b0 0x7fe5b41ef2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:56418/0 (socket says 172.21.15.60:56418) 2024-09-12T02:23:15.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.961+0000 7fe5b27fc640 1 --2- 172.21.15.60:0/2516469590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5b40b07a0 0x7fe5b41ef810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:15.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.961+0000 7fe5b37fe640 1 -- 172.21.15.60:0/2516469590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5b40b07a0 msgr2=0x7fe5b41ef810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:15.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.961+0000 7fe5b37fe640 1 --2- 172.21.15.60:0/2516469590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5b40b07a0 0x7fe5b41ef810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:15.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.961+0000 7fe5b37fe640 1 -- 172.21.15.60:0/2516469590 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5a00039b0 msgr2=0x7fe5b41ef2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:15.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.961+0000 7fe5b37fe640 1 --2- 172.21.15.60:0/2516469590 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5a00039b0 0x7fe5b41ef2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:15.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.961+0000 7fe5b37fe640 1 -- 172.21.15.60:0/2516469590 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5b40af5d0 con 0x7fe5b41efd50 2024-09-12T02:23:15.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.961+0000 7fe5b37fe640 1 --2- 172.21.15.60:0/2516469590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5b41efd50 0x7fe5b414bba0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe5b406c270 tx=0x7fe5ac011c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:15.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.961+0000 7fe5ab7fe640 1 -- 172.21.15.60:0/2516469590 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac019020 con 0x7fe5b41efd50 2024-09-12T02:23:15.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.961+0000 7fe5ab7fe640 1 -- 172.21.15.60:0/2516469590 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5ac004030 con 0x7fe5b41efd50 2024-09-12T02:23:15.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.962+0000 7fe5ab7fe640 1 -- 172.21.15.60:0/2516469590 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac004420 con 0x7fe5b41efd50 2024-09-12T02:23:15.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.962+0000 7fe5b9726640 1 -- 172.21.15.60:0/2516469590 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5b40b0f20 con 0x7fe5b41efd50 2024-09-12T02:23:15.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.962+0000 7fe5b9726640 1 -- 172.21.15.60:0/2516469590 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5b414cb40 con 0x7fe5b41efd50 2024-09-12T02:23:15.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.963+0000 7fe5b9726640 1 -- 172.21.15.60:0/2516469590 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5b406c6a0 con 0x7fe5b41efd50 2024-09-12T02:23:15.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.963+0000 7fe5ab7fe640 1 -- 172.21.15.60:0/2516469590 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe5ac01c020 con 0x7fe5b41efd50 2024-09-12T02:23:15.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.964+0000 7fe5ab7fe640 1 --2- 172.21.15.60:0/2516469590 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe59406be60 0x7fe59406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:15.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.964+0000 7fe5ab7fe640 1 -- 172.21.15.60:0/2516469590 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6431+0+0 (secure 0 0 0) 0x7fe5ac08b3f0 con 0x7fe5b41efd50 2024-09-12T02:23:15.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.964+0000 7fe5b2ffd640 1 --2- 172.21.15.60:0/2516469590 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe59406be60 0x7fe59406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:15.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.964+0000 7fe5b2ffd640 1 --2- 172.21.15.60:0/2516469590 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe59406be60 0x7fe59406e320 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4035000 tx=0x7fe5a402f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:15.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:15.968+0000 7fe5ab7fe640 1 -- 172.21.15.60:0/2516469590 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe5ac023020 con 0x7fe5b41efd50 2024-09-12T02:23:16.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.182+0000 7fe5b9726640 1 -- 172.21.15.60:0/2516469590 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "b", "metadata": "b_metadata", "data": "b_data"} v 0) -- 0x7fe5b414faa0 con 0x7fe5b41efd50 2024-09-12T02:23:16.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.835+0000 7fe5ab7fe640 1 -- 172.21.15.60:0/2516469590 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "b", "metadata": "b_metadata", "data": "b_data"}]=0 new fs with metadata pool 4 and data pool 5 v8) ==== 157+0+0 (secure 0 0 0) 0x7fe5ac059b60 con 0x7fe5b41efd50 2024-09-12T02:23:16.837 INFO:teuthology.orchestra.run.smithi060.stderr:new fs with metadata pool 4 and data pool 5 2024-09-12T02:23:16.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.842+0000 7fe5b9726640 1 -- 172.21.15.60:0/2516469590 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe59406be60 msgr2=0x7fe59406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:16.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.842+0000 7fe5b9726640 1 --2- 172.21.15.60:0/2516469590 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe59406be60 0x7fe59406e320 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4035000 tx=0x7fe5a402f000 comp rx=0 tx=0).stop 2024-09-12T02:23:16.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.842+0000 7fe5b9726640 1 -- 172.21.15.60:0/2516469590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5b41efd50 msgr2=0x7fe5b414bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:16.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.842+0000 7fe5b9726640 1 --2- 172.21.15.60:0/2516469590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5b41efd50 0x7fe5b414bba0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe5b406c270 tx=0x7fe5ac011c30 comp rx=0 tx=0).stop 2024-09-12T02:23:16.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.844+0000 7fe5b9726640 1 -- 172.21.15.60:0/2516469590 shutdown_connections 2024-09-12T02:23:16.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.844+0000 7fe5b9726640 1 --2- 172.21.15.60:0/2516469590 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe59406be60 0x7fe59406e320 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:16.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.844+0000 7fe5b9726640 1 --2- 172.21.15.60:0/2516469590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5b41efd50 0x7fe5b414bba0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:16.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.844+0000 7fe5b9726640 1 --2- 172.21.15.60:0/2516469590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5b40b07a0 0x7fe5b41ef810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:16.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.844+0000 7fe5b9726640 1 --2- 172.21.15.60:0/2516469590 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5a00039b0 0x7fe5b41ef2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:16.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.844+0000 7fe5b9726640 1 -- 172.21.15.60:0/2516469590 >> 172.21.15.60:0/2516469590 conn(0x7fe5b4073310 msgr2=0x7fe5b41502a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:16.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.851+0000 7fe5b9726640 1 -- 172.21.15.60:0/2516469590 shutdown_connections 2024-09-12T02:23:16.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.852+0000 7fe5b9726640 1 -- 172.21.15.60:0/2516469590 wait complete. 2024-09-12T02:23:16.871 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:23:16.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.977+0000 7ff881d91640 1 Processor -- start 2024-09-12T02:23:16.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.977+0000 7ff881d91640 1 -- start start 2024-09-12T02:23:16.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.978+0000 7ff881d91640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff87c0ca390 0x7ff87c161c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:16.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.978+0000 7ff881d91640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff87c15a7c0 con 0x7ff87c150480 2024-09-12T02:23:16.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.978+0000 7ff881d91640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff87c159a00 con 0x7ff87c06c650 2024-09-12T02:23:16.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.978+0000 7ff881d91640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7ff87c06c240 con 0x7ff87c0ca390 2024-09-12T02:23:16.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.978+0000 7ff87bfff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff87c0ca390 0x7ff87c161c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:16.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.978+0000 7ff87b7fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff87c150480 0x7ff87c0c7a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55658/0 (socket says 172.21.15.60:55658) 2024-09-12T02:23:16.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.978+0000 7ff87b7fe640 1 -- 172.21.15.60:0/4066780514 learned_addr learned my addr 172.21.15.60:0/4066780514 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:16.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.978+0000 7ff87bfff640 1 -- 172.21.15.60:0/4066780514 >> v1:172.21.15.105:6789/0 conn(0x7ff87c06c650 legacy=0x7ff87c0c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:16.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.978+0000 7ff87bfff640 1 -- 172.21.15.60:0/4066780514 >> v1:172.21.15.60:6789/0 conn(0x7ff87c150480 legacy=0x7ff87c0c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:16.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.978+0000 7ff87bfff640 1 -- 172.21.15.60:0/4066780514 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff87c159ce0 con 0x7ff87c0ca390 2024-09-12T02:23:16.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.978+0000 7ff87a7fc640 1 -- 172.21.15.60:0/4066780514 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1364525880 0 0) 0x7ff87c15a7c0 con 0x7ff87c150480 2024-09-12T02:23:16.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.979+0000 7ff87bfff640 1 --2- 172.21.15.60:0/4066780514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff87c0ca390 0x7ff87c161c00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff874009d90 tx=0x7ff87402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7924456d14049d03 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:16.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.979+0000 7ff87a7fc640 1 -- 172.21.15.60:0/4066780514 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff874007740 con 0x7ff87c0ca390 2024-09-12T02:23:16.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.979+0000 7ff87a7fc640 1 -- 172.21.15.60:0/4066780514 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8740078e0 con 0x7ff87c0ca390 2024-09-12T02:23:16.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.979+0000 7ff87a7fc640 1 -- 172.21.15.60:0/4066780514 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff874007cb0 con 0x7ff87c0ca390 2024-09-12T02:23:16.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.980+0000 7ff881d91640 1 -- 172.21.15.60:0/4066780514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff87c0ca390 msgr2=0x7ff87c161c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:16.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.980+0000 7ff881d91640 1 --2- 172.21.15.60:0/4066780514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff87c0ca390 0x7ff87c161c00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff874009d90 tx=0x7ff87402a6f0 comp rx=0 tx=0).stop 2024-09-12T02:23:16.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.980+0000 7ff881d91640 1 -- 172.21.15.60:0/4066780514 shutdown_connections 2024-09-12T02:23:16.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.980+0000 7ff881d91640 1 --2- 172.21.15.60:0/4066780514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff87c0ca390 0x7ff87c161c00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:16.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.980+0000 7ff881d91640 1 -- 172.21.15.60:0/4066780514 >> 172.21.15.60:0/4066780514 conn(0x7ff87c068030 msgr2=0x7ff87c073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:16.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.980+0000 7ff881d91640 1 -- 172.21.15.60:0/4066780514 shutdown_connections 2024-09-12T02:23:16.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.980+0000 7ff881d91640 1 -- 172.21.15.60:0/4066780514 wait complete. 2024-09-12T02:23:16.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.981+0000 7ff881d91640 1 Processor -- start 2024-09-12T02:23:16.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.981+0000 7ff881d91640 1 -- start start 2024-09-12T02:23:16.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.982+0000 7ff881d91640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff87c06c650 0x7ff87c1586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:16.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.982+0000 7ff881d91640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff87c0ca390 0x7ff87c151e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:16.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.982+0000 7ff881d91640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff87c150480 0x7ff87c14f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:16.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.982+0000 7ff881d91640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff87c06d270 con 0x7ff87c0ca390 2024-09-12T02:23:16.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.982+0000 7ff881d91640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff87c15a330 con 0x7ff87c06c650 2024-09-12T02:23:16.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.982+0000 7ff881d91640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff87c0c81a0 con 0x7ff87c150480 2024-09-12T02:23:16.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.982+0000 7ff87affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff87c0ca390 0x7ff87c151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:16.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.982+0000 7ff87affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff87c0ca390 0x7ff87c151e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38208/0 (socket says 172.21.15.60:38208) 2024-09-12T02:23:16.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.982+0000 7ff87affd640 1 -- 172.21.15.60:0/94104673 learned_addr learned my addr 172.21.15.60:0/94104673 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:16.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.982+0000 7ff87b7fe640 1 --2- 172.21.15.60:0/94104673 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff87c06c650 0x7ff87c1586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:16.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.982+0000 7ff87bfff640 1 --2- 172.21.15.60:0/94104673 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff87c150480 0x7ff87c14f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:16.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.982+0000 7ff87affd640 1 -- 172.21.15.60:0/94104673 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff87c150480 msgr2=0x7ff87c14f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:16.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.982+0000 7ff87affd640 1 --2- 172.21.15.60:0/94104673 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff87c150480 0x7ff87c14f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:16.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.982+0000 7ff87affd640 1 -- 172.21.15.60:0/94104673 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff87c06c650 msgr2=0x7ff87c1586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:16.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.982+0000 7ff87affd640 1 --2- 172.21.15.60:0/94104673 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff87c06c650 0x7ff87c1586f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:16.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.982+0000 7ff87affd640 1 -- 172.21.15.60:0/94104673 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff87c153b60 con 0x7ff87c0ca390 2024-09-12T02:23:16.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.982+0000 7ff87affd640 1 --2- 172.21.15.60:0/94104673 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff87c0ca390 0x7ff87c151e30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff87000c480 tx=0x7ff87000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:16.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.983+0000 7ff863fff640 1 -- 172.21.15.60:0/94104673 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8700052d0 con 0x7ff87c0ca390 2024-09-12T02:23:16.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.983+0000 7ff863fff640 1 -- 172.21.15.60:0/94104673 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff870005470 con 0x7ff87c0ca390 2024-09-12T02:23:16.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.983+0000 7ff881d91640 1 -- 172.21.15.60:0/94104673 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff87c153880 con 0x7ff87c0ca390 2024-09-12T02:23:16.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.983+0000 7ff863fff640 1 -- 172.21.15.60:0/94104673 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff870012870 con 0x7ff87c0ca390 2024-09-12T02:23:16.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.983+0000 7ff881d91640 1 -- 172.21.15.60:0/94104673 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff87c1ed980 con 0x7ff87c0ca390 2024-09-12T02:23:16.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.984+0000 7ff881d91640 1 -- 172.21.15.60:0/94104673 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff87c156270 con 0x7ff87c0ca390 2024-09-12T02:23:16.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.984+0000 7ff863fff640 1 -- 172.21.15.60:0/94104673 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff870012a10 con 0x7ff87c0ca390 2024-09-12T02:23:16.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.985+0000 7ff863fff640 1 --2- 172.21.15.60:0/94104673 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff86806be60 0x7ff86806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:16.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.985+0000 7ff87b7fe640 1 --2- 172.21.15.60:0/94104673 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff86806be60 0x7ff86806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:16.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.985+0000 7ff863fff640 1 -- 172.21.15.60:0/94104673 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7ff87008ac40 con 0x7ff87c0ca390 2024-09-12T02:23:16.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.985+0000 7ff87b7fe640 1 --2- 172.21.15.60:0/94104673 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff86806be60 0x7ff86806e320 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff86c000f60 tx=0x7ff86c007e40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:16.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:16.989+0000 7ff863fff640 1 -- 172.21.15.60:0/94104673 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff87c153b60 con 0x7ff87c0ca390 2024-09-12T02:23:17.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.165+0000 7ff881d91640 1 -- 172.21.15.60:0/94104673 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff87c1edb50 con 0x7ff87c0ca390 2024-09-12T02:23:17.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.166+0000 7ff863fff640 1 -- 172.21.15.60:0/94104673 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+20452 (secure 0 0 0) 0x7ff870058d00 con 0x7ff87c0ca390 2024-09-12T02:23:17.167 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:23:17.167 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":25,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","created":"2024-09-12T02:22:39.869862+0000","modified":"2024-09-12T02:23:16.183814+0000","last_up_change":"2024-09-12T02:22:53.459371+0000","last_in_change":"2024-09-12T02:22:42.817076+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:22:52.130579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-09-12T02:23:01.854763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-09-12T02:23:03.104847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-09-12T02:23:14.175168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-09-12T02:23:15.166293+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0f0c7386-002f-47e2-a7a3-6c8a70264cc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6819","nonce":1789465659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6821","nonce":1789465659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6825","nonce":1789465659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6823","nonce":1789465659}]},"public_addr":"172.21.15.60:6819/1789465659","cluster_addr":"172.21.15.60:6821/1789465659","heartbeat_back_addr":"172.21.15.60:6825/1789465659","heartbeat_front_addr":"172.21.15.60:6823/1789465659","state":["exists","up"]},{"osd":1,"uuid":"64be7b84-36fc-43c0-9e70-a617e5b68941","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6811","nonce":1109822408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6813","nonce":1109822408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6817","nonce":1109822408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6815","nonce":1109822408}]},"public_addr":"172.21.15.60:6811/1109822408","cluster_addr":"172.21.15.60:6813/1109822408","heartbeat_back_addr":"172.21.15.60:6817/1109822408","heartbeat_front_addr":"172.21.15.60:6815/1109822408","state":["exists","up"]},{"osd":2,"uuid":"df00caa1-d45e-4b87-ac1e-8bc098d509d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6827","nonce":278470077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6829","nonce":278470077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6833","nonce":278470077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6831","nonce":278470077}]},"public_addr":"172.21.15.60:6827/278470077","cluster_addr":"172.21.15.60:6829/278470077","heartbeat_back_addr":"172.21.15.60:6833/278470077","heartbeat_front_addr":"172.21.15.60:6831/278470077","state":["exists","up"]},{"osd":3,"uuid":"f6453471-893a-490b-b0c7-f196a0f574e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6803","nonce":3606424156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6805","nonce":3606424156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6809","nonce":3606424156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6807","nonce":3606424156}]},"public_addr":"172.21.15.60:6803/3606424156","cluster_addr":"172.21.15.60:6805/3606424156","heartbeat_back_addr":"172.21.15.60:6809/3606424156","heartbeat_front_addr":"172.21.15.60:6807/3606424156","state":["exists","up"]},{"osd":4,"uuid":"96e908b6-ce3e-466c-b02d-08fc71a1dba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6809","nonce":1581641129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6811","nonce":1581641129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6815","nonce":1581641129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6813","nonce":1581641129}]},"public_addr":"172.21.15.105:6809/1581641129","cluster_addr":"172.21.15.105:6811/1581641129","heartbeat_back_addr":"172.21.15.105:6815/1581641129","heartbeat_front_addr":"172.21.15.105:6813/1581641129","state":["exists","up"]},{"osd":5,"uuid":"7ebc26f0-a462-4364-9303-7351f7cba21f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6825","nonce":1392337793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6827","nonce":1392337793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6831","nonce":1392337793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6829","nonce":1392337793}]},"public_addr":"172.21.15.105:6825/1392337793","cluster_addr":"172.21.15.105:6827/1392337793","heartbeat_back_addr":"172.21.15.105:6831/1392337793","heartbeat_front_addr":"172.21.15.105:6829/1392337793","state":["exists","up"]},{"osd":6,"uuid":"49487ea1-9c6d-4090-bbcc-f28b33040eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6801","nonce":50951309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6803","nonce":50951309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6807","nonce":50951309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6805","nonce":50951309}]},"public_addr":"172.21.15.105:6801/50951309","cluster_addr":"172.21.15.105:6803/50951309","heartbeat_back_addr":"172.21.15.105:6807/50951309","heartbeat_front_addr":"172.21.15.105:6805/50951309","state":["exists","up"]},{"osd":7,"uuid":"1e3a0aa9-7e29-4785-8506-6b5d3be2be35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6817","nonce":3745331251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6819","nonce":3745331251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6823","nonce":3745331251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6821","nonce":3745331251}]},"public_addr":"172.21.15.105:6817/3745331251","cluster_addr":"172.21.15.105:6819/3745331251","heartbeat_back_addr":"172.21.15.105:6823/3745331251","heartbeat_front_addr":"172.21.15.105:6821/3745331251","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:50.112629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.307689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.542851+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.334773+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:50.096967+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:50.259633+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.888988+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.917421+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:23:17.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.168+0000 7ff881d91640 1 -- 172.21.15.60:0/94104673 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff86806be60 msgr2=0x7ff86806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:17.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.168+0000 7ff881d91640 1 --2- 172.21.15.60:0/94104673 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff86806be60 0x7ff86806e320 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff86c000f60 tx=0x7ff86c007e40 comp rx=0 tx=0).stop 2024-09-12T02:23:17.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.168+0000 7ff881d91640 1 -- 172.21.15.60:0/94104673 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff87c0ca390 msgr2=0x7ff87c151e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:17.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.168+0000 7ff881d91640 1 --2- 172.21.15.60:0/94104673 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff87c0ca390 0x7ff87c151e30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff87000c480 tx=0x7ff87000c940 comp rx=0 tx=0).stop 2024-09-12T02:23:17.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.168+0000 7ff881d91640 1 -- 172.21.15.60:0/94104673 shutdown_connections 2024-09-12T02:23:17.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.168+0000 7ff881d91640 1 --2- 172.21.15.60:0/94104673 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff86806be60 0x7ff86806e320 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:17.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.168+0000 7ff881d91640 1 --2- 172.21.15.60:0/94104673 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff87c150480 0x7ff87c14f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:17.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.168+0000 7ff881d91640 1 --2- 172.21.15.60:0/94104673 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff87c0ca390 0x7ff87c151e30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:17.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.168+0000 7ff881d91640 1 --2- 172.21.15.60:0/94104673 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff87c06c650 0x7ff87c1586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:17.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.168+0000 7ff881d91640 1 -- 172.21.15.60:0/94104673 >> 172.21.15.60:0/94104673 conn(0x7ff87c068030 msgr2=0x7ff87c0ca770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:17.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.168+0000 7ff881d91640 1 -- 172.21.15.60:0/94104673 shutdown_connections 2024-09-12T02:23:17.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.168+0000 7ff881d91640 1 -- 172.21.15.60:0/94104673 wait complete. 2024-09-12T02:23:17.180 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:23:17.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.281+0000 7fea6faa6640 1 Processor -- start 2024-09-12T02:23:17.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.281+0000 7fea6faa6640 1 -- start start 2024-09-12T02:23:17.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.282+0000 7fea6faa6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fea68153910 0x7fea680c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:17.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.282+0000 7fea6faa6640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea68153d60 con 0x7fea680c69c0 2024-09-12T02:23:17.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.282+0000 7fea6faa6640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea680c5940 con 0x7fea681505f0 2024-09-12T02:23:17.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.282+0000 7fea6faa6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fea680c7860 con 0x7fea68153910 2024-09-12T02:23:17.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.282+0000 7fea6e043640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fea68153910 0x7fea680c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:17.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.282+0000 7fea6d041640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fea680c69c0 0x7fea680c42b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55662/0 (socket says 172.21.15.60:55662) 2024-09-12T02:23:17.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.282+0000 7fea6d041640 1 -- 172.21.15.60:0/630743226 learned_addr learned my addr 172.21.15.60:0/630743226 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:17.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.283+0000 7fea6e043640 1 -- 172.21.15.60:0/630743226 >> v1:172.21.15.105:6789/0 conn(0x7fea681505f0 legacy=0x7fea680c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:17.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.283+0000 7fea6e043640 1 -- 172.21.15.60:0/630743226 >> v1:172.21.15.60:6789/0 conn(0x7fea680c69c0 legacy=0x7fea680c42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:17.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.283+0000 7fea6e043640 1 -- 172.21.15.60:0/630743226 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea680c5c00 con 0x7fea68153910 2024-09-12T02:23:17.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.283+0000 7fea6e043640 1 --2- 172.21.15.60:0/630743226 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea68153910 0x7fea680c49c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fea60009d90 tx=0x7fea6002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e736ed19f144210 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:17.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.283+0000 7fea6c840640 1 -- 172.21.15.60:0/630743226 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea60031600 con 0x7fea68153910 2024-09-12T02:23:17.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.283+0000 7fea6c840640 1 -- 172.21.15.60:0/630743226 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea600317a0 con 0x7fea68153910 2024-09-12T02:23:17.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.283+0000 7fea6c840640 1 -- 172.21.15.60:0/630743226 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea60031b70 con 0x7fea68153910 2024-09-12T02:23:17.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.284+0000 7fea6faa6640 1 -- 172.21.15.60:0/630743226 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea68153910 msgr2=0x7fea680c49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:17.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.284+0000 7fea6faa6640 1 --2- 172.21.15.60:0/630743226 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea68153910 0x7fea680c49c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fea60009d90 tx=0x7fea6002a610 comp rx=0 tx=0).stop 2024-09-12T02:23:17.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.284+0000 7fea6faa6640 1 -- 172.21.15.60:0/630743226 shutdown_connections 2024-09-12T02:23:17.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.284+0000 7fea6faa6640 1 --2- 172.21.15.60:0/630743226 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea68153910 0x7fea680c49c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:17.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.284+0000 7fea6faa6640 1 -- 172.21.15.60:0/630743226 >> 172.21.15.60:0/630743226 conn(0x7fea680c7a40 msgr2=0x7fea680c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:17.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.284+0000 7fea6faa6640 1 -- 172.21.15.60:0/630743226 shutdown_connections 2024-09-12T02:23:17.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.284+0000 7fea6faa6640 1 -- 172.21.15.60:0/630743226 wait complete. 2024-09-12T02:23:17.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.285+0000 7fea6faa6640 1 Processor -- start 2024-09-12T02:23:17.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.285+0000 7fea6faa6640 1 -- start start 2024-09-12T02:23:17.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.286+0000 7fea6faa6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea681505f0 0x7fea680c17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:17.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.286+0000 7fea6faa6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea68153910 0x7fea681ef250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:17.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.286+0000 7fea6faa6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea680c31f0 0x7fea680c2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:17.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.286+0000 7fea6faa6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fea680c64a0 con 0x7fea68153910 2024-09-12T02:23:17.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.286+0000 7fea6faa6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fea680c61c0 con 0x7fea680c31f0 2024-09-12T02:23:17.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.286+0000 7fea6faa6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fea681509d0 con 0x7fea681505f0 2024-09-12T02:23:17.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.286+0000 7fea6d041640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea68153910 0x7fea681ef250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:17.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.286+0000 7fea6d041640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea68153910 0x7fea681ef250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38236/0 (socket says 172.21.15.60:38236) 2024-09-12T02:23:17.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.286+0000 7fea6d041640 1 -- 172.21.15.60:0/510144136 learned_addr learned my addr 172.21.15.60:0/510144136 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:17.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.286+0000 7fea6e043640 1 --2- 172.21.15.60:0/510144136 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea680c31f0 0x7fea680c2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:17.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.286+0000 7fea6d842640 1 --2- 172.21.15.60:0/510144136 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea681505f0 0x7fea680c17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:17.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.286+0000 7fea6d041640 1 -- 172.21.15.60:0/510144136 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea681505f0 msgr2=0x7fea680c17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:17.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.286+0000 7fea6d041640 1 --2- 172.21.15.60:0/510144136 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea681505f0 0x7fea680c17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:17.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.286+0000 7fea6d041640 1 -- 172.21.15.60:0/510144136 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea680c31f0 msgr2=0x7fea680c2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:17.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.286+0000 7fea6d041640 1 --2- 172.21.15.60:0/510144136 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea680c31f0 0x7fea680c2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:17.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.286+0000 7fea6d041640 1 -- 172.21.15.60:0/510144136 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea6815d4a0 con 0x7fea68153910 2024-09-12T02:23:17.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.287+0000 7fea6d041640 1 --2- 172.21.15.60:0/510144136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea68153910 0x7fea681ef250 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fea5800c430 tx=0x7fea5800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:17.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.287+0000 7fea5e7fc640 1 -- 172.21.15.60:0/510144136 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea58017070 con 0x7fea68153910 2024-09-12T02:23:17.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.287+0000 7fea5e7fc640 1 -- 172.21.15.60:0/510144136 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea58005ce0 con 0x7fea68153910 2024-09-12T02:23:17.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.287+0000 7fea5e7fc640 1 -- 172.21.15.60:0/510144136 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea580072f0 con 0x7fea68153910 2024-09-12T02:23:17.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.287+0000 7fea6faa6640 1 -- 172.21.15.60:0/510144136 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea68152e10 con 0x7fea68153910 2024-09-12T02:23:17.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.287+0000 7fea6faa6640 1 -- 172.21.15.60:0/510144136 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea680c12d0 con 0x7fea68153910 2024-09-12T02:23:17.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.288+0000 7fea6faa6640 1 -- 172.21.15.60:0/510144136 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea680aa8e0 con 0x7fea68153910 2024-09-12T02:23:17.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.289+0000 7fea5e7fc640 1 -- 172.21.15.60:0/510144136 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fea5801a070 con 0x7fea68153910 2024-09-12T02:23:17.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.289+0000 7fea5e7fc640 1 --2- 172.21.15.60:0/510144136 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fea4c06be60 0x7fea4c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:17.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.289+0000 7fea5e7fc640 1 -- 172.21.15.60:0/510144136 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fea5808a500 con 0x7fea68153910 2024-09-12T02:23:17.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.289+0000 7fea6d842640 1 --2- 172.21.15.60:0/510144136 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fea4c06be60 0x7fea4c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:17.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.289+0000 7fea6d842640 1 --2- 172.21.15.60:0/510144136 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fea4c06be60 0x7fea4c06e320 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fea64004ea0 tx=0x7fea64009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:17.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.293+0000 7fea5e7fc640 1 -- 172.21.15.60:0/510144136 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fea680aa8e0 con 0x7fea68153910 2024-09-12T02:23:17.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.470+0000 7fea6faa6640 1 -- 172.21.15.60:0/510144136 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fea680aad90 con 0x7fea68153910 2024-09-12T02:23:17.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.472+0000 7fea5e7fc640 1 -- 172.21.15.60:0/510144136 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+20452 (secure 0 0 0) 0x7fea680aad90 con 0x7fea68153910 2024-09-12T02:23:17.472 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:23:17.472 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":25,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","created":"2024-09-12T02:22:39.869862+0000","modified":"2024-09-12T02:23:16.183814+0000","last_up_change":"2024-09-12T02:22:53.459371+0000","last_in_change":"2024-09-12T02:22:42.817076+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:22:52.130579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-09-12T02:23:01.854763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-09-12T02:23:03.104847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-09-12T02:23:14.175168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-09-12T02:23:15.166293+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0f0c7386-002f-47e2-a7a3-6c8a70264cc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6819","nonce":1789465659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6821","nonce":1789465659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6825","nonce":1789465659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6823","nonce":1789465659}]},"public_addr":"172.21.15.60:6819/1789465659","cluster_addr":"172.21.15.60:6821/1789465659","heartbeat_back_addr":"172.21.15.60:6825/1789465659","heartbeat_front_addr":"172.21.15.60:6823/1789465659","state":["exists","up"]},{"osd":1,"uuid":"64be7b84-36fc-43c0-9e70-a617e5b68941","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6811","nonce":1109822408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6813","nonce":1109822408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6817","nonce":1109822408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6815","nonce":1109822408}]},"public_addr":"172.21.15.60:6811/1109822408","cluster_addr":"172.21.15.60:6813/1109822408","heartbeat_back_addr":"172.21.15.60:6817/1109822408","heartbeat_front_addr":"172.21.15.60:6815/1109822408","state":["exists","up"]},{"osd":2,"uuid":"df00caa1-d45e-4b87-ac1e-8bc098d509d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6827","nonce":278470077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6829","nonce":278470077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6833","nonce":278470077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6831","nonce":278470077}]},"public_addr":"172.21.15.60:6827/278470077","cluster_addr":"172.21.15.60:6829/278470077","heartbeat_back_addr":"172.21.15.60:6833/278470077","heartbeat_front_addr":"172.21.15.60:6831/278470077","state":["exists","up"]},{"osd":3,"uuid":"f6453471-893a-490b-b0c7-f196a0f574e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6803","nonce":3606424156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6805","nonce":3606424156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6809","nonce":3606424156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6807","nonce":3606424156}]},"public_addr":"172.21.15.60:6803/3606424156","cluster_addr":"172.21.15.60:6805/3606424156","heartbeat_back_addr":"172.21.15.60:6809/3606424156","heartbeat_front_addr":"172.21.15.60:6807/3606424156","state":["exists","up"]},{"osd":4,"uuid":"96e908b6-ce3e-466c-b02d-08fc71a1dba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6809","nonce":1581641129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6811","nonce":1581641129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6815","nonce":1581641129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6813","nonce":1581641129}]},"public_addr":"172.21.15.105:6809/1581641129","cluster_addr":"172.21.15.105:6811/1581641129","heartbeat_back_addr":"172.21.15.105:6815/1581641129","heartbeat_front_addr":"172.21.15.105:6813/1581641129","state":["exists","up"]},{"osd":5,"uuid":"7ebc26f0-a462-4364-9303-7351f7cba21f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6825","nonce":1392337793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6827","nonce":1392337793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6831","nonce":1392337793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6829","nonce":1392337793}]},"public_addr":"172.21.15.105:6825/1392337793","cluster_addr":"172.21.15.105:6827/1392337793","heartbeat_back_addr":"172.21.15.105:6831/1392337793","heartbeat_front_addr":"172.21.15.105:6829/1392337793","state":["exists","up"]},{"osd":6,"uuid":"49487ea1-9c6d-4090-bbcc-f28b33040eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6801","nonce":50951309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6803","nonce":50951309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6807","nonce":50951309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6805","nonce":50951309}]},"public_addr":"172.21.15.105:6801/50951309","cluster_addr":"172.21.15.105:6803/50951309","heartbeat_back_addr":"172.21.15.105:6807/50951309","heartbeat_front_addr":"172.21.15.105:6805/50951309","state":["exists","up"]},{"osd":7,"uuid":"1e3a0aa9-7e29-4785-8506-6b5d3be2be35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6817","nonce":3745331251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6819","nonce":3745331251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6823","nonce":3745331251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6821","nonce":3745331251}]},"public_addr":"172.21.15.105:6817/3745331251","cluster_addr":"172.21.15.105:6819/3745331251","heartbeat_back_addr":"172.21.15.105:6823/3745331251","heartbeat_front_addr":"172.21.15.105:6821/3745331251","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:50.112629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.307689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.542851+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.334773+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:50.096967+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:50.259633+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.888988+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.917421+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:23:17.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.474+0000 7fea6faa6640 1 -- 172.21.15.60:0/510144136 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fea4c06be60 msgr2=0x7fea4c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:17.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.474+0000 7fea6faa6640 1 --2- 172.21.15.60:0/510144136 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fea4c06be60 0x7fea4c06e320 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fea64004ea0 tx=0x7fea64009040 comp rx=0 tx=0).stop 2024-09-12T02:23:17.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.474+0000 7fea6faa6640 1 -- 172.21.15.60:0/510144136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea68153910 msgr2=0x7fea681ef250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:17.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.474+0000 7fea6faa6640 1 --2- 172.21.15.60:0/510144136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea68153910 0x7fea681ef250 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fea5800c430 tx=0x7fea5800c8f0 comp rx=0 tx=0).stop 2024-09-12T02:23:17.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.474+0000 7fea6faa6640 1 -- 172.21.15.60:0/510144136 shutdown_connections 2024-09-12T02:23:17.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.474+0000 7fea6faa6640 1 --2- 172.21.15.60:0/510144136 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fea4c06be60 0x7fea4c06e320 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:17.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.474+0000 7fea6faa6640 1 --2- 172.21.15.60:0/510144136 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea680c31f0 0x7fea680c2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:17.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.474+0000 7fea6faa6640 1 --2- 172.21.15.60:0/510144136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea68153910 0x7fea681ef250 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:17.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.474+0000 7fea6faa6640 1 --2- 172.21.15.60:0/510144136 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea681505f0 0x7fea680c17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:17.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.474+0000 7fea6faa6640 1 -- 172.21.15.60:0/510144136 >> 172.21.15.60:0/510144136 conn(0x7fea680c7a40 msgr2=0x7fea680c4090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:17.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.474+0000 7fea6faa6640 1 -- 172.21.15.60:0/510144136 shutdown_connections 2024-09-12T02:23:17.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.474+0000 7fea6faa6640 1 -- 172.21.15.60:0/510144136 wait complete. 2024-09-12T02:23:17.486 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set b standby_count_wanted 0 2024-09-12T02:23:17.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.590+0000 7f9131cac640 1 Processor -- start 2024-09-12T02:23:17.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.590+0000 7f9131cac640 1 -- start start 2024-09-12T02:23:17.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.591+0000 7f9131cac640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f912c0a6f60 0x7f912c0c6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:17.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.591+0000 7f9131cac640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f912c0c6f90 0x7f912c0c2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:17.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.591+0000 7f9131cac640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f912c0c2560 con 0x7f912c1506f0 2024-09-12T02:23:17.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.591+0000 7f9131cac640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f912c156cf0 con 0x7f912c0a6f60 2024-09-12T02:23:17.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.591+0000 7f9131cac640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f912c156fd0 con 0x7f912c0c6f90 2024-09-12T02:23:17.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.591+0000 7f912b7fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f912c1506f0 0x7f912c1564a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55664/0 (socket says 172.21.15.60:55664) 2024-09-12T02:23:17.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.591+0000 7f912b7fe640 1 -- 172.21.15.60:0/3297521280 learned_addr learned my addr 172.21.15.60:0/3297521280 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:17.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.591+0000 7f912bfff640 1 --2- 172.21.15.60:0/3297521280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f912c0c6f90 0x7f912c0c2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:17.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.591+0000 7f912affd640 1 --2- 172.21.15.60:0/3297521280 >> v2:172.21.15.105:3300/0 conn(0x7f912c0a6f60 0x7f912c0c6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:17.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.591+0000 7f912a7fc640 1 -- 172.21.15.60:0/3297521280 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3490245540 0 0) 0x7f912c0c2560 con 0x7f912c1506f0 2024-09-12T02:23:17.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.591+0000 7f912a7fc640 1 -- 172.21.15.60:0/3297521280 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9114003520 con 0x7f912c1506f0 2024-09-12T02:23:17.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.591+0000 7f912a7fc640 1 -- 172.21.15.60:0/3297521280 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 415104558 0 0) 0x7f9114003520 con 0x7f912c1506f0 2024-09-12T02:23:17.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.591+0000 7f912a7fc640 1 -- 172.21.15.60:0/3297521280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f912c0c6f90 msgr2=0x7f912c0c2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:17.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.591+0000 7f912a7fc640 1 --2- 172.21.15.60:0/3297521280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f912c0c6f90 0x7f912c0c2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:17.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.591+0000 7f912a7fc640 1 -- 172.21.15.60:0/3297521280 >> v2:172.21.15.105:3300/0 conn(0x7f912c0a6f60 msgr2=0x7f912c0c6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:17.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.591+0000 7f912a7fc640 1 --2- 172.21.15.60:0/3297521280 >> v2:172.21.15.105:3300/0 conn(0x7f912c0a6f60 0x7f912c0c6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:17.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.591+0000 7f912a7fc640 1 -- 172.21.15.60:0/3297521280 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f912c1572b0 con 0x7f912c1506f0 2024-09-12T02:23:17.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.591+0000 7f912a7fc640 1 -- 172.21.15.60:0/3297521280 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7f911c001670 con 0x7f912c1506f0 2024-09-12T02:23:17.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.591+0000 7f912a7fc640 1 -- 172.21.15.60:0/3297521280 >> v1:172.21.15.60:6789/0 conn(0x7f912c1506f0 legacy=0x7f912c1564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:17.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.591+0000 7f912a7fc640 1 --2- 172.21.15.60:0/3297521280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91140039b0 0x7f9114003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:17.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.591+0000 7f912a7fc640 1 --2- 172.21.15.60:0/3297521280 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9114004800 0x7f9114004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:17.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.591+0000 7f912a7fc640 1 --2- 172.21.15.60:0/3297521280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f912c0c6f90 0x7f9114005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:17.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.591+0000 7f912a7fc640 1 -- 172.21.15.60:0/3297521280 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f912c156cf0 con 0x7f91140039b0 2024-09-12T02:23:17.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.591+0000 7f912a7fc640 1 -- 172.21.15.60:0/3297521280 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f912c156fd0 con 0x7f9114004800 2024-09-12T02:23:17.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.592+0000 7f912a7fc640 1 -- 172.21.15.60:0/3297521280 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f911400bc30 con 0x7f912c0c6f90 2024-09-12T02:23:17.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.592+0000 7f912affd640 1 --2- 172.21.15.60:0/3297521280 >> v2:172.21.15.105:3300/0 conn(0x7f912c0a6f60 0x7f912c0c6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:23:17.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.592+0000 7f912b7fe640 1 --2- 172.21.15.60:0/3297521280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91140039b0 0x7f9114003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:17.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.592+0000 7f912bfff640 1 --2- 172.21.15.60:0/3297521280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f912c0c6f90 0x7f9114005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:17.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.592+0000 7f912affd640 1 --2- 172.21.15.60:0/3297521280 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9114004800 0x7f9114004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:17.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.592+0000 7f912b7fe640 1 -- 172.21.15.60:0/3297521280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f912c0c6f90 msgr2=0x7f9114005290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:17.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.592+0000 7f912b7fe640 1 --2- 172.21.15.60:0/3297521280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f912c0c6f90 0x7f9114005290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:17.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.592+0000 7f912b7fe640 1 -- 172.21.15.60:0/3297521280 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9114004800 msgr2=0x7f9114004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:17.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.592+0000 7f912b7fe640 1 --2- 172.21.15.60:0/3297521280 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9114004800 0x7f9114004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:17.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.592+0000 7f912b7fe640 1 -- 172.21.15.60:0/3297521280 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9114003520 con 0x7f91140039b0 2024-09-12T02:23:17.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.592+0000 7f912affd640 1 --2- 172.21.15.60:0/3297521280 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9114004800 0x7f9114004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:23:17.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.593+0000 7f912b7fe640 1 --2- 172.21.15.60:0/3297521280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91140039b0 0x7f9114003dd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f911c00c190 tx=0x7f9114005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b801e364283fd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:17.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.593+0000 7f912a7fc640 1 -- 172.21.15.60:0/3297521280 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f911c007c80 con 0x7f91140039b0 2024-09-12T02:23:17.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.593+0000 7f912a7fc640 1 -- 172.21.15.60:0/3297521280 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f911c005ad0 con 0x7f91140039b0 2024-09-12T02:23:17.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.593+0000 7f912a7fc640 1 -- 172.21.15.60:0/3297521280 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f911c007070 con 0x7f91140039b0 2024-09-12T02:23:17.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.593+0000 7f9131cac640 1 -- 172.21.15.60:0/3297521280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91140039b0 msgr2=0x7f9114003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:17.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.593+0000 7f9131cac640 1 --2- 172.21.15.60:0/3297521280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91140039b0 0x7f9114003dd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f911c00c190 tx=0x7f9114005830 comp rx=0 tx=0).stop 2024-09-12T02:23:17.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.593+0000 7f912bfff640 1 -- 172.21.15.60:0/3297521280 reap_dead start 2024-09-12T02:23:17.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.593+0000 7f9131cac640 1 -- 172.21.15.60:0/3297521280 shutdown_connections 2024-09-12T02:23:17.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.593+0000 7f9131cac640 1 -- 172.21.15.60:0/3297521280 >> 172.21.15.60:0/3297521280 conn(0x7f912c06c210 msgr2=0x7f912c0c7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:17.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.593+0000 7f9131cac640 1 -- 172.21.15.60:0/3297521280 shutdown_connections 2024-09-12T02:23:17.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.593+0000 7f9131cac640 1 -- 172.21.15.60:0/3297521280 wait complete. 2024-09-12T02:23:17.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.594+0000 7f9131cac640 1 Processor -- start 2024-09-12T02:23:17.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.595+0000 7f9131cac640 1 -- start start 2024-09-12T02:23:17.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.595+0000 7f9131cac640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91140039b0 0x7f912c1558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:17.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.595+0000 7f9131cac640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f912c1456a0 0x7f912c0c10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:17.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.595+0000 7f9131cac640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f912c146f30 0x7f912c144090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:17.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.595+0000 7f9131cac640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f912c150ad0 con 0x7f91140039b0 2024-09-12T02:23:17.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.595+0000 7f9131cac640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f912c0c3cd0 con 0x7f912c1456a0 2024-09-12T02:23:17.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.595+0000 7f9131cac640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f912c0c2d20 con 0x7f912c146f30 2024-09-12T02:23:17.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.595+0000 7f912b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91140039b0 0x7f912c1558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:17.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.596+0000 7f912b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91140039b0 0x7f912c1558c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38262/0 (socket says 172.21.15.60:38262) 2024-09-12T02:23:17.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.596+0000 7f912b7fe640 1 -- 172.21.15.60:0/1472629288 learned_addr learned my addr 172.21.15.60:0/1472629288 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:17.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.596+0000 7f912affd640 1 --2- 172.21.15.60:0/1472629288 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f912c1456a0 0x7f912c0c10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:17.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.596+0000 7f912bfff640 1 --2- 172.21.15.60:0/1472629288 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f912c146f30 0x7f912c144090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:17.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.596+0000 7f912b7fe640 1 -- 172.21.15.60:0/1472629288 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f912c146f30 msgr2=0x7f912c144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:17.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.596+0000 7f912b7fe640 1 --2- 172.21.15.60:0/1472629288 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f912c146f30 0x7f912c144090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:17.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.596+0000 7f912b7fe640 1 -- 172.21.15.60:0/1472629288 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f912c1456a0 msgr2=0x7f912c0c10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:17.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.596+0000 7f912b7fe640 1 --2- 172.21.15.60:0/1472629288 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f912c1456a0 0x7f912c0c10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:17.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.596+0000 7f912b7fe640 1 -- 172.21.15.60:0/1472629288 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f912c0ac1a0 con 0x7f91140039b0 2024-09-12T02:23:17.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.596+0000 7f912b7fe640 1 --2- 172.21.15.60:0/1472629288 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91140039b0 0x7f912c1558c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f911c02acd0 tx=0x7f912c06e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:17.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.596+0000 7f9113fff640 1 -- 172.21.15.60:0/1472629288 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f911c040020 con 0x7f91140039b0 2024-09-12T02:23:17.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.596+0000 7f9113fff640 1 -- 172.21.15.60:0/1472629288 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f911c0013b0 con 0x7f91140039b0 2024-09-12T02:23:17.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.596+0000 7f9131cac640 1 -- 172.21.15.60:0/1472629288 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f912c0ac480 con 0x7f91140039b0 2024-09-12T02:23:17.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.596+0000 7f9113fff640 1 -- 172.21.15.60:0/1472629288 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f911c037040 con 0x7f91140039b0 2024-09-12T02:23:17.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.596+0000 7f9131cac640 1 -- 172.21.15.60:0/1472629288 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f912c1553a0 con 0x7f91140039b0 2024-09-12T02:23:17.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.597+0000 7f9131cac640 1 -- 172.21.15.60:0/1472629288 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f912c0c6a50 con 0x7f91140039b0 2024-09-12T02:23:17.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.598+0000 7f9113fff640 1 -- 172.21.15.60:0/1472629288 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f911c043020 con 0x7f91140039b0 2024-09-12T02:23:17.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.598+0000 7f9113fff640 1 --2- 172.21.15.60:0/1472629288 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f911806be30 0x7f911806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:17.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.598+0000 7f9113fff640 1 -- 172.21.15.60:0/1472629288 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f911c0aa9d0 con 0x7f91140039b0 2024-09-12T02:23:17.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.598+0000 7f912affd640 1 --2- 172.21.15.60:0/1472629288 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f911806be30 0x7f911806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:17.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.599+0000 7f912affd640 1 --2- 172.21.15.60:0/1472629288 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f911806be30 0x7f911806e2f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f912c148040 tx=0x7f9120008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:17.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.602+0000 7f9113fff640 1 -- 172.21.15.60:0/1472629288 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f911c005aa0 con 0x7f91140039b0 2024-09-12T02:23:17.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.819+0000 7f9131cac640 1 -- 172.21.15.60:0/1472629288 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "b", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f912c0c6a50 con 0x7f91140039b0 2024-09-12T02:23:17.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.841+0000 7f9113fff640 1 -- 172.21.15.60:0/1472629288 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "b", "var": "standby_count_wanted", "val": "0"}]=0 v9) ==== 113+0+0 (secure 0 0 0) 0x7f911c078a30 con 0x7f91140039b0 2024-09-12T02:23:17.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.843+0000 7f9131cac640 1 -- 172.21.15.60:0/1472629288 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f911806be30 msgr2=0x7f911806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:17.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.843+0000 7f9131cac640 1 --2- 172.21.15.60:0/1472629288 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f911806be30 0x7f911806e2f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f912c148040 tx=0x7f9120008040 comp rx=0 tx=0).stop 2024-09-12T02:23:17.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.843+0000 7f9131cac640 1 -- 172.21.15.60:0/1472629288 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91140039b0 msgr2=0x7f912c1558c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:17.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.843+0000 7f9131cac640 1 --2- 172.21.15.60:0/1472629288 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91140039b0 0x7f912c1558c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f911c02acd0 tx=0x7f912c06e960 comp rx=0 tx=0).stop 2024-09-12T02:23:17.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.843+0000 7f9131cac640 1 -- 172.21.15.60:0/1472629288 shutdown_connections 2024-09-12T02:23:17.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.843+0000 7f9131cac640 1 --2- 172.21.15.60:0/1472629288 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f911806be30 0x7f911806e2f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:17.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.843+0000 7f9131cac640 1 --2- 172.21.15.60:0/1472629288 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f912c146f30 0x7f912c144090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:17.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.843+0000 7f9131cac640 1 --2- 172.21.15.60:0/1472629288 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f912c1456a0 0x7f912c0c10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:17.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.843+0000 7f9131cac640 1 --2- 172.21.15.60:0/1472629288 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91140039b0 0x7f912c1558c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:17.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.843+0000 7f9131cac640 1 -- 172.21.15.60:0/1472629288 >> 172.21.15.60:0/1472629288 conn(0x7f912c06c210 msgr2=0x7f912c14b370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:17.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.843+0000 7f9131cac640 1 -- 172.21.15.60:0/1472629288 shutdown_connections 2024-09-12T02:23:17.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.843+0000 7f9131cac640 1 -- 172.21.15.60:0/1472629288 wait complete. 2024-09-12T02:23:17.854 DEBUG:tasks.cephfs.filesystem:fs_config: {'session_timeout': 300} 2024-09-12T02:23:17.855 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set b allow_standby_replay false 2024-09-12T02:23:17.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.960+0000 7f24a2198640 1 Processor -- start 2024-09-12T02:23:17.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.960+0000 7f24a2198640 1 -- start start 2024-09-12T02:23:17.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.961+0000 7f24a2198640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f249c0bf410 0x7f249c0b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:17.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.961+0000 7f24a2198640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f249c157310 con 0x7f249c153ac0 2024-09-12T02:23:17.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.961+0000 7f24a2198640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f249c0683f0 con 0x7f249c0ab370 2024-09-12T02:23:17.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.961+0000 7f24a2198640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f249c156de0 con 0x7f249c0bf410 2024-09-12T02:23:17.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.961+0000 7f249affd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f249c0bf410 0x7f249c0b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:17.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.961+0000 7f249b7fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f249c153ac0 0x7f249c0c66c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55670/0 (socket says 172.21.15.60:55670) 2024-09-12T02:23:17.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.961+0000 7f249b7fe640 1 -- 172.21.15.60:0/485321583 learned_addr learned my addr 172.21.15.60:0/485321583 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:17.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.961+0000 7f249affd640 1 -- 172.21.15.60:0/485321583 >> v1:172.21.15.105:6789/0 conn(0x7f249c0ab370 legacy=0x7f249c0b1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:17.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.961+0000 7f249affd640 1 -- 172.21.15.60:0/485321583 >> v1:172.21.15.60:6789/0 conn(0x7f249c153ac0 legacy=0x7f249c0c66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:17.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.961+0000 7f249affd640 1 -- 172.21.15.60:0/485321583 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f249c157030 con 0x7f249c0bf410 2024-09-12T02:23:17.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.962+0000 7f249affd640 1 --2- 172.21.15.60:0/485321583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f249c0bf410 0x7f249c0b0c50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f24900097a0 tx=0x7f249002a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7106b79d1c1483c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:17.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.962+0000 7f249a7fc640 1 -- 172.21.15.60:0/485321583 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2490037070 con 0x7f249c0bf410 2024-09-12T02:23:17.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.962+0000 7f249a7fc640 1 -- 172.21.15.60:0/485321583 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f249002adc0 con 0x7f249c0bf410 2024-09-12T02:23:17.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.962+0000 7f249a7fc640 1 -- 172.21.15.60:0/485321583 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2490032660 con 0x7f249c0bf410 2024-09-12T02:23:17.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.962+0000 7f24a2198640 1 -- 172.21.15.60:0/485321583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f249c0bf410 msgr2=0x7f249c0b0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:17.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.962+0000 7f24a2198640 1 --2- 172.21.15.60:0/485321583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f249c0bf410 0x7f249c0b0c50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f24900097a0 tx=0x7f249002a0b0 comp rx=0 tx=0).stop 2024-09-12T02:23:17.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.962+0000 7f24a2198640 1 -- 172.21.15.60:0/485321583 shutdown_connections 2024-09-12T02:23:17.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.962+0000 7f24a2198640 1 --2- 172.21.15.60:0/485321583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f249c0bf410 0x7f249c0b0c50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:17.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.962+0000 7f24a2198640 1 -- 172.21.15.60:0/485321583 >> 172.21.15.60:0/485321583 conn(0x7f249c0c87c0 msgr2=0x7f249c0c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:17.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.962+0000 7f24a2198640 1 -- 172.21.15.60:0/485321583 shutdown_connections 2024-09-12T02:23:17.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.963+0000 7f24a2198640 1 -- 172.21.15.60:0/485321583 wait complete. 2024-09-12T02:23:17.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.964+0000 7f24a2198640 1 Processor -- start 2024-09-12T02:23:17.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.964+0000 7f24a2198640 1 -- start start 2024-09-12T02:23:17.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.964+0000 7f24a2198640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f249c0ab370 0x7f249c0aa380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:17.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.964+0000 7f24a2198640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f249c0bf410 0x7f249c1e15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:17.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.964+0000 7f24a2198640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f249c153ac0 0x7f249c14e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:17.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.964+0000 7f24a2198640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f249c0c6dd0 con 0x7f249c153ac0 2024-09-12T02:23:17.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.964+0000 7f24a2198640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f249c0ca050 con 0x7f249c0ab370 2024-09-12T02:23:17.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.964+0000 7f24a2198640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f249c0c6f50 con 0x7f249c0bf410 2024-09-12T02:23:17.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.965+0000 7f249bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f249c153ac0 0x7f249c14e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:17.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.965+0000 7f249bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f249c153ac0 0x7f249c14e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38272/0 (socket says 172.21.15.60:38272) 2024-09-12T02:23:17.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.965+0000 7f249bfff640 1 -- 172.21.15.60:0/3261496473 learned_addr learned my addr 172.21.15.60:0/3261496473 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:17.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.965+0000 7f249b7fe640 1 --2- 172.21.15.60:0/3261496473 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f249c0ab370 0x7f249c0aa380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:17.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.965+0000 7f249affd640 1 --2- 172.21.15.60:0/3261496473 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f249c0bf410 0x7f249c1e15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:17.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.965+0000 7f249bfff640 1 -- 172.21.15.60:0/3261496473 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f249c0bf410 msgr2=0x7f249c1e15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:17.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.965+0000 7f249bfff640 1 --2- 172.21.15.60:0/3261496473 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f249c0bf410 0x7f249c1e15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:17.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.965+0000 7f249bfff640 1 -- 172.21.15.60:0/3261496473 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f249c0ab370 msgr2=0x7f249c0aa380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:17.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.965+0000 7f249bfff640 1 --2- 172.21.15.60:0/3261496473 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f249c0ab370 0x7f249c0aa380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:17.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.965+0000 7f249bfff640 1 -- 172.21.15.60:0/3261496473 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f249c0aa8c0 con 0x7f249c153ac0 2024-09-12T02:23:17.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.965+0000 7f249bfff640 1 --2- 172.21.15.60:0/3261496473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f249c153ac0 0x7f249c14e9a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f249400ba10 tx=0x7f249400bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:17.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.965+0000 7f2483fff640 1 -- 172.21.15.60:0/3261496473 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2494019070 con 0x7f249c153ac0 2024-09-12T02:23:17.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.965+0000 7f2483fff640 1 -- 172.21.15.60:0/3261496473 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f249400cb40 con 0x7f249c153ac0 2024-09-12T02:23:17.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.965+0000 7f24a2198640 1 -- 172.21.15.60:0/3261496473 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f249c1ecf70 con 0x7f249c153ac0 2024-09-12T02:23:17.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.965+0000 7f2483fff640 1 -- 172.21.15.60:0/3261496473 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2494014440 con 0x7f249c153ac0 2024-09-12T02:23:17.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.965+0000 7f24a2198640 1 -- 172.21.15.60:0/3261496473 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f249c14cd80 con 0x7f249c153ac0 2024-09-12T02:23:17.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.966+0000 7f24a2198640 1 -- 172.21.15.60:0/3261496473 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f249c153ea0 con 0x7f249c153ac0 2024-09-12T02:23:17.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.967+0000 7f2483fff640 1 -- 172.21.15.60:0/3261496473 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f249401c070 con 0x7f249c153ac0 2024-09-12T02:23:17.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.967+0000 7f2483fff640 1 --2- 172.21.15.60:0/3261496473 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f248806be30 0x7f248806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:17.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.967+0000 7f2483fff640 1 -- 172.21.15.60:0/3261496473 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f249408ac20 con 0x7f249c153ac0 2024-09-12T02:23:17.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.967+0000 7f249b7fe640 1 --2- 172.21.15.60:0/3261496473 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f248806be30 0x7f248806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:17.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.968+0000 7f249b7fe640 1 --2- 172.21.15.60:0/3261496473 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f248806be30 0x7f248806e2f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f248c007fd0 tx=0x7f248c007e80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:17.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:17.972+0000 7f2483fff640 1 -- 172.21.15.60:0/3261496473 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2494058ce0 con 0x7f249c153ac0 2024-09-12T02:23:18.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.184+0000 7f24a2198640 1 -- 172.21.15.60:0/3261496473 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "b", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f249c154520 con 0x7f249c153ac0 2024-09-12T02:23:18.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.845+0000 7f2483fff640 1 -- 172.21.15.60:0/3261496473 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "b", "var": "allow_standby_replay", "val": "false"}]=0 v10) ==== 117+0+0 (secure 0 0 0) 0x7f249405cfe0 con 0x7f249c153ac0 2024-09-12T02:23:18.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.848+0000 7f24a2198640 1 -- 172.21.15.60:0/3261496473 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f248806be30 msgr2=0x7f248806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:18.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.848+0000 7f24a2198640 1 --2- 172.21.15.60:0/3261496473 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f248806be30 0x7f248806e2f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f248c007fd0 tx=0x7f248c007e80 comp rx=0 tx=0).stop 2024-09-12T02:23:18.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.848+0000 7f24a2198640 1 -- 172.21.15.60:0/3261496473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f249c153ac0 msgr2=0x7f249c14e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:18.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.848+0000 7f24a2198640 1 --2- 172.21.15.60:0/3261496473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f249c153ac0 0x7f249c14e9a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f249400ba10 tx=0x7f249400bed0 comp rx=0 tx=0).stop 2024-09-12T02:23:18.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.848+0000 7f24a2198640 1 -- 172.21.15.60:0/3261496473 shutdown_connections 2024-09-12T02:23:18.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.848+0000 7f24a2198640 1 --2- 172.21.15.60:0/3261496473 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f248806be30 0x7f248806e2f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:18.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.848+0000 7f24a2198640 1 --2- 172.21.15.60:0/3261496473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f249c153ac0 0x7f249c14e9a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:18.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.848+0000 7f24a2198640 1 --2- 172.21.15.60:0/3261496473 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f249c0bf410 0x7f249c1e15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:18.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.848+0000 7f24a2198640 1 --2- 172.21.15.60:0/3261496473 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f249c0ab370 0x7f249c0aa380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:18.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.848+0000 7f24a2198640 1 -- 172.21.15.60:0/3261496473 >> 172.21.15.60:0/3261496473 conn(0x7f249c0c87c0 msgr2=0x7f249c152320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:18.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.848+0000 7f24a2198640 1 -- 172.21.15.60:0/3261496473 shutdown_connections 2024-09-12T02:23:18.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.848+0000 7f24a2198640 1 -- 172.21.15.60:0/3261496473 wait complete. 2024-09-12T02:23:18.861 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set b session_timeout 300 2024-09-12T02:23:18.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.968+0000 7ff656c5e640 1 Processor -- start 2024-09-12T02:23:18.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.968+0000 7ff656c5e640 1 -- start start 2024-09-12T02:23:18.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.969+0000 7ff656c5e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff650153a40 0x7ff65006c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:18.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.969+0000 7ff656c5e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff650156310 0x7ff6501567c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:18.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.969+0000 7ff656c5e640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff650159900 con 0x7ff65006cbe0 2024-09-12T02:23:18.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.969+0000 7ff656c5e640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff650159be0 con 0x7ff650156310 2024-09-12T02:23:18.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.969+0000 7ff656c5e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff650159ec0 con 0x7ff650153a40 2024-09-12T02:23:18.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.969+0000 7ff6551fb640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff650156310 0x7ff6501567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:18.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.969+0000 7ff6549fa640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff650153a40 0x7ff65006c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:18.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.969+0000 7ff64ffff640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7ff65006cbe0 0x7ff6500c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:35364/0 (socket says 172.21.15.60:35364) 2024-09-12T02:23:18.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.969+0000 7ff6551fb640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff650156310 0x7ff6501567c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:56498/0 (socket says 172.21.15.60:56498) 2024-09-12T02:23:18.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.969+0000 7ff6549fa640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff650153a40 0x7ff65006c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:50552/0 (socket says 172.21.15.60:50552) 2024-09-12T02:23:18.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.969+0000 7ff64ffff640 1 -- 172.21.15.60:0/3634203382 learned_addr learned my addr 172.21.15.60:0/3634203382 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:18.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.970+0000 7ff6549fa640 1 -- 172.21.15.60:0/3634203382 >> v2:172.21.15.105:3300/0 conn(0x7ff650156310 msgr2=0x7ff6501567c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:18.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.970+0000 7ff6549fa640 1 --2- 172.21.15.60:0/3634203382 >> v2:172.21.15.105:3300/0 conn(0x7ff650156310 0x7ff6501567c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:18.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.970+0000 7ff6549fa640 1 -- 172.21.15.60:0/3634203382 >> v1:172.21.15.105:6789/0 conn(0x7ff65006cbe0 legacy=0x7ff6500c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:18.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.970+0000 7ff6549fa640 1 -- 172.21.15.60:0/3634203382 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff65015a1a0 con 0x7ff650153a40 2024-09-12T02:23:18.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.970+0000 7ff6551fb640 1 --2- 172.21.15.60:0/3634203382 >> v2:172.21.15.105:3300/0 conn(0x7ff650156310 0x7ff6501567c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:23:18.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.971+0000 7ff6549fa640 1 --2- 172.21.15.60:0/3634203382 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff650153a40 0x7ff65006c6a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff648009d90 tx=0x7ff64802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=227278b788dd722d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:18.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.971+0000 7ff64f7fe640 1 -- 172.21.15.60:0/3634203382 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff648007740 con 0x7ff650153a40 2024-09-12T02:23:18.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.971+0000 7ff64f7fe640 1 -- 172.21.15.60:0/3634203382 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6480078e0 con 0x7ff650153a40 2024-09-12T02:23:18.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.971+0000 7ff64f7fe640 1 -- 172.21.15.60:0/3634203382 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff648007cb0 con 0x7ff650153a40 2024-09-12T02:23:18.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.971+0000 7ff656c5e640 1 -- 172.21.15.60:0/3634203382 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff650153a40 msgr2=0x7ff65006c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:18.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.971+0000 7ff656c5e640 1 --2- 172.21.15.60:0/3634203382 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff650153a40 0x7ff65006c6a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff648009d90 tx=0x7ff64802a660 comp rx=0 tx=0).stop 2024-09-12T02:23:18.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.971+0000 7ff656c5e640 1 -- 172.21.15.60:0/3634203382 shutdown_connections 2024-09-12T02:23:18.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.971+0000 7ff656c5e640 1 --2- 172.21.15.60:0/3634203382 >> v2:172.21.15.105:3300/0 conn(0x7ff650156310 0x7ff6501567c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:18.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.971+0000 7ff656c5e640 1 --2- 172.21.15.60:0/3634203382 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff650153a40 0x7ff65006c6a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:18.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.971+0000 7ff656c5e640 1 -- 172.21.15.60:0/3634203382 >> 172.21.15.60:0/3634203382 conn(0x7ff650073310 msgr2=0x7ff6500736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:18.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.972+0000 7ff656c5e640 1 -- 172.21.15.60:0/3634203382 shutdown_connections 2024-09-12T02:23:18.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.972+0000 7ff656c5e640 1 -- 172.21.15.60:0/3634203382 wait complete. 2024-09-12T02:23:18.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.973+0000 7ff656c5e640 1 Processor -- start 2024-09-12T02:23:18.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.973+0000 7ff656c5e640 1 -- start start 2024-09-12T02:23:18.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.973+0000 7ff656c5e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff65006cbe0 0x7ff6500ac9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:18.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.973+0000 7ff656c5e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff650153a40 0x7ff6501ec5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:18.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.973+0000 7ff656c5e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff650156310 0x7ff6501ecb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:18.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.973+0000 7ff656c5e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff650153e20 con 0x7ff650153a40 2024-09-12T02:23:18.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.973+0000 7ff656c5e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff6500c9270 con 0x7ff650156310 2024-09-12T02:23:18.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.973+0000 7ff656c5e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff650153fa0 con 0x7ff65006cbe0 2024-09-12T02:23:18.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.974+0000 7ff64ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff650153a40 0x7ff6501ec5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:18.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.974+0000 7ff64ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff650153a40 0x7ff6501ec5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38276/0 (socket says 172.21.15.60:38276) 2024-09-12T02:23:18.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.974+0000 7ff64ffff640 1 -- 172.21.15.60:0/2213183224 learned_addr learned my addr 172.21.15.60:0/2213183224 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:18.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.974+0000 7ff6551fb640 1 --2- 172.21.15.60:0/2213183224 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff650156310 0x7ff6501ecb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:18.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.974+0000 7ff6549fa640 1 --2- 172.21.15.60:0/2213183224 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff65006cbe0 0x7ff6500ac9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:18.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.974+0000 7ff64ffff640 1 -- 172.21.15.60:0/2213183224 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff65006cbe0 msgr2=0x7ff6500ac9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:18.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.974+0000 7ff64ffff640 1 --2- 172.21.15.60:0/2213183224 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff65006cbe0 0x7ff6500ac9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:18.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.974+0000 7ff64ffff640 1 -- 172.21.15.60:0/2213183224 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff650156310 msgr2=0x7ff6501ecb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:18.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.974+0000 7ff64ffff640 1 --2- 172.21.15.60:0/2213183224 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff650156310 0x7ff6501ecb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:18.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.974+0000 7ff64ffff640 1 -- 172.21.15.60:0/2213183224 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6500ad6e0 con 0x7ff650153a40 2024-09-12T02:23:18.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.974+0000 7ff64ffff640 1 --2- 172.21.15.60:0/2213183224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff650153a40 0x7ff6501ec5f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff64000c470 tx=0x7ff64000c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:18.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.974+0000 7ff64d7fa640 1 -- 172.21.15.60:0/2213183224 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff640017070 con 0x7ff650153a40 2024-09-12T02:23:18.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.974+0000 7ff64d7fa640 1 -- 172.21.15.60:0/2213183224 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff640005ce0 con 0x7ff650153a40 2024-09-12T02:23:18.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.974+0000 7ff656c5e640 1 -- 172.21.15.60:0/2213183224 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6500b0a80 con 0x7ff650153a40 2024-09-12T02:23:18.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.974+0000 7ff64d7fa640 1 -- 172.21.15.60:0/2213183224 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6400072d0 con 0x7ff650153a40 2024-09-12T02:23:18.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.974+0000 7ff656c5e640 1 -- 172.21.15.60:0/2213183224 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6501ec0d0 con 0x7ff650153a40 2024-09-12T02:23:18.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.975+0000 7ff656c5e640 1 -- 172.21.15.60:0/2213183224 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff65006c6a0 con 0x7ff650153a40 2024-09-12T02:23:18.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.976+0000 7ff64d7fa640 1 -- 172.21.15.60:0/2213183224 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff64001a070 con 0x7ff650153a40 2024-09-12T02:23:18.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.976+0000 7ff64d7fa640 1 --2- 172.21.15.60:0/2213183224 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff63006be30 0x7ff63006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:18.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.976+0000 7ff64d7fa640 1 -- 172.21.15.60:0/2213183224 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7ff64008a380 con 0x7ff650153a40 2024-09-12T02:23:18.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.977+0000 7ff6549fa640 1 --2- 172.21.15.60:0/2213183224 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff63006be30 0x7ff63006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:18.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.977+0000 7ff6549fa640 1 --2- 172.21.15.60:0/2213183224 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff63006be30 0x7ff63006e2f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff648034000 tx=0x7ff64802f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:18.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:18.981+0000 7ff64d7fa640 1 -- 172.21.15.60:0/2213183224 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff6400583b0 con 0x7ff650153a40 2024-09-12T02:23:19.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.193+0000 7ff656c5e640 1 -- 172.21.15.60:0/2213183224 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "b", "var": "session_timeout", "val": "300"} v 0) -- 0x7ff650157070 con 0x7ff650153a40 2024-09-12T02:23:19.611 INFO:tasks.ceph.mds.d.smithi105.stderr:2024-09-12T02:23:19.611+0000 7f59d0c3d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:23:19.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.847+0000 7ff64d7fa640 1 -- 172.21.15.60:0/2213183224 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "b", "var": "session_timeout", "val": "300"}]=0 v11) ==== 110+0+0 (secure 0 0 0) 0x7ff64005c6b0 con 0x7ff650153a40 2024-09-12T02:23:19.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.849+0000 7ff656c5e640 1 -- 172.21.15.60:0/2213183224 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff63006be30 msgr2=0x7ff63006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:19.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.849+0000 7ff656c5e640 1 --2- 172.21.15.60:0/2213183224 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff63006be30 0x7ff63006e2f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff648034000 tx=0x7ff64802f000 comp rx=0 tx=0).stop 2024-09-12T02:23:19.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.849+0000 7ff656c5e640 1 -- 172.21.15.60:0/2213183224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff650153a40 msgr2=0x7ff6501ec5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:19.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.849+0000 7ff656c5e640 1 --2- 172.21.15.60:0/2213183224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff650153a40 0x7ff6501ec5f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff64000c470 tx=0x7ff64000c930 comp rx=0 tx=0).stop 2024-09-12T02:23:19.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.850+0000 7ff656c5e640 1 -- 172.21.15.60:0/2213183224 shutdown_connections 2024-09-12T02:23:19.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.850+0000 7ff656c5e640 1 --2- 172.21.15.60:0/2213183224 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff63006be30 0x7ff63006e2f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:19.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.850+0000 7ff656c5e640 1 --2- 172.21.15.60:0/2213183224 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff650156310 0x7ff6501ecb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:19.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.850+0000 7ff656c5e640 1 --2- 172.21.15.60:0/2213183224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff650153a40 0x7ff6501ec5f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:19.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.850+0000 7ff656c5e640 1 --2- 172.21.15.60:0/2213183224 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff65006cbe0 0x7ff6500ac9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:19.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.850+0000 7ff656c5e640 1 -- 172.21.15.60:0/2213183224 >> 172.21.15.60:0/2213183224 conn(0x7ff650073310 msgr2=0x7ff6500c87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:19.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.850+0000 7ff656c5e640 1 -- 172.21.15.60:0/2213183224 shutdown_connections 2024-09-12T02:23:19.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.850+0000 7ff656c5e640 1 -- 172.21.15.60:0/2213183224 wait complete. 2024-09-12T02:23:19.863 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'b' 2024-09-12T02:23:19.863 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:23:19.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.970+0000 7f22068e4640 1 Processor -- start 2024-09-12T02:23:19.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.970+0000 7f22068e4640 1 -- start start 2024-09-12T02:23:19.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.971+0000 7f22068e4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f220006ede0 0x7f2200161ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:19.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.971+0000 7f22068e4640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f220015a830 con 0x7f220015a450 2024-09-12T02:23:19.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.971+0000 7f22068e4640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22000c7490 con 0x7f22000c84e0 2024-09-12T02:23:19.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.971+0000 7f22068e4640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f220006e240 con 0x7f220006ede0 2024-09-12T02:23:19.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.971+0000 7f2204e81640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f220006ede0 0x7f2200161ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:19.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.971+0000 7f21fffff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f220015a450 0x7f22000c3a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53844/0 (socket says 172.21.15.60:53844) 2024-09-12T02:23:19.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.971+0000 7f21fffff640 1 -- 172.21.15.60:0/3582660367 learned_addr learned my addr 172.21.15.60:0/3582660367 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:19.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.972+0000 7f2204e81640 1 -- 172.21.15.60:0/3582660367 >> v1:172.21.15.105:6789/0 conn(0x7f22000c84e0 legacy=0x7f220006e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:19.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.972+0000 7f2204e81640 1 -- 172.21.15.60:0/3582660367 >> v1:172.21.15.60:6789/0 conn(0x7f220015a450 legacy=0x7f22000c3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:19.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.972+0000 7f2204e81640 1 -- 172.21.15.60:0/3582660367 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22000c7770 con 0x7f220006ede0 2024-09-12T02:23:19.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.972+0000 7f2204e81640 1 --2- 172.21.15.60:0/3582660367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f220006ede0 0x7f2200161ca0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f21f8009dc0 tx=0x7f21f802a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adf5edc221c3bfb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:19.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.972+0000 7f21feffd640 1 -- 172.21.15.60:0/3582660367 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f8037070 con 0x7f220006ede0 2024-09-12T02:23:19.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.972+0000 7f21feffd640 1 -- 172.21.15.60:0/3582660367 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21f8007740 con 0x7f220006ede0 2024-09-12T02:23:19.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.972+0000 7f21feffd640 1 -- 172.21.15.60:0/3582660367 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f8007b10 con 0x7f220006ede0 2024-09-12T02:23:19.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.973+0000 7f22068e4640 1 -- 172.21.15.60:0/3582660367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f220006ede0 msgr2=0x7f2200161ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:19.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.973+0000 7f22068e4640 1 --2- 172.21.15.60:0/3582660367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f220006ede0 0x7f2200161ca0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f21f8009dc0 tx=0x7f21f802a7c0 comp rx=0 tx=0).stop 2024-09-12T02:23:19.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.973+0000 7f22068e4640 1 -- 172.21.15.60:0/3582660367 shutdown_connections 2024-09-12T02:23:19.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.973+0000 7f22068e4640 1 --2- 172.21.15.60:0/3582660367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f220006ede0 0x7f2200161ca0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:19.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.973+0000 7f22068e4640 1 -- 172.21.15.60:0/3582660367 >> 172.21.15.60:0/3582660367 conn(0x7f22000c5660 msgr2=0x7f22000c5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:19.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.973+0000 7f22068e4640 1 -- 172.21.15.60:0/3582660367 shutdown_connections 2024-09-12T02:23:19.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.973+0000 7f22068e4640 1 -- 172.21.15.60:0/3582660367 wait complete. 2024-09-12T02:23:19.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.974+0000 7f22068e4640 1 Processor -- start 2024-09-12T02:23:19.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.974+0000 7f22068e4640 1 -- start start 2024-09-12T02:23:19.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.975+0000 7f22068e4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f220006ede0 0x7f22001eff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:19.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.975+0000 7f22068e4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22000c84e0 0x7f22001e0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:19.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.975+0000 7f22068e4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f220015a450 0x7f22001ec000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:19.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.975+0000 7f22068e4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f22000c41a0 con 0x7f220006ede0 2024-09-12T02:23:19.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.975+0000 7f22068e4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f22000c7d30 con 0x7f22000c84e0 2024-09-12T02:23:19.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.975+0000 7f22068e4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f22000c4320 con 0x7f220015a450 2024-09-12T02:23:19.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.975+0000 7f21fffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f220006ede0 0x7f22001eff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:19.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.975+0000 7f21fffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f220006ede0 0x7f22001eff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49602/0 (socket says 172.21.15.60:49602) 2024-09-12T02:23:19.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.975+0000 7f21fffff640 1 -- 172.21.15.60:0/3410915188 learned_addr learned my addr 172.21.15.60:0/3410915188 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:19.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.975+0000 7f2204e81640 1 --2- 172.21.15.60:0/3410915188 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f220015a450 0x7f22001ec000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:19.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.975+0000 7f21ff7fe640 1 --2- 172.21.15.60:0/3410915188 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22000c84e0 0x7f22001e0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:19.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.975+0000 7f21fffff640 1 -- 172.21.15.60:0/3410915188 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f220015a450 msgr2=0x7f22001ec000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:19.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.975+0000 7f21fffff640 1 --2- 172.21.15.60:0/3410915188 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f220015a450 0x7f22001ec000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:19.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.975+0000 7f21fffff640 1 -- 172.21.15.60:0/3410915188 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22000c84e0 msgr2=0x7f22001e0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:19.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.976+0000 7f21fffff640 1 --2- 172.21.15.60:0/3410915188 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22000c84e0 0x7f22001e0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:19.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.976+0000 7f21fffff640 1 -- 172.21.15.60:0/3410915188 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22000ae9f0 con 0x7f220006ede0 2024-09-12T02:23:19.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.976+0000 7f21ff7fe640 1 --2- 172.21.15.60:0/3410915188 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22000c84e0 0x7f22001e0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:23:19.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.976+0000 7f21fffff640 1 --2- 172.21.15.60:0/3410915188 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f220006ede0 0x7f22001eff30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f21f000c480 tx=0x7f21f000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:19.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.976+0000 7f21fcff9640 1 -- 172.21.15.60:0/3410915188 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f0018070 con 0x7f220006ede0 2024-09-12T02:23:19.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.976+0000 7f21fcff9640 1 -- 172.21.15.60:0/3410915188 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21f0005ce0 con 0x7f220006ede0 2024-09-12T02:23:19.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.976+0000 7f22068e4640 1 -- 172.21.15.60:0/3410915188 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22001f0470 con 0x7f220006ede0 2024-09-12T02:23:19.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.976+0000 7f21fcff9640 1 -- 172.21.15.60:0/3410915188 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f00072d0 con 0x7f220006ede0 2024-09-12T02:23:19.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.976+0000 7f22068e4640 1 -- 172.21.15.60:0/3410915188 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2200154d20 con 0x7f220006ede0 2024-09-12T02:23:19.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.977+0000 7f22068e4640 1 -- 172.21.15.60:0/3410915188 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f220006f270 con 0x7f220006ede0 2024-09-12T02:23:19.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.977+0000 7f21fcff9640 1 -- 172.21.15.60:0/3410915188 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f21f001b070 con 0x7f220006ede0 2024-09-12T02:23:19.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.978+0000 7f21fcff9640 1 --2- 172.21.15.60:0/3410915188 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f21ec06be30 0x7f21ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:19.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.978+0000 7f21fcff9640 1 -- 172.21.15.60:0/3410915188 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f21f008a3d0 con 0x7f220006ede0 2024-09-12T02:23:19.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.978+0000 7f21ff7fe640 1 --2- 172.21.15.60:0/3410915188 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f21ec06be30 0x7f21ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:19.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.978+0000 7f21ff7fe640 1 --2- 172.21.15.60:0/3410915188 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f21ec06be30 0x7f21ec06e2f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f21f4001700 tx=0x7f21f4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:19.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:19.982+0000 7f21fcff9640 1 -- 172.21.15.60:0/3410915188 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f21f0058410 con 0x7f220006ede0 2024-09-12T02:23:20.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.197+0000 7f22068e4640 1 -- 172.21.15.60:0/3410915188 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f22000c3660 con 0x7f220006ede0 2024-09-12T02:23:20.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.197+0000 7f21fcff9640 1 -- 172.21.15.60:0/3410915188 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+6524 (secure 0 0 0) 0x7f21f005c710 con 0x7f220006ede0 2024-09-12T02:23:20.198 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:23:20.198 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":11,"btime":"2024-09-12T02:23:19:846521+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3208837169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3208837169},{"type":"v1","addr":"172.21.15.60:6836","nonce":3208837169}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/664538827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":664538827},{"type":"v1","addr":"172.21.15.60:6837","nonce":664538827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:23:04.113913+0000","modified":"2024-09-12T02:23:07.140885+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/2854563525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2854563525},{"type":"v1","addr":"172.21.15.105:6835","nonce":2854563525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1},{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:23:16.184151+0000","modified":"2024-09-12T02:23:19.195177+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"d","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6834/248466084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":248466084},{"type":"v1","addr":"172.21.15.105:6834","nonce":248466084}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":2}]} 2024-09-12T02:23:20.198 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 11 2024-09-12T02:23:20.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.199+0000 7f22068e4640 1 -- 172.21.15.60:0/3410915188 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f21ec06be30 msgr2=0x7f21ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:20.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.199+0000 7f22068e4640 1 --2- 172.21.15.60:0/3410915188 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f21ec06be30 0x7f21ec06e2f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f21f4001700 tx=0x7f21f4009040 comp rx=0 tx=0).stop 2024-09-12T02:23:20.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.199+0000 7f22068e4640 1 -- 172.21.15.60:0/3410915188 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f220006ede0 msgr2=0x7f22001eff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:20.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.199+0000 7f22068e4640 1 --2- 172.21.15.60:0/3410915188 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f220006ede0 0x7f22001eff30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f21f000c480 tx=0x7f21f000c940 comp rx=0 tx=0).stop 2024-09-12T02:23:20.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.199+0000 7f22068e4640 1 -- 172.21.15.60:0/3410915188 shutdown_connections 2024-09-12T02:23:20.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.199+0000 7f22068e4640 1 --2- 172.21.15.60:0/3410915188 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f21ec06be30 0x7f21ec06e2f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:20.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.199+0000 7f22068e4640 1 --2- 172.21.15.60:0/3410915188 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f220015a450 0x7f22001ec000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:20.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.199+0000 7f22068e4640 1 --2- 172.21.15.60:0/3410915188 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22000c84e0 0x7f22001e0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:20.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.199+0000 7f22068e4640 1 --2- 172.21.15.60:0/3410915188 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f220006ede0 0x7f22001eff30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:20.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.199+0000 7f22068e4640 1 -- 172.21.15.60:0/3410915188 >> 172.21.15.60:0/3410915188 conn(0x7f22000c5660 msgr2=0x7f22000c3910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:20.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.200+0000 7f22068e4640 1 -- 172.21.15.60:0/3410915188 shutdown_connections 2024-09-12T02:23:20.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.200+0000 7f22068e4640 1 -- 172.21.15.60:0/3410915188 wait complete. 2024-09-12T02:23:20.211 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:23:20.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.312+0000 7fcbefa1e640 1 Processor -- start 2024-09-12T02:23:20.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.312+0000 7fcbefa1e640 1 -- start start 2024-09-12T02:23:20.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.313+0000 7fcbefa1e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fcbe806c650 0x7fcbe80c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:20.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.313+0000 7fcbefa1e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbe80ca1c0 0x7fcbe8160bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:20.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.313+0000 7fcbefa1e640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbe815a7c0 con 0x7fcbe8150480 2024-09-12T02:23:20.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.313+0000 7fcbefa1e640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fcbe806c240 con 0x7fcbe806c650 2024-09-12T02:23:20.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.313+0000 7fcbefa1e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcbe815a330 con 0x7fcbe80ca1c0 2024-09-12T02:23:20.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.313+0000 7fcbecfb9640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fcbe806c650 0x7fcbe80c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:20.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.313+0000 7fcbedfbb640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbe80ca1c0 0x7fcbe8160bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:20.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.313+0000 7fcbed7ba640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fcbe8150480 0x7fcbe80c7a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:45384/0 (socket says 172.21.15.60:45384) 2024-09-12T02:23:20.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.313+0000 7fcbecfb9640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fcbe806c650 0x7fcbe80c9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:46212/0 (socket says 172.21.15.60:46212) 2024-09-12T02:23:20.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.313+0000 7fcbed7ba640 1 -- 172.21.15.60:0/1334497600 learned_addr learned my addr 172.21.15.60:0/1334497600 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:20.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.313+0000 7fcbecfb9640 1 -- 172.21.15.60:0/1334497600 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbe80ca1c0 msgr2=0x7fcbe8160bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:20.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.313+0000 7fcbecfb9640 1 --2- 172.21.15.60:0/1334497600 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbe80ca1c0 0x7fcbe8160bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:20.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.313+0000 7fcbecfb9640 1 -- 172.21.15.60:0/1334497600 >> v1:172.21.15.105:6789/0 conn(0x7fcbe8150480 legacy=0x7fcbe80c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:20.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.313+0000 7fcbecfb9640 1 -- 172.21.15.60:0/1334497600 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe8159a00 con 0x7fcbe806c650 2024-09-12T02:23:20.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.313+0000 7fcbe7fff640 1 -- 172.21.15.60:0/1334497600 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2380326290 0 0) 0x7fcbe815a7c0 con 0x7fcbe8150480 2024-09-12T02:23:20.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.314+0000 7fcbecfb9640 1 --2- 172.21.15.60:0/1334497600 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbe806c650 0x7fcbe80c9c80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc0097a0 tx=0x7fcbdc02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f72d291b0f1a827b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:20.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.314+0000 7fcbe7fff640 1 -- 172.21.15.60:0/1334497600 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc037070 con 0x7fcbe806c650 2024-09-12T02:23:20.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.314+0000 7fcbe7fff640 1 -- 172.21.15.60:0/1334497600 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbdc032440 con 0x7fcbe806c650 2024-09-12T02:23:20.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.314+0000 7fcbe7fff640 1 -- 172.21.15.60:0/1334497600 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc032810 con 0x7fcbe806c650 2024-09-12T02:23:20.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.315+0000 7fcbefa1e640 1 -- 172.21.15.60:0/1334497600 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbe806c650 msgr2=0x7fcbe80c9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:20.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.315+0000 7fcbefa1e640 1 --2- 172.21.15.60:0/1334497600 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbe806c650 0x7fcbe80c9c80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc0097a0 tx=0x7fcbdc02a180 comp rx=0 tx=0).stop 2024-09-12T02:23:20.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.315+0000 7fcbefa1e640 1 -- 172.21.15.60:0/1334497600 shutdown_connections 2024-09-12T02:23:20.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.315+0000 7fcbefa1e640 1 --2- 172.21.15.60:0/1334497600 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbe80ca1c0 0x7fcbe8160bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:20.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.315+0000 7fcbefa1e640 1 --2- 172.21.15.60:0/1334497600 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbe806c650 0x7fcbe80c9c80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:20.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.315+0000 7fcbefa1e640 1 -- 172.21.15.60:0/1334497600 >> 172.21.15.60:0/1334497600 conn(0x7fcbe8068030 msgr2=0x7fcbe8073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:20.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.315+0000 7fcbefa1e640 1 -- 172.21.15.60:0/1334497600 shutdown_connections 2024-09-12T02:23:20.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.315+0000 7fcbefa1e640 1 -- 172.21.15.60:0/1334497600 wait complete. 2024-09-12T02:23:20.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.316+0000 7fcbefa1e640 1 Processor -- start 2024-09-12T02:23:20.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.316+0000 7fcbefa1e640 1 -- start start 2024-09-12T02:23:20.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.317+0000 7fcbefa1e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbe806c650 0x7fcbe8158a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:20.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.317+0000 7fcbefa1e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbe80ca1c0 0x7fcbe8150eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:20.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.317+0000 7fcbefa1e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcbe8150480 0x7fcbe81513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:20.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.317+0000 7fcbefa1e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe80ca630 con 0x7fcbe8150480 2024-09-12T02:23:20.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.317+0000 7fcbefa1e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe8159fc0 con 0x7fcbe80ca1c0 2024-09-12T02:23:20.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.317+0000 7fcbefa1e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcbe806d270 con 0x7fcbe806c650 2024-09-12T02:23:20.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.317+0000 7fcbedfbb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcbe8150480 0x7fcbe81513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:20.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.317+0000 7fcbedfbb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcbe8150480 0x7fcbe81513f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49608/0 (socket says 172.21.15.60:49608) 2024-09-12T02:23:20.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.317+0000 7fcbedfbb640 1 -- 172.21.15.60:0/3136282520 learned_addr learned my addr 172.21.15.60:0/3136282520 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:20.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.317+0000 7fcbed7ba640 1 --2- 172.21.15.60:0/3136282520 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbe806c650 0x7fcbe8158a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:20.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.317+0000 7fcbecfb9640 1 --2- 172.21.15.60:0/3136282520 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbe80ca1c0 0x7fcbe8150eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:20.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.317+0000 7fcbedfbb640 1 -- 172.21.15.60:0/3136282520 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbe806c650 msgr2=0x7fcbe8158a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:20.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.317+0000 7fcbedfbb640 1 --2- 172.21.15.60:0/3136282520 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbe806c650 0x7fcbe8158a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:20.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.317+0000 7fcbedfbb640 1 -- 172.21.15.60:0/3136282520 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbe80ca1c0 msgr2=0x7fcbe8150eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:20.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.317+0000 7fcbedfbb640 1 --2- 172.21.15.60:0/3136282520 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbe80ca1c0 0x7fcbe8150eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:20.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.317+0000 7fcbedfbb640 1 -- 172.21.15.60:0/3136282520 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe81ef5e0 con 0x7fcbe8150480 2024-09-12T02:23:20.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.317+0000 7fcbedfbb640 1 --2- 172.21.15.60:0/3136282520 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcbe8150480 0x7fcbe81513f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcbe000e7f0 tx=0x7fcbe000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:20.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.318+0000 7fcbe5ffb640 1 -- 172.21.15.60:0/3136282520 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe0017070 con 0x7fcbe8150480 2024-09-12T02:23:20.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.318+0000 7fcbe5ffb640 1 -- 172.21.15.60:0/3136282520 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbe000ee40 con 0x7fcbe8150480 2024-09-12T02:23:20.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.318+0000 7fcbefa1e640 1 -- 172.21.15.60:0/3136282520 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbe81ef880 con 0x7fcbe8150480 2024-09-12T02:23:20.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.318+0000 7fcbe5ffb640 1 -- 172.21.15.60:0/3136282520 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe000cb80 con 0x7fcbe8150480 2024-09-12T02:23:20.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.318+0000 7fcbefa1e640 1 -- 172.21.15.60:0/3136282520 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbe81efe40 con 0x7fcbe8150480 2024-09-12T02:23:20.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.319+0000 7fcbefa1e640 1 -- 172.21.15.60:0/3136282520 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbe8156270 con 0x7fcbe8150480 2024-09-12T02:23:20.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.319+0000 7fcbe5ffb640 1 -- 172.21.15.60:0/3136282520 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcbe001a070 con 0x7fcbe8150480 2024-09-12T02:23:20.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.320+0000 7fcbe5ffb640 1 --2- 172.21.15.60:0/3136282520 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcbd406be30 0x7fcbd406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:20.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.320+0000 7fcbe5ffb640 1 -- 172.21.15.60:0/3136282520 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7fcbe008b330 con 0x7fcbe8150480 2024-09-12T02:23:20.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.320+0000 7fcbed7ba640 1 --2- 172.21.15.60:0/3136282520 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcbd406be30 0x7fcbd406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:20.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.320+0000 7fcbed7ba640 1 --2- 172.21.15.60:0/3136282520 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcbd406be30 0x7fcbd406e2f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcbd80012e0 tx=0x7fcbd8001700 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:20.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.324+0000 7fcbe5ffb640 1 -- 172.21.15.60:0/3136282520 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcbe0059360 con 0x7fcbe8150480 2024-09-12T02:23:20.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.498+0000 7fcbefa1e640 1 -- 172.21.15.60:0/3136282520 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcbe806c430 con 0x7fcbe8150480 2024-09-12T02:23:20.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.500+0000 7fcbe5ffb640 1 -- 172.21.15.60:0/3136282520 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+20439 (secure 0 0 0) 0x7fcbe005d660 con 0x7fcbe8150480 2024-09-12T02:23:20.501 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:23:20.501 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":26,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","created":"2024-09-12T02:22:39.869862+0000","modified":"2024-09-12T02:23:17.835334+0000","last_up_change":"2024-09-12T02:22:53.459371+0000","last_in_change":"2024-09-12T02:22:42.817076+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:22:52.130579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-09-12T02:23:01.854763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-09-12T02:23:03.104847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-09-12T02:23:14.175168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-09-12T02:23:15.166293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0f0c7386-002f-47e2-a7a3-6c8a70264cc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6819","nonce":1789465659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6821","nonce":1789465659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6825","nonce":1789465659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6823","nonce":1789465659}]},"public_addr":"172.21.15.60:6819/1789465659","cluster_addr":"172.21.15.60:6821/1789465659","heartbeat_back_addr":"172.21.15.60:6825/1789465659","heartbeat_front_addr":"172.21.15.60:6823/1789465659","state":["exists","up"]},{"osd":1,"uuid":"64be7b84-36fc-43c0-9e70-a617e5b68941","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6811","nonce":1109822408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6813","nonce":1109822408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6817","nonce":1109822408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6815","nonce":1109822408}]},"public_addr":"172.21.15.60:6811/1109822408","cluster_addr":"172.21.15.60:6813/1109822408","heartbeat_back_addr":"172.21.15.60:6817/1109822408","heartbeat_front_addr":"172.21.15.60:6815/1109822408","state":["exists","up"]},{"osd":2,"uuid":"df00caa1-d45e-4b87-ac1e-8bc098d509d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6827","nonce":278470077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6829","nonce":278470077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6833","nonce":278470077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6831","nonce":278470077}]},"public_addr":"172.21.15.60:6827/278470077","cluster_addr":"172.21.15.60:6829/278470077","heartbeat_back_addr":"172.21.15.60:6833/278470077","heartbeat_front_addr":"172.21.15.60:6831/278470077","state":["exists","up"]},{"osd":3,"uuid":"f6453471-893a-490b-b0c7-f196a0f574e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6803","nonce":3606424156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6805","nonce":3606424156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6809","nonce":3606424156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6807","nonce":3606424156}]},"public_addr":"172.21.15.60:6803/3606424156","cluster_addr":"172.21.15.60:6805/3606424156","heartbeat_back_addr":"172.21.15.60:6809/3606424156","heartbeat_front_addr":"172.21.15.60:6807/3606424156","state":["exists","up"]},{"osd":4,"uuid":"96e908b6-ce3e-466c-b02d-08fc71a1dba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6809","nonce":1581641129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6811","nonce":1581641129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6815","nonce":1581641129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6813","nonce":1581641129}]},"public_addr":"172.21.15.105:6809/1581641129","cluster_addr":"172.21.15.105:6811/1581641129","heartbeat_back_addr":"172.21.15.105:6815/1581641129","heartbeat_front_addr":"172.21.15.105:6813/1581641129","state":["exists","up"]},{"osd":5,"uuid":"7ebc26f0-a462-4364-9303-7351f7cba21f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6825","nonce":1392337793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6827","nonce":1392337793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6831","nonce":1392337793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6829","nonce":1392337793}]},"public_addr":"172.21.15.105:6825/1392337793","cluster_addr":"172.21.15.105:6827/1392337793","heartbeat_back_addr":"172.21.15.105:6831/1392337793","heartbeat_front_addr":"172.21.15.105:6829/1392337793","state":["exists","up"]},{"osd":6,"uuid":"49487ea1-9c6d-4090-bbcc-f28b33040eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6801","nonce":50951309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6803","nonce":50951309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6807","nonce":50951309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6805","nonce":50951309}]},"public_addr":"172.21.15.105:6801/50951309","cluster_addr":"172.21.15.105:6803/50951309","heartbeat_back_addr":"172.21.15.105:6807/50951309","heartbeat_front_addr":"172.21.15.105:6805/50951309","state":["exists","up"]},{"osd":7,"uuid":"1e3a0aa9-7e29-4785-8506-6b5d3be2be35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6817","nonce":3745331251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6819","nonce":3745331251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6823","nonce":3745331251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6821","nonce":3745331251}]},"public_addr":"172.21.15.105:6817/3745331251","cluster_addr":"172.21.15.105:6819/3745331251","heartbeat_back_addr":"172.21.15.105:6823/3745331251","heartbeat_front_addr":"172.21.15.105:6821/3745331251","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:50.112629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.307689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.542851+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.334773+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:50.096967+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:50.259633+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.888988+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.917421+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:23:20.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.502+0000 7fcbefa1e640 1 -- 172.21.15.60:0/3136282520 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcbd406be30 msgr2=0x7fcbd406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:20.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.502+0000 7fcbefa1e640 1 --2- 172.21.15.60:0/3136282520 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcbd406be30 0x7fcbd406e2f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcbd80012e0 tx=0x7fcbd8001700 comp rx=0 tx=0).stop 2024-09-12T02:23:20.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.502+0000 7fcbefa1e640 1 -- 172.21.15.60:0/3136282520 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcbe8150480 msgr2=0x7fcbe81513f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:20.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.502+0000 7fcbefa1e640 1 --2- 172.21.15.60:0/3136282520 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcbe8150480 0x7fcbe81513f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcbe000e7f0 tx=0x7fcbe000ebf0 comp rx=0 tx=0).stop 2024-09-12T02:23:20.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.502+0000 7fcbefa1e640 1 -- 172.21.15.60:0/3136282520 shutdown_connections 2024-09-12T02:23:20.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.502+0000 7fcbefa1e640 1 --2- 172.21.15.60:0/3136282520 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcbd406be30 0x7fcbd406e2f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:20.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.502+0000 7fcbefa1e640 1 --2- 172.21.15.60:0/3136282520 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcbe8150480 0x7fcbe81513f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:20.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.502+0000 7fcbefa1e640 1 --2- 172.21.15.60:0/3136282520 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbe80ca1c0 0x7fcbe8150eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:20.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.502+0000 7fcbefa1e640 1 --2- 172.21.15.60:0/3136282520 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbe806c650 0x7fcbe8158a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:20.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.502+0000 7fcbefa1e640 1 -- 172.21.15.60:0/3136282520 >> 172.21.15.60:0/3136282520 conn(0x7fcbe8068030 msgr2=0x7fcbe80c7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:20.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.502+0000 7fcbefa1e640 1 -- 172.21.15.60:0/3136282520 shutdown_connections 2024-09-12T02:23:20.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.502+0000 7fcbefa1e640 1 -- 172.21.15.60:0/3136282520 wait complete. 2024-09-12T02:23:20.513 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T02:23:20.514 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:23:20.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.615+0000 7f410455b640 1 Processor -- start 2024-09-12T02:23:20.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.615+0000 7f410455b640 1 -- start start 2024-09-12T02:23:20.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.616+0000 7f410455b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f40fc0c84e0 0x7f40fc06e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:20.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.616+0000 7f410455b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40fc06ec10 0x7f40fc160c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:20.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.616+0000 7f410455b640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40fc15a830 con 0x7f40fc15a450 2024-09-12T02:23:20.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.616+0000 7f410455b640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f40fc06e240 con 0x7f40fc0c84e0 2024-09-12T02:23:20.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.616+0000 7f410455b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f40fc0c7490 con 0x7f40fc06ec10 2024-09-12T02:23:20.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.616+0000 7f4101af6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f40fc0c84e0 0x7f40fc06e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:20.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.616+0000 7f4101af6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f40fc0c84e0 0x7f40fc06e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49614/0 (socket says 172.21.15.60:49614) 2024-09-12T02:23:20.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.616+0000 7f4101af6640 1 -- 172.21.15.60:0/3932412211 learned_addr learned my addr 172.21.15.60:0/3932412211 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:20.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.616+0000 7f4102af8640 1 --2- 172.21.15.60:0/3932412211 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40fc06ec10 0x7f40fc160c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:20.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.616+0000 7f4101af6640 1 -- 172.21.15.60:0/3932412211 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40fc06ec10 msgr2=0x7f40fc160c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:20.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.616+0000 7f4101af6640 1 --2- 172.21.15.60:0/3932412211 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40fc06ec10 0x7f40fc160c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:20.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.616+0000 7f4101af6640 1 -- 172.21.15.60:0/3932412211 >> v1:172.21.15.105:6789/0 conn(0x7f40fc15a450 legacy=0x7f40fc0c3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:20.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.616+0000 7f4101af6640 1 -- 172.21.15.60:0/3932412211 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40fc0c7770 con 0x7f40fc0c84e0 2024-09-12T02:23:20.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.617+0000 7f4101af6640 1 --2- 172.21.15.60:0/3932412211 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40fc0c84e0 0x7f40fc06e6d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f40ec009870 tx=0x7f40ec02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e48cdd92261d7ec6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:20.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.617+0000 7f41012f5640 1 -- 172.21.15.60:0/3932412211 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40ec037070 con 0x7f40fc0c84e0 2024-09-12T02:23:20.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.617+0000 7f41012f5640 1 -- 172.21.15.60:0/3932412211 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40ec032440 con 0x7f40fc0c84e0 2024-09-12T02:23:20.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.617+0000 7f41012f5640 1 -- 172.21.15.60:0/3932412211 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40ec032810 con 0x7f40fc0c84e0 2024-09-12T02:23:20.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.618+0000 7f410455b640 1 -- 172.21.15.60:0/3932412211 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40fc0c84e0 msgr2=0x7f40fc06e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:20.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.618+0000 7f410455b640 1 --2- 172.21.15.60:0/3932412211 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40fc0c84e0 0x7f40fc06e6d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f40ec009870 tx=0x7f40ec02a2a0 comp rx=0 tx=0).stop 2024-09-12T02:23:20.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.618+0000 7f410455b640 1 -- 172.21.15.60:0/3932412211 shutdown_connections 2024-09-12T02:23:20.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.618+0000 7f410455b640 1 --2- 172.21.15.60:0/3932412211 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40fc06ec10 0x7f40fc160c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:20.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.618+0000 7f410455b640 1 --2- 172.21.15.60:0/3932412211 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40fc0c84e0 0x7f40fc06e6d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:20.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.618+0000 7f410455b640 1 -- 172.21.15.60:0/3932412211 >> 172.21.15.60:0/3932412211 conn(0x7f40fc0c5660 msgr2=0x7f40fc0c5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:20.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.618+0000 7f410455b640 1 -- 172.21.15.60:0/3932412211 shutdown_connections 2024-09-12T02:23:20.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.618+0000 7f410455b640 1 -- 172.21.15.60:0/3932412211 wait complete. 2024-09-12T02:23:20.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.619+0000 7f410455b640 1 Processor -- start 2024-09-12T02:23:20.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.619+0000 7f410455b640 1 -- start start 2024-09-12T02:23:20.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.620+0000 7f410455b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40fc06ec10 0x7f40fc157040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:20.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.620+0000 7f410455b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40fc0c84e0 0x7f40fc0a69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:20.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.620+0000 7f410455b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40fc15a450 0x7f40fc0a6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:20.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.620+0000 7f410455b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f40fc0c41a0 con 0x7f40fc06ec10 2024-09-12T02:23:20.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.620+0000 7f410455b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f40fc0c7d30 con 0x7f40fc15a450 2024-09-12T02:23:20.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.620+0000 7f410455b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f40fc0c4320 con 0x7f40fc0c84e0 2024-09-12T02:23:20.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.620+0000 7f41022f7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40fc06ec10 0x7f40fc157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:20.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.620+0000 7f41022f7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40fc06ec10 0x7f40fc157040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49620/0 (socket says 172.21.15.60:49620) 2024-09-12T02:23:20.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.620+0000 7f41022f7640 1 -- 172.21.15.60:0/1447225102 learned_addr learned my addr 172.21.15.60:0/1447225102 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:20.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.620+0000 7f4101af6640 1 --2- 172.21.15.60:0/1447225102 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40fc0c84e0 0x7f40fc0a69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:20.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.620+0000 7f4102af8640 1 --2- 172.21.15.60:0/1447225102 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40fc15a450 0x7f40fc0a6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:20.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.620+0000 7f41022f7640 1 -- 172.21.15.60:0/1447225102 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40fc0c84e0 msgr2=0x7f40fc0a69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:20.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.620+0000 7f41022f7640 1 --2- 172.21.15.60:0/1447225102 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40fc0c84e0 0x7f40fc0a69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:20.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.620+0000 7f41022f7640 1 -- 172.21.15.60:0/1447225102 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40fc15a450 msgr2=0x7f40fc0a6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:20.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.620+0000 7f41022f7640 1 --2- 172.21.15.60:0/1447225102 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40fc15a450 0x7f40fc0a6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:20.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.620+0000 7f41022f7640 1 -- 172.21.15.60:0/1447225102 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40fc159190 con 0x7f40fc06ec10 2024-09-12T02:23:20.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.620+0000 7f41022f7640 1 --2- 172.21.15.60:0/1447225102 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40fc06ec10 0x7f40fc157040 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f40f800b420 tx=0x7f40f800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:20.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.621+0000 7f40f2ffd640 1 -- 172.21.15.60:0/1447225102 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f8011830 con 0x7f40fc06ec10 2024-09-12T02:23:20.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.621+0000 7f40f2ffd640 1 -- 172.21.15.60:0/1447225102 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40f8016070 con 0x7f40fc06ec10 2024-09-12T02:23:20.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.621+0000 7f410455b640 1 -- 172.21.15.60:0/1447225102 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40fc1ebe20 con 0x7f40fc06ec10 2024-09-12T02:23:20.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.621+0000 7f40f2ffd640 1 -- 172.21.15.60:0/1447225102 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f8011c10 con 0x7f40fc06ec10 2024-09-12T02:23:20.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.621+0000 7f410455b640 1 -- 172.21.15.60:0/1447225102 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40fc1ec3e0 con 0x7f40fc06ec10 2024-09-12T02:23:20.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.622+0000 7f410455b640 1 -- 172.21.15.60:0/1447225102 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40fc0c3660 con 0x7f40fc06ec10 2024-09-12T02:23:20.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.622+0000 7f40f2ffd640 1 -- 172.21.15.60:0/1447225102 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f40f801b460 con 0x7f40fc06ec10 2024-09-12T02:23:20.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.623+0000 7f40f2ffd640 1 --2- 172.21.15.60:0/1447225102 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f40e006be30 0x7f40e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:20.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.623+0000 7f40f2ffd640 1 -- 172.21.15.60:0/1447225102 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f40f808ad10 con 0x7f40fc06ec10 2024-09-12T02:23:20.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.623+0000 7f4101af6640 1 --2- 172.21.15.60:0/1447225102 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f40e006be30 0x7f40e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:20.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.623+0000 7f4101af6640 1 --2- 172.21.15.60:0/1447225102 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f40e006be30 0x7f40e006e2f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f40ec034000 tx=0x7f40ec02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:20.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.627+0000 7f40f2ffd640 1 -- 172.21.15.60:0/1447225102 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f40f8090020 con 0x7f40fc06ec10 2024-09-12T02:23:20.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.800+0000 7f410455b640 1 -- 172.21.15.60:0/1447225102 --> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f40fc0c6ba0 con 0x7f40e006be30 2024-09-12T02:23:20.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.812+0000 7f40f2ffd640 1 -- 172.21.15.60:0/1447225102 <== mgr.4098 v2:172.21.15.60:6800/3549430091 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490384 (secure 0 0 0) 0x7f40ec0b9ba0 con 0x7f40e006be30 2024-09-12T02:23:20.818 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:23:20.821 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T02:23:20.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.816+0000 7f410455b640 1 -- 172.21.15.60:0/1447225102 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f40e006be30 msgr2=0x7f40e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:20.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.816+0000 7f410455b640 1 --2- 172.21.15.60:0/1447225102 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f40e006be30 0x7f40e006e2f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f40ec034000 tx=0x7f40ec02e000 comp rx=0 tx=0).stop 2024-09-12T02:23:20.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.816+0000 7f410455b640 1 -- 172.21.15.60:0/1447225102 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40fc06ec10 msgr2=0x7f40fc157040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:20.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.816+0000 7f410455b640 1 --2- 172.21.15.60:0/1447225102 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40fc06ec10 0x7f40fc157040 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f40f800b420 tx=0x7f40f800b8e0 comp rx=0 tx=0).stop 2024-09-12T02:23:20.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.816+0000 7f410455b640 1 -- 172.21.15.60:0/1447225102 shutdown_connections 2024-09-12T02:23:20.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.816+0000 7f410455b640 1 --2- 172.21.15.60:0/1447225102 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f40e006be30 0x7f40e006e2f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:20.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.816+0000 7f410455b640 1 --2- 172.21.15.60:0/1447225102 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40fc15a450 0x7f40fc0a6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:20.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.816+0000 7f410455b640 1 --2- 172.21.15.60:0/1447225102 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40fc0c84e0 0x7f40fc0a69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:20.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.816+0000 7f410455b640 1 --2- 172.21.15.60:0/1447225102 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40fc06ec10 0x7f40fc157040 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:20.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.816+0000 7f410455b640 1 -- 172.21.15.60:0/1447225102 >> 172.21.15.60:0/1447225102 conn(0x7f40fc0c5660 msgr2=0x7f40fc06ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:20.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.816+0000 7f410455b640 1 -- 172.21.15.60:0/1447225102 shutdown_connections 2024-09-12T02:23:20.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.816+0000 7f410455b640 1 -- 172.21.15.60:0/1447225102 wait complete. 2024-09-12T02:23:20.828 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-09-12T02:23:20.089735+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595188,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":248,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":194,"ondisk_log_size":194,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":277,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252852,"kb_used_data":3308,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754721868,"statfs":{"total":773094113280,"available":772835192832,"internally_reserved":0,"allocated":3387392,"data_stored":1990993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.281196"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840458+0000","last_change":"2024-09-12T02:23:16.851521+0000","last_active":"2024-09-12T02:23:17.840458+0000","last_peered":"2024-09-12T02:23:17.840458+0000","last_clean":"2024-09-12T02:23:17.840458+0000","last_became_active":"2024-09-12T02:23:16.851220+0000","last_became_peered":"2024-09-12T02:23:16.851220+0000","last_unstale":"2024-09-12T02:23:17.840458+0000","last_undegraded":"2024-09-12T02:23:17.840458+0000","last_fullsized":"2024-09-12T02:23:17.840458+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:28.680072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331964+0000","last_change":"2024-09-12T02:23:03.757848+0000","last_active":"2024-09-12T02:23:18.331964+0000","last_peered":"2024-09-12T02:23:18.331964+0000","last_clean":"2024-09-12T02:23:18.331964+0000","last_became_active":"2024-09-12T02:23:03.757544+0000","last_became_peered":"2024-09-12T02:23:03.757544+0000","last_unstale":"2024-09-12T02:23:18.331964+0000","last_undegraded":"2024-09-12T02:23:18.331964+0000","last_fullsized":"2024-09-12T02:23:18.331964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:43.576128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.834954+0000","last_change":"2024-09-12T02:23:04.790549+0000","last_active":"2024-09-12T02:23:16.834954+0000","last_peered":"2024-09-12T02:23:16.834954+0000","last_clean":"2024-09-12T02:23:16.834954+0000","last_became_active":"2024-09-12T02:23:04.790187+0000","last_became_peered":"2024-09-12T02:23:04.790187+0000","last_unstale":"2024-09-12T02:23:16.834954+0000","last_undegraded":"2024-09-12T02:23:16.834954+0000","last_fullsized":"2024-09-12T02:23:16.834954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:49.656395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.833070+0000","last_change":"2024-09-12T02:23:15.829383+0000","last_active":"2024-09-12T02:23:16.833070+0000","last_peered":"2024-09-12T02:23:16.833070+0000","last_clean":"2024-09-12T02:23:16.833070+0000","last_became_active":"2024-09-12T02:23:15.828295+0000","last_became_peered":"2024-09-12T02:23:15.828295+0000","last_unstale":"2024-09-12T02:23:16.833070+0000","last_undegraded":"2024-09-12T02:23:16.833070+0000","last_fullsized":"2024-09-12T02:23:16.833070+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:13.217846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.857189+0000","last_change":"2024-09-12T02:23:16.853675+0000","last_active":"2024-09-12T02:23:16.857189+0000","last_peered":"2024-09-12T02:23:16.857189+0000","last_clean":"2024-09-12T02:23:16.857189+0000","last_became_active":"2024-09-12T02:23:16.853371+0000","last_became_peered":"2024-09-12T02:23:16.853371+0000","last_unstale":"2024-09-12T02:23:16.857189+0000","last_undegraded":"2024-09-12T02:23:16.857189+0000","last_fullsized":"2024-09-12T02:23:16.857189+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:38.513559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.835062+0000","last_change":"2024-09-12T02:23:03.767076+0000","last_active":"2024-09-12T02:23:16.835062+0000","last_peered":"2024-09-12T02:23:16.835062+0000","last_clean":"2024-09-12T02:23:16.835062+0000","last_became_active":"2024-09-12T02:23:03.766686+0000","last_became_peered":"2024-09-12T02:23:03.766686+0000","last_unstale":"2024-09-12T02:23:16.835062+0000","last_undegraded":"2024-09-12T02:23:16.835062+0000","last_fullsized":"2024-09-12T02:23:16.835062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:45.706208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331882+0000","last_change":"2024-09-12T02:23:04.782108+0000","last_active":"2024-09-12T02:23:18.331882+0000","last_peered":"2024-09-12T02:23:18.331882+0000","last_clean":"2024-09-12T02:23:18.331882+0000","last_became_active":"2024-09-12T02:23:04.781829+0000","last_became_peered":"2024-09-12T02:23:04.781829+0000","last_unstale":"2024-09-12T02:23:18.331882+0000","last_undegraded":"2024-09-12T02:23:18.331882+0000","last_fullsized":"2024-09-12T02:23:18.331882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:07:33.165742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840554+0000","last_change":"2024-09-12T02:23:15.828697+0000","last_active":"2024-09-12T02:23:17.840554+0000","last_peered":"2024-09-12T02:23:17.840554+0000","last_clean":"2024-09-12T02:23:17.840554+0000","last_became_active":"2024-09-12T02:23:15.828317+0000","last_became_peered":"2024-09-12T02:23:15.828317+0000","last_unstale":"2024-09-12T02:23:17.840554+0000","last_undegraded":"2024-09-12T02:23:17.840554+0000","last_fullsized":"2024-09-12T02:23:17.840554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:55.347515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840938+0000","last_change":"2024-09-12T02:23:16.856209+0000","last_active":"2024-09-12T02:23:17.840938+0000","last_peered":"2024-09-12T02:23:17.840938+0000","last_clean":"2024-09-12T02:23:17.840938+0000","last_became_active":"2024-09-12T02:23:16.855874+0000","last_became_peered":"2024-09-12T02:23:16.855874+0000","last_unstale":"2024-09-12T02:23:17.840938+0000","last_undegraded":"2024-09-12T02:23:17.840938+0000","last_fullsized":"2024-09-12T02:23:17.840938+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:44.299638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842447+0000","last_change":"2024-09-12T02:23:03.767875+0000","last_active":"2024-09-12T02:23:17.842447+0000","last_peered":"2024-09-12T02:23:17.842447+0000","last_clean":"2024-09-12T02:23:17.842447+0000","last_became_active":"2024-09-12T02:23:03.767596+0000","last_became_peered":"2024-09-12T02:23:03.767596+0000","last_unstale":"2024-09-12T02:23:17.842447+0000","last_undegraded":"2024-09-12T02:23:17.842447+0000","last_fullsized":"2024-09-12T02:23:17.842447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:22.605725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325618+0000","last_change":"2024-09-12T02:23:04.791903+0000","last_active":"2024-09-12T02:23:18.325618+0000","last_peered":"2024-09-12T02:23:18.325618+0000","last_clean":"2024-09-12T02:23:18.325618+0000","last_became_active":"2024-09-12T02:23:04.791635+0000","last_became_peered":"2024-09-12T02:23:04.791635+0000","last_unstale":"2024-09-12T02:23:18.325618+0000","last_undegraded":"2024-09-12T02:23:18.325618+0000","last_fullsized":"2024-09-12T02:23:18.325618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:08.192088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841943+0000","last_change":"2024-09-12T02:23:15.833369+0000","last_active":"2024-09-12T02:23:17.841943+0000","last_peered":"2024-09-12T02:23:17.841943+0000","last_clean":"2024-09-12T02:23:17.841943+0000","last_became_active":"2024-09-12T02:23:15.833010+0000","last_became_peered":"2024-09-12T02:23:15.833010+0000","last_unstale":"2024-09-12T02:23:17.841943+0000","last_undegraded":"2024-09-12T02:23:17.841943+0000","last_fullsized":"2024-09-12T02:23:17.841943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:51.465462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325378+0000","last_change":"2024-09-12T02:23:16.853013+0000","last_active":"2024-09-12T02:23:18.325378+0000","last_peered":"2024-09-12T02:23:18.325378+0000","last_clean":"2024-09-12T02:23:18.325378+0000","last_became_active":"2024-09-12T02:23:16.852698+0000","last_became_peered":"2024-09-12T02:23:16.852698+0000","last_unstale":"2024-09-12T02:23:18.325378+0000","last_undegraded":"2024-09-12T02:23:18.325378+0000","last_fullsized":"2024-09-12T02:23:18.325378+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:11.709531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842467+0000","last_change":"2024-09-12T02:23:03.763480+0000","last_active":"2024-09-12T02:23:17.842467+0000","last_peered":"2024-09-12T02:23:17.842467+0000","last_clean":"2024-09-12T02:23:17.842467+0000","last_became_active":"2024-09-12T02:23:03.762464+0000","last_became_peered":"2024-09-12T02:23:03.762464+0000","last_unstale":"2024-09-12T02:23:17.842467+0000","last_undegraded":"2024-09-12T02:23:17.842467+0000","last_fullsized":"2024-09-12T02:23:17.842467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:24.308289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325931+0000","last_change":"2024-09-12T02:23:04.791109+0000","last_active":"2024-09-12T02:23:18.325931+0000","last_peered":"2024-09-12T02:23:18.325931+0000","last_clean":"2024-09-12T02:23:18.325931+0000","last_became_active":"2024-09-12T02:23:04.790201+0000","last_became_peered":"2024-09-12T02:23:04.790201+0000","last_unstale":"2024-09-12T02:23:18.325931+0000","last_undegraded":"2024-09-12T02:23:18.325931+0000","last_fullsized":"2024-09-12T02:23:18.325931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:13.166139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840837+0000","last_change":"2024-09-12T02:23:15.834261+0000","last_active":"2024-09-12T02:23:17.840837+0000","last_peered":"2024-09-12T02:23:17.840837+0000","last_clean":"2024-09-12T02:23:17.840837+0000","last_became_active":"2024-09-12T02:23:15.833982+0000","last_became_peered":"2024-09-12T02:23:15.833982+0000","last_unstale":"2024-09-12T02:23:17.840837+0000","last_undegraded":"2024-09-12T02:23:17.840837+0000","last_fullsized":"2024-09-12T02:23:17.840837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:04.987961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.862641+0000","last_change":"2024-09-12T02:23:16.861432+0000","last_active":"2024-09-12T02:23:16.862641+0000","last_peered":"2024-09-12T02:23:16.862641+0000","last_clean":"2024-09-12T02:23:16.862641+0000","last_became_active":"2024-09-12T02:23:16.861003+0000","last_became_peered":"2024-09-12T02:23:16.861003+0000","last_unstale":"2024-09-12T02:23:16.862641+0000","last_undegraded":"2024-09-12T02:23:16.862641+0000","last_fullsized":"2024-09-12T02:23:16.862641+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:26.362169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.830825+0000","last_change":"2024-09-12T02:23:04.788754+0000","last_active":"2024-09-12T02:23:16.830825+0000","last_peered":"2024-09-12T02:23:16.830825+0000","last_clean":"2024-09-12T02:23:16.830825+0000","last_became_active":"2024-09-12T02:23:04.788350+0000","last_became_peered":"2024-09-12T02:23:04.788350+0000","last_unstale":"2024-09-12T02:23:16.830825+0000","last_undegraded":"2024-09-12T02:23:16.830825+0000","last_fullsized":"2024-09-12T02:23:16.830825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:08.192088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841873+0000","last_change":"2024-09-12T02:23:03.763423+0000","last_active":"2024-09-12T02:23:17.841873+0000","last_peered":"2024-09-12T02:23:17.841873+0000","last_clean":"2024-09-12T02:23:17.841873+0000","last_became_active":"2024-09-12T02:23:03.762627+0000","last_became_peered":"2024-09-12T02:23:03.762627+0000","last_unstale":"2024-09-12T02:23:17.841873+0000","last_undegraded":"2024-09-12T02:23:17.841873+0000","last_fullsized":"2024-09-12T02:23:17.841873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:18.090657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841725+0000","last_change":"2024-09-12T02:23:15.831604+0000","last_active":"2024-09-12T02:23:17.841725+0000","last_peered":"2024-09-12T02:23:17.841725+0000","last_clean":"2024-09-12T02:23:17.841725+0000","last_became_active":"2024-09-12T02:23:15.831292+0000","last_became_peered":"2024-09-12T02:23:15.831292+0000","last_unstale":"2024-09-12T02:23:17.841725+0000","last_undegraded":"2024-09-12T02:23:17.841725+0000","last_fullsized":"2024-09-12T02:23:17.841725+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:30.234721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.844486+0000","last_change":"2024-09-12T02:23:16.842506+0000","last_active":"2024-09-12T02:23:16.844486+0000","last_peered":"2024-09-12T02:23:16.844486+0000","last_clean":"2024-09-12T02:23:16.844486+0000","last_became_active":"2024-09-12T02:23:16.842210+0000","last_became_peered":"2024-09-12T02:23:16.842210+0000","last_unstale":"2024-09-12T02:23:16.844486+0000","last_undegraded":"2024-09-12T02:23:16.844486+0000","last_fullsized":"2024-09-12T02:23:16.844486+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:44.854807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.833892+0000","last_change":"2024-09-12T02:23:04.782769+0000","last_active":"2024-09-12T02:23:16.833892+0000","last_peered":"2024-09-12T02:23:16.833892+0000","last_clean":"2024-09-12T02:23:16.833892+0000","last_became_active":"2024-09-12T02:23:04.782472+0000","last_became_peered":"2024-09-12T02:23:04.782472+0000","last_unstale":"2024-09-12T02:23:16.833892+0000","last_undegraded":"2024-09-12T02:23:16.833892+0000","last_fullsized":"2024-09-12T02:23:16.833892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:46.144471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.839976+0000","last_change":"2024-09-12T02:23:03.771468+0000","last_active":"2024-09-12T02:23:16.839976+0000","last_peered":"2024-09-12T02:23:16.839976+0000","last_clean":"2024-09-12T02:23:16.839976+0000","last_became_active":"2024-09-12T02:23:03.769619+0000","last_became_peered":"2024-09-12T02:23:03.769619+0000","last_unstale":"2024-09-12T02:23:16.839976+0000","last_undegraded":"2024-09-12T02:23:16.839976+0000","last_fullsized":"2024-09-12T02:23:16.839976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:38.422369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841394+0000","last_change":"2024-09-12T02:23:15.833359+0000","last_active":"2024-09-12T02:23:17.841394+0000","last_peered":"2024-09-12T02:23:17.841394+0000","last_clean":"2024-09-12T02:23:17.841394+0000","last_became_active":"2024-09-12T02:23:15.832995+0000","last_became_peered":"2024-09-12T02:23:15.832995+0000","last_unstale":"2024-09-12T02:23:17.841394+0000","last_undegraded":"2024-09-12T02:23:17.841394+0000","last_fullsized":"2024-09-12T02:23:17.841394+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:57.922845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841919+0000","last_change":"2024-09-12T02:23:16.856439+0000","last_active":"2024-09-12T02:23:17.841919+0000","last_peered":"2024-09-12T02:23:17.841919+0000","last_clean":"2024-09-12T02:23:17.841919+0000","last_became_active":"2024-09-12T02:23:16.856166+0000","last_became_peered":"2024-09-12T02:23:16.856166+0000","last_unstale":"2024-09-12T02:23:17.841919+0000","last_undegraded":"2024-09-12T02:23:17.841919+0000","last_fullsized":"2024-09-12T02:23:17.841919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:42:56.534517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.831348+0000","last_change":"2024-09-12T02:23:04.783991+0000","last_active":"2024-09-12T02:23:16.831348+0000","last_peered":"2024-09-12T02:23:16.831348+0000","last_clean":"2024-09-12T02:23:16.831348+0000","last_became_active":"2024-09-12T02:23:04.783143+0000","last_became_peered":"2024-09-12T02:23:04.783143+0000","last_unstale":"2024-09-12T02:23:16.831348+0000","last_undegraded":"2024-09-12T02:23:16.831348+0000","last_fullsized":"2024-09-12T02:23:16.831348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:53.940843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.839097+0000","last_change":"2024-09-12T02:23:03.770581+0000","last_active":"2024-09-12T02:23:16.839097+0000","last_peered":"2024-09-12T02:23:16.839097+0000","last_clean":"2024-09-12T02:23:16.839097+0000","last_became_active":"2024-09-12T02:23:03.769406+0000","last_became_peered":"2024-09-12T02:23:03.769406+0000","last_unstale":"2024-09-12T02:23:16.839097+0000","last_undegraded":"2024-09-12T02:23:16.839097+0000","last_fullsized":"2024-09-12T02:23:16.839097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:20.963819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"25'1","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.857964+0000","last_change":"2024-09-12T02:23:15.835033+0000","last_active":"2024-09-12T02:23:16.857964+0000","last_peered":"2024-09-12T02:23:16.857964+0000","last_clean":"2024-09-12T02:23:16.857964+0000","last_became_active":"2024-09-12T02:23:15.834753+0000","last_became_peered":"2024-09-12T02:23:15.834753+0000","last_unstale":"2024-09-12T02:23:16.857964+0000","last_undegraded":"2024-09-12T02:23:16.857964+0000","last_fullsized":"2024-09-12T02:23:16.857964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:57.434162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.326093+0000","last_change":"2024-09-12T02:23:16.860867+0000","last_active":"2024-09-12T02:23:18.326093+0000","last_peered":"2024-09-12T02:23:18.326093+0000","last_clean":"2024-09-12T02:23:18.326093+0000","last_became_active":"2024-09-12T02:23:16.860656+0000","last_became_peered":"2024-09-12T02:23:16.860656+0000","last_unstale":"2024-09-12T02:23:18.326093+0000","last_undegraded":"2024-09-12T02:23:18.326093+0000","last_fullsized":"2024-09-12T02:23:18.326093+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:11.375287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842133+0000","last_change":"2024-09-12T02:23:04.780821+0000","last_active":"2024-09-12T02:23:17.842133+0000","last_peered":"2024-09-12T02:23:17.842133+0000","last_clean":"2024-09-12T02:23:17.842133+0000","last_became_active":"2024-09-12T02:23:04.779984+0000","last_became_peered":"2024-09-12T02:23:04.779984+0000","last_unstale":"2024-09-12T02:23:17.842133+0000","last_undegraded":"2024-09-12T02:23:17.842133+0000","last_fullsized":"2024-09-12T02:23:17.842133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:25.724116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841013+0000","last_change":"2024-09-12T02:23:03.764530+0000","last_active":"2024-09-12T02:23:17.841013+0000","last_peered":"2024-09-12T02:23:17.841013+0000","last_clean":"2024-09-12T02:23:17.841013+0000","last_became_active":"2024-09-12T02:23:03.764218+0000","last_became_peered":"2024-09-12T02:23:03.764218+0000","last_unstale":"2024-09-12T02:23:17.841013+0000","last_undegraded":"2024-09-12T02:23:17.841013+0000","last_fullsized":"2024-09-12T02:23:17.841013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:55.445619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842053+0000","last_change":"2024-09-12T02:23:15.831621+0000","last_active":"2024-09-12T02:23:17.842053+0000","last_peered":"2024-09-12T02:23:17.842053+0000","last_clean":"2024-09-12T02:23:17.842053+0000","last_became_active":"2024-09-12T02:23:15.831331+0000","last_became_peered":"2024-09-12T02:23:15.831331+0000","last_unstale":"2024-09-12T02:23:17.842053+0000","last_undegraded":"2024-09-12T02:23:17.842053+0000","last_fullsized":"2024-09-12T02:23:17.842053+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:06.494392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.855121+0000","last_change":"2024-09-12T02:23:16.847556+0000","last_active":"2024-09-12T02:23:16.855121+0000","last_peered":"2024-09-12T02:23:16.855121+0000","last_clean":"2024-09-12T02:23:16.855121+0000","last_became_active":"2024-09-12T02:23:16.845749+0000","last_became_peered":"2024-09-12T02:23:16.845749+0000","last_unstale":"2024-09-12T02:23:16.855121+0000","last_undegraded":"2024-09-12T02:23:16.855121+0000","last_fullsized":"2024-09-12T02:23:16.855121+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:41.469242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.332030+0000","last_change":"2024-09-12T02:23:04.786895+0000","last_active":"2024-09-12T02:23:18.332030+0000","last_peered":"2024-09-12T02:23:18.332030+0000","last_clean":"2024-09-12T02:23:18.332030+0000","last_became_active":"2024-09-12T02:23:04.786591+0000","last_became_peered":"2024-09-12T02:23:04.786591+0000","last_unstale":"2024-09-12T02:23:18.332030+0000","last_undegraded":"2024-09-12T02:23:18.332030+0000","last_fullsized":"2024-09-12T02:23:18.332030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:14.751707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.832025+0000","last_change":"2024-09-12T02:23:03.771259+0000","last_active":"2024-09-12T02:23:16.832025+0000","last_peered":"2024-09-12T02:23:16.832025+0000","last_clean":"2024-09-12T02:23:16.832025+0000","last_became_active":"2024-09-12T02:23:03.770687+0000","last_became_peered":"2024-09-12T02:23:03.770687+0000","last_unstale":"2024-09-12T02:23:16.832025+0000","last_undegraded":"2024-09-12T02:23:16.832025+0000","last_fullsized":"2024-09-12T02:23:16.832025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:38.516959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841319+0000","last_change":"2024-09-12T02:23:15.829406+0000","last_active":"2024-09-12T02:23:17.841319+0000","last_peered":"2024-09-12T02:23:17.841319+0000","last_clean":"2024-09-12T02:23:17.841319+0000","last_became_active":"2024-09-12T02:23:15.829135+0000","last_became_peered":"2024-09-12T02:23:15.829135+0000","last_unstale":"2024-09-12T02:23:17.841319+0000","last_undegraded":"2024-09-12T02:23:17.841319+0000","last_fullsized":"2024-09-12T02:23:17.841319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:22.365804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840867+0000","last_change":"2024-09-12T02:23:16.857016+0000","last_active":"2024-09-12T02:23:17.840867+0000","last_peered":"2024-09-12T02:23:17.840867+0000","last_clean":"2024-09-12T02:23:17.840867+0000","last_became_active":"2024-09-12T02:23:16.856705+0000","last_became_peered":"2024-09-12T02:23:16.856705+0000","last_unstale":"2024-09-12T02:23:17.840867+0000","last_undegraded":"2024-09-12T02:23:17.840867+0000","last_fullsized":"2024-09-12T02:23:17.840867+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:03.672668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.837861+0000","last_change":"2024-09-12T02:23:04.786424+0000","last_active":"2024-09-12T02:23:16.837861+0000","last_peered":"2024-09-12T02:23:16.837861+0000","last_clean":"2024-09-12T02:23:16.837861+0000","last_became_active":"2024-09-12T02:23:04.786136+0000","last_became_peered":"2024-09-12T02:23:04.786136+0000","last_unstale":"2024-09-12T02:23:16.837861+0000","last_undegraded":"2024-09-12T02:23:16.837861+0000","last_fullsized":"2024-09-12T02:23:16.837861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:31.214894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.841191+0000","last_change":"2024-09-12T02:23:03.769745+0000","last_active":"2024-09-12T02:23:16.841191+0000","last_peered":"2024-09-12T02:23:16.841191+0000","last_clean":"2024-09-12T02:23:16.841191+0000","last_became_active":"2024-09-12T02:23:03.769410+0000","last_became_peered":"2024-09-12T02:23:03.769410+0000","last_unstale":"2024-09-12T02:23:16.841191+0000","last_undegraded":"2024-09-12T02:23:16.841191+0000","last_fullsized":"2024-09-12T02:23:16.841191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:00.414459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.830847+0000","last_change":"2024-09-12T02:23:15.827211+0000","last_active":"2024-09-12T02:23:16.830847+0000","last_peered":"2024-09-12T02:23:16.830847+0000","last_clean":"2024-09-12T02:23:16.830847+0000","last_became_active":"2024-09-12T02:23:15.826564+0000","last_became_peered":"2024-09-12T02:23:15.826564+0000","last_unstale":"2024-09-12T02:23:16.830847+0000","last_undegraded":"2024-09-12T02:23:16.830847+0000","last_fullsized":"2024-09-12T02:23:16.830847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:32.389443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.840526+0000","last_change":"2024-09-12T02:23:16.837434+0000","last_active":"2024-09-12T02:23:16.840526+0000","last_peered":"2024-09-12T02:23:16.840526+0000","last_clean":"2024-09-12T02:23:16.840526+0000","last_became_active":"2024-09-12T02:23:16.837162+0000","last_became_peered":"2024-09-12T02:23:16.837162+0000","last_unstale":"2024-09-12T02:23:16.840526+0000","last_undegraded":"2024-09-12T02:23:16.840526+0000","last_fullsized":"2024-09-12T02:23:16.840526+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:28.010927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.842375+0000","last_change":"2024-09-12T02:23:04.775876+0000","last_active":"2024-09-12T02:23:16.842375+0000","last_peered":"2024-09-12T02:23:16.842375+0000","last_clean":"2024-09-12T02:23:16.842375+0000","last_became_active":"2024-09-12T02:23:04.775571+0000","last_became_peered":"2024-09-12T02:23:04.775571+0000","last_unstale":"2024-09-12T02:23:16.842375+0000","last_undegraded":"2024-09-12T02:23:16.842375+0000","last_fullsized":"2024-09-12T02:23:16.842375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:05.070528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842890+0000","last_change":"2024-09-12T02:23:03.764093+0000","last_active":"2024-09-12T02:23:17.842890+0000","last_peered":"2024-09-12T02:23:17.842890+0000","last_clean":"2024-09-12T02:23:17.842890+0000","last_became_active":"2024-09-12T02:23:03.763147+0000","last_became_peered":"2024-09-12T02:23:03.763147+0000","last_unstale":"2024-09-12T02:23:17.842890+0000","last_undegraded":"2024-09-12T02:23:17.842890+0000","last_fullsized":"2024-09-12T02:23:17.842890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:13.317894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331728+0000","last_change":"2024-09-12T02:23:15.832461+0000","last_active":"2024-09-12T02:23:18.331728+0000","last_peered":"2024-09-12T02:23:18.331728+0000","last_clean":"2024-09-12T02:23:18.331728+0000","last_became_active":"2024-09-12T02:23:15.831637+0000","last_became_peered":"2024-09-12T02:23:15.831637+0000","last_unstale":"2024-09-12T02:23:18.331728+0000","last_undegraded":"2024-09-12T02:23:18.331728+0000","last_fullsized":"2024-09-12T02:23:18.331728+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:30.909927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.332020+0000","last_change":"2024-09-12T02:23:16.835824+0000","last_active":"2024-09-12T02:23:18.332020+0000","last_peered":"2024-09-12T02:23:18.332020+0000","last_clean":"2024-09-12T02:23:18.332020+0000","last_became_active":"2024-09-12T02:23:16.835520+0000","last_became_peered":"2024-09-12T02:23:16.835520+0000","last_unstale":"2024-09-12T02:23:18.332020+0000","last_undegraded":"2024-09-12T02:23:18.332020+0000","last_fullsized":"2024-09-12T02:23:18.332020+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:32.797100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.326009+0000","last_change":"2024-09-12T02:23:04.787557+0000","last_active":"2024-09-12T02:23:18.326009+0000","last_peered":"2024-09-12T02:23:18.326009+0000","last_clean":"2024-09-12T02:23:18.326009+0000","last_became_active":"2024-09-12T02:23:04.786527+0000","last_became_peered":"2024-09-12T02:23:04.786527+0000","last_unstale":"2024-09-12T02:23:18.326009+0000","last_undegraded":"2024-09-12T02:23:18.326009+0000","last_fullsized":"2024-09-12T02:23:18.326009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:23.273457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.842481+0000","last_change":"2024-09-12T02:23:03.769913+0000","last_active":"2024-09-12T02:23:16.842481+0000","last_peered":"2024-09-12T02:23:16.842481+0000","last_clean":"2024-09-12T02:23:16.842481+0000","last_became_active":"2024-09-12T02:23:03.769444+0000","last_became_peered":"2024-09-12T02:23:03.769444+0000","last_unstale":"2024-09-12T02:23:16.842481+0000","last_undegraded":"2024-09-12T02:23:16.842481+0000","last_fullsized":"2024-09-12T02:23:16.842481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:21.243182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.839694+0000","last_change":"2024-09-12T02:23:15.829080+0000","last_active":"2024-09-12T02:23:16.839694+0000","last_peered":"2024-09-12T02:23:16.839694+0000","last_clean":"2024-09-12T02:23:16.839694+0000","last_became_active":"2024-09-12T02:23:15.828256+0000","last_became_peered":"2024-09-12T02:23:15.828256+0000","last_unstale":"2024-09-12T02:23:16.839694+0000","last_undegraded":"2024-09-12T02:23:16.839694+0000","last_fullsized":"2024-09-12T02:23:16.839694+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:07.743952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331720+0000","last_change":"2024-09-12T02:23:16.845710+0000","last_active":"2024-09-12T02:23:18.331720+0000","last_peered":"2024-09-12T02:23:18.331720+0000","last_clean":"2024-09-12T02:23:18.331720+0000","last_became_active":"2024-09-12T02:23:16.845379+0000","last_became_peered":"2024-09-12T02:23:16.845379+0000","last_unstale":"2024-09-12T02:23:18.331720+0000","last_undegraded":"2024-09-12T02:23:18.331720+0000","last_fullsized":"2024-09-12T02:23:18.331720+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:16.769410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842948+0000","last_change":"2024-09-12T02:23:04.790723+0000","last_active":"2024-09-12T02:23:17.842948+0000","last_peered":"2024-09-12T02:23:17.842948+0000","last_clean":"2024-09-12T02:23:17.842948+0000","last_became_active":"2024-09-12T02:23:04.786877+0000","last_became_peered":"2024-09-12T02:23:04.786877+0000","last_unstale":"2024-09-12T02:23:17.842948+0000","last_undegraded":"2024-09-12T02:23:17.842948+0000","last_fullsized":"2024-09-12T02:23:17.842948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:48.516002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325581+0000","last_change":"2024-09-12T02:23:03.771518+0000","last_active":"2024-09-12T02:23:18.325581+0000","last_peered":"2024-09-12T02:23:18.325581+0000","last_clean":"2024-09-12T02:23:18.325581+0000","last_became_active":"2024-09-12T02:23:03.771063+0000","last_became_peered":"2024-09-12T02:23:03.771063+0000","last_unstale":"2024-09-12T02:23:18.325581+0000","last_undegraded":"2024-09-12T02:23:18.325581+0000","last_fullsized":"2024-09-12T02:23:18.325581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:43.974555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.842318+0000","last_change":"2024-09-12T02:23:15.827028+0000","last_active":"2024-09-12T02:23:16.842318+0000","last_peered":"2024-09-12T02:23:16.842318+0000","last_clean":"2024-09-12T02:23:16.842318+0000","last_became_active":"2024-09-12T02:23:15.826708+0000","last_became_peered":"2024-09-12T02:23:15.826708+0000","last_unstale":"2024-09-12T02:23:16.842318+0000","last_undegraded":"2024-09-12T02:23:16.842318+0000","last_fullsized":"2024-09-12T02:23:16.842318+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:34.642396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.853100+0000","last_change":"2024-09-12T02:23:16.849429+0000","last_active":"2024-09-12T02:23:16.853100+0000","last_peered":"2024-09-12T02:23:16.853100+0000","last_clean":"2024-09-12T02:23:16.853100+0000","last_became_active":"2024-09-12T02:23:16.849119+0000","last_became_peered":"2024-09-12T02:23:16.849119+0000","last_unstale":"2024-09-12T02:23:16.853100+0000","last_undegraded":"2024-09-12T02:23:16.853100+0000","last_fullsized":"2024-09-12T02:23:16.853100+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:41.277947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.834936+0000","last_change":"2024-09-12T02:23:04.773745+0000","last_active":"2024-09-12T02:23:16.834936+0000","last_peered":"2024-09-12T02:23:16.834936+0000","last_clean":"2024-09-12T02:23:16.834936+0000","last_became_active":"2024-09-12T02:23:04.773360+0000","last_became_peered":"2024-09-12T02:23:04.773360+0000","last_unstale":"2024-09-12T02:23:16.834936+0000","last_undegraded":"2024-09-12T02:23:16.834936+0000","last_fullsized":"2024-09-12T02:23:16.834936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:33.097774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.827184+0000","last_change":"2024-09-12T02:23:03.760700+0000","last_active":"2024-09-12T02:23:16.827184+0000","last_peered":"2024-09-12T02:23:16.827184+0000","last_clean":"2024-09-12T02:23:16.827184+0000","last_became_active":"2024-09-12T02:23:03.760397+0000","last_became_peered":"2024-09-12T02:23:03.760397+0000","last_unstale":"2024-09-12T02:23:16.827184+0000","last_undegraded":"2024-09-12T02:23:16.827184+0000","last_fullsized":"2024-09-12T02:23:16.827184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:36.788864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"25'2","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.861535+0000","last_change":"2024-09-12T02:23:15.828714+0000","last_active":"2024-09-12T02:23:16.861535+0000","last_peered":"2024-09-12T02:23:16.861535+0000","last_clean":"2024-09-12T02:23:16.861535+0000","last_became_active":"2024-09-12T02:23:15.827458+0000","last_became_peered":"2024-09-12T02:23:15.827458+0000","last_unstale":"2024-09-12T02:23:16.861535+0000","last_undegraded":"2024-09-12T02:23:16.861535+0000","last_fullsized":"2024-09-12T02:23:16.861535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:12.581897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.326108+0000","last_change":"2024-09-12T02:23:16.855212+0000","last_active":"2024-09-12T02:23:18.326108+0000","last_peered":"2024-09-12T02:23:18.326108+0000","last_clean":"2024-09-12T02:23:18.326108+0000","last_became_active":"2024-09-12T02:23:16.854938+0000","last_became_peered":"2024-09-12T02:23:16.854938+0000","last_unstale":"2024-09-12T02:23:18.326108+0000","last_undegraded":"2024-09-12T02:23:18.326108+0000","last_fullsized":"2024-09-12T02:23:18.326108+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:02.944057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331430+0000","last_change":"2024-09-12T02:23:04.787820+0000","last_active":"2024-09-12T02:23:18.331430+0000","last_peered":"2024-09-12T02:23:18.331430+0000","last_clean":"2024-09-12T02:23:18.331430+0000","last_became_active":"2024-09-12T02:23:04.787523+0000","last_became_peered":"2024-09-12T02:23:04.787523+0000","last_unstale":"2024-09-12T02:23:18.331430+0000","last_undegraded":"2024-09-12T02:23:18.331430+0000","last_fullsized":"2024-09-12T02:23:18.331430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:52.784171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841124+0000","last_change":"2024-09-12T02:23:03.771625+0000","last_active":"2024-09-12T02:23:17.841124+0000","last_peered":"2024-09-12T02:23:17.841124+0000","last_clean":"2024-09-12T02:23:17.841124+0000","last_became_active":"2024-09-12T02:23:03.771163+0000","last_became_peered":"2024-09-12T02:23:03.771163+0000","last_unstale":"2024-09-12T02:23:17.841124+0000","last_undegraded":"2024-09-12T02:23:17.841124+0000","last_fullsized":"2024-09-12T02:23:17.841124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:32.772569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331906+0000","last_change":"2024-09-12T02:23:15.833889+0000","last_active":"2024-09-12T02:23:18.331906+0000","last_peered":"2024-09-12T02:23:18.331906+0000","last_clean":"2024-09-12T02:23:18.331906+0000","last_became_active":"2024-09-12T02:23:15.833587+0000","last_became_peered":"2024-09-12T02:23:15.833587+0000","last_unstale":"2024-09-12T02:23:18.331906+0000","last_undegraded":"2024-09-12T02:23:18.331906+0000","last_fullsized":"2024-09-12T02:23:18.331906+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:32.787861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842295+0000","last_change":"2024-09-12T02:23:16.848864+0000","last_active":"2024-09-12T02:23:17.842295+0000","last_peered":"2024-09-12T02:23:17.842295+0000","last_clean":"2024-09-12T02:23:17.842295+0000","last_became_active":"2024-09-12T02:23:16.848385+0000","last_became_peered":"2024-09-12T02:23:16.848385+0000","last_unstale":"2024-09-12T02:23:17.842295+0000","last_undegraded":"2024-09-12T02:23:17.842295+0000","last_fullsized":"2024-09-12T02:23:17.842295+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:03.656397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.833443+0000","last_change":"2024-09-12T02:23:04.781839+0000","last_active":"2024-09-12T02:23:16.833443+0000","last_peered":"2024-09-12T02:23:16.833443+0000","last_clean":"2024-09-12T02:23:16.833443+0000","last_became_active":"2024-09-12T02:23:04.780984+0000","last_became_peered":"2024-09-12T02:23:04.780984+0000","last_unstale":"2024-09-12T02:23:16.833443+0000","last_undegraded":"2024-09-12T02:23:16.833443+0000","last_fullsized":"2024-09-12T02:23:16.833443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:07.692791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325299+0000","last_change":"2024-09-12T02:23:03.765100+0000","last_active":"2024-09-12T02:23:18.325299+0000","last_peered":"2024-09-12T02:23:18.325299+0000","last_clean":"2024-09-12T02:23:18.325299+0000","last_became_active":"2024-09-12T02:23:03.764801+0000","last_became_peered":"2024-09-12T02:23:03.764801+0000","last_unstale":"2024-09-12T02:23:18.325299+0000","last_undegraded":"2024-09-12T02:23:18.325299+0000","last_fullsized":"2024-09-12T02:23:18.325299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:06.891040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":178,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841644+0000","last_change":"2024-09-12T02:22:55.143869+0000","last_active":"2024-09-12T02:23:17.841644+0000","last_peered":"2024-09-12T02:23:17.841644+0000","last_clean":"2024-09-12T02:23:17.841644+0000","last_became_active":"2024-09-12T02:22:55.142784+0000","last_became_peered":"2024-09-12T02:22:55.142784+0000","last_unstale":"2024-09-12T02:23:17.841644+0000","last_undegraded":"2024-09-12T02:23:17.841644+0000","last_fullsized":"2024-09-12T02:23:17.841644+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:22:52.457979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:22:52.457979+0000","last_clean_scrub_stamp":"2024-09-12T02:22:52.457979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:46.152602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.831093+0000","last_change":"2024-09-12T02:23:15.831362+0000","last_active":"2024-09-12T02:23:16.831093+0000","last_peered":"2024-09-12T02:23:16.831093+0000","last_clean":"2024-09-12T02:23:16.831093+0000","last_became_active":"2024-09-12T02:23:15.831084+0000","last_became_peered":"2024-09-12T02:23:15.831084+0000","last_unstale":"2024-09-12T02:23:16.831093+0000","last_undegraded":"2024-09-12T02:23:16.831093+0000","last_fullsized":"2024-09-12T02:23:16.831093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:17.754173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.841864+0000","last_change":"2024-09-12T02:23:16.838831+0000","last_active":"2024-09-12T02:23:16.841864+0000","last_peered":"2024-09-12T02:23:16.841864+0000","last_clean":"2024-09-12T02:23:16.841864+0000","last_became_active":"2024-09-12T02:23:16.838523+0000","last_became_peered":"2024-09-12T02:23:16.838523+0000","last_unstale":"2024-09-12T02:23:16.841864+0000","last_undegraded":"2024-09-12T02:23:16.841864+0000","last_fullsized":"2024-09-12T02:23:16.841864+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:57.462030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842398+0000","last_change":"2024-09-12T02:23:04.783483+0000","last_active":"2024-09-12T02:23:17.842398+0000","last_peered":"2024-09-12T02:23:17.842398+0000","last_clean":"2024-09-12T02:23:17.842398+0000","last_became_active":"2024-09-12T02:23:04.782878+0000","last_became_peered":"2024-09-12T02:23:04.782878+0000","last_unstale":"2024-09-12T02:23:17.842398+0000","last_undegraded":"2024-09-12T02:23:17.842398+0000","last_fullsized":"2024-09-12T02:23:17.842398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:52.335065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.827972+0000","last_change":"2024-09-12T02:23:03.762507+0000","last_active":"2024-09-12T02:23:16.827972+0000","last_peered":"2024-09-12T02:23:16.827972+0000","last_clean":"2024-09-12T02:23:16.827972+0000","last_became_active":"2024-09-12T02:23:03.762164+0000","last_became_peered":"2024-09-12T02:23:03.762164+0000","last_unstale":"2024-09-12T02:23:16.827972+0000","last_undegraded":"2024-09-12T02:23:16.827972+0000","last_fullsized":"2024-09-12T02:23:16.827972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:34.569630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.830673+0000","last_change":"2024-09-12T02:23:15.830783+0000","last_active":"2024-09-12T02:23:16.830673+0000","last_peered":"2024-09-12T02:23:16.830673+0000","last_clean":"2024-09-12T02:23:16.830673+0000","last_became_active":"2024-09-12T02:23:15.830471+0000","last_became_peered":"2024-09-12T02:23:15.830471+0000","last_unstale":"2024-09-12T02:23:16.830673+0000","last_undegraded":"2024-09-12T02:23:16.830673+0000","last_fullsized":"2024-09-12T02:23:16.830673+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:22.927201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.857557+0000","last_change":"2024-09-12T02:23:16.856328+0000","last_active":"2024-09-12T02:23:16.857557+0000","last_peered":"2024-09-12T02:23:16.857557+0000","last_clean":"2024-09-12T02:23:16.857557+0000","last_became_active":"2024-09-12T02:23:16.855992+0000","last_became_peered":"2024-09-12T02:23:16.855992+0000","last_unstale":"2024-09-12T02:23:16.857557+0000","last_undegraded":"2024-09-12T02:23:16.857557+0000","last_fullsized":"2024-09-12T02:23:16.857557+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:01.262313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325763+0000","last_change":"2024-09-12T02:23:04.784318+0000","last_active":"2024-09-12T02:23:18.325763+0000","last_peered":"2024-09-12T02:23:18.325763+0000","last_clean":"2024-09-12T02:23:18.325763+0000","last_became_active":"2024-09-12T02:23:04.784012+0000","last_became_peered":"2024-09-12T02:23:04.784012+0000","last_unstale":"2024-09-12T02:23:18.325763+0000","last_undegraded":"2024-09-12T02:23:18.325763+0000","last_fullsized":"2024-09-12T02:23:18.325763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:51.352859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.840569+0000","last_change":"2024-09-12T02:23:03.766034+0000","last_active":"2024-09-12T02:23:16.840569+0000","last_peered":"2024-09-12T02:23:16.840569+0000","last_clean":"2024-09-12T02:23:16.840569+0000","last_became_active":"2024-09-12T02:23:03.765735+0000","last_became_peered":"2024-09-12T02:23:03.765735+0000","last_unstale":"2024-09-12T02:23:16.840569+0000","last_undegraded":"2024-09-12T02:23:16.840569+0000","last_fullsized":"2024-09-12T02:23:16.840569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:19.691229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331594+0000","last_change":"2024-09-12T02:23:15.832527+0000","last_active":"2024-09-12T02:23:18.331594+0000","last_peered":"2024-09-12T02:23:18.331594+0000","last_clean":"2024-09-12T02:23:18.331594+0000","last_became_active":"2024-09-12T02:23:15.832184+0000","last_became_peered":"2024-09-12T02:23:15.832184+0000","last_unstale":"2024-09-12T02:23:18.331594+0000","last_undegraded":"2024-09-12T02:23:18.331594+0000","last_fullsized":"2024-09-12T02:23:18.331594+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:29.131198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840742+0000","last_change":"2024-09-12T02:23:16.849357+0000","last_active":"2024-09-12T02:23:17.840742+0000","last_peered":"2024-09-12T02:23:17.840742+0000","last_clean":"2024-09-12T02:23:17.840742+0000","last_became_active":"2024-09-12T02:23:16.849067+0000","last_became_peered":"2024-09-12T02:23:16.849067+0000","last_unstale":"2024-09-12T02:23:17.840742+0000","last_undegraded":"2024-09-12T02:23:17.840742+0000","last_fullsized":"2024-09-12T02:23:17.840742+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:06.887523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.843122+0000","last_change":"2024-09-12T02:23:04.791152+0000","last_active":"2024-09-12T02:23:17.843122+0000","last_peered":"2024-09-12T02:23:17.843122+0000","last_clean":"2024-09-12T02:23:17.843122+0000","last_became_active":"2024-09-12T02:23:04.790707+0000","last_became_peered":"2024-09-12T02:23:04.790707+0000","last_unstale":"2024-09-12T02:23:17.843122+0000","last_undegraded":"2024-09-12T02:23:17.843122+0000","last_fullsized":"2024-09-12T02:23:17.843122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:42.798507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.827531+0000","last_change":"2024-09-12T02:23:03.763327+0000","last_active":"2024-09-12T02:23:16.827531+0000","last_peered":"2024-09-12T02:23:16.827531+0000","last_clean":"2024-09-12T02:23:16.827531+0000","last_became_active":"2024-09-12T02:23:03.763005+0000","last_became_peered":"2024-09-12T02:23:03.763005+0000","last_unstale":"2024-09-12T02:23:16.827531+0000","last_undegraded":"2024-09-12T02:23:16.827531+0000","last_fullsized":"2024-09-12T02:23:16.827531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:09.500459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325022+0000","last_change":"2024-09-12T02:23:15.819644+0000","last_active":"2024-09-12T02:23:18.325022+0000","last_peered":"2024-09-12T02:23:18.325022+0000","last_clean":"2024-09-12T02:23:18.325022+0000","last_became_active":"2024-09-12T02:23:15.819370+0000","last_became_peered":"2024-09-12T02:23:15.819370+0000","last_unstale":"2024-09-12T02:23:18.325022+0000","last_undegraded":"2024-09-12T02:23:18.325022+0000","last_fullsized":"2024-09-12T02:23:18.325022+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:56.384531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.841813+0000","last_change":"2024-09-12T02:23:16.838234+0000","last_active":"2024-09-12T02:23:16.841813+0000","last_peered":"2024-09-12T02:23:16.841813+0000","last_clean":"2024-09-12T02:23:16.841813+0000","last_became_active":"2024-09-12T02:23:16.837942+0000","last_became_peered":"2024-09-12T02:23:16.837942+0000","last_unstale":"2024-09-12T02:23:16.841813+0000","last_undegraded":"2024-09-12T02:23:16.841813+0000","last_fullsized":"2024-09-12T02:23:16.841813+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:18.312476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842558+0000","last_change":"2024-09-12T02:23:04.781196+0000","last_active":"2024-09-12T02:23:17.842558+0000","last_peered":"2024-09-12T02:23:17.842558+0000","last_clean":"2024-09-12T02:23:17.842558+0000","last_became_active":"2024-09-12T02:23:04.780893+0000","last_became_peered":"2024-09-12T02:23:04.780893+0000","last_unstale":"2024-09-12T02:23:17.842558+0000","last_undegraded":"2024-09-12T02:23:17.842558+0000","last_fullsized":"2024-09-12T02:23:17.842558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:26.527539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842742+0000","last_change":"2024-09-12T02:23:03.769541+0000","last_active":"2024-09-12T02:23:17.842742+0000","last_peered":"2024-09-12T02:23:17.842742+0000","last_clean":"2024-09-12T02:23:17.842742+0000","last_became_active":"2024-09-12T02:23:03.765281+0000","last_became_peered":"2024-09-12T02:23:03.765281+0000","last_unstale":"2024-09-12T02:23:17.842742+0000","last_undegraded":"2024-09-12T02:23:17.842742+0000","last_fullsized":"2024-09-12T02:23:17.842742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:53.409370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841039+0000","last_change":"2024-09-12T02:23:15.841592+0000","last_active":"2024-09-12T02:23:17.841039+0000","last_peered":"2024-09-12T02:23:17.841039+0000","last_clean":"2024-09-12T02:23:17.841039+0000","last_became_active":"2024-09-12T02:23:15.841380+0000","last_became_peered":"2024-09-12T02:23:15.841380+0000","last_unstale":"2024-09-12T02:23:17.841039+0000","last_undegraded":"2024-09-12T02:23:17.841039+0000","last_fullsized":"2024-09-12T02:23:17.841039+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:38.396332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.853890+0000","last_change":"2024-09-12T02:23:16.846596+0000","last_active":"2024-09-12T02:23:16.853890+0000","last_peered":"2024-09-12T02:23:16.853890+0000","last_clean":"2024-09-12T02:23:16.853890+0000","last_became_active":"2024-09-12T02:23:16.846273+0000","last_became_peered":"2024-09-12T02:23:16.846273+0000","last_unstale":"2024-09-12T02:23:16.853890+0000","last_undegraded":"2024-09-12T02:23:16.853890+0000","last_fullsized":"2024-09-12T02:23:16.853890+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:09:34.739118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841299+0000","last_change":"2024-09-12T02:23:04.781856+0000","last_active":"2024-09-12T02:23:17.841299+0000","last_peered":"2024-09-12T02:23:17.841299+0000","last_clean":"2024-09-12T02:23:17.841299+0000","last_became_active":"2024-09-12T02:23:04.781575+0000","last_became_peered":"2024-09-12T02:23:04.781575+0000","last_unstale":"2024-09-12T02:23:17.841299+0000","last_undegraded":"2024-09-12T02:23:17.841299+0000","last_fullsized":"2024-09-12T02:23:17.841299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:26.630558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.827052+0000","last_change":"2024-09-12T02:23:03.771368+0000","last_active":"2024-09-12T02:23:16.827052+0000","last_peered":"2024-09-12T02:23:16.827052+0000","last_clean":"2024-09-12T02:23:16.827052+0000","last_became_active":"2024-09-12T02:23:03.771061+0000","last_became_peered":"2024-09-12T02:23:03.771061+0000","last_unstale":"2024-09-12T02:23:16.827052+0000","last_undegraded":"2024-09-12T02:23:16.827052+0000","last_fullsized":"2024-09-12T02:23:16.827052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:57.476458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.332045+0000","last_change":"2024-09-12T02:23:15.833158+0000","last_active":"2024-09-12T02:23:18.332045+0000","last_peered":"2024-09-12T02:23:18.332045+0000","last_clean":"2024-09-12T02:23:18.332045+0000","last_became_active":"2024-09-12T02:23:15.831707+0000","last_became_peered":"2024-09-12T02:23:15.831707+0000","last_unstale":"2024-09-12T02:23:18.332045+0000","last_undegraded":"2024-09-12T02:23:18.332045+0000","last_fullsized":"2024-09-12T02:23:18.332045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:30.000066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325904+0000","last_change":"2024-09-12T02:23:16.858757+0000","last_active":"2024-09-12T02:23:18.325904+0000","last_peered":"2024-09-12T02:23:18.325904+0000","last_clean":"2024-09-12T02:23:18.325904+0000","last_became_active":"2024-09-12T02:23:16.858469+0000","last_became_peered":"2024-09-12T02:23:16.858469+0000","last_unstale":"2024-09-12T02:23:18.325904+0000","last_undegraded":"2024-09-12T02:23:18.325904+0000","last_fullsized":"2024-09-12T02:23:18.325904+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:22.288143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.830384+0000","last_change":"2024-09-12T02:23:04.785248+0000","last_active":"2024-09-12T02:23:16.830384+0000","last_peered":"2024-09-12T02:23:16.830384+0000","last_clean":"2024-09-12T02:23:16.830384+0000","last_became_active":"2024-09-12T02:23:04.784977+0000","last_became_peered":"2024-09-12T02:23:04.784977+0000","last_unstale":"2024-09-12T02:23:16.830384+0000","last_undegraded":"2024-09-12T02:23:16.830384+0000","last_fullsized":"2024-09-12T02:23:16.830384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:23.273457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.831341+0000","last_change":"2024-09-12T02:23:03.767842+0000","last_active":"2024-09-12T02:23:16.831341+0000","last_peered":"2024-09-12T02:23:16.831341+0000","last_clean":"2024-09-12T02:23:16.831341+0000","last_became_active":"2024-09-12T02:23:03.767066+0000","last_became_peered":"2024-09-12T02:23:03.767066+0000","last_unstale":"2024-09-12T02:23:16.831341+0000","last_undegraded":"2024-09-12T02:23:16.831341+0000","last_fullsized":"2024-09-12T02:23:16.831341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:50.800749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.837700+0000","last_change":"2024-09-12T02:23:15.826104+0000","last_active":"2024-09-12T02:23:16.837700+0000","last_peered":"2024-09-12T02:23:16.837700+0000","last_clean":"2024-09-12T02:23:16.837700+0000","last_became_active":"2024-09-12T02:23:15.825779+0000","last_became_peered":"2024-09-12T02:23:15.825779+0000","last_unstale":"2024-09-12T02:23:16.837700+0000","last_undegraded":"2024-09-12T02:23:16.837700+0000","last_fullsized":"2024-09-12T02:23:16.837700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:32.661083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325654+0000","last_change":"2024-09-12T02:23:16.856543+0000","last_active":"2024-09-12T02:23:18.325654+0000","last_peered":"2024-09-12T02:23:18.325654+0000","last_clean":"2024-09-12T02:23:18.325654+0000","last_became_active":"2024-09-12T02:23:16.855538+0000","last_became_peered":"2024-09-12T02:23:16.855538+0000","last_unstale":"2024-09-12T02:23:18.325654+0000","last_undegraded":"2024-09-12T02:23:18.325654+0000","last_fullsized":"2024-09-12T02:23:18.325654+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:05.857593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841758+0000","last_change":"2024-09-12T02:23:04.783671+0000","last_active":"2024-09-12T02:23:17.841758+0000","last_peered":"2024-09-12T02:23:17.841758+0000","last_clean":"2024-09-12T02:23:17.841758+0000","last_became_active":"2024-09-12T02:23:04.783399+0000","last_became_peered":"2024-09-12T02:23:04.783399+0000","last_unstale":"2024-09-12T02:23:17.841758+0000","last_undegraded":"2024-09-12T02:23:17.841758+0000","last_fullsized":"2024-09-12T02:23:17.841758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:04.321789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325480+0000","last_change":"2024-09-12T02:23:03.767217+0000","last_active":"2024-09-12T02:23:18.325480+0000","last_peered":"2024-09-12T02:23:18.325480+0000","last_clean":"2024-09-12T02:23:18.325480+0000","last_became_active":"2024-09-12T02:23:03.766551+0000","last_became_peered":"2024-09-12T02:23:03.766551+0000","last_unstale":"2024-09-12T02:23:18.325480+0000","last_undegraded":"2024-09-12T02:23:18.325480+0000","last_fullsized":"2024-09-12T02:23:18.325480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:09.963450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"25'6","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.864961+0000","last_change":"2024-09-12T02:23:15.832638+0000","last_active":"2024-09-12T02:23:16.864961+0000","last_peered":"2024-09-12T02:23:16.864961+0000","last_clean":"2024-09-12T02:23:16.864961+0000","last_became_active":"2024-09-12T02:23:15.832152+0000","last_became_peered":"2024-09-12T02:23:15.832152+0000","last_unstale":"2024-09-12T02:23:16.864961+0000","last_undegraded":"2024-09-12T02:23:16.864961+0000","last_fullsized":"2024-09-12T02:23:16.864961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:06.820636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.854363+0000","last_change":"2024-09-12T02:23:16.846920+0000","last_active":"2024-09-12T02:23:16.854363+0000","last_peered":"2024-09-12T02:23:16.854363+0000","last_clean":"2024-09-12T02:23:16.854363+0000","last_became_active":"2024-09-12T02:23:16.846454+0000","last_became_peered":"2024-09-12T02:23:16.846454+0000","last_unstale":"2024-09-12T02:23:16.854363+0000","last_undegraded":"2024-09-12T02:23:16.854363+0000","last_fullsized":"2024-09-12T02:23:16.854363+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:43.749228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331516+0000","last_change":"2024-09-12T02:23:04.784379+0000","last_active":"2024-09-12T02:23:18.331516+0000","last_peered":"2024-09-12T02:23:18.331516+0000","last_clean":"2024-09-12T02:23:18.331516+0000","last_became_active":"2024-09-12T02:23:04.784094+0000","last_became_peered":"2024-09-12T02:23:04.784094+0000","last_unstale":"2024-09-12T02:23:18.331516+0000","last_undegraded":"2024-09-12T02:23:18.331516+0000","last_fullsized":"2024-09-12T02:23:18.331516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:22.103008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.332137+0000","last_change":"2024-09-12T02:23:03.762859+0000","last_active":"2024-09-12T02:23:18.332137+0000","last_peered":"2024-09-12T02:23:18.332137+0000","last_clean":"2024-09-12T02:23:18.332137+0000","last_became_active":"2024-09-12T02:23:03.762557+0000","last_became_peered":"2024-09-12T02:23:03.762557+0000","last_unstale":"2024-09-12T02:23:18.332137+0000","last_undegraded":"2024-09-12T02:23:18.332137+0000","last_fullsized":"2024-09-12T02:23:18.332137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:34.863435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"25'3","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325835+0000","last_change":"2024-09-12T02:23:15.823090+0000","last_active":"2024-09-12T02:23:18.325835+0000","last_peered":"2024-09-12T02:23:18.325835+0000","last_clean":"2024-09-12T02:23:18.325835+0000","last_became_active":"2024-09-12T02:23:15.822441+0000","last_became_peered":"2024-09-12T02:23:15.822441+0000","last_unstale":"2024-09-12T02:23:18.325835+0000","last_undegraded":"2024-09-12T02:23:18.325835+0000","last_fullsized":"2024-09-12T02:23:18.325835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:35.125478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.841511+0000","last_change":"2024-09-12T02:23:16.839875+0000","last_active":"2024-09-12T02:23:16.841511+0000","last_peered":"2024-09-12T02:23:16.841511+0000","last_clean":"2024-09-12T02:23:16.841511+0000","last_became_active":"2024-09-12T02:23:16.838277+0000","last_became_peered":"2024-09-12T02:23:16.838277+0000","last_unstale":"2024-09-12T02:23:16.841511+0000","last_undegraded":"2024-09-12T02:23:16.841511+0000","last_fullsized":"2024-09-12T02:23:16.841511+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:23.327553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842288+0000","last_change":"2024-09-12T02:23:04.780843+0000","last_active":"2024-09-12T02:23:17.842288+0000","last_peered":"2024-09-12T02:23:17.842288+0000","last_clean":"2024-09-12T02:23:17.842288+0000","last_became_active":"2024-09-12T02:23:04.780475+0000","last_became_peered":"2024-09-12T02:23:04.780475+0000","last_unstale":"2024-09-12T02:23:17.842288+0000","last_undegraded":"2024-09-12T02:23:17.842288+0000","last_fullsized":"2024-09-12T02:23:17.842288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:38.074872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.830962+0000","last_change":"2024-09-12T02:23:03.768425+0000","last_active":"2024-09-12T02:23:16.830962+0000","last_peered":"2024-09-12T02:23:16.830962+0000","last_clean":"2024-09-12T02:23:16.830962+0000","last_became_active":"2024-09-12T02:23:03.768092+0000","last_became_peered":"2024-09-12T02:23:03.768092+0000","last_unstale":"2024-09-12T02:23:16.830962+0000","last_undegraded":"2024-09-12T02:23:16.830962+0000","last_fullsized":"2024-09-12T02:23:16.830962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:18.572070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.839523+0000","last_change":"2024-09-12T02:23:15.829364+0000","last_active":"2024-09-12T02:23:16.839523+0000","last_peered":"2024-09-12T02:23:16.839523+0000","last_clean":"2024-09-12T02:23:16.839523+0000","last_became_active":"2024-09-12T02:23:15.827936+0000","last_became_peered":"2024-09-12T02:23:15.827936+0000","last_unstale":"2024-09-12T02:23:16.839523+0000","last_undegraded":"2024-09-12T02:23:16.839523+0000","last_fullsized":"2024-09-12T02:23:16.839523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:04.973202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.857190+0000","last_change":"2024-09-12T02:23:16.854209+0000","last_active":"2024-09-12T02:23:16.857190+0000","last_peered":"2024-09-12T02:23:16.857190+0000","last_clean":"2024-09-12T02:23:16.857190+0000","last_became_active":"2024-09-12T02:23:16.853900+0000","last_became_peered":"2024-09-12T02:23:16.853900+0000","last_unstale":"2024-09-12T02:23:16.857190+0000","last_undegraded":"2024-09-12T02:23:16.857190+0000","last_fullsized":"2024-09-12T02:23:16.857190+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:41.469242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842656+0000","last_change":"2024-09-12T02:23:04.777953+0000","last_active":"2024-09-12T02:23:17.842656+0000","last_peered":"2024-09-12T02:23:17.842656+0000","last_clean":"2024-09-12T02:23:17.842656+0000","last_became_active":"2024-09-12T02:23:04.777081+0000","last_became_peered":"2024-09-12T02:23:04.777081+0000","last_unstale":"2024-09-12T02:23:17.842656+0000","last_undegraded":"2024-09-12T02:23:17.842656+0000","last_fullsized":"2024-09-12T02:23:17.842656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:14.103378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.840506+0000","last_change":"2024-09-12T02:23:03.771271+0000","last_active":"2024-09-12T02:23:16.840506+0000","last_peered":"2024-09-12T02:23:16.840506+0000","last_clean":"2024-09-12T02:23:16.840506+0000","last_became_active":"2024-09-12T02:23:03.769601+0000","last_became_peered":"2024-09-12T02:23:03.769601+0000","last_unstale":"2024-09-12T02:23:16.840506+0000","last_undegraded":"2024-09-12T02:23:16.840506+0000","last_fullsized":"2024-09-12T02:23:16.840506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:22.910072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842076+0000","last_change":"2024-09-12T02:23:15.831522+0000","last_active":"2024-09-12T02:23:17.842076+0000","last_peered":"2024-09-12T02:23:17.842076+0000","last_clean":"2024-09-12T02:23:17.842076+0000","last_became_active":"2024-09-12T02:23:15.831220+0000","last_became_peered":"2024-09-12T02:23:15.831220+0000","last_unstale":"2024-09-12T02:23:17.842076+0000","last_undegraded":"2024-09-12T02:23:17.842076+0000","last_fullsized":"2024-09-12T02:23:17.842076+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:54.337051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.860246+0000","last_change":"2024-09-12T02:23:16.858361+0000","last_active":"2024-09-12T02:23:16.860246+0000","last_peered":"2024-09-12T02:23:16.860246+0000","last_clean":"2024-09-12T02:23:16.860246+0000","last_became_active":"2024-09-12T02:23:16.858075+0000","last_became_peered":"2024-09-12T02:23:16.858075+0000","last_unstale":"2024-09-12T02:23:16.860246+0000","last_undegraded":"2024-09-12T02:23:16.860246+0000","last_fullsized":"2024-09-12T02:23:16.860246+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:00.231676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331887+0000","last_change":"2024-09-12T02:23:04.779171+0000","last_active":"2024-09-12T02:23:18.331887+0000","last_peered":"2024-09-12T02:23:18.331887+0000","last_clean":"2024-09-12T02:23:18.331887+0000","last_became_active":"2024-09-12T02:23:04.778850+0000","last_became_peered":"2024-09-12T02:23:04.778850+0000","last_unstale":"2024-09-12T02:23:18.331887+0000","last_undegraded":"2024-09-12T02:23:18.331887+0000","last_fullsized":"2024-09-12T02:23:18.331887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:21.746490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325975+0000","last_change":"2024-09-12T02:23:03.769710+0000","last_active":"2024-09-12T02:23:18.325975+0000","last_peered":"2024-09-12T02:23:18.325975+0000","last_clean":"2024-09-12T02:23:18.325975+0000","last_became_active":"2024-09-12T02:23:03.769436+0000","last_became_peered":"2024-09-12T02:23:03.769436+0000","last_unstale":"2024-09-12T02:23:18.325975+0000","last_undegraded":"2024-09-12T02:23:18.325975+0000","last_fullsized":"2024-09-12T02:23:18.325975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:11.194147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"25'8","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.862841+0000","last_change":"2024-09-12T02:23:15.833196+0000","last_active":"2024-09-12T02:23:16.862841+0000","last_peered":"2024-09-12T02:23:16.862841+0000","last_clean":"2024-09-12T02:23:16.862841+0000","last_became_active":"2024-09-12T02:23:15.832873+0000","last_became_peered":"2024-09-12T02:23:15.832873+0000","last_unstale":"2024-09-12T02:23:16.862841+0000","last_undegraded":"2024-09-12T02:23:16.862841+0000","last_fullsized":"2024-09-12T02:23:16.862841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:15.238046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840614+0000","last_change":"2024-09-12T02:23:16.856735+0000","last_active":"2024-09-12T02:23:17.840614+0000","last_peered":"2024-09-12T02:23:17.840614+0000","last_clean":"2024-09-12T02:23:17.840614+0000","last_became_active":"2024-09-12T02:23:16.856455+0000","last_became_peered":"2024-09-12T02:23:16.856455+0000","last_unstale":"2024-09-12T02:23:17.840614+0000","last_undegraded":"2024-09-12T02:23:17.840614+0000","last_fullsized":"2024-09-12T02:23:17.840614+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:55.376194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325968+0000","last_change":"2024-09-12T02:23:04.786100+0000","last_active":"2024-09-12T02:23:18.325968+0000","last_peered":"2024-09-12T02:23:18.325968+0000","last_clean":"2024-09-12T02:23:18.325968+0000","last_became_active":"2024-09-12T02:23:04.785795+0000","last_became_peered":"2024-09-12T02:23:04.785795+0000","last_unstale":"2024-09-12T02:23:18.325968+0000","last_undegraded":"2024-09-12T02:23:18.325968+0000","last_fullsized":"2024-09-12T02:23:18.325968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:58.597807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.831896+0000","last_change":"2024-09-12T02:23:03.770668+0000","last_active":"2024-09-12T02:23:16.831896+0000","last_peered":"2024-09-12T02:23:16.831896+0000","last_clean":"2024-09-12T02:23:16.831896+0000","last_became_active":"2024-09-12T02:23:03.769302+0000","last_became_peered":"2024-09-12T02:23:03.769302+0000","last_unstale":"2024-09-12T02:23:16.831896+0000","last_undegraded":"2024-09-12T02:23:16.831896+0000","last_fullsized":"2024-09-12T02:23:16.831896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:18.948922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.832533+0000","last_change":"2024-09-12T02:23:15.825585+0000","last_active":"2024-09-12T02:23:16.832533+0000","last_peered":"2024-09-12T02:23:16.832533+0000","last_clean":"2024-09-12T02:23:16.832533+0000","last_became_active":"2024-09-12T02:23:15.825305+0000","last_became_peered":"2024-09-12T02:23:15.825305+0000","last_unstale":"2024-09-12T02:23:16.832533+0000","last_undegraded":"2024-09-12T02:23:16.832533+0000","last_fullsized":"2024-09-12T02:23:16.832533+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:43.818922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.854210+0000","last_change":"2024-09-12T02:23:16.852415+0000","last_active":"2024-09-12T02:23:16.854210+0000","last_peered":"2024-09-12T02:23:16.854210+0000","last_clean":"2024-09-12T02:23:16.854210+0000","last_became_active":"2024-09-12T02:23:16.852061+0000","last_became_peered":"2024-09-12T02:23:16.852061+0000","last_unstale":"2024-09-12T02:23:16.854210+0000","last_undegraded":"2024-09-12T02:23:16.854210+0000","last_fullsized":"2024-09-12T02:23:16.854210+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:18.122398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331783+0000","last_change":"2024-09-12T02:23:15.833414+0000","last_active":"2024-09-12T02:23:18.331783+0000","last_peered":"2024-09-12T02:23:18.331783+0000","last_clean":"2024-09-12T02:23:18.331783+0000","last_became_active":"2024-09-12T02:23:15.832837+0000","last_became_peered":"2024-09-12T02:23:15.832837+0000","last_unstale":"2024-09-12T02:23:18.331783+0000","last_undegraded":"2024-09-12T02:23:18.331783+0000","last_fullsized":"2024-09-12T02:23:18.331783+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:31.510160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.838979+0000","last_change":"2024-09-12T02:23:04.776572+0000","last_active":"2024-09-12T02:23:16.838979+0000","last_peered":"2024-09-12T02:23:16.838979+0000","last_clean":"2024-09-12T02:23:16.838979+0000","last_became_active":"2024-09-12T02:23:04.776270+0000","last_became_peered":"2024-09-12T02:23:04.776270+0000","last_unstale":"2024-09-12T02:23:16.838979+0000","last_undegraded":"2024-09-12T02:23:16.838979+0000","last_fullsized":"2024-09-12T02:23:16.838979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:12.807907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325207+0000","last_change":"2024-09-12T02:23:03.762450+0000","last_active":"2024-09-12T02:23:18.325207+0000","last_peered":"2024-09-12T02:23:18.325207+0000","last_clean":"2024-09-12T02:23:18.325207+0000","last_became_active":"2024-09-12T02:23:03.762161+0000","last_became_peered":"2024-09-12T02:23:03.762161+0000","last_unstale":"2024-09-12T02:23:18.325207+0000","last_undegraded":"2024-09-12T02:23:18.325207+0000","last_fullsized":"2024-09-12T02:23:18.325207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:42.256395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331804+0000","last_change":"2024-09-12T02:23:16.844537+0000","last_active":"2024-09-12T02:23:18.331804+0000","last_peered":"2024-09-12T02:23:18.331804+0000","last_clean":"2024-09-12T02:23:18.331804+0000","last_became_active":"2024-09-12T02:23:16.844248+0000","last_became_peered":"2024-09-12T02:23:16.844248+0000","last_unstale":"2024-09-12T02:23:18.331804+0000","last_undegraded":"2024-09-12T02:23:18.331804+0000","last_fullsized":"2024-09-12T02:23:18.331804+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:45.801324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"25'4","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.857421+0000","last_change":"2024-09-12T02:23:15.826010+0000","last_active":"2024-09-12T02:23:16.857421+0000","last_peered":"2024-09-12T02:23:16.857421+0000","last_clean":"2024-09-12T02:23:16.857421+0000","last_became_active":"2024-09-12T02:23:15.825730+0000","last_became_peered":"2024-09-12T02:23:15.825730+0000","last_unstale":"2024-09-12T02:23:16.857421+0000","last_undegraded":"2024-09-12T02:23:16.857421+0000","last_fullsized":"2024-09-12T02:23:16.857421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:17.920975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.831255+0000","last_change":"2024-09-12T02:23:04.783317+0000","last_active":"2024-09-12T02:23:16.831255+0000","last_peered":"2024-09-12T02:23:16.831255+0000","last_clean":"2024-09-12T02:23:16.831255+0000","last_became_active":"2024-09-12T02:23:04.783039+0000","last_became_peered":"2024-09-12T02:23:04.783039+0000","last_unstale":"2024-09-12T02:23:16.831255+0000","last_undegraded":"2024-09-12T02:23:16.831255+0000","last_fullsized":"2024-09-12T02:23:16.831255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:17.577991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.833315+0000","last_change":"2024-09-12T02:23:03.768361+0000","last_active":"2024-09-12T02:23:16.833315+0000","last_peered":"2024-09-12T02:23:16.833315+0000","last_clean":"2024-09-12T02:23:16.833315+0000","last_became_active":"2024-09-12T02:23:03.768137+0000","last_became_peered":"2024-09-12T02:23:03.768137+0000","last_unstale":"2024-09-12T02:23:16.833315+0000","last_undegraded":"2024-09-12T02:23:16.833315+0000","last_fullsized":"2024-09-12T02:23:16.833315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:29.721363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.862573+0000","last_change":"2024-09-12T02:23:16.861251+0000","last_active":"2024-09-12T02:23:16.862573+0000","last_peered":"2024-09-12T02:23:16.862573+0000","last_clean":"2024-09-12T02:23:16.862573+0000","last_became_active":"2024-09-12T02:23:16.860980+0000","last_became_peered":"2024-09-12T02:23:16.860980+0000","last_unstale":"2024-09-12T02:23:16.862573+0000","last_undegraded":"2024-09-12T02:23:16.862573+0000","last_fullsized":"2024-09-12T02:23:16.862573+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:00.506034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.831208+0000","last_change":"2024-09-12T02:23:03.768186+0000","last_active":"2024-09-12T02:23:16.831208+0000","last_peered":"2024-09-12T02:23:16.831208+0000","last_clean":"2024-09-12T02:23:16.831208+0000","last_became_active":"2024-09-12T02:23:03.767916+0000","last_became_peered":"2024-09-12T02:23:03.767916+0000","last_unstale":"2024-09-12T02:23:16.831208+0000","last_undegraded":"2024-09-12T02:23:16.831208+0000","last_fullsized":"2024-09-12T02:23:16.831208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:04.424540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.332085+0000","last_change":"2024-09-12T02:23:04.793412+0000","last_active":"2024-09-12T02:23:18.332085+0000","last_peered":"2024-09-12T02:23:18.332085+0000","last_clean":"2024-09-12T02:23:18.332085+0000","last_became_active":"2024-09-12T02:23:04.793100+0000","last_became_peered":"2024-09-12T02:23:04.793100+0000","last_unstale":"2024-09-12T02:23:18.332085+0000","last_undegraded":"2024-09-12T02:23:18.332085+0000","last_fullsized":"2024-09-12T02:23:18.332085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:50.446212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"25'2","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.863930+0000","last_change":"2024-09-12T02:23:15.830776+0000","last_active":"2024-09-12T02:23:16.863930+0000","last_peered":"2024-09-12T02:23:16.863930+0000","last_clean":"2024-09-12T02:23:16.863930+0000","last_became_active":"2024-09-12T02:23:15.830492+0000","last_became_peered":"2024-09-12T02:23:15.830492+0000","last_unstale":"2024-09-12T02:23:16.863930+0000","last_undegraded":"2024-09-12T02:23:16.863930+0000","last_fullsized":"2024-09-12T02:23:16.863930+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:40.517292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840575+0000","last_change":"2024-09-12T02:23:16.851953+0000","last_active":"2024-09-12T02:23:17.840575+0000","last_peered":"2024-09-12T02:23:17.840575+0000","last_clean":"2024-09-12T02:23:17.840575+0000","last_became_active":"2024-09-12T02:23:16.851558+0000","last_became_peered":"2024-09-12T02:23:16.851558+0000","last_unstale":"2024-09-12T02:23:17.840575+0000","last_undegraded":"2024-09-12T02:23:17.840575+0000","last_fullsized":"2024-09-12T02:23:17.840575+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:29.852193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.834001+0000","last_change":"2024-09-12T02:23:03.764310+0000","last_active":"2024-09-12T02:23:16.834001+0000","last_peered":"2024-09-12T02:23:16.834001+0000","last_clean":"2024-09-12T02:23:16.834001+0000","last_became_active":"2024-09-12T02:23:03.764020+0000","last_became_peered":"2024-09-12T02:23:03.764020+0000","last_unstale":"2024-09-12T02:23:16.834001+0000","last_undegraded":"2024-09-12T02:23:16.834001+0000","last_fullsized":"2024-09-12T02:23:16.834001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:25.892874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841038+0000","last_change":"2024-09-12T02:23:04.771579+0000","last_active":"2024-09-12T02:23:17.841038+0000","last_peered":"2024-09-12T02:23:17.841038+0000","last_clean":"2024-09-12T02:23:17.841038+0000","last_became_active":"2024-09-12T02:23:04.771310+0000","last_became_peered":"2024-09-12T02:23:04.771310+0000","last_unstale":"2024-09-12T02:23:17.841038+0000","last_undegraded":"2024-09-12T02:23:17.841038+0000","last_fullsized":"2024-09-12T02:23:17.841038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:05.115474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"25'2","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.857707+0000","last_change":"2024-09-12T02:23:15.832757+0000","last_active":"2024-09-12T02:23:16.857707+0000","last_peered":"2024-09-12T02:23:16.857707+0000","last_clean":"2024-09-12T02:23:16.857707+0000","last_became_active":"2024-09-12T02:23:15.832478+0000","last_became_peered":"2024-09-12T02:23:15.832478+0000","last_unstale":"2024-09-12T02:23:16.857707+0000","last_undegraded":"2024-09-12T02:23:16.857707+0000","last_fullsized":"2024-09-12T02:23:16.857707+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:29.301251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.854514+0000","last_change":"2024-09-12T02:23:16.848437+0000","last_active":"2024-09-12T02:23:16.854514+0000","last_peered":"2024-09-12T02:23:16.854514+0000","last_clean":"2024-09-12T02:23:16.854514+0000","last_became_active":"2024-09-12T02:23:16.847063+0000","last_became_peered":"2024-09-12T02:23:16.847063+0000","last_unstale":"2024-09-12T02:23:16.854514+0000","last_undegraded":"2024-09-12T02:23:16.854514+0000","last_fullsized":"2024-09-12T02:23:16.854514+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:28.331107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.830251+0000","last_change":"2024-09-12T02:23:04.788489+0000","last_active":"2024-09-12T02:23:16.830251+0000","last_peered":"2024-09-12T02:23:16.830251+0000","last_clean":"2024-09-12T02:23:16.830251+0000","last_became_active":"2024-09-12T02:23:04.788195+0000","last_became_peered":"2024-09-12T02:23:04.788195+0000","last_unstale":"2024-09-12T02:23:16.830251+0000","last_undegraded":"2024-09-12T02:23:16.830251+0000","last_fullsized":"2024-09-12T02:23:16.830251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:51.352859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.844925+0000","last_change":"2024-09-12T02:23:16.843805+0000","last_active":"2024-09-12T02:23:16.844925+0000","last_peered":"2024-09-12T02:23:16.844925+0000","last_clean":"2024-09-12T02:23:16.844925+0000","last_became_active":"2024-09-12T02:23:16.843517+0000","last_became_peered":"2024-09-12T02:23:16.843517+0000","last_unstale":"2024-09-12T02:23:16.844925+0000","last_undegraded":"2024-09-12T02:23:16.844925+0000","last_fullsized":"2024-09-12T02:23:16.844925+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:15.724355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.827029+0000","last_change":"2024-09-12T02:23:04.780662+0000","last_active":"2024-09-12T02:23:16.827029+0000","last_peered":"2024-09-12T02:23:16.827029+0000","last_clean":"2024-09-12T02:23:16.827029+0000","last_became_active":"2024-09-12T02:23:04.780402+0000","last_became_peered":"2024-09-12T02:23:04.780402+0000","last_unstale":"2024-09-12T02:23:16.827029+0000","last_undegraded":"2024-09-12T02:23:16.827029+0000","last_fullsized":"2024-09-12T02:23:16.827029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:23:00.556487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325531+0000","last_change":"2024-09-12T02:23:16.852992+0000","last_active":"2024-09-12T02:23:18.325531+0000","last_peered":"2024-09-12T02:23:18.325531+0000","last_clean":"2024-09-12T02:23:18.325531+0000","last_became_active":"2024-09-12T02:23:16.852706+0000","last_became_peered":"2024-09-12T02:23:16.852706+0000","last_unstale":"2024-09-12T02:23:18.325531+0000","last_undegraded":"2024-09-12T02:23:18.325531+0000","last_fullsized":"2024-09-12T02:23:18.325531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:56.896457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325468+0000","last_change":"2024-09-12T02:23:04.785920+0000","last_active":"2024-09-12T02:23:18.325468+0000","last_peered":"2024-09-12T02:23:18.325468+0000","last_clean":"2024-09-12T02:23:18.325468+0000","last_became_active":"2024-09-12T02:23:04.785422+0000","last_became_peered":"2024-09-12T02:23:04.785422+0000","last_unstale":"2024-09-12T02:23:18.325468+0000","last_undegraded":"2024-09-12T02:23:18.325468+0000","last_fullsized":"2024-09-12T02:23:18.325468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:55.106703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.863192+0000","last_change":"2024-09-12T02:23:16.861939+0000","last_active":"2024-09-12T02:23:16.863192+0000","last_peered":"2024-09-12T02:23:16.863192+0000","last_clean":"2024-09-12T02:23:16.863192+0000","last_became_active":"2024-09-12T02:23:16.861658+0000","last_became_peered":"2024-09-12T02:23:16.861658+0000","last_unstale":"2024-09-12T02:23:16.863192+0000","last_undegraded":"2024-09-12T02:23:16.863192+0000","last_fullsized":"2024-09-12T02:23:16.863192+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:16:56.850086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331991+0000","last_change":"2024-09-12T02:23:04.777018+0000","last_active":"2024-09-12T02:23:18.331991+0000","last_peered":"2024-09-12T02:23:18.331991+0000","last_clean":"2024-09-12T02:23:18.331991+0000","last_became_active":"2024-09-12T02:23:04.776736+0000","last_became_peered":"2024-09-12T02:23:04.776736+0000","last_unstale":"2024-09-12T02:23:18.331991+0000","last_undegraded":"2024-09-12T02:23:18.331991+0000","last_fullsized":"2024-09-12T02:23:18.331991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:08.668990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840760+0000","last_change":"2024-09-12T02:23:16.847615+0000","last_active":"2024-09-12T02:23:17.840760+0000","last_peered":"2024-09-12T02:23:17.840760+0000","last_clean":"2024-09-12T02:23:17.840760+0000","last_became_active":"2024-09-12T02:23:16.847260+0000","last_became_peered":"2024-09-12T02:23:16.847260+0000","last_unstale":"2024-09-12T02:23:17.840760+0000","last_undegraded":"2024-09-12T02:23:17.840760+0000","last_fullsized":"2024-09-12T02:23:17.840760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:48.920477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.834604+0000","last_change":"2024-09-12T02:23:04.789372+0000","last_active":"2024-09-12T02:23:16.834604+0000","last_peered":"2024-09-12T02:23:16.834604+0000","last_clean":"2024-09-12T02:23:16.834604+0000","last_became_active":"2024-09-12T02:23:04.789090+0000","last_became_peered":"2024-09-12T02:23:04.789090+0000","last_unstale":"2024-09-12T02:23:16.834604+0000","last_undegraded":"2024-09-12T02:23:16.834604+0000","last_fullsized":"2024-09-12T02:23:16.834604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:49.533491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841815+0000","last_change":"2024-09-12T02:23:16.859000+0000","last_active":"2024-09-12T02:23:17.841815+0000","last_peered":"2024-09-12T02:23:17.841815+0000","last_clean":"2024-09-12T02:23:17.841815+0000","last_became_active":"2024-09-12T02:23:16.858637+0000","last_became_peered":"2024-09-12T02:23:16.858637+0000","last_unstale":"2024-09-12T02:23:17.841815+0000","last_undegraded":"2024-09-12T02:23:17.841815+0000","last_fullsized":"2024-09-12T02:23:17.841815+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:47.915947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.840447+0000","last_change":"2024-09-12T02:23:04.776435+0000","last_active":"2024-09-12T02:23:16.840447+0000","last_peered":"2024-09-12T02:23:16.840447+0000","last_clean":"2024-09-12T02:23:16.840447+0000","last_became_active":"2024-09-12T02:23:04.776120+0000","last_became_peered":"2024-09-12T02:23:04.776120+0000","last_unstale":"2024-09-12T02:23:16.840447+0000","last_undegraded":"2024-09-12T02:23:16.840447+0000","last_fullsized":"2024-09-12T02:23:16.840447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:27.985094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840466+0000","last_change":"2024-09-12T02:23:16.856477+0000","last_active":"2024-09-12T02:23:17.840466+0000","last_peered":"2024-09-12T02:23:17.840466+0000","last_clean":"2024-09-12T02:23:17.840466+0000","last_became_active":"2024-09-12T02:23:16.855839+0000","last_became_peered":"2024-09-12T02:23:16.855839+0000","last_unstale":"2024-09-12T02:23:17.840466+0000","last_undegraded":"2024-09-12T02:23:17.840466+0000","last_fullsized":"2024-09-12T02:23:17.840466+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:42.510184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.830975+0000","last_change":"2024-09-12T02:23:04.788827+0000","last_active":"2024-09-12T02:23:16.830975+0000","last_peered":"2024-09-12T02:23:16.830975+0000","last_clean":"2024-09-12T02:23:16.830975+0000","last_became_active":"2024-09-12T02:23:04.788521+0000","last_became_peered":"2024-09-12T02:23:04.788521+0000","last_unstale":"2024-09-12T02:23:16.830975+0000","last_undegraded":"2024-09-12T02:23:16.830975+0000","last_fullsized":"2024-09-12T02:23:16.830975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:24.470245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.840796+0000","last_change":"2024-09-12T02:23:16.838421+0000","last_active":"2024-09-12T02:23:16.840796+0000","last_peered":"2024-09-12T02:23:16.840796+0000","last_clean":"2024-09-12T02:23:16.840796+0000","last_became_active":"2024-09-12T02:23:16.837606+0000","last_became_peered":"2024-09-12T02:23:16.837606+0000","last_unstale":"2024-09-12T02:23:16.840796+0000","last_undegraded":"2024-09-12T02:23:16.840796+0000","last_fullsized":"2024-09-12T02:23:16.840796+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:14:29.721252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.837753+0000","last_change":"2024-09-12T02:23:04.787899+0000","last_active":"2024-09-12T02:23:16.837753+0000","last_peered":"2024-09-12T02:23:16.837753+0000","last_clean":"2024-09-12T02:23:16.837753+0000","last_became_active":"2024-09-12T02:23:04.787619+0000","last_became_peered":"2024-09-12T02:23:04.787619+0000","last_unstale":"2024-09-12T02:23:16.837753+0000","last_undegraded":"2024-09-12T02:23:16.837753+0000","last_fullsized":"2024-09-12T02:23:16.837753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:57.732453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.854489+0000","last_change":"2024-09-12T02:23:16.845296+0000","last_active":"2024-09-12T02:23:16.854489+0000","last_peered":"2024-09-12T02:23:16.854489+0000","last_clean":"2024-09-12T02:23:16.854489+0000","last_became_active":"2024-09-12T02:23:16.844939+0000","last_became_peered":"2024-09-12T02:23:16.844939+0000","last_unstale":"2024-09-12T02:23:16.854489+0000","last_undegraded":"2024-09-12T02:23:16.854489+0000","last_fullsized":"2024-09-12T02:23:16.854489+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:05.526833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325133+0000","last_change":"2024-09-12T02:23:04.787389+0000","last_active":"2024-09-12T02:23:18.325133+0000","last_peered":"2024-09-12T02:23:18.325133+0000","last_clean":"2024-09-12T02:23:18.325133+0000","last_became_active":"2024-09-12T02:23:04.787092+0000","last_became_peered":"2024-09-12T02:23:04.787092+0000","last_unstale":"2024-09-12T02:23:18.325133+0000","last_undegraded":"2024-09-12T02:23:18.325133+0000","last_fullsized":"2024-09-12T02:23:18.325133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:02.924906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.843281+0000","last_change":"2024-09-12T02:23:16.849846+0000","last_active":"2024-09-12T02:23:17.843281+0000","last_peered":"2024-09-12T02:23:17.843281+0000","last_clean":"2024-09-12T02:23:17.843281+0000","last_became_active":"2024-09-12T02:23:16.849585+0000","last_became_peered":"2024-09-12T02:23:16.849585+0000","last_unstale":"2024-09-12T02:23:17.843281+0000","last_undegraded":"2024-09-12T02:23:17.843281+0000","last_fullsized":"2024-09-12T02:23:17.843281+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:58.775679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.833194+0000","last_change":"2024-09-12T02:23:04.788624+0000","last_active":"2024-09-12T02:23:16.833194+0000","last_peered":"2024-09-12T02:23:16.833194+0000","last_clean":"2024-09-12T02:23:16.833194+0000","last_became_active":"2024-09-12T02:23:04.788352+0000","last_became_peered":"2024-09-12T02:23:04.788352+0000","last_unstale":"2024-09-12T02:23:16.833194+0000","last_undegraded":"2024-09-12T02:23:16.833194+0000","last_fullsized":"2024-09-12T02:23:16.833194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:13.961110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.853405+0000","last_change":"2024-09-12T02:23:16.850112+0000","last_active":"2024-09-12T02:23:16.853405+0000","last_peered":"2024-09-12T02:23:16.853405+0000","last_clean":"2024-09-12T02:23:16.853405+0000","last_became_active":"2024-09-12T02:23:16.849831+0000","last_became_peered":"2024-09-12T02:23:16.849831+0000","last_unstale":"2024-09-12T02:23:16.853405+0000","last_undegraded":"2024-09-12T02:23:16.853405+0000","last_fullsized":"2024-09-12T02:23:16.853405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:27.207742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325319+0000","last_change":"2024-09-12T02:23:04.785685+0000","last_active":"2024-09-12T02:23:18.325319+0000","last_peered":"2024-09-12T02:23:18.325319+0000","last_clean":"2024-09-12T02:23:18.325319+0000","last_became_active":"2024-09-12T02:23:04.784945+0000","last_became_peered":"2024-09-12T02:23:04.784945+0000","last_unstale":"2024-09-12T02:23:18.325319+0000","last_undegraded":"2024-09-12T02:23:18.325319+0000","last_fullsized":"2024-09-12T02:23:18.325319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:36.658436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.853776+0000","last_change":"2024-09-12T02:23:16.846108+0000","last_active":"2024-09-12T02:23:16.853776+0000","last_peered":"2024-09-12T02:23:16.853776+0000","last_clean":"2024-09-12T02:23:16.853776+0000","last_became_active":"2024-09-12T02:23:16.845793+0000","last_became_peered":"2024-09-12T02:23:16.845793+0000","last_unstale":"2024-09-12T02:23:16.853776+0000","last_undegraded":"2024-09-12T02:23:16.853776+0000","last_fullsized":"2024-09-12T02:23:16.853776+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:46.138969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331880+0000","last_change":"2024-09-12T02:23:04.785849+0000","last_active":"2024-09-12T02:23:18.331880+0000","last_peered":"2024-09-12T02:23:18.331880+0000","last_clean":"2024-09-12T02:23:18.331880+0000","last_became_active":"2024-09-12T02:23:04.785511+0000","last_became_peered":"2024-09-12T02:23:04.785511+0000","last_unstale":"2024-09-12T02:23:18.331880+0000","last_undegraded":"2024-09-12T02:23:18.331880+0000","last_fullsized":"2024-09-12T02:23:18.331880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:28.670102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840717+0000","last_change":"2024-09-12T02:23:16.855615+0000","last_active":"2024-09-12T02:23:17.840717+0000","last_peered":"2024-09-12T02:23:17.840717+0000","last_clean":"2024-09-12T02:23:17.840717+0000","last_became_active":"2024-09-12T02:23:16.855278+0000","last_became_peered":"2024-09-12T02:23:16.855278+0000","last_unstale":"2024-09-12T02:23:17.840717+0000","last_undegraded":"2024-09-12T02:23:17.840717+0000","last_fullsized":"2024-09-12T02:23:17.840717+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:34.214175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.830445+0000","last_change":"2024-09-12T02:23:04.789575+0000","last_active":"2024-09-12T02:23:16.830445+0000","last_peered":"2024-09-12T02:23:16.830445+0000","last_clean":"2024-09-12T02:23:16.830445+0000","last_became_active":"2024-09-12T02:23:04.789296+0000","last_became_peered":"2024-09-12T02:23:04.789296+0000","last_unstale":"2024-09-12T02:23:16.830445+0000","last_undegraded":"2024-09-12T02:23:16.830445+0000","last_fullsized":"2024-09-12T02:23:16.830445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:13.166139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841521+0000","last_change":"2024-09-12T02:23:16.858045+0000","last_active":"2024-09-12T02:23:17.841521+0000","last_peered":"2024-09-12T02:23:17.841521+0000","last_clean":"2024-09-12T02:23:17.841521+0000","last_became_active":"2024-09-12T02:23:16.857772+0000","last_became_peered":"2024-09-12T02:23:16.857772+0000","last_unstale":"2024-09-12T02:23:17.841521+0000","last_undegraded":"2024-09-12T02:23:17.841521+0000","last_fullsized":"2024-09-12T02:23:17.841521+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:35.598279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842504+0000","last_change":"2024-09-12T02:23:04.777450+0000","last_active":"2024-09-12T02:23:17.842504+0000","last_peered":"2024-09-12T02:23:17.842504+0000","last_clean":"2024-09-12T02:23:17.842504+0000","last_became_active":"2024-09-12T02:23:04.776825+0000","last_became_peered":"2024-09-12T02:23:04.776825+0000","last_unstale":"2024-09-12T02:23:17.842504+0000","last_undegraded":"2024-09-12T02:23:17.842504+0000","last_fullsized":"2024-09-12T02:23:17.842504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:40.315075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325062+0000","last_change":"2024-09-12T02:23:16.846032+0000","last_active":"2024-09-12T02:23:18.325062+0000","last_peered":"2024-09-12T02:23:18.325062+0000","last_clean":"2024-09-12T02:23:18.325062+0000","last_became_active":"2024-09-12T02:23:16.845492+0000","last_became_peered":"2024-09-12T02:23:16.845492+0000","last_unstale":"2024-09-12T02:23:18.325062+0000","last_undegraded":"2024-09-12T02:23:18.325062+0000","last_fullsized":"2024-09-12T02:23:18.325062+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:18.785798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.827414+0000","last_change":"2024-09-12T02:23:04.791378+0000","last_active":"2024-09-12T02:23:16.827414+0000","last_peered":"2024-09-12T02:23:16.827414+0000","last_clean":"2024-09-12T02:23:16.827414+0000","last_became_active":"2024-09-12T02:23:04.790926+0000","last_became_peered":"2024-09-12T02:23:04.790926+0000","last_unstale":"2024-09-12T02:23:16.827414+0000","last_undegraded":"2024-09-12T02:23:16.827414+0000","last_fullsized":"2024-09-12T02:23:16.827414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:34.764210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331435+0000","last_change":"2024-09-12T02:23:16.851099+0000","last_active":"2024-09-12T02:23:18.331435+0000","last_peered":"2024-09-12T02:23:18.331435+0000","last_clean":"2024-09-12T02:23:18.331435+0000","last_became_active":"2024-09-12T02:23:16.850747+0000","last_became_peered":"2024-09-12T02:23:16.850747+0000","last_unstale":"2024-09-12T02:23:18.331435+0000","last_undegraded":"2024-09-12T02:23:18.331435+0000","last_fullsized":"2024-09-12T02:23:18.331435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:01:31.445590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.326232+0000","last_change":"2024-09-12T02:23:04.789439+0000","last_active":"2024-09-12T02:23:18.326232+0000","last_peered":"2024-09-12T02:23:18.326232+0000","last_clean":"2024-09-12T02:23:18.326232+0000","last_became_active":"2024-09-12T02:23:04.787421+0000","last_became_peered":"2024-09-12T02:23:04.787421+0000","last_unstale":"2024-09-12T02:23:18.326232+0000","last_undegraded":"2024-09-12T02:23:18.326232+0000","last_fullsized":"2024-09-12T02:23:18.326232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:44.295056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.854405+0000","last_change":"2024-09-12T02:23:16.850923+0000","last_active":"2024-09-12T02:23:16.854405+0000","last_peered":"2024-09-12T02:23:16.854405+0000","last_clean":"2024-09-12T02:23:16.854405+0000","last_became_active":"2024-09-12T02:23:16.850609+0000","last_became_peered":"2024-09-12T02:23:16.850609+0000","last_unstale":"2024-09-12T02:23:16.854405+0000","last_undegraded":"2024-09-12T02:23:16.854405+0000","last_fullsized":"2024-09-12T02:23:16.854405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:20.919016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325085+0000","last_change":"2024-09-12T02:23:04.790532+0000","last_active":"2024-09-12T02:23:18.325085+0000","last_peered":"2024-09-12T02:23:18.325085+0000","last_clean":"2024-09-12T02:23:18.325085+0000","last_became_active":"2024-09-12T02:23:04.789229+0000","last_became_peered":"2024-09-12T02:23:04.789229+0000","last_unstale":"2024-09-12T02:23:18.325085+0000","last_undegraded":"2024-09-12T02:23:18.325085+0000","last_fullsized":"2024-09-12T02:23:18.325085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:59.901665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841478+0000","last_change":"2024-09-12T02:23:16.856612+0000","last_active":"2024-09-12T02:23:17.841478+0000","last_peered":"2024-09-12T02:23:17.841478+0000","last_clean":"2024-09-12T02:23:17.841478+0000","last_became_active":"2024-09-12T02:23:16.856290+0000","last_became_peered":"2024-09-12T02:23:16.856290+0000","last_unstale":"2024-09-12T02:23:17.841478+0000","last_undegraded":"2024-09-12T02:23:17.841478+0000","last_fullsized":"2024-09-12T02:23:17.841478+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:14.846281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.839019+0000","last_change":"2024-09-12T02:23:04.782490+0000","last_active":"2024-09-12T02:23:16.839019+0000","last_peered":"2024-09-12T02:23:16.839019+0000","last_clean":"2024-09-12T02:23:16.839019+0000","last_became_active":"2024-09-12T02:23:04.782183+0000","last_became_peered":"2024-09-12T02:23:04.782183+0000","last_unstale":"2024-09-12T02:23:16.839019+0000","last_undegraded":"2024-09-12T02:23:16.839019+0000","last_fullsized":"2024-09-12T02:23:16.839019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:28.699880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325361+0000","last_change":"2024-09-12T02:23:16.858100+0000","last_active":"2024-09-12T02:23:18.325361+0000","last_peered":"2024-09-12T02:23:18.325361+0000","last_clean":"2024-09-12T02:23:18.325361+0000","last_became_active":"2024-09-12T02:23:16.857818+0000","last_became_peered":"2024-09-12T02:23:16.857818+0000","last_unstale":"2024-09-12T02:23:18.325361+0000","last_undegraded":"2024-09-12T02:23:18.325361+0000","last_fullsized":"2024-09-12T02:23:18.325361+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:45.991170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331508+0000","last_change":"2024-09-12T02:23:04.787140+0000","last_active":"2024-09-12T02:23:18.331508+0000","last_peered":"2024-09-12T02:23:18.331508+0000","last_clean":"2024-09-12T02:23:18.331508+0000","last_became_active":"2024-09-12T02:23:04.786799+0000","last_became_peered":"2024-09-12T02:23:04.786799+0000","last_unstale":"2024-09-12T02:23:18.331508+0000","last_undegraded":"2024-09-12T02:23:18.331508+0000","last_fullsized":"2024-09-12T02:23:18.331508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:31.639605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842225+0000","last_change":"2024-09-12T02:23:16.846100+0000","last_active":"2024-09-12T02:23:17.842225+0000","last_peered":"2024-09-12T02:23:17.842225+0000","last_clean":"2024-09-12T02:23:17.842225+0000","last_became_active":"2024-09-12T02:23:16.845749+0000","last_became_peered":"2024-09-12T02:23:16.845749+0000","last_unstale":"2024-09-12T02:23:17.842225+0000","last_undegraded":"2024-09-12T02:23:17.842225+0000","last_fullsized":"2024-09-12T02:23:17.842225+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:42.783366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.833778+0000","last_change":"2024-09-12T02:23:04.782128+0000","last_active":"2024-09-12T02:23:16.833778+0000","last_peered":"2024-09-12T02:23:16.833778+0000","last_clean":"2024-09-12T02:23:16.833778+0000","last_became_active":"2024-09-12T02:23:04.781101+0000","last_became_peered":"2024-09-12T02:23:04.781101+0000","last_unstale":"2024-09-12T02:23:16.833778+0000","last_undegraded":"2024-09-12T02:23:16.833778+0000","last_fullsized":"2024-09-12T02:23:16.833778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:49.421147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.842200+0000","last_change":"2024-09-12T02:23:16.836968+0000","last_active":"2024-09-12T02:23:16.842200+0000","last_peered":"2024-09-12T02:23:16.842200+0000","last_clean":"2024-09-12T02:23:16.842200+0000","last_became_active":"2024-09-12T02:23:16.836561+0000","last_became_peered":"2024-09-12T02:23:16.836561+0000","last_unstale":"2024-09-12T02:23:16.842200+0000","last_undegraded":"2024-09-12T02:23:16.842200+0000","last_fullsized":"2024-09-12T02:23:16.842200+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:34.286339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842555+0000","last_change":"2024-09-12T02:23:04.787034+0000","last_active":"2024-09-12T02:23:17.842555+0000","last_peered":"2024-09-12T02:23:17.842555+0000","last_clean":"2024-09-12T02:23:17.842555+0000","last_became_active":"2024-09-12T02:23:04.786044+0000","last_became_peered":"2024-09-12T02:23:04.786044+0000","last_unstale":"2024-09-12T02:23:17.842555+0000","last_undegraded":"2024-09-12T02:23:17.842555+0000","last_fullsized":"2024-09-12T02:23:17.842555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:07.183028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.847348+0000","last_change":"2024-09-12T02:23:16.846114+0000","last_active":"2024-09-12T02:23:16.847348+0000","last_peered":"2024-09-12T02:23:16.847348+0000","last_clean":"2024-09-12T02:23:16.847348+0000","last_became_active":"2024-09-12T02:23:16.845757+0000","last_became_peered":"2024-09-12T02:23:16.845757+0000","last_unstale":"2024-09-12T02:23:16.847348+0000","last_undegraded":"2024-09-12T02:23:16.847348+0000","last_fullsized":"2024-09-12T02:23:16.847348+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:05.691128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.831392+0000","last_change":"2024-09-12T02:23:04.785662+0000","last_active":"2024-09-12T02:23:16.831392+0000","last_peered":"2024-09-12T02:23:16.831392+0000","last_clean":"2024-09-12T02:23:16.831392+0000","last_became_active":"2024-09-12T02:23:04.785375+0000","last_became_peered":"2024-09-12T02:23:04.785375+0000","last_unstale":"2024-09-12T02:23:16.831392+0000","last_undegraded":"2024-09-12T02:23:16.831392+0000","last_fullsized":"2024-09-12T02:23:16.831392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:44.295056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841351+0000","last_change":"2024-09-12T02:23:16.858175+0000","last_active":"2024-09-12T02:23:17.841351+0000","last_peered":"2024-09-12T02:23:17.841351+0000","last_clean":"2024-09-12T02:23:17.841351+0000","last_became_active":"2024-09-12T02:23:16.857873+0000","last_became_peered":"2024-09-12T02:23:16.857873+0000","last_unstale":"2024-09-12T02:23:17.841351+0000","last_undegraded":"2024-09-12T02:23:17.841351+0000","last_fullsized":"2024-09-12T02:23:17.841351+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:54.535867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.830727+0000","last_change":"2024-09-12T02:23:04.791929+0000","last_active":"2024-09-12T02:23:16.830727+0000","last_peered":"2024-09-12T02:23:16.830727+0000","last_clean":"2024-09-12T02:23:16.830727+0000","last_became_active":"2024-09-12T02:23:04.791622+0000","last_became_peered":"2024-09-12T02:23:04.791622+0000","last_unstale":"2024-09-12T02:23:16.830727+0000","last_undegraded":"2024-09-12T02:23:16.830727+0000","last_fullsized":"2024-09-12T02:23:16.830727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:35.012685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325239+0000","last_change":"2024-09-12T02:23:16.849985+0000","last_active":"2024-09-12T02:23:18.325239+0000","last_peered":"2024-09-12T02:23:18.325239+0000","last_clean":"2024-09-12T02:23:18.325239+0000","last_became_active":"2024-09-12T02:23:16.849641+0000","last_became_peered":"2024-09-12T02:23:16.849641+0000","last_unstale":"2024-09-12T02:23:18.325239+0000","last_undegraded":"2024-09-12T02:23:18.325239+0000","last_fullsized":"2024-09-12T02:23:18.325239+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:28.373543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.843012+0000","last_change":"2024-09-12T02:23:04.781090+0000","last_active":"2024-09-12T02:23:17.843012+0000","last_peered":"2024-09-12T02:23:17.843012+0000","last_clean":"2024-09-12T02:23:17.843012+0000","last_became_active":"2024-09-12T02:23:04.780740+0000","last_became_peered":"2024-09-12T02:23:04.780740+0000","last_unstale":"2024-09-12T02:23:17.843012+0000","last_undegraded":"2024-09-12T02:23:17.843012+0000","last_fullsized":"2024-09-12T02:23:17.843012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:30.639111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.841990+0000","last_change":"2024-09-12T02:23:16.840250+0000","last_active":"2024-09-12T02:23:16.841990+0000","last_peered":"2024-09-12T02:23:16.841990+0000","last_clean":"2024-09-12T02:23:16.841990+0000","last_became_active":"2024-09-12T02:23:16.839914+0000","last_became_peered":"2024-09-12T02:23:16.839914+0000","last_unstale":"2024-09-12T02:23:16.841990+0000","last_undegraded":"2024-09-12T02:23:16.841990+0000","last_fullsized":"2024-09-12T02:23:16.841990+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:04.503400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.831157+0000","last_change":"2024-09-12T02:23:04.779648+0000","last_active":"2024-09-12T02:23:16.831157+0000","last_peered":"2024-09-12T02:23:16.831157+0000","last_clean":"2024-09-12T02:23:16.831157+0000","last_became_active":"2024-09-12T02:23:04.779384+0000","last_became_peered":"2024-09-12T02:23:04.779384+0000","last_unstale":"2024-09-12T02:23:16.831157+0000","last_undegraded":"2024-09-12T02:23:16.831157+0000","last_fullsized":"2024-09-12T02:23:16.831157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:41.491471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.851721+0000","last_change":"2024-09-12T02:23:16.850060+0000","last_active":"2024-09-12T02:23:16.851721+0000","last_peered":"2024-09-12T02:23:16.851721+0000","last_clean":"2024-09-12T02:23:16.851721+0000","last_became_active":"2024-09-12T02:23:16.849744+0000","last_became_peered":"2024-09-12T02:23:16.849744+0000","last_unstale":"2024-09-12T02:23:16.851721+0000","last_undegraded":"2024-09-12T02:23:16.851721+0000","last_fullsized":"2024-09-12T02:23:16.851721+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:55.191627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841118+0000","last_change":"2024-09-12T02:23:04.779265+0000","last_active":"2024-09-12T02:23:17.841118+0000","last_peered":"2024-09-12T02:23:17.841118+0000","last_clean":"2024-09-12T02:23:17.841118+0000","last_became_active":"2024-09-12T02:23:04.778968+0000","last_became_peered":"2024-09-12T02:23:04.778968+0000","last_unstale":"2024-09-12T02:23:17.841118+0000","last_undegraded":"2024-09-12T02:23:17.841118+0000","last_fullsized":"2024-09-12T02:23:17.841118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:53.022598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.863224+0000","last_change":"2024-09-12T02:23:16.862034+0000","last_active":"2024-09-12T02:23:16.863224+0000","last_peered":"2024-09-12T02:23:16.863224+0000","last_clean":"2024-09-12T02:23:16.863224+0000","last_became_active":"2024-09-12T02:23:16.861441+0000","last_became_peered":"2024-09-12T02:23:16.861441+0000","last_unstale":"2024-09-12T02:23:16.863224+0000","last_undegraded":"2024-09-12T02:23:16.863224+0000","last_fullsized":"2024-09-12T02:23:16.863224+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:54.669297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325312+0000","last_change":"2024-09-12T02:23:04.788890+0000","last_active":"2024-09-12T02:23:18.325312+0000","last_peered":"2024-09-12T02:23:18.325312+0000","last_clean":"2024-09-12T02:23:18.325312+0000","last_became_active":"2024-09-12T02:23:04.788617+0000","last_became_peered":"2024-09-12T02:23:04.788617+0000","last_unstale":"2024-09-12T02:23:18.325312+0000","last_undegraded":"2024-09-12T02:23:18.325312+0000","last_fullsized":"2024-09-12T02:23:18.325312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:24.194151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325951+0000","last_change":"2024-09-12T02:23:16.855853+0000","last_active":"2024-09-12T02:23:18.325951+0000","last_peered":"2024-09-12T02:23:18.325951+0000","last_clean":"2024-09-12T02:23:18.325951+0000","last_became_active":"2024-09-12T02:23:16.855437+0000","last_became_peered":"2024-09-12T02:23:16.855437+0000","last_unstale":"2024-09-12T02:23:18.325951+0000","last_undegraded":"2024-09-12T02:23:18.325951+0000","last_fullsized":"2024-09-12T02:23:18.325951+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:27.557862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841894+0000","last_change":"2024-09-12T02:23:04.777165+0000","last_active":"2024-09-12T02:23:17.841894+0000","last_peered":"2024-09-12T02:23:17.841894+0000","last_clean":"2024-09-12T02:23:17.841894+0000","last_became_active":"2024-09-12T02:23:04.776857+0000","last_became_peered":"2024-09-12T02:23:04.776857+0000","last_unstale":"2024-09-12T02:23:17.841894+0000","last_undegraded":"2024-09-12T02:23:17.841894+0000","last_fullsized":"2024-09-12T02:23:17.841894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:28.309591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.855348+0000","last_change":"2024-09-12T02:23:16.849235+0000","last_active":"2024-09-12T02:23:16.855348+0000","last_peered":"2024-09-12T02:23:16.855348+0000","last_clean":"2024-09-12T02:23:16.855348+0000","last_became_active":"2024-09-12T02:23:16.848936+0000","last_became_peered":"2024-09-12T02:23:16.848936+0000","last_unstale":"2024-09-12T02:23:16.855348+0000","last_undegraded":"2024-09-12T02:23:16.855348+0000","last_fullsized":"2024-09-12T02:23:16.855348+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:23.664066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325607+0000","last_change":"2024-09-12T02:23:04.786772+0000","last_active":"2024-09-12T02:23:18.325607+0000","last_peered":"2024-09-12T02:23:18.325607+0000","last_clean":"2024-09-12T02:23:18.325607+0000","last_became_active":"2024-09-12T02:23:04.786509+0000","last_became_peered":"2024-09-12T02:23:04.786509+0000","last_unstale":"2024-09-12T02:23:18.325607+0000","last_undegraded":"2024-09-12T02:23:18.325607+0000","last_fullsized":"2024-09-12T02:23:18.325607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:01.755827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.836697+0000","last_change":"2024-09-12T02:23:16.834788+0000","last_active":"2024-09-12T02:23:16.836697+0000","last_peered":"2024-09-12T02:23:16.836697+0000","last_clean":"2024-09-12T02:23:16.836697+0000","last_became_active":"2024-09-12T02:23:16.834483+0000","last_became_peered":"2024-09-12T02:23:16.834483+0000","last_unstale":"2024-09-12T02:23:16.836697+0000","last_undegraded":"2024-09-12T02:23:16.836697+0000","last_fullsized":"2024-09-12T02:23:16.836697+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:44.008833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331724+0000","last_change":"2024-09-12T02:23:04.778772+0000","last_active":"2024-09-12T02:23:18.331724+0000","last_peered":"2024-09-12T02:23:18.331724+0000","last_clean":"2024-09-12T02:23:18.331724+0000","last_became_active":"2024-09-12T02:23:04.778445+0000","last_became_peered":"2024-09-12T02:23:04.778445+0000","last_unstale":"2024-09-12T02:23:18.331724+0000","last_undegraded":"2024-09-12T02:23:18.331724+0000","last_fullsized":"2024-09-12T02:23:18.331724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:58.292023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840431+0000","last_change":"2024-09-12T02:23:16.844170+0000","last_active":"2024-09-12T02:23:17.840431+0000","last_peered":"2024-09-12T02:23:17.840431+0000","last_clean":"2024-09-12T02:23:17.840431+0000","last_became_active":"2024-09-12T02:23:16.843880+0000","last_became_peered":"2024-09-12T02:23:16.843880+0000","last_unstale":"2024-09-12T02:23:17.840431+0000","last_undegraded":"2024-09-12T02:23:17.840431+0000","last_fullsized":"2024-09-12T02:23:17.840431+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:59.283416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.841071+0000","last_change":"2024-09-12T02:23:04.785821+0000","last_active":"2024-09-12T02:23:16.841071+0000","last_peered":"2024-09-12T02:23:16.841071+0000","last_clean":"2024-09-12T02:23:16.841071+0000","last_became_active":"2024-09-12T02:23:04.785516+0000","last_became_peered":"2024-09-12T02:23:04.785516+0000","last_unstale":"2024-09-12T02:23:16.841071+0000","last_undegraded":"2024-09-12T02:23:16.841071+0000","last_fullsized":"2024-09-12T02:23:16.841071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:42.400040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840987+0000","last_change":"2024-09-12T02:23:16.844145+0000","last_active":"2024-09-12T02:23:17.840987+0000","last_peered":"2024-09-12T02:23:17.840987+0000","last_clean":"2024-09-12T02:23:17.840987+0000","last_became_active":"2024-09-12T02:23:16.843815+0000","last_became_peered":"2024-09-12T02:23:16.843815+0000","last_unstale":"2024-09-12T02:23:17.840987+0000","last_undegraded":"2024-09-12T02:23:17.840987+0000","last_fullsized":"2024-09-12T02:23:17.840987+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:31.789317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842753+0000","last_change":"2024-09-12T02:23:04.791204+0000","last_active":"2024-09-12T02:23:17.842753+0000","last_peered":"2024-09-12T02:23:17.842753+0000","last_clean":"2024-09-12T02:23:17.842753+0000","last_became_active":"2024-09-12T02:23:04.790906+0000","last_became_peered":"2024-09-12T02:23:04.790906+0000","last_unstale":"2024-09-12T02:23:17.842753+0000","last_undegraded":"2024-09-12T02:23:17.842753+0000","last_fullsized":"2024-09-12T02:23:17.842753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:16.336873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476744,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":695559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476744,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":274432,"data_stored":99640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476745,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":105281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":286720,"data_stored":104749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35608,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336232,"statfs":{"total":96636764160,"available":96600301568,"internally_reserved":0,"allocated":258048,"data_stored":97482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36192,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335648,"statfs":{"total":96636764160,"available":96599703552,"internally_reserved":0,"allocated":860160,"data_stored":688418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35632,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336208,"statfs":{"total":96636764160,"available":96600276992,"internally_reserved":0,"allocated":282624,"data_stored":100658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35628,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336212,"statfs":{"total":96636764160,"available":96600281088,"internally_reserved":0,"allocated":278528,"data_stored":99206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:23:20.836 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:23:20.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.969+0000 7fb40899f640 1 Processor -- start 2024-09-12T02:23:20.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.969+0000 7fb40899f640 1 -- start start 2024-09-12T02:23:20.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.970+0000 7fb40899f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb404153890 0x7fb40415a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:20.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.970+0000 7fb40899f640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb4040c8050 0x7fb404073310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:20.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.970+0000 7fb40899f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb404073850 0x7fb404156130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:20.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.970+0000 7fb40899f640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fb4040ca290 con 0x7fb404153890 2024-09-12T02:23:20.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.970+0000 7fb40899f640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fb40415a570 con 0x7fb4040c8050 2024-09-12T02:23:20.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.970+0000 7fb40899f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb4040c6b50 con 0x7fb404073850 2024-09-12T02:23:20.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.970+0000 7fb4037fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb404153890 0x7fb40415a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:20.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.970+0000 7fb4037fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb404153890 0x7fb40415a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49632/0 (socket says 172.21.15.60:49632) 2024-09-12T02:23:20.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.970+0000 7fb4037fe640 1 -- 172.21.15.60:0/3164527809 learned_addr learned my addr 172.21.15.60:0/3164527809 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:20.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.970+0000 7fb402ffd640 1 --2- 172.21.15.60:0/3164527809 >> v2:172.21.15.105:3300/0 conn(0x7fb4040c8050 0x7fb404073310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:20.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.970+0000 7fb403fff640 1 --2- 172.21.15.60:0/3164527809 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb404073850 0x7fb404156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:20.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.970+0000 7fb4037fe640 1 -- 172.21.15.60:0/3164527809 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb404073850 msgr2=0x7fb404156130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:20.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.970+0000 7fb4037fe640 1 --2- 172.21.15.60:0/3164527809 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb404073850 0x7fb404156130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:20.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.970+0000 7fb4037fe640 1 -- 172.21.15.60:0/3164527809 >> v2:172.21.15.105:3300/0 conn(0x7fb4040c8050 msgr2=0x7fb404073310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:20.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.970+0000 7fb4037fe640 1 --2- 172.21.15.60:0/3164527809 >> v2:172.21.15.105:3300/0 conn(0x7fb4040c8050 0x7fb404073310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:20.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.970+0000 7fb4037fe640 1 -- 172.21.15.60:0/3164527809 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb404153c70 con 0x7fb404153890 2024-09-12T02:23:20.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.971+0000 7fb4037fe640 1 --2- 172.21.15.60:0/3164527809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb404153890 0x7fb40415a030 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb4040c5d90 tx=0x7fb3f402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cc7173c52715e38 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:20.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.971+0000 7fb4027fc640 1 -- 172.21.15.60:0/3164527809 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f4037070 con 0x7fb404153890 2024-09-12T02:23:20.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.971+0000 7fb4027fc640 1 -- 172.21.15.60:0/3164527809 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3f4032440 con 0x7fb404153890 2024-09-12T02:23:20.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.971+0000 7fb4027fc640 1 -- 172.21.15.60:0/3164527809 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f4032810 con 0x7fb404153890 2024-09-12T02:23:20.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.972+0000 7fb40899f640 1 -- 172.21.15.60:0/3164527809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb404153890 msgr2=0x7fb40415a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:20.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.972+0000 7fb40899f640 1 --2- 172.21.15.60:0/3164527809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb404153890 0x7fb40415a030 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb4040c5d90 tx=0x7fb3f402a1e0 comp rx=0 tx=0).stop 2024-09-12T02:23:20.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.972+0000 7fb40899f640 1 -- 172.21.15.60:0/3164527809 shutdown_connections 2024-09-12T02:23:20.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.972+0000 7fb40899f640 1 --2- 172.21.15.60:0/3164527809 >> v2:172.21.15.105:3300/0 conn(0x7fb4040c8050 0x7fb404073310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:20.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.972+0000 7fb40899f640 1 --2- 172.21.15.60:0/3164527809 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb404073850 0x7fb404156130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:20.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.972+0000 7fb40899f640 1 --2- 172.21.15.60:0/3164527809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb404153890 0x7fb40415a030 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:20.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.972+0000 7fb40899f640 1 -- 172.21.15.60:0/3164527809 >> 172.21.15.60:0/3164527809 conn(0x7fb4040cbb70 msgr2=0x7fb4040cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:20.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.972+0000 7fb40899f640 1 -- 172.21.15.60:0/3164527809 shutdown_connections 2024-09-12T02:23:20.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.972+0000 7fb40899f640 1 -- 172.21.15.60:0/3164527809 wait complete. 2024-09-12T02:23:20.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.973+0000 7fb40899f640 1 Processor -- start 2024-09-12T02:23:20.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.973+0000 7fb40899f640 1 -- start start 2024-09-12T02:23:20.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.974+0000 7fb40899f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb404073850 0x7fb404148c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:20.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.974+0000 7fb40899f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4040c8050 0x7fb404157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:20.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.974+0000 7fb40899f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb404153890 0x7fb404157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:20.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.974+0000 7fb40899f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb40406d330 con 0x7fb404153890 2024-09-12T02:23:20.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.974+0000 7fb40899f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb4040c6870 con 0x7fb4040c8050 2024-09-12T02:23:20.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.974+0000 7fb40899f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb40406d610 con 0x7fb404073850 2024-09-12T02:23:20.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.974+0000 7fb403fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb404153890 0x7fb404157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:20.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.974+0000 7fb403fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb404153890 0x7fb404157960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49636/0 (socket says 172.21.15.60:49636) 2024-09-12T02:23:20.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.974+0000 7fb403fff640 1 -- 172.21.15.60:0/292300581 learned_addr learned my addr 172.21.15.60:0/292300581 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:20.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.974+0000 7fb4037fe640 1 --2- 172.21.15.60:0/292300581 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb404073850 0x7fb404148c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:20.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.974+0000 7fb402ffd640 1 --2- 172.21.15.60:0/292300581 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4040c8050 0x7fb404157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:20.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.974+0000 7fb403fff640 1 -- 172.21.15.60:0/292300581 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb404073850 msgr2=0x7fb404148c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:20.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.974+0000 7fb403fff640 1 --2- 172.21.15.60:0/292300581 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb404073850 0x7fb404148c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:20.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.974+0000 7fb403fff640 1 -- 172.21.15.60:0/292300581 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4040c8050 msgr2=0x7fb404157420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:20.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.974+0000 7fb403fff640 1 --2- 172.21.15.60:0/292300581 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4040c8050 0x7fb404157420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:20.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.974+0000 7fb403fff640 1 -- 172.21.15.60:0/292300581 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4041ebdc0 con 0x7fb404153890 2024-09-12T02:23:20.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.974+0000 7fb402ffd640 1 --2- 172.21.15.60:0/292300581 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4040c8050 0x7fb404157420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:23:20.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.975+0000 7fb403fff640 1 --2- 172.21.15.60:0/292300581 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb404153890 0x7fb404157960 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc007d40 tx=0x7fb3fc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:20.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.975+0000 7fb3ebfff640 1 -- 172.21.15.60:0/292300581 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc014420 con 0x7fb404153890 2024-09-12T02:23:20.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.975+0000 7fb3ebfff640 1 -- 172.21.15.60:0/292300581 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3fc019070 con 0x7fb404153890 2024-09-12T02:23:20.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.975+0000 7fb40899f640 1 -- 172.21.15.60:0/292300581 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4041ec080 con 0x7fb404153890 2024-09-12T02:23:20.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.975+0000 7fb3ebfff640 1 -- 172.21.15.60:0/292300581 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc014820 con 0x7fb404153890 2024-09-12T02:23:20.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.975+0000 7fb40899f640 1 -- 172.21.15.60:0/292300581 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4041ec640 con 0x7fb404153890 2024-09-12T02:23:20.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.976+0000 7fb40899f640 1 -- 172.21.15.60:0/292300581 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4040c61c0 con 0x7fb404153890 2024-09-12T02:23:20.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.976+0000 7fb3ebfff640 1 -- 172.21.15.60:0/292300581 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb3fc0149c0 con 0x7fb404153890 2024-09-12T02:23:20.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.977+0000 7fb3ebfff640 1 --2- 172.21.15.60:0/292300581 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb3f006be30 0x7fb3f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:20.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.977+0000 7fb3ebfff640 1 -- 172.21.15.60:0/292300581 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7fb3fc08b7b0 con 0x7fb404153890 2024-09-12T02:23:20.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.977+0000 7fb4037fe640 1 --2- 172.21.15.60:0/292300581 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb3f006be30 0x7fb3f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:20.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.977+0000 7fb4037fe640 1 --2- 172.21.15.60:0/292300581 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb3f006be30 0x7fb3f006e2f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4034000 tx=0x7fb3f402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:20.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:20.981+0000 7fb3ebfff640 1 -- 172.21.15.60:0/292300581 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb4040c61c0 con 0x7fb404153890 2024-09-12T02:23:21.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.153+0000 7fb40899f640 1 -- 172.21.15.60:0/292300581 --> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb404156fd0 con 0x7fb3f006be30 2024-09-12T02:23:21.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.164+0000 7fb3ebfff640 1 -- 172.21.15.60:0/292300581 <== mgr.4098 v2:172.21.15.60:6800/3549430091 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490384 (secure 0 0 0) 0x7fb404156fd0 con 0x7fb3f006be30 2024-09-12T02:23:21.170 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:23:21.173 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T02:23:21.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.168+0000 7fb40899f640 1 -- 172.21.15.60:0/292300581 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb3f006be30 msgr2=0x7fb3f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:21.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.168+0000 7fb40899f640 1 --2- 172.21.15.60:0/292300581 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb3f006be30 0x7fb3f006e2f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4034000 tx=0x7fb3f402e000 comp rx=0 tx=0).stop 2024-09-12T02:23:21.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.168+0000 7fb40899f640 1 -- 172.21.15.60:0/292300581 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb404153890 msgr2=0x7fb404157960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:21.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.168+0000 7fb40899f640 1 --2- 172.21.15.60:0/292300581 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb404153890 0x7fb404157960 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc007d40 tx=0x7fb3fc00e4b0 comp rx=0 tx=0).stop 2024-09-12T02:23:21.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.168+0000 7fb40899f640 1 -- 172.21.15.60:0/292300581 shutdown_connections 2024-09-12T02:23:21.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.168+0000 7fb40899f640 1 --2- 172.21.15.60:0/292300581 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb3f006be30 0x7fb3f006e2f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:21.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.168+0000 7fb40899f640 1 --2- 172.21.15.60:0/292300581 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb404153890 0x7fb404157960 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:21.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.168+0000 7fb40899f640 1 --2- 172.21.15.60:0/292300581 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4040c8050 0x7fb404157420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:21.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.168+0000 7fb40899f640 1 --2- 172.21.15.60:0/292300581 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb404073850 0x7fb404148c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:21.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.168+0000 7fb40899f640 1 -- 172.21.15.60:0/292300581 >> 172.21.15.60:0/292300581 conn(0x7fb4040cbb70 msgr2=0x7fb4040c8580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:21.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.168+0000 7fb40899f640 1 -- 172.21.15.60:0/292300581 shutdown_connections 2024-09-12T02:23:21.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.168+0000 7fb40899f640 1 -- 172.21.15.60:0/292300581 wait complete. 2024-09-12T02:23:21.179 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-09-12T02:23:20.089735+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595188,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":248,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":194,"ondisk_log_size":194,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":277,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252852,"kb_used_data":3308,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754721868,"statfs":{"total":773094113280,"available":772835192832,"internally_reserved":0,"allocated":3387392,"data_stored":1990993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.281196"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840458+0000","last_change":"2024-09-12T02:23:16.851521+0000","last_active":"2024-09-12T02:23:17.840458+0000","last_peered":"2024-09-12T02:23:17.840458+0000","last_clean":"2024-09-12T02:23:17.840458+0000","last_became_active":"2024-09-12T02:23:16.851220+0000","last_became_peered":"2024-09-12T02:23:16.851220+0000","last_unstale":"2024-09-12T02:23:17.840458+0000","last_undegraded":"2024-09-12T02:23:17.840458+0000","last_fullsized":"2024-09-12T02:23:17.840458+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:28.680072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331964+0000","last_change":"2024-09-12T02:23:03.757848+0000","last_active":"2024-09-12T02:23:18.331964+0000","last_peered":"2024-09-12T02:23:18.331964+0000","last_clean":"2024-09-12T02:23:18.331964+0000","last_became_active":"2024-09-12T02:23:03.757544+0000","last_became_peered":"2024-09-12T02:23:03.757544+0000","last_unstale":"2024-09-12T02:23:18.331964+0000","last_undegraded":"2024-09-12T02:23:18.331964+0000","last_fullsized":"2024-09-12T02:23:18.331964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:43.576128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.834954+0000","last_change":"2024-09-12T02:23:04.790549+0000","last_active":"2024-09-12T02:23:16.834954+0000","last_peered":"2024-09-12T02:23:16.834954+0000","last_clean":"2024-09-12T02:23:16.834954+0000","last_became_active":"2024-09-12T02:23:04.790187+0000","last_became_peered":"2024-09-12T02:23:04.790187+0000","last_unstale":"2024-09-12T02:23:16.834954+0000","last_undegraded":"2024-09-12T02:23:16.834954+0000","last_fullsized":"2024-09-12T02:23:16.834954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:49.656395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.833070+0000","last_change":"2024-09-12T02:23:15.829383+0000","last_active":"2024-09-12T02:23:16.833070+0000","last_peered":"2024-09-12T02:23:16.833070+0000","last_clean":"2024-09-12T02:23:16.833070+0000","last_became_active":"2024-09-12T02:23:15.828295+0000","last_became_peered":"2024-09-12T02:23:15.828295+0000","last_unstale":"2024-09-12T02:23:16.833070+0000","last_undegraded":"2024-09-12T02:23:16.833070+0000","last_fullsized":"2024-09-12T02:23:16.833070+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:13.217846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.857189+0000","last_change":"2024-09-12T02:23:16.853675+0000","last_active":"2024-09-12T02:23:16.857189+0000","last_peered":"2024-09-12T02:23:16.857189+0000","last_clean":"2024-09-12T02:23:16.857189+0000","last_became_active":"2024-09-12T02:23:16.853371+0000","last_became_peered":"2024-09-12T02:23:16.853371+0000","last_unstale":"2024-09-12T02:23:16.857189+0000","last_undegraded":"2024-09-12T02:23:16.857189+0000","last_fullsized":"2024-09-12T02:23:16.857189+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:38.513559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.835062+0000","last_change":"2024-09-12T02:23:03.767076+0000","last_active":"2024-09-12T02:23:16.835062+0000","last_peered":"2024-09-12T02:23:16.835062+0000","last_clean":"2024-09-12T02:23:16.835062+0000","last_became_active":"2024-09-12T02:23:03.766686+0000","last_became_peered":"2024-09-12T02:23:03.766686+0000","last_unstale":"2024-09-12T02:23:16.835062+0000","last_undegraded":"2024-09-12T02:23:16.835062+0000","last_fullsized":"2024-09-12T02:23:16.835062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:45.706208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331882+0000","last_change":"2024-09-12T02:23:04.782108+0000","last_active":"2024-09-12T02:23:18.331882+0000","last_peered":"2024-09-12T02:23:18.331882+0000","last_clean":"2024-09-12T02:23:18.331882+0000","last_became_active":"2024-09-12T02:23:04.781829+0000","last_became_peered":"2024-09-12T02:23:04.781829+0000","last_unstale":"2024-09-12T02:23:18.331882+0000","last_undegraded":"2024-09-12T02:23:18.331882+0000","last_fullsized":"2024-09-12T02:23:18.331882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:07:33.165742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840554+0000","last_change":"2024-09-12T02:23:15.828697+0000","last_active":"2024-09-12T02:23:17.840554+0000","last_peered":"2024-09-12T02:23:17.840554+0000","last_clean":"2024-09-12T02:23:17.840554+0000","last_became_active":"2024-09-12T02:23:15.828317+0000","last_became_peered":"2024-09-12T02:23:15.828317+0000","last_unstale":"2024-09-12T02:23:17.840554+0000","last_undegraded":"2024-09-12T02:23:17.840554+0000","last_fullsized":"2024-09-12T02:23:17.840554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:55.347515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840938+0000","last_change":"2024-09-12T02:23:16.856209+0000","last_active":"2024-09-12T02:23:17.840938+0000","last_peered":"2024-09-12T02:23:17.840938+0000","last_clean":"2024-09-12T02:23:17.840938+0000","last_became_active":"2024-09-12T02:23:16.855874+0000","last_became_peered":"2024-09-12T02:23:16.855874+0000","last_unstale":"2024-09-12T02:23:17.840938+0000","last_undegraded":"2024-09-12T02:23:17.840938+0000","last_fullsized":"2024-09-12T02:23:17.840938+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:44.299638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842447+0000","last_change":"2024-09-12T02:23:03.767875+0000","last_active":"2024-09-12T02:23:17.842447+0000","last_peered":"2024-09-12T02:23:17.842447+0000","last_clean":"2024-09-12T02:23:17.842447+0000","last_became_active":"2024-09-12T02:23:03.767596+0000","last_became_peered":"2024-09-12T02:23:03.767596+0000","last_unstale":"2024-09-12T02:23:17.842447+0000","last_undegraded":"2024-09-12T02:23:17.842447+0000","last_fullsized":"2024-09-12T02:23:17.842447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:22.605725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325618+0000","last_change":"2024-09-12T02:23:04.791903+0000","last_active":"2024-09-12T02:23:18.325618+0000","last_peered":"2024-09-12T02:23:18.325618+0000","last_clean":"2024-09-12T02:23:18.325618+0000","last_became_active":"2024-09-12T02:23:04.791635+0000","last_became_peered":"2024-09-12T02:23:04.791635+0000","last_unstale":"2024-09-12T02:23:18.325618+0000","last_undegraded":"2024-09-12T02:23:18.325618+0000","last_fullsized":"2024-09-12T02:23:18.325618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:08.192088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841943+0000","last_change":"2024-09-12T02:23:15.833369+0000","last_active":"2024-09-12T02:23:17.841943+0000","last_peered":"2024-09-12T02:23:17.841943+0000","last_clean":"2024-09-12T02:23:17.841943+0000","last_became_active":"2024-09-12T02:23:15.833010+0000","last_became_peered":"2024-09-12T02:23:15.833010+0000","last_unstale":"2024-09-12T02:23:17.841943+0000","last_undegraded":"2024-09-12T02:23:17.841943+0000","last_fullsized":"2024-09-12T02:23:17.841943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:51.465462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325378+0000","last_change":"2024-09-12T02:23:16.853013+0000","last_active":"2024-09-12T02:23:18.325378+0000","last_peered":"2024-09-12T02:23:18.325378+0000","last_clean":"2024-09-12T02:23:18.325378+0000","last_became_active":"2024-09-12T02:23:16.852698+0000","last_became_peered":"2024-09-12T02:23:16.852698+0000","last_unstale":"2024-09-12T02:23:18.325378+0000","last_undegraded":"2024-09-12T02:23:18.325378+0000","last_fullsized":"2024-09-12T02:23:18.325378+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:11.709531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842467+0000","last_change":"2024-09-12T02:23:03.763480+0000","last_active":"2024-09-12T02:23:17.842467+0000","last_peered":"2024-09-12T02:23:17.842467+0000","last_clean":"2024-09-12T02:23:17.842467+0000","last_became_active":"2024-09-12T02:23:03.762464+0000","last_became_peered":"2024-09-12T02:23:03.762464+0000","last_unstale":"2024-09-12T02:23:17.842467+0000","last_undegraded":"2024-09-12T02:23:17.842467+0000","last_fullsized":"2024-09-12T02:23:17.842467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:24.308289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325931+0000","last_change":"2024-09-12T02:23:04.791109+0000","last_active":"2024-09-12T02:23:18.325931+0000","last_peered":"2024-09-12T02:23:18.325931+0000","last_clean":"2024-09-12T02:23:18.325931+0000","last_became_active":"2024-09-12T02:23:04.790201+0000","last_became_peered":"2024-09-12T02:23:04.790201+0000","last_unstale":"2024-09-12T02:23:18.325931+0000","last_undegraded":"2024-09-12T02:23:18.325931+0000","last_fullsized":"2024-09-12T02:23:18.325931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:13.166139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840837+0000","last_change":"2024-09-12T02:23:15.834261+0000","last_active":"2024-09-12T02:23:17.840837+0000","last_peered":"2024-09-12T02:23:17.840837+0000","last_clean":"2024-09-12T02:23:17.840837+0000","last_became_active":"2024-09-12T02:23:15.833982+0000","last_became_peered":"2024-09-12T02:23:15.833982+0000","last_unstale":"2024-09-12T02:23:17.840837+0000","last_undegraded":"2024-09-12T02:23:17.840837+0000","last_fullsized":"2024-09-12T02:23:17.840837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:04.987961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.862641+0000","last_change":"2024-09-12T02:23:16.861432+0000","last_active":"2024-09-12T02:23:16.862641+0000","last_peered":"2024-09-12T02:23:16.862641+0000","last_clean":"2024-09-12T02:23:16.862641+0000","last_became_active":"2024-09-12T02:23:16.861003+0000","last_became_peered":"2024-09-12T02:23:16.861003+0000","last_unstale":"2024-09-12T02:23:16.862641+0000","last_undegraded":"2024-09-12T02:23:16.862641+0000","last_fullsized":"2024-09-12T02:23:16.862641+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:26.362169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.830825+0000","last_change":"2024-09-12T02:23:04.788754+0000","last_active":"2024-09-12T02:23:16.830825+0000","last_peered":"2024-09-12T02:23:16.830825+0000","last_clean":"2024-09-12T02:23:16.830825+0000","last_became_active":"2024-09-12T02:23:04.788350+0000","last_became_peered":"2024-09-12T02:23:04.788350+0000","last_unstale":"2024-09-12T02:23:16.830825+0000","last_undegraded":"2024-09-12T02:23:16.830825+0000","last_fullsized":"2024-09-12T02:23:16.830825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:08.192088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841873+0000","last_change":"2024-09-12T02:23:03.763423+0000","last_active":"2024-09-12T02:23:17.841873+0000","last_peered":"2024-09-12T02:23:17.841873+0000","last_clean":"2024-09-12T02:23:17.841873+0000","last_became_active":"2024-09-12T02:23:03.762627+0000","last_became_peered":"2024-09-12T02:23:03.762627+0000","last_unstale":"2024-09-12T02:23:17.841873+0000","last_undegraded":"2024-09-12T02:23:17.841873+0000","last_fullsized":"2024-09-12T02:23:17.841873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:18.090657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841725+0000","last_change":"2024-09-12T02:23:15.831604+0000","last_active":"2024-09-12T02:23:17.841725+0000","last_peered":"2024-09-12T02:23:17.841725+0000","last_clean":"2024-09-12T02:23:17.841725+0000","last_became_active":"2024-09-12T02:23:15.831292+0000","last_became_peered":"2024-09-12T02:23:15.831292+0000","last_unstale":"2024-09-12T02:23:17.841725+0000","last_undegraded":"2024-09-12T02:23:17.841725+0000","last_fullsized":"2024-09-12T02:23:17.841725+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:30.234721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.844486+0000","last_change":"2024-09-12T02:23:16.842506+0000","last_active":"2024-09-12T02:23:16.844486+0000","last_peered":"2024-09-12T02:23:16.844486+0000","last_clean":"2024-09-12T02:23:16.844486+0000","last_became_active":"2024-09-12T02:23:16.842210+0000","last_became_peered":"2024-09-12T02:23:16.842210+0000","last_unstale":"2024-09-12T02:23:16.844486+0000","last_undegraded":"2024-09-12T02:23:16.844486+0000","last_fullsized":"2024-09-12T02:23:16.844486+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:44.854807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.833892+0000","last_change":"2024-09-12T02:23:04.782769+0000","last_active":"2024-09-12T02:23:16.833892+0000","last_peered":"2024-09-12T02:23:16.833892+0000","last_clean":"2024-09-12T02:23:16.833892+0000","last_became_active":"2024-09-12T02:23:04.782472+0000","last_became_peered":"2024-09-12T02:23:04.782472+0000","last_unstale":"2024-09-12T02:23:16.833892+0000","last_undegraded":"2024-09-12T02:23:16.833892+0000","last_fullsized":"2024-09-12T02:23:16.833892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:46.144471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.839976+0000","last_change":"2024-09-12T02:23:03.771468+0000","last_active":"2024-09-12T02:23:16.839976+0000","last_peered":"2024-09-12T02:23:16.839976+0000","last_clean":"2024-09-12T02:23:16.839976+0000","last_became_active":"2024-09-12T02:23:03.769619+0000","last_became_peered":"2024-09-12T02:23:03.769619+0000","last_unstale":"2024-09-12T02:23:16.839976+0000","last_undegraded":"2024-09-12T02:23:16.839976+0000","last_fullsized":"2024-09-12T02:23:16.839976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:38.422369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841394+0000","last_change":"2024-09-12T02:23:15.833359+0000","last_active":"2024-09-12T02:23:17.841394+0000","last_peered":"2024-09-12T02:23:17.841394+0000","last_clean":"2024-09-12T02:23:17.841394+0000","last_became_active":"2024-09-12T02:23:15.832995+0000","last_became_peered":"2024-09-12T02:23:15.832995+0000","last_unstale":"2024-09-12T02:23:17.841394+0000","last_undegraded":"2024-09-12T02:23:17.841394+0000","last_fullsized":"2024-09-12T02:23:17.841394+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:57.922845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841919+0000","last_change":"2024-09-12T02:23:16.856439+0000","last_active":"2024-09-12T02:23:17.841919+0000","last_peered":"2024-09-12T02:23:17.841919+0000","last_clean":"2024-09-12T02:23:17.841919+0000","last_became_active":"2024-09-12T02:23:16.856166+0000","last_became_peered":"2024-09-12T02:23:16.856166+0000","last_unstale":"2024-09-12T02:23:17.841919+0000","last_undegraded":"2024-09-12T02:23:17.841919+0000","last_fullsized":"2024-09-12T02:23:17.841919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:42:56.534517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.831348+0000","last_change":"2024-09-12T02:23:04.783991+0000","last_active":"2024-09-12T02:23:16.831348+0000","last_peered":"2024-09-12T02:23:16.831348+0000","last_clean":"2024-09-12T02:23:16.831348+0000","last_became_active":"2024-09-12T02:23:04.783143+0000","last_became_peered":"2024-09-12T02:23:04.783143+0000","last_unstale":"2024-09-12T02:23:16.831348+0000","last_undegraded":"2024-09-12T02:23:16.831348+0000","last_fullsized":"2024-09-12T02:23:16.831348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:53.940843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.839097+0000","last_change":"2024-09-12T02:23:03.770581+0000","last_active":"2024-09-12T02:23:16.839097+0000","last_peered":"2024-09-12T02:23:16.839097+0000","last_clean":"2024-09-12T02:23:16.839097+0000","last_became_active":"2024-09-12T02:23:03.769406+0000","last_became_peered":"2024-09-12T02:23:03.769406+0000","last_unstale":"2024-09-12T02:23:16.839097+0000","last_undegraded":"2024-09-12T02:23:16.839097+0000","last_fullsized":"2024-09-12T02:23:16.839097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:20.963819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"25'1","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.857964+0000","last_change":"2024-09-12T02:23:15.835033+0000","last_active":"2024-09-12T02:23:16.857964+0000","last_peered":"2024-09-12T02:23:16.857964+0000","last_clean":"2024-09-12T02:23:16.857964+0000","last_became_active":"2024-09-12T02:23:15.834753+0000","last_became_peered":"2024-09-12T02:23:15.834753+0000","last_unstale":"2024-09-12T02:23:16.857964+0000","last_undegraded":"2024-09-12T02:23:16.857964+0000","last_fullsized":"2024-09-12T02:23:16.857964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:57.434162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.326093+0000","last_change":"2024-09-12T02:23:16.860867+0000","last_active":"2024-09-12T02:23:18.326093+0000","last_peered":"2024-09-12T02:23:18.326093+0000","last_clean":"2024-09-12T02:23:18.326093+0000","last_became_active":"2024-09-12T02:23:16.860656+0000","last_became_peered":"2024-09-12T02:23:16.860656+0000","last_unstale":"2024-09-12T02:23:18.326093+0000","last_undegraded":"2024-09-12T02:23:18.326093+0000","last_fullsized":"2024-09-12T02:23:18.326093+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:11.375287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842133+0000","last_change":"2024-09-12T02:23:04.780821+0000","last_active":"2024-09-12T02:23:17.842133+0000","last_peered":"2024-09-12T02:23:17.842133+0000","last_clean":"2024-09-12T02:23:17.842133+0000","last_became_active":"2024-09-12T02:23:04.779984+0000","last_became_peered":"2024-09-12T02:23:04.779984+0000","last_unstale":"2024-09-12T02:23:17.842133+0000","last_undegraded":"2024-09-12T02:23:17.842133+0000","last_fullsized":"2024-09-12T02:23:17.842133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:25.724116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841013+0000","last_change":"2024-09-12T02:23:03.764530+0000","last_active":"2024-09-12T02:23:17.841013+0000","last_peered":"2024-09-12T02:23:17.841013+0000","last_clean":"2024-09-12T02:23:17.841013+0000","last_became_active":"2024-09-12T02:23:03.764218+0000","last_became_peered":"2024-09-12T02:23:03.764218+0000","last_unstale":"2024-09-12T02:23:17.841013+0000","last_undegraded":"2024-09-12T02:23:17.841013+0000","last_fullsized":"2024-09-12T02:23:17.841013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:55.445619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842053+0000","last_change":"2024-09-12T02:23:15.831621+0000","last_active":"2024-09-12T02:23:17.842053+0000","last_peered":"2024-09-12T02:23:17.842053+0000","last_clean":"2024-09-12T02:23:17.842053+0000","last_became_active":"2024-09-12T02:23:15.831331+0000","last_became_peered":"2024-09-12T02:23:15.831331+0000","last_unstale":"2024-09-12T02:23:17.842053+0000","last_undegraded":"2024-09-12T02:23:17.842053+0000","last_fullsized":"2024-09-12T02:23:17.842053+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:06.494392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.855121+0000","last_change":"2024-09-12T02:23:16.847556+0000","last_active":"2024-09-12T02:23:16.855121+0000","last_peered":"2024-09-12T02:23:16.855121+0000","last_clean":"2024-09-12T02:23:16.855121+0000","last_became_active":"2024-09-12T02:23:16.845749+0000","last_became_peered":"2024-09-12T02:23:16.845749+0000","last_unstale":"2024-09-12T02:23:16.855121+0000","last_undegraded":"2024-09-12T02:23:16.855121+0000","last_fullsized":"2024-09-12T02:23:16.855121+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:41.469242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.332030+0000","last_change":"2024-09-12T02:23:04.786895+0000","last_active":"2024-09-12T02:23:18.332030+0000","last_peered":"2024-09-12T02:23:18.332030+0000","last_clean":"2024-09-12T02:23:18.332030+0000","last_became_active":"2024-09-12T02:23:04.786591+0000","last_became_peered":"2024-09-12T02:23:04.786591+0000","last_unstale":"2024-09-12T02:23:18.332030+0000","last_undegraded":"2024-09-12T02:23:18.332030+0000","last_fullsized":"2024-09-12T02:23:18.332030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:14.751707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.832025+0000","last_change":"2024-09-12T02:23:03.771259+0000","last_active":"2024-09-12T02:23:16.832025+0000","last_peered":"2024-09-12T02:23:16.832025+0000","last_clean":"2024-09-12T02:23:16.832025+0000","last_became_active":"2024-09-12T02:23:03.770687+0000","last_became_peered":"2024-09-12T02:23:03.770687+0000","last_unstale":"2024-09-12T02:23:16.832025+0000","last_undegraded":"2024-09-12T02:23:16.832025+0000","last_fullsized":"2024-09-12T02:23:16.832025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:38.516959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841319+0000","last_change":"2024-09-12T02:23:15.829406+0000","last_active":"2024-09-12T02:23:17.841319+0000","last_peered":"2024-09-12T02:23:17.841319+0000","last_clean":"2024-09-12T02:23:17.841319+0000","last_became_active":"2024-09-12T02:23:15.829135+0000","last_became_peered":"2024-09-12T02:23:15.829135+0000","last_unstale":"2024-09-12T02:23:17.841319+0000","last_undegraded":"2024-09-12T02:23:17.841319+0000","last_fullsized":"2024-09-12T02:23:17.841319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:22.365804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840867+0000","last_change":"2024-09-12T02:23:16.857016+0000","last_active":"2024-09-12T02:23:17.840867+0000","last_peered":"2024-09-12T02:23:17.840867+0000","last_clean":"2024-09-12T02:23:17.840867+0000","last_became_active":"2024-09-12T02:23:16.856705+0000","last_became_peered":"2024-09-12T02:23:16.856705+0000","last_unstale":"2024-09-12T02:23:17.840867+0000","last_undegraded":"2024-09-12T02:23:17.840867+0000","last_fullsized":"2024-09-12T02:23:17.840867+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:03.672668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.837861+0000","last_change":"2024-09-12T02:23:04.786424+0000","last_active":"2024-09-12T02:23:16.837861+0000","last_peered":"2024-09-12T02:23:16.837861+0000","last_clean":"2024-09-12T02:23:16.837861+0000","last_became_active":"2024-09-12T02:23:04.786136+0000","last_became_peered":"2024-09-12T02:23:04.786136+0000","last_unstale":"2024-09-12T02:23:16.837861+0000","last_undegraded":"2024-09-12T02:23:16.837861+0000","last_fullsized":"2024-09-12T02:23:16.837861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:31.214894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.841191+0000","last_change":"2024-09-12T02:23:03.769745+0000","last_active":"2024-09-12T02:23:16.841191+0000","last_peered":"2024-09-12T02:23:16.841191+0000","last_clean":"2024-09-12T02:23:16.841191+0000","last_became_active":"2024-09-12T02:23:03.769410+0000","last_became_peered":"2024-09-12T02:23:03.769410+0000","last_unstale":"2024-09-12T02:23:16.841191+0000","last_undegraded":"2024-09-12T02:23:16.841191+0000","last_fullsized":"2024-09-12T02:23:16.841191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:00.414459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.830847+0000","last_change":"2024-09-12T02:23:15.827211+0000","last_active":"2024-09-12T02:23:16.830847+0000","last_peered":"2024-09-12T02:23:16.830847+0000","last_clean":"2024-09-12T02:23:16.830847+0000","last_became_active":"2024-09-12T02:23:15.826564+0000","last_became_peered":"2024-09-12T02:23:15.826564+0000","last_unstale":"2024-09-12T02:23:16.830847+0000","last_undegraded":"2024-09-12T02:23:16.830847+0000","last_fullsized":"2024-09-12T02:23:16.830847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:32.389443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.840526+0000","last_change":"2024-09-12T02:23:16.837434+0000","last_active":"2024-09-12T02:23:16.840526+0000","last_peered":"2024-09-12T02:23:16.840526+0000","last_clean":"2024-09-12T02:23:16.840526+0000","last_became_active":"2024-09-12T02:23:16.837162+0000","last_became_peered":"2024-09-12T02:23:16.837162+0000","last_unstale":"2024-09-12T02:23:16.840526+0000","last_undegraded":"2024-09-12T02:23:16.840526+0000","last_fullsized":"2024-09-12T02:23:16.840526+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:28.010927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.842375+0000","last_change":"2024-09-12T02:23:04.775876+0000","last_active":"2024-09-12T02:23:16.842375+0000","last_peered":"2024-09-12T02:23:16.842375+0000","last_clean":"2024-09-12T02:23:16.842375+0000","last_became_active":"2024-09-12T02:23:04.775571+0000","last_became_peered":"2024-09-12T02:23:04.775571+0000","last_unstale":"2024-09-12T02:23:16.842375+0000","last_undegraded":"2024-09-12T02:23:16.842375+0000","last_fullsized":"2024-09-12T02:23:16.842375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:05.070528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842890+0000","last_change":"2024-09-12T02:23:03.764093+0000","last_active":"2024-09-12T02:23:17.842890+0000","last_peered":"2024-09-12T02:23:17.842890+0000","last_clean":"2024-09-12T02:23:17.842890+0000","last_became_active":"2024-09-12T02:23:03.763147+0000","last_became_peered":"2024-09-12T02:23:03.763147+0000","last_unstale":"2024-09-12T02:23:17.842890+0000","last_undegraded":"2024-09-12T02:23:17.842890+0000","last_fullsized":"2024-09-12T02:23:17.842890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:13.317894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331728+0000","last_change":"2024-09-12T02:23:15.832461+0000","last_active":"2024-09-12T02:23:18.331728+0000","last_peered":"2024-09-12T02:23:18.331728+0000","last_clean":"2024-09-12T02:23:18.331728+0000","last_became_active":"2024-09-12T02:23:15.831637+0000","last_became_peered":"2024-09-12T02:23:15.831637+0000","last_unstale":"2024-09-12T02:23:18.331728+0000","last_undegraded":"2024-09-12T02:23:18.331728+0000","last_fullsized":"2024-09-12T02:23:18.331728+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:30.909927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.332020+0000","last_change":"2024-09-12T02:23:16.835824+0000","last_active":"2024-09-12T02:23:18.332020+0000","last_peered":"2024-09-12T02:23:18.332020+0000","last_clean":"2024-09-12T02:23:18.332020+0000","last_became_active":"2024-09-12T02:23:16.835520+0000","last_became_peered":"2024-09-12T02:23:16.835520+0000","last_unstale":"2024-09-12T02:23:18.332020+0000","last_undegraded":"2024-09-12T02:23:18.332020+0000","last_fullsized":"2024-09-12T02:23:18.332020+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:32.797100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.326009+0000","last_change":"2024-09-12T02:23:04.787557+0000","last_active":"2024-09-12T02:23:18.326009+0000","last_peered":"2024-09-12T02:23:18.326009+0000","last_clean":"2024-09-12T02:23:18.326009+0000","last_became_active":"2024-09-12T02:23:04.786527+0000","last_became_peered":"2024-09-12T02:23:04.786527+0000","last_unstale":"2024-09-12T02:23:18.326009+0000","last_undegraded":"2024-09-12T02:23:18.326009+0000","last_fullsized":"2024-09-12T02:23:18.326009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:23.273457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.842481+0000","last_change":"2024-09-12T02:23:03.769913+0000","last_active":"2024-09-12T02:23:16.842481+0000","last_peered":"2024-09-12T02:23:16.842481+0000","last_clean":"2024-09-12T02:23:16.842481+0000","last_became_active":"2024-09-12T02:23:03.769444+0000","last_became_peered":"2024-09-12T02:23:03.769444+0000","last_unstale":"2024-09-12T02:23:16.842481+0000","last_undegraded":"2024-09-12T02:23:16.842481+0000","last_fullsized":"2024-09-12T02:23:16.842481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:21.243182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.839694+0000","last_change":"2024-09-12T02:23:15.829080+0000","last_active":"2024-09-12T02:23:16.839694+0000","last_peered":"2024-09-12T02:23:16.839694+0000","last_clean":"2024-09-12T02:23:16.839694+0000","last_became_active":"2024-09-12T02:23:15.828256+0000","last_became_peered":"2024-09-12T02:23:15.828256+0000","last_unstale":"2024-09-12T02:23:16.839694+0000","last_undegraded":"2024-09-12T02:23:16.839694+0000","last_fullsized":"2024-09-12T02:23:16.839694+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:07.743952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331720+0000","last_change":"2024-09-12T02:23:16.845710+0000","last_active":"2024-09-12T02:23:18.331720+0000","last_peered":"2024-09-12T02:23:18.331720+0000","last_clean":"2024-09-12T02:23:18.331720+0000","last_became_active":"2024-09-12T02:23:16.845379+0000","last_became_peered":"2024-09-12T02:23:16.845379+0000","last_unstale":"2024-09-12T02:23:18.331720+0000","last_undegraded":"2024-09-12T02:23:18.331720+0000","last_fullsized":"2024-09-12T02:23:18.331720+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:16.769410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842948+0000","last_change":"2024-09-12T02:23:04.790723+0000","last_active":"2024-09-12T02:23:17.842948+0000","last_peered":"2024-09-12T02:23:17.842948+0000","last_clean":"2024-09-12T02:23:17.842948+0000","last_became_active":"2024-09-12T02:23:04.786877+0000","last_became_peered":"2024-09-12T02:23:04.786877+0000","last_unstale":"2024-09-12T02:23:17.842948+0000","last_undegraded":"2024-09-12T02:23:17.842948+0000","last_fullsized":"2024-09-12T02:23:17.842948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:48.516002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325581+0000","last_change":"2024-09-12T02:23:03.771518+0000","last_active":"2024-09-12T02:23:18.325581+0000","last_peered":"2024-09-12T02:23:18.325581+0000","last_clean":"2024-09-12T02:23:18.325581+0000","last_became_active":"2024-09-12T02:23:03.771063+0000","last_became_peered":"2024-09-12T02:23:03.771063+0000","last_unstale":"2024-09-12T02:23:18.325581+0000","last_undegraded":"2024-09-12T02:23:18.325581+0000","last_fullsized":"2024-09-12T02:23:18.325581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:43.974555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.842318+0000","last_change":"2024-09-12T02:23:15.827028+0000","last_active":"2024-09-12T02:23:16.842318+0000","last_peered":"2024-09-12T02:23:16.842318+0000","last_clean":"2024-09-12T02:23:16.842318+0000","last_became_active":"2024-09-12T02:23:15.826708+0000","last_became_peered":"2024-09-12T02:23:15.826708+0000","last_unstale":"2024-09-12T02:23:16.842318+0000","last_undegraded":"2024-09-12T02:23:16.842318+0000","last_fullsized":"2024-09-12T02:23:16.842318+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:34.642396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.853100+0000","last_change":"2024-09-12T02:23:16.849429+0000","last_active":"2024-09-12T02:23:16.853100+0000","last_peered":"2024-09-12T02:23:16.853100+0000","last_clean":"2024-09-12T02:23:16.853100+0000","last_became_active":"2024-09-12T02:23:16.849119+0000","last_became_peered":"2024-09-12T02:23:16.849119+0000","last_unstale":"2024-09-12T02:23:16.853100+0000","last_undegraded":"2024-09-12T02:23:16.853100+0000","last_fullsized":"2024-09-12T02:23:16.853100+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:41.277947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.834936+0000","last_change":"2024-09-12T02:23:04.773745+0000","last_active":"2024-09-12T02:23:16.834936+0000","last_peered":"2024-09-12T02:23:16.834936+0000","last_clean":"2024-09-12T02:23:16.834936+0000","last_became_active":"2024-09-12T02:23:04.773360+0000","last_became_peered":"2024-09-12T02:23:04.773360+0000","last_unstale":"2024-09-12T02:23:16.834936+0000","last_undegraded":"2024-09-12T02:23:16.834936+0000","last_fullsized":"2024-09-12T02:23:16.834936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:33.097774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.827184+0000","last_change":"2024-09-12T02:23:03.760700+0000","last_active":"2024-09-12T02:23:16.827184+0000","last_peered":"2024-09-12T02:23:16.827184+0000","last_clean":"2024-09-12T02:23:16.827184+0000","last_became_active":"2024-09-12T02:23:03.760397+0000","last_became_peered":"2024-09-12T02:23:03.760397+0000","last_unstale":"2024-09-12T02:23:16.827184+0000","last_undegraded":"2024-09-12T02:23:16.827184+0000","last_fullsized":"2024-09-12T02:23:16.827184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:36.788864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"25'2","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.861535+0000","last_change":"2024-09-12T02:23:15.828714+0000","last_active":"2024-09-12T02:23:16.861535+0000","last_peered":"2024-09-12T02:23:16.861535+0000","last_clean":"2024-09-12T02:23:16.861535+0000","last_became_active":"2024-09-12T02:23:15.827458+0000","last_became_peered":"2024-09-12T02:23:15.827458+0000","last_unstale":"2024-09-12T02:23:16.861535+0000","last_undegraded":"2024-09-12T02:23:16.861535+0000","last_fullsized":"2024-09-12T02:23:16.861535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:12.581897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.326108+0000","last_change":"2024-09-12T02:23:16.855212+0000","last_active":"2024-09-12T02:23:18.326108+0000","last_peered":"2024-09-12T02:23:18.326108+0000","last_clean":"2024-09-12T02:23:18.326108+0000","last_became_active":"2024-09-12T02:23:16.854938+0000","last_became_peered":"2024-09-12T02:23:16.854938+0000","last_unstale":"2024-09-12T02:23:18.326108+0000","last_undegraded":"2024-09-12T02:23:18.326108+0000","last_fullsized":"2024-09-12T02:23:18.326108+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:02.944057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331430+0000","last_change":"2024-09-12T02:23:04.787820+0000","last_active":"2024-09-12T02:23:18.331430+0000","last_peered":"2024-09-12T02:23:18.331430+0000","last_clean":"2024-09-12T02:23:18.331430+0000","last_became_active":"2024-09-12T02:23:04.787523+0000","last_became_peered":"2024-09-12T02:23:04.787523+0000","last_unstale":"2024-09-12T02:23:18.331430+0000","last_undegraded":"2024-09-12T02:23:18.331430+0000","last_fullsized":"2024-09-12T02:23:18.331430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:52.784171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841124+0000","last_change":"2024-09-12T02:23:03.771625+0000","last_active":"2024-09-12T02:23:17.841124+0000","last_peered":"2024-09-12T02:23:17.841124+0000","last_clean":"2024-09-12T02:23:17.841124+0000","last_became_active":"2024-09-12T02:23:03.771163+0000","last_became_peered":"2024-09-12T02:23:03.771163+0000","last_unstale":"2024-09-12T02:23:17.841124+0000","last_undegraded":"2024-09-12T02:23:17.841124+0000","last_fullsized":"2024-09-12T02:23:17.841124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:32.772569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331906+0000","last_change":"2024-09-12T02:23:15.833889+0000","last_active":"2024-09-12T02:23:18.331906+0000","last_peered":"2024-09-12T02:23:18.331906+0000","last_clean":"2024-09-12T02:23:18.331906+0000","last_became_active":"2024-09-12T02:23:15.833587+0000","last_became_peered":"2024-09-12T02:23:15.833587+0000","last_unstale":"2024-09-12T02:23:18.331906+0000","last_undegraded":"2024-09-12T02:23:18.331906+0000","last_fullsized":"2024-09-12T02:23:18.331906+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:32.787861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842295+0000","last_change":"2024-09-12T02:23:16.848864+0000","last_active":"2024-09-12T02:23:17.842295+0000","last_peered":"2024-09-12T02:23:17.842295+0000","last_clean":"2024-09-12T02:23:17.842295+0000","last_became_active":"2024-09-12T02:23:16.848385+0000","last_became_peered":"2024-09-12T02:23:16.848385+0000","last_unstale":"2024-09-12T02:23:17.842295+0000","last_undegraded":"2024-09-12T02:23:17.842295+0000","last_fullsized":"2024-09-12T02:23:17.842295+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:03.656397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.833443+0000","last_change":"2024-09-12T02:23:04.781839+0000","last_active":"2024-09-12T02:23:16.833443+0000","last_peered":"2024-09-12T02:23:16.833443+0000","last_clean":"2024-09-12T02:23:16.833443+0000","last_became_active":"2024-09-12T02:23:04.780984+0000","last_became_peered":"2024-09-12T02:23:04.780984+0000","last_unstale":"2024-09-12T02:23:16.833443+0000","last_undegraded":"2024-09-12T02:23:16.833443+0000","last_fullsized":"2024-09-12T02:23:16.833443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:07.692791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325299+0000","last_change":"2024-09-12T02:23:03.765100+0000","last_active":"2024-09-12T02:23:18.325299+0000","last_peered":"2024-09-12T02:23:18.325299+0000","last_clean":"2024-09-12T02:23:18.325299+0000","last_became_active":"2024-09-12T02:23:03.764801+0000","last_became_peered":"2024-09-12T02:23:03.764801+0000","last_unstale":"2024-09-12T02:23:18.325299+0000","last_undegraded":"2024-09-12T02:23:18.325299+0000","last_fullsized":"2024-09-12T02:23:18.325299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:06.891040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":178,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841644+0000","last_change":"2024-09-12T02:22:55.143869+0000","last_active":"2024-09-12T02:23:17.841644+0000","last_peered":"2024-09-12T02:23:17.841644+0000","last_clean":"2024-09-12T02:23:17.841644+0000","last_became_active":"2024-09-12T02:22:55.142784+0000","last_became_peered":"2024-09-12T02:22:55.142784+0000","last_unstale":"2024-09-12T02:23:17.841644+0000","last_undegraded":"2024-09-12T02:23:17.841644+0000","last_fullsized":"2024-09-12T02:23:17.841644+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:22:52.457979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:22:52.457979+0000","last_clean_scrub_stamp":"2024-09-12T02:22:52.457979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:46.152602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.831093+0000","last_change":"2024-09-12T02:23:15.831362+0000","last_active":"2024-09-12T02:23:16.831093+0000","last_peered":"2024-09-12T02:23:16.831093+0000","last_clean":"2024-09-12T02:23:16.831093+0000","last_became_active":"2024-09-12T02:23:15.831084+0000","last_became_peered":"2024-09-12T02:23:15.831084+0000","last_unstale":"2024-09-12T02:23:16.831093+0000","last_undegraded":"2024-09-12T02:23:16.831093+0000","last_fullsized":"2024-09-12T02:23:16.831093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:17.754173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.841864+0000","last_change":"2024-09-12T02:23:16.838831+0000","last_active":"2024-09-12T02:23:16.841864+0000","last_peered":"2024-09-12T02:23:16.841864+0000","last_clean":"2024-09-12T02:23:16.841864+0000","last_became_active":"2024-09-12T02:23:16.838523+0000","last_became_peered":"2024-09-12T02:23:16.838523+0000","last_unstale":"2024-09-12T02:23:16.841864+0000","last_undegraded":"2024-09-12T02:23:16.841864+0000","last_fullsized":"2024-09-12T02:23:16.841864+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:57.462030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842398+0000","last_change":"2024-09-12T02:23:04.783483+0000","last_active":"2024-09-12T02:23:17.842398+0000","last_peered":"2024-09-12T02:23:17.842398+0000","last_clean":"2024-09-12T02:23:17.842398+0000","last_became_active":"2024-09-12T02:23:04.782878+0000","last_became_peered":"2024-09-12T02:23:04.782878+0000","last_unstale":"2024-09-12T02:23:17.842398+0000","last_undegraded":"2024-09-12T02:23:17.842398+0000","last_fullsized":"2024-09-12T02:23:17.842398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:52.335065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.827972+0000","last_change":"2024-09-12T02:23:03.762507+0000","last_active":"2024-09-12T02:23:16.827972+0000","last_peered":"2024-09-12T02:23:16.827972+0000","last_clean":"2024-09-12T02:23:16.827972+0000","last_became_active":"2024-09-12T02:23:03.762164+0000","last_became_peered":"2024-09-12T02:23:03.762164+0000","last_unstale":"2024-09-12T02:23:16.827972+0000","last_undegraded":"2024-09-12T02:23:16.827972+0000","last_fullsized":"2024-09-12T02:23:16.827972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:34.569630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.830673+0000","last_change":"2024-09-12T02:23:15.830783+0000","last_active":"2024-09-12T02:23:16.830673+0000","last_peered":"2024-09-12T02:23:16.830673+0000","last_clean":"2024-09-12T02:23:16.830673+0000","last_became_active":"2024-09-12T02:23:15.830471+0000","last_became_peered":"2024-09-12T02:23:15.830471+0000","last_unstale":"2024-09-12T02:23:16.830673+0000","last_undegraded":"2024-09-12T02:23:16.830673+0000","last_fullsized":"2024-09-12T02:23:16.830673+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:22.927201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.857557+0000","last_change":"2024-09-12T02:23:16.856328+0000","last_active":"2024-09-12T02:23:16.857557+0000","last_peered":"2024-09-12T02:23:16.857557+0000","last_clean":"2024-09-12T02:23:16.857557+0000","last_became_active":"2024-09-12T02:23:16.855992+0000","last_became_peered":"2024-09-12T02:23:16.855992+0000","last_unstale":"2024-09-12T02:23:16.857557+0000","last_undegraded":"2024-09-12T02:23:16.857557+0000","last_fullsized":"2024-09-12T02:23:16.857557+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:01.262313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325763+0000","last_change":"2024-09-12T02:23:04.784318+0000","last_active":"2024-09-12T02:23:18.325763+0000","last_peered":"2024-09-12T02:23:18.325763+0000","last_clean":"2024-09-12T02:23:18.325763+0000","last_became_active":"2024-09-12T02:23:04.784012+0000","last_became_peered":"2024-09-12T02:23:04.784012+0000","last_unstale":"2024-09-12T02:23:18.325763+0000","last_undegraded":"2024-09-12T02:23:18.325763+0000","last_fullsized":"2024-09-12T02:23:18.325763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:51.352859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.840569+0000","last_change":"2024-09-12T02:23:03.766034+0000","last_active":"2024-09-12T02:23:16.840569+0000","last_peered":"2024-09-12T02:23:16.840569+0000","last_clean":"2024-09-12T02:23:16.840569+0000","last_became_active":"2024-09-12T02:23:03.765735+0000","last_became_peered":"2024-09-12T02:23:03.765735+0000","last_unstale":"2024-09-12T02:23:16.840569+0000","last_undegraded":"2024-09-12T02:23:16.840569+0000","last_fullsized":"2024-09-12T02:23:16.840569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:19.691229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331594+0000","last_change":"2024-09-12T02:23:15.832527+0000","last_active":"2024-09-12T02:23:18.331594+0000","last_peered":"2024-09-12T02:23:18.331594+0000","last_clean":"2024-09-12T02:23:18.331594+0000","last_became_active":"2024-09-12T02:23:15.832184+0000","last_became_peered":"2024-09-12T02:23:15.832184+0000","last_unstale":"2024-09-12T02:23:18.331594+0000","last_undegraded":"2024-09-12T02:23:18.331594+0000","last_fullsized":"2024-09-12T02:23:18.331594+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:29.131198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840742+0000","last_change":"2024-09-12T02:23:16.849357+0000","last_active":"2024-09-12T02:23:17.840742+0000","last_peered":"2024-09-12T02:23:17.840742+0000","last_clean":"2024-09-12T02:23:17.840742+0000","last_became_active":"2024-09-12T02:23:16.849067+0000","last_became_peered":"2024-09-12T02:23:16.849067+0000","last_unstale":"2024-09-12T02:23:17.840742+0000","last_undegraded":"2024-09-12T02:23:17.840742+0000","last_fullsized":"2024-09-12T02:23:17.840742+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:06.887523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.843122+0000","last_change":"2024-09-12T02:23:04.791152+0000","last_active":"2024-09-12T02:23:17.843122+0000","last_peered":"2024-09-12T02:23:17.843122+0000","last_clean":"2024-09-12T02:23:17.843122+0000","last_became_active":"2024-09-12T02:23:04.790707+0000","last_became_peered":"2024-09-12T02:23:04.790707+0000","last_unstale":"2024-09-12T02:23:17.843122+0000","last_undegraded":"2024-09-12T02:23:17.843122+0000","last_fullsized":"2024-09-12T02:23:17.843122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:42.798507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.827531+0000","last_change":"2024-09-12T02:23:03.763327+0000","last_active":"2024-09-12T02:23:16.827531+0000","last_peered":"2024-09-12T02:23:16.827531+0000","last_clean":"2024-09-12T02:23:16.827531+0000","last_became_active":"2024-09-12T02:23:03.763005+0000","last_became_peered":"2024-09-12T02:23:03.763005+0000","last_unstale":"2024-09-12T02:23:16.827531+0000","last_undegraded":"2024-09-12T02:23:16.827531+0000","last_fullsized":"2024-09-12T02:23:16.827531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:09.500459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325022+0000","last_change":"2024-09-12T02:23:15.819644+0000","last_active":"2024-09-12T02:23:18.325022+0000","last_peered":"2024-09-12T02:23:18.325022+0000","last_clean":"2024-09-12T02:23:18.325022+0000","last_became_active":"2024-09-12T02:23:15.819370+0000","last_became_peered":"2024-09-12T02:23:15.819370+0000","last_unstale":"2024-09-12T02:23:18.325022+0000","last_undegraded":"2024-09-12T02:23:18.325022+0000","last_fullsized":"2024-09-12T02:23:18.325022+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:56.384531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.841813+0000","last_change":"2024-09-12T02:23:16.838234+0000","last_active":"2024-09-12T02:23:16.841813+0000","last_peered":"2024-09-12T02:23:16.841813+0000","last_clean":"2024-09-12T02:23:16.841813+0000","last_became_active":"2024-09-12T02:23:16.837942+0000","last_became_peered":"2024-09-12T02:23:16.837942+0000","last_unstale":"2024-09-12T02:23:16.841813+0000","last_undegraded":"2024-09-12T02:23:16.841813+0000","last_fullsized":"2024-09-12T02:23:16.841813+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:18.312476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842558+0000","last_change":"2024-09-12T02:23:04.781196+0000","last_active":"2024-09-12T02:23:17.842558+0000","last_peered":"2024-09-12T02:23:17.842558+0000","last_clean":"2024-09-12T02:23:17.842558+0000","last_became_active":"2024-09-12T02:23:04.780893+0000","last_became_peered":"2024-09-12T02:23:04.780893+0000","last_unstale":"2024-09-12T02:23:17.842558+0000","last_undegraded":"2024-09-12T02:23:17.842558+0000","last_fullsized":"2024-09-12T02:23:17.842558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:26.527539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842742+0000","last_change":"2024-09-12T02:23:03.769541+0000","last_active":"2024-09-12T02:23:17.842742+0000","last_peered":"2024-09-12T02:23:17.842742+0000","last_clean":"2024-09-12T02:23:17.842742+0000","last_became_active":"2024-09-12T02:23:03.765281+0000","last_became_peered":"2024-09-12T02:23:03.765281+0000","last_unstale":"2024-09-12T02:23:17.842742+0000","last_undegraded":"2024-09-12T02:23:17.842742+0000","last_fullsized":"2024-09-12T02:23:17.842742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:53.409370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841039+0000","last_change":"2024-09-12T02:23:15.841592+0000","last_active":"2024-09-12T02:23:17.841039+0000","last_peered":"2024-09-12T02:23:17.841039+0000","last_clean":"2024-09-12T02:23:17.841039+0000","last_became_active":"2024-09-12T02:23:15.841380+0000","last_became_peered":"2024-09-12T02:23:15.841380+0000","last_unstale":"2024-09-12T02:23:17.841039+0000","last_undegraded":"2024-09-12T02:23:17.841039+0000","last_fullsized":"2024-09-12T02:23:17.841039+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:38.396332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.853890+0000","last_change":"2024-09-12T02:23:16.846596+0000","last_active":"2024-09-12T02:23:16.853890+0000","last_peered":"2024-09-12T02:23:16.853890+0000","last_clean":"2024-09-12T02:23:16.853890+0000","last_became_active":"2024-09-12T02:23:16.846273+0000","last_became_peered":"2024-09-12T02:23:16.846273+0000","last_unstale":"2024-09-12T02:23:16.853890+0000","last_undegraded":"2024-09-12T02:23:16.853890+0000","last_fullsized":"2024-09-12T02:23:16.853890+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:09:34.739118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841299+0000","last_change":"2024-09-12T02:23:04.781856+0000","last_active":"2024-09-12T02:23:17.841299+0000","last_peered":"2024-09-12T02:23:17.841299+0000","last_clean":"2024-09-12T02:23:17.841299+0000","last_became_active":"2024-09-12T02:23:04.781575+0000","last_became_peered":"2024-09-12T02:23:04.781575+0000","last_unstale":"2024-09-12T02:23:17.841299+0000","last_undegraded":"2024-09-12T02:23:17.841299+0000","last_fullsized":"2024-09-12T02:23:17.841299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:26.630558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.827052+0000","last_change":"2024-09-12T02:23:03.771368+0000","last_active":"2024-09-12T02:23:16.827052+0000","last_peered":"2024-09-12T02:23:16.827052+0000","last_clean":"2024-09-12T02:23:16.827052+0000","last_became_active":"2024-09-12T02:23:03.771061+0000","last_became_peered":"2024-09-12T02:23:03.771061+0000","last_unstale":"2024-09-12T02:23:16.827052+0000","last_undegraded":"2024-09-12T02:23:16.827052+0000","last_fullsized":"2024-09-12T02:23:16.827052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:57.476458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.332045+0000","last_change":"2024-09-12T02:23:15.833158+0000","last_active":"2024-09-12T02:23:18.332045+0000","last_peered":"2024-09-12T02:23:18.332045+0000","last_clean":"2024-09-12T02:23:18.332045+0000","last_became_active":"2024-09-12T02:23:15.831707+0000","last_became_peered":"2024-09-12T02:23:15.831707+0000","last_unstale":"2024-09-12T02:23:18.332045+0000","last_undegraded":"2024-09-12T02:23:18.332045+0000","last_fullsized":"2024-09-12T02:23:18.332045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:30.000066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325904+0000","last_change":"2024-09-12T02:23:16.858757+0000","last_active":"2024-09-12T02:23:18.325904+0000","last_peered":"2024-09-12T02:23:18.325904+0000","last_clean":"2024-09-12T02:23:18.325904+0000","last_became_active":"2024-09-12T02:23:16.858469+0000","last_became_peered":"2024-09-12T02:23:16.858469+0000","last_unstale":"2024-09-12T02:23:18.325904+0000","last_undegraded":"2024-09-12T02:23:18.325904+0000","last_fullsized":"2024-09-12T02:23:18.325904+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:22.288143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.830384+0000","last_change":"2024-09-12T02:23:04.785248+0000","last_active":"2024-09-12T02:23:16.830384+0000","last_peered":"2024-09-12T02:23:16.830384+0000","last_clean":"2024-09-12T02:23:16.830384+0000","last_became_active":"2024-09-12T02:23:04.784977+0000","last_became_peered":"2024-09-12T02:23:04.784977+0000","last_unstale":"2024-09-12T02:23:16.830384+0000","last_undegraded":"2024-09-12T02:23:16.830384+0000","last_fullsized":"2024-09-12T02:23:16.830384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:23.273457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.831341+0000","last_change":"2024-09-12T02:23:03.767842+0000","last_active":"2024-09-12T02:23:16.831341+0000","last_peered":"2024-09-12T02:23:16.831341+0000","last_clean":"2024-09-12T02:23:16.831341+0000","last_became_active":"2024-09-12T02:23:03.767066+0000","last_became_peered":"2024-09-12T02:23:03.767066+0000","last_unstale":"2024-09-12T02:23:16.831341+0000","last_undegraded":"2024-09-12T02:23:16.831341+0000","last_fullsized":"2024-09-12T02:23:16.831341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:50.800749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.837700+0000","last_change":"2024-09-12T02:23:15.826104+0000","last_active":"2024-09-12T02:23:16.837700+0000","last_peered":"2024-09-12T02:23:16.837700+0000","last_clean":"2024-09-12T02:23:16.837700+0000","last_became_active":"2024-09-12T02:23:15.825779+0000","last_became_peered":"2024-09-12T02:23:15.825779+0000","last_unstale":"2024-09-12T02:23:16.837700+0000","last_undegraded":"2024-09-12T02:23:16.837700+0000","last_fullsized":"2024-09-12T02:23:16.837700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:32.661083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325654+0000","last_change":"2024-09-12T02:23:16.856543+0000","last_active":"2024-09-12T02:23:18.325654+0000","last_peered":"2024-09-12T02:23:18.325654+0000","last_clean":"2024-09-12T02:23:18.325654+0000","last_became_active":"2024-09-12T02:23:16.855538+0000","last_became_peered":"2024-09-12T02:23:16.855538+0000","last_unstale":"2024-09-12T02:23:18.325654+0000","last_undegraded":"2024-09-12T02:23:18.325654+0000","last_fullsized":"2024-09-12T02:23:18.325654+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:05.857593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841758+0000","last_change":"2024-09-12T02:23:04.783671+0000","last_active":"2024-09-12T02:23:17.841758+0000","last_peered":"2024-09-12T02:23:17.841758+0000","last_clean":"2024-09-12T02:23:17.841758+0000","last_became_active":"2024-09-12T02:23:04.783399+0000","last_became_peered":"2024-09-12T02:23:04.783399+0000","last_unstale":"2024-09-12T02:23:17.841758+0000","last_undegraded":"2024-09-12T02:23:17.841758+0000","last_fullsized":"2024-09-12T02:23:17.841758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:04.321789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325480+0000","last_change":"2024-09-12T02:23:03.767217+0000","last_active":"2024-09-12T02:23:18.325480+0000","last_peered":"2024-09-12T02:23:18.325480+0000","last_clean":"2024-09-12T02:23:18.325480+0000","last_became_active":"2024-09-12T02:23:03.766551+0000","last_became_peered":"2024-09-12T02:23:03.766551+0000","last_unstale":"2024-09-12T02:23:18.325480+0000","last_undegraded":"2024-09-12T02:23:18.325480+0000","last_fullsized":"2024-09-12T02:23:18.325480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:09.963450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"25'6","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.864961+0000","last_change":"2024-09-12T02:23:15.832638+0000","last_active":"2024-09-12T02:23:16.864961+0000","last_peered":"2024-09-12T02:23:16.864961+0000","last_clean":"2024-09-12T02:23:16.864961+0000","last_became_active":"2024-09-12T02:23:15.832152+0000","last_became_peered":"2024-09-12T02:23:15.832152+0000","last_unstale":"2024-09-12T02:23:16.864961+0000","last_undegraded":"2024-09-12T02:23:16.864961+0000","last_fullsized":"2024-09-12T02:23:16.864961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:06.820636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.854363+0000","last_change":"2024-09-12T02:23:16.846920+0000","last_active":"2024-09-12T02:23:16.854363+0000","last_peered":"2024-09-12T02:23:16.854363+0000","last_clean":"2024-09-12T02:23:16.854363+0000","last_became_active":"2024-09-12T02:23:16.846454+0000","last_became_peered":"2024-09-12T02:23:16.846454+0000","last_unstale":"2024-09-12T02:23:16.854363+0000","last_undegraded":"2024-09-12T02:23:16.854363+0000","last_fullsized":"2024-09-12T02:23:16.854363+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:43.749228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331516+0000","last_change":"2024-09-12T02:23:04.784379+0000","last_active":"2024-09-12T02:23:18.331516+0000","last_peered":"2024-09-12T02:23:18.331516+0000","last_clean":"2024-09-12T02:23:18.331516+0000","last_became_active":"2024-09-12T02:23:04.784094+0000","last_became_peered":"2024-09-12T02:23:04.784094+0000","last_unstale":"2024-09-12T02:23:18.331516+0000","last_undegraded":"2024-09-12T02:23:18.331516+0000","last_fullsized":"2024-09-12T02:23:18.331516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:22.103008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.332137+0000","last_change":"2024-09-12T02:23:03.762859+0000","last_active":"2024-09-12T02:23:18.332137+0000","last_peered":"2024-09-12T02:23:18.332137+0000","last_clean":"2024-09-12T02:23:18.332137+0000","last_became_active":"2024-09-12T02:23:03.762557+0000","last_became_peered":"2024-09-12T02:23:03.762557+0000","last_unstale":"2024-09-12T02:23:18.332137+0000","last_undegraded":"2024-09-12T02:23:18.332137+0000","last_fullsized":"2024-09-12T02:23:18.332137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:34.863435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"25'3","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325835+0000","last_change":"2024-09-12T02:23:15.823090+0000","last_active":"2024-09-12T02:23:18.325835+0000","last_peered":"2024-09-12T02:23:18.325835+0000","last_clean":"2024-09-12T02:23:18.325835+0000","last_became_active":"2024-09-12T02:23:15.822441+0000","last_became_peered":"2024-09-12T02:23:15.822441+0000","last_unstale":"2024-09-12T02:23:18.325835+0000","last_undegraded":"2024-09-12T02:23:18.325835+0000","last_fullsized":"2024-09-12T02:23:18.325835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:35.125478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.841511+0000","last_change":"2024-09-12T02:23:16.839875+0000","last_active":"2024-09-12T02:23:16.841511+0000","last_peered":"2024-09-12T02:23:16.841511+0000","last_clean":"2024-09-12T02:23:16.841511+0000","last_became_active":"2024-09-12T02:23:16.838277+0000","last_became_peered":"2024-09-12T02:23:16.838277+0000","last_unstale":"2024-09-12T02:23:16.841511+0000","last_undegraded":"2024-09-12T02:23:16.841511+0000","last_fullsized":"2024-09-12T02:23:16.841511+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:23.327553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842288+0000","last_change":"2024-09-12T02:23:04.780843+0000","last_active":"2024-09-12T02:23:17.842288+0000","last_peered":"2024-09-12T02:23:17.842288+0000","last_clean":"2024-09-12T02:23:17.842288+0000","last_became_active":"2024-09-12T02:23:04.780475+0000","last_became_peered":"2024-09-12T02:23:04.780475+0000","last_unstale":"2024-09-12T02:23:17.842288+0000","last_undegraded":"2024-09-12T02:23:17.842288+0000","last_fullsized":"2024-09-12T02:23:17.842288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:38.074872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.830962+0000","last_change":"2024-09-12T02:23:03.768425+0000","last_active":"2024-09-12T02:23:16.830962+0000","last_peered":"2024-09-12T02:23:16.830962+0000","last_clean":"2024-09-12T02:23:16.830962+0000","last_became_active":"2024-09-12T02:23:03.768092+0000","last_became_peered":"2024-09-12T02:23:03.768092+0000","last_unstale":"2024-09-12T02:23:16.830962+0000","last_undegraded":"2024-09-12T02:23:16.830962+0000","last_fullsized":"2024-09-12T02:23:16.830962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:18.572070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.839523+0000","last_change":"2024-09-12T02:23:15.829364+0000","last_active":"2024-09-12T02:23:16.839523+0000","last_peered":"2024-09-12T02:23:16.839523+0000","last_clean":"2024-09-12T02:23:16.839523+0000","last_became_active":"2024-09-12T02:23:15.827936+0000","last_became_peered":"2024-09-12T02:23:15.827936+0000","last_unstale":"2024-09-12T02:23:16.839523+0000","last_undegraded":"2024-09-12T02:23:16.839523+0000","last_fullsized":"2024-09-12T02:23:16.839523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:04.973202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.857190+0000","last_change":"2024-09-12T02:23:16.854209+0000","last_active":"2024-09-12T02:23:16.857190+0000","last_peered":"2024-09-12T02:23:16.857190+0000","last_clean":"2024-09-12T02:23:16.857190+0000","last_became_active":"2024-09-12T02:23:16.853900+0000","last_became_peered":"2024-09-12T02:23:16.853900+0000","last_unstale":"2024-09-12T02:23:16.857190+0000","last_undegraded":"2024-09-12T02:23:16.857190+0000","last_fullsized":"2024-09-12T02:23:16.857190+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:41.469242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842656+0000","last_change":"2024-09-12T02:23:04.777953+0000","last_active":"2024-09-12T02:23:17.842656+0000","last_peered":"2024-09-12T02:23:17.842656+0000","last_clean":"2024-09-12T02:23:17.842656+0000","last_became_active":"2024-09-12T02:23:04.777081+0000","last_became_peered":"2024-09-12T02:23:04.777081+0000","last_unstale":"2024-09-12T02:23:17.842656+0000","last_undegraded":"2024-09-12T02:23:17.842656+0000","last_fullsized":"2024-09-12T02:23:17.842656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:14.103378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.840506+0000","last_change":"2024-09-12T02:23:03.771271+0000","last_active":"2024-09-12T02:23:16.840506+0000","last_peered":"2024-09-12T02:23:16.840506+0000","last_clean":"2024-09-12T02:23:16.840506+0000","last_became_active":"2024-09-12T02:23:03.769601+0000","last_became_peered":"2024-09-12T02:23:03.769601+0000","last_unstale":"2024-09-12T02:23:16.840506+0000","last_undegraded":"2024-09-12T02:23:16.840506+0000","last_fullsized":"2024-09-12T02:23:16.840506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:22.910072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842076+0000","last_change":"2024-09-12T02:23:15.831522+0000","last_active":"2024-09-12T02:23:17.842076+0000","last_peered":"2024-09-12T02:23:17.842076+0000","last_clean":"2024-09-12T02:23:17.842076+0000","last_became_active":"2024-09-12T02:23:15.831220+0000","last_became_peered":"2024-09-12T02:23:15.831220+0000","last_unstale":"2024-09-12T02:23:17.842076+0000","last_undegraded":"2024-09-12T02:23:17.842076+0000","last_fullsized":"2024-09-12T02:23:17.842076+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:54.337051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.860246+0000","last_change":"2024-09-12T02:23:16.858361+0000","last_active":"2024-09-12T02:23:16.860246+0000","last_peered":"2024-09-12T02:23:16.860246+0000","last_clean":"2024-09-12T02:23:16.860246+0000","last_became_active":"2024-09-12T02:23:16.858075+0000","last_became_peered":"2024-09-12T02:23:16.858075+0000","last_unstale":"2024-09-12T02:23:16.860246+0000","last_undegraded":"2024-09-12T02:23:16.860246+0000","last_fullsized":"2024-09-12T02:23:16.860246+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:00.231676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331887+0000","last_change":"2024-09-12T02:23:04.779171+0000","last_active":"2024-09-12T02:23:18.331887+0000","last_peered":"2024-09-12T02:23:18.331887+0000","last_clean":"2024-09-12T02:23:18.331887+0000","last_became_active":"2024-09-12T02:23:04.778850+0000","last_became_peered":"2024-09-12T02:23:04.778850+0000","last_unstale":"2024-09-12T02:23:18.331887+0000","last_undegraded":"2024-09-12T02:23:18.331887+0000","last_fullsized":"2024-09-12T02:23:18.331887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:21.746490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325975+0000","last_change":"2024-09-12T02:23:03.769710+0000","last_active":"2024-09-12T02:23:18.325975+0000","last_peered":"2024-09-12T02:23:18.325975+0000","last_clean":"2024-09-12T02:23:18.325975+0000","last_became_active":"2024-09-12T02:23:03.769436+0000","last_became_peered":"2024-09-12T02:23:03.769436+0000","last_unstale":"2024-09-12T02:23:18.325975+0000","last_undegraded":"2024-09-12T02:23:18.325975+0000","last_fullsized":"2024-09-12T02:23:18.325975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:11.194147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"25'8","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.862841+0000","last_change":"2024-09-12T02:23:15.833196+0000","last_active":"2024-09-12T02:23:16.862841+0000","last_peered":"2024-09-12T02:23:16.862841+0000","last_clean":"2024-09-12T02:23:16.862841+0000","last_became_active":"2024-09-12T02:23:15.832873+0000","last_became_peered":"2024-09-12T02:23:15.832873+0000","last_unstale":"2024-09-12T02:23:16.862841+0000","last_undegraded":"2024-09-12T02:23:16.862841+0000","last_fullsized":"2024-09-12T02:23:16.862841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:15.238046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840614+0000","last_change":"2024-09-12T02:23:16.856735+0000","last_active":"2024-09-12T02:23:17.840614+0000","last_peered":"2024-09-12T02:23:17.840614+0000","last_clean":"2024-09-12T02:23:17.840614+0000","last_became_active":"2024-09-12T02:23:16.856455+0000","last_became_peered":"2024-09-12T02:23:16.856455+0000","last_unstale":"2024-09-12T02:23:17.840614+0000","last_undegraded":"2024-09-12T02:23:17.840614+0000","last_fullsized":"2024-09-12T02:23:17.840614+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:55.376194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325968+0000","last_change":"2024-09-12T02:23:04.786100+0000","last_active":"2024-09-12T02:23:18.325968+0000","last_peered":"2024-09-12T02:23:18.325968+0000","last_clean":"2024-09-12T02:23:18.325968+0000","last_became_active":"2024-09-12T02:23:04.785795+0000","last_became_peered":"2024-09-12T02:23:04.785795+0000","last_unstale":"2024-09-12T02:23:18.325968+0000","last_undegraded":"2024-09-12T02:23:18.325968+0000","last_fullsized":"2024-09-12T02:23:18.325968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:58.597807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.831896+0000","last_change":"2024-09-12T02:23:03.770668+0000","last_active":"2024-09-12T02:23:16.831896+0000","last_peered":"2024-09-12T02:23:16.831896+0000","last_clean":"2024-09-12T02:23:16.831896+0000","last_became_active":"2024-09-12T02:23:03.769302+0000","last_became_peered":"2024-09-12T02:23:03.769302+0000","last_unstale":"2024-09-12T02:23:16.831896+0000","last_undegraded":"2024-09-12T02:23:16.831896+0000","last_fullsized":"2024-09-12T02:23:16.831896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:18.948922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.832533+0000","last_change":"2024-09-12T02:23:15.825585+0000","last_active":"2024-09-12T02:23:16.832533+0000","last_peered":"2024-09-12T02:23:16.832533+0000","last_clean":"2024-09-12T02:23:16.832533+0000","last_became_active":"2024-09-12T02:23:15.825305+0000","last_became_peered":"2024-09-12T02:23:15.825305+0000","last_unstale":"2024-09-12T02:23:16.832533+0000","last_undegraded":"2024-09-12T02:23:16.832533+0000","last_fullsized":"2024-09-12T02:23:16.832533+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:43.818922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.854210+0000","last_change":"2024-09-12T02:23:16.852415+0000","last_active":"2024-09-12T02:23:16.854210+0000","last_peered":"2024-09-12T02:23:16.854210+0000","last_clean":"2024-09-12T02:23:16.854210+0000","last_became_active":"2024-09-12T02:23:16.852061+0000","last_became_peered":"2024-09-12T02:23:16.852061+0000","last_unstale":"2024-09-12T02:23:16.854210+0000","last_undegraded":"2024-09-12T02:23:16.854210+0000","last_fullsized":"2024-09-12T02:23:16.854210+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:18.122398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331783+0000","last_change":"2024-09-12T02:23:15.833414+0000","last_active":"2024-09-12T02:23:18.331783+0000","last_peered":"2024-09-12T02:23:18.331783+0000","last_clean":"2024-09-12T02:23:18.331783+0000","last_became_active":"2024-09-12T02:23:15.832837+0000","last_became_peered":"2024-09-12T02:23:15.832837+0000","last_unstale":"2024-09-12T02:23:18.331783+0000","last_undegraded":"2024-09-12T02:23:18.331783+0000","last_fullsized":"2024-09-12T02:23:18.331783+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:31.510160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.838979+0000","last_change":"2024-09-12T02:23:04.776572+0000","last_active":"2024-09-12T02:23:16.838979+0000","last_peered":"2024-09-12T02:23:16.838979+0000","last_clean":"2024-09-12T02:23:16.838979+0000","last_became_active":"2024-09-12T02:23:04.776270+0000","last_became_peered":"2024-09-12T02:23:04.776270+0000","last_unstale":"2024-09-12T02:23:16.838979+0000","last_undegraded":"2024-09-12T02:23:16.838979+0000","last_fullsized":"2024-09-12T02:23:16.838979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:12.807907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325207+0000","last_change":"2024-09-12T02:23:03.762450+0000","last_active":"2024-09-12T02:23:18.325207+0000","last_peered":"2024-09-12T02:23:18.325207+0000","last_clean":"2024-09-12T02:23:18.325207+0000","last_became_active":"2024-09-12T02:23:03.762161+0000","last_became_peered":"2024-09-12T02:23:03.762161+0000","last_unstale":"2024-09-12T02:23:18.325207+0000","last_undegraded":"2024-09-12T02:23:18.325207+0000","last_fullsized":"2024-09-12T02:23:18.325207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:42.256395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331804+0000","last_change":"2024-09-12T02:23:16.844537+0000","last_active":"2024-09-12T02:23:18.331804+0000","last_peered":"2024-09-12T02:23:18.331804+0000","last_clean":"2024-09-12T02:23:18.331804+0000","last_became_active":"2024-09-12T02:23:16.844248+0000","last_became_peered":"2024-09-12T02:23:16.844248+0000","last_unstale":"2024-09-12T02:23:18.331804+0000","last_undegraded":"2024-09-12T02:23:18.331804+0000","last_fullsized":"2024-09-12T02:23:18.331804+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:45.801324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"25'4","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.857421+0000","last_change":"2024-09-12T02:23:15.826010+0000","last_active":"2024-09-12T02:23:16.857421+0000","last_peered":"2024-09-12T02:23:16.857421+0000","last_clean":"2024-09-12T02:23:16.857421+0000","last_became_active":"2024-09-12T02:23:15.825730+0000","last_became_peered":"2024-09-12T02:23:15.825730+0000","last_unstale":"2024-09-12T02:23:16.857421+0000","last_undegraded":"2024-09-12T02:23:16.857421+0000","last_fullsized":"2024-09-12T02:23:16.857421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:17.920975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.831255+0000","last_change":"2024-09-12T02:23:04.783317+0000","last_active":"2024-09-12T02:23:16.831255+0000","last_peered":"2024-09-12T02:23:16.831255+0000","last_clean":"2024-09-12T02:23:16.831255+0000","last_became_active":"2024-09-12T02:23:04.783039+0000","last_became_peered":"2024-09-12T02:23:04.783039+0000","last_unstale":"2024-09-12T02:23:16.831255+0000","last_undegraded":"2024-09-12T02:23:16.831255+0000","last_fullsized":"2024-09-12T02:23:16.831255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:17.577991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.833315+0000","last_change":"2024-09-12T02:23:03.768361+0000","last_active":"2024-09-12T02:23:16.833315+0000","last_peered":"2024-09-12T02:23:16.833315+0000","last_clean":"2024-09-12T02:23:16.833315+0000","last_became_active":"2024-09-12T02:23:03.768137+0000","last_became_peered":"2024-09-12T02:23:03.768137+0000","last_unstale":"2024-09-12T02:23:16.833315+0000","last_undegraded":"2024-09-12T02:23:16.833315+0000","last_fullsized":"2024-09-12T02:23:16.833315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:29.721363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.862573+0000","last_change":"2024-09-12T02:23:16.861251+0000","last_active":"2024-09-12T02:23:16.862573+0000","last_peered":"2024-09-12T02:23:16.862573+0000","last_clean":"2024-09-12T02:23:16.862573+0000","last_became_active":"2024-09-12T02:23:16.860980+0000","last_became_peered":"2024-09-12T02:23:16.860980+0000","last_unstale":"2024-09-12T02:23:16.862573+0000","last_undegraded":"2024-09-12T02:23:16.862573+0000","last_fullsized":"2024-09-12T02:23:16.862573+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:00.506034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.831208+0000","last_change":"2024-09-12T02:23:03.768186+0000","last_active":"2024-09-12T02:23:16.831208+0000","last_peered":"2024-09-12T02:23:16.831208+0000","last_clean":"2024-09-12T02:23:16.831208+0000","last_became_active":"2024-09-12T02:23:03.767916+0000","last_became_peered":"2024-09-12T02:23:03.767916+0000","last_unstale":"2024-09-12T02:23:16.831208+0000","last_undegraded":"2024-09-12T02:23:16.831208+0000","last_fullsized":"2024-09-12T02:23:16.831208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:04.424540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.332085+0000","last_change":"2024-09-12T02:23:04.793412+0000","last_active":"2024-09-12T02:23:18.332085+0000","last_peered":"2024-09-12T02:23:18.332085+0000","last_clean":"2024-09-12T02:23:18.332085+0000","last_became_active":"2024-09-12T02:23:04.793100+0000","last_became_peered":"2024-09-12T02:23:04.793100+0000","last_unstale":"2024-09-12T02:23:18.332085+0000","last_undegraded":"2024-09-12T02:23:18.332085+0000","last_fullsized":"2024-09-12T02:23:18.332085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:50.446212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"25'2","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.863930+0000","last_change":"2024-09-12T02:23:15.830776+0000","last_active":"2024-09-12T02:23:16.863930+0000","last_peered":"2024-09-12T02:23:16.863930+0000","last_clean":"2024-09-12T02:23:16.863930+0000","last_became_active":"2024-09-12T02:23:15.830492+0000","last_became_peered":"2024-09-12T02:23:15.830492+0000","last_unstale":"2024-09-12T02:23:16.863930+0000","last_undegraded":"2024-09-12T02:23:16.863930+0000","last_fullsized":"2024-09-12T02:23:16.863930+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:40.517292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840575+0000","last_change":"2024-09-12T02:23:16.851953+0000","last_active":"2024-09-12T02:23:17.840575+0000","last_peered":"2024-09-12T02:23:17.840575+0000","last_clean":"2024-09-12T02:23:17.840575+0000","last_became_active":"2024-09-12T02:23:16.851558+0000","last_became_peered":"2024-09-12T02:23:16.851558+0000","last_unstale":"2024-09-12T02:23:17.840575+0000","last_undegraded":"2024-09-12T02:23:17.840575+0000","last_fullsized":"2024-09-12T02:23:17.840575+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:29.852193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.834001+0000","last_change":"2024-09-12T02:23:03.764310+0000","last_active":"2024-09-12T02:23:16.834001+0000","last_peered":"2024-09-12T02:23:16.834001+0000","last_clean":"2024-09-12T02:23:16.834001+0000","last_became_active":"2024-09-12T02:23:03.764020+0000","last_became_peered":"2024-09-12T02:23:03.764020+0000","last_unstale":"2024-09-12T02:23:16.834001+0000","last_undegraded":"2024-09-12T02:23:16.834001+0000","last_fullsized":"2024-09-12T02:23:16.834001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:25.892874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841038+0000","last_change":"2024-09-12T02:23:04.771579+0000","last_active":"2024-09-12T02:23:17.841038+0000","last_peered":"2024-09-12T02:23:17.841038+0000","last_clean":"2024-09-12T02:23:17.841038+0000","last_became_active":"2024-09-12T02:23:04.771310+0000","last_became_peered":"2024-09-12T02:23:04.771310+0000","last_unstale":"2024-09-12T02:23:17.841038+0000","last_undegraded":"2024-09-12T02:23:17.841038+0000","last_fullsized":"2024-09-12T02:23:17.841038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:05.115474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"25'2","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.857707+0000","last_change":"2024-09-12T02:23:15.832757+0000","last_active":"2024-09-12T02:23:16.857707+0000","last_peered":"2024-09-12T02:23:16.857707+0000","last_clean":"2024-09-12T02:23:16.857707+0000","last_became_active":"2024-09-12T02:23:15.832478+0000","last_became_peered":"2024-09-12T02:23:15.832478+0000","last_unstale":"2024-09-12T02:23:16.857707+0000","last_undegraded":"2024-09-12T02:23:16.857707+0000","last_fullsized":"2024-09-12T02:23:16.857707+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:29.301251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.854514+0000","last_change":"2024-09-12T02:23:16.848437+0000","last_active":"2024-09-12T02:23:16.854514+0000","last_peered":"2024-09-12T02:23:16.854514+0000","last_clean":"2024-09-12T02:23:16.854514+0000","last_became_active":"2024-09-12T02:23:16.847063+0000","last_became_peered":"2024-09-12T02:23:16.847063+0000","last_unstale":"2024-09-12T02:23:16.854514+0000","last_undegraded":"2024-09-12T02:23:16.854514+0000","last_fullsized":"2024-09-12T02:23:16.854514+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:28.331107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.830251+0000","last_change":"2024-09-12T02:23:04.788489+0000","last_active":"2024-09-12T02:23:16.830251+0000","last_peered":"2024-09-12T02:23:16.830251+0000","last_clean":"2024-09-12T02:23:16.830251+0000","last_became_active":"2024-09-12T02:23:04.788195+0000","last_became_peered":"2024-09-12T02:23:04.788195+0000","last_unstale":"2024-09-12T02:23:16.830251+0000","last_undegraded":"2024-09-12T02:23:16.830251+0000","last_fullsized":"2024-09-12T02:23:16.830251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:51.352859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.844925+0000","last_change":"2024-09-12T02:23:16.843805+0000","last_active":"2024-09-12T02:23:16.844925+0000","last_peered":"2024-09-12T02:23:16.844925+0000","last_clean":"2024-09-12T02:23:16.844925+0000","last_became_active":"2024-09-12T02:23:16.843517+0000","last_became_peered":"2024-09-12T02:23:16.843517+0000","last_unstale":"2024-09-12T02:23:16.844925+0000","last_undegraded":"2024-09-12T02:23:16.844925+0000","last_fullsized":"2024-09-12T02:23:16.844925+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:15.724355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.827029+0000","last_change":"2024-09-12T02:23:04.780662+0000","last_active":"2024-09-12T02:23:16.827029+0000","last_peered":"2024-09-12T02:23:16.827029+0000","last_clean":"2024-09-12T02:23:16.827029+0000","last_became_active":"2024-09-12T02:23:04.780402+0000","last_became_peered":"2024-09-12T02:23:04.780402+0000","last_unstale":"2024-09-12T02:23:16.827029+0000","last_undegraded":"2024-09-12T02:23:16.827029+0000","last_fullsized":"2024-09-12T02:23:16.827029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:23:00.556487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325531+0000","last_change":"2024-09-12T02:23:16.852992+0000","last_active":"2024-09-12T02:23:18.325531+0000","last_peered":"2024-09-12T02:23:18.325531+0000","last_clean":"2024-09-12T02:23:18.325531+0000","last_became_active":"2024-09-12T02:23:16.852706+0000","last_became_peered":"2024-09-12T02:23:16.852706+0000","last_unstale":"2024-09-12T02:23:18.325531+0000","last_undegraded":"2024-09-12T02:23:18.325531+0000","last_fullsized":"2024-09-12T02:23:18.325531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:56.896457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325468+0000","last_change":"2024-09-12T02:23:04.785920+0000","last_active":"2024-09-12T02:23:18.325468+0000","last_peered":"2024-09-12T02:23:18.325468+0000","last_clean":"2024-09-12T02:23:18.325468+0000","last_became_active":"2024-09-12T02:23:04.785422+0000","last_became_peered":"2024-09-12T02:23:04.785422+0000","last_unstale":"2024-09-12T02:23:18.325468+0000","last_undegraded":"2024-09-12T02:23:18.325468+0000","last_fullsized":"2024-09-12T02:23:18.325468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:55.106703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.863192+0000","last_change":"2024-09-12T02:23:16.861939+0000","last_active":"2024-09-12T02:23:16.863192+0000","last_peered":"2024-09-12T02:23:16.863192+0000","last_clean":"2024-09-12T02:23:16.863192+0000","last_became_active":"2024-09-12T02:23:16.861658+0000","last_became_peered":"2024-09-12T02:23:16.861658+0000","last_unstale":"2024-09-12T02:23:16.863192+0000","last_undegraded":"2024-09-12T02:23:16.863192+0000","last_fullsized":"2024-09-12T02:23:16.863192+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:16:56.850086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331991+0000","last_change":"2024-09-12T02:23:04.777018+0000","last_active":"2024-09-12T02:23:18.331991+0000","last_peered":"2024-09-12T02:23:18.331991+0000","last_clean":"2024-09-12T02:23:18.331991+0000","last_became_active":"2024-09-12T02:23:04.776736+0000","last_became_peered":"2024-09-12T02:23:04.776736+0000","last_unstale":"2024-09-12T02:23:18.331991+0000","last_undegraded":"2024-09-12T02:23:18.331991+0000","last_fullsized":"2024-09-12T02:23:18.331991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:08.668990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840760+0000","last_change":"2024-09-12T02:23:16.847615+0000","last_active":"2024-09-12T02:23:17.840760+0000","last_peered":"2024-09-12T02:23:17.840760+0000","last_clean":"2024-09-12T02:23:17.840760+0000","last_became_active":"2024-09-12T02:23:16.847260+0000","last_became_peered":"2024-09-12T02:23:16.847260+0000","last_unstale":"2024-09-12T02:23:17.840760+0000","last_undegraded":"2024-09-12T02:23:17.840760+0000","last_fullsized":"2024-09-12T02:23:17.840760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:48.920477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.834604+0000","last_change":"2024-09-12T02:23:04.789372+0000","last_active":"2024-09-12T02:23:16.834604+0000","last_peered":"2024-09-12T02:23:16.834604+0000","last_clean":"2024-09-12T02:23:16.834604+0000","last_became_active":"2024-09-12T02:23:04.789090+0000","last_became_peered":"2024-09-12T02:23:04.789090+0000","last_unstale":"2024-09-12T02:23:16.834604+0000","last_undegraded":"2024-09-12T02:23:16.834604+0000","last_fullsized":"2024-09-12T02:23:16.834604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:49.533491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841815+0000","last_change":"2024-09-12T02:23:16.859000+0000","last_active":"2024-09-12T02:23:17.841815+0000","last_peered":"2024-09-12T02:23:17.841815+0000","last_clean":"2024-09-12T02:23:17.841815+0000","last_became_active":"2024-09-12T02:23:16.858637+0000","last_became_peered":"2024-09-12T02:23:16.858637+0000","last_unstale":"2024-09-12T02:23:17.841815+0000","last_undegraded":"2024-09-12T02:23:17.841815+0000","last_fullsized":"2024-09-12T02:23:17.841815+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:47.915947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.840447+0000","last_change":"2024-09-12T02:23:04.776435+0000","last_active":"2024-09-12T02:23:16.840447+0000","last_peered":"2024-09-12T02:23:16.840447+0000","last_clean":"2024-09-12T02:23:16.840447+0000","last_became_active":"2024-09-12T02:23:04.776120+0000","last_became_peered":"2024-09-12T02:23:04.776120+0000","last_unstale":"2024-09-12T02:23:16.840447+0000","last_undegraded":"2024-09-12T02:23:16.840447+0000","last_fullsized":"2024-09-12T02:23:16.840447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:27.985094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840466+0000","last_change":"2024-09-12T02:23:16.856477+0000","last_active":"2024-09-12T02:23:17.840466+0000","last_peered":"2024-09-12T02:23:17.840466+0000","last_clean":"2024-09-12T02:23:17.840466+0000","last_became_active":"2024-09-12T02:23:16.855839+0000","last_became_peered":"2024-09-12T02:23:16.855839+0000","last_unstale":"2024-09-12T02:23:17.840466+0000","last_undegraded":"2024-09-12T02:23:17.840466+0000","last_fullsized":"2024-09-12T02:23:17.840466+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:42.510184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.830975+0000","last_change":"2024-09-12T02:23:04.788827+0000","last_active":"2024-09-12T02:23:16.830975+0000","last_peered":"2024-09-12T02:23:16.830975+0000","last_clean":"2024-09-12T02:23:16.830975+0000","last_became_active":"2024-09-12T02:23:04.788521+0000","last_became_peered":"2024-09-12T02:23:04.788521+0000","last_unstale":"2024-09-12T02:23:16.830975+0000","last_undegraded":"2024-09-12T02:23:16.830975+0000","last_fullsized":"2024-09-12T02:23:16.830975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:24.470245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.840796+0000","last_change":"2024-09-12T02:23:16.838421+0000","last_active":"2024-09-12T02:23:16.840796+0000","last_peered":"2024-09-12T02:23:16.840796+0000","last_clean":"2024-09-12T02:23:16.840796+0000","last_became_active":"2024-09-12T02:23:16.837606+0000","last_became_peered":"2024-09-12T02:23:16.837606+0000","last_unstale":"2024-09-12T02:23:16.840796+0000","last_undegraded":"2024-09-12T02:23:16.840796+0000","last_fullsized":"2024-09-12T02:23:16.840796+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:14:29.721252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.837753+0000","last_change":"2024-09-12T02:23:04.787899+0000","last_active":"2024-09-12T02:23:16.837753+0000","last_peered":"2024-09-12T02:23:16.837753+0000","last_clean":"2024-09-12T02:23:16.837753+0000","last_became_active":"2024-09-12T02:23:04.787619+0000","last_became_peered":"2024-09-12T02:23:04.787619+0000","last_unstale":"2024-09-12T02:23:16.837753+0000","last_undegraded":"2024-09-12T02:23:16.837753+0000","last_fullsized":"2024-09-12T02:23:16.837753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:57.732453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.854489+0000","last_change":"2024-09-12T02:23:16.845296+0000","last_active":"2024-09-12T02:23:16.854489+0000","last_peered":"2024-09-12T02:23:16.854489+0000","last_clean":"2024-09-12T02:23:16.854489+0000","last_became_active":"2024-09-12T02:23:16.844939+0000","last_became_peered":"2024-09-12T02:23:16.844939+0000","last_unstale":"2024-09-12T02:23:16.854489+0000","last_undegraded":"2024-09-12T02:23:16.854489+0000","last_fullsized":"2024-09-12T02:23:16.854489+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:05.526833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325133+0000","last_change":"2024-09-12T02:23:04.787389+0000","last_active":"2024-09-12T02:23:18.325133+0000","last_peered":"2024-09-12T02:23:18.325133+0000","last_clean":"2024-09-12T02:23:18.325133+0000","last_became_active":"2024-09-12T02:23:04.787092+0000","last_became_peered":"2024-09-12T02:23:04.787092+0000","last_unstale":"2024-09-12T02:23:18.325133+0000","last_undegraded":"2024-09-12T02:23:18.325133+0000","last_fullsized":"2024-09-12T02:23:18.325133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:02.924906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.843281+0000","last_change":"2024-09-12T02:23:16.849846+0000","last_active":"2024-09-12T02:23:17.843281+0000","last_peered":"2024-09-12T02:23:17.843281+0000","last_clean":"2024-09-12T02:23:17.843281+0000","last_became_active":"2024-09-12T02:23:16.849585+0000","last_became_peered":"2024-09-12T02:23:16.849585+0000","last_unstale":"2024-09-12T02:23:17.843281+0000","last_undegraded":"2024-09-12T02:23:17.843281+0000","last_fullsized":"2024-09-12T02:23:17.843281+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:58.775679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.833194+0000","last_change":"2024-09-12T02:23:04.788624+0000","last_active":"2024-09-12T02:23:16.833194+0000","last_peered":"2024-09-12T02:23:16.833194+0000","last_clean":"2024-09-12T02:23:16.833194+0000","last_became_active":"2024-09-12T02:23:04.788352+0000","last_became_peered":"2024-09-12T02:23:04.788352+0000","last_unstale":"2024-09-12T02:23:16.833194+0000","last_undegraded":"2024-09-12T02:23:16.833194+0000","last_fullsized":"2024-09-12T02:23:16.833194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:13.961110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.853405+0000","last_change":"2024-09-12T02:23:16.850112+0000","last_active":"2024-09-12T02:23:16.853405+0000","last_peered":"2024-09-12T02:23:16.853405+0000","last_clean":"2024-09-12T02:23:16.853405+0000","last_became_active":"2024-09-12T02:23:16.849831+0000","last_became_peered":"2024-09-12T02:23:16.849831+0000","last_unstale":"2024-09-12T02:23:16.853405+0000","last_undegraded":"2024-09-12T02:23:16.853405+0000","last_fullsized":"2024-09-12T02:23:16.853405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:27.207742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325319+0000","last_change":"2024-09-12T02:23:04.785685+0000","last_active":"2024-09-12T02:23:18.325319+0000","last_peered":"2024-09-12T02:23:18.325319+0000","last_clean":"2024-09-12T02:23:18.325319+0000","last_became_active":"2024-09-12T02:23:04.784945+0000","last_became_peered":"2024-09-12T02:23:04.784945+0000","last_unstale":"2024-09-12T02:23:18.325319+0000","last_undegraded":"2024-09-12T02:23:18.325319+0000","last_fullsized":"2024-09-12T02:23:18.325319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:36.658436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.853776+0000","last_change":"2024-09-12T02:23:16.846108+0000","last_active":"2024-09-12T02:23:16.853776+0000","last_peered":"2024-09-12T02:23:16.853776+0000","last_clean":"2024-09-12T02:23:16.853776+0000","last_became_active":"2024-09-12T02:23:16.845793+0000","last_became_peered":"2024-09-12T02:23:16.845793+0000","last_unstale":"2024-09-12T02:23:16.853776+0000","last_undegraded":"2024-09-12T02:23:16.853776+0000","last_fullsized":"2024-09-12T02:23:16.853776+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:46.138969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331880+0000","last_change":"2024-09-12T02:23:04.785849+0000","last_active":"2024-09-12T02:23:18.331880+0000","last_peered":"2024-09-12T02:23:18.331880+0000","last_clean":"2024-09-12T02:23:18.331880+0000","last_became_active":"2024-09-12T02:23:04.785511+0000","last_became_peered":"2024-09-12T02:23:04.785511+0000","last_unstale":"2024-09-12T02:23:18.331880+0000","last_undegraded":"2024-09-12T02:23:18.331880+0000","last_fullsized":"2024-09-12T02:23:18.331880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:28.670102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840717+0000","last_change":"2024-09-12T02:23:16.855615+0000","last_active":"2024-09-12T02:23:17.840717+0000","last_peered":"2024-09-12T02:23:17.840717+0000","last_clean":"2024-09-12T02:23:17.840717+0000","last_became_active":"2024-09-12T02:23:16.855278+0000","last_became_peered":"2024-09-12T02:23:16.855278+0000","last_unstale":"2024-09-12T02:23:17.840717+0000","last_undegraded":"2024-09-12T02:23:17.840717+0000","last_fullsized":"2024-09-12T02:23:17.840717+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:34.214175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.830445+0000","last_change":"2024-09-12T02:23:04.789575+0000","last_active":"2024-09-12T02:23:16.830445+0000","last_peered":"2024-09-12T02:23:16.830445+0000","last_clean":"2024-09-12T02:23:16.830445+0000","last_became_active":"2024-09-12T02:23:04.789296+0000","last_became_peered":"2024-09-12T02:23:04.789296+0000","last_unstale":"2024-09-12T02:23:16.830445+0000","last_undegraded":"2024-09-12T02:23:16.830445+0000","last_fullsized":"2024-09-12T02:23:16.830445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:13.166139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841521+0000","last_change":"2024-09-12T02:23:16.858045+0000","last_active":"2024-09-12T02:23:17.841521+0000","last_peered":"2024-09-12T02:23:17.841521+0000","last_clean":"2024-09-12T02:23:17.841521+0000","last_became_active":"2024-09-12T02:23:16.857772+0000","last_became_peered":"2024-09-12T02:23:16.857772+0000","last_unstale":"2024-09-12T02:23:17.841521+0000","last_undegraded":"2024-09-12T02:23:17.841521+0000","last_fullsized":"2024-09-12T02:23:17.841521+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:35.598279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842504+0000","last_change":"2024-09-12T02:23:04.777450+0000","last_active":"2024-09-12T02:23:17.842504+0000","last_peered":"2024-09-12T02:23:17.842504+0000","last_clean":"2024-09-12T02:23:17.842504+0000","last_became_active":"2024-09-12T02:23:04.776825+0000","last_became_peered":"2024-09-12T02:23:04.776825+0000","last_unstale":"2024-09-12T02:23:17.842504+0000","last_undegraded":"2024-09-12T02:23:17.842504+0000","last_fullsized":"2024-09-12T02:23:17.842504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:40.315075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325062+0000","last_change":"2024-09-12T02:23:16.846032+0000","last_active":"2024-09-12T02:23:18.325062+0000","last_peered":"2024-09-12T02:23:18.325062+0000","last_clean":"2024-09-12T02:23:18.325062+0000","last_became_active":"2024-09-12T02:23:16.845492+0000","last_became_peered":"2024-09-12T02:23:16.845492+0000","last_unstale":"2024-09-12T02:23:18.325062+0000","last_undegraded":"2024-09-12T02:23:18.325062+0000","last_fullsized":"2024-09-12T02:23:18.325062+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:18.785798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.827414+0000","last_change":"2024-09-12T02:23:04.791378+0000","last_active":"2024-09-12T02:23:16.827414+0000","last_peered":"2024-09-12T02:23:16.827414+0000","last_clean":"2024-09-12T02:23:16.827414+0000","last_became_active":"2024-09-12T02:23:04.790926+0000","last_became_peered":"2024-09-12T02:23:04.790926+0000","last_unstale":"2024-09-12T02:23:16.827414+0000","last_undegraded":"2024-09-12T02:23:16.827414+0000","last_fullsized":"2024-09-12T02:23:16.827414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:34.764210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331435+0000","last_change":"2024-09-12T02:23:16.851099+0000","last_active":"2024-09-12T02:23:18.331435+0000","last_peered":"2024-09-12T02:23:18.331435+0000","last_clean":"2024-09-12T02:23:18.331435+0000","last_became_active":"2024-09-12T02:23:16.850747+0000","last_became_peered":"2024-09-12T02:23:16.850747+0000","last_unstale":"2024-09-12T02:23:18.331435+0000","last_undegraded":"2024-09-12T02:23:18.331435+0000","last_fullsized":"2024-09-12T02:23:18.331435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:01:31.445590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.326232+0000","last_change":"2024-09-12T02:23:04.789439+0000","last_active":"2024-09-12T02:23:18.326232+0000","last_peered":"2024-09-12T02:23:18.326232+0000","last_clean":"2024-09-12T02:23:18.326232+0000","last_became_active":"2024-09-12T02:23:04.787421+0000","last_became_peered":"2024-09-12T02:23:04.787421+0000","last_unstale":"2024-09-12T02:23:18.326232+0000","last_undegraded":"2024-09-12T02:23:18.326232+0000","last_fullsized":"2024-09-12T02:23:18.326232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:44.295056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.854405+0000","last_change":"2024-09-12T02:23:16.850923+0000","last_active":"2024-09-12T02:23:16.854405+0000","last_peered":"2024-09-12T02:23:16.854405+0000","last_clean":"2024-09-12T02:23:16.854405+0000","last_became_active":"2024-09-12T02:23:16.850609+0000","last_became_peered":"2024-09-12T02:23:16.850609+0000","last_unstale":"2024-09-12T02:23:16.854405+0000","last_undegraded":"2024-09-12T02:23:16.854405+0000","last_fullsized":"2024-09-12T02:23:16.854405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:20.919016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325085+0000","last_change":"2024-09-12T02:23:04.790532+0000","last_active":"2024-09-12T02:23:18.325085+0000","last_peered":"2024-09-12T02:23:18.325085+0000","last_clean":"2024-09-12T02:23:18.325085+0000","last_became_active":"2024-09-12T02:23:04.789229+0000","last_became_peered":"2024-09-12T02:23:04.789229+0000","last_unstale":"2024-09-12T02:23:18.325085+0000","last_undegraded":"2024-09-12T02:23:18.325085+0000","last_fullsized":"2024-09-12T02:23:18.325085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:59.901665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841478+0000","last_change":"2024-09-12T02:23:16.856612+0000","last_active":"2024-09-12T02:23:17.841478+0000","last_peered":"2024-09-12T02:23:17.841478+0000","last_clean":"2024-09-12T02:23:17.841478+0000","last_became_active":"2024-09-12T02:23:16.856290+0000","last_became_peered":"2024-09-12T02:23:16.856290+0000","last_unstale":"2024-09-12T02:23:17.841478+0000","last_undegraded":"2024-09-12T02:23:17.841478+0000","last_fullsized":"2024-09-12T02:23:17.841478+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:14.846281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.839019+0000","last_change":"2024-09-12T02:23:04.782490+0000","last_active":"2024-09-12T02:23:16.839019+0000","last_peered":"2024-09-12T02:23:16.839019+0000","last_clean":"2024-09-12T02:23:16.839019+0000","last_became_active":"2024-09-12T02:23:04.782183+0000","last_became_peered":"2024-09-12T02:23:04.782183+0000","last_unstale":"2024-09-12T02:23:16.839019+0000","last_undegraded":"2024-09-12T02:23:16.839019+0000","last_fullsized":"2024-09-12T02:23:16.839019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:28.699880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325361+0000","last_change":"2024-09-12T02:23:16.858100+0000","last_active":"2024-09-12T02:23:18.325361+0000","last_peered":"2024-09-12T02:23:18.325361+0000","last_clean":"2024-09-12T02:23:18.325361+0000","last_became_active":"2024-09-12T02:23:16.857818+0000","last_became_peered":"2024-09-12T02:23:16.857818+0000","last_unstale":"2024-09-12T02:23:18.325361+0000","last_undegraded":"2024-09-12T02:23:18.325361+0000","last_fullsized":"2024-09-12T02:23:18.325361+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:45.991170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331508+0000","last_change":"2024-09-12T02:23:04.787140+0000","last_active":"2024-09-12T02:23:18.331508+0000","last_peered":"2024-09-12T02:23:18.331508+0000","last_clean":"2024-09-12T02:23:18.331508+0000","last_became_active":"2024-09-12T02:23:04.786799+0000","last_became_peered":"2024-09-12T02:23:04.786799+0000","last_unstale":"2024-09-12T02:23:18.331508+0000","last_undegraded":"2024-09-12T02:23:18.331508+0000","last_fullsized":"2024-09-12T02:23:18.331508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:31.639605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842225+0000","last_change":"2024-09-12T02:23:16.846100+0000","last_active":"2024-09-12T02:23:17.842225+0000","last_peered":"2024-09-12T02:23:17.842225+0000","last_clean":"2024-09-12T02:23:17.842225+0000","last_became_active":"2024-09-12T02:23:16.845749+0000","last_became_peered":"2024-09-12T02:23:16.845749+0000","last_unstale":"2024-09-12T02:23:17.842225+0000","last_undegraded":"2024-09-12T02:23:17.842225+0000","last_fullsized":"2024-09-12T02:23:17.842225+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:42.783366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.833778+0000","last_change":"2024-09-12T02:23:04.782128+0000","last_active":"2024-09-12T02:23:16.833778+0000","last_peered":"2024-09-12T02:23:16.833778+0000","last_clean":"2024-09-12T02:23:16.833778+0000","last_became_active":"2024-09-12T02:23:04.781101+0000","last_became_peered":"2024-09-12T02:23:04.781101+0000","last_unstale":"2024-09-12T02:23:16.833778+0000","last_undegraded":"2024-09-12T02:23:16.833778+0000","last_fullsized":"2024-09-12T02:23:16.833778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:49.421147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.842200+0000","last_change":"2024-09-12T02:23:16.836968+0000","last_active":"2024-09-12T02:23:16.842200+0000","last_peered":"2024-09-12T02:23:16.842200+0000","last_clean":"2024-09-12T02:23:16.842200+0000","last_became_active":"2024-09-12T02:23:16.836561+0000","last_became_peered":"2024-09-12T02:23:16.836561+0000","last_unstale":"2024-09-12T02:23:16.842200+0000","last_undegraded":"2024-09-12T02:23:16.842200+0000","last_fullsized":"2024-09-12T02:23:16.842200+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:34.286339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842555+0000","last_change":"2024-09-12T02:23:04.787034+0000","last_active":"2024-09-12T02:23:17.842555+0000","last_peered":"2024-09-12T02:23:17.842555+0000","last_clean":"2024-09-12T02:23:17.842555+0000","last_became_active":"2024-09-12T02:23:04.786044+0000","last_became_peered":"2024-09-12T02:23:04.786044+0000","last_unstale":"2024-09-12T02:23:17.842555+0000","last_undegraded":"2024-09-12T02:23:17.842555+0000","last_fullsized":"2024-09-12T02:23:17.842555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:07.183028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.847348+0000","last_change":"2024-09-12T02:23:16.846114+0000","last_active":"2024-09-12T02:23:16.847348+0000","last_peered":"2024-09-12T02:23:16.847348+0000","last_clean":"2024-09-12T02:23:16.847348+0000","last_became_active":"2024-09-12T02:23:16.845757+0000","last_became_peered":"2024-09-12T02:23:16.845757+0000","last_unstale":"2024-09-12T02:23:16.847348+0000","last_undegraded":"2024-09-12T02:23:16.847348+0000","last_fullsized":"2024-09-12T02:23:16.847348+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:05.691128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.831392+0000","last_change":"2024-09-12T02:23:04.785662+0000","last_active":"2024-09-12T02:23:16.831392+0000","last_peered":"2024-09-12T02:23:16.831392+0000","last_clean":"2024-09-12T02:23:16.831392+0000","last_became_active":"2024-09-12T02:23:04.785375+0000","last_became_peered":"2024-09-12T02:23:04.785375+0000","last_unstale":"2024-09-12T02:23:16.831392+0000","last_undegraded":"2024-09-12T02:23:16.831392+0000","last_fullsized":"2024-09-12T02:23:16.831392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:44.295056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841351+0000","last_change":"2024-09-12T02:23:16.858175+0000","last_active":"2024-09-12T02:23:17.841351+0000","last_peered":"2024-09-12T02:23:17.841351+0000","last_clean":"2024-09-12T02:23:17.841351+0000","last_became_active":"2024-09-12T02:23:16.857873+0000","last_became_peered":"2024-09-12T02:23:16.857873+0000","last_unstale":"2024-09-12T02:23:17.841351+0000","last_undegraded":"2024-09-12T02:23:17.841351+0000","last_fullsized":"2024-09-12T02:23:17.841351+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:54.535867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.830727+0000","last_change":"2024-09-12T02:23:04.791929+0000","last_active":"2024-09-12T02:23:16.830727+0000","last_peered":"2024-09-12T02:23:16.830727+0000","last_clean":"2024-09-12T02:23:16.830727+0000","last_became_active":"2024-09-12T02:23:04.791622+0000","last_became_peered":"2024-09-12T02:23:04.791622+0000","last_unstale":"2024-09-12T02:23:16.830727+0000","last_undegraded":"2024-09-12T02:23:16.830727+0000","last_fullsized":"2024-09-12T02:23:16.830727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:35.012685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325239+0000","last_change":"2024-09-12T02:23:16.849985+0000","last_active":"2024-09-12T02:23:18.325239+0000","last_peered":"2024-09-12T02:23:18.325239+0000","last_clean":"2024-09-12T02:23:18.325239+0000","last_became_active":"2024-09-12T02:23:16.849641+0000","last_became_peered":"2024-09-12T02:23:16.849641+0000","last_unstale":"2024-09-12T02:23:18.325239+0000","last_undegraded":"2024-09-12T02:23:18.325239+0000","last_fullsized":"2024-09-12T02:23:18.325239+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:28.373543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.843012+0000","last_change":"2024-09-12T02:23:04.781090+0000","last_active":"2024-09-12T02:23:17.843012+0000","last_peered":"2024-09-12T02:23:17.843012+0000","last_clean":"2024-09-12T02:23:17.843012+0000","last_became_active":"2024-09-12T02:23:04.780740+0000","last_became_peered":"2024-09-12T02:23:04.780740+0000","last_unstale":"2024-09-12T02:23:17.843012+0000","last_undegraded":"2024-09-12T02:23:17.843012+0000","last_fullsized":"2024-09-12T02:23:17.843012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:30.639111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.841990+0000","last_change":"2024-09-12T02:23:16.840250+0000","last_active":"2024-09-12T02:23:16.841990+0000","last_peered":"2024-09-12T02:23:16.841990+0000","last_clean":"2024-09-12T02:23:16.841990+0000","last_became_active":"2024-09-12T02:23:16.839914+0000","last_became_peered":"2024-09-12T02:23:16.839914+0000","last_unstale":"2024-09-12T02:23:16.841990+0000","last_undegraded":"2024-09-12T02:23:16.841990+0000","last_fullsized":"2024-09-12T02:23:16.841990+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:04.503400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.831157+0000","last_change":"2024-09-12T02:23:04.779648+0000","last_active":"2024-09-12T02:23:16.831157+0000","last_peered":"2024-09-12T02:23:16.831157+0000","last_clean":"2024-09-12T02:23:16.831157+0000","last_became_active":"2024-09-12T02:23:04.779384+0000","last_became_peered":"2024-09-12T02:23:04.779384+0000","last_unstale":"2024-09-12T02:23:16.831157+0000","last_undegraded":"2024-09-12T02:23:16.831157+0000","last_fullsized":"2024-09-12T02:23:16.831157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:41.491471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.851721+0000","last_change":"2024-09-12T02:23:16.850060+0000","last_active":"2024-09-12T02:23:16.851721+0000","last_peered":"2024-09-12T02:23:16.851721+0000","last_clean":"2024-09-12T02:23:16.851721+0000","last_became_active":"2024-09-12T02:23:16.849744+0000","last_became_peered":"2024-09-12T02:23:16.849744+0000","last_unstale":"2024-09-12T02:23:16.851721+0000","last_undegraded":"2024-09-12T02:23:16.851721+0000","last_fullsized":"2024-09-12T02:23:16.851721+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:55.191627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841118+0000","last_change":"2024-09-12T02:23:04.779265+0000","last_active":"2024-09-12T02:23:17.841118+0000","last_peered":"2024-09-12T02:23:17.841118+0000","last_clean":"2024-09-12T02:23:17.841118+0000","last_became_active":"2024-09-12T02:23:04.778968+0000","last_became_peered":"2024-09-12T02:23:04.778968+0000","last_unstale":"2024-09-12T02:23:17.841118+0000","last_undegraded":"2024-09-12T02:23:17.841118+0000","last_fullsized":"2024-09-12T02:23:17.841118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:53.022598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.863224+0000","last_change":"2024-09-12T02:23:16.862034+0000","last_active":"2024-09-12T02:23:16.863224+0000","last_peered":"2024-09-12T02:23:16.863224+0000","last_clean":"2024-09-12T02:23:16.863224+0000","last_became_active":"2024-09-12T02:23:16.861441+0000","last_became_peered":"2024-09-12T02:23:16.861441+0000","last_unstale":"2024-09-12T02:23:16.863224+0000","last_undegraded":"2024-09-12T02:23:16.863224+0000","last_fullsized":"2024-09-12T02:23:16.863224+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:54.669297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325312+0000","last_change":"2024-09-12T02:23:04.788890+0000","last_active":"2024-09-12T02:23:18.325312+0000","last_peered":"2024-09-12T02:23:18.325312+0000","last_clean":"2024-09-12T02:23:18.325312+0000","last_became_active":"2024-09-12T02:23:04.788617+0000","last_became_peered":"2024-09-12T02:23:04.788617+0000","last_unstale":"2024-09-12T02:23:18.325312+0000","last_undegraded":"2024-09-12T02:23:18.325312+0000","last_fullsized":"2024-09-12T02:23:18.325312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:24.194151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325951+0000","last_change":"2024-09-12T02:23:16.855853+0000","last_active":"2024-09-12T02:23:18.325951+0000","last_peered":"2024-09-12T02:23:18.325951+0000","last_clean":"2024-09-12T02:23:18.325951+0000","last_became_active":"2024-09-12T02:23:16.855437+0000","last_became_peered":"2024-09-12T02:23:16.855437+0000","last_unstale":"2024-09-12T02:23:18.325951+0000","last_undegraded":"2024-09-12T02:23:18.325951+0000","last_fullsized":"2024-09-12T02:23:18.325951+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:27.557862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841894+0000","last_change":"2024-09-12T02:23:04.777165+0000","last_active":"2024-09-12T02:23:17.841894+0000","last_peered":"2024-09-12T02:23:17.841894+0000","last_clean":"2024-09-12T02:23:17.841894+0000","last_became_active":"2024-09-12T02:23:04.776857+0000","last_became_peered":"2024-09-12T02:23:04.776857+0000","last_unstale":"2024-09-12T02:23:17.841894+0000","last_undegraded":"2024-09-12T02:23:17.841894+0000","last_fullsized":"2024-09-12T02:23:17.841894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:28.309591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.855348+0000","last_change":"2024-09-12T02:23:16.849235+0000","last_active":"2024-09-12T02:23:16.855348+0000","last_peered":"2024-09-12T02:23:16.855348+0000","last_clean":"2024-09-12T02:23:16.855348+0000","last_became_active":"2024-09-12T02:23:16.848936+0000","last_became_peered":"2024-09-12T02:23:16.848936+0000","last_unstale":"2024-09-12T02:23:16.855348+0000","last_undegraded":"2024-09-12T02:23:16.855348+0000","last_fullsized":"2024-09-12T02:23:16.855348+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:23.664066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325607+0000","last_change":"2024-09-12T02:23:04.786772+0000","last_active":"2024-09-12T02:23:18.325607+0000","last_peered":"2024-09-12T02:23:18.325607+0000","last_clean":"2024-09-12T02:23:18.325607+0000","last_became_active":"2024-09-12T02:23:04.786509+0000","last_became_peered":"2024-09-12T02:23:04.786509+0000","last_unstale":"2024-09-12T02:23:18.325607+0000","last_undegraded":"2024-09-12T02:23:18.325607+0000","last_fullsized":"2024-09-12T02:23:18.325607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:01.755827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.836697+0000","last_change":"2024-09-12T02:23:16.834788+0000","last_active":"2024-09-12T02:23:16.836697+0000","last_peered":"2024-09-12T02:23:16.836697+0000","last_clean":"2024-09-12T02:23:16.836697+0000","last_became_active":"2024-09-12T02:23:16.834483+0000","last_became_peered":"2024-09-12T02:23:16.834483+0000","last_unstale":"2024-09-12T02:23:16.836697+0000","last_undegraded":"2024-09-12T02:23:16.836697+0000","last_fullsized":"2024-09-12T02:23:16.836697+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:44.008833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331724+0000","last_change":"2024-09-12T02:23:04.778772+0000","last_active":"2024-09-12T02:23:18.331724+0000","last_peered":"2024-09-12T02:23:18.331724+0000","last_clean":"2024-09-12T02:23:18.331724+0000","last_became_active":"2024-09-12T02:23:04.778445+0000","last_became_peered":"2024-09-12T02:23:04.778445+0000","last_unstale":"2024-09-12T02:23:18.331724+0000","last_undegraded":"2024-09-12T02:23:18.331724+0000","last_fullsized":"2024-09-12T02:23:18.331724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:58.292023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840431+0000","last_change":"2024-09-12T02:23:16.844170+0000","last_active":"2024-09-12T02:23:17.840431+0000","last_peered":"2024-09-12T02:23:17.840431+0000","last_clean":"2024-09-12T02:23:17.840431+0000","last_became_active":"2024-09-12T02:23:16.843880+0000","last_became_peered":"2024-09-12T02:23:16.843880+0000","last_unstale":"2024-09-12T02:23:17.840431+0000","last_undegraded":"2024-09-12T02:23:17.840431+0000","last_fullsized":"2024-09-12T02:23:17.840431+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:59.283416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T02:23:16.841071+0000","last_change":"2024-09-12T02:23:04.785821+0000","last_active":"2024-09-12T02:23:16.841071+0000","last_peered":"2024-09-12T02:23:16.841071+0000","last_clean":"2024-09-12T02:23:16.841071+0000","last_became_active":"2024-09-12T02:23:04.785516+0000","last_became_peered":"2024-09-12T02:23:04.785516+0000","last_unstale":"2024-09-12T02:23:16.841071+0000","last_undegraded":"2024-09-12T02:23:16.841071+0000","last_fullsized":"2024-09-12T02:23:16.841071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:42.400040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840987+0000","last_change":"2024-09-12T02:23:16.844145+0000","last_active":"2024-09-12T02:23:17.840987+0000","last_peered":"2024-09-12T02:23:17.840987+0000","last_clean":"2024-09-12T02:23:17.840987+0000","last_became_active":"2024-09-12T02:23:16.843815+0000","last_became_peered":"2024-09-12T02:23:16.843815+0000","last_unstale":"2024-09-12T02:23:17.840987+0000","last_undegraded":"2024-09-12T02:23:17.840987+0000","last_fullsized":"2024-09-12T02:23:17.840987+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:31.789317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842753+0000","last_change":"2024-09-12T02:23:04.791204+0000","last_active":"2024-09-12T02:23:17.842753+0000","last_peered":"2024-09-12T02:23:17.842753+0000","last_clean":"2024-09-12T02:23:17.842753+0000","last_became_active":"2024-09-12T02:23:04.790906+0000","last_became_peered":"2024-09-12T02:23:04.790906+0000","last_unstale":"2024-09-12T02:23:17.842753+0000","last_undegraded":"2024-09-12T02:23:17.842753+0000","last_fullsized":"2024-09-12T02:23:17.842753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:16.336873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476744,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":695559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476744,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":274432,"data_stored":99640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476745,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":105281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":286720,"data_stored":104749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35608,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336232,"statfs":{"total":96636764160,"available":96600301568,"internally_reserved":0,"allocated":258048,"data_stored":97482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36192,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335648,"statfs":{"total":96636764160,"available":96599703552,"internally_reserved":0,"allocated":860160,"data_stored":688418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35632,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336208,"statfs":{"total":96636764160,"available":96600276992,"internally_reserved":0,"allocated":282624,"data_stored":100658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35628,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336212,"statfs":{"total":96636764160,"available":96600281088,"internally_reserved":0,"allocated":278528,"data_stored":99206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:23:21.190 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T02:23:21.190 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T02:23:21.191 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T02:23:21.191 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T02:23:21.192 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T02:23:21.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.322+0000 7fbbc1c94640 1 Processor -- start 2024-09-12T02:23:21.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.322+0000 7fbbc1c94640 1 -- start start 2024-09-12T02:23:21.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.323+0000 7fbbc1c94640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbbc0caff0 0x7fbbbc0cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:21.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.323+0000 7fbbc1c94640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbbbc156ce0 0x7fbbbc0ca040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:21.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.323+0000 7fbbc1c94640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbbc150690 con 0x7fbbbc06c610 2024-09-12T02:23:21.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.323+0000 7fbbc1c94640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fbbbc1571e0 con 0x7fbbbc156ce0 2024-09-12T02:23:21.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.323+0000 7fbbc1c94640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbbbc0cbb20 con 0x7fbbbc0caff0 2024-09-12T02:23:21.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.323+0000 7fbbbbfff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fbbbc06c610 0x7fbbbc0ca580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53858/0 (socket says 172.21.15.60:53858) 2024-09-12T02:23:21.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.323+0000 7fbbbbfff640 1 -- 172.21.15.60:0/3541174482 learned_addr learned my addr 172.21.15.60:0/3541174482 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:21.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.323+0000 7fbbbb7fe640 1 --2- 172.21.15.60:0/3541174482 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbbc0caff0 0x7fbbbc0cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:21.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.323+0000 7fbbb3fff640 1 --2- 172.21.15.60:0/3541174482 >> v2:172.21.15.105:3300/0 conn(0x7fbbbc156ce0 0x7fbbbc0ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:21.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.323+0000 7fbbbaffd640 1 -- 172.21.15.60:0/3541174482 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1694764896 0 0) 0x7fbbbc150690 con 0x7fbbbc06c610 2024-09-12T02:23:21.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.323+0000 7fbbbaffd640 1 -- 172.21.15.60:0/3541174482 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbba8003520 con 0x7fbbbc06c610 2024-09-12T02:23:21.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.323+0000 7fbbbb7fe640 1 -- 172.21.15.60:0/3541174482 >> v2:172.21.15.105:3300/0 conn(0x7fbbbc156ce0 msgr2=0x7fbbbc0ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:21.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.323+0000 7fbbbb7fe640 1 --2- 172.21.15.60:0/3541174482 >> v2:172.21.15.105:3300/0 conn(0x7fbbbc156ce0 0x7fbbbc0ca040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:21.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.323+0000 7fbbbb7fe640 1 -- 172.21.15.60:0/3541174482 >> v1:172.21.15.60:6789/0 conn(0x7fbbbc06c610 legacy=0x7fbbbc0ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:21.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.324+0000 7fbbbb7fe640 1 -- 172.21.15.60:0/3541174482 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbbc0cbdc0 con 0x7fbbbc0caff0 2024-09-12T02:23:21.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.324+0000 7fbbbb7fe640 1 --2- 172.21.15.60:0/3541174482 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbbc0caff0 0x7fbbbc0cb3d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbbac0097a0 tx=0x7fbbac02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52fec61fdd0900fb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:21.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.324+0000 7fbbbaffd640 1 -- 172.21.15.60:0/3541174482 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbac037070 con 0x7fbbbc0caff0 2024-09-12T02:23:21.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.324+0000 7fbbbaffd640 1 -- 172.21.15.60:0/3541174482 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbac02ae50 con 0x7fbbbc0caff0 2024-09-12T02:23:21.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.324+0000 7fbbbaffd640 1 -- 172.21.15.60:0/3541174482 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbac032660 con 0x7fbbbc0caff0 2024-09-12T02:23:21.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.325+0000 7fbbc1c94640 1 -- 172.21.15.60:0/3541174482 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbbc0caff0 msgr2=0x7fbbbc0cb3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:21.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.325+0000 7fbbc1c94640 1 --2- 172.21.15.60:0/3541174482 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbbc0caff0 0x7fbbbc0cb3d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbbac0097a0 tx=0x7fbbac02a100 comp rx=0 tx=0).stop 2024-09-12T02:23:21.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.325+0000 7fbbc1c94640 1 -- 172.21.15.60:0/3541174482 shutdown_connections 2024-09-12T02:23:21.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.325+0000 7fbbc1c94640 1 --2- 172.21.15.60:0/3541174482 >> v2:172.21.15.105:3300/0 conn(0x7fbbbc156ce0 0x7fbbbc0ca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:21.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.325+0000 7fbbc1c94640 1 --2- 172.21.15.60:0/3541174482 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbbc0caff0 0x7fbbbc0cb3d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:21.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.325+0000 7fbbc1c94640 1 -- 172.21.15.60:0/3541174482 >> 172.21.15.60:0/3541174482 conn(0x7fbbbc068010 msgr2=0x7fbbbc073310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:21.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.325+0000 7fbbc1c94640 1 -- 172.21.15.60:0/3541174482 shutdown_connections 2024-09-12T02:23:21.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.325+0000 7fbbc1c94640 1 -- 172.21.15.60:0/3541174482 wait complete. 2024-09-12T02:23:21.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.326+0000 7fbbc1c94640 1 Processor -- start 2024-09-12T02:23:21.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.326+0000 7fbbc1c94640 1 -- start start 2024-09-12T02:23:21.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.327+0000 7fbbc1c94640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbbc06c610 0x7fbbbc1ec820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:21.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.327+0000 7fbbc1c94640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbbbc0caff0 0x7fbbbc1dfff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:21.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.327+0000 7fbbc1c94640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbbc156ce0 0x7fbbbc14ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:21.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.327+0000 7fbbc1c94640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbbbc0cac90 con 0x7fbbbc0caff0 2024-09-12T02:23:21.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.327+0000 7fbbc1c94640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbbbc0cc380 con 0x7fbbbc156ce0 2024-09-12T02:23:21.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.327+0000 7fbbc1c94640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbbbc06bbe0 con 0x7fbbbc06c610 2024-09-12T02:23:21.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.327+0000 7fbbb3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbbbc0caff0 0x7fbbbc1dfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:21.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.327+0000 7fbbb3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbbbc0caff0 0x7fbbbc1dfff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49642/0 (socket says 172.21.15.60:49642) 2024-09-12T02:23:21.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.327+0000 7fbbb3fff640 1 -- 172.21.15.60:0/2857774045 learned_addr learned my addr 172.21.15.60:0/2857774045 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:21.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.327+0000 7fbbbb7fe640 1 --2- 172.21.15.60:0/2857774045 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbbc06c610 0x7fbbbc1ec820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:21.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.327+0000 7fbbbbfff640 1 --2- 172.21.15.60:0/2857774045 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbbc156ce0 0x7fbbbc14ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:21.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.327+0000 7fbbb3fff640 1 -- 172.21.15.60:0/2857774045 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbbc06c610 msgr2=0x7fbbbc1ec820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:21.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.327+0000 7fbbb3fff640 1 --2- 172.21.15.60:0/2857774045 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbbc06c610 0x7fbbbc1ec820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:21.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.327+0000 7fbbb3fff640 1 -- 172.21.15.60:0/2857774045 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbbc156ce0 msgr2=0x7fbbbc14ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:21.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.327+0000 7fbbb3fff640 1 --2- 172.21.15.60:0/2857774045 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbbc156ce0 0x7fbbbc14ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:21.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.327+0000 7fbbb3fff640 1 -- 172.21.15.60:0/2857774045 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbbc1e0b90 con 0x7fbbbc0caff0 2024-09-12T02:23:21.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.328+0000 7fbbb3fff640 1 --2- 172.21.15.60:0/2857774045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbbbc0caff0 0x7fbbbc1dfff0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbba400e980 tx=0x7fbba400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:21.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.328+0000 7fbbb8ff9640 1 -- 172.21.15.60:0/2857774045 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba4017070 con 0x7fbbbc0caff0 2024-09-12T02:23:21.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.328+0000 7fbbb8ff9640 1 -- 172.21.15.60:0/2857774045 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbba400ca00 con 0x7fbbbc0caff0 2024-09-12T02:23:21.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.328+0000 7fbbc1c94640 1 -- 172.21.15.60:0/2857774045 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbbc1e0e70 con 0x7fbbbc0caff0 2024-09-12T02:23:21.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.328+0000 7fbbb8ff9640 1 -- 172.21.15.60:0/2857774045 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba400cdd0 con 0x7fbbbc0caff0 2024-09-12T02:23:21.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.328+0000 7fbbc1c94640 1 -- 172.21.15.60:0/2857774045 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbbc156140 con 0x7fbbbc0caff0 2024-09-12T02:23:21.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.329+0000 7fbbc1c94640 1 -- 172.21.15.60:0/2857774045 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbbc1e1390 con 0x7fbbbc0caff0 2024-09-12T02:23:21.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.329+0000 7fbbb8ff9640 1 -- 172.21.15.60:0/2857774045 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbba401a070 con 0x7fbbbc0caff0 2024-09-12T02:23:21.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.330+0000 7fbbb8ff9640 1 --2- 172.21.15.60:0/2857774045 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbb9c06be30 0x7fbb9c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:21.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.330+0000 7fbbb8ff9640 1 -- 172.21.15.60:0/2857774045 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7fbba408b470 con 0x7fbbbc0caff0 2024-09-12T02:23:21.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.330+0000 7fbbbb7fe640 1 --2- 172.21.15.60:0/2857774045 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbb9c06be30 0x7fbb9c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:21.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.330+0000 7fbbbb7fe640 1 --2- 172.21.15.60:0/2857774045 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbb9c06be30 0x7fbb9c06e2f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbbac034000 tx=0x7fbbac02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:21.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.334+0000 7fbbb8ff9640 1 -- 172.21.15.60:0/2857774045 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbba4059490 con 0x7fbbbc0caff0 2024-09-12T02:23:21.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.560+0000 7fbbc1c94640 1 -- 172.21.15.60:0/2857774045 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fbbbc0cb3d0 con 0x7fbbbc0caff0 2024-09-12T02:23:21.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.563+0000 7fbbb8ff9640 1 -- 172.21.15.60:0/2857774045 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+172937 (secure 0 0 0) 0x7fbba405d790 con 0x7fbbbc0caff0 2024-09-12T02:23:21.565 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:23:21.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.566+0000 7fbbc1c94640 1 -- 172.21.15.60:0/2857774045 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbb9c06be30 msgr2=0x7fbb9c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:21.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.566+0000 7fbbc1c94640 1 --2- 172.21.15.60:0/2857774045 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbb9c06be30 0x7fbb9c06e2f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbbac034000 tx=0x7fbbac02e000 comp rx=0 tx=0).stop 2024-09-12T02:23:21.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.566+0000 7fbbc1c94640 1 -- 172.21.15.60:0/2857774045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbbbc0caff0 msgr2=0x7fbbbc1dfff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:21.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.566+0000 7fbbc1c94640 1 --2- 172.21.15.60:0/2857774045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbbbc0caff0 0x7fbbbc1dfff0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbba400e980 tx=0x7fbba400ee40 comp rx=0 tx=0).stop 2024-09-12T02:23:21.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.566+0000 7fbbc1c94640 1 -- 172.21.15.60:0/2857774045 shutdown_connections 2024-09-12T02:23:21.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.566+0000 7fbbc1c94640 1 --2- 172.21.15.60:0/2857774045 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbb9c06be30 0x7fbb9c06e2f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:21.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.566+0000 7fbbc1c94640 1 --2- 172.21.15.60:0/2857774045 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbbc156ce0 0x7fbbbc14ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:21.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.566+0000 7fbbc1c94640 1 --2- 172.21.15.60:0/2857774045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbbbc0caff0 0x7fbbbc1dfff0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:21.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.566+0000 7fbbc1c94640 1 --2- 172.21.15.60:0/2857774045 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbbc06c610 0x7fbbbc1ec820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:21.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.566+0000 7fbbc1c94640 1 -- 172.21.15.60:0/2857774045 >> 172.21.15.60:0/2857774045 conn(0x7fbbbc068010 msgr2=0x7fbbbc073310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:21.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.566+0000 7fbbc1c94640 1 -- 172.21.15.60:0/2857774045 shutdown_connections 2024-09-12T02:23:21.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.566+0000 7fbbc1c94640 1 -- 172.21.15.60:0/2857774045 wait complete. 2024-09-12T02:23:21.577 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":5,"flags":0,"active_gid":4098,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":3549430091},{"type":"v1","addr":"172.21.15.60:6801","nonce":3549430091}]},"active_addr":"172.21.15.60:6801/3549430091","active_change":"2024-09-12T02:22:44.080465+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4101,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.60:0","nonce":2342249478}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.60:0","nonce":260028872}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.60:0","nonce":300938115}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.60:0","nonce":1567836310}]}]} 2024-09-12T02:23:21.581 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T02:23:21.581 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T02:23:21.582 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:23:21.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.683+0000 7fa8c8d11640 1 Processor -- start 2024-09-12T02:23:21.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.683+0000 7fa8c8d11640 1 -- start start 2024-09-12T02:23:21.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.684+0000 7fa8c8d11640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8c406c650 0x7fa8c40c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:21.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.684+0000 7fa8c8d11640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa8c40ca1c0 0x7fa8c4160bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:21.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.684+0000 7fa8c8d11640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8c415a7c0 con 0x7fa8c4150480 2024-09-12T02:23:21.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.684+0000 7fa8c8d11640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fa8c406c240 con 0x7fa8c40ca1c0 2024-09-12T02:23:21.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.684+0000 7fa8c8d11640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa8c415a330 con 0x7fa8c406c650 2024-09-12T02:23:21.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.684+0000 7fa8c259c640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa8c4150480 0x7fa8c40c7a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53860/0 (socket says 172.21.15.60:53860) 2024-09-12T02:23:21.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.684+0000 7fa8c259c640 1 -- 172.21.15.60:0/3526069807 learned_addr learned my addr 172.21.15.60:0/3526069807 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:21.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.684+0000 7fa8c1d9b640 1 --2- 172.21.15.60:0/3526069807 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8c406c650 0x7fa8c40c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:21.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.684+0000 7fa8c2d9d640 1 --2- 172.21.15.60:0/3526069807 >> v2:172.21.15.105:3300/0 conn(0x7fa8c40ca1c0 0x7fa8c4160bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:21.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.684+0000 7fa8c159a640 1 -- 172.21.15.60:0/3526069807 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1819780243 0 0) 0x7fa8c415a7c0 con 0x7fa8c4150480 2024-09-12T02:23:21.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.684+0000 7fa8c159a640 1 -- 172.21.15.60:0/3526069807 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8ac003520 con 0x7fa8c4150480 2024-09-12T02:23:21.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.684+0000 7fa8c1d9b640 1 -- 172.21.15.60:0/3526069807 >> v2:172.21.15.105:3300/0 conn(0x7fa8c40ca1c0 msgr2=0x7fa8c4160bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:21.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.684+0000 7fa8c1d9b640 1 --2- 172.21.15.60:0/3526069807 >> v2:172.21.15.105:3300/0 conn(0x7fa8c40ca1c0 0x7fa8c4160bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:21.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.684+0000 7fa8c1d9b640 1 -- 172.21.15.60:0/3526069807 >> v1:172.21.15.60:6789/0 conn(0x7fa8c4150480 legacy=0x7fa8c40c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:21.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.684+0000 7fa8c1d9b640 1 -- 172.21.15.60:0/3526069807 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8c4159a00 con 0x7fa8c406c650 2024-09-12T02:23:21.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.684+0000 7fa8c2d9d640 1 --2- 172.21.15.60:0/3526069807 >> v2:172.21.15.105:3300/0 conn(0x7fa8c40ca1c0 0x7fa8c4160bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:23:21.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.685+0000 7fa8c1d9b640 1 --2- 172.21.15.60:0/3526069807 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8c406c650 0x7fa8c40c9c80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa8b80097a0 tx=0x7fa8b802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e0e32b5140f0074 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:21.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.685+0000 7fa8c159a640 1 -- 172.21.15.60:0/3526069807 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b8037070 con 0x7fa8c406c650 2024-09-12T02:23:21.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.685+0000 7fa8c159a640 1 -- 172.21.15.60:0/3526069807 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8b8032440 con 0x7fa8c406c650 2024-09-12T02:23:21.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.685+0000 7fa8c159a640 1 -- 172.21.15.60:0/3526069807 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b8032810 con 0x7fa8c406c650 2024-09-12T02:23:21.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.686+0000 7fa8c8d11640 1 -- 172.21.15.60:0/3526069807 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8c406c650 msgr2=0x7fa8c40c9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:21.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.686+0000 7fa8c8d11640 1 --2- 172.21.15.60:0/3526069807 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8c406c650 0x7fa8c40c9c80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa8b80097a0 tx=0x7fa8b802a180 comp rx=0 tx=0).stop 2024-09-12T02:23:21.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.686+0000 7fa8c8d11640 1 -- 172.21.15.60:0/3526069807 shutdown_connections 2024-09-12T02:23:21.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.686+0000 7fa8c8d11640 1 --2- 172.21.15.60:0/3526069807 >> v2:172.21.15.105:3300/0 conn(0x7fa8c40ca1c0 0x7fa8c4160bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:21.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.686+0000 7fa8c8d11640 1 --2- 172.21.15.60:0/3526069807 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8c406c650 0x7fa8c40c9c80 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:21.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.686+0000 7fa8c8d11640 1 -- 172.21.15.60:0/3526069807 >> 172.21.15.60:0/3526069807 conn(0x7fa8c4068030 msgr2=0x7fa8c4073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:21.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.686+0000 7fa8c8d11640 1 -- 172.21.15.60:0/3526069807 shutdown_connections 2024-09-12T02:23:21.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.686+0000 7fa8c8d11640 1 -- 172.21.15.60:0/3526069807 wait complete. 2024-09-12T02:23:21.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.687+0000 7fa8c8d11640 1 Processor -- start 2024-09-12T02:23:21.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.687+0000 7fa8c8d11640 1 -- start start 2024-09-12T02:23:21.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.688+0000 7fa8c8d11640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8c406c650 0x7fa8c414f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:21.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.688+0000 7fa8c8d11640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8c40ca1c0 0x7fa8c41e13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:21.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.688+0000 7fa8c8d11640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8c4150480 0x7fa8c41df8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:21.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.688+0000 7fa8c8d11640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c40ca670 con 0x7fa8c4150480 2024-09-12T02:23:21.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.688+0000 7fa8c8d11640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c4159fc0 con 0x7fa8c406c650 2024-09-12T02:23:21.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.688+0000 7fa8c8d11640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa8c406d270 con 0x7fa8c40ca1c0 2024-09-12T02:23:21.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.688+0000 7fa8c2d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8c4150480 0x7fa8c41df8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:21.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.688+0000 7fa8c2d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8c4150480 0x7fa8c41df8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49646/0 (socket says 172.21.15.60:49646) 2024-09-12T02:23:21.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.688+0000 7fa8c2d9d640 1 -- 172.21.15.60:0/1448839183 learned_addr learned my addr 172.21.15.60:0/1448839183 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:21.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.688+0000 7fa8c1d9b640 1 --2- 172.21.15.60:0/1448839183 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8c40ca1c0 0x7fa8c41e13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:21.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.688+0000 7fa8c259c640 1 --2- 172.21.15.60:0/1448839183 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8c406c650 0x7fa8c414f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:21.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.688+0000 7fa8c2d9d640 1 -- 172.21.15.60:0/1448839183 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8c40ca1c0 msgr2=0x7fa8c41e13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:21.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.688+0000 7fa8c2d9d640 1 --2- 172.21.15.60:0/1448839183 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8c40ca1c0 0x7fa8c41e13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:21.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.688+0000 7fa8c2d9d640 1 -- 172.21.15.60:0/1448839183 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8c406c650 msgr2=0x7fa8c414f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:21.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.688+0000 7fa8c2d9d640 1 --2- 172.21.15.60:0/1448839183 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8c406c650 0x7fa8c414f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:21.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.688+0000 7fa8c2d9d640 1 -- 172.21.15.60:0/1448839183 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8c41ec6c0 con 0x7fa8c4150480 2024-09-12T02:23:21.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.688+0000 7fa8c1d9b640 1 --2- 172.21.15.60:0/1448839183 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8c40ca1c0 0x7fa8c41e13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:23:21.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.689+0000 7fa8c2d9d640 1 --2- 172.21.15.60:0/1448839183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8c4150480 0x7fa8c41df8d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc009f00 tx=0x7fa8bc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:21.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.689+0000 7fa8b2ffd640 1 -- 172.21.15.60:0/1448839183 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc018030 con 0x7fa8c4150480 2024-09-12T02:23:21.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.689+0000 7fa8b2ffd640 1 -- 172.21.15.60:0/1448839183 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8bc00ce50 con 0x7fa8c4150480 2024-09-12T02:23:21.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.689+0000 7fa8c8d11640 1 -- 172.21.15.60:0/1448839183 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8c41e1910 con 0x7fa8c4150480 2024-09-12T02:23:21.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.689+0000 7fa8b2ffd640 1 -- 172.21.15.60:0/1448839183 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc003bb0 con 0x7fa8c4150480 2024-09-12T02:23:21.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.689+0000 7fa8c8d11640 1 -- 172.21.15.60:0/1448839183 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8c41e2290 con 0x7fa8c4150480 2024-09-12T02:23:21.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.690+0000 7fa8c8d11640 1 -- 172.21.15.60:0/1448839183 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8c4156270 con 0x7fa8c4150480 2024-09-12T02:23:21.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.690+0000 7fa8b2ffd640 1 -- 172.21.15.60:0/1448839183 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa8bc005d10 con 0x7fa8c4150480 2024-09-12T02:23:21.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.691+0000 7fa8b2ffd640 1 --2- 172.21.15.60:0/1448839183 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa8a406be30 0x7fa8a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:21.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.691+0000 7fa8b2ffd640 1 -- 172.21.15.60:0/1448839183 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7fa8bc08bb80 con 0x7fa8c4150480 2024-09-12T02:23:21.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.691+0000 7fa8c259c640 1 --2- 172.21.15.60:0/1448839183 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa8a406be30 0x7fa8a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:21.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.691+0000 7fa8c259c640 1 --2- 172.21.15.60:0/1448839183 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa8a406be30 0x7fa8a406e2f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa8b4007fd0 tx=0x7fa8b4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:21.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.695+0000 7fa8b2ffd640 1 -- 172.21.15.60:0/1448839183 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa8bc022070 con 0x7fa8c4150480 2024-09-12T02:23:21.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.872+0000 7fa8c8d11640 1 -- 172.21.15.60:0/1448839183 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa8c406c430 con 0x7fa8c4150480 2024-09-12T02:23:21.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.874+0000 7fa8b2ffd640 1 -- 172.21.15.60:0/1448839183 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+20439 (secure 0 0 0) 0x7fa8bc010040 con 0x7fa8c4150480 2024-09-12T02:23:21.875 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:23:21.875 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":26,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","created":"2024-09-12T02:22:39.869862+0000","modified":"2024-09-12T02:23:17.835334+0000","last_up_change":"2024-09-12T02:22:53.459371+0000","last_in_change":"2024-09-12T02:22:42.817076+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:22:52.130579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-09-12T02:23:01.854763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-09-12T02:23:03.104847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-09-12T02:23:14.175168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-09-12T02:23:15.166293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0f0c7386-002f-47e2-a7a3-6c8a70264cc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6819","nonce":1789465659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6821","nonce":1789465659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6825","nonce":1789465659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6823","nonce":1789465659}]},"public_addr":"172.21.15.60:6819/1789465659","cluster_addr":"172.21.15.60:6821/1789465659","heartbeat_back_addr":"172.21.15.60:6825/1789465659","heartbeat_front_addr":"172.21.15.60:6823/1789465659","state":["exists","up"]},{"osd":1,"uuid":"64be7b84-36fc-43c0-9e70-a617e5b68941","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6811","nonce":1109822408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6813","nonce":1109822408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6817","nonce":1109822408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6815","nonce":1109822408}]},"public_addr":"172.21.15.60:6811/1109822408","cluster_addr":"172.21.15.60:6813/1109822408","heartbeat_back_addr":"172.21.15.60:6817/1109822408","heartbeat_front_addr":"172.21.15.60:6815/1109822408","state":["exists","up"]},{"osd":2,"uuid":"df00caa1-d45e-4b87-ac1e-8bc098d509d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6827","nonce":278470077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6829","nonce":278470077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6833","nonce":278470077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6831","nonce":278470077}]},"public_addr":"172.21.15.60:6827/278470077","cluster_addr":"172.21.15.60:6829/278470077","heartbeat_back_addr":"172.21.15.60:6833/278470077","heartbeat_front_addr":"172.21.15.60:6831/278470077","state":["exists","up"]},{"osd":3,"uuid":"f6453471-893a-490b-b0c7-f196a0f574e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6803","nonce":3606424156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6805","nonce":3606424156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6809","nonce":3606424156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6807","nonce":3606424156}]},"public_addr":"172.21.15.60:6803/3606424156","cluster_addr":"172.21.15.60:6805/3606424156","heartbeat_back_addr":"172.21.15.60:6809/3606424156","heartbeat_front_addr":"172.21.15.60:6807/3606424156","state":["exists","up"]},{"osd":4,"uuid":"96e908b6-ce3e-466c-b02d-08fc71a1dba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6809","nonce":1581641129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6811","nonce":1581641129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6815","nonce":1581641129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6813","nonce":1581641129}]},"public_addr":"172.21.15.105:6809/1581641129","cluster_addr":"172.21.15.105:6811/1581641129","heartbeat_back_addr":"172.21.15.105:6815/1581641129","heartbeat_front_addr":"172.21.15.105:6813/1581641129","state":["exists","up"]},{"osd":5,"uuid":"7ebc26f0-a462-4364-9303-7351f7cba21f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6825","nonce":1392337793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6827","nonce":1392337793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6831","nonce":1392337793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6829","nonce":1392337793}]},"public_addr":"172.21.15.105:6825/1392337793","cluster_addr":"172.21.15.105:6827/1392337793","heartbeat_back_addr":"172.21.15.105:6831/1392337793","heartbeat_front_addr":"172.21.15.105:6829/1392337793","state":["exists","up"]},{"osd":6,"uuid":"49487ea1-9c6d-4090-bbcc-f28b33040eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6801","nonce":50951309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6803","nonce":50951309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6807","nonce":50951309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6805","nonce":50951309}]},"public_addr":"172.21.15.105:6801/50951309","cluster_addr":"172.21.15.105:6803/50951309","heartbeat_back_addr":"172.21.15.105:6807/50951309","heartbeat_front_addr":"172.21.15.105:6805/50951309","state":["exists","up"]},{"osd":7,"uuid":"1e3a0aa9-7e29-4785-8506-6b5d3be2be35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6817","nonce":3745331251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6819","nonce":3745331251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6823","nonce":3745331251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6821","nonce":3745331251}]},"public_addr":"172.21.15.105:6817/3745331251","cluster_addr":"172.21.15.105:6819/3745331251","heartbeat_back_addr":"172.21.15.105:6823/3745331251","heartbeat_front_addr":"172.21.15.105:6821/3745331251","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:50.112629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.307689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.542851+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.334773+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:50.096967+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:50.259633+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.888988+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.917421+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:23:21.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.876+0000 7fa8c8d11640 1 -- 172.21.15.60:0/1448839183 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa8a406be30 msgr2=0x7fa8a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:21.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.876+0000 7fa8c8d11640 1 --2- 172.21.15.60:0/1448839183 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa8a406be30 0x7fa8a406e2f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa8b4007fd0 tx=0x7fa8b4009040 comp rx=0 tx=0).stop 2024-09-12T02:23:21.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.876+0000 7fa8c8d11640 1 -- 172.21.15.60:0/1448839183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8c4150480 msgr2=0x7fa8c41df8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:21.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.876+0000 7fa8c8d11640 1 --2- 172.21.15.60:0/1448839183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8c4150480 0x7fa8c41df8d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc009f00 tx=0x7fa8bc00c490 comp rx=0 tx=0).stop 2024-09-12T02:23:21.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.876+0000 7fa8c8d11640 1 -- 172.21.15.60:0/1448839183 shutdown_connections 2024-09-12T02:23:21.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.876+0000 7fa8c8d11640 1 --2- 172.21.15.60:0/1448839183 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa8a406be30 0x7fa8a406e2f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:21.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.876+0000 7fa8c8d11640 1 --2- 172.21.15.60:0/1448839183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8c4150480 0x7fa8c41df8d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:21.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.876+0000 7fa8c8d11640 1 --2- 172.21.15.60:0/1448839183 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8c40ca1c0 0x7fa8c41e13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:21.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.876+0000 7fa8c8d11640 1 --2- 172.21.15.60:0/1448839183 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8c406c650 0x7fa8c414f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:21.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.876+0000 7fa8c8d11640 1 -- 172.21.15.60:0/1448839183 >> 172.21.15.60:0/1448839183 conn(0x7fa8c4068030 msgr2=0x7fa8c40c79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:21.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.876+0000 7fa8c8d11640 1 -- 172.21.15.60:0/1448839183 shutdown_connections 2024-09-12T02:23:21.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.876+0000 7fa8c8d11640 1 -- 172.21.15.60:0/1448839183 wait complete. 2024-09-12T02:23:21.888 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T02:23:21.888 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:23:21.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.990+0000 7f1fb38f8640 1 Processor -- start 2024-09-12T02:23:21.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.990+0000 7f1fb38f8640 1 -- start start 2024-09-12T02:23:21.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.991+0000 7f1fb38f8640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fac150480 0x7f1fac0c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:21.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.991+0000 7f1fb38f8640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fac15a7c0 con 0x7f1fac0ca390 2024-09-12T02:23:21.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.991+0000 7f1fb38f8640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fac159a00 con 0x7f1fac06c650 2024-09-12T02:23:21.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.991+0000 7f1fb38f8640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1fac06c240 con 0x7f1fac150480 2024-09-12T02:23:21.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.991+0000 7f1fb1e95640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f1fac0ca390 0x7f1fac160bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53864/0 (socket says 172.21.15.60:53864) 2024-09-12T02:23:21.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.991+0000 7f1fb1e95640 1 -- 172.21.15.60:0/3999726457 learned_addr learned my addr 172.21.15.60:0/3999726457 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:21.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.991+0000 7f1fb1694640 1 --2- 172.21.15.60:0/3999726457 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fac150480 0x7f1fac0c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:21.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.991+0000 7f1fa3fff640 1 -- 172.21.15.60:0/3999726457 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 169811377 0 0) 0x7f1fac15a7c0 con 0x7f1fac0ca390 2024-09-12T02:23:21.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.991+0000 7f1fa3fff640 1 -- 172.21.15.60:0/3999726457 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f98003520 con 0x7f1fac0ca390 2024-09-12T02:23:21.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.991+0000 7f1fb1694640 1 -- 172.21.15.60:0/3999726457 >> v1:172.21.15.105:6789/0 conn(0x7f1fac06c650 legacy=0x7f1fac0c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:21.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.991+0000 7f1fa3fff640 1 -- 172.21.15.60:0/3999726457 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1914317000 0 0) 0x7f1fac159a00 con 0x7f1fac06c650 2024-09-12T02:23:21.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.991+0000 7f1fb1694640 1 -- 172.21.15.60:0/3999726457 >> v1:172.21.15.60:6789/0 conn(0x7f1fac0ca390 legacy=0x7f1fac160bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:21.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.991+0000 7f1fb1694640 1 -- 172.21.15.60:0/3999726457 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fac159ce0 con 0x7f1fac150480 2024-09-12T02:23:21.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.992+0000 7f1fb1694640 1 --2- 172.21.15.60:0/3999726457 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fac150480 0x7f1fac0c7a90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1fa80097d0 tx=0x7f1fa802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6313b9b63bbd7e7b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:21.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.992+0000 7f1fa3fff640 1 -- 172.21.15.60:0/3999726457 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa8037070 con 0x7f1fac150480 2024-09-12T02:23:21.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.992+0000 7f1fa3fff640 1 -- 172.21.15.60:0/3999726457 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fa8032440 con 0x7f1fac150480 2024-09-12T02:23:21.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.992+0000 7f1fa3fff640 1 -- 172.21.15.60:0/3999726457 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa80327f0 con 0x7f1fac150480 2024-09-12T02:23:21.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.993+0000 7f1fb38f8640 1 -- 172.21.15.60:0/3999726457 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fac150480 msgr2=0x7f1fac0c7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:21.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.993+0000 7f1fb38f8640 1 --2- 172.21.15.60:0/3999726457 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fac150480 0x7f1fac0c7a90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1fa80097d0 tx=0x7f1fa802a210 comp rx=0 tx=0).stop 2024-09-12T02:23:21.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.993+0000 7f1fb38f8640 1 -- 172.21.15.60:0/3999726457 shutdown_connections 2024-09-12T02:23:21.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.993+0000 7f1fb38f8640 1 --2- 172.21.15.60:0/3999726457 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fac150480 0x7f1fac0c7a90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:21.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.993+0000 7f1fb38f8640 1 -- 172.21.15.60:0/3999726457 >> 172.21.15.60:0/3999726457 conn(0x7f1fac068030 msgr2=0x7f1fac073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:21.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.993+0000 7f1fb38f8640 1 -- 172.21.15.60:0/3999726457 shutdown_connections 2024-09-12T02:23:21.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.993+0000 7f1fb38f8640 1 -- 172.21.15.60:0/3999726457 wait complete. 2024-09-12T02:23:21.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.994+0000 7f1fb38f8640 1 Processor -- start 2024-09-12T02:23:21.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.994+0000 7f1fb38f8640 1 -- start start 2024-09-12T02:23:21.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.995+0000 7f1fb38f8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fac06c650 0x7f1fac1530c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:21.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.995+0000 7f1fb38f8640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fac0ca390 0x7f1fac150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:21.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.995+0000 7f1fb38f8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fac150480 0x7f1fac1ef0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:21.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.995+0000 7f1fb38f8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1fac06d270 con 0x7f1fac150480 2024-09-12T02:23:21.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.995+0000 7f1fb38f8640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1fac15a330 con 0x7f1fac06c650 2024-09-12T02:23:21.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.995+0000 7f1fb38f8640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1fac156270 con 0x7f1fac0ca390 2024-09-12T02:23:21.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.995+0000 7f1fb1e95640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fac150480 0x7f1fac1ef0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:21.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.995+0000 7f1fb1e95640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fac150480 0x7f1fac1ef0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49654/0 (socket says 172.21.15.60:49654) 2024-09-12T02:23:21.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.995+0000 7f1fb1e95640 1 -- 172.21.15.60:0/4175237481 learned_addr learned my addr 172.21.15.60:0/4175237481 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:21.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.995+0000 7f1fb1694640 1 --2- 172.21.15.60:0/4175237481 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fac06c650 0x7f1fac1530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:21.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.995+0000 7f1fb0e93640 1 --2- 172.21.15.60:0/4175237481 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fac0ca390 0x7f1fac150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.995+0000 7f1fb1e95640 1 -- 172.21.15.60:0/4175237481 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fac0ca390 msgr2=0x7f1fac150ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.995+0000 7f1fb1e95640 1 --2- 172.21.15.60:0/4175237481 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fac0ca390 0x7f1fac150ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.995+0000 7f1fb1e95640 1 -- 172.21.15.60:0/4175237481 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fac06c650 msgr2=0x7f1fac1530c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.995+0000 7f1fb1e95640 1 --2- 172.21.15.60:0/4175237481 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fac06c650 0x7f1fac1530c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.995+0000 7f1fb1e95640 1 -- 172.21.15.60:0/4175237481 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fac1578a0 con 0x7f1fac150480 2024-09-12T02:23:22.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.995+0000 7f1fb1e95640 1 --2- 172.21.15.60:0/4175237481 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fac150480 0x7f1fac1ef0a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1fa400cad0 tx=0x7f1fa400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.995+0000 7f1fa1ffb640 1 -- 172.21.15.60:0/4175237481 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa4017070 con 0x7f1fac150480 2024-09-12T02:23:22.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.995+0000 7f1fa1ffb640 1 -- 172.21.15.60:0/4175237481 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fa400ac30 con 0x7f1fac150480 2024-09-12T02:23:22.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.995+0000 7f1fb38f8640 1 -- 172.21.15.60:0/4175237481 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fac1528c0 con 0x7f1fac150480 2024-09-12T02:23:22.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.995+0000 7f1fa1ffb640 1 -- 172.21.15.60:0/4175237481 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa4012400 con 0x7f1fac150480 2024-09-12T02:23:22.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.996+0000 7f1fb38f8640 1 -- 172.21.15.60:0/4175237481 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fac1ef5e0 con 0x7f1fac150480 2024-09-12T02:23:22.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.997+0000 7f1fb38f8640 1 -- 172.21.15.60:0/4175237481 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fac159a00 con 0x7f1fac150480 2024-09-12T02:23:22.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.997+0000 7f1fa1ffb640 1 -- 172.21.15.60:0/4175237481 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1fa401a070 con 0x7f1fac150480 2024-09-12T02:23:22.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.998+0000 7f1fa1ffb640 1 --2- 172.21.15.60:0/4175237481 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1f9006be60 0x7f1f9006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.998+0000 7f1fb1694640 1 --2- 172.21.15.60:0/4175237481 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1f9006be60 0x7f1f9006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.998+0000 7f1fa1ffb640 1 -- 172.21.15.60:0/4175237481 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f1fa408ad70 con 0x7f1fac150480 2024-09-12T02:23:22.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:21.998+0000 7f1fb1694640 1 --2- 172.21.15.60:0/4175237481 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1f9006be60 0x7f1f9006e320 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8034000 tx=0x7f1fa802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.002+0000 7f1fa1ffb640 1 -- 172.21.15.60:0/4175237481 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1fa4058e30 con 0x7f1fac150480 2024-09-12T02:23:22.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.179+0000 7f1fb38f8640 1 -- 172.21.15.60:0/4175237481 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1fac06c430 con 0x7f1fac150480 2024-09-12T02:23:22.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.180+0000 7f1fa1ffb640 1 -- 172.21.15.60:0/4175237481 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+20439 (secure 0 0 0) 0x7f1fa405d130 con 0x7f1fac150480 2024-09-12T02:23:22.181 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:23:22.181 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":26,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","created":"2024-09-12T02:22:39.869862+0000","modified":"2024-09-12T02:23:17.835334+0000","last_up_change":"2024-09-12T02:22:53.459371+0000","last_in_change":"2024-09-12T02:22:42.817076+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:22:52.130579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-09-12T02:23:01.854763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-09-12T02:23:03.104847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-09-12T02:23:14.175168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-09-12T02:23:15.166293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0f0c7386-002f-47e2-a7a3-6c8a70264cc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6819","nonce":1789465659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6821","nonce":1789465659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6825","nonce":1789465659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6823","nonce":1789465659}]},"public_addr":"172.21.15.60:6819/1789465659","cluster_addr":"172.21.15.60:6821/1789465659","heartbeat_back_addr":"172.21.15.60:6825/1789465659","heartbeat_front_addr":"172.21.15.60:6823/1789465659","state":["exists","up"]},{"osd":1,"uuid":"64be7b84-36fc-43c0-9e70-a617e5b68941","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6811","nonce":1109822408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6813","nonce":1109822408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6817","nonce":1109822408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6815","nonce":1109822408}]},"public_addr":"172.21.15.60:6811/1109822408","cluster_addr":"172.21.15.60:6813/1109822408","heartbeat_back_addr":"172.21.15.60:6817/1109822408","heartbeat_front_addr":"172.21.15.60:6815/1109822408","state":["exists","up"]},{"osd":2,"uuid":"df00caa1-d45e-4b87-ac1e-8bc098d509d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6827","nonce":278470077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6829","nonce":278470077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6833","nonce":278470077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6831","nonce":278470077}]},"public_addr":"172.21.15.60:6827/278470077","cluster_addr":"172.21.15.60:6829/278470077","heartbeat_back_addr":"172.21.15.60:6833/278470077","heartbeat_front_addr":"172.21.15.60:6831/278470077","state":["exists","up"]},{"osd":3,"uuid":"f6453471-893a-490b-b0c7-f196a0f574e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6803","nonce":3606424156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6805","nonce":3606424156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6809","nonce":3606424156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6807","nonce":3606424156}]},"public_addr":"172.21.15.60:6803/3606424156","cluster_addr":"172.21.15.60:6805/3606424156","heartbeat_back_addr":"172.21.15.60:6809/3606424156","heartbeat_front_addr":"172.21.15.60:6807/3606424156","state":["exists","up"]},{"osd":4,"uuid":"96e908b6-ce3e-466c-b02d-08fc71a1dba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6809","nonce":1581641129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6811","nonce":1581641129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6815","nonce":1581641129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6813","nonce":1581641129}]},"public_addr":"172.21.15.105:6809/1581641129","cluster_addr":"172.21.15.105:6811/1581641129","heartbeat_back_addr":"172.21.15.105:6815/1581641129","heartbeat_front_addr":"172.21.15.105:6813/1581641129","state":["exists","up"]},{"osd":5,"uuid":"7ebc26f0-a462-4364-9303-7351f7cba21f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6825","nonce":1392337793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6827","nonce":1392337793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6831","nonce":1392337793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6829","nonce":1392337793}]},"public_addr":"172.21.15.105:6825/1392337793","cluster_addr":"172.21.15.105:6827/1392337793","heartbeat_back_addr":"172.21.15.105:6831/1392337793","heartbeat_front_addr":"172.21.15.105:6829/1392337793","state":["exists","up"]},{"osd":6,"uuid":"49487ea1-9c6d-4090-bbcc-f28b33040eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6801","nonce":50951309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6803","nonce":50951309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6807","nonce":50951309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6805","nonce":50951309}]},"public_addr":"172.21.15.105:6801/50951309","cluster_addr":"172.21.15.105:6803/50951309","heartbeat_back_addr":"172.21.15.105:6807/50951309","heartbeat_front_addr":"172.21.15.105:6805/50951309","state":["exists","up"]},{"osd":7,"uuid":"1e3a0aa9-7e29-4785-8506-6b5d3be2be35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6817","nonce":3745331251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6819","nonce":3745331251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6823","nonce":3745331251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6821","nonce":3745331251}]},"public_addr":"172.21.15.105:6817/3745331251","cluster_addr":"172.21.15.105:6819/3745331251","heartbeat_back_addr":"172.21.15.105:6823/3745331251","heartbeat_front_addr":"172.21.15.105:6821/3745331251","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:50.112629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.307689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.542851+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.334773+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:50.096967+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:50.259633+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.888988+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.917421+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:23:22.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.182+0000 7f1fb38f8640 1 -- 172.21.15.60:0/4175237481 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1f9006be60 msgr2=0x7f1f9006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.182+0000 7f1fb38f8640 1 --2- 172.21.15.60:0/4175237481 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1f9006be60 0x7f1f9006e320 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8034000 tx=0x7f1fa802e000 comp rx=0 tx=0).stop 2024-09-12T02:23:22.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.182+0000 7f1fb38f8640 1 -- 172.21.15.60:0/4175237481 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fac150480 msgr2=0x7f1fac1ef0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.182+0000 7f1fb38f8640 1 --2- 172.21.15.60:0/4175237481 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fac150480 0x7f1fac1ef0a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1fa400cad0 tx=0x7f1fa400cf90 comp rx=0 tx=0).stop 2024-09-12T02:23:22.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.182+0000 7f1fb38f8640 1 -- 172.21.15.60:0/4175237481 shutdown_connections 2024-09-12T02:23:22.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.182+0000 7f1fb38f8640 1 --2- 172.21.15.60:0/4175237481 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1f9006be60 0x7f1f9006e320 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.182+0000 7f1fb38f8640 1 --2- 172.21.15.60:0/4175237481 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fac150480 0x7f1fac1ef0a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.182+0000 7f1fb38f8640 1 --2- 172.21.15.60:0/4175237481 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fac0ca390 0x7f1fac150ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.182+0000 7f1fb38f8640 1 --2- 172.21.15.60:0/4175237481 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fac06c650 0x7f1fac1530c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.182+0000 7f1fb38f8640 1 -- 172.21.15.60:0/4175237481 >> 172.21.15.60:0/4175237481 conn(0x7f1fac068030 msgr2=0x7f1fac075030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:22.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.182+0000 7f1fb38f8640 1 -- 172.21.15.60:0/4175237481 shutdown_connections 2024-09-12T02:23:22.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.182+0000 7f1fb38f8640 1 -- 172.21.15.60:0/4175237481 wait complete. 2024-09-12T02:23:22.194 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T02:23:22.195 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T02:23:22.195 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T02:23:22.195 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T02:23:22.196 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-12T02:23:22.196 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-12T02:23:22.196 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-12T02:23:22.197 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-12T02:23:22.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.370+0000 7ff0c359e640 1 Processor -- start 2024-09-12T02:23:22.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.370+0000 7ff0c359e640 1 -- start start 2024-09-12T02:23:22.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.372+0000 7ff0c359e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff0c40ab220 0x7ff0c406bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.372+0000 7f4c22d76640 1 Processor -- start 2024-09-12T02:23:22.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.372+0000 7ff0c359e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0c41669f0 0x7ff0c4166e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.372+0000 7ff0c359e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0c40ab660 con 0x7ff0c40ac600 2024-09-12T02:23:22.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.372+0000 7ff0c359e640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7ff0c40c3c10 con 0x7ff0c40ab220 2024-09-12T02:23:22.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.372+0000 7ff0c359e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff0c40c3e60 con 0x7ff0c41669f0 2024-09-12T02:23:22.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.372+0000 7ff0c1d9b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff0c40ab220 0x7ff0c406bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.372+0000 7ff0c1d9b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff0c40ab220 0x7ff0c406bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49662/0 (socket says 172.21.15.60:49662) 2024-09-12T02:23:22.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.372+0000 7ff0c1d9b640 1 -- 172.21.15.60:0/1504365056 learned_addr learned my addr 172.21.15.60:0/1504365056 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:22.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.372+0000 7ff0c1d9b640 1 -- 172.21.15.60:0/1504365056 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0c41669f0 msgr2=0x7ff0c4166e80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:23:22.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.373+0000 7ff0c2d9d640 1 --2- 172.21.15.60:0/1504365056 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0c41669f0 0x7ff0c4166e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.373+0000 7fe2d6311640 1 Processor -- start 2024-09-12T02:23:22.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.373+0000 7f0ba21ea640 1 Processor -- start 2024-09-12T02:23:22.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.373+0000 7f4c22d76640 1 -- start start 2024-09-12T02:23:22.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.373+0000 7ff0c1d9b640 1 --2- 172.21.15.60:0/1504365056 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0c41669f0 0x7ff0c4166e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.373+0000 7fe2d6311640 1 -- start start 2024-09-12T02:23:22.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.373+0000 7ff0c1d9b640 1 -- 172.21.15.60:0/1504365056 >> v1:172.21.15.60:6789/0 conn(0x7ff0c40ac600 legacy=0x7ff0c40c47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.373+0000 7ff0c1d9b640 1 -- 172.21.15.60:0/1504365056 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0c40aaa20 con 0x7ff0c40ab220 2024-09-12T02:23:22.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.373+0000 7f0ba21ea640 1 -- start start 2024-09-12T02:23:22.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.373+0000 7f32c28b8640 1 Processor -- start 2024-09-12T02:23:22.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.374+0000 7f9a87386640 1 Processor -- start 2024-09-12T02:23:22.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.374+0000 7f95522d7640 1 Processor -- start 2024-09-12T02:23:22.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.374+0000 7ff0c1d9b640 1 --2- 172.21.15.60:0/1504365056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0c40ab220 0x7ff0c406bbe0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc00bef0 tx=0x7ff0bc02ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fc36bdc6eafc7f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.375+0000 7fe2d6311640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe2d00ab450 0x7fe2d00c3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.375+0000 7fe2cffff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe2d01501d0 0x7fe2d0156760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53898/0 (socket says 172.21.15.60:53898) 2024-09-12T02:23:22.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.375+0000 7fe2cffff640 1 -- 172.21.15.60:0/3209947450 learned_addr learned my addr 172.21.15.60:0/3209947450 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:22.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.375+0000 7fe2d6311640 1 -- 172.21.15.60:0/3209947450 --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2d00c4800 con 0x7fe2d01501d0 2024-09-12T02:23:22.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.375+0000 7fe2cf7fe640 1 --2- 172.21.15.60:0/3209947450 >> v2:172.21.15.60:3300/0 conn(0x7fe2d00ab450 0x7fe2d00c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.375+0000 7fe2d6311640 1 -- 172.21.15.60:0/3209947450 --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2d00c4ae0 con 0x7fe2d00c3e60 2024-09-12T02:23:22.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.375+0000 7fe2d6311640 1 -- 172.21.15.60:0/3209947450 --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fe2d00c3490 con 0x7fe2d00ab450 2024-09-12T02:23:22.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.374+0000 7f0ba21ea640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b9c155080 0x7f0b9c0c2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.374+0000 7f0ba21ea640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0b9c0c3290 0x7f0b9c0c5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.374+0000 7f0ba21ea640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b9c0c2380 con 0x7f0b9c06eb90 2024-09-12T02:23:22.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.374+0000 7f0ba21ea640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f0b9c0ab420 con 0x7f0b9c0c3290 2024-09-12T02:23:22.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.374+0000 7f0ba21ea640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0b9c0ab9e0 con 0x7f0b9c155080 2024-09-12T02:23:22.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.375+0000 7f0ba11e8640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f0b9c06eb90 0x7f0b9c0a6e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53896/0 (socket says 172.21.15.60:53896) 2024-09-12T02:23:22.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.375+0000 7f0ba11e8640 1 -- 172.21.15.60:0/965442098 learned_addr learned my addr 172.21.15.60:0/965442098 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:22.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.374+0000 7f4c22d76640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4c1400aef0 0x7f4c14049180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.374+0000 7f4c22d76640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c140071d0 con 0x7f4c140d66e0 2024-09-12T02:23:22.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.374+0000 7f4c22d76640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c1404a980 con 0x7f4c140465c0 2024-09-12T02:23:22.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.374+0000 7f4c22d76640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f4c140da320 con 0x7f4c1400aef0 2024-09-12T02:23:22.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.375+0000 7f4c22575640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f4c140d66e0 0x7f4c140e0740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53880/0 (socket says 172.21.15.60:53880) 2024-09-12T02:23:22.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.375+0000 7f4c21d74640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4c1400aef0 0x7f4c14049180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.375+0000 7f4c22575640 1 -- 172.21.15.60:0/1612249627 learned_addr learned my addr 172.21.15.60:0/1612249627 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:22.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.374+0000 7f95522d7640 1 -- start start 2024-09-12T02:23:22.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.375+0000 7f95522d7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f954c150480 0x7f954c0c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.375+0000 7f95522d7640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f954c06c650 0x7f954c0c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.374+0000 7f32c28b8640 1 -- start start 2024-09-12T02:23:22.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.375+0000 7ff0c159a640 1 -- 172.21.15.60:0/1504365056 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc009600 con 0x7ff0c40ab220 2024-09-12T02:23:22.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.375+0000 7f0b9bfff640 1 -- 172.21.15.60:0/965442098 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 424407809 0 0) 0x7f0b9c0c2380 con 0x7f0b9c06eb90 2024-09-12T02:23:22.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.375+0000 7f0b9bfff640 1 -- 172.21.15.60:0/965442098 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b84003520 con 0x7f0b9c06eb90 2024-09-12T02:23:22.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.375+0000 7ff0c159a640 1 -- 172.21.15.60:0/1504365056 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0bc0097a0 con 0x7ff0c40ab220 2024-09-12T02:23:22.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.375+0000 7f4c21d74640 1 -- 172.21.15.60:0/1612249627 >> v1:172.21.15.105:6789/0 conn(0x7f4c140465c0 legacy=0x7f4c140d9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.375+0000 7f4c20d72640 1 -- 172.21.15.60:0/1612249627 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2154742625 0 0) 0x7f4c1404a980 con 0x7f4c140465c0 2024-09-12T02:23:22.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.375+0000 7f4c21d74640 1 -- 172.21.15.60:0/1612249627 >> v1:172.21.15.60:6789/0 conn(0x7f4c140d66e0 legacy=0x7f4c140e0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.375+0000 7f954bfff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f954c150480 0x7f954c0c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.375+0000 7f954bfff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f954c150480 0x7f954c0c7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:46996/0 (socket says 172.21.15.60:46996) 2024-09-12T02:23:22.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.375+0000 7f954bfff640 1 -- 172.21.15.60:0/1409236018 learned_addr learned my addr 172.21.15.60:0/1409236018 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:22.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.375+0000 7f4c21d74640 1 -- 172.21.15.60:0/1612249627 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c1404ac60 con 0x7f4c1400aef0 2024-09-12T02:23:22.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.375+0000 7f954b7fe640 1 --2- 172.21.15.60:0/1409236018 >> v2:172.21.15.105:3300/0 conn(0x7f954c06c650 0x7f954c0c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.374+0000 7f9a87386640 1 -- start start 2024-09-12T02:23:22.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.375+0000 7f95522d7640 1 -- 172.21.15.60:0/1409236018 --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f954c15a7c0 con 0x7f954c0c9c80 2024-09-12T02:23:22.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.375+0000 7f95522d7640 1 -- 172.21.15.60:0/1409236018 --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f954c06c240 con 0x7f954c06c650 2024-09-12T02:23:22.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.375+0000 7f95522d7640 1 -- 172.21.15.60:0/1409236018 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f954c15a330 con 0x7f954c150480 2024-09-12T02:23:22.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.375+0000 7fe2ceffd640 1 -- 172.21.15.60:0/3209947450 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 225217473 0 0) 0x7fe2d00c4800 con 0x7fe2d01501d0 2024-09-12T02:23:22.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.376+0000 7fe2ceffd640 1 -- 172.21.15.60:0/3209947450 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2b8003520 con 0x7fe2d01501d0 2024-09-12T02:23:22.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.376+0000 7f9a87386640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9a800c81e0 0x7f9a8015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.376+0000 7ff0c159a640 1 -- 172.21.15.60:0/1504365056 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc009b90 con 0x7ff0c40ab220 2024-09-12T02:23:22.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.376+0000 7f0ba19e9640 1 --2- 172.21.15.60:0/965442098 >> v2:172.21.15.105:3300/0 conn(0x7f0b9c0c3290 0x7f0b9c0c5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.376+0000 7f32c28b8640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f32b400b0d0 0x7f32b400b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.376+0000 7f0ba09e7640 1 --2- 172.21.15.60:0/965442098 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b9c155080 0x7f0b9c0c2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.376+0000 7f32c28b8640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f32b4005ff0 0x7f32b4006420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.376+0000 7f32c28b8640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32b40d5cf0 con 0x7f32b40d34d0 2024-09-12T02:23:22.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.376+0000 7f9a84921640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f9a800c73f0 0x7f9a800c7ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53916/0 (socket says 172.21.15.60:53916) 2024-09-12T02:23:22.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.376+0000 7f32c18b6640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f32b40d34d0 0x7f32b40495d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53920/0 (socket says 172.21.15.60:53920) 2024-09-12T02:23:22.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.376+0000 7f32c18b6640 1 -- 172.21.15.60:0/2444892065 learned_addr learned my addr 172.21.15.60:0/2444892065 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:22.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.376+0000 7f32c28b8640 1 -- 172.21.15.60:0/2444892065 --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f32b40d6bc0 con 0x7f32b400b0d0 2024-09-12T02:23:22.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.376+0000 7f0ba09e7640 1 -- 172.21.15.60:0/965442098 >> v2:172.21.15.105:3300/0 conn(0x7f0b9c0c3290 msgr2=0x7f0b9c0c5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:22.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.376+0000 7f0ba09e7640 1 --2- 172.21.15.60:0/965442098 >> v2:172.21.15.105:3300/0 conn(0x7f0b9c0c3290 0x7f0b9c0c5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.376+0000 7f0ba09e7640 1 -- 172.21.15.60:0/965442098 >> v1:172.21.15.60:6789/0 conn(0x7f0b9c06eb90 legacy=0x7f0b9c0a6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.376+0000 7f0ba09e7640 1 -- 172.21.15.60:0/965442098 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b9c0c2620 con 0x7f0b9c155080 2024-09-12T02:23:22.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.377+0000 7f9a85122640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f9a80157f80 0x7f9a800c9c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:45424/0 (socket says 172.21.15.60:45424) 2024-09-12T02:23:22.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.377+0000 7f9a85923640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9a800c81e0 0x7f9a8015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.377+0000 7f9a85923640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9a800c81e0 0x7f9a8015b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49684/0 (socket says 172.21.15.60:49684) 2024-09-12T02:23:22.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.376+0000 7f954b7fe640 1 -- 172.21.15.60:0/1409236018 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f954c150480 msgr2=0x7f954c0c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:22.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.376+0000 7f954b7fe640 1 --2- 172.21.15.60:0/1409236018 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f954c150480 0x7f954c0c7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.376+0000 7f954b7fe640 1 -- 172.21.15.60:0/1409236018 >> v1:172.21.15.60:6789/0 conn(0x7f954c0c9c80 legacy=0x7f954c0ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:22.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.376+0000 7f954b7fe640 1 -- 172.21.15.60:0/1409236018 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f954c159a00 con 0x7f954c06c650 2024-09-12T02:23:22.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.376+0000 7ff0c359e640 1 -- 172.21.15.60:0/1504365056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0c40ab220 msgr2=0x7ff0c406bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.376+0000 7ff0c359e640 1 --2- 172.21.15.60:0/1504365056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0c40ab220 0x7ff0c406bbe0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc00bef0 tx=0x7ff0bc02ebd0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.377+0000 7ff0c359e640 1 -- 172.21.15.60:0/1504365056 shutdown_connections 2024-09-12T02:23:22.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.377+0000 7ff0c359e640 1 --2- 172.21.15.60:0/1504365056 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0c41669f0 0x7ff0c4166e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.377+0000 7ff0c359e640 1 --2- 172.21.15.60:0/1504365056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0c40ab220 0x7ff0c406bbe0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.377+0000 7ff0c359e640 1 -- 172.21.15.60:0/1504365056 >> 172.21.15.60:0/1504365056 conn(0x7ff0c40c7ae0 msgr2=0x7ff0c40c7ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:22.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.377+0000 7f9a87386640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a800c85f0 con 0x7f9a800c73f0 2024-09-12T02:23:22.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.377+0000 7f9a87386640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a8006c920 con 0x7f9a80157f80 2024-09-12T02:23:22.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.377+0000 7f9a87386640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f9a8015b5e0 con 0x7f9a800c81e0 2024-09-12T02:23:22.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.376+0000 7fe2ceffd640 1 -- 172.21.15.60:0/3209947450 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3755725870 0 0) 0x7fe2d00c4ae0 con 0x7fe2d00c3e60 2024-09-12T02:23:22.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.376+0000 7fe2ceffd640 1 -- 172.21.15.60:0/3209947450 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2b8003880 con 0x7fe2d00c3e60 2024-09-12T02:23:22.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.377+0000 7fe2ceffd640 1 -- 172.21.15.60:0/3209947450 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1941684565 0 0) 0x7fe2b8003520 con 0x7fe2d01501d0 2024-09-12T02:23:22.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.377+0000 7fe2ceffd640 1 -- 172.21.15.60:0/3209947450 >> v2:172.21.15.60:3300/0 conn(0x7fe2d00ab450 msgr2=0x7fe2d00c3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:22.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.377+0000 7fe2ceffd640 1 --2- 172.21.15.60:0/3209947450 >> v2:172.21.15.60:3300/0 conn(0x7fe2d00ab450 0x7fe2d00c3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.377+0000 7fe2ceffd640 1 -- 172.21.15.60:0/3209947450 >> v1:172.21.15.105:6789/0 conn(0x7fe2d00c3e60 legacy=0x7fe2d006e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.377+0000 7fe2ceffd640 1 -- 172.21.15.60:0/3209947450 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2d00c2e40 con 0x7fe2d01501d0 2024-09-12T02:23:22.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.377+0000 7fe2ceffd640 1 -- 172.21.15.60:0/3209947450 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7fe2c4001650 con 0x7fe2d01501d0 2024-09-12T02:23:22.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.377+0000 7fe2ceffd640 1 -- 172.21.15.60:0/3209947450 >> v1:172.21.15.60:6789/0 conn(0x7fe2d01501d0 legacy=0x7fe2d0156760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.377+0000 7fe2ceffd640 1 --2- 172.21.15.60:0/3209947450 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2b8003d70 0x7fe2b80041b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.377+0000 7fe2ceffd640 1 --2- 172.21.15.60:0/3209947450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2b8004850 0x7fe2b8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.377+0000 7fe2ceffd640 1 --2- 172.21.15.60:0/3209947450 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2b8005320 0x7fe2b800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.377+0000 7fe2ceffd640 1 -- 172.21.15.60:0/3209947450 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d00c3490 con 0x7fe2b8004850 2024-09-12T02:23:22.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.377+0000 7fe2ceffd640 1 -- 172.21.15.60:0/3209947450 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b800c260 con 0x7fe2b8005320 2024-09-12T02:23:22.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.377+0000 7fe2ceffd640 1 -- 172.21.15.60:0/3209947450 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe2b800c460 con 0x7fe2b8003d70 2024-09-12T02:23:22.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.377+0000 7ff0c359e640 1 -- 172.21.15.60:0/1504365056 shutdown_connections 2024-09-12T02:23:22.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.377+0000 7ff0c359e640 1 -- 172.21.15.60:0/1504365056 wait complete. 2024-09-12T02:23:22.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.377+0000 7f9a84921640 1 -- 172.21.15.60:0/2499724005 learned_addr learned my addr 172.21.15.60:0/2499724005 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:22.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.376+0000 7f3b3d331640 1 Processor -- start 2024-09-12T02:23:22.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.377+0000 7f3b3d331640 1 -- start start 2024-09-12T02:23:22.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.377+0000 7f954b7fe640 1 --2- 172.21.15.60:0/1409236018 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f954c06c650 0x7f954c0c7fd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f95400097a0 tx=0x7f954002a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f9758fbd449715f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.377+0000 7fe2d48ae640 1 --2- 172.21.15.60:0/3209947450 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2b8005320 0x7fe2b800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.376+0000 7f32c20b7640 1 --2- 172.21.15.60:0/2444892065 >> v2:172.21.15.105:3300/0 conn(0x7f32b4005ff0 0x7f32b4006420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.377+0000 7f32c10b5640 1 --2- 172.21.15.60:0/2444892065 >> v2:172.21.15.60:3300/0 conn(0x7f32b400b0d0 0x7f32b400b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.377+0000 7f32c08b4640 1 -- 172.21.15.60:0/2444892065 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3755613169 0 0) 0x7f32b40d5cf0 con 0x7f32b40d34d0 2024-09-12T02:23:22.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.377+0000 7f32c28b8640 1 -- 172.21.15.60:0/2444892065 --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f32b40d5fb0 con 0x7f32b4005ff0 2024-09-12T02:23:22.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.377+0000 7f9a77fff640 1 -- 172.21.15.60:0/2499724005 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2777351788 0 0) 0x7f9a8006c920 con 0x7f9a80157f80 2024-09-12T02:23:22.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.377+0000 7f9a77fff640 1 -- 172.21.15.60:0/2499724005 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a6c003520 con 0x7f9a80157f80 2024-09-12T02:23:22.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.377+0000 7fe2cf7fe640 1 --2- 172.21.15.60:0/3209947450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2b8004850 0x7fe2b8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.377+0000 7f4c21d74640 1 --2- 172.21.15.60:0/1612249627 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c1400aef0 0x7f4c14049180 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4c1800c6d0 tx=0x7f4c1802e790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6bc2d857db437e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.377+0000 7f0ba09e7640 1 --2- 172.21.15.60:0/965442098 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b9c155080 0x7f0b9c0c2d50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0b900097a0 tx=0x7f0b9002a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4d4b3691d4e649f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.377+0000 7f9a85923640 1 -- 172.21.15.60:0/2499724005 >> v1:172.21.15.105:6789/0 conn(0x7f9a80157f80 legacy=0x7f9a800c9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.377+0000 7f9a85923640 1 -- 172.21.15.60:0/2499724005 >> v1:172.21.15.60:6789/0 conn(0x7f9a800c73f0 legacy=0x7f9a800c7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.377+0000 7f9a85923640 1 -- 172.21.15.60:0/2499724005 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a8006cc00 con 0x7f9a800c81e0 2024-09-12T02:23:22.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.378+0000 7f954affd640 1 -- 172.21.15.60:0/1409236018 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9540037070 con 0x7f954c06c650 2024-09-12T02:23:22.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.378+0000 7fe2d48ae640 1 -- 172.21.15.60:0/3209947450 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2b8003d70 msgr2=0x7fe2b80041b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:22.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.378+0000 7fe2d48ae640 1 --2- 172.21.15.60:0/3209947450 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2b8003d70 0x7fe2b80041b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.378+0000 7fe2d48ae640 1 -- 172.21.15.60:0/3209947450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2b8004850 msgr2=0x7fe2b8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:22.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.378+0000 7fe2d48ae640 1 --2- 172.21.15.60:0/3209947450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2b8004850 0x7fe2b8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.378+0000 7fe2d48ae640 1 -- 172.21.15.60:0/3209947450 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2d00c2e40 con 0x7fe2b8005320 2024-09-12T02:23:22.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.378+0000 7f4c20d72640 1 -- 172.21.15.60:0/1612249627 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1803a070 con 0x7f4c1400aef0 2024-09-12T02:23:22.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.378+0000 7f4c20d72640 1 -- 172.21.15.60:0/1612249627 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c1800a510 con 0x7f4c1400aef0 2024-09-12T02:23:22.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.378+0000 7f4c20d72640 1 -- 172.21.15.60:0/1612249627 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1800a900 con 0x7f4c1400aef0 2024-09-12T02:23:22.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.378+0000 7f954affd640 1 -- 172.21.15.60:0/1409236018 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f954002ae40 con 0x7f954c06c650 2024-09-12T02:23:22.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.378+0000 7f954affd640 1 -- 172.21.15.60:0/1409236018 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9540032660 con 0x7f954c06c650 2024-09-12T02:23:22.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.378+0000 7f3b3d331640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b3004a060 0x7f3b300de260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.378+0000 7f3b377fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f3b3004a440 0x7f3b300e8b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53924/0 (socket says 172.21.15.60:53924) 2024-09-12T02:23:22.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.378+0000 7f3b367fc640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f3b3004f060 0x7f3b30005d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:45430/0 (socket says 172.21.15.60:45430) 2024-09-12T02:23:22.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.378+0000 7f3b377fe640 1 -- 172.21.15.60:0/197125314 learned_addr learned my addr 172.21.15.60:0/197125314 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:22.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.378+0000 7f3b36ffd640 1 --2- 172.21.15.60:0/197125314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b3004a060 0x7f3b300de260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.378+0000 7f32c08b4640 1 -- 172.21.15.60:0/2444892065 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32a8007930 con 0x7f32b40d34d0 2024-09-12T02:23:22.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.379+0000 7f95522d7640 1 -- 172.21.15.60:0/1409236018 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f954c06c650 msgr2=0x7f954c0c7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.379+0000 7f3b3d331640 1 -- 172.21.15.60:0/197125314 --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b30006430 con 0x7f3b3004a440 2024-09-12T02:23:22.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.379+0000 7f32c20b7640 1 -- 172.21.15.60:0/2444892065 >> v2:172.21.15.60:3300/0 conn(0x7f32b400b0d0 msgr2=0x7f32b400b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:22.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.379+0000 7f32c20b7640 1 --2- 172.21.15.60:0/2444892065 >> v2:172.21.15.60:3300/0 conn(0x7f32b400b0d0 0x7f32b400b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.379+0000 7f32c20b7640 1 -- 172.21.15.60:0/2444892065 >> v1:172.21.15.60:6789/0 conn(0x7f32b40d34d0 legacy=0x7f32b40495d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.379+0000 7f95522d7640 1 --2- 172.21.15.60:0/1409236018 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f954c06c650 0x7f954c0c7fd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f95400097a0 tx=0x7f954002a130 comp rx=0 tx=0).stop 2024-09-12T02:23:22.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.379+0000 7f3b3d331640 1 -- 172.21.15.60:0/197125314 --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b3004d750 con 0x7f3b3004f060 2024-09-12T02:23:22.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.379+0000 7f3b3d331640 1 -- 172.21.15.60:0/197125314 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3b3004a8f0 con 0x7f3b3004a060 2024-09-12T02:23:22.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.379+0000 7f32c20b7640 1 -- 172.21.15.60:0/2444892065 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b40d6290 con 0x7f32b4005ff0 2024-09-12T02:23:22.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.378+0000 7f0b9bfff640 1 -- 172.21.15.60:0/965442098 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b90037070 con 0x7f0b9c155080 2024-09-12T02:23:22.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.378+0000 7f0b9bfff640 1 -- 172.21.15.60:0/965442098 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b90032440 con 0x7f0b9c155080 2024-09-12T02:23:22.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.378+0000 7f0b9bfff640 1 -- 172.21.15.60:0/965442098 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b90032810 con 0x7f0b9c155080 2024-09-12T02:23:22.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.379+0000 7fe2d48ae640 1 -- 172.21.15.60:0/3209947450 reap_dead start 2024-09-12T02:23:22.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.379+0000 7f3b35ffb640 1 -- 172.21.15.60:0/197125314 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2658288615 0 0) 0x7f3b30006430 con 0x7f3b3004a440 2024-09-12T02:23:22.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.379+0000 7f3b35ffb640 1 -- 172.21.15.60:0/197125314 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b20003520 con 0x7f3b3004a440 2024-09-12T02:23:22.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.379+0000 7ff0c359e640 1 Processor -- start 2024-09-12T02:23:22.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.379+0000 7ff0c359e640 1 -- start start 2024-09-12T02:23:22.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.379+0000 7fe2d48ae640 1 --2- 172.21.15.60:0/3209947450 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2b8005320 0x7fe2b800b9c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8001f30 tx=0x7fe2b8005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=710d7e8d15aa77f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.379+0000 7f9a85923640 1 --2- 172.21.15.60:0/2499724005 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a800c81e0 0x7f9a8015b0a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9a78009d90 tx=0x7f9a7802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e484c0207cb3e76f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.379+0000 7f4c22d76640 1 -- 172.21.15.60:0/1612249627 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c1400aef0 msgr2=0x7f4c14049180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.379+0000 7f4c22d76640 1 --2- 172.21.15.60:0/1612249627 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c1400aef0 0x7f4c14049180 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4c1800c6d0 tx=0x7f4c1802e790 comp rx=0 tx=0).stop 2024-09-12T02:23:22.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.379+0000 7f4c22d76640 1 -- 172.21.15.60:0/1612249627 shutdown_connections 2024-09-12T02:23:22.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.379+0000 7f4c22d76640 1 --2- 172.21.15.60:0/1612249627 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c1400aef0 0x7f4c14049180 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.379+0000 7f4c22d76640 1 -- 172.21.15.60:0/1612249627 >> 172.21.15.60:0/1612249627 conn(0x7f4c14047d00 msgr2=0x7f4c14048110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:22.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.379+0000 7f0ba21ea640 1 -- 172.21.15.60:0/965442098 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b9c155080 msgr2=0x7f0b9c0c2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.379+0000 7f0ba21ea640 1 --2- 172.21.15.60:0/965442098 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b9c155080 0x7f0b9c0c2d50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0b900097a0 tx=0x7f0b9002a230 comp rx=0 tx=0).stop 2024-09-12T02:23:22.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.379+0000 7f4c22d76640 1 -- 172.21.15.60:0/1612249627 shutdown_connections 2024-09-12T02:23:22.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.379+0000 7f95522d7640 1 -- 172.21.15.60:0/1409236018 shutdown_connections 2024-09-12T02:23:22.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.379+0000 7f95522d7640 1 --2- 172.21.15.60:0/1409236018 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f954c06c650 0x7f954c0c7fd0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.379+0000 7f95522d7640 1 --2- 172.21.15.60:0/1409236018 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f954c150480 0x7f954c0c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.379+0000 7f95522d7640 1 -- 172.21.15.60:0/1409236018 >> 172.21.15.60:0/1409236018 conn(0x7f954c068030 msgr2=0x7f954c073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:22.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.380+0000 7f0ba21ea640 1 -- 172.21.15.60:0/965442098 shutdown_connections 2024-09-12T02:23:22.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.380+0000 7fe2ceffd640 1 -- 172.21.15.60:0/3209947450 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c8001b80 con 0x7fe2b8005320 2024-09-12T02:23:22.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.380+0000 7fe2ceffd640 1 -- 172.21.15.60:0/3209947450 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2c8003b70 con 0x7fe2b8005320 2024-09-12T02:23:22.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.380+0000 7f0ba21ea640 1 --2- 172.21.15.60:0/965442098 >> v2:172.21.15.105:3300/0 conn(0x7f0b9c0c3290 0x7f0b9c0c5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.380+0000 7f0ba21ea640 1 --2- 172.21.15.60:0/965442098 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b9c155080 0x7f0b9c0c2d50 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.380+0000 7f95522d7640 1 -- 172.21.15.60:0/1409236018 shutdown_connections 2024-09-12T02:23:22.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.380+0000 7fe2ceffd640 1 -- 172.21.15.60:0/3209947450 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c8001b80 con 0x7fe2b8005320 2024-09-12T02:23:22.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.379+0000 7f3b36ffd640 1 -- 172.21.15.60:0/197125314 >> v1:172.21.15.105:6789/0 conn(0x7f3b3004f060 legacy=0x7f3b30005d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.379+0000 7f3b36ffd640 1 -- 172.21.15.60:0/197125314 >> v1:172.21.15.60:6789/0 conn(0x7f3b3004a440 legacy=0x7f3b300e8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.379+0000 7f3b36ffd640 1 -- 172.21.15.60:0/197125314 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b3004cbd0 con 0x7f3b3004a060 2024-09-12T02:23:22.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.380+0000 7f0ba21ea640 1 -- 172.21.15.60:0/965442098 >> 172.21.15.60:0/965442098 conn(0x7f0b9c0c7f00 msgr2=0x7f0b9c0a9680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:22.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.380+0000 7f0ba21ea640 1 -- 172.21.15.60:0/965442098 shutdown_connections 2024-09-12T02:23:22.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.380+0000 7f95522d7640 1 -- 172.21.15.60:0/1409236018 wait complete. 2024-09-12T02:23:22.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.380+0000 7f9a77fff640 1 -- 172.21.15.60:0/2499724005 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a78007740 con 0x7f9a800c81e0 2024-09-12T02:23:22.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.380+0000 7f9a77fff640 1 -- 172.21.15.60:0/2499724005 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a780078e0 con 0x7f9a800c81e0 2024-09-12T02:23:22.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.380+0000 7f9a77fff640 1 -- 172.21.15.60:0/2499724005 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a78007cb0 con 0x7f9a800c81e0 2024-09-12T02:23:22.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.380+0000 7f3b36ffd640 1 --2- 172.21.15.60:0/197125314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b3004a060 0x7f3b300de260 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3b280097d0 tx=0x7f3b2802a0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4025c30c5dbacddd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.380+0000 7f0ba21ea640 1 -- 172.21.15.60:0/965442098 wait complete. 2024-09-12T02:23:22.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.380+0000 7f4c22d76640 1 -- 172.21.15.60:0/1612249627 wait complete. 2024-09-12T02:23:22.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.380+0000 7ff0c359e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0c40ab220 0x7ff0c4074280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.380+0000 7ff0c359e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0c40ac600 0x7ff0c415f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.380+0000 7ff0c359e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0c41669f0 0x7ff0c42041f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.380+0000 7ff0c359e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c406c120 con 0x7ff0c40ab220 2024-09-12T02:23:22.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.380+0000 7ff0c359e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c40c4140 con 0x7ff0c40ac600 2024-09-12T02:23:22.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.380+0000 7ff0c359e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff0c406c2a0 con 0x7ff0c41669f0 2024-09-12T02:23:22.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.381+0000 7ff0c2d9d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0c41669f0 0x7ff0c42041f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.381+0000 7ff0c2d9d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0c41669f0 0x7ff0c42041f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:47010/0 (socket says 172.21.15.60:47010) 2024-09-12T02:23:22.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.381+0000 7ff0c2d9d640 1 -- 172.21.15.60:0/3373725243 learned_addr learned my addr 172.21.15.60:0/3373725243 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:22.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.381+0000 7ff0c1d9b640 1 --2- 172.21.15.60:0/3373725243 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0c40ac600 0x7ff0c415f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.381+0000 7ff0c259c640 1 --2- 172.21.15.60:0/3373725243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0c40ab220 0x7ff0c4074280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.381+0000 7fe2d6311640 1 -- 172.21.15.60:0/3209947450 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2b8005320 msgr2=0x7fe2b800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.381+0000 7fe2d6311640 1 --2- 172.21.15.60:0/3209947450 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2b8005320 0x7fe2b800b9c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8001f30 tx=0x7fe2b8005830 comp rx=0 tx=0).stop 2024-09-12T02:23:22.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.381+0000 7f32c20b7640 1 --2- 172.21.15.60:0/2444892065 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32b4005ff0 0x7f32b4006420 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f32b40d6d40 tx=0x7f32ac02a4e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7a2e84fb1fb84ce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.381+0000 7f9a87386640 1 -- 172.21.15.60:0/2499724005 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a800c81e0 msgr2=0x7f9a8015b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.381+0000 7f9a87386640 1 --2- 172.21.15.60:0/2499724005 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a800c81e0 0x7f9a8015b0a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9a78009d90 tx=0x7f9a7802a660 comp rx=0 tx=0).stop 2024-09-12T02:23:22.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.381+0000 7fe2d6311640 1 -- 172.21.15.60:0/3209947450 shutdown_connections 2024-09-12T02:23:22.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.381+0000 7fe2d6311640 1 --2- 172.21.15.60:0/3209947450 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2b8005320 0x7fe2b800b9c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.381+0000 7fe2d6311640 1 -- 172.21.15.60:0/3209947450 >> 172.21.15.60:0/3209947450 conn(0x7fe2d00c83a0 msgr2=0x7fe2d00c8780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:22.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.381+0000 7f3b35ffb640 1 -- 172.21.15.60:0/197125314 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b28037070 con 0x7f3b3004a060 2024-09-12T02:23:22.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.381+0000 7f3b35ffb640 1 -- 172.21.15.60:0/197125314 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b2802ae40 con 0x7f3b3004a060 2024-09-12T02:23:22.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.381+0000 7f3b35ffb640 1 -- 172.21.15.60:0/197125314 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b28032660 con 0x7f3b3004a060 2024-09-12T02:23:22.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.381+0000 7f4c22d76640 1 Processor -- start 2024-09-12T02:23:22.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.381+0000 7ff0c2d9d640 1 -- 172.21.15.60:0/3373725243 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0c40ac600 msgr2=0x7ff0c415f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.381+0000 7ff0c2d9d640 1 --2- 172.21.15.60:0/3373725243 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0c40ac600 0x7ff0c415f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.381+0000 7ff0c2d9d640 1 -- 172.21.15.60:0/3373725243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0c40ab220 msgr2=0x7ff0c4074280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.381+0000 7ff0c2d9d640 1 --2- 172.21.15.60:0/3373725243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0c40ab220 0x7ff0c4074280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.381+0000 7ff0c2d9d640 1 -- 172.21.15.60:0/3373725243 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0c4073fa0 con 0x7ff0c41669f0 2024-09-12T02:23:22.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.381+0000 7f32c08b4640 1 -- 172.21.15.60:0/2444892065 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac00b040 con 0x7f32b4005ff0 2024-09-12T02:23:22.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.381+0000 7f4c22d76640 1 -- start start 2024-09-12T02:23:22.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.381+0000 7f32c08b4640 1 -- 172.21.15.60:0/2444892065 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32ac031600 con 0x7f32b4005ff0 2024-09-12T02:23:22.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.381+0000 7ff0c2d9d640 1 --2- 172.21.15.60:0/3373725243 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0c41669f0 0x7ff0c42041f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff0b800c550 tx=0x7ff0b800ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.381+0000 7f32c08b4640 1 -- 172.21.15.60:0/2444892065 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac00b040 con 0x7f32b4005ff0 2024-09-12T02:23:22.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.382+0000 7fe2d6311640 1 -- 172.21.15.60:0/3209947450 shutdown_connections 2024-09-12T02:23:22.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.382+0000 7f0ba21ea640 1 Processor -- start 2024-09-12T02:23:22.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.382+0000 7f0ba21ea640 1 -- start start 2024-09-12T02:23:22.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.382+0000 7ff0b2ffd640 1 -- 172.21.15.60:0/3373725243 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b8015070 con 0x7ff0c41669f0 2024-09-12T02:23:22.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.382+0000 7f95522d7640 1 Processor -- start 2024-09-12T02:23:22.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.382+0000 7ff0b2ffd640 1 -- 172.21.15.60:0/3373725243 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0b8004220 con 0x7ff0c41669f0 2024-09-12T02:23:22.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.382+0000 7ff0c359e640 1 -- 172.21.15.60:0/3373725243 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0c40a5420 con 0x7ff0c41669f0 2024-09-12T02:23:22.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.382+0000 7ff0b2ffd640 1 -- 172.21.15.60:0/3373725243 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b8003610 con 0x7ff0c41669f0 2024-09-12T02:23:22.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.382+0000 7ff0c359e640 1 -- 172.21.15.60:0/3373725243 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0c415fa30 con 0x7ff0c41669f0 2024-09-12T02:23:22.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.382+0000 7f32c28b8640 1 -- 172.21.15.60:0/2444892065 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32b4005ff0 msgr2=0x7f32b4006420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.382+0000 7f32c28b8640 1 --2- 172.21.15.60:0/2444892065 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32b4005ff0 0x7f32b4006420 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f32b40d6d40 tx=0x7f32ac02a4e0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.383+0000 7f95522d7640 1 -- start start 2024-09-12T02:23:22.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.382+0000 7f3b3d331640 1 -- 172.21.15.60:0/197125314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b3004a060 msgr2=0x7f3b300de260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.382+0000 7f3b3d331640 1 --2- 172.21.15.60:0/197125314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b3004a060 0x7f3b300de260 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3b280097d0 tx=0x7f3b2802a0f0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.383+0000 7f3b3d331640 1 -- 172.21.15.60:0/197125314 shutdown_connections 2024-09-12T02:23:22.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.383+0000 7f3b3d331640 1 --2- 172.21.15.60:0/197125314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b3004a060 0x7f3b300de260 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.383+0000 7f3b3d331640 1 -- 172.21.15.60:0/197125314 >> 172.21.15.60:0/197125314 conn(0x7f3b3004c0b0 msgr2=0x7f3b3004c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:22.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.383+0000 7fe2d6311640 1 -- 172.21.15.60:0/3209947450 wait complete. 2024-09-12T02:23:22.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.382+0000 7f4c22d76640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c1400aef0 0x7f4c140409b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.382+0000 7f4c22d76640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c140465c0 0x7f4c1402fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.383+0000 7f4c22d76640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4c140d66e0 0x7f4c140d0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.383+0000 7f4c22d76640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4c140d96f0 con 0x7f4c140465c0 2024-09-12T02:23:22.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.383+0000 7f4c22d76640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4c140d9410 con 0x7f4c140d66e0 2024-09-12T02:23:22.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.383+0000 7f4c22d76640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4c14046a00 con 0x7f4c1400aef0 2024-09-12T02:23:22.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.383+0000 7f0ba21ea640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b9c06eb90 0x7f0b9c0707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.383+0000 7f0ba21ea640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b9c0c3290 0x7f0b9c14c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.383+0000 7f0ba21ea640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b9c155080 0x7f0b9c14cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.383+0000 7f0ba21ea640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9c1554a0 con 0x7f0b9c155080 2024-09-12T02:23:22.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.383+0000 7f0ba21ea640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9c0ab670 con 0x7f0b9c06eb90 2024-09-12T02:23:22.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.383+0000 7f0ba21ea640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0b9c0aaac0 con 0x7f0b9c0c3290 2024-09-12T02:23:22.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.383+0000 7f4c21d74640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c1400aef0 0x7f4c140409b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.383+0000 7f32c28b8640 1 -- 172.21.15.60:0/2444892065 shutdown_connections 2024-09-12T02:23:22.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.383+0000 7f4c21d74640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c1400aef0 0x7f4c140409b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:47014/0 (socket says 172.21.15.60:47014) 2024-09-12T02:23:22.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.383+0000 7f32c28b8640 1 --2- 172.21.15.60:0/2444892065 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32b4005ff0 0x7f32b4006420 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.383+0000 7f9a87386640 1 -- 172.21.15.60:0/2499724005 shutdown_connections 2024-09-12T02:23:22.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.383+0000 7f9a87386640 1 --2- 172.21.15.60:0/2499724005 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a800c81e0 0x7f9a8015b0a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.383+0000 7f9a87386640 1 -- 172.21.15.60:0/2499724005 >> 172.21.15.60:0/2499724005 conn(0x7f9a800cbd30 msgr2=0x7f9a800cc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:22.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.383+0000 7f4c21d74640 1 -- 172.21.15.60:0/718387424 learned_addr learned my addr 172.21.15.60:0/718387424 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:22.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.383+0000 7f32c28b8640 1 --2- 172.21.15.60:0/2444892065 >> v2:172.21.15.60:3300/0 conn(0x7f32b400b0d0 0x7f32b400b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.383+0000 7f32c28b8640 1 -- 172.21.15.60:0/2444892065 >> 172.21.15.60:0/2444892065 conn(0x7f32b4048150 msgr2=0x7f32b4048560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:22.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.383+0000 7f4c21573640 1 --2- 172.21.15.60:0/718387424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c140465c0 0x7f4c1402fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.383+0000 7f3b3d331640 1 -- 172.21.15.60:0/197125314 shutdown_connections 2024-09-12T02:23:22.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.383+0000 7f0ba09e7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b9c0c3290 0x7f0b9c14c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.383+0000 7f32c28b8640 1 -- 172.21.15.60:0/2444892065 shutdown_connections 2024-09-12T02:23:22.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.383+0000 7f0ba09e7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b9c0c3290 0x7f0b9c14c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:47020/0 (socket says 172.21.15.60:47020) 2024-09-12T02:23:22.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.383+0000 7f0ba09e7640 1 -- 172.21.15.60:0/3740728043 learned_addr learned my addr 172.21.15.60:0/3740728043 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:22.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.383+0000 7f32c28b8640 1 -- 172.21.15.60:0/2444892065 wait complete. 2024-09-12T02:23:22.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.383+0000 7f4c22575640 1 --2- 172.21.15.60:0/718387424 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4c140d66e0 0x7f4c140d0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.384+0000 7ff0c359e640 1 -- 172.21.15.60:0/3373725243 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff0c40a5660 con 0x7ff0c41669f0 2024-09-12T02:23:22.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.384+0000 7f0ba11e8640 1 --2- 172.21.15.60:0/3740728043 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b9c06eb90 0x7f0b9c0707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.384+0000 7f4c21d74640 1 -- 172.21.15.60:0/718387424 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4c140d66e0 msgr2=0x7f4c140d0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.384+0000 7f4c21d74640 1 --2- 172.21.15.60:0/718387424 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4c140d66e0 0x7f4c140d0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.384+0000 7f4c21d74640 1 -- 172.21.15.60:0/718387424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c140465c0 msgr2=0x7f4c1402fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.384+0000 7f4c21d74640 1 --2- 172.21.15.60:0/718387424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c140465c0 0x7f4c1402fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.384+0000 7f4c21d74640 1 -- 172.21.15.60:0/718387424 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c1403fa60 con 0x7f4c1400aef0 2024-09-12T02:23:22.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.384+0000 7f4c21573640 1 --2- 172.21.15.60:0/718387424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c140465c0 0x7f4c1402fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:23:22.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.384+0000 7f0ba19e9640 1 --2- 172.21.15.60:0/3740728043 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b9c155080 0x7f0b9c14cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.384+0000 7f3b3d331640 1 -- 172.21.15.60:0/197125314 wait complete. 2024-09-12T02:23:22.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.384+0000 7f0ba09e7640 1 -- 172.21.15.60:0/3740728043 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b9c06eb90 msgr2=0x7f0b9c0707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.384+0000 7f0ba09e7640 1 --2- 172.21.15.60:0/3740728043 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b9c06eb90 0x7f0b9c0707f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.384+0000 7f0ba09e7640 1 -- 172.21.15.60:0/3740728043 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b9c155080 msgr2=0x7f0b9c14cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.384+0000 7f0ba09e7640 1 --2- 172.21.15.60:0/3740728043 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b9c155080 0x7f0b9c14cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.384+0000 7f0ba09e7640 1 -- 172.21.15.60:0/3740728043 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b9c160a20 con 0x7f0b9c0c3290 2024-09-12T02:23:22.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.384+0000 7f4c21d74640 1 --2- 172.21.15.60:0/718387424 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c1400aef0 0x7f4c140409b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4c18000c00 tx=0x7f4c180046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.384+0000 7f4c127fc640 1 -- 172.21.15.60:0/718387424 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1803a040 con 0x7f4c1400aef0 2024-09-12T02:23:22.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.384+0000 7f4c127fc640 1 -- 172.21.15.60:0/718387424 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c1800bca0 con 0x7f4c1400aef0 2024-09-12T02:23:22.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.384+0000 7f4c127fc640 1 -- 172.21.15.60:0/718387424 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c18003850 con 0x7f4c1400aef0 2024-09-12T02:23:22.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.384+0000 7f4c22d76640 1 -- 172.21.15.60:0/718387424 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c14041450 con 0x7f4c1400aef0 2024-09-12T02:23:22.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.384+0000 7f4c22d76640 1 -- 172.21.15.60:0/718387424 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c14041a10 con 0x7f4c1400aef0 2024-09-12T02:23:22.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.385+0000 7f95522d7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f954c06c650 0x7f954c0afda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.385+0000 7f95522d7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f954c0c9c80 0x7f954c1ec650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.385+0000 7fe2d6311640 1 Processor -- start 2024-09-12T02:23:22.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.385+0000 7f95522d7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f954c150480 0x7f954c1ecb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.385+0000 7f95522d7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f954c06d270 con 0x7f954c150480 2024-09-12T02:23:22.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.385+0000 7f95522d7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f954c159fc0 con 0x7f954c06c650 2024-09-12T02:23:22.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.385+0000 7f95522d7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f954c156270 con 0x7f954c0c9c80 2024-09-12T02:23:22.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.385+0000 7fe2d6311640 1 -- start start 2024-09-12T02:23:22.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.385+0000 7f9550874640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f954c150480 0x7f954c1ecb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.385+0000 7f9550874640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f954c150480 0x7f954c1ecb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49720/0 (socket says 172.21.15.60:49720) 2024-09-12T02:23:22.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.385+0000 7f9550874640 1 -- 172.21.15.60:0/2449201651 learned_addr learned my addr 172.21.15.60:0/2449201651 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:22.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.385+0000 7f0ba09e7640 1 --2- 172.21.15.60:0/3740728043 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b9c0c3290 0x7f0b9c14c680 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0b9002a820 tx=0x7f0b900046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.385+0000 7f32c28b8640 1 Processor -- start 2024-09-12T02:23:22.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.385+0000 7f9a87386640 1 -- 172.21.15.60:0/2499724005 shutdown_connections 2024-09-12T02:23:22.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.385+0000 7f32c28b8640 1 -- start start 2024-09-12T02:23:22.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.386+0000 7f954bfff640 1 --2- 172.21.15.60:0/2449201651 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f954c06c650 0x7f954c0afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.386+0000 7f9550874640 1 -- 172.21.15.60:0/2449201651 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f954c0c9c80 msgr2=0x7f954c1ec650 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:23:22.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.386+0000 7f9550874640 1 --2- 172.21.15.60:0/2449201651 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f954c0c9c80 0x7f954c1ec650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.386+0000 7f9550874640 1 -- 172.21.15.60:0/2449201651 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f954c06c650 msgr2=0x7f954c0afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.386+0000 7f9550874640 1 --2- 172.21.15.60:0/2449201651 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f954c06c650 0x7f954c0afda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.386+0000 7f9550874640 1 -- 172.21.15.60:0/2449201651 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f954c1e27d0 con 0x7f954c150480 2024-09-12T02:23:22.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.386+0000 7f3b3d331640 1 Processor -- start 2024-09-12T02:23:22.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.386+0000 7f9550874640 1 --2- 172.21.15.60:0/2449201651 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f954c150480 0x7f954c1ecb90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f954400b990 tx=0x7f954400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.386+0000 7f0b99ffb640 1 -- 172.21.15.60:0/3740728043 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b90037050 con 0x7f0b9c0c3290 2024-09-12T02:23:22.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.386+0000 7f0b99ffb640 1 -- 172.21.15.60:0/3740728043 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b90043070 con 0x7f0b9c0c3290 2024-09-12T02:23:22.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.386+0000 7f0b99ffb640 1 -- 172.21.15.60:0/3740728043 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b9003cb30 con 0x7f0b9c0c3290 2024-09-12T02:23:22.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.387+0000 7fe2d6311640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2b8005320 0x7fe2d01dfab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.386+0000 7f0ba21ea640 1 -- 172.21.15.60:0/3740728043 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b9c1f0320 con 0x7f0b9c0c3290 2024-09-12T02:23:22.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.387+0000 7f0ba21ea640 1 -- 172.21.15.60:0/3740728043 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b9c160cc0 con 0x7f0b9c0c3290 2024-09-12T02:23:22.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.387+0000 7fe2d6311640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2d0149660 0x7fe2d0149ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.387+0000 7fe2d6311640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2d01dd750 0x7fe2d01ddbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.387+0000 7fe2cffff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2b8005320 0x7fe2d01dfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.387+0000 7fe2cf7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2d0149660 0x7fe2d0149ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.387+0000 7f32c28b8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32b4005ff0 0x7f32b40d81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.386+0000 7f9a87386640 1 -- 172.21.15.60:0/2499724005 wait complete. 2024-09-12T02:23:22.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.387+0000 7fe2cf7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2d0149660 0x7fe2d0149ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49734/0 (socket says 172.21.15.60:49734) 2024-09-12T02:23:22.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.387+0000 7f32c28b8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32b400b0d0 0x7f32b40cbb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.387+0000 7fe2cffff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2b8005320 0x7fe2d01dfab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:47040/0 (socket says 172.21.15.60:47040) 2024-09-12T02:23:22.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.387+0000 7f4c127fc640 1 -- 172.21.15.60:0/718387424 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4c180039f0 con 0x7f4c1400aef0 2024-09-12T02:23:22.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.386+0000 7f3b3d331640 1 -- start start 2024-09-12T02:23:22.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.387+0000 7f32c18b6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32b4005ff0 0x7f32b40d81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.387+0000 7f32c18b6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32b4005ff0 0x7f32b40d81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49738/0 (socket says 172.21.15.60:49738) 2024-09-12T02:23:22.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.387+0000 7f32c18b6640 1 -- 172.21.15.60:0/3246164201 learned_addr learned my addr 172.21.15.60:0/3246164201 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:22.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.387+0000 7f32c28b8640 1 --2- 172.21.15.60:0/3246164201 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32b40d34d0 0x7f32b416b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.387+0000 7f3b3d331640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b3004a060 0x7f3b300dc950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.387+0000 7f3b3d331640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b3004a440 0x7f3b300dff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.387+0000 7f3b3d331640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b3004f060 0x7f3b300dd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.387+0000 7f3b36ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b3004a060 0x7f3b300dc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.387+0000 7fe2cf7fe640 1 -- 172.21.15.60:0/255789884 learned_addr learned my addr 172.21.15.60:0/255789884 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:22.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.387+0000 7f32c28b8640 1 -- 172.21.15.60:0/3246164201 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f32b4007650 con 0x7f32b4005ff0 2024-09-12T02:23:22.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.387+0000 7f9a87386640 1 Processor -- start 2024-09-12T02:23:22.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.387+0000 7f32c10b5640 1 --2- 172.21.15.60:0/3246164201 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32b400b0d0 0x7f32b40cbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.387+0000 7f32c28b8640 1 -- 172.21.15.60:0/3246164201 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f32b40d6850 con 0x7f32b400b0d0 2024-09-12T02:23:22.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.385+0000 7ff0b2ffd640 1 -- 172.21.15.60:0/3373725243 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff0b80037b0 con 0x7ff0c41669f0 2024-09-12T02:23:22.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.385+0000 7ff0b2ffd640 1 --2- 172.21.15.60:0/3373725243 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff0a406bf00 0x7ff0a406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.385+0000 7ff0b2ffd640 1 -- 172.21.15.60:0/3373725243 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7ff0b808aec0 con 0x7ff0c41669f0 2024-09-12T02:23:22.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.386+0000 7ff0b2ffd640 1 --2- 172.21.15.60:0/3373725243 >> [v2:172.21.15.60:6818/1789465659,v1:172.21.15.60:6819/1789465659] conn(0x7ff0a40767a0 0x7ff0a4078bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.386+0000 7ff0b2ffd640 1 -- 172.21.15.60:0/3373725243 --> [v2:172.21.15.60:6818/1789465659,v1:172.21.15.60:6819/1789465659] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff0a4079270 con 0x7ff0a40767a0 2024-09-12T02:23:22.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.386+0000 7ff0b2ffd640 1 -- 172.21.15.60:0/3373725243 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff0b808d520 con 0x7ff0c41669f0 2024-09-12T02:23:22.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.386+0000 7ff0c259c640 1 --2- 172.21.15.60:0/3373725243 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff0a406bf00 0x7ff0a406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.387+0000 7ff0c259c640 1 --2- 172.21.15.60:0/3373725243 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff0a406bf00 0x7ff0a406e3c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff0b4000f60 tx=0x7ff0b4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.387+0000 7ff0c1d9b640 1 --2- 172.21.15.60:0/3373725243 >> [v2:172.21.15.60:6818/1789465659,v1:172.21.15.60:6819/1789465659] conn(0x7ff0a40767a0 0x7ff0a4078bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.388+0000 7fe2d6311640 1 -- 172.21.15.60:0/255789884 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d006f1b0 con 0x7fe2d0149660 2024-09-12T02:23:22.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.388+0000 7fe2d6311640 1 -- 172.21.15.60:0/255789884 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d00c44d0 con 0x7fe2d01dd750 2024-09-12T02:23:22.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.388+0000 7fe2d48ae640 1 --2- 172.21.15.60:0/255789884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2d01dd750 0x7fe2d01ddbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.388+0000 7fe2d6311640 1 -- 172.21.15.60:0/255789884 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe2d006f330 con 0x7fe2b8005320 2024-09-12T02:23:22.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.389+0000 7fe2cffff640 1 -- 172.21.15.60:0/255789884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2d01dd750 msgr2=0x7fe2d01ddbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.389+0000 7fe2cffff640 1 --2- 172.21.15.60:0/255789884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2d01dd750 0x7fe2d01ddbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.389+0000 7fe2cffff640 1 -- 172.21.15.60:0/255789884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2d0149660 msgr2=0x7fe2d0149ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.389+0000 7fe2cffff640 1 --2- 172.21.15.60:0/255789884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2d0149660 0x7fe2d0149ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.389+0000 7fe2cffff640 1 -- 172.21.15.60:0/255789884 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2d014d0f0 con 0x7fe2b8005320 2024-09-12T02:23:22.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.388+0000 7f9a87386640 1 -- start start 2024-09-12T02:23:22.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.389+0000 7f9a87386640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a800c73f0 0x7f9a801f5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.389+0000 7f9a87386640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a800c81e0 0x7f9a801e5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.389+0000 7f9a87386640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a80157f80 0x7f9a801fbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.389+0000 7f9a85122640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a800c73f0 0x7f9a801f5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.389+0000 7f9a85122640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a800c73f0 0x7f9a801f5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:47070/0 (socket says 172.21.15.60:47070) 2024-09-12T02:23:22.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.388+0000 7f4c22d76640 1 -- 172.21.15.60:0/718387424 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4c1403fd40 con 0x7f4c1400aef0 2024-09-12T02:23:22.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.388+0000 7f4c127fc640 1 --2- 172.21.15.60:0/718387424 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4c0006bf30 0x7f4c0006e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.388+0000 7f4c127fc640 1 -- 172.21.15.60:0/718387424 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f4c180aae90 con 0x7f4c1400aef0 2024-09-12T02:23:22.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.388+0000 7f4c127fc640 1 --2- 172.21.15.60:0/718387424 >> [v2:172.21.15.105:6808/1581641129,v1:172.21.15.105:6809/1581641129] conn(0x7f4c00076740 0x7f4c00078b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.388+0000 7f4c127fc640 1 -- 172.21.15.60:0/718387424 --> [v2:172.21.15.105:6808/1581641129,v1:172.21.15.105:6809/1581641129] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4c18044e80 con 0x7f4c00076740 2024-09-12T02:23:22.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.388+0000 7f4c21573640 1 --2- 172.21.15.60:0/718387424 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4c0006bf30 0x7f4c0006e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.388+0000 7f9548ff9640 1 -- 172.21.15.60:0/2449201651 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9544019070 con 0x7f954c150480 2024-09-12T02:23:22.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.388+0000 7f9548ff9640 1 -- 172.21.15.60:0/2449201651 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f954400cba0 con 0x7f954c150480 2024-09-12T02:23:22.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.388+0000 7f9548ff9640 1 -- 172.21.15.60:0/2449201651 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9544014440 con 0x7f954c150480 2024-09-12T02:23:22.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.388+0000 7f95522d7640 1 -- 172.21.15.60:0/2449201651 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f954c1e2210 con 0x7f954c150480 2024-09-12T02:23:22.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.388+0000 7f95522d7640 1 -- 172.21.15.60:0/2449201651 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f954c0b02e0 con 0x7f954c150480 2024-09-12T02:23:22.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.387+0000 7f3b3d331640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3b3004ebd0 con 0x7f3b3004a060 2024-09-12T02:23:22.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.388+0000 7f3b36ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b3004a060 0x7f3b300dc950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49742/0 (socket says 172.21.15.60:49742) 2024-09-12T02:23:22.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.388+0000 7f3b36ffd640 1 -- 172.21.15.60:0/3955050427 learned_addr learned my addr 172.21.15.60:0/3955050427 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:22.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.388+0000 7f3b367fc640 1 --2- 172.21.15.60:0/3955050427 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b3004a440 0x7f3b300dff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.388+0000 7f32c28b8640 1 -- 172.21.15.60:0/3246164201 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f32b40d38b0 con 0x7f32b40d34d0 2024-09-12T02:23:22.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.388+0000 7f32c20b7640 1 --2- 172.21.15.60:0/3246164201 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32b40d34d0 0x7f32b416b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.389+0000 7f32c18b6640 1 -- 172.21.15.60:0/3246164201 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32b40d34d0 msgr2=0x7f32b416b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.389+0000 7f32c18b6640 1 --2- 172.21.15.60:0/3246164201 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32b40d34d0 0x7f32b416b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.389+0000 7f32c18b6640 1 -- 172.21.15.60:0/3246164201 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32b400b0d0 msgr2=0x7f32b40cbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.389+0000 7f32c18b6640 1 --2- 172.21.15.60:0/3246164201 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32b400b0d0 0x7f32b40cbb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.389+0000 7f32c18b6640 1 -- 172.21.15.60:0/3246164201 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b40d86f0 con 0x7f32b4005ff0 2024-09-12T02:23:22.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.389+0000 7f32c18b6640 1 --2- 172.21.15.60:0/3246164201 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32b4005ff0 0x7f32b40d81b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f32bc06a5d0 tx=0x7f32bc0699a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.389+0000 7f32b27fc640 1 -- 172.21.15.60:0/3246164201 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32bc06bbe0 con 0x7f32b4005ff0 2024-09-12T02:23:22.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.389+0000 7f9a85122640 1 -- 172.21.15.60:0/1423893162 learned_addr learned my addr 172.21.15.60:0/1423893162 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:22.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.389+0000 7f9a87386640 1 -- 172.21.15.60:0/1423893162 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9a800ca340 con 0x7f9a800c81e0 2024-09-12T02:23:22.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.389+0000 7f9a87386640 1 -- 172.21.15.60:0/1423893162 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9a800c6b70 con 0x7f9a80157f80 2024-09-12T02:23:22.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.389+0000 7f9a87386640 1 -- 172.21.15.60:0/1423893162 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9a8006c5b0 con 0x7f9a800c73f0 2024-09-12T02:23:22.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.389+0000 7f9a85923640 1 --2- 172.21.15.60:0/1423893162 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a80157f80 0x7f9a801fbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.389+0000 7f4c127fc640 1 -- 172.21.15.60:0/718387424 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4c180751d0 con 0x7f4c1400aef0 2024-09-12T02:23:22.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.390+0000 7f4c21573640 1 --2- 172.21.15.60:0/718387424 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4c0006bf30 0x7f4c0006e3f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c007fd0 tx=0x7f4c0c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.389+0000 7f9a84921640 1 --2- 172.21.15.60:0/1423893162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a800c81e0 0x7f9a801e5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.389+0000 7f32b27fc640 1 -- 172.21.15.60:0/3246164201 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32bc092020 con 0x7f32b4005ff0 2024-09-12T02:23:22.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.390+0000 7f0ba21ea640 1 -- 172.21.15.60:0/3740728043 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0b9c04ffb0 con 0x7f0b9c0c3290 2024-09-12T02:23:22.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.390+0000 7f0b99ffb640 1 -- 172.21.15.60:0/3740728043 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0b9003ccd0 con 0x7f0b9c0c3290 2024-09-12T02:23:22.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.390+0000 7f9a85923640 1 -- 172.21.15.60:0/1423893162 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a800c73f0 msgr2=0x7f9a801f5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.390+0000 7f9a85923640 1 --2- 172.21.15.60:0/1423893162 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a800c73f0 0x7f9a801f5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.390+0000 7f9a85923640 1 -- 172.21.15.60:0/1423893162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a800c81e0 msgr2=0x7f9a801e5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.390+0000 7f9a85923640 1 --2- 172.21.15.60:0/1423893162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a800c81e0 0x7f9a801e5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.390+0000 7fe2cffff640 1 --2- 172.21.15.60:0/255789884 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2b8005320 0x7fe2d01dfab0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe2c400c7b0 tx=0x7fe2c400cbb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.390+0000 7f9a85923640 1 -- 172.21.15.60:0/1423893162 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a800af160 con 0x7f9a80157f80 2024-09-12T02:23:22.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.390+0000 7f9a84921640 1 --2- 172.21.15.60:0/1423893162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a800c81e0 0x7f9a801e5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:23:22.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.390+0000 7f3b377fe640 1 --2- 172.21.15.60:0/3955050427 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b3004f060 0x7f3b300dd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.390+0000 7f3b3d331640 1 -- 172.21.15.60:0/3955050427 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3b3004e2a0 con 0x7f3b3004f060 2024-09-12T02:23:22.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.390+0000 7f3b3d331640 1 -- 172.21.15.60:0/3955050427 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3b3004e580 con 0x7f3b3004a440 2024-09-12T02:23:22.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.390+0000 7fe2ccff9640 1 -- 172.21.15.60:0/255789884 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c4018070 con 0x7fe2b8005320 2024-09-12T02:23:22.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.390+0000 7fe2ccff9640 1 -- 172.21.15.60:0/255789884 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2c40072d0 con 0x7fe2b8005320 2024-09-12T02:23:22.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.390+0000 7f32b27fc640 1 -- 172.21.15.60:0/3246164201 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32bc0741c0 con 0x7f32b4005ff0 2024-09-12T02:23:22.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.390+0000 7f9548ff9640 1 -- 172.21.15.60:0/2449201651 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f954401c070 con 0x7f954c150480 2024-09-12T02:23:22.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.390+0000 7fe2d6311640 1 -- 172.21.15.60:0/255789884 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2d014a020 con 0x7fe2b8005320 2024-09-12T02:23:22.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.390+0000 7f32c28b8640 1 -- 172.21.15.60:0/3246164201 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32b40d70e0 con 0x7f32b4005ff0 2024-09-12T02:23:22.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.390+0000 7fe2ccff9640 1 -- 172.21.15.60:0/255789884 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c40047e0 con 0x7fe2b8005320 2024-09-12T02:23:22.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.391+0000 7f9548ff9640 1 --2- 172.21.15.60:0/2449201651 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f953806beb0 0x7f953806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.390+0000 7f32c28b8640 1 -- 172.21.15.60:0/3246164201 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32b40d76a0 con 0x7f32b4005ff0 2024-09-12T02:23:22.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.390+0000 7fe2d6311640 1 -- 172.21.15.60:0/255789884 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2d01efc80 con 0x7fe2b8005320 2024-09-12T02:23:22.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.390+0000 7f4c22575640 1 --2- 172.21.15.60:0/718387424 >> [v2:172.21.15.105:6808/1581641129,v1:172.21.15.105:6809/1581641129] conn(0x7f4c00076740 0x7f4c00078b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.391+0000 7f9548ff9640 1 -- 172.21.15.60:0/2449201651 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f954408ae70 con 0x7f954c150480 2024-09-12T02:23:22.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.391+0000 7f954bfff640 1 --2- 172.21.15.60:0/2449201651 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f953806beb0 0x7f953806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.388+0000 7ff0c1d9b640 1 --2- 172.21.15.60:0/3373725243 >> [v2:172.21.15.60:6818/1789465659,v1:172.21.15.60:6819/1789465659] conn(0x7ff0a40767a0 0x7ff0a4078bc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.391+0000 7f0b99ffb640 1 --2- 172.21.15.60:0/3740728043 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0b8806bf30 0x7f0b8806e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.391+0000 7f0b99ffb640 1 -- 172.21.15.60:0/3740728043 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f0b900abc80 con 0x7f0b9c0c3290 2024-09-12T02:23:22.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.391+0000 7ff0b2ffd640 1 -- 172.21.15.60:0/3373725243 <== osd.0 v2:172.21.15.60:6818/1789465659 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff0a4079270 con 0x7ff0a40767a0 2024-09-12T02:23:22.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.391+0000 7f0b99ffb640 1 --2- 172.21.15.60:0/3740728043 >> [v2:172.21.15.60:6826/278470077,v1:172.21.15.60:6827/278470077] conn(0x7f0b88076750 0x7f0b88078b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.391+0000 7f0b99ffb640 1 -- 172.21.15.60:0/3740728043 --> [v2:172.21.15.60:6826/278470077,v1:172.21.15.60:6827/278470077] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0b90046e80 con 0x7f0b88076750 2024-09-12T02:23:22.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.391+0000 7f4c22575640 1 --2- 172.21.15.60:0/718387424 >> [v2:172.21.15.105:6808/1581641129,v1:172.21.15.105:6809/1581641129] conn(0x7f4c00076740 0x7f4c00078b60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.390+0000 7f3b377fe640 1 -- 172.21.15.60:0/3955050427 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b3004a440 msgr2=0x7f3b300dff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.391+0000 7f9a85923640 1 --2- 172.21.15.60:0/1423893162 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a80157f80 0x7f9a801fbcc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9a800ccb60 tx=0x7f9a78004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.391+0000 7f9a75ffb640 1 -- 172.21.15.60:0/1423893162 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a78040070 con 0x7f9a80157f80 2024-09-12T02:23:22.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.391+0000 7f9a75ffb640 1 -- 172.21.15.60:0/1423893162 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a78031de0 con 0x7f9a80157f80 2024-09-12T02:23:22.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.391+0000 7f9a75ffb640 1 -- 172.21.15.60:0/1423893162 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a780456a0 con 0x7f9a80157f80 2024-09-12T02:23:22.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.391+0000 7f9a87386640 1 -- 172.21.15.60:0/1423893162 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a8014ced0 con 0x7f9a80157f80 2024-09-12T02:23:22.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.390+0000 7f3b377fe640 1 --2- 172.21.15.60:0/3955050427 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b3004a440 0x7f3b300dff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.390+0000 7f3b377fe640 1 -- 172.21.15.60:0/3955050427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b3004a060 msgr2=0x7f3b300dc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.391+0000 7f3b377fe640 1 --2- 172.21.15.60:0/3955050427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b3004a060 0x7f3b300dc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.391+0000 7f3b377fe640 1 -- 172.21.15.60:0/3955050427 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b300dd210 con 0x7f3b3004f060 2024-09-12T02:23:22.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.391+0000 7f3b36ffd640 1 --2- 172.21.15.60:0/3955050427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b3004a060 0x7f3b300dc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:23:22.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.391+0000 7f3b367fc640 1 --2- 172.21.15.60:0/3955050427 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b3004a440 0x7f3b300dff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:23:22.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.391+0000 7f3b377fe640 1 --2- 172.21.15.60:0/3955050427 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b3004f060 0x7f3b300dd860 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3b38000b60 tx=0x7f3b380699a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.391+0000 7f3b1f7fe640 1 -- 172.21.15.60:0/3955050427 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b38076660 con 0x7f3b3004f060 2024-09-12T02:23:22.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.392+0000 7f3b1f7fe640 1 -- 172.21.15.60:0/3955050427 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b38092020 con 0x7f3b3004f060 2024-09-12T02:23:22.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.392+0000 7f3b1f7fe640 1 -- 172.21.15.60:0/3955050427 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3806be20 con 0x7f3b3004f060 2024-09-12T02:23:22.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.392+0000 7f0ba11e8640 1 --2- 172.21.15.60:0/3740728043 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0b8806bf30 0x7f0b8806e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.392+0000 7f0ba19e9640 1 --2- 172.21.15.60:0/3740728043 >> [v2:172.21.15.60:6826/278470077,v1:172.21.15.60:6827/278470077] conn(0x7f0b88076750 0x7f0b88078b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.392+0000 7f954bfff640 1 --2- 172.21.15.60:0/2449201651 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f953806beb0 0x7f953806e370 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f954c1e3bd0 tx=0x7f953c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.392+0000 7f9a87386640 1 -- 172.21.15.60:0/1423893162 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a801fc870 con 0x7f9a80157f80 2024-09-12T02:23:22.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.392+0000 7f0b99ffb640 1 -- 172.21.15.60:0/3740728043 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0b90075f10 con 0x7f0b9c0c3290 2024-09-12T02:23:22.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.393+0000 7fe2d6311640 1 -- 172.21.15.60:0/255789884 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe2d006eb10 con 0x7fe2b8005320 2024-09-12T02:23:22.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.393+0000 7fe2ccff9640 1 -- 172.21.15.60:0/255789884 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe2c401b070 con 0x7fe2b8005320 2024-09-12T02:23:22.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.393+0000 7f4c127fc640 1 -- 172.21.15.60:0/718387424 <== osd.4 v2:172.21.15.105:6808/1581641129 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4c18044e80 con 0x7f4c00076740 2024-09-12T02:23:22.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.392+0000 7f95522d7640 1 --2- 172.21.15.60:0/2449201651 >> [v2:172.21.15.105:6824/1392337793,v1:172.21.15.105:6825/1392337793] conn(0x7f954c14f8e0 0x7f954c1ef500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.392+0000 7f95522d7640 1 -- 172.21.15.60:0/2449201651 --> [v2:172.21.15.105:6824/1392337793,v1:172.21.15.105:6825/1392337793] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f954c1ec410 con 0x7f954c14f8e0 2024-09-12T02:23:22.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.393+0000 7f954b7fe640 1 --2- 172.21.15.60:0/2449201651 >> [v2:172.21.15.105:6824/1392337793,v1:172.21.15.105:6825/1392337793] conn(0x7f954c14f8e0 0x7f954c1ef500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.392+0000 7f329ffff640 1 -- 172.21.15.60:0/3246164201 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f32b4004af0 con 0x7f32b4005ff0 2024-09-12T02:23:22.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.393+0000 7f9a87386640 1 -- 172.21.15.60:0/1423893162 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9a800c5d60 con 0x7f9a80157f80 2024-09-12T02:23:22.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.393+0000 7f954b7fe640 1 --2- 172.21.15.60:0/2449201651 >> [v2:172.21.15.105:6824/1392337793,v1:172.21.15.105:6825/1392337793] conn(0x7f954c14f8e0 0x7f954c1ef500 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.393+0000 7fe2ccff9640 1 --2- 172.21.15.60:0/255789884 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe2bc06be60 0x7fe2bc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.394+0000 7fe2ccff9640 1 -- 172.21.15.60:0/255789884 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7fe2c408a540 con 0x7fe2b8005320 2024-09-12T02:23:22.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.394+0000 7fe2cf7fe640 1 --2- 172.21.15.60:0/255789884 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe2bc06be60 0x7fe2bc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.394+0000 7f3b3d331640 1 -- 172.21.15.60:0/3955050427 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b30034230 con 0x7f3b3004f060 2024-09-12T02:23:22.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.394+0000 7f3b3d331640 1 -- 172.21.15.60:0/3955050427 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b30033750 con 0x7f3b3004f060 2024-09-12T02:23:22.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.394+0000 7fe2ccff9640 1 --2- 172.21.15.60:0/255789884 >> [v2:172.21.15.60:6810/1109822408,v1:172.21.15.60:6811/1109822408] conn(0x7fe2bc076680 0x7fe2bc078aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.394+0000 7fe2ccff9640 1 -- 172.21.15.60:0/255789884 --> [v2:172.21.15.60:6810/1109822408,v1:172.21.15.60:6811/1109822408] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe2bc079150 con 0x7fe2bc076680 2024-09-12T02:23:22.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.394+0000 7fe2ccff9640 1 -- 172.21.15.60:0/255789884 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe2c4091050 con 0x7fe2b8005320 2024-09-12T02:23:22.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.394+0000 7f9548ff9640 1 -- 172.21.15.60:0/2449201651 <== osd.5 v2:172.21.15.105:6824/1392337793 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f954c1ec410 con 0x7f954c14f8e0 2024-09-12T02:23:22.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.394+0000 7f9a75ffb640 1 -- 172.21.15.60:0/1423893162 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9a78039040 con 0x7f9a80157f80 2024-09-12T02:23:22.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.394+0000 7fe2d48ae640 1 --2- 172.21.15.60:0/255789884 >> [v2:172.21.15.60:6810/1109822408,v1:172.21.15.60:6811/1109822408] conn(0x7fe2bc076680 0x7fe2bc078aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.392+0000 7f0ba11e8640 1 --2- 172.21.15.60:0/3740728043 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0b8806bf30 0x7f0b8806e3f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0b94001560 tx=0x7f0b94009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.394+0000 7f0ba19e9640 1 --2- 172.21.15.60:0/3740728043 >> [v2:172.21.15.60:6826/278470077,v1:172.21.15.60:6827/278470077] conn(0x7f0b88076750 0x7f0b88078b70 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.394+0000 7fe2cf7fe640 1 --2- 172.21.15.60:0/255789884 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe2bc06be60 0x7fe2bc06e320 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe2d014ccb0 tx=0x7fe2c0009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.395+0000 7f32b27fc640 1 -- 172.21.15.60:0/3246164201 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f32bc074360 con 0x7f32b4005ff0 2024-09-12T02:23:22.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.395+0000 7f3b3d331640 1 -- 172.21.15.60:0/3955050427 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3b300d9a30 con 0x7f3b3004f060 2024-09-12T02:23:22.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.395+0000 7f0b99ffb640 1 -- 172.21.15.60:0/3740728043 <== osd.2 v2:172.21.15.60:6826/278470077 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0b90046e80 con 0x7f0b88076750 2024-09-12T02:23:22.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.395+0000 7f9a75ffb640 1 --2- 172.21.15.60:0/1423893162 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9a6406bf00 0x7f9a6406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.395+0000 7f9a75ffb640 1 -- 172.21.15.60:0/1423893162 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f9a780ac970 con 0x7f9a80157f80 2024-09-12T02:23:22.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.395+0000 7fe2d48ae640 1 --2- 172.21.15.60:0/255789884 >> [v2:172.21.15.60:6810/1109822408,v1:172.21.15.60:6811/1109822408] conn(0x7fe2bc076680 0x7fe2bc078aa0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.395+0000 7f9a85122640 1 --2- 172.21.15.60:0/1423893162 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9a6406bf00 0x7f9a6406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.395+0000 7f9a75ffb640 1 --2- 172.21.15.60:0/1423893162 >> [v2:172.21.15.60:6802/3606424156,v1:172.21.15.60:6803/3606424156] conn(0x7f9a64076790 0x7f9a64078bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.395+0000 7f9a75ffb640 1 -- 172.21.15.60:0/1423893162 --> [v2:172.21.15.60:6802/3606424156,v1:172.21.15.60:6803/3606424156] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9a7804fe50 con 0x7f9a64076790 2024-09-12T02:23:22.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.395+0000 7f9a75ffb640 1 -- 172.21.15.60:0/1423893162 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9a780b2250 con 0x7f9a80157f80 2024-09-12T02:23:22.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.395+0000 7f32b27fc640 1 --2- 172.21.15.60:0/3246164201 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f32a006be80 0x7f32a006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.396+0000 7f32b27fc640 1 -- 172.21.15.60:0/3246164201 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f32bc107090 con 0x7f32b4005ff0 2024-09-12T02:23:22.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.396+0000 7f32b27fc640 1 --2- 172.21.15.60:0/3246164201 >> [v2:172.21.15.105:6816/3745331251,v1:172.21.15.105:6817/3745331251] conn(0x7f32a0076720 0x7f32a0078b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.396+0000 7f32c10b5640 1 --2- 172.21.15.60:0/3246164201 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f32a006be80 0x7f32a006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.396+0000 7f32b27fc640 1 -- 172.21.15.60:0/3246164201 --> [v2:172.21.15.105:6816/3745331251,v1:172.21.15.105:6817/3745331251] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f32a00791f0 con 0x7f32a0076720 2024-09-12T02:23:22.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.396+0000 7f32b27fc640 1 -- 172.21.15.60:0/3246164201 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f32bc10e050 con 0x7f32b4005ff0 2024-09-12T02:23:22.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.396+0000 7f9a84921640 1 --2- 172.21.15.60:0/1423893162 >> [v2:172.21.15.60:6802/3606424156,v1:172.21.15.60:6803/3606424156] conn(0x7f9a64076790 0x7f9a64078bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.396+0000 7fe2ccff9640 1 -- 172.21.15.60:0/255789884 <== osd.1 v2:172.21.15.60:6810/1109822408 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe2bc079150 con 0x7fe2bc076680 2024-09-12T02:23:22.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.396+0000 7f3b1f7fe640 1 -- 172.21.15.60:0/3955050427 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3b380741c0 con 0x7f3b3004f060 2024-09-12T02:23:22.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.396+0000 7f32c20b7640 1 --2- 172.21.15.60:0/3246164201 >> [v2:172.21.15.105:6816/3745331251,v1:172.21.15.105:6817/3745331251] conn(0x7f32a0076720 0x7f32a0078b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.397+0000 7f9a85122640 1 --2- 172.21.15.60:0/1423893162 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9a6406bf00 0x7f9a6406e3c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c007fd0 tx=0x7f9a7c007d80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.397+0000 7f3b1f7fe640 1 --2- 172.21.15.60:0/3955050427 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3b2406bf30 0x7f3b2406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.397+0000 7f9a84921640 1 --2- 172.21.15.60:0/1423893162 >> [v2:172.21.15.60:6802/3606424156,v1:172.21.15.60:6803/3606424156] conn(0x7f9a64076790 0x7f9a64078bb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.397+0000 7f32c10b5640 1 --2- 172.21.15.60:0/3246164201 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f32a006be80 0x7f32a006e340 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f32b40d5750 tx=0x7f32b8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.397+0000 7f3b1f7fe640 1 -- 172.21.15.60:0/3955050427 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f3b38107100 con 0x7f3b3004f060 2024-09-12T02:23:22.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.397+0000 7f3b36ffd640 1 --2- 172.21.15.60:0/3955050427 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3b2406bf30 0x7f3b2406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.397+0000 7f3b1f7fe640 1 --2- 172.21.15.60:0/3955050427 >> [v2:172.21.15.105:6800/50951309,v1:172.21.15.105:6801/50951309] conn(0x7f3b240767c0 0x7f3b24078be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.397+0000 7f3b1f7fe640 1 -- 172.21.15.60:0/3955050427 --> [v2:172.21.15.105:6800/50951309,v1:172.21.15.105:6801/50951309] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3b24079290 con 0x7f3b240767c0 2024-09-12T02:23:22.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.397+0000 7f3b1f7fe640 1 -- 172.21.15.60:0/3955050427 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3b381074f0 con 0x7f3b3004f060 2024-09-12T02:23:22.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.398+0000 7f3b367fc640 1 --2- 172.21.15.60:0/3955050427 >> [v2:172.21.15.105:6800/50951309,v1:172.21.15.105:6801/50951309] conn(0x7f3b240767c0 0x7f3b24078be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.398+0000 7f32c20b7640 1 --2- 172.21.15.60:0/3246164201 >> [v2:172.21.15.105:6816/3745331251,v1:172.21.15.105:6817/3745331251] conn(0x7f32a0076720 0x7f32a0078b40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.398+0000 7f3b36ffd640 1 --2- 172.21.15.60:0/3955050427 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3b2406bf30 0x7f3b2406e3f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3b28009560 tx=0x7f3b2802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.398+0000 7f3b367fc640 1 --2- 172.21.15.60:0/3955050427 >> [v2:172.21.15.105:6800/50951309,v1:172.21.15.105:6801/50951309] conn(0x7f3b240767c0 0x7f3b24078be0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.398+0000 7f9a75ffb640 1 -- 172.21.15.60:0/1423893162 <== osd.3 v2:172.21.15.60:6802/3606424156 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9a7804fe50 con 0x7f9a64076790 2024-09-12T02:23:22.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.399+0000 7f32b27fc640 1 -- 172.21.15.60:0/3246164201 <== osd.7 v2:172.21.15.105:6816/3745331251 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f32a00791f0 con 0x7f32a0076720 2024-09-12T02:23:22.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.400+0000 7f3b1f7fe640 1 -- 172.21.15.60:0/3955050427 <== osd.6 v2:172.21.15.105:6800/50951309 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3b24079290 con 0x7f3b240767c0 2024-09-12T02:23:22.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.424+0000 7f4c22d76640 1 -- 172.21.15.60:0/718387424 --> [v2:172.21.15.105:6808/1581641129,v1:172.21.15.105:6809/1581641129] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4c140478c0 con 0x7f4c00076740 2024-09-12T02:23:22.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.426+0000 7ff0c359e640 1 -- 172.21.15.60:0/3373725243 --> [v2:172.21.15.60:6818/1789465659,v1:172.21.15.60:6819/1789465659] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff0c40a5210 con 0x7ff0a40767a0 2024-09-12T02:23:22.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.425+0000 7f4c127fc640 1 -- 172.21.15.60:0/718387424 <== osd.4 v2:172.21.15.105:6808/1581641129 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4c140478c0 con 0x7f4c00076740 2024-09-12T02:23:22.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.426+0000 7f95522d7640 1 -- 172.21.15.60:0/2449201651 --> [v2:172.21.15.105:6824/1392337793,v1:172.21.15.105:6825/1392337793] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f954c0695d0 con 0x7f954c14f8e0 2024-09-12T02:23:22.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.426+0000 7ff0b2ffd640 1 -- 172.21.15.60:0/3373725243 <== osd.0 v2:172.21.15.60:6818/1789465659 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff0c40a5210 con 0x7ff0a40767a0 2024-09-12T02:23:22.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.426+0000 7f4bfffff640 1 -- 172.21.15.60:0/718387424 >> [v2:172.21.15.105:6808/1581641129,v1:172.21.15.105:6809/1581641129] conn(0x7f4c00076740 msgr2=0x7f4c00078b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.426+0000 7f0ba21ea640 1 -- 172.21.15.60:0/3740728043 --> [v2:172.21.15.60:6826/278470077,v1:172.21.15.60:6827/278470077] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0b9c0c2d50 con 0x7f0b88076750 2024-09-12T02:23:22.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.426+0000 7f4bfffff640 1 --2- 172.21.15.60:0/718387424 >> [v2:172.21.15.105:6808/1581641129,v1:172.21.15.105:6809/1581641129] conn(0x7f4c00076740 0x7f4c00078b60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.427+0000 7f4bfffff640 1 -- 172.21.15.60:0/718387424 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4c0006bf30 msgr2=0x7f4c0006e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.427+0000 7f4bfffff640 1 --2- 172.21.15.60:0/718387424 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4c0006bf30 0x7f4c0006e3f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c007fd0 tx=0x7f4c0c009040 comp rx=0 tx=0).stop 2024-09-12T02:23:22.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.427+0000 7f4bfffff640 1 -- 172.21.15.60:0/718387424 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c1400aef0 msgr2=0x7f4c140409b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.427+0000 7f4bfffff640 1 --2- 172.21.15.60:0/718387424 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c1400aef0 0x7f4c140409b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4c18000c00 tx=0x7f4c180046c0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.427+0000 7f4c22575640 1 -- 172.21.15.60:0/718387424 reap_dead start 2024-09-12T02:23:22.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.427+0000 7f9548ff9640 1 -- 172.21.15.60:0/2449201651 <== osd.5 v2:172.21.15.105:6824/1392337793 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f954c0695d0 con 0x7f954c14f8e0 2024-09-12T02:23:22.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.427+0000 7f4bfffff640 1 -- 172.21.15.60:0/718387424 shutdown_connections 2024-09-12T02:23:22.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.427+0000 7f4bfffff640 1 -- 172.21.15.60:0/718387424 >> 172.21.15.60:0/718387424 conn(0x7f4c14047d00 msgr2=0x7f4c140d6af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:22.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.427+0000 7f95522d7640 1 -- 172.21.15.60:0/2449201651 >> [v2:172.21.15.105:6824/1392337793,v1:172.21.15.105:6825/1392337793] conn(0x7f954c14f8e0 msgr2=0x7f954c1ef500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.427+0000 7f95522d7640 1 --2- 172.21.15.60:0/2449201651 >> [v2:172.21.15.105:6824/1392337793,v1:172.21.15.105:6825/1392337793] conn(0x7f954c14f8e0 0x7f954c1ef500 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.427+0000 7f4bfffff640 1 -- 172.21.15.60:0/718387424 shutdown_connections 2024-09-12T02:23:22.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.427+0000 7f4bfffff640 1 -- 172.21.15.60:0/718387424 wait complete. 2024-09-12T02:23:22.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.427+0000 7ff0c359e640 1 -- 172.21.15.60:0/3373725243 >> [v2:172.21.15.60:6818/1789465659,v1:172.21.15.60:6819/1789465659] conn(0x7ff0a40767a0 msgr2=0x7ff0a4078bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.427+0000 7ff0c359e640 1 --2- 172.21.15.60:0/3373725243 >> [v2:172.21.15.60:6818/1789465659,v1:172.21.15.60:6819/1789465659] conn(0x7ff0a40767a0 0x7ff0a4078bc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.427+0000 7f0b99ffb640 1 -- 172.21.15.60:0/3740728043 <== osd.2 v2:172.21.15.60:6826/278470077 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0b9c0c2d50 con 0x7f0b88076750 2024-09-12T02:23:22.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.427+0000 7f95522d7640 1 -- 172.21.15.60:0/2449201651 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f953806beb0 msgr2=0x7f953806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.427+0000 7f95522d7640 1 --2- 172.21.15.60:0/2449201651 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f953806beb0 0x7f953806e370 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f954c1e3bd0 tx=0x7f953c008040 comp rx=0 tx=0).stop 2024-09-12T02:23:22.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.428+0000 7f95522d7640 1 -- 172.21.15.60:0/2449201651 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f954c150480 msgr2=0x7f954c1ecb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.428+0000 7f95522d7640 1 --2- 172.21.15.60:0/2449201651 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f954c150480 0x7f954c1ecb90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f954400b990 tx=0x7f954400be50 comp rx=0 tx=0).stop 2024-09-12T02:23:22.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.428+0000 7f9550874640 1 -- 172.21.15.60:0/2449201651 reap_dead start 2024-09-12T02:23:22.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.428+0000 7ff0c359e640 1 -- 172.21.15.60:0/3373725243 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff0a406bf00 msgr2=0x7ff0a406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.428+0000 7ff0c359e640 1 --2- 172.21.15.60:0/3373725243 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff0a406bf00 0x7ff0a406e3c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff0b4000f60 tx=0x7ff0b4009040 comp rx=0 tx=0).stop 2024-09-12T02:23:22.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.428+0000 7ff0c359e640 1 -- 172.21.15.60:0/3373725243 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0c41669f0 msgr2=0x7ff0c42041f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.428+0000 7ff0c359e640 1 --2- 172.21.15.60:0/3373725243 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0c41669f0 0x7ff0c42041f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff0b800c550 tx=0x7ff0b800ca10 comp rx=0 tx=0).stop 2024-09-12T02:23:22.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.428+0000 7ff0c2d9d640 1 -- 172.21.15.60:0/3373725243 reap_dead start 2024-09-12T02:23:22.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.428+0000 7ff0c359e640 1 -- 172.21.15.60:0/3373725243 shutdown_connections 2024-09-12T02:23:22.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.428+0000 7ff0c359e640 1 -- 172.21.15.60:0/3373725243 >> 172.21.15.60:0/3373725243 conn(0x7ff0c40c7ae0 msgr2=0x7ff0c40a72a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:22.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.428+0000 7fe2d6311640 1 -- 172.21.15.60:0/255789884 --> [v2:172.21.15.60:6810/1109822408,v1:172.21.15.60:6811/1109822408] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe2d00c3920 con 0x7fe2bc076680 2024-09-12T02:23:22.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.428+0000 7f95522d7640 1 -- 172.21.15.60:0/2449201651 shutdown_connections 2024-09-12T02:23:22.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.428+0000 7f95522d7640 1 -- 172.21.15.60:0/2449201651 >> 172.21.15.60:0/2449201651 conn(0x7f954c068030 msgr2=0x7f954c0cb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:22.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.428+0000 7ff0c359e640 1 -- 172.21.15.60:0/3373725243 shutdown_connections 2024-09-12T02:23:22.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.428+0000 7f95522d7640 1 -- 172.21.15.60:0/2449201651 shutdown_connections 2024-09-12T02:23:22.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.428+0000 7f95522d7640 1 -- 172.21.15.60:0/2449201651 wait complete. 2024-09-12T02:23:22.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.428+0000 7ff0c359e640 1 -- 172.21.15.60:0/3373725243 wait complete. 2024-09-12T02:23:22.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.428+0000 7f0ba21ea640 1 -- 172.21.15.60:0/3740728043 >> [v2:172.21.15.60:6826/278470077,v1:172.21.15.60:6827/278470077] conn(0x7f0b88076750 msgr2=0x7f0b88078b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.428+0000 7f0ba21ea640 1 --2- 172.21.15.60:0/3740728043 >> [v2:172.21.15.60:6826/278470077,v1:172.21.15.60:6827/278470077] conn(0x7f0b88076750 0x7f0b88078b70 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.429+0000 7fe2ccff9640 1 -- 172.21.15.60:0/255789884 <== osd.1 v2:172.21.15.60:6810/1109822408 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe2d00c3920 con 0x7fe2bc076680 2024-09-12T02:23:22.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.428+0000 7f0ba21ea640 1 -- 172.21.15.60:0/3740728043 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0b8806bf30 msgr2=0x7f0b8806e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.428+0000 7f0ba21ea640 1 --2- 172.21.15.60:0/3740728043 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0b8806bf30 0x7f0b8806e3f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0b94001560 tx=0x7f0b94009040 comp rx=0 tx=0).stop 2024-09-12T02:23:22.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.429+0000 7f0ba21ea640 1 -- 172.21.15.60:0/3740728043 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b9c0c3290 msgr2=0x7f0b9c14c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.429+0000 7f0ba21ea640 1 --2- 172.21.15.60:0/3740728043 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b9c0c3290 0x7f0b9c14c680 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0b9002a820 tx=0x7f0b900046c0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.429+0000 7f0ba19e9640 1 -- 172.21.15.60:0/3740728043 reap_dead start 2024-09-12T02:23:22.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.429+0000 7f0ba21ea640 1 -- 172.21.15.60:0/3740728043 shutdown_connections 2024-09-12T02:23:22.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.429+0000 7f0ba21ea640 1 -- 172.21.15.60:0/3740728043 >> 172.21.15.60:0/3740728043 conn(0x7f0b9c0c7f00 msgr2=0x7f0b9c153aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:22.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.429+0000 7f0ba21ea640 1 -- 172.21.15.60:0/3740728043 shutdown_connections 2024-09-12T02:23:22.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.429+0000 7f0ba21ea640 1 -- 172.21.15.60:0/3740728043 wait complete. 2024-09-12T02:23:22.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.429+0000 7fe2d6311640 1 -- 172.21.15.60:0/255789884 >> [v2:172.21.15.60:6810/1109822408,v1:172.21.15.60:6811/1109822408] conn(0x7fe2bc076680 msgr2=0x7fe2bc078aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.429+0000 7fe2d6311640 1 --2- 172.21.15.60:0/255789884 >> [v2:172.21.15.60:6810/1109822408,v1:172.21.15.60:6811/1109822408] conn(0x7fe2bc076680 0x7fe2bc078aa0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.429+0000 7fe2d6311640 1 -- 172.21.15.60:0/255789884 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe2bc06be60 msgr2=0x7fe2bc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.429+0000 7fe2d6311640 1 --2- 172.21.15.60:0/255789884 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe2bc06be60 0x7fe2bc06e320 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe2d014ccb0 tx=0x7fe2c0009190 comp rx=0 tx=0).stop 2024-09-12T02:23:22.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.429+0000 7fe2d6311640 1 -- 172.21.15.60:0/255789884 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2b8005320 msgr2=0x7fe2d01dfab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.429+0000 7fe2d6311640 1 --2- 172.21.15.60:0/255789884 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2b8005320 0x7fe2d01dfab0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe2c400c7b0 tx=0x7fe2c400cbb0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.430+0000 7fe2d48ae640 1 -- 172.21.15.60:0/255789884 reap_dead start 2024-09-12T02:23:22.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.430+0000 7fe2d6311640 1 -- 172.21.15.60:0/255789884 shutdown_connections 2024-09-12T02:23:22.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.430+0000 7fe2d6311640 1 -- 172.21.15.60:0/255789884 >> 172.21.15.60:0/255789884 conn(0x7fe2d00c83a0 msgr2=0x7fe2d006e070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:22.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.430+0000 7f329ffff640 1 -- 172.21.15.60:0/3246164201 --> [v2:172.21.15.105:6816/3745331251,v1:172.21.15.105:6817/3745331251] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f32b4007430 con 0x7f32a0076720 2024-09-12T02:23:22.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.430+0000 7fe2d6311640 1 -- 172.21.15.60:0/255789884 shutdown_connections 2024-09-12T02:23:22.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.430+0000 7fe2d6311640 1 -- 172.21.15.60:0/255789884 wait complete. 2024-09-12T02:23:22.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.430+0000 7f32b27fc640 1 -- 172.21.15.60:0/3246164201 <== osd.7 v2:172.21.15.105:6816/3745331251 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f32b4007430 con 0x7f32a0076720 2024-09-12T02:23:22.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.431+0000 7f3b3d331640 1 -- 172.21.15.60:0/3955050427 --> [v2:172.21.15.105:6800/50951309,v1:172.21.15.105:6801/50951309] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3b30007960 con 0x7f3b240767c0 2024-09-12T02:23:22.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.431+0000 7f329ffff640 1 -- 172.21.15.60:0/3246164201 >> [v2:172.21.15.105:6816/3745331251,v1:172.21.15.105:6817/3745331251] conn(0x7f32a0076720 msgr2=0x7f32a0078b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.431+0000 7f329ffff640 1 --2- 172.21.15.60:0/3246164201 >> [v2:172.21.15.105:6816/3745331251,v1:172.21.15.105:6817/3745331251] conn(0x7f32a0076720 0x7f32a0078b40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.431+0000 7f9a87386640 1 -- 172.21.15.60:0/1423893162 --> [v2:172.21.15.60:6802/3606424156,v1:172.21.15.60:6803/3606424156] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9a80074100 con 0x7f9a64076790 2024-09-12T02:23:22.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.432+0000 7f329ffff640 1 -- 172.21.15.60:0/3246164201 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f32a006be80 msgr2=0x7f32a006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.432+0000 7f329ffff640 1 --2- 172.21.15.60:0/3246164201 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f32a006be80 0x7f32a006e340 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f32b40d5750 tx=0x7f32b8008040 comp rx=0 tx=0).stop 2024-09-12T02:23:22.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.432+0000 7f329ffff640 1 -- 172.21.15.60:0/3246164201 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32b4005ff0 msgr2=0x7f32b40d81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.432+0000 7f329ffff640 1 --2- 172.21.15.60:0/3246164201 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32b4005ff0 0x7f32b40d81b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f32bc06a5d0 tx=0x7f32bc0699a0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.432+0000 7f32c20b7640 1 -- 172.21.15.60:0/3246164201 reap_dead start 2024-09-12T02:23:22.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.432+0000 7f3b1f7fe640 1 -- 172.21.15.60:0/3955050427 <== osd.6 v2:172.21.15.105:6800/50951309 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3b30007960 con 0x7f3b240767c0 2024-09-12T02:23:22.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.432+0000 7f329ffff640 1 -- 172.21.15.60:0/3246164201 shutdown_connections 2024-09-12T02:23:22.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.432+0000 7f329ffff640 1 -- 172.21.15.60:0/3246164201 >> 172.21.15.60:0/3246164201 conn(0x7f32b4048150 msgr2=0x7f32b40cf070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:22.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.432+0000 7f9a75ffb640 1 -- 172.21.15.60:0/1423893162 <== osd.3 v2:172.21.15.60:6802/3606424156 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9a80074100 con 0x7f9a64076790 2024-09-12T02:23:22.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.432+0000 7f329ffff640 1 -- 172.21.15.60:0/3246164201 shutdown_connections 2024-09-12T02:23:22.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.433+0000 7f329ffff640 1 -- 172.21.15.60:0/3246164201 wait complete. 2024-09-12T02:23:22.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.433+0000 7f9a87386640 1 -- 172.21.15.60:0/1423893162 >> [v2:172.21.15.60:6802/3606424156,v1:172.21.15.60:6803/3606424156] conn(0x7f9a64076790 msgr2=0x7f9a64078bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.433+0000 7f3b3d331640 1 -- 172.21.15.60:0/3955050427 >> [v2:172.21.15.105:6800/50951309,v1:172.21.15.105:6801/50951309] conn(0x7f3b240767c0 msgr2=0x7f3b24078be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.433+0000 7f3b3d331640 1 --2- 172.21.15.60:0/3955050427 >> [v2:172.21.15.105:6800/50951309,v1:172.21.15.105:6801/50951309] conn(0x7f3b240767c0 0x7f3b24078be0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.433+0000 7f9a87386640 1 --2- 172.21.15.60:0/1423893162 >> [v2:172.21.15.60:6802/3606424156,v1:172.21.15.60:6803/3606424156] conn(0x7f9a64076790 0x7f9a64078bb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.434+0000 7f3b3d331640 1 -- 172.21.15.60:0/3955050427 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3b2406bf30 msgr2=0x7f3b2406e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.434+0000 7f3b3d331640 1 --2- 172.21.15.60:0/3955050427 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3b2406bf30 0x7f3b2406e3f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3b28009560 tx=0x7f3b2802e000 comp rx=0 tx=0).stop 2024-09-12T02:23:22.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.434+0000 7f3b3d331640 1 -- 172.21.15.60:0/3955050427 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b3004f060 msgr2=0x7f3b300dd860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.434+0000 7f3b3d331640 1 --2- 172.21.15.60:0/3955050427 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b3004f060 0x7f3b300dd860 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3b38000b60 tx=0x7f3b380699a0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.434+0000 7f9a87386640 1 -- 172.21.15.60:0/1423893162 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9a6406bf00 msgr2=0x7f9a6406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.434+0000 7f9a87386640 1 --2- 172.21.15.60:0/1423893162 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9a6406bf00 0x7f9a6406e3c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c007fd0 tx=0x7f9a7c007d80 comp rx=0 tx=0).stop 2024-09-12T02:23:22.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.434+0000 7f9a87386640 1 -- 172.21.15.60:0/1423893162 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a80157f80 msgr2=0x7f9a801fbcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.434+0000 7f9a87386640 1 --2- 172.21.15.60:0/1423893162 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a80157f80 0x7f9a801fbcc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9a800ccb60 tx=0x7f9a78004a40 comp rx=0 tx=0).stop 2024-09-12T02:23:22.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.434+0000 7f9a85923640 1 -- 172.21.15.60:0/1423893162 reap_dead start 2024-09-12T02:23:22.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.434+0000 7f9a87386640 1 -- 172.21.15.60:0/1423893162 shutdown_connections 2024-09-12T02:23:22.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.434+0000 7f9a87386640 1 -- 172.21.15.60:0/1423893162 >> 172.21.15.60:0/1423893162 conn(0x7f9a800cbd30 msgr2=0x7f9a80067950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:22.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.435+0000 7f3b377fe640 1 -- 172.21.15.60:0/3955050427 reap_dead start 2024-09-12T02:23:22.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.435+0000 7f9a87386640 1 -- 172.21.15.60:0/1423893162 shutdown_connections 2024-09-12T02:23:22.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.435+0000 7f9a87386640 1 -- 172.21.15.60:0/1423893162 wait complete. 2024-09-12T02:23:22.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.435+0000 7f3b3d331640 1 -- 172.21.15.60:0/3955050427 shutdown_connections 2024-09-12T02:23:22.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.435+0000 7f3b3d331640 1 -- 172.21.15.60:0/3955050427 >> 172.21.15.60:0/3955050427 conn(0x7f3b3004c0b0 msgr2=0x7f3b30005bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:22.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.439+0000 7f3b3d331640 1 -- 172.21.15.60:0/3955050427 shutdown_connections 2024-09-12T02:23:22.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.439+0000 7f3b3d331640 1 -- 172.21.15.60:0/3955050427 wait complete. 2024-09-12T02:23:22.491 INFO:teuthology.orchestra.run.smithi060.stdout:64424509448 2024-09-12T02:23:22.492 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T02:23:22.492 INFO:teuthology.orchestra.run.smithi060.stdout:64424509449 2024-09-12T02:23:22.493 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T02:23:22.493 INFO:teuthology.orchestra.run.smithi060.stdout:68719476746 2024-09-12T02:23:22.494 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T02:23:22.494 INFO:teuthology.orchestra.run.smithi060.stdout:64424509447 2024-09-12T02:23:22.495 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T02:23:22.495 INFO:teuthology.orchestra.run.smithi060.stdout:60129542153 2024-09-12T02:23:22.496 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T02:23:22.496 INFO:teuthology.orchestra.run.smithi060.stdout:68719476745 2024-09-12T02:23:22.497 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T02:23:22.497 INFO:teuthology.orchestra.run.smithi060.stdout:60129542154 2024-09-12T02:23:22.498 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T02:23:22.498 INFO:teuthology.orchestra.run.smithi060.stdout:68719476745 2024-09-12T02:23:22.499 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T02:23:22.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.709+0000 7f09a7cd0640 1 Processor -- start 2024-09-12T02:23:22.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.709+0000 7f7138f49640 1 Processor -- start 2024-09-12T02:23:22.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.709+0000 7f7138f49640 1 -- start start 2024-09-12T02:23:22.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.710+0000 7f09a7cd0640 1 -- start start 2024-09-12T02:23:22.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.710+0000 7fb24d48b640 1 Processor -- start 2024-09-12T02:23:22.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.710+0000 7f7138f49640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f71340c5940 0x7f713415aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.710+0000 7f7138f49640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f713415af60 0x7f7134164fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.710+0000 7f7138f49640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f713415e050 con 0x7f7134157ff0 2024-09-12T02:23:22.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.710+0000 7f7138f49640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f713415e330 con 0x7f71340c5940 2024-09-12T02:23:22.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.710+0000 7fb24d48b640 1 -- start start 2024-09-12T02:23:22.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.710+0000 7f7138f49640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f713415e610 con 0x7f713415af60 2024-09-12T02:23:22.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.711+0000 7f11e247b640 1 Processor -- start 2024-09-12T02:23:22.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.711+0000 7f7132d9d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f713415af60 0x7f7134164fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.711+0000 7f7132d9d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f713415af60 0x7f7134164fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:47076/0 (socket says 172.21.15.60:47076) 2024-09-12T02:23:22.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.711+0000 7f7132d9d640 1 -- 172.21.15.60:0/439733400 learned_addr learned my addr 172.21.15.60:0/439733400 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:22.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.711+0000 7f7131d9b640 1 --2- 172.21.15.60:0/439733400 >> v2:172.21.15.60:3300/0 conn(0x7f71340c5940 0x7f713415aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.711+0000 7f11e247b640 1 -- start start 2024-09-12T02:23:22.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.711+0000 7f09a7cd0640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f09a00acc90 0x7f09a00ad070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.711+0000 7f09a7cd0640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f09a0154ae0 0x7f09a006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.711+0000 7f09a7cd0640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09a00c3570 con 0x7f09a006df20 2024-09-12T02:23:22.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.711+0000 7f09a7cd0640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f09a00c4110 con 0x7f09a0154ae0 2024-09-12T02:23:22.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.711+0000 7f09a7cd0640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f09a0154f70 con 0x7f09a00acc90 2024-09-12T02:23:22.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.711+0000 7fcc4ea77640 1 Processor -- start 2024-09-12T02:23:22.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.712+0000 7f09a526b640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f09a006df20 0x7f09a006cda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:45444/0 (socket says 172.21.15.60:45444) 2024-09-12T02:23:22.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.712+0000 7f09a526b640 1 -- 172.21.15.60:0/754426154 learned_addr learned my addr 172.21.15.60:0/754426154 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:22.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.712+0000 7f342ea8d640 1 Processor -- start 2024-09-12T02:23:22.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.712+0000 7fb24d48b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb2480c2e30 0x7fb248153390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.712+0000 7f09a626d640 1 --2- 172.21.15.60:0/754426154 >> v2:172.21.15.60:3300/0 conn(0x7f09a0154ae0 0x7f09a006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.712+0000 7f7132d9d640 1 -- 172.21.15.60:0/439733400 >> v2:172.21.15.60:3300/0 conn(0x7f71340c5940 msgr2=0x7f713415aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:22.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.712+0000 7f7132d9d640 1 --2- 172.21.15.60:0/439733400 >> v2:172.21.15.60:3300/0 conn(0x7f71340c5940 0x7f713415aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.712+0000 7fb24d48b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb2480c3d60 0x7fb24814fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.712+0000 7f7132d9d640 1 -- 172.21.15.60:0/439733400 >> v1:172.21.15.105:6789/0 conn(0x7f7134157ff0 legacy=0x7f71340c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.712+0000 7f09a5a6c640 1 --2- 172.21.15.60:0/754426154 >> v2:172.21.15.105:3300/0 conn(0x7f09a00acc90 0x7f09a00ad070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.712+0000 7f09a4a6a640 1 -- 172.21.15.60:0/754426154 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1521465483 0 0) 0x7f09a00c3570 con 0x7f09a006df20 2024-09-12T02:23:22.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.712+0000 7f09a4a6a640 1 -- 172.21.15.60:0/754426154 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f098c007930 con 0x7f09a006df20 2024-09-12T02:23:22.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.712+0000 7f7132d9d640 1 -- 172.21.15.60:0/439733400 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f713415e8f0 con 0x7f713415af60 2024-09-12T02:23:22.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.712+0000 7fb24d48b640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2480c37a0 con 0x7fb2480aba60 2024-09-12T02:23:22.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.712+0000 7fb24d48b640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fb2480c3a80 con 0x7fb2480c2e30 2024-09-12T02:23:22.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.712+0000 7fb24d48b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb248155fb0 con 0x7fb2480c3d60 2024-09-12T02:23:22.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.713+0000 7fb246ffd640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fb2480aba60 0x7fb2481567b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:45446/0 (socket says 172.21.15.60:45446) 2024-09-12T02:23:22.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.713+0000 7fb246ffd640 1 -- 172.21.15.60:0/2474634488 learned_addr learned my addr 172.21.15.60:0/2474634488 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:22.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.713+0000 7fb2477fe640 1 --2- 172.21.15.60:0/2474634488 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb2480c3d60 0x7fb24814fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.713+0000 7f7132d9d640 1 --2- 172.21.15.60:0/439733400 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f713415af60 0x7f7134164fc0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7124009870 tx=0x7f712402a140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d60f849551583fc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.713+0000 7f713159a640 1 -- 172.21.15.60:0/439733400 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7124037070 con 0x7f713415af60 2024-09-12T02:23:22.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.712+0000 7fcc4ea77640 1 -- start start 2024-09-12T02:23:22.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.713+0000 7fcc4ea77640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fcc40009050 0x7fcc400de1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.713+0000 7fcc4ea77640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc4000cc80 0x7fcc400de730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.713+0000 7fcc4ea77640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc400e1760 con 0x7fcc400dbb70 2024-09-12T02:23:22.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.713+0000 7fcc4ea77640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fcc4000c8e0 con 0x7fcc40009050 2024-09-12T02:23:22.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.713+0000 7fcc4ea77640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcc4000d390 con 0x7fcc4000cc80 2024-09-12T02:23:22.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.712+0000 7f11e247b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11dc155080 0x7f11dc0a6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.713+0000 7f11e247b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f11dc0c2d50 0x7f11dc0c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.713+0000 7f11e247b640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11dc0c2380 con 0x7f11dc0c5860 2024-09-12T02:23:22.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.713+0000 7f11e247b640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f11dc0ab420 con 0x7f11dc0c2d50 2024-09-12T02:23:22.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.713+0000 7f11e247b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f11dc0ab9e0 con 0x7f11dc155080 2024-09-12T02:23:22.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.713+0000 7f11e1c7a640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f11dc0c5860 0x7f11dc0c5d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53926/0 (socket says 172.21.15.60:53926) 2024-09-12T02:23:22.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.713+0000 7f11e1c7a640 1 -- 172.21.15.60:0/125593425 learned_addr learned my addr 172.21.15.60:0/125593425 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:22.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.713+0000 7f11e1479640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11dc155080 0x7f11dc0a6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.713+0000 7f11e0c78640 1 --2- 172.21.15.60:0/125593425 >> v2:172.21.15.60:3300/0 conn(0x7f11dc0c2d50 0x7f11dc0c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.712+0000 7f09a4a6a640 1 -- 172.21.15.60:0/754426154 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4119591015 0 0) 0x7f098c007930 con 0x7f09a006df20 2024-09-12T02:23:22.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.712+0000 7f09a4a6a640 1 -- 172.21.15.60:0/754426154 >> v2:172.21.15.105:3300/0 conn(0x7f09a00acc90 msgr2=0x7f09a00ad070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:22.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.712+0000 7f09a4a6a640 1 --2- 172.21.15.60:0/754426154 >> v2:172.21.15.105:3300/0 conn(0x7f09a00acc90 0x7f09a00ad070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.712+0000 7f09a4a6a640 1 -- 172.21.15.60:0/754426154 >> v2:172.21.15.60:3300/0 conn(0x7f09a0154ae0 msgr2=0x7f09a006d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:22.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.712+0000 7f09a4a6a640 1 --2- 172.21.15.60:0/754426154 >> v2:172.21.15.60:3300/0 conn(0x7f09a0154ae0 0x7f09a006d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.712+0000 7f09a4a6a640 1 -- 172.21.15.60:0/754426154 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09a00c37e0 con 0x7f09a006df20 2024-09-12T02:23:22.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.712+0000 7f09a4a6a640 1 -- 172.21.15.60:0/754426154 <== mon.1 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7f09980019f0 con 0x7f09a006df20 2024-09-12T02:23:22.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.713+0000 7f09a4a6a640 1 -- 172.21.15.60:0/754426154 >> v1:172.21.15.105:6789/0 conn(0x7f09a006df20 legacy=0x7f09a006cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.713+0000 7f09a4a6a640 1 --2- 172.21.15.60:0/754426154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f098c007dc0 0x7f098c0081e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.713+0000 7f09a4a6a640 1 --2- 172.21.15.60:0/754426154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f098c008c10 0x7f098c009090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.713+0000 7f09a4a6a640 1 --2- 172.21.15.60:0/754426154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f098c007460 0x7f098c0095d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.713+0000 7f09a4a6a640 1 -- 172.21.15.60:0/754426154 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f09a0154f70 con 0x7f098c007460 2024-09-12T02:23:22.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.713+0000 7f09a4a6a640 1 -- 172.21.15.60:0/754426154 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f098c014700 con 0x7f098c008c10 2024-09-12T02:23:22.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.713+0000 7f09a4a6a640 1 -- 172.21.15.60:0/754426154 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f098c014900 con 0x7f098c007dc0 2024-09-12T02:23:22.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.713+0000 7f09a626d640 1 --2- 172.21.15.60:0/754426154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f098c007460 0x7f098c0095d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.713+0000 7f09a5a6c640 1 --2- 172.21.15.60:0/754426154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f098c007dc0 0x7f098c0081e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.713+0000 7f09a526b640 1 --2- 172.21.15.60:0/754426154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f098c008c10 0x7f098c009090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.712+0000 7f342ea8d640 1 -- start start 2024-09-12T02:23:22.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.713+0000 7efc7a01e640 1 Processor -- start 2024-09-12T02:23:22.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.714+0000 7f713159a640 1 -- 172.21.15.60:0/439733400 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7124032440 con 0x7f713415af60 2024-09-12T02:23:22.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.714+0000 7f09a5a6c640 1 -- 172.21.15.60:0/754426154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f098c008c10 msgr2=0x7f098c009090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:22.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.714+0000 7f713159a640 1 -- 172.21.15.60:0/439733400 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7124032810 con 0x7f713415af60 2024-09-12T02:23:22.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.714+0000 7f342ea8d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f34280ac0e0 0x7f3428157630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.714+0000 7f342ea8d640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f34280adc70 0x7f3428157b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.714+0000 7fb23ffff640 1 --2- 172.21.15.60:0/2474634488 >> v2:172.21.15.60:3300/0 conn(0x7fb2480c2e30 0x7fb248153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.714+0000 7f11d3fff640 1 -- 172.21.15.60:0/125593425 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1430032744 0 0) 0x7f11dc0c2380 con 0x7f11dc0c5860 2024-09-12T02:23:22.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.714+0000 7f342ea8d640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34280c4f40 con 0x7f34280ab460 2024-09-12T02:23:22.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.714+0000 7f342ea8d640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f342815a4a0 con 0x7f34280ac0e0 2024-09-12T02:23:22.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.714+0000 7f342ea8d640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f342815a760 con 0x7f34280adc70 2024-09-12T02:23:22.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.714+0000 7f09a5a6c640 1 --2- 172.21.15.60:0/754426154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f098c008c10 0x7f098c009090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.714+0000 7f09a5a6c640 1 -- 172.21.15.60:0/754426154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f098c007460 msgr2=0x7f098c0095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:22.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.714+0000 7f09a5a6c640 1 --2- 172.21.15.60:0/754426154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f098c007460 0x7f098c0095d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.714+0000 7f09a5a6c640 1 -- 172.21.15.60:0/754426154 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09a00c37e0 con 0x7f098c007dc0 2024-09-12T02:23:22.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.714+0000 7f09a626d640 1 --2- 172.21.15.60:0/754426154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f098c007460 0x7f098c0095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:23:22.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.714+0000 7f09a626d640 1 -- 172.21.15.60:0/754426154 reap_dead start 2024-09-12T02:23:22.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.713+0000 7fcc4c813640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fcc400dbb70 0x7fcc40040460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:45454/0 (socket says 172.21.15.60:45454) 2024-09-12T02:23:22.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.713+0000 7fcc4c813640 1 -- 172.21.15.60:0/326299760 learned_addr learned my addr 172.21.15.60:0/326299760 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:22.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.714+0000 7fcc477fe640 1 -- 172.21.15.60:0/326299760 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3617507636 0 0) 0x7fcc400e1760 con 0x7fcc400dbb70 2024-09-12T02:23:22.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.714+0000 7f11e0c78640 1 -- 172.21.15.60:0/125593425 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11dc155080 msgr2=0x7f11dc0a6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:22.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.714+0000 7f11e0c78640 1 --2- 172.21.15.60:0/125593425 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11dc155080 0x7f11dc0a6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.714+0000 7f11e0c78640 1 -- 172.21.15.60:0/125593425 >> v1:172.21.15.60:6789/0 conn(0x7f11dc0c5860 legacy=0x7f11dc0c5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.714+0000 7f11e0c78640 1 -- 172.21.15.60:0/125593425 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11dc0c2620 con 0x7f11dc0c2d50 2024-09-12T02:23:22.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.714+0000 7fcc477fe640 1 -- 172.21.15.60:0/326299760 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc38003520 con 0x7fcc400dbb70 2024-09-12T02:23:22.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.714+0000 7fcc4d014640 1 --2- 172.21.15.60:0/326299760 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc4000cc80 0x7fcc400de730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.713+0000 7efc7a01e640 1 -- start start 2024-09-12T02:23:22.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.714+0000 7f342d02a640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f34280adc70 0x7f3428157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.714+0000 7f342d02a640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f34280adc70 0x7f3428157b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:46458/0 (socket says 172.21.15.60:46458) 2024-09-12T02:23:22.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.714+0000 7f342d02a640 1 -- 172.21.15.60:0/1580598255 learned_addr learned my addr 172.21.15.60:0/1580598255 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:22.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.715+0000 7efc7a01e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efc74157e60 0x7efc740c38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.715+0000 7f7138f49640 1 -- 172.21.15.60:0/439733400 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f713415af60 msgr2=0x7f7134164fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.715+0000 7f7138f49640 1 --2- 172.21.15.60:0/439733400 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f713415af60 0x7f7134164fc0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7124009870 tx=0x7f712402a140 comp rx=0 tx=0).stop 2024-09-12T02:23:22.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.714+0000 7fb23ffff640 1 -- 172.21.15.60:0/2474634488 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb2480c3d60 msgr2=0x7fb24814fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:22.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.714+0000 7fb23ffff640 1 --2- 172.21.15.60:0/2474634488 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb2480c3d60 0x7fb24814fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.714+0000 7fb23ffff640 1 -- 172.21.15.60:0/2474634488 >> v1:172.21.15.105:6789/0 conn(0x7fb2480aba60 legacy=0x7fb2481567b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:22.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.714+0000 7fb23ffff640 1 -- 172.21.15.60:0/2474634488 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb248156290 con 0x7fb2480c2e30 2024-09-12T02:23:22.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.715+0000 7fcc47fff640 1 --2- 172.21.15.60:0/326299760 >> v2:172.21.15.105:3300/0 conn(0x7fcc40009050 0x7fcc400de1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.715+0000 7fcc4d014640 1 -- 172.21.15.60:0/326299760 >> v2:172.21.15.105:3300/0 conn(0x7fcc40009050 msgr2=0x7fcc400de1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:22.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.715+0000 7efc7901c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efc74157e60 0x7efc740c38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.715+0000 7fcc4d014640 1 --2- 172.21.15.60:0/326299760 >> v2:172.21.15.105:3300/0 conn(0x7fcc40009050 0x7fcc400de1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.715+0000 7fcc4d014640 1 -- 172.21.15.60:0/326299760 >> v1:172.21.15.105:6789/0 conn(0x7fcc400dbb70 legacy=0x7fcc40040460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.715+0000 7f342d02a640 1 -- 172.21.15.60:0/1580598255 >> v2:172.21.15.60:3300/0 conn(0x7f34280ac0e0 msgr2=0x7f3428157630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:22.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.715+0000 7f342d02a640 1 --2- 172.21.15.60:0/1580598255 >> v2:172.21.15.60:3300/0 conn(0x7f34280ac0e0 0x7f3428157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.715+0000 7f342d02a640 1 -- 172.21.15.60:0/1580598255 >> v1:172.21.15.105:6789/0 conn(0x7f34280ab460 legacy=0x7f342815dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:22.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.715+0000 7f342d02a640 1 -- 172.21.15.60:0/1580598255 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f342815aa40 con 0x7f34280adc70 2024-09-12T02:23:22.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.715+0000 7fcc4d014640 1 -- 172.21.15.60:0/326299760 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc4000d5e0 con 0x7fcc4000cc80 2024-09-12T02:23:22.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.715+0000 7fcc477fe640 1 -- 172.21.15.60:0/326299760 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 212392779 0 0) 0x7fcc38003520 con 0x7fcc400dbb70 2024-09-12T02:23:22.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.715+0000 7f09a5a6c640 1 --2- 172.21.15.60:0/754426154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f098c007dc0 0x7f098c0081e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0990009ac0 tx=0x7f098c009c40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d680d7b5efaca13 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.715+0000 7f7138f49640 1 -- 172.21.15.60:0/439733400 shutdown_connections 2024-09-12T02:23:22.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.715+0000 7f7138f49640 1 --2- 172.21.15.60:0/439733400 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f713415af60 0x7f7134164fc0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.715+0000 7f7138f49640 1 --2- 172.21.15.60:0/439733400 >> v2:172.21.15.60:3300/0 conn(0x7f71340c5940 0x7f713415aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.715+0000 7f7138f49640 1 -- 172.21.15.60:0/439733400 >> 172.21.15.60:0/439733400 conn(0x7f71340c7a40 msgr2=0x7f71340c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:22.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.715+0000 7f09a4a6a640 1 -- 172.21.15.60:0/754426154 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0990036070 con 0x7f098c007dc0 2024-09-12T02:23:22.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.715+0000 7f09a4a6a640 1 -- 172.21.15.60:0/754426154 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0990031400 con 0x7f098c007dc0 2024-09-12T02:23:22.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.715+0000 7f09a4a6a640 1 -- 172.21.15.60:0/754426154 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0990009690 con 0x7f098c007dc0 2024-09-12T02:23:22.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.715+0000 7efc7901c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efc74157e60 0x7efc740c38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49806/0 (socket says 172.21.15.60:49806) 2024-09-12T02:23:22.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.715+0000 7efc7a01e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7efc740c3e20 0x7efc740c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.715+0000 7efc7901c640 1 -- 172.21.15.60:0/4150824438 learned_addr learned my addr 172.21.15.60:0/4150824438 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:22.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.715+0000 7efc7a01e640 1 --2- 172.21.15.60:0/4150824438 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efc740c2890 0x7efc740c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.715+0000 7efc7a01e640 1 -- 172.21.15.60:0/4150824438 --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7efc740a5ed0 con 0x7efc74157e60 2024-09-12T02:23:22.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.715+0000 7efc7a01e640 1 -- 172.21.15.60:0/4150824438 --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7efc740a5ba0 con 0x7efc740c3e20 2024-09-12T02:23:22.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.715+0000 7efc7a01e640 1 -- 172.21.15.60:0/4150824438 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efc74158240 con 0x7efc740c2890 2024-09-12T02:23:22.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.715+0000 7efc7881b640 1 --2- 172.21.15.60:0/4150824438 >> v2:172.21.15.105:3300/0 conn(0x7efc740c3e20 0x7efc740c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.715+0000 7efc7981d640 1 --2- 172.21.15.60:0/4150824438 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efc740c2890 0x7efc740c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.715+0000 7efc7901c640 1 -- 172.21.15.60:0/4150824438 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efc740c2890 msgr2=0x7efc740c5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:22.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.715+0000 7efc7901c640 1 --2- 172.21.15.60:0/4150824438 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efc740c2890 0x7efc740c5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.715+0000 7efc7901c640 1 -- 172.21.15.60:0/4150824438 >> v2:172.21.15.105:3300/0 conn(0x7efc740c3e20 msgr2=0x7efc740c58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:22.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.715+0000 7efc7901c640 1 --2- 172.21.15.60:0/4150824438 >> v2:172.21.15.105:3300/0 conn(0x7efc740c3e20 0x7efc740c58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.715+0000 7efc7901c640 1 -- 172.21.15.60:0/4150824438 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc740a6360 con 0x7efc74157e60 2024-09-12T02:23:22.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.716+0000 7f7138f49640 1 -- 172.21.15.60:0/439733400 shutdown_connections 2024-09-12T02:23:22.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.716+0000 7fcc4d014640 1 --2- 172.21.15.60:0/326299760 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc4000cc80 0x7fcc400de730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcc480504d0 tx=0x7fcc480a6b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d471551de7545f13 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.716+0000 7f342d02a640 1 --2- 172.21.15.60:0/1580598255 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34280adc70 0x7f3428157b70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3428068ac0 tx=0x7f342002a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73c00b173b31fa45 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.716+0000 7f7138f49640 1 -- 172.21.15.60:0/439733400 wait complete. 2024-09-12T02:23:22.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.716+0000 7fcc477fe640 1 -- 172.21.15.60:0/326299760 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc34001670 con 0x7fcc4000cc80 2024-09-12T02:23:22.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.716+0000 7f34277fe640 1 -- 172.21.15.60:0/1580598255 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3420036070 con 0x7f34280adc70 2024-09-12T02:23:22.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.716+0000 7fb23ffff640 1 --2- 172.21.15.60:0/2474634488 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2480c2e30 0x7fb248153390 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb2480ab280 tx=0x7fb230029fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0cdd414cf087d8f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.716+0000 7f34277fe640 1 -- 172.21.15.60:0/1580598255 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3420031600 con 0x7f34280adc70 2024-09-12T02:23:22.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.716+0000 7f34277fe640 1 -- 172.21.15.60:0/1580598255 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34200319d0 con 0x7f34280adc70 2024-09-12T02:23:22.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.716+0000 7f11e0c78640 1 --2- 172.21.15.60:0/125593425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11dc0c2d50 0x7f11dc0c3170 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f11cc0087d0 tx=0x7f11cc02c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56c590132dd6ffbe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.716+0000 7fb2467fc640 1 -- 172.21.15.60:0/2474634488 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb230037070 con 0x7fb2480c2e30 2024-09-12T02:23:22.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.716+0000 7fb2467fc640 1 -- 172.21.15.60:0/2474634488 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb23002acf0 con 0x7fb2480c2e30 2024-09-12T02:23:22.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.716+0000 7fb2467fc640 1 -- 172.21.15.60:0/2474634488 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb230032660 con 0x7fb2480c2e30 2024-09-12T02:23:22.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.717+0000 7f11d3fff640 1 -- 172.21.15.60:0/125593425 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11cc03a070 con 0x7f11dc0c2d50 2024-09-12T02:23:22.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.716+0000 7f09a7cd0640 1 -- 172.21.15.60:0/754426154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f098c007dc0 msgr2=0x7f098c0081e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.716+0000 7f09a7cd0640 1 --2- 172.21.15.60:0/754426154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f098c007dc0 0x7f098c0081e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0990009ac0 tx=0x7f098c009c40 comp rx=0 tx=0).stop 2024-09-12T02:23:22.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.717+0000 7f11d3fff640 1 -- 172.21.15.60:0/125593425 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11cc032480 con 0x7f11dc0c2d50 2024-09-12T02:23:22.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.717+0000 7f11d3fff640 1 -- 172.21.15.60:0/125593425 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11cc032850 con 0x7f11dc0c2d50 2024-09-12T02:23:22.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.717+0000 7f09a7cd0640 1 -- 172.21.15.60:0/754426154 shutdown_connections 2024-09-12T02:23:22.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.717+0000 7f09a7cd0640 1 --2- 172.21.15.60:0/754426154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f098c007dc0 0x7f098c0081e0 secure :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0990009ac0 tx=0x7f098c009c40 comp rx=0 tx=0).stop 2024-09-12T02:23:22.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.717+0000 7f09a7cd0640 1 -- 172.21.15.60:0/754426154 >> 172.21.15.60:0/754426154 conn(0x7f09a00a9680 msgr2=0x7f09a00a9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:22.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.717+0000 7f09a7cd0640 1 -- 172.21.15.60:0/754426154 shutdown_connections 2024-09-12T02:23:22.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.717+0000 7efc7901c640 1 --2- 172.21.15.60:0/4150824438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc74157e60 0x7efc740c38e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efc740a6a10 tx=0x7efc7002a0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91981a15eb532d3f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.717+0000 7f342ea8d640 1 -- 172.21.15.60:0/1580598255 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34280adc70 msgr2=0x7f3428157b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.717+0000 7f342ea8d640 1 --2- 172.21.15.60:0/1580598255 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34280adc70 0x7f3428157b70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3428068ac0 tx=0x7f342002a6f0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.717+0000 7efc67fff640 1 -- 172.21.15.60:0/4150824438 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc70037070 con 0x7efc74157e60 2024-09-12T02:23:22.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.717+0000 7efc67fff640 1 -- 172.21.15.60:0/4150824438 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc7002ae10 con 0x7efc74157e60 2024-09-12T02:23:22.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.717+0000 7f342ea8d640 1 -- 172.21.15.60:0/1580598255 shutdown_connections 2024-09-12T02:23:22.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.717+0000 7f342ea8d640 1 --2- 172.21.15.60:0/1580598255 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34280adc70 0x7f3428157b70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.717+0000 7f342ea8d640 1 --2- 172.21.15.60:0/1580598255 >> v2:172.21.15.60:3300/0 conn(0x7f34280ac0e0 0x7f3428157630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.717+0000 7f342ea8d640 1 -- 172.21.15.60:0/1580598255 >> 172.21.15.60:0/1580598255 conn(0x7f3428067f80 msgr2=0x7f342806dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:22.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.717+0000 7efc67fff640 1 -- 172.21.15.60:0/4150824438 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc70032660 con 0x7efc74157e60 2024-09-12T02:23:22.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.717+0000 7fb24d48b640 1 -- 172.21.15.60:0/2474634488 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2480c2e30 msgr2=0x7fb248153390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.717+0000 7fb24d48b640 1 --2- 172.21.15.60:0/2474634488 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2480c2e30 0x7fb248153390 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb2480ab280 tx=0x7fb230029fe0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.718+0000 7f11e247b640 1 -- 172.21.15.60:0/125593425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11dc0c2d50 msgr2=0x7f11dc0c3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.717+0000 7f342ea8d640 1 -- 172.21.15.60:0/1580598255 shutdown_connections 2024-09-12T02:23:22.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.717+0000 7f342ea8d640 1 -- 172.21.15.60:0/1580598255 wait complete. 2024-09-12T02:23:22.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.718+0000 7f11e247b640 1 --2- 172.21.15.60:0/125593425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11dc0c2d50 0x7f11dc0c3170 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f11cc0087d0 tx=0x7f11cc02c740 comp rx=0 tx=0).stop 2024-09-12T02:23:22.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.717+0000 7fcc477fe640 1 -- 172.21.15.60:0/326299760 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc480aa6e0 con 0x7fcc4000cc80 2024-09-12T02:23:22.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.718+0000 7fcc477fe640 1 -- 172.21.15.60:0/326299760 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc480aaad0 con 0x7fcc4000cc80 2024-09-12T02:23:22.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.718+0000 7f11e247b640 1 -- 172.21.15.60:0/125593425 shutdown_connections 2024-09-12T02:23:22.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.718+0000 7f11e247b640 1 --2- 172.21.15.60:0/125593425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11dc0c2d50 0x7f11dc0c3170 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.718+0000 7fb24d48b640 1 -- 172.21.15.60:0/2474634488 shutdown_connections 2024-09-12T02:23:22.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.718+0000 7fb24d48b640 1 --2- 172.21.15.60:0/2474634488 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb2480c3d60 0x7fb24814fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.718+0000 7fb24d48b640 1 --2- 172.21.15.60:0/2474634488 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2480c2e30 0x7fb248153390 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.718+0000 7fb24d48b640 1 -- 172.21.15.60:0/2474634488 >> 172.21.15.60:0/2474634488 conn(0x7fb2480c8430 msgr2=0x7fb2480c8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:22.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.718+0000 7f11e247b640 1 --2- 172.21.15.60:0/125593425 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11dc155080 0x7f11dc0a6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.717+0000 7f09a7cd0640 1 -- 172.21.15.60:0/754426154 wait complete. 2024-09-12T02:23:22.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.718+0000 7f11e247b640 1 -- 172.21.15.60:0/125593425 >> 172.21.15.60:0/125593425 conn(0x7f11dc0c7f00 msgr2=0x7f11dc0a9680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:22.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.718+0000 7fb24d48b640 1 -- 172.21.15.60:0/2474634488 shutdown_connections 2024-09-12T02:23:22.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.718+0000 7fb24d48b640 1 -- 172.21.15.60:0/2474634488 wait complete. 2024-09-12T02:23:22.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.718+0000 7efc7a01e640 1 -- 172.21.15.60:0/4150824438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc74157e60 msgr2=0x7efc740c38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.718+0000 7efc7a01e640 1 --2- 172.21.15.60:0/4150824438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc74157e60 0x7efc740c38e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efc740a6a10 tx=0x7efc7002a0c0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.718+0000 7f7138f49640 1 Processor -- start 2024-09-12T02:23:22.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.718+0000 7f11e247b640 1 -- 172.21.15.60:0/125593425 shutdown_connections 2024-09-12T02:23:22.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.718+0000 7efc7a01e640 1 -- 172.21.15.60:0/4150824438 shutdown_connections 2024-09-12T02:23:22.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.718+0000 7efc7a01e640 1 --2- 172.21.15.60:0/4150824438 >> v2:172.21.15.105:3300/0 conn(0x7efc740c3e20 0x7efc740c58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.718+0000 7efc7a01e640 1 --2- 172.21.15.60:0/4150824438 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efc740c2890 0x7efc740c5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.718+0000 7efc7a01e640 1 --2- 172.21.15.60:0/4150824438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc74157e60 0x7efc740c38e0 secure :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efc740a6a10 tx=0x7efc7002a0c0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.718+0000 7efc7a01e640 1 -- 172.21.15.60:0/4150824438 >> 172.21.15.60:0/4150824438 conn(0x7efc740a9780 msgr2=0x7efc740a9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:22.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.718+0000 7fcc4ea77640 1 -- 172.21.15.60:0/326299760 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc4000cc80 msgr2=0x7fcc400de730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.718+0000 7fcc4ea77640 1 --2- 172.21.15.60:0/326299760 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc4000cc80 0x7fcc400de730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcc480504d0 tx=0x7fcc480a6b20 comp rx=0 tx=0).stop 2024-09-12T02:23:22.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.718+0000 7fcc4ea77640 1 -- 172.21.15.60:0/326299760 shutdown_connections 2024-09-12T02:23:22.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.718+0000 7fcc4ea77640 1 --2- 172.21.15.60:0/326299760 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc4000cc80 0x7fcc400de730 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.718+0000 7fcc4ea77640 1 --2- 172.21.15.60:0/326299760 >> v2:172.21.15.105:3300/0 conn(0x7fcc40009050 0x7fcc400de1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.718+0000 7fcc4ea77640 1 -- 172.21.15.60:0/326299760 >> 172.21.15.60:0/326299760 conn(0x7fcc4002f040 msgr2=0x7fcc4002f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:22.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.719+0000 7f09a7cd0640 1 Processor -- start 2024-09-12T02:23:22.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.719+0000 7f09a7cd0640 1 -- start start 2024-09-12T02:23:22.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.719+0000 7efc7a01e640 1 -- 172.21.15.60:0/4150824438 shutdown_connections 2024-09-12T02:23:22.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.719+0000 7f11e247b640 1 -- 172.21.15.60:0/125593425 wait complete. 2024-09-12T02:23:22.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.719+0000 7f342ea8d640 1 Processor -- start 2024-09-12T02:23:22.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.719+0000 7f342ea8d640 1 -- start start 2024-09-12T02:23:22.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.719+0000 7efc7a01e640 1 -- 172.21.15.60:0/4150824438 wait complete. 2024-09-12T02:23:22.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.719+0000 7f7138f49640 1 -- start start 2024-09-12T02:23:22.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.720+0000 7f09a7cd0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f09a00abd20 0x7f09a01e8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.720+0000 7f09a7cd0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09a014d8f0 0x7f09a01e85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.720+0000 7f7138f49640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f71340c5940 0x7f71340a7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.720+0000 7f09a7cd0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09a01e8ae0 0x7f09a014c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.720+0000 7f09a7cd0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f09a0151c10 con 0x7f09a01e8ae0 2024-09-12T02:23:22.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.720+0000 7f09a7cd0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f09a00c3da0 con 0x7f09a014d8f0 2024-09-12T02:23:22.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.720+0000 7fb24d48b640 1 Processor -- start 2024-09-12T02:23:22.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.720+0000 7f7138f49640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7134157ff0 0x7f71341f3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.720+0000 7f09a7cd0640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f09a00c73f0 con 0x7f09a00abd20 2024-09-12T02:23:22.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.720+0000 7f09a626d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09a01e8ae0 0x7f09a014c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.720+0000 7f713259c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f71340c5940 0x7f71340a7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.720+0000 7f713259c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f71340c5940 0x7f71340a7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:47118/0 (socket says 172.21.15.60:47118) 2024-09-12T02:23:22.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.720+0000 7f09a626d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09a01e8ae0 0x7f09a014c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49816/0 (socket says 172.21.15.60:49816) 2024-09-12T02:23:22.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.720+0000 7f09a626d640 1 -- 172.21.15.60:0/3504473894 learned_addr learned my addr 172.21.15.60:0/3504473894 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:22.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.720+0000 7f09a5a6c640 1 --2- 172.21.15.60:0/3504473894 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f09a00abd20 0x7f09a01e8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.720+0000 7f713259c640 1 -- 172.21.15.60:0/1736117947 learned_addr learned my addr 172.21.15.60:0/1736117947 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:22.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.720+0000 7f7131d9b640 1 --2- 172.21.15.60:0/1736117947 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7134157ff0 0x7f71341f3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.720+0000 7efc7a01e640 1 Processor -- start 2024-09-12T02:23:22.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.721+0000 7f11e247b640 1 Processor -- start 2024-09-12T02:23:22.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.721+0000 7f7138f49640 1 --2- 172.21.15.60:0/1736117947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f713415af60 0x7f713415ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.721+0000 7f7138f49640 1 -- 172.21.15.60:0/1736117947 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f713415ddb0 con 0x7f7134157ff0 2024-09-12T02:23:22.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.721+0000 7f09a626d640 1 -- 172.21.15.60:0/3504473894 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f09a00abd20 msgr2=0x7f09a01e8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.721+0000 7f09a626d640 1 --2- 172.21.15.60:0/3504473894 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f09a00abd20 0x7f09a01e8060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.721+0000 7f09a626d640 1 -- 172.21.15.60:0/3504473894 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09a014d8f0 msgr2=0x7f09a01e85a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:23:22.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.721+0000 7f09a626d640 1 --2- 172.21.15.60:0/3504473894 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09a014d8f0 0x7f09a01e85a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.721+0000 7f09a626d640 1 -- 172.21.15.60:0/3504473894 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09a0147e10 con 0x7f09a01e8ae0 2024-09-12T02:23:22.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.721+0000 7f342ea8d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34280ab460 0x7f342814f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.721+0000 7f7132d9d640 1 --2- 172.21.15.60:0/1736117947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f713415af60 0x7f713415ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.721+0000 7f7138f49640 1 -- 172.21.15.60:0/1736117947 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f713415dc30 con 0x7f713415af60 2024-09-12T02:23:22.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.721+0000 7f7138f49640 1 -- 172.21.15.60:0/1736117947 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f713406f250 con 0x7f71340c5940 2024-09-12T02:23:22.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.721+0000 7f09a626d640 1 --2- 172.21.15.60:0/3504473894 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09a01e8ae0 0x7f09a014c0f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f09a0074a90 tx=0x7f099c011e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.720+0000 7fcc98a45640 1 Processor -- start 2024-09-12T02:23:22.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.720+0000 7fcc98a45640 1 -- start start 2024-09-12T02:23:22.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.721+0000 7f342ea8d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34280ac0e0 0x7f34281e4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.721+0000 7f342c829640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34280ab460 0x7f342814f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.721+0000 7f09967fc640 1 -- 172.21.15.60:0/3504473894 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099c009670 con 0x7f09a01e8ae0 2024-09-12T02:23:22.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.721+0000 7f09967fc640 1 -- 172.21.15.60:0/3504473894 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f099c01b070 con 0x7f09a01e8ae0 2024-09-12T02:23:22.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.721+0000 7f09967fc640 1 -- 172.21.15.60:0/3504473894 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099c004480 con 0x7f09a01e8ae0 2024-09-12T02:23:22.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.721+0000 7f09a7cd0640 1 -- 172.21.15.60:0/3504473894 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09a01553c0 con 0x7f09a01e8ae0 2024-09-12T02:23:22.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7f342c829640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34280ab460 0x7f342814f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:47138/0 (socket says 172.21.15.60:47138) 2024-09-12T02:23:22.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.720+0000 7fb24d48b640 1 -- start start 2024-09-12T02:23:22.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.721+0000 7fb24d48b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2480aba60 0x7fb248154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.721+0000 7fb24d48b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb2480c2e30 0x7fb248149bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.721+0000 7fcc98a45640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc9406edd0 0x7fcc941562d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.721+0000 7fcc98a45640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcc9414f820 0x7fcc9414fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.721+0000 7fcc98a45640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc940c53f0 con 0x7fcc940c7230 2024-09-12T02:23:22.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7fcc98a45640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fcc941532d0 con 0x7fcc9414f820 2024-09-12T02:23:22.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7fcc98a45640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcc940c2d60 con 0x7fcc9406edd0 2024-09-12T02:23:22.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7f7131d9b640 1 -- 172.21.15.60:0/1736117947 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f71340c5940 msgr2=0x7f71340a7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7f7131d9b640 1 --2- 172.21.15.60:0/1736117947 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f71340c5940 0x7f71340a7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7f7131d9b640 1 -- 172.21.15.60:0/1736117947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f713415af60 msgr2=0x7f713415ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7f7131d9b640 1 --2- 172.21.15.60:0/1736117947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f713415af60 0x7f713415ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7f09a7cd0640 1 -- 172.21.15.60:0/3504473894 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09a01ebe60 con 0x7f09a01e8ae0 2024-09-12T02:23:22.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.721+0000 7efc7a01e640 1 -- start start 2024-09-12T02:23:22.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7efc7a01e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efc740c2890 0x7efc740ad650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7f7131d9b640 1 -- 172.21.15.60:0/1736117947 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71340a7dd0 con 0x7f7134157ff0 2024-09-12T02:23:22.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7fcc9259c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc9406edd0 0x7fcc941562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7fb24d48b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2480c3d60 0x7fb24814a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7fb246ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2480aba60 0x7fb248154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.721+0000 7f11e247b640 1 -- start start 2024-09-12T02:23:22.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7efc7a01e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc740c3e20 0x7efc741534c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7f11e247b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11dc0c2d50 0x7f11dc14e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7fcc9259c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc9406edd0 0x7fcc941562d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:47148/0 (socket says 172.21.15.60:47148) 2024-09-12T02:23:22.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7fcc9259c640 1 -- 172.21.15.60:0/531706835 learned_addr learned my addr 172.21.15.60:0/531706835 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:22.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7fb246ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2480aba60 0x7fb248154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49838/0 (socket says 172.21.15.60:49838) 2024-09-12T02:23:22.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7fb23ffff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb2480c2e30 0x7fb248149bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7fb23ffff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb2480c2e30 0x7fb248149bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:47154/0 (socket says 172.21.15.60:47154) 2024-09-12T02:23:22.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7efc7a01e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc7414feb0 0x7efc7414ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7f11e247b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11dc0c5860 0x7f11dc152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7f11e247b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11dc155080 0x7f11dc14cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7fb246ffd640 1 -- 172.21.15.60:0/1967520686 learned_addr learned my addr 172.21.15.60:0/1967520686 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:22.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7f7132d9d640 1 --2- 172.21.15.60:0/1736117947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f713415af60 0x7f713415ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:23:22.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7efc7a01e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7efc740c6350 con 0x7efc740c3e20 2024-09-12T02:23:22.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7fcc92d9d640 1 --2- 172.21.15.60:0/531706835 >> v2:172.21.15.60:3300/0 conn(0x7fcc9414f820 0x7fcc9414fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7fb24d48b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb2480c4330 con 0x7fb2480aba60 2024-09-12T02:23:22.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7fb2477fe640 1 --2- 172.21.15.60:0/1967520686 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2480c3d60 0x7fb24814a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7f342c829640 1 -- 172.21.15.60:0/3670717232 learned_addr learned my addr 172.21.15.60:0/3670717232 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:22.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7fb24d48b640 1 -- 172.21.15.60:0/1967520686 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb2480c41b0 con 0x7fb2480c3d60 2024-09-12T02:23:22.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7fb24d48b640 1 -- 172.21.15.60:0/1967520686 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb2480c44b0 con 0x7fb2480c2e30 2024-09-12T02:23:22.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7f342ea8d640 1 --2- 172.21.15.60:0/3670717232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34280adc70 0x7f34281e3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7f3427fff640 1 --2- 172.21.15.60:0/3670717232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34280ac0e0 0x7f34281e4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7fcc4ea77640 1 -- 172.21.15.60:0/326299760 shutdown_connections 2024-09-12T02:23:22.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7efc7a01e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efc7415b4e0 con 0x7efc7414feb0 2024-09-12T02:23:22.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7efc7a01e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efc740c2de0 con 0x7efc740c2890 2024-09-12T02:23:22.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7efc7981d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc7414feb0 0x7efc7414ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.723+0000 7fcc4ea77640 1 -- 172.21.15.60:0/326299760 wait complete. 2024-09-12T02:23:22.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.723+0000 7f342ea8d640 1 -- 172.21.15.60:0/3670717232 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f34280ac4c0 con 0x7f34280adc70 2024-09-12T02:23:22.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.723+0000 7f342ea8d640 1 -- 172.21.15.60:0/3670717232 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f342815b000 con 0x7f34280ac0e0 2024-09-12T02:23:22.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.723+0000 7f342ea8d640 1 -- 172.21.15.60:0/3670717232 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f34280ac640 con 0x7f34280ab460 2024-09-12T02:23:22.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7efc7981d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc7414feb0 0x7efc7414ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:46510/0 (socket says 172.21.15.60:46510) 2024-09-12T02:23:22.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.723+0000 7f342d02a640 1 --2- 172.21.15.60:0/3670717232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34280adc70 0x7f34281e3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7efc7981d640 1 -- 172.21.15.60:0/3924711981 learned_addr learned my addr 172.21.15.60:0/3924711981 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:22.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7efc7881b640 1 --2- 172.21.15.60:0/3924711981 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc740c3e20 0x7efc741534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.723+0000 7efc7901c640 1 --2- 172.21.15.60:0/3924711981 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efc740c2890 0x7efc740ad650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7f7131d9b640 1 --2- 172.21.15.60:0/1736117947 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7134157ff0 0x7f71341f3a40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f712800e870 tx=0x7f712800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7fcc9259c640 1 -- 172.21.15.60:0/531706835 >> v2:172.21.15.60:3300/0 conn(0x7fcc9414f820 msgr2=0x7fcc9414fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:22.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7fcc9259c640 1 --2- 172.21.15.60:0/531706835 >> v2:172.21.15.60:3300/0 conn(0x7fcc9414f820 0x7fcc9414fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7fcc9259c640 1 -- 172.21.15.60:0/531706835 >> v1:172.21.15.60:6789/0 conn(0x7fcc940c7230 legacy=0x7fcc94152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:22.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7fcc9259c640 1 -- 172.21.15.60:0/531706835 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc940c3040 con 0x7fcc9406edd0 2024-09-12T02:23:22.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.723+0000 7efc7981d640 1 -- 172.21.15.60:0/3924711981 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efc740c2890 msgr2=0x7efc740ad650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.723+0000 7efc7981d640 1 --2- 172.21.15.60:0/3924711981 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efc740c2890 0x7efc740ad650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7f11e247b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f11dc0a73a0 con 0x7f11dc155080 2024-09-12T02:23:22.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7f11e247b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f11dc0ab670 con 0x7f11dc0c2d50 2024-09-12T02:23:22.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.723+0000 7efc7981d640 1 -- 172.21.15.60:0/3924711981 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc740c3e20 msgr2=0x7efc741534c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.723+0000 7efc7981d640 1 --2- 172.21.15.60:0/3924711981 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc740c3e20 0x7efc741534c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.723+0000 7efc7981d640 1 -- 172.21.15.60:0/3924711981 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc741506c0 con 0x7efc7414feb0 2024-09-12T02:23:22.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7f11e1c7a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11dc155080 0x7f11dc14cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7f11e1479640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11dc0c2d50 0x7f11dc14e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.723+0000 7f11e1479640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11dc0c2d50 0x7f11dc14e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:46480/0 (socket says 172.21.15.60:46480) 2024-09-12T02:23:22.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.723+0000 7f11e1479640 1 -- 172.21.15.60:0/319707779 learned_addr learned my addr 172.21.15.60:0/319707779 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:22.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.723+0000 7f11e0c78640 1 --2- 172.21.15.60:0/319707779 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11dc0c5860 0x7f11dc152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.722+0000 7f11e247b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f11dc155460 con 0x7f11dc0c5860 2024-09-12T02:23:22.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.723+0000 7f7122ffd640 1 -- 172.21.15.60:0/1736117947 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7128017070 con 0x7f7134157ff0 2024-09-12T02:23:22.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.724+0000 7f7122ffd640 1 -- 172.21.15.60:0/1736117947 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f712800ee60 con 0x7f7134157ff0 2024-09-12T02:23:22.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.724+0000 7f7122ffd640 1 -- 172.21.15.60:0/1736117947 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f712800cb40 con 0x7f7134157ff0 2024-09-12T02:23:22.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.724+0000 7f3427fff640 1 -- 172.21.15.60:0/3670717232 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34280ab460 msgr2=0x7f342814f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.724+0000 7f3427fff640 1 --2- 172.21.15.60:0/3670717232 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34280ab460 0x7f342814f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.724+0000 7f3427fff640 1 -- 172.21.15.60:0/3670717232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34280adc70 msgr2=0x7f34281e3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.724+0000 7f3427fff640 1 --2- 172.21.15.60:0/3670717232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34280adc70 0x7f34281e3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.724+0000 7f3427fff640 1 -- 172.21.15.60:0/3670717232 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f342815cb50 con 0x7f34280ac0e0 2024-09-12T02:23:22.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.724+0000 7f11e1479640 1 -- 172.21.15.60:0/319707779 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11dc0c5860 msgr2=0x7f11dc152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.724+0000 7f11e1479640 1 --2- 172.21.15.60:0/319707779 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11dc0c5860 0x7f11dc152680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.724+0000 7f11e1479640 1 -- 172.21.15.60:0/319707779 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11dc155080 msgr2=0x7f11dc14cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.724+0000 7efc7981d640 1 --2- 172.21.15.60:0/3924711981 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc7414feb0 0x7efc7414ce00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efc6c00ef00 tx=0x7efc6c00b480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.724+0000 7fcc9259c640 1 --2- 172.21.15.60:0/531706835 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc9406edd0 0x7fcc941562d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcc84009e50 tx=0x7fcc8402a5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b588d0bb7c6472c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.724+0000 7f7138f49640 1 -- 172.21.15.60:0/1736117947 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71340acf80 con 0x7f7134157ff0 2024-09-12T02:23:22.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.724+0000 7f7138f49640 1 -- 172.21.15.60:0/1736117947 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71340aad90 con 0x7f7134157ff0 2024-09-12T02:23:22.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.723+0000 7fb246ffd640 1 -- 172.21.15.60:0/1967520686 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb2480c2e30 msgr2=0x7fb248149bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.723+0000 7fb246ffd640 1 --2- 172.21.15.60:0/1967520686 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb2480c2e30 0x7fb248149bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.723+0000 7fb246ffd640 1 -- 172.21.15.60:0/1967520686 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2480c3d60 msgr2=0x7fb24814a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.723+0000 7fb246ffd640 1 --2- 172.21.15.60:0/1967520686 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2480c3d60 0x7fb24814a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.723+0000 7fb246ffd640 1 -- 172.21.15.60:0/1967520686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2481510f0 con 0x7fb2480aba60 2024-09-12T02:23:22.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.724+0000 7fb246ffd640 1 --2- 172.21.15.60:0/1967520686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2480aba60 0x7fb248154810 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb23800c4d0 tx=0x7fb23800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.724+0000 7f3427fff640 1 --2- 172.21.15.60:0/3670717232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34280ac0e0 0x7f34281e4b30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f341c00b3e0 tx=0x7f341c00b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.724+0000 7fcc9159a640 1 -- 172.21.15.60:0/531706835 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc84036070 con 0x7fcc9406edd0 2024-09-12T02:23:22.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.724+0000 7fcc9159a640 1 -- 172.21.15.60:0/531706835 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc84031600 con 0x7fcc9406edd0 2024-09-12T02:23:22.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.724+0000 7f09a7cd0640 1 -- 172.21.15.60:0/3504473894 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0988005290 con 0x7f09a01e8ae0 2024-09-12T02:23:22.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.724+0000 7f34257fa640 1 -- 172.21.15.60:0/3670717232 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f341c015020 con 0x7f34280ac0e0 2024-09-12T02:23:22.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.724+0000 7f34257fa640 1 -- 172.21.15.60:0/3670717232 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f341c011830 con 0x7f34280ac0e0 2024-09-12T02:23:22.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.725+0000 7f34257fa640 1 -- 172.21.15.60:0/3670717232 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f341c015020 con 0x7f34280ac0e0 2024-09-12T02:23:22.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.724+0000 7efc65ffb640 1 -- 172.21.15.60:0/3924711981 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc6c018020 con 0x7efc7414feb0 2024-09-12T02:23:22.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.724+0000 7efc65ffb640 1 -- 172.21.15.60:0/3924711981 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc6c014400 con 0x7efc7414feb0 2024-09-12T02:23:22.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.724+0000 7efc65ffb640 1 -- 172.21.15.60:0/3924711981 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc6c0147b0 con 0x7efc7414feb0 2024-09-12T02:23:22.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.725+0000 7efc7a01e640 1 -- 172.21.15.60:0/3924711981 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc741f03a0 con 0x7efc7414feb0 2024-09-12T02:23:22.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.725+0000 7efc7a01e640 1 -- 172.21.15.60:0/3924711981 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc741f0960 con 0x7efc7414feb0 2024-09-12T02:23:22.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.725+0000 7fcc4ea77640 1 Processor -- start 2024-09-12T02:23:22.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.725+0000 7fcc4ea77640 1 -- start start 2024-09-12T02:23:22.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.725+0000 7fcc98a45640 1 -- 172.21.15.60:0/531706835 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc9406edd0 msgr2=0x7fcc941562d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.725+0000 7fcc98a45640 1 --2- 172.21.15.60:0/531706835 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc9406edd0 0x7fcc941562d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcc84009e50 tx=0x7fcc8402a5b0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.725+0000 7f342ea8d640 1 -- 172.21.15.60:0/3670717232 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f342815cdf0 con 0x7f34280ac0e0 2024-09-12T02:23:22.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.726+0000 7f342ea8d640 1 -- 172.21.15.60:0/3670717232 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f342815d3b0 con 0x7f34280ac0e0 2024-09-12T02:23:22.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.725+0000 7fcc98a45640 1 -- 172.21.15.60:0/531706835 shutdown_connections 2024-09-12T02:23:22.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.726+0000 7fcc98a45640 1 --2- 172.21.15.60:0/531706835 >> v2:172.21.15.60:3300/0 conn(0x7fcc9414f820 0x7fcc9414fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.726+0000 7fcc98a45640 1 --2- 172.21.15.60:0/531706835 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc9406edd0 0x7fcc941562d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.726+0000 7fcc98a45640 1 -- 172.21.15.60:0/531706835 >> 172.21.15.60:0/531706835 conn(0x7fcc940c7a40 msgr2=0x7fcc940c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:22.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.726+0000 7f11e1479640 1 --2- 172.21.15.60:0/319707779 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11dc155080 0x7f11dc14cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.726+0000 7f11e1479640 1 -- 172.21.15.60:0/319707779 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11dc153340 con 0x7f11dc0c2d50 2024-09-12T02:23:22.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.726+0000 7f11e1c7a640 1 --2- 172.21.15.60:0/319707779 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11dc155080 0x7f11dc14cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:23:22.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.726+0000 7f7138f49640 1 -- 172.21.15.60:0/1736117947 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71340aaf90 con 0x7f7134157ff0 2024-09-12T02:23:22.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.726+0000 7f11e1479640 1 --2- 172.21.15.60:0/319707779 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11dc0c2d50 0x7f11dc14e130 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f11d800d5f0 tx=0x7f11d800dab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.725+0000 7fb23f7fe640 1 -- 172.21.15.60:0/1967520686 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb238017070 con 0x7fb2480aba60 2024-09-12T02:23:22.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.725+0000 7fb23f7fe640 1 -- 172.21.15.60:0/1967520686 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2380064e0 con 0x7fb2480aba60 2024-09-12T02:23:22.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.726+0000 7fb23f7fe640 1 -- 172.21.15.60:0/1967520686 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb238004a20 con 0x7fb2480aba60 2024-09-12T02:23:22.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.726+0000 7fb24d48b640 1 -- 172.21.15.60:0/1967520686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2481513d0 con 0x7fb2480aba60 2024-09-12T02:23:22.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.726+0000 7fb24d48b640 1 -- 172.21.15.60:0/1967520686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb248151990 con 0x7fb2480aba60 2024-09-12T02:23:22.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.726+0000 7efc7a01e640 1 -- 172.21.15.60:0/3924711981 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc740c33c0 con 0x7efc7414feb0 2024-09-12T02:23:22.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.727+0000 7fcc98a45640 1 -- 172.21.15.60:0/531706835 shutdown_connections 2024-09-12T02:23:22.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.727+0000 7fcc98a45640 1 -- 172.21.15.60:0/531706835 wait complete. 2024-09-12T02:23:22.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.726+0000 7fcc4ea77640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc40009050 0x7fcc400ca980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.727+0000 7fcc4ea77640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc4000cc80 0x7fcc400e1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.727+0000 7fcc4ea77640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc400dbb70 0x7fcc4003d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.727+0000 7fcc4ea77640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcc400e1fe0 con 0x7fcc40009050 2024-09-12T02:23:22.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.727+0000 7fcc4ea77640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcc400e1d00 con 0x7fcc4000cc80 2024-09-12T02:23:22.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.727+0000 7fcc4ea77640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcc40040b70 con 0x7fcc400dbb70 2024-09-12T02:23:22.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.727+0000 7f11d1ffb640 1 -- 172.21.15.60:0/319707779 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d80125f0 con 0x7f11dc0c2d50 2024-09-12T02:23:22.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.727+0000 7fb24d48b640 1 -- 172.21.15.60:0/1967520686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2480698f0 con 0x7fb2480aba60 2024-09-12T02:23:22.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.727+0000 7fcc47fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc4000cc80 0x7fcc400e1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.727+0000 7fcc4d014640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc400dbb70 0x7fcc4003d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.727+0000 7fcc4c813640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc40009050 0x7fcc400ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.728+0000 7fcc4c813640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc40009050 0x7fcc400ca980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49878/0 (socket says 172.21.15.60:49878) 2024-09-12T02:23:22.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.728+0000 7fcc4c813640 1 -- 172.21.15.60:0/3717098334 learned_addr learned my addr 172.21.15.60:0/3717098334 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:22.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.727+0000 7f11d1ffb640 1 -- 172.21.15.60:0/319707779 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11d8019070 con 0x7f11dc0c2d50 2024-09-12T02:23:22.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.725+0000 7f09967fc640 1 -- 172.21.15.60:0/3504473894 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f099c012040 con 0x7f09a01e8ae0 2024-09-12T02:23:22.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.725+0000 7f09967fc640 1 --2- 172.21.15.60:0/3504473894 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f098406bf30 0x7f098406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.726+0000 7f09967fc640 1 -- 172.21.15.60:0/3504473894 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f099c08ae10 con 0x7f09a01e8ae0 2024-09-12T02:23:22.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.727+0000 7f09a5a6c640 1 --2- 172.21.15.60:0/3504473894 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f098406bf30 0x7f098406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.727+0000 7f342ea8d640 1 -- 172.21.15.60:0/3670717232 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f342815d5b0 con 0x7f34280ac0e0 2024-09-12T02:23:22.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.728+0000 7f7122ffd640 1 -- 172.21.15.60:0/1736117947 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f712801a070 con 0x7f7134157ff0 2024-09-12T02:23:22.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.728+0000 7fcc4c813640 1 -- 172.21.15.60:0/3717098334 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc400dbb70 msgr2=0x7fcc4003d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.728+0000 7fcc4c813640 1 --2- 172.21.15.60:0/3717098334 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc400dbb70 0x7fcc4003d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.728+0000 7fcc4c813640 1 -- 172.21.15.60:0/3717098334 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc4000cc80 msgr2=0x7fcc400e1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.728+0000 7fcc4c813640 1 --2- 172.21.15.60:0/3717098334 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc4000cc80 0x7fcc400e1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.728+0000 7fcc4c813640 1 -- 172.21.15.60:0/3717098334 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc400e15c0 con 0x7fcc40009050 2024-09-12T02:23:22.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.728+0000 7fcc47fff640 1 --2- 172.21.15.60:0/3717098334 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc4000cc80 0x7fcc400e1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:23:22.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.728+0000 7f09a5a6c640 1 --2- 172.21.15.60:0/3504473894 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f098406bf30 0x7f098406e3f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0990033000 tx=0x7f0990008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.728+0000 7f11e247b640 1 -- 172.21.15.60:0/319707779 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11dc071dd0 con 0x7f11dc0c2d50 2024-09-12T02:23:22.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.728+0000 7f11e247b640 1 -- 172.21.15.60:0/319707779 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11dc06ce60 con 0x7f11dc0c2d50 2024-09-12T02:23:22.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.728+0000 7efc65ffb640 1 -- 172.21.15.60:0/3924711981 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efc6c005d10 con 0x7efc7414feb0 2024-09-12T02:23:22.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.729+0000 7fcc98a45640 1 Processor -- start 2024-09-12T02:23:22.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.729+0000 7f7122ffd640 1 --2- 172.21.15.60:0/1736117947 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f711406bf30 0x7f711406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.729+0000 7fcc4c813640 1 --2- 172.21.15.60:0/3717098334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc40009050 0x7fcc400ca980 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcc3400c780 tx=0x7fcc3400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.729+0000 7f7122ffd640 1 -- 172.21.15.60:0/1736117947 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f712808ae20 con 0x7f7134157ff0 2024-09-12T02:23:22.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.729+0000 7f713259c640 1 --2- 172.21.15.60:0/1736117947 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f711406bf30 0x7f711406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.729+0000 7efc65ffb640 1 --2- 172.21.15.60:0/3924711981 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7efc5806bf00 0x7efc5806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.729+0000 7fcc98a45640 1 -- start start 2024-09-12T02:23:22.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.729+0000 7efc65ffb640 1 -- 172.21.15.60:0/3924711981 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7efc6c08b9f0 con 0x7efc7414feb0 2024-09-12T02:23:22.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.729+0000 7f11d1ffb640 1 -- 172.21.15.60:0/319707779 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d80129d0 con 0x7f11dc0c2d50 2024-09-12T02:23:22.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.730+0000 7f34257fa640 1 -- 172.21.15.60:0/3670717232 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f341c018020 con 0x7f34280ac0e0 2024-09-12T02:23:22.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.730+0000 7efc7901c640 1 --2- 172.21.15.60:0/3924711981 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7efc5806bf00 0x7efc5806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.730+0000 7f713259c640 1 --2- 172.21.15.60:0/1736117947 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f711406bf30 0x7f711406e3f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f71340c6a80 tx=0x7f712c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.730+0000 7fb23f7fe640 1 -- 172.21.15.60:0/1967520686 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb23801a070 con 0x7fb2480aba60 2024-09-12T02:23:22.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.730+0000 7fcc98a45640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc9406edd0 0x7fcc94070dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.730+0000 7fcc98a45640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc940c7230 0x7fcc94146d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.730+0000 7fcc98a45640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc9414f820 0x7fcc941f0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.730+0000 7fcc98a45640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcc940c5bc0 con 0x7fcc9414f820 2024-09-12T02:23:22.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.730+0000 7f11e247b640 1 -- 172.21.15.60:0/319707779 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11dc0aaac0 con 0x7f11dc0c2d50 2024-09-12T02:23:22.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.730+0000 7fcc91d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc940c7230 0x7fcc94146d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.730+0000 7fcc91d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc940c7230 0x7fcc94146d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:46550/0 (socket says 172.21.15.60:46550) 2024-09-12T02:23:22.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.730+0000 7fcc91d9b640 1 -- 172.21.15.60:0/3329903568 learned_addr learned my addr 172.21.15.60:0/3329903568 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:22.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.730+0000 7efc7901c640 1 --2- 172.21.15.60:0/3924711981 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7efc5806bf00 0x7efc5806e3c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efc70034000 tx=0x7efc7002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.730+0000 7fcc92d9d640 1 --2- 172.21.15.60:0/3329903568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc9414f820 0x7fcc941f0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.730+0000 7f34257fa640 1 --2- 172.21.15.60:0/3670717232 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f341406c230 0x7f341406e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.730+0000 7fcc9259c640 1 --2- 172.21.15.60:0/3329903568 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc9406edd0 0x7fcc94070dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.730+0000 7fcc98a45640 1 -- 172.21.15.60:0/3329903568 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcc94152350 con 0x7fcc940c7230 2024-09-12T02:23:22.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.730+0000 7fb23f7fe640 1 --2- 172.21.15.60:0/1967520686 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb22806bf00 0x7fb22806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.730+0000 7fcc98a45640 1 -- 172.21.15.60:0/3329903568 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcc940c5d40 con 0x7fcc9406edd0 2024-09-12T02:23:22.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.731+0000 7f34257fa640 1 -- 172.21.15.60:0/3670717232 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f341c011630 con 0x7f34280ac0e0 2024-09-12T02:23:22.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.731+0000 7fb23ffff640 1 --2- 172.21.15.60:0/1967520686 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb22806bf00 0x7fb22806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.731+0000 7fb23f7fe640 1 -- 172.21.15.60:0/1967520686 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7fb23808a4d0 con 0x7fb2480aba60 2024-09-12T02:23:22.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.731+0000 7f342c829640 1 --2- 172.21.15.60:0/3670717232 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f341406c230 0x7f341406e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.731+0000 7fcc91d9b640 1 -- 172.21.15.60:0/3329903568 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc9406edd0 msgr2=0x7fcc94070dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.731+0000 7fcc91d9b640 1 --2- 172.21.15.60:0/3329903568 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc9406edd0 0x7fcc94070dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.731+0000 7fb23ffff640 1 --2- 172.21.15.60:0/1967520686 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb22806bf00 0x7fb22806e3c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb230034000 tx=0x7fb23002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.731+0000 7f342c829640 1 --2- 172.21.15.60:0/3670717232 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f341406c230 0x7f341406e6f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f34180099a0 tx=0x7f3418006f90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.731+0000 7fcc91d9b640 1 -- 172.21.15.60:0/3329903568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc9414f820 msgr2=0x7fcc941f0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:22.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.731+0000 7fcc91d9b640 1 --2- 172.21.15.60:0/3329903568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc9414f820 0x7fcc941f0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:22.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.731+0000 7fcc91d9b640 1 -- 172.21.15.60:0/3329903568 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc941f4230 con 0x7fcc940c7230 2024-09-12T02:23:22.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.731+0000 7fcc92d9d640 1 --2- 172.21.15.60:0/3329903568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc9414f820 0x7fcc941f0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:23:22.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.731+0000 7fcc91d9b640 1 --2- 172.21.15.60:0/3329903568 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc940c7230 0x7fcc94146d90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcc8800c440 tx=0x7fcc8800c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.733+0000 7efc65ffb640 1 -- 172.21.15.60:0/3924711981 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efc6c022030 con 0x7efc7414feb0 2024-09-12T02:23:22.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.734+0000 7f09967fc640 1 -- 172.21.15.60:0/3504473894 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f099c059500 con 0x7f09a01e8ae0 2024-09-12T02:23:22.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.737+0000 7fcc82ffd640 1 -- 172.21.15.60:0/3329903568 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc88017070 con 0x7fcc940c7230 2024-09-12T02:23:22.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.737+0000 7fcc82ffd640 1 -- 172.21.15.60:0/3329903568 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc880035f0 con 0x7fcc940c7230 2024-09-12T02:23:22.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.737+0000 7fcc82ffd640 1 -- 172.21.15.60:0/3329903568 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc880039e0 con 0x7fcc940c7230 2024-09-12T02:23:22.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.737+0000 7f34257fa640 1 -- 172.21.15.60:0/3670717232 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f342815d5b0 con 0x7f34280ac0e0 2024-09-12T02:23:22.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.737+0000 7fcc98a45640 1 -- 172.21.15.60:0/3329903568 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc941f4510 con 0x7fcc940c7230 2024-09-12T02:23:22.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.737+0000 7fcc98a45640 1 -- 172.21.15.60:0/3329903568 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc941472d0 con 0x7fcc940c7230 2024-09-12T02:23:22.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.739+0000 7f7122ffd640 1 -- 172.21.15.60:0/1736117947 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f71340aaf90 con 0x7f7134157ff0 2024-09-12T02:23:22.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.739+0000 7fcc98a45640 1 -- 172.21.15.60:0/3329903568 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc941562d0 con 0x7fcc940c7230 2024-09-12T02:23:22.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.739+0000 7f11d1ffb640 1 -- 172.21.15.60:0/319707779 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f11d8012b70 con 0x7f11dc0c2d50 2024-09-12T02:23:22.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.739+0000 7f11d1ffb640 1 --2- 172.21.15.60:0/319707779 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f11c006beb0 0x7f11c006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.739+0000 7f11d1ffb640 1 -- 172.21.15.60:0/319707779 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f11d808bf50 con 0x7f11dc0c2d50 2024-09-12T02:23:22.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.740+0000 7f11e0c78640 1 --2- 172.21.15.60:0/319707779 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f11c006beb0 0x7f11c006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.741+0000 7f11e0c78640 1 --2- 172.21.15.60:0/319707779 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f11c006beb0 0x7f11c006e370 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f11cc037000 tx=0x7f11cc00a040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.742+0000 7f11d1ffb640 1 -- 172.21.15.60:0/319707779 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f11dc153340 con 0x7f11dc0c2d50 2024-09-12T02:23:22.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.746+0000 7fcc457fa640 1 -- 172.21.15.60:0/3717098334 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc34017070 con 0x7fcc40009050 2024-09-12T02:23:22.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.746+0000 7fb23f7fe640 1 -- 172.21.15.60:0/1967520686 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb2380584e0 con 0x7fb2480aba60 2024-09-12T02:23:22.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.746+0000 7fcc457fa640 1 -- 172.21.15.60:0/3717098334 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc34005ad0 con 0x7fcc40009050 2024-09-12T02:23:22.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.746+0000 7fcc457fa640 1 -- 172.21.15.60:0/3717098334 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc34007070 con 0x7fcc40009050 2024-09-12T02:23:22.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.747+0000 7fcc4ea77640 1 -- 172.21.15.60:0/3717098334 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc4003fbb0 con 0x7fcc40009050 2024-09-12T02:23:22.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.747+0000 7fcc4ea77640 1 -- 172.21.15.60:0/3717098334 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc400ca180 con 0x7fcc40009050 2024-09-12T02:23:22.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.747+0000 7fcc82ffd640 1 -- 172.21.15.60:0/3329903568 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcc88003b80 con 0x7fcc940c7230 2024-09-12T02:23:22.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.749+0000 7fcc4ea77640 1 -- 172.21.15.60:0/3717098334 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc400ca4b0 con 0x7fcc40009050 2024-09-12T02:23:22.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.750+0000 7fcc82ffd640 1 --2- 172.21.15.60:0/3329903568 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcc7406be30 0x7fcc7406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.750+0000 7fcc82ffd640 1 -- 172.21.15.60:0/3329903568 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7fcc8808a5e0 con 0x7fcc940c7230 2024-09-12T02:23:22.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.750+0000 7fcc82ffd640 1 -- 172.21.15.60:0/3329903568 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcc88020080 con 0x7fcc940c7230 2024-09-12T02:23:22.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.751+0000 7fcc9259c640 1 --2- 172.21.15.60:0/3329903568 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcc7406be30 0x7fcc7406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.752+0000 7fcc9259c640 1 --2- 172.21.15.60:0/3329903568 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcc7406be30 0x7fcc7406e2f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcc84033000 tx=0x7fcc84009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:22.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.759+0000 7fcc457fa640 1 -- 172.21.15.60:0/3717098334 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcc3401a070 con 0x7fcc40009050 2024-09-12T02:23:22.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.760+0000 7fcc457fa640 1 --2- 172.21.15.60:0/3717098334 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcc2c06bf00 0x7fcc2c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:22.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.761+0000 7fcc457fa640 1 -- 172.21.15.60:0/3717098334 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7fcc3408a5f0 con 0x7fcc40009050 2024-09-12T02:23:22.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.761+0000 7fcc457fa640 1 -- 172.21.15.60:0/3717098334 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcc34058690 con 0x7fcc40009050 2024-09-12T02:23:22.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.762+0000 7fcc47fff640 1 --2- 172.21.15.60:0/3717098334 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcc2c06bf00 0x7fcc2c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:22.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:22.763+0000 7fcc47fff640 1 --2- 172.21.15.60:0/3717098334 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcc2c06bf00 0x7fcc2c06e3c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c006fd0 tx=0x7fcc3c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:23.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.135+0000 7efc7a01e640 1 -- 172.21.15.60:0/3924711981 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7efc741552b0 con 0x7efc7414feb0 2024-09-12T02:23:23.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.135+0000 7efc65ffb640 1 -- 172.21.15.60:0/3924711981 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efc741506c0 con 0x7efc7414feb0 2024-09-12T02:23:23.136 INFO:teuthology.orchestra.run.smithi060.stdout:60129542152 2024-09-12T02:23:23.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.139+0000 7efc577fe640 1 -- 172.21.15.60:0/3924711981 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7efc5806bf00 msgr2=0x7efc5806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:23.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.139+0000 7efc577fe640 1 --2- 172.21.15.60:0/3924711981 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7efc5806bf00 0x7efc5806e3c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efc70034000 tx=0x7efc7002e000 comp rx=0 tx=0).stop 2024-09-12T02:23:23.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.139+0000 7efc577fe640 1 -- 172.21.15.60:0/3924711981 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc7414feb0 msgr2=0x7efc7414ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:23.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.139+0000 7efc577fe640 1 --2- 172.21.15.60:0/3924711981 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc7414feb0 0x7efc7414ce00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efc6c00ef00 tx=0x7efc6c00b480 comp rx=0 tx=0).stop 2024-09-12T02:23:23.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.139+0000 7efc577fe640 1 -- 172.21.15.60:0/3924711981 shutdown_connections 2024-09-12T02:23:23.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.139+0000 7efc577fe640 1 --2- 172.21.15.60:0/3924711981 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7efc5806bf00 0x7efc5806e3c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:23.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.139+0000 7efc577fe640 1 --2- 172.21.15.60:0/3924711981 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc7414feb0 0x7efc7414ce00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:23.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.140+0000 7efc577fe640 1 --2- 172.21.15.60:0/3924711981 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc740c3e20 0x7efc741534c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:23.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.140+0000 7efc577fe640 1 --2- 172.21.15.60:0/3924711981 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efc740c2890 0x7efc740ad650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:23.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.140+0000 7efc577fe640 1 -- 172.21.15.60:0/3924711981 >> 172.21.15.60:0/3924711981 conn(0x7efc740a9780 msgr2=0x7efc740c57d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:23.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.140+0000 7efc577fe640 1 -- 172.21.15.60:0/3924711981 shutdown_connections 2024-09-12T02:23:23.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.140+0000 7efc577fe640 1 -- 172.21.15.60:0/3924711981 wait complete. 2024-09-12T02:23:23.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.143+0000 7f09a7cd0640 1 -- 172.21.15.60:0/3504473894 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f0988005580 con 0x7f09a01e8ae0 2024-09-12T02:23:23.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.143+0000 7f7138f49640 1 -- 172.21.15.60:0/1736117947 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f713415b3d0 con 0x7f7134157ff0 2024-09-12T02:23:23.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.144+0000 7f7122ffd640 1 -- 172.21.15.60:0/1736117947 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7128058ec0 con 0x7f7134157ff0 2024-09-12T02:23:23.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.144+0000 7f09967fc640 1 -- 172.21.15.60:0/3504473894 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f099c058e00 con 0x7f09a01e8ae0 2024-09-12T02:23:23.145 INFO:teuthology.orchestra.run.smithi060.stdout:60129542151 2024-09-12T02:23:23.145 INFO:teuthology.orchestra.run.smithi060.stdout:64424509447 2024-09-12T02:23:23.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.147+0000 7f7120ff9640 1 -- 172.21.15.60:0/1736117947 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f711406bf30 msgr2=0x7f711406e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:23.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.147+0000 7f0983fff640 1 -- 172.21.15.60:0/3504473894 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f098406bf30 msgr2=0x7f098406e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:23.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.147+0000 7f0983fff640 1 --2- 172.21.15.60:0/3504473894 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f098406bf30 0x7f098406e3f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0990033000 tx=0x7f0990008030 comp rx=0 tx=0).stop 2024-09-12T02:23:23.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.147+0000 7f7120ff9640 1 --2- 172.21.15.60:0/1736117947 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f711406bf30 0x7f711406e3f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f71340c6a80 tx=0x7f712c009040 comp rx=0 tx=0).stop 2024-09-12T02:23:23.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.147+0000 7f7120ff9640 1 -- 172.21.15.60:0/1736117947 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7134157ff0 msgr2=0x7f71341f3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:23.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.147+0000 7f0983fff640 1 -- 172.21.15.60:0/3504473894 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09a01e8ae0 msgr2=0x7f09a014c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:23.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.147+0000 7f0983fff640 1 --2- 172.21.15.60:0/3504473894 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09a01e8ae0 0x7f09a014c0f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f09a0074a90 tx=0x7f099c011e30 comp rx=0 tx=0).stop 2024-09-12T02:23:23.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.148+0000 7f7120ff9640 1 --2- 172.21.15.60:0/1736117947 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7134157ff0 0x7f71341f3a40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f712800e870 tx=0x7f712800ed30 comp rx=0 tx=0).stop 2024-09-12T02:23:23.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.148+0000 7f0983fff640 1 -- 172.21.15.60:0/3504473894 shutdown_connections 2024-09-12T02:23:23.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.148+0000 7f0983fff640 1 --2- 172.21.15.60:0/3504473894 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f098406bf30 0x7f098406e3f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:23.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.148+0000 7f7120ff9640 1 -- 172.21.15.60:0/1736117947 shutdown_connections 2024-09-12T02:23:23.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.148+0000 7f7120ff9640 1 --2- 172.21.15.60:0/1736117947 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f711406bf30 0x7f711406e3f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:23.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.148+0000 7f7120ff9640 1 --2- 172.21.15.60:0/1736117947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f713415af60 0x7f713415ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:23.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.148+0000 7f7120ff9640 1 --2- 172.21.15.60:0/1736117947 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7134157ff0 0x7f71341f3a40 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:23.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.148+0000 7f7120ff9640 1 --2- 172.21.15.60:0/1736117947 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f71340c5940 0x7f71340a7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:23.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.148+0000 7f7120ff9640 1 -- 172.21.15.60:0/1736117947 >> 172.21.15.60:0/1736117947 conn(0x7f71340c7a40 msgr2=0x7f71340c2130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:23.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.148+0000 7f0983fff640 1 --2- 172.21.15.60:0/3504473894 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09a01e8ae0 0x7f09a014c0f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:23.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.148+0000 7f7120ff9640 1 -- 172.21.15.60:0/1736117947 shutdown_connections 2024-09-12T02:23:23.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.148+0000 7f0983fff640 1 --2- 172.21.15.60:0/3504473894 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09a014d8f0 0x7f09a01e85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:23.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.148+0000 7f0983fff640 1 --2- 172.21.15.60:0/3504473894 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f09a00abd20 0x7f09a01e8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:23.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.148+0000 7f0983fff640 1 -- 172.21.15.60:0/3504473894 >> 172.21.15.60:0/3504473894 conn(0x7f09a00a9680 msgr2=0x7f09a00c4b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:23.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.148+0000 7f7120ff9640 1 -- 172.21.15.60:0/1736117947 wait complete. 2024-09-12T02:23:23.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.148+0000 7f0983fff640 1 -- 172.21.15.60:0/3504473894 shutdown_connections 2024-09-12T02:23:23.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.148+0000 7f0983fff640 1 -- 172.21.15.60:0/3504473894 wait complete. 2024-09-12T02:23:23.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.152+0000 7f11e247b640 1 -- 172.21.15.60:0/319707779 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f11dc1519a0 con 0x7f11dc0c2d50 2024-09-12T02:23:23.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.152+0000 7f11d1ffb640 1 -- 172.21.15.60:0/319707779 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f11d805a640 con 0x7f11dc0c2d50 2024-09-12T02:23:23.156 INFO:teuthology.orchestra.run.smithi060.stdout:64424509446 2024-09-12T02:23:23.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.154+0000 7f342ea8d640 1 -- 172.21.15.60:0/3670717232 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f34281e5070 con 0x7f34280ac0e0 2024-09-12T02:23:23.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.156+0000 7f11e247b640 1 -- 172.21.15.60:0/319707779 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f11c006beb0 msgr2=0x7f11c006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:23.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.157+0000 7f34257fa640 1 -- 172.21.15.60:0/3670717232 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f341c08a070 con 0x7f34280ac0e0 2024-09-12T02:23:23.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.156+0000 7f11e247b640 1 --2- 172.21.15.60:0/319707779 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f11c006beb0 0x7f11c006e370 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f11cc037000 tx=0x7f11cc00a040 comp rx=0 tx=0).stop 2024-09-12T02:23:23.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.156+0000 7f11e247b640 1 -- 172.21.15.60:0/319707779 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11dc0c2d50 msgr2=0x7f11dc14e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:23.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.156+0000 7f11e247b640 1 --2- 172.21.15.60:0/319707779 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11dc0c2d50 0x7f11dc14e130 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f11d800d5f0 tx=0x7f11d800dab0 comp rx=0 tx=0).stop 2024-09-12T02:23:23.158 INFO:teuthology.orchestra.run.smithi060.stdout:68719476744 2024-09-12T02:23:23.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.156+0000 7f11e247b640 1 -- 172.21.15.60:0/319707779 shutdown_connections 2024-09-12T02:23:23.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.157+0000 7fb24d48b640 1 -- 172.21.15.60:0/1967520686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fb24814c720 con 0x7fb2480aba60 2024-09-12T02:23:23.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.156+0000 7f11e247b640 1 --2- 172.21.15.60:0/319707779 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f11c006beb0 0x7f11c006e370 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:23.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.157+0000 7fb23f7fe640 1 -- 172.21.15.60:0/1967520686 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb23805c7e0 con 0x7fb2480aba60 2024-09-12T02:23:23.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.156+0000 7f11e247b640 1 --2- 172.21.15.60:0/319707779 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11dc155080 0x7f11dc14cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:23.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.156+0000 7f11e247b640 1 --2- 172.21.15.60:0/319707779 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11dc0c5860 0x7f11dc152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:23.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.156+0000 7f11e247b640 1 --2- 172.21.15.60:0/319707779 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11dc0c2d50 0x7f11dc14e130 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f11d800d5f0 tx=0x7f11d800dab0 comp rx=0 tx=0).stop 2024-09-12T02:23:23.160 INFO:teuthology.orchestra.run.smithi060.stdout:64424509448 2024-09-12T02:23:23.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.156+0000 7f11e247b640 1 -- 172.21.15.60:0/319707779 >> 172.21.15.60:0/319707779 conn(0x7f11dc0c7f00 msgr2=0x7f11dc0a88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:23.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.158+0000 7f11e247b640 1 -- 172.21.15.60:0/319707779 shutdown_connections 2024-09-12T02:23:23.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.158+0000 7f11e247b640 1 -- 172.21.15.60:0/319707779 wait complete. 2024-09-12T02:23:23.162 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542152 for osd.3 2024-09-12T02:23:23.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.160+0000 7fb24d48b640 1 -- 172.21.15.60:0/1967520686 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb22806bf00 msgr2=0x7fb22806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:23.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.160+0000 7fb24d48b640 1 --2- 172.21.15.60:0/1967520686 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb22806bf00 0x7fb22806e3c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb230034000 tx=0x7fb23002e000 comp rx=0 tx=0).stop 2024-09-12T02:23:23.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.160+0000 7fb24d48b640 1 -- 172.21.15.60:0/1967520686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2480aba60 msgr2=0x7fb248154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:23.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.160+0000 7fb24d48b640 1 --2- 172.21.15.60:0/1967520686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2480aba60 0x7fb248154810 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb23800c4d0 tx=0x7fb23800c990 comp rx=0 tx=0).stop 2024-09-12T02:23:23.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.160+0000 7fb24d48b640 1 -- 172.21.15.60:0/1967520686 shutdown_connections 2024-09-12T02:23:23.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.160+0000 7fb24d48b640 1 --2- 172.21.15.60:0/1967520686 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb22806bf00 0x7fb22806e3c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:23.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.160+0000 7fb24d48b640 1 --2- 172.21.15.60:0/1967520686 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2480c3d60 0x7fb24814a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:23.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.160+0000 7fb24d48b640 1 --2- 172.21.15.60:0/1967520686 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb2480c2e30 0x7fb248149bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:23.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.160+0000 7fb24d48b640 1 --2- 172.21.15.60:0/1967520686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2480aba60 0x7fb248154810 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:23.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.160+0000 7fb24d48b640 1 -- 172.21.15.60:0/1967520686 >> 172.21.15.60:0/1967520686 conn(0x7fb2480c8430 msgr2=0x7fb24814bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:23.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.161+0000 7fb24d48b640 1 -- 172.21.15.60:0/1967520686 shutdown_connections 2024-09-12T02:23:23.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.161+0000 7fb24d48b640 1 -- 172.21.15.60:0/1967520686 wait complete. 2024-09-12T02:23:23.164 INFO:teuthology.orchestra.run.smithi060.stdout:68719476744 2024-09-12T02:23:23.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.161+0000 7fcc98a45640 1 -- 172.21.15.60:0/3329903568 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fcc940c6db0 con 0x7fcc940c7230 2024-09-12T02:23:23.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.161+0000 7fcc82ffd640 1 -- 172.21.15.60:0/3329903568 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcc880010c0 con 0x7fcc940c7230 2024-09-12T02:23:23.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.162+0000 7f342ea8d640 1 -- 172.21.15.60:0/3670717232 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f341406c230 msgr2=0x7f341406e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:23.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.162+0000 7f342ea8d640 1 --2- 172.21.15.60:0/3670717232 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f341406c230 0x7f341406e6f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f34180099a0 tx=0x7f3418006f90 comp rx=0 tx=0).stop 2024-09-12T02:23:23.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.162+0000 7f342ea8d640 1 -- 172.21.15.60:0/3670717232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34280ac0e0 msgr2=0x7f34281e4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:23.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.162+0000 7f342ea8d640 1 --2- 172.21.15.60:0/3670717232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34280ac0e0 0x7f34281e4b30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f341c00b3e0 tx=0x7f341c00b8a0 comp rx=0 tx=0).stop 2024-09-12T02:23:23.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.162+0000 7f342ea8d640 1 -- 172.21.15.60:0/3670717232 shutdown_connections 2024-09-12T02:23:23.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.162+0000 7f342ea8d640 1 --2- 172.21.15.60:0/3670717232 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f341406c230 0x7f341406e6f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:23.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.162+0000 7f342ea8d640 1 --2- 172.21.15.60:0/3670717232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34280adc70 0x7f34281e3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:23.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.162+0000 7f342ea8d640 1 --2- 172.21.15.60:0/3670717232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34280ac0e0 0x7f34281e4b30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:23.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.162+0000 7f342ea8d640 1 --2- 172.21.15.60:0/3670717232 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34280ab460 0x7f342814f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:23.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.162+0000 7f342ea8d640 1 -- 172.21.15.60:0/3670717232 >> 172.21.15.60:0/3670717232 conn(0x7f3428067f80 msgr2=0x7f342806dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:23.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.162+0000 7f342ea8d640 1 -- 172.21.15.60:0/3670717232 shutdown_connections 2024-09-12T02:23:23.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.162+0000 7f342ea8d640 1 -- 172.21.15.60:0/3670717232 wait complete. 2024-09-12T02:23:23.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.165+0000 7fcc98a45640 1 -- 172.21.15.60:0/3329903568 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcc7406be30 msgr2=0x7fcc7406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:23.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.165+0000 7fcc98a45640 1 --2- 172.21.15.60:0/3329903568 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcc7406be30 0x7fcc7406e2f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcc84033000 tx=0x7fcc84009000 comp rx=0 tx=0).stop 2024-09-12T02:23:23.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.165+0000 7fcc98a45640 1 -- 172.21.15.60:0/3329903568 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc940c7230 msgr2=0x7fcc94146d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:23.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.165+0000 7fcc98a45640 1 --2- 172.21.15.60:0/3329903568 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc940c7230 0x7fcc94146d90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcc8800c440 tx=0x7fcc8800c900 comp rx=0 tx=0).stop 2024-09-12T02:23:23.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.165+0000 7fcc98a45640 1 -- 172.21.15.60:0/3329903568 shutdown_connections 2024-09-12T02:23:23.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.165+0000 7fcc98a45640 1 --2- 172.21.15.60:0/3329903568 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcc7406be30 0x7fcc7406e2f0 secure :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcc84033000 tx=0x7fcc84009000 comp rx=0 tx=0).stop 2024-09-12T02:23:23.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.165+0000 7fcc98a45640 1 --2- 172.21.15.60:0/3329903568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc9414f820 0x7fcc941f0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:23.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.165+0000 7fcc98a45640 1 --2- 172.21.15.60:0/3329903568 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc940c7230 0x7fcc94146d90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:23.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.165+0000 7fcc98a45640 1 --2- 172.21.15.60:0/3329903568 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc9406edd0 0x7fcc94070dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:23.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.165+0000 7fcc98a45640 1 -- 172.21.15.60:0/3329903568 >> 172.21.15.60:0/3329903568 conn(0x7fcc940c7a40 msgr2=0x7fcc940ab290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:23.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.166+0000 7fcc98a45640 1 -- 172.21.15.60:0/3329903568 shutdown_connections 2024-09-12T02:23:23.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.166+0000 7fcc98a45640 1 -- 172.21.15.60:0/3329903568 wait complete. 2024-09-12T02:23:23.170 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542151 for osd.1 2024-09-12T02:23:23.171 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.4 2024-09-12T02:23:23.177 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.2 2024-09-12T02:23:23.178 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.0 2024-09-12T02:23:23.179 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476745 got 68719476744 for osd.7 2024-09-12T02:23:23.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.179+0000 7fcc4ea77640 1 -- 172.21.15.60:0/3717098334 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fcc400e2500 con 0x7fcc40009050 2024-09-12T02:23:23.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.179+0000 7fcc457fa640 1 -- 172.21.15.60:0/3717098334 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcc3405c990 con 0x7fcc40009050 2024-09-12T02:23:23.180 INFO:teuthology.orchestra.run.smithi060.stdout:68719476745 2024-09-12T02:23:23.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.182+0000 7fcc4ea77640 1 -- 172.21.15.60:0/3717098334 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcc2c06bf00 msgr2=0x7fcc2c06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:23.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.182+0000 7fcc4ea77640 1 --2- 172.21.15.60:0/3717098334 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcc2c06bf00 0x7fcc2c06e3c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c006fd0 tx=0x7fcc3c008040 comp rx=0 tx=0).stop 2024-09-12T02:23:23.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.182+0000 7fcc4ea77640 1 -- 172.21.15.60:0/3717098334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc40009050 msgr2=0x7fcc400ca980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:23.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.182+0000 7fcc4ea77640 1 --2- 172.21.15.60:0/3717098334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc40009050 0x7fcc400ca980 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcc3400c780 tx=0x7fcc3400cc40 comp rx=0 tx=0).stop 2024-09-12T02:23:23.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.182+0000 7fcc4ea77640 1 -- 172.21.15.60:0/3717098334 shutdown_connections 2024-09-12T02:23:23.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.182+0000 7fcc4ea77640 1 --2- 172.21.15.60:0/3717098334 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcc2c06bf00 0x7fcc2c06e3c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:23.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.182+0000 7fcc4ea77640 1 --2- 172.21.15.60:0/3717098334 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc400dbb70 0x7fcc4003d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:23.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.182+0000 7fcc4ea77640 1 --2- 172.21.15.60:0/3717098334 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc4000cc80 0x7fcc400e1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:23.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.182+0000 7fcc4ea77640 1 --2- 172.21.15.60:0/3717098334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc40009050 0x7fcc400ca980 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:23.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.182+0000 7fcc4ea77640 1 -- 172.21.15.60:0/3717098334 >> 172.21.15.60:0/3717098334 conn(0x7fcc4002f040 msgr2=0x7fcc400c8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:23.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.182+0000 7fcc4ea77640 1 -- 172.21.15.60:0/3717098334 shutdown_connections 2024-09-12T02:23:23.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:23.182+0000 7fcc4ea77640 1 -- 172.21.15.60:0/3717098334 wait complete. 2024-09-12T02:23:23.185 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476745 got 68719476744 for osd.6 2024-09-12T02:23:23.194 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476746 got 68719476745 for osd.5 2024-09-12T02:23:24.163 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T02:23:24.171 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T02:23:24.172 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T02:23:24.177 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T02:23:24.179 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T02:23:24.179 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T02:23:24.186 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T02:23:24.195 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T02:23:24.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.333+0000 7f38b1d8d640 1 Processor -- start 2024-09-12T02:23:24.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.334+0000 7f38b1d8d640 1 -- start start 2024-09-12T02:23:24.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.335+0000 7f38b1d8d640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f38ac1564a0 0x7f38ac0c2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.335+0000 7f38b1d8d640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38ac0c6bc0 con 0x7f38ac153240 2024-09-12T02:23:24.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.335+0000 7f38b1d8d640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38ac0c6ea0 con 0x7f38ac0c29e0 2024-09-12T02:23:24.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.335+0000 7f38b1d8d640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f38ac1569a0 con 0x7f38ac1564a0 2024-09-12T02:23:24.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.336+0000 7f38aaffd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f38ac1564a0 0x7f38ac0c2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:24.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.336+0000 7f38aaffd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f38ac1564a0 0x7f38ac0c2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:46560/0 (socket says 172.21.15.60:46560) 2024-09-12T02:23:24.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.336+0000 7f38aaffd640 1 -- 172.21.15.60:0/1920047006 learned_addr learned my addr 172.21.15.60:0/1920047006 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:24.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.336+0000 7f38aa7fc640 1 -- 172.21.15.60:0/1920047006 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4040351690 0 0) 0x7f38ac0c6ea0 con 0x7f38ac0c29e0 2024-09-12T02:23:24.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.336+0000 7f38aa7fc640 1 -- 172.21.15.60:0/1920047006 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3894003520 con 0x7f38ac0c29e0 2024-09-12T02:23:24.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.337+0000 7f38aa7fc640 1 -- 172.21.15.60:0/1920047006 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 274543502 0 0) 0x7f3894003520 con 0x7f38ac0c29e0 2024-09-12T02:23:24.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.337+0000 7f38aa7fc640 1 -- 172.21.15.60:0/1920047006 >> v2:172.21.15.105:3300/0 conn(0x7f38ac1564a0 msgr2=0x7f38ac0c2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:24.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.337+0000 7f38aa7fc640 1 --2- 172.21.15.60:0/1920047006 >> v2:172.21.15.105:3300/0 conn(0x7f38ac1564a0 0x7f38ac0c2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.337+0000 7f38aa7fc640 1 -- 172.21.15.60:0/1920047006 >> v1:172.21.15.60:6789/0 conn(0x7f38ac153240 legacy=0x7f38ac06d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:24.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.337+0000 7f38aa7fc640 1 -- 172.21.15.60:0/1920047006 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38ac06cd90 con 0x7f38ac0c29e0 2024-09-12T02:23:24.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.337+0000 7f38aa7fc640 1 -- 172.21.15.60:0/1920047006 <== mon.1 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7f389c001670 con 0x7f38ac0c29e0 2024-09-12T02:23:24.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.337+0000 7f38aa7fc640 1 -- 172.21.15.60:0/1920047006 >> v1:172.21.15.105:6789/0 conn(0x7f38ac0c29e0 legacy=0x7f38ac152b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:24.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.337+0000 7f38aa7fc640 1 --2- 172.21.15.60:0/1920047006 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38940039b0 0x7f3894003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.337+0000 7f38aa7fc640 1 --2- 172.21.15.60:0/1920047006 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3894004800 0x7f3894004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.337+0000 7f38aa7fc640 1 --2- 172.21.15.60:0/1920047006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38940052c0 0x7f389400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.338+0000 7f38ab7fe640 1 --2- 172.21.15.60:0/1920047006 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38940039b0 0x7f3894003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:24.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.338+0000 7f38aa7fc640 1 -- 172.21.15.60:0/1920047006 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f38ac1569a0 con 0x7f38940052c0 2024-09-12T02:23:24.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.338+0000 7f38aa7fc640 1 -- 172.21.15.60:0/1920047006 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f389400c200 con 0x7f3894004800 2024-09-12T02:23:24.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.338+0000 7f38aa7fc640 1 -- 172.21.15.60:0/1920047006 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f389400c400 con 0x7f38940039b0 2024-09-12T02:23:24.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.339+0000 7f38abfff640 1 --2- 172.21.15.60:0/1920047006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38940052c0 0x7f389400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:24.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.339+0000 7f38ab7fe640 1 -- 172.21.15.60:0/1920047006 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3894004800 msgr2=0x7f3894004c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:23:24.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.339+0000 7f38ab7fe640 1 --2- 172.21.15.60:0/1920047006 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3894004800 0x7f3894004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.339+0000 7f38ab7fe640 1 -- 172.21.15.60:0/1920047006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38940052c0 msgr2=0x7f389400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:24.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.339+0000 7f38ab7fe640 1 --2- 172.21.15.60:0/1920047006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38940052c0 0x7f389400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.339+0000 7f38ab7fe640 1 -- 172.21.15.60:0/1920047006 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3894003520 con 0x7f38940039b0 2024-09-12T02:23:24.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.340+0000 7f38abfff640 1 --2- 172.21.15.60:0/1920047006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38940052c0 0x7f389400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:23:24.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.340+0000 7f38abfff640 1 -- 172.21.15.60:0/1920047006 reap_dead start 2024-09-12T02:23:24.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.341+0000 7f38ab7fe640 1 --2- 172.21.15.60:0/1920047006 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38940039b0 0x7f3894003d90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f389c007f40 tx=0x7f3894005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87ead99df74118a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:24.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.341+0000 7f38aa7fc640 1 -- 172.21.15.60:0/1920047006 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f389c007b90 con 0x7f38940039b0 2024-09-12T02:23:24.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.341+0000 7f38aa7fc640 1 -- 172.21.15.60:0/1920047006 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f389c031620 con 0x7f38940039b0 2024-09-12T02:23:24.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.341+0000 7f38aa7fc640 1 -- 172.21.15.60:0/1920047006 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f389c031a10 con 0x7f38940039b0 2024-09-12T02:23:24.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.342+0000 7f38b1d8d640 1 -- 172.21.15.60:0/1920047006 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38940039b0 msgr2=0x7f3894003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:24.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.342+0000 7f38b1d8d640 1 --2- 172.21.15.60:0/1920047006 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38940039b0 0x7f3894003d90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f389c007f40 tx=0x7f3894005830 comp rx=0 tx=0).stop 2024-09-12T02:23:24.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.343+0000 7f38b1d8d640 1 -- 172.21.15.60:0/1920047006 shutdown_connections 2024-09-12T02:23:24.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.343+0000 7f38b1d8d640 1 --2- 172.21.15.60:0/1920047006 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38940039b0 0x7f3894003d90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.343+0000 7f38b1d8d640 1 -- 172.21.15.60:0/1920047006 >> 172.21.15.60:0/1920047006 conn(0x7f38ac0a9680 msgr2=0x7f38ac0a9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:24.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.343+0000 7f38b1d8d640 1 -- 172.21.15.60:0/1920047006 shutdown_connections 2024-09-12T02:23:24.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.343+0000 7f38b1d8d640 1 -- 172.21.15.60:0/1920047006 wait complete. 2024-09-12T02:23:24.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.345+0000 7f38b1d8d640 1 Processor -- start 2024-09-12T02:23:24.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.345+0000 7f38b1d8d640 1 -- start start 2024-09-12T02:23:24.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.347+0000 7f38b1d8d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38940039b0 0x7f38ac074080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.347+0000 7f38ab7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38940039b0 0x7f38ac074080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:24.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.347+0000 7f38ab7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38940039b0 0x7f38ac074080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49894/0 (socket says 172.21.15.60:49894) 2024-09-12T02:23:24.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.348+0000 7f38ab7fe640 1 -- 172.21.15.60:0/3499078465 learned_addr learned my addr 172.21.15.60:0/3499078465 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:24.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.348+0000 7f38b1d8d640 1 --2- 172.21.15.60:0/3499078465 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38ac0745c0 0x7f38ac1e13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.348+0000 7f38b1d8d640 1 --2- 172.21.15.60:0/3499078465 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38ac1e18e0 0x7f38ac1fbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.348+0000 7f38b1d8d640 1 -- 172.21.15.60:0/3499078465 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f38ac0ad120 con 0x7f38940039b0 2024-09-12T02:23:24.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.348+0000 7f38b1d8d640 1 -- 172.21.15.60:0/3499078465 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f38ac0aa3b0 con 0x7f38ac1e18e0 2024-09-12T02:23:24.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.348+0000 7f38aaffd640 1 --2- 172.21.15.60:0/3499078465 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38ac0745c0 0x7f38ac1e13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:24.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.348+0000 7f38b1d8d640 1 -- 172.21.15.60:0/3499078465 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f38ac0ad2a0 con 0x7f38ac0745c0 2024-09-12T02:23:24.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.349+0000 7f38aaffd640 1 -- 172.21.15.60:0/3499078465 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38ac1e18e0 msgr2=0x7f38ac1fbc80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:23:24.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.349+0000 7f38aaffd640 1 --2- 172.21.15.60:0/3499078465 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38ac1e18e0 0x7f38ac1fbc80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.349+0000 7f38aaffd640 1 -- 172.21.15.60:0/3499078465 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38940039b0 msgr2=0x7f38ac074080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:24.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.349+0000 7f38aaffd640 1 --2- 172.21.15.60:0/3499078465 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38940039b0 0x7f38ac074080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.349+0000 7f38aaffd640 1 -- 172.21.15.60:0/3499078465 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38ac071140 con 0x7f38ac0745c0 2024-09-12T02:23:24.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.350+0000 7f38ab7fe640 1 --2- 172.21.15.60:0/3499078465 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38940039b0 0x7f38ac074080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:23:24.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.350+0000 7f38aaffd640 1 --2- 172.21.15.60:0/3499078465 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38ac0745c0 0x7f38ac1e13a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f38a4009f00 tx=0x7f38a4004410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:24.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.350+0000 7f3893fff640 1 -- 172.21.15.60:0/3499078465 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a400eac0 con 0x7f38ac0745c0 2024-09-12T02:23:24.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.350+0000 7f38b1d8d640 1 -- 172.21.15.60:0/3499078465 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38ac071420 con 0x7f38ac0745c0 2024-09-12T02:23:24.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.351+0000 7f38b1d8d640 1 -- 172.21.15.60:0/3499078465 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f38ac1dff90 con 0x7f38ac0745c0 2024-09-12T02:23:24.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.351+0000 7f3893fff640 1 -- 172.21.15.60:0/3499078465 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38a400ec60 con 0x7f38ac0745c0 2024-09-12T02:23:24.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.351+0000 7f3893fff640 1 -- 172.21.15.60:0/3499078465 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a4017680 con 0x7f38ac0745c0 2024-09-12T02:23:24.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.353+0000 7f3893fff640 1 -- 172.21.15.60:0/3499078465 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f38a4020440 con 0x7f38ac0745c0 2024-09-12T02:23:24.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.354+0000 7f3893fff640 1 --2- 172.21.15.60:0/3499078465 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f389406de30 0x7f38940702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.355+0000 7f38ab7fe640 1 --2- 172.21.15.60:0/3499078465 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f389406de30 0x7f38940702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:24.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.356+0000 7f38ab7fe640 1 --2- 172.21.15.60:0/3499078465 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f389406de30 0x7f38940702f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f389c007f40 tx=0x7f389c02f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:24.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.356+0000 7f3893fff640 1 -- 172.21.15.60:0/3499078465 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f38a408b620 con 0x7f38ac0745c0 2024-09-12T02:23:24.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.356+0000 7f38b1d8d640 1 -- 172.21.15.60:0/3499078465 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f388c005290 con 0x7f38ac0745c0 2024-09-12T02:23:24.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.362+0000 7f3893fff640 1 -- 172.21.15.60:0/3499078465 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f38a4059d10 con 0x7f38ac0745c0 2024-09-12T02:23:24.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.388+0000 7f5685415640 1 Processor -- start 2024-09-12T02:23:24.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.389+0000 7ff1345b9640 1 Processor -- start 2024-09-12T02:23:24.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.388+0000 7f5685415640 1 -- start start 2024-09-12T02:23:24.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.390+0000 7f5685415640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f56800c27d0 0x7f5680152d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.390+0000 7f203c531640 1 Processor -- start 2024-09-12T02:23:24.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.390+0000 7f5685415640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f56800aa270 0x7f568014f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.390+0000 7f5685415640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f56800c3770 0x7f56800c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.390+0000 7f5685415640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f5680152890 con 0x7f56800aa270 2024-09-12T02:23:24.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.390+0000 7f5685415640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f5680152280 con 0x7f56800c3770 2024-09-12T02:23:24.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.390+0000 7f5685415640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f56800c2c60 con 0x7f56800c27d0 2024-09-12T02:23:24.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.390+0000 7f567ffff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f56800c27d0 0x7f5680152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:24.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.390+0000 7f5684c14640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f56800c3770 0x7f56800c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:24.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.390+0000 7f5684c14640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f56800c3770 0x7f56800c58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:46582/0 (socket says 172.21.15.60:46582) 2024-09-12T02:23:24.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.390+0000 7f203c531640 1 -- start start 2024-09-12T02:23:24.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.390+0000 7f2e68827640 1 Processor -- start 2024-09-12T02:23:24.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.391+0000 7f2e68827640 1 -- start start 2024-09-12T02:23:24.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.390+0000 7f5684c14640 1 -- 172.21.15.60:0/4134158442 learned_addr learned my addr 172.21.15.60:0/4134158442 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:24.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.390+0000 7f567f7fe640 1 --2- 172.21.15.60:0/4134158442 >> v2:172.21.15.60:3300/0 conn(0x7f56800aa270 0x7f568014f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:24.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.389+0000 7ff1345b9640 1 -- start start 2024-09-12T02:23:24.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.391+0000 7ff1345b9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff12c0c7800 0x7ff12c153370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.391+0000 7ff1345b9640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff12c0c7d70 con 0x7ff12c0c8770 2024-09-12T02:23:24.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.391+0000 7ff1345b9640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff12c0c8050 con 0x7ff12c1538b0 2024-09-12T02:23:24.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.391+0000 7ff1345b9640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff12c0c9530 con 0x7ff12c0c7800 2024-09-12T02:23:24.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.391+0000 7f5684c14640 1 -- 172.21.15.60:0/4134158442 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f56800c27d0 msgr2=0x7f5680152d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:24.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.391+0000 7f5684c14640 1 --2- 172.21.15.60:0/4134158442 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f56800c27d0 0x7f5680152d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.391+0000 7f5684c14640 1 -- 172.21.15.60:0/4134158442 >> v2:172.21.15.60:3300/0 conn(0x7f56800aa270 msgr2=0x7f568014f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:24.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.391+0000 7f5684c14640 1 --2- 172.21.15.60:0/4134158442 >> v2:172.21.15.60:3300/0 conn(0x7f56800aa270 0x7f568014f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.391+0000 7f5684c14640 1 -- 172.21.15.60:0/4134158442 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5680152520 con 0x7f56800c3770 2024-09-12T02:23:24.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.391+0000 7ff131b54640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff12c0c7800 0x7ff12c153370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:24.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.391+0000 7ff131b54640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff12c0c7800 0x7ff12c153370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:47228/0 (socket says 172.21.15.60:47228) 2024-09-12T02:23:24.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.391+0000 7ff131b54640 1 -- 172.21.15.60:0/3948703707 learned_addr learned my addr 172.21.15.60:0/3948703707 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:24.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.392+0000 7ff131b54640 1 -- 172.21.15.60:0/3948703707 >> v1:172.21.15.105:6789/0 conn(0x7ff12c1538b0 legacy=0x7ff12c06c580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:23:24.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.392+0000 7f203c531640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f20340729c0 0x7f2034072e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.392+0000 7ff131b54640 1 -- 172.21.15.60:0/3948703707 >> v1:172.21.15.60:6789/0 conn(0x7ff12c0c8770 legacy=0x7ff12c156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:24.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.392+0000 7f203c531640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20340c63f0 con 0x7f20340acd50 2024-09-12T02:23:24.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.392+0000 7f203c531640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f203415dda0 con 0x7f2034073390 2024-09-12T02:23:24.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.392+0000 7f203c531640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f2034072270 con 0x7f20340729c0 2024-09-12T02:23:24.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.392+0000 7f2039acc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f20340729c0 0x7f2034072e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:24.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.392+0000 7f2039acc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f20340729c0 0x7f2034072e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49918/0 (socket says 172.21.15.60:49918) 2024-09-12T02:23:24.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.392+0000 7f2039acc640 1 -- 172.21.15.60:0/2692605934 learned_addr learned my addr 172.21.15.60:0/2692605934 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:24.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.392+0000 7f5684c14640 1 --2- 172.21.15.60:0/4134158442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f56800c3770 0x7f56800c58d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5680156780 tx=0x7f567802a570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ad21b8804d34cf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:24.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.393+0000 7f567effd640 1 -- 172.21.15.60:0/4134158442 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5678036070 con 0x7f56800c3770 2024-09-12T02:23:24.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.392+0000 7f2e68827640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2e64150430 0x7f2e64156670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.392+0000 7f2e68827640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e640c5d00 0x7f2e64156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.392+0000 7f2e68827640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2e6406dab0 0x7f2e6406df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.392+0000 7f2e68827640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f2e640c6d00 con 0x7f2e64150430 2024-09-12T02:23:24.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.392+0000 7f2e68827640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f2e641561b0 con 0x7f2e6406dab0 2024-09-12T02:23:24.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.392+0000 7f2e68827640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2e6406eac0 con 0x7f2e640c5d00 2024-09-12T02:23:24.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.392+0000 7f2e62d9d640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2e6406dab0 0x7f2e6406df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:24.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.393+0000 7f2e62d9d640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2e6406dab0 0x7f2e6406df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:46588/0 (socket says 172.21.15.60:46588) 2024-09-12T02:23:24.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.393+0000 7f2e62d9d640 1 -- 172.21.15.60:0/2694441578 learned_addr learned my addr 172.21.15.60:0/2694441578 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:24.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.393+0000 7f2e61d9b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e640c5d00 0x7f2e64156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:24.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.393+0000 7f567effd640 1 -- 172.21.15.60:0/4134158442 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5678031600 con 0x7f56800c3770 2024-09-12T02:23:24.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.393+0000 7f567effd640 1 -- 172.21.15.60:0/4134158442 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56780319d0 con 0x7f56800c3770 2024-09-12T02:23:24.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.392+0000 7ff131b54640 1 -- 172.21.15.60:0/3948703707 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff12c06bd80 con 0x7ff12c0c7800 2024-09-12T02:23:24.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.392+0000 7ff131353640 1 -- 172.21.15.60:0/3948703707 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1303244531 0 0) 0x7ff12c0c7d70 con 0x7ff12c0c8770 2024-09-12T02:23:24.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.393+0000 7f2e62d9d640 1 -- 172.21.15.60:0/2694441578 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e640c5d00 msgr2=0x7f2e64156bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:24.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.393+0000 7f2039acc640 1 -- 172.21.15.60:0/2692605934 >> v1:172.21.15.105:6789/0 conn(0x7f2034073390 legacy=0x7f2034165030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:24.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.393+0000 7f2039acc640 1 -- 172.21.15.60:0/2692605934 >> v1:172.21.15.60:6789/0 conn(0x7f20340acd50 legacy=0x7f203415af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:24.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.393+0000 7f2039acc640 1 -- 172.21.15.60:0/2692605934 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20340724a0 con 0x7f20340729c0 2024-09-12T02:23:24.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.393+0000 7f2e62d9d640 1 --2- 172.21.15.60:0/2694441578 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e640c5d00 0x7f2e64156bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.393+0000 7f2e62d9d640 1 -- 172.21.15.60:0/2694441578 >> v2:172.21.15.60:3300/0 conn(0x7f2e64150430 msgr2=0x7f2e64156670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:24.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.393+0000 7f2e62d9d640 1 --2- 172.21.15.60:0/2694441578 >> v2:172.21.15.60:3300/0 conn(0x7f2e64150430 0x7f2e64156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.393+0000 7ff131b54640 1 --2- 172.21.15.60:0/3948703707 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff12c0c7800 0x7ff12c153370 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff124009e80 tx=0x7ff12402a750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7256901f58c78522 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:24.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.393+0000 7f2e62d9d640 1 -- 172.21.15.60:0/2694441578 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e64159760 con 0x7f2e6406dab0 2024-09-12T02:23:24.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.393+0000 7ff131353640 1 -- 172.21.15.60:0/3948703707 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff124036070 con 0x7ff12c0c7800 2024-09-12T02:23:24.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.393+0000 7ff131353640 1 -- 172.21.15.60:0/3948703707 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff124031600 con 0x7ff12c0c7800 2024-09-12T02:23:24.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.393+0000 7ff131353640 1 -- 172.21.15.60:0/3948703707 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1240319d0 con 0x7ff12c0c7800 2024-09-12T02:23:24.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.394+0000 7f5685415640 1 -- 172.21.15.60:0/4134158442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f56800c3770 msgr2=0x7f56800c58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:24.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.394+0000 7f5685415640 1 --2- 172.21.15.60:0/4134158442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f56800c3770 0x7f56800c58d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5680156780 tx=0x7f567802a570 comp rx=0 tx=0).stop 2024-09-12T02:23:24.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.393+0000 7f2b8c1c4640 1 Processor -- start 2024-09-12T02:23:24.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.394+0000 7f2b8c1c4640 1 -- start start 2024-09-12T02:23:24.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.394+0000 7f5685415640 1 -- 172.21.15.60:0/4134158442 shutdown_connections 2024-09-12T02:23:24.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.394+0000 7f2039acc640 1 --2- 172.21.15.60:0/2692605934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20340729c0 0x7f2034072e50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2030009870 tx=0x7f203002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5700152431060a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:24.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.394+0000 7f2e62d9d640 1 --2- 172.21.15.60:0/2694441578 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e6406dab0 0x7f2e6406df40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2e640a70f0 tx=0x7f2e5c02a610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6834198948222fbb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:24.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.394+0000 7f5685415640 1 --2- 172.21.15.60:0/4134158442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f56800c3770 0x7f56800c58d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.394+0000 7f5685415640 1 --2- 172.21.15.60:0/4134158442 >> v2:172.21.15.60:3300/0 conn(0x7f56800aa270 0x7f568014f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.394+0000 7f5685415640 1 --2- 172.21.15.60:0/4134158442 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f56800c27d0 0x7f5680152d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.394+0000 7f5685415640 1 -- 172.21.15.60:0/4134158442 >> 172.21.15.60:0/4134158442 conn(0x7f56800a9780 msgr2=0x7f56800a9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:24.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.394+0000 7f5685415640 1 -- 172.21.15.60:0/4134158442 shutdown_connections 2024-09-12T02:23:24.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.394+0000 7ff1345b9640 1 -- 172.21.15.60:0/3948703707 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff12c0c7800 msgr2=0x7ff12c153370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:24.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.394+0000 7ff1345b9640 1 --2- 172.21.15.60:0/3948703707 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff12c0c7800 0x7ff12c153370 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff124009e80 tx=0x7ff12402a750 comp rx=0 tx=0).stop 2024-09-12T02:23:24.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.394+0000 7f20392cb640 1 -- 172.21.15.60:0/2692605934 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2030037070 con 0x7f20340729c0 2024-09-12T02:23:24.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.395+0000 7f20392cb640 1 -- 172.21.15.60:0/2692605934 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f203002ada0 con 0x7f20340729c0 2024-09-12T02:23:24.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.395+0000 7ff1345b9640 1 -- 172.21.15.60:0/3948703707 shutdown_connections 2024-09-12T02:23:24.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.395+0000 7ff1345b9640 1 --2- 172.21.15.60:0/3948703707 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff12c0c7800 0x7ff12c153370 secure :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff124009e80 tx=0x7ff12402a750 comp rx=0 tx=0).stop 2024-09-12T02:23:24.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.395+0000 7ff1345b9640 1 -- 172.21.15.60:0/3948703707 >> 172.21.15.60:0/3948703707 conn(0x7ff12c0ad740 msgr2=0x7ff12c0adb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:24.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.395+0000 7f20392cb640 1 -- 172.21.15.60:0/2692605934 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2030032660 con 0x7f20340729c0 2024-09-12T02:23:24.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.395+0000 7f2e6159a640 1 -- 172.21.15.60:0/2694441578 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c036070 con 0x7f2e6406dab0 2024-09-12T02:23:24.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.395+0000 7f2b8c1c4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2b8406e640 0x7f2b8415b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.395+0000 7f2b8c1c4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2b840c5820 0x7f2b84158760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.395+0000 7f2b8c1c4640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b84067ea0 con 0x7f2b8406ea20 2024-09-12T02:23:24.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.395+0000 7f2b8c1c4640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f2b840ab4e0 con 0x7f2b840c5820 2024-09-12T02:23:24.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.395+0000 7f2b8c1c4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2b840ab7c0 con 0x7f2b8406e640 2024-09-12T02:23:24.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.396+0000 7f2b89f60640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2b8406e640 0x7f2b8415b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:24.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.396+0000 7f2b89f60640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2b8406e640 0x7f2b8415b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:47246/0 (socket says 172.21.15.60:47246) 2024-09-12T02:23:24.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.396+0000 7f2b89f60640 1 -- 172.21.15.60:0/353514255 learned_addr learned my addr 172.21.15.60:0/353514255 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:24.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.395+0000 7f203c531640 1 -- 172.21.15.60:0/2692605934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20340729c0 msgr2=0x7f2034072e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:24.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.395+0000 7f203c531640 1 --2- 172.21.15.60:0/2692605934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20340729c0 0x7f2034072e50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2030009870 tx=0x7f203002a110 comp rx=0 tx=0).stop 2024-09-12T02:23:24.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.396+0000 7f203c531640 1 -- 172.21.15.60:0/2692605934 shutdown_connections 2024-09-12T02:23:24.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.396+0000 7f203c531640 1 --2- 172.21.15.60:0/2692605934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20340729c0 0x7f2034072e50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.396+0000 7f203c531640 1 -- 172.21.15.60:0/2692605934 >> 172.21.15.60:0/2692605934 conn(0x7f20340c5660 msgr2=0x7f20340c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:24.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.396+0000 7f203c531640 1 -- 172.21.15.60:0/2692605934 shutdown_connections 2024-09-12T02:23:24.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.395+0000 7ff1345b9640 1 -- 172.21.15.60:0/3948703707 shutdown_connections 2024-09-12T02:23:24.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.395+0000 7f2e6159a640 1 -- 172.21.15.60:0/2694441578 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e5c031600 con 0x7f2e6406dab0 2024-09-12T02:23:24.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.396+0000 7f2b8a761640 1 --2- 172.21.15.60:0/353514255 >> v2:172.21.15.60:3300/0 conn(0x7f2b840c5820 0x7f2b84158760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:24.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.395+0000 7ff1345b9640 1 -- 172.21.15.60:0/3948703707 wait complete. 2024-09-12T02:23:24.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.396+0000 7f2b89f60640 1 -- 172.21.15.60:0/353514255 >> v2:172.21.15.60:3300/0 conn(0x7f2b840c5820 msgr2=0x7f2b84158760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:24.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.396+0000 7f2b89f60640 1 --2- 172.21.15.60:0/353514255 >> v2:172.21.15.60:3300/0 conn(0x7f2b840c5820 0x7f2b84158760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.396+0000 7f2b89f60640 1 -- 172.21.15.60:0/353514255 >> v1:172.21.15.105:6789/0 conn(0x7f2b8406ea20 legacy=0x7f2b840c5110 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:23:24.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.396+0000 7f2b89f60640 1 -- 172.21.15.60:0/353514255 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b840ad580 con 0x7f2b8406e640 2024-09-12T02:23:24.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.396+0000 7f203c531640 1 -- 172.21.15.60:0/2692605934 wait complete. 2024-09-12T02:23:24.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.394+0000 7f5685415640 1 -- 172.21.15.60:0/4134158442 wait complete. 2024-09-12T02:23:24.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.396+0000 7f5685415640 1 Processor -- start 2024-09-12T02:23:24.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.396+0000 7f2e68827640 1 -- 172.21.15.60:0/2694441578 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e6406dab0 msgr2=0x7f2e6406df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:24.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.396+0000 7f2e68827640 1 --2- 172.21.15.60:0/2694441578 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e6406dab0 0x7f2e6406df40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2e640a70f0 tx=0x7f2e5c02a610 comp rx=0 tx=0).stop 2024-09-12T02:23:24.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.397+0000 7ff1345b9640 1 Processor -- start 2024-09-12T02:23:24.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.396+0000 7f5685415640 1 -- start start 2024-09-12T02:23:24.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.397+0000 7f2e68827640 1 -- 172.21.15.60:0/2694441578 shutdown_connections 2024-09-12T02:23:24.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.397+0000 7f2e68827640 1 --2- 172.21.15.60:0/2694441578 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e6406dab0 0x7f2e6406df40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.397+0000 7f2e68827640 1 --2- 172.21.15.60:0/2694441578 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e640c5d00 0x7f2e64156bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.397+0000 7f2e68827640 1 --2- 172.21.15.60:0/2694441578 >> v2:172.21.15.60:3300/0 conn(0x7f2e64150430 0x7f2e64156670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.397+0000 7f2e68827640 1 -- 172.21.15.60:0/2694441578 >> 172.21.15.60:0/2694441578 conn(0x7f2e640c7a40 msgr2=0x7f2e640c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:24.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.397+0000 7ff1345b9640 1 -- start start 2024-09-12T02:23:24.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.397+0000 7f2e68827640 1 -- 172.21.15.60:0/2694441578 shutdown_connections 2024-09-12T02:23:24.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.397+0000 7f3602803640 1 Processor -- start 2024-09-12T02:23:24.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.397+0000 7f2e68827640 1 -- 172.21.15.60:0/2694441578 wait complete. 2024-09-12T02:23:24.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.397+0000 7f203c531640 1 Processor -- start 2024-09-12T02:23:24.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.397+0000 7f203c531640 1 -- start start 2024-09-12T02:23:24.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.398+0000 7f5685415640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f56800aa270 0x7f5680073b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.398+0000 7f5685415640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f56800c3770 0x7f5680139750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.398+0000 7f5685415640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56800bd270 0x7f5680139c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.398+0000 7f5685415640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f56800a7210 con 0x7f56800bd270 2024-09-12T02:23:24.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.398+0000 7f5685415640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f568014fcf0 con 0x7f56800aa270 2024-09-12T02:23:24.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.398+0000 7f5685415640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f56800a7390 con 0x7f56800c3770 2024-09-12T02:23:24.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.398+0000 7f3602803640 1 -- start start 2024-09-12T02:23:24.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.398+0000 7ff1345b9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff12c0c8770 0x7ff12c145140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.398+0000 7ff1345b9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff12c1538b0 0x7ff12c0ac120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.398+0000 7ff1345b9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff12c1f3cd0 0x7ff12c14dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.398+0000 7ff1345b9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff12c0c8b50 con 0x7ff12c1538b0 2024-09-12T02:23:24.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.398+0000 7ff1345b9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff12c0c8cd0 con 0x7ff12c0c8770 2024-09-12T02:23:24.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.398+0000 7ff1345b9640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff12c06cc90 con 0x7ff12c1f3cd0 2024-09-12T02:23:24.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.398+0000 7f5684c14640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56800bd270 0x7f5680139c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:24.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.398+0000 7ff132355640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff12c0c8770 0x7ff12c145140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:24.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.398+0000 7ff132b56640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff12c1f3cd0 0x7ff12c14dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:24.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.398+0000 7ff132355640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff12c0c8770 0x7ff12c145140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:46606/0 (socket says 172.21.15.60:46606) 2024-09-12T02:23:24.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.398+0000 7ff132355640 1 -- 172.21.15.60:0/3630905066 learned_addr learned my addr 172.21.15.60:0/3630905066 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:24.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.398+0000 7ff131b54640 1 --2- 172.21.15.60:0/3630905066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff12c1538b0 0x7ff12c0ac120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:24.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.398+0000 7f5684c14640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56800bd270 0x7f5680139c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49944/0 (socket says 172.21.15.60:49944) 2024-09-12T02:23:24.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.398+0000 7f5684c14640 1 -- 172.21.15.60:0/1624092754 learned_addr learned my addr 172.21.15.60:0/1624092754 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:24.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.398+0000 7f567ffff640 1 --2- 172.21.15.60:0/1624092754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f56800aa270 0x7f5680073b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:24.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.399+0000 7f3602803640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f35f4006c80 0x7f35f40db2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.399+0000 7ff132355640 1 -- 172.21.15.60:0/3630905066 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff12c1f3cd0 msgr2=0x7ff12c14dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:24.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.399+0000 7ff132355640 1 --2- 172.21.15.60:0/3630905066 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff12c1f3cd0 0x7ff12c14dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.399+0000 7ff132355640 1 -- 172.21.15.60:0/3630905066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff12c1538b0 msgr2=0x7ff12c0ac120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:24.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.399+0000 7ff132355640 1 --2- 172.21.15.60:0/3630905066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff12c1538b0 0x7ff12c0ac120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.399+0000 7ff132355640 1 -- 172.21.15.60:0/3630905066 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff12c1e26e0 con 0x7ff12c0c8770 2024-09-12T02:23:24.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.399+0000 7ff132355640 1 --2- 172.21.15.60:0/3630905066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff12c0c8770 0x7ff12c145140 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff12800c460 tx=0x7ff12800c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:24.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.399+0000 7f2e68827640 1 Processor -- start 2024-09-12T02:23:24.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.399+0000 7f3602803640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35f40de2a0 con 0x7f35f404acd0 2024-09-12T02:23:24.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.399+0000 7f3602803640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35f40de580 con 0x7f35f404a4e0 2024-09-12T02:23:24.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.399+0000 7f3602803640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f35f40de860 con 0x7f35f4006c80 2024-09-12T02:23:24.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.399+0000 7ff122ffd640 1 -- 172.21.15.60:0/3630905066 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff128005480 con 0x7ff12c0c8770 2024-09-12T02:23:24.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.400+0000 7ff122ffd640 1 -- 172.21.15.60:0/3630905066 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1280035f0 con 0x7ff12c0c8770 2024-09-12T02:23:24.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.400+0000 7ff122ffd640 1 -- 172.21.15.60:0/3630905066 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1280039c0 con 0x7ff12c0c8770 2024-09-12T02:23:24.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.399+0000 7f3602002640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f35f404acd0 0x7f35f40498a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53956/0 (socket says 172.21.15.60:53956) 2024-09-12T02:23:24.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.399+0000 7f3602002640 1 -- 172.21.15.60:0/3531150986 learned_addr learned my addr 172.21.15.60:0/3531150986 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:24.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.400+0000 7f3601801640 1 --2- 172.21.15.60:0/3531150986 >> v2:172.21.15.105:3300/0 conn(0x7f35f4006c80 0x7f35f40db2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:24.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.399+0000 7f567f7fe640 1 --2- 172.21.15.60:0/1624092754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f56800c3770 0x7f5680139750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:24.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.399+0000 7f567f7fe640 1 -- 172.21.15.60:0/1624092754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f56800aa270 msgr2=0x7f5680073b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:24.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.399+0000 7f567f7fe640 1 --2- 172.21.15.60:0/1624092754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f56800aa270 0x7f5680073b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.399+0000 7f567f7fe640 1 -- 172.21.15.60:0/1624092754 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56800bd270 msgr2=0x7f5680139c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:24.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.399+0000 7f567f7fe640 1 --2- 172.21.15.60:0/1624092754 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56800bd270 0x7f5680139c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.399+0000 7f567f7fe640 1 -- 172.21.15.60:0/1624092754 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56800bd710 con 0x7f56800c3770 2024-09-12T02:23:24.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.400+0000 7f567f7fe640 1 --2- 172.21.15.60:0/1624092754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f56800c3770 0x7f5680139750 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f567400e840 tx=0x7f567400ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:24.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.400+0000 7f567cff9640 1 -- 172.21.15.60:0/1624092754 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5674017070 con 0x7f56800c3770 2024-09-12T02:23:24.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.400+0000 7f567cff9640 1 -- 172.21.15.60:0/1624092754 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f567400c730 con 0x7f56800c3770 2024-09-12T02:23:24.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.400+0000 7f567cff9640 1 -- 172.21.15.60:0/1624092754 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567400cb00 con 0x7f56800c3770 2024-09-12T02:23:24.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.399+0000 7f2b89f60640 1 --2- 172.21.15.60:0/353514255 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2b8406e640 0x7f2b8415b270 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2b74009870 tx=0x7f2b7402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=281de716e5e63e19 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:24.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.399+0000 7f2b88f5e640 1 -- 172.21.15.60:0/353514255 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b74037070 con 0x7f2b8406e640 2024-09-12T02:23:24.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.400+0000 7f567ffff640 1 --2- 172.21.15.60:0/1624092754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f56800aa270 0x7f5680073b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:23:24.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.399+0000 7f2b88f5e640 1 -- 172.21.15.60:0/353514255 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b74032440 con 0x7f2b8406e640 2024-09-12T02:23:24.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.400+0000 7f2b8c1c4640 1 -- 172.21.15.60:0/353514255 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2b8406e640 msgr2=0x7f2b8415b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:24.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.400+0000 7f2b88f5e640 1 -- 172.21.15.60:0/353514255 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b74037070 con 0x7f2b8406e640 2024-09-12T02:23:24.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.400+0000 7f2b8c1c4640 1 --2- 172.21.15.60:0/353514255 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2b8406e640 0x7f2b8415b270 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2b74009870 tx=0x7f2b7402a210 comp rx=0 tx=0).stop 2024-09-12T02:23:24.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.400+0000 7f203c531640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20340729c0 0x7f20341f3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.400+0000 7ff1345b9640 1 -- 172.21.15.60:0/3630905066 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff12c1f0900 con 0x7ff12c0c8770 2024-09-12T02:23:24.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.400+0000 7ff1345b9640 1 -- 172.21.15.60:0/3630905066 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff12c1f0ec0 con 0x7ff12c0c8770 2024-09-12T02:23:24.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.399+0000 7f2e68827640 1 -- start start 2024-09-12T02:23:24.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.400+0000 7f2e68827640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e6406dab0 0x7f2e6414b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.400+0000 7f2e68827640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e640c5d00 0x7f2e64158c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.400+0000 7f203c531640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2034073390 0x7f20341545d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.400+0000 7f3601801640 1 -- 172.21.15.60:0/3531150986 >> v1:172.21.15.105:6789/0 conn(0x7f35f404a4e0 legacy=0x7f35f4049190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:24.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.400+0000 7f5685415640 1 -- 172.21.15.60:0/1624092754 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5680071a00 con 0x7f56800c3770 2024-09-12T02:23:24.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.401+0000 7f5685415640 1 -- 172.21.15.60:0/1624092754 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5680073400 con 0x7f56800c3770 2024-09-12T02:23:24.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.401+0000 7f203a2cd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20340729c0 0x7f20341f3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:24.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.401+0000 7f203a2cd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20340729c0 0x7f20341f3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:47276/0 (socket says 172.21.15.60:47276) 2024-09-12T02:23:24.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.401+0000 7f2039acc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2034073390 0x7f20341545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:24.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.401+0000 7f2e6259c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e6406dab0 0x7f2e6414b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:24.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.401+0000 7f2e6259c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e6406dab0 0x7f2e6414b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:47278/0 (socket says 172.21.15.60:47278) 2024-09-12T02:23:24.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.401+0000 7f2e6259c640 1 -- 172.21.15.60:0/743682006 learned_addr learned my addr 172.21.15.60:0/743682006 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:24.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.400+0000 7f3601801640 1 -- 172.21.15.60:0/3531150986 >> v1:172.21.15.60:6789/0 conn(0x7f35f404acd0 legacy=0x7f35f40498a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:24.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.400+0000 7f35f3fff640 1 -- 172.21.15.60:0/3531150986 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 569499970 0 0) 0x7f35f40de2a0 con 0x7f35f404acd0 2024-09-12T02:23:24.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.400+0000 7f3601801640 1 -- 172.21.15.60:0/3531150986 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35f40deb40 con 0x7f35f4006c80 2024-09-12T02:23:24.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.401+0000 7f2e68827640 1 --2- 172.21.15.60:0/743682006 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e64150430 0x7f2e64159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.401+0000 7f2039acc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2034073390 0x7f20341545d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:46632/0 (socket says 172.21.15.60:46632) 2024-09-12T02:23:24.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.401+0000 7f2e68827640 1 -- 172.21.15.60:0/743682006 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2e640a73c0 con 0x7f2e640c5d00 2024-09-12T02:23:24.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.401+0000 7f203c531640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20340acd50 0x7f20340c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.401+0000 7f203c531640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f20340748b0 con 0x7f20340acd50 2024-09-12T02:23:24.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.401+0000 7f2e68827640 1 -- 172.21.15.60:0/743682006 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2e641570f0 con 0x7f2e64150430 2024-09-12T02:23:24.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.401+0000 7f203c531640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2034074660 con 0x7f2034073390 2024-09-12T02:23:24.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.401+0000 7f203c531640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f20340abc10 con 0x7f20340729c0 2024-09-12T02:23:24.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.401+0000 7f2e62d9d640 1 --2- 172.21.15.60:0/743682006 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e64150430 0x7f2e64159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:24.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.401+0000 7f2e68827640 1 -- 172.21.15.60:0/743682006 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2e64150810 con 0x7f2e6406dab0 2024-09-12T02:23:24.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.401+0000 7f203a2cd640 1 -- 172.21.15.60:0/2608426461 learned_addr learned my addr 172.21.15.60:0/2608426461 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:24.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.401+0000 7fca52786640 1 Processor -- start 2024-09-12T02:23:24.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.402+0000 7f2b8c1c4640 1 -- 172.21.15.60:0/353514255 shutdown_connections 2024-09-12T02:23:24.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.402+0000 7f2b8c1c4640 1 --2- 172.21.15.60:0/353514255 >> v2:172.21.15.60:3300/0 conn(0x7f2b840c5820 0x7f2b84158760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.402+0000 7f2b8c1c4640 1 --2- 172.21.15.60:0/353514255 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2b8406e640 0x7f2b8415b270 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.402+0000 7f2b8c1c4640 1 -- 172.21.15.60:0/353514255 >> 172.21.15.60:0/353514255 conn(0x7f2b840c8430 msgr2=0x7f2b840c8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:24.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.401+0000 7f203aace640 1 --2- 172.21.15.60:0/2608426461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20340acd50 0x7f20340c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:24.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.402+0000 7f203a2cd640 1 -- 172.21.15.60:0/2608426461 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2034073390 msgr2=0x7f20341545d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:24.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.402+0000 7f203a2cd640 1 --2- 172.21.15.60:0/2608426461 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2034073390 0x7f20341545d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.402+0000 7f203a2cd640 1 -- 172.21.15.60:0/2608426461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20340acd50 msgr2=0x7f20340c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:24.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.402+0000 7f203a2cd640 1 --2- 172.21.15.60:0/2608426461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20340acd50 0x7f20340c72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.402+0000 7f2e61d9b640 1 --2- 172.21.15.60:0/743682006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e640c5d00 0x7f2e64158c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:24.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.402+0000 7fca52786640 1 -- start start 2024-09-12T02:23:24.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.402+0000 7f203a2cd640 1 -- 172.21.15.60:0/2608426461 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f203415b9f0 con 0x7f20340729c0 2024-09-12T02:23:24.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.402+0000 7f203aace640 1 --2- 172.21.15.60:0/2608426461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20340acd50 0x7f20340c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:23:24.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.402+0000 7f2e62d9d640 1 -- 172.21.15.60:0/743682006 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e6406dab0 msgr2=0x7f2e6414b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:24.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.402+0000 7f2e62d9d640 1 --2- 172.21.15.60:0/743682006 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e6406dab0 0x7f2e6414b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.402+0000 7f2e62d9d640 1 -- 172.21.15.60:0/743682006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e640c5d00 msgr2=0x7f2e64158c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:24.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.402+0000 7f2e62d9d640 1 --2- 172.21.15.60:0/743682006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e640c5d00 0x7f2e64158c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.402+0000 7f2e62d9d640 1 -- 172.21.15.60:0/743682006 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e6414b7f0 con 0x7f2e64150430 2024-09-12T02:23:24.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.402+0000 7f2e62d9d640 1 --2- 172.21.15.60:0/743682006 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e64150430 0x7f2e64159140 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2e64070720 tx=0x7f2e5c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:24.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.402+0000 7f203a2cd640 1 --2- 172.21.15.60:0/2608426461 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20340729c0 0x7f20341f3d10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f202c00c8c0 tx=0x7f202c00cd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:24.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.402+0000 7f5685415640 1 -- 172.21.15.60:0/1624092754 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f568014f7b0 con 0x7f56800c3770 2024-09-12T02:23:24.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.402+0000 7ff122ffd640 1 -- 172.21.15.60:0/3630905066 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff128003b60 con 0x7ff12c0c8770 2024-09-12T02:23:24.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.402+0000 7f2026ffd640 1 -- 172.21.15.60:0/2608426461 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202c017070 con 0x7f20340729c0 2024-09-12T02:23:24.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.402+0000 7f203c531640 1 -- 172.21.15.60:0/2608426461 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20340c7f90 con 0x7f20340729c0 2024-09-12T02:23:24.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.402+0000 7f2e52ffd640 1 -- 172.21.15.60:0/743682006 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c041020 con 0x7f2e64150430 2024-09-12T02:23:24.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.403+0000 7f203c531640 1 -- 172.21.15.60:0/2608426461 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f20340c8530 con 0x7f20340729c0 2024-09-12T02:23:24.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.403+0000 7ff1345b9640 1 -- 172.21.15.60:0/3630905066 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff12c075a10 con 0x7ff12c0c8770 2024-09-12T02:23:24.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.403+0000 7f2e68827640 1 -- 172.21.15.60:0/743682006 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e640a7890 con 0x7f2e64150430 2024-09-12T02:23:24.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.403+0000 7f2e68827640 1 -- 172.21.15.60:0/743682006 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e640a55a0 con 0x7f2e64150430 2024-09-12T02:23:24.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.403+0000 7f2026ffd640 1 -- 172.21.15.60:0/2608426461 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f202c003da0 con 0x7f20340729c0 2024-09-12T02:23:24.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.403+0000 7f2026ffd640 1 -- 172.21.15.60:0/2608426461 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202c0052b0 con 0x7f20340729c0 2024-09-12T02:23:24.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.403+0000 7f2b8c1c4640 1 -- 172.21.15.60:0/353514255 shutdown_connections 2024-09-12T02:23:24.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.403+0000 7f2e52ffd640 1 -- 172.21.15.60:0/743682006 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e5c03c470 con 0x7f2e64150430 2024-09-12T02:23:24.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.403+0000 7f2e52ffd640 1 -- 172.21.15.60:0/743682006 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c036040 con 0x7f2e64150430 2024-09-12T02:23:24.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.403+0000 7fca52786640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fca4c0a6c10 0x7fca4c0c2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.403+0000 7fca52786640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fca4c0c5940 0x7fca4c06e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.403+0000 7fca52786640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca4c15a970 con 0x7fca4c0c6010 2024-09-12T02:23:24.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.403+0000 7fca52786640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fca4c15ac50 con 0x7fca4c0a6c10 2024-09-12T02:23:24.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.403+0000 7fca52786640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fca4c15af30 con 0x7fca4c0c5940 2024-09-12T02:23:24.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.403+0000 7ff122ffd640 1 --2- 172.21.15.60:0/3630905066 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff11006c020 0x7ff11006e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.403+0000 7fca4bfff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fca4c0a6c10 0x7fca4c0c2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:24.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.403+0000 7fca4bfff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fca4c0a6c10 0x7fca4c0c2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49986/0 (socket says 172.21.15.60:49986) 2024-09-12T02:23:24.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.403+0000 7fca4bfff640 1 -- 172.21.15.60:0/811545566 learned_addr learned my addr 172.21.15.60:0/811545566 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:24.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.403+0000 7f3601801640 1 --2- 172.21.15.60:0/3531150986 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35f4006c80 0x7f35f40db2f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f35f80097a0 tx=0x7f35f802a140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc35977ff407acf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:24.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.403+0000 7fca50d23640 1 --2- 172.21.15.60:0/811545566 >> v2:172.21.15.105:3300/0 conn(0x7fca4c0c5940 0x7fca4c06e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:24.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.404+0000 7f35f3fff640 1 -- 172.21.15.60:0/3531150986 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f8037070 con 0x7f35f4006c80 2024-09-12T02:23:24.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.404+0000 7f35f3fff640 1 -- 172.21.15.60:0/3531150986 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35f802ae50 con 0x7f35f4006c80 2024-09-12T02:23:24.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.403+0000 7f567cff9640 1 -- 172.21.15.60:0/1624092754 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f567401a070 con 0x7f56800c3770 2024-09-12T02:23:24.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.404+0000 7f567cff9640 1 --2- 172.21.15.60:0/1624092754 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f566c06be30 0x7f566c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.404+0000 7f35f3fff640 1 -- 172.21.15.60:0/3531150986 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f8037070 con 0x7f35f4006c80 2024-09-12T02:23:24.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.404+0000 7ff122ffd640 1 -- 172.21.15.60:0/3630905066 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7ff12808ab50 con 0x7ff12c0c8770 2024-09-12T02:23:24.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.404+0000 7ff131b54640 1 --2- 172.21.15.60:0/3630905066 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff11006c020 0x7ff11006e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:24.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.404+0000 7fca4bfff640 1 -- 172.21.15.60:0/811545566 >> v2:172.21.15.105:3300/0 conn(0x7fca4c0c5940 msgr2=0x7fca4c06e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:24.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.404+0000 7fca4bfff640 1 --2- 172.21.15.60:0/811545566 >> v2:172.21.15.105:3300/0 conn(0x7fca4c0c5940 0x7fca4c06e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.404+0000 7fca4bfff640 1 -- 172.21.15.60:0/811545566 >> v1:172.21.15.105:6789/0 conn(0x7fca4c0c6010 legacy=0x7fca4c06dab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:23:24.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.404+0000 7fca4bfff640 1 -- 172.21.15.60:0/811545566 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca4c15b210 con 0x7fca4c0a6c10 2024-09-12T02:23:24.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.405+0000 7ff131b54640 1 --2- 172.21.15.60:0/3630905066 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff11006c020 0x7ff11006e4e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff124033000 tx=0x7ff124009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:24.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.405+0000 7f567cff9640 1 -- 172.21.15.60:0/1624092754 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f56740572f0 con 0x7f56800c3770 2024-09-12T02:23:24.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.405+0000 7f3602803640 1 -- 172.21.15.60:0/3531150986 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35f4006c80 msgr2=0x7f35f40db2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:24.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.405+0000 7f3602803640 1 --2- 172.21.15.60:0/3531150986 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35f4006c80 0x7f35f40db2f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f35f80097a0 tx=0x7f35f802a140 comp rx=0 tx=0).stop 2024-09-12T02:23:24.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.405+0000 7f567ffff640 1 --2- 172.21.15.60:0/1624092754 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f566c06be30 0x7f566c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:24.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.403+0000 7f2b8c1c4640 1 -- 172.21.15.60:0/353514255 wait complete. 2024-09-12T02:23:24.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.405+0000 7f2b8c1c4640 1 Processor -- start 2024-09-12T02:23:24.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.405+0000 7f2b8c1c4640 1 -- start start 2024-09-12T02:23:24.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.405+0000 7f3602803640 1 -- 172.21.15.60:0/3531150986 shutdown_connections 2024-09-12T02:23:24.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.405+0000 7f3602803640 1 --2- 172.21.15.60:0/3531150986 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35f4006c80 0x7f35f40db2f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.405+0000 7f3602803640 1 -- 172.21.15.60:0/3531150986 >> 172.21.15.60:0/3531150986 conn(0x7f35f4047d10 msgr2=0x7f35f4048120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:24.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.405+0000 7fca4bfff640 1 --2- 172.21.15.60:0/811545566 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca4c0a6c10 0x7fca4c0c2440 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fca4c0a9700 tx=0x7fca3402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=140920a9f65ac558 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:24.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.405+0000 7f2e52ffd640 1 -- 172.21.15.60:0/743682006 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2e5c044020 con 0x7f2e64150430 2024-09-12T02:23:24.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.406+0000 7f567ffff640 1 --2- 172.21.15.60:0/1624092754 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f566c06be30 0x7f566c06e2f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f56800ada70 tx=0x7f5670008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:24.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.405+0000 7fca4b7fe640 1 -- 172.21.15.60:0/811545566 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca34037070 con 0x7fca4c0a6c10 2024-09-12T02:23:24.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.406+0000 7fca4b7fe640 1 -- 172.21.15.60:0/811545566 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca34032440 con 0x7fca4c0a6c10 2024-09-12T02:23:24.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.406+0000 7fca4b7fe640 1 -- 172.21.15.60:0/811545566 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca34032810 con 0x7fca4c0a6c10 2024-09-12T02:23:24.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.405+0000 7f3602803640 1 -- 172.21.15.60:0/3531150986 shutdown_connections 2024-09-12T02:23:24.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.406+0000 7f2b8c1c4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2b8406e640 0x7f2b8415ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.406+0000 7f2b8c1c4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b8406ea20 0x7f2b840c4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.406+0000 7f2b8c1c4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b840c5820 0x7f2b84074040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.406+0000 7f2b8c1c4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2b840abc50 con 0x7f2b8406ea20 2024-09-12T02:23:24.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.406+0000 7f2b8c1c4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2b840ad250 con 0x7f2b840c5820 2024-09-12T02:23:24.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.406+0000 7f2e68827640 1 -- 172.21.15.60:0/743682006 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e640c6f70 con 0x7f2e64150430 2024-09-12T02:23:24.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.406+0000 7f2b8c1c4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2b84073c40 con 0x7f2b8406e640 2024-09-12T02:23:24.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.406+0000 7f2b89f60640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2b8406e640 0x7f2b8415ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:24.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.406+0000 7f2e52ffd640 1 --2- 172.21.15.60:0/743682006 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2e4406bf00 0x7f2e4406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.406+0000 7f2b89f60640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2b8406e640 0x7f2b8415ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:47286/0 (socket says 172.21.15.60:47286) 2024-09-12T02:23:24.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.406+0000 7f2b89f60640 1 -- 172.21.15.60:0/2494799442 learned_addr learned my addr 172.21.15.60:0/2494799442 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:24.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.406+0000 7f2b8975f640 1 --2- 172.21.15.60:0/2494799442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b8406ea20 0x7f2b840c4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:24.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.407+0000 7f2e52ffd640 1 -- 172.21.15.60:0/743682006 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f2e5c0ac410 con 0x7f2e64150430 2024-09-12T02:23:24.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.406+0000 7f203c531640 1 -- 172.21.15.60:0/2608426461 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20340adc30 con 0x7f20340729c0 2024-09-12T02:23:24.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.407+0000 7f2e6259c640 1 --2- 172.21.15.60:0/743682006 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2e4406bf00 0x7f2e4406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:24.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.407+0000 7fca52786640 1 -- 172.21.15.60:0/811545566 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca4c0a6c10 msgr2=0x7fca4c0c2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:24.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.407+0000 7fca52786640 1 --2- 172.21.15.60:0/811545566 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca4c0a6c10 0x7fca4c0c2440 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fca4c0a9700 tx=0x7fca3402a1a0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.407+0000 7f2026ffd640 1 -- 172.21.15.60:0/2608426461 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f202c01a070 con 0x7f20340729c0 2024-09-12T02:23:24.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.406+0000 7f3602803640 1 -- 172.21.15.60:0/3531150986 wait complete. 2024-09-12T02:23:24.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.407+0000 7f2b8a761640 1 --2- 172.21.15.60:0/2494799442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b840c5820 0x7f2b84074040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:24.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.407+0000 7fca52786640 1 -- 172.21.15.60:0/811545566 shutdown_connections 2024-09-12T02:23:24.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.407+0000 7fca52786640 1 --2- 172.21.15.60:0/811545566 >> v2:172.21.15.105:3300/0 conn(0x7fca4c0c5940 0x7fca4c06e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.407+0000 7fca52786640 1 --2- 172.21.15.60:0/811545566 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca4c0a6c10 0x7fca4c0c2440 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.407+0000 7fca52786640 1 -- 172.21.15.60:0/811545566 >> 172.21.15.60:0/811545566 conn(0x7fca4c0c7a40 msgr2=0x7fca4c0c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:24.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.407+0000 7f2b89f60640 1 -- 172.21.15.60:0/2494799442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b840c5820 msgr2=0x7f2b84074040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:24.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.407+0000 7f2b89f60640 1 --2- 172.21.15.60:0/2494799442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b840c5820 0x7f2b84074040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.407+0000 7f2b89f60640 1 -- 172.21.15.60:0/2494799442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b8406ea20 msgr2=0x7f2b840c4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:24.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.407+0000 7f3602803640 1 Processor -- start 2024-09-12T02:23:24.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.407+0000 7f2b89f60640 1 --2- 172.21.15.60:0/2494799442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b8406ea20 0x7f2b840c4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.407+0000 7f2026ffd640 1 --2- 172.21.15.60:0/2608426461 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f201806bf30 0x7f201806e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.408+0000 7f2b89f60640 1 -- 172.21.15.60:0/2494799442 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b8415dfc0 con 0x7f2b8406e640 2024-09-12T02:23:24.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.408+0000 7fca52786640 1 -- 172.21.15.60:0/811545566 shutdown_connections 2024-09-12T02:23:24.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.408+0000 7f2b8a761640 1 --2- 172.21.15.60:0/2494799442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b840c5820 0x7f2b84074040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:23:24.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.408+0000 7f2039acc640 1 --2- 172.21.15.60:0/2608426461 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f201806bf30 0x7f201806e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:24.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.408+0000 7f2026ffd640 1 -- 172.21.15.60:0/2608426461 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f202c08a880 con 0x7f20340729c0 2024-09-12T02:23:24.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.408+0000 7f2b8975f640 1 --2- 172.21.15.60:0/2494799442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b8406ea20 0x7f2b840c4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:23:24.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.408+0000 7f2e6259c640 1 --2- 172.21.15.60:0/743682006 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2e4406bf00 0x7f2e4406e3c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2e580099a0 tx=0x7f2e58006f90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:24.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.408+0000 7f3602803640 1 -- start start 2024-09-12T02:23:24.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.408+0000 7fca52786640 1 -- 172.21.15.60:0/811545566 wait complete. 2024-09-12T02:23:24.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.408+0000 7f2b89f60640 1 --2- 172.21.15.60:0/2494799442 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2b8406e640 0x7f2b8415ea80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2b7402a250 tx=0x7f2b740046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:24.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.408+0000 7f2039acc640 1 --2- 172.21.15.60:0/2608426461 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f201806bf30 0x7f201806e3f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2030034000 tx=0x7f203002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:24.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.409+0000 7f3602803640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35f4006c80 0x7f35f40d5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.409+0000 7f3602803640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35f404a4e0 0x7f35f40d3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.409+0000 7f3602803640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35f404acd0 0x7f35f40cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.409+0000 7f3601801640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35f4006c80 0x7f35f40d5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:24.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.409+0000 7f3601000640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35f404a4e0 0x7f35f40d3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:24.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.409+0000 7f3601801640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35f4006c80 0x7f35f40d5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:46662/0 (socket says 172.21.15.60:46662) 2024-09-12T02:23:24.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.409+0000 7f3601801640 1 -- 172.21.15.60:0/1073471270 learned_addr learned my addr 172.21.15.60:0/1073471270 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:24.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.409+0000 7f3602002640 1 --2- 172.21.15.60:0/1073471270 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35f404acd0 0x7f35f40cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:24.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.409+0000 7f3602803640 1 -- 172.21.15.60:0/1073471270 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f35f4007060 con 0x7f35f404a4e0 2024-09-12T02:23:24.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.409+0000 7f3602803640 1 -- 172.21.15.60:0/1073471270 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f35f40ddf50 con 0x7f35f4006c80 2024-09-12T02:23:24.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.409+0000 7f3602803640 1 -- 172.21.15.60:0/1073471270 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f35f40071e0 con 0x7f35f404acd0 2024-09-12T02:23:24.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.409+0000 7f3601000640 1 -- 172.21.15.60:0/1073471270 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35f404acd0 msgr2=0x7f35f40cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:24.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.409+0000 7f3601000640 1 --2- 172.21.15.60:0/1073471270 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35f404acd0 0x7f35f40cf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.409+0000 7f3601000640 1 -- 172.21.15.60:0/1073471270 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35f4006c80 msgr2=0x7f35f40d5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:24.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.409+0000 7fca52786640 1 Processor -- start 2024-09-12T02:23:24.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.409+0000 7f3601000640 1 --2- 172.21.15.60:0/1073471270 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35f4006c80 0x7f35f40d5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.409+0000 7f3601000640 1 -- 172.21.15.60:0/1073471270 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35f40e2350 con 0x7f35f404a4e0 2024-09-12T02:23:24.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.409+0000 7f3601801640 1 --2- 172.21.15.60:0/1073471270 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35f4006c80 0x7f35f40d5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:23:24.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.410+0000 7fca52786640 1 -- start start 2024-09-12T02:23:24.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.410+0000 7f3601000640 1 --2- 172.21.15.60:0/1073471270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35f404a4e0 0x7f35f40d3e50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f35ec00c410 tx=0x7f35ec00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:24.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.410+0000 7f35f1ffb640 1 -- 172.21.15.60:0/1073471270 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35ec017070 con 0x7f35f404a4e0 2024-09-12T02:23:24.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.410+0000 7f35f1ffb640 1 -- 172.21.15.60:0/1073471270 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35ec0035f0 con 0x7f35f404a4e0 2024-09-12T02:23:24.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.410+0000 7f35f1ffb640 1 -- 172.21.15.60:0/1073471270 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35ec003a20 con 0x7f35f404a4e0 2024-09-12T02:23:24.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.410+0000 7f3602803640 1 -- 172.21.15.60:0/1073471270 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35f40d1210 con 0x7f35f404a4e0 2024-09-12T02:23:24.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.410+0000 7f3602803640 1 -- 172.21.15.60:0/1073471270 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35f40d5930 con 0x7f35f404a4e0 2024-09-12T02:23:24.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.411+0000 7fca52786640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca4c0c5940 0x7fca4c0c6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.411+0000 7fca52786640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca4c0c6010 0x7fca4c153a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.411+0000 7fca52786640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca4c15e5c0 0x7fca4c153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.411+0000 7fca52786640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fca4c0a73a0 con 0x7fca4c0c5940 2024-09-12T02:23:24.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.411+0000 7fca52786640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fca4c15a620 con 0x7fca4c0c6010 2024-09-12T02:23:24.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.411+0000 7fca52786640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fca4c0a7520 con 0x7fca4c15e5c0 2024-09-12T02:23:24.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.411+0000 7fca437fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca4c0c6010 0x7fca4c153a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:24.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.411+0000 7fca50d23640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca4c15e5c0 0x7fca4c153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:24.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.411+0000 7fca50d23640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca4c15e5c0 0x7fca4c153fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:47314/0 (socket says 172.21.15.60:47314) 2024-09-12T02:23:24.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.411+0000 7fca437fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca4c0c6010 0x7fca4c153a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:46666/0 (socket says 172.21.15.60:46666) 2024-09-12T02:23:24.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.411+0000 7fca50d23640 1 -- 172.21.15.60:0/2352254799 learned_addr learned my addr 172.21.15.60:0/2352254799 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:24.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.411+0000 7fca50d23640 1 -- 172.21.15.60:0/2352254799 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca4c0c6010 msgr2=0x7fca4c153a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:24.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.411+0000 7fca50d23640 1 --2- 172.21.15.60:0/2352254799 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca4c0c6010 0x7fca4c153a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.411+0000 7fca50d23640 1 -- 172.21.15.60:0/2352254799 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca4c0c5940 msgr2=0x7fca4c0c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:24.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.411+0000 7fca50d23640 1 --2- 172.21.15.60:0/2352254799 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca4c0c5940 0x7fca4c0c6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.411+0000 7fca50d23640 1 -- 172.21.15.60:0/2352254799 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca4c0aaa40 con 0x7fca4c15e5c0 2024-09-12T02:23:24.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.412+0000 7fca50d23640 1 --2- 172.21.15.60:0/2352254799 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca4c15e5c0 0x7fca4c153fd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fca4400cd40 tx=0x7fca4400a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:24.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.412+0000 7f3602803640 1 -- 172.21.15.60:0/1073471270 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35f40db2f0 con 0x7f35f404a4e0 2024-09-12T02:23:24.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.412+0000 7f35f1ffb640 1 -- 172.21.15.60:0/1073471270 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f35ec003bc0 con 0x7f35f404a4e0 2024-09-12T02:23:24.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.413+0000 7f35f1ffb640 1 --2- 172.21.15.60:0/1073471270 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f35e006be30 0x7f35e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.413+0000 7f3601801640 1 --2- 172.21.15.60:0/1073471270 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f35e006be30 0x7f35e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:24.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.413+0000 7f35f1ffb640 1 -- 172.21.15.60:0/1073471270 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f35ec08a340 con 0x7f35f404a4e0 2024-09-12T02:23:24.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.413+0000 7f3601801640 1 --2- 172.21.15.60:0/1073471270 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f35e006be30 0x7f35e006e2f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f35f80097a0 tx=0x7f35f802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:24.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.414+0000 7ff122ffd640 1 -- 172.21.15.60:0/3630905066 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff12c1e26e0 con 0x7ff12c0c8770 2024-09-12T02:23:24.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.415+0000 7f567cff9640 1 -- 172.21.15.60:0/1624092754 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5674059250 con 0x7f56800c3770 2024-09-12T02:23:24.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.417+0000 7f35f1ffb640 1 -- 172.21.15.60:0/1073471270 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f35ec0584c0 con 0x7f35f404a4e0 2024-09-12T02:23:24.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.424+0000 7f2e52ffd640 1 -- 172.21.15.60:0/743682006 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2e5c07ab00 con 0x7f2e64150430 2024-09-12T02:23:24.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.424+0000 7f2026ffd640 1 -- 172.21.15.60:0/2608426461 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f202c058920 con 0x7f20340729c0 2024-09-12T02:23:24.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.424+0000 7fca497fa640 1 -- 172.21.15.60:0/2352254799 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca44003b90 con 0x7fca4c15e5c0 2024-09-12T02:23:24.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.424+0000 7fca497fa640 1 -- 172.21.15.60:0/2352254799 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca44003d30 con 0x7fca4c15e5c0 2024-09-12T02:23:24.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.425+0000 7fca52786640 1 -- 172.21.15.60:0/2352254799 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca4c0abaa0 con 0x7fca4c15e5c0 2024-09-12T02:23:24.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.425+0000 7fca497fa640 1 -- 172.21.15.60:0/2352254799 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca44004240 con 0x7fca4c15e5c0 2024-09-12T02:23:24.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.425+0000 7fca52786640 1 -- 172.21.15.60:0/2352254799 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fca4c0aafc0 con 0x7fca4c15e5c0 2024-09-12T02:23:24.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.425+0000 7f2b7a7fc640 1 -- 172.21.15.60:0/2494799442 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b74041020 con 0x7f2b8406e640 2024-09-12T02:23:24.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.426+0000 7f2b7a7fc640 1 -- 172.21.15.60:0/2494799442 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b740325f0 con 0x7f2b8406e640 2024-09-12T02:23:24.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.426+0000 7f2b7a7fc640 1 -- 172.21.15.60:0/2494799442 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b74037040 con 0x7f2b8406e640 2024-09-12T02:23:24.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.427+0000 7f2b8c1c4640 1 -- 172.21.15.60:0/2494799442 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b841f9430 con 0x7f2b8406e640 2024-09-12T02:23:24.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.427+0000 7f2b8c1c4640 1 -- 172.21.15.60:0/2494799442 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b8415e540 con 0x7f2b8406e640 2024-09-12T02:23:24.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.428+0000 7fca52786640 1 -- 172.21.15.60:0/2352254799 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca30005290 con 0x7fca4c15e5c0 2024-09-12T02:23:24.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.428+0000 7f2b8c1c4640 1 -- 172.21.15.60:0/2494799442 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b8406ee60 con 0x7f2b8406e640 2024-09-12T02:23:24.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.429+0000 7fca497fa640 1 -- 172.21.15.60:0/2352254799 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fca440043e0 con 0x7fca4c15e5c0 2024-09-12T02:23:24.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.430+0000 7fca497fa640 1 --2- 172.21.15.60:0/2352254799 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fca2c06bf00 0x7fca2c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.430+0000 7fca497fa640 1 -- 172.21.15.60:0/2352254799 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7fca4408bb00 con 0x7fca4c15e5c0 2024-09-12T02:23:24.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.430+0000 7fca4bfff640 1 --2- 172.21.15.60:0/2352254799 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fca2c06bf00 0x7fca2c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:24.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.431+0000 7fca4bfff640 1 --2- 172.21.15.60:0/2352254799 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fca2c06bf00 0x7fca2c06e3c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fca34034000 tx=0x7fca3402c000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:24.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.430+0000 7f2b7a7fc640 1 -- 172.21.15.60:0/2494799442 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2b74044020 con 0x7f2b8406e640 2024-09-12T02:23:24.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.430+0000 7f2b7a7fc640 1 --2- 172.21.15.60:0/2494799442 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2b6806be30 0x7f2b6806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:24.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.430+0000 7f2b7a7fc640 1 -- 172.21.15.60:0/2494799442 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f2b740ab9b0 con 0x7f2b8406e640 2024-09-12T02:23:24.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.431+0000 7f2b8975f640 1 --2- 172.21.15.60:0/2494799442 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2b6806be30 0x7f2b6806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:24.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.432+0000 7f2b8975f640 1 --2- 172.21.15.60:0/2494799442 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2b6806be30 0x7f2b6806e2f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2b84157960 tx=0x7f2b800090e0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:24.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.434+0000 7fca497fa640 1 -- 172.21.15.60:0/2352254799 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fca4405a1f0 con 0x7fca4c15e5c0 2024-09-12T02:23:24.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.438+0000 7f2b7a7fc640 1 -- 172.21.15.60:0/2494799442 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2b7404b030 con 0x7f2b8406e640 2024-09-12T02:23:24.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.757+0000 7f38b1d8d640 1 -- 172.21.15.60:0/3499078465 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f388c005580 con 0x7f38ac0745c0 2024-09-12T02:23:24.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.759+0000 7f3893fff640 1 -- 172.21.15.60:0/3499078465 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f38a4059610 con 0x7f38ac0745c0 2024-09-12T02:23:24.759 INFO:teuthology.orchestra.run.smithi060.stdout:60129542152 2024-09-12T02:23:24.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.762+0000 7f38b1d8d640 1 -- 172.21.15.60:0/3499078465 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f389406de30 msgr2=0x7f38940702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:24.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.762+0000 7f38b1d8d640 1 --2- 172.21.15.60:0/3499078465 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f389406de30 0x7f38940702f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f389c007f40 tx=0x7f389c02f000 comp rx=0 tx=0).stop 2024-09-12T02:23:24.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.762+0000 7f38b1d8d640 1 -- 172.21.15.60:0/3499078465 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38ac0745c0 msgr2=0x7f38ac1e13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:24.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.762+0000 7f38b1d8d640 1 --2- 172.21.15.60:0/3499078465 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38ac0745c0 0x7f38ac1e13a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f38a4009f00 tx=0x7f38a4004410 comp rx=0 tx=0).stop 2024-09-12T02:23:24.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.762+0000 7f38b1d8d640 1 -- 172.21.15.60:0/3499078465 shutdown_connections 2024-09-12T02:23:24.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.762+0000 7f38b1d8d640 1 --2- 172.21.15.60:0/3499078465 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f389406de30 0x7f38940702f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.762+0000 7f38b1d8d640 1 --2- 172.21.15.60:0/3499078465 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38ac1e18e0 0x7f38ac1fbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.763+0000 7f38b1d8d640 1 --2- 172.21.15.60:0/3499078465 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38ac0745c0 0x7f38ac1e13a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.763+0000 7f38b1d8d640 1 --2- 172.21.15.60:0/3499078465 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38940039b0 0x7f38ac074080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.763+0000 7f38b1d8d640 1 -- 172.21.15.60:0/3499078465 >> 172.21.15.60:0/3499078465 conn(0x7f38ac0a9680 msgr2=0x7f38ac06d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:24.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.763+0000 7f38b1d8d640 1 -- 172.21.15.60:0/3499078465 shutdown_connections 2024-09-12T02:23:24.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.763+0000 7f38b1d8d640 1 -- 172.21.15.60:0/3499078465 wait complete. 2024-09-12T02:23:24.780 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542152 for osd.3 2024-09-12T02:23:24.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.800+0000 7f2e68827640 1 -- 172.21.15.60:0/743682006 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f2e64159b00 con 0x7f2e64150430 2024-09-12T02:23:24.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.800+0000 7f2e52ffd640 1 -- 172.21.15.60:0/743682006 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2e5c07a400 con 0x7f2e64150430 2024-09-12T02:23:24.801 INFO:teuthology.orchestra.run.smithi060.stdout:64424509448 2024-09-12T02:23:24.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.802+0000 7f2e68827640 1 -- 172.21.15.60:0/743682006 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2e4406bf00 msgr2=0x7f2e4406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:24.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.802+0000 7f2e68827640 1 --2- 172.21.15.60:0/743682006 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2e4406bf00 0x7f2e4406e3c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2e580099a0 tx=0x7f2e58006f90 comp rx=0 tx=0).stop 2024-09-12T02:23:24.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.803+0000 7f2e68827640 1 -- 172.21.15.60:0/743682006 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e64150430 msgr2=0x7f2e64159140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:24.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.803+0000 7f2e68827640 1 --2- 172.21.15.60:0/743682006 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e64150430 0x7f2e64159140 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2e64070720 tx=0x7f2e5c004a40 comp rx=0 tx=0).stop 2024-09-12T02:23:24.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.803+0000 7f2e68827640 1 -- 172.21.15.60:0/743682006 shutdown_connections 2024-09-12T02:23:24.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.803+0000 7f2e68827640 1 --2- 172.21.15.60:0/743682006 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2e4406bf00 0x7f2e4406e3c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.803+0000 7f2e68827640 1 --2- 172.21.15.60:0/743682006 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e64150430 0x7f2e64159140 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.803+0000 7f2e68827640 1 --2- 172.21.15.60:0/743682006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e640c5d00 0x7f2e64158c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.803+0000 7f2e68827640 1 --2- 172.21.15.60:0/743682006 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e6406dab0 0x7f2e6414b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.803+0000 7f2e68827640 1 -- 172.21.15.60:0/743682006 >> 172.21.15.60:0/743682006 conn(0x7f2e640c7a40 msgr2=0x7f2e640c38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:24.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.803+0000 7f2e68827640 1 -- 172.21.15.60:0/743682006 shutdown_connections 2024-09-12T02:23:24.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.803+0000 7f2e68827640 1 -- 172.21.15.60:0/743682006 wait complete. 2024-09-12T02:23:24.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.813+0000 7ff1345b9640 1 -- 172.21.15.60:0/3630905066 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7ff12c0c98d0 con 0x7ff12c0c8770 2024-09-12T02:23:24.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.813+0000 7ff122ffd640 1 -- 172.21.15.60:0/3630905066 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff12c0c98d0 con 0x7ff12c0c8770 2024-09-12T02:23:24.814 INFO:teuthology.orchestra.run.smithi060.stdout:64424509446 2024-09-12T02:23:24.815 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.0 2024-09-12T02:23:24.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.817+0000 7ff1345b9640 1 -- 172.21.15.60:0/3630905066 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff11006c020 msgr2=0x7ff11006e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:24.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.817+0000 7ff1345b9640 1 --2- 172.21.15.60:0/3630905066 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff11006c020 0x7ff11006e4e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff124033000 tx=0x7ff124009000 comp rx=0 tx=0).stop 2024-09-12T02:23:24.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.817+0000 7ff1345b9640 1 -- 172.21.15.60:0/3630905066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff12c0c8770 msgr2=0x7ff12c145140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:24.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.817+0000 7ff1345b9640 1 --2- 172.21.15.60:0/3630905066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff12c0c8770 0x7ff12c145140 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff12800c460 tx=0x7ff12800c920 comp rx=0 tx=0).stop 2024-09-12T02:23:24.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.817+0000 7ff1345b9640 1 -- 172.21.15.60:0/3630905066 shutdown_connections 2024-09-12T02:23:24.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.817+0000 7ff1345b9640 1 --2- 172.21.15.60:0/3630905066 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff11006c020 0x7ff11006e4e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.817+0000 7ff1345b9640 1 --2- 172.21.15.60:0/3630905066 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff12c1f3cd0 0x7ff12c14dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.817+0000 7ff1345b9640 1 --2- 172.21.15.60:0/3630905066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff12c1538b0 0x7ff12c0ac120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.817+0000 7ff1345b9640 1 --2- 172.21.15.60:0/3630905066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff12c0c8770 0x7ff12c145140 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.817+0000 7ff1345b9640 1 -- 172.21.15.60:0/3630905066 >> 172.21.15.60:0/3630905066 conn(0x7ff12c0ad740 msgr2=0x7ff12c0ca6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:24.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.817+0000 7ff1345b9640 1 -- 172.21.15.60:0/3630905066 shutdown_connections 2024-09-12T02:23:24.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.817+0000 7ff1345b9640 1 -- 172.21.15.60:0/3630905066 wait complete. 2024-09-12T02:23:24.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.824+0000 7f5685415640 1 -- 172.21.15.60:0/1624092754 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f568013a1d0 con 0x7f56800c3770 2024-09-12T02:23:24.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.824+0000 7f567cff9640 1 -- 172.21.15.60:0/1624092754 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f567405d550 con 0x7f56800c3770 2024-09-12T02:23:24.825 INFO:teuthology.orchestra.run.smithi060.stdout:68719476744 2024-09-12T02:23:24.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.828+0000 7f5685415640 1 -- 172.21.15.60:0/1624092754 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f566c06be30 msgr2=0x7f566c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:24.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.828+0000 7f5685415640 1 --2- 172.21.15.60:0/1624092754 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f566c06be30 0x7f566c06e2f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f56800ada70 tx=0x7f5670008040 comp rx=0 tx=0).stop 2024-09-12T02:23:24.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.828+0000 7f5685415640 1 -- 172.21.15.60:0/1624092754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f56800c3770 msgr2=0x7f5680139750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:24.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.828+0000 7f5685415640 1 --2- 172.21.15.60:0/1624092754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f56800c3770 0x7f5680139750 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f567400e840 tx=0x7f567400ed00 comp rx=0 tx=0).stop 2024-09-12T02:23:24.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.828+0000 7f5685415640 1 -- 172.21.15.60:0/1624092754 shutdown_connections 2024-09-12T02:23:24.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.828+0000 7f5685415640 1 --2- 172.21.15.60:0/1624092754 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f566c06be30 0x7f566c06e2f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.828+0000 7f5685415640 1 --2- 172.21.15.60:0/1624092754 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56800bd270 0x7f5680139c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.828+0000 7f5685415640 1 --2- 172.21.15.60:0/1624092754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f56800c3770 0x7f5680139750 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.828+0000 7f5685415640 1 --2- 172.21.15.60:0/1624092754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f56800aa270 0x7f5680073b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.828+0000 7f5685415640 1 -- 172.21.15.60:0/1624092754 >> 172.21.15.60:0/1624092754 conn(0x7f56800a9780 msgr2=0x7f5680151490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:24.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.828+0000 7f5685415640 1 -- 172.21.15.60:0/1624092754 shutdown_connections 2024-09-12T02:23:24.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.828+0000 7f5685415640 1 -- 172.21.15.60:0/1624092754 wait complete. 2024-09-12T02:23:24.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.829+0000 7f3602803640 1 -- 172.21.15.60:0/1073471270 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f35f40d9c20 con 0x7f35f404a4e0 2024-09-12T02:23:24.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.829+0000 7f35f1ffb640 1 -- 172.21.15.60:0/1073471270 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f35ec05c7c0 con 0x7f35f404a4e0 2024-09-12T02:23:24.830 INFO:teuthology.orchestra.run.smithi060.stdout:68719476744 2024-09-12T02:23:24.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.832+0000 7f3602803640 1 -- 172.21.15.60:0/1073471270 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f35e006be30 msgr2=0x7f35e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:24.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.832+0000 7f3602803640 1 --2- 172.21.15.60:0/1073471270 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f35e006be30 0x7f35e006e2f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f35f80097a0 tx=0x7f35f802e000 comp rx=0 tx=0).stop 2024-09-12T02:23:24.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.832+0000 7f3602803640 1 -- 172.21.15.60:0/1073471270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35f404a4e0 msgr2=0x7f35f40d3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:24.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.832+0000 7f3602803640 1 --2- 172.21.15.60:0/1073471270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35f404a4e0 0x7f35f40d3e50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f35ec00c410 tx=0x7f35ec00c810 comp rx=0 tx=0).stop 2024-09-12T02:23:24.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.832+0000 7f3602803640 1 -- 172.21.15.60:0/1073471270 shutdown_connections 2024-09-12T02:23:24.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.832+0000 7f3602803640 1 --2- 172.21.15.60:0/1073471270 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f35e006be30 0x7f35e006e2f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.832+0000 7f3602803640 1 --2- 172.21.15.60:0/1073471270 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35f404acd0 0x7f35f40cf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.832+0000 7f3602803640 1 --2- 172.21.15.60:0/1073471270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35f404a4e0 0x7f35f40d3e50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.832+0000 7f3602803640 1 --2- 172.21.15.60:0/1073471270 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35f4006c80 0x7f35f40d5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.832+0000 7f3602803640 1 -- 172.21.15.60:0/1073471270 >> 172.21.15.60:0/1073471270 conn(0x7f35f4047d10 msgr2=0x7f35f40dd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:24.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.832+0000 7f3602803640 1 -- 172.21.15.60:0/1073471270 shutdown_connections 2024-09-12T02:23:24.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.832+0000 7f3602803640 1 -- 172.21.15.60:0/1073471270 wait complete. 2024-09-12T02:23:24.835 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.2 2024-09-12T02:23:24.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.834+0000 7f203c531640 1 -- 172.21.15.60:0/2608426461 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f2034154b10 con 0x7f20340729c0 2024-09-12T02:23:24.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.834+0000 7f2026ffd640 1 -- 172.21.15.60:0/2608426461 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f202c05cc20 con 0x7f20340729c0 2024-09-12T02:23:24.836 INFO:teuthology.orchestra.run.smithi060.stdout:64424509447 2024-09-12T02:23:24.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.838+0000 7f2b8c1c4640 1 -- 172.21.15.60:0/2494799442 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f2b84158d20 con 0x7f2b8406e640 2024-09-12T02:23:24.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.838+0000 7f203c531640 1 -- 172.21.15.60:0/2608426461 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f201806bf30 msgr2=0x7f201806e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:24.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.838+0000 7f203c531640 1 --2- 172.21.15.60:0/2608426461 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f201806bf30 0x7f201806e3f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2030034000 tx=0x7f203002e000 comp rx=0 tx=0).stop 2024-09-12T02:23:24.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.838+0000 7f203c531640 1 -- 172.21.15.60:0/2608426461 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20340729c0 msgr2=0x7f20341f3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:24.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.838+0000 7f203c531640 1 --2- 172.21.15.60:0/2608426461 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20340729c0 0x7f20341f3d10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f202c00c8c0 tx=0x7f202c00cd80 comp rx=0 tx=0).stop 2024-09-12T02:23:24.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.838+0000 7f203c531640 1 -- 172.21.15.60:0/2608426461 shutdown_connections 2024-09-12T02:23:24.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.838+0000 7f203c531640 1 --2- 172.21.15.60:0/2608426461 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f201806bf30 0x7f201806e3f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.838+0000 7f203c531640 1 --2- 172.21.15.60:0/2608426461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20340acd50 0x7f20340c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.838+0000 7f203c531640 1 --2- 172.21.15.60:0/2608426461 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2034073390 0x7f20341545d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.838+0000 7f203c531640 1 --2- 172.21.15.60:0/2608426461 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20340729c0 0x7f20341f3d10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.838+0000 7f203c531640 1 -- 172.21.15.60:0/2608426461 >> 172.21.15.60:0/2608426461 conn(0x7f20340c5660 msgr2=0x7f203415af10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:24.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.839+0000 7f203c531640 1 -- 172.21.15.60:0/2608426461 shutdown_connections 2024-09-12T02:23:24.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.839+0000 7f203c531640 1 -- 172.21.15.60:0/2608426461 wait complete. 2024-09-12T02:23:24.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.839+0000 7f2b7a7fc640 1 -- 172.21.15.60:0/2494799442 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2b7404b030 con 0x7f2b8406e640 2024-09-12T02:23:24.841 INFO:teuthology.orchestra.run.smithi060.stdout:60129542151 2024-09-12T02:23:24.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.841+0000 7f2b8c1c4640 1 -- 172.21.15.60:0/2494799442 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2b6806be30 msgr2=0x7f2b6806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:24.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.841+0000 7f2b8c1c4640 1 --2- 172.21.15.60:0/2494799442 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2b6806be30 0x7f2b6806e2f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2b84157960 tx=0x7f2b800090e0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.841+0000 7f2b8c1c4640 1 -- 172.21.15.60:0/2494799442 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2b8406e640 msgr2=0x7f2b8415ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:24.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.841+0000 7f2b8c1c4640 1 --2- 172.21.15.60:0/2494799442 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2b8406e640 0x7f2b8415ea80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2b7402a250 tx=0x7f2b740046c0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.841+0000 7f2b8c1c4640 1 -- 172.21.15.60:0/2494799442 shutdown_connections 2024-09-12T02:23:24.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.841+0000 7f2b8c1c4640 1 --2- 172.21.15.60:0/2494799442 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2b6806be30 0x7f2b6806e2f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.841+0000 7f2b8c1c4640 1 --2- 172.21.15.60:0/2494799442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b840c5820 0x7f2b84074040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.841+0000 7f2b8c1c4640 1 --2- 172.21.15.60:0/2494799442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b8406ea20 0x7f2b840c4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.841+0000 7f2b8c1c4640 1 --2- 172.21.15.60:0/2494799442 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2b8406e640 0x7f2b8415ea80 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.841+0000 7f2b8c1c4640 1 -- 172.21.15.60:0/2494799442 >> 172.21.15.60:0/2494799442 conn(0x7f2b840c8430 msgr2=0x7f2b840c4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:24.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.842+0000 7f2b8c1c4640 1 -- 172.21.15.60:0/2494799442 shutdown_connections 2024-09-12T02:23:24.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.842+0000 7f2b8c1c4640 1 -- 172.21.15.60:0/2494799442 wait complete. 2024-09-12T02:23:24.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.843+0000 7fca52786640 1 -- 172.21.15.60:0/2352254799 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fca30005580 con 0x7fca4c15e5c0 2024-09-12T02:23:24.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.843+0000 7fca497fa640 1 -- 172.21.15.60:0/2352254799 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fca44059af0 con 0x7fca4c15e5c0 2024-09-12T02:23:24.844 INFO:teuthology.orchestra.run.smithi060.stdout:68719476745 2024-09-12T02:23:24.845 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476745 got 68719476744 for osd.7 2024-09-12T02:23:24.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.846+0000 7fca52786640 1 -- 172.21.15.60:0/2352254799 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fca2c06bf00 msgr2=0x7fca2c06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:24.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.846+0000 7fca52786640 1 --2- 172.21.15.60:0/2352254799 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fca2c06bf00 0x7fca2c06e3c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fca34034000 tx=0x7fca3402c000 comp rx=0 tx=0).stop 2024-09-12T02:23:24.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.846+0000 7fca52786640 1 -- 172.21.15.60:0/2352254799 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca4c15e5c0 msgr2=0x7fca4c153fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:24.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.846+0000 7fca52786640 1 --2- 172.21.15.60:0/2352254799 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca4c15e5c0 0x7fca4c153fd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fca4400cd40 tx=0x7fca4400a660 comp rx=0 tx=0).stop 2024-09-12T02:23:24.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.847+0000 7fca52786640 1 -- 172.21.15.60:0/2352254799 shutdown_connections 2024-09-12T02:23:24.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.847+0000 7fca52786640 1 --2- 172.21.15.60:0/2352254799 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fca2c06bf00 0x7fca2c06e3c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.847+0000 7fca52786640 1 --2- 172.21.15.60:0/2352254799 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca4c15e5c0 0x7fca4c153fd0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.847+0000 7fca52786640 1 --2- 172.21.15.60:0/2352254799 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca4c0c6010 0x7fca4c153a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.847+0000 7fca52786640 1 --2- 172.21.15.60:0/2352254799 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca4c0c5940 0x7fca4c0c6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:24.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.847+0000 7fca52786640 1 -- 172.21.15.60:0/2352254799 >> 172.21.15.60:0/2352254799 conn(0x7fca4c0c7a40 msgr2=0x7fca4c0c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:24.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.847+0000 7fca52786640 1 -- 172.21.15.60:0/2352254799 shutdown_connections 2024-09-12T02:23:24.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:24.847+0000 7fca52786640 1 -- 172.21.15.60:0/2352254799 wait complete. 2024-09-12T02:23:24.851 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476745 got 68719476744 for osd.6 2024-09-12T02:23:24.857 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.4 2024-09-12T02:23:24.858 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542151 for osd.1 2024-09-12T02:23:24.861 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476746 got 68719476745 for osd.5 2024-09-12T02:23:25.782 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T02:23:25.816 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T02:23:25.823 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:23:25.828 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:23:25.836 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T02:23:25.846 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T02:23:25.852 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T02:23:25.858 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T02:23:25.859 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T02:23:25.862 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T02:23:25.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.925+0000 7f4ea832a640 1 Processor -- start 2024-09-12T02:23:25.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.925+0000 7f4ea832a640 1 -- start start 2024-09-12T02:23:25.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.927+0000 7f4ea832a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4ea00c26b0 0x7f4ea0166490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:25.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.927+0000 7f4ea832a640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ea0166a70 con 0x7f4ea008d440 2024-09-12T02:23:25.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.927+0000 7f4ea832a640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ea0166d50 con 0x7f4ea00c5940 2024-09-12T02:23:25.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.927+0000 7f4ea832a640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f4ea01630c0 con 0x7f4ea00c26b0 2024-09-12T02:23:25.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.927+0000 7f4ea68c7640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f4ea008d440 0x7f4ea008d870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53962/0 (socket says 172.21.15.60:53962) 2024-09-12T02:23:25.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.927+0000 7f4ea68c7640 1 -- 172.21.15.60:0/2832467087 learned_addr learned my addr 172.21.15.60:0/2832467087 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:25.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.927+0000 7f4ea60c6640 1 --2- 172.21.15.60:0/2832467087 >> v2:172.21.15.60:3300/0 conn(0x7f4ea00c26b0 0x7f4ea0166490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:25.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.928+0000 7f4ea50c4640 1 -- 172.21.15.60:0/2832467087 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2885014319 0 0) 0x7f4ea0166a70 con 0x7f4ea008d440 2024-09-12T02:23:25.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.928+0000 7f4ea50c4640 1 -- 172.21.15.60:0/2832467087 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e8c003500 con 0x7f4ea008d440 2024-09-12T02:23:25.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.928+0000 7f4ea60c6640 1 -- 172.21.15.60:0/2832467087 >> v1:172.21.15.105:6789/0 conn(0x7f4ea00c5940 legacy=0x7f4ea0163550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:25.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.929+0000 7f4ea60c6640 1 -- 172.21.15.60:0/2832467087 >> v1:172.21.15.60:6789/0 conn(0x7f4ea008d440 legacy=0x7f4ea008d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:25.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.929+0000 7f4ea60c6640 1 -- 172.21.15.60:0/2832467087 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ea0167030 con 0x7f4ea00c26b0 2024-09-12T02:23:25.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.930+0000 7f4ea60c6640 1 --2- 172.21.15.60:0/2832467087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ea00c26b0 0x7f4ea0166490 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4e90009850 tx=0x7f4e9002e4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a899271c9b4b9dde server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:25.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.931+0000 7f4ea50c4640 1 -- 172.21.15.60:0/2832467087 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e9003a070 con 0x7f4ea00c26b0 2024-09-12T02:23:25.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.931+0000 7f4ea50c4640 1 -- 172.21.15.60:0/2832467087 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e90007690 con 0x7f4ea00c26b0 2024-09-12T02:23:25.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.931+0000 7f4ea50c4640 1 -- 172.21.15.60:0/2832467087 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e90007aa0 con 0x7f4ea00c26b0 2024-09-12T02:23:25.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.932+0000 7f4ea832a640 1 -- 172.21.15.60:0/2832467087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ea00c26b0 msgr2=0x7f4ea0166490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:25.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.932+0000 7f4ea832a640 1 --2- 172.21.15.60:0/2832467087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ea00c26b0 0x7f4ea0166490 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4e90009850 tx=0x7f4e9002e4e0 comp rx=0 tx=0).stop 2024-09-12T02:23:25.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.933+0000 7f4ea832a640 1 -- 172.21.15.60:0/2832467087 shutdown_connections 2024-09-12T02:23:25.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.933+0000 7f4ea832a640 1 --2- 172.21.15.60:0/2832467087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ea00c26b0 0x7f4ea0166490 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:25.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.933+0000 7f4ea832a640 1 -- 172.21.15.60:0/2832467087 >> 172.21.15.60:0/2832467087 conn(0x7f4ea00c7a40 msgr2=0x7f4ea00c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:25.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.933+0000 7f4ea832a640 1 -- 172.21.15.60:0/2832467087 shutdown_connections 2024-09-12T02:23:25.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.933+0000 7f4ea832a640 1 -- 172.21.15.60:0/2832467087 wait complete. 2024-09-12T02:23:25.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.935+0000 7f4ea832a640 1 Processor -- start 2024-09-12T02:23:25.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.935+0000 7f4ea832a640 1 -- start start 2024-09-12T02:23:25.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.936+0000 7f4ea832a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ea008d440 0x7f4ea00acd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:25.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.936+0000 7f4ea832a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ea00c26b0 0x7f4ea01ed520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:25.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.936+0000 7f4ea832a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ea00c5940 0x7f4ea01f9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:25.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.936+0000 7f4ea832a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea006f460 con 0x7f4ea008d440 2024-09-12T02:23:25.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.936+0000 7f4ea832a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea006f2e0 con 0x7f4ea00c26b0 2024-09-12T02:23:25.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.936+0000 7f4ea832a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4ea00c62f0 con 0x7f4ea00c5940 2024-09-12T02:23:25.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.937+0000 7f4ea68c7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ea00c5940 0x7f4ea01f9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:25.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.937+0000 7f4ea68c7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ea00c5940 0x7f4ea01f9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:47326/0 (socket says 172.21.15.60:47326) 2024-09-12T02:23:25.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.937+0000 7f4ea68c7640 1 -- 172.21.15.60:0/3891666313 learned_addr learned my addr 172.21.15.60:0/3891666313 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:25.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.937+0000 7f4ea60c6640 1 --2- 172.21.15.60:0/3891666313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ea008d440 0x7f4ea00acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:25.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.937+0000 7f4ea68c7640 1 -- 172.21.15.60:0/3891666313 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ea00c26b0 msgr2=0x7f4ea01ed520 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:23:25.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.937+0000 7f4ea68c7640 1 --2- 172.21.15.60:0/3891666313 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ea00c26b0 0x7f4ea01ed520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:25.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.937+0000 7f4ea68c7640 1 -- 172.21.15.60:0/3891666313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ea008d440 msgr2=0x7f4ea00acd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:25.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.937+0000 7f4ea68c7640 1 --2- 172.21.15.60:0/3891666313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ea008d440 0x7f4ea00acd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:25.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.938+0000 7f4ea68c7640 1 -- 172.21.15.60:0/3891666313 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ea01fc590 con 0x7f4ea00c5940 2024-09-12T02:23:25.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.938+0000 7f4ea60c6640 1 --2- 172.21.15.60:0/3891666313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ea008d440 0x7f4ea00acd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:23:25.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.938+0000 7f4ea68c7640 1 --2- 172.21.15.60:0/3891666313 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ea00c5940 0x7f4ea01f9090 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4e9800cb40 tx=0x7f4e9800a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:25.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.939+0000 7f4e96ffd640 1 -- 172.21.15.60:0/3891666313 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e98017070 con 0x7f4ea00c5940 2024-09-12T02:23:25.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.940+0000 7f4ea832a640 1 -- 172.21.15.60:0/3891666313 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ea01fc870 con 0x7f4ea00c5940 2024-09-12T02:23:25.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.940+0000 7f4ea832a640 1 -- 172.21.15.60:0/3891666313 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ea01fce30 con 0x7f4ea00c5940 2024-09-12T02:23:25.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.940+0000 7f4e96ffd640 1 -- 172.21.15.60:0/3891666313 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e9800aca0 con 0x7f4ea00c5940 2024-09-12T02:23:25.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.940+0000 7f4e96ffd640 1 -- 172.21.15.60:0/3891666313 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e98012620 con 0x7f4ea00c5940 2024-09-12T02:23:25.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.944+0000 7f4e96ffd640 1 -- 172.21.15.60:0/3891666313 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4e9801a070 con 0x7f4ea00c5940 2024-09-12T02:23:25.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.945+0000 7f4e96ffd640 1 --2- 172.21.15.60:0/3891666313 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4e8406bf00 0x7f4e8406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:25.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.945+0000 7f4ea60c6640 1 --2- 172.21.15.60:0/3891666313 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4e8406bf00 0x7f4e8406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:25.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.945+0000 7f4e96ffd640 1 -- 172.21.15.60:0/3891666313 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f4e9808ae50 con 0x7f4ea00c5940 2024-09-12T02:23:25.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.954+0000 7f4ea832a640 1 -- 172.21.15.60:0/3891666313 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e88005290 con 0x7f4ea00c5940 2024-09-12T02:23:25.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.955+0000 7f4ea60c6640 1 --2- 172.21.15.60:0/3891666313 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4e8406bf00 0x7f4e8406e3c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4e90037000 tx=0x7f4e90009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:25.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.960+0000 7f4e96ffd640 1 -- 172.21.15.60:0/3891666313 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4e98058ef0 con 0x7f4ea00c5940 2024-09-12T02:23:25.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.988+0000 7ffa52465640 1 Processor -- start 2024-09-12T02:23:25.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.988+0000 7ffa52465640 1 -- start start 2024-09-12T02:23:25.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.989+0000 7ffa52465640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa4c06f1d0 0x7ffa4c0c2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:25.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.989+0000 7ffa52465640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ffa4c0c5940 0x7ffa4c152a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:25.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.989+0000 7ffa52465640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa4c0c7500 con 0x7ffa4c14fa90 2024-09-12T02:23:25.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.989+0000 7ffa52465640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7ffa4c0c72b0 con 0x7ffa4c0c5940 2024-09-12T02:23:25.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.989+0000 7ffa52465640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ffa4c152580 con 0x7ffa4c06f1d0 2024-09-12T02:23:25.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.990+0000 7ffa50a02640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ffa4c0c5940 0x7ffa4c152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:25.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.990+0000 7ffa50a02640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ffa4c0c5940 0x7ffa4c152a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50046/0 (socket says 172.21.15.60:50046) 2024-09-12T02:23:25.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.990+0000 7ffa50a02640 1 -- 172.21.15.60:0/147846158 learned_addr learned my addr 172.21.15.60:0/147846158 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:25.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.990+0000 7ffa50a02640 1 -- 172.21.15.60:0/147846158 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa4c06f1d0 msgr2=0x7ffa4c0c2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:25.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.990+0000 7ffa50a02640 1 --2- 172.21.15.60:0/147846158 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa4c06f1d0 0x7ffa4c0c2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:25.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.990+0000 7ffa50a02640 1 -- 172.21.15.60:0/147846158 >> v1:172.21.15.105:6789/0 conn(0x7ffa4c14fa90 legacy=0x7ffa4c0c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:25.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.990+0000 7ffa50a02640 1 -- 172.21.15.60:0/147846158 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa4c156300 con 0x7ffa4c0c5940 2024-09-12T02:23:25.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.992+0000 7ffa50a02640 1 --2- 172.21.15.60:0/147846158 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa4c0c5940 0x7ffa4c152a10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ffa44009bd0 tx=0x7ffa4402bb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d9e8fd6b371ffc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:25.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.992+0000 7ffa4affd640 1 -- 172.21.15.60:0/147846158 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa44033070 con 0x7ffa4c0c5940 2024-09-12T02:23:25.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.992+0000 7ffa4affd640 1 -- 172.21.15.60:0/147846158 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa4402d690 con 0x7ffa4c0c5940 2024-09-12T02:23:25.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.993+0000 7ffa52465640 1 -- 172.21.15.60:0/147846158 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa4c0c5940 msgr2=0x7ffa4c152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:25.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.993+0000 7ffa52465640 1 --2- 172.21.15.60:0/147846158 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa4c0c5940 0x7ffa4c152a10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ffa44009bd0 tx=0x7ffa4402bb80 comp rx=0 tx=0).stop 2024-09-12T02:23:25.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.995+0000 7ffa52465640 1 -- 172.21.15.60:0/147846158 shutdown_connections 2024-09-12T02:23:25.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.995+0000 7ffa52465640 1 --2- 172.21.15.60:0/147846158 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa4c0c5940 0x7ffa4c152a10 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:25.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.995+0000 7ffa52465640 1 --2- 172.21.15.60:0/147846158 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa4c06f1d0 0x7ffa4c0c2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:25.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.995+0000 7ffa52465640 1 -- 172.21.15.60:0/147846158 >> 172.21.15.60:0/147846158 conn(0x7ffa4c0c7a40 msgr2=0x7ffa4c0c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:25.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.995+0000 7ffa52465640 1 -- 172.21.15.60:0/147846158 shutdown_connections 2024-09-12T02:23:25.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.995+0000 7ffa52465640 1 -- 172.21.15.60:0/147846158 wait complete. 2024-09-12T02:23:25.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.997+0000 7ffa52465640 1 Processor -- start 2024-09-12T02:23:25.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.997+0000 7ffa52465640 1 -- start start 2024-09-12T02:23:25.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.999+0000 7ffa52465640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa4c06f1d0 0x7ffa4c072010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:25.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.999+0000 7ffa52465640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa4c0c5940 0x7ffa4c14eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:26.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.999+0000 7ffa4bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa4c06f1d0 0x7ffa4c072010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:26.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.999+0000 7ffa4bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa4c06f1d0 0x7ffa4c072010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50050/0 (socket says 172.21.15.60:50050) 2024-09-12T02:23:26.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.999+0000 7ffa4bfff640 1 -- 172.21.15.60:0/3493732224 learned_addr learned my addr 172.21.15.60:0/3493732224 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:26.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:25.999+0000 7ffa52465640 1 --2- 172.21.15.60:0/3493732224 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa4c14fa90 0x7ffa4c0a63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:26.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.000+0000 7ffa52465640 1 -- 172.21.15.60:0/3493732224 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ffa4c14fe70 con 0x7ffa4c06f1d0 2024-09-12T02:23:26.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.000+0000 7ffa52465640 1 -- 172.21.15.60:0/3493732224 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ffa4c0c2b10 con 0x7ffa4c14fa90 2024-09-12T02:23:26.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.000+0000 7ffa52465640 1 -- 172.21.15.60:0/3493732224 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ffa4c0c4be0 con 0x7ffa4c0c5940 2024-09-12T02:23:26.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.000+0000 7ffa50a02640 1 --2- 172.21.15.60:0/3493732224 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa4c14fa90 0x7ffa4c0a63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:26.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.001+0000 7ffa4bfff640 1 -- 172.21.15.60:0/3493732224 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa4c0c5940 msgr2=0x7ffa4c14eed0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:23:26.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.001+0000 7ffa4bfff640 1 --2- 172.21.15.60:0/3493732224 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa4c0c5940 0x7ffa4c14eed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.001+0000 7ffa4bfff640 1 -- 172.21.15.60:0/3493732224 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa4c14fa90 msgr2=0x7ffa4c0a63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:26.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.001+0000 7ffa4bfff640 1 --2- 172.21.15.60:0/3493732224 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa4c14fa90 0x7ffa4c0a63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.001+0000 7ffa4bfff640 1 -- 172.21.15.60:0/3493732224 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa4c0a5c20 con 0x7ffa4c06f1d0 2024-09-12T02:23:26.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.001+0000 7ffa4bfff640 1 --2- 172.21.15.60:0/3493732224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa4c06f1d0 0x7ffa4c072010 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ffa4000b410 tx=0x7ffa4000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:26.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.002+0000 7ffa48ff9640 1 -- 172.21.15.60:0/3493732224 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa40015020 con 0x7ffa4c06f1d0 2024-09-12T02:23:26.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.002+0000 7ffa52465640 1 -- 172.21.15.60:0/3493732224 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa4c070d40 con 0x7ffa4c06f1d0 2024-09-12T02:23:26.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.002+0000 7ffa52465640 1 -- 172.21.15.60:0/3493732224 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa4c071300 con 0x7ffa4c06f1d0 2024-09-12T02:23:26.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.006+0000 7ffa48ff9640 1 -- 172.21.15.60:0/3493732224 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa40011830 con 0x7ffa4c06f1d0 2024-09-12T02:23:26.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.006+0000 7ffa48ff9640 1 -- 172.21.15.60:0/3493732224 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa40011c20 con 0x7ffa4c06f1d0 2024-09-12T02:23:26.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.006+0000 7ffa48ff9640 1 -- 172.21.15.60:0/3493732224 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffa40018020 con 0x7ffa4c06f1d0 2024-09-12T02:23:26.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.007+0000 7ffa48ff9640 1 --2- 172.21.15.60:0/3493732224 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ffa3806bf30 0x7ffa3806e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:26.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.007+0000 7ffa4b7fe640 1 --2- 172.21.15.60:0/3493732224 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ffa3806bf30 0x7ffa3806e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:26.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.008+0000 7ffa48ff9640 1 -- 172.21.15.60:0/3493732224 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7ffa4008b160 con 0x7ffa4c06f1d0 2024-09-12T02:23:26.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.009+0000 7ffa4b7fe640 1 --2- 172.21.15.60:0/3493732224 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ffa3806bf30 0x7ffa3806e3f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c0c81e0 tx=0x7ffa3c006c20 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:26.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.009+0000 7ffa52465640 1 -- 172.21.15.60:0/3493732224 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa2c005290 con 0x7ffa4c06f1d0 2024-09-12T02:23:26.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.019+0000 7ffa48ff9640 1 -- 172.21.15.60:0/3493732224 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffa4001f020 con 0x7ffa4c06f1d0 2024-09-12T02:23:26.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.046+0000 7f213159f640 1 Processor -- start 2024-09-12T02:23:26.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.046+0000 7f213159f640 1 -- start start 2024-09-12T02:23:26.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.047+0000 7f213159f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f212c06ddc0 0x7f212c0a6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:26.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.047+0000 7f213159f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f212c0c3a80 0x7f212c0ab400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:26.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.047+0000 7f213159f640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f212c0c2d50 con 0x7f212c0c36a0 2024-09-12T02:23:26.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.047+0000 7f213159f640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f212c0c30a0 con 0x7f212c06ddc0 2024-09-12T02:23:26.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.047+0000 7f213159f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f212c0c40e0 con 0x7f212c0c3a80 2024-09-12T02:23:26.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.048+0000 7efc94253640 1 Processor -- start 2024-09-12T02:23:26.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.046+0000 7f1b64f11640 1 Processor -- start 2024-09-12T02:23:26.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.046+0000 7f1b64f11640 1 -- start start 2024-09-12T02:23:26.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.048+0000 7f1b64f11640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1b60157f50 0x7f1b60071140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:26.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.048+0000 7f1b64f11640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1b60073ec0 0x7f1b600ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:26.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.048+0000 7f1b64f11640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1b600ad360 0x7f1b600ab9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:26.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.048+0000 7f1b64f11640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f1b60158330 con 0x7f1b60157f50 2024-09-12T02:23:26.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.048+0000 7f1b64f11640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f1b6015a7a0 con 0x7f1b600ad360 2024-09-12T02:23:26.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.048+0000 7f1b64f11640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1b6015aa80 con 0x7f1b60073ec0 2024-09-12T02:23:26.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.048+0000 7f212b7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f212c06ddc0 0x7f212c0a6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:26.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.048+0000 7f212b7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f212c06ddc0 0x7f212c0a6f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50062/0 (socket says 172.21.15.60:50062) 2024-09-12T02:23:26.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.048+0000 7f212b7fe640 1 -- 172.21.15.60:0/281413842 learned_addr learned my addr 172.21.15.60:0/281413842 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:26.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.048+0000 7f1b57fff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1b60073ec0 0x7f1b600ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:26.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.048+0000 7f1b57fff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1b60073ec0 0x7f1b600ace20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:47352/0 (socket says 172.21.15.60:47352) 2024-09-12T02:23:26.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.048+0000 7f1b57fff640 1 -- 172.21.15.60:0/3005638022 learned_addr learned my addr 172.21.15.60:0/3005638022 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:26.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.048+0000 7f1b5e59c640 1 --2- 172.21.15.60:0/3005638022 >> v2:172.21.15.60:3300/0 conn(0x7f1b60157f50 0x7f1b60071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:26.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.048+0000 7f212b7fe640 1 -- 172.21.15.60:0/281413842 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f212c0c3a80 msgr2=0x7f212c0ab400 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:23:26.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.048+0000 7f212b7fe640 1 --2- 172.21.15.60:0/281413842 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f212c0c3a80 0x7f212c0ab400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.048+0000 7f212b7fe640 1 -- 172.21.15.60:0/281413842 >> v1:172.21.15.105:6789/0 conn(0x7f212c0c36a0 legacy=0x7f212c0c2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:26.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.048+0000 7f1b57fff640 1 -- 172.21.15.60:0/3005638022 >> v2:172.21.15.105:3300/0 conn(0x7f1b600ad360 msgr2=0x7f1b600ab9b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:23:26.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.048+0000 7efc94253640 1 -- start start 2024-09-12T02:23:26.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.049+0000 7efc94253640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efc8c0c29e0 0x7efc8c0c2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:26.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.049+0000 7efc94253640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7efc8c153240 0x7efc8c06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:26.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.049+0000 7efc94253640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc8c0c6bc0 con 0x7efc8c1564a0 2024-09-12T02:23:26.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.048+0000 7f1b57fff640 1 --2- 172.21.15.60:0/3005638022 >> v2:172.21.15.105:3300/0 conn(0x7f1b600ad360 0x7f1b600ab9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.049+0000 7efc94253640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7efc8c1569a0 con 0x7efc8c153240 2024-09-12T02:23:26.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.049+0000 7efc94253640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efc8c0c6ea0 con 0x7efc8c0c29e0 2024-09-12T02:23:26.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.050+0000 7efc91fef640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efc8c0c29e0 0x7efc8c0c2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:26.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.048+0000 7f1b57fff640 1 -- 172.21.15.60:0/3005638022 >> v2:172.21.15.60:3300/0 conn(0x7f1b60157f50 msgr2=0x7f1b60071140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:26.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.049+0000 7f1b57fff640 1 --2- 172.21.15.60:0/3005638022 >> v2:172.21.15.60:3300/0 conn(0x7f1b60157f50 0x7f1b60071140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.049+0000 7f1b57fff640 1 -- 172.21.15.60:0/3005638022 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b6015ad60 con 0x7f1b60073ec0 2024-09-12T02:23:26.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.050+0000 7f1b5e59c640 1 --2- 172.21.15.60:0/3005638022 >> v2:172.21.15.60:3300/0 conn(0x7f1b60157f50 0x7f1b60071140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:23:26.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.050+0000 7f1b57fff640 1 --2- 172.21.15.60:0/3005638022 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1b60073ec0 0x7f1b600ace20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1b600744b0 tx=0x7f1b5002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ba5778eaa0420f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:26.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.049+0000 7f212b7fe640 1 -- 172.21.15.60:0/281413842 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f212c0aa980 con 0x7f212c06ddc0 2024-09-12T02:23:26.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.050+0000 7fd569a01640 1 Processor -- start 2024-09-12T02:23:26.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.050+0000 7f1b5dd9b640 1 -- 172.21.15.60:0/3005638022 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b50037070 con 0x7f1b60073ec0 2024-09-12T02:23:26.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.050+0000 7f61ba215640 1 Processor -- start 2024-09-12T02:23:26.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.050+0000 7f1b5dd9b640 1 -- 172.21.15.60:0/3005638022 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b5002ae50 con 0x7f1b60073ec0 2024-09-12T02:23:26.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.050+0000 7fd569a01640 1 -- start start 2024-09-12T02:23:26.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.051+0000 7f1b5dd9b640 1 -- 172.21.15.60:0/3005638022 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b50032640 con 0x7f1b60073ec0 2024-09-12T02:23:26.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.051+0000 7f1b64f11640 1 -- 172.21.15.60:0/3005638022 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1b60073ec0 msgr2=0x7f1b600ace20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:26.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.051+0000 7f1b64f11640 1 --2- 172.21.15.60:0/3005638022 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1b60073ec0 0x7f1b600ace20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1b600744b0 tx=0x7f1b5002a100 comp rx=0 tx=0).stop 2024-09-12T02:23:26.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.050+0000 7efc917ee640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7efc8c1564a0 0x7efc8c152b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:45514/0 (socket says 172.21.15.60:45514) 2024-09-12T02:23:26.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.050+0000 7efc917ee640 1 -- 172.21.15.60:0/2137956529 learned_addr learned my addr 172.21.15.60:0/2137956529 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:26.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.050+0000 7efc91fef640 1 -- 172.21.15.60:0/2137956529 >> v2:172.21.15.105:3300/0 conn(0x7efc8c153240 msgr2=0x7efc8c06d2b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:23:26.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.050+0000 7efc90fed640 1 -- 172.21.15.60:0/2137956529 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3654325334 0 0) 0x7efc8c0c6bc0 con 0x7efc8c1564a0 2024-09-12T02:23:26.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.050+0000 7efc91fef640 1 --2- 172.21.15.60:0/2137956529 >> v2:172.21.15.105:3300/0 conn(0x7efc8c153240 0x7efc8c06d2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.050+0000 7efc91fef640 1 -- 172.21.15.60:0/2137956529 >> v1:172.21.15.105:6789/0 conn(0x7efc8c1564a0 legacy=0x7efc8c152b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:26.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.050+0000 7efc91fef640 1 -- 172.21.15.60:0/2137956529 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc8c06cd90 con 0x7efc8c0c29e0 2024-09-12T02:23:26.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.051+0000 7f1b64f11640 1 -- 172.21.15.60:0/3005638022 shutdown_connections 2024-09-12T02:23:26.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.051+0000 7f1b64f11640 1 --2- 172.21.15.60:0/3005638022 >> v2:172.21.15.105:3300/0 conn(0x7f1b600ad360 0x7f1b600ab9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.051+0000 7f1b64f11640 1 --2- 172.21.15.60:0/3005638022 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1b60073ec0 0x7f1b600ace20 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.051+0000 7f1b64f11640 1 --2- 172.21.15.60:0/3005638022 >> v2:172.21.15.60:3300/0 conn(0x7f1b60157f50 0x7f1b60071140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.051+0000 7f1b64f11640 1 -- 172.21.15.60:0/3005638022 >> 172.21.15.60:0/3005638022 conn(0x7f1b600c6980 msgr2=0x7f1b600c6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:26.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.052+0000 7fd569a01640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd5640c3b60 0x7fd5640c3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:26.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.052+0000 7fd562ffd640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fd56414fcf0 0x7fd56406e140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:45530/0 (socket says 172.21.15.60:45530) 2024-09-12T02:23:26.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.052+0000 7fd5627fc640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd5640c3b60 0x7fd5640c3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:26.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.052+0000 7fd5627fc640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd5640c3b60 0x7fd5640c3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:46690/0 (socket says 172.21.15.60:46690) 2024-09-12T02:23:26.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.052+0000 7fd562ffd640 1 -- 172.21.15.60:0/333979130 learned_addr learned my addr 172.21.15.60:0/333979130 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:26.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.052+0000 7fd569a01640 1 -- 172.21.15.60:0/333979130 --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5641530f0 con 0x7fd56406d490 2024-09-12T02:23:26.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.052+0000 7fd569a01640 1 -- 172.21.15.60:0/333979130 --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5641533d0 con 0x7fd56414fcf0 2024-09-12T02:23:26.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.052+0000 7fd569a01640 1 -- 172.21.15.60:0/333979130 --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fd56406d000 con 0x7fd5640c3b60 2024-09-12T02:23:26.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.053+0000 7fd561ffb640 1 -- 172.21.15.60:0/333979130 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1694158007 0 0) 0x7fd5641530f0 con 0x7fd56406d490 2024-09-12T02:23:26.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.053+0000 7fd561ffb640 1 -- 172.21.15.60:0/333979130 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd54c003440 con 0x7fd56406d490 2024-09-12T02:23:26.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.053+0000 7fd5627fc640 1 -- 172.21.15.60:0/333979130 >> v1:172.21.15.105:6789/0 conn(0x7fd56414fcf0 legacy=0x7fd56406e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:26.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.053+0000 7fd5627fc640 1 -- 172.21.15.60:0/333979130 >> v1:172.21.15.60:6789/0 conn(0x7fd56406d490 legacy=0x7fd56415ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:26.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.053+0000 7fd5627fc640 1 -- 172.21.15.60:0/333979130 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd56406cc90 con 0x7fd5640c3b60 2024-09-12T02:23:26.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.051+0000 7f212b7fe640 1 --2- 172.21.15.60:0/281413842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f212c06ddc0 0x7f212c0a6f60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f212400d370 tx=0x7f212402cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e06a447a3fc5f198 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:26.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.052+0000 7f212affd640 1 -- 172.21.15.60:0/281413842 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f212400be60 con 0x7f212c06ddc0 2024-09-12T02:23:26.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.052+0000 7f212affd640 1 -- 172.21.15.60:0/281413842 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2124003b90 con 0x7f212c06ddc0 2024-09-12T02:23:26.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.052+0000 7f212affd640 1 -- 172.21.15.60:0/281413842 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f212402e660 con 0x7f212c06ddc0 2024-09-12T02:23:26.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.053+0000 7f213159f640 1 -- 172.21.15.60:0/281413842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f212c06ddc0 msgr2=0x7f212c0a6f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:26.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.053+0000 7f213159f640 1 --2- 172.21.15.60:0/281413842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f212c06ddc0 0x7f212c0a6f60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f212400d370 tx=0x7f212402cb00 comp rx=0 tx=0).stop 2024-09-12T02:23:26.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.053+0000 7fd2d265e640 1 Processor -- start 2024-09-12T02:23:26.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.050+0000 7f61ba215640 1 -- start start 2024-09-12T02:23:26.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.052+0000 7f61ba215640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f61ac0d7890 0x7f61ac005d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:26.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.052+0000 7f61ba215640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f61ac049fc0 0x7f61ac04a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:26.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.052+0000 7f61ba215640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61ac0da8c0 con 0x7f61ac04dc60 2024-09-12T02:23:26.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.052+0000 7f61ba215640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f61ac0daba0 con 0x7f61ac0d7890 2024-09-12T02:23:26.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.052+0000 7f61ba215640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f61ac04e330 con 0x7f61ac049fc0 2024-09-12T02:23:26.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.052+0000 7f61b8a12640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f61ac04dc60 0x7f61ac04ee10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:45534/0 (socket says 172.21.15.60:45534) 2024-09-12T02:23:26.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.052+0000 7f61b8a12640 1 -- 172.21.15.60:0/213864192 learned_addr learned my addr 172.21.15.60:0/213864192 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:26.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.052+0000 7f61b9a14640 1 --2- 172.21.15.60:0/213864192 >> v2:172.21.15.105:3300/0 conn(0x7f61ac049fc0 0x7f61ac04a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:26.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.053+0000 7f61b9a14640 1 -- 172.21.15.60:0/213864192 >> v2:172.21.15.60:3300/0 conn(0x7f61ac0d7890 msgr2=0x7f61ac005d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:26.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.053+0000 7f61b9a14640 1 --2- 172.21.15.60:0/213864192 >> v2:172.21.15.60:3300/0 conn(0x7f61ac0d7890 0x7f61ac005d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.053+0000 7f61b9a14640 1 -- 172.21.15.60:0/213864192 >> v1:172.21.15.105:6789/0 conn(0x7f61ac04dc60 legacy=0x7f61ac04ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:26.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.053+0000 7f61b9a14640 1 -- 172.21.15.60:0/213864192 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61ac04e610 con 0x7f61ac049fc0 2024-09-12T02:23:26.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.052+0000 7efc91fef640 1 --2- 172.21.15.60:0/2137956529 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efc8c0c29e0 0x7efc8c0c2dc0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efc88010b90 tx=0x7efc8802e640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f78a1d053ade04c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:26.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.053+0000 7efc90fed640 1 -- 172.21.15.60:0/2137956529 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc8802ee60 con 0x7efc8c0c29e0 2024-09-12T02:23:26.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.053+0000 7efc90fed640 1 -- 172.21.15.60:0/2137956529 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc88033710 con 0x7efc8c0c29e0 2024-09-12T02:23:26.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.053+0000 7efc90fed640 1 -- 172.21.15.60:0/2137956529 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc88033b20 con 0x7efc8c0c29e0 2024-09-12T02:23:26.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.054+0000 7efc94253640 1 -- 172.21.15.60:0/2137956529 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efc8c0c29e0 msgr2=0x7efc8c0c2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:26.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.054+0000 7efc94253640 1 --2- 172.21.15.60:0/2137956529 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efc8c0c29e0 0x7efc8c0c2dc0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efc88010b90 tx=0x7efc8802e640 comp rx=0 tx=0).stop 2024-09-12T02:23:26.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.054+0000 7efc94253640 1 -- 172.21.15.60:0/2137956529 shutdown_connections 2024-09-12T02:23:26.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.054+0000 7efc94253640 1 --2- 172.21.15.60:0/2137956529 >> v2:172.21.15.105:3300/0 conn(0x7efc8c153240 0x7efc8c06d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.054+0000 7efc94253640 1 --2- 172.21.15.60:0/2137956529 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efc8c0c29e0 0x7efc8c0c2dc0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.054+0000 7efc94253640 1 -- 172.21.15.60:0/2137956529 >> 172.21.15.60:0/2137956529 conn(0x7efc8c0a9680 msgr2=0x7efc8c0a9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:26.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.053+0000 7fd2d265e640 1 -- start start 2024-09-12T02:23:26.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.054+0000 7efc94253640 1 -- 172.21.15.60:0/2137956529 shutdown_connections 2024-09-12T02:23:26.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.054+0000 7fd2d265e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd2cc06bbe0 0x7fd2cc06c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:26.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.054+0000 7fd2d265e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2cc1598c0 0x7fd2cc159d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:26.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.054+0000 7efc94253640 1 -- 172.21.15.60:0/2137956529 wait complete. 2024-09-12T02:23:26.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.054+0000 7fd2d265e640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2cc0c6b20 con 0x7fd2cc153de0 2024-09-12T02:23:26.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.054+0000 7fd2d265e640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fd2cc0c9480 con 0x7fd2cc06bbe0 2024-09-12T02:23:26.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.054+0000 7fd2d265e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd2cc0cb620 con 0x7fd2cc1598c0 2024-09-12T02:23:26.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.054+0000 7f213159f640 1 -- 172.21.15.60:0/281413842 shutdown_connections 2024-09-12T02:23:26.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.054+0000 7f213159f640 1 --2- 172.21.15.60:0/281413842 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f212c0c3a80 0x7f212c0ab400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.054+0000 7f213159f640 1 --2- 172.21.15.60:0/281413842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f212c06ddc0 0x7f212c0a6f60 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.054+0000 7f213159f640 1 -- 172.21.15.60:0/281413842 >> 172.21.15.60:0/281413842 conn(0x7f212c0c7ae0 msgr2=0x7f212c0c7ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:26.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.054+0000 7fd2d0bfb640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2cc1598c0 0x7fd2cc159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:26.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.054+0000 7fd2d0bfb640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2cc1598c0 0x7fd2cc159d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:47388/0 (socket says 172.21.15.60:47388) 2024-09-12T02:23:26.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.054+0000 7fd2d0bfb640 1 -- 172.21.15.60:0/1664053033 learned_addr learned my addr 172.21.15.60:0/1664053033 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:26.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.055+0000 7fd2cb7fe640 1 --2- 172.21.15.60:0/1664053033 >> v2:172.21.15.60:3300/0 conn(0x7fd2cc06bbe0 0x7fd2cc06c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:26.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.051+0000 7f1b64f11640 1 -- 172.21.15.60:0/3005638022 shutdown_connections 2024-09-12T02:23:26.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.051+0000 7f1b64f11640 1 -- 172.21.15.60:0/3005638022 wait complete. 2024-09-12T02:23:26.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.055+0000 7fd5627fc640 1 --2- 172.21.15.60:0/333979130 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5640c3b60 0x7fd5640c3fd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd5580097a0 tx=0x7fd55802a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37d7c2148caf5401 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:26.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.053+0000 7f1b64f11640 1 Processor -- start 2024-09-12T02:23:26.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.055+0000 7fd2d0bfb640 1 -- 172.21.15.60:0/1664053033 >> v2:172.21.15.60:3300/0 conn(0x7fd2cc06bbe0 msgr2=0x7fd2cc06c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:26.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.055+0000 7fd2d0bfb640 1 --2- 172.21.15.60:0/1664053033 >> v2:172.21.15.60:3300/0 conn(0x7fd2cc06bbe0 0x7fd2cc06c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.055+0000 7fd2d0bfb640 1 -- 172.21.15.60:0/1664053033 >> v1:172.21.15.105:6789/0 conn(0x7fd2cc153de0 legacy=0x7fd2cc0ca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:26.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.055+0000 7fd2d0bfb640 1 -- 172.21.15.60:0/1664053033 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2cc0c6e00 con 0x7fd2cc1598c0 2024-09-12T02:23:26.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.054+0000 7f1b64f11640 1 -- start start 2024-09-12T02:23:26.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.055+0000 7fd561ffb640 1 -- 172.21.15.60:0/333979130 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd558037070 con 0x7fd5640c3b60 2024-09-12T02:23:26.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.055+0000 7f1b64f11640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1b60073ec0 0x7f1b601412e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:26.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.055+0000 7fd561ffb640 1 -- 172.21.15.60:0/333979130 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd558032440 con 0x7fd5640c3b60 2024-09-12T02:23:26.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.055+0000 7f1b64f11640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1b600ad360 0x7f1b601313c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:26.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.055+0000 7f1b64f11640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b60157f50 0x7f1b600c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:26.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.055+0000 7f1b64f11640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1b600ac070 con 0x7f1b60157f50 2024-09-12T02:23:26.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.055+0000 7f1b64f11640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1b600abef0 con 0x7f1b60073ec0 2024-09-12T02:23:26.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.055+0000 7f1b57fff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1b600ad360 0x7f1b601313c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:26.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.056+0000 7f61b9a14640 1 --2- 172.21.15.60:0/213864192 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61ac049fc0 0x7f61ac04a410 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f61ac0de450 tx=0x7f61b002a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=361338f7f7b61a74 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:26.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.055+0000 7f1b5ed9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b60157f50 0x7f1b600c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:26.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.055+0000 7f1b5e59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1b60073ec0 0x7f1b601412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:26.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.055+0000 7f1b5ed9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b60157f50 0x7f1b600c8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50104/0 (socket says 172.21.15.60:50104) 2024-09-12T02:23:26.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.055+0000 7f1b5ed9d640 1 -- 172.21.15.60:0/3609646291 learned_addr learned my addr 172.21.15.60:0/3609646291 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:26.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.056+0000 7f61abfff640 1 -- 172.21.15.60:0/213864192 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b0037070 con 0x7f61ac049fc0 2024-09-12T02:23:26.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.055+0000 7f1b64f11640 1 -- 172.21.15.60:0/3609646291 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1b600ac1f0 con 0x7f1b600ad360 2024-09-12T02:23:26.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.056+0000 7f1b5ed9d640 1 -- 172.21.15.60:0/3609646291 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1b600ad360 msgr2=0x7f1b601313c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:26.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.056+0000 7f61abfff640 1 -- 172.21.15.60:0/213864192 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61b0032440 con 0x7f61ac049fc0 2024-09-12T02:23:26.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.056+0000 7f1b5ed9d640 1 --2- 172.21.15.60:0/3609646291 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1b600ad360 0x7f1b601313c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.056+0000 7f61abfff640 1 -- 172.21.15.60:0/213864192 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b0037070 con 0x7f61ac049fc0 2024-09-12T02:23:26.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.056+0000 7f1b5ed9d640 1 -- 172.21.15.60:0/3609646291 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1b60073ec0 msgr2=0x7f1b601412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:26.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.056+0000 7fd2d0bfb640 1 --2- 172.21.15.60:0/1664053033 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2cc1598c0 0x7fd2cc159d50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0009870 tx=0x7fd2c002a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=565858a72ae8b616 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:26.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.056+0000 7efc94253640 1 Processor -- start 2024-09-12T02:23:26.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.056+0000 7fd561ffb640 1 -- 172.21.15.60:0/333979130 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd558037070 con 0x7fd5640c3b60 2024-09-12T02:23:26.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.056+0000 7fd569a01640 1 -- 172.21.15.60:0/333979130 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5640c3b60 msgr2=0x7fd5640c3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:26.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.056+0000 7fd569a01640 1 --2- 172.21.15.60:0/333979130 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5640c3b60 0x7fd5640c3fd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd5580097a0 tx=0x7fd55802a1e0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.056+0000 7f1b5ed9d640 1 --2- 172.21.15.60:0/3609646291 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1b60073ec0 0x7f1b601412e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.056+0000 7f1b5ed9d640 1 -- 172.21.15.60:0/3609646291 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b600c9860 con 0x7f1b60157f50 2024-09-12T02:23:26.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.056+0000 7f213159f640 1 -- 172.21.15.60:0/281413842 shutdown_connections 2024-09-12T02:23:26.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.056+0000 7fd2caffd640 1 -- 172.21.15.60:0/1664053033 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c0037070 con 0x7fd2cc1598c0 2024-09-12T02:23:26.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.056+0000 7fd2caffd640 1 -- 172.21.15.60:0/1664053033 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2c0032440 con 0x7fd2cc1598c0 2024-09-12T02:23:26.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.057+0000 7fd2caffd640 1 -- 172.21.15.60:0/1664053033 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c0037070 con 0x7fd2cc1598c0 2024-09-12T02:23:26.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.057+0000 7f61ba215640 1 -- 172.21.15.60:0/213864192 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61ac049fc0 msgr2=0x7f61ac04a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:26.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.057+0000 7f61ba215640 1 --2- 172.21.15.60:0/213864192 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61ac049fc0 0x7f61ac04a410 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f61ac0de450 tx=0x7f61b002a110 comp rx=0 tx=0).stop 2024-09-12T02:23:26.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.057+0000 7f61ba215640 1 -- 172.21.15.60:0/213864192 shutdown_connections 2024-09-12T02:23:26.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.057+0000 7f61ba215640 1 --2- 172.21.15.60:0/213864192 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61ac049fc0 0x7f61ac04a410 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.057+0000 7f61ba215640 1 --2- 172.21.15.60:0/213864192 >> v2:172.21.15.60:3300/0 conn(0x7f61ac0d7890 0x7f61ac005d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.057+0000 7f61ba215640 1 -- 172.21.15.60:0/213864192 >> 172.21.15.60:0/213864192 conn(0x7f61ac04c0c0 msgr2=0x7f61ac04c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:26.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.056+0000 7efc94253640 1 -- start start 2024-09-12T02:23:26.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.057+0000 7f61ba215640 1 -- 172.21.15.60:0/213864192 shutdown_connections 2024-09-12T02:23:26.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.057+0000 7fd2d265e640 1 -- 172.21.15.60:0/1664053033 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2cc1598c0 msgr2=0x7fd2cc159d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:26.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.057+0000 7fd2d265e640 1 --2- 172.21.15.60:0/1664053033 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2cc1598c0 0x7fd2cc159d50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0009870 tx=0x7fd2c002a250 comp rx=0 tx=0).stop 2024-09-12T02:23:26.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.058+0000 7fd2d265e640 1 -- 172.21.15.60:0/1664053033 shutdown_connections 2024-09-12T02:23:26.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.058+0000 7fd2d265e640 1 --2- 172.21.15.60:0/1664053033 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2cc1598c0 0x7fd2cc159d50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.058+0000 7fd2d265e640 1 --2- 172.21.15.60:0/1664053033 >> v2:172.21.15.60:3300/0 conn(0x7fd2cc06bbe0 0x7fd2cc06c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.058+0000 7fd2d265e640 1 -- 172.21.15.60:0/1664053033 >> 172.21.15.60:0/1664053033 conn(0x7fd2cc0c8800 msgr2=0x7fd2cc0c8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:26.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.056+0000 7f1b57fff640 1 --2- 172.21.15.60:0/3609646291 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1b600ad360 0x7f1b601313c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:23:26.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.056+0000 7f1b5ed9d640 1 --2- 172.21.15.60:0/3609646291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b60157f50 0x7f1b600c8b30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1b5800b9a0 tx=0x7f1b5800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:26.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.057+0000 7f1b56ffd640 1 -- 172.21.15.60:0/3609646291 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b58019070 con 0x7f1b60157f50 2024-09-12T02:23:26.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.056+0000 7f213159f640 1 -- 172.21.15.60:0/281413842 wait complete. 2024-09-12T02:23:26.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.058+0000 7fd2d265e640 1 -- 172.21.15.60:0/1664053033 shutdown_connections 2024-09-12T02:23:26.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.057+0000 7efc94253640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc8c0c29e0 0x7efc8c0bd410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:26.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.057+0000 7efc94253640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efc8c153240 0x7efc8c154740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:26.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.058+0000 7efc91fef640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc8c0c29e0 0x7efc8c0bd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:26.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.058+0000 7efc91fef640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc8c0c29e0 0x7efc8c0bd410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50110/0 (socket says 172.21.15.60:50110) 2024-09-12T02:23:26.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.058+0000 7f213159f640 1 Processor -- start 2024-09-12T02:23:26.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.058+0000 7efc94253640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc8c1564a0 0x7efc8c14ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:26.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.058+0000 7efc91fef640 1 -- 172.21.15.60:0/1722712758 learned_addr learned my addr 172.21.15.60:0/1722712758 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:26.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.058+0000 7efc94253640 1 -- 172.21.15.60:0/1722712758 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7efc8c0ad120 con 0x7efc8c0c29e0 2024-09-12T02:23:26.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.058+0000 7efc94253640 1 -- 172.21.15.60:0/1722712758 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efc8c0aa3b0 con 0x7efc8c1564a0 2024-09-12T02:23:26.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.058+0000 7efc94253640 1 -- 172.21.15.60:0/1722712758 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efc8c0ad2a0 con 0x7efc8c153240 2024-09-12T02:23:26.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.058+0000 7efc917ee640 1 --2- 172.21.15.60:0/1722712758 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efc8c153240 0x7efc8c154740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:26.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.058+0000 7efc927f0640 1 --2- 172.21.15.60:0/1722712758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc8c1564a0 0x7efc8c14ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:26.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.057+0000 7f61ba215640 1 -- 172.21.15.60:0/213864192 wait complete. 2024-09-12T02:23:26.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.059+0000 7f213159f640 1 -- start start 2024-09-12T02:23:26.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.058+0000 7fd569a01640 1 -- 172.21.15.60:0/333979130 shutdown_connections 2024-09-12T02:23:26.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.058+0000 7fd569a01640 1 --2- 172.21.15.60:0/333979130 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5640c3b60 0x7fd5640c3fd0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.058+0000 7fd569a01640 1 -- 172.21.15.60:0/333979130 >> 172.21.15.60:0/333979130 conn(0x7fd5640c4c50 msgr2=0x7fd5640c5060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:26.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.058+0000 7fd2d265e640 1 -- 172.21.15.60:0/1664053033 wait complete. 2024-09-12T02:23:26.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.059+0000 7efc91fef640 1 -- 172.21.15.60:0/1722712758 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efc8c153240 msgr2=0x7efc8c154740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:26.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.059+0000 7efc91fef640 1 --2- 172.21.15.60:0/1722712758 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efc8c153240 0x7efc8c154740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.059+0000 7efc91fef640 1 -- 172.21.15.60:0/1722712758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc8c1564a0 msgr2=0x7efc8c14ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:26.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.059+0000 7efc91fef640 1 --2- 172.21.15.60:0/1722712758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc8c1564a0 0x7efc8c14ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.059+0000 7efc91fef640 1 -- 172.21.15.60:0/1722712758 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc8c1e7090 con 0x7efc8c0c29e0 2024-09-12T02:23:26.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.059+0000 7efc91fef640 1 --2- 172.21.15.60:0/1722712758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc8c0c29e0 0x7efc8c0bd410 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efc88010cb0 tx=0x7efc880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:26.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.059+0000 7f61ba215640 1 Processor -- start 2024-09-12T02:23:26.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.060+0000 7f61ba215640 1 -- start start 2024-09-12T02:23:26.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.060+0000 7f213159f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f212c06ddc0 0x7f212c1561d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:26.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.060+0000 7f213159f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f212c0c36a0 0x7f212c0a9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:26.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.060+0000 7fd569a01640 1 -- 172.21.15.60:0/333979130 shutdown_connections 2024-09-12T02:23:26.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.061+0000 7fd569a01640 1 -- 172.21.15.60:0/333979130 wait complete. 2024-09-12T02:23:26.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.061+0000 7fd2d265e640 1 Processor -- start 2024-09-12T02:23:26.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.060+0000 7f212bfff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f212c06ddc0 0x7f212c1561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:26.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.061+0000 7f212bfff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f212c06ddc0 0x7f212c1561d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:47414/0 (socket says 172.21.15.60:47414) 2024-09-12T02:23:26.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.061+0000 7f61ba215640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61ac049fc0 0x7f61ac173a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:26.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.061+0000 7f61ba215640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61ac04dc60 0x7f61ac047420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:26.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.061+0000 7f61ba215640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61ac0d7890 0x7f61ac16fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:26.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.061+0000 7f61b8a12640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61ac04dc60 0x7f61ac047420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:26.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.061+0000 7f61b8a12640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61ac04dc60 0x7f61ac047420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:46732/0 (socket says 172.21.15.60:46732) 2024-09-12T02:23:26.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.057+0000 7f1b64f11640 1 -- 172.21.15.60:0/3609646291 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b600c9b40 con 0x7f1b60157f50 2024-09-12T02:23:26.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.057+0000 7f1b64f11640 1 -- 172.21.15.60:0/3609646291 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b60131ee0 con 0x7f1b60157f50 2024-09-12T02:23:26.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.058+0000 7f1b64f11640 1 -- 172.21.15.60:0/3609646291 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b600ac520 con 0x7f1b60157f50 2024-09-12T02:23:26.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.059+0000 7f1b5e59c640 1 --2- 172.21.15.60:0/3609646291 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1b60073ec0 0x7f1b601412e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:23:26.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.059+0000 7f1b56ffd640 1 -- 172.21.15.60:0/3609646291 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b5800cba0 con 0x7f1b60157f50 2024-09-12T02:23:26.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.060+0000 7f1b56ffd640 1 -- 172.21.15.60:0/3609646291 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b58014440 con 0x7f1b60157f50 2024-09-12T02:23:26.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.060+0000 7f1b56ffd640 1 -- 172.21.15.60:0/3609646291 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1b5801c070 con 0x7f1b60157f50 2024-09-12T02:23:26.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.061+0000 7f1b56ffd640 1 --2- 172.21.15.60:0/3609646291 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1b4406bf30 0x7f1b4406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:26.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.061+0000 7f1b56ffd640 1 -- 172.21.15.60:0/3609646291 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f1b5808af60 con 0x7f1b60157f50 2024-09-12T02:23:26.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.061+0000 7f61b9213640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61ac049fc0 0x7f61ac173a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:26.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.062+0000 7f61b9213640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61ac049fc0 0x7f61ac173a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:47424/0 (socket says 172.21.15.60:47424) 2024-09-12T02:23:26.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.061+0000 7fd2d265e640 1 -- start start 2024-09-12T02:23:26.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.062+0000 7f61b8a12640 1 -- 172.21.15.60:0/1888220652 learned_addr learned my addr 172.21.15.60:0/1888220652 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:26.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.062+0000 7f1b5e59c640 1 --2- 172.21.15.60:0/3609646291 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1b4406bf30 0x7f1b4406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:26.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.062+0000 7f61ba215640 1 -- 172.21.15.60:0/1888220652 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f61ac042df0 con 0x7f61ac0d7890 2024-09-12T02:23:26.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.062+0000 7f61b9a14640 1 --2- 172.21.15.60:0/1888220652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61ac0d7890 0x7f61ac16fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:26.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.062+0000 7f61ba215640 1 -- 172.21.15.60:0/1888220652 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f61ac04a950 con 0x7f61ac04dc60 2024-09-12T02:23:26.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.062+0000 7f61ba215640 1 -- 172.21.15.60:0/1888220652 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f61ac042f70 con 0x7f61ac049fc0 2024-09-12T02:23:26.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.061+0000 7f213159f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f212c0c3a80 0x7f212c1e7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:26.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.061+0000 7f213159f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f212c0c4550 con 0x7f212c0c36a0 2024-09-12T02:23:26.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.062+0000 7fd2d265e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2cc06bbe0 0x7fd2cc1f0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:26.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.062+0000 7fd2d265e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2cc153de0 0x7fd2cc1487a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:26.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.062+0000 7fd2d265e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2cc1598c0 0x7fd2cc142360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:26.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.062+0000 7fd2d265e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd2cc0cbab0 con 0x7fd2cc153de0 2024-09-12T02:23:26.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.062+0000 7fd2d265e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd2cc06c560 con 0x7fd2cc1598c0 2024-09-12T02:23:26.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.062+0000 7fd2d265e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd2cc15a290 con 0x7fd2cc06bbe0 2024-09-12T02:23:26.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.061+0000 7f2130d9e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f212c0c3a80 0x7f212c1e7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:26.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.063+0000 7fd2cb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2cc153de0 0x7fd2cc1487a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:26.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.061+0000 7f2130d9e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f212c0c3a80 0x7f212c1e7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:46718/0 (socket says 172.21.15.60:46718) 2024-09-12T02:23:26.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.063+0000 7fd2cb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2cc153de0 0x7fd2cc1487a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50132/0 (socket says 172.21.15.60:50132) 2024-09-12T02:23:26.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.063+0000 7fd2cb7fe640 1 -- 172.21.15.60:0/4227803253 learned_addr learned my addr 172.21.15.60:0/4227803253 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:26.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.061+0000 7f2130d9e640 1 -- 172.21.15.60:0/2048923328 learned_addr learned my addr 172.21.15.60:0/2048923328 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:26.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.061+0000 7f212b7fe640 1 --2- 172.21.15.60:0/2048923328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f212c0c36a0 0x7f212c0a9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:26.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.061+0000 7f213159f640 1 -- 172.21.15.60:0/2048923328 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f212c0c43d0 con 0x7f212c0c3a80 2024-09-12T02:23:26.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.059+0000 7efc827fc640 1 -- 172.21.15.60:0/1722712758 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc88044070 con 0x7efc8c0c29e0 2024-09-12T02:23:26.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.060+0000 7efc827fc640 1 -- 172.21.15.60:0/1722712758 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc88035ab0 con 0x7efc8c0c29e0 2024-09-12T02:23:26.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.061+0000 7efc827fc640 1 -- 172.21.15.60:0/1722712758 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc88035e60 con 0x7efc8c0c29e0 2024-09-12T02:23:26.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.063+0000 7efc94253640 1 -- 172.21.15.60:0/1722712758 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc8c1e7350 con 0x7efc8c0c29e0 2024-09-12T02:23:26.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.063+0000 7efc94253640 1 -- 172.21.15.60:0/1722712758 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc8c070b90 con 0x7efc8c0c29e0 2024-09-12T02:23:26.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.063+0000 7fd2cbfff640 1 --2- 172.21.15.60:0/4227803253 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2cc06bbe0 0x7fd2cc1f0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:26.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.063+0000 7fd2d0bfb640 1 --2- 172.21.15.60:0/4227803253 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2cc1598c0 0x7fd2cc142360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:26.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.061+0000 7f213159f640 1 -- 172.21.15.60:0/2048923328 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f212c152a80 con 0x7f212c06ddc0 2024-09-12T02:23:26.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.062+0000 7f2130d9e640 1 -- 172.21.15.60:0/2048923328 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f212c06ddc0 msgr2=0x7f212c1561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:26.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.062+0000 7f2130d9e640 1 --2- 172.21.15.60:0/2048923328 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f212c06ddc0 0x7f212c1561d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.063+0000 7fd2cb7fe640 1 -- 172.21.15.60:0/4227803253 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2cc06bbe0 msgr2=0x7fd2cc1f0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:26.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.063+0000 7fd2cb7fe640 1 --2- 172.21.15.60:0/4227803253 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2cc06bbe0 0x7fd2cc1f0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.063+0000 7fd2cb7fe640 1 -- 172.21.15.60:0/4227803253 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2cc1598c0 msgr2=0x7fd2cc142360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:26.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.063+0000 7fd2cb7fe640 1 --2- 172.21.15.60:0/4227803253 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2cc1598c0 0x7fd2cc142360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.063+0000 7fd2cb7fe640 1 -- 172.21.15.60:0/4227803253 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2cc1ec120 con 0x7fd2cc153de0 2024-09-12T02:23:26.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.062+0000 7f2130d9e640 1 -- 172.21.15.60:0/2048923328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f212c0c36a0 msgr2=0x7f212c0a9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:26.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.062+0000 7f2130d9e640 1 --2- 172.21.15.60:0/2048923328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f212c0c36a0 0x7f212c0a9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.062+0000 7f2130d9e640 1 -- 172.21.15.60:0/2048923328 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f212c155350 con 0x7f212c0c3a80 2024-09-12T02:23:26.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.062+0000 7f212b7fe640 1 --2- 172.21.15.60:0/2048923328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f212c0c36a0 0x7f212c0a9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:23:26.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.062+0000 7f2130d9e640 1 --2- 172.21.15.60:0/2048923328 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f212c0c3a80 0x7f212c1e7090 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f212000b490 tx=0x7f212000b950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:26.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.063+0000 7fd2cb7fe640 1 --2- 172.21.15.60:0/4227803253 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2cc153de0 0x7fd2cc1487a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc00eb70 tx=0x7fd2bc00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:26.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.062+0000 7f212bfff640 1 --2- 172.21.15.60:0/2048923328 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f212c06ddc0 0x7f212c1561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-12T02:23:26.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.063+0000 7f61b8a12640 1 -- 172.21.15.60:0/1888220652 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61ac049fc0 msgr2=0x7f61ac173a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:26.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.064+0000 7f2128ff9640 1 -- 172.21.15.60:0/2048923328 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2120015020 con 0x7f212c0c3a80 2024-09-12T02:23:26.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.063+0000 7f61b8a12640 1 --2- 172.21.15.60:0/1888220652 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61ac049fc0 0x7f61ac173a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.063+0000 7f61b8a12640 1 -- 172.21.15.60:0/1888220652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61ac0d7890 msgr2=0x7f61ac16fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:26.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.064+0000 7f213159f640 1 -- 172.21.15.60:0/2048923328 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f212c154ab0 con 0x7f212c0c3a80 2024-09-12T02:23:26.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.063+0000 7f61b8a12640 1 --2- 172.21.15.60:0/1888220652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61ac0d7890 0x7f61ac16fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.063+0000 7f61b8a12640 1 -- 172.21.15.60:0/1888220652 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61ac048fe0 con 0x7f61ac04dc60 2024-09-12T02:23:26.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.064+0000 7f1b5e59c640 1 --2- 172.21.15.60:0/3609646291 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1b4406bf30 0x7f1b4406e3f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1b48006fd0 tx=0x7f1b48008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:26.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.064+0000 7f213159f640 1 -- 172.21.15.60:0/2048923328 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f212c155070 con 0x7f212c0c3a80 2024-09-12T02:23:26.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.064+0000 7fd569a01640 1 Processor -- start 2024-09-12T02:23:26.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.064+0000 7f61b8a12640 1 --2- 172.21.15.60:0/1888220652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61ac04dc60 0x7f61ac047420 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f61b4050d60 tx=0x7f61b40699a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:26.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.064+0000 7f61a9ffb640 1 -- 172.21.15.60:0/1888220652 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b406bbe0 con 0x7f61ac04dc60 2024-09-12T02:23:26.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.064+0000 7fd569a01640 1 -- start start 2024-09-12T02:23:26.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.065+0000 7efc94253640 1 -- 172.21.15.60:0/1722712758 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc8c068b10 con 0x7efc8c0c29e0 2024-09-12T02:23:26.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.065+0000 7f61a9ffb640 1 -- 172.21.15.60:0/1888220652 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61b4092020 con 0x7f61ac04dc60 2024-09-12T02:23:26.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.065+0000 7f61ba215640 1 -- 172.21.15.60:0/1888220652 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61ac046ab0 con 0x7f61ac04dc60 2024-09-12T02:23:26.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.064+0000 7f2128ff9640 1 -- 172.21.15.60:0/2048923328 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2120011850 con 0x7f212c0c3a80 2024-09-12T02:23:26.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.064+0000 7f2128ff9640 1 -- 172.21.15.60:0/2048923328 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2120011c40 con 0x7f212c0c3a80 2024-09-12T02:23:26.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.065+0000 7f61ba215640 1 -- 172.21.15.60:0/1888220652 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61ac0d9d20 con 0x7f61ac04dc60 2024-09-12T02:23:26.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.065+0000 7f61a9ffb640 1 -- 172.21.15.60:0/1888220652 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b4074400 con 0x7f61ac04dc60 2024-09-12T02:23:26.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.065+0000 7f21127fc640 1 -- 172.21.15.60:0/2048923328 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f212c0a6f60 con 0x7f212c0c3a80 2024-09-12T02:23:26.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.066+0000 7fd569a01640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd56406d490 0x7fd5640734a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:26.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.066+0000 7fd569a01640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5640c3b60 0x7fd5641555c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:26.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.066+0000 7fd569a01640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd56414fcf0 0x7fd564155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:26.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.066+0000 7fd569a01640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd56406eab0 con 0x7fd5640c3b60 2024-09-12T02:23:26.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.066+0000 7fd569a01640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd5641500d0 con 0x7fd56414fcf0 2024-09-12T02:23:26.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.066+0000 7fd569a01640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd56406ec30 con 0x7fd56406d490 2024-09-12T02:23:26.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.066+0000 7fd5637fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd56414fcf0 0x7fd564155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:26.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.066+0000 7fd5637fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd56414fcf0 0x7fd564155b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:46750/0 (socket says 172.21.15.60:46750) 2024-09-12T02:23:26.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.066+0000 7fd5637fe640 1 -- 172.21.15.60:0/2855335035 learned_addr learned my addr 172.21.15.60:0/2855335035 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:26.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.066+0000 7fd562ffd640 1 --2- 172.21.15.60:0/2855335035 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd56406d490 0x7fd5640734a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:26.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.067+0000 7fd5627fc640 1 --2- 172.21.15.60:0/2855335035 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5640c3b60 0x7fd5641555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:26.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.067+0000 7f61ba215640 1 -- 172.21.15.60:0/1888220652 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61ac04a410 con 0x7f61ac04dc60 2024-09-12T02:23:26.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.067+0000 7fd562ffd640 1 -- 172.21.15.60:0/2855335035 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd56414fcf0 msgr2=0x7fd564155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:26.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.067+0000 7fd562ffd640 1 --2- 172.21.15.60:0/2855335035 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd56414fcf0 0x7fd564155b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.067+0000 7fd562ffd640 1 -- 172.21.15.60:0/2855335035 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5640c3b60 msgr2=0x7fd5641555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:26.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.067+0000 7fd562ffd640 1 --2- 172.21.15.60:0/2855335035 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5640c3b60 0x7fd5641555c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.067+0000 7fd562ffd640 1 -- 172.21.15.60:0/2855335035 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd56414b5d0 con 0x7fd56406d490 2024-09-12T02:23:26.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.067+0000 7f2128ff9640 1 -- 172.21.15.60:0/2048923328 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2120018020 con 0x7f212c0c3a80 2024-09-12T02:23:26.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.067+0000 7fd562ffd640 1 --2- 172.21.15.60:0/2855335035 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd56406d490 0x7fd5640734a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd55400b440 tx=0x7fd55400b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:26.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.067+0000 7f61a9ffb640 1 -- 172.21.15.60:0/1888220652 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f61b40745a0 con 0x7f61ac04dc60 2024-09-12T02:23:26.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.068+0000 7f2128ff9640 1 --2- 172.21.15.60:0/2048923328 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f211806be80 0x7f211806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:26.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.068+0000 7f61a9ffb640 1 --2- 172.21.15.60:0/1888220652 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f619806be80 0x7f619806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:26.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.068+0000 7f61a9ffb640 1 -- 172.21.15.60:0/1888220652 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f61b4107100 con 0x7f61ac04dc60 2024-09-12T02:23:26.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.068+0000 7f212bfff640 1 --2- 172.21.15.60:0/2048923328 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f211806be80 0x7f211806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:26.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.068+0000 7f1b56ffd640 1 -- 172.21.15.60:0/3609646291 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1b58058f90 con 0x7f1b60157f50 2024-09-12T02:23:26.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.069+0000 7fd54bfff640 1 -- 172.21.15.60:0/2855335035 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd554015020 con 0x7fd56406d490 2024-09-12T02:23:26.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.069+0000 7f2128ff9640 1 -- 172.21.15.60:0/2048923328 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f212008b190 con 0x7f212c0c3a80 2024-09-12T02:23:26.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.069+0000 7fd54bfff640 1 -- 172.21.15.60:0/2855335035 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd554011850 con 0x7fd56406d490 2024-09-12T02:23:26.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.069+0000 7f61b9213640 1 --2- 172.21.15.60:0/1888220652 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f619806be80 0x7f619806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:26.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.069+0000 7fd54bfff640 1 -- 172.21.15.60:0/2855335035 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd554011c40 con 0x7fd56406d490 2024-09-12T02:23:26.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.069+0000 7f212bfff640 1 --2- 172.21.15.60:0/2048923328 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f211806be80 0x7f211806e340 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f211c000f60 tx=0x7f211c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:26.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.069+0000 7f61b9213640 1 --2- 172.21.15.60:0/1888220652 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f619806be80 0x7f619806e340 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f61ac049860 tx=0x7f61a4009060 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:26.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.069+0000 7fd569a01640 1 -- 172.21.15.60:0/2855335035 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd56414b8b0 con 0x7fd56406d490 2024-09-12T02:23:26.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.069+0000 7fd569a01640 1 -- 172.21.15.60:0/2855335035 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd564073e00 con 0x7fd56406d490 2024-09-12T02:23:26.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.070+0000 7fd2c8ff9640 1 -- 172.21.15.60:0/4227803253 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc017070 con 0x7fd2cc153de0 2024-09-12T02:23:26.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.070+0000 7fd2c8ff9640 1 -- 172.21.15.60:0/4227803253 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2bc00ed80 con 0x7fd2cc153de0 2024-09-12T02:23:26.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.070+0000 7fd2c8ff9640 1 -- 172.21.15.60:0/4227803253 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc00cdd0 con 0x7fd2cc153de0 2024-09-12T02:23:26.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.070+0000 7fd2d265e640 1 -- 172.21.15.60:0/4227803253 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2cc1ec3e0 con 0x7fd2cc153de0 2024-09-12T02:23:26.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.070+0000 7fd2d265e640 1 -- 172.21.15.60:0/4227803253 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2cc1ec9a0 con 0x7fd2cc153de0 2024-09-12T02:23:26.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.070+0000 7efc827fc640 1 -- 172.21.15.60:0/1722712758 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efc8803d040 con 0x7efc8c0c29e0 2024-09-12T02:23:26.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.071+0000 7efc827fc640 1 --2- 172.21.15.60:0/1722712758 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7efc7006bf00 0x7efc7006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:26.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.071+0000 7efc827fc640 1 -- 172.21.15.60:0/1722712758 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7efc880acc00 con 0x7efc8c0c29e0 2024-09-12T02:23:26.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.072+0000 7f2128ff9640 1 -- 172.21.15.60:0/2048923328 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f212001f020 con 0x7f212c0c3a80 2024-09-12T02:23:26.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.072+0000 7efc917ee640 1 --2- 172.21.15.60:0/1722712758 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7efc7006bf00 0x7efc7006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:26.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.071+0000 7fd2d265e640 1 -- 172.21.15.60:0/4227803253 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2cc14c260 con 0x7fd2cc153de0 2024-09-12T02:23:26.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.072+0000 7fd54bfff640 1 -- 172.21.15.60:0/2855335035 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd554018020 con 0x7fd56406d490 2024-09-12T02:23:26.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.072+0000 7fd569a01640 1 -- 172.21.15.60:0/2855335035 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5640ab370 con 0x7fd56406d490 2024-09-12T02:23:26.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.072+0000 7efc917ee640 1 --2- 172.21.15.60:0/1722712758 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7efc7006bf00 0x7efc7006e3c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7efc8c1e81c0 tx=0x7efc84009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:26.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.073+0000 7fd54bfff640 1 --2- 172.21.15.60:0/2855335035 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd55006bf30 0x7fd55006e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:26.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.073+0000 7fd54bfff640 1 -- 172.21.15.60:0/2855335035 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7fd55408a940 con 0x7fd56406d490 2024-09-12T02:23:26.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.073+0000 7fd5627fc640 1 --2- 172.21.15.60:0/2855335035 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd55006bf30 0x7fd55006e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:26.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.074+0000 7fd5627fc640 1 --2- 172.21.15.60:0/2855335035 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd55006bf30 0x7fd55006e3f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd558034000 tx=0x7fd55802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:26.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.076+0000 7efc827fc640 1 -- 172.21.15.60:0/1722712758 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efc8807b2f0 con 0x7efc8c0c29e0 2024-09-12T02:23:26.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.078+0000 7fd2c8ff9640 1 -- 172.21.15.60:0/4227803253 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd2bc01a070 con 0x7fd2cc153de0 2024-09-12T02:23:26.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.078+0000 7fd2c8ff9640 1 --2- 172.21.15.60:0/4227803253 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd2b806bf00 0x7fd2b806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:26.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.078+0000 7fd2c8ff9640 1 -- 172.21.15.60:0/4227803253 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7fd2bc08b910 con 0x7fd2cc153de0 2024-09-12T02:23:26.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.079+0000 7fd2cbfff640 1 --2- 172.21.15.60:0/4227803253 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd2b806bf00 0x7fd2b806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:26.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.079+0000 7f61a9ffb640 1 -- 172.21.15.60:0/1888220652 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f61b409c030 con 0x7f61ac04dc60 2024-09-12T02:23:26.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.080+0000 7fd2cbfff640 1 --2- 172.21.15.60:0/4227803253 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd2b806bf00 0x7fd2b806e3c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd2c4007fd0 tx=0x7fd2c4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:26.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.081+0000 7fd54bfff640 1 -- 172.21.15.60:0/2855335035 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd55401f070 con 0x7fd56406d490 2024-09-12T02:23:26.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.083+0000 7fd2c8ff9640 1 -- 172.21.15.60:0/4227803253 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd2cc14c260 con 0x7fd2cc153de0 2024-09-12T02:23:26.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.357+0000 7f4ea832a640 1 -- 172.21.15.60:0/3891666313 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f4e88005580 con 0x7f4ea00c5940 2024-09-12T02:23:26.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.358+0000 7f4e96ffd640 1 -- 172.21.15.60:0/3891666313 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4e9805d1f0 con 0x7f4ea00c5940 2024-09-12T02:23:26.358 INFO:teuthology.orchestra.run.smithi060.stdout:60129542154 2024-09-12T02:23:26.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.361+0000 7f4e94ff9640 1 -- 172.21.15.60:0/3891666313 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4e8406bf00 msgr2=0x7f4e8406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:26.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.361+0000 7f4e94ff9640 1 --2- 172.21.15.60:0/3891666313 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4e8406bf00 0x7f4e8406e3c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4e90037000 tx=0x7f4e90009000 comp rx=0 tx=0).stop 2024-09-12T02:23:26.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.362+0000 7f4e94ff9640 1 -- 172.21.15.60:0/3891666313 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ea00c5940 msgr2=0x7f4ea01f9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:26.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.362+0000 7f4e94ff9640 1 --2- 172.21.15.60:0/3891666313 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ea00c5940 0x7f4ea01f9090 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4e9800cb40 tx=0x7f4e9800a060 comp rx=0 tx=0).stop 2024-09-12T02:23:26.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.362+0000 7f4e94ff9640 1 -- 172.21.15.60:0/3891666313 shutdown_connections 2024-09-12T02:23:26.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.362+0000 7f4e94ff9640 1 --2- 172.21.15.60:0/3891666313 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4e8406bf00 0x7f4e8406e3c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.362+0000 7f4e94ff9640 1 --2- 172.21.15.60:0/3891666313 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ea00c5940 0x7f4ea01f9090 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.362+0000 7f4e94ff9640 1 --2- 172.21.15.60:0/3891666313 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ea00c26b0 0x7f4ea01ed520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.362+0000 7f4e94ff9640 1 --2- 172.21.15.60:0/3891666313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ea008d440 0x7f4ea00acd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.362+0000 7f4e94ff9640 1 -- 172.21.15.60:0/3891666313 >> 172.21.15.60:0/3891666313 conn(0x7f4ea00c7a40 msgr2=0x7f4ea0160cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:26.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.362+0000 7f4e94ff9640 1 -- 172.21.15.60:0/3891666313 shutdown_connections 2024-09-12T02:23:26.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.363+0000 7f4e94ff9640 1 -- 172.21.15.60:0/3891666313 wait complete. 2024-09-12T02:23:26.379 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.3 2024-09-12T02:23:26.380 DEBUG:teuthology.parallel:result is None 2024-09-12T02:23:26.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.417+0000 7f21127fc640 1 -- 172.21.15.60:0/2048923328 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f212c0720d0 con 0x7f212c0c3a80 2024-09-12T02:23:26.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.417+0000 7ffa52465640 1 -- 172.21.15.60:0/3493732224 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7ffa2c005580 con 0x7ffa4c06f1d0 2024-09-12T02:23:26.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.418+0000 7f2128ff9640 1 -- 172.21.15.60:0/2048923328 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2120059980 con 0x7f212c0c3a80 2024-09-12T02:23:26.419 INFO:teuthology.orchestra.run.smithi060.stdout:68719476745 2024-09-12T02:23:26.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.418+0000 7ffa48ff9640 1 -- 172.21.15.60:0/3493732224 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ffa400172c0 con 0x7ffa4c06f1d0 2024-09-12T02:23:26.419 INFO:teuthology.orchestra.run.smithi060.stdout:64424509450 2024-09-12T02:23:26.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.420+0000 7f21127fc640 1 -- 172.21.15.60:0/2048923328 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f211806be80 msgr2=0x7f211806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:26.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.420+0000 7f21127fc640 1 --2- 172.21.15.60:0/2048923328 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f211806be80 0x7f211806e340 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f211c000f60 tx=0x7f211c009040 comp rx=0 tx=0).stop 2024-09-12T02:23:26.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.420+0000 7f21127fc640 1 -- 172.21.15.60:0/2048923328 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f212c0c3a80 msgr2=0x7f212c1e7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:26.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.420+0000 7f21127fc640 1 --2- 172.21.15.60:0/2048923328 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f212c0c3a80 0x7f212c1e7090 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f212000b490 tx=0x7f212000b950 comp rx=0 tx=0).stop 2024-09-12T02:23:26.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.420+0000 7f21127fc640 1 -- 172.21.15.60:0/2048923328 shutdown_connections 2024-09-12T02:23:26.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.420+0000 7f21127fc640 1 --2- 172.21.15.60:0/2048923328 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f211806be80 0x7f211806e340 secure :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f211c000f60 tx=0x7f211c009040 comp rx=0 tx=0).stop 2024-09-12T02:23:26.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.420+0000 7f21127fc640 1 --2- 172.21.15.60:0/2048923328 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f212c0c3a80 0x7f212c1e7090 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.420+0000 7f21127fc640 1 --2- 172.21.15.60:0/2048923328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f212c0c36a0 0x7f212c0a9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.420+0000 7f21127fc640 1 --2- 172.21.15.60:0/2048923328 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f212c06ddc0 0x7f212c1561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.420+0000 7f21127fc640 1 -- 172.21.15.60:0/2048923328 >> 172.21.15.60:0/2048923328 conn(0x7f212c0c7ae0 msgr2=0x7f212c0ab1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:26.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.421+0000 7f21127fc640 1 -- 172.21.15.60:0/2048923328 shutdown_connections 2024-09-12T02:23:26.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.421+0000 7f21127fc640 1 -- 172.21.15.60:0/2048923328 wait complete. 2024-09-12T02:23:26.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.422+0000 7ffa52465640 1 -- 172.21.15.60:0/3493732224 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ffa3806bf30 msgr2=0x7ffa3806e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:26.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.422+0000 7ffa52465640 1 --2- 172.21.15.60:0/3493732224 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ffa3806bf30 0x7ffa3806e3f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c0c81e0 tx=0x7ffa3c006c20 comp rx=0 tx=0).stop 2024-09-12T02:23:26.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.422+0000 7ffa52465640 1 -- 172.21.15.60:0/3493732224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa4c06f1d0 msgr2=0x7ffa4c072010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:26.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.422+0000 7ffa52465640 1 --2- 172.21.15.60:0/3493732224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa4c06f1d0 0x7ffa4c072010 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ffa4000b410 tx=0x7ffa4000b8d0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.422+0000 7ffa52465640 1 -- 172.21.15.60:0/3493732224 shutdown_connections 2024-09-12T02:23:26.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.422+0000 7ffa52465640 1 --2- 172.21.15.60:0/3493732224 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ffa3806bf30 0x7ffa3806e3f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.422+0000 7ffa52465640 1 --2- 172.21.15.60:0/3493732224 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa4c14fa90 0x7ffa4c0a63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.422+0000 7ffa52465640 1 --2- 172.21.15.60:0/3493732224 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa4c0c5940 0x7ffa4c14eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.422+0000 7ffa52465640 1 --2- 172.21.15.60:0/3493732224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa4c06f1d0 0x7ffa4c072010 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.422+0000 7ffa52465640 1 -- 172.21.15.60:0/3493732224 >> 172.21.15.60:0/3493732224 conn(0x7ffa4c0c7a40 msgr2=0x7ffa4c150f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:26.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.423+0000 7ffa52465640 1 -- 172.21.15.60:0/3493732224 shutdown_connections 2024-09-12T02:23:26.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.423+0000 7ffa52465640 1 -- 172.21.15.60:0/3493732224 wait complete. 2024-09-12T02:23:26.434 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476745 got 68719476745 for osd.6 2024-09-12T02:23:26.434 DEBUG:teuthology.parallel:result is None 2024-09-12T02:23:26.440 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509450 for osd.0 2024-09-12T02:23:26.440 DEBUG:teuthology.parallel:result is None 2024-09-12T02:23:26.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.453+0000 7f1b64f11640 1 -- 172.21.15.60:0/3609646291 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f1b60073ca0 con 0x7f1b60157f50 2024-09-12T02:23:26.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.454+0000 7f1b56ffd640 1 -- 172.21.15.60:0/3609646291 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1b5805d290 con 0x7f1b60157f50 2024-09-12T02:23:26.454 INFO:teuthology.orchestra.run.smithi060.stdout:64424509448 2024-09-12T02:23:26.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.456+0000 7f1b64f11640 1 -- 172.21.15.60:0/3609646291 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1b4406bf30 msgr2=0x7f1b4406e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:26.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.456+0000 7f1b64f11640 1 --2- 172.21.15.60:0/3609646291 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1b4406bf30 0x7f1b4406e3f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1b48006fd0 tx=0x7f1b48008040 comp rx=0 tx=0).stop 2024-09-12T02:23:26.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.456+0000 7f1b64f11640 1 -- 172.21.15.60:0/3609646291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b60157f50 msgr2=0x7f1b600c8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:26.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.456+0000 7f1b64f11640 1 --2- 172.21.15.60:0/3609646291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b60157f50 0x7f1b600c8b30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1b5800b9a0 tx=0x7f1b5800be60 comp rx=0 tx=0).stop 2024-09-12T02:23:26.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.456+0000 7f1b64f11640 1 -- 172.21.15.60:0/3609646291 shutdown_connections 2024-09-12T02:23:26.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.456+0000 7f1b64f11640 1 --2- 172.21.15.60:0/3609646291 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1b4406bf30 0x7f1b4406e3f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.456+0000 7f1b64f11640 1 --2- 172.21.15.60:0/3609646291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b60157f50 0x7f1b600c8b30 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.456+0000 7f1b64f11640 1 --2- 172.21.15.60:0/3609646291 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1b600ad360 0x7f1b601313c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.456+0000 7f1b64f11640 1 --2- 172.21.15.60:0/3609646291 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1b60073ec0 0x7f1b601412e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.456+0000 7f1b64f11640 1 -- 172.21.15.60:0/3609646291 >> 172.21.15.60:0/3609646291 conn(0x7f1b600c6980 msgr2=0x7f1b600ab460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:26.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.456+0000 7f1b64f11640 1 -- 172.21.15.60:0/3609646291 shutdown_connections 2024-09-12T02:23:26.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.456+0000 7f1b64f11640 1 -- 172.21.15.60:0/3609646291 wait complete. 2024-09-12T02:23:26.467 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509448 for osd.2 2024-09-12T02:23:26.467 DEBUG:teuthology.parallel:result is None 2024-09-12T02:23:26.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.489+0000 7efc94253640 1 -- 172.21.15.60:0/1722712758 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7efc8c0c2dc0 con 0x7efc8c0c29e0 2024-09-12T02:23:26.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.490+0000 7efc827fc640 1 -- 172.21.15.60:0/1722712758 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efc8807abf0 con 0x7efc8c0c29e0 2024-09-12T02:23:26.494 INFO:teuthology.orchestra.run.smithi060.stdout:68719476746 2024-09-12T02:23:26.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.491+0000 7f61ba215640 1 -- 172.21.15.60:0/1888220652 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f61ac04d540 con 0x7f61ac04dc60 2024-09-12T02:23:26.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.492+0000 7f61a9ffb640 1 -- 172.21.15.60:0/1888220652 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f61b40d51a0 con 0x7f61ac04dc60 2024-09-12T02:23:26.495 INFO:teuthology.orchestra.run.smithi060.stdout:60129542153 2024-09-12T02:23:26.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.493+0000 7efc94253640 1 -- 172.21.15.60:0/1722712758 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7efc7006bf00 msgr2=0x7efc7006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:26.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.493+0000 7efc94253640 1 --2- 172.21.15.60:0/1722712758 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7efc7006bf00 0x7efc7006e3c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7efc8c1e81c0 tx=0x7efc84009040 comp rx=0 tx=0).stop 2024-09-12T02:23:26.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.493+0000 7efc94253640 1 -- 172.21.15.60:0/1722712758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc8c0c29e0 msgr2=0x7efc8c0bd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:26.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.493+0000 7efc94253640 1 --2- 172.21.15.60:0/1722712758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc8c0c29e0 0x7efc8c0bd410 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efc88010cb0 tx=0x7efc880046c0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.493+0000 7efc94253640 1 -- 172.21.15.60:0/1722712758 shutdown_connections 2024-09-12T02:23:26.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.493+0000 7efc94253640 1 --2- 172.21.15.60:0/1722712758 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7efc7006bf00 0x7efc7006e3c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.493+0000 7efc94253640 1 --2- 172.21.15.60:0/1722712758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc8c1564a0 0x7efc8c14ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.493+0000 7efc94253640 1 --2- 172.21.15.60:0/1722712758 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efc8c153240 0x7efc8c154740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.493+0000 7efc94253640 1 --2- 172.21.15.60:0/1722712758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc8c0c29e0 0x7efc8c0bd410 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.493+0000 7efc94253640 1 -- 172.21.15.60:0/1722712758 >> 172.21.15.60:0/1722712758 conn(0x7efc8c0a9680 msgr2=0x7efc8c0a8ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:26.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.493+0000 7efc94253640 1 -- 172.21.15.60:0/1722712758 shutdown_connections 2024-09-12T02:23:26.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.493+0000 7efc94253640 1 -- 172.21.15.60:0/1722712758 wait complete. 2024-09-12T02:23:26.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.493+0000 7fd569a01640 1 -- 172.21.15.60:0/2855335035 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fd56406f000 con 0x7fd56406d490 2024-09-12T02:23:26.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.494+0000 7fd54bfff640 1 -- 172.21.15.60:0/2855335035 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd554059030 con 0x7fd56406d490 2024-09-12T02:23:26.498 INFO:teuthology.orchestra.run.smithi060.stdout:68719476745 2024-09-12T02:23:26.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.495+0000 7f61ba215640 1 -- 172.21.15.60:0/1888220652 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f619806be80 msgr2=0x7f619806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:26.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.495+0000 7f61ba215640 1 --2- 172.21.15.60:0/1888220652 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f619806be80 0x7f619806e340 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f61ac049860 tx=0x7f61a4009060 comp rx=0 tx=0).stop 2024-09-12T02:23:26.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.495+0000 7f61ba215640 1 -- 172.21.15.60:0/1888220652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61ac04dc60 msgr2=0x7f61ac047420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:26.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.495+0000 7f61ba215640 1 --2- 172.21.15.60:0/1888220652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61ac04dc60 0x7f61ac047420 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f61b4050d60 tx=0x7f61b40699a0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.495+0000 7f61ba215640 1 -- 172.21.15.60:0/1888220652 shutdown_connections 2024-09-12T02:23:26.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.495+0000 7f61ba215640 1 --2- 172.21.15.60:0/1888220652 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f619806be80 0x7f619806e340 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.495+0000 7f61ba215640 1 --2- 172.21.15.60:0/1888220652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61ac0d7890 0x7f61ac16fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.495+0000 7f61ba215640 1 --2- 172.21.15.60:0/1888220652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61ac04dc60 0x7f61ac047420 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.495+0000 7f61ba215640 1 --2- 172.21.15.60:0/1888220652 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61ac049fc0 0x7f61ac173a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.495+0000 7f61ba215640 1 -- 172.21.15.60:0/1888220652 >> 172.21.15.60:0/1888220652 conn(0x7f61ac04c0c0 msgr2=0x7f61ac00e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:26.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.495+0000 7f61ba215640 1 -- 172.21.15.60:0/1888220652 shutdown_connections 2024-09-12T02:23:26.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.495+0000 7f61ba215640 1 -- 172.21.15.60:0/1888220652 wait complete. 2024-09-12T02:23:26.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.496+0000 7fd2d265e640 1 -- 172.21.15.60:0/4227803253 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fd2cc06c020 con 0x7fd2cc153de0 2024-09-12T02:23:26.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.496+0000 7fd2c8ff9640 1 -- 172.21.15.60:0/4227803253 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd2bc05a000 con 0x7fd2cc153de0 2024-09-12T02:23:26.501 INFO:teuthology.orchestra.run.smithi060.stdout:64424509449 2024-09-12T02:23:26.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.497+0000 7fd569a01640 1 -- 172.21.15.60:0/2855335035 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd55006bf30 msgr2=0x7fd55006e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:26.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.497+0000 7fd569a01640 1 --2- 172.21.15.60:0/2855335035 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd55006bf30 0x7fd55006e3f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd558034000 tx=0x7fd55802e000 comp rx=0 tx=0).stop 2024-09-12T02:23:26.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.497+0000 7fd569a01640 1 -- 172.21.15.60:0/2855335035 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd56406d490 msgr2=0x7fd5640734a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:26.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.497+0000 7fd569a01640 1 --2- 172.21.15.60:0/2855335035 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd56406d490 0x7fd5640734a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd55400b440 tx=0x7fd55400b900 comp rx=0 tx=0).stop 2024-09-12T02:23:26.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.497+0000 7fd569a01640 1 -- 172.21.15.60:0/2855335035 shutdown_connections 2024-09-12T02:23:26.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.497+0000 7fd569a01640 1 --2- 172.21.15.60:0/2855335035 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd55006bf30 0x7fd55006e3f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.497+0000 7fd569a01640 1 --2- 172.21.15.60:0/2855335035 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd56414fcf0 0x7fd564155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.497+0000 7fd569a01640 1 --2- 172.21.15.60:0/2855335035 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5640c3b60 0x7fd5641555c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.497+0000 7fd569a01640 1 --2- 172.21.15.60:0/2855335035 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd56406d490 0x7fd5640734a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.497+0000 7fd569a01640 1 -- 172.21.15.60:0/2855335035 >> 172.21.15.60:0/2855335035 conn(0x7fd5640c4c50 msgr2=0x7fd56406e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:26.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.497+0000 7fd569a01640 1 -- 172.21.15.60:0/2855335035 shutdown_connections 2024-09-12T02:23:26.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.497+0000 7fd569a01640 1 -- 172.21.15.60:0/2855335035 wait complete. 2024-09-12T02:23:26.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.499+0000 7fd2d265e640 1 -- 172.21.15.60:0/4227803253 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd2b806bf00 msgr2=0x7fd2b806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:26.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.499+0000 7fd2d265e640 1 --2- 172.21.15.60:0/4227803253 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd2b806bf00 0x7fd2b806e3c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd2c4007fd0 tx=0x7fd2c4009040 comp rx=0 tx=0).stop 2024-09-12T02:23:26.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.499+0000 7fd2d265e640 1 -- 172.21.15.60:0/4227803253 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2cc153de0 msgr2=0x7fd2cc1487a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:26.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.499+0000 7fd2d265e640 1 --2- 172.21.15.60:0/4227803253 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2cc153de0 0x7fd2cc1487a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc00eb70 tx=0x7fd2bc00c520 comp rx=0 tx=0).stop 2024-09-12T02:23:26.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.500+0000 7fd2d265e640 1 -- 172.21.15.60:0/4227803253 shutdown_connections 2024-09-12T02:23:26.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.500+0000 7fd2d265e640 1 --2- 172.21.15.60:0/4227803253 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd2b806bf00 0x7fd2b806e3c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.500+0000 7fd2d265e640 1 --2- 172.21.15.60:0/4227803253 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2cc1598c0 0x7fd2cc142360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.500+0000 7fd2d265e640 1 --2- 172.21.15.60:0/4227803253 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2cc153de0 0x7fd2cc1487a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.500+0000 7fd2d265e640 1 --2- 172.21.15.60:0/4227803253 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2cc06bbe0 0x7fd2cc1f0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.500+0000 7fd2d265e640 1 -- 172.21.15.60:0/4227803253 >> 172.21.15.60:0/4227803253 conn(0x7fd2cc0c8800 msgr2=0x7fd2cc0c9950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:26.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.500+0000 7fd2d265e640 1 -- 172.21.15.60:0/4227803253 shutdown_connections 2024-09-12T02:23:26.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.500+0000 7fd2d265e640 1 -- 172.21.15.60:0/4227803253 wait complete. 2024-09-12T02:23:26.511 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476746 got 68719476746 for osd.5 2024-09-12T02:23:26.511 DEBUG:teuthology.parallel:result is None 2024-09-12T02:23:26.513 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.1 2024-09-12T02:23:26.513 DEBUG:teuthology.parallel:result is None 2024-09-12T02:23:26.514 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476745 got 68719476745 for osd.7 2024-09-12T02:23:26.514 DEBUG:teuthology.parallel:result is None 2024-09-12T02:23:26.516 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509449 for osd.4 2024-09-12T02:23:26.516 DEBUG:teuthology.parallel:result is None 2024-09-12T02:23:26.516 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T02:23:26.516 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:23:26.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.658+0000 7f1ea3ca5640 1 Processor -- start 2024-09-12T02:23:26.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.658+0000 7f1ea3ca5640 1 -- start start 2024-09-12T02:23:26.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.659+0000 7f1ea3ca5640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1e9c0c69c0 0x7f1e9c153910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:26.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.659+0000 7f1ea3ca5640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1e9c0c42b0 0x7f1e9c0c46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:26.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.659+0000 7f1ea3ca5640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e9c0c5940 con 0x7f1e9c1505f0 2024-09-12T02:23:26.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.659+0000 7f1ea3ca5640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f1e9c0c7860 con 0x7f1e9c0c69c0 2024-09-12T02:23:26.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.659+0000 7f1ea3ca5640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1e9c0c5c00 con 0x7f1e9c0c42b0 2024-09-12T02:23:26.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.659+0000 7f1ea1240640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1e9c0c69c0 0x7f1e9c153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:26.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.659+0000 7f1ea1a41640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f1e9c1505f0 0x7f1e9c0c2440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53982/0 (socket says 172.21.15.60:53982) 2024-09-12T02:23:26.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.659+0000 7f1ea1a41640 1 -- 172.21.15.60:0/2073679345 learned_addr learned my addr 172.21.15.60:0/2073679345 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:26.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.660+0000 7f1ea2242640 1 --2- 172.21.15.60:0/2073679345 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1e9c0c42b0 0x7f1e9c0c46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:26.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.660+0000 7f1ea1240640 1 -- 172.21.15.60:0/2073679345 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1e9c0c42b0 msgr2=0x7f1e9c0c46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:26.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.660+0000 7f1ea1240640 1 --2- 172.21.15.60:0/2073679345 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1e9c0c42b0 0x7f1e9c0c46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.660+0000 7f1ea1240640 1 -- 172.21.15.60:0/2073679345 >> v1:172.21.15.60:6789/0 conn(0x7f1e9c1505f0 legacy=0x7f1e9c0c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:26.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.660+0000 7f1ea1240640 1 -- 172.21.15.60:0/2073679345 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e9c0c5ee0 con 0x7f1e9c0c69c0 2024-09-12T02:23:26.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.660+0000 7f1ea0a3f640 1 -- 172.21.15.60:0/2073679345 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2302613459 0 0) 0x7f1e9c0c5940 con 0x7f1e9c1505f0 2024-09-12T02:23:26.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.660+0000 7f1ea1240640 1 --2- 172.21.15.60:0/2073679345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e9c0c69c0 0x7f1e9c153910 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c0097a0 tx=0x7f1e8c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f3479887f5caead server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:26.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.661+0000 7f1ea0a3f640 1 -- 172.21.15.60:0/2073679345 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c037070 con 0x7f1e9c0c69c0 2024-09-12T02:23:26.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.661+0000 7f1ea0a3f640 1 -- 172.21.15.60:0/2073679345 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e8c02ae50 con 0x7f1e9c0c69c0 2024-09-12T02:23:26.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.661+0000 7f1ea0a3f640 1 -- 172.21.15.60:0/2073679345 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c032660 con 0x7f1e9c0c69c0 2024-09-12T02:23:26.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.661+0000 7f1ea3ca5640 1 -- 172.21.15.60:0/2073679345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e9c0c69c0 msgr2=0x7f1e9c153910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:26.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.661+0000 7f1ea3ca5640 1 --2- 172.21.15.60:0/2073679345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e9c0c69c0 0x7f1e9c153910 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c0097a0 tx=0x7f1e8c02a100 comp rx=0 tx=0).stop 2024-09-12T02:23:26.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.661+0000 7f1ea3ca5640 1 -- 172.21.15.60:0/2073679345 shutdown_connections 2024-09-12T02:23:26.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.661+0000 7f1ea3ca5640 1 --2- 172.21.15.60:0/2073679345 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1e9c0c42b0 0x7f1e9c0c46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.661+0000 7f1ea3ca5640 1 --2- 172.21.15.60:0/2073679345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e9c0c69c0 0x7f1e9c153910 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.661+0000 7f1ea3ca5640 1 -- 172.21.15.60:0/2073679345 >> 172.21.15.60:0/2073679345 conn(0x7f1e9c0c7a40 msgr2=0x7f1e9c0c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:26.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.661+0000 7f1ea3ca5640 1 -- 172.21.15.60:0/2073679345 shutdown_connections 2024-09-12T02:23:26.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.661+0000 7f1ea3ca5640 1 -- 172.21.15.60:0/2073679345 wait complete. 2024-09-12T02:23:26.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.662+0000 7f1ea3ca5640 1 Processor -- start 2024-09-12T02:23:26.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.662+0000 7f1ea3ca5640 1 -- start start 2024-09-12T02:23:26.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.663+0000 7f1ea3ca5640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1e9c0c42b0 0x7f1e9c0ad6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:26.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.663+0000 7f1ea3ca5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e9c1505f0 0x7f1e9c14b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:26.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.663+0000 7f1ea3ca5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e9c148280 0x7f1e9c145d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:26.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.663+0000 7f1ea3ca5640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1e9c1509d0 con 0x7f1e9c1505f0 2024-09-12T02:23:26.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.663+0000 7f1ea3ca5640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1e9c0c64a0 con 0x7f1e9c148280 2024-09-12T02:23:26.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.663+0000 7f1ea3ca5640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1e9c150b50 con 0x7f1e9c0c42b0 2024-09-12T02:23:26.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.663+0000 7f1ea1240640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e9c1505f0 0x7f1e9c14b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:26.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.663+0000 7f1ea1240640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e9c1505f0 0x7f1e9c14b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50162/0 (socket says 172.21.15.60:50162) 2024-09-12T02:23:26.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.663+0000 7f1ea1240640 1 -- 172.21.15.60:0/2879978506 learned_addr learned my addr 172.21.15.60:0/2879978506 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:26.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.663+0000 7f1ea2242640 1 --2- 172.21.15.60:0/2879978506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e9c148280 0x7f1e9c145d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:26.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.663+0000 7f1ea1a41640 1 --2- 172.21.15.60:0/2879978506 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1e9c0c42b0 0x7f1e9c0ad6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:26.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.663+0000 7f1ea1240640 1 -- 172.21.15.60:0/2879978506 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1e9c0c42b0 msgr2=0x7f1e9c0ad6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:26.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.663+0000 7f1ea1240640 1 --2- 172.21.15.60:0/2879978506 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1e9c0c42b0 0x7f1e9c0ad6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.663+0000 7f1ea1240640 1 -- 172.21.15.60:0/2879978506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e9c148280 msgr2=0x7f1e9c145d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:26.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.663+0000 7f1ea1240640 1 --2- 172.21.15.60:0/2879978506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e9c148280 0x7f1e9c145d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.663+0000 7f1ea1240640 1 -- 172.21.15.60:0/2879978506 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e9c1e85b0 con 0x7f1e9c1505f0 2024-09-12T02:23:26.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.664+0000 7f1ea1240640 1 --2- 172.21.15.60:0/2879978506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e9c1505f0 0x7f1e9c14b390 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c0098c0 tx=0x7f1e8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:26.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.664+0000 7f1e927fc640 1 -- 172.21.15.60:0/2879978506 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c041030 con 0x7f1e9c1505f0 2024-09-12T02:23:26.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.664+0000 7f1e927fc640 1 -- 172.21.15.60:0/2879978506 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e8c02ac50 con 0x7f1e9c1505f0 2024-09-12T02:23:26.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.664+0000 7f1e927fc640 1 -- 172.21.15.60:0/2879978506 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c037040 con 0x7f1e9c1505f0 2024-09-12T02:23:26.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.664+0000 7f1ea3ca5640 1 -- 172.21.15.60:0/2879978506 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e9c1e8890 con 0x7f1e9c1505f0 2024-09-12T02:23:26.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.664+0000 7f1ea3ca5640 1 -- 172.21.15.60:0/2879978506 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e9c0abfb0 con 0x7f1e9c1505f0 2024-09-12T02:23:26.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.665+0000 7f1ea3ca5640 1 -- 172.21.15.60:0/2879978506 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e9c153910 con 0x7f1e9c1505f0 2024-09-12T02:23:26.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.665+0000 7f1e927fc640 1 -- 172.21.15.60:0/2879978506 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1e8c044070 con 0x7f1e9c1505f0 2024-09-12T02:23:26.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.666+0000 7f1e927fc640 1 --2- 172.21.15.60:0/2879978506 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1e8006be30 0x7f1e8006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:26.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.666+0000 7f1e927fc640 1 -- 172.21.15.60:0/2879978506 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f1e8c0ab8f0 con 0x7f1e9c1505f0 2024-09-12T02:23:26.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.666+0000 7f1ea1a41640 1 --2- 172.21.15.60:0/2879978506 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1e8006be30 0x7f1e8006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:26.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.666+0000 7f1ea1a41640 1 --2- 172.21.15.60:0/2879978506 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1e8006be30 0x7f1e8006e2f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1e98000f60 tx=0x7f1e98007b50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:26.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.670+0000 7f1e927fc640 1 -- 172.21.15.60:0/2879978506 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1e8c044e40 con 0x7f1e9c1505f0 2024-09-12T02:23:26.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.841+0000 7f1ea3ca5640 1 -- 172.21.15.60:0/2879978506 --> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1e9c151cf0 con 0x7f1e8006be30 2024-09-12T02:23:26.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.853+0000 7f1e927fc640 1 -- 172.21.15.60:0/2879978506 <== mgr.4098 v2:172.21.15.60:6800/3549430091 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490307 (secure 0 0 0) 0x7f1e9c151cf0 con 0x7f1e8006be30 2024-09-12T02:23:26.858 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:23:26.861 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T02:23:26.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.857+0000 7f1ea3ca5640 1 -- 172.21.15.60:0/2879978506 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1e8006be30 msgr2=0x7f1e8006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:26.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.857+0000 7f1ea3ca5640 1 --2- 172.21.15.60:0/2879978506 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1e8006be30 0x7f1e8006e2f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1e98000f60 tx=0x7f1e98007b50 comp rx=0 tx=0).stop 2024-09-12T02:23:26.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.857+0000 7f1ea3ca5640 1 -- 172.21.15.60:0/2879978506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e9c1505f0 msgr2=0x7f1e9c14b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:26.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.857+0000 7f1ea3ca5640 1 --2- 172.21.15.60:0/2879978506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e9c1505f0 0x7f1e9c14b390 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c0098c0 tx=0x7f1e8c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.857+0000 7f1ea3ca5640 1 -- 172.21.15.60:0/2879978506 shutdown_connections 2024-09-12T02:23:26.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.857+0000 7f1ea3ca5640 1 --2- 172.21.15.60:0/2879978506 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1e8006be30 0x7f1e8006e2f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.857+0000 7f1ea3ca5640 1 --2- 172.21.15.60:0/2879978506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e9c148280 0x7f1e9c145d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.857+0000 7f1ea3ca5640 1 --2- 172.21.15.60:0/2879978506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e9c1505f0 0x7f1e9c14b390 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.857+0000 7f1ea3ca5640 1 --2- 172.21.15.60:0/2879978506 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1e9c0c42b0 0x7f1e9c0ad6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:26.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.857+0000 7f1ea3ca5640 1 -- 172.21.15.60:0/2879978506 >> 172.21.15.60:0/2879978506 conn(0x7f1e9c0c7a40 msgr2=0x7f1e9c0c46d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:26.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.857+0000 7f1ea3ca5640 1 -- 172.21.15.60:0/2879978506 shutdown_connections 2024-09-12T02:23:26.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:26.857+0000 7f1ea3ca5640 1 -- 172.21.15.60:0/2879978506 wait complete. 2024-09-12T02:23:26.868 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-09-12T02:23:26.091255+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595188,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":249,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252880,"kb_used_data":3368,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754721840,"statfs":{"total":773094113280,"available":772835164160,"internally_reserved":0,"allocated":3448832,"data_stored":2026528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.265683"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840458+0000","last_change":"2024-09-12T02:23:16.851521+0000","last_active":"2024-09-12T02:23:17.840458+0000","last_peered":"2024-09-12T02:23:17.840458+0000","last_clean":"2024-09-12T02:23:17.840458+0000","last_became_active":"2024-09-12T02:23:16.851220+0000","last_became_peered":"2024-09-12T02:23:16.851220+0000","last_unstale":"2024-09-12T02:23:17.840458+0000","last_undegraded":"2024-09-12T02:23:17.840458+0000","last_fullsized":"2024-09-12T02:23:17.840458+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:28.680072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331964+0000","last_change":"2024-09-12T02:23:03.757848+0000","last_active":"2024-09-12T02:23:18.331964+0000","last_peered":"2024-09-12T02:23:18.331964+0000","last_clean":"2024-09-12T02:23:18.331964+0000","last_became_active":"2024-09-12T02:23:03.757544+0000","last_became_peered":"2024-09-12T02:23:03.757544+0000","last_unstale":"2024-09-12T02:23:18.331964+0000","last_undegraded":"2024-09-12T02:23:18.331964+0000","last_fullsized":"2024-09-12T02:23:18.331964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:43.576128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840084+0000","last_change":"2024-09-12T02:23:04.790549+0000","last_active":"2024-09-12T02:23:17.840084+0000","last_peered":"2024-09-12T02:23:17.840084+0000","last_clean":"2024-09-12T02:23:17.840084+0000","last_became_active":"2024-09-12T02:23:04.790187+0000","last_became_peered":"2024-09-12T02:23:04.790187+0000","last_unstale":"2024-09-12T02:23:17.840084+0000","last_undegraded":"2024-09-12T02:23:17.840084+0000","last_fullsized":"2024-09-12T02:23:17.840084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:49.656395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.838950+0000","last_change":"2024-09-12T02:23:15.829383+0000","last_active":"2024-09-12T02:23:17.838950+0000","last_peered":"2024-09-12T02:23:17.838950+0000","last_clean":"2024-09-12T02:23:17.838950+0000","last_became_active":"2024-09-12T02:23:15.828295+0000","last_became_peered":"2024-09-12T02:23:15.828295+0000","last_unstale":"2024-09-12T02:23:17.838950+0000","last_undegraded":"2024-09-12T02:23:17.838950+0000","last_fullsized":"2024-09-12T02:23:17.838950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:13.217846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444073+0000","last_change":"2024-09-12T02:23:16.853675+0000","last_active":"2024-09-12T02:23:18.444073+0000","last_peered":"2024-09-12T02:23:18.444073+0000","last_clean":"2024-09-12T02:23:18.444073+0000","last_became_active":"2024-09-12T02:23:16.853371+0000","last_became_peered":"2024-09-12T02:23:16.853371+0000","last_unstale":"2024-09-12T02:23:18.444073+0000","last_undegraded":"2024-09-12T02:23:18.444073+0000","last_fullsized":"2024-09-12T02:23:18.444073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:10.323501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840125+0000","last_change":"2024-09-12T02:23:03.767076+0000","last_active":"2024-09-12T02:23:17.840125+0000","last_peered":"2024-09-12T02:23:17.840125+0000","last_clean":"2024-09-12T02:23:17.840125+0000","last_became_active":"2024-09-12T02:23:03.766686+0000","last_became_peered":"2024-09-12T02:23:03.766686+0000","last_unstale":"2024-09-12T02:23:17.840125+0000","last_undegraded":"2024-09-12T02:23:17.840125+0000","last_fullsized":"2024-09-12T02:23:17.840125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:45.706208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331882+0000","last_change":"2024-09-12T02:23:04.782108+0000","last_active":"2024-09-12T02:23:18.331882+0000","last_peered":"2024-09-12T02:23:18.331882+0000","last_clean":"2024-09-12T02:23:18.331882+0000","last_became_active":"2024-09-12T02:23:04.781829+0000","last_became_peered":"2024-09-12T02:23:04.781829+0000","last_unstale":"2024-09-12T02:23:18.331882+0000","last_undegraded":"2024-09-12T02:23:18.331882+0000","last_fullsized":"2024-09-12T02:23:18.331882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:07:33.165742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840554+0000","last_change":"2024-09-12T02:23:15.828697+0000","last_active":"2024-09-12T02:23:17.840554+0000","last_peered":"2024-09-12T02:23:17.840554+0000","last_clean":"2024-09-12T02:23:17.840554+0000","last_became_active":"2024-09-12T02:23:15.828317+0000","last_became_peered":"2024-09-12T02:23:15.828317+0000","last_unstale":"2024-09-12T02:23:17.840554+0000","last_undegraded":"2024-09-12T02:23:17.840554+0000","last_fullsized":"2024-09-12T02:23:17.840554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:55.347515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840938+0000","last_change":"2024-09-12T02:23:16.856209+0000","last_active":"2024-09-12T02:23:17.840938+0000","last_peered":"2024-09-12T02:23:17.840938+0000","last_clean":"2024-09-12T02:23:17.840938+0000","last_became_active":"2024-09-12T02:23:16.855874+0000","last_became_peered":"2024-09-12T02:23:16.855874+0000","last_unstale":"2024-09-12T02:23:17.840938+0000","last_undegraded":"2024-09-12T02:23:17.840938+0000","last_fullsized":"2024-09-12T02:23:17.840938+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:44.299638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842447+0000","last_change":"2024-09-12T02:23:03.767875+0000","last_active":"2024-09-12T02:23:17.842447+0000","last_peered":"2024-09-12T02:23:17.842447+0000","last_clean":"2024-09-12T02:23:17.842447+0000","last_became_active":"2024-09-12T02:23:03.767596+0000","last_became_peered":"2024-09-12T02:23:03.767596+0000","last_unstale":"2024-09-12T02:23:17.842447+0000","last_undegraded":"2024-09-12T02:23:17.842447+0000","last_fullsized":"2024-09-12T02:23:17.842447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:22.605725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325618+0000","last_change":"2024-09-12T02:23:04.791903+0000","last_active":"2024-09-12T02:23:18.325618+0000","last_peered":"2024-09-12T02:23:18.325618+0000","last_clean":"2024-09-12T02:23:18.325618+0000","last_became_active":"2024-09-12T02:23:04.791635+0000","last_became_peered":"2024-09-12T02:23:04.791635+0000","last_unstale":"2024-09-12T02:23:18.325618+0000","last_undegraded":"2024-09-12T02:23:18.325618+0000","last_fullsized":"2024-09-12T02:23:18.325618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:08.192088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841943+0000","last_change":"2024-09-12T02:23:15.833369+0000","last_active":"2024-09-12T02:23:17.841943+0000","last_peered":"2024-09-12T02:23:17.841943+0000","last_clean":"2024-09-12T02:23:17.841943+0000","last_became_active":"2024-09-12T02:23:15.833010+0000","last_became_peered":"2024-09-12T02:23:15.833010+0000","last_unstale":"2024-09-12T02:23:17.841943+0000","last_undegraded":"2024-09-12T02:23:17.841943+0000","last_fullsized":"2024-09-12T02:23:17.841943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:51.465462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325378+0000","last_change":"2024-09-12T02:23:16.853013+0000","last_active":"2024-09-12T02:23:18.325378+0000","last_peered":"2024-09-12T02:23:18.325378+0000","last_clean":"2024-09-12T02:23:18.325378+0000","last_became_active":"2024-09-12T02:23:16.852698+0000","last_became_peered":"2024-09-12T02:23:16.852698+0000","last_unstale":"2024-09-12T02:23:18.325378+0000","last_undegraded":"2024-09-12T02:23:18.325378+0000","last_fullsized":"2024-09-12T02:23:18.325378+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:11.709531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842467+0000","last_change":"2024-09-12T02:23:03.763480+0000","last_active":"2024-09-12T02:23:17.842467+0000","last_peered":"2024-09-12T02:23:17.842467+0000","last_clean":"2024-09-12T02:23:17.842467+0000","last_became_active":"2024-09-12T02:23:03.762464+0000","last_became_peered":"2024-09-12T02:23:03.762464+0000","last_unstale":"2024-09-12T02:23:17.842467+0000","last_undegraded":"2024-09-12T02:23:17.842467+0000","last_fullsized":"2024-09-12T02:23:17.842467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:24.308289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325931+0000","last_change":"2024-09-12T02:23:04.791109+0000","last_active":"2024-09-12T02:23:18.325931+0000","last_peered":"2024-09-12T02:23:18.325931+0000","last_clean":"2024-09-12T02:23:18.325931+0000","last_became_active":"2024-09-12T02:23:04.790201+0000","last_became_peered":"2024-09-12T02:23:04.790201+0000","last_unstale":"2024-09-12T02:23:18.325931+0000","last_undegraded":"2024-09-12T02:23:18.325931+0000","last_fullsized":"2024-09-12T02:23:18.325931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:13.166139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840837+0000","last_change":"2024-09-12T02:23:15.834261+0000","last_active":"2024-09-12T02:23:17.840837+0000","last_peered":"2024-09-12T02:23:17.840837+0000","last_clean":"2024-09-12T02:23:17.840837+0000","last_became_active":"2024-09-12T02:23:15.833982+0000","last_became_peered":"2024-09-12T02:23:15.833982+0000","last_unstale":"2024-09-12T02:23:17.840837+0000","last_undegraded":"2024-09-12T02:23:17.840837+0000","last_fullsized":"2024-09-12T02:23:17.840837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:04.987961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444359+0000","last_change":"2024-09-12T02:23:16.861432+0000","last_active":"2024-09-12T02:23:18.444359+0000","last_peered":"2024-09-12T02:23:18.444359+0000","last_clean":"2024-09-12T02:23:18.444359+0000","last_became_active":"2024-09-12T02:23:16.861003+0000","last_became_peered":"2024-09-12T02:23:16.861003+0000","last_unstale":"2024-09-12T02:23:18.444359+0000","last_undegraded":"2024-09-12T02:23:18.444359+0000","last_fullsized":"2024-09-12T02:23:18.444359+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:01.777500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597613+0000","last_change":"2024-09-12T02:23:04.788754+0000","last_active":"2024-09-12T02:23:19.597613+0000","last_peered":"2024-09-12T02:23:19.597613+0000","last_clean":"2024-09-12T02:23:19.597613+0000","last_became_active":"2024-09-12T02:23:04.788350+0000","last_became_peered":"2024-09-12T02:23:04.788350+0000","last_unstale":"2024-09-12T02:23:19.597613+0000","last_undegraded":"2024-09-12T02:23:19.597613+0000","last_fullsized":"2024-09-12T02:23:19.597613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:08.192088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841873+0000","last_change":"2024-09-12T02:23:03.763423+0000","last_active":"2024-09-12T02:23:17.841873+0000","last_peered":"2024-09-12T02:23:17.841873+0000","last_clean":"2024-09-12T02:23:17.841873+0000","last_became_active":"2024-09-12T02:23:03.762627+0000","last_became_peered":"2024-09-12T02:23:03.762627+0000","last_unstale":"2024-09-12T02:23:17.841873+0000","last_undegraded":"2024-09-12T02:23:17.841873+0000","last_fullsized":"2024-09-12T02:23:17.841873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:18.090657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841725+0000","last_change":"2024-09-12T02:23:15.831604+0000","last_active":"2024-09-12T02:23:17.841725+0000","last_peered":"2024-09-12T02:23:17.841725+0000","last_clean":"2024-09-12T02:23:17.841725+0000","last_became_active":"2024-09-12T02:23:15.831292+0000","last_became_peered":"2024-09-12T02:23:15.831292+0000","last_unstale":"2024-09-12T02:23:17.841725+0000","last_undegraded":"2024-09-12T02:23:17.841725+0000","last_fullsized":"2024-09-12T02:23:17.841725+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:30.234721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673393+0000","last_change":"2024-09-12T02:23:16.842506+0000","last_active":"2024-09-12T02:23:18.673393+0000","last_peered":"2024-09-12T02:23:18.673393+0000","last_clean":"2024-09-12T02:23:18.673393+0000","last_became_active":"2024-09-12T02:23:16.842210+0000","last_became_peered":"2024-09-12T02:23:16.842210+0000","last_unstale":"2024-09-12T02:23:18.673393+0000","last_undegraded":"2024-09-12T02:23:18.673393+0000","last_fullsized":"2024-09-12T02:23:18.673393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:52.806704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839230+0000","last_change":"2024-09-12T02:23:04.782769+0000","last_active":"2024-09-12T02:23:17.839230+0000","last_peered":"2024-09-12T02:23:17.839230+0000","last_clean":"2024-09-12T02:23:17.839230+0000","last_became_active":"2024-09-12T02:23:04.782472+0000","last_became_peered":"2024-09-12T02:23:04.782472+0000","last_unstale":"2024-09-12T02:23:17.839230+0000","last_undegraded":"2024-09-12T02:23:17.839230+0000","last_fullsized":"2024-09-12T02:23:17.839230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:46.144471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444704+0000","last_change":"2024-09-12T02:23:03.771468+0000","last_active":"2024-09-12T02:23:18.444704+0000","last_peered":"2024-09-12T02:23:18.444704+0000","last_clean":"2024-09-12T02:23:18.444704+0000","last_became_active":"2024-09-12T02:23:03.769619+0000","last_became_peered":"2024-09-12T02:23:03.769619+0000","last_unstale":"2024-09-12T02:23:18.444704+0000","last_undegraded":"2024-09-12T02:23:18.444704+0000","last_fullsized":"2024-09-12T02:23:18.444704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:38.422369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841394+0000","last_change":"2024-09-12T02:23:15.833359+0000","last_active":"2024-09-12T02:23:17.841394+0000","last_peered":"2024-09-12T02:23:17.841394+0000","last_clean":"2024-09-12T02:23:17.841394+0000","last_became_active":"2024-09-12T02:23:15.832995+0000","last_became_peered":"2024-09-12T02:23:15.832995+0000","last_unstale":"2024-09-12T02:23:17.841394+0000","last_undegraded":"2024-09-12T02:23:17.841394+0000","last_fullsized":"2024-09-12T02:23:17.841394+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:57.922845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841919+0000","last_change":"2024-09-12T02:23:16.856439+0000","last_active":"2024-09-12T02:23:17.841919+0000","last_peered":"2024-09-12T02:23:17.841919+0000","last_clean":"2024-09-12T02:23:17.841919+0000","last_became_active":"2024-09-12T02:23:16.856166+0000","last_became_peered":"2024-09-12T02:23:16.856166+0000","last_unstale":"2024-09-12T02:23:17.841919+0000","last_undegraded":"2024-09-12T02:23:17.841919+0000","last_fullsized":"2024-09-12T02:23:17.841919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:42:56.534517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839424+0000","last_change":"2024-09-12T02:23:04.783991+0000","last_active":"2024-09-12T02:23:17.839424+0000","last_peered":"2024-09-12T02:23:17.839424+0000","last_clean":"2024-09-12T02:23:17.839424+0000","last_became_active":"2024-09-12T02:23:04.783143+0000","last_became_peered":"2024-09-12T02:23:04.783143+0000","last_unstale":"2024-09-12T02:23:17.839424+0000","last_undegraded":"2024-09-12T02:23:17.839424+0000","last_fullsized":"2024-09-12T02:23:17.839424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:53.940843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444206+0000","last_change":"2024-09-12T02:23:03.770581+0000","last_active":"2024-09-12T02:23:18.444206+0000","last_peered":"2024-09-12T02:23:18.444206+0000","last_clean":"2024-09-12T02:23:18.444206+0000","last_became_active":"2024-09-12T02:23:03.769406+0000","last_became_peered":"2024-09-12T02:23:03.769406+0000","last_unstale":"2024-09-12T02:23:18.444206+0000","last_undegraded":"2024-09-12T02:23:18.444206+0000","last_fullsized":"2024-09-12T02:23:18.444206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:20.963819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444698+0000","last_change":"2024-09-12T02:23:15.835033+0000","last_active":"2024-09-12T02:23:18.444698+0000","last_peered":"2024-09-12T02:23:18.444698+0000","last_clean":"2024-09-12T02:23:18.444698+0000","last_became_active":"2024-09-12T02:23:15.834753+0000","last_became_peered":"2024-09-12T02:23:15.834753+0000","last_unstale":"2024-09-12T02:23:18.444698+0000","last_undegraded":"2024-09-12T02:23:18.444698+0000","last_fullsized":"2024-09-12T02:23:18.444698+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:57.434162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.326093+0000","last_change":"2024-09-12T02:23:16.860867+0000","last_active":"2024-09-12T02:23:18.326093+0000","last_peered":"2024-09-12T02:23:18.326093+0000","last_clean":"2024-09-12T02:23:18.326093+0000","last_became_active":"2024-09-12T02:23:16.860656+0000","last_became_peered":"2024-09-12T02:23:16.860656+0000","last_unstale":"2024-09-12T02:23:18.326093+0000","last_undegraded":"2024-09-12T02:23:18.326093+0000","last_fullsized":"2024-09-12T02:23:18.326093+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:11.375287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842133+0000","last_change":"2024-09-12T02:23:04.780821+0000","last_active":"2024-09-12T02:23:17.842133+0000","last_peered":"2024-09-12T02:23:17.842133+0000","last_clean":"2024-09-12T02:23:17.842133+0000","last_became_active":"2024-09-12T02:23:04.779984+0000","last_became_peered":"2024-09-12T02:23:04.779984+0000","last_unstale":"2024-09-12T02:23:17.842133+0000","last_undegraded":"2024-09-12T02:23:17.842133+0000","last_fullsized":"2024-09-12T02:23:17.842133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:25.724116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841013+0000","last_change":"2024-09-12T02:23:03.764530+0000","last_active":"2024-09-12T02:23:17.841013+0000","last_peered":"2024-09-12T02:23:17.841013+0000","last_clean":"2024-09-12T02:23:17.841013+0000","last_became_active":"2024-09-12T02:23:03.764218+0000","last_became_peered":"2024-09-12T02:23:03.764218+0000","last_unstale":"2024-09-12T02:23:17.841013+0000","last_undegraded":"2024-09-12T02:23:17.841013+0000","last_fullsized":"2024-09-12T02:23:17.841013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:55.445619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842053+0000","last_change":"2024-09-12T02:23:15.831621+0000","last_active":"2024-09-12T02:23:17.842053+0000","last_peered":"2024-09-12T02:23:17.842053+0000","last_clean":"2024-09-12T02:23:17.842053+0000","last_became_active":"2024-09-12T02:23:15.831331+0000","last_became_peered":"2024-09-12T02:23:15.831331+0000","last_unstale":"2024-09-12T02:23:17.842053+0000","last_undegraded":"2024-09-12T02:23:17.842053+0000","last_fullsized":"2024-09-12T02:23:17.842053+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:06.494392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.838770+0000","last_change":"2024-09-12T02:23:16.847556+0000","last_active":"2024-09-12T02:23:17.838770+0000","last_peered":"2024-09-12T02:23:17.838770+0000","last_clean":"2024-09-12T02:23:17.838770+0000","last_became_active":"2024-09-12T02:23:16.845749+0000","last_became_peered":"2024-09-12T02:23:16.845749+0000","last_unstale":"2024-09-12T02:23:17.838770+0000","last_undegraded":"2024-09-12T02:23:17.838770+0000","last_fullsized":"2024-09-12T02:23:17.838770+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:39.542842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.332030+0000","last_change":"2024-09-12T02:23:04.786895+0000","last_active":"2024-09-12T02:23:18.332030+0000","last_peered":"2024-09-12T02:23:18.332030+0000","last_clean":"2024-09-12T02:23:18.332030+0000","last_became_active":"2024-09-12T02:23:04.786591+0000","last_became_peered":"2024-09-12T02:23:04.786591+0000","last_unstale":"2024-09-12T02:23:18.332030+0000","last_undegraded":"2024-09-12T02:23:18.332030+0000","last_fullsized":"2024-09-12T02:23:18.332030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:14.751707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.598264+0000","last_change":"2024-09-12T02:23:03.771259+0000","last_active":"2024-09-12T02:23:19.598264+0000","last_peered":"2024-09-12T02:23:19.598264+0000","last_clean":"2024-09-12T02:23:19.598264+0000","last_became_active":"2024-09-12T02:23:03.770687+0000","last_became_peered":"2024-09-12T02:23:03.770687+0000","last_unstale":"2024-09-12T02:23:19.598264+0000","last_undegraded":"2024-09-12T02:23:19.598264+0000","last_fullsized":"2024-09-12T02:23:19.598264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:38.516959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841319+0000","last_change":"2024-09-12T02:23:15.829406+0000","last_active":"2024-09-12T02:23:17.841319+0000","last_peered":"2024-09-12T02:23:17.841319+0000","last_clean":"2024-09-12T02:23:17.841319+0000","last_became_active":"2024-09-12T02:23:15.829135+0000","last_became_peered":"2024-09-12T02:23:15.829135+0000","last_unstale":"2024-09-12T02:23:17.841319+0000","last_undegraded":"2024-09-12T02:23:17.841319+0000","last_fullsized":"2024-09-12T02:23:17.841319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:22.365804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840867+0000","last_change":"2024-09-12T02:23:16.857016+0000","last_active":"2024-09-12T02:23:17.840867+0000","last_peered":"2024-09-12T02:23:17.840867+0000","last_clean":"2024-09-12T02:23:17.840867+0000","last_became_active":"2024-09-12T02:23:16.856705+0000","last_became_peered":"2024-09-12T02:23:16.856705+0000","last_unstale":"2024-09-12T02:23:17.840867+0000","last_undegraded":"2024-09-12T02:23:17.840867+0000","last_fullsized":"2024-09-12T02:23:17.840867+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:03.672668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840282+0000","last_change":"2024-09-12T02:23:04.786424+0000","last_active":"2024-09-12T02:23:17.840282+0000","last_peered":"2024-09-12T02:23:17.840282+0000","last_clean":"2024-09-12T02:23:17.840282+0000","last_became_active":"2024-09-12T02:23:04.786136+0000","last_became_peered":"2024-09-12T02:23:04.786136+0000","last_unstale":"2024-09-12T02:23:17.840282+0000","last_undegraded":"2024-09-12T02:23:17.840282+0000","last_fullsized":"2024-09-12T02:23:17.840282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:31.214894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444621+0000","last_change":"2024-09-12T02:23:03.769745+0000","last_active":"2024-09-12T02:23:18.444621+0000","last_peered":"2024-09-12T02:23:18.444621+0000","last_clean":"2024-09-12T02:23:18.444621+0000","last_became_active":"2024-09-12T02:23:03.769410+0000","last_became_peered":"2024-09-12T02:23:03.769410+0000","last_unstale":"2024-09-12T02:23:18.444621+0000","last_undegraded":"2024-09-12T02:23:18.444621+0000","last_fullsized":"2024-09-12T02:23:18.444621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:00.414459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.838725+0000","last_change":"2024-09-12T02:23:15.827211+0000","last_active":"2024-09-12T02:23:17.838725+0000","last_peered":"2024-09-12T02:23:17.838725+0000","last_clean":"2024-09-12T02:23:17.838725+0000","last_became_active":"2024-09-12T02:23:15.826564+0000","last_became_peered":"2024-09-12T02:23:15.826564+0000","last_unstale":"2024-09-12T02:23:17.838725+0000","last_undegraded":"2024-09-12T02:23:17.838725+0000","last_fullsized":"2024-09-12T02:23:17.838725+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:32.389443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597488+0000","last_change":"2024-09-12T02:23:16.837434+0000","last_active":"2024-09-12T02:23:19.597488+0000","last_peered":"2024-09-12T02:23:19.597488+0000","last_clean":"2024-09-12T02:23:19.597488+0000","last_became_active":"2024-09-12T02:23:16.837162+0000","last_became_peered":"2024-09-12T02:23:16.837162+0000","last_unstale":"2024-09-12T02:23:19.597488+0000","last_undegraded":"2024-09-12T02:23:19.597488+0000","last_fullsized":"2024-09-12T02:23:19.597488+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:09.146064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444511+0000","last_change":"2024-09-12T02:23:04.775876+0000","last_active":"2024-09-12T02:23:18.444511+0000","last_peered":"2024-09-12T02:23:18.444511+0000","last_clean":"2024-09-12T02:23:18.444511+0000","last_became_active":"2024-09-12T02:23:04.775571+0000","last_became_peered":"2024-09-12T02:23:04.775571+0000","last_unstale":"2024-09-12T02:23:18.444511+0000","last_undegraded":"2024-09-12T02:23:18.444511+0000","last_fullsized":"2024-09-12T02:23:18.444511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:05.070528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842890+0000","last_change":"2024-09-12T02:23:03.764093+0000","last_active":"2024-09-12T02:23:17.842890+0000","last_peered":"2024-09-12T02:23:17.842890+0000","last_clean":"2024-09-12T02:23:17.842890+0000","last_became_active":"2024-09-12T02:23:03.763147+0000","last_became_peered":"2024-09-12T02:23:03.763147+0000","last_unstale":"2024-09-12T02:23:17.842890+0000","last_undegraded":"2024-09-12T02:23:17.842890+0000","last_fullsized":"2024-09-12T02:23:17.842890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:13.317894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331728+0000","last_change":"2024-09-12T02:23:15.832461+0000","last_active":"2024-09-12T02:23:18.331728+0000","last_peered":"2024-09-12T02:23:18.331728+0000","last_clean":"2024-09-12T02:23:18.331728+0000","last_became_active":"2024-09-12T02:23:15.831637+0000","last_became_peered":"2024-09-12T02:23:15.831637+0000","last_unstale":"2024-09-12T02:23:18.331728+0000","last_undegraded":"2024-09-12T02:23:18.331728+0000","last_fullsized":"2024-09-12T02:23:18.331728+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:30.909927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.332020+0000","last_change":"2024-09-12T02:23:16.835824+0000","last_active":"2024-09-12T02:23:18.332020+0000","last_peered":"2024-09-12T02:23:18.332020+0000","last_clean":"2024-09-12T02:23:18.332020+0000","last_became_active":"2024-09-12T02:23:16.835520+0000","last_became_peered":"2024-09-12T02:23:16.835520+0000","last_unstale":"2024-09-12T02:23:18.332020+0000","last_undegraded":"2024-09-12T02:23:18.332020+0000","last_fullsized":"2024-09-12T02:23:18.332020+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:32.797100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.326009+0000","last_change":"2024-09-12T02:23:04.787557+0000","last_active":"2024-09-12T02:23:18.326009+0000","last_peered":"2024-09-12T02:23:18.326009+0000","last_clean":"2024-09-12T02:23:18.326009+0000","last_became_active":"2024-09-12T02:23:04.786527+0000","last_became_peered":"2024-09-12T02:23:04.786527+0000","last_unstale":"2024-09-12T02:23:18.326009+0000","last_undegraded":"2024-09-12T02:23:18.326009+0000","last_fullsized":"2024-09-12T02:23:18.326009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:23.273457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444585+0000","last_change":"2024-09-12T02:23:03.769913+0000","last_active":"2024-09-12T02:23:18.444585+0000","last_peered":"2024-09-12T02:23:18.444585+0000","last_clean":"2024-09-12T02:23:18.444585+0000","last_became_active":"2024-09-12T02:23:03.769444+0000","last_became_peered":"2024-09-12T02:23:03.769444+0000","last_unstale":"2024-09-12T02:23:18.444585+0000","last_undegraded":"2024-09-12T02:23:18.444585+0000","last_fullsized":"2024-09-12T02:23:18.444585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:21.243182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444133+0000","last_change":"2024-09-12T02:23:15.829080+0000","last_active":"2024-09-12T02:23:18.444133+0000","last_peered":"2024-09-12T02:23:18.444133+0000","last_clean":"2024-09-12T02:23:18.444133+0000","last_became_active":"2024-09-12T02:23:15.828256+0000","last_became_peered":"2024-09-12T02:23:15.828256+0000","last_unstale":"2024-09-12T02:23:18.444133+0000","last_undegraded":"2024-09-12T02:23:18.444133+0000","last_fullsized":"2024-09-12T02:23:18.444133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:07.743952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331720+0000","last_change":"2024-09-12T02:23:16.845710+0000","last_active":"2024-09-12T02:23:18.331720+0000","last_peered":"2024-09-12T02:23:18.331720+0000","last_clean":"2024-09-12T02:23:18.331720+0000","last_became_active":"2024-09-12T02:23:16.845379+0000","last_became_peered":"2024-09-12T02:23:16.845379+0000","last_unstale":"2024-09-12T02:23:18.331720+0000","last_undegraded":"2024-09-12T02:23:18.331720+0000","last_fullsized":"2024-09-12T02:23:18.331720+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:16.769410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842948+0000","last_change":"2024-09-12T02:23:04.790723+0000","last_active":"2024-09-12T02:23:17.842948+0000","last_peered":"2024-09-12T02:23:17.842948+0000","last_clean":"2024-09-12T02:23:17.842948+0000","last_became_active":"2024-09-12T02:23:04.786877+0000","last_became_peered":"2024-09-12T02:23:04.786877+0000","last_unstale":"2024-09-12T02:23:17.842948+0000","last_undegraded":"2024-09-12T02:23:17.842948+0000","last_fullsized":"2024-09-12T02:23:17.842948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:48.516002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325581+0000","last_change":"2024-09-12T02:23:03.771518+0000","last_active":"2024-09-12T02:23:18.325581+0000","last_peered":"2024-09-12T02:23:18.325581+0000","last_clean":"2024-09-12T02:23:18.325581+0000","last_became_active":"2024-09-12T02:23:03.771063+0000","last_became_peered":"2024-09-12T02:23:03.771063+0000","last_unstale":"2024-09-12T02:23:18.325581+0000","last_undegraded":"2024-09-12T02:23:18.325581+0000","last_fullsized":"2024-09-12T02:23:18.325581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:43.974555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444509+0000","last_change":"2024-09-12T02:23:15.827028+0000","last_active":"2024-09-12T02:23:18.444509+0000","last_peered":"2024-09-12T02:23:18.444509+0000","last_clean":"2024-09-12T02:23:18.444509+0000","last_became_active":"2024-09-12T02:23:15.826708+0000","last_became_peered":"2024-09-12T02:23:15.826708+0000","last_unstale":"2024-09-12T02:23:18.444509+0000","last_undegraded":"2024-09-12T02:23:18.444509+0000","last_fullsized":"2024-09-12T02:23:18.444509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:34.642396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673336+0000","last_change":"2024-09-12T02:23:16.849429+0000","last_active":"2024-09-12T02:23:18.673336+0000","last_peered":"2024-09-12T02:23:18.673336+0000","last_clean":"2024-09-12T02:23:18.673336+0000","last_became_active":"2024-09-12T02:23:16.849119+0000","last_became_peered":"2024-09-12T02:23:16.849119+0000","last_unstale":"2024-09-12T02:23:18.673336+0000","last_undegraded":"2024-09-12T02:23:18.673336+0000","last_fullsized":"2024-09-12T02:23:18.673336+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:10.688619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444107+0000","last_change":"2024-09-12T02:23:04.773745+0000","last_active":"2024-09-12T02:23:18.444107+0000","last_peered":"2024-09-12T02:23:18.444107+0000","last_clean":"2024-09-12T02:23:18.444107+0000","last_became_active":"2024-09-12T02:23:04.773360+0000","last_became_peered":"2024-09-12T02:23:04.773360+0000","last_unstale":"2024-09-12T02:23:18.444107+0000","last_undegraded":"2024-09-12T02:23:18.444107+0000","last_fullsized":"2024-09-12T02:23:18.444107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:33.097774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673252+0000","last_change":"2024-09-12T02:23:03.760700+0000","last_active":"2024-09-12T02:23:18.673252+0000","last_peered":"2024-09-12T02:23:18.673252+0000","last_clean":"2024-09-12T02:23:18.673252+0000","last_became_active":"2024-09-12T02:23:03.760397+0000","last_became_peered":"2024-09-12T02:23:03.760397+0000","last_unstale":"2024-09-12T02:23:18.673252+0000","last_undegraded":"2024-09-12T02:23:18.673252+0000","last_fullsized":"2024-09-12T02:23:18.673252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:36.788864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444739+0000","last_change":"2024-09-12T02:23:15.828714+0000","last_active":"2024-09-12T02:23:18.444739+0000","last_peered":"2024-09-12T02:23:18.444739+0000","last_clean":"2024-09-12T02:23:18.444739+0000","last_became_active":"2024-09-12T02:23:15.827458+0000","last_became_peered":"2024-09-12T02:23:15.827458+0000","last_unstale":"2024-09-12T02:23:18.444739+0000","last_undegraded":"2024-09-12T02:23:18.444739+0000","last_fullsized":"2024-09-12T02:23:18.444739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:12.581897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.326108+0000","last_change":"2024-09-12T02:23:16.855212+0000","last_active":"2024-09-12T02:23:18.326108+0000","last_peered":"2024-09-12T02:23:18.326108+0000","last_clean":"2024-09-12T02:23:18.326108+0000","last_became_active":"2024-09-12T02:23:16.854938+0000","last_became_peered":"2024-09-12T02:23:16.854938+0000","last_unstale":"2024-09-12T02:23:18.326108+0000","last_undegraded":"2024-09-12T02:23:18.326108+0000","last_fullsized":"2024-09-12T02:23:18.326108+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:02.944057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331430+0000","last_change":"2024-09-12T02:23:04.787820+0000","last_active":"2024-09-12T02:23:18.331430+0000","last_peered":"2024-09-12T02:23:18.331430+0000","last_clean":"2024-09-12T02:23:18.331430+0000","last_became_active":"2024-09-12T02:23:04.787523+0000","last_became_peered":"2024-09-12T02:23:04.787523+0000","last_unstale":"2024-09-12T02:23:18.331430+0000","last_undegraded":"2024-09-12T02:23:18.331430+0000","last_fullsized":"2024-09-12T02:23:18.331430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:52.784171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841124+0000","last_change":"2024-09-12T02:23:03.771625+0000","last_active":"2024-09-12T02:23:17.841124+0000","last_peered":"2024-09-12T02:23:17.841124+0000","last_clean":"2024-09-12T02:23:17.841124+0000","last_became_active":"2024-09-12T02:23:03.771163+0000","last_became_peered":"2024-09-12T02:23:03.771163+0000","last_unstale":"2024-09-12T02:23:17.841124+0000","last_undegraded":"2024-09-12T02:23:17.841124+0000","last_fullsized":"2024-09-12T02:23:17.841124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:32.772569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.404274+0000","last_change":"2024-09-12T02:23:15.833889+0000","last_active":"2024-09-12T02:23:18.404274+0000","last_peered":"2024-09-12T02:23:18.404274+0000","last_clean":"2024-09-12T02:23:18.404274+0000","last_became_active":"2024-09-12T02:23:15.833587+0000","last_became_peered":"2024-09-12T02:23:15.833587+0000","last_unstale":"2024-09-12T02:23:18.404274+0000","last_undegraded":"2024-09-12T02:23:18.404274+0000","last_fullsized":"2024-09-12T02:23:18.404274+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:32.787861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842295+0000","last_change":"2024-09-12T02:23:16.848864+0000","last_active":"2024-09-12T02:23:17.842295+0000","last_peered":"2024-09-12T02:23:17.842295+0000","last_clean":"2024-09-12T02:23:17.842295+0000","last_became_active":"2024-09-12T02:23:16.848385+0000","last_became_peered":"2024-09-12T02:23:16.848385+0000","last_unstale":"2024-09-12T02:23:17.842295+0000","last_undegraded":"2024-09-12T02:23:17.842295+0000","last_fullsized":"2024-09-12T02:23:17.842295+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:03.656397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839490+0000","last_change":"2024-09-12T02:23:04.781839+0000","last_active":"2024-09-12T02:23:17.839490+0000","last_peered":"2024-09-12T02:23:17.839490+0000","last_clean":"2024-09-12T02:23:17.839490+0000","last_became_active":"2024-09-12T02:23:04.780984+0000","last_became_peered":"2024-09-12T02:23:04.780984+0000","last_unstale":"2024-09-12T02:23:17.839490+0000","last_undegraded":"2024-09-12T02:23:17.839490+0000","last_fullsized":"2024-09-12T02:23:17.839490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:07.692791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325299+0000","last_change":"2024-09-12T02:23:03.765100+0000","last_active":"2024-09-12T02:23:18.325299+0000","last_peered":"2024-09-12T02:23:18.325299+0000","last_clean":"2024-09-12T02:23:18.325299+0000","last_became_active":"2024-09-12T02:23:03.764801+0000","last_became_peered":"2024-09-12T02:23:03.764801+0000","last_unstale":"2024-09-12T02:23:18.325299+0000","last_undegraded":"2024-09-12T02:23:18.325299+0000","last_fullsized":"2024-09-12T02:23:18.325299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:06.891040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":178,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841644+0000","last_change":"2024-09-12T02:22:55.143869+0000","last_active":"2024-09-12T02:23:17.841644+0000","last_peered":"2024-09-12T02:23:17.841644+0000","last_clean":"2024-09-12T02:23:17.841644+0000","last_became_active":"2024-09-12T02:22:55.142784+0000","last_became_peered":"2024-09-12T02:22:55.142784+0000","last_unstale":"2024-09-12T02:23:17.841644+0000","last_undegraded":"2024-09-12T02:23:17.841644+0000","last_fullsized":"2024-09-12T02:23:17.841644+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:22:52.457979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:22:52.457979+0000","last_clean_scrub_stamp":"2024-09-12T02:22:52.457979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:46.152602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597751+0000","last_change":"2024-09-12T02:23:15.831362+0000","last_active":"2024-09-12T02:23:19.597751+0000","last_peered":"2024-09-12T02:23:19.597751+0000","last_clean":"2024-09-12T02:23:19.597751+0000","last_became_active":"2024-09-12T02:23:15.831084+0000","last_became_peered":"2024-09-12T02:23:15.831084+0000","last_unstale":"2024-09-12T02:23:19.597751+0000","last_undegraded":"2024-09-12T02:23:19.597751+0000","last_fullsized":"2024-09-12T02:23:19.597751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:17.754173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673475+0000","last_change":"2024-09-12T02:23:16.838831+0000","last_active":"2024-09-12T02:23:18.673475+0000","last_peered":"2024-09-12T02:23:18.673475+0000","last_clean":"2024-09-12T02:23:18.673475+0000","last_became_active":"2024-09-12T02:23:16.838523+0000","last_became_peered":"2024-09-12T02:23:16.838523+0000","last_unstale":"2024-09-12T02:23:18.673475+0000","last_undegraded":"2024-09-12T02:23:18.673475+0000","last_fullsized":"2024-09-12T02:23:18.673475+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:35:42.088332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842398+0000","last_change":"2024-09-12T02:23:04.783483+0000","last_active":"2024-09-12T02:23:17.842398+0000","last_peered":"2024-09-12T02:23:17.842398+0000","last_clean":"2024-09-12T02:23:17.842398+0000","last_became_active":"2024-09-12T02:23:04.782878+0000","last_became_peered":"2024-09-12T02:23:04.782878+0000","last_unstale":"2024-09-12T02:23:17.842398+0000","last_undegraded":"2024-09-12T02:23:17.842398+0000","last_fullsized":"2024-09-12T02:23:17.842398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:52.335065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673508+0000","last_change":"2024-09-12T02:23:03.762507+0000","last_active":"2024-09-12T02:23:18.673508+0000","last_peered":"2024-09-12T02:23:18.673508+0000","last_clean":"2024-09-12T02:23:18.673508+0000","last_became_active":"2024-09-12T02:23:03.762164+0000","last_became_peered":"2024-09-12T02:23:03.762164+0000","last_unstale":"2024-09-12T02:23:18.673508+0000","last_undegraded":"2024-09-12T02:23:18.673508+0000","last_fullsized":"2024-09-12T02:23:18.673508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:34.569630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597483+0000","last_change":"2024-09-12T02:23:15.830783+0000","last_active":"2024-09-12T02:23:19.597483+0000","last_peered":"2024-09-12T02:23:19.597483+0000","last_clean":"2024-09-12T02:23:19.597483+0000","last_became_active":"2024-09-12T02:23:15.830471+0000","last_became_peered":"2024-09-12T02:23:15.830471+0000","last_unstale":"2024-09-12T02:23:19.597483+0000","last_undegraded":"2024-09-12T02:23:19.597483+0000","last_fullsized":"2024-09-12T02:23:19.597483+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:22.927201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673175+0000","last_change":"2024-09-12T02:23:16.856328+0000","last_active":"2024-09-12T02:23:18.673175+0000","last_peered":"2024-09-12T02:23:18.673175+0000","last_clean":"2024-09-12T02:23:18.673175+0000","last_became_active":"2024-09-12T02:23:16.855992+0000","last_became_peered":"2024-09-12T02:23:16.855992+0000","last_unstale":"2024-09-12T02:23:18.673175+0000","last_undegraded":"2024-09-12T02:23:18.673175+0000","last_fullsized":"2024-09-12T02:23:18.673175+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:47.682103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325763+0000","last_change":"2024-09-12T02:23:04.784318+0000","last_active":"2024-09-12T02:23:18.325763+0000","last_peered":"2024-09-12T02:23:18.325763+0000","last_clean":"2024-09-12T02:23:18.325763+0000","last_became_active":"2024-09-12T02:23:04.784012+0000","last_became_peered":"2024-09-12T02:23:04.784012+0000","last_unstale":"2024-09-12T02:23:18.325763+0000","last_undegraded":"2024-09-12T02:23:18.325763+0000","last_fullsized":"2024-09-12T02:23:18.325763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:51.352859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444936+0000","last_change":"2024-09-12T02:23:03.766034+0000","last_active":"2024-09-12T02:23:18.444936+0000","last_peered":"2024-09-12T02:23:18.444936+0000","last_clean":"2024-09-12T02:23:18.444936+0000","last_became_active":"2024-09-12T02:23:03.765735+0000","last_became_peered":"2024-09-12T02:23:03.765735+0000","last_unstale":"2024-09-12T02:23:18.444936+0000","last_undegraded":"2024-09-12T02:23:18.444936+0000","last_fullsized":"2024-09-12T02:23:18.444936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:19.691229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331594+0000","last_change":"2024-09-12T02:23:15.832527+0000","last_active":"2024-09-12T02:23:18.331594+0000","last_peered":"2024-09-12T02:23:18.331594+0000","last_clean":"2024-09-12T02:23:18.331594+0000","last_became_active":"2024-09-12T02:23:15.832184+0000","last_became_peered":"2024-09-12T02:23:15.832184+0000","last_unstale":"2024-09-12T02:23:18.331594+0000","last_undegraded":"2024-09-12T02:23:18.331594+0000","last_fullsized":"2024-09-12T02:23:18.331594+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:29.131198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840742+0000","last_change":"2024-09-12T02:23:16.849357+0000","last_active":"2024-09-12T02:23:17.840742+0000","last_peered":"2024-09-12T02:23:17.840742+0000","last_clean":"2024-09-12T02:23:17.840742+0000","last_became_active":"2024-09-12T02:23:16.849067+0000","last_became_peered":"2024-09-12T02:23:16.849067+0000","last_unstale":"2024-09-12T02:23:17.840742+0000","last_undegraded":"2024-09-12T02:23:17.840742+0000","last_fullsized":"2024-09-12T02:23:17.840742+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:06.887523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.843122+0000","last_change":"2024-09-12T02:23:04.791152+0000","last_active":"2024-09-12T02:23:17.843122+0000","last_peered":"2024-09-12T02:23:17.843122+0000","last_clean":"2024-09-12T02:23:17.843122+0000","last_became_active":"2024-09-12T02:23:04.790707+0000","last_became_peered":"2024-09-12T02:23:04.790707+0000","last_unstale":"2024-09-12T02:23:17.843122+0000","last_undegraded":"2024-09-12T02:23:17.843122+0000","last_fullsized":"2024-09-12T02:23:17.843122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:42.798507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673465+0000","last_change":"2024-09-12T02:23:03.763327+0000","last_active":"2024-09-12T02:23:18.673465+0000","last_peered":"2024-09-12T02:23:18.673465+0000","last_clean":"2024-09-12T02:23:18.673465+0000","last_became_active":"2024-09-12T02:23:03.763005+0000","last_became_peered":"2024-09-12T02:23:03.763005+0000","last_unstale":"2024-09-12T02:23:18.673465+0000","last_undegraded":"2024-09-12T02:23:18.673465+0000","last_fullsized":"2024-09-12T02:23:18.673465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:09.500459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325022+0000","last_change":"2024-09-12T02:23:15.819644+0000","last_active":"2024-09-12T02:23:18.325022+0000","last_peered":"2024-09-12T02:23:18.325022+0000","last_clean":"2024-09-12T02:23:18.325022+0000","last_became_active":"2024-09-12T02:23:15.819370+0000","last_became_peered":"2024-09-12T02:23:15.819370+0000","last_unstale":"2024-09-12T02:23:18.325022+0000","last_undegraded":"2024-09-12T02:23:18.325022+0000","last_fullsized":"2024-09-12T02:23:18.325022+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:56.384531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673028+0000","last_change":"2024-09-12T02:23:16.838234+0000","last_active":"2024-09-12T02:23:18.673028+0000","last_peered":"2024-09-12T02:23:18.673028+0000","last_clean":"2024-09-12T02:23:18.673028+0000","last_became_active":"2024-09-12T02:23:16.837942+0000","last_became_peered":"2024-09-12T02:23:16.837942+0000","last_unstale":"2024-09-12T02:23:18.673028+0000","last_undegraded":"2024-09-12T02:23:18.673028+0000","last_fullsized":"2024-09-12T02:23:18.673028+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:41.842931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842558+0000","last_change":"2024-09-12T02:23:04.781196+0000","last_active":"2024-09-12T02:23:17.842558+0000","last_peered":"2024-09-12T02:23:17.842558+0000","last_clean":"2024-09-12T02:23:17.842558+0000","last_became_active":"2024-09-12T02:23:04.780893+0000","last_became_peered":"2024-09-12T02:23:04.780893+0000","last_unstale":"2024-09-12T02:23:17.842558+0000","last_undegraded":"2024-09-12T02:23:17.842558+0000","last_fullsized":"2024-09-12T02:23:17.842558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:26.527539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842742+0000","last_change":"2024-09-12T02:23:03.769541+0000","last_active":"2024-09-12T02:23:17.842742+0000","last_peered":"2024-09-12T02:23:17.842742+0000","last_clean":"2024-09-12T02:23:17.842742+0000","last_became_active":"2024-09-12T02:23:03.765281+0000","last_became_peered":"2024-09-12T02:23:03.765281+0000","last_unstale":"2024-09-12T02:23:17.842742+0000","last_undegraded":"2024-09-12T02:23:17.842742+0000","last_fullsized":"2024-09-12T02:23:17.842742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:53.409370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841039+0000","last_change":"2024-09-12T02:23:15.841592+0000","last_active":"2024-09-12T02:23:17.841039+0000","last_peered":"2024-09-12T02:23:17.841039+0000","last_clean":"2024-09-12T02:23:17.841039+0000","last_became_active":"2024-09-12T02:23:15.841380+0000","last_became_peered":"2024-09-12T02:23:15.841380+0000","last_unstale":"2024-09-12T02:23:17.841039+0000","last_undegraded":"2024-09-12T02:23:17.841039+0000","last_fullsized":"2024-09-12T02:23:17.841039+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:38.396332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840229+0000","last_change":"2024-09-12T02:23:16.846596+0000","last_active":"2024-09-12T02:23:17.840229+0000","last_peered":"2024-09-12T02:23:17.840229+0000","last_clean":"2024-09-12T02:23:17.840229+0000","last_became_active":"2024-09-12T02:23:16.846273+0000","last_became_peered":"2024-09-12T02:23:16.846273+0000","last_unstale":"2024-09-12T02:23:17.840229+0000","last_undegraded":"2024-09-12T02:23:17.840229+0000","last_fullsized":"2024-09-12T02:23:17.840229+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:03.628494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841299+0000","last_change":"2024-09-12T02:23:04.781856+0000","last_active":"2024-09-12T02:23:17.841299+0000","last_peered":"2024-09-12T02:23:17.841299+0000","last_clean":"2024-09-12T02:23:17.841299+0000","last_became_active":"2024-09-12T02:23:04.781575+0000","last_became_peered":"2024-09-12T02:23:04.781575+0000","last_unstale":"2024-09-12T02:23:17.841299+0000","last_undegraded":"2024-09-12T02:23:17.841299+0000","last_fullsized":"2024-09-12T02:23:17.841299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:26.630558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673048+0000","last_change":"2024-09-12T02:23:03.771368+0000","last_active":"2024-09-12T02:23:18.673048+0000","last_peered":"2024-09-12T02:23:18.673048+0000","last_clean":"2024-09-12T02:23:18.673048+0000","last_became_active":"2024-09-12T02:23:03.771061+0000","last_became_peered":"2024-09-12T02:23:03.771061+0000","last_unstale":"2024-09-12T02:23:18.673048+0000","last_undegraded":"2024-09-12T02:23:18.673048+0000","last_fullsized":"2024-09-12T02:23:18.673048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:57.476458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.332045+0000","last_change":"2024-09-12T02:23:15.833158+0000","last_active":"2024-09-12T02:23:18.332045+0000","last_peered":"2024-09-12T02:23:18.332045+0000","last_clean":"2024-09-12T02:23:18.332045+0000","last_became_active":"2024-09-12T02:23:15.831707+0000","last_became_peered":"2024-09-12T02:23:15.831707+0000","last_unstale":"2024-09-12T02:23:18.332045+0000","last_undegraded":"2024-09-12T02:23:18.332045+0000","last_fullsized":"2024-09-12T02:23:18.332045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:30.000066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325904+0000","last_change":"2024-09-12T02:23:16.858757+0000","last_active":"2024-09-12T02:23:18.325904+0000","last_peered":"2024-09-12T02:23:18.325904+0000","last_clean":"2024-09-12T02:23:18.325904+0000","last_became_active":"2024-09-12T02:23:16.858469+0000","last_became_peered":"2024-09-12T02:23:16.858469+0000","last_unstale":"2024-09-12T02:23:18.325904+0000","last_undegraded":"2024-09-12T02:23:18.325904+0000","last_fullsized":"2024-09-12T02:23:18.325904+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:22.288143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597329+0000","last_change":"2024-09-12T02:23:04.785248+0000","last_active":"2024-09-12T02:23:19.597329+0000","last_peered":"2024-09-12T02:23:19.597329+0000","last_clean":"2024-09-12T02:23:19.597329+0000","last_became_active":"2024-09-12T02:23:04.784977+0000","last_became_peered":"2024-09-12T02:23:04.784977+0000","last_unstale":"2024-09-12T02:23:19.597329+0000","last_undegraded":"2024-09-12T02:23:19.597329+0000","last_fullsized":"2024-09-12T02:23:19.597329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:23.273457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597715+0000","last_change":"2024-09-12T02:23:03.767842+0000","last_active":"2024-09-12T02:23:19.597715+0000","last_peered":"2024-09-12T02:23:19.597715+0000","last_clean":"2024-09-12T02:23:19.597715+0000","last_became_active":"2024-09-12T02:23:03.767066+0000","last_became_peered":"2024-09-12T02:23:03.767066+0000","last_unstale":"2024-09-12T02:23:19.597715+0000","last_undegraded":"2024-09-12T02:23:19.597715+0000","last_fullsized":"2024-09-12T02:23:19.597715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:50.800749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840199+0000","last_change":"2024-09-12T02:23:15.826104+0000","last_active":"2024-09-12T02:23:17.840199+0000","last_peered":"2024-09-12T02:23:17.840199+0000","last_clean":"2024-09-12T02:23:17.840199+0000","last_became_active":"2024-09-12T02:23:15.825779+0000","last_became_peered":"2024-09-12T02:23:15.825779+0000","last_unstale":"2024-09-12T02:23:17.840199+0000","last_undegraded":"2024-09-12T02:23:17.840199+0000","last_fullsized":"2024-09-12T02:23:17.840199+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:32.661083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325654+0000","last_change":"2024-09-12T02:23:16.856543+0000","last_active":"2024-09-12T02:23:18.325654+0000","last_peered":"2024-09-12T02:23:18.325654+0000","last_clean":"2024-09-12T02:23:18.325654+0000","last_became_active":"2024-09-12T02:23:16.855538+0000","last_became_peered":"2024-09-12T02:23:16.855538+0000","last_unstale":"2024-09-12T02:23:18.325654+0000","last_undegraded":"2024-09-12T02:23:18.325654+0000","last_fullsized":"2024-09-12T02:23:18.325654+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:05.857593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841758+0000","last_change":"2024-09-12T02:23:04.783671+0000","last_active":"2024-09-12T02:23:17.841758+0000","last_peered":"2024-09-12T02:23:17.841758+0000","last_clean":"2024-09-12T02:23:17.841758+0000","last_became_active":"2024-09-12T02:23:04.783399+0000","last_became_peered":"2024-09-12T02:23:04.783399+0000","last_unstale":"2024-09-12T02:23:17.841758+0000","last_undegraded":"2024-09-12T02:23:17.841758+0000","last_fullsized":"2024-09-12T02:23:17.841758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:04.321789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325480+0000","last_change":"2024-09-12T02:23:03.767217+0000","last_active":"2024-09-12T02:23:18.325480+0000","last_peered":"2024-09-12T02:23:18.325480+0000","last_clean":"2024-09-12T02:23:18.325480+0000","last_became_active":"2024-09-12T02:23:03.766551+0000","last_became_peered":"2024-09-12T02:23:03.766551+0000","last_unstale":"2024-09-12T02:23:18.325480+0000","last_undegraded":"2024-09-12T02:23:18.325480+0000","last_fullsized":"2024-09-12T02:23:18.325480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:09.963450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"25'6","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839572+0000","last_change":"2024-09-12T02:23:15.832638+0000","last_active":"2024-09-12T02:23:17.839572+0000","last_peered":"2024-09-12T02:23:17.839572+0000","last_clean":"2024-09-12T02:23:17.839572+0000","last_became_active":"2024-09-12T02:23:15.832152+0000","last_became_peered":"2024-09-12T02:23:15.832152+0000","last_unstale":"2024-09-12T02:23:17.839572+0000","last_undegraded":"2024-09-12T02:23:17.839572+0000","last_fullsized":"2024-09-12T02:23:17.839572+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:06.820636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839619+0000","last_change":"2024-09-12T02:23:16.846920+0000","last_active":"2024-09-12T02:23:17.839619+0000","last_peered":"2024-09-12T02:23:17.839619+0000","last_clean":"2024-09-12T02:23:17.839619+0000","last_became_active":"2024-09-12T02:23:16.846454+0000","last_became_peered":"2024-09-12T02:23:16.846454+0000","last_unstale":"2024-09-12T02:23:17.839619+0000","last_undegraded":"2024-09-12T02:23:17.839619+0000","last_fullsized":"2024-09-12T02:23:17.839619+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:51.782998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331516+0000","last_change":"2024-09-12T02:23:04.784379+0000","last_active":"2024-09-12T02:23:18.331516+0000","last_peered":"2024-09-12T02:23:18.331516+0000","last_clean":"2024-09-12T02:23:18.331516+0000","last_became_active":"2024-09-12T02:23:04.784094+0000","last_became_peered":"2024-09-12T02:23:04.784094+0000","last_unstale":"2024-09-12T02:23:18.331516+0000","last_undegraded":"2024-09-12T02:23:18.331516+0000","last_fullsized":"2024-09-12T02:23:18.331516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:22.103008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.332137+0000","last_change":"2024-09-12T02:23:03.762859+0000","last_active":"2024-09-12T02:23:18.332137+0000","last_peered":"2024-09-12T02:23:18.332137+0000","last_clean":"2024-09-12T02:23:18.332137+0000","last_became_active":"2024-09-12T02:23:03.762557+0000","last_became_peered":"2024-09-12T02:23:03.762557+0000","last_unstale":"2024-09-12T02:23:18.332137+0000","last_undegraded":"2024-09-12T02:23:18.332137+0000","last_fullsized":"2024-09-12T02:23:18.332137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:34.863435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"25'3","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325835+0000","last_change":"2024-09-12T02:23:15.823090+0000","last_active":"2024-09-12T02:23:18.325835+0000","last_peered":"2024-09-12T02:23:18.325835+0000","last_clean":"2024-09-12T02:23:18.325835+0000","last_became_active":"2024-09-12T02:23:15.822441+0000","last_became_peered":"2024-09-12T02:23:15.822441+0000","last_unstale":"2024-09-12T02:23:18.325835+0000","last_undegraded":"2024-09-12T02:23:18.325835+0000","last_fullsized":"2024-09-12T02:23:18.325835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:35.125478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839147+0000","last_change":"2024-09-12T02:23:16.839875+0000","last_active":"2024-09-12T02:23:17.839147+0000","last_peered":"2024-09-12T02:23:17.839147+0000","last_clean":"2024-09-12T02:23:17.839147+0000","last_became_active":"2024-09-12T02:23:16.838277+0000","last_became_peered":"2024-09-12T02:23:16.838277+0000","last_unstale":"2024-09-12T02:23:17.839147+0000","last_undegraded":"2024-09-12T02:23:17.839147+0000","last_fullsized":"2024-09-12T02:23:17.839147+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:09.370310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842288+0000","last_change":"2024-09-12T02:23:04.780843+0000","last_active":"2024-09-12T02:23:17.842288+0000","last_peered":"2024-09-12T02:23:17.842288+0000","last_clean":"2024-09-12T02:23:17.842288+0000","last_became_active":"2024-09-12T02:23:04.780475+0000","last_became_peered":"2024-09-12T02:23:04.780475+0000","last_unstale":"2024-09-12T02:23:17.842288+0000","last_undegraded":"2024-09-12T02:23:17.842288+0000","last_fullsized":"2024-09-12T02:23:17.842288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:38.074872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597754+0000","last_change":"2024-09-12T02:23:03.768425+0000","last_active":"2024-09-12T02:23:19.597754+0000","last_peered":"2024-09-12T02:23:19.597754+0000","last_clean":"2024-09-12T02:23:19.597754+0000","last_became_active":"2024-09-12T02:23:03.768092+0000","last_became_peered":"2024-09-12T02:23:03.768092+0000","last_unstale":"2024-09-12T02:23:19.597754+0000","last_undegraded":"2024-09-12T02:23:19.597754+0000","last_fullsized":"2024-09-12T02:23:19.597754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:18.572070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444109+0000","last_change":"2024-09-12T02:23:15.829364+0000","last_active":"2024-09-12T02:23:18.444109+0000","last_peered":"2024-09-12T02:23:18.444109+0000","last_clean":"2024-09-12T02:23:18.444109+0000","last_became_active":"2024-09-12T02:23:15.827936+0000","last_became_peered":"2024-09-12T02:23:15.827936+0000","last_unstale":"2024-09-12T02:23:18.444109+0000","last_undegraded":"2024-09-12T02:23:18.444109+0000","last_fullsized":"2024-09-12T02:23:18.444109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:04.973202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444416+0000","last_change":"2024-09-12T02:23:16.854209+0000","last_active":"2024-09-12T02:23:18.444416+0000","last_peered":"2024-09-12T02:23:18.444416+0000","last_clean":"2024-09-12T02:23:18.444416+0000","last_became_active":"2024-09-12T02:23:16.853900+0000","last_became_peered":"2024-09-12T02:23:16.853900+0000","last_unstale":"2024-09-12T02:23:18.444416+0000","last_undegraded":"2024-09-12T02:23:18.444416+0000","last_fullsized":"2024-09-12T02:23:18.444416+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:52.831434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842656+0000","last_change":"2024-09-12T02:23:04.777953+0000","last_active":"2024-09-12T02:23:17.842656+0000","last_peered":"2024-09-12T02:23:17.842656+0000","last_clean":"2024-09-12T02:23:17.842656+0000","last_became_active":"2024-09-12T02:23:04.777081+0000","last_became_peered":"2024-09-12T02:23:04.777081+0000","last_unstale":"2024-09-12T02:23:17.842656+0000","last_undegraded":"2024-09-12T02:23:17.842656+0000","last_fullsized":"2024-09-12T02:23:17.842656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:14.103378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444886+0000","last_change":"2024-09-12T02:23:03.771271+0000","last_active":"2024-09-12T02:23:18.444886+0000","last_peered":"2024-09-12T02:23:18.444886+0000","last_clean":"2024-09-12T02:23:18.444886+0000","last_became_active":"2024-09-12T02:23:03.769601+0000","last_became_peered":"2024-09-12T02:23:03.769601+0000","last_unstale":"2024-09-12T02:23:18.444886+0000","last_undegraded":"2024-09-12T02:23:18.444886+0000","last_fullsized":"2024-09-12T02:23:18.444886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:22.910072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842076+0000","last_change":"2024-09-12T02:23:15.831522+0000","last_active":"2024-09-12T02:23:17.842076+0000","last_peered":"2024-09-12T02:23:17.842076+0000","last_clean":"2024-09-12T02:23:17.842076+0000","last_became_active":"2024-09-12T02:23:15.831220+0000","last_became_peered":"2024-09-12T02:23:15.831220+0000","last_unstale":"2024-09-12T02:23:17.842076+0000","last_undegraded":"2024-09-12T02:23:17.842076+0000","last_fullsized":"2024-09-12T02:23:17.842076+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:54.337051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597564+0000","last_change":"2024-09-12T02:23:16.858361+0000","last_active":"2024-09-12T02:23:19.597564+0000","last_peered":"2024-09-12T02:23:19.597564+0000","last_clean":"2024-09-12T02:23:19.597564+0000","last_became_active":"2024-09-12T02:23:16.858075+0000","last_became_peered":"2024-09-12T02:23:16.858075+0000","last_unstale":"2024-09-12T02:23:19.597564+0000","last_undegraded":"2024-09-12T02:23:19.597564+0000","last_fullsized":"2024-09-12T02:23:19.597564+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:35.038604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331887+0000","last_change":"2024-09-12T02:23:04.779171+0000","last_active":"2024-09-12T02:23:18.331887+0000","last_peered":"2024-09-12T02:23:18.331887+0000","last_clean":"2024-09-12T02:23:18.331887+0000","last_became_active":"2024-09-12T02:23:04.778850+0000","last_became_peered":"2024-09-12T02:23:04.778850+0000","last_unstale":"2024-09-12T02:23:18.331887+0000","last_undegraded":"2024-09-12T02:23:18.331887+0000","last_fullsized":"2024-09-12T02:23:18.331887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:21.746490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325975+0000","last_change":"2024-09-12T02:23:03.769710+0000","last_active":"2024-09-12T02:23:18.325975+0000","last_peered":"2024-09-12T02:23:18.325975+0000","last_clean":"2024-09-12T02:23:18.325975+0000","last_became_active":"2024-09-12T02:23:03.769436+0000","last_became_peered":"2024-09-12T02:23:03.769436+0000","last_unstale":"2024-09-12T02:23:18.325975+0000","last_undegraded":"2024-09-12T02:23:18.325975+0000","last_fullsized":"2024-09-12T02:23:18.325975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:11.194147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"25'8","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.838898+0000","last_change":"2024-09-12T02:23:15.833196+0000","last_active":"2024-09-12T02:23:17.838898+0000","last_peered":"2024-09-12T02:23:17.838898+0000","last_clean":"2024-09-12T02:23:17.838898+0000","last_became_active":"2024-09-12T02:23:15.832873+0000","last_became_peered":"2024-09-12T02:23:15.832873+0000","last_unstale":"2024-09-12T02:23:17.838898+0000","last_undegraded":"2024-09-12T02:23:17.838898+0000","last_fullsized":"2024-09-12T02:23:17.838898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:15.238046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840614+0000","last_change":"2024-09-12T02:23:16.856735+0000","last_active":"2024-09-12T02:23:17.840614+0000","last_peered":"2024-09-12T02:23:17.840614+0000","last_clean":"2024-09-12T02:23:17.840614+0000","last_became_active":"2024-09-12T02:23:16.856455+0000","last_became_peered":"2024-09-12T02:23:16.856455+0000","last_unstale":"2024-09-12T02:23:17.840614+0000","last_undegraded":"2024-09-12T02:23:17.840614+0000","last_fullsized":"2024-09-12T02:23:17.840614+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:55.376194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325968+0000","last_change":"2024-09-12T02:23:04.786100+0000","last_active":"2024-09-12T02:23:18.325968+0000","last_peered":"2024-09-12T02:23:18.325968+0000","last_clean":"2024-09-12T02:23:18.325968+0000","last_became_active":"2024-09-12T02:23:04.785795+0000","last_became_peered":"2024-09-12T02:23:04.785795+0000","last_unstale":"2024-09-12T02:23:18.325968+0000","last_undegraded":"2024-09-12T02:23:18.325968+0000","last_fullsized":"2024-09-12T02:23:18.325968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:58.597807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.598224+0000","last_change":"2024-09-12T02:23:03.770668+0000","last_active":"2024-09-12T02:23:19.598224+0000","last_peered":"2024-09-12T02:23:19.598224+0000","last_clean":"2024-09-12T02:23:19.598224+0000","last_became_active":"2024-09-12T02:23:03.769302+0000","last_became_peered":"2024-09-12T02:23:03.769302+0000","last_unstale":"2024-09-12T02:23:19.598224+0000","last_undegraded":"2024-09-12T02:23:19.598224+0000","last_fullsized":"2024-09-12T02:23:19.598224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:18.948922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.838826+0000","last_change":"2024-09-12T02:23:15.825585+0000","last_active":"2024-09-12T02:23:17.838826+0000","last_peered":"2024-09-12T02:23:17.838826+0000","last_clean":"2024-09-12T02:23:17.838826+0000","last_became_active":"2024-09-12T02:23:15.825305+0000","last_became_peered":"2024-09-12T02:23:15.825305+0000","last_unstale":"2024-09-12T02:23:17.838826+0000","last_undegraded":"2024-09-12T02:23:17.838826+0000","last_fullsized":"2024-09-12T02:23:17.838826+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:43.818922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.598136+0000","last_change":"2024-09-12T02:23:16.852415+0000","last_active":"2024-09-12T02:23:19.598136+0000","last_peered":"2024-09-12T02:23:19.598136+0000","last_clean":"2024-09-12T02:23:19.598136+0000","last_became_active":"2024-09-12T02:23:16.852061+0000","last_became_peered":"2024-09-12T02:23:16.852061+0000","last_unstale":"2024-09-12T02:23:19.598136+0000","last_undegraded":"2024-09-12T02:23:19.598136+0000","last_fullsized":"2024-09-12T02:23:19.598136+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:30:49.720576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331783+0000","last_change":"2024-09-12T02:23:15.833414+0000","last_active":"2024-09-12T02:23:18.331783+0000","last_peered":"2024-09-12T02:23:18.331783+0000","last_clean":"2024-09-12T02:23:18.331783+0000","last_became_active":"2024-09-12T02:23:15.832837+0000","last_became_peered":"2024-09-12T02:23:15.832837+0000","last_unstale":"2024-09-12T02:23:18.331783+0000","last_undegraded":"2024-09-12T02:23:18.331783+0000","last_fullsized":"2024-09-12T02:23:18.331783+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:31.510160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444086+0000","last_change":"2024-09-12T02:23:04.776572+0000","last_active":"2024-09-12T02:23:18.444086+0000","last_peered":"2024-09-12T02:23:18.444086+0000","last_clean":"2024-09-12T02:23:18.444086+0000","last_became_active":"2024-09-12T02:23:04.776270+0000","last_became_peered":"2024-09-12T02:23:04.776270+0000","last_unstale":"2024-09-12T02:23:18.444086+0000","last_undegraded":"2024-09-12T02:23:18.444086+0000","last_fullsized":"2024-09-12T02:23:18.444086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:12.807907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325207+0000","last_change":"2024-09-12T02:23:03.762450+0000","last_active":"2024-09-12T02:23:18.325207+0000","last_peered":"2024-09-12T02:23:18.325207+0000","last_clean":"2024-09-12T02:23:18.325207+0000","last_became_active":"2024-09-12T02:23:03.762161+0000","last_became_peered":"2024-09-12T02:23:03.762161+0000","last_unstale":"2024-09-12T02:23:18.325207+0000","last_undegraded":"2024-09-12T02:23:18.325207+0000","last_fullsized":"2024-09-12T02:23:18.325207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:42.256395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331804+0000","last_change":"2024-09-12T02:23:16.844537+0000","last_active":"2024-09-12T02:23:18.331804+0000","last_peered":"2024-09-12T02:23:18.331804+0000","last_clean":"2024-09-12T02:23:18.331804+0000","last_became_active":"2024-09-12T02:23:16.844248+0000","last_became_peered":"2024-09-12T02:23:16.844248+0000","last_unstale":"2024-09-12T02:23:18.331804+0000","last_undegraded":"2024-09-12T02:23:18.331804+0000","last_fullsized":"2024-09-12T02:23:18.331804+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:45.801324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"25'4","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.598147+0000","last_change":"2024-09-12T02:23:15.826010+0000","last_active":"2024-09-12T02:23:19.598147+0000","last_peered":"2024-09-12T02:23:19.598147+0000","last_clean":"2024-09-12T02:23:19.598147+0000","last_became_active":"2024-09-12T02:23:15.825730+0000","last_became_peered":"2024-09-12T02:23:15.825730+0000","last_unstale":"2024-09-12T02:23:19.598147+0000","last_undegraded":"2024-09-12T02:23:19.598147+0000","last_fullsized":"2024-09-12T02:23:19.598147+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:17.920975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839339+0000","last_change":"2024-09-12T02:23:04.783317+0000","last_active":"2024-09-12T02:23:17.839339+0000","last_peered":"2024-09-12T02:23:17.839339+0000","last_clean":"2024-09-12T02:23:17.839339+0000","last_became_active":"2024-09-12T02:23:04.783039+0000","last_became_peered":"2024-09-12T02:23:04.783039+0000","last_unstale":"2024-09-12T02:23:17.839339+0000","last_undegraded":"2024-09-12T02:23:17.839339+0000","last_fullsized":"2024-09-12T02:23:17.839339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:17.577991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839055+0000","last_change":"2024-09-12T02:23:03.768361+0000","last_active":"2024-09-12T02:23:17.839055+0000","last_peered":"2024-09-12T02:23:17.839055+0000","last_clean":"2024-09-12T02:23:17.839055+0000","last_became_active":"2024-09-12T02:23:03.768137+0000","last_became_peered":"2024-09-12T02:23:03.768137+0000","last_unstale":"2024-09-12T02:23:17.839055+0000","last_undegraded":"2024-09-12T02:23:17.839055+0000","last_fullsized":"2024-09-12T02:23:17.839055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:29.721363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444813+0000","last_change":"2024-09-12T02:23:16.861251+0000","last_active":"2024-09-12T02:23:18.444813+0000","last_peered":"2024-09-12T02:23:18.444813+0000","last_clean":"2024-09-12T02:23:18.444813+0000","last_became_active":"2024-09-12T02:23:16.860980+0000","last_became_peered":"2024-09-12T02:23:16.860980+0000","last_unstale":"2024-09-12T02:23:18.444813+0000","last_undegraded":"2024-09-12T02:23:18.444813+0000","last_fullsized":"2024-09-12T02:23:18.444813+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:16.177179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597691+0000","last_change":"2024-09-12T02:23:03.768186+0000","last_active":"2024-09-12T02:23:19.597691+0000","last_peered":"2024-09-12T02:23:19.597691+0000","last_clean":"2024-09-12T02:23:19.597691+0000","last_became_active":"2024-09-12T02:23:03.767916+0000","last_became_peered":"2024-09-12T02:23:03.767916+0000","last_unstale":"2024-09-12T02:23:19.597691+0000","last_undegraded":"2024-09-12T02:23:19.597691+0000","last_fullsized":"2024-09-12T02:23:19.597691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:04.424540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.332085+0000","last_change":"2024-09-12T02:23:04.793412+0000","last_active":"2024-09-12T02:23:18.332085+0000","last_peered":"2024-09-12T02:23:18.332085+0000","last_clean":"2024-09-12T02:23:18.332085+0000","last_became_active":"2024-09-12T02:23:04.793100+0000","last_became_peered":"2024-09-12T02:23:04.793100+0000","last_unstale":"2024-09-12T02:23:18.332085+0000","last_undegraded":"2024-09-12T02:23:18.332085+0000","last_fullsized":"2024-09-12T02:23:18.332085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:50.446212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673306+0000","last_change":"2024-09-12T02:23:15.830776+0000","last_active":"2024-09-12T02:23:18.673306+0000","last_peered":"2024-09-12T02:23:18.673306+0000","last_clean":"2024-09-12T02:23:18.673306+0000","last_became_active":"2024-09-12T02:23:15.830492+0000","last_became_peered":"2024-09-12T02:23:15.830492+0000","last_unstale":"2024-09-12T02:23:18.673306+0000","last_undegraded":"2024-09-12T02:23:18.673306+0000","last_fullsized":"2024-09-12T02:23:18.673306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:40.517292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840575+0000","last_change":"2024-09-12T02:23:16.851953+0000","last_active":"2024-09-12T02:23:17.840575+0000","last_peered":"2024-09-12T02:23:17.840575+0000","last_clean":"2024-09-12T02:23:17.840575+0000","last_became_active":"2024-09-12T02:23:16.851558+0000","last_became_peered":"2024-09-12T02:23:16.851558+0000","last_unstale":"2024-09-12T02:23:17.840575+0000","last_undegraded":"2024-09-12T02:23:17.840575+0000","last_fullsized":"2024-09-12T02:23:17.840575+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:29.852193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839423+0000","last_change":"2024-09-12T02:23:03.764310+0000","last_active":"2024-09-12T02:23:17.839423+0000","last_peered":"2024-09-12T02:23:17.839423+0000","last_clean":"2024-09-12T02:23:17.839423+0000","last_became_active":"2024-09-12T02:23:03.764020+0000","last_became_peered":"2024-09-12T02:23:03.764020+0000","last_unstale":"2024-09-12T02:23:17.839423+0000","last_undegraded":"2024-09-12T02:23:17.839423+0000","last_fullsized":"2024-09-12T02:23:17.839423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:25.892874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841038+0000","last_change":"2024-09-12T02:23:04.771579+0000","last_active":"2024-09-12T02:23:17.841038+0000","last_peered":"2024-09-12T02:23:17.841038+0000","last_clean":"2024-09-12T02:23:17.841038+0000","last_became_active":"2024-09-12T02:23:04.771310+0000","last_became_peered":"2024-09-12T02:23:04.771310+0000","last_unstale":"2024-09-12T02:23:17.841038+0000","last_undegraded":"2024-09-12T02:23:17.841038+0000","last_fullsized":"2024-09-12T02:23:17.841038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:05.115474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839742+0000","last_change":"2024-09-12T02:23:15.832757+0000","last_active":"2024-09-12T02:23:17.839742+0000","last_peered":"2024-09-12T02:23:17.839742+0000","last_clean":"2024-09-12T02:23:17.839742+0000","last_became_active":"2024-09-12T02:23:15.832478+0000","last_became_peered":"2024-09-12T02:23:15.832478+0000","last_unstale":"2024-09-12T02:23:17.839742+0000","last_undegraded":"2024-09-12T02:23:17.839742+0000","last_fullsized":"2024-09-12T02:23:17.839742+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:29.301251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839974+0000","last_change":"2024-09-12T02:23:16.848437+0000","last_active":"2024-09-12T02:23:17.839974+0000","last_peered":"2024-09-12T02:23:17.839974+0000","last_clean":"2024-09-12T02:23:17.839974+0000","last_became_active":"2024-09-12T02:23:16.847063+0000","last_became_peered":"2024-09-12T02:23:16.847063+0000","last_unstale":"2024-09-12T02:23:17.839974+0000","last_undegraded":"2024-09-12T02:23:17.839974+0000","last_fullsized":"2024-09-12T02:23:17.839974+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:49.979448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597310+0000","last_change":"2024-09-12T02:23:04.788489+0000","last_active":"2024-09-12T02:23:19.597310+0000","last_peered":"2024-09-12T02:23:19.597310+0000","last_clean":"2024-09-12T02:23:19.597310+0000","last_became_active":"2024-09-12T02:23:04.788195+0000","last_became_peered":"2024-09-12T02:23:04.788195+0000","last_unstale":"2024-09-12T02:23:19.597310+0000","last_undegraded":"2024-09-12T02:23:19.597310+0000","last_fullsized":"2024-09-12T02:23:19.597310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:51.352859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444586+0000","last_change":"2024-09-12T02:23:16.843805+0000","last_active":"2024-09-12T02:23:18.444586+0000","last_peered":"2024-09-12T02:23:18.444586+0000","last_clean":"2024-09-12T02:23:18.444586+0000","last_became_active":"2024-09-12T02:23:16.843517+0000","last_became_peered":"2024-09-12T02:23:16.843517+0000","last_unstale":"2024-09-12T02:23:18.444586+0000","last_undegraded":"2024-09-12T02:23:18.444586+0000","last_fullsized":"2024-09-12T02:23:18.444586+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:30.873311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673159+0000","last_change":"2024-09-12T02:23:04.780662+0000","last_active":"2024-09-12T02:23:18.673159+0000","last_peered":"2024-09-12T02:23:18.673159+0000","last_clean":"2024-09-12T02:23:18.673159+0000","last_became_active":"2024-09-12T02:23:04.780402+0000","last_became_peered":"2024-09-12T02:23:04.780402+0000","last_unstale":"2024-09-12T02:23:18.673159+0000","last_undegraded":"2024-09-12T02:23:18.673159+0000","last_fullsized":"2024-09-12T02:23:18.673159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:23:00.556487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325531+0000","last_change":"2024-09-12T02:23:16.852992+0000","last_active":"2024-09-12T02:23:18.325531+0000","last_peered":"2024-09-12T02:23:18.325531+0000","last_clean":"2024-09-12T02:23:18.325531+0000","last_became_active":"2024-09-12T02:23:16.852706+0000","last_became_peered":"2024-09-12T02:23:16.852706+0000","last_unstale":"2024-09-12T02:23:18.325531+0000","last_undegraded":"2024-09-12T02:23:18.325531+0000","last_fullsized":"2024-09-12T02:23:18.325531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:56.896457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325468+0000","last_change":"2024-09-12T02:23:04.785920+0000","last_active":"2024-09-12T02:23:18.325468+0000","last_peered":"2024-09-12T02:23:18.325468+0000","last_clean":"2024-09-12T02:23:18.325468+0000","last_became_active":"2024-09-12T02:23:04.785422+0000","last_became_peered":"2024-09-12T02:23:04.785422+0000","last_unstale":"2024-09-12T02:23:18.325468+0000","last_undegraded":"2024-09-12T02:23:18.325468+0000","last_fullsized":"2024-09-12T02:23:18.325468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:55.106703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444779+0000","last_change":"2024-09-12T02:23:16.861939+0000","last_active":"2024-09-12T02:23:18.444779+0000","last_peered":"2024-09-12T02:23:18.444779+0000","last_clean":"2024-09-12T02:23:18.444779+0000","last_became_active":"2024-09-12T02:23:16.861658+0000","last_became_peered":"2024-09-12T02:23:16.861658+0000","last_unstale":"2024-09-12T02:23:18.444779+0000","last_undegraded":"2024-09-12T02:23:18.444779+0000","last_fullsized":"2024-09-12T02:23:18.444779+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:06.755715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331991+0000","last_change":"2024-09-12T02:23:04.777018+0000","last_active":"2024-09-12T02:23:18.331991+0000","last_peered":"2024-09-12T02:23:18.331991+0000","last_clean":"2024-09-12T02:23:18.331991+0000","last_became_active":"2024-09-12T02:23:04.776736+0000","last_became_peered":"2024-09-12T02:23:04.776736+0000","last_unstale":"2024-09-12T02:23:18.331991+0000","last_undegraded":"2024-09-12T02:23:18.331991+0000","last_fullsized":"2024-09-12T02:23:18.331991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:08.668990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840760+0000","last_change":"2024-09-12T02:23:16.847615+0000","last_active":"2024-09-12T02:23:17.840760+0000","last_peered":"2024-09-12T02:23:17.840760+0000","last_clean":"2024-09-12T02:23:17.840760+0000","last_became_active":"2024-09-12T02:23:16.847260+0000","last_became_peered":"2024-09-12T02:23:16.847260+0000","last_unstale":"2024-09-12T02:23:17.840760+0000","last_undegraded":"2024-09-12T02:23:17.840760+0000","last_fullsized":"2024-09-12T02:23:17.840760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:48.920477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839828+0000","last_change":"2024-09-12T02:23:04.789372+0000","last_active":"2024-09-12T02:23:17.839828+0000","last_peered":"2024-09-12T02:23:17.839828+0000","last_clean":"2024-09-12T02:23:17.839828+0000","last_became_active":"2024-09-12T02:23:04.789090+0000","last_became_peered":"2024-09-12T02:23:04.789090+0000","last_unstale":"2024-09-12T02:23:17.839828+0000","last_undegraded":"2024-09-12T02:23:17.839828+0000","last_fullsized":"2024-09-12T02:23:17.839828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:49.533491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841815+0000","last_change":"2024-09-12T02:23:16.859000+0000","last_active":"2024-09-12T02:23:17.841815+0000","last_peered":"2024-09-12T02:23:17.841815+0000","last_clean":"2024-09-12T02:23:17.841815+0000","last_became_active":"2024-09-12T02:23:16.858637+0000","last_became_peered":"2024-09-12T02:23:16.858637+0000","last_unstale":"2024-09-12T02:23:17.841815+0000","last_undegraded":"2024-09-12T02:23:17.841815+0000","last_fullsized":"2024-09-12T02:23:17.841815+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:47.915947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444881+0000","last_change":"2024-09-12T02:23:04.776435+0000","last_active":"2024-09-12T02:23:18.444881+0000","last_peered":"2024-09-12T02:23:18.444881+0000","last_clean":"2024-09-12T02:23:18.444881+0000","last_became_active":"2024-09-12T02:23:04.776120+0000","last_became_peered":"2024-09-12T02:23:04.776120+0000","last_unstale":"2024-09-12T02:23:18.444881+0000","last_undegraded":"2024-09-12T02:23:18.444881+0000","last_fullsized":"2024-09-12T02:23:18.444881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:27.985094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840466+0000","last_change":"2024-09-12T02:23:16.856477+0000","last_active":"2024-09-12T02:23:17.840466+0000","last_peered":"2024-09-12T02:23:17.840466+0000","last_clean":"2024-09-12T02:23:17.840466+0000","last_became_active":"2024-09-12T02:23:16.855839+0000","last_became_peered":"2024-09-12T02:23:16.855839+0000","last_unstale":"2024-09-12T02:23:17.840466+0000","last_undegraded":"2024-09-12T02:23:17.840466+0000","last_fullsized":"2024-09-12T02:23:17.840466+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:42.510184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.598050+0000","last_change":"2024-09-12T02:23:04.788827+0000","last_active":"2024-09-12T02:23:19.598050+0000","last_peered":"2024-09-12T02:23:19.598050+0000","last_clean":"2024-09-12T02:23:19.598050+0000","last_became_active":"2024-09-12T02:23:04.788521+0000","last_became_peered":"2024-09-12T02:23:04.788521+0000","last_unstale":"2024-09-12T02:23:19.598050+0000","last_undegraded":"2024-09-12T02:23:19.598050+0000","last_fullsized":"2024-09-12T02:23:19.598050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:24.470245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597525+0000","last_change":"2024-09-12T02:23:16.838421+0000","last_active":"2024-09-12T02:23:19.597525+0000","last_peered":"2024-09-12T02:23:19.597525+0000","last_clean":"2024-09-12T02:23:19.597525+0000","last_became_active":"2024-09-12T02:23:16.837606+0000","last_became_peered":"2024-09-12T02:23:16.837606+0000","last_unstale":"2024-09-12T02:23:19.597525+0000","last_undegraded":"2024-09-12T02:23:19.597525+0000","last_fullsized":"2024-09-12T02:23:19.597525+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:09.704007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840259+0000","last_change":"2024-09-12T02:23:04.787899+0000","last_active":"2024-09-12T02:23:17.840259+0000","last_peered":"2024-09-12T02:23:17.840259+0000","last_clean":"2024-09-12T02:23:17.840259+0000","last_became_active":"2024-09-12T02:23:04.787619+0000","last_became_peered":"2024-09-12T02:23:04.787619+0000","last_unstale":"2024-09-12T02:23:17.840259+0000","last_undegraded":"2024-09-12T02:23:17.840259+0000","last_fullsized":"2024-09-12T02:23:17.840259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:57.732453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839922+0000","last_change":"2024-09-12T02:23:16.845296+0000","last_active":"2024-09-12T02:23:17.839922+0000","last_peered":"2024-09-12T02:23:17.839922+0000","last_clean":"2024-09-12T02:23:17.839922+0000","last_became_active":"2024-09-12T02:23:16.844939+0000","last_became_peered":"2024-09-12T02:23:16.844939+0000","last_unstale":"2024-09-12T02:23:17.839922+0000","last_undegraded":"2024-09-12T02:23:17.839922+0000","last_fullsized":"2024-09-12T02:23:17.839922+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:16.790822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325133+0000","last_change":"2024-09-12T02:23:04.787389+0000","last_active":"2024-09-12T02:23:18.325133+0000","last_peered":"2024-09-12T02:23:18.325133+0000","last_clean":"2024-09-12T02:23:18.325133+0000","last_became_active":"2024-09-12T02:23:04.787092+0000","last_became_peered":"2024-09-12T02:23:04.787092+0000","last_unstale":"2024-09-12T02:23:18.325133+0000","last_undegraded":"2024-09-12T02:23:18.325133+0000","last_fullsized":"2024-09-12T02:23:18.325133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:02.924906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.843281+0000","last_change":"2024-09-12T02:23:16.849846+0000","last_active":"2024-09-12T02:23:17.843281+0000","last_peered":"2024-09-12T02:23:17.843281+0000","last_clean":"2024-09-12T02:23:17.843281+0000","last_became_active":"2024-09-12T02:23:16.849585+0000","last_became_peered":"2024-09-12T02:23:16.849585+0000","last_unstale":"2024-09-12T02:23:17.843281+0000","last_undegraded":"2024-09-12T02:23:17.843281+0000","last_fullsized":"2024-09-12T02:23:17.843281+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:58.775679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839012+0000","last_change":"2024-09-12T02:23:04.788624+0000","last_active":"2024-09-12T02:23:17.839012+0000","last_peered":"2024-09-12T02:23:17.839012+0000","last_clean":"2024-09-12T02:23:17.839012+0000","last_became_active":"2024-09-12T02:23:04.788352+0000","last_became_peered":"2024-09-12T02:23:04.788352+0000","last_unstale":"2024-09-12T02:23:17.839012+0000","last_undegraded":"2024-09-12T02:23:17.839012+0000","last_fullsized":"2024-09-12T02:23:17.839012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:13.961110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673339+0000","last_change":"2024-09-12T02:23:16.850112+0000","last_active":"2024-09-12T02:23:18.673339+0000","last_peered":"2024-09-12T02:23:18.673339+0000","last_clean":"2024-09-12T02:23:18.673339+0000","last_became_active":"2024-09-12T02:23:16.849831+0000","last_became_peered":"2024-09-12T02:23:16.849831+0000","last_unstale":"2024-09-12T02:23:18.673339+0000","last_undegraded":"2024-09-12T02:23:18.673339+0000","last_fullsized":"2024-09-12T02:23:18.673339+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:42.625762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325319+0000","last_change":"2024-09-12T02:23:04.785685+0000","last_active":"2024-09-12T02:23:18.325319+0000","last_peered":"2024-09-12T02:23:18.325319+0000","last_clean":"2024-09-12T02:23:18.325319+0000","last_became_active":"2024-09-12T02:23:04.784945+0000","last_became_peered":"2024-09-12T02:23:04.784945+0000","last_unstale":"2024-09-12T02:23:18.325319+0000","last_undegraded":"2024-09-12T02:23:18.325319+0000","last_fullsized":"2024-09-12T02:23:18.325319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:36.658436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839639+0000","last_change":"2024-09-12T02:23:16.846108+0000","last_active":"2024-09-12T02:23:17.839639+0000","last_peered":"2024-09-12T02:23:17.839639+0000","last_clean":"2024-09-12T02:23:17.839639+0000","last_became_active":"2024-09-12T02:23:16.845793+0000","last_became_peered":"2024-09-12T02:23:16.845793+0000","last_unstale":"2024-09-12T02:23:17.839639+0000","last_undegraded":"2024-09-12T02:23:17.839639+0000","last_fullsized":"2024-09-12T02:23:17.839639+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:36.274858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331880+0000","last_change":"2024-09-12T02:23:04.785849+0000","last_active":"2024-09-12T02:23:18.331880+0000","last_peered":"2024-09-12T02:23:18.331880+0000","last_clean":"2024-09-12T02:23:18.331880+0000","last_became_active":"2024-09-12T02:23:04.785511+0000","last_became_peered":"2024-09-12T02:23:04.785511+0000","last_unstale":"2024-09-12T02:23:18.331880+0000","last_undegraded":"2024-09-12T02:23:18.331880+0000","last_fullsized":"2024-09-12T02:23:18.331880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:28.670102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840717+0000","last_change":"2024-09-12T02:23:16.855615+0000","last_active":"2024-09-12T02:23:17.840717+0000","last_peered":"2024-09-12T02:23:17.840717+0000","last_clean":"2024-09-12T02:23:17.840717+0000","last_became_active":"2024-09-12T02:23:16.855278+0000","last_became_peered":"2024-09-12T02:23:16.855278+0000","last_unstale":"2024-09-12T02:23:17.840717+0000","last_undegraded":"2024-09-12T02:23:17.840717+0000","last_fullsized":"2024-09-12T02:23:17.840717+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:34.214175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597577+0000","last_change":"2024-09-12T02:23:04.789575+0000","last_active":"2024-09-12T02:23:19.597577+0000","last_peered":"2024-09-12T02:23:19.597577+0000","last_clean":"2024-09-12T02:23:19.597577+0000","last_became_active":"2024-09-12T02:23:04.789296+0000","last_became_peered":"2024-09-12T02:23:04.789296+0000","last_unstale":"2024-09-12T02:23:19.597577+0000","last_undegraded":"2024-09-12T02:23:19.597577+0000","last_fullsized":"2024-09-12T02:23:19.597577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:13.166139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841521+0000","last_change":"2024-09-12T02:23:16.858045+0000","last_active":"2024-09-12T02:23:17.841521+0000","last_peered":"2024-09-12T02:23:17.841521+0000","last_clean":"2024-09-12T02:23:17.841521+0000","last_became_active":"2024-09-12T02:23:16.857772+0000","last_became_peered":"2024-09-12T02:23:16.857772+0000","last_unstale":"2024-09-12T02:23:17.841521+0000","last_undegraded":"2024-09-12T02:23:17.841521+0000","last_fullsized":"2024-09-12T02:23:17.841521+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:35.598279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842504+0000","last_change":"2024-09-12T02:23:04.777450+0000","last_active":"2024-09-12T02:23:17.842504+0000","last_peered":"2024-09-12T02:23:17.842504+0000","last_clean":"2024-09-12T02:23:17.842504+0000","last_became_active":"2024-09-12T02:23:04.776825+0000","last_became_peered":"2024-09-12T02:23:04.776825+0000","last_unstale":"2024-09-12T02:23:17.842504+0000","last_undegraded":"2024-09-12T02:23:17.842504+0000","last_fullsized":"2024-09-12T02:23:17.842504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:40.315075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325062+0000","last_change":"2024-09-12T02:23:16.846032+0000","last_active":"2024-09-12T02:23:18.325062+0000","last_peered":"2024-09-12T02:23:18.325062+0000","last_clean":"2024-09-12T02:23:18.325062+0000","last_became_active":"2024-09-12T02:23:16.845492+0000","last_became_peered":"2024-09-12T02:23:16.845492+0000","last_unstale":"2024-09-12T02:23:18.325062+0000","last_undegraded":"2024-09-12T02:23:18.325062+0000","last_fullsized":"2024-09-12T02:23:18.325062+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:18.785798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673368+0000","last_change":"2024-09-12T02:23:04.791378+0000","last_active":"2024-09-12T02:23:18.673368+0000","last_peered":"2024-09-12T02:23:18.673368+0000","last_clean":"2024-09-12T02:23:18.673368+0000","last_became_active":"2024-09-12T02:23:04.790926+0000","last_became_peered":"2024-09-12T02:23:04.790926+0000","last_unstale":"2024-09-12T02:23:18.673368+0000","last_undegraded":"2024-09-12T02:23:18.673368+0000","last_fullsized":"2024-09-12T02:23:18.673368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:34.764210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331435+0000","last_change":"2024-09-12T02:23:16.851099+0000","last_active":"2024-09-12T02:23:18.331435+0000","last_peered":"2024-09-12T02:23:18.331435+0000","last_clean":"2024-09-12T02:23:18.331435+0000","last_became_active":"2024-09-12T02:23:16.850747+0000","last_became_peered":"2024-09-12T02:23:16.850747+0000","last_unstale":"2024-09-12T02:23:18.331435+0000","last_undegraded":"2024-09-12T02:23:18.331435+0000","last_fullsized":"2024-09-12T02:23:18.331435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:01:31.445590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.326232+0000","last_change":"2024-09-12T02:23:04.789439+0000","last_active":"2024-09-12T02:23:18.326232+0000","last_peered":"2024-09-12T02:23:18.326232+0000","last_clean":"2024-09-12T02:23:18.326232+0000","last_became_active":"2024-09-12T02:23:04.787421+0000","last_became_peered":"2024-09-12T02:23:04.787421+0000","last_unstale":"2024-09-12T02:23:18.326232+0000","last_undegraded":"2024-09-12T02:23:18.326232+0000","last_fullsized":"2024-09-12T02:23:18.326232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:44.295056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444485+0000","last_change":"2024-09-12T02:23:16.850923+0000","last_active":"2024-09-12T02:23:18.444485+0000","last_peered":"2024-09-12T02:23:18.444485+0000","last_clean":"2024-09-12T02:23:18.444485+0000","last_became_active":"2024-09-12T02:23:16.850609+0000","last_became_peered":"2024-09-12T02:23:16.850609+0000","last_unstale":"2024-09-12T02:23:18.444485+0000","last_undegraded":"2024-09-12T02:23:18.444485+0000","last_fullsized":"2024-09-12T02:23:18.444485+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:52.110438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325085+0000","last_change":"2024-09-12T02:23:04.790532+0000","last_active":"2024-09-12T02:23:18.325085+0000","last_peered":"2024-09-12T02:23:18.325085+0000","last_clean":"2024-09-12T02:23:18.325085+0000","last_became_active":"2024-09-12T02:23:04.789229+0000","last_became_peered":"2024-09-12T02:23:04.789229+0000","last_unstale":"2024-09-12T02:23:18.325085+0000","last_undegraded":"2024-09-12T02:23:18.325085+0000","last_fullsized":"2024-09-12T02:23:18.325085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:59.901665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841478+0000","last_change":"2024-09-12T02:23:16.856612+0000","last_active":"2024-09-12T02:23:17.841478+0000","last_peered":"2024-09-12T02:23:17.841478+0000","last_clean":"2024-09-12T02:23:17.841478+0000","last_became_active":"2024-09-12T02:23:16.856290+0000","last_became_peered":"2024-09-12T02:23:16.856290+0000","last_unstale":"2024-09-12T02:23:17.841478+0000","last_undegraded":"2024-09-12T02:23:17.841478+0000","last_fullsized":"2024-09-12T02:23:17.841478+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:14.846281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444198+0000","last_change":"2024-09-12T02:23:04.782490+0000","last_active":"2024-09-12T02:23:18.444198+0000","last_peered":"2024-09-12T02:23:18.444198+0000","last_clean":"2024-09-12T02:23:18.444198+0000","last_became_active":"2024-09-12T02:23:04.782183+0000","last_became_peered":"2024-09-12T02:23:04.782183+0000","last_unstale":"2024-09-12T02:23:18.444198+0000","last_undegraded":"2024-09-12T02:23:18.444198+0000","last_fullsized":"2024-09-12T02:23:18.444198+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:28.699880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325361+0000","last_change":"2024-09-12T02:23:16.858100+0000","last_active":"2024-09-12T02:23:18.325361+0000","last_peered":"2024-09-12T02:23:18.325361+0000","last_clean":"2024-09-12T02:23:18.325361+0000","last_became_active":"2024-09-12T02:23:16.857818+0000","last_became_peered":"2024-09-12T02:23:16.857818+0000","last_unstale":"2024-09-12T02:23:18.325361+0000","last_undegraded":"2024-09-12T02:23:18.325361+0000","last_fullsized":"2024-09-12T02:23:18.325361+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:45.991170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331508+0000","last_change":"2024-09-12T02:23:04.787140+0000","last_active":"2024-09-12T02:23:18.331508+0000","last_peered":"2024-09-12T02:23:18.331508+0000","last_clean":"2024-09-12T02:23:18.331508+0000","last_became_active":"2024-09-12T02:23:04.786799+0000","last_became_peered":"2024-09-12T02:23:04.786799+0000","last_unstale":"2024-09-12T02:23:18.331508+0000","last_undegraded":"2024-09-12T02:23:18.331508+0000","last_fullsized":"2024-09-12T02:23:18.331508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:31.639605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842225+0000","last_change":"2024-09-12T02:23:16.846100+0000","last_active":"2024-09-12T02:23:17.842225+0000","last_peered":"2024-09-12T02:23:17.842225+0000","last_clean":"2024-09-12T02:23:17.842225+0000","last_became_active":"2024-09-12T02:23:16.845749+0000","last_became_peered":"2024-09-12T02:23:16.845749+0000","last_unstale":"2024-09-12T02:23:17.842225+0000","last_undegraded":"2024-09-12T02:23:17.842225+0000","last_fullsized":"2024-09-12T02:23:17.842225+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:42.783366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839149+0000","last_change":"2024-09-12T02:23:04.782128+0000","last_active":"2024-09-12T02:23:17.839149+0000","last_peered":"2024-09-12T02:23:17.839149+0000","last_clean":"2024-09-12T02:23:17.839149+0000","last_became_active":"2024-09-12T02:23:04.781101+0000","last_became_peered":"2024-09-12T02:23:04.781101+0000","last_unstale":"2024-09-12T02:23:17.839149+0000","last_undegraded":"2024-09-12T02:23:17.839149+0000","last_fullsized":"2024-09-12T02:23:17.839149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:49.421147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839296+0000","last_change":"2024-09-12T02:23:16.836968+0000","last_active":"2024-09-12T02:23:17.839296+0000","last_peered":"2024-09-12T02:23:17.839296+0000","last_clean":"2024-09-12T02:23:17.839296+0000","last_became_active":"2024-09-12T02:23:16.836561+0000","last_became_peered":"2024-09-12T02:23:16.836561+0000","last_unstale":"2024-09-12T02:23:17.839296+0000","last_undegraded":"2024-09-12T02:23:17.839296+0000","last_fullsized":"2024-09-12T02:23:17.839296+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:08.765569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842555+0000","last_change":"2024-09-12T02:23:04.787034+0000","last_active":"2024-09-12T02:23:17.842555+0000","last_peered":"2024-09-12T02:23:17.842555+0000","last_clean":"2024-09-12T02:23:17.842555+0000","last_became_active":"2024-09-12T02:23:04.786044+0000","last_became_peered":"2024-09-12T02:23:04.786044+0000","last_unstale":"2024-09-12T02:23:17.842555+0000","last_undegraded":"2024-09-12T02:23:17.842555+0000","last_fullsized":"2024-09-12T02:23:17.842555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:07.183028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673151+0000","last_change":"2024-09-12T02:23:16.846114+0000","last_active":"2024-09-12T02:23:18.673151+0000","last_peered":"2024-09-12T02:23:18.673151+0000","last_clean":"2024-09-12T02:23:18.673151+0000","last_became_active":"2024-09-12T02:23:16.845757+0000","last_became_peered":"2024-09-12T02:23:16.845757+0000","last_unstale":"2024-09-12T02:23:18.673151+0000","last_undegraded":"2024-09-12T02:23:18.673151+0000","last_fullsized":"2024-09-12T02:23:18.673151+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:17:52.019813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597793+0000","last_change":"2024-09-12T02:23:04.785662+0000","last_active":"2024-09-12T02:23:19.597793+0000","last_peered":"2024-09-12T02:23:19.597793+0000","last_clean":"2024-09-12T02:23:19.597793+0000","last_became_active":"2024-09-12T02:23:04.785375+0000","last_became_peered":"2024-09-12T02:23:04.785375+0000","last_unstale":"2024-09-12T02:23:19.597793+0000","last_undegraded":"2024-09-12T02:23:19.597793+0000","last_fullsized":"2024-09-12T02:23:19.597793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:44.295056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841351+0000","last_change":"2024-09-12T02:23:16.858175+0000","last_active":"2024-09-12T02:23:17.841351+0000","last_peered":"2024-09-12T02:23:17.841351+0000","last_clean":"2024-09-12T02:23:17.841351+0000","last_became_active":"2024-09-12T02:23:16.857873+0000","last_became_peered":"2024-09-12T02:23:16.857873+0000","last_unstale":"2024-09-12T02:23:17.841351+0000","last_undegraded":"2024-09-12T02:23:17.841351+0000","last_fullsized":"2024-09-12T02:23:17.841351+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:54.535867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597940+0000","last_change":"2024-09-12T02:23:04.791929+0000","last_active":"2024-09-12T02:23:19.597940+0000","last_peered":"2024-09-12T02:23:19.597940+0000","last_clean":"2024-09-12T02:23:19.597940+0000","last_became_active":"2024-09-12T02:23:04.791622+0000","last_became_peered":"2024-09-12T02:23:04.791622+0000","last_unstale":"2024-09-12T02:23:19.597940+0000","last_undegraded":"2024-09-12T02:23:19.597940+0000","last_fullsized":"2024-09-12T02:23:19.597940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:35.012685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325239+0000","last_change":"2024-09-12T02:23:16.849985+0000","last_active":"2024-09-12T02:23:18.325239+0000","last_peered":"2024-09-12T02:23:18.325239+0000","last_clean":"2024-09-12T02:23:18.325239+0000","last_became_active":"2024-09-12T02:23:16.849641+0000","last_became_peered":"2024-09-12T02:23:16.849641+0000","last_unstale":"2024-09-12T02:23:18.325239+0000","last_undegraded":"2024-09-12T02:23:18.325239+0000","last_fullsized":"2024-09-12T02:23:18.325239+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:28.373543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.843012+0000","last_change":"2024-09-12T02:23:04.781090+0000","last_active":"2024-09-12T02:23:17.843012+0000","last_peered":"2024-09-12T02:23:17.843012+0000","last_clean":"2024-09-12T02:23:17.843012+0000","last_became_active":"2024-09-12T02:23:04.780740+0000","last_became_peered":"2024-09-12T02:23:04.780740+0000","last_unstale":"2024-09-12T02:23:17.843012+0000","last_undegraded":"2024-09-12T02:23:17.843012+0000","last_fullsized":"2024-09-12T02:23:17.843012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:30.639111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839819+0000","last_change":"2024-09-12T02:23:16.840250+0000","last_active":"2024-09-12T02:23:17.839819+0000","last_peered":"2024-09-12T02:23:17.839819+0000","last_clean":"2024-09-12T02:23:17.839819+0000","last_became_active":"2024-09-12T02:23:16.839914+0000","last_became_peered":"2024-09-12T02:23:16.839914+0000","last_unstale":"2024-09-12T02:23:17.839819+0000","last_undegraded":"2024-09-12T02:23:17.839819+0000","last_fullsized":"2024-09-12T02:23:17.839819+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:04.798197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.838971+0000","last_change":"2024-09-12T02:23:04.779648+0000","last_active":"2024-09-12T02:23:17.838971+0000","last_peered":"2024-09-12T02:23:17.838971+0000","last_clean":"2024-09-12T02:23:17.838971+0000","last_became_active":"2024-09-12T02:23:04.779384+0000","last_became_peered":"2024-09-12T02:23:04.779384+0000","last_unstale":"2024-09-12T02:23:17.838971+0000","last_undegraded":"2024-09-12T02:23:17.838971+0000","last_fullsized":"2024-09-12T02:23:17.838971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:41.491471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.598038+0000","last_change":"2024-09-12T02:23:16.850060+0000","last_active":"2024-09-12T02:23:19.598038+0000","last_peered":"2024-09-12T02:23:19.598038+0000","last_clean":"2024-09-12T02:23:19.598038+0000","last_became_active":"2024-09-12T02:23:16.849744+0000","last_became_peered":"2024-09-12T02:23:16.849744+0000","last_unstale":"2024-09-12T02:23:19.598038+0000","last_undegraded":"2024-09-12T02:23:19.598038+0000","last_fullsized":"2024-09-12T02:23:19.598038+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:34.130685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841118+0000","last_change":"2024-09-12T02:23:04.779265+0000","last_active":"2024-09-12T02:23:17.841118+0000","last_peered":"2024-09-12T02:23:17.841118+0000","last_clean":"2024-09-12T02:23:17.841118+0000","last_became_active":"2024-09-12T02:23:04.778968+0000","last_became_peered":"2024-09-12T02:23:04.778968+0000","last_unstale":"2024-09-12T02:23:17.841118+0000","last_undegraded":"2024-09-12T02:23:17.841118+0000","last_fullsized":"2024-09-12T02:23:17.841118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:53.022598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444316+0000","last_change":"2024-09-12T02:23:16.862034+0000","last_active":"2024-09-12T02:23:18.444316+0000","last_peered":"2024-09-12T02:23:18.444316+0000","last_clean":"2024-09-12T02:23:18.444316+0000","last_became_active":"2024-09-12T02:23:16.861441+0000","last_became_peered":"2024-09-12T02:23:16.861441+0000","last_unstale":"2024-09-12T02:23:18.444316+0000","last_undegraded":"2024-09-12T02:23:18.444316+0000","last_fullsized":"2024-09-12T02:23:18.444316+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:24.332614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325312+0000","last_change":"2024-09-12T02:23:04.788890+0000","last_active":"2024-09-12T02:23:18.325312+0000","last_peered":"2024-09-12T02:23:18.325312+0000","last_clean":"2024-09-12T02:23:18.325312+0000","last_became_active":"2024-09-12T02:23:04.788617+0000","last_became_peered":"2024-09-12T02:23:04.788617+0000","last_unstale":"2024-09-12T02:23:18.325312+0000","last_undegraded":"2024-09-12T02:23:18.325312+0000","last_fullsized":"2024-09-12T02:23:18.325312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:24.194151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325951+0000","last_change":"2024-09-12T02:23:16.855853+0000","last_active":"2024-09-12T02:23:18.325951+0000","last_peered":"2024-09-12T02:23:18.325951+0000","last_clean":"2024-09-12T02:23:18.325951+0000","last_became_active":"2024-09-12T02:23:16.855437+0000","last_became_peered":"2024-09-12T02:23:16.855437+0000","last_unstale":"2024-09-12T02:23:18.325951+0000","last_undegraded":"2024-09-12T02:23:18.325951+0000","last_fullsized":"2024-09-12T02:23:18.325951+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:27.557862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841894+0000","last_change":"2024-09-12T02:23:04.777165+0000","last_active":"2024-09-12T02:23:17.841894+0000","last_peered":"2024-09-12T02:23:17.841894+0000","last_clean":"2024-09-12T02:23:17.841894+0000","last_became_active":"2024-09-12T02:23:04.776857+0000","last_became_peered":"2024-09-12T02:23:04.776857+0000","last_unstale":"2024-09-12T02:23:17.841894+0000","last_undegraded":"2024-09-12T02:23:17.841894+0000","last_fullsized":"2024-09-12T02:23:17.841894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:28.309591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839032+0000","last_change":"2024-09-12T02:23:16.849235+0000","last_active":"2024-09-12T02:23:17.839032+0000","last_peered":"2024-09-12T02:23:17.839032+0000","last_clean":"2024-09-12T02:23:17.839032+0000","last_became_active":"2024-09-12T02:23:16.848936+0000","last_became_peered":"2024-09-12T02:23:16.848936+0000","last_unstale":"2024-09-12T02:23:17.839032+0000","last_undegraded":"2024-09-12T02:23:17.839032+0000","last_fullsized":"2024-09-12T02:23:17.839032+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:32.415375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325607+0000","last_change":"2024-09-12T02:23:04.786772+0000","last_active":"2024-09-12T02:23:18.325607+0000","last_peered":"2024-09-12T02:23:18.325607+0000","last_clean":"2024-09-12T02:23:18.325607+0000","last_became_active":"2024-09-12T02:23:04.786509+0000","last_became_peered":"2024-09-12T02:23:04.786509+0000","last_unstale":"2024-09-12T02:23:18.325607+0000","last_undegraded":"2024-09-12T02:23:18.325607+0000","last_fullsized":"2024-09-12T02:23:18.325607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:01.755827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673170+0000","last_change":"2024-09-12T02:23:16.834788+0000","last_active":"2024-09-12T02:23:18.673170+0000","last_peered":"2024-09-12T02:23:18.673170+0000","last_clean":"2024-09-12T02:23:18.673170+0000","last_became_active":"2024-09-12T02:23:16.834483+0000","last_became_peered":"2024-09-12T02:23:16.834483+0000","last_unstale":"2024-09-12T02:23:18.673170+0000","last_undegraded":"2024-09-12T02:23:18.673170+0000","last_fullsized":"2024-09-12T02:23:18.673170+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:23.441282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331724+0000","last_change":"2024-09-12T02:23:04.778772+0000","last_active":"2024-09-12T02:23:18.331724+0000","last_peered":"2024-09-12T02:23:18.331724+0000","last_clean":"2024-09-12T02:23:18.331724+0000","last_became_active":"2024-09-12T02:23:04.778445+0000","last_became_peered":"2024-09-12T02:23:04.778445+0000","last_unstale":"2024-09-12T02:23:18.331724+0000","last_undegraded":"2024-09-12T02:23:18.331724+0000","last_fullsized":"2024-09-12T02:23:18.331724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:58.292023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840431+0000","last_change":"2024-09-12T02:23:16.844170+0000","last_active":"2024-09-12T02:23:17.840431+0000","last_peered":"2024-09-12T02:23:17.840431+0000","last_clean":"2024-09-12T02:23:17.840431+0000","last_became_active":"2024-09-12T02:23:16.843880+0000","last_became_peered":"2024-09-12T02:23:16.843880+0000","last_unstale":"2024-09-12T02:23:17.840431+0000","last_undegraded":"2024-09-12T02:23:17.840431+0000","last_fullsized":"2024-09-12T02:23:17.840431+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:59.283416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444520+0000","last_change":"2024-09-12T02:23:04.785821+0000","last_active":"2024-09-12T02:23:18.444520+0000","last_peered":"2024-09-12T02:23:18.444520+0000","last_clean":"2024-09-12T02:23:18.444520+0000","last_became_active":"2024-09-12T02:23:04.785516+0000","last_became_peered":"2024-09-12T02:23:04.785516+0000","last_unstale":"2024-09-12T02:23:18.444520+0000","last_undegraded":"2024-09-12T02:23:18.444520+0000","last_fullsized":"2024-09-12T02:23:18.444520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:42.400040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840987+0000","last_change":"2024-09-12T02:23:16.844145+0000","last_active":"2024-09-12T02:23:17.840987+0000","last_peered":"2024-09-12T02:23:17.840987+0000","last_clean":"2024-09-12T02:23:17.840987+0000","last_became_active":"2024-09-12T02:23:16.843815+0000","last_became_peered":"2024-09-12T02:23:16.843815+0000","last_unstale":"2024-09-12T02:23:17.840987+0000","last_undegraded":"2024-09-12T02:23:17.840987+0000","last_fullsized":"2024-09-12T02:23:17.840987+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:31.789317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842753+0000","last_change":"2024-09-12T02:23:04.791204+0000","last_active":"2024-09-12T02:23:17.842753+0000","last_peered":"2024-09-12T02:23:17.842753+0000","last_clean":"2024-09-12T02:23:17.842753+0000","last_became_active":"2024-09-12T02:23:04.790906+0000","last_became_peered":"2024-09-12T02:23:04.790906+0000","last_unstale":"2024-09-12T02:23:17.842753+0000","last_undegraded":"2024-09-12T02:23:17.842753+0000","last_fullsized":"2024-09-12T02:23:17.842753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:16.336873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476746,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":695559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476746,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":106747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476747,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":105281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":286720,"data_stored":104749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35612,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336228,"statfs":{"total":96636764160,"available":96600297472,"internally_reserved":0,"allocated":270336,"data_stored":104589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36200,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335640,"statfs":{"total":96636764160,"available":96599695360,"internally_reserved":0,"allocated":872448,"data_stored":695525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542154,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35636,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336204,"statfs":{"total":96636764160,"available":96600272896,"internally_reserved":0,"allocated":294912,"data_stored":107765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35632,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336208,"statfs":{"total":96636764160,"available":96600276992,"internally_reserved":0,"allocated":290816,"data_stored":106313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:23:26.876 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:23:27.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.009+0000 7f6437111640 1 Processor -- start 2024-09-12T02:23:27.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.009+0000 7f6437111640 1 -- start start 2024-09-12T02:23:27.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.010+0000 7f6437111640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6430072ec0 0x7f6430153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:27.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.010+0000 7f6437111640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f64300afc60 0x7f6430151380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:27.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.010+0000 7f6437111640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f643006efa0 con 0x7f64300c4ac0 2024-09-12T02:23:27.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.010+0000 7f6437111640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f643006f280 con 0x7f64300afc60 2024-09-12T02:23:27.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.010+0000 7f6437111640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f643006f560 con 0x7f6430072ec0 2024-09-12T02:23:27.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.010+0000 7f64356ae640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f64300afc60 0x7f6430151380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:27.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.010+0000 7f64356ae640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f64300afc60 0x7f6430151380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50166/0 (socket says 172.21.15.60:50166) 2024-09-12T02:23:27.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.010+0000 7f64356ae640 1 -- 172.21.15.60:0/2297970116 learned_addr learned my addr 172.21.15.60:0/2297970116 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:27.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.011+0000 7f64356ae640 1 -- 172.21.15.60:0/2297970116 >> v2:172.21.15.105:3300/0 conn(0x7f6430072ec0 msgr2=0x7f6430153ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:27.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.011+0000 7f64356ae640 1 --2- 172.21.15.60:0/2297970116 >> v2:172.21.15.105:3300/0 conn(0x7f6430072ec0 0x7f6430153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:27.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.011+0000 7f64356ae640 1 -- 172.21.15.60:0/2297970116 >> v1:172.21.15.105:6789/0 conn(0x7f64300c4ac0 legacy=0x7f6430070040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:27.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.011+0000 7f64356ae640 1 -- 172.21.15.60:0/2297970116 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f643006f840 con 0x7f64300afc60 2024-09-12T02:23:27.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.011+0000 7f64356ae640 1 --2- 172.21.15.60:0/2297970116 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64300afc60 0x7f6430151380 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f64300766f0 tx=0x7f642802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a5ea6630e811e51 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:27.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.012+0000 7f642f7fe640 1 -- 172.21.15.60:0/2297970116 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6428037070 con 0x7f64300afc60 2024-09-12T02:23:27.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.012+0000 7f642f7fe640 1 -- 172.21.15.60:0/2297970116 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f642802ae20 con 0x7f64300afc60 2024-09-12T02:23:27.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.012+0000 7f642f7fe640 1 -- 172.21.15.60:0/2297970116 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6428032660 con 0x7f64300afc60 2024-09-12T02:23:27.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.012+0000 7f6437111640 1 -- 172.21.15.60:0/2297970116 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64300afc60 msgr2=0x7f6430151380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:27.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.012+0000 7f6437111640 1 --2- 172.21.15.60:0/2297970116 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64300afc60 0x7f6430151380 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f64300766f0 tx=0x7f642802a110 comp rx=0 tx=0).stop 2024-09-12T02:23:27.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.012+0000 7f6437111640 1 -- 172.21.15.60:0/2297970116 shutdown_connections 2024-09-12T02:23:27.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.012+0000 7f6437111640 1 --2- 172.21.15.60:0/2297970116 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64300afc60 0x7f6430151380 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:27.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.012+0000 7f6437111640 1 --2- 172.21.15.60:0/2297970116 >> v2:172.21.15.105:3300/0 conn(0x7f6430072ec0 0x7f6430153ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:27.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.012+0000 7f6437111640 1 -- 172.21.15.60:0/2297970116 >> 172.21.15.60:0/2297970116 conn(0x7f64300c9d80 msgr2=0x7f64300ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:27.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.012+0000 7f6437111640 1 -- 172.21.15.60:0/2297970116 shutdown_connections 2024-09-12T02:23:27.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.012+0000 7f6437111640 1 -- 172.21.15.60:0/2297970116 wait complete. 2024-09-12T02:23:27.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.013+0000 7f6437111640 1 Processor -- start 2024-09-12T02:23:27.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.013+0000 7f6437111640 1 -- start start 2024-09-12T02:23:27.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.014+0000 7f6437111640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6430072ec0 0x7f64301efd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:27.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.014+0000 7f6437111640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64300afc60 0x7f64300c8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:27.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.014+0000 7f6437111640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64300c4ac0 0x7f6430141430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:27.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.014+0000 7f6437111640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6430070750 con 0x7f64300afc60 2024-09-12T02:23:27.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.014+0000 7f6437111640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f64300c47f0 con 0x7f64300c4ac0 2024-09-12T02:23:27.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.014+0000 7f6437111640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f64300708d0 con 0x7f6430072ec0 2024-09-12T02:23:27.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.014+0000 7f642ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64300afc60 0x7f64300c8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:27.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.014+0000 7f642ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64300afc60 0x7f64300c8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50170/0 (socket says 172.21.15.60:50170) 2024-09-12T02:23:27.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.014+0000 7f642ffff640 1 -- 172.21.15.60:0/2922952765 learned_addr learned my addr 172.21.15.60:0/2922952765 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:27.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.015+0000 7f6434ead640 1 --2- 172.21.15.60:0/2922952765 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6430072ec0 0x7f64301efd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:27.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.015+0000 7f642ffff640 1 -- 172.21.15.60:0/2922952765 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6430072ec0 msgr2=0x7f64301efd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:27.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.015+0000 7f642ffff640 1 --2- 172.21.15.60:0/2922952765 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6430072ec0 0x7f64301efd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:27.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.015+0000 7f64356ae640 1 --2- 172.21.15.60:0/2922952765 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64300c4ac0 0x7f6430141430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:27.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.015+0000 7f642ffff640 1 -- 172.21.15.60:0/2922952765 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64300c4ac0 msgr2=0x7f6430141430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:27.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.015+0000 7f642ffff640 1 --2- 172.21.15.60:0/2922952765 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64300c4ac0 0x7f6430141430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:27.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.015+0000 7f642ffff640 1 -- 172.21.15.60:0/2922952765 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f643006d680 con 0x7f64300afc60 2024-09-12T02:23:27.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.015+0000 7f642ffff640 1 --2- 172.21.15.60:0/2922952765 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64300afc60 0x7f64300c8e40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f641800ba80 tx=0x7f641800bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:27.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.015+0000 7f642d7fa640 1 -- 172.21.15.60:0/2922952765 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6418019070 con 0x7f64300afc60 2024-09-12T02:23:27.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.015+0000 7f642d7fa640 1 -- 172.21.15.60:0/2922952765 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f641800cc90 con 0x7f64300afc60 2024-09-12T02:23:27.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.015+0000 7f642d7fa640 1 -- 172.21.15.60:0/2922952765 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6418014680 con 0x7f64300afc60 2024-09-12T02:23:27.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.015+0000 7f6437111640 1 -- 172.21.15.60:0/2922952765 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f643006d960 con 0x7f64300afc60 2024-09-12T02:23:27.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.015+0000 7f6437111640 1 -- 172.21.15.60:0/2922952765 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64300c9380 con 0x7f64300afc60 2024-09-12T02:23:27.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.016+0000 7f6437111640 1 -- 172.21.15.60:0/2922952765 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64300732a0 con 0x7f64300afc60 2024-09-12T02:23:27.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.017+0000 7f642d7fa640 1 -- 172.21.15.60:0/2922952765 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f641801c070 con 0x7f64300afc60 2024-09-12T02:23:27.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.017+0000 7f642d7fa640 1 --2- 172.21.15.60:0/2922952765 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f641006be30 0x7f641006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:27.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.017+0000 7f642d7fa640 1 -- 172.21.15.60:0/2922952765 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f641808af20 con 0x7f64300afc60 2024-09-12T02:23:27.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.017+0000 7f6434ead640 1 --2- 172.21.15.60:0/2922952765 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f641006be30 0x7f641006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:27.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.018+0000 7f6434ead640 1 --2- 172.21.15.60:0/2922952765 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f641006be30 0x7f641006e2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f642000a810 tx=0x7f6420008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:27.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.022+0000 7f642d7fa640 1 -- 172.21.15.60:0/2922952765 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6418059630 con 0x7f64300afc60 2024-09-12T02:23:27.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.193+0000 7f6437111640 1 -- 172.21.15.60:0/2922952765 --> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f64300c6180 con 0x7f641006be30 2024-09-12T02:23:27.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.204+0000 7f642d7fa640 1 -- 172.21.15.60:0/2922952765 <== mgr.4098 v2:172.21.15.60:6800/3549430091 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490307 (secure 0 0 0) 0x7f64300c6180 con 0x7f641006be30 2024-09-12T02:23:27.210 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:23:27.213 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T02:23:27.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.209+0000 7f6437111640 1 -- 172.21.15.60:0/2922952765 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f641006be30 msgr2=0x7f641006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:27.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.209+0000 7f6437111640 1 --2- 172.21.15.60:0/2922952765 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f641006be30 0x7f641006e2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f642000a810 tx=0x7f6420008040 comp rx=0 tx=0).stop 2024-09-12T02:23:27.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.209+0000 7f6437111640 1 -- 172.21.15.60:0/2922952765 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64300afc60 msgr2=0x7f64300c8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:27.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.209+0000 7f6437111640 1 --2- 172.21.15.60:0/2922952765 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64300afc60 0x7f64300c8e40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f641800ba80 tx=0x7f641800bf40 comp rx=0 tx=0).stop 2024-09-12T02:23:27.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.209+0000 7f6437111640 1 -- 172.21.15.60:0/2922952765 shutdown_connections 2024-09-12T02:23:27.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.209+0000 7f6437111640 1 --2- 172.21.15.60:0/2922952765 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f641006be30 0x7f641006e2f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:27.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.209+0000 7f6437111640 1 --2- 172.21.15.60:0/2922952765 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64300c4ac0 0x7f6430141430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:27.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.209+0000 7f6437111640 1 --2- 172.21.15.60:0/2922952765 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64300afc60 0x7f64300c8e40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:27.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.209+0000 7f6437111640 1 --2- 172.21.15.60:0/2922952765 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6430072ec0 0x7f64301efd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:27.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.209+0000 7f6437111640 1 -- 172.21.15.60:0/2922952765 >> 172.21.15.60:0/2922952765 conn(0x7f64300c9d80 msgr2=0x7f6430152270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:27.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.209+0000 7f6437111640 1 -- 172.21.15.60:0/2922952765 shutdown_connections 2024-09-12T02:23:27.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.209+0000 7f6437111640 1 -- 172.21.15.60:0/2922952765 wait complete. 2024-09-12T02:23:27.220 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-09-12T02:23:26.091255+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595188,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":249,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252880,"kb_used_data":3368,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754721840,"statfs":{"total":773094113280,"available":772835164160,"internally_reserved":0,"allocated":3448832,"data_stored":2026528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.265683"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840458+0000","last_change":"2024-09-12T02:23:16.851521+0000","last_active":"2024-09-12T02:23:17.840458+0000","last_peered":"2024-09-12T02:23:17.840458+0000","last_clean":"2024-09-12T02:23:17.840458+0000","last_became_active":"2024-09-12T02:23:16.851220+0000","last_became_peered":"2024-09-12T02:23:16.851220+0000","last_unstale":"2024-09-12T02:23:17.840458+0000","last_undegraded":"2024-09-12T02:23:17.840458+0000","last_fullsized":"2024-09-12T02:23:17.840458+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:28.680072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331964+0000","last_change":"2024-09-12T02:23:03.757848+0000","last_active":"2024-09-12T02:23:18.331964+0000","last_peered":"2024-09-12T02:23:18.331964+0000","last_clean":"2024-09-12T02:23:18.331964+0000","last_became_active":"2024-09-12T02:23:03.757544+0000","last_became_peered":"2024-09-12T02:23:03.757544+0000","last_unstale":"2024-09-12T02:23:18.331964+0000","last_undegraded":"2024-09-12T02:23:18.331964+0000","last_fullsized":"2024-09-12T02:23:18.331964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:43.576128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840084+0000","last_change":"2024-09-12T02:23:04.790549+0000","last_active":"2024-09-12T02:23:17.840084+0000","last_peered":"2024-09-12T02:23:17.840084+0000","last_clean":"2024-09-12T02:23:17.840084+0000","last_became_active":"2024-09-12T02:23:04.790187+0000","last_became_peered":"2024-09-12T02:23:04.790187+0000","last_unstale":"2024-09-12T02:23:17.840084+0000","last_undegraded":"2024-09-12T02:23:17.840084+0000","last_fullsized":"2024-09-12T02:23:17.840084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:49.656395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.838950+0000","last_change":"2024-09-12T02:23:15.829383+0000","last_active":"2024-09-12T02:23:17.838950+0000","last_peered":"2024-09-12T02:23:17.838950+0000","last_clean":"2024-09-12T02:23:17.838950+0000","last_became_active":"2024-09-12T02:23:15.828295+0000","last_became_peered":"2024-09-12T02:23:15.828295+0000","last_unstale":"2024-09-12T02:23:17.838950+0000","last_undegraded":"2024-09-12T02:23:17.838950+0000","last_fullsized":"2024-09-12T02:23:17.838950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:13.217846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444073+0000","last_change":"2024-09-12T02:23:16.853675+0000","last_active":"2024-09-12T02:23:18.444073+0000","last_peered":"2024-09-12T02:23:18.444073+0000","last_clean":"2024-09-12T02:23:18.444073+0000","last_became_active":"2024-09-12T02:23:16.853371+0000","last_became_peered":"2024-09-12T02:23:16.853371+0000","last_unstale":"2024-09-12T02:23:18.444073+0000","last_undegraded":"2024-09-12T02:23:18.444073+0000","last_fullsized":"2024-09-12T02:23:18.444073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:10.323501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840125+0000","last_change":"2024-09-12T02:23:03.767076+0000","last_active":"2024-09-12T02:23:17.840125+0000","last_peered":"2024-09-12T02:23:17.840125+0000","last_clean":"2024-09-12T02:23:17.840125+0000","last_became_active":"2024-09-12T02:23:03.766686+0000","last_became_peered":"2024-09-12T02:23:03.766686+0000","last_unstale":"2024-09-12T02:23:17.840125+0000","last_undegraded":"2024-09-12T02:23:17.840125+0000","last_fullsized":"2024-09-12T02:23:17.840125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:45.706208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331882+0000","last_change":"2024-09-12T02:23:04.782108+0000","last_active":"2024-09-12T02:23:18.331882+0000","last_peered":"2024-09-12T02:23:18.331882+0000","last_clean":"2024-09-12T02:23:18.331882+0000","last_became_active":"2024-09-12T02:23:04.781829+0000","last_became_peered":"2024-09-12T02:23:04.781829+0000","last_unstale":"2024-09-12T02:23:18.331882+0000","last_undegraded":"2024-09-12T02:23:18.331882+0000","last_fullsized":"2024-09-12T02:23:18.331882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:07:33.165742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840554+0000","last_change":"2024-09-12T02:23:15.828697+0000","last_active":"2024-09-12T02:23:17.840554+0000","last_peered":"2024-09-12T02:23:17.840554+0000","last_clean":"2024-09-12T02:23:17.840554+0000","last_became_active":"2024-09-12T02:23:15.828317+0000","last_became_peered":"2024-09-12T02:23:15.828317+0000","last_unstale":"2024-09-12T02:23:17.840554+0000","last_undegraded":"2024-09-12T02:23:17.840554+0000","last_fullsized":"2024-09-12T02:23:17.840554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:55.347515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840938+0000","last_change":"2024-09-12T02:23:16.856209+0000","last_active":"2024-09-12T02:23:17.840938+0000","last_peered":"2024-09-12T02:23:17.840938+0000","last_clean":"2024-09-12T02:23:17.840938+0000","last_became_active":"2024-09-12T02:23:16.855874+0000","last_became_peered":"2024-09-12T02:23:16.855874+0000","last_unstale":"2024-09-12T02:23:17.840938+0000","last_undegraded":"2024-09-12T02:23:17.840938+0000","last_fullsized":"2024-09-12T02:23:17.840938+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:44.299638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842447+0000","last_change":"2024-09-12T02:23:03.767875+0000","last_active":"2024-09-12T02:23:17.842447+0000","last_peered":"2024-09-12T02:23:17.842447+0000","last_clean":"2024-09-12T02:23:17.842447+0000","last_became_active":"2024-09-12T02:23:03.767596+0000","last_became_peered":"2024-09-12T02:23:03.767596+0000","last_unstale":"2024-09-12T02:23:17.842447+0000","last_undegraded":"2024-09-12T02:23:17.842447+0000","last_fullsized":"2024-09-12T02:23:17.842447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:22.605725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325618+0000","last_change":"2024-09-12T02:23:04.791903+0000","last_active":"2024-09-12T02:23:18.325618+0000","last_peered":"2024-09-12T02:23:18.325618+0000","last_clean":"2024-09-12T02:23:18.325618+0000","last_became_active":"2024-09-12T02:23:04.791635+0000","last_became_peered":"2024-09-12T02:23:04.791635+0000","last_unstale":"2024-09-12T02:23:18.325618+0000","last_undegraded":"2024-09-12T02:23:18.325618+0000","last_fullsized":"2024-09-12T02:23:18.325618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:08.192088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841943+0000","last_change":"2024-09-12T02:23:15.833369+0000","last_active":"2024-09-12T02:23:17.841943+0000","last_peered":"2024-09-12T02:23:17.841943+0000","last_clean":"2024-09-12T02:23:17.841943+0000","last_became_active":"2024-09-12T02:23:15.833010+0000","last_became_peered":"2024-09-12T02:23:15.833010+0000","last_unstale":"2024-09-12T02:23:17.841943+0000","last_undegraded":"2024-09-12T02:23:17.841943+0000","last_fullsized":"2024-09-12T02:23:17.841943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:51.465462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325378+0000","last_change":"2024-09-12T02:23:16.853013+0000","last_active":"2024-09-12T02:23:18.325378+0000","last_peered":"2024-09-12T02:23:18.325378+0000","last_clean":"2024-09-12T02:23:18.325378+0000","last_became_active":"2024-09-12T02:23:16.852698+0000","last_became_peered":"2024-09-12T02:23:16.852698+0000","last_unstale":"2024-09-12T02:23:18.325378+0000","last_undegraded":"2024-09-12T02:23:18.325378+0000","last_fullsized":"2024-09-12T02:23:18.325378+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:11.709531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842467+0000","last_change":"2024-09-12T02:23:03.763480+0000","last_active":"2024-09-12T02:23:17.842467+0000","last_peered":"2024-09-12T02:23:17.842467+0000","last_clean":"2024-09-12T02:23:17.842467+0000","last_became_active":"2024-09-12T02:23:03.762464+0000","last_became_peered":"2024-09-12T02:23:03.762464+0000","last_unstale":"2024-09-12T02:23:17.842467+0000","last_undegraded":"2024-09-12T02:23:17.842467+0000","last_fullsized":"2024-09-12T02:23:17.842467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:24.308289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325931+0000","last_change":"2024-09-12T02:23:04.791109+0000","last_active":"2024-09-12T02:23:18.325931+0000","last_peered":"2024-09-12T02:23:18.325931+0000","last_clean":"2024-09-12T02:23:18.325931+0000","last_became_active":"2024-09-12T02:23:04.790201+0000","last_became_peered":"2024-09-12T02:23:04.790201+0000","last_unstale":"2024-09-12T02:23:18.325931+0000","last_undegraded":"2024-09-12T02:23:18.325931+0000","last_fullsized":"2024-09-12T02:23:18.325931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:13.166139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840837+0000","last_change":"2024-09-12T02:23:15.834261+0000","last_active":"2024-09-12T02:23:17.840837+0000","last_peered":"2024-09-12T02:23:17.840837+0000","last_clean":"2024-09-12T02:23:17.840837+0000","last_became_active":"2024-09-12T02:23:15.833982+0000","last_became_peered":"2024-09-12T02:23:15.833982+0000","last_unstale":"2024-09-12T02:23:17.840837+0000","last_undegraded":"2024-09-12T02:23:17.840837+0000","last_fullsized":"2024-09-12T02:23:17.840837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:04.987961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444359+0000","last_change":"2024-09-12T02:23:16.861432+0000","last_active":"2024-09-12T02:23:18.444359+0000","last_peered":"2024-09-12T02:23:18.444359+0000","last_clean":"2024-09-12T02:23:18.444359+0000","last_became_active":"2024-09-12T02:23:16.861003+0000","last_became_peered":"2024-09-12T02:23:16.861003+0000","last_unstale":"2024-09-12T02:23:18.444359+0000","last_undegraded":"2024-09-12T02:23:18.444359+0000","last_fullsized":"2024-09-12T02:23:18.444359+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:01.777500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597613+0000","last_change":"2024-09-12T02:23:04.788754+0000","last_active":"2024-09-12T02:23:19.597613+0000","last_peered":"2024-09-12T02:23:19.597613+0000","last_clean":"2024-09-12T02:23:19.597613+0000","last_became_active":"2024-09-12T02:23:04.788350+0000","last_became_peered":"2024-09-12T02:23:04.788350+0000","last_unstale":"2024-09-12T02:23:19.597613+0000","last_undegraded":"2024-09-12T02:23:19.597613+0000","last_fullsized":"2024-09-12T02:23:19.597613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:08.192088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841873+0000","last_change":"2024-09-12T02:23:03.763423+0000","last_active":"2024-09-12T02:23:17.841873+0000","last_peered":"2024-09-12T02:23:17.841873+0000","last_clean":"2024-09-12T02:23:17.841873+0000","last_became_active":"2024-09-12T02:23:03.762627+0000","last_became_peered":"2024-09-12T02:23:03.762627+0000","last_unstale":"2024-09-12T02:23:17.841873+0000","last_undegraded":"2024-09-12T02:23:17.841873+0000","last_fullsized":"2024-09-12T02:23:17.841873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:18.090657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841725+0000","last_change":"2024-09-12T02:23:15.831604+0000","last_active":"2024-09-12T02:23:17.841725+0000","last_peered":"2024-09-12T02:23:17.841725+0000","last_clean":"2024-09-12T02:23:17.841725+0000","last_became_active":"2024-09-12T02:23:15.831292+0000","last_became_peered":"2024-09-12T02:23:15.831292+0000","last_unstale":"2024-09-12T02:23:17.841725+0000","last_undegraded":"2024-09-12T02:23:17.841725+0000","last_fullsized":"2024-09-12T02:23:17.841725+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:30.234721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673393+0000","last_change":"2024-09-12T02:23:16.842506+0000","last_active":"2024-09-12T02:23:18.673393+0000","last_peered":"2024-09-12T02:23:18.673393+0000","last_clean":"2024-09-12T02:23:18.673393+0000","last_became_active":"2024-09-12T02:23:16.842210+0000","last_became_peered":"2024-09-12T02:23:16.842210+0000","last_unstale":"2024-09-12T02:23:18.673393+0000","last_undegraded":"2024-09-12T02:23:18.673393+0000","last_fullsized":"2024-09-12T02:23:18.673393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:52.806704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839230+0000","last_change":"2024-09-12T02:23:04.782769+0000","last_active":"2024-09-12T02:23:17.839230+0000","last_peered":"2024-09-12T02:23:17.839230+0000","last_clean":"2024-09-12T02:23:17.839230+0000","last_became_active":"2024-09-12T02:23:04.782472+0000","last_became_peered":"2024-09-12T02:23:04.782472+0000","last_unstale":"2024-09-12T02:23:17.839230+0000","last_undegraded":"2024-09-12T02:23:17.839230+0000","last_fullsized":"2024-09-12T02:23:17.839230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:46.144471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444704+0000","last_change":"2024-09-12T02:23:03.771468+0000","last_active":"2024-09-12T02:23:18.444704+0000","last_peered":"2024-09-12T02:23:18.444704+0000","last_clean":"2024-09-12T02:23:18.444704+0000","last_became_active":"2024-09-12T02:23:03.769619+0000","last_became_peered":"2024-09-12T02:23:03.769619+0000","last_unstale":"2024-09-12T02:23:18.444704+0000","last_undegraded":"2024-09-12T02:23:18.444704+0000","last_fullsized":"2024-09-12T02:23:18.444704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:38.422369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841394+0000","last_change":"2024-09-12T02:23:15.833359+0000","last_active":"2024-09-12T02:23:17.841394+0000","last_peered":"2024-09-12T02:23:17.841394+0000","last_clean":"2024-09-12T02:23:17.841394+0000","last_became_active":"2024-09-12T02:23:15.832995+0000","last_became_peered":"2024-09-12T02:23:15.832995+0000","last_unstale":"2024-09-12T02:23:17.841394+0000","last_undegraded":"2024-09-12T02:23:17.841394+0000","last_fullsized":"2024-09-12T02:23:17.841394+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:57.922845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841919+0000","last_change":"2024-09-12T02:23:16.856439+0000","last_active":"2024-09-12T02:23:17.841919+0000","last_peered":"2024-09-12T02:23:17.841919+0000","last_clean":"2024-09-12T02:23:17.841919+0000","last_became_active":"2024-09-12T02:23:16.856166+0000","last_became_peered":"2024-09-12T02:23:16.856166+0000","last_unstale":"2024-09-12T02:23:17.841919+0000","last_undegraded":"2024-09-12T02:23:17.841919+0000","last_fullsized":"2024-09-12T02:23:17.841919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:42:56.534517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839424+0000","last_change":"2024-09-12T02:23:04.783991+0000","last_active":"2024-09-12T02:23:17.839424+0000","last_peered":"2024-09-12T02:23:17.839424+0000","last_clean":"2024-09-12T02:23:17.839424+0000","last_became_active":"2024-09-12T02:23:04.783143+0000","last_became_peered":"2024-09-12T02:23:04.783143+0000","last_unstale":"2024-09-12T02:23:17.839424+0000","last_undegraded":"2024-09-12T02:23:17.839424+0000","last_fullsized":"2024-09-12T02:23:17.839424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:53.940843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444206+0000","last_change":"2024-09-12T02:23:03.770581+0000","last_active":"2024-09-12T02:23:18.444206+0000","last_peered":"2024-09-12T02:23:18.444206+0000","last_clean":"2024-09-12T02:23:18.444206+0000","last_became_active":"2024-09-12T02:23:03.769406+0000","last_became_peered":"2024-09-12T02:23:03.769406+0000","last_unstale":"2024-09-12T02:23:18.444206+0000","last_undegraded":"2024-09-12T02:23:18.444206+0000","last_fullsized":"2024-09-12T02:23:18.444206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:20.963819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444698+0000","last_change":"2024-09-12T02:23:15.835033+0000","last_active":"2024-09-12T02:23:18.444698+0000","last_peered":"2024-09-12T02:23:18.444698+0000","last_clean":"2024-09-12T02:23:18.444698+0000","last_became_active":"2024-09-12T02:23:15.834753+0000","last_became_peered":"2024-09-12T02:23:15.834753+0000","last_unstale":"2024-09-12T02:23:18.444698+0000","last_undegraded":"2024-09-12T02:23:18.444698+0000","last_fullsized":"2024-09-12T02:23:18.444698+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:57.434162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.326093+0000","last_change":"2024-09-12T02:23:16.860867+0000","last_active":"2024-09-12T02:23:18.326093+0000","last_peered":"2024-09-12T02:23:18.326093+0000","last_clean":"2024-09-12T02:23:18.326093+0000","last_became_active":"2024-09-12T02:23:16.860656+0000","last_became_peered":"2024-09-12T02:23:16.860656+0000","last_unstale":"2024-09-12T02:23:18.326093+0000","last_undegraded":"2024-09-12T02:23:18.326093+0000","last_fullsized":"2024-09-12T02:23:18.326093+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:11.375287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842133+0000","last_change":"2024-09-12T02:23:04.780821+0000","last_active":"2024-09-12T02:23:17.842133+0000","last_peered":"2024-09-12T02:23:17.842133+0000","last_clean":"2024-09-12T02:23:17.842133+0000","last_became_active":"2024-09-12T02:23:04.779984+0000","last_became_peered":"2024-09-12T02:23:04.779984+0000","last_unstale":"2024-09-12T02:23:17.842133+0000","last_undegraded":"2024-09-12T02:23:17.842133+0000","last_fullsized":"2024-09-12T02:23:17.842133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:25.724116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841013+0000","last_change":"2024-09-12T02:23:03.764530+0000","last_active":"2024-09-12T02:23:17.841013+0000","last_peered":"2024-09-12T02:23:17.841013+0000","last_clean":"2024-09-12T02:23:17.841013+0000","last_became_active":"2024-09-12T02:23:03.764218+0000","last_became_peered":"2024-09-12T02:23:03.764218+0000","last_unstale":"2024-09-12T02:23:17.841013+0000","last_undegraded":"2024-09-12T02:23:17.841013+0000","last_fullsized":"2024-09-12T02:23:17.841013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:55.445619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842053+0000","last_change":"2024-09-12T02:23:15.831621+0000","last_active":"2024-09-12T02:23:17.842053+0000","last_peered":"2024-09-12T02:23:17.842053+0000","last_clean":"2024-09-12T02:23:17.842053+0000","last_became_active":"2024-09-12T02:23:15.831331+0000","last_became_peered":"2024-09-12T02:23:15.831331+0000","last_unstale":"2024-09-12T02:23:17.842053+0000","last_undegraded":"2024-09-12T02:23:17.842053+0000","last_fullsized":"2024-09-12T02:23:17.842053+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:06.494392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.838770+0000","last_change":"2024-09-12T02:23:16.847556+0000","last_active":"2024-09-12T02:23:17.838770+0000","last_peered":"2024-09-12T02:23:17.838770+0000","last_clean":"2024-09-12T02:23:17.838770+0000","last_became_active":"2024-09-12T02:23:16.845749+0000","last_became_peered":"2024-09-12T02:23:16.845749+0000","last_unstale":"2024-09-12T02:23:17.838770+0000","last_undegraded":"2024-09-12T02:23:17.838770+0000","last_fullsized":"2024-09-12T02:23:17.838770+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:39.542842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.332030+0000","last_change":"2024-09-12T02:23:04.786895+0000","last_active":"2024-09-12T02:23:18.332030+0000","last_peered":"2024-09-12T02:23:18.332030+0000","last_clean":"2024-09-12T02:23:18.332030+0000","last_became_active":"2024-09-12T02:23:04.786591+0000","last_became_peered":"2024-09-12T02:23:04.786591+0000","last_unstale":"2024-09-12T02:23:18.332030+0000","last_undegraded":"2024-09-12T02:23:18.332030+0000","last_fullsized":"2024-09-12T02:23:18.332030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:14.751707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.598264+0000","last_change":"2024-09-12T02:23:03.771259+0000","last_active":"2024-09-12T02:23:19.598264+0000","last_peered":"2024-09-12T02:23:19.598264+0000","last_clean":"2024-09-12T02:23:19.598264+0000","last_became_active":"2024-09-12T02:23:03.770687+0000","last_became_peered":"2024-09-12T02:23:03.770687+0000","last_unstale":"2024-09-12T02:23:19.598264+0000","last_undegraded":"2024-09-12T02:23:19.598264+0000","last_fullsized":"2024-09-12T02:23:19.598264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:38.516959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841319+0000","last_change":"2024-09-12T02:23:15.829406+0000","last_active":"2024-09-12T02:23:17.841319+0000","last_peered":"2024-09-12T02:23:17.841319+0000","last_clean":"2024-09-12T02:23:17.841319+0000","last_became_active":"2024-09-12T02:23:15.829135+0000","last_became_peered":"2024-09-12T02:23:15.829135+0000","last_unstale":"2024-09-12T02:23:17.841319+0000","last_undegraded":"2024-09-12T02:23:17.841319+0000","last_fullsized":"2024-09-12T02:23:17.841319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:22.365804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840867+0000","last_change":"2024-09-12T02:23:16.857016+0000","last_active":"2024-09-12T02:23:17.840867+0000","last_peered":"2024-09-12T02:23:17.840867+0000","last_clean":"2024-09-12T02:23:17.840867+0000","last_became_active":"2024-09-12T02:23:16.856705+0000","last_became_peered":"2024-09-12T02:23:16.856705+0000","last_unstale":"2024-09-12T02:23:17.840867+0000","last_undegraded":"2024-09-12T02:23:17.840867+0000","last_fullsized":"2024-09-12T02:23:17.840867+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:03.672668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840282+0000","last_change":"2024-09-12T02:23:04.786424+0000","last_active":"2024-09-12T02:23:17.840282+0000","last_peered":"2024-09-12T02:23:17.840282+0000","last_clean":"2024-09-12T02:23:17.840282+0000","last_became_active":"2024-09-12T02:23:04.786136+0000","last_became_peered":"2024-09-12T02:23:04.786136+0000","last_unstale":"2024-09-12T02:23:17.840282+0000","last_undegraded":"2024-09-12T02:23:17.840282+0000","last_fullsized":"2024-09-12T02:23:17.840282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:31.214894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444621+0000","last_change":"2024-09-12T02:23:03.769745+0000","last_active":"2024-09-12T02:23:18.444621+0000","last_peered":"2024-09-12T02:23:18.444621+0000","last_clean":"2024-09-12T02:23:18.444621+0000","last_became_active":"2024-09-12T02:23:03.769410+0000","last_became_peered":"2024-09-12T02:23:03.769410+0000","last_unstale":"2024-09-12T02:23:18.444621+0000","last_undegraded":"2024-09-12T02:23:18.444621+0000","last_fullsized":"2024-09-12T02:23:18.444621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:00.414459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.838725+0000","last_change":"2024-09-12T02:23:15.827211+0000","last_active":"2024-09-12T02:23:17.838725+0000","last_peered":"2024-09-12T02:23:17.838725+0000","last_clean":"2024-09-12T02:23:17.838725+0000","last_became_active":"2024-09-12T02:23:15.826564+0000","last_became_peered":"2024-09-12T02:23:15.826564+0000","last_unstale":"2024-09-12T02:23:17.838725+0000","last_undegraded":"2024-09-12T02:23:17.838725+0000","last_fullsized":"2024-09-12T02:23:17.838725+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:32.389443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597488+0000","last_change":"2024-09-12T02:23:16.837434+0000","last_active":"2024-09-12T02:23:19.597488+0000","last_peered":"2024-09-12T02:23:19.597488+0000","last_clean":"2024-09-12T02:23:19.597488+0000","last_became_active":"2024-09-12T02:23:16.837162+0000","last_became_peered":"2024-09-12T02:23:16.837162+0000","last_unstale":"2024-09-12T02:23:19.597488+0000","last_undegraded":"2024-09-12T02:23:19.597488+0000","last_fullsized":"2024-09-12T02:23:19.597488+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:09.146064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444511+0000","last_change":"2024-09-12T02:23:04.775876+0000","last_active":"2024-09-12T02:23:18.444511+0000","last_peered":"2024-09-12T02:23:18.444511+0000","last_clean":"2024-09-12T02:23:18.444511+0000","last_became_active":"2024-09-12T02:23:04.775571+0000","last_became_peered":"2024-09-12T02:23:04.775571+0000","last_unstale":"2024-09-12T02:23:18.444511+0000","last_undegraded":"2024-09-12T02:23:18.444511+0000","last_fullsized":"2024-09-12T02:23:18.444511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:05.070528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842890+0000","last_change":"2024-09-12T02:23:03.764093+0000","last_active":"2024-09-12T02:23:17.842890+0000","last_peered":"2024-09-12T02:23:17.842890+0000","last_clean":"2024-09-12T02:23:17.842890+0000","last_became_active":"2024-09-12T02:23:03.763147+0000","last_became_peered":"2024-09-12T02:23:03.763147+0000","last_unstale":"2024-09-12T02:23:17.842890+0000","last_undegraded":"2024-09-12T02:23:17.842890+0000","last_fullsized":"2024-09-12T02:23:17.842890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:13.317894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331728+0000","last_change":"2024-09-12T02:23:15.832461+0000","last_active":"2024-09-12T02:23:18.331728+0000","last_peered":"2024-09-12T02:23:18.331728+0000","last_clean":"2024-09-12T02:23:18.331728+0000","last_became_active":"2024-09-12T02:23:15.831637+0000","last_became_peered":"2024-09-12T02:23:15.831637+0000","last_unstale":"2024-09-12T02:23:18.331728+0000","last_undegraded":"2024-09-12T02:23:18.331728+0000","last_fullsized":"2024-09-12T02:23:18.331728+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:30.909927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.332020+0000","last_change":"2024-09-12T02:23:16.835824+0000","last_active":"2024-09-12T02:23:18.332020+0000","last_peered":"2024-09-12T02:23:18.332020+0000","last_clean":"2024-09-12T02:23:18.332020+0000","last_became_active":"2024-09-12T02:23:16.835520+0000","last_became_peered":"2024-09-12T02:23:16.835520+0000","last_unstale":"2024-09-12T02:23:18.332020+0000","last_undegraded":"2024-09-12T02:23:18.332020+0000","last_fullsized":"2024-09-12T02:23:18.332020+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:32.797100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.326009+0000","last_change":"2024-09-12T02:23:04.787557+0000","last_active":"2024-09-12T02:23:18.326009+0000","last_peered":"2024-09-12T02:23:18.326009+0000","last_clean":"2024-09-12T02:23:18.326009+0000","last_became_active":"2024-09-12T02:23:04.786527+0000","last_became_peered":"2024-09-12T02:23:04.786527+0000","last_unstale":"2024-09-12T02:23:18.326009+0000","last_undegraded":"2024-09-12T02:23:18.326009+0000","last_fullsized":"2024-09-12T02:23:18.326009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:23.273457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444585+0000","last_change":"2024-09-12T02:23:03.769913+0000","last_active":"2024-09-12T02:23:18.444585+0000","last_peered":"2024-09-12T02:23:18.444585+0000","last_clean":"2024-09-12T02:23:18.444585+0000","last_became_active":"2024-09-12T02:23:03.769444+0000","last_became_peered":"2024-09-12T02:23:03.769444+0000","last_unstale":"2024-09-12T02:23:18.444585+0000","last_undegraded":"2024-09-12T02:23:18.444585+0000","last_fullsized":"2024-09-12T02:23:18.444585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:21.243182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444133+0000","last_change":"2024-09-12T02:23:15.829080+0000","last_active":"2024-09-12T02:23:18.444133+0000","last_peered":"2024-09-12T02:23:18.444133+0000","last_clean":"2024-09-12T02:23:18.444133+0000","last_became_active":"2024-09-12T02:23:15.828256+0000","last_became_peered":"2024-09-12T02:23:15.828256+0000","last_unstale":"2024-09-12T02:23:18.444133+0000","last_undegraded":"2024-09-12T02:23:18.444133+0000","last_fullsized":"2024-09-12T02:23:18.444133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:07.743952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331720+0000","last_change":"2024-09-12T02:23:16.845710+0000","last_active":"2024-09-12T02:23:18.331720+0000","last_peered":"2024-09-12T02:23:18.331720+0000","last_clean":"2024-09-12T02:23:18.331720+0000","last_became_active":"2024-09-12T02:23:16.845379+0000","last_became_peered":"2024-09-12T02:23:16.845379+0000","last_unstale":"2024-09-12T02:23:18.331720+0000","last_undegraded":"2024-09-12T02:23:18.331720+0000","last_fullsized":"2024-09-12T02:23:18.331720+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:16.769410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842948+0000","last_change":"2024-09-12T02:23:04.790723+0000","last_active":"2024-09-12T02:23:17.842948+0000","last_peered":"2024-09-12T02:23:17.842948+0000","last_clean":"2024-09-12T02:23:17.842948+0000","last_became_active":"2024-09-12T02:23:04.786877+0000","last_became_peered":"2024-09-12T02:23:04.786877+0000","last_unstale":"2024-09-12T02:23:17.842948+0000","last_undegraded":"2024-09-12T02:23:17.842948+0000","last_fullsized":"2024-09-12T02:23:17.842948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:48.516002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325581+0000","last_change":"2024-09-12T02:23:03.771518+0000","last_active":"2024-09-12T02:23:18.325581+0000","last_peered":"2024-09-12T02:23:18.325581+0000","last_clean":"2024-09-12T02:23:18.325581+0000","last_became_active":"2024-09-12T02:23:03.771063+0000","last_became_peered":"2024-09-12T02:23:03.771063+0000","last_unstale":"2024-09-12T02:23:18.325581+0000","last_undegraded":"2024-09-12T02:23:18.325581+0000","last_fullsized":"2024-09-12T02:23:18.325581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:43.974555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444509+0000","last_change":"2024-09-12T02:23:15.827028+0000","last_active":"2024-09-12T02:23:18.444509+0000","last_peered":"2024-09-12T02:23:18.444509+0000","last_clean":"2024-09-12T02:23:18.444509+0000","last_became_active":"2024-09-12T02:23:15.826708+0000","last_became_peered":"2024-09-12T02:23:15.826708+0000","last_unstale":"2024-09-12T02:23:18.444509+0000","last_undegraded":"2024-09-12T02:23:18.444509+0000","last_fullsized":"2024-09-12T02:23:18.444509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:34.642396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673336+0000","last_change":"2024-09-12T02:23:16.849429+0000","last_active":"2024-09-12T02:23:18.673336+0000","last_peered":"2024-09-12T02:23:18.673336+0000","last_clean":"2024-09-12T02:23:18.673336+0000","last_became_active":"2024-09-12T02:23:16.849119+0000","last_became_peered":"2024-09-12T02:23:16.849119+0000","last_unstale":"2024-09-12T02:23:18.673336+0000","last_undegraded":"2024-09-12T02:23:18.673336+0000","last_fullsized":"2024-09-12T02:23:18.673336+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:10.688619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444107+0000","last_change":"2024-09-12T02:23:04.773745+0000","last_active":"2024-09-12T02:23:18.444107+0000","last_peered":"2024-09-12T02:23:18.444107+0000","last_clean":"2024-09-12T02:23:18.444107+0000","last_became_active":"2024-09-12T02:23:04.773360+0000","last_became_peered":"2024-09-12T02:23:04.773360+0000","last_unstale":"2024-09-12T02:23:18.444107+0000","last_undegraded":"2024-09-12T02:23:18.444107+0000","last_fullsized":"2024-09-12T02:23:18.444107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:33.097774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673252+0000","last_change":"2024-09-12T02:23:03.760700+0000","last_active":"2024-09-12T02:23:18.673252+0000","last_peered":"2024-09-12T02:23:18.673252+0000","last_clean":"2024-09-12T02:23:18.673252+0000","last_became_active":"2024-09-12T02:23:03.760397+0000","last_became_peered":"2024-09-12T02:23:03.760397+0000","last_unstale":"2024-09-12T02:23:18.673252+0000","last_undegraded":"2024-09-12T02:23:18.673252+0000","last_fullsized":"2024-09-12T02:23:18.673252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:36.788864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444739+0000","last_change":"2024-09-12T02:23:15.828714+0000","last_active":"2024-09-12T02:23:18.444739+0000","last_peered":"2024-09-12T02:23:18.444739+0000","last_clean":"2024-09-12T02:23:18.444739+0000","last_became_active":"2024-09-12T02:23:15.827458+0000","last_became_peered":"2024-09-12T02:23:15.827458+0000","last_unstale":"2024-09-12T02:23:18.444739+0000","last_undegraded":"2024-09-12T02:23:18.444739+0000","last_fullsized":"2024-09-12T02:23:18.444739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:12.581897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.326108+0000","last_change":"2024-09-12T02:23:16.855212+0000","last_active":"2024-09-12T02:23:18.326108+0000","last_peered":"2024-09-12T02:23:18.326108+0000","last_clean":"2024-09-12T02:23:18.326108+0000","last_became_active":"2024-09-12T02:23:16.854938+0000","last_became_peered":"2024-09-12T02:23:16.854938+0000","last_unstale":"2024-09-12T02:23:18.326108+0000","last_undegraded":"2024-09-12T02:23:18.326108+0000","last_fullsized":"2024-09-12T02:23:18.326108+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:02.944057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331430+0000","last_change":"2024-09-12T02:23:04.787820+0000","last_active":"2024-09-12T02:23:18.331430+0000","last_peered":"2024-09-12T02:23:18.331430+0000","last_clean":"2024-09-12T02:23:18.331430+0000","last_became_active":"2024-09-12T02:23:04.787523+0000","last_became_peered":"2024-09-12T02:23:04.787523+0000","last_unstale":"2024-09-12T02:23:18.331430+0000","last_undegraded":"2024-09-12T02:23:18.331430+0000","last_fullsized":"2024-09-12T02:23:18.331430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:52.784171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841124+0000","last_change":"2024-09-12T02:23:03.771625+0000","last_active":"2024-09-12T02:23:17.841124+0000","last_peered":"2024-09-12T02:23:17.841124+0000","last_clean":"2024-09-12T02:23:17.841124+0000","last_became_active":"2024-09-12T02:23:03.771163+0000","last_became_peered":"2024-09-12T02:23:03.771163+0000","last_unstale":"2024-09-12T02:23:17.841124+0000","last_undegraded":"2024-09-12T02:23:17.841124+0000","last_fullsized":"2024-09-12T02:23:17.841124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:32.772569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.404274+0000","last_change":"2024-09-12T02:23:15.833889+0000","last_active":"2024-09-12T02:23:18.404274+0000","last_peered":"2024-09-12T02:23:18.404274+0000","last_clean":"2024-09-12T02:23:18.404274+0000","last_became_active":"2024-09-12T02:23:15.833587+0000","last_became_peered":"2024-09-12T02:23:15.833587+0000","last_unstale":"2024-09-12T02:23:18.404274+0000","last_undegraded":"2024-09-12T02:23:18.404274+0000","last_fullsized":"2024-09-12T02:23:18.404274+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:32.787861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842295+0000","last_change":"2024-09-12T02:23:16.848864+0000","last_active":"2024-09-12T02:23:17.842295+0000","last_peered":"2024-09-12T02:23:17.842295+0000","last_clean":"2024-09-12T02:23:17.842295+0000","last_became_active":"2024-09-12T02:23:16.848385+0000","last_became_peered":"2024-09-12T02:23:16.848385+0000","last_unstale":"2024-09-12T02:23:17.842295+0000","last_undegraded":"2024-09-12T02:23:17.842295+0000","last_fullsized":"2024-09-12T02:23:17.842295+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:03.656397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839490+0000","last_change":"2024-09-12T02:23:04.781839+0000","last_active":"2024-09-12T02:23:17.839490+0000","last_peered":"2024-09-12T02:23:17.839490+0000","last_clean":"2024-09-12T02:23:17.839490+0000","last_became_active":"2024-09-12T02:23:04.780984+0000","last_became_peered":"2024-09-12T02:23:04.780984+0000","last_unstale":"2024-09-12T02:23:17.839490+0000","last_undegraded":"2024-09-12T02:23:17.839490+0000","last_fullsized":"2024-09-12T02:23:17.839490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:07.692791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325299+0000","last_change":"2024-09-12T02:23:03.765100+0000","last_active":"2024-09-12T02:23:18.325299+0000","last_peered":"2024-09-12T02:23:18.325299+0000","last_clean":"2024-09-12T02:23:18.325299+0000","last_became_active":"2024-09-12T02:23:03.764801+0000","last_became_peered":"2024-09-12T02:23:03.764801+0000","last_unstale":"2024-09-12T02:23:18.325299+0000","last_undegraded":"2024-09-12T02:23:18.325299+0000","last_fullsized":"2024-09-12T02:23:18.325299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:06.891040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":178,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841644+0000","last_change":"2024-09-12T02:22:55.143869+0000","last_active":"2024-09-12T02:23:17.841644+0000","last_peered":"2024-09-12T02:23:17.841644+0000","last_clean":"2024-09-12T02:23:17.841644+0000","last_became_active":"2024-09-12T02:22:55.142784+0000","last_became_peered":"2024-09-12T02:22:55.142784+0000","last_unstale":"2024-09-12T02:23:17.841644+0000","last_undegraded":"2024-09-12T02:23:17.841644+0000","last_fullsized":"2024-09-12T02:23:17.841644+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:22:52.457979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:22:52.457979+0000","last_clean_scrub_stamp":"2024-09-12T02:22:52.457979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:46.152602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597751+0000","last_change":"2024-09-12T02:23:15.831362+0000","last_active":"2024-09-12T02:23:19.597751+0000","last_peered":"2024-09-12T02:23:19.597751+0000","last_clean":"2024-09-12T02:23:19.597751+0000","last_became_active":"2024-09-12T02:23:15.831084+0000","last_became_peered":"2024-09-12T02:23:15.831084+0000","last_unstale":"2024-09-12T02:23:19.597751+0000","last_undegraded":"2024-09-12T02:23:19.597751+0000","last_fullsized":"2024-09-12T02:23:19.597751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:17.754173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673475+0000","last_change":"2024-09-12T02:23:16.838831+0000","last_active":"2024-09-12T02:23:18.673475+0000","last_peered":"2024-09-12T02:23:18.673475+0000","last_clean":"2024-09-12T02:23:18.673475+0000","last_became_active":"2024-09-12T02:23:16.838523+0000","last_became_peered":"2024-09-12T02:23:16.838523+0000","last_unstale":"2024-09-12T02:23:18.673475+0000","last_undegraded":"2024-09-12T02:23:18.673475+0000","last_fullsized":"2024-09-12T02:23:18.673475+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:35:42.088332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842398+0000","last_change":"2024-09-12T02:23:04.783483+0000","last_active":"2024-09-12T02:23:17.842398+0000","last_peered":"2024-09-12T02:23:17.842398+0000","last_clean":"2024-09-12T02:23:17.842398+0000","last_became_active":"2024-09-12T02:23:04.782878+0000","last_became_peered":"2024-09-12T02:23:04.782878+0000","last_unstale":"2024-09-12T02:23:17.842398+0000","last_undegraded":"2024-09-12T02:23:17.842398+0000","last_fullsized":"2024-09-12T02:23:17.842398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:52.335065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673508+0000","last_change":"2024-09-12T02:23:03.762507+0000","last_active":"2024-09-12T02:23:18.673508+0000","last_peered":"2024-09-12T02:23:18.673508+0000","last_clean":"2024-09-12T02:23:18.673508+0000","last_became_active":"2024-09-12T02:23:03.762164+0000","last_became_peered":"2024-09-12T02:23:03.762164+0000","last_unstale":"2024-09-12T02:23:18.673508+0000","last_undegraded":"2024-09-12T02:23:18.673508+0000","last_fullsized":"2024-09-12T02:23:18.673508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:34.569630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597483+0000","last_change":"2024-09-12T02:23:15.830783+0000","last_active":"2024-09-12T02:23:19.597483+0000","last_peered":"2024-09-12T02:23:19.597483+0000","last_clean":"2024-09-12T02:23:19.597483+0000","last_became_active":"2024-09-12T02:23:15.830471+0000","last_became_peered":"2024-09-12T02:23:15.830471+0000","last_unstale":"2024-09-12T02:23:19.597483+0000","last_undegraded":"2024-09-12T02:23:19.597483+0000","last_fullsized":"2024-09-12T02:23:19.597483+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:22.927201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673175+0000","last_change":"2024-09-12T02:23:16.856328+0000","last_active":"2024-09-12T02:23:18.673175+0000","last_peered":"2024-09-12T02:23:18.673175+0000","last_clean":"2024-09-12T02:23:18.673175+0000","last_became_active":"2024-09-12T02:23:16.855992+0000","last_became_peered":"2024-09-12T02:23:16.855992+0000","last_unstale":"2024-09-12T02:23:18.673175+0000","last_undegraded":"2024-09-12T02:23:18.673175+0000","last_fullsized":"2024-09-12T02:23:18.673175+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:47.682103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325763+0000","last_change":"2024-09-12T02:23:04.784318+0000","last_active":"2024-09-12T02:23:18.325763+0000","last_peered":"2024-09-12T02:23:18.325763+0000","last_clean":"2024-09-12T02:23:18.325763+0000","last_became_active":"2024-09-12T02:23:04.784012+0000","last_became_peered":"2024-09-12T02:23:04.784012+0000","last_unstale":"2024-09-12T02:23:18.325763+0000","last_undegraded":"2024-09-12T02:23:18.325763+0000","last_fullsized":"2024-09-12T02:23:18.325763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:51.352859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444936+0000","last_change":"2024-09-12T02:23:03.766034+0000","last_active":"2024-09-12T02:23:18.444936+0000","last_peered":"2024-09-12T02:23:18.444936+0000","last_clean":"2024-09-12T02:23:18.444936+0000","last_became_active":"2024-09-12T02:23:03.765735+0000","last_became_peered":"2024-09-12T02:23:03.765735+0000","last_unstale":"2024-09-12T02:23:18.444936+0000","last_undegraded":"2024-09-12T02:23:18.444936+0000","last_fullsized":"2024-09-12T02:23:18.444936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:19.691229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331594+0000","last_change":"2024-09-12T02:23:15.832527+0000","last_active":"2024-09-12T02:23:18.331594+0000","last_peered":"2024-09-12T02:23:18.331594+0000","last_clean":"2024-09-12T02:23:18.331594+0000","last_became_active":"2024-09-12T02:23:15.832184+0000","last_became_peered":"2024-09-12T02:23:15.832184+0000","last_unstale":"2024-09-12T02:23:18.331594+0000","last_undegraded":"2024-09-12T02:23:18.331594+0000","last_fullsized":"2024-09-12T02:23:18.331594+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:29.131198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840742+0000","last_change":"2024-09-12T02:23:16.849357+0000","last_active":"2024-09-12T02:23:17.840742+0000","last_peered":"2024-09-12T02:23:17.840742+0000","last_clean":"2024-09-12T02:23:17.840742+0000","last_became_active":"2024-09-12T02:23:16.849067+0000","last_became_peered":"2024-09-12T02:23:16.849067+0000","last_unstale":"2024-09-12T02:23:17.840742+0000","last_undegraded":"2024-09-12T02:23:17.840742+0000","last_fullsized":"2024-09-12T02:23:17.840742+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:06.887523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.843122+0000","last_change":"2024-09-12T02:23:04.791152+0000","last_active":"2024-09-12T02:23:17.843122+0000","last_peered":"2024-09-12T02:23:17.843122+0000","last_clean":"2024-09-12T02:23:17.843122+0000","last_became_active":"2024-09-12T02:23:04.790707+0000","last_became_peered":"2024-09-12T02:23:04.790707+0000","last_unstale":"2024-09-12T02:23:17.843122+0000","last_undegraded":"2024-09-12T02:23:17.843122+0000","last_fullsized":"2024-09-12T02:23:17.843122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:42.798507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673465+0000","last_change":"2024-09-12T02:23:03.763327+0000","last_active":"2024-09-12T02:23:18.673465+0000","last_peered":"2024-09-12T02:23:18.673465+0000","last_clean":"2024-09-12T02:23:18.673465+0000","last_became_active":"2024-09-12T02:23:03.763005+0000","last_became_peered":"2024-09-12T02:23:03.763005+0000","last_unstale":"2024-09-12T02:23:18.673465+0000","last_undegraded":"2024-09-12T02:23:18.673465+0000","last_fullsized":"2024-09-12T02:23:18.673465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:09.500459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325022+0000","last_change":"2024-09-12T02:23:15.819644+0000","last_active":"2024-09-12T02:23:18.325022+0000","last_peered":"2024-09-12T02:23:18.325022+0000","last_clean":"2024-09-12T02:23:18.325022+0000","last_became_active":"2024-09-12T02:23:15.819370+0000","last_became_peered":"2024-09-12T02:23:15.819370+0000","last_unstale":"2024-09-12T02:23:18.325022+0000","last_undegraded":"2024-09-12T02:23:18.325022+0000","last_fullsized":"2024-09-12T02:23:18.325022+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:56.384531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673028+0000","last_change":"2024-09-12T02:23:16.838234+0000","last_active":"2024-09-12T02:23:18.673028+0000","last_peered":"2024-09-12T02:23:18.673028+0000","last_clean":"2024-09-12T02:23:18.673028+0000","last_became_active":"2024-09-12T02:23:16.837942+0000","last_became_peered":"2024-09-12T02:23:16.837942+0000","last_unstale":"2024-09-12T02:23:18.673028+0000","last_undegraded":"2024-09-12T02:23:18.673028+0000","last_fullsized":"2024-09-12T02:23:18.673028+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:41.842931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842558+0000","last_change":"2024-09-12T02:23:04.781196+0000","last_active":"2024-09-12T02:23:17.842558+0000","last_peered":"2024-09-12T02:23:17.842558+0000","last_clean":"2024-09-12T02:23:17.842558+0000","last_became_active":"2024-09-12T02:23:04.780893+0000","last_became_peered":"2024-09-12T02:23:04.780893+0000","last_unstale":"2024-09-12T02:23:17.842558+0000","last_undegraded":"2024-09-12T02:23:17.842558+0000","last_fullsized":"2024-09-12T02:23:17.842558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:26.527539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842742+0000","last_change":"2024-09-12T02:23:03.769541+0000","last_active":"2024-09-12T02:23:17.842742+0000","last_peered":"2024-09-12T02:23:17.842742+0000","last_clean":"2024-09-12T02:23:17.842742+0000","last_became_active":"2024-09-12T02:23:03.765281+0000","last_became_peered":"2024-09-12T02:23:03.765281+0000","last_unstale":"2024-09-12T02:23:17.842742+0000","last_undegraded":"2024-09-12T02:23:17.842742+0000","last_fullsized":"2024-09-12T02:23:17.842742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:53.409370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841039+0000","last_change":"2024-09-12T02:23:15.841592+0000","last_active":"2024-09-12T02:23:17.841039+0000","last_peered":"2024-09-12T02:23:17.841039+0000","last_clean":"2024-09-12T02:23:17.841039+0000","last_became_active":"2024-09-12T02:23:15.841380+0000","last_became_peered":"2024-09-12T02:23:15.841380+0000","last_unstale":"2024-09-12T02:23:17.841039+0000","last_undegraded":"2024-09-12T02:23:17.841039+0000","last_fullsized":"2024-09-12T02:23:17.841039+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:38.396332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840229+0000","last_change":"2024-09-12T02:23:16.846596+0000","last_active":"2024-09-12T02:23:17.840229+0000","last_peered":"2024-09-12T02:23:17.840229+0000","last_clean":"2024-09-12T02:23:17.840229+0000","last_became_active":"2024-09-12T02:23:16.846273+0000","last_became_peered":"2024-09-12T02:23:16.846273+0000","last_unstale":"2024-09-12T02:23:17.840229+0000","last_undegraded":"2024-09-12T02:23:17.840229+0000","last_fullsized":"2024-09-12T02:23:17.840229+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:03.628494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841299+0000","last_change":"2024-09-12T02:23:04.781856+0000","last_active":"2024-09-12T02:23:17.841299+0000","last_peered":"2024-09-12T02:23:17.841299+0000","last_clean":"2024-09-12T02:23:17.841299+0000","last_became_active":"2024-09-12T02:23:04.781575+0000","last_became_peered":"2024-09-12T02:23:04.781575+0000","last_unstale":"2024-09-12T02:23:17.841299+0000","last_undegraded":"2024-09-12T02:23:17.841299+0000","last_fullsized":"2024-09-12T02:23:17.841299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:26.630558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673048+0000","last_change":"2024-09-12T02:23:03.771368+0000","last_active":"2024-09-12T02:23:18.673048+0000","last_peered":"2024-09-12T02:23:18.673048+0000","last_clean":"2024-09-12T02:23:18.673048+0000","last_became_active":"2024-09-12T02:23:03.771061+0000","last_became_peered":"2024-09-12T02:23:03.771061+0000","last_unstale":"2024-09-12T02:23:18.673048+0000","last_undegraded":"2024-09-12T02:23:18.673048+0000","last_fullsized":"2024-09-12T02:23:18.673048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:57.476458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.332045+0000","last_change":"2024-09-12T02:23:15.833158+0000","last_active":"2024-09-12T02:23:18.332045+0000","last_peered":"2024-09-12T02:23:18.332045+0000","last_clean":"2024-09-12T02:23:18.332045+0000","last_became_active":"2024-09-12T02:23:15.831707+0000","last_became_peered":"2024-09-12T02:23:15.831707+0000","last_unstale":"2024-09-12T02:23:18.332045+0000","last_undegraded":"2024-09-12T02:23:18.332045+0000","last_fullsized":"2024-09-12T02:23:18.332045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:30.000066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325904+0000","last_change":"2024-09-12T02:23:16.858757+0000","last_active":"2024-09-12T02:23:18.325904+0000","last_peered":"2024-09-12T02:23:18.325904+0000","last_clean":"2024-09-12T02:23:18.325904+0000","last_became_active":"2024-09-12T02:23:16.858469+0000","last_became_peered":"2024-09-12T02:23:16.858469+0000","last_unstale":"2024-09-12T02:23:18.325904+0000","last_undegraded":"2024-09-12T02:23:18.325904+0000","last_fullsized":"2024-09-12T02:23:18.325904+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:22.288143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597329+0000","last_change":"2024-09-12T02:23:04.785248+0000","last_active":"2024-09-12T02:23:19.597329+0000","last_peered":"2024-09-12T02:23:19.597329+0000","last_clean":"2024-09-12T02:23:19.597329+0000","last_became_active":"2024-09-12T02:23:04.784977+0000","last_became_peered":"2024-09-12T02:23:04.784977+0000","last_unstale":"2024-09-12T02:23:19.597329+0000","last_undegraded":"2024-09-12T02:23:19.597329+0000","last_fullsized":"2024-09-12T02:23:19.597329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:23.273457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597715+0000","last_change":"2024-09-12T02:23:03.767842+0000","last_active":"2024-09-12T02:23:19.597715+0000","last_peered":"2024-09-12T02:23:19.597715+0000","last_clean":"2024-09-12T02:23:19.597715+0000","last_became_active":"2024-09-12T02:23:03.767066+0000","last_became_peered":"2024-09-12T02:23:03.767066+0000","last_unstale":"2024-09-12T02:23:19.597715+0000","last_undegraded":"2024-09-12T02:23:19.597715+0000","last_fullsized":"2024-09-12T02:23:19.597715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:50.800749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840199+0000","last_change":"2024-09-12T02:23:15.826104+0000","last_active":"2024-09-12T02:23:17.840199+0000","last_peered":"2024-09-12T02:23:17.840199+0000","last_clean":"2024-09-12T02:23:17.840199+0000","last_became_active":"2024-09-12T02:23:15.825779+0000","last_became_peered":"2024-09-12T02:23:15.825779+0000","last_unstale":"2024-09-12T02:23:17.840199+0000","last_undegraded":"2024-09-12T02:23:17.840199+0000","last_fullsized":"2024-09-12T02:23:17.840199+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:32.661083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325654+0000","last_change":"2024-09-12T02:23:16.856543+0000","last_active":"2024-09-12T02:23:18.325654+0000","last_peered":"2024-09-12T02:23:18.325654+0000","last_clean":"2024-09-12T02:23:18.325654+0000","last_became_active":"2024-09-12T02:23:16.855538+0000","last_became_peered":"2024-09-12T02:23:16.855538+0000","last_unstale":"2024-09-12T02:23:18.325654+0000","last_undegraded":"2024-09-12T02:23:18.325654+0000","last_fullsized":"2024-09-12T02:23:18.325654+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:05.857593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841758+0000","last_change":"2024-09-12T02:23:04.783671+0000","last_active":"2024-09-12T02:23:17.841758+0000","last_peered":"2024-09-12T02:23:17.841758+0000","last_clean":"2024-09-12T02:23:17.841758+0000","last_became_active":"2024-09-12T02:23:04.783399+0000","last_became_peered":"2024-09-12T02:23:04.783399+0000","last_unstale":"2024-09-12T02:23:17.841758+0000","last_undegraded":"2024-09-12T02:23:17.841758+0000","last_fullsized":"2024-09-12T02:23:17.841758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:04.321789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325480+0000","last_change":"2024-09-12T02:23:03.767217+0000","last_active":"2024-09-12T02:23:18.325480+0000","last_peered":"2024-09-12T02:23:18.325480+0000","last_clean":"2024-09-12T02:23:18.325480+0000","last_became_active":"2024-09-12T02:23:03.766551+0000","last_became_peered":"2024-09-12T02:23:03.766551+0000","last_unstale":"2024-09-12T02:23:18.325480+0000","last_undegraded":"2024-09-12T02:23:18.325480+0000","last_fullsized":"2024-09-12T02:23:18.325480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:09.963450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"25'6","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839572+0000","last_change":"2024-09-12T02:23:15.832638+0000","last_active":"2024-09-12T02:23:17.839572+0000","last_peered":"2024-09-12T02:23:17.839572+0000","last_clean":"2024-09-12T02:23:17.839572+0000","last_became_active":"2024-09-12T02:23:15.832152+0000","last_became_peered":"2024-09-12T02:23:15.832152+0000","last_unstale":"2024-09-12T02:23:17.839572+0000","last_undegraded":"2024-09-12T02:23:17.839572+0000","last_fullsized":"2024-09-12T02:23:17.839572+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:06.820636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839619+0000","last_change":"2024-09-12T02:23:16.846920+0000","last_active":"2024-09-12T02:23:17.839619+0000","last_peered":"2024-09-12T02:23:17.839619+0000","last_clean":"2024-09-12T02:23:17.839619+0000","last_became_active":"2024-09-12T02:23:16.846454+0000","last_became_peered":"2024-09-12T02:23:16.846454+0000","last_unstale":"2024-09-12T02:23:17.839619+0000","last_undegraded":"2024-09-12T02:23:17.839619+0000","last_fullsized":"2024-09-12T02:23:17.839619+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:51.782998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331516+0000","last_change":"2024-09-12T02:23:04.784379+0000","last_active":"2024-09-12T02:23:18.331516+0000","last_peered":"2024-09-12T02:23:18.331516+0000","last_clean":"2024-09-12T02:23:18.331516+0000","last_became_active":"2024-09-12T02:23:04.784094+0000","last_became_peered":"2024-09-12T02:23:04.784094+0000","last_unstale":"2024-09-12T02:23:18.331516+0000","last_undegraded":"2024-09-12T02:23:18.331516+0000","last_fullsized":"2024-09-12T02:23:18.331516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:22.103008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.332137+0000","last_change":"2024-09-12T02:23:03.762859+0000","last_active":"2024-09-12T02:23:18.332137+0000","last_peered":"2024-09-12T02:23:18.332137+0000","last_clean":"2024-09-12T02:23:18.332137+0000","last_became_active":"2024-09-12T02:23:03.762557+0000","last_became_peered":"2024-09-12T02:23:03.762557+0000","last_unstale":"2024-09-12T02:23:18.332137+0000","last_undegraded":"2024-09-12T02:23:18.332137+0000","last_fullsized":"2024-09-12T02:23:18.332137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:34.863435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"25'3","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325835+0000","last_change":"2024-09-12T02:23:15.823090+0000","last_active":"2024-09-12T02:23:18.325835+0000","last_peered":"2024-09-12T02:23:18.325835+0000","last_clean":"2024-09-12T02:23:18.325835+0000","last_became_active":"2024-09-12T02:23:15.822441+0000","last_became_peered":"2024-09-12T02:23:15.822441+0000","last_unstale":"2024-09-12T02:23:18.325835+0000","last_undegraded":"2024-09-12T02:23:18.325835+0000","last_fullsized":"2024-09-12T02:23:18.325835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:35.125478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839147+0000","last_change":"2024-09-12T02:23:16.839875+0000","last_active":"2024-09-12T02:23:17.839147+0000","last_peered":"2024-09-12T02:23:17.839147+0000","last_clean":"2024-09-12T02:23:17.839147+0000","last_became_active":"2024-09-12T02:23:16.838277+0000","last_became_peered":"2024-09-12T02:23:16.838277+0000","last_unstale":"2024-09-12T02:23:17.839147+0000","last_undegraded":"2024-09-12T02:23:17.839147+0000","last_fullsized":"2024-09-12T02:23:17.839147+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:09.370310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842288+0000","last_change":"2024-09-12T02:23:04.780843+0000","last_active":"2024-09-12T02:23:17.842288+0000","last_peered":"2024-09-12T02:23:17.842288+0000","last_clean":"2024-09-12T02:23:17.842288+0000","last_became_active":"2024-09-12T02:23:04.780475+0000","last_became_peered":"2024-09-12T02:23:04.780475+0000","last_unstale":"2024-09-12T02:23:17.842288+0000","last_undegraded":"2024-09-12T02:23:17.842288+0000","last_fullsized":"2024-09-12T02:23:17.842288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:38.074872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597754+0000","last_change":"2024-09-12T02:23:03.768425+0000","last_active":"2024-09-12T02:23:19.597754+0000","last_peered":"2024-09-12T02:23:19.597754+0000","last_clean":"2024-09-12T02:23:19.597754+0000","last_became_active":"2024-09-12T02:23:03.768092+0000","last_became_peered":"2024-09-12T02:23:03.768092+0000","last_unstale":"2024-09-12T02:23:19.597754+0000","last_undegraded":"2024-09-12T02:23:19.597754+0000","last_fullsized":"2024-09-12T02:23:19.597754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:18.572070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444109+0000","last_change":"2024-09-12T02:23:15.829364+0000","last_active":"2024-09-12T02:23:18.444109+0000","last_peered":"2024-09-12T02:23:18.444109+0000","last_clean":"2024-09-12T02:23:18.444109+0000","last_became_active":"2024-09-12T02:23:15.827936+0000","last_became_peered":"2024-09-12T02:23:15.827936+0000","last_unstale":"2024-09-12T02:23:18.444109+0000","last_undegraded":"2024-09-12T02:23:18.444109+0000","last_fullsized":"2024-09-12T02:23:18.444109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:04.973202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444416+0000","last_change":"2024-09-12T02:23:16.854209+0000","last_active":"2024-09-12T02:23:18.444416+0000","last_peered":"2024-09-12T02:23:18.444416+0000","last_clean":"2024-09-12T02:23:18.444416+0000","last_became_active":"2024-09-12T02:23:16.853900+0000","last_became_peered":"2024-09-12T02:23:16.853900+0000","last_unstale":"2024-09-12T02:23:18.444416+0000","last_undegraded":"2024-09-12T02:23:18.444416+0000","last_fullsized":"2024-09-12T02:23:18.444416+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:52.831434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842656+0000","last_change":"2024-09-12T02:23:04.777953+0000","last_active":"2024-09-12T02:23:17.842656+0000","last_peered":"2024-09-12T02:23:17.842656+0000","last_clean":"2024-09-12T02:23:17.842656+0000","last_became_active":"2024-09-12T02:23:04.777081+0000","last_became_peered":"2024-09-12T02:23:04.777081+0000","last_unstale":"2024-09-12T02:23:17.842656+0000","last_undegraded":"2024-09-12T02:23:17.842656+0000","last_fullsized":"2024-09-12T02:23:17.842656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:14.103378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444886+0000","last_change":"2024-09-12T02:23:03.771271+0000","last_active":"2024-09-12T02:23:18.444886+0000","last_peered":"2024-09-12T02:23:18.444886+0000","last_clean":"2024-09-12T02:23:18.444886+0000","last_became_active":"2024-09-12T02:23:03.769601+0000","last_became_peered":"2024-09-12T02:23:03.769601+0000","last_unstale":"2024-09-12T02:23:18.444886+0000","last_undegraded":"2024-09-12T02:23:18.444886+0000","last_fullsized":"2024-09-12T02:23:18.444886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:22.910072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842076+0000","last_change":"2024-09-12T02:23:15.831522+0000","last_active":"2024-09-12T02:23:17.842076+0000","last_peered":"2024-09-12T02:23:17.842076+0000","last_clean":"2024-09-12T02:23:17.842076+0000","last_became_active":"2024-09-12T02:23:15.831220+0000","last_became_peered":"2024-09-12T02:23:15.831220+0000","last_unstale":"2024-09-12T02:23:17.842076+0000","last_undegraded":"2024-09-12T02:23:17.842076+0000","last_fullsized":"2024-09-12T02:23:17.842076+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:54.337051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597564+0000","last_change":"2024-09-12T02:23:16.858361+0000","last_active":"2024-09-12T02:23:19.597564+0000","last_peered":"2024-09-12T02:23:19.597564+0000","last_clean":"2024-09-12T02:23:19.597564+0000","last_became_active":"2024-09-12T02:23:16.858075+0000","last_became_peered":"2024-09-12T02:23:16.858075+0000","last_unstale":"2024-09-12T02:23:19.597564+0000","last_undegraded":"2024-09-12T02:23:19.597564+0000","last_fullsized":"2024-09-12T02:23:19.597564+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:35.038604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331887+0000","last_change":"2024-09-12T02:23:04.779171+0000","last_active":"2024-09-12T02:23:18.331887+0000","last_peered":"2024-09-12T02:23:18.331887+0000","last_clean":"2024-09-12T02:23:18.331887+0000","last_became_active":"2024-09-12T02:23:04.778850+0000","last_became_peered":"2024-09-12T02:23:04.778850+0000","last_unstale":"2024-09-12T02:23:18.331887+0000","last_undegraded":"2024-09-12T02:23:18.331887+0000","last_fullsized":"2024-09-12T02:23:18.331887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:21.746490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325975+0000","last_change":"2024-09-12T02:23:03.769710+0000","last_active":"2024-09-12T02:23:18.325975+0000","last_peered":"2024-09-12T02:23:18.325975+0000","last_clean":"2024-09-12T02:23:18.325975+0000","last_became_active":"2024-09-12T02:23:03.769436+0000","last_became_peered":"2024-09-12T02:23:03.769436+0000","last_unstale":"2024-09-12T02:23:18.325975+0000","last_undegraded":"2024-09-12T02:23:18.325975+0000","last_fullsized":"2024-09-12T02:23:18.325975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:11.194147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"25'8","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.838898+0000","last_change":"2024-09-12T02:23:15.833196+0000","last_active":"2024-09-12T02:23:17.838898+0000","last_peered":"2024-09-12T02:23:17.838898+0000","last_clean":"2024-09-12T02:23:17.838898+0000","last_became_active":"2024-09-12T02:23:15.832873+0000","last_became_peered":"2024-09-12T02:23:15.832873+0000","last_unstale":"2024-09-12T02:23:17.838898+0000","last_undegraded":"2024-09-12T02:23:17.838898+0000","last_fullsized":"2024-09-12T02:23:17.838898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:15.238046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840614+0000","last_change":"2024-09-12T02:23:16.856735+0000","last_active":"2024-09-12T02:23:17.840614+0000","last_peered":"2024-09-12T02:23:17.840614+0000","last_clean":"2024-09-12T02:23:17.840614+0000","last_became_active":"2024-09-12T02:23:16.856455+0000","last_became_peered":"2024-09-12T02:23:16.856455+0000","last_unstale":"2024-09-12T02:23:17.840614+0000","last_undegraded":"2024-09-12T02:23:17.840614+0000","last_fullsized":"2024-09-12T02:23:17.840614+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:55.376194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325968+0000","last_change":"2024-09-12T02:23:04.786100+0000","last_active":"2024-09-12T02:23:18.325968+0000","last_peered":"2024-09-12T02:23:18.325968+0000","last_clean":"2024-09-12T02:23:18.325968+0000","last_became_active":"2024-09-12T02:23:04.785795+0000","last_became_peered":"2024-09-12T02:23:04.785795+0000","last_unstale":"2024-09-12T02:23:18.325968+0000","last_undegraded":"2024-09-12T02:23:18.325968+0000","last_fullsized":"2024-09-12T02:23:18.325968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:58.597807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.598224+0000","last_change":"2024-09-12T02:23:03.770668+0000","last_active":"2024-09-12T02:23:19.598224+0000","last_peered":"2024-09-12T02:23:19.598224+0000","last_clean":"2024-09-12T02:23:19.598224+0000","last_became_active":"2024-09-12T02:23:03.769302+0000","last_became_peered":"2024-09-12T02:23:03.769302+0000","last_unstale":"2024-09-12T02:23:19.598224+0000","last_undegraded":"2024-09-12T02:23:19.598224+0000","last_fullsized":"2024-09-12T02:23:19.598224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:18.948922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.838826+0000","last_change":"2024-09-12T02:23:15.825585+0000","last_active":"2024-09-12T02:23:17.838826+0000","last_peered":"2024-09-12T02:23:17.838826+0000","last_clean":"2024-09-12T02:23:17.838826+0000","last_became_active":"2024-09-12T02:23:15.825305+0000","last_became_peered":"2024-09-12T02:23:15.825305+0000","last_unstale":"2024-09-12T02:23:17.838826+0000","last_undegraded":"2024-09-12T02:23:17.838826+0000","last_fullsized":"2024-09-12T02:23:17.838826+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:43.818922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.598136+0000","last_change":"2024-09-12T02:23:16.852415+0000","last_active":"2024-09-12T02:23:19.598136+0000","last_peered":"2024-09-12T02:23:19.598136+0000","last_clean":"2024-09-12T02:23:19.598136+0000","last_became_active":"2024-09-12T02:23:16.852061+0000","last_became_peered":"2024-09-12T02:23:16.852061+0000","last_unstale":"2024-09-12T02:23:19.598136+0000","last_undegraded":"2024-09-12T02:23:19.598136+0000","last_fullsized":"2024-09-12T02:23:19.598136+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:30:49.720576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331783+0000","last_change":"2024-09-12T02:23:15.833414+0000","last_active":"2024-09-12T02:23:18.331783+0000","last_peered":"2024-09-12T02:23:18.331783+0000","last_clean":"2024-09-12T02:23:18.331783+0000","last_became_active":"2024-09-12T02:23:15.832837+0000","last_became_peered":"2024-09-12T02:23:15.832837+0000","last_unstale":"2024-09-12T02:23:18.331783+0000","last_undegraded":"2024-09-12T02:23:18.331783+0000","last_fullsized":"2024-09-12T02:23:18.331783+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:31.510160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444086+0000","last_change":"2024-09-12T02:23:04.776572+0000","last_active":"2024-09-12T02:23:18.444086+0000","last_peered":"2024-09-12T02:23:18.444086+0000","last_clean":"2024-09-12T02:23:18.444086+0000","last_became_active":"2024-09-12T02:23:04.776270+0000","last_became_peered":"2024-09-12T02:23:04.776270+0000","last_unstale":"2024-09-12T02:23:18.444086+0000","last_undegraded":"2024-09-12T02:23:18.444086+0000","last_fullsized":"2024-09-12T02:23:18.444086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:12.807907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325207+0000","last_change":"2024-09-12T02:23:03.762450+0000","last_active":"2024-09-12T02:23:18.325207+0000","last_peered":"2024-09-12T02:23:18.325207+0000","last_clean":"2024-09-12T02:23:18.325207+0000","last_became_active":"2024-09-12T02:23:03.762161+0000","last_became_peered":"2024-09-12T02:23:03.762161+0000","last_unstale":"2024-09-12T02:23:18.325207+0000","last_undegraded":"2024-09-12T02:23:18.325207+0000","last_fullsized":"2024-09-12T02:23:18.325207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:42.256395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331804+0000","last_change":"2024-09-12T02:23:16.844537+0000","last_active":"2024-09-12T02:23:18.331804+0000","last_peered":"2024-09-12T02:23:18.331804+0000","last_clean":"2024-09-12T02:23:18.331804+0000","last_became_active":"2024-09-12T02:23:16.844248+0000","last_became_peered":"2024-09-12T02:23:16.844248+0000","last_unstale":"2024-09-12T02:23:18.331804+0000","last_undegraded":"2024-09-12T02:23:18.331804+0000","last_fullsized":"2024-09-12T02:23:18.331804+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:45.801324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"25'4","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.598147+0000","last_change":"2024-09-12T02:23:15.826010+0000","last_active":"2024-09-12T02:23:19.598147+0000","last_peered":"2024-09-12T02:23:19.598147+0000","last_clean":"2024-09-12T02:23:19.598147+0000","last_became_active":"2024-09-12T02:23:15.825730+0000","last_became_peered":"2024-09-12T02:23:15.825730+0000","last_unstale":"2024-09-12T02:23:19.598147+0000","last_undegraded":"2024-09-12T02:23:19.598147+0000","last_fullsized":"2024-09-12T02:23:19.598147+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:17.920975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839339+0000","last_change":"2024-09-12T02:23:04.783317+0000","last_active":"2024-09-12T02:23:17.839339+0000","last_peered":"2024-09-12T02:23:17.839339+0000","last_clean":"2024-09-12T02:23:17.839339+0000","last_became_active":"2024-09-12T02:23:04.783039+0000","last_became_peered":"2024-09-12T02:23:04.783039+0000","last_unstale":"2024-09-12T02:23:17.839339+0000","last_undegraded":"2024-09-12T02:23:17.839339+0000","last_fullsized":"2024-09-12T02:23:17.839339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:17.577991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839055+0000","last_change":"2024-09-12T02:23:03.768361+0000","last_active":"2024-09-12T02:23:17.839055+0000","last_peered":"2024-09-12T02:23:17.839055+0000","last_clean":"2024-09-12T02:23:17.839055+0000","last_became_active":"2024-09-12T02:23:03.768137+0000","last_became_peered":"2024-09-12T02:23:03.768137+0000","last_unstale":"2024-09-12T02:23:17.839055+0000","last_undegraded":"2024-09-12T02:23:17.839055+0000","last_fullsized":"2024-09-12T02:23:17.839055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:29.721363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444813+0000","last_change":"2024-09-12T02:23:16.861251+0000","last_active":"2024-09-12T02:23:18.444813+0000","last_peered":"2024-09-12T02:23:18.444813+0000","last_clean":"2024-09-12T02:23:18.444813+0000","last_became_active":"2024-09-12T02:23:16.860980+0000","last_became_peered":"2024-09-12T02:23:16.860980+0000","last_unstale":"2024-09-12T02:23:18.444813+0000","last_undegraded":"2024-09-12T02:23:18.444813+0000","last_fullsized":"2024-09-12T02:23:18.444813+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:16.177179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597691+0000","last_change":"2024-09-12T02:23:03.768186+0000","last_active":"2024-09-12T02:23:19.597691+0000","last_peered":"2024-09-12T02:23:19.597691+0000","last_clean":"2024-09-12T02:23:19.597691+0000","last_became_active":"2024-09-12T02:23:03.767916+0000","last_became_peered":"2024-09-12T02:23:03.767916+0000","last_unstale":"2024-09-12T02:23:19.597691+0000","last_undegraded":"2024-09-12T02:23:19.597691+0000","last_fullsized":"2024-09-12T02:23:19.597691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:04.424540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.332085+0000","last_change":"2024-09-12T02:23:04.793412+0000","last_active":"2024-09-12T02:23:18.332085+0000","last_peered":"2024-09-12T02:23:18.332085+0000","last_clean":"2024-09-12T02:23:18.332085+0000","last_became_active":"2024-09-12T02:23:04.793100+0000","last_became_peered":"2024-09-12T02:23:04.793100+0000","last_unstale":"2024-09-12T02:23:18.332085+0000","last_undegraded":"2024-09-12T02:23:18.332085+0000","last_fullsized":"2024-09-12T02:23:18.332085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:50.446212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673306+0000","last_change":"2024-09-12T02:23:15.830776+0000","last_active":"2024-09-12T02:23:18.673306+0000","last_peered":"2024-09-12T02:23:18.673306+0000","last_clean":"2024-09-12T02:23:18.673306+0000","last_became_active":"2024-09-12T02:23:15.830492+0000","last_became_peered":"2024-09-12T02:23:15.830492+0000","last_unstale":"2024-09-12T02:23:18.673306+0000","last_undegraded":"2024-09-12T02:23:18.673306+0000","last_fullsized":"2024-09-12T02:23:18.673306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:40.517292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840575+0000","last_change":"2024-09-12T02:23:16.851953+0000","last_active":"2024-09-12T02:23:17.840575+0000","last_peered":"2024-09-12T02:23:17.840575+0000","last_clean":"2024-09-12T02:23:17.840575+0000","last_became_active":"2024-09-12T02:23:16.851558+0000","last_became_peered":"2024-09-12T02:23:16.851558+0000","last_unstale":"2024-09-12T02:23:17.840575+0000","last_undegraded":"2024-09-12T02:23:17.840575+0000","last_fullsized":"2024-09-12T02:23:17.840575+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:29.852193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839423+0000","last_change":"2024-09-12T02:23:03.764310+0000","last_active":"2024-09-12T02:23:17.839423+0000","last_peered":"2024-09-12T02:23:17.839423+0000","last_clean":"2024-09-12T02:23:17.839423+0000","last_became_active":"2024-09-12T02:23:03.764020+0000","last_became_peered":"2024-09-12T02:23:03.764020+0000","last_unstale":"2024-09-12T02:23:17.839423+0000","last_undegraded":"2024-09-12T02:23:17.839423+0000","last_fullsized":"2024-09-12T02:23:17.839423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:25.892874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841038+0000","last_change":"2024-09-12T02:23:04.771579+0000","last_active":"2024-09-12T02:23:17.841038+0000","last_peered":"2024-09-12T02:23:17.841038+0000","last_clean":"2024-09-12T02:23:17.841038+0000","last_became_active":"2024-09-12T02:23:04.771310+0000","last_became_peered":"2024-09-12T02:23:04.771310+0000","last_unstale":"2024-09-12T02:23:17.841038+0000","last_undegraded":"2024-09-12T02:23:17.841038+0000","last_fullsized":"2024-09-12T02:23:17.841038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:05.115474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839742+0000","last_change":"2024-09-12T02:23:15.832757+0000","last_active":"2024-09-12T02:23:17.839742+0000","last_peered":"2024-09-12T02:23:17.839742+0000","last_clean":"2024-09-12T02:23:17.839742+0000","last_became_active":"2024-09-12T02:23:15.832478+0000","last_became_peered":"2024-09-12T02:23:15.832478+0000","last_unstale":"2024-09-12T02:23:17.839742+0000","last_undegraded":"2024-09-12T02:23:17.839742+0000","last_fullsized":"2024-09-12T02:23:17.839742+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:29.301251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839974+0000","last_change":"2024-09-12T02:23:16.848437+0000","last_active":"2024-09-12T02:23:17.839974+0000","last_peered":"2024-09-12T02:23:17.839974+0000","last_clean":"2024-09-12T02:23:17.839974+0000","last_became_active":"2024-09-12T02:23:16.847063+0000","last_became_peered":"2024-09-12T02:23:16.847063+0000","last_unstale":"2024-09-12T02:23:17.839974+0000","last_undegraded":"2024-09-12T02:23:17.839974+0000","last_fullsized":"2024-09-12T02:23:17.839974+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:49.979448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597310+0000","last_change":"2024-09-12T02:23:04.788489+0000","last_active":"2024-09-12T02:23:19.597310+0000","last_peered":"2024-09-12T02:23:19.597310+0000","last_clean":"2024-09-12T02:23:19.597310+0000","last_became_active":"2024-09-12T02:23:04.788195+0000","last_became_peered":"2024-09-12T02:23:04.788195+0000","last_unstale":"2024-09-12T02:23:19.597310+0000","last_undegraded":"2024-09-12T02:23:19.597310+0000","last_fullsized":"2024-09-12T02:23:19.597310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:51.352859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444586+0000","last_change":"2024-09-12T02:23:16.843805+0000","last_active":"2024-09-12T02:23:18.444586+0000","last_peered":"2024-09-12T02:23:18.444586+0000","last_clean":"2024-09-12T02:23:18.444586+0000","last_became_active":"2024-09-12T02:23:16.843517+0000","last_became_peered":"2024-09-12T02:23:16.843517+0000","last_unstale":"2024-09-12T02:23:18.444586+0000","last_undegraded":"2024-09-12T02:23:18.444586+0000","last_fullsized":"2024-09-12T02:23:18.444586+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:30.873311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673159+0000","last_change":"2024-09-12T02:23:04.780662+0000","last_active":"2024-09-12T02:23:18.673159+0000","last_peered":"2024-09-12T02:23:18.673159+0000","last_clean":"2024-09-12T02:23:18.673159+0000","last_became_active":"2024-09-12T02:23:04.780402+0000","last_became_peered":"2024-09-12T02:23:04.780402+0000","last_unstale":"2024-09-12T02:23:18.673159+0000","last_undegraded":"2024-09-12T02:23:18.673159+0000","last_fullsized":"2024-09-12T02:23:18.673159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:23:00.556487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325531+0000","last_change":"2024-09-12T02:23:16.852992+0000","last_active":"2024-09-12T02:23:18.325531+0000","last_peered":"2024-09-12T02:23:18.325531+0000","last_clean":"2024-09-12T02:23:18.325531+0000","last_became_active":"2024-09-12T02:23:16.852706+0000","last_became_peered":"2024-09-12T02:23:16.852706+0000","last_unstale":"2024-09-12T02:23:18.325531+0000","last_undegraded":"2024-09-12T02:23:18.325531+0000","last_fullsized":"2024-09-12T02:23:18.325531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:56.896457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325468+0000","last_change":"2024-09-12T02:23:04.785920+0000","last_active":"2024-09-12T02:23:18.325468+0000","last_peered":"2024-09-12T02:23:18.325468+0000","last_clean":"2024-09-12T02:23:18.325468+0000","last_became_active":"2024-09-12T02:23:04.785422+0000","last_became_peered":"2024-09-12T02:23:04.785422+0000","last_unstale":"2024-09-12T02:23:18.325468+0000","last_undegraded":"2024-09-12T02:23:18.325468+0000","last_fullsized":"2024-09-12T02:23:18.325468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:55.106703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444779+0000","last_change":"2024-09-12T02:23:16.861939+0000","last_active":"2024-09-12T02:23:18.444779+0000","last_peered":"2024-09-12T02:23:18.444779+0000","last_clean":"2024-09-12T02:23:18.444779+0000","last_became_active":"2024-09-12T02:23:16.861658+0000","last_became_peered":"2024-09-12T02:23:16.861658+0000","last_unstale":"2024-09-12T02:23:18.444779+0000","last_undegraded":"2024-09-12T02:23:18.444779+0000","last_fullsized":"2024-09-12T02:23:18.444779+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:06.755715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331991+0000","last_change":"2024-09-12T02:23:04.777018+0000","last_active":"2024-09-12T02:23:18.331991+0000","last_peered":"2024-09-12T02:23:18.331991+0000","last_clean":"2024-09-12T02:23:18.331991+0000","last_became_active":"2024-09-12T02:23:04.776736+0000","last_became_peered":"2024-09-12T02:23:04.776736+0000","last_unstale":"2024-09-12T02:23:18.331991+0000","last_undegraded":"2024-09-12T02:23:18.331991+0000","last_fullsized":"2024-09-12T02:23:18.331991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:08.668990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840760+0000","last_change":"2024-09-12T02:23:16.847615+0000","last_active":"2024-09-12T02:23:17.840760+0000","last_peered":"2024-09-12T02:23:17.840760+0000","last_clean":"2024-09-12T02:23:17.840760+0000","last_became_active":"2024-09-12T02:23:16.847260+0000","last_became_peered":"2024-09-12T02:23:16.847260+0000","last_unstale":"2024-09-12T02:23:17.840760+0000","last_undegraded":"2024-09-12T02:23:17.840760+0000","last_fullsized":"2024-09-12T02:23:17.840760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:48.920477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839828+0000","last_change":"2024-09-12T02:23:04.789372+0000","last_active":"2024-09-12T02:23:17.839828+0000","last_peered":"2024-09-12T02:23:17.839828+0000","last_clean":"2024-09-12T02:23:17.839828+0000","last_became_active":"2024-09-12T02:23:04.789090+0000","last_became_peered":"2024-09-12T02:23:04.789090+0000","last_unstale":"2024-09-12T02:23:17.839828+0000","last_undegraded":"2024-09-12T02:23:17.839828+0000","last_fullsized":"2024-09-12T02:23:17.839828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:49.533491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841815+0000","last_change":"2024-09-12T02:23:16.859000+0000","last_active":"2024-09-12T02:23:17.841815+0000","last_peered":"2024-09-12T02:23:17.841815+0000","last_clean":"2024-09-12T02:23:17.841815+0000","last_became_active":"2024-09-12T02:23:16.858637+0000","last_became_peered":"2024-09-12T02:23:16.858637+0000","last_unstale":"2024-09-12T02:23:17.841815+0000","last_undegraded":"2024-09-12T02:23:17.841815+0000","last_fullsized":"2024-09-12T02:23:17.841815+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:47.915947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444881+0000","last_change":"2024-09-12T02:23:04.776435+0000","last_active":"2024-09-12T02:23:18.444881+0000","last_peered":"2024-09-12T02:23:18.444881+0000","last_clean":"2024-09-12T02:23:18.444881+0000","last_became_active":"2024-09-12T02:23:04.776120+0000","last_became_peered":"2024-09-12T02:23:04.776120+0000","last_unstale":"2024-09-12T02:23:18.444881+0000","last_undegraded":"2024-09-12T02:23:18.444881+0000","last_fullsized":"2024-09-12T02:23:18.444881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:27.985094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840466+0000","last_change":"2024-09-12T02:23:16.856477+0000","last_active":"2024-09-12T02:23:17.840466+0000","last_peered":"2024-09-12T02:23:17.840466+0000","last_clean":"2024-09-12T02:23:17.840466+0000","last_became_active":"2024-09-12T02:23:16.855839+0000","last_became_peered":"2024-09-12T02:23:16.855839+0000","last_unstale":"2024-09-12T02:23:17.840466+0000","last_undegraded":"2024-09-12T02:23:17.840466+0000","last_fullsized":"2024-09-12T02:23:17.840466+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:42.510184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.598050+0000","last_change":"2024-09-12T02:23:04.788827+0000","last_active":"2024-09-12T02:23:19.598050+0000","last_peered":"2024-09-12T02:23:19.598050+0000","last_clean":"2024-09-12T02:23:19.598050+0000","last_became_active":"2024-09-12T02:23:04.788521+0000","last_became_peered":"2024-09-12T02:23:04.788521+0000","last_unstale":"2024-09-12T02:23:19.598050+0000","last_undegraded":"2024-09-12T02:23:19.598050+0000","last_fullsized":"2024-09-12T02:23:19.598050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:24.470245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597525+0000","last_change":"2024-09-12T02:23:16.838421+0000","last_active":"2024-09-12T02:23:19.597525+0000","last_peered":"2024-09-12T02:23:19.597525+0000","last_clean":"2024-09-12T02:23:19.597525+0000","last_became_active":"2024-09-12T02:23:16.837606+0000","last_became_peered":"2024-09-12T02:23:16.837606+0000","last_unstale":"2024-09-12T02:23:19.597525+0000","last_undegraded":"2024-09-12T02:23:19.597525+0000","last_fullsized":"2024-09-12T02:23:19.597525+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:09.704007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840259+0000","last_change":"2024-09-12T02:23:04.787899+0000","last_active":"2024-09-12T02:23:17.840259+0000","last_peered":"2024-09-12T02:23:17.840259+0000","last_clean":"2024-09-12T02:23:17.840259+0000","last_became_active":"2024-09-12T02:23:04.787619+0000","last_became_peered":"2024-09-12T02:23:04.787619+0000","last_unstale":"2024-09-12T02:23:17.840259+0000","last_undegraded":"2024-09-12T02:23:17.840259+0000","last_fullsized":"2024-09-12T02:23:17.840259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:57.732453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839922+0000","last_change":"2024-09-12T02:23:16.845296+0000","last_active":"2024-09-12T02:23:17.839922+0000","last_peered":"2024-09-12T02:23:17.839922+0000","last_clean":"2024-09-12T02:23:17.839922+0000","last_became_active":"2024-09-12T02:23:16.844939+0000","last_became_peered":"2024-09-12T02:23:16.844939+0000","last_unstale":"2024-09-12T02:23:17.839922+0000","last_undegraded":"2024-09-12T02:23:17.839922+0000","last_fullsized":"2024-09-12T02:23:17.839922+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:16.790822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325133+0000","last_change":"2024-09-12T02:23:04.787389+0000","last_active":"2024-09-12T02:23:18.325133+0000","last_peered":"2024-09-12T02:23:18.325133+0000","last_clean":"2024-09-12T02:23:18.325133+0000","last_became_active":"2024-09-12T02:23:04.787092+0000","last_became_peered":"2024-09-12T02:23:04.787092+0000","last_unstale":"2024-09-12T02:23:18.325133+0000","last_undegraded":"2024-09-12T02:23:18.325133+0000","last_fullsized":"2024-09-12T02:23:18.325133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:02.924906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.843281+0000","last_change":"2024-09-12T02:23:16.849846+0000","last_active":"2024-09-12T02:23:17.843281+0000","last_peered":"2024-09-12T02:23:17.843281+0000","last_clean":"2024-09-12T02:23:17.843281+0000","last_became_active":"2024-09-12T02:23:16.849585+0000","last_became_peered":"2024-09-12T02:23:16.849585+0000","last_unstale":"2024-09-12T02:23:17.843281+0000","last_undegraded":"2024-09-12T02:23:17.843281+0000","last_fullsized":"2024-09-12T02:23:17.843281+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:58.775679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839012+0000","last_change":"2024-09-12T02:23:04.788624+0000","last_active":"2024-09-12T02:23:17.839012+0000","last_peered":"2024-09-12T02:23:17.839012+0000","last_clean":"2024-09-12T02:23:17.839012+0000","last_became_active":"2024-09-12T02:23:04.788352+0000","last_became_peered":"2024-09-12T02:23:04.788352+0000","last_unstale":"2024-09-12T02:23:17.839012+0000","last_undegraded":"2024-09-12T02:23:17.839012+0000","last_fullsized":"2024-09-12T02:23:17.839012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:13.961110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673339+0000","last_change":"2024-09-12T02:23:16.850112+0000","last_active":"2024-09-12T02:23:18.673339+0000","last_peered":"2024-09-12T02:23:18.673339+0000","last_clean":"2024-09-12T02:23:18.673339+0000","last_became_active":"2024-09-12T02:23:16.849831+0000","last_became_peered":"2024-09-12T02:23:16.849831+0000","last_unstale":"2024-09-12T02:23:18.673339+0000","last_undegraded":"2024-09-12T02:23:18.673339+0000","last_fullsized":"2024-09-12T02:23:18.673339+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:42.625762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325319+0000","last_change":"2024-09-12T02:23:04.785685+0000","last_active":"2024-09-12T02:23:18.325319+0000","last_peered":"2024-09-12T02:23:18.325319+0000","last_clean":"2024-09-12T02:23:18.325319+0000","last_became_active":"2024-09-12T02:23:04.784945+0000","last_became_peered":"2024-09-12T02:23:04.784945+0000","last_unstale":"2024-09-12T02:23:18.325319+0000","last_undegraded":"2024-09-12T02:23:18.325319+0000","last_fullsized":"2024-09-12T02:23:18.325319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:36.658436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839639+0000","last_change":"2024-09-12T02:23:16.846108+0000","last_active":"2024-09-12T02:23:17.839639+0000","last_peered":"2024-09-12T02:23:17.839639+0000","last_clean":"2024-09-12T02:23:17.839639+0000","last_became_active":"2024-09-12T02:23:16.845793+0000","last_became_peered":"2024-09-12T02:23:16.845793+0000","last_unstale":"2024-09-12T02:23:17.839639+0000","last_undegraded":"2024-09-12T02:23:17.839639+0000","last_fullsized":"2024-09-12T02:23:17.839639+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:36.274858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331880+0000","last_change":"2024-09-12T02:23:04.785849+0000","last_active":"2024-09-12T02:23:18.331880+0000","last_peered":"2024-09-12T02:23:18.331880+0000","last_clean":"2024-09-12T02:23:18.331880+0000","last_became_active":"2024-09-12T02:23:04.785511+0000","last_became_peered":"2024-09-12T02:23:04.785511+0000","last_unstale":"2024-09-12T02:23:18.331880+0000","last_undegraded":"2024-09-12T02:23:18.331880+0000","last_fullsized":"2024-09-12T02:23:18.331880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:28.670102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840717+0000","last_change":"2024-09-12T02:23:16.855615+0000","last_active":"2024-09-12T02:23:17.840717+0000","last_peered":"2024-09-12T02:23:17.840717+0000","last_clean":"2024-09-12T02:23:17.840717+0000","last_became_active":"2024-09-12T02:23:16.855278+0000","last_became_peered":"2024-09-12T02:23:16.855278+0000","last_unstale":"2024-09-12T02:23:17.840717+0000","last_undegraded":"2024-09-12T02:23:17.840717+0000","last_fullsized":"2024-09-12T02:23:17.840717+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:34.214175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597577+0000","last_change":"2024-09-12T02:23:04.789575+0000","last_active":"2024-09-12T02:23:19.597577+0000","last_peered":"2024-09-12T02:23:19.597577+0000","last_clean":"2024-09-12T02:23:19.597577+0000","last_became_active":"2024-09-12T02:23:04.789296+0000","last_became_peered":"2024-09-12T02:23:04.789296+0000","last_unstale":"2024-09-12T02:23:19.597577+0000","last_undegraded":"2024-09-12T02:23:19.597577+0000","last_fullsized":"2024-09-12T02:23:19.597577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:13.166139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841521+0000","last_change":"2024-09-12T02:23:16.858045+0000","last_active":"2024-09-12T02:23:17.841521+0000","last_peered":"2024-09-12T02:23:17.841521+0000","last_clean":"2024-09-12T02:23:17.841521+0000","last_became_active":"2024-09-12T02:23:16.857772+0000","last_became_peered":"2024-09-12T02:23:16.857772+0000","last_unstale":"2024-09-12T02:23:17.841521+0000","last_undegraded":"2024-09-12T02:23:17.841521+0000","last_fullsized":"2024-09-12T02:23:17.841521+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:35.598279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842504+0000","last_change":"2024-09-12T02:23:04.777450+0000","last_active":"2024-09-12T02:23:17.842504+0000","last_peered":"2024-09-12T02:23:17.842504+0000","last_clean":"2024-09-12T02:23:17.842504+0000","last_became_active":"2024-09-12T02:23:04.776825+0000","last_became_peered":"2024-09-12T02:23:04.776825+0000","last_unstale":"2024-09-12T02:23:17.842504+0000","last_undegraded":"2024-09-12T02:23:17.842504+0000","last_fullsized":"2024-09-12T02:23:17.842504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:40.315075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325062+0000","last_change":"2024-09-12T02:23:16.846032+0000","last_active":"2024-09-12T02:23:18.325062+0000","last_peered":"2024-09-12T02:23:18.325062+0000","last_clean":"2024-09-12T02:23:18.325062+0000","last_became_active":"2024-09-12T02:23:16.845492+0000","last_became_peered":"2024-09-12T02:23:16.845492+0000","last_unstale":"2024-09-12T02:23:18.325062+0000","last_undegraded":"2024-09-12T02:23:18.325062+0000","last_fullsized":"2024-09-12T02:23:18.325062+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:18.785798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673368+0000","last_change":"2024-09-12T02:23:04.791378+0000","last_active":"2024-09-12T02:23:18.673368+0000","last_peered":"2024-09-12T02:23:18.673368+0000","last_clean":"2024-09-12T02:23:18.673368+0000","last_became_active":"2024-09-12T02:23:04.790926+0000","last_became_peered":"2024-09-12T02:23:04.790926+0000","last_unstale":"2024-09-12T02:23:18.673368+0000","last_undegraded":"2024-09-12T02:23:18.673368+0000","last_fullsized":"2024-09-12T02:23:18.673368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:34.764210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331435+0000","last_change":"2024-09-12T02:23:16.851099+0000","last_active":"2024-09-12T02:23:18.331435+0000","last_peered":"2024-09-12T02:23:18.331435+0000","last_clean":"2024-09-12T02:23:18.331435+0000","last_became_active":"2024-09-12T02:23:16.850747+0000","last_became_peered":"2024-09-12T02:23:16.850747+0000","last_unstale":"2024-09-12T02:23:18.331435+0000","last_undegraded":"2024-09-12T02:23:18.331435+0000","last_fullsized":"2024-09-12T02:23:18.331435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:01:31.445590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.326232+0000","last_change":"2024-09-12T02:23:04.789439+0000","last_active":"2024-09-12T02:23:18.326232+0000","last_peered":"2024-09-12T02:23:18.326232+0000","last_clean":"2024-09-12T02:23:18.326232+0000","last_became_active":"2024-09-12T02:23:04.787421+0000","last_became_peered":"2024-09-12T02:23:04.787421+0000","last_unstale":"2024-09-12T02:23:18.326232+0000","last_undegraded":"2024-09-12T02:23:18.326232+0000","last_fullsized":"2024-09-12T02:23:18.326232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:44.295056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444485+0000","last_change":"2024-09-12T02:23:16.850923+0000","last_active":"2024-09-12T02:23:18.444485+0000","last_peered":"2024-09-12T02:23:18.444485+0000","last_clean":"2024-09-12T02:23:18.444485+0000","last_became_active":"2024-09-12T02:23:16.850609+0000","last_became_peered":"2024-09-12T02:23:16.850609+0000","last_unstale":"2024-09-12T02:23:18.444485+0000","last_undegraded":"2024-09-12T02:23:18.444485+0000","last_fullsized":"2024-09-12T02:23:18.444485+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:52.110438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325085+0000","last_change":"2024-09-12T02:23:04.790532+0000","last_active":"2024-09-12T02:23:18.325085+0000","last_peered":"2024-09-12T02:23:18.325085+0000","last_clean":"2024-09-12T02:23:18.325085+0000","last_became_active":"2024-09-12T02:23:04.789229+0000","last_became_peered":"2024-09-12T02:23:04.789229+0000","last_unstale":"2024-09-12T02:23:18.325085+0000","last_undegraded":"2024-09-12T02:23:18.325085+0000","last_fullsized":"2024-09-12T02:23:18.325085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:59.901665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841478+0000","last_change":"2024-09-12T02:23:16.856612+0000","last_active":"2024-09-12T02:23:17.841478+0000","last_peered":"2024-09-12T02:23:17.841478+0000","last_clean":"2024-09-12T02:23:17.841478+0000","last_became_active":"2024-09-12T02:23:16.856290+0000","last_became_peered":"2024-09-12T02:23:16.856290+0000","last_unstale":"2024-09-12T02:23:17.841478+0000","last_undegraded":"2024-09-12T02:23:17.841478+0000","last_fullsized":"2024-09-12T02:23:17.841478+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:14.846281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444198+0000","last_change":"2024-09-12T02:23:04.782490+0000","last_active":"2024-09-12T02:23:18.444198+0000","last_peered":"2024-09-12T02:23:18.444198+0000","last_clean":"2024-09-12T02:23:18.444198+0000","last_became_active":"2024-09-12T02:23:04.782183+0000","last_became_peered":"2024-09-12T02:23:04.782183+0000","last_unstale":"2024-09-12T02:23:18.444198+0000","last_undegraded":"2024-09-12T02:23:18.444198+0000","last_fullsized":"2024-09-12T02:23:18.444198+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:28.699880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325361+0000","last_change":"2024-09-12T02:23:16.858100+0000","last_active":"2024-09-12T02:23:18.325361+0000","last_peered":"2024-09-12T02:23:18.325361+0000","last_clean":"2024-09-12T02:23:18.325361+0000","last_became_active":"2024-09-12T02:23:16.857818+0000","last_became_peered":"2024-09-12T02:23:16.857818+0000","last_unstale":"2024-09-12T02:23:18.325361+0000","last_undegraded":"2024-09-12T02:23:18.325361+0000","last_fullsized":"2024-09-12T02:23:18.325361+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:45.991170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331508+0000","last_change":"2024-09-12T02:23:04.787140+0000","last_active":"2024-09-12T02:23:18.331508+0000","last_peered":"2024-09-12T02:23:18.331508+0000","last_clean":"2024-09-12T02:23:18.331508+0000","last_became_active":"2024-09-12T02:23:04.786799+0000","last_became_peered":"2024-09-12T02:23:04.786799+0000","last_unstale":"2024-09-12T02:23:18.331508+0000","last_undegraded":"2024-09-12T02:23:18.331508+0000","last_fullsized":"2024-09-12T02:23:18.331508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:31.639605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842225+0000","last_change":"2024-09-12T02:23:16.846100+0000","last_active":"2024-09-12T02:23:17.842225+0000","last_peered":"2024-09-12T02:23:17.842225+0000","last_clean":"2024-09-12T02:23:17.842225+0000","last_became_active":"2024-09-12T02:23:16.845749+0000","last_became_peered":"2024-09-12T02:23:16.845749+0000","last_unstale":"2024-09-12T02:23:17.842225+0000","last_undegraded":"2024-09-12T02:23:17.842225+0000","last_fullsized":"2024-09-12T02:23:17.842225+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:42.783366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839149+0000","last_change":"2024-09-12T02:23:04.782128+0000","last_active":"2024-09-12T02:23:17.839149+0000","last_peered":"2024-09-12T02:23:17.839149+0000","last_clean":"2024-09-12T02:23:17.839149+0000","last_became_active":"2024-09-12T02:23:04.781101+0000","last_became_peered":"2024-09-12T02:23:04.781101+0000","last_unstale":"2024-09-12T02:23:17.839149+0000","last_undegraded":"2024-09-12T02:23:17.839149+0000","last_fullsized":"2024-09-12T02:23:17.839149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:49.421147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839296+0000","last_change":"2024-09-12T02:23:16.836968+0000","last_active":"2024-09-12T02:23:17.839296+0000","last_peered":"2024-09-12T02:23:17.839296+0000","last_clean":"2024-09-12T02:23:17.839296+0000","last_became_active":"2024-09-12T02:23:16.836561+0000","last_became_peered":"2024-09-12T02:23:16.836561+0000","last_unstale":"2024-09-12T02:23:17.839296+0000","last_undegraded":"2024-09-12T02:23:17.839296+0000","last_fullsized":"2024-09-12T02:23:17.839296+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:08.765569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842555+0000","last_change":"2024-09-12T02:23:04.787034+0000","last_active":"2024-09-12T02:23:17.842555+0000","last_peered":"2024-09-12T02:23:17.842555+0000","last_clean":"2024-09-12T02:23:17.842555+0000","last_became_active":"2024-09-12T02:23:04.786044+0000","last_became_peered":"2024-09-12T02:23:04.786044+0000","last_unstale":"2024-09-12T02:23:17.842555+0000","last_undegraded":"2024-09-12T02:23:17.842555+0000","last_fullsized":"2024-09-12T02:23:17.842555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:07.183028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673151+0000","last_change":"2024-09-12T02:23:16.846114+0000","last_active":"2024-09-12T02:23:18.673151+0000","last_peered":"2024-09-12T02:23:18.673151+0000","last_clean":"2024-09-12T02:23:18.673151+0000","last_became_active":"2024-09-12T02:23:16.845757+0000","last_became_peered":"2024-09-12T02:23:16.845757+0000","last_unstale":"2024-09-12T02:23:18.673151+0000","last_undegraded":"2024-09-12T02:23:18.673151+0000","last_fullsized":"2024-09-12T02:23:18.673151+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:17:52.019813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597793+0000","last_change":"2024-09-12T02:23:04.785662+0000","last_active":"2024-09-12T02:23:19.597793+0000","last_peered":"2024-09-12T02:23:19.597793+0000","last_clean":"2024-09-12T02:23:19.597793+0000","last_became_active":"2024-09-12T02:23:04.785375+0000","last_became_peered":"2024-09-12T02:23:04.785375+0000","last_unstale":"2024-09-12T02:23:19.597793+0000","last_undegraded":"2024-09-12T02:23:19.597793+0000","last_fullsized":"2024-09-12T02:23:19.597793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:44.295056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841351+0000","last_change":"2024-09-12T02:23:16.858175+0000","last_active":"2024-09-12T02:23:17.841351+0000","last_peered":"2024-09-12T02:23:17.841351+0000","last_clean":"2024-09-12T02:23:17.841351+0000","last_became_active":"2024-09-12T02:23:16.857873+0000","last_became_peered":"2024-09-12T02:23:16.857873+0000","last_unstale":"2024-09-12T02:23:17.841351+0000","last_undegraded":"2024-09-12T02:23:17.841351+0000","last_fullsized":"2024-09-12T02:23:17.841351+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:54.535867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597940+0000","last_change":"2024-09-12T02:23:04.791929+0000","last_active":"2024-09-12T02:23:19.597940+0000","last_peered":"2024-09-12T02:23:19.597940+0000","last_clean":"2024-09-12T02:23:19.597940+0000","last_became_active":"2024-09-12T02:23:04.791622+0000","last_became_peered":"2024-09-12T02:23:04.791622+0000","last_unstale":"2024-09-12T02:23:19.597940+0000","last_undegraded":"2024-09-12T02:23:19.597940+0000","last_fullsized":"2024-09-12T02:23:19.597940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:35.012685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325239+0000","last_change":"2024-09-12T02:23:16.849985+0000","last_active":"2024-09-12T02:23:18.325239+0000","last_peered":"2024-09-12T02:23:18.325239+0000","last_clean":"2024-09-12T02:23:18.325239+0000","last_became_active":"2024-09-12T02:23:16.849641+0000","last_became_peered":"2024-09-12T02:23:16.849641+0000","last_unstale":"2024-09-12T02:23:18.325239+0000","last_undegraded":"2024-09-12T02:23:18.325239+0000","last_fullsized":"2024-09-12T02:23:18.325239+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:28.373543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.843012+0000","last_change":"2024-09-12T02:23:04.781090+0000","last_active":"2024-09-12T02:23:17.843012+0000","last_peered":"2024-09-12T02:23:17.843012+0000","last_clean":"2024-09-12T02:23:17.843012+0000","last_became_active":"2024-09-12T02:23:04.780740+0000","last_became_peered":"2024-09-12T02:23:04.780740+0000","last_unstale":"2024-09-12T02:23:17.843012+0000","last_undegraded":"2024-09-12T02:23:17.843012+0000","last_fullsized":"2024-09-12T02:23:17.843012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:30.639111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839819+0000","last_change":"2024-09-12T02:23:16.840250+0000","last_active":"2024-09-12T02:23:17.839819+0000","last_peered":"2024-09-12T02:23:17.839819+0000","last_clean":"2024-09-12T02:23:17.839819+0000","last_became_active":"2024-09-12T02:23:16.839914+0000","last_became_peered":"2024-09-12T02:23:16.839914+0000","last_unstale":"2024-09-12T02:23:17.839819+0000","last_undegraded":"2024-09-12T02:23:17.839819+0000","last_fullsized":"2024-09-12T02:23:17.839819+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:04.798197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.838971+0000","last_change":"2024-09-12T02:23:04.779648+0000","last_active":"2024-09-12T02:23:17.838971+0000","last_peered":"2024-09-12T02:23:17.838971+0000","last_clean":"2024-09-12T02:23:17.838971+0000","last_became_active":"2024-09-12T02:23:04.779384+0000","last_became_peered":"2024-09-12T02:23:04.779384+0000","last_unstale":"2024-09-12T02:23:17.838971+0000","last_undegraded":"2024-09-12T02:23:17.838971+0000","last_fullsized":"2024-09-12T02:23:17.838971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:41.491471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.598038+0000","last_change":"2024-09-12T02:23:16.850060+0000","last_active":"2024-09-12T02:23:19.598038+0000","last_peered":"2024-09-12T02:23:19.598038+0000","last_clean":"2024-09-12T02:23:19.598038+0000","last_became_active":"2024-09-12T02:23:16.849744+0000","last_became_peered":"2024-09-12T02:23:16.849744+0000","last_unstale":"2024-09-12T02:23:19.598038+0000","last_undegraded":"2024-09-12T02:23:19.598038+0000","last_fullsized":"2024-09-12T02:23:19.598038+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:34.130685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841118+0000","last_change":"2024-09-12T02:23:04.779265+0000","last_active":"2024-09-12T02:23:17.841118+0000","last_peered":"2024-09-12T02:23:17.841118+0000","last_clean":"2024-09-12T02:23:17.841118+0000","last_became_active":"2024-09-12T02:23:04.778968+0000","last_became_peered":"2024-09-12T02:23:04.778968+0000","last_unstale":"2024-09-12T02:23:17.841118+0000","last_undegraded":"2024-09-12T02:23:17.841118+0000","last_fullsized":"2024-09-12T02:23:17.841118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:53.022598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444316+0000","last_change":"2024-09-12T02:23:16.862034+0000","last_active":"2024-09-12T02:23:18.444316+0000","last_peered":"2024-09-12T02:23:18.444316+0000","last_clean":"2024-09-12T02:23:18.444316+0000","last_became_active":"2024-09-12T02:23:16.861441+0000","last_became_peered":"2024-09-12T02:23:16.861441+0000","last_unstale":"2024-09-12T02:23:18.444316+0000","last_undegraded":"2024-09-12T02:23:18.444316+0000","last_fullsized":"2024-09-12T02:23:18.444316+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:24.332614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325312+0000","last_change":"2024-09-12T02:23:04.788890+0000","last_active":"2024-09-12T02:23:18.325312+0000","last_peered":"2024-09-12T02:23:18.325312+0000","last_clean":"2024-09-12T02:23:18.325312+0000","last_became_active":"2024-09-12T02:23:04.788617+0000","last_became_peered":"2024-09-12T02:23:04.788617+0000","last_unstale":"2024-09-12T02:23:18.325312+0000","last_undegraded":"2024-09-12T02:23:18.325312+0000","last_fullsized":"2024-09-12T02:23:18.325312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:24.194151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325951+0000","last_change":"2024-09-12T02:23:16.855853+0000","last_active":"2024-09-12T02:23:18.325951+0000","last_peered":"2024-09-12T02:23:18.325951+0000","last_clean":"2024-09-12T02:23:18.325951+0000","last_became_active":"2024-09-12T02:23:16.855437+0000","last_became_peered":"2024-09-12T02:23:16.855437+0000","last_unstale":"2024-09-12T02:23:18.325951+0000","last_undegraded":"2024-09-12T02:23:18.325951+0000","last_fullsized":"2024-09-12T02:23:18.325951+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:27.557862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841894+0000","last_change":"2024-09-12T02:23:04.777165+0000","last_active":"2024-09-12T02:23:17.841894+0000","last_peered":"2024-09-12T02:23:17.841894+0000","last_clean":"2024-09-12T02:23:17.841894+0000","last_became_active":"2024-09-12T02:23:04.776857+0000","last_became_peered":"2024-09-12T02:23:04.776857+0000","last_unstale":"2024-09-12T02:23:17.841894+0000","last_undegraded":"2024-09-12T02:23:17.841894+0000","last_fullsized":"2024-09-12T02:23:17.841894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:28.309591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839032+0000","last_change":"2024-09-12T02:23:16.849235+0000","last_active":"2024-09-12T02:23:17.839032+0000","last_peered":"2024-09-12T02:23:17.839032+0000","last_clean":"2024-09-12T02:23:17.839032+0000","last_became_active":"2024-09-12T02:23:16.848936+0000","last_became_peered":"2024-09-12T02:23:16.848936+0000","last_unstale":"2024-09-12T02:23:17.839032+0000","last_undegraded":"2024-09-12T02:23:17.839032+0000","last_fullsized":"2024-09-12T02:23:17.839032+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:32.415375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325607+0000","last_change":"2024-09-12T02:23:04.786772+0000","last_active":"2024-09-12T02:23:18.325607+0000","last_peered":"2024-09-12T02:23:18.325607+0000","last_clean":"2024-09-12T02:23:18.325607+0000","last_became_active":"2024-09-12T02:23:04.786509+0000","last_became_peered":"2024-09-12T02:23:04.786509+0000","last_unstale":"2024-09-12T02:23:18.325607+0000","last_undegraded":"2024-09-12T02:23:18.325607+0000","last_fullsized":"2024-09-12T02:23:18.325607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:01.755827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673170+0000","last_change":"2024-09-12T02:23:16.834788+0000","last_active":"2024-09-12T02:23:18.673170+0000","last_peered":"2024-09-12T02:23:18.673170+0000","last_clean":"2024-09-12T02:23:18.673170+0000","last_became_active":"2024-09-12T02:23:16.834483+0000","last_became_peered":"2024-09-12T02:23:16.834483+0000","last_unstale":"2024-09-12T02:23:18.673170+0000","last_undegraded":"2024-09-12T02:23:18.673170+0000","last_fullsized":"2024-09-12T02:23:18.673170+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:23.441282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331724+0000","last_change":"2024-09-12T02:23:04.778772+0000","last_active":"2024-09-12T02:23:18.331724+0000","last_peered":"2024-09-12T02:23:18.331724+0000","last_clean":"2024-09-12T02:23:18.331724+0000","last_became_active":"2024-09-12T02:23:04.778445+0000","last_became_peered":"2024-09-12T02:23:04.778445+0000","last_unstale":"2024-09-12T02:23:18.331724+0000","last_undegraded":"2024-09-12T02:23:18.331724+0000","last_fullsized":"2024-09-12T02:23:18.331724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:58.292023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840431+0000","last_change":"2024-09-12T02:23:16.844170+0000","last_active":"2024-09-12T02:23:17.840431+0000","last_peered":"2024-09-12T02:23:17.840431+0000","last_clean":"2024-09-12T02:23:17.840431+0000","last_became_active":"2024-09-12T02:23:16.843880+0000","last_became_peered":"2024-09-12T02:23:16.843880+0000","last_unstale":"2024-09-12T02:23:17.840431+0000","last_undegraded":"2024-09-12T02:23:17.840431+0000","last_fullsized":"2024-09-12T02:23:17.840431+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:59.283416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444520+0000","last_change":"2024-09-12T02:23:04.785821+0000","last_active":"2024-09-12T02:23:18.444520+0000","last_peered":"2024-09-12T02:23:18.444520+0000","last_clean":"2024-09-12T02:23:18.444520+0000","last_became_active":"2024-09-12T02:23:04.785516+0000","last_became_peered":"2024-09-12T02:23:04.785516+0000","last_unstale":"2024-09-12T02:23:18.444520+0000","last_undegraded":"2024-09-12T02:23:18.444520+0000","last_fullsized":"2024-09-12T02:23:18.444520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:42.400040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840987+0000","last_change":"2024-09-12T02:23:16.844145+0000","last_active":"2024-09-12T02:23:17.840987+0000","last_peered":"2024-09-12T02:23:17.840987+0000","last_clean":"2024-09-12T02:23:17.840987+0000","last_became_active":"2024-09-12T02:23:16.843815+0000","last_became_peered":"2024-09-12T02:23:16.843815+0000","last_unstale":"2024-09-12T02:23:17.840987+0000","last_undegraded":"2024-09-12T02:23:17.840987+0000","last_fullsized":"2024-09-12T02:23:17.840987+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:31.789317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842753+0000","last_change":"2024-09-12T02:23:04.791204+0000","last_active":"2024-09-12T02:23:17.842753+0000","last_peered":"2024-09-12T02:23:17.842753+0000","last_clean":"2024-09-12T02:23:17.842753+0000","last_became_active":"2024-09-12T02:23:04.790906+0000","last_became_peered":"2024-09-12T02:23:04.790906+0000","last_unstale":"2024-09-12T02:23:17.842753+0000","last_undegraded":"2024-09-12T02:23:17.842753+0000","last_fullsized":"2024-09-12T02:23:17.842753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:16.336873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476746,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":695559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476746,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":106747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476747,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":105281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":286720,"data_stored":104749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35612,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336228,"statfs":{"total":96636764160,"available":96600297472,"internally_reserved":0,"allocated":270336,"data_stored":104589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36200,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335640,"statfs":{"total":96636764160,"available":96599695360,"internally_reserved":0,"allocated":872448,"data_stored":695525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542154,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35636,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336204,"statfs":{"total":96636764160,"available":96600272896,"internally_reserved":0,"allocated":294912,"data_stored":107765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35632,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336208,"statfs":{"total":96636764160,"available":96600276992,"internally_reserved":0,"allocated":290816,"data_stored":106313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:23:27.227 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T02:23:27.228 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T02:23:27.228 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T02:23:27.228 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T02:23:27.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.361+0000 7f89da650640 1 Processor -- start 2024-09-12T02:23:27.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.361+0000 7f89da650640 1 -- start start 2024-09-12T02:23:27.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.362+0000 7f89da650640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f89d4156d90 0x7f89d4161ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:27.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.362+0000 7f89da650640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89d4157f10 con 0x7f89d415a3e0 2024-09-12T02:23:27.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.362+0000 7f89da650640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89d406c5b0 con 0x7f89d40cc2d0 2024-09-12T02:23:27.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.362+0000 7f89da650640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f89d406c890 con 0x7f89d4156d90 2024-09-12T02:23:27.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.362+0000 7f89d37fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f89d415a3e0 0x7f89d40c7a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53990/0 (socket says 172.21.15.60:53990) 2024-09-12T02:23:27.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.362+0000 7f89d37fe640 1 -- 172.21.15.60:0/3269469740 learned_addr learned my addr 172.21.15.60:0/3269469740 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:27.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.362+0000 7f89d8bed640 1 --2- 172.21.15.60:0/3269469740 >> v2:172.21.15.105:3300/0 conn(0x7f89d4156d90 0x7f89d4161ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:27.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.362+0000 7f89d2ffd640 1 -- 172.21.15.60:0/3269469740 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2490154666 0 0) 0x7f89d4157f10 con 0x7f89d415a3e0 2024-09-12T02:23:27.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.362+0000 7f89d2ffd640 1 -- 172.21.15.60:0/3269469740 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89bc003520 con 0x7f89d415a3e0 2024-09-12T02:23:27.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.363+0000 7f89d2ffd640 1 -- 172.21.15.60:0/3269469740 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 869609911 0 0) 0x7f89d406c5b0 con 0x7f89d40cc2d0 2024-09-12T02:23:27.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.363+0000 7f89d2ffd640 1 -- 172.21.15.60:0/3269469740 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89d4157f10 con 0x7f89d40cc2d0 2024-09-12T02:23:27.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.363+0000 7f89d2ffd640 1 -- 172.21.15.60:0/3269469740 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1424447860 0 0) 0x7f89bc003520 con 0x7f89d415a3e0 2024-09-12T02:23:27.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.363+0000 7f89d2ffd640 1 -- 172.21.15.60:0/3269469740 >> v2:172.21.15.105:3300/0 conn(0x7f89d4156d90 msgr2=0x7f89d4161ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:27.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.363+0000 7f89d2ffd640 1 --2- 172.21.15.60:0/3269469740 >> v2:172.21.15.105:3300/0 conn(0x7f89d4156d90 0x7f89d4161ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:27.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.363+0000 7f89d2ffd640 1 -- 172.21.15.60:0/3269469740 >> v1:172.21.15.105:6789/0 conn(0x7f89d40cc2d0 legacy=0x7f89d4157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:27.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.363+0000 7f89d2ffd640 1 -- 172.21.15.60:0/3269469740 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d4159900 con 0x7f89d415a3e0 2024-09-12T02:23:27.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.363+0000 7f89d2ffd640 1 -- 172.21.15.60:0/3269469740 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7f89c8001670 con 0x7f89d415a3e0 2024-09-12T02:23:27.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.363+0000 7f89d8bed640 1 --2- 172.21.15.60:0/3269469740 >> v2:172.21.15.105:3300/0 conn(0x7f89d4156d90 0x7f89d4161ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:23:27.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.363+0000 7f89d2ffd640 1 -- 172.21.15.60:0/3269469740 >> v1:172.21.15.60:6789/0 conn(0x7f89d415a3e0 legacy=0x7f89d40c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:27.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.363+0000 7f89d2ffd640 1 --2- 172.21.15.60:0/3269469740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89bc003b40 0x7f89bc003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:27.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.363+0000 7f89d2ffd640 1 --2- 172.21.15.60:0/3269469740 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f89bc004800 0x7f89bc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:27.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.363+0000 7f89d2ffd640 1 --2- 172.21.15.60:0/3269469740 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89bc0051c0 0x7f89bc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:27.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.363+0000 7f89d2ffd640 1 -- 172.21.15.60:0/3269469740 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f89d406c890 con 0x7f89bc003b40 2024-09-12T02:23:27.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.363+0000 7f89d2ffd640 1 -- 172.21.15.60:0/3269469740 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f89bc00c040 con 0x7f89bc0051c0 2024-09-12T02:23:27.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.363+0000 7f89d2ffd640 1 -- 172.21.15.60:0/3269469740 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f89bc00c240 con 0x7f89bc004800 2024-09-12T02:23:27.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.363+0000 7f89d3fff640 1 --2- 172.21.15.60:0/3269469740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89bc003b40 0x7f89bc003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:27.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.363+0000 7f89d37fe640 1 --2- 172.21.15.60:0/3269469740 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f89bc004800 0x7f89bc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:27.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.363+0000 7f89d8bed640 1 --2- 172.21.15.60:0/3269469740 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89bc0051c0 0x7f89bc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:27.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.363+0000 7f89d3fff640 1 -- 172.21.15.60:0/3269469740 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f89bc004800 msgr2=0x7f89bc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:27.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.363+0000 7f89d3fff640 1 --2- 172.21.15.60:0/3269469740 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f89bc004800 0x7f89bc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:27.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.363+0000 7f89d3fff640 1 -- 172.21.15.60:0/3269469740 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89bc0051c0 msgr2=0x7f89bc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:27.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.363+0000 7f89d3fff640 1 --2- 172.21.15.60:0/3269469740 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89bc0051c0 0x7f89bc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:27.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.363+0000 7f89d8bed640 1 -- 172.21.15.60:0/3269469740 reap_dead start 2024-09-12T02:23:27.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.363+0000 7f89d3fff640 1 -- 172.21.15.60:0/3269469740 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89bc003520 con 0x7f89bc003b40 2024-09-12T02:23:27.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.364+0000 7f89d3fff640 1 --2- 172.21.15.60:0/3269469740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89bc003b40 0x7f89bc003f40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f89c40018d0 tx=0x7f89bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=705dab1c69a4c73e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:27.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.364+0000 7f89d2ffd640 1 -- 172.21.15.60:0/3269469740 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c40014f0 con 0x7f89bc003b40 2024-09-12T02:23:27.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.364+0000 7f89d2ffd640 1 -- 172.21.15.60:0/3269469740 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89c40052d0 con 0x7f89bc003b40 2024-09-12T02:23:27.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.364+0000 7f89d2ffd640 1 -- 172.21.15.60:0/3269469740 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c402ac40 con 0x7f89bc003b40 2024-09-12T02:23:27.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.365+0000 7f89da650640 1 -- 172.21.15.60:0/3269469740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89bc003b40 msgr2=0x7f89bc003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:27.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.365+0000 7f89da650640 1 --2- 172.21.15.60:0/3269469740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89bc003b40 0x7f89bc003f40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f89c40018d0 tx=0x7f89bc005830 comp rx=0 tx=0).stop 2024-09-12T02:23:27.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.365+0000 7f89da650640 1 -- 172.21.15.60:0/3269469740 shutdown_connections 2024-09-12T02:23:27.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.365+0000 7f89da650640 1 --2- 172.21.15.60:0/3269469740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89bc003b40 0x7f89bc003f40 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:27.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.365+0000 7f89da650640 1 -- 172.21.15.60:0/3269469740 >> 172.21.15.60:0/3269469740 conn(0x7f89d4067fe0 msgr2=0x7f89d4073310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:27.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.365+0000 7f89da650640 1 -- 172.21.15.60:0/3269469740 shutdown_connections 2024-09-12T02:23:27.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.365+0000 7f89da650640 1 -- 172.21.15.60:0/3269469740 wait complete. 2024-09-12T02:23:27.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.366+0000 7f89da650640 1 Processor -- start 2024-09-12T02:23:27.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.366+0000 7f89da650640 1 -- start start 2024-09-12T02:23:27.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.367+0000 7f89da650640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89bc003b40 0x7f89d41e2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:27.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.367+0000 7f89da650640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f89d41ec0c0 0x7f89d41ec540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:27.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.367+0000 7f89da650640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89d41eca80 0x7f89d41ef4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:27.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.367+0000 7f89da650640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f89d41571e0 con 0x7f89bc003b40 2024-09-12T02:23:27.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.367+0000 7f89da650640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f89d4159ec0 con 0x7f89d41eca80 2024-09-12T02:23:27.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.367+0000 7f89da650640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f89d406d2c0 con 0x7f89d41ec0c0 2024-09-12T02:23:27.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.367+0000 7f89d3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89bc003b40 0x7f89d41e2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:27.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.367+0000 7f89d3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89bc003b40 0x7f89d41e2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50188/0 (socket says 172.21.15.60:50188) 2024-09-12T02:23:27.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.367+0000 7f89d3fff640 1 -- 172.21.15.60:0/547112137 learned_addr learned my addr 172.21.15.60:0/547112137 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:27.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.367+0000 7f89d8bed640 1 --2- 172.21.15.60:0/547112137 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89d41eca80 0x7f89d41ef4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:27.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.367+0000 7f89d37fe640 1 --2- 172.21.15.60:0/547112137 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f89d41ec0c0 0x7f89d41ec540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:27.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.367+0000 7f89d3fff640 1 -- 172.21.15.60:0/547112137 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f89d41ec0c0 msgr2=0x7f89d41ec540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:27.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.367+0000 7f89d3fff640 1 --2- 172.21.15.60:0/547112137 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f89d41ec0c0 0x7f89d41ec540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:27.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.367+0000 7f89d3fff640 1 -- 172.21.15.60:0/547112137 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89d41eca80 msgr2=0x7f89d41ef4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:27.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.367+0000 7f89d3fff640 1 --2- 172.21.15.60:0/547112137 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89d41eca80 0x7f89d41ef4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:27.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.367+0000 7f89d3fff640 1 -- 172.21.15.60:0/547112137 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d40acb00 con 0x7f89bc003b40 2024-09-12T02:23:27.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.367+0000 7f89d37fe640 1 --2- 172.21.15.60:0/547112137 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f89d41ec0c0 0x7f89d41ec540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:23:27.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.367+0000 7f89d8bed640 1 --2- 172.21.15.60:0/547112137 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89d41eca80 0x7f89d41ef4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:23:27.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.367+0000 7f89d3fff640 1 --2- 172.21.15.60:0/547112137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89bc003b40 0x7f89d41e2100 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f89c40019f0 tx=0x7f89c40012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:27.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.367+0000 7f89d0ff9640 1 -- 172.21.15.60:0/547112137 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c403f030 con 0x7f89bc003b40 2024-09-12T02:23:27.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.367+0000 7f89d0ff9640 1 -- 172.21.15.60:0/547112137 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89c4006e50 con 0x7f89bc003b40 2024-09-12T02:23:27.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.367+0000 7f89d0ff9640 1 -- 172.21.15.60:0/547112137 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c4037040 con 0x7f89bc003b40 2024-09-12T02:23:27.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.368+0000 7f89da650640 1 -- 172.21.15.60:0/547112137 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89d414de20 con 0x7f89bc003b40 2024-09-12T02:23:27.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.368+0000 7f89da650640 1 -- 172.21.15.60:0/547112137 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89d414e0c0 con 0x7f89bc003b40 2024-09-12T02:23:27.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.369+0000 7f89da650640 1 -- 172.21.15.60:0/547112137 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89d406c1d0 con 0x7f89bc003b40 2024-09-12T02:23:27.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.369+0000 7f89d0ff9640 1 -- 172.21.15.60:0/547112137 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f89c4042070 con 0x7f89bc003b40 2024-09-12T02:23:27.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.369+0000 7f89d0ff9640 1 --2- 172.21.15.60:0/547112137 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f89c006be30 0x7f89c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:27.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.370+0000 7f89d0ff9640 1 -- 172.21.15.60:0/547112137 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f89c40aac20 con 0x7f89bc003b40 2024-09-12T02:23:27.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.370+0000 7f89d37fe640 1 --2- 172.21.15.60:0/547112137 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f89c006be30 0x7f89c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:27.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.370+0000 7f89d37fe640 1 --2- 172.21.15.60:0/547112137 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f89c006be30 0x7f89c006e2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f89d40aecb0 tx=0x7f89c8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:27.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.374+0000 7f89d0ff9640 1 -- 172.21.15.60:0/547112137 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f89c4079330 con 0x7f89bc003b40 2024-09-12T02:23:27.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.585+0000 7f89da650640 1 -- 172.21.15.60:0/547112137 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f89d41593d0 con 0x7f89bc003b40 2024-09-12T02:23:27.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.586+0000 7f89d0ff9640 1 -- 172.21.15.60:0/547112137 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f89c4078c30 con 0x7f89bc003b40 2024-09-12T02:23:27.586 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:23:27.586 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T02:23:27.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.588+0000 7f89da650640 1 -- 172.21.15.60:0/547112137 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f89c006be30 msgr2=0x7f89c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:27.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.588+0000 7f89da650640 1 --2- 172.21.15.60:0/547112137 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f89c006be30 0x7f89c006e2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f89d40aecb0 tx=0x7f89c8009040 comp rx=0 tx=0).stop 2024-09-12T02:23:27.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.588+0000 7f89da650640 1 -- 172.21.15.60:0/547112137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89bc003b40 msgr2=0x7f89d41e2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:27.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.588+0000 7f89da650640 1 --2- 172.21.15.60:0/547112137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89bc003b40 0x7f89d41e2100 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f89c40019f0 tx=0x7f89c40012d0 comp rx=0 tx=0).stop 2024-09-12T02:23:27.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.588+0000 7f89da650640 1 -- 172.21.15.60:0/547112137 shutdown_connections 2024-09-12T02:23:27.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.588+0000 7f89da650640 1 --2- 172.21.15.60:0/547112137 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f89c006be30 0x7f89c006e2f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:27.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.588+0000 7f89da650640 1 --2- 172.21.15.60:0/547112137 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89d41eca80 0x7f89d41ef4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:27.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.588+0000 7f89da650640 1 --2- 172.21.15.60:0/547112137 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f89d41ec0c0 0x7f89d41ec540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:27.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.588+0000 7f89da650640 1 --2- 172.21.15.60:0/547112137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89bc003b40 0x7f89d41e2100 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:27.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.588+0000 7f89da650640 1 -- 172.21.15.60:0/547112137 >> 172.21.15.60:0/547112137 conn(0x7f89d4067fe0 msgr2=0x7f89d4073310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:27.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.588+0000 7f89da650640 1 -- 172.21.15.60:0/547112137 shutdown_connections 2024-09-12T02:23:27.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.588+0000 7f89da650640 1 -- 172.21.15.60:0/547112137 wait complete. 2024-09-12T02:23:27.599 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T02:23:27.600 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:23:27.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.701+0000 7f897aa47640 1 Processor -- start 2024-09-12T02:23:27.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.701+0000 7f897aa47640 1 -- start start 2024-09-12T02:23:27.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.702+0000 7f897aa47640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f897406bbe0 0x7f897406c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:27.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.702+0000 7f897aa47640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f89741598c0 0x7f8974159d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:27.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.702+0000 7f897aa47640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89740c6b20 con 0x7f8974153de0 2024-09-12T02:23:27.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.702+0000 7f897aa47640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f89740c9480 con 0x7f89741598c0 2024-09-12T02:23:27.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.702+0000 7f897aa47640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f89740cb620 con 0x7f897406bbe0 2024-09-12T02:23:27.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.702+0000 7f8978fe4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f89741598c0 0x7f8974159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:27.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.702+0000 7f8973fff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f8974153de0 0x7f89740ca640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53998/0 (socket says 172.21.15.60:53998) 2024-09-12T02:23:27.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.702+0000 7f8973fff640 1 -- 172.21.15.60:0/2759530681 learned_addr learned my addr 172.21.15.60:0/2759530681 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:27.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.702+0000 7f89737fe640 1 --2- 172.21.15.60:0/2759530681 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f897406bbe0 0x7f897406c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:27.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.702+0000 7f8978fe4640 1 -- 172.21.15.60:0/2759530681 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f897406bbe0 msgr2=0x7f897406c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:27.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.702+0000 7f8978fe4640 1 --2- 172.21.15.60:0/2759530681 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f897406bbe0 0x7f897406c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:27.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.702+0000 7f8978fe4640 1 -- 172.21.15.60:0/2759530681 >> v1:172.21.15.60:6789/0 conn(0x7f8974153de0 legacy=0x7f89740ca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:27.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.702+0000 7f8978fe4640 1 -- 172.21.15.60:0/2759530681 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89740c6e00 con 0x7f89741598c0 2024-09-12T02:23:27.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.702+0000 7f8972ffd640 1 -- 172.21.15.60:0/2759530681 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1617767006 0 0) 0x7f89740c6b20 con 0x7f8974153de0 2024-09-12T02:23:27.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.703+0000 7f8978fe4640 1 --2- 172.21.15.60:0/2759530681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89741598c0 0x7f8974159d70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f896c009d90 tx=0x7f896c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a065945a5849a1bb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:27.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.703+0000 7f8972ffd640 1 -- 172.21.15.60:0/2759530681 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896c007740 con 0x7f89741598c0 2024-09-12T02:23:27.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.703+0000 7f8972ffd640 1 -- 172.21.15.60:0/2759530681 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f896c0078e0 con 0x7f89741598c0 2024-09-12T02:23:27.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.703+0000 7f8972ffd640 1 -- 172.21.15.60:0/2759530681 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896c007cb0 con 0x7f89741598c0 2024-09-12T02:23:27.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.704+0000 7f897aa47640 1 -- 172.21.15.60:0/2759530681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89741598c0 msgr2=0x7f8974159d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:27.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.704+0000 7f897aa47640 1 --2- 172.21.15.60:0/2759530681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89741598c0 0x7f8974159d70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f896c009d90 tx=0x7f896c02a660 comp rx=0 tx=0).stop 2024-09-12T02:23:27.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.704+0000 7f897aa47640 1 -- 172.21.15.60:0/2759530681 shutdown_connections 2024-09-12T02:23:27.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.704+0000 7f897aa47640 1 --2- 172.21.15.60:0/2759530681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89741598c0 0x7f8974159d70 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:27.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.704+0000 7f897aa47640 1 --2- 172.21.15.60:0/2759530681 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f897406bbe0 0x7f897406c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:27.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.704+0000 7f897aa47640 1 -- 172.21.15.60:0/2759530681 >> 172.21.15.60:0/2759530681 conn(0x7f89740c8800 msgr2=0x7f89740c8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:27.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.704+0000 7f897aa47640 1 -- 172.21.15.60:0/2759530681 shutdown_connections 2024-09-12T02:23:27.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.704+0000 7f897aa47640 1 -- 172.21.15.60:0/2759530681 wait complete. 2024-09-12T02:23:27.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.705+0000 7f897aa47640 1 Processor -- start 2024-09-12T02:23:27.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.705+0000 7f897aa47640 1 -- start start 2024-09-12T02:23:27.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.706+0000 7f897aa47640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f897406bbe0 0x7f89741541c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:27.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.706+0000 7f897aa47640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8974153de0 0x7f8974158d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:27.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.706+0000 7f897aa47640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89741598c0 0x7f89741ef8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:27.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.706+0000 7f897aa47640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f89740cbab0 con 0x7f8974153de0 2024-09-12T02:23:27.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.706+0000 7f897aa47640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f897406c560 con 0x7f89741598c0 2024-09-12T02:23:27.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.706+0000 7f897aa47640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f897415a2b0 con 0x7f897406bbe0 2024-09-12T02:23:27.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.706+0000 7f89737fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8974153de0 0x7f8974158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:27.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.706+0000 7f89737fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8974153de0 0x7f8974158d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50206/0 (socket says 172.21.15.60:50206) 2024-09-12T02:23:27.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.706+0000 7f89737fe640 1 -- 172.21.15.60:0/2174168105 learned_addr learned my addr 172.21.15.60:0/2174168105 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:27.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.706+0000 7f89737fe640 1 -- 172.21.15.60:0/2174168105 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f897406bbe0 msgr2=0x7f89741541c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:27.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.706+0000 7f89737fe640 1 --2- 172.21.15.60:0/2174168105 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f897406bbe0 0x7f89741541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:27.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.706+0000 7f89737fe640 1 -- 172.21.15.60:0/2174168105 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89741598c0 msgr2=0x7f89741ef8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:27.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.706+0000 7f8978fe4640 1 --2- 172.21.15.60:0/2174168105 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89741598c0 0x7f89741ef8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:27.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.706+0000 7f89737fe640 1 --2- 172.21.15.60:0/2174168105 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89741598c0 0x7f89741ef8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:27.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.706+0000 7f89737fe640 1 -- 172.21.15.60:0/2174168105 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8974156be0 con 0x7f8974153de0 2024-09-12T02:23:27.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.706+0000 7f89737fe640 1 --2- 172.21.15.60:0/2174168105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8974153de0 0x7f8974158d10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f896800e9b0 tx=0x7f896800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:27.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.707+0000 7f8970ff9640 1 -- 172.21.15.60:0/2174168105 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8968017070 con 0x7f8974153de0 2024-09-12T02:23:27.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.707+0000 7f8970ff9640 1 -- 172.21.15.60:0/2174168105 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f896800c9a0 con 0x7f8974153de0 2024-09-12T02:23:27.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.707+0000 7f897aa47640 1 -- 172.21.15.60:0/2174168105 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8974156ec0 con 0x7f8974153de0 2024-09-12T02:23:27.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.707+0000 7f8970ff9640 1 -- 172.21.15.60:0/2174168105 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896800cd70 con 0x7f8974153de0 2024-09-12T02:23:27.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.707+0000 7f897aa47640 1 -- 172.21.15.60:0/2174168105 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8974159250 con 0x7f8974153de0 2024-09-12T02:23:27.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.708+0000 7f897aa47640 1 -- 172.21.15.60:0/2174168105 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f897406c020 con 0x7f8974153de0 2024-09-12T02:23:27.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.708+0000 7f8970ff9640 1 -- 172.21.15.60:0/2174168105 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f896801a070 con 0x7f8974153de0 2024-09-12T02:23:27.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.709+0000 7f8970ff9640 1 --2- 172.21.15.60:0/2174168105 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f896006be60 0x7f896006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:27.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.709+0000 7f8970ff9640 1 -- 172.21.15.60:0/2174168105 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f896808b400 con 0x7f8974153de0 2024-09-12T02:23:27.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.709+0000 7f8973fff640 1 --2- 172.21.15.60:0/2174168105 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f896006be60 0x7f896006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:27.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.709+0000 7f8973fff640 1 --2- 172.21.15.60:0/2174168105 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f896006be60 0x7f896006e320 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8964007fd0 tx=0x7f8964007920 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:27.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.713+0000 7f8970ff9640 1 -- 172.21.15.60:0/2174168105 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8968059b10 con 0x7f8974153de0 2024-09-12T02:23:27.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.925+0000 7f897aa47640 1 -- 172.21.15.60:0/2174168105 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f89740c9600 con 0x7f8974153de0 2024-09-12T02:23:27.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.926+0000 7f8970ff9640 1 -- 172.21.15.60:0/2174168105 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+6524 (secure 0 0 0) 0x7f8968059410 con 0x7f8974153de0 2024-09-12T02:23:27.929 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:23:27.929 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":11,"btime":"2024-09-12T02:23:19:846521+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3208837169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3208837169},{"type":"v1","addr":"172.21.15.60:6836","nonce":3208837169}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/664538827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":664538827},{"type":"v1","addr":"172.21.15.60:6837","nonce":664538827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:23:04.113913+0000","modified":"2024-09-12T02:23:07.140885+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/2854563525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2854563525},{"type":"v1","addr":"172.21.15.105:6835","nonce":2854563525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1},{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:23:16.184151+0000","modified":"2024-09-12T02:23:19.195177+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"d","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6834/248466084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":248466084},{"type":"v1","addr":"172.21.15.105:6834","nonce":248466084}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":2}]} 2024-09-12T02:23:27.930 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 11 2024-09-12T02:23:27.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.928+0000 7f897aa47640 1 -- 172.21.15.60:0/2174168105 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f896006be60 msgr2=0x7f896006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:27.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.928+0000 7f897aa47640 1 --2- 172.21.15.60:0/2174168105 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f896006be60 0x7f896006e320 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8964007fd0 tx=0x7f8964007920 comp rx=0 tx=0).stop 2024-09-12T02:23:27.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.928+0000 7f897aa47640 1 -- 172.21.15.60:0/2174168105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8974153de0 msgr2=0x7f8974158d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:27.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.928+0000 7f897aa47640 1 --2- 172.21.15.60:0/2174168105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8974153de0 0x7f8974158d10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f896800e9b0 tx=0x7f896800ee70 comp rx=0 tx=0).stop 2024-09-12T02:23:27.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.928+0000 7f897aa47640 1 -- 172.21.15.60:0/2174168105 shutdown_connections 2024-09-12T02:23:27.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.928+0000 7f897aa47640 1 --2- 172.21.15.60:0/2174168105 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f896006be60 0x7f896006e320 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:27.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.928+0000 7f897aa47640 1 --2- 172.21.15.60:0/2174168105 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89741598c0 0x7f89741ef8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:27.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.928+0000 7f897aa47640 1 --2- 172.21.15.60:0/2174168105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8974153de0 0x7f8974158d10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:27.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.928+0000 7f897aa47640 1 --2- 172.21.15.60:0/2174168105 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f897406bbe0 0x7f89741541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:27.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.928+0000 7f897aa47640 1 -- 172.21.15.60:0/2174168105 >> 172.21.15.60:0/2174168105 conn(0x7f89740c8800 msgr2=0x7f89740ca0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:27.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.928+0000 7f897aa47640 1 -- 172.21.15.60:0/2174168105 shutdown_connections 2024-09-12T02:23:27.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:27.928+0000 7f897aa47640 1 -- 172.21.15.60:0/2174168105 wait complete. 2024-09-12T02:23:27.940 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:23:28.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.041+0000 7f3d98378640 1 Processor -- start 2024-09-12T02:23:28.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.041+0000 7f3d98378640 1 -- start start 2024-09-12T02:23:28.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.042+0000 7f3d98378640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3d90073ae0 0x7f3d90153380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:28.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.042+0000 7f3d98378640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d90156f50 0x7f3d901538c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:28.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.042+0000 7f3d98378640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d9006dd50 con 0x7f3d900733d0 2024-09-12T02:23:28.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.042+0000 7f3d98378640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f3d9006e030 con 0x7f3d90073ae0 2024-09-12T02:23:28.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.042+0000 7f3d98378640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3d9006e310 con 0x7f3d90156f50 2024-09-12T02:23:28.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.042+0000 7f3d96114640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3d90073ae0 0x7f3d90153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:28.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.042+0000 7f3d96114640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3d90073ae0 0x7f3d90153380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50208/0 (socket says 172.21.15.60:50208) 2024-09-12T02:23:28.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.042+0000 7f3d96114640 1 -- 172.21.15.60:0/2209190316 learned_addr learned my addr 172.21.15.60:0/2209190316 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:28.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.042+0000 7f3d96915640 1 --2- 172.21.15.60:0/2209190316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d90156f50 0x7f3d901538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:28.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.042+0000 7f3d96114640 1 -- 172.21.15.60:0/2209190316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d90156f50 msgr2=0x7f3d901538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:28.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.042+0000 7f3d96114640 1 --2- 172.21.15.60:0/2209190316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d90156f50 0x7f3d901538c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:28.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.042+0000 7f3d96114640 1 -- 172.21.15.60:0/2209190316 >> v1:172.21.15.105:6789/0 conn(0x7f3d900733d0 legacy=0x7f3d90156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:28.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.042+0000 7f3d96114640 1 -- 172.21.15.60:0/2209190316 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d9006e5f0 con 0x7f3d90073ae0 2024-09-12T02:23:28.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.043+0000 7f3d96114640 1 --2- 172.21.15.60:0/2209190316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d90073ae0 0x7f3d90153380 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3d88009870 tx=0x7f3d8802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e2a9094404c157 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:28.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.043+0000 7f3d95112640 1 -- 172.21.15.60:0/2209190316 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d88037070 con 0x7f3d90073ae0 2024-09-12T02:23:28.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.043+0000 7f3d95112640 1 -- 172.21.15.60:0/2209190316 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d88032440 con 0x7f3d90073ae0 2024-09-12T02:23:28.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.043+0000 7f3d95112640 1 -- 172.21.15.60:0/2209190316 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d88032810 con 0x7f3d90073ae0 2024-09-12T02:23:28.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.044+0000 7f3d98378640 1 -- 172.21.15.60:0/2209190316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d90073ae0 msgr2=0x7f3d90153380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:28.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.044+0000 7f3d98378640 1 --2- 172.21.15.60:0/2209190316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d90073ae0 0x7f3d90153380 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3d88009870 tx=0x7f3d8802a270 comp rx=0 tx=0).stop 2024-09-12T02:23:28.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.044+0000 7f3d98378640 1 -- 172.21.15.60:0/2209190316 shutdown_connections 2024-09-12T02:23:28.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.044+0000 7f3d98378640 1 --2- 172.21.15.60:0/2209190316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d90156f50 0x7f3d901538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:28.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.044+0000 7f3d98378640 1 --2- 172.21.15.60:0/2209190316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d90073ae0 0x7f3d90153380 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:28.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.044+0000 7f3d98378640 1 -- 172.21.15.60:0/2209190316 >> 172.21.15.60:0/2209190316 conn(0x7f3d900c9d80 msgr2=0x7f3d900ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:28.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.044+0000 7f3d98378640 1 -- 172.21.15.60:0/2209190316 shutdown_connections 2024-09-12T02:23:28.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.044+0000 7f3d98378640 1 -- 172.21.15.60:0/2209190316 wait complete. 2024-09-12T02:23:28.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.045+0000 7f3d98378640 1 Processor -- start 2024-09-12T02:23:28.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.045+0000 7f3d98378640 1 -- start start 2024-09-12T02:23:28.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.046+0000 7f3d98378640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d900733d0 0x7f3d90147d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:28.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.046+0000 7f3d98378640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d90073ae0 0x7f3d90151610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:28.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.046+0000 7f3d98378640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d90156f50 0x7f3d90151b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:28.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.046+0000 7f3d98378640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3d9006edd0 con 0x7f3d900733d0 2024-09-12T02:23:28.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.046+0000 7f3d98378640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3d9006ec50 con 0x7f3d90073ae0 2024-09-12T02:23:28.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.046+0000 7f3d98378640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3d90073ec0 con 0x7f3d90156f50 2024-09-12T02:23:28.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.046+0000 7f3d96114640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d900733d0 0x7f3d90147d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:28.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.046+0000 7f3d96114640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d900733d0 0x7f3d90147d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50222/0 (socket says 172.21.15.60:50222) 2024-09-12T02:23:28.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.046+0000 7f3d96114640 1 -- 172.21.15.60:0/2099584759 learned_addr learned my addr 172.21.15.60:0/2099584759 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:28.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.046+0000 7f3d96915640 1 --2- 172.21.15.60:0/2099584759 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d90156f50 0x7f3d90151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:28.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.046+0000 7f3d95913640 1 --2- 172.21.15.60:0/2099584759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d90073ae0 0x7f3d90151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:28.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.046+0000 7f3d96114640 1 -- 172.21.15.60:0/2099584759 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d90156f50 msgr2=0x7f3d90151b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:28.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.046+0000 7f3d96114640 1 --2- 172.21.15.60:0/2099584759 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d90156f50 0x7f3d90151b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:28.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.046+0000 7f3d96114640 1 -- 172.21.15.60:0/2099584759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d90073ae0 msgr2=0x7f3d90151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:28.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.046+0000 7f3d96114640 1 --2- 172.21.15.60:0/2099584759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d90073ae0 0x7f3d90151610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:28.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.046+0000 7f3d96114640 1 -- 172.21.15.60:0/2099584759 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d901489b0 con 0x7f3d900733d0 2024-09-12T02:23:28.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.046+0000 7f3d95913640 1 --2- 172.21.15.60:0/2099584759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d90073ae0 0x7f3d90151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:23:28.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.046+0000 7f3d96114640 1 --2- 172.21.15.60:0/2099584759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d900733d0 0x7f3d90147d30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3d88000c00 tx=0x7f3d880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:28.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.046+0000 7f3d8effd640 1 -- 172.21.15.60:0/2099584759 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d88041020 con 0x7f3d900733d0 2024-09-12T02:23:28.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.046+0000 7f3d8effd640 1 -- 172.21.15.60:0/2099584759 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d880306c0 con 0x7f3d900733d0 2024-09-12T02:23:28.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.046+0000 7f3d8effd640 1 -- 172.21.15.60:0/2099584759 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d88037040 con 0x7f3d900733d0 2024-09-12T02:23:28.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.046+0000 7f3d98378640 1 -- 172.21.15.60:0/2099584759 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d901ecb80 con 0x7f3d900733d0 2024-09-12T02:23:28.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.047+0000 7f3d98378640 1 -- 172.21.15.60:0/2099584759 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d90147930 con 0x7f3d900733d0 2024-09-12T02:23:28.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.047+0000 7f3d98378640 1 -- 172.21.15.60:0/2099584759 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d9006d850 con 0x7f3d900733d0 2024-09-12T02:23:28.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.048+0000 7f3d8effd640 1 -- 172.21.15.60:0/2099584759 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3d88044020 con 0x7f3d900733d0 2024-09-12T02:23:28.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.048+0000 7f3d8effd640 1 --2- 172.21.15.60:0/2099584759 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3d7c06be30 0x7f3d7c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:28.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.048+0000 7f3d8effd640 1 -- 172.21.15.60:0/2099584759 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f3d880ab870 con 0x7f3d900733d0 2024-09-12T02:23:28.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.048+0000 7f3d95913640 1 --2- 172.21.15.60:0/2099584759 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3d7c06be30 0x7f3d7c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:28.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.049+0000 7f3d95913640 1 --2- 172.21.15.60:0/2099584759 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3d7c06be30 0x7f3d7c06e2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3d90150770 tx=0x7f3d84009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:28.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.053+0000 7f3d8effd640 1 -- 172.21.15.60:0/2099584759 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3d8804b030 con 0x7f3d900733d0 2024-09-12T02:23:28.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.265+0000 7f3d98378640 1 -- 172.21.15.60:0/2099584759 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3d900c4080 con 0x7f3d900733d0 2024-09-12T02:23:28.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.265+0000 7f3d8effd640 1 -- 172.21.15.60:0/2099584759 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+6524 (secure 0 0 0) 0x7f3d8807a0a0 con 0x7f3d900733d0 2024-09-12T02:23:28.266 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:23:28.266 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":11,"btime":"2024-09-12T02:23:19:846521+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3208837169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3208837169},{"type":"v1","addr":"172.21.15.60:6836","nonce":3208837169}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/664538827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":664538827},{"type":"v1","addr":"172.21.15.60:6837","nonce":664538827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:23:04.113913+0000","modified":"2024-09-12T02:23:07.140885+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/2854563525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2854563525},{"type":"v1","addr":"172.21.15.105:6835","nonce":2854563525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1},{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:23:16.184151+0000","modified":"2024-09-12T02:23:19.195177+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"d","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6834/248466084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":248466084},{"type":"v1","addr":"172.21.15.105:6834","nonce":248466084}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":2}]} 2024-09-12T02:23:28.266 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 11 2024-09-12T02:23:28.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.267+0000 7f3d98378640 1 -- 172.21.15.60:0/2099584759 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3d7c06be30 msgr2=0x7f3d7c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:28.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.267+0000 7f3d98378640 1 --2- 172.21.15.60:0/2099584759 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3d7c06be30 0x7f3d7c06e2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3d90150770 tx=0x7f3d84009040 comp rx=0 tx=0).stop 2024-09-12T02:23:28.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.267+0000 7f3d98378640 1 -- 172.21.15.60:0/2099584759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d900733d0 msgr2=0x7f3d90147d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:28.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.267+0000 7f3d98378640 1 --2- 172.21.15.60:0/2099584759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d900733d0 0x7f3d90147d30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3d88000c00 tx=0x7f3d880046c0 comp rx=0 tx=0).stop 2024-09-12T02:23:28.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.267+0000 7f3d98378640 1 -- 172.21.15.60:0/2099584759 shutdown_connections 2024-09-12T02:23:28.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.267+0000 7f3d98378640 1 --2- 172.21.15.60:0/2099584759 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3d7c06be30 0x7f3d7c06e2f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:28.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.267+0000 7f3d98378640 1 --2- 172.21.15.60:0/2099584759 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d90156f50 0x7f3d90151b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:28.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.267+0000 7f3d98378640 1 --2- 172.21.15.60:0/2099584759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d90073ae0 0x7f3d90151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:28.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.267+0000 7f3d98378640 1 --2- 172.21.15.60:0/2099584759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d900733d0 0x7f3d90147d30 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:28.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.267+0000 7f3d98378640 1 -- 172.21.15.60:0/2099584759 >> 172.21.15.60:0/2099584759 conn(0x7f3d900c9d80 msgr2=0x7f3d90153150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:28.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.267+0000 7f3d98378640 1 -- 172.21.15.60:0/2099584759 shutdown_connections 2024-09-12T02:23:28.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.267+0000 7f3d98378640 1 -- 172.21.15.60:0/2099584759 wait complete. 2024-09-12T02:23:28.278 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:23:28.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.380+0000 7f8903791640 1 Processor -- start 2024-09-12T02:23:28.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.380+0000 7f8903791640 1 -- start start 2024-09-12T02:23:28.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.381+0000 7f8903791640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88fc06c650 0x7f88fc0c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:28.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.381+0000 7f8903791640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f88fc0ca1c0 0x7f88fc160bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:28.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.381+0000 7f8903791640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88fc15a7c0 con 0x7f88fc150480 2024-09-12T02:23:28.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.381+0000 7f8903791640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f88fc06c240 con 0x7f88fc0ca1c0 2024-09-12T02:23:28.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.381+0000 7f8903791640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f88fc15a330 con 0x7f88fc06c650 2024-09-12T02:23:28.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.381+0000 7f890152d640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f88fc150480 0x7f88fc0c7a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:54000/0 (socket says 172.21.15.60:54000) 2024-09-12T02:23:28.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.381+0000 7f890152d640 1 -- 172.21.15.60:0/1886885301 learned_addr learned my addr 172.21.15.60:0/1886885301 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:28.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.382+0000 7f8900d2c640 1 --2- 172.21.15.60:0/1886885301 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88fc06c650 0x7f88fc0c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:28.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.382+0000 7f88fbfff640 1 -- 172.21.15.60:0/1886885301 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3401904331 0 0) 0x7f88fc15a7c0 con 0x7f88fc150480 2024-09-12T02:23:28.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.382+0000 7f88fbfff640 1 -- 172.21.15.60:0/1886885301 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88e4003520 con 0x7f88fc150480 2024-09-12T02:23:28.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.382+0000 7f8901d2e640 1 --2- 172.21.15.60:0/1886885301 >> v2:172.21.15.105:3300/0 conn(0x7f88fc0ca1c0 0x7f88fc160bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:28.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.382+0000 7f88fbfff640 1 -- 172.21.15.60:0/1886885301 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3071460120 0 0) 0x7f88e4003520 con 0x7f88fc150480 2024-09-12T02:23:28.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.382+0000 7f88fbfff640 1 -- 172.21.15.60:0/1886885301 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88fc06c650 msgr2=0x7f88fc0c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:28.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.382+0000 7f88fbfff640 1 --2- 172.21.15.60:0/1886885301 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88fc06c650 0x7f88fc0c9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:28.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.382+0000 7f88fbfff640 1 -- 172.21.15.60:0/1886885301 >> v2:172.21.15.105:3300/0 conn(0x7f88fc0ca1c0 msgr2=0x7f88fc160bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:28.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.382+0000 7f88fbfff640 1 --2- 172.21.15.60:0/1886885301 >> v2:172.21.15.105:3300/0 conn(0x7f88fc0ca1c0 0x7f88fc160bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:28.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.382+0000 7f88fbfff640 1 -- 172.21.15.60:0/1886885301 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88fc159a00 con 0x7f88fc150480 2024-09-12T02:23:28.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.382+0000 7f88fbfff640 1 -- 172.21.15.60:0/1886885301 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7f88f4001670 con 0x7f88fc150480 2024-09-12T02:23:28.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.382+0000 7f8901d2e640 1 --2- 172.21.15.60:0/1886885301 >> v2:172.21.15.105:3300/0 conn(0x7f88fc0ca1c0 0x7f88fc160bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:23:28.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.382+0000 7f88fbfff640 1 -- 172.21.15.60:0/1886885301 >> v1:172.21.15.60:6789/0 conn(0x7f88fc150480 legacy=0x7f88fc0c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:28.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.382+0000 7f88fbfff640 1 --2- 172.21.15.60:0/1886885301 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88e40039b0 0x7f88e4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:28.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.382+0000 7f88fbfff640 1 --2- 172.21.15.60:0/1886885301 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88e4004800 0x7f88e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:28.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.382+0000 7f88fbfff640 1 --2- 172.21.15.60:0/1886885301 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88fc06c650 0x7f88e40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:28.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.382+0000 7f88fbfff640 1 -- 172.21.15.60:0/1886885301 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f88fc15a330 con 0x7f88e4004800 2024-09-12T02:23:28.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.382+0000 7f88fbfff640 1 -- 172.21.15.60:0/1886885301 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f88e400b9c0 con 0x7f88e40039b0 2024-09-12T02:23:28.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.382+0000 7f88fbfff640 1 -- 172.21.15.60:0/1886885301 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f88e400bb40 con 0x7f88fc06c650 2024-09-12T02:23:28.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.382+0000 7f8900d2c640 1 --2- 172.21.15.60:0/1886885301 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88e4004800 0x7f88e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:28.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.382+0000 7f890152d640 1 --2- 172.21.15.60:0/1886885301 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88e40039b0 0x7f88e4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:28.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.382+0000 7f8901d2e640 1 --2- 172.21.15.60:0/1886885301 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88fc06c650 0x7f88e40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:28.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.382+0000 7f8900d2c640 1 -- 172.21.15.60:0/1886885301 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88fc06c650 msgr2=0x7f88e40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:28.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.382+0000 7f8900d2c640 1 --2- 172.21.15.60:0/1886885301 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88fc06c650 0x7f88e40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:28.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.382+0000 7f8900d2c640 1 -- 172.21.15.60:0/1886885301 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88e40039b0 msgr2=0x7f88e4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:28.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.382+0000 7f8900d2c640 1 --2- 172.21.15.60:0/1886885301 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88e40039b0 0x7f88e4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:28.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.382+0000 7f8900d2c640 1 -- 172.21.15.60:0/1886885301 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88e4003520 con 0x7f88e4004800 2024-09-12T02:23:28.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.383+0000 7f8900d2c640 1 --2- 172.21.15.60:0/1886885301 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88e4004800 0x7f88e4004c80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f88f0009a90 tx=0x7f88e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7ab2fcaf0f41f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:28.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.383+0000 7f88fbfff640 1 -- 172.21.15.60:0/1886885301 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f0036070 con 0x7f88e4004800 2024-09-12T02:23:28.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.383+0000 7f88fbfff640 1 -- 172.21.15.60:0/1886885301 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88f0031400 con 0x7f88e4004800 2024-09-12T02:23:28.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.383+0000 7f88fbfff640 1 -- 172.21.15.60:0/1886885301 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f0009690 con 0x7f88e4004800 2024-09-12T02:23:28.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.384+0000 7f8903791640 1 -- 172.21.15.60:0/1886885301 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88e4004800 msgr2=0x7f88e4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:28.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.384+0000 7f8903791640 1 --2- 172.21.15.60:0/1886885301 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88e4004800 0x7f88e4004c80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f88f0009a90 tx=0x7f88e4005830 comp rx=0 tx=0).stop 2024-09-12T02:23:28.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.384+0000 7f8901d2e640 1 -- 172.21.15.60:0/1886885301 reap_dead start 2024-09-12T02:23:28.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.384+0000 7f8903791640 1 -- 172.21.15.60:0/1886885301 shutdown_connections 2024-09-12T02:23:28.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.384+0000 7f8903791640 1 -- 172.21.15.60:0/1886885301 >> 172.21.15.60:0/1886885301 conn(0x7f88fc068030 msgr2=0x7f88fc073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:28.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.384+0000 7f8903791640 1 -- 172.21.15.60:0/1886885301 shutdown_connections 2024-09-12T02:23:28.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.384+0000 7f8903791640 1 -- 172.21.15.60:0/1886885301 wait complete. 2024-09-12T02:23:28.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.385+0000 7f8903791640 1 Processor -- start 2024-09-12T02:23:28.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.385+0000 7f8903791640 1 -- start start 2024-09-12T02:23:28.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.386+0000 7f8903791640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88e4004800 0x7f88fc14ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:28.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.386+0000 7f8903791640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88fc149780 0x7f88fc1ef520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:28.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.386+0000 7f8903791640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88fc1efa60 0x7f88fc1e2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:28.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.386+0000 7f8903791640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f88fc0ca670 con 0x7f88fc1efa60 2024-09-12T02:23:28.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.386+0000 7f8903791640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f88fc159fc0 con 0x7f88e4004800 2024-09-12T02:23:28.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.386+0000 7f8903791640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f88fc06d270 con 0x7f88fc149780 2024-09-12T02:23:28.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.386+0000 7f8901d2e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88fc1efa60 0x7f88fc1e2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:28.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.386+0000 7f8901d2e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88fc1efa60 0x7f88fc1e2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50242/0 (socket says 172.21.15.60:50242) 2024-09-12T02:23:28.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.386+0000 7f8901d2e640 1 -- 172.21.15.60:0/587434112 learned_addr learned my addr 172.21.15.60:0/587434112 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:28.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.386+0000 7f890152d640 1 --2- 172.21.15.60:0/587434112 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88e4004800 0x7f88fc14ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:28.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.386+0000 7f8900d2c640 1 --2- 172.21.15.60:0/587434112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88fc149780 0x7f88fc1ef520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:28.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.386+0000 7f8901d2e640 1 -- 172.21.15.60:0/587434112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88fc149780 msgr2=0x7f88fc1ef520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:28.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.386+0000 7f8901d2e640 1 --2- 172.21.15.60:0/587434112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88fc149780 0x7f88fc1ef520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:28.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.386+0000 7f8901d2e640 1 -- 172.21.15.60:0/587434112 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88e4004800 msgr2=0x7f88fc14ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:28.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.386+0000 7f8901d2e640 1 --2- 172.21.15.60:0/587434112 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88e4004800 0x7f88fc14ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:28.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.386+0000 7f8901d2e640 1 -- 172.21.15.60:0/587434112 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88fc14e6f0 con 0x7f88fc1efa60 2024-09-12T02:23:28.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.386+0000 7f8901d2e640 1 --2- 172.21.15.60:0/587434112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88fc1efa60 0x7f88fc1e2b10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f88fc06bc70 tx=0x7f88ec010530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:28.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.386+0000 7f88f9ffb640 1 -- 172.21.15.60:0/587434112 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ec010d50 con 0x7f88fc1efa60 2024-09-12T02:23:28.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.387+0000 7f88f9ffb640 1 -- 172.21.15.60:0/587434112 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88ec003990 con 0x7f88fc1efa60 2024-09-12T02:23:28.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.387+0000 7f8903791640 1 -- 172.21.15.60:0/587434112 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88fc0b0bf0 con 0x7f88fc1efa60 2024-09-12T02:23:28.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.387+0000 7f88f9ffb640 1 -- 172.21.15.60:0/587434112 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ec003b80 con 0x7f88fc1efa60 2024-09-12T02:23:28.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.387+0000 7f8903791640 1 -- 172.21.15.60:0/587434112 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88fc0b05a0 con 0x7f88fc1efa60 2024-09-12T02:23:28.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.388+0000 7f8903791640 1 -- 172.21.15.60:0/587434112 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88fc06c430 con 0x7f88fc1efa60 2024-09-12T02:23:28.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.388+0000 7f88f9ffb640 1 -- 172.21.15.60:0/587434112 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f88ec01e030 con 0x7f88fc1efa60 2024-09-12T02:23:28.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.389+0000 7f88f9ffb640 1 --2- 172.21.15.60:0/587434112 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f88e806be30 0x7f88e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:28.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.389+0000 7f88f9ffb640 1 -- 172.21.15.60:0/587434112 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f88ec08b770 con 0x7f88fc1efa60 2024-09-12T02:23:28.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.389+0000 7f890152d640 1 --2- 172.21.15.60:0/587434112 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f88e806be30 0x7f88e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:28.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.389+0000 7f890152d640 1 --2- 172.21.15.60:0/587434112 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f88e806be30 0x7f88e806e2f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f88f4001eb0 tx=0x7f88f4007970 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:28.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.393+0000 7f88f9ffb640 1 -- 172.21.15.60:0/587434112 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f88ec025020 con 0x7f88fc1efa60 2024-09-12T02:23:28.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.569+0000 7f8903791640 1 -- 172.21.15.60:0/587434112 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f88fc155df0 con 0x7f88fc1efa60 2024-09-12T02:23:28.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.570+0000 7f88f9ffb640 1 -- 172.21.15.60:0/587434112 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+20439 (secure 0 0 0) 0x7f88ec059e80 con 0x7f88fc1efa60 2024-09-12T02:23:28.571 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:23:28.571 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":26,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","created":"2024-09-12T02:22:39.869862+0000","modified":"2024-09-12T02:23:17.835334+0000","last_up_change":"2024-09-12T02:22:53.459371+0000","last_in_change":"2024-09-12T02:22:42.817076+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:22:52.130579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-09-12T02:23:01.854763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-09-12T02:23:03.104847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-09-12T02:23:14.175168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-09-12T02:23:15.166293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0f0c7386-002f-47e2-a7a3-6c8a70264cc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6819","nonce":1789465659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6821","nonce":1789465659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6825","nonce":1789465659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6823","nonce":1789465659}]},"public_addr":"172.21.15.60:6819/1789465659","cluster_addr":"172.21.15.60:6821/1789465659","heartbeat_back_addr":"172.21.15.60:6825/1789465659","heartbeat_front_addr":"172.21.15.60:6823/1789465659","state":["exists","up"]},{"osd":1,"uuid":"64be7b84-36fc-43c0-9e70-a617e5b68941","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6811","nonce":1109822408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6813","nonce":1109822408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6817","nonce":1109822408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6815","nonce":1109822408}]},"public_addr":"172.21.15.60:6811/1109822408","cluster_addr":"172.21.15.60:6813/1109822408","heartbeat_back_addr":"172.21.15.60:6817/1109822408","heartbeat_front_addr":"172.21.15.60:6815/1109822408","state":["exists","up"]},{"osd":2,"uuid":"df00caa1-d45e-4b87-ac1e-8bc098d509d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6827","nonce":278470077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6829","nonce":278470077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6833","nonce":278470077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6831","nonce":278470077}]},"public_addr":"172.21.15.60:6827/278470077","cluster_addr":"172.21.15.60:6829/278470077","heartbeat_back_addr":"172.21.15.60:6833/278470077","heartbeat_front_addr":"172.21.15.60:6831/278470077","state":["exists","up"]},{"osd":3,"uuid":"f6453471-893a-490b-b0c7-f196a0f574e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6803","nonce":3606424156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6805","nonce":3606424156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6809","nonce":3606424156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6807","nonce":3606424156}]},"public_addr":"172.21.15.60:6803/3606424156","cluster_addr":"172.21.15.60:6805/3606424156","heartbeat_back_addr":"172.21.15.60:6809/3606424156","heartbeat_front_addr":"172.21.15.60:6807/3606424156","state":["exists","up"]},{"osd":4,"uuid":"96e908b6-ce3e-466c-b02d-08fc71a1dba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6809","nonce":1581641129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6811","nonce":1581641129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6815","nonce":1581641129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6813","nonce":1581641129}]},"public_addr":"172.21.15.105:6809/1581641129","cluster_addr":"172.21.15.105:6811/1581641129","heartbeat_back_addr":"172.21.15.105:6815/1581641129","heartbeat_front_addr":"172.21.15.105:6813/1581641129","state":["exists","up"]},{"osd":5,"uuid":"7ebc26f0-a462-4364-9303-7351f7cba21f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6825","nonce":1392337793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6827","nonce":1392337793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6831","nonce":1392337793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6829","nonce":1392337793}]},"public_addr":"172.21.15.105:6825/1392337793","cluster_addr":"172.21.15.105:6827/1392337793","heartbeat_back_addr":"172.21.15.105:6831/1392337793","heartbeat_front_addr":"172.21.15.105:6829/1392337793","state":["exists","up"]},{"osd":6,"uuid":"49487ea1-9c6d-4090-bbcc-f28b33040eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6801","nonce":50951309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6803","nonce":50951309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6807","nonce":50951309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6805","nonce":50951309}]},"public_addr":"172.21.15.105:6801/50951309","cluster_addr":"172.21.15.105:6803/50951309","heartbeat_back_addr":"172.21.15.105:6807/50951309","heartbeat_front_addr":"172.21.15.105:6805/50951309","state":["exists","up"]},{"osd":7,"uuid":"1e3a0aa9-7e29-4785-8506-6b5d3be2be35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6817","nonce":3745331251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6819","nonce":3745331251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6823","nonce":3745331251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6821","nonce":3745331251}]},"public_addr":"172.21.15.105:6817/3745331251","cluster_addr":"172.21.15.105:6819/3745331251","heartbeat_back_addr":"172.21.15.105:6823/3745331251","heartbeat_front_addr":"172.21.15.105:6821/3745331251","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:50.112629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.307689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.542851+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.334773+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:50.096967+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:50.259633+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.888988+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.917421+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:23:28.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.572+0000 7f8903791640 1 -- 172.21.15.60:0/587434112 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f88e806be30 msgr2=0x7f88e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:28.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.572+0000 7f8903791640 1 --2- 172.21.15.60:0/587434112 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f88e806be30 0x7f88e806e2f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f88f4001eb0 tx=0x7f88f4007970 comp rx=0 tx=0).stop 2024-09-12T02:23:28.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.572+0000 7f8903791640 1 -- 172.21.15.60:0/587434112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88fc1efa60 msgr2=0x7f88fc1e2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:28.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.572+0000 7f8903791640 1 --2- 172.21.15.60:0/587434112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88fc1efa60 0x7f88fc1e2b10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f88fc06bc70 tx=0x7f88ec010530 comp rx=0 tx=0).stop 2024-09-12T02:23:28.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.572+0000 7f8903791640 1 -- 172.21.15.60:0/587434112 shutdown_connections 2024-09-12T02:23:28.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.572+0000 7f8903791640 1 --2- 172.21.15.60:0/587434112 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f88e806be30 0x7f88e806e2f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:28.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.572+0000 7f8903791640 1 --2- 172.21.15.60:0/587434112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88fc1efa60 0x7f88fc1e2b10 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:28.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.572+0000 7f8903791640 1 --2- 172.21.15.60:0/587434112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88fc149780 0x7f88fc1ef520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:28.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.572+0000 7f8903791640 1 --2- 172.21.15.60:0/587434112 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88e4004800 0x7f88fc14ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:28.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.572+0000 7f8903791640 1 -- 172.21.15.60:0/587434112 >> 172.21.15.60:0/587434112 conn(0x7f88fc068030 msgr2=0x7f88fc073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:28.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.573+0000 7f8903791640 1 -- 172.21.15.60:0/587434112 shutdown_connections 2024-09-12T02:23:28.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.573+0000 7f8903791640 1 -- 172.21.15.60:0/587434112 wait complete. 2024-09-12T02:23:28.585 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:23:28.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.686+0000 7fee25eed640 1 Processor -- start 2024-09-12T02:23:28.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.686+0000 7fee25eed640 1 -- start start 2024-09-12T02:23:28.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.687+0000 7fee25eed640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee200afdd0 0x7fee200c5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:28.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.687+0000 7fee25eed640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee200c54e0 con 0x7fee20153af0 2024-09-12T02:23:28.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.687+0000 7fee25eed640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee200c74a0 con 0x7fee200af870 2024-09-12T02:23:28.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.687+0000 7fee25eed640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fee200c7740 con 0x7fee200afdd0 2024-09-12T02:23:28.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.687+0000 7fee1f7fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fee20153af0 0x7fee201563a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:54006/0 (socket says 172.21.15.60:54006) 2024-09-12T02:23:28.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.687+0000 7fee1f7fe640 1 -- 172.21.15.60:0/1399397359 learned_addr learned my addr 172.21.15.60:0/1399397359 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:28.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.687+0000 7fee1e7fc640 1 -- 172.21.15.60:0/1399397359 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2412499006 0 0) 0x7fee200c54e0 con 0x7fee20153af0 2024-09-12T02:23:28.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.687+0000 7fee1e7fc640 1 -- 172.21.15.60:0/1399397359 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee08003520 con 0x7fee20153af0 2024-09-12T02:23:28.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.687+0000 7fee1effd640 1 --2- 172.21.15.60:0/1399397359 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee200afdd0 0x7fee200c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:28.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.688+0000 7fee1e7fc640 1 -- 172.21.15.60:0/1399397359 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3887309310 0 0) 0x7fee08003520 con 0x7fee20153af0 2024-09-12T02:23:28.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.688+0000 7fee1e7fc640 1 -- 172.21.15.60:0/1399397359 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee200afdd0 msgr2=0x7fee200c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:28.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.688+0000 7fee1e7fc640 1 --2- 172.21.15.60:0/1399397359 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee200afdd0 0x7fee200c5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:28.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.688+0000 7fee1e7fc640 1 -- 172.21.15.60:0/1399397359 >> v1:172.21.15.105:6789/0 conn(0x7fee200af870 legacy=0x7fee200c4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:28.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.688+0000 7fee1e7fc640 1 -- 172.21.15.60:0/1399397359 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee2015a3c0 con 0x7fee20153af0 2024-09-12T02:23:28.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.688+0000 7fee1e7fc640 1 -- 172.21.15.60:0/1399397359 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7fee10001670 con 0x7fee20153af0 2024-09-12T02:23:28.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.688+0000 7fee1e7fc640 1 -- 172.21.15.60:0/1399397359 >> v1:172.21.15.60:6789/0 conn(0x7fee20153af0 legacy=0x7fee201563a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:28.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.688+0000 7fee1e7fc640 1 --2- 172.21.15.60:0/1399397359 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee080039e0 0x7fee08003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:28.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.688+0000 7fee1e7fc640 1 --2- 172.21.15.60:0/1399397359 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee08004800 0x7fee08004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:28.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.688+0000 7fee1e7fc640 1 --2- 172.21.15.60:0/1399397359 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee200afdd0 0x7fee08005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:28.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.688+0000 7fee1e7fc640 1 -- 172.21.15.60:0/1399397359 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fee200c7740 con 0x7fee080039e0 2024-09-12T02:23:28.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.688+0000 7fee1e7fc640 1 -- 172.21.15.60:0/1399397359 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fee0800bbb0 con 0x7fee08004800 2024-09-12T02:23:28.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.688+0000 7fee1e7fc640 1 -- 172.21.15.60:0/1399397359 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fee0800bdb0 con 0x7fee200afdd0 2024-09-12T02:23:28.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.688+0000 7fee1f7fe640 1 --2- 172.21.15.60:0/1399397359 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee080039e0 0x7fee08003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:28.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.688+0000 7fee1effd640 1 --2- 172.21.15.60:0/1399397359 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee08004800 0x7fee08004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:28.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.688+0000 7fee1ffff640 1 --2- 172.21.15.60:0/1399397359 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee200afdd0 0x7fee08005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:28.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.688+0000 7fee1f7fe640 1 -- 172.21.15.60:0/1399397359 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee200afdd0 msgr2=0x7fee08005290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:28.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.688+0000 7fee1f7fe640 1 --2- 172.21.15.60:0/1399397359 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee200afdd0 0x7fee08005290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:28.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.688+0000 7fee1f7fe640 1 -- 172.21.15.60:0/1399397359 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee08004800 msgr2=0x7fee08004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:28.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.688+0000 7fee1f7fe640 1 --2- 172.21.15.60:0/1399397359 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee08004800 0x7fee08004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:28.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.688+0000 7fee1f7fe640 1 -- 172.21.15.60:0/1399397359 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee08003520 con 0x7fee080039e0 2024-09-12T02:23:28.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.689+0000 7fee1f7fe640 1 --2- 172.21.15.60:0/1399397359 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee080039e0 0x7fee08003e00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fee1000c210 tx=0x7fee08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=319bd9a1176e159 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:28.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.689+0000 7fee1e7fc640 1 -- 172.21.15.60:0/1399397359 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee10007d30 con 0x7fee080039e0 2024-09-12T02:23:28.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.689+0000 7fee1e7fc640 1 -- 172.21.15.60:0/1399397359 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee10005ad0 con 0x7fee080039e0 2024-09-12T02:23:28.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.689+0000 7fee1e7fc640 1 -- 172.21.15.60:0/1399397359 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee10007070 con 0x7fee080039e0 2024-09-12T02:23:28.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.690+0000 7fee25eed640 1 -- 172.21.15.60:0/1399397359 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee080039e0 msgr2=0x7fee08003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:28.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.690+0000 7fee25eed640 1 --2- 172.21.15.60:0/1399397359 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee080039e0 0x7fee08003e00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fee1000c210 tx=0x7fee08005830 comp rx=0 tx=0).stop 2024-09-12T02:23:28.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.690+0000 7fee1ffff640 1 -- 172.21.15.60:0/1399397359 reap_dead start 2024-09-12T02:23:28.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.690+0000 7fee25eed640 1 -- 172.21.15.60:0/1399397359 shutdown_connections 2024-09-12T02:23:28.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.690+0000 7fee25eed640 1 -- 172.21.15.60:0/1399397359 >> 172.21.15.60:0/1399397359 conn(0x7fee200c6880 msgr2=0x7fee200c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:28.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.690+0000 7fee25eed640 1 -- 172.21.15.60:0/1399397359 shutdown_connections 2024-09-12T02:23:28.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.690+0000 7fee25eed640 1 -- 172.21.15.60:0/1399397359 wait complete. 2024-09-12T02:23:28.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.691+0000 7fee25eed640 1 Processor -- start 2024-09-12T02:23:28.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.691+0000 7fee25eed640 1 -- start start 2024-09-12T02:23:28.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.692+0000 7fee25eed640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee080039e0 0x7fee20156e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:28.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.692+0000 7fee25eed640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee201e3560 0x7fee201e14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:28.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.692+0000 7fee25eed640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee201e1a20 0x7fee201ef3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:28.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.692+0000 7fee25eed640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fee200c5010 con 0x7fee080039e0 2024-09-12T02:23:28.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.692+0000 7fee25eed640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fee200c4e90 con 0x7fee201e1a20 2024-09-12T02:23:28.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.692+0000 7fee25eed640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fee200c5190 con 0x7fee201e3560 2024-09-12T02:23:28.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.692+0000 7fee1f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee080039e0 0x7fee20156e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:28.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.692+0000 7fee1f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee080039e0 0x7fee20156e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50248/0 (socket says 172.21.15.60:50248) 2024-09-12T02:23:28.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.692+0000 7fee1f7fe640 1 -- 172.21.15.60:0/3228106854 learned_addr learned my addr 172.21.15.60:0/3228106854 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:28.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.692+0000 7fee1effd640 1 --2- 172.21.15.60:0/3228106854 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee201e3560 0x7fee201e14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:28.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.692+0000 7fee1ffff640 1 --2- 172.21.15.60:0/3228106854 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee201e1a20 0x7fee201ef3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:28.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.692+0000 7fee1f7fe640 1 -- 172.21.15.60:0/3228106854 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee201e3560 msgr2=0x7fee201e14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:28.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.692+0000 7fee1f7fe640 1 --2- 172.21.15.60:0/3228106854 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee201e3560 0x7fee201e14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:28.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.692+0000 7fee1f7fe640 1 -- 172.21.15.60:0/3228106854 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee201e1a20 msgr2=0x7fee201ef3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:28.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.692+0000 7fee1f7fe640 1 --2- 172.21.15.60:0/3228106854 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee201e1a20 0x7fee201ef3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:28.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.692+0000 7fee1f7fe640 1 -- 172.21.15.60:0/3228106854 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee2014e3c0 con 0x7fee080039e0 2024-09-12T02:23:28.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.692+0000 7fee1f7fe640 1 --2- 172.21.15.60:0/3228106854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee080039e0 0x7fee20156e10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fee10001970 tx=0x7fee10001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:28.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.692+0000 7fee07fff640 1 -- 172.21.15.60:0/3228106854 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee100049e0 con 0x7fee080039e0 2024-09-12T02:23:28.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.692+0000 7fee07fff640 1 -- 172.21.15.60:0/3228106854 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee10043070 con 0x7fee080039e0 2024-09-12T02:23:28.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.692+0000 7fee25eed640 1 -- 172.21.15.60:0/3228106854 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee200c3d50 con 0x7fee080039e0 2024-09-12T02:23:28.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.692+0000 7fee07fff640 1 -- 172.21.15.60:0/3228106854 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee10004dc0 con 0x7fee080039e0 2024-09-12T02:23:28.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.693+0000 7fee25eed640 1 -- 172.21.15.60:0/3228106854 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee20150f00 con 0x7fee080039e0 2024-09-12T02:23:28.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.693+0000 7fee25eed640 1 -- 172.21.15.60:0/3228106854 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee200707a0 con 0x7fee080039e0 2024-09-12T02:23:28.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.694+0000 7fee07fff640 1 -- 172.21.15.60:0/3228106854 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fee10007070 con 0x7fee080039e0 2024-09-12T02:23:28.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.694+0000 7fee07fff640 1 --2- 172.21.15.60:0/3228106854 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fee0c06be60 0x7fee0c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:28.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.694+0000 7fee07fff640 1 -- 172.21.15.60:0/3228106854 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7fee100ab720 con 0x7fee080039e0 2024-09-12T02:23:28.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.694+0000 7fee1effd640 1 --2- 172.21.15.60:0/3228106854 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fee0c06be60 0x7fee0c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:28.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.695+0000 7fee1effd640 1 --2- 172.21.15.60:0/3228106854 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fee0c06be60 0x7fee0c06e320 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fee200754a0 tx=0x7fee14008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:28.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.699+0000 7fee07fff640 1 -- 172.21.15.60:0/3228106854 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fee200707a0 con 0x7fee080039e0 2024-09-12T02:23:28.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.916+0000 7fee25eed640 1 -- 172.21.15.60:0/3228106854 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fee200c4780 con 0x7fee080039e0 2024-09-12T02:23:28.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.916+0000 7fee07fff640 1 -- 172.21.15.60:0/3228106854 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+6524 (secure 0 0 0) 0x7fee10079f50 con 0x7fee080039e0 2024-09-12T02:23:28.917 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:23:28.917 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":11,"btime":"2024-09-12T02:23:19:846521+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3208837169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3208837169},{"type":"v1","addr":"172.21.15.60:6836","nonce":3208837169}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/664538827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":664538827},{"type":"v1","addr":"172.21.15.60:6837","nonce":664538827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:23:04.113913+0000","modified":"2024-09-12T02:23:07.140885+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/2854563525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2854563525},{"type":"v1","addr":"172.21.15.105:6835","nonce":2854563525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1},{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:23:16.184151+0000","modified":"2024-09-12T02:23:19.195177+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"d","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6834/248466084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":248466084},{"type":"v1","addr":"172.21.15.105:6834","nonce":248466084}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":2}]} 2024-09-12T02:23:28.918 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 11 2024-09-12T02:23:28.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.918+0000 7fee25eed640 1 -- 172.21.15.60:0/3228106854 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fee0c06be60 msgr2=0x7fee0c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:28.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.918+0000 7fee25eed640 1 --2- 172.21.15.60:0/3228106854 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fee0c06be60 0x7fee0c06e320 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fee200754a0 tx=0x7fee14008040 comp rx=0 tx=0).stop 2024-09-12T02:23:28.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.918+0000 7fee25eed640 1 -- 172.21.15.60:0/3228106854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee080039e0 msgr2=0x7fee20156e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:28.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.918+0000 7fee25eed640 1 --2- 172.21.15.60:0/3228106854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee080039e0 0x7fee20156e10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fee10001970 tx=0x7fee10001a40 comp rx=0 tx=0).stop 2024-09-12T02:23:28.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.918+0000 7fee25eed640 1 -- 172.21.15.60:0/3228106854 shutdown_connections 2024-09-12T02:23:28.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.919+0000 7fee25eed640 1 --2- 172.21.15.60:0/3228106854 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fee0c06be60 0x7fee0c06e320 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:28.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.919+0000 7fee25eed640 1 --2- 172.21.15.60:0/3228106854 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee201e1a20 0x7fee201ef3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:28.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.919+0000 7fee25eed640 1 --2- 172.21.15.60:0/3228106854 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee201e3560 0x7fee201e14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:28.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.919+0000 7fee25eed640 1 --2- 172.21.15.60:0/3228106854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee080039e0 0x7fee20156e10 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:28.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.919+0000 7fee25eed640 1 -- 172.21.15.60:0/3228106854 >> 172.21.15.60:0/3228106854 conn(0x7fee200c6880 msgr2=0x7fee20151a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:28.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.919+0000 7fee25eed640 1 -- 172.21.15.60:0/3228106854 shutdown_connections 2024-09-12T02:23:28.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:28.919+0000 7fee25eed640 1 -- 172.21.15.60:0/3228106854 wait complete. 2024-09-12T02:23:29.333 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:23:04.113913+0000', 'modified': '2024-09-12T02:23:07.140885+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4281}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4281': {'gid': 4281, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.105:6835/2854563525', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6833', 'nonce': 2854563525}, {'type': 'v1', 'addr': '172.21.15.105:6835', 'nonce': 2854563525}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'a', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4281, 'qdb_cluster': [4281]} 2024-09-12T02:23:29.333 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T02:23:29.333 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-12T02:23:29.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.440+0000 7f695596d640 1 Processor -- start 2024-09-12T02:23:29.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.440+0000 7f695596d640 1 -- start start 2024-09-12T02:23:29.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.441+0000 7f695596d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6950153de0 0x7f69500ca640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:29.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.441+0000 7f695596d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69501598c0 0x7f6950159d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:29.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.441+0000 7f695596d640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69500cab80 con 0x7f695006bbe0 2024-09-12T02:23:29.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.441+0000 7f695596d640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f69500c9480 con 0x7f6950153de0 2024-09-12T02:23:29.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.441+0000 7f695596d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f69500cb620 con 0x7f69501598c0 2024-09-12T02:23:29.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.441+0000 7f694effd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6950153de0 0x7f69500ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:29.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.441+0000 7f694effd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6950153de0 0x7f69500ca640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50084/0 (socket says 172.21.15.60:50084) 2024-09-12T02:23:29.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.441+0000 7f694effd640 1 -- 172.21.15.60:0/2181864245 learned_addr learned my addr 172.21.15.60:0/2181864245 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:29.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.441+0000 7f69467fc640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f695006bbe0 0x7f695006c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:35336/0 (socket says 172.21.15.60:35336) 2024-09-12T02:23:29.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.441+0000 7f694effd640 1 -- 172.21.15.60:0/2181864245 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69501598c0 msgr2=0x7f6950159d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:29.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.441+0000 7f694f7fe640 1 --2- 172.21.15.60:0/2181864245 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69501598c0 0x7f6950159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:29.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.441+0000 7f694effd640 1 --2- 172.21.15.60:0/2181864245 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69501598c0 0x7f6950159d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:29.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.441+0000 7f694e7fc640 1 -- 172.21.15.60:0/2181864245 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1696615399 0 0) 0x7f6938001110 con 0x7f695006bbe0 2024-09-12T02:23:29.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.441+0000 7f694effd640 1 -- 172.21.15.60:0/2181864245 >> v1:172.21.15.60:6789/0 conn(0x7f695006bbe0 legacy=0x7f695006c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:29.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.441+0000 7f694effd640 1 -- 172.21.15.60:0/2181864245 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69500c6b20 con 0x7f6950153de0 2024-09-12T02:23:29.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.442+0000 7f694effd640 1 --2- 172.21.15.60:0/2181864245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6950153de0 0x7f69500ca640 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6940009870 tx=0x7f694002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27cc61d797263aea server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:29.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.442+0000 7f694e7fc640 1 -- 172.21.15.60:0/2181864245 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6940037070 con 0x7f6950153de0 2024-09-12T02:23:29.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.442+0000 7f694e7fc640 1 -- 172.21.15.60:0/2181864245 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6940032440 con 0x7f6950153de0 2024-09-12T02:23:29.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.442+0000 7f694e7fc640 1 -- 172.21.15.60:0/2181864245 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6940032810 con 0x7f6950153de0 2024-09-12T02:23:29.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.443+0000 7f695596d640 1 -- 172.21.15.60:0/2181864245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6950153de0 msgr2=0x7f69500ca640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:29.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.443+0000 7f695596d640 1 --2- 172.21.15.60:0/2181864245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6950153de0 0x7f69500ca640 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6940009870 tx=0x7f694002a270 comp rx=0 tx=0).stop 2024-09-12T02:23:29.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.443+0000 7f695596d640 1 -- 172.21.15.60:0/2181864245 shutdown_connections 2024-09-12T02:23:29.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.443+0000 7f695596d640 1 --2- 172.21.15.60:0/2181864245 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69501598c0 0x7f6950159d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:29.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.443+0000 7f695596d640 1 --2- 172.21.15.60:0/2181864245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6950153de0 0x7f69500ca640 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:29.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.443+0000 7f695596d640 1 -- 172.21.15.60:0/2181864245 >> 172.21.15.60:0/2181864245 conn(0x7f69500c8800 msgr2=0x7f69500c8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:29.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.443+0000 7f695596d640 1 -- 172.21.15.60:0/2181864245 shutdown_connections 2024-09-12T02:23:29.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.443+0000 7f695596d640 1 -- 172.21.15.60:0/2181864245 wait complete. 2024-09-12T02:23:29.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.444+0000 7f695596d640 1 Processor -- start 2024-09-12T02:23:29.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.444+0000 7f695596d640 1 -- start start 2024-09-12T02:23:29.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.445+0000 7f695596d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f695006bbe0 0x7f69501df930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:29.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.445+0000 7f695596d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6950153de0 0x7f695014d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:29.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.445+0000 7f695596d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69501598c0 0x7f695014db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:29.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.445+0000 7f695596d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f69500cbab0 con 0x7f6950153de0 2024-09-12T02:23:29.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.445+0000 7f695596d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f69500c70e0 con 0x7f695006bbe0 2024-09-12T02:23:29.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.445+0000 7f695596d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f695015a290 con 0x7f69501598c0 2024-09-12T02:23:29.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.445+0000 7f69467fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6950153de0 0x7f695014d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:29.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.445+0000 7f69467fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6950153de0 0x7f695014d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50098/0 (socket says 172.21.15.60:50098) 2024-09-12T02:23:29.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.445+0000 7f69467fc640 1 -- 172.21.15.60:0/2781884647 learned_addr learned my addr 172.21.15.60:0/2781884647 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:29.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.445+0000 7f694f7fe640 1 --2- 172.21.15.60:0/2781884647 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69501598c0 0x7f695014db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:29.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.445+0000 7f694effd640 1 --2- 172.21.15.60:0/2781884647 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f695006bbe0 0x7f69501df930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:29.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.445+0000 7f69467fc640 1 -- 172.21.15.60:0/2781884647 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69501598c0 msgr2=0x7f695014db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:29.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.445+0000 7f69467fc640 1 --2- 172.21.15.60:0/2781884647 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69501598c0 0x7f695014db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:29.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.445+0000 7f69467fc640 1 -- 172.21.15.60:0/2781884647 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f695006bbe0 msgr2=0x7f69501df930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:29.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.445+0000 7f69467fc640 1 --2- 172.21.15.60:0/2781884647 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f695006bbe0 0x7f69501df930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:29.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.445+0000 7f69467fc640 1 -- 172.21.15.60:0/2781884647 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69501dfe70 con 0x7f6950153de0 2024-09-12T02:23:29.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.445+0000 7f694f7fe640 1 --2- 172.21.15.60:0/2781884647 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69501598c0 0x7f695014db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:23:29.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.445+0000 7f694effd640 1 --2- 172.21.15.60:0/2781884647 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f695006bbe0 0x7f69501df930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:23:29.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.445+0000 7f69467fc640 1 --2- 172.21.15.60:0/2781884647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6950153de0 0x7f695014d120 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f693800c7b0 tx=0x7f693800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:29.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.445+0000 7f694cff9640 1 -- 172.21.15.60:0/2781884647 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6938018070 con 0x7f6950153de0 2024-09-12T02:23:29.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.445+0000 7f694cff9640 1 -- 172.21.15.60:0/2781884647 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69380072d0 con 0x7f6950153de0 2024-09-12T02:23:29.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.445+0000 7f694cff9640 1 -- 172.21.15.60:0/2781884647 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69380047e0 con 0x7f6950153de0 2024-09-12T02:23:29.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.445+0000 7f695596d640 1 -- 172.21.15.60:0/2781884647 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f695014cc20 con 0x7f6950153de0 2024-09-12T02:23:29.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.446+0000 7f695596d640 1 -- 172.21.15.60:0/2781884647 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69501e20a0 con 0x7f6950153de0 2024-09-12T02:23:29.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.447+0000 7f694cff9640 1 -- 172.21.15.60:0/2781884647 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f693801b070 con 0x7f6950153de0 2024-09-12T02:23:29.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.448+0000 7f694cff9640 1 --2- 172.21.15.60:0/2781884647 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f693006be30 0x7f693006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:29.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.448+0000 7f694cff9640 1 -- 172.21.15.60:0/2781884647 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f693808a400 con 0x7f6950153de0 2024-09-12T02:23:29.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.448+0000 7f694effd640 1 --2- 172.21.15.60:0/2781884647 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f693006be30 0x7f693006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:29.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.448+0000 7f694effd640 1 --2- 172.21.15.60:0/2781884647 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f693006be30 0x7f693006e2f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6940034000 tx=0x7f694002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:29.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.449+0000 7f69587e4740 1 Processor -- start 2024-09-12T02:23:29.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.449+0000 7f69587e4740 1 -- start start 2024-09-12T02:23:29.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.449+0000 7f69587e4740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efc9df080 0x561efc9dd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:29.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.449+0000 7f69587e4740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x561efca19a60 0x561efc9df460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:29.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.449+0000 7f69587e4740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561efca18720 0x561efc9db960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:29.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.449+0000 7f69587e4740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x561efc940520 con 0x561efc9df080 2024-09-12T02:23:29.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.449+0000 7f69587e4740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x561efc8e83e0 con 0x561efca18720 2024-09-12T02:23:29.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.449+0000 7f69587e4740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x561efc93c4e0 con 0x561efca19a60 2024-09-12T02:23:29.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.449+0000 7f694effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efc9df080 0x561efc9dd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:29.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.450+0000 7f694effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efc9df080 0x561efc9dd980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50108/0 (socket says 172.21.15.60:50108) 2024-09-12T02:23:29.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.450+0000 7f694effd640 1 -- 172.21.15.60:0/2199943280 learned_addr learned my addr 172.21.15.60:0/2199943280 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:29.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.450+0000 7f694f7fe640 1 --2- 172.21.15.60:0/2199943280 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561efca18720 0x561efc9db960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:29.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.450+0000 7f69467fc640 1 --2- 172.21.15.60:0/2199943280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x561efca19a60 0x561efc9df460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:29.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.450+0000 7f694effd640 1 -- 172.21.15.60:0/2199943280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x561efca19a60 msgr2=0x561efc9df460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:29.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.450+0000 7f694effd640 1 --2- 172.21.15.60:0/2199943280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x561efca19a60 0x561efc9df460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:29.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.450+0000 7f694effd640 1 -- 172.21.15.60:0/2199943280 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561efca18720 msgr2=0x561efc9db960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:29.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.450+0000 7f694effd640 1 --2- 172.21.15.60:0/2199943280 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561efca18720 0x561efc9db960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:29.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.450+0000 7f694effd640 1 -- 172.21.15.60:0/2199943280 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561efc9032f0 con 0x561efc9df080 2024-09-12T02:23:29.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.450+0000 7f694f7fe640 1 --2- 172.21.15.60:0/2199943280 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561efca18720 0x561efc9db960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:23:29.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.450+0000 7f69467fc640 1 --2- 172.21.15.60:0/2199943280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x561efca19a60 0x561efc9df460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:23:29.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.450+0000 7f694effd640 1 --2- 172.21.15.60:0/2199943280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efc9df080 0x561efc9dd980 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6940000c00 tx=0x7f694002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4c8a5214e8254c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:29.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.450+0000 7f69457fa640 1 -- 172.21.15.60:0/2199943280 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6940037040 con 0x561efc9df080 2024-09-12T02:23:29.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.450+0000 7f69457fa640 1 -- 172.21.15.60:0/2199943280 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f694004d070 con 0x561efc9df080 2024-09-12T02:23:29.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.450+0000 7f69457fa640 1 -- 172.21.15.60:0/2199943280 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6940003d60 con 0x561efc9df080 2024-09-12T02:23:29.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.451+0000 7f69587e4740 1 -- 172.21.15.60:0/2199943280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efc9df080 msgr2=0x561efc9dd980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:29.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.451+0000 7f69587e4740 1 --2- 172.21.15.60:0/2199943280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efc9df080 0x561efc9dd980 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6940000c00 tx=0x7f694002c000 comp rx=0 tx=0).stop 2024-09-12T02:23:29.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.451+0000 7f69587e4740 1 -- 172.21.15.60:0/2199943280 shutdown_connections 2024-09-12T02:23:29.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.451+0000 7f69587e4740 1 --2- 172.21.15.60:0/2199943280 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561efca18720 0x561efc9db960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:29.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.451+0000 7f69587e4740 1 --2- 172.21.15.60:0/2199943280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x561efca19a60 0x561efc9df460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:29.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.451+0000 7f69587e4740 1 --2- 172.21.15.60:0/2199943280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efc9df080 0x561efc9dd980 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:29.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.451+0000 7f69587e4740 1 -- 172.21.15.60:0/2199943280 >> 172.21.15.60:0/2199943280 conn(0x561efc9da960 msgr2=0x561efc9de130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:29.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.451+0000 7f69587e4740 1 -- 172.21.15.60:0/2199943280 shutdown_connections 2024-09-12T02:23:29.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.451+0000 7f69587e4740 1 -- 172.21.15.60:0/2199943280 wait complete. 2024-09-12T02:23:29.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.451+0000 7f69587e4740 1 -- start start 2024-09-12T02:23:29.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.452+0000 7f69587e4740 1 Processor -- start 2024-09-12T02:23:29.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.452+0000 7f69587e4740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x561efca18720 0x561efc9f6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:29.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.452+0000 7f69587e4740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561efca19a60 0x561efca2a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:29.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.452+0000 7f69587e4740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efc9f7d70 0x561efc9f6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:29.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.452+0000 7f69587e4740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x561efc9df9a0 con 0x561efc9f7d70 2024-09-12T02:23:29.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.452+0000 7f69587e4740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x561efc8c9450 con 0x561efca19a60 2024-09-12T02:23:29.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.452+0000 7f69587e4740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x561efc9dcbc0 con 0x561efca18720 2024-09-12T02:23:29.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.452+0000 7f69587e4740 10 client.0 _ll_register_callbacks cb 0x561efc652ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:23:29.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.452+0000 7f694f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efc9f7d70 0x561efc9f6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:29.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.452+0000 7f694f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efc9f7d70 0x561efc9f6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50124/0 (socket says 172.21.15.60:50124) 2024-09-12T02:23:29.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.452+0000 7f694f7fe640 1 -- 172.21.15.60:0/824606992 learned_addr learned my addr 172.21.15.60:0/824606992 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:29.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.452+0000 7f69467fc640 1 --2- 172.21.15.60:0/824606992 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561efca19a60 0x561efca2a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:29.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.452+0000 7f694effd640 1 --2- 172.21.15.60:0/824606992 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x561efca18720 0x561efc9f6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:29.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.453+0000 7f694f7fe640 1 -- 172.21.15.60:0/824606992 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x561efca18720 msgr2=0x561efc9f6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:29.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.453+0000 7f694f7fe640 1 --2- 172.21.15.60:0/824606992 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x561efca18720 0x561efc9f6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:29.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.453+0000 7f694f7fe640 1 -- 172.21.15.60:0/824606992 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561efca19a60 msgr2=0x561efca2a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:29.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.453+0000 7f694f7fe640 1 --2- 172.21.15.60:0/824606992 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561efca19a60 0x561efca2a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:29.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.453+0000 7f694f7fe640 1 -- 172.21.15.60:0/824606992 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561efc6532d0 con 0x561efc9f7d70 2024-09-12T02:23:29.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.453+0000 7f694f7fe640 1 --2- 172.21.15.60:0/824606992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efc9f7d70 0x561efc9f6c80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f694800fb50 tx=0x7f694800a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de731bcab4825e59 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:29.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.453+0000 7f692e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T02:23:29.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.453+0000 7f692e7fc640 1 -- 172.21.15.60:0/824606992 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6948017070 con 0x561efc9f7d70 2024-09-12T02:23:29.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.453+0000 7f692e7fc640 1 -- 172.21.15.60:0/824606992 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f6948012480 con 0x561efc9f7d70 2024-09-12T02:23:29.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.453+0000 7f69587e4740 1 -- 172.21.15.60:0/824606992 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f694004d070 con 0x561efc9f7d70 2024-09-12T02:23:29.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.453+0000 7f692e7fc640 1 -- 172.21.15.60:0/824606992 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=11) ==== 24+0+0 (secure 0 0 0) 0x7f6948022050 con 0x561efc9f7d70 2024-09-12T02:23:29.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.453+0000 7f69587e4740 10 client.4758 fetch_fsmap learned FSMap version 11 2024-09-12T02:23:29.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.453+0000 7f69587e4740 1 -- 172.21.15.60:0/824606992 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=11,monmap=2+}) -- 0x561efc71d6b0 con 0x561efc9f7d70 2024-09-12T02:23:29.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.453+0000 7f692e7fc640 1 -- 172.21.15.60:0/824606992 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f694004d070 con 0x561efc9f7d70 2024-09-12T02:23:29.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.453+0000 7f692e7fc640 1 -- 172.21.15.60:0/824606992 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 11) ==== 4136+0+0 (secure 0 0 0) 0x7f6948025020 con 0x561efc9f7d70 2024-09-12T02:23:29.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.453+0000 7f69587e4740 10 client.4758 fetch_fsmap finished waiting for FSMap version 11 2024-09-12T02:23:29.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.453+0000 7f69587e4740 10 client.4758 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:23:29.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.453+0000 7f69587e4740 20 client.4758 populate_metadata read hostname 'smithi060' 2024-09-12T02:23:29.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.453+0000 7f69587e4740 1 --2- 172.21.15.60:0/824606992 >> [v2:172.21.15.105:6833/2854563525,v1:172.21.15.105:6835/2854563525] conn(0x561efca2d250 0x561efca2d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:29.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.453+0000 7f69587e4740 4 client.4758 mds_command: new command op to 4281 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:23:29.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.453+0000 7f69587e4740 1 -- 172.21.15.60:0/824606992 --> [v2:172.21.15.105:6833/2854563525,v1:172.21.15.105:6835/2854563525] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561efc94dc50 con 0x561efca2d250 2024-09-12T02:23:29.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.454+0000 7f694effd640 1 --2- 172.21.15.60:0/824606992 >> [v2:172.21.15.105:6833/2854563525,v1:172.21.15.105:6835/2854563525] conn(0x561efca2d250 0x561efca2d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:29.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.454+0000 7f694effd640 1 --2- 172.21.15.60:0/824606992 >> [v2:172.21.15.105:6833/2854563525,v1:172.21.15.105:6835/2854563525] conn(0x561efca2d250 0x561efca2d630 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8553e124769e10f server_cookie=4441b18858d735ec in_seq=0 out_seq=0 2024-09-12T02:23:29.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.454+0000 7f692e7fc640 10 client.4758 ms_handle_connect on v2:172.21.15.105:6833/2854563525 2024-09-12T02:23:29.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.455+0000 7f692e7fc640 1 -- 172.21.15.60:0/824606992 <== mds.0 v2:172.21.15.105:6833/2854563525 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561efc94dc50 con 0x561efca2d250 2024-09-12T02:23:29.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.455+0000 7f692e7fc640 10 client.4758 handle_command_reply: tid=0 2024-09-12T02:23:29.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.455+0000 7f69587e4740 1 client.4758 shutdown 2024-09-12T02:23:29.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.455+0000 7f69587e4740 1 -- 172.21.15.60:0/824606992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efc9f7d70 msgr2=0x561efc9f6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:29.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.455+0000 7f69587e4740 1 --2- 172.21.15.60:0/824606992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efc9f7d70 0x561efc9f6c80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f694800fb50 tx=0x7f694800a680 comp rx=0 tx=0).stop 2024-09-12T02:23:29.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.455+0000 7f69587e4740 1 -- 172.21.15.60:0/824606992 shutdown_connections 2024-09-12T02:23:29.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.455+0000 7f69587e4740 1 --2- 172.21.15.60:0/824606992 >> [v2:172.21.15.105:6833/2854563525,v1:172.21.15.105:6835/2854563525] conn(0x561efca2d250 0x561efca2d630 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:29.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.455+0000 7f69587e4740 1 --2- 172.21.15.60:0/824606992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efc9f7d70 0x561efc9f6c80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:29.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.455+0000 7f692e7fc640 0 client.4758 ms_handle_reset on v2:172.21.15.105:6833/2854563525 2024-09-12T02:23:29.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.455+0000 7f69587e4740 1 --2- 172.21.15.60:0/824606992 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561efca19a60 0x561efca2a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:29.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.455+0000 7f69587e4740 1 --2- 172.21.15.60:0/824606992 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x561efca18720 0x561efc9f6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:29.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.455+0000 7f69587e4740 1 -- 172.21.15.60:0/824606992 >> 172.21.15.60:0/824606992 conn(0x561efc9df080 msgr2=0x561efc9d7ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:29.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.455+0000 7f69587e4740 1 -- 172.21.15.60:0/824606992 shutdown_connections 2024-09-12T02:23:29.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.455+0000 7f69587e4740 1 -- 172.21.15.60:0/824606992 wait complete. 2024-09-12T02:23:29.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.455+0000 7f69587e4740 20 client.4758 trim_cache size 0 max 16384 2024-09-12T02:23:29.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.473+0000 7f69587e4740 1 Processor -- start 2024-09-12T02:23:29.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.473+0000 7f69587e4740 1 -- start start 2024-09-12T02:23:29.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.474+0000 7f69587e4740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x561efc9f7d70 0x561efca2d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:29.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.474+0000 7f69587e4740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561efca18720 0x561efca3d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:29.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.474+0000 7f69587e4740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efca19a60 0x561efca3db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:29.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.474+0000 7f69587e4740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f69501fb980 con 0x561efca19a60 2024-09-12T02:23:29.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.474+0000 7f69587e4740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f69501f93d0 con 0x561efca18720 2024-09-12T02:23:29.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.474+0000 7f69587e4740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f69501f9a20 con 0x561efc9f7d70 2024-09-12T02:23:29.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.474+0000 7f694f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efca19a60 0x561efca3db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:29.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.474+0000 7f694f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efca19a60 0x561efca3db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50134/0 (socket says 172.21.15.60:50134) 2024-09-12T02:23:29.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.474+0000 7f694f7fe640 1 -- 172.21.15.60:0/3319647844 learned_addr learned my addr 172.21.15.60:0/3319647844 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:29.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.474+0000 7f694f7fe640 1 -- 172.21.15.60:0/3319647844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x561efc9f7d70 msgr2=0x561efca2d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:29.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.474+0000 7f694f7fe640 1 --2- 172.21.15.60:0/3319647844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x561efc9f7d70 0x561efca2d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:29.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.474+0000 7f694f7fe640 1 -- 172.21.15.60:0/3319647844 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561efca18720 msgr2=0x561efca3d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:29.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.474+0000 7f694f7fe640 1 --2- 172.21.15.60:0/3319647844 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561efca18720 0x561efca3d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:29.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.474+0000 7f694f7fe640 1 -- 172.21.15.60:0/3319647844 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561efc9f64d0 con 0x561efca19a60 2024-09-12T02:23:29.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.475+0000 7f694f7fe640 1 --2- 172.21.15.60:0/3319647844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efca19a60 0x561efca3db50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f69480079e0 tx=0x7f6948012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2731f23163600250 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:29.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.475+0000 7f6944ff9640 1 -- 172.21.15.60:0/3319647844 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f694802c070 con 0x561efca19a60 2024-09-12T02:23:29.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.475+0000 7f6944ff9640 1 -- 172.21.15.60:0/3319647844 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69480074f0 con 0x561efca19a60 2024-09-12T02:23:29.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.475+0000 7f6944ff9640 1 -- 172.21.15.60:0/3319647844 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6948017040 con 0x561efca19a60 2024-09-12T02:23:29.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.475+0000 7f69587e4740 1 -- 172.21.15.60:0/3319647844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efca19a60 msgr2=0x561efca3db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:29.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.475+0000 7f69587e4740 1 --2- 172.21.15.60:0/3319647844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efca19a60 0x561efca3db50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f69480079e0 tx=0x7f6948012000 comp rx=0 tx=0).stop 2024-09-12T02:23:29.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.475+0000 7f69587e4740 1 -- 172.21.15.60:0/3319647844 shutdown_connections 2024-09-12T02:23:29.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.475+0000 7f69587e4740 1 --2- 172.21.15.60:0/3319647844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efca19a60 0x561efca3db50 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:29.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.475+0000 7f69587e4740 1 --2- 172.21.15.60:0/3319647844 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561efca18720 0x561efca3d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:29.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.475+0000 7f69587e4740 1 --2- 172.21.15.60:0/3319647844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x561efc9f7d70 0x561efca2d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:29.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.475+0000 7f69587e4740 1 -- 172.21.15.60:0/3319647844 >> 172.21.15.60:0/3319647844 conn(0x561efc9df080 msgr2=0x561efca1a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:29.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.476+0000 7f69587e4740 1 -- 172.21.15.60:0/3319647844 shutdown_connections 2024-09-12T02:23:29.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.476+0000 7f69587e4740 1 -- 172.21.15.60:0/3319647844 wait complete. 2024-09-12T02:23:29.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.476+0000 7f69587e4740 1 -- start start 2024-09-12T02:23:29.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.476+0000 7f69587e4740 1 Processor -- start 2024-09-12T02:23:29.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.477+0000 7f69587e4740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561efc9f7d70 0x561efca9afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:29.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.477+0000 7f69587e4740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efca18720 0x561efca91b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:29.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.477+0000 7f69587e4740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x561efca19a60 0x561efca21c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:29.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.477+0000 7f69587e4740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x561efca1cdd0 con 0x561efca18720 2024-09-12T02:23:29.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.477+0000 7f69587e4740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x561efca10820 con 0x561efc9f7d70 2024-09-12T02:23:29.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.477+0000 7f69587e4740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x561efca1b480 con 0x561efca19a60 2024-09-12T02:23:29.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.477+0000 7f69587e4740 10 client.0 _ll_register_callbacks cb 0x7f69480077b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:23:29.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.477+0000 7f69467fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efca18720 0x561efca91b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:29.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.477+0000 7f69467fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efca18720 0x561efca91b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50136/0 (socket says 172.21.15.60:50136) 2024-09-12T02:23:29.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.477+0000 7f69467fc640 1 -- 172.21.15.60:0/3072709762 learned_addr learned my addr 172.21.15.60:0/3072709762 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:29.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.477+0000 7f694f7fe640 1 --2- 172.21.15.60:0/3072709762 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x561efca19a60 0x561efca21c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:29.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.477+0000 7f694effd640 1 --2- 172.21.15.60:0/3072709762 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561efc9f7d70 0x561efca9afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:29.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.477+0000 7f69467fc640 1 -- 172.21.15.60:0/3072709762 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x561efca19a60 msgr2=0x561efca21c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:29.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.477+0000 7f69467fc640 1 --2- 172.21.15.60:0/3072709762 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x561efca19a60 0x561efca21c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:29.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.477+0000 7f69467fc640 1 -- 172.21.15.60:0/3072709762 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561efc9f7d70 msgr2=0x561efca9afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:29.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.477+0000 7f69467fc640 1 --2- 172.21.15.60:0/3072709762 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561efc9f7d70 0x561efca9afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:29.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.477+0000 7f69467fc640 1 -- 172.21.15.60:0/3072709762 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561efca920d0 con 0x561efca18720 2024-09-12T02:23:29.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.477+0000 7f69467fc640 1 --2- 172.21.15.60:0/3072709762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efca18720 0x561efca91b90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6938058110 tx=0x7f6938007e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ae616ad641eaa14 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:29.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.477+0000 7f692e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T02:23:29.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.477+0000 7f692e7fc640 1 -- 172.21.15.60:0/3072709762 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693805c7c0 con 0x561efca18720 2024-09-12T02:23:29.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.477+0000 7f692e7fc640 1 -- 172.21.15.60:0/3072709762 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f6938070170 con 0x561efca18720 2024-09-12T02:23:29.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.477+0000 7f69587e4740 1 -- 172.21.15.60:0/3072709762 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69480074f0 con 0x561efca18720 2024-09-12T02:23:29.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.478+0000 7f692e7fc640 1 -- 172.21.15.60:0/3072709762 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=11) ==== 24+0+0 (secure 0 0 0) 0x7f6938060ff0 con 0x561efca18720 2024-09-12T02:23:29.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.478+0000 7f69587e4740 10 client.4764 fetch_fsmap learned FSMap version 11 2024-09-12T02:23:29.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.478+0000 7f69587e4740 1 -- 172.21.15.60:0/3072709762 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=11,monmap=2+}) -- 0x561efca9b710 con 0x561efca18720 2024-09-12T02:23:29.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.478+0000 7f692e7fc640 1 -- 172.21.15.60:0/3072709762 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69480074f0 con 0x561efca18720 2024-09-12T02:23:29.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.478+0000 7f692e7fc640 1 -- 172.21.15.60:0/3072709762 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 11) ==== 4136+0+0 (secure 0 0 0) 0x7f69380881a0 con 0x561efca18720 2024-09-12T02:23:29.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.478+0000 7f69587e4740 10 client.4764 fetch_fsmap finished waiting for FSMap version 11 2024-09-12T02:23:29.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.478+0000 7f69587e4740 10 client.4764 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:23:29.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.478+0000 7f69587e4740 20 client.4764 populate_metadata read hostname 'smithi060' 2024-09-12T02:23:29.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.478+0000 7f69587e4740 1 --2- 172.21.15.60:0/3072709762 >> [v2:172.21.15.105:6833/2854563525,v1:172.21.15.105:6835/2854563525] conn(0x561efca0ec90 0x561efca0f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:29.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.478+0000 7f69587e4740 4 client.4764 mds_command: new command op to 4281 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:23:29.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.478+0000 7f69587e4740 1 -- 172.21.15.60:0/3072709762 --> [v2:172.21.15.105:6833/2854563525,v1:172.21.15.105:6835/2854563525] -- command(tid 0: {"prefix": "status"}) -- 0x561efc947fa0 con 0x561efca0ec90 2024-09-12T02:23:29.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.478+0000 7f694effd640 1 --2- 172.21.15.60:0/3072709762 >> [v2:172.21.15.105:6833/2854563525,v1:172.21.15.105:6835/2854563525] conn(0x561efca0ec90 0x561efca0f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:29.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.478+0000 7f694effd640 1 -- 172.21.15.60:0/3072709762 >> [v2:172.21.15.105:6833/2854563525,v1:172.21.15.105:6835/2854563525] conn(0x561efca0ec90 msgr2=0x561efca0f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 18 2024-09-12T02:23:29.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.478+0000 7f694effd640 1 -- 172.21.15.60:0/3072709762 >> [v2:172.21.15.105:6833/2854563525,v1:172.21.15.105:6835/2854563525] conn(0x561efca0ec90 msgr2=0x561efca0f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:23:29.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.478+0000 7f694effd640 1 --2- 172.21.15.60:0/3072709762 >> [v2:172.21.15.105:6833/2854563525,v1:172.21.15.105:6835/2854563525] conn(0x561efca0ec90 0x561efca0f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:23:29.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.478+0000 7f694effd640 1 --2- 172.21.15.60:0/3072709762 >> [v2:172.21.15.105:6833/2854563525,v1:172.21.15.105:6835/2854563525] conn(0x561efca0ec90 0x561efca0f070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:23:29.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.679+0000 7f694effd640 1 --2- 172.21.15.60:0/3072709762 >> [v2:172.21.15.105:6833/2854563525,v1:172.21.15.105:6835/2854563525] conn(0x561efca0ec90 0x561efca0f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:29.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.679+0000 7f694effd640 1 --2- 172.21.15.60:0/3072709762 >> [v2:172.21.15.105:6833/2854563525,v1:172.21.15.105:6835/2854563525] conn(0x561efca0ec90 0x561efca0f070 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63b6db2de505522d server_cookie=e70d375f8d2b9f3e in_seq=0 out_seq=0 2024-09-12T02:23:29.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.679+0000 7f692e7fc640 10 client.4764 ms_handle_connect on v2:172.21.15.105:6833/2854563525 2024-09-12T02:23:29.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.680+0000 7f692e7fc640 1 -- 172.21.15.60:0/3072709762 <== mds.0 v2:172.21.15.105:6833/2854563525 1 ==== command_reply(tid 0: 0 ) ==== 8+0+319 (crc 0 0 0) 0x561efc947fa0 con 0x561efca0ec90 2024-09-12T02:23:29.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.680+0000 7f692e7fc640 10 client.4764 handle_command_reply: tid=0 2024-09-12T02:23:29.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.680+0000 7f69587e4740 1 client.4764 shutdown 2024-09-12T02:23:29.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.680+0000 7f69587e4740 1 -- 172.21.15.60:0/3072709762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efca18720 msgr2=0x561efca91b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:29.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.680+0000 7f69587e4740 1 --2- 172.21.15.60:0/3072709762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efca18720 0x561efca91b90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6938058110 tx=0x7f6938007e20 comp rx=0 tx=0).stop 2024-09-12T02:23:29.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.680+0000 7f69587e4740 1 -- 172.21.15.60:0/3072709762 shutdown_connections 2024-09-12T02:23:29.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.680+0000 7f69587e4740 1 --2- 172.21.15.60:0/3072709762 >> [v2:172.21.15.105:6833/2854563525,v1:172.21.15.105:6835/2854563525] conn(0x561efca0ec90 0x561efca0f070 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:29.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.680+0000 7f69587e4740 1 --2- 172.21.15.60:0/3072709762 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x561efca19a60 0x561efca21c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:29.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.680+0000 7f69587e4740 1 --2- 172.21.15.60:0/3072709762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561efca18720 0x561efca91b90 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:29.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.680+0000 7f692e7fc640 0 client.4764 ms_handle_reset on v2:172.21.15.105:6833/2854563525 2024-09-12T02:23:29.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.680+0000 7f69587e4740 1 --2- 172.21.15.60:0/3072709762 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561efc9f7d70 0x561efca9afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:29.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.680+0000 7f69587e4740 1 -- 172.21.15.60:0/3072709762 >> 172.21.15.60:0/3072709762 conn(0x561efc9df080 msgr2=0x561efca1d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:29.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.680+0000 7f69587e4740 1 -- 172.21.15.60:0/3072709762 shutdown_connections 2024-09-12T02:23:29.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.680+0000 7f69587e4740 1 -- 172.21.15.60:0/3072709762 wait complete. 2024-09-12T02:23:29.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.680+0000 7f69587e4740 20 client.4764 trim_cache size 0 max 16384 2024-09-12T02:23:29.682 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:23:29.682 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:23:29.683 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 0, 2024-09-12T02:23:29.683 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4281, 2024-09-12T02:23:29.683 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2024-09-12T02:23:29.683 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2024-09-12T02:23:29.683 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "a", 2024-09-12T02:23:29.683 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 24.917887683, 2024-09-12T02:23:29.683 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 7, 2024-09-12T02:23:29.683 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 26, 2024-09-12T02:23:29.683 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 22, 2024-09-12T02:23:29.683 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 31.069958932999999 2024-09-12T02:23:29.683 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:23:29.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.681+0000 7f695596d640 1 -- 172.21.15.60:0/2781884647 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f693006be30 msgr2=0x7f693006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:29.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.681+0000 7f695596d640 1 --2- 172.21.15.60:0/2781884647 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f693006be30 0x7f693006e2f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6940034000 tx=0x7f694002e000 comp rx=0 tx=0).stop 2024-09-12T02:23:29.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.681+0000 7f695596d640 1 -- 172.21.15.60:0/2781884647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6950153de0 msgr2=0x7f695014d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:29.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.681+0000 7f695596d640 1 --2- 172.21.15.60:0/2781884647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6950153de0 0x7f695014d120 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f693800c7b0 tx=0x7f693800cc70 comp rx=0 tx=0).stop 2024-09-12T02:23:29.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.681+0000 7f695596d640 1 -- 172.21.15.60:0/2781884647 shutdown_connections 2024-09-12T02:23:29.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.681+0000 7f695596d640 1 --2- 172.21.15.60:0/2781884647 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f693006be30 0x7f693006e2f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:29.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.681+0000 7f695596d640 1 --2- 172.21.15.60:0/2781884647 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69501598c0 0x7f695014db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:29.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.681+0000 7f695596d640 1 --2- 172.21.15.60:0/2781884647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6950153de0 0x7f695014d120 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:29.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.681+0000 7f695596d640 1 --2- 172.21.15.60:0/2781884647 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f695006bbe0 0x7f69501df930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:29.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.681+0000 7f695596d640 1 -- 172.21.15.60:0/2781884647 >> 172.21.15.60:0/2781884647 conn(0x7f69500c8800 msgr2=0x7f69500acaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:29.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.681+0000 7f695596d640 1 -- 172.21.15.60:0/2781884647 shutdown_connections 2024-09-12T02:23:29.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.681+0000 7f695596d640 1 -- 172.21.15.60:0/2781884647 wait complete. 2024-09-12T02:23:29.693 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:23:29.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.796+0000 7efdc759e640 1 Processor -- start 2024-09-12T02:23:29.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.796+0000 7efdc759e640 1 -- start start 2024-09-12T02:23:29.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.797+0000 7efdc759e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efdc8153740 0x7efdc80c8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:29.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.797+0000 7efdc759e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7efdc80ca0c0 0x7efdc806bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:29.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.797+0000 7efdc759e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efdc80c8d50 0x7efdc806c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:29.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.797+0000 7efdc759e640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7efdc80ae780 con 0x7efdc80c8d50 2024-09-12T02:23:29.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.797+0000 7efdc759e640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7efdc8156b70 con 0x7efdc80ca0c0 2024-09-12T02:23:29.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.797+0000 7efdc759e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efdc8156e10 con 0x7efdc8153740 2024-09-12T02:23:29.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.797+0000 7efdc6d9d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efdc80c8d50 0x7efdc806c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:29.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.797+0000 7efdc6d9d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efdc80c8d50 0x7efdc806c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50148/0 (socket says 172.21.15.60:50148) 2024-09-12T02:23:29.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.797+0000 7efdc6d9d640 1 -- 172.21.15.60:0/2296905937 learned_addr learned my addr 172.21.15.60:0/2296905937 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:29.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.797+0000 7efdc6d9d640 1 -- 172.21.15.60:0/2296905937 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efdc8153740 msgr2=0x7efdc80c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:29.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.797+0000 7efdc6d9d640 1 --2- 172.21.15.60:0/2296905937 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efdc8153740 0x7efdc80c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:29.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.797+0000 7efdc5d9b640 1 --2- 172.21.15.60:0/2296905937 >> v2:172.21.15.105:3300/0 conn(0x7efdc80ca0c0 0x7efdc806bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:29.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.797+0000 7efdc6d9d640 1 -- 172.21.15.60:0/2296905937 >> v2:172.21.15.105:3300/0 conn(0x7efdc80ca0c0 msgr2=0x7efdc806bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:29.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.797+0000 7efdc6d9d640 1 --2- 172.21.15.60:0/2296905937 >> v2:172.21.15.105:3300/0 conn(0x7efdc80ca0c0 0x7efdc806bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:29.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.797+0000 7efdc6d9d640 1 -- 172.21.15.60:0/2296905937 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdc80ae410 con 0x7efdc80c8d50 2024-09-12T02:23:29.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.797+0000 7efdc5d9b640 1 --2- 172.21.15.60:0/2296905937 >> v2:172.21.15.105:3300/0 conn(0x7efdc80ca0c0 0x7efdc806bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:23:29.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.798+0000 7efdc6d9d640 1 --2- 172.21.15.60:0/2296905937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdc80c8d50 0x7efdc806c220 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efdc80c9510 tx=0x7efdb802a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97f85a7284152406 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:29.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.798+0000 7efdc559a640 1 -- 172.21.15.60:0/2296905937 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb8037070 con 0x7efdc80c8d50 2024-09-12T02:23:29.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.798+0000 7efdc559a640 1 -- 172.21.15.60:0/2296905937 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdb802ae00 con 0x7efdc80c8d50 2024-09-12T02:23:29.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.798+0000 7efdc559a640 1 -- 172.21.15.60:0/2296905937 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb8032660 con 0x7efdc80c8d50 2024-09-12T02:23:29.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.798+0000 7efdc759e640 1 -- 172.21.15.60:0/2296905937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdc80c8d50 msgr2=0x7efdc806c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:29.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.798+0000 7efdc759e640 1 --2- 172.21.15.60:0/2296905937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdc80c8d50 0x7efdc806c220 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efdc80c9510 tx=0x7efdb802a0b0 comp rx=0 tx=0).stop 2024-09-12T02:23:29.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.798+0000 7efdc759e640 1 -- 172.21.15.60:0/2296905937 shutdown_connections 2024-09-12T02:23:29.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.799+0000 7efdc759e640 1 --2- 172.21.15.60:0/2296905937 >> v2:172.21.15.105:3300/0 conn(0x7efdc80ca0c0 0x7efdc806bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:29.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.799+0000 7efdc759e640 1 --2- 172.21.15.60:0/2296905937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdc80c8d50 0x7efdc806c220 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:29.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.799+0000 7efdc759e640 1 --2- 172.21.15.60:0/2296905937 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efdc8153740 0x7efdc80c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:29.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.799+0000 7efdc759e640 1 -- 172.21.15.60:0/2296905937 >> 172.21.15.60:0/2296905937 conn(0x7efdc8073940 msgr2=0x7efdc80ada30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:29.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.799+0000 7efdc759e640 1 -- 172.21.15.60:0/2296905937 shutdown_connections 2024-09-12T02:23:29.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.799+0000 7efdc759e640 1 -- 172.21.15.60:0/2296905937 wait complete. 2024-09-12T02:23:29.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.800+0000 7efdc759e640 1 Processor -- start 2024-09-12T02:23:29.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.800+0000 7efdc759e640 1 -- start start 2024-09-12T02:23:29.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.800+0000 7efdc759e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdc80c8d50 0x7efdc814e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:29.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.800+0000 7efdc759e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efdc80ca0c0 0x7efdc8148210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:29.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.800+0000 7efdc759e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdc8153740 0x7efdc8151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:29.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.800+0000 7efdc759e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7efdc8153ca0 con 0x7efdc8153740 2024-09-12T02:23:29.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.800+0000 7efdc759e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efdc8153b20 con 0x7efdc80c8d50 2024-09-12T02:23:29.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.800+0000 7efdc759e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efdc806c760 con 0x7efdc80ca0c0 2024-09-12T02:23:29.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.801+0000 7efdc6d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdc8153740 0x7efdc8151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:29.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.801+0000 7efdc6d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdc8153740 0x7efdc8151a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50164/0 (socket says 172.21.15.60:50164) 2024-09-12T02:23:29.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.801+0000 7efdc6d9d640 1 -- 172.21.15.60:0/2292136106 learned_addr learned my addr 172.21.15.60:0/2292136106 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:29.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.801+0000 7efdc5d9b640 1 --2- 172.21.15.60:0/2292136106 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efdc80ca0c0 0x7efdc8148210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:29.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.801+0000 7efdc659c640 1 --2- 172.21.15.60:0/2292136106 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdc80c8d50 0x7efdc814e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:29.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.801+0000 7efdc6d9d640 1 -- 172.21.15.60:0/2292136106 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efdc80ca0c0 msgr2=0x7efdc8148210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:29.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.801+0000 7efdc6d9d640 1 --2- 172.21.15.60:0/2292136106 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efdc80ca0c0 0x7efdc8148210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:29.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.801+0000 7efdc6d9d640 1 -- 172.21.15.60:0/2292136106 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdc80c8d50 msgr2=0x7efdc814e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:29.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.801+0000 7efdc6d9d640 1 --2- 172.21.15.60:0/2292136106 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdc80c8d50 0x7efdc814e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:29.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.801+0000 7efdc6d9d640 1 -- 172.21.15.60:0/2292136106 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdc815a480 con 0x7efdc8153740 2024-09-12T02:23:29.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.801+0000 7efdc6d9d640 1 --2- 172.21.15.60:0/2292136106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdc8153740 0x7efdc8151a90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7efdb80090b0 tx=0x7efdb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:29.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.801+0000 7efdbeffd640 1 -- 172.21.15.60:0/2292136106 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb8041070 con 0x7efdc8153740 2024-09-12T02:23:29.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.801+0000 7efdbeffd640 1 -- 172.21.15.60:0/2292136106 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdb803c670 con 0x7efdc8153740 2024-09-12T02:23:29.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.801+0000 7efdbeffd640 1 -- 172.21.15.60:0/2292136106 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb8037040 con 0x7efdc8153740 2024-09-12T02:23:29.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.801+0000 7efdc759e640 1 -- 172.21.15.60:0/2292136106 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdc8151550 con 0x7efdc8153740 2024-09-12T02:23:29.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.801+0000 7efdc759e640 1 -- 172.21.15.60:0/2292136106 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdc814c260 con 0x7efdc8153740 2024-09-12T02:23:29.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.802+0000 7efdc759e640 1 -- 172.21.15.60:0/2292136106 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdc80c6780 con 0x7efdc8153740 2024-09-12T02:23:29.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.803+0000 7efdbeffd640 1 -- 172.21.15.60:0/2292136106 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efdb803a070 con 0x7efdc8153740 2024-09-12T02:23:29.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.803+0000 7efdbeffd640 1 --2- 172.21.15.60:0/2292136106 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7efda806be30 0x7efda806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:29.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.803+0000 7efdc659c640 1 --2- 172.21.15.60:0/2292136106 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7efda806be30 0x7efda806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:29.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.803+0000 7efdbeffd640 1 -- 172.21.15.60:0/2292136106 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7efdb80ab4e0 con 0x7efdc8153740 2024-09-12T02:23:29.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.804+0000 7efdc659c640 1 --2- 172.21.15.60:0/2292136106 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7efda806be30 0x7efda806e2f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efdc0007dc0 tx=0x7efdc00072f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:29.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:29.808+0000 7efdbeffd640 1 -- 172.21.15.60:0/2292136106 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efdb8079bf0 con 0x7efdc8153740 2024-09-12T02:23:30.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.022+0000 7efdc759e640 1 -- 172.21.15.60:0/2292136106 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efdc80cb110 con 0x7efdc8153740 2024-09-12T02:23:30.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.022+0000 7efdbeffd640 1 -- 172.21.15.60:0/2292136106 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+6524 (secure 0 0 0) 0x7efdb80794f0 con 0x7efdc8153740 2024-09-12T02:23:30.023 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:23:30.023 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":11,"btime":"2024-09-12T02:23:19:846521+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3208837169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3208837169},{"type":"v1","addr":"172.21.15.60:6836","nonce":3208837169}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/664538827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":664538827},{"type":"v1","addr":"172.21.15.60:6837","nonce":664538827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:23:04.113913+0000","modified":"2024-09-12T02:23:07.140885+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/2854563525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2854563525},{"type":"v1","addr":"172.21.15.105:6835","nonce":2854563525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1},{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:23:16.184151+0000","modified":"2024-09-12T02:23:19.195177+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"d","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6834/248466084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":248466084},{"type":"v1","addr":"172.21.15.105:6834","nonce":248466084}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":2}]} 2024-09-12T02:23:30.023 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 11 2024-09-12T02:23:30.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.025+0000 7efdc759e640 1 -- 172.21.15.60:0/2292136106 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7efda806be30 msgr2=0x7efda806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:30.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.025+0000 7efdc759e640 1 --2- 172.21.15.60:0/2292136106 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7efda806be30 0x7efda806e2f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efdc0007dc0 tx=0x7efdc00072f0 comp rx=0 tx=0).stop 2024-09-12T02:23:30.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.025+0000 7efdc759e640 1 -- 172.21.15.60:0/2292136106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdc8153740 msgr2=0x7efdc8151a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:30.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.025+0000 7efdc759e640 1 --2- 172.21.15.60:0/2292136106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdc8153740 0x7efdc8151a90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7efdb80090b0 tx=0x7efdb80046c0 comp rx=0 tx=0).stop 2024-09-12T02:23:30.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.025+0000 7efdc759e640 1 -- 172.21.15.60:0/2292136106 shutdown_connections 2024-09-12T02:23:30.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.025+0000 7efdc759e640 1 --2- 172.21.15.60:0/2292136106 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7efda806be30 0x7efda806e2f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:30.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.025+0000 7efdc759e640 1 --2- 172.21.15.60:0/2292136106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdc8153740 0x7efdc8151a90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:30.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.025+0000 7efdc759e640 1 --2- 172.21.15.60:0/2292136106 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efdc80ca0c0 0x7efdc8148210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:30.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.025+0000 7efdc759e640 1 --2- 172.21.15.60:0/2292136106 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdc80c8d50 0x7efdc814e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:30.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.025+0000 7efdc759e640 1 -- 172.21.15.60:0/2292136106 >> 172.21.15.60:0/2292136106 conn(0x7efdc8073940 msgr2=0x7efdc806bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:30.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.025+0000 7efdc759e640 1 -- 172.21.15.60:0/2292136106 shutdown_connections 2024-09-12T02:23:30.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.025+0000 7efdc759e640 1 -- 172.21.15.60:0/2292136106 wait complete. 2024-09-12T02:23:30.036 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:23:30.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.138+0000 7f618055f640 1 Processor -- start 2024-09-12T02:23:30.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.138+0000 7f618055f640 1 -- start start 2024-09-12T02:23:30.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.139+0000 7f618055f640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6178072e70 0x7f6178073250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:30.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.139+0000 7f618055f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6178073c60 0x7f61781581f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:30.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.139+0000 7f618055f640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61780c5950 con 0x7f61780c2b50 2024-09-12T02:23:30.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.139+0000 7f618055f640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f6178071530 con 0x7f6178072e70 2024-09-12T02:23:30.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.139+0000 7f618055f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f61780c2800 con 0x7f6178073c60 2024-09-12T02:23:30.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.139+0000 7f617e2fb640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6178072e70 0x7f6178073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:30.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.139+0000 7f617eafc640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6178073c60 0x7f61781581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:30.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.140+0000 7f617dafa640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f61780c2b50 0x7f6178070e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:52174/0 (socket says 172.21.15.60:52174) 2024-09-12T02:23:30.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.140+0000 7f617dafa640 1 -- 172.21.15.60:0/2715564851 learned_addr learned my addr 172.21.15.60:0/2715564851 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:30.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.140+0000 7f617e2fb640 1 -- 172.21.15.60:0/2715564851 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6178073c60 msgr2=0x7f61781581f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:30.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.140+0000 7f617e2fb640 1 --2- 172.21.15.60:0/2715564851 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6178073c60 0x7f61781581f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:30.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.140+0000 7f617e2fb640 1 -- 172.21.15.60:0/2715564851 >> v1:172.21.15.105:6789/0 conn(0x7f61780c2b50 legacy=0x7f6178070e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:30.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.140+0000 7f617e2fb640 1 -- 172.21.15.60:0/2715564851 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6178073860 con 0x7f6178072e70 2024-09-12T02:23:30.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.140+0000 7f617eafc640 1 --2- 172.21.15.60:0/2715564851 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6178073c60 0x7f61781581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:23:30.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.140+0000 7f617d2f9640 1 -- 172.21.15.60:0/2715564851 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2171982374 0 0) 0x7f61780c5950 con 0x7f61780c2b50 2024-09-12T02:23:30.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.141+0000 7f617e2fb640 1 --2- 172.21.15.60:0/2715564851 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6178072e70 0x7f6178073250 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f61740097a0 tx=0x7f617402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9317eeeec431c083 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:30.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.141+0000 7f617d2f9640 1 -- 172.21.15.60:0/2715564851 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6174037070 con 0x7f6178072e70 2024-09-12T02:23:30.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.141+0000 7f617d2f9640 1 -- 172.21.15.60:0/2715564851 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f617402ae50 con 0x7f6178072e70 2024-09-12T02:23:30.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.141+0000 7f617d2f9640 1 -- 172.21.15.60:0/2715564851 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6174032660 con 0x7f6178072e70 2024-09-12T02:23:30.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.141+0000 7f618055f640 1 -- 172.21.15.60:0/2715564851 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6178072e70 msgr2=0x7f6178073250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:30.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.141+0000 7f618055f640 1 --2- 172.21.15.60:0/2715564851 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6178072e70 0x7f6178073250 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f61740097a0 tx=0x7f617402a100 comp rx=0 tx=0).stop 2024-09-12T02:23:30.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.141+0000 7f618055f640 1 -- 172.21.15.60:0/2715564851 shutdown_connections 2024-09-12T02:23:30.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.141+0000 7f618055f640 1 --2- 172.21.15.60:0/2715564851 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6178073c60 0x7f61781581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:30.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.141+0000 7f618055f640 1 --2- 172.21.15.60:0/2715564851 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6178072e70 0x7f6178073250 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:30.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.141+0000 7f618055f640 1 -- 172.21.15.60:0/2715564851 >> 172.21.15.60:0/2715564851 conn(0x7f61780c4c50 msgr2=0x7f61780c5060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:30.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.142+0000 7f618055f640 1 -- 172.21.15.60:0/2715564851 shutdown_connections 2024-09-12T02:23:30.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.142+0000 7f618055f640 1 -- 172.21.15.60:0/2715564851 wait complete. 2024-09-12T02:23:30.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.143+0000 7f618055f640 1 Processor -- start 2024-09-12T02:23:30.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.143+0000 7f618055f640 1 -- start start 2024-09-12T02:23:30.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.143+0000 7f618055f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6178072e70 0x7f6178149f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:30.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.143+0000 7f618055f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6178073c60 0x7f61780c6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:30.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.143+0000 7f618055f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61780c2b50 0x7f61780c7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:30.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.143+0000 7f618055f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6178151610 con 0x7f61780c2b50 2024-09-12T02:23:30.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.143+0000 7f618055f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6178151490 con 0x7f6178072e70 2024-09-12T02:23:30.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.143+0000 7f618055f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6178151790 con 0x7f6178073c60 2024-09-12T02:23:30.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.143+0000 7f617eafc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61780c2b50 0x7f61780c7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:30.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.143+0000 7f617eafc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61780c2b50 0x7f61780c7400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50174/0 (socket says 172.21.15.60:50174) 2024-09-12T02:23:30.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.143+0000 7f617eafc640 1 -- 172.21.15.60:0/3490324890 learned_addr learned my addr 172.21.15.60:0/3490324890 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:30.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.144+0000 7f617dafa640 1 --2- 172.21.15.60:0/3490324890 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6178073c60 0x7f61780c6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:30.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.144+0000 7f617e2fb640 1 --2- 172.21.15.60:0/3490324890 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6178072e70 0x7f6178149f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:30.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.144+0000 7f617eafc640 1 -- 172.21.15.60:0/3490324890 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6178073c60 msgr2=0x7f61780c6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:30.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.144+0000 7f617eafc640 1 --2- 172.21.15.60:0/3490324890 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6178073c60 0x7f61780c6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:30.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.144+0000 7f617eafc640 1 -- 172.21.15.60:0/3490324890 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6178072e70 msgr2=0x7f6178149f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:30.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.144+0000 7f617eafc640 1 --2- 172.21.15.60:0/3490324890 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6178072e70 0x7f6178149f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:30.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.144+0000 7f617eafc640 1 -- 172.21.15.60:0/3490324890 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61781ec7d0 con 0x7f61780c2b50 2024-09-12T02:23:30.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.144+0000 7f617e2fb640 1 --2- 172.21.15.60:0/3490324890 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6178072e70 0x7f6178149f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:23:30.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.144+0000 7f617eafc640 1 --2- 172.21.15.60:0/3490324890 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61780c2b50 0x7f61780c7400 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f617000efc0 tx=0x7f6170009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:30.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.144+0000 7f616effd640 1 -- 172.21.15.60:0/3490324890 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6170018030 con 0x7f61780c2b50 2024-09-12T02:23:30.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.144+0000 7f618055f640 1 -- 172.21.15.60:0/3490324890 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61780acc50 con 0x7f61780c2b50 2024-09-12T02:23:30.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.144+0000 7f616effd640 1 -- 172.21.15.60:0/3490324890 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f617000cd80 con 0x7f61780c2b50 2024-09-12T02:23:30.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.144+0000 7f616effd640 1 -- 172.21.15.60:0/3490324890 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6170003bb0 con 0x7f61780c2b50 2024-09-12T02:23:30.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.144+0000 7f618055f640 1 -- 172.21.15.60:0/3490324890 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f617814a440 con 0x7f61780c2b50 2024-09-12T02:23:30.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.145+0000 7f618055f640 1 -- 172.21.15.60:0/3490324890 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f617814f8f0 con 0x7f61780c2b50 2024-09-12T02:23:30.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.146+0000 7f616effd640 1 -- 172.21.15.60:0/3490324890 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f617001b070 con 0x7f61780c2b50 2024-09-12T02:23:30.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.146+0000 7f616effd640 1 --2- 172.21.15.60:0/3490324890 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f615c06be30 0x7f615c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:30.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.146+0000 7f617e2fb640 1 --2- 172.21.15.60:0/3490324890 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f615c06be30 0x7f615c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:30.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.146+0000 7f616effd640 1 -- 172.21.15.60:0/3490324890 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f617008bc30 con 0x7f61780c2b50 2024-09-12T02:23:30.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.147+0000 7f617e2fb640 1 --2- 172.21.15.60:0/3490324890 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f615c06be30 0x7f615c06e2f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6174034000 tx=0x7f617402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:30.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.151+0000 7f616effd640 1 -- 172.21.15.60:0/3490324890 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f617814f8f0 con 0x7f61780c2b50 2024-09-12T02:23:30.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.329+0000 7f618055f640 1 -- 172.21.15.60:0/3490324890 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6178073250 con 0x7f61780c2b50 2024-09-12T02:23:30.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.330+0000 7f616effd640 1 -- 172.21.15.60:0/3490324890 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+20439 (secure 0 0 0) 0x7f6170010040 con 0x7f61780c2b50 2024-09-12T02:23:30.331 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:23:30.331 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":26,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","created":"2024-09-12T02:22:39.869862+0000","modified":"2024-09-12T02:23:17.835334+0000","last_up_change":"2024-09-12T02:22:53.459371+0000","last_in_change":"2024-09-12T02:22:42.817076+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:22:52.130579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-09-12T02:23:01.854763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-09-12T02:23:03.104847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-09-12T02:23:14.175168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-09-12T02:23:15.166293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0f0c7386-002f-47e2-a7a3-6c8a70264cc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6819","nonce":1789465659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6821","nonce":1789465659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6825","nonce":1789465659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6823","nonce":1789465659}]},"public_addr":"172.21.15.60:6819/1789465659","cluster_addr":"172.21.15.60:6821/1789465659","heartbeat_back_addr":"172.21.15.60:6825/1789465659","heartbeat_front_addr":"172.21.15.60:6823/1789465659","state":["exists","up"]},{"osd":1,"uuid":"64be7b84-36fc-43c0-9e70-a617e5b68941","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6811","nonce":1109822408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6813","nonce":1109822408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6817","nonce":1109822408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6815","nonce":1109822408}]},"public_addr":"172.21.15.60:6811/1109822408","cluster_addr":"172.21.15.60:6813/1109822408","heartbeat_back_addr":"172.21.15.60:6817/1109822408","heartbeat_front_addr":"172.21.15.60:6815/1109822408","state":["exists","up"]},{"osd":2,"uuid":"df00caa1-d45e-4b87-ac1e-8bc098d509d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6827","nonce":278470077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6829","nonce":278470077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6833","nonce":278470077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6831","nonce":278470077}]},"public_addr":"172.21.15.60:6827/278470077","cluster_addr":"172.21.15.60:6829/278470077","heartbeat_back_addr":"172.21.15.60:6833/278470077","heartbeat_front_addr":"172.21.15.60:6831/278470077","state":["exists","up"]},{"osd":3,"uuid":"f6453471-893a-490b-b0c7-f196a0f574e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6803","nonce":3606424156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6805","nonce":3606424156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6809","nonce":3606424156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6807","nonce":3606424156}]},"public_addr":"172.21.15.60:6803/3606424156","cluster_addr":"172.21.15.60:6805/3606424156","heartbeat_back_addr":"172.21.15.60:6809/3606424156","heartbeat_front_addr":"172.21.15.60:6807/3606424156","state":["exists","up"]},{"osd":4,"uuid":"96e908b6-ce3e-466c-b02d-08fc71a1dba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6809","nonce":1581641129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6811","nonce":1581641129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6815","nonce":1581641129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6813","nonce":1581641129}]},"public_addr":"172.21.15.105:6809/1581641129","cluster_addr":"172.21.15.105:6811/1581641129","heartbeat_back_addr":"172.21.15.105:6815/1581641129","heartbeat_front_addr":"172.21.15.105:6813/1581641129","state":["exists","up"]},{"osd":5,"uuid":"7ebc26f0-a462-4364-9303-7351f7cba21f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6825","nonce":1392337793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6827","nonce":1392337793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6831","nonce":1392337793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6829","nonce":1392337793}]},"public_addr":"172.21.15.105:6825/1392337793","cluster_addr":"172.21.15.105:6827/1392337793","heartbeat_back_addr":"172.21.15.105:6831/1392337793","heartbeat_front_addr":"172.21.15.105:6829/1392337793","state":["exists","up"]},{"osd":6,"uuid":"49487ea1-9c6d-4090-bbcc-f28b33040eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6801","nonce":50951309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6803","nonce":50951309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6807","nonce":50951309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6805","nonce":50951309}]},"public_addr":"172.21.15.105:6801/50951309","cluster_addr":"172.21.15.105:6803/50951309","heartbeat_back_addr":"172.21.15.105:6807/50951309","heartbeat_front_addr":"172.21.15.105:6805/50951309","state":["exists","up"]},{"osd":7,"uuid":"1e3a0aa9-7e29-4785-8506-6b5d3be2be35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6817","nonce":3745331251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6819","nonce":3745331251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6823","nonce":3745331251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6821","nonce":3745331251}]},"public_addr":"172.21.15.105:6817/3745331251","cluster_addr":"172.21.15.105:6819/3745331251","heartbeat_back_addr":"172.21.15.105:6823/3745331251","heartbeat_front_addr":"172.21.15.105:6821/3745331251","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:50.112629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.307689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.542851+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.334773+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:50.096967+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:50.259633+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.888988+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.917421+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:23:30.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.333+0000 7f618055f640 1 -- 172.21.15.60:0/3490324890 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f615c06be30 msgr2=0x7f615c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:30.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.333+0000 7f618055f640 1 --2- 172.21.15.60:0/3490324890 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f615c06be30 0x7f615c06e2f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6174034000 tx=0x7f617402e000 comp rx=0 tx=0).stop 2024-09-12T02:23:30.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.333+0000 7f618055f640 1 -- 172.21.15.60:0/3490324890 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61780c2b50 msgr2=0x7f61780c7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:30.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.333+0000 7f618055f640 1 --2- 172.21.15.60:0/3490324890 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61780c2b50 0x7f61780c7400 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f617000efc0 tx=0x7f6170009f90 comp rx=0 tx=0).stop 2024-09-12T02:23:30.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.333+0000 7f618055f640 1 -- 172.21.15.60:0/3490324890 shutdown_connections 2024-09-12T02:23:30.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.333+0000 7f618055f640 1 --2- 172.21.15.60:0/3490324890 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f615c06be30 0x7f615c06e2f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:30.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.333+0000 7f618055f640 1 --2- 172.21.15.60:0/3490324890 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61780c2b50 0x7f61780c7400 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:30.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.333+0000 7f618055f640 1 --2- 172.21.15.60:0/3490324890 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6178073c60 0x7f61780c6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:30.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.333+0000 7f618055f640 1 --2- 172.21.15.60:0/3490324890 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6178072e70 0x7f6178149f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:30.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.333+0000 7f618055f640 1 -- 172.21.15.60:0/3490324890 >> 172.21.15.60:0/3490324890 conn(0x7f61780c4c50 msgr2=0x7f6178070e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:30.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.333+0000 7f618055f640 1 -- 172.21.15.60:0/3490324890 shutdown_connections 2024-09-12T02:23:30.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.333+0000 7f618055f640 1 -- 172.21.15.60:0/3490324890 wait complete. 2024-09-12T02:23:30.345 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:23:30.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.446+0000 7f021fd8f640 1 Processor -- start 2024-09-12T02:23:30.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.446+0000 7f021fd8f640 1 -- start start 2024-09-12T02:23:30.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.447+0000 7f021fd8f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02180af870 0x7f02180c4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:30.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.447+0000 7f021fd8f640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02180c54e0 con 0x7f0218153af0 2024-09-12T02:23:30.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.447+0000 7f021fd8f640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02180c74a0 con 0x7f02180afdd0 2024-09-12T02:23:30.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.447+0000 7f021fd8f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f02180c7740 con 0x7f02180af870 2024-09-12T02:23:30.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.447+0000 7f021db2b640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f0218153af0 0x7f02181563a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:35344/0 (socket says 172.21.15.60:35344) 2024-09-12T02:23:30.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.447+0000 7f021db2b640 1 -- 172.21.15.60:0/1233775453 learned_addr learned my addr 172.21.15.60:0/1233775453 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:30.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.447+0000 7f021e32c640 1 --2- 172.21.15.60:0/1233775453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02180af870 0x7f02180c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:30.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.447+0000 7f021cb29640 1 -- 172.21.15.60:0/1233775453 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2943906680 0 0) 0x7f02180c54e0 con 0x7f0218153af0 2024-09-12T02:23:30.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.447+0000 7f021cb29640 1 -- 172.21.15.60:0/1233775453 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0200003520 con 0x7f0218153af0 2024-09-12T02:23:30.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.448+0000 7f021cb29640 1 -- 172.21.15.60:0/1233775453 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4095370440 0 0) 0x7f0200003520 con 0x7f0218153af0 2024-09-12T02:23:30.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.448+0000 7f021cb29640 1 -- 172.21.15.60:0/1233775453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02180af870 msgr2=0x7f02180c4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:30.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.448+0000 7f021cb29640 1 --2- 172.21.15.60:0/1233775453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02180af870 0x7f02180c4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:30.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.448+0000 7f021cb29640 1 -- 172.21.15.60:0/1233775453 >> v1:172.21.15.105:6789/0 conn(0x7f02180afdd0 legacy=0x7f02180c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:30.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.448+0000 7f021cb29640 1 -- 172.21.15.60:0/1233775453 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f021815a3c0 con 0x7f0218153af0 2024-09-12T02:23:30.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.448+0000 7f021cb29640 1 -- 172.21.15.60:0/1233775453 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7f02080019f0 con 0x7f0218153af0 2024-09-12T02:23:30.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.448+0000 7f021cb29640 1 -- 172.21.15.60:0/1233775453 >> v1:172.21.15.60:6789/0 conn(0x7f0218153af0 legacy=0x7f02181563a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:30.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.448+0000 7f021cb29640 1 --2- 172.21.15.60:0/1233775453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02180af870 0x7f02000039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:30.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.448+0000 7f021cb29640 1 --2- 172.21.15.60:0/1233775453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0200003f20 0x7f0200004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:30.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.448+0000 7f021cb29640 1 --2- 172.21.15.60:0/1233775453 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0200004d40 0x7f02000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:30.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.448+0000 7f021cb29640 1 -- 172.21.15.60:0/1233775453 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f02180c7740 con 0x7f0200003f20 2024-09-12T02:23:30.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.448+0000 7f021cb29640 1 -- 172.21.15.60:0/1233775453 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f020000bbb0 con 0x7f0200004d40 2024-09-12T02:23:30.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.448+0000 7f021cb29640 1 -- 172.21.15.60:0/1233775453 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f020000bdb0 con 0x7f02180af870 2024-09-12T02:23:30.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.448+0000 7f021d32a640 1 --2- 172.21.15.60:0/1233775453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0200003f20 0x7f0200004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:30.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.448+0000 7f021db2b640 1 --2- 172.21.15.60:0/1233775453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02180af870 0x7f02000039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:30.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.448+0000 7f021e32c640 1 --2- 172.21.15.60:0/1233775453 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0200004d40 0x7f02000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:30.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.448+0000 7f021d32a640 1 -- 172.21.15.60:0/1233775453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02180af870 msgr2=0x7f02000039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:30.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.448+0000 7f021d32a640 1 --2- 172.21.15.60:0/1233775453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02180af870 0x7f02000039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:30.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.448+0000 7f021d32a640 1 -- 172.21.15.60:0/1233775453 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0200004d40 msgr2=0x7f02000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:30.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.448+0000 7f021d32a640 1 --2- 172.21.15.60:0/1233775453 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0200004d40 0x7f02000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:30.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.448+0000 7f021d32a640 1 -- 172.21.15.60:0/1233775453 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0200003520 con 0x7f0200003f20 2024-09-12T02:23:30.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.449+0000 7f021d32a640 1 --2- 172.21.15.60:0/1233775453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0200003f20 0x7f0200004800 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f020c001860 tx=0x7f0200005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb7430f404a6c62f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:30.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.449+0000 7f021cb29640 1 -- 172.21.15.60:0/1233775453 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f020c037070 con 0x7f0200003f20 2024-09-12T02:23:30.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.449+0000 7f021cb29640 1 -- 172.21.15.60:0/1233775453 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f020c02abf0 con 0x7f0200003f20 2024-09-12T02:23:30.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.449+0000 7f021cb29640 1 -- 172.21.15.60:0/1233775453 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f020c001430 con 0x7f0200003f20 2024-09-12T02:23:30.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.450+0000 7f021fd8f640 1 -- 172.21.15.60:0/1233775453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0200003f20 msgr2=0x7f0200004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:30.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.450+0000 7f021fd8f640 1 --2- 172.21.15.60:0/1233775453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0200003f20 0x7f0200004800 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f020c001860 tx=0x7f0200005830 comp rx=0 tx=0).stop 2024-09-12T02:23:30.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.450+0000 7f021e32c640 1 -- 172.21.15.60:0/1233775453 reap_dead start 2024-09-12T02:23:30.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.450+0000 7f021fd8f640 1 -- 172.21.15.60:0/1233775453 shutdown_connections 2024-09-12T02:23:30.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.450+0000 7f021fd8f640 1 -- 172.21.15.60:0/1233775453 >> 172.21.15.60:0/1233775453 conn(0x7f02180c6880 msgr2=0x7f02180c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:30.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.450+0000 7f021fd8f640 1 -- 172.21.15.60:0/1233775453 shutdown_connections 2024-09-12T02:23:30.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.450+0000 7f021fd8f640 1 -- 172.21.15.60:0/1233775453 wait complete. 2024-09-12T02:23:30.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.451+0000 7f021fd8f640 1 Processor -- start 2024-09-12T02:23:30.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.451+0000 7f021fd8f640 1 -- start start 2024-09-12T02:23:30.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.452+0000 7f021fd8f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0200003f20 0x7f02181565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:30.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.452+0000 7f021fd8f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0218159eb0 0x7f021814bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:30.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.452+0000 7f021fd8f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f021814c290 0x7f02181582d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:30.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.452+0000 7f021fd8f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f02180c4900 con 0x7f0218159eb0 2024-09-12T02:23:30.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.452+0000 7f021fd8f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f02180c4780 con 0x7f021814c290 2024-09-12T02:23:30.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.452+0000 7f021fd8f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f02180c4a80 con 0x7f0200003f20 2024-09-12T02:23:30.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.452+0000 7f021d32a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0218159eb0 0x7f021814bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:30.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.452+0000 7f021d32a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0218159eb0 0x7f021814bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50182/0 (socket says 172.21.15.60:50182) 2024-09-12T02:23:30.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.452+0000 7f021d32a640 1 -- 172.21.15.60:0/319954437 learned_addr learned my addr 172.21.15.60:0/319954437 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:30.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.452+0000 7f021e32c640 1 --2- 172.21.15.60:0/319954437 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f021814c290 0x7f02181582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:30.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.452+0000 7f021db2b640 1 --2- 172.21.15.60:0/319954437 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0200003f20 0x7f02181565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:30.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.452+0000 7f021d32a640 1 -- 172.21.15.60:0/319954437 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0200003f20 msgr2=0x7f02181565e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:30.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.452+0000 7f021d32a640 1 --2- 172.21.15.60:0/319954437 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0200003f20 0x7f02181565e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:30.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.452+0000 7f021d32a640 1 -- 172.21.15.60:0/319954437 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f021814c290 msgr2=0x7f02181582d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:30.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.452+0000 7f021d32a640 1 --2- 172.21.15.60:0/319954437 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f021814c290 0x7f02181582d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:30.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.452+0000 7f021d32a640 1 -- 172.21.15.60:0/319954437 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0218155b80 con 0x7f0218159eb0 2024-09-12T02:23:30.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.452+0000 7f021d32a640 1 --2- 172.21.15.60:0/319954437 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0218159eb0 0x7f021814bd50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f020c001980 tx=0x7f020c001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:30.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.452+0000 7f02167fc640 1 -- 172.21.15.60:0/319954437 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f020c03f020 con 0x7f0218159eb0 2024-09-12T02:23:30.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.452+0000 7f02167fc640 1 -- 172.21.15.60:0/319954437 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f020c005270 con 0x7f0218159eb0 2024-09-12T02:23:30.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.452+0000 7f021fd8f640 1 -- 172.21.15.60:0/319954437 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0218155e60 con 0x7f0218159eb0 2024-09-12T02:23:30.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.452+0000 7f02167fc640 1 -- 172.21.15.60:0/319954437 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f020c037040 con 0x7f0218159eb0 2024-09-12T02:23:30.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.452+0000 7f021fd8f640 1 -- 172.21.15.60:0/319954437 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0218156b20 con 0x7f0218159eb0 2024-09-12T02:23:30.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.453+0000 7f021fd8f640 1 -- 172.21.15.60:0/319954437 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0218156030 con 0x7f0218159eb0 2024-09-12T02:23:30.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.454+0000 7f02167fc640 1 -- 172.21.15.60:0/319954437 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f020c042020 con 0x7f0218159eb0 2024-09-12T02:23:30.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.454+0000 7f02167fc640 1 --2- 172.21.15.60:0/319954437 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f020406be30 0x7f020406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:30.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.454+0000 7f02167fc640 1 -- 172.21.15.60:0/319954437 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f020c0aaed0 con 0x7f0218159eb0 2024-09-12T02:23:30.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.454+0000 7f021db2b640 1 --2- 172.21.15.60:0/319954437 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f020406be30 0x7f020406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:30.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.455+0000 7f021db2b640 1 --2- 172.21.15.60:0/319954437 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f020406be30 0x7f020406e2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0208002230 tx=0x7f0208006040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:30.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.459+0000 7f02167fc640 1 -- 172.21.15.60:0/319954437 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f020c049030 con 0x7f0218159eb0 2024-09-12T02:23:30.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.669+0000 7f021fd8f640 1 -- 172.21.15.60:0/319954437 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f021806ec90 con 0x7f0218159eb0 2024-09-12T02:23:30.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.669+0000 7f02167fc640 1 -- 172.21.15.60:0/319954437 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+6524 (secure 0 0 0) 0x7f020c078e60 con 0x7f0218159eb0 2024-09-12T02:23:30.670 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:23:30.670 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":11,"btime":"2024-09-12T02:23:19:846521+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3208837169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3208837169},{"type":"v1","addr":"172.21.15.60:6836","nonce":3208837169}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/664538827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":664538827},{"type":"v1","addr":"172.21.15.60:6837","nonce":664538827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:23:04.113913+0000","modified":"2024-09-12T02:23:07.140885+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/2854563525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2854563525},{"type":"v1","addr":"172.21.15.105:6835","nonce":2854563525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1},{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:23:16.184151+0000","modified":"2024-09-12T02:23:19.195177+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"d","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6834/248466084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":248466084},{"type":"v1","addr":"172.21.15.105:6834","nonce":248466084}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":2}]} 2024-09-12T02:23:30.671 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 11 2024-09-12T02:23:30.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.672+0000 7f021fd8f640 1 -- 172.21.15.60:0/319954437 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f020406be30 msgr2=0x7f020406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:30.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.672+0000 7f021fd8f640 1 --2- 172.21.15.60:0/319954437 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f020406be30 0x7f020406e2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0208002230 tx=0x7f0208006040 comp rx=0 tx=0).stop 2024-09-12T02:23:30.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.672+0000 7f021fd8f640 1 -- 172.21.15.60:0/319954437 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0218159eb0 msgr2=0x7f021814bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:30.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.672+0000 7f021fd8f640 1 --2- 172.21.15.60:0/319954437 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0218159eb0 0x7f021814bd50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f020c001980 tx=0x7f020c001230 comp rx=0 tx=0).stop 2024-09-12T02:23:30.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.672+0000 7f021fd8f640 1 -- 172.21.15.60:0/319954437 shutdown_connections 2024-09-12T02:23:30.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.672+0000 7f021fd8f640 1 --2- 172.21.15.60:0/319954437 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f020406be30 0x7f020406e2f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:30.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.672+0000 7f021fd8f640 1 --2- 172.21.15.60:0/319954437 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f021814c290 0x7f02181582d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:30.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.672+0000 7f021fd8f640 1 --2- 172.21.15.60:0/319954437 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0218159eb0 0x7f021814bd50 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:30.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.672+0000 7f021fd8f640 1 --2- 172.21.15.60:0/319954437 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0200003f20 0x7f02181565e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:30.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.672+0000 7f021fd8f640 1 -- 172.21.15.60:0/319954437 >> 172.21.15.60:0/319954437 conn(0x7f02180c6880 msgr2=0x7f02180c60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:30.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.672+0000 7f021fd8f640 1 -- 172.21.15.60:0/319954437 shutdown_connections 2024-09-12T02:23:30.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:30.672+0000 7f021fd8f640 1 -- 172.21.15.60:0/319954437 wait complete. 2024-09-12T02:23:31.085 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 11, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:23:16.184151+0000', 'modified': '2024-09-12T02:23:19.195177+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4278}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4278': {'gid': 4278, 'name': 'd', 'rank': 0, 'incarnation': 8, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.105:6834/248466084', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6832', 'nonce': 248466084}, {'type': 'v1', 'addr': '172.21.15.105:6834', 'nonce': 248466084}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'b', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4278, 'qdb_cluster': [4278]} 2024-09-12T02:23:31.086 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T02:23:31.086 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-12T02:23:31.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.195+0000 7f6a5c647640 1 Processor -- start 2024-09-12T02:23:31.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.195+0000 7f6a5c647640 1 -- start start 2024-09-12T02:23:31.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.196+0000 7f6a5c647640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6a54153de0 0x7f6a540ca640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:31.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.196+0000 7f6a5c647640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6a5406bbe0 0x7f6a5406c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:31.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.196+0000 7f6a5c647640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a540cab80 con 0x7f6a541598c0 2024-09-12T02:23:31.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.196+0000 7f6a5c647640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f6a540c9480 con 0x7f6a54153de0 2024-09-12T02:23:31.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.196+0000 7f6a5c647640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f6a540cb620 con 0x7f6a5406bbe0 2024-09-12T02:23:31.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.196+0000 7f6a5a3e3640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6a54153de0 0x7f6a540ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:31.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.196+0000 7f6a5a3e3640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6a54153de0 0x7f6a540ca640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50194/0 (socket says 172.21.15.60:50194) 2024-09-12T02:23:31.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.196+0000 7f6a5a3e3640 1 -- 172.21.15.60:0/3022992594 learned_addr learned my addr 172.21.15.60:0/3022992594 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:31.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.196+0000 7f6a59be2640 1 --2- 172.21.15.60:0/3022992594 >> v2:172.21.15.105:3300/0 conn(0x7f6a5406bbe0 0x7f6a5406c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:31.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.196+0000 7f6a5a3e3640 1 -- 172.21.15.60:0/3022992594 >> v2:172.21.15.105:3300/0 conn(0x7f6a5406bbe0 msgr2=0x7f6a5406c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:31.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.196+0000 7f6a5a3e3640 1 --2- 172.21.15.60:0/3022992594 >> v2:172.21.15.105:3300/0 conn(0x7f6a5406bbe0 0x7f6a5406c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:31.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.196+0000 7f6a5a3e3640 1 -- 172.21.15.60:0/3022992594 >> v1:172.21.15.105:6789/0 conn(0x7f6a541598c0 legacy=0x7f6a54159d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:31.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.196+0000 7f6a5a3e3640 1 -- 172.21.15.60:0/3022992594 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a540c6b20 con 0x7f6a54153de0 2024-09-12T02:23:31.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.197+0000 7f6a5a3e3640 1 --2- 172.21.15.60:0/3022992594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a54153de0 0x7f6a540ca640 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6a540c8760 tx=0x7f6a5002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ec46a47872b0908 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:31.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.197+0000 7f6a593e1640 1 -- 172.21.15.60:0/3022992594 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a50037070 con 0x7f6a54153de0 2024-09-12T02:23:31.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.197+0000 7f6a593e1640 1 -- 172.21.15.60:0/3022992594 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a50032440 con 0x7f6a54153de0 2024-09-12T02:23:31.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.197+0000 7f6a593e1640 1 -- 172.21.15.60:0/3022992594 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a50032810 con 0x7f6a54153de0 2024-09-12T02:23:31.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.198+0000 7f6a5c647640 1 -- 172.21.15.60:0/3022992594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a54153de0 msgr2=0x7f6a540ca640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:31.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.198+0000 7f6a5c647640 1 --2- 172.21.15.60:0/3022992594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a54153de0 0x7f6a540ca640 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6a540c8760 tx=0x7f6a5002a270 comp rx=0 tx=0).stop 2024-09-12T02:23:31.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.198+0000 7f6a5c647640 1 -- 172.21.15.60:0/3022992594 shutdown_connections 2024-09-12T02:23:31.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.198+0000 7f6a5c647640 1 --2- 172.21.15.60:0/3022992594 >> v2:172.21.15.105:3300/0 conn(0x7f6a5406bbe0 0x7f6a5406c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:31.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.198+0000 7f6a5c647640 1 --2- 172.21.15.60:0/3022992594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a54153de0 0x7f6a540ca640 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:31.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.198+0000 7f6a5c647640 1 -- 172.21.15.60:0/3022992594 >> 172.21.15.60:0/3022992594 conn(0x7f6a540c8800 msgr2=0x7f6a540c8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:31.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.198+0000 7f6a5c647640 1 -- 172.21.15.60:0/3022992594 shutdown_connections 2024-09-12T02:23:31.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.198+0000 7f6a5c647640 1 -- 172.21.15.60:0/3022992594 wait complete. 2024-09-12T02:23:31.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.199+0000 7f6a5c647640 1 Processor -- start 2024-09-12T02:23:31.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.199+0000 7f6a5c647640 1 -- start start 2024-09-12T02:23:31.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.200+0000 7f6a5c647640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a5406bbe0 0x7f6a541effe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:31.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.200+0000 7f6a5c647640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a54153de0 0x7f6a541eca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:31.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.200+0000 7f6a5c647640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a541598c0 0x7f6a540afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:31.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.200+0000 7f6a5c647640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5406c560 con 0x7f6a54153de0 2024-09-12T02:23:31.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.200+0000 7f6a5c647640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6a540c70e0 con 0x7f6a5406bbe0 2024-09-12T02:23:31.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.200+0000 7f6a5c647640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6a540cbab0 con 0x7f6a541598c0 2024-09-12T02:23:31.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.200+0000 7f6a59be2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a54153de0 0x7f6a541eca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:31.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.200+0000 7f6a59be2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a54153de0 0x7f6a541eca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50196/0 (socket says 172.21.15.60:50196) 2024-09-12T02:23:31.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.200+0000 7f6a59be2640 1 -- 172.21.15.60:0/67256449 learned_addr learned my addr 172.21.15.60:0/67256449 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:31.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.200+0000 7f6a5a3e3640 1 --2- 172.21.15.60:0/67256449 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a5406bbe0 0x7f6a541effe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:31.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.200+0000 7f6a5abe4640 1 --2- 172.21.15.60:0/67256449 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a541598c0 0x7f6a540afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:31.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.200+0000 7f6a59be2640 1 -- 172.21.15.60:0/67256449 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a541598c0 msgr2=0x7f6a540afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:31.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.200+0000 7f6a59be2640 1 --2- 172.21.15.60:0/67256449 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a541598c0 0x7f6a540afbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:31.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.200+0000 7f6a59be2640 1 -- 172.21.15.60:0/67256449 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a5406bbe0 msgr2=0x7f6a541effe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:31.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.200+0000 7f6a59be2640 1 --2- 172.21.15.60:0/67256449 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a5406bbe0 0x7f6a541effe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:31.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.200+0000 7f6a59be2640 1 -- 172.21.15.60:0/67256449 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a541596a0 con 0x7f6a54153de0 2024-09-12T02:23:31.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.200+0000 7f6a59be2640 1 --2- 172.21.15.60:0/67256449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a54153de0 0x7f6a541eca50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6a4400d800 tx=0x7f6a4400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:31.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.201+0000 7f6a4affd640 1 -- 172.21.15.60:0/67256449 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a4400b660 con 0x7f6a54153de0 2024-09-12T02:23:31.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.201+0000 7f6a4affd640 1 -- 172.21.15.60:0/67256449 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a44019070 con 0x7f6a54153de0 2024-09-12T02:23:31.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.201+0000 7f6a5c647640 1 -- 172.21.15.60:0/67256449 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a541ecf90 con 0x7f6a54153de0 2024-09-12T02:23:31.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.201+0000 7f6a4affd640 1 -- 172.21.15.60:0/67256449 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a4400ba20 con 0x7f6a54153de0 2024-09-12T02:23:31.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.201+0000 7f6a5c647640 1 -- 172.21.15.60:0/67256449 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a54152660 con 0x7f6a54153de0 2024-09-12T02:23:31.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.202+0000 7f6a4affd640 1 -- 172.21.15.60:0/67256449 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6a4400bbc0 con 0x7f6a54153de0 2024-09-12T02:23:31.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.203+0000 7f6a4affd640 1 --2- 172.21.15.60:0/67256449 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f6a3806be30 0x7f6a3806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:31.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.203+0000 7f6a4affd640 1 -- 172.21.15.60:0/67256449 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f6a4408b490 con 0x7f6a54153de0 2024-09-12T02:23:31.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.203+0000 7f6a5a3e3640 1 --2- 172.21.15.60:0/67256449 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f6a3806be30 0x7f6a3806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:31.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.203+0000 7f6a5a3e3640 1 --2- 172.21.15.60:0/67256449 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f6a3806be30 0x7f6a3806e2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6a50034000 tx=0x7f6a5002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:31.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.204+0000 7f6a5f3dc740 1 Processor -- start 2024-09-12T02:23:31.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.204+0000 7f6a5f3dc740 1 -- start start 2024-09-12T02:23:31.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.204+0000 7f6a5f3dc740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564487e2c080 0x564487e2a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:31.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.205+0000 7f6a5f3dc740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x564487e66a60 0x564487e2c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:31.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.205+0000 7f6a5f3dc740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564487e65720 0x564487e28960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:31.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.205+0000 7f6a5f3dc740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x564487d8d520 con 0x564487e2c080 2024-09-12T02:23:31.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.205+0000 7f6a5f3dc740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x564487d353e0 con 0x564487e65720 2024-09-12T02:23:31.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.205+0000 7f6a5f3dc740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x564487d894e0 con 0x564487e66a60 2024-09-12T02:23:31.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.205+0000 7f6a5a3e3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564487e2c080 0x564487e2a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:31.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.205+0000 7f6a5a3e3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564487e2c080 0x564487e2a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50202/0 (socket says 172.21.15.60:50202) 2024-09-12T02:23:31.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.205+0000 7f6a5a3e3640 1 -- 172.21.15.60:0/3817756933 learned_addr learned my addr 172.21.15.60:0/3817756933 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:31.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.205+0000 7f6a5a3e3640 1 -- 172.21.15.60:0/3817756933 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x564487e66a60 msgr2=0x564487e2c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:31.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.205+0000 7f6a5a3e3640 1 --2- 172.21.15.60:0/3817756933 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x564487e66a60 0x564487e2c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:31.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.205+0000 7f6a5a3e3640 1 -- 172.21.15.60:0/3817756933 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564487e65720 msgr2=0x564487e28960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:31.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.205+0000 7f6a5abe4640 1 --2- 172.21.15.60:0/3817756933 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564487e65720 0x564487e28960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:31.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.205+0000 7f6a5a3e3640 1 --2- 172.21.15.60:0/3817756933 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564487e65720 0x564487e28960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:31.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.205+0000 7f6a5a3e3640 1 -- 172.21.15.60:0/3817756933 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564487d502f0 con 0x564487e2c080 2024-09-12T02:23:31.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.205+0000 7f6a5abe4640 1 --2- 172.21.15.60:0/3817756933 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564487e65720 0x564487e28960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:23:31.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.205+0000 7f6a5a3e3640 1 --2- 172.21.15.60:0/3817756933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564487e2c080 0x564487e2a980 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6a50000c00 tx=0x7f6a5002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1867d08f2dbc12ab server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:31.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.205+0000 7f6a37fff640 1 -- 172.21.15.60:0/3817756933 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a50037040 con 0x564487e2c080 2024-09-12T02:23:31.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.205+0000 7f6a37fff640 1 -- 172.21.15.60:0/3817756933 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a5004e070 con 0x564487e2c080 2024-09-12T02:23:31.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.205+0000 7f6a37fff640 1 -- 172.21.15.60:0/3817756933 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a50049480 con 0x564487e2c080 2024-09-12T02:23:31.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.206+0000 7f6a5f3dc740 1 -- 172.21.15.60:0/3817756933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564487e2c080 msgr2=0x564487e2a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:31.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.206+0000 7f6a5f3dc740 1 --2- 172.21.15.60:0/3817756933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564487e2c080 0x564487e2a980 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6a50000c00 tx=0x7f6a5002c000 comp rx=0 tx=0).stop 2024-09-12T02:23:31.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.206+0000 7f6a5f3dc740 1 -- 172.21.15.60:0/3817756933 shutdown_connections 2024-09-12T02:23:31.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.206+0000 7f6a5f3dc740 1 --2- 172.21.15.60:0/3817756933 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564487e65720 0x564487e28960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:31.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.206+0000 7f6a5f3dc740 1 --2- 172.21.15.60:0/3817756933 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x564487e66a60 0x564487e2c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:31.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.206+0000 7f6a5f3dc740 1 --2- 172.21.15.60:0/3817756933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564487e2c080 0x564487e2a980 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:31.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.206+0000 7f6a5f3dc740 1 -- 172.21.15.60:0/3817756933 >> 172.21.15.60:0/3817756933 conn(0x564487e27960 msgr2=0x564487e2b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:31.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.206+0000 7f6a5f3dc740 1 -- 172.21.15.60:0/3817756933 shutdown_connections 2024-09-12T02:23:31.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.206+0000 7f6a5f3dc740 1 -- 172.21.15.60:0/3817756933 wait complete. 2024-09-12T02:23:31.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.207+0000 7f6a5f3dc740 1 -- start start 2024-09-12T02:23:31.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.207+0000 7f6a5f3dc740 1 Processor -- start 2024-09-12T02:23:31.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.208+0000 7f6a5f3dc740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564487e65720 0x564487e67fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:31.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.208+0000 7f6a5f3dc740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564487e66a60 0x564487e7a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:31.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.208+0000 7f6a5f3dc740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x564487e68520 0x564487e7a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:31.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.208+0000 7f6a5f3dc740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x564487e2c9a0 con 0x564487e66a60 2024-09-12T02:23:31.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.208+0000 7f6a5f3dc740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x564487d16450 con 0x564487e65720 2024-09-12T02:23:31.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.208+0000 7f6a5f3dc740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x564487e29bc0 con 0x564487e68520 2024-09-12T02:23:31.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.208+0000 7f6a5f3dc740 10 client.0 _ll_register_callbacks cb 0x564487a9fac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:23:31.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.208+0000 7f6a59be2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564487e66a60 0x564487e7a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:31.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.208+0000 7f6a59be2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564487e66a60 0x564487e7a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50214/0 (socket says 172.21.15.60:50214) 2024-09-12T02:23:31.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.208+0000 7f6a59be2640 1 -- 172.21.15.60:0/2383982460 learned_addr learned my addr 172.21.15.60:0/2383982460 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:31.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.208+0000 7f6a5a3e3640 1 --2- 172.21.15.60:0/2383982460 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564487e65720 0x564487e67fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:31.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.208+0000 7f6a5abe4640 1 --2- 172.21.15.60:0/2383982460 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x564487e68520 0x564487e7a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:31.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.208+0000 7f6a59be2640 1 -- 172.21.15.60:0/2383982460 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x564487e68520 msgr2=0x564487e7a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:31.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.208+0000 7f6a59be2640 1 --2- 172.21.15.60:0/2383982460 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x564487e68520 0x564487e7a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:31.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.208+0000 7f6a59be2640 1 -- 172.21.15.60:0/2383982460 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564487e65720 msgr2=0x564487e67fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:31.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.208+0000 7f6a59be2640 1 --2- 172.21.15.60:0/2383982460 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564487e65720 0x564487e67fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:31.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.208+0000 7f6a59be2640 1 -- 172.21.15.60:0/2383982460 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564487aa02d0 con 0x564487e66a60 2024-09-12T02:23:31.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.208+0000 7f6a59be2640 1 --2- 172.21.15.60:0/2383982460 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564487e66a60 0x564487e7a190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6a44061ab0 tx=0x7f6a440595f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d785015e5c292e60 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:31.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.208+0000 7f6a357fa640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T02:23:31.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.208+0000 7f6a357fa640 1 -- 172.21.15.60:0/2383982460 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a44071070 con 0x564487e66a60 2024-09-12T02:23:31.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.208+0000 7f6a357fa640 1 -- 172.21.15.60:0/2383982460 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f6a44071210 con 0x564487e66a60 2024-09-12T02:23:31.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.208+0000 7f6a5f3dc740 1 -- 172.21.15.60:0/2383982460 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a5004e070 con 0x564487e66a60 2024-09-12T02:23:31.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.208+0000 7f6a357fa640 1 -- 172.21.15.60:0/2383982460 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=11) ==== 24+0+0 (secure 0 0 0) 0x7f6a44071430 con 0x564487e66a60 2024-09-12T02:23:31.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.208+0000 7f6a5f3dc740 10 client.4791 fetch_fsmap learned FSMap version 11 2024-09-12T02:23:31.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.208+0000 7f6a5f3dc740 1 -- 172.21.15.60:0/2383982460 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=11,monmap=2+}) -- 0x564487b6a6b0 con 0x564487e66a60 2024-09-12T02:23:31.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.209+0000 7f6a357fa640 1 -- 172.21.15.60:0/2383982460 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a5004e070 con 0x564487e66a60 2024-09-12T02:23:31.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.209+0000 7f6a357fa640 1 -- 172.21.15.60:0/2383982460 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 11) ==== 4136+0+0 (secure 0 0 0) 0x7f6a44013070 con 0x564487e66a60 2024-09-12T02:23:31.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.209+0000 7f6a5f3dc740 10 client.4791 fetch_fsmap finished waiting for FSMap version 11 2024-09-12T02:23:31.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.209+0000 7f6a5f3dc740 10 client.4791 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T02:23:31.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.209+0000 7f6a5f3dc740 20 client.4791 populate_metadata read hostname 'smithi060' 2024-09-12T02:23:31.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.209+0000 7f6a5f3dc740 1 --2- 172.21.15.60:0/2383982460 >> [v2:172.21.15.105:6832/248466084,v1:172.21.15.105:6834/248466084] conn(0x564487e76f30 0x564487e77310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:31.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.209+0000 7f6a5f3dc740 4 client.4791 mds_command: new command op to 4278 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:23:31.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.209+0000 7f6a5f3dc740 1 -- 172.21.15.60:0/2383982460 --> [v2:172.21.15.105:6832/248466084,v1:172.21.15.105:6834/248466084] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564487d9ac50 con 0x564487e76f30 2024-09-12T02:23:31.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.209+0000 7f6a5a3e3640 1 --2- 172.21.15.60:0/2383982460 >> [v2:172.21.15.105:6832/248466084,v1:172.21.15.105:6834/248466084] conn(0x564487e76f30 0x564487e77310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:31.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.209+0000 7f6a357fa640 10 client.4791 ms_handle_connect on v2:172.21.15.105:6832/248466084 2024-09-12T02:23:31.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.209+0000 7f6a5a3e3640 1 --2- 172.21.15.60:0/2383982460 >> [v2:172.21.15.105:6832/248466084,v1:172.21.15.105:6834/248466084] conn(0x564487e76f30 0x564487e77310 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=616d94b13cc53a58 server_cookie=5a01a8b95dd3150b in_seq=0 out_seq=0 2024-09-12T02:23:31.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.210+0000 7f6a357fa640 1 -- 172.21.15.60:0/2383982460 <== mds.0 v2:172.21.15.105:6832/248466084 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564487d9ac50 con 0x564487e76f30 2024-09-12T02:23:31.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.210+0000 7f6a357fa640 10 client.4791 handle_command_reply: tid=0 2024-09-12T02:23:31.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.210+0000 7f6a5f3dc740 1 client.4791 shutdown 2024-09-12T02:23:31.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.210+0000 7f6a5f3dc740 1 -- 172.21.15.60:0/2383982460 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564487e66a60 msgr2=0x564487e7a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:31.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.210+0000 7f6a5f3dc740 1 --2- 172.21.15.60:0/2383982460 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564487e66a60 0x564487e7a190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6a44061ab0 tx=0x7f6a440595f0 comp rx=0 tx=0).stop 2024-09-12T02:23:31.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.210+0000 7f6a5f3dc740 1 -- 172.21.15.60:0/2383982460 shutdown_connections 2024-09-12T02:23:31.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.210+0000 7f6a5f3dc740 1 --2- 172.21.15.60:0/2383982460 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x564487e68520 0x564487e7a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:31.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.210+0000 7f6a5f3dc740 1 --2- 172.21.15.60:0/2383982460 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564487e66a60 0x564487e7a190 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:31.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.210+0000 7f6a5f3dc740 1 --2- 172.21.15.60:0/2383982460 >> [v2:172.21.15.105:6832/248466084,v1:172.21.15.105:6834/248466084] conn(0x564487e76f30 0x564487e77310 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:31.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.210+0000 7f6a5f3dc740 1 --2- 172.21.15.60:0/2383982460 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564487e65720 0x564487e67fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:31.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.210+0000 7f6a5f3dc740 1 -- 172.21.15.60:0/2383982460 >> 172.21.15.60:0/2383982460 conn(0x564487e2c080 msgr2=0x564487e6a100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:31.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.210+0000 7f6a357fa640 0 client.4791 ms_handle_reset on v2:172.21.15.105:6832/248466084 2024-09-12T02:23:31.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.211+0000 7f6a5f3dc740 1 -- 172.21.15.60:0/2383982460 shutdown_connections 2024-09-12T02:23:31.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.211+0000 7f6a5f3dc740 1 -- 172.21.15.60:0/2383982460 wait complete. 2024-09-12T02:23:31.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.211+0000 7f6a5f3dc740 20 client.4791 trim_cache size 0 max 16384 2024-09-12T02:23:31.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.229+0000 7f6a5f3dc740 1 Processor -- start 2024-09-12T02:23:31.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.229+0000 7f6a5f3dc740 1 -- start start 2024-09-12T02:23:31.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.229+0000 7f6a5f3dc740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x564487e65720 0x564487e6a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:31.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.229+0000 7f6a5f3dc740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564487e66a60 0x564487e499b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:31.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.229+0000 7f6a5f3dc740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564487e68520 0x564487e8a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:31.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.229+0000 7f6a5f3dc740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6a541fba10 con 0x564487e66a60 2024-09-12T02:23:31.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.229+0000 7f6a5f3dc740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5414e370 con 0x564487e68520 2024-09-12T02:23:31.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.229+0000 7f6a5f3dc740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6a541f9ad0 con 0x564487e65720 2024-09-12T02:23:31.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.229+0000 7f6a59be2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564487e66a60 0x564487e499b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:31.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.229+0000 7f6a59be2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564487e66a60 0x564487e499b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50224/0 (socket says 172.21.15.60:50224) 2024-09-12T02:23:31.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.229+0000 7f6a59be2640 1 -- 172.21.15.60:0/514439783 learned_addr learned my addr 172.21.15.60:0/514439783 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:31.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.230+0000 7f6a59be2640 1 -- 172.21.15.60:0/514439783 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x564487e65720 msgr2=0x564487e6a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:31.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.230+0000 7f6a59be2640 1 --2- 172.21.15.60:0/514439783 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x564487e65720 0x564487e6a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:31.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.230+0000 7f6a59be2640 1 -- 172.21.15.60:0/514439783 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564487e68520 msgr2=0x564487e8a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:31.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.230+0000 7f6a59be2640 1 --2- 172.21.15.60:0/514439783 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564487e68520 0x564487e8a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:31.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.230+0000 7f6a59be2640 1 -- 172.21.15.60:0/514439783 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564487e76c20 con 0x564487e66a60 2024-09-12T02:23:31.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.230+0000 7f6a59be2640 1 --2- 172.21.15.60:0/514439783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564487e66a60 0x564487e499b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6a44055910 tx=0x7f6a44020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc9d739d97b11aee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:31.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.230+0000 7f6a377fe640 1 -- 172.21.15.60:0/514439783 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a44071040 con 0x564487e66a60 2024-09-12T02:23:31.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.230+0000 7f6a377fe640 1 -- 172.21.15.60:0/514439783 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a440711e0 con 0x564487e66a60 2024-09-12T02:23:31.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.230+0000 7f6a377fe640 1 -- 172.21.15.60:0/514439783 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a44055b20 con 0x564487e66a60 2024-09-12T02:23:31.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.230+0000 7f6a5f3dc740 1 -- 172.21.15.60:0/514439783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564487e66a60 msgr2=0x564487e499b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:31.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.230+0000 7f6a5f3dc740 1 --2- 172.21.15.60:0/514439783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564487e66a60 0x564487e499b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6a44055910 tx=0x7f6a44020000 comp rx=0 tx=0).stop 2024-09-12T02:23:31.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.230+0000 7f6a5f3dc740 1 -- 172.21.15.60:0/514439783 shutdown_connections 2024-09-12T02:23:31.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.230+0000 7f6a5f3dc740 1 --2- 172.21.15.60:0/514439783 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564487e68520 0x564487e8a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:31.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.230+0000 7f6a5f3dc740 1 --2- 172.21.15.60:0/514439783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564487e66a60 0x564487e499b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:31.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.230+0000 7f6a5f3dc740 1 --2- 172.21.15.60:0/514439783 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x564487e65720 0x564487e6a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:31.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.230+0000 7f6a5f3dc740 1 -- 172.21.15.60:0/514439783 >> 172.21.15.60:0/514439783 conn(0x564487e2c080 msgr2=0x564487e63780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:31.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.230+0000 7f6a5f3dc740 1 -- 172.21.15.60:0/514439783 shutdown_connections 2024-09-12T02:23:31.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.231+0000 7f6a5f3dc740 1 -- 172.21.15.60:0/514439783 wait complete. 2024-09-12T02:23:31.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.231+0000 7f6a5f3dc740 1 -- start start 2024-09-12T02:23:31.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.231+0000 7f6a5f3dc740 1 Processor -- start 2024-09-12T02:23:31.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.232+0000 7f6a5f3dc740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x564487e65720 0x564487e49d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:31.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.232+0000 7f6a5f3dc740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564487e66a60 0x564487e46cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:31.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.232+0000 7f6a5f3dc740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564487e68520 0x564487e48800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:31.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.232+0000 7f6a5f3dc740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x564487e68b30 con 0x564487e66a60 2024-09-12T02:23:31.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.232+0000 7f6a5f3dc740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x564487e69dc0 con 0x564487e68520 2024-09-12T02:23:31.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.232+0000 7f6a5f3dc740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x564487e76a00 con 0x564487e65720 2024-09-12T02:23:31.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.232+0000 7f6a5f3dc740 10 client.0 _ll_register_callbacks cb 0x7f6a4400beb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:23:31.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.232+0000 7f6a59be2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564487e66a60 0x564487e46cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:31.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.232+0000 7f6a59be2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564487e66a60 0x564487e46cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50226/0 (socket says 172.21.15.60:50226) 2024-09-12T02:23:31.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.232+0000 7f6a59be2640 1 -- 172.21.15.60:0/3162056580 learned_addr learned my addr 172.21.15.60:0/3162056580 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:31.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.232+0000 7f6a5abe4640 1 --2- 172.21.15.60:0/3162056580 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564487e68520 0x564487e48800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:31.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.232+0000 7f6a5a3e3640 1 --2- 172.21.15.60:0/3162056580 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x564487e65720 0x564487e49d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:31.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.232+0000 7f6a59be2640 1 -- 172.21.15.60:0/3162056580 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x564487e65720 msgr2=0x564487e49d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:31.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.232+0000 7f6a59be2640 1 --2- 172.21.15.60:0/3162056580 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x564487e65720 0x564487e49d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:31.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.232+0000 7f6a59be2640 1 -- 172.21.15.60:0/3162056580 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564487e68520 msgr2=0x564487e48800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:31.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.232+0000 7f6a59be2640 1 --2- 172.21.15.60:0/3162056580 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564487e68520 0x564487e48800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:31.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.232+0000 7f6a59be2640 1 -- 172.21.15.60:0/3162056580 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564487e42cd0 con 0x564487e66a60 2024-09-12T02:23:31.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.233+0000 7f6a59be2640 1 --2- 172.21.15.60:0/3162056580 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564487e66a60 0x564487e46cb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6a44059160 tx=0x7f6a44020070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fea08b28c1a20c2c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:31.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.233+0000 7f6a357fa640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T02:23:31.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.233+0000 7f6a357fa640 1 -- 172.21.15.60:0/3162056580 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a44071040 con 0x564487e66a60 2024-09-12T02:23:31.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.233+0000 7f6a357fa640 1 -- 172.21.15.60:0/3162056580 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f6a44058900 con 0x564487e66a60 2024-09-12T02:23:31.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.233+0000 7f6a5f3dc740 1 -- 172.21.15.60:0/3162056580 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a440711e0 con 0x564487e66a60 2024-09-12T02:23:31.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.233+0000 7f6a357fa640 1 -- 172.21.15.60:0/3162056580 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=11) ==== 24+0+0 (secure 0 0 0) 0x7f6a44058e10 con 0x564487e66a60 2024-09-12T02:23:31.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.233+0000 7f6a5f3dc740 10 client.4797 fetch_fsmap learned FSMap version 11 2024-09-12T02:23:31.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.233+0000 7f6a5f3dc740 1 -- 172.21.15.60:0/3162056580 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=11,monmap=2+}) -- 0x564487e42cd0 con 0x564487e66a60 2024-09-12T02:23:31.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.233+0000 7f6a357fa640 1 -- 172.21.15.60:0/3162056580 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a440711e0 con 0x564487e66a60 2024-09-12T02:23:31.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.233+0000 7f6a357fa640 1 -- 172.21.15.60:0/3162056580 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 11) ==== 4136+0+0 (secure 0 0 0) 0x7f6a44055200 con 0x564487e66a60 2024-09-12T02:23:31.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.233+0000 7f6a5f3dc740 10 client.4797 fetch_fsmap finished waiting for FSMap version 11 2024-09-12T02:23:31.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.233+0000 7f6a5f3dc740 10 client.4797 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T02:23:31.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.233+0000 7f6a5f3dc740 20 client.4797 populate_metadata read hostname 'smithi060' 2024-09-12T02:23:31.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.233+0000 7f6a5f3dc740 1 --2- 172.21.15.60:0/3162056580 >> [v2:172.21.15.105:6832/248466084,v1:172.21.15.105:6834/248466084] conn(0x564487ee2a70 0x564487ee2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:31.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.233+0000 7f6a5f3dc740 4 client.4797 mds_command: new command op to 4278 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:23:31.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.233+0000 7f6a5f3dc740 1 -- 172.21.15.60:0/3162056580 --> [v2:172.21.15.105:6832/248466084,v1:172.21.15.105:6834/248466084] -- command(tid 0: {"prefix": "status"}) -- 0x564487e280c0 con 0x564487ee2a70 2024-09-12T02:23:31.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.233+0000 7f6a5a3e3640 1 --2- 172.21.15.60:0/3162056580 >> [v2:172.21.15.105:6832/248466084,v1:172.21.15.105:6834/248466084] conn(0x564487ee2a70 0x564487ee2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:31.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.234+0000 7f6a357fa640 10 client.4797 ms_handle_connect on v2:172.21.15.105:6832/248466084 2024-09-12T02:23:31.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.234+0000 7f6a5a3e3640 1 --2- 172.21.15.60:0/3162056580 >> [v2:172.21.15.105:6832/248466084,v1:172.21.15.105:6834/248466084] conn(0x564487ee2a70 0x564487ee2e50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1c7376634f2ef36 server_cookie=dad0e75fa6cc72b1 in_seq=0 out_seq=0 2024-09-12T02:23:31.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.234+0000 7f6a5a3e3640 1 -- 172.21.15.60:0/3162056580 >> [v2:172.21.15.105:6832/248466084,v1:172.21.15.105:6834/248466084] conn(0x564487ee2a70 msgr2=0x564487ee2e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 18 2024-09-12T02:23:31.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.234+0000 7f6a5a3e3640 1 -- 172.21.15.60:0/3162056580 >> [v2:172.21.15.105:6832/248466084,v1:172.21.15.105:6834/248466084] conn(0x564487ee2a70 msgr2=0x564487ee2e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:23:31.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.234+0000 7f6a5a3e3640 1 --2- 172.21.15.60:0/3162056580 >> [v2:172.21.15.105:6832/248466084,v1:172.21.15.105:6834/248466084] conn(0x564487ee2a70 0x564487ee2e50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:23:31.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.234+0000 7f6a5a3e3640 1 --2- 172.21.15.60:0/3162056580 >> [v2:172.21.15.105:6832/248466084,v1:172.21.15.105:6834/248466084] conn(0x564487ee2a70 0x564487ee2e50 unknown :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-09-12T02:23:31.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.234+0000 7f6a5a3e3640 1 --2- 172.21.15.60:0/3162056580 >> [v2:172.21.15.105:6832/248466084,v1:172.21.15.105:6834/248466084] conn(0x564487ee2a70 0x564487ee2e50 unknown :-1 s=BANNER_CONNECTING pgs=14 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:31.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.234+0000 7f6a5a3e3640 1 --2- 172.21.15.60:0/3162056580 >> [v2:172.21.15.105:6832/248466084,v1:172.21.15.105:6834/248466084] conn(0x564487ee2a70 0x564487ee2e50 crc :-1 s=READY pgs=14 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1c7376634f2ef36 server_cookie=dad0e75fa6cc72b1 in_seq=0 out_seq=1 2024-09-12T02:23:31.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.234+0000 7f6a357fa640 10 client.4797 ms_handle_connect on v2:172.21.15.105:6832/248466084 2024-09-12T02:23:31.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.234+0000 7f6a357fa640 1 -- 172.21.15.60:0/3162056580 <== mds.0 v2:172.21.15.105:6832/248466084 1 ==== command_reply(tid 0: 0 ) ==== 8+0+320 (crc 0 0 0) 0x564487e280c0 con 0x564487ee2a70 2024-09-12T02:23:31.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.234+0000 7f6a357fa640 10 client.4797 handle_command_reply: tid=0 2024-09-12T02:23:31.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.234+0000 7f6a5f3dc740 1 client.4797 shutdown 2024-09-12T02:23:31.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.235+0000 7f6a5f3dc740 1 -- 172.21.15.60:0/3162056580 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564487e66a60 msgr2=0x564487e46cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:31.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.235+0000 7f6a5f3dc740 1 --2- 172.21.15.60:0/3162056580 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564487e66a60 0x564487e46cb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6a44059160 tx=0x7f6a44020070 comp rx=0 tx=0).stop 2024-09-12T02:23:31.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.235+0000 7f6a5f3dc740 1 -- 172.21.15.60:0/3162056580 shutdown_connections 2024-09-12T02:23:31.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.235+0000 7f6a5f3dc740 1 --2- 172.21.15.60:0/3162056580 >> [v2:172.21.15.105:6832/248466084,v1:172.21.15.105:6834/248466084] conn(0x564487ee2a70 0x564487ee2e50 crc :-1 s=READY pgs=14 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:31.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.235+0000 7f6a5f3dc740 1 --2- 172.21.15.60:0/3162056580 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564487e68520 0x564487e48800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:31.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.235+0000 7f6a5f3dc740 1 --2- 172.21.15.60:0/3162056580 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564487e66a60 0x564487e46cb0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:31.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.235+0000 7f6a5f3dc740 1 --2- 172.21.15.60:0/3162056580 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x564487e65720 0x564487e49d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:31.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.235+0000 7f6a357fa640 0 client.4797 ms_handle_reset on v2:172.21.15.105:6832/248466084 2024-09-12T02:23:31.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.235+0000 7f6a5f3dc740 1 -- 172.21.15.60:0/3162056580 >> 172.21.15.60:0/3162056580 conn(0x564487e2c080 msgr2=0x564487e63780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:31.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.235+0000 7f6a5f3dc740 1 -- 172.21.15.60:0/3162056580 shutdown_connections 2024-09-12T02:23:31.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.235+0000 7f6a5f3dc740 1 -- 172.21.15.60:0/3162056580 wait complete. 2024-09-12T02:23:31.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.235+0000 7f6a5f3dc740 20 client.4797 trim_cache size 0 max 16384 2024-09-12T02:23:31.242 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:23:31.242 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:23:31.242 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 0, 2024-09-12T02:23:31.242 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4278, 2024-09-12T02:23:31.242 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2024-09-12T02:23:31.242 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2024-09-12T02:23:31.242 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "b", 2024-09-12T02:23:31.242 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 14.398707671, 2024-09-12T02:23:31.242 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 11, 2024-09-12T02:23:31.242 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 26, 2024-09-12T02:23:31.242 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 26, 2024-09-12T02:23:31.243 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 32.624382818999997 2024-09-12T02:23:31.243 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:23:31.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.235+0000 7f6a5c647640 1 -- 172.21.15.60:0/67256449 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f6a3806be30 msgr2=0x7f6a3806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:31.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.235+0000 7f6a5c647640 1 --2- 172.21.15.60:0/67256449 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f6a3806be30 0x7f6a3806e2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6a50034000 tx=0x7f6a5002e000 comp rx=0 tx=0).stop 2024-09-12T02:23:31.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.235+0000 7f6a5c647640 1 -- 172.21.15.60:0/67256449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a54153de0 msgr2=0x7f6a541eca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:31.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.235+0000 7f6a5c647640 1 --2- 172.21.15.60:0/67256449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a54153de0 0x7f6a541eca50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6a4400d800 tx=0x7f6a4400dcc0 comp rx=0 tx=0).stop 2024-09-12T02:23:31.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.235+0000 7f6a5c647640 1 -- 172.21.15.60:0/67256449 shutdown_connections 2024-09-12T02:23:31.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.235+0000 7f6a5c647640 1 --2- 172.21.15.60:0/67256449 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f6a3806be30 0x7f6a3806e2f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:31.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.235+0000 7f6a5c647640 1 --2- 172.21.15.60:0/67256449 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a541598c0 0x7f6a540afbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:31.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.235+0000 7f6a5c647640 1 --2- 172.21.15.60:0/67256449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a54153de0 0x7f6a541eca50 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:31.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.235+0000 7f6a5c647640 1 --2- 172.21.15.60:0/67256449 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a5406bbe0 0x7f6a541effe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:31.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.235+0000 7f6a5c647640 1 -- 172.21.15.60:0/67256449 >> 172.21.15.60:0/67256449 conn(0x7f6a540c8800 msgr2=0x7f6a540ac810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:31.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.235+0000 7f6a5c647640 1 -- 172.21.15.60:0/67256449 shutdown_connections 2024-09-12T02:23:31.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.235+0000 7f6a5c647640 1 -- 172.21.15.60:0/67256449 wait complete. 2024-09-12T02:23:31.247 INFO:teuthology.run_tasks:Running task sequential... 2024-09-12T02:23:31.258 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-12T02:23:31.258 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-12T02:23:31.258 INFO:teuthology.task.print:Enabling mgr modules 2024-09-12T02:23:31.258 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-12T02:23:31.316 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-12T02:23:31.316 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-09-12T02:23:31.317 INFO:tasks.ceph_fuse:client.0 config is {'cephfs_name': 'a'} 2024-09-12T02:23:31.317 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T02:23:31.317 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:23:31.317 INFO:tasks.ceph_fuse:client.1 config is {'cephfs_name': 'b'} 2024-09-12T02:23:31.317 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T02:23:31.317 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-12T02:23:31.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:23:31.317 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2024-09-12T02:23:31.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:23:31.334 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link delete ceph-brx 2024-09-12T02:23:31.402 INFO:teuthology.orchestra.run.smithi060.stderr:Cannot find device "ceph-brx" 2024-09-12T02:23:31.403 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:23:31.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:23:31.404 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2024-09-12T02:23:31.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:23:31.424 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link delete ceph-brx 2024-09-12T02:23:31.496 INFO:teuthology.orchestra.run.smithi105.stderr:Cannot find device "ceph-brx" 2024-09-12T02:23:31.497 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:23:31.498 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-12T02:23:31.498 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-12T02:23:31.498 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:23:31.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.600+0000 7f4fdc665640 1 Processor -- start 2024-09-12T02:23:31.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.601+0000 7f4fdc665640 1 -- start start 2024-09-12T02:23:31.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.602+0000 7f4fdc665640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4fd4153be0 0x7f4fd40c3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:31.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.602+0000 7f4fdc665640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4fd40c8180 0x7f4fd4160bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:31.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.602+0000 7f4fdc665640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fd4153fc0 con 0x7f4fd40ac720 2024-09-12T02:23:31.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.602+0000 7f4fdc665640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f4fd4156db0 con 0x7f4fd4153be0 2024-09-12T02:23:31.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.602+0000 7f4fdc665640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4fd40a8030 con 0x7f4fd40c8180 2024-09-12T02:23:31.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.602+0000 7f4fd9c00640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f4fd40ac720 0x7f4fd40c7a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:35358/0 (socket says 172.21.15.60:35358) 2024-09-12T02:23:31.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.602+0000 7f4fd9c00640 1 -- 172.21.15.60:0/3912824092 learned_addr learned my addr 172.21.15.60:0/3912824092 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:31.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.602+0000 7f4fdac02640 1 --2- 172.21.15.60:0/3912824092 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4fd40c8180 0x7f4fd4160bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:31.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.602+0000 7f4fda401640 1 --2- 172.21.15.60:0/3912824092 >> v2:172.21.15.105:3300/0 conn(0x7f4fd4153be0 0x7f4fd40c3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:31.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.602+0000 7f4fd93ff640 1 -- 172.21.15.60:0/3912824092 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3484927064 0 0) 0x7f4fc4001110 con 0x7f4fd40ac720 2024-09-12T02:23:31.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.602+0000 7f4fd93ff640 1 -- 172.21.15.60:0/3912824092 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fc0003520 con 0x7f4fd40ac720 2024-09-12T02:23:31.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.602+0000 7f4fd93ff640 1 -- 172.21.15.60:0/3912824092 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1671973312 0 0) 0x7f4fc0003520 con 0x7f4fd40ac720 2024-09-12T02:23:31.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.602+0000 7f4fd93ff640 1 -- 172.21.15.60:0/3912824092 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4fd40c8180 msgr2=0x7f4fd4160bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:31.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.602+0000 7f4fd93ff640 1 --2- 172.21.15.60:0/3912824092 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4fd40c8180 0x7f4fd4160bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:31.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.602+0000 7f4fd93ff640 1 -- 172.21.15.60:0/3912824092 >> v2:172.21.15.105:3300/0 conn(0x7f4fd4153be0 msgr2=0x7f4fd40c3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:31.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.602+0000 7f4fd93ff640 1 --2- 172.21.15.60:0/3912824092 >> v2:172.21.15.105:3300/0 conn(0x7f4fd4153be0 0x7f4fd40c3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:31.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.602+0000 7f4fd93ff640 1 -- 172.21.15.60:0/3912824092 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fd40c86d0 con 0x7f4fd40ac720 2024-09-12T02:23:31.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.602+0000 7f4fd93ff640 1 -- 172.21.15.60:0/3912824092 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7f4fc4001840 con 0x7f4fd40ac720 2024-09-12T02:23:31.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.602+0000 7f4fda401640 1 --2- 172.21.15.60:0/3912824092 >> v2:172.21.15.105:3300/0 conn(0x7f4fd4153be0 0x7f4fd40c3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:23:31.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.602+0000 7f4fd93ff640 1 -- 172.21.15.60:0/3912824092 >> v1:172.21.15.60:6789/0 conn(0x7f4fd40ac720 legacy=0x7f4fd40c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:31.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.602+0000 7f4fd93ff640 1 --2- 172.21.15.60:0/3912824092 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4fd40c8180 0x7f4fc00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:31.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.603+0000 7f4fd93ff640 1 --2- 172.21.15.60:0/3912824092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fc0003f30 0x7f4fc0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:31.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.603+0000 7f4fd93ff640 1 --2- 172.21.15.60:0/3912824092 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fc0004d40 0x7f4fc00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:31.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.603+0000 7f4fd93ff640 1 -- 172.21.15.60:0/3912824092 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd4156db0 con 0x7f4fc0004d40 2024-09-12T02:23:31.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.603+0000 7f4fd93ff640 1 -- 172.21.15.60:0/3912824092 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd40a8030 con 0x7f4fc0003f30 2024-09-12T02:23:31.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.603+0000 7f4fd93ff640 1 -- 172.21.15.60:0/3912824092 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4fc000baa0 con 0x7f4fd40c8180 2024-09-12T02:23:31.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.603+0000 7f4fdac02640 1 --2- 172.21.15.60:0/3912824092 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fc0004d40 0x7f4fc00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:31.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.603+0000 7f4fda401640 1 --2- 172.21.15.60:0/3912824092 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4fd40c8180 0x7f4fc00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:31.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.603+0000 7f4fd9c00640 1 --2- 172.21.15.60:0/3912824092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fc0003f30 0x7f4fc0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:31.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.603+0000 7f4fdac02640 1 -- 172.21.15.60:0/3912824092 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4fd40c8180 msgr2=0x7f4fc00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:31.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.603+0000 7f4fdac02640 1 --2- 172.21.15.60:0/3912824092 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4fd40c8180 0x7f4fc00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:31.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.603+0000 7f4fdac02640 1 -- 172.21.15.60:0/3912824092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fc0003f30 msgr2=0x7f4fc0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:31.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.603+0000 7f4fdac02640 1 --2- 172.21.15.60:0/3912824092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fc0003f30 0x7f4fc0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:31.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.603+0000 7f4fdac02640 1 -- 172.21.15.60:0/3912824092 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc0003520 con 0x7f4fc0004d40 2024-09-12T02:23:31.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.604+0000 7f4fdac02640 1 --2- 172.21.15.60:0/3912824092 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fc0004d40 0x7f4fc00051c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc009aa0 tx=0x7f4fc0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc5a7632fca5b642 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:31.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.604+0000 7f4fd93ff640 1 -- 172.21.15.60:0/3912824092 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc036070 con 0x7f4fc0004d40 2024-09-12T02:23:31.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.604+0000 7f4fd93ff640 1 -- 172.21.15.60:0/3912824092 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fcc031400 con 0x7f4fc0004d40 2024-09-12T02:23:31.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.604+0000 7f4fd93ff640 1 -- 172.21.15.60:0/3912824092 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc009670 con 0x7f4fc0004d40 2024-09-12T02:23:31.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.604+0000 7f4fdc665640 1 -- 172.21.15.60:0/3912824092 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fc0004d40 msgr2=0x7f4fc00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:31.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.604+0000 7f4fdc665640 1 --2- 172.21.15.60:0/3912824092 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fc0004d40 0x7f4fc00051c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc009aa0 tx=0x7f4fc0005830 comp rx=0 tx=0).stop 2024-09-12T02:23:31.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.604+0000 7f4fdac02640 1 -- 172.21.15.60:0/3912824092 reap_dead start 2024-09-12T02:23:31.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.605+0000 7f4fdc665640 1 -- 172.21.15.60:0/3912824092 shutdown_connections 2024-09-12T02:23:31.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.605+0000 7f4fdc665640 1 -- 172.21.15.60:0/3912824092 >> 172.21.15.60:0/3912824092 conn(0x7f4fd40c5660 msgr2=0x7f4fd40c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:31.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.605+0000 7f4fdc665640 1 -- 172.21.15.60:0/3912824092 shutdown_connections 2024-09-12T02:23:31.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.605+0000 7f4fdc665640 1 -- 172.21.15.60:0/3912824092 wait complete. 2024-09-12T02:23:31.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.606+0000 7f4fdc665640 1 Processor -- start 2024-09-12T02:23:31.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.606+0000 7f4fdc665640 1 -- start start 2024-09-12T02:23:31.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.606+0000 7f4fdc665640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fc0004d40 0x7f4fd41e00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:31.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.607+0000 7f4fdc665640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4fd414d740 0x7f4fd414e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:31.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.607+0000 7f4fdc665640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd41e0910 0x7f4fd41e0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:31.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.607+0000 7f4fdc665640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd40ac370 con 0x7f4fd41e0910 2024-09-12T02:23:31.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.607+0000 7f4fdc665640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd40a83e0 con 0x7f4fc0004d40 2024-09-12T02:23:31.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.607+0000 7f4fdc665640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4fd40ac4f0 con 0x7f4fd414d740 2024-09-12T02:23:31.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.607+0000 7f4fdac02640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd41e0910 0x7f4fd41e0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:31.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.607+0000 7f4fdac02640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd41e0910 0x7f4fd41e0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50234/0 (socket says 172.21.15.60:50234) 2024-09-12T02:23:31.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.607+0000 7f4fdac02640 1 -- 172.21.15.60:0/3614871588 learned_addr learned my addr 172.21.15.60:0/3614871588 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:31.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.607+0000 7f4fda401640 1 --2- 172.21.15.60:0/3614871588 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fc0004d40 0x7f4fd41e00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:31.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.607+0000 7f4fd9c00640 1 --2- 172.21.15.60:0/3614871588 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4fd414d740 0x7f4fd414e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:31.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.607+0000 7f4fdac02640 1 -- 172.21.15.60:0/3614871588 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4fd414d740 msgr2=0x7f4fd414e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:31.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.607+0000 7f4fdac02640 1 --2- 172.21.15.60:0/3614871588 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4fd414d740 0x7f4fd414e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:31.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.607+0000 7f4fdac02640 1 -- 172.21.15.60:0/3614871588 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fc0004d40 msgr2=0x7f4fd41e00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:31.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.607+0000 7f4fdac02640 1 --2- 172.21.15.60:0/3614871588 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fc0004d40 0x7f4fd41e00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:31.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.607+0000 7f4fdac02640 1 -- 172.21.15.60:0/3614871588 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fd4073230 con 0x7f4fd41e0910 2024-09-12T02:23:31.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.607+0000 7f4fd9c00640 1 --2- 172.21.15.60:0/3614871588 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4fd414d740 0x7f4fd414e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:23:31.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.607+0000 7f4fdac02640 1 --2- 172.21.15.60:0/3614871588 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd41e0910 0x7f4fd41e0d90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc009bc0 tx=0x7f4fcc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:31.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.607+0000 7f4fcaffd640 1 -- 172.21.15.60:0/3614871588 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc036040 con 0x7f4fd41e0910 2024-09-12T02:23:31.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.607+0000 7f4fcaffd640 1 -- 172.21.15.60:0/3614871588 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fcc00f000 con 0x7f4fd41e0910 2024-09-12T02:23:31.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.607+0000 7f4fcaffd640 1 -- 172.21.15.60:0/3614871588 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc009670 con 0x7f4fd41e0910 2024-09-12T02:23:31.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.607+0000 7f4fdc665640 1 -- 172.21.15.60:0/3614871588 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fd4073510 con 0x7f4fd41e0910 2024-09-12T02:23:31.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.607+0000 7f4fdc665640 1 -- 172.21.15.60:0/3614871588 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fd41df8b0 con 0x7f4fd41e0910 2024-09-12T02:23:31.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.608+0000 7f4fdc665640 1 -- 172.21.15.60:0/3614871588 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fd40c63f0 con 0x7f4fd41e0910 2024-09-12T02:23:31.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.609+0000 7f4fcaffd640 1 -- 172.21.15.60:0/3614871588 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4fcc045020 con 0x7f4fd41e0910 2024-09-12T02:23:31.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.609+0000 7f4fcaffd640 1 --2- 172.21.15.60:0/3614871588 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4fb806be60 0x7f4fb806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:31.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.609+0000 7f4fcaffd640 1 -- 172.21.15.60:0/3614871588 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f4fcc0ab1d0 con 0x7f4fd41e0910 2024-09-12T02:23:31.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.609+0000 7f4fda401640 1 --2- 172.21.15.60:0/3614871588 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4fb806be60 0x7f4fb806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:31.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.610+0000 7f4fda401640 1 --2- 172.21.15.60:0/3614871588 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4fb806be60 0x7f4fb806e320 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0009fd0 tx=0x7f4fd000b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:31.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.614+0000 7f4fcaffd640 1 -- 172.21.15.60:0/3614871588 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4fcc079350 con 0x7f4fd41e0910 2024-09-12T02:23:31.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.824+0000 7f4fdc665640 1 -- 172.21.15.60:0/3614871588 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f4fd40aa6f0 con 0x7f4fd41e0910 2024-09-12T02:23:31.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.825+0000 7f4fcaffd640 1 -- 172.21.15.60:0/3614871588 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v11) ==== 53+0+116 (secure 0 0 0) 0x7f4fcc07d650 con 0x7f4fd41e0910 2024-09-12T02:23:31.825 INFO:teuthology.orchestra.run.smithi060.stdout:name: a, metadata pool: a_metadata, data pools: [a_data ] 2024-09-12T02:23:31.825 INFO:teuthology.orchestra.run.smithi060.stdout:name: b, metadata pool: b_metadata, data pools: [b_data ] 2024-09-12T02:23:31.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.826+0000 7f4fdc665640 1 -- 172.21.15.60:0/3614871588 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4fb806be60 msgr2=0x7f4fb806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:31.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.826+0000 7f4fdc665640 1 --2- 172.21.15.60:0/3614871588 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4fb806be60 0x7f4fb806e320 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0009fd0 tx=0x7f4fd000b040 comp rx=0 tx=0).stop 2024-09-12T02:23:31.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.827+0000 7f4fdc665640 1 -- 172.21.15.60:0/3614871588 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd41e0910 msgr2=0x7f4fd41e0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:31.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.827+0000 7f4fdc665640 1 --2- 172.21.15.60:0/3614871588 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd41e0910 0x7f4fd41e0d90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc009bc0 tx=0x7f4fcc004730 comp rx=0 tx=0).stop 2024-09-12T02:23:31.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.827+0000 7f4fdc665640 1 -- 172.21.15.60:0/3614871588 shutdown_connections 2024-09-12T02:23:31.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.827+0000 7f4fdc665640 1 --2- 172.21.15.60:0/3614871588 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4fb806be60 0x7f4fb806e320 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:31.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.827+0000 7f4fdc665640 1 --2- 172.21.15.60:0/3614871588 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd41e0910 0x7f4fd41e0d90 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:31.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.827+0000 7f4fdc665640 1 --2- 172.21.15.60:0/3614871588 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4fd414d740 0x7f4fd414e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:31.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.827+0000 7f4fdc665640 1 --2- 172.21.15.60:0/3614871588 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fc0004d40 0x7f4fd41e00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:31.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.827+0000 7f4fdc665640 1 -- 172.21.15.60:0/3614871588 >> 172.21.15.60:0/3614871588 conn(0x7f4fd40c5660 msgr2=0x7f4fd41547f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:31.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.827+0000 7f4fdc665640 1 -- 172.21.15.60:0/3614871588 shutdown_connections 2024-09-12T02:23:31.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31.827+0000 7f4fdc665640 1 -- 172.21.15.60:0/3614871588 wait complete. 2024-09-12T02:23:31.838 INFO:tasks.cephfs.mount:Mounting Ceph FS a; just confirmed its presence on cluster 2024-09-12T02:23:31.839 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:23:31.839 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi060.front.sepia.ceph.com 2024-09-12T02:23:31.839 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T02:23:31.839 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:23:31.839 INFO:tasks.cephfs.mount:self.cephfs_name = a 2024-09-12T02:23:31.839 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T02:23:31.839 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:23:31.839 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:23:31.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:23:31.839 DEBUG:teuthology.orchestra.run.smithi060:> ip addr 2024-09-12T02:23:31.855 INFO:teuthology.orchestra.run.smithi060.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:23:31.855 INFO:teuthology.orchestra.run.smithi060.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:23:31.855 INFO:teuthology.orchestra.run.smithi060.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:23:31.855 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:23:31.855 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 ::1/128 scope host 2024-09-12T02:23:31.855 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:23:31.856 INFO:teuthology.orchestra.run.smithi060.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:23:31.856 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cc brd ff:ff:ff:ff:ff:ff 2024-09-12T02:23:31.856 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f0 2024-09-12T02:23:31.856 INFO:teuthology.orchestra.run.smithi060.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:23:31.856 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cd brd ff:ff:ff:ff:ff:ff 2024-09-12T02:23:31.856 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f1 2024-09-12T02:23:31.856 INFO:teuthology.orchestra.run.smithi060.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:23:31.856 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:60 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:23:31.856 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f0 2024-09-12T02:23:31.856 INFO:teuthology.orchestra.run.smithi060.stdout: inet 172.21.15.60/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T02:23:31.856 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft 42707sec preferred_lft 42707sec 2024-09-12T02:23:31.856 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::ec4:7aff:febd:1560/64 scope link 2024-09-12T02:23:31.857 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:23:31.857 INFO:teuthology.orchestra.run.smithi060.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:23:31.857 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:61 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:23:31.857 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f1 2024-09-12T02:23:31.860 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T02:23:31.860 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:23:31.861 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2024-09-12T02:23:31.861 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link add name ceph-brx type bridge 2024-09-12T02:23:31.861 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip addr flush dev ceph-brx 2024-09-12T02:23:31.861 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set ceph-brx up 2024-09-12T02:23:31.861 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T02:23:31.861 DEBUG:teuthology.orchestra.run.smithi060:> ') 2024-09-12T02:23:31.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:23:32.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:23:32.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:23:32.063 DEBUG:teuthology.orchestra.run.smithi060:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:23:32.089 INFO:teuthology.orchestra.run.smithi060.stdout:1 2024-09-12T02:23:32.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:23:32.091 DEBUG:teuthology.orchestra.run.smithi060:> route 2024-09-12T02:23:32.162 INFO:teuthology.orchestra.run.smithi060.stdout:Kernel IP routing table 2024-09-12T02:23:32.163 INFO:teuthology.orchestra.run.smithi060.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:23:32.163 INFO:teuthology.orchestra.run.smithi060.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T02:23:32.163 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T02:23:32.163 INFO:teuthology.orchestra.run.smithi060.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:23:32.163 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:23:32.164 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2024-09-12T02:23:32.164 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T02:23:32.164 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T02:23:32.164 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T02:23:32.164 DEBUG:teuthology.orchestra.run.smithi060:> ') 2024-09-12T02:23:32.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:23:32.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:23:32.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:23:32.433 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2024-09-12T02:23:32.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:23:32.450 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list-id 2024-09-12T02:23:32.506 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:23:32.506 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2024-09-12T02:23:32.506 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:23:32.506 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-12T02:23:32.507 DEBUG:teuthology.orchestra.run.smithi060:> ') 2024-09-12T02:23:32.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:23:32.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:23:32.628 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-12T02:23:32.629 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:23:32.629 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2024-09-12T02:23:32.629 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-12T02:23:32.629 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T02:23:32.629 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-12T02:23:32.629 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-12T02:23:32.629 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-12T02:23:32.629 DEBUG:teuthology.orchestra.run.smithi060:> ') 2024-09-12T02:23:32.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:23:32.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:23:32.760 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:23:32.760 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2024-09-12T02:23:32.760 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set brx.0 up 2024-09-12T02:23:32.761 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T02:23:32.761 DEBUG:teuthology.orchestra.run.smithi060:> ') 2024-09-12T02:23:32.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:23:32.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:23:32.841 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'cephfs_name': 'a'} 2024-09-12T02:23:32.841 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:23:32.841 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T02:23:32.870 INFO:teuthology.orchestra.run.smithi060.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:23:32.870 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:23:32.870 DEBUG:teuthology.orchestra.run.smithi060:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:23:32.926 DEBUG:teuthology.orchestra.run.smithi060:> sudo modprobe fuse 2024-09-12T02:23:32.992 DEBUG:teuthology.orchestra.run.smithi060:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T02:23:33.048 INFO:teuthology.orchestra.run.smithi060.stdout:/proc 2024-09-12T02:23:33.049 INFO:teuthology.orchestra.run.smithi060.stdout:/sys 2024-09-12T02:23:33.049 INFO:teuthology.orchestra.run.smithi060.stdout:/dev 2024-09-12T02:23:33.049 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/kernel/security 2024-09-12T02:23:33.049 INFO:teuthology.orchestra.run.smithi060.stdout:/dev/shm 2024-09-12T02:23:33.049 INFO:teuthology.orchestra.run.smithi060.stdout:/dev/pts 2024-09-12T02:23:33.049 INFO:teuthology.orchestra.run.smithi060.stdout:/run 2024-09-12T02:23:33.049 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/cgroup 2024-09-12T02:23:33.049 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/pstore 2024-09-12T02:23:33.049 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/bpf 2024-09-12T02:23:33.049 INFO:teuthology.orchestra.run.smithi060.stdout:/ 2024-09-12T02:23:33.049 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/selinux 2024-09-12T02:23:33.050 INFO:teuthology.orchestra.run.smithi060.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:23:33.050 INFO:teuthology.orchestra.run.smithi060.stdout:/dev/hugepages 2024-09-12T02:23:33.050 INFO:teuthology.orchestra.run.smithi060.stdout:/dev/mqueue 2024-09-12T02:23:33.050 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/kernel/debug 2024-09-12T02:23:33.050 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/kernel/tracing 2024-09-12T02:23:33.050 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/fuse/connections 2024-09-12T02:23:33.050 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/kernel/config 2024-09-12T02:23:33.050 INFO:teuthology.orchestra.run.smithi060.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T02:23:33.050 INFO:teuthology.orchestra.run.smithi060.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T02:23:33.050 INFO:teuthology.orchestra.run.smithi060.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T02:23:33.050 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T02:23:33.050 INFO:teuthology.orchestra.run.smithi060.stdout:/run/user/1000 2024-09-12T02:23:33.050 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/ceph 2024-09-12T02:23:33.051 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T02:23:33.051 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T02:23:33.051 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T02:23:33.051 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T02:23:33.051 INFO:teuthology.orchestra.run.smithi060.stdout:/run/netns 2024-09-12T02:23:33.051 INFO:teuthology.orchestra.run.smithi060.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:23:33.051 INFO:teuthology.orchestra.run.smithi060.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:23:33.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:23:33.051 DEBUG:teuthology.orchestra.run.smithi060:> ls /sys/fs/fuse/connections 2024-09-12T02:23:33.105 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-12T02:23:33.105 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_fs=a) 2024-09-12T02:23:33.147 DEBUG:teuthology.orchestra.run.smithi060:> sudo modprobe fuse 2024-09-12T02:23:33.173 DEBUG:teuthology.orchestra.run.smithi060:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T02:23:33.231 INFO:teuthology.orchestra.run.smithi060.stdout:/proc 2024-09-12T02:23:33.231 INFO:teuthology.orchestra.run.smithi060.stdout:/sys 2024-09-12T02:23:33.231 INFO:teuthology.orchestra.run.smithi060.stdout:/dev 2024-09-12T02:23:33.231 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/kernel/security 2024-09-12T02:23:33.231 INFO:teuthology.orchestra.run.smithi060.stdout:/dev/shm 2024-09-12T02:23:33.231 INFO:teuthology.orchestra.run.smithi060.stdout:/dev/pts 2024-09-12T02:23:33.231 INFO:teuthology.orchestra.run.smithi060.stdout:/run 2024-09-12T02:23:33.231 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/cgroup 2024-09-12T02:23:33.231 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/pstore 2024-09-12T02:23:33.232 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/bpf 2024-09-12T02:23:33.232 INFO:teuthology.orchestra.run.smithi060.stdout:/ 2024-09-12T02:23:33.232 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/selinux 2024-09-12T02:23:33.232 INFO:teuthology.orchestra.run.smithi060.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:23:33.232 INFO:teuthology.orchestra.run.smithi060.stdout:/dev/hugepages 2024-09-12T02:23:33.232 INFO:teuthology.orchestra.run.smithi060.stdout:/dev/mqueue 2024-09-12T02:23:33.232 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/kernel/debug 2024-09-12T02:23:33.232 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/kernel/tracing 2024-09-12T02:23:33.232 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/fs/fuse/connections 2024-09-12T02:23:33.232 INFO:teuthology.orchestra.run.smithi060.stdout:/sys/kernel/config 2024-09-12T02:23:33.232 INFO:teuthology.orchestra.run.smithi060.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T02:23:33.232 INFO:teuthology.orchestra.run.smithi060.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T02:23:33.232 INFO:teuthology.orchestra.run.smithi060.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T02:23:33.233 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T02:23:33.233 INFO:teuthology.orchestra.run.smithi060.stdout:/run/user/1000 2024-09-12T02:23:33.233 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/ceph 2024-09-12T02:23:33.233 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T02:23:33.233 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T02:23:33.233 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T02:23:33.233 INFO:teuthology.orchestra.run.smithi060.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T02:23:33.233 INFO:teuthology.orchestra.run.smithi060.stdout:/run/netns 2024-09-12T02:23:33.233 INFO:teuthology.orchestra.run.smithi060.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:23:33.233 INFO:teuthology.orchestra.run.smithi060.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:23:33.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:23:33.234 DEBUG:teuthology.orchestra.run.smithi060:> ls /sys/fs/fuse/connections 2024-09-12T02:23:33.251 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi060.stderr:2024-09-12T02:23:33.250+0000 7f258281b480 -1 init, newargv = 0x559c883fd6c0 newargc=15 2024-09-12T02:23:33.251 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi060.stderr:ceph-fuse[45340]: starting ceph client 2024-09-12T02:23:33.257 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi060.stderr:ceph-fuse[45340]: starting fuse 2024-09-12T02:23:33.267 INFO:teuthology.orchestra.run.smithi060.stdout:43 2024-09-12T02:23:33.267 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-09-12T02:23:33.267 DEBUG:teuthology.orchestra.run.smithi060:> sudo stdin-killer -- python3 -c ' 2024-09-12T02:23:33.267 DEBUG:teuthology.orchestra.run.smithi060:> import glob 2024-09-12T02:23:33.267 DEBUG:teuthology.orchestra.run.smithi060:> import re 2024-09-12T02:23:33.267 DEBUG:teuthology.orchestra.run.smithi060:> import os 2024-09-12T02:23:33.267 DEBUG:teuthology.orchestra.run.smithi060:> import subprocess 2024-09-12T02:23:33.268 DEBUG:teuthology.orchestra.run.smithi060:> 2024-09-12T02:23:33.268 DEBUG:teuthology.orchestra.run.smithi060:> def _find_admin_socket(client_name): 2024-09-12T02:23:33.268 DEBUG:teuthology.orchestra.run.smithi060:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-12T02:23:33.268 DEBUG:teuthology.orchestra.run.smithi060:> files = glob.glob(asok_path) 2024-09-12T02:23:33.268 DEBUG:teuthology.orchestra.run.smithi060:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-12T02:23:33.268 DEBUG:teuthology.orchestra.run.smithi060:> 2024-09-12T02:23:33.268 DEBUG:teuthology.orchestra.run.smithi060:> # Given a non-glob path, it better be there 2024-09-12T02:23:33.268 DEBUG:teuthology.orchestra.run.smithi060:> if "*" not in asok_path: 2024-09-12T02:23:33.268 DEBUG:teuthology.orchestra.run.smithi060:> assert(len(files) == 1) 2024-09-12T02:23:33.268 DEBUG:teuthology.orchestra.run.smithi060:> return files[0] 2024-09-12T02:23:33.268 DEBUG:teuthology.orchestra.run.smithi060:> 2024-09-12T02:23:33.268 DEBUG:teuthology.orchestra.run.smithi060:> for f in files: 2024-09-12T02:23:33.268 DEBUG:teuthology.orchestra.run.smithi060:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T02:23:33.269 DEBUG:teuthology.orchestra.run.smithi060:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T02:23:33.269 DEBUG:teuthology.orchestra.run.smithi060:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T02:23:33.269 DEBUG:teuthology.orchestra.run.smithi060:> contents = proc_f.read() 2024-09-12T02:23:33.269 DEBUG:teuthology.orchestra.run.smithi060:> if mountpoint in contents: 2024-09-12T02:23:33.269 DEBUG:teuthology.orchestra.run.smithi060:> return f 2024-09-12T02:23:33.269 DEBUG:teuthology.orchestra.run.smithi060:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T02:23:33.269 DEBUG:teuthology.orchestra.run.smithi060:> 2024-09-12T02:23:33.269 DEBUG:teuthology.orchestra.run.smithi060:> print(_find_admin_socket("client.0")) 2024-09-12T02:23:33.269 DEBUG:teuthology.orchestra.run.smithi060:> ' 2024-09-12T02:23:33.388 INFO:teuthology.orchestra.run.smithi060.stdout:/var/run/ceph/ceph-client.0.45340.asok 2024-09-12T02:23:33.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:23:33.399 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.45340.asok 2024-09-12T02:23:33.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:23:33.399 DEBUG:teuthology.orchestra.run.smithi060:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.45340.asok status 2024-09-12T02:23:33.536 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:23:33.536 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": { 2024-09-12T02:23:33.536 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-12T02:23:33.536 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T02:23:33.537 INFO:teuthology.orchestra.run.smithi060.stdout: "entity_id": "0", 2024-09-12T02:23:33.537 INFO:teuthology.orchestra.run.smithi060.stdout: "hostname": "smithi060", 2024-09-12T02:23:33.537 INFO:teuthology.orchestra.run.smithi060.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-12T02:23:33.537 INFO:teuthology.orchestra.run.smithi060.stdout: "pid": "45340", 2024-09-12T02:23:33.537 INFO:teuthology.orchestra.run.smithi060.stdout: "root": "/" 2024-09-12T02:23:33.537 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:33.537 INFO:teuthology.orchestra.run.smithi060.stdout: "dentry_count": 0, 2024-09-12T02:23:33.537 INFO:teuthology.orchestra.run.smithi060.stdout: "dentry_pinned_count": 0, 2024-09-12T02:23:33.537 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4809, 2024-09-12T02:23:33.537 INFO:teuthology.orchestra.run.smithi060.stdout: "inst": { 2024-09-12T02:23:33.537 INFO:teuthology.orchestra.run.smithi060.stdout: "name": { 2024-09-12T02:23:33.537 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "client", 2024-09-12T02:23:33.537 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4809 2024-09-12T02:23:33.538 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:33.538 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": { 2024-09-12T02:23:33.538 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:23:33.538 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "192.168.0.1:0", 2024-09-12T02:23:33.538 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2014693036 2024-09-12T02:23:33.538 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:23:33.538 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:33.538 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": { 2024-09-12T02:23:33.538 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:23:33.538 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "192.168.0.1:0", 2024-09-12T02:23:33.538 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2014693036 2024-09-12T02:23:33.538 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:33.539 INFO:teuthology.orchestra.run.smithi060.stdout: "inst_str": "client.4809 192.168.0.1:0/2014693036", 2024-09-12T02:23:33.539 INFO:teuthology.orchestra.run.smithi060.stdout: "addr_str": "192.168.0.1:0/2014693036", 2024-09-12T02:23:33.539 INFO:teuthology.orchestra.run.smithi060.stdout: "inode_count": 1, 2024-09-12T02:23:33.539 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_epoch": 7, 2024-09-12T02:23:33.539 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_epoch": 26, 2024-09-12T02:23:33.539 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_epoch_barrier": 0, 2024-09-12T02:23:33.539 INFO:teuthology.orchestra.run.smithi060.stdout: "blocklisted": false, 2024-09-12T02:23:33.539 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "a" 2024-09-12T02:23:33.539 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:23:33.544 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-12T02:23:33.545 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:23:33.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.646+0000 7fce871f6640 1 Processor -- start 2024-09-12T02:23:33.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.646+0000 7fce871f6640 1 -- start start 2024-09-12T02:23:33.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.647+0000 7fce871f6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fce800c3560 0x7fce800c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:33.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.647+0000 7fce871f6640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce80153fc0 con 0x7fce800c7fb0 2024-09-12T02:23:33.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.647+0000 7fce871f6640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce800c8400 con 0x7fce80153be0 2024-09-12T02:23:33.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.647+0000 7fce871f6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fce80156db0 con 0x7fce800c3560 2024-09-12T02:23:33.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.647+0000 7fce7ffff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fce800c3560 0x7fce800c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:33.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.647+0000 7fce85793640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fce800c7fb0 0x7fce80160bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:35374/0 (socket says 172.21.15.60:35374) 2024-09-12T02:23:33.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.647+0000 7fce85793640 1 -- 172.21.15.60:0/3419677330 learned_addr learned my addr 172.21.15.60:0/3419677330 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:33.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.648+0000 7fce7ffff640 1 -- 172.21.15.60:0/3419677330 >> v1:172.21.15.105:6789/0 conn(0x7fce80153be0 legacy=0x7fce800ac720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:33.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.648+0000 7fce7ffff640 1 -- 172.21.15.60:0/3419677330 >> v1:172.21.15.60:6789/0 conn(0x7fce800c7fb0 legacy=0x7fce80160bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:33.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.648+0000 7fce7f7fe640 1 -- 172.21.15.60:0/3419677330 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2964571898 0 0) 0x7fce78001490 con 0x7fce800c7fb0 2024-09-12T02:23:33.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.648+0000 7fce7ffff640 1 -- 172.21.15.60:0/3419677330 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce800a8030 con 0x7fce800c3560 2024-09-12T02:23:33.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.648+0000 7fce7ffff640 1 --2- 172.21.15.60:0/3419677330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce800c3560 0x7fce800c7a70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fce680097a0 tx=0x7fce6802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ee61f13f06e0231 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:33.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.649+0000 7fce7f7fe640 1 -- 172.21.15.60:0/3419677330 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce68037070 con 0x7fce800c3560 2024-09-12T02:23:33.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.649+0000 7fce7f7fe640 1 -- 172.21.15.60:0/3419677330 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce68032440 con 0x7fce800c3560 2024-09-12T02:23:33.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.649+0000 7fce7f7fe640 1 -- 172.21.15.60:0/3419677330 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6802ae60 con 0x7fce800c3560 2024-09-12T02:23:33.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.649+0000 7fce871f6640 1 -- 172.21.15.60:0/3419677330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce800c3560 msgr2=0x7fce800c7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:33.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.649+0000 7fce871f6640 1 --2- 172.21.15.60:0/3419677330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce800c3560 0x7fce800c7a70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fce680097a0 tx=0x7fce6802a110 comp rx=0 tx=0).stop 2024-09-12T02:23:33.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.649+0000 7fce871f6640 1 -- 172.21.15.60:0/3419677330 shutdown_connections 2024-09-12T02:23:33.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.649+0000 7fce871f6640 1 --2- 172.21.15.60:0/3419677330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce800c3560 0x7fce800c7a70 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:33.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.649+0000 7fce871f6640 1 -- 172.21.15.60:0/3419677330 >> 172.21.15.60:0/3419677330 conn(0x7fce800c5660 msgr2=0x7fce800c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:33.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.649+0000 7fce871f6640 1 -- 172.21.15.60:0/3419677330 shutdown_connections 2024-09-12T02:23:33.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.649+0000 7fce871f6640 1 -- 172.21.15.60:0/3419677330 wait complete. 2024-09-12T02:23:33.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.650+0000 7fce871f6640 1 Processor -- start 2024-09-12T02:23:33.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.650+0000 7fce871f6640 1 -- start start 2024-09-12T02:23:33.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.651+0000 7fce871f6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce800c3560 0x7fce8014a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:33.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.651+0000 7fce871f6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce800c7fb0 0x7fce80152c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:33.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.651+0000 7fce871f6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce80153be0 0x7fce801ef620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:33.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.651+0000 7fce871f6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fce800a83e0 con 0x7fce800c3560 2024-09-12T02:23:33.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.651+0000 7fce871f6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fce80157240 con 0x7fce80153be0 2024-09-12T02:23:33.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.651+0000 7fce871f6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fce800ac370 con 0x7fce800c7fb0 2024-09-12T02:23:33.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.651+0000 7fce84f92640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce800c3560 0x7fce8014a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:33.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.651+0000 7fce84f92640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce800c3560 0x7fce8014a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50250/0 (socket says 172.21.15.60:50250) 2024-09-12T02:23:33.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.651+0000 7fce84f92640 1 -- 172.21.15.60:0/390085560 learned_addr learned my addr 172.21.15.60:0/390085560 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:33.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.651+0000 7fce85793640 1 --2- 172.21.15.60:0/390085560 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce80153be0 0x7fce801ef620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:33.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.652+0000 7fce7ffff640 1 --2- 172.21.15.60:0/390085560 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce800c7fb0 0x7fce80152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:33.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.652+0000 7fce84f92640 1 -- 172.21.15.60:0/390085560 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce800c7fb0 msgr2=0x7fce80152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:33.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.652+0000 7fce84f92640 1 --2- 172.21.15.60:0/390085560 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce800c7fb0 0x7fce80152c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:33.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.652+0000 7fce84f92640 1 -- 172.21.15.60:0/390085560 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce80153be0 msgr2=0x7fce801ef620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:33.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.652+0000 7fce84f92640 1 --2- 172.21.15.60:0/390085560 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce80153be0 0x7fce801ef620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:33.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.652+0000 7fce84f92640 1 -- 172.21.15.60:0/390085560 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce80155d50 con 0x7fce800c3560 2024-09-12T02:23:33.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.652+0000 7fce85793640 1 --2- 172.21.15.60:0/390085560 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce80153be0 0x7fce801ef620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:23:33.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.652+0000 7fce7ffff640 1 --2- 172.21.15.60:0/390085560 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce800c7fb0 0x7fce80152c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:23:33.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.652+0000 7fce84f92640 1 --2- 172.21.15.60:0/390085560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce800c3560 0x7fce8014a0b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fce7000c400 tx=0x7fce7000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:33.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.652+0000 7fce7d7fa640 1 -- 172.21.15.60:0/390085560 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce70017070 con 0x7fce800c3560 2024-09-12T02:23:33.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.652+0000 7fce7d7fa640 1 -- 172.21.15.60:0/390085560 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce700052d0 con 0x7fce800c3560 2024-09-12T02:23:33.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.652+0000 7fce7d7fa640 1 -- 172.21.15.60:0/390085560 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce70003830 con 0x7fce800c3560 2024-09-12T02:23:33.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.652+0000 7fce871f6640 1 -- 172.21.15.60:0/390085560 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce801565d0 con 0x7fce800c3560 2024-09-12T02:23:33.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.652+0000 7fce871f6640 1 -- 172.21.15.60:0/390085560 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce801562f0 con 0x7fce800c3560 2024-09-12T02:23:33.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.653+0000 7fce871f6640 1 -- 172.21.15.60:0/390085560 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce800c63f0 con 0x7fce800c3560 2024-09-12T02:23:33.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.654+0000 7fce7d7fa640 1 -- 172.21.15.60:0/390085560 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fce7001a070 con 0x7fce800c3560 2024-09-12T02:23:33.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.654+0000 7fce7d7fa640 1 --2- 172.21.15.60:0/390085560 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fce6006be30 0x7fce6006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:33.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.654+0000 7fce7d7fa640 1 -- 172.21.15.60:0/390085560 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7fce7008a460 con 0x7fce800c3560 2024-09-12T02:23:33.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.654+0000 7fce7ffff640 1 --2- 172.21.15.60:0/390085560 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fce6006be30 0x7fce6006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:33.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.655+0000 7fce7ffff640 1 --2- 172.21.15.60:0/390085560 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fce6006be30 0x7fce6006e2f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fce68034000 tx=0x7fce6802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:33.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.658+0000 7fce7d7fa640 1 -- 172.21.15.60:0/390085560 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fce70058b70 con 0x7fce800c3560 2024-09-12T02:23:33.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.872+0000 7fce871f6640 1 -- 172.21.15.60:0/390085560 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fce800c4f10 con 0x7fce800c3560 2024-09-12T02:23:33.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.872+0000 7fce7d7fa640 1 -- 172.21.15.60:0/390085560 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v11) ==== 53+0+116 (secure 0 0 0) 0x7fce70058470 con 0x7fce800c3560 2024-09-12T02:23:33.873 INFO:teuthology.orchestra.run.smithi060.stdout:name: a, metadata pool: a_metadata, data pools: [a_data ] 2024-09-12T02:23:33.873 INFO:teuthology.orchestra.run.smithi060.stdout:name: b, metadata pool: b_metadata, data pools: [b_data ] 2024-09-12T02:23:33.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.874+0000 7fce871f6640 1 -- 172.21.15.60:0/390085560 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fce6006be30 msgr2=0x7fce6006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:33.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.874+0000 7fce871f6640 1 --2- 172.21.15.60:0/390085560 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fce6006be30 0x7fce6006e2f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fce68034000 tx=0x7fce6802e000 comp rx=0 tx=0).stop 2024-09-12T02:23:33.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.874+0000 7fce871f6640 1 -- 172.21.15.60:0/390085560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce800c3560 msgr2=0x7fce8014a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:33.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.874+0000 7fce871f6640 1 --2- 172.21.15.60:0/390085560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce800c3560 0x7fce8014a0b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fce7000c400 tx=0x7fce7000c8c0 comp rx=0 tx=0).stop 2024-09-12T02:23:33.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.874+0000 7fce871f6640 1 -- 172.21.15.60:0/390085560 shutdown_connections 2024-09-12T02:23:33.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.874+0000 7fce871f6640 1 --2- 172.21.15.60:0/390085560 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fce6006be30 0x7fce6006e2f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:33.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.874+0000 7fce871f6640 1 --2- 172.21.15.60:0/390085560 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce80153be0 0x7fce801ef620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:33.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.874+0000 7fce871f6640 1 --2- 172.21.15.60:0/390085560 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce800c7fb0 0x7fce80152c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:33.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.874+0000 7fce871f6640 1 --2- 172.21.15.60:0/390085560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce800c3560 0x7fce8014a0b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:33.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.874+0000 7fce871f6640 1 -- 172.21.15.60:0/390085560 >> 172.21.15.60:0/390085560 conn(0x7fce800c5660 msgr2=0x7fce800c4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:33.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.874+0000 7fce871f6640 1 -- 172.21.15.60:0/390085560 shutdown_connections 2024-09-12T02:23:33.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:33.874+0000 7fce871f6640 1 -- 172.21.15.60:0/390085560 wait complete. 2024-09-12T02:23:33.886 INFO:tasks.cephfs.mount:Mounting Ceph FS b; just confirmed its presence on cluster 2024-09-12T02:23:33.886 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:23:33.886 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi105.front.sepia.ceph.com 2024-09-12T02:23:33.886 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-12T02:23:33.886 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-12T02:23:33.886 INFO:tasks.cephfs.mount:self.cephfs_name = b 2024-09-12T02:23:33.886 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T02:23:33.886 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:23:33.886 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T02:23:33.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:23:33.886 DEBUG:teuthology.orchestra.run.smithi105:> ip addr 2024-09-12T02:23:33.905 INFO:teuthology.orchestra.run.smithi105.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:23:33.906 INFO:teuthology.orchestra.run.smithi105.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:23:33.906 INFO:teuthology.orchestra.run.smithi105.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:23:33.906 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:23:33.906 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 ::1/128 scope host 2024-09-12T02:23:33.906 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:23:33.906 INFO:teuthology.orchestra.run.smithi105.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:23:33.906 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b8 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:23:33.906 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f0 2024-09-12T02:23:33.906 INFO:teuthology.orchestra.run.smithi105.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:23:33.906 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b9 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:23:33.906 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f1 2024-09-12T02:23:33.906 INFO:teuthology.orchestra.run.smithi105.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:23:33.907 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:28 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:23:33.907 INFO:teuthology.orchestra.run.smithi105.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:23:33.907 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:29 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:23:33.907 INFO:teuthology.orchestra.run.smithi105.stdout: inet 172.21.15.105/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:23:33.908 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft 42695sec preferred_lft 42695sec 2024-09-12T02:23:33.908 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::ec4:7aff:fe8f:d429/64 scope link noprefixroute 2024-09-12T02:23:33.908 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:23:33.908 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T02:23:33.908 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:23:33.908 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-09-12T02:23:33.909 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link add name ceph-brx type bridge 2024-09-12T02:23:33.909 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip addr flush dev ceph-brx 2024-09-12T02:23:33.909 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set ceph-brx up 2024-09-12T02:23:33.909 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T02:23:33.909 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-09-12T02:23:33.998 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:23:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:23:34.113 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:23:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:23:34.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:23:34.119 DEBUG:teuthology.orchestra.run.smithi105:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:23:34.143 INFO:teuthology.orchestra.run.smithi105.stdout:1 2024-09-12T02:23:34.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:23:34.145 DEBUG:teuthology.orchestra.run.smithi105:> route 2024-09-12T02:23:34.214 INFO:teuthology.orchestra.run.smithi105.stdout:Kernel IP routing table 2024-09-12T02:23:34.214 INFO:teuthology.orchestra.run.smithi105.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:23:34.214 INFO:teuthology.orchestra.run.smithi105.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:23:34.214 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:23:34.214 INFO:teuthology.orchestra.run.smithi105.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:23:34.214 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:23:34.214 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-09-12T02:23:34.215 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:23:34.215 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:23:34.215 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:23:34.215 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-09-12T02:23:34.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:23:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:23:34.508 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:23:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:23:34.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:23:34.529 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2024-09-12T02:23:34.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:23:34.546 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list-id 2024-09-12T02:23:34.601 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:23:34.601 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-09-12T02:23:34.601 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T02:23:34.601 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-12T02:23:34.601 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-09-12T02:23:34.689 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:23:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:23:34.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:23:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:23:34.720 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-12T02:23:34.720 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:23:34.720 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-09-12T02:23:34.720 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-12T02:23:34.720 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T02:23:34.720 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-12T02:23:34.720 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-12T02:23:34.720 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-12T02:23:34.720 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-09-12T02:23:34.769 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:23:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:23:34.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:23:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:23:34.847 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:23:34.847 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-09-12T02:23:34.847 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set brx.0 up 2024-09-12T02:23:34.847 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T02:23:34.847 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-09-12T02:23:34.895 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:23:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:23:34.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:23:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:23:34.924 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {'cephfs_name': 'b'} 2024-09-12T02:23:34.924 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:23:34.924 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-12T02:23:34.953 INFO:teuthology.orchestra.run.smithi105.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-12T02:23:34.954 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:23:34.954 DEBUG:teuthology.orchestra.run.smithi105:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-12T02:23:35.010 DEBUG:teuthology.orchestra.run.smithi105:> sudo modprobe fuse 2024-09-12T02:23:35.076 DEBUG:teuthology.orchestra.run.smithi105:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T02:23:35.132 INFO:teuthology.orchestra.run.smithi105.stdout:/proc 2024-09-12T02:23:35.133 INFO:teuthology.orchestra.run.smithi105.stdout:/sys 2024-09-12T02:23:35.133 INFO:teuthology.orchestra.run.smithi105.stdout:/dev 2024-09-12T02:23:35.133 INFO:teuthology.orchestra.run.smithi105.stdout:/sys/kernel/security 2024-09-12T02:23:35.133 INFO:teuthology.orchestra.run.smithi105.stdout:/dev/shm 2024-09-12T02:23:35.133 INFO:teuthology.orchestra.run.smithi105.stdout:/dev/pts 2024-09-12T02:23:35.133 INFO:teuthology.orchestra.run.smithi105.stdout:/run 2024-09-12T02:23:35.133 INFO:teuthology.orchestra.run.smithi105.stdout:/sys/fs/cgroup 2024-09-12T02:23:35.133 INFO:teuthology.orchestra.run.smithi105.stdout:/sys/fs/pstore 2024-09-12T02:23:35.133 INFO:teuthology.orchestra.run.smithi105.stdout:/sys/fs/bpf 2024-09-12T02:23:35.133 INFO:teuthology.orchestra.run.smithi105.stdout:/ 2024-09-12T02:23:35.133 INFO:teuthology.orchestra.run.smithi105.stdout:/sys/fs/selinux 2024-09-12T02:23:35.133 INFO:teuthology.orchestra.run.smithi105.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:23:35.133 INFO:teuthology.orchestra.run.smithi105.stdout:/sys/kernel/debug 2024-09-12T02:23:35.134 INFO:teuthology.orchestra.run.smithi105.stdout:/dev/mqueue 2024-09-12T02:23:35.134 INFO:teuthology.orchestra.run.smithi105.stdout:/dev/hugepages 2024-09-12T02:23:35.134 INFO:teuthology.orchestra.run.smithi105.stdout:/sys/kernel/tracing 2024-09-12T02:23:35.134 INFO:teuthology.orchestra.run.smithi105.stdout:/sys/fs/fuse/connections 2024-09-12T02:23:35.134 INFO:teuthology.orchestra.run.smithi105.stdout:/sys/kernel/config 2024-09-12T02:23:35.134 INFO:teuthology.orchestra.run.smithi105.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T02:23:35.134 INFO:teuthology.orchestra.run.smithi105.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T02:23:35.134 INFO:teuthology.orchestra.run.smithi105.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T02:23:35.134 INFO:teuthology.orchestra.run.smithi105.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T02:23:35.134 INFO:teuthology.orchestra.run.smithi105.stdout:/run/user/1000 2024-09-12T02:23:35.135 INFO:teuthology.orchestra.run.smithi105.stdout:/var/lib/ceph 2024-09-12T02:23:35.135 INFO:teuthology.orchestra.run.smithi105.stdout:/var/lib/ceph/osd/ceph-4 2024-09-12T02:23:35.135 INFO:teuthology.orchestra.run.smithi105.stdout:/var/lib/ceph/osd/ceph-5 2024-09-12T02:23:35.135 INFO:teuthology.orchestra.run.smithi105.stdout:/var/lib/ceph/osd/ceph-6 2024-09-12T02:23:35.135 INFO:teuthology.orchestra.run.smithi105.stdout:/var/lib/ceph/osd/ceph-7 2024-09-12T02:23:35.136 INFO:teuthology.orchestra.run.smithi105.stdout:/run/netns 2024-09-12T02:23:35.136 INFO:teuthology.orchestra.run.smithi105.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T02:23:35.136 INFO:teuthology.orchestra.run.smithi105.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T02:23:35.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:23:35.136 DEBUG:teuthology.orchestra.run.smithi105:> ls /sys/fs/fuse/connections 2024-09-12T02:23:35.188 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-12T02:23:35.188 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1 --client_fs=b) 2024-09-12T02:23:35.230 DEBUG:teuthology.orchestra.run.smithi105:> sudo modprobe fuse 2024-09-12T02:23:35.254 DEBUG:teuthology.orchestra.run.smithi105:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T02:23:35.311 INFO:teuthology.orchestra.run.smithi105.stdout:/proc 2024-09-12T02:23:35.311 INFO:teuthology.orchestra.run.smithi105.stdout:/sys 2024-09-12T02:23:35.311 INFO:teuthology.orchestra.run.smithi105.stdout:/dev 2024-09-12T02:23:35.311 INFO:teuthology.orchestra.run.smithi105.stdout:/sys/kernel/security 2024-09-12T02:23:35.311 INFO:teuthology.orchestra.run.smithi105.stdout:/dev/shm 2024-09-12T02:23:35.312 INFO:teuthology.orchestra.run.smithi105.stdout:/dev/pts 2024-09-12T02:23:35.312 INFO:teuthology.orchestra.run.smithi105.stdout:/run 2024-09-12T02:23:35.312 INFO:teuthology.orchestra.run.smithi105.stdout:/sys/fs/cgroup 2024-09-12T02:23:35.312 INFO:teuthology.orchestra.run.smithi105.stdout:/sys/fs/pstore 2024-09-12T02:23:35.312 INFO:teuthology.orchestra.run.smithi105.stdout:/sys/fs/bpf 2024-09-12T02:23:35.312 INFO:teuthology.orchestra.run.smithi105.stdout:/ 2024-09-12T02:23:35.312 INFO:teuthology.orchestra.run.smithi105.stdout:/sys/fs/selinux 2024-09-12T02:23:35.312 INFO:teuthology.orchestra.run.smithi105.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:23:35.312 INFO:teuthology.orchestra.run.smithi105.stdout:/sys/kernel/debug 2024-09-12T02:23:35.312 INFO:teuthology.orchestra.run.smithi105.stdout:/dev/mqueue 2024-09-12T02:23:35.312 INFO:teuthology.orchestra.run.smithi105.stdout:/dev/hugepages 2024-09-12T02:23:35.312 INFO:teuthology.orchestra.run.smithi105.stdout:/sys/kernel/tracing 2024-09-12T02:23:35.312 INFO:teuthology.orchestra.run.smithi105.stdout:/sys/fs/fuse/connections 2024-09-12T02:23:35.312 INFO:teuthology.orchestra.run.smithi105.stdout:/sys/kernel/config 2024-09-12T02:23:35.313 INFO:teuthology.orchestra.run.smithi105.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T02:23:35.313 INFO:teuthology.orchestra.run.smithi105.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T02:23:35.313 INFO:teuthology.orchestra.run.smithi105.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T02:23:35.313 INFO:teuthology.orchestra.run.smithi105.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T02:23:35.313 INFO:teuthology.orchestra.run.smithi105.stdout:/run/user/1000 2024-09-12T02:23:35.313 INFO:teuthology.orchestra.run.smithi105.stdout:/var/lib/ceph 2024-09-12T02:23:35.313 INFO:teuthology.orchestra.run.smithi105.stdout:/var/lib/ceph/osd/ceph-4 2024-09-12T02:23:35.313 INFO:teuthology.orchestra.run.smithi105.stdout:/var/lib/ceph/osd/ceph-5 2024-09-12T02:23:35.313 INFO:teuthology.orchestra.run.smithi105.stdout:/var/lib/ceph/osd/ceph-6 2024-09-12T02:23:35.313 INFO:teuthology.orchestra.run.smithi105.stdout:/var/lib/ceph/osd/ceph-7 2024-09-12T02:23:35.313 INFO:teuthology.orchestra.run.smithi105.stdout:/run/netns 2024-09-12T02:23:35.314 INFO:teuthology.orchestra.run.smithi105.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T02:23:35.314 INFO:teuthology.orchestra.run.smithi105.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T02:23:35.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:23:35.314 DEBUG:teuthology.orchestra.run.smithi105:> ls /sys/fs/fuse/connections 2024-09-12T02:23:35.323 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi105.stderr:2024-09-12T02:23:35.322+0000 7f5142be2480 -1 init, newargv = 0x559b9a9ea670 newargc=15 2024-09-12T02:23:35.323 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi105.stderr:ceph-fuse[42685]: starting ceph client 2024-09-12T02:23:35.330 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi105.stderr:ceph-fuse[42685]: starting fuse 2024-09-12T02:23:35.338 INFO:teuthology.orchestra.run.smithi105.stdout:42 2024-09-12T02:23:35.339 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-09-12T02:23:35.339 DEBUG:teuthology.orchestra.run.smithi105:> sudo stdin-killer -- python3 -c ' 2024-09-12T02:23:35.339 DEBUG:teuthology.orchestra.run.smithi105:> import glob 2024-09-12T02:23:35.339 DEBUG:teuthology.orchestra.run.smithi105:> import re 2024-09-12T02:23:35.339 DEBUG:teuthology.orchestra.run.smithi105:> import os 2024-09-12T02:23:35.339 DEBUG:teuthology.orchestra.run.smithi105:> import subprocess 2024-09-12T02:23:35.339 DEBUG:teuthology.orchestra.run.smithi105:> 2024-09-12T02:23:35.339 DEBUG:teuthology.orchestra.run.smithi105:> def _find_admin_socket(client_name): 2024-09-12T02:23:35.339 DEBUG:teuthology.orchestra.run.smithi105:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-12T02:23:35.340 DEBUG:teuthology.orchestra.run.smithi105:> files = glob.glob(asok_path) 2024-09-12T02:23:35.340 DEBUG:teuthology.orchestra.run.smithi105:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-12T02:23:35.340 DEBUG:teuthology.orchestra.run.smithi105:> 2024-09-12T02:23:35.340 DEBUG:teuthology.orchestra.run.smithi105:> # Given a non-glob path, it better be there 2024-09-12T02:23:35.340 DEBUG:teuthology.orchestra.run.smithi105:> if "*" not in asok_path: 2024-09-12T02:23:35.340 DEBUG:teuthology.orchestra.run.smithi105:> assert(len(files) == 1) 2024-09-12T02:23:35.340 DEBUG:teuthology.orchestra.run.smithi105:> return files[0] 2024-09-12T02:23:35.340 DEBUG:teuthology.orchestra.run.smithi105:> 2024-09-12T02:23:35.340 DEBUG:teuthology.orchestra.run.smithi105:> for f in files: 2024-09-12T02:23:35.340 DEBUG:teuthology.orchestra.run.smithi105:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T02:23:35.340 DEBUG:teuthology.orchestra.run.smithi105:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T02:23:35.340 DEBUG:teuthology.orchestra.run.smithi105:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T02:23:35.340 DEBUG:teuthology.orchestra.run.smithi105:> contents = proc_f.read() 2024-09-12T02:23:35.340 DEBUG:teuthology.orchestra.run.smithi105:> if mountpoint in contents: 2024-09-12T02:23:35.341 DEBUG:teuthology.orchestra.run.smithi105:> return f 2024-09-12T02:23:35.341 DEBUG:teuthology.orchestra.run.smithi105:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T02:23:35.341 DEBUG:teuthology.orchestra.run.smithi105:> 2024-09-12T02:23:35.341 DEBUG:teuthology.orchestra.run.smithi105:> print(_find_admin_socket("client.1")) 2024-09-12T02:23:35.341 DEBUG:teuthology.orchestra.run.smithi105:> ' 2024-09-12T02:23:35.457 INFO:teuthology.orchestra.run.smithi105.stdout:/var/run/ceph/ceph-client.1.42685.asok 2024-09-12T02:23:35.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T02:23:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:23:35.467 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.42685.asok 2024-09-12T02:23:35.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:23:35.467 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.42685.asok status 2024-09-12T02:23:35.602 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2024-09-12T02:23:35.602 INFO:teuthology.orchestra.run.smithi105.stdout: "metadata": { 2024-09-12T02:23:35.602 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-12T02:23:35.602 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T02:23:35.602 INFO:teuthology.orchestra.run.smithi105.stdout: "entity_id": "1", 2024-09-12T02:23:35.603 INFO:teuthology.orchestra.run.smithi105.stdout: "hostname": "smithi105", 2024-09-12T02:23:35.603 INFO:teuthology.orchestra.run.smithi105.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-12T02:23:35.603 INFO:teuthology.orchestra.run.smithi105.stdout: "pid": "42685", 2024-09-12T02:23:35.603 INFO:teuthology.orchestra.run.smithi105.stdout: "root": "/" 2024-09-12T02:23:35.603 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T02:23:35.603 INFO:teuthology.orchestra.run.smithi105.stdout: "dentry_count": 0, 2024-09-12T02:23:35.603 INFO:teuthology.orchestra.run.smithi105.stdout: "dentry_pinned_count": 0, 2024-09-12T02:23:35.603 INFO:teuthology.orchestra.run.smithi105.stdout: "id": 4583, 2024-09-12T02:23:35.603 INFO:teuthology.orchestra.run.smithi105.stdout: "inst": { 2024-09-12T02:23:35.603 INFO:teuthology.orchestra.run.smithi105.stdout: "name": { 2024-09-12T02:23:35.603 INFO:teuthology.orchestra.run.smithi105.stdout: "type": "client", 2024-09-12T02:23:35.603 INFO:teuthology.orchestra.run.smithi105.stdout: "num": 4583 2024-09-12T02:23:35.603 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T02:23:35.604 INFO:teuthology.orchestra.run.smithi105.stdout: "addr": { 2024-09-12T02:23:35.604 INFO:teuthology.orchestra.run.smithi105.stdout: "type": "v1", 2024-09-12T02:23:35.604 INFO:teuthology.orchestra.run.smithi105.stdout: "addr": "192.168.0.1:0", 2024-09-12T02:23:35.604 INFO:teuthology.orchestra.run.smithi105.stdout: "nonce": 1082184357 2024-09-12T02:23:35.604 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-12T02:23:35.604 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T02:23:35.604 INFO:teuthology.orchestra.run.smithi105.stdout: "addr": { 2024-09-12T02:23:35.604 INFO:teuthology.orchestra.run.smithi105.stdout: "type": "v1", 2024-09-12T02:23:35.604 INFO:teuthology.orchestra.run.smithi105.stdout: "addr": "192.168.0.1:0", 2024-09-12T02:23:35.604 INFO:teuthology.orchestra.run.smithi105.stdout: "nonce": 1082184357 2024-09-12T02:23:35.604 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T02:23:35.604 INFO:teuthology.orchestra.run.smithi105.stdout: "inst_str": "client.4583 192.168.0.1:0/1082184357", 2024-09-12T02:23:35.604 INFO:teuthology.orchestra.run.smithi105.stdout: "addr_str": "192.168.0.1:0/1082184357", 2024-09-12T02:23:35.604 INFO:teuthology.orchestra.run.smithi105.stdout: "inode_count": 1, 2024-09-12T02:23:35.605 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_epoch": 11, 2024-09-12T02:23:35.605 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_epoch": 26, 2024-09-12T02:23:35.605 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_epoch_barrier": 0, 2024-09-12T02:23:35.605 INFO:teuthology.orchestra.run.smithi105.stdout: "blocklisted": false, 2024-09-12T02:23:35.605 INFO:teuthology.orchestra.run.smithi105.stdout: "fs_name": "b" 2024-09-12T02:23:35.605 INFO:teuthology.orchestra.run.smithi105.stdout:} 2024-09-12T02:23:35.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:23:35.611 DEBUG:teuthology.orchestra.run.smithi060:> stat --file-system '--printf=%T 2024-09-12T02:23:35.611 DEBUG:teuthology.orchestra.run.smithi060:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-12T02:23:35.632 INFO:teuthology.orchestra.run.smithi060.stdout:fuseblk 2024-09-12T02:23:35.632 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-12T02:23:35.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:23:35.632 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:23:35.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:23:35.705 DEBUG:teuthology.orchestra.run.smithi105:> stat --file-system '--printf=%T 2024-09-12T02:23:35.705 DEBUG:teuthology.orchestra.run.smithi105:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-12T02:23:35.721 INFO:teuthology.orchestra.run.smithi105.stdout:fuseblk 2024-09-12T02:23:35.722 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-12T02:23:35.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:23:35.722 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-12T02:23:35.788 INFO:teuthology.run_tasks:Running task mon_thrash... 2024-09-12T02:23:35.801 INFO:tasks.mon_thrash:Beginning mon_thrash... 2024-09-12T02:23:35.801 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:23:35.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.913+0000 7f580fa45640 1 Processor -- start 2024-09-12T02:23:35.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.913+0000 7f580fa45640 1 -- start start 2024-09-12T02:23:35.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.914+0000 7f580fa45640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58080acc30 0x7f58080c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:35.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.914+0000 7f580fa45640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f58080c8180 0x7f580815dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:35.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.914+0000 7f580fa45640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5808070590 con 0x7f58080c44b0 2024-09-12T02:23:35.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.914+0000 7f580fa45640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f58080c4ea0 con 0x7f58080c8180 2024-09-12T02:23:35.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.914+0000 7f580fa45640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f58080a8220 con 0x7f58080acc30 2024-09-12T02:23:35.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.914+0000 7f580cfe0640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f58080c44b0 0x7f58080c7a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:35376/0 (socket says 172.21.15.60:35376) 2024-09-12T02:23:35.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.914+0000 7f580cfe0640 1 -- 172.21.15.60:0/2060614788 learned_addr learned my addr 172.21.15.60:0/2060614788 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:35.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.915+0000 7f580d7e1640 1 --2- 172.21.15.60:0/2060614788 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58080acc30 0x7f58080c3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:35.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.915+0000 7f580dfe2640 1 --2- 172.21.15.60:0/2060614788 >> v2:172.21.15.105:3300/0 conn(0x7f58080c8180 0x7f580815dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:35.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.915+0000 7f57fffff640 1 -- 172.21.15.60:0/2060614788 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3174087887 0 0) 0x7f5808070590 con 0x7f58080c44b0 2024-09-12T02:23:35.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.915+0000 7f57fffff640 1 -- 172.21.15.60:0/2060614788 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57f4003520 con 0x7f58080c44b0 2024-09-12T02:23:35.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.915+0000 7f580d7e1640 1 -- 172.21.15.60:0/2060614788 >> v2:172.21.15.105:3300/0 conn(0x7f58080c8180 msgr2=0x7f580815dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:35.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.915+0000 7f580d7e1640 1 --2- 172.21.15.60:0/2060614788 >> v2:172.21.15.105:3300/0 conn(0x7f58080c8180 0x7f580815dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:35.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.915+0000 7f580d7e1640 1 -- 172.21.15.60:0/2060614788 >> v1:172.21.15.60:6789/0 conn(0x7f58080c44b0 legacy=0x7f58080c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:35.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.915+0000 7f57fffff640 1 -- 172.21.15.60:0/2060614788 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 570994488 0 0) 0x7f57f4003520 con 0x7f58080c44b0 2024-09-12T02:23:35.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.915+0000 7f580d7e1640 1 -- 172.21.15.60:0/2060614788 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58080a84f0 con 0x7f58080acc30 2024-09-12T02:23:35.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.915+0000 7f580dfe2640 1 --2- 172.21.15.60:0/2060614788 >> v2:172.21.15.105:3300/0 conn(0x7f58080c8180 0x7f580815dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:23:35.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.916+0000 7f580d7e1640 1 --2- 172.21.15.60:0/2060614788 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58080acc30 0x7f58080c3f70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f58040097a0 tx=0x7f580402a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7514f1d59006461 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:35.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.916+0000 7f57fffff640 1 -- 172.21.15.60:0/2060614788 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5804037070 con 0x7f58080acc30 2024-09-12T02:23:35.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.916+0000 7f57fffff640 1 -- 172.21.15.60:0/2060614788 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f580402aa90 con 0x7f58080acc30 2024-09-12T02:23:35.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.916+0000 7f57fffff640 1 -- 172.21.15.60:0/2060614788 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f8001690 con 0x7f58080acc30 2024-09-12T02:23:35.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.917+0000 7f580fa45640 1 -- 172.21.15.60:0/2060614788 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58080acc30 msgr2=0x7f58080c3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:35.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.917+0000 7f580fa45640 1 --2- 172.21.15.60:0/2060614788 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58080acc30 0x7f58080c3f70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f58040097a0 tx=0x7f580402a000 comp rx=0 tx=0).stop 2024-09-12T02:23:35.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.917+0000 7f580fa45640 1 -- 172.21.15.60:0/2060614788 shutdown_connections 2024-09-12T02:23:35.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.917+0000 7f580fa45640 1 --2- 172.21.15.60:0/2060614788 >> v2:172.21.15.105:3300/0 conn(0x7f58080c8180 0x7f580815dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:35.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.917+0000 7f580fa45640 1 --2- 172.21.15.60:0/2060614788 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58080acc30 0x7f58080c3f70 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:35.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.917+0000 7f580fa45640 1 -- 172.21.15.60:0/2060614788 >> 172.21.15.60:0/2060614788 conn(0x7f58080c5660 msgr2=0x7f58080c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:35.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.917+0000 7f580fa45640 1 -- 172.21.15.60:0/2060614788 shutdown_connections 2024-09-12T02:23:35.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.917+0000 7f580fa45640 1 -- 172.21.15.60:0/2060614788 wait complete. 2024-09-12T02:23:35.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.918+0000 7f580fa45640 1 Processor -- start 2024-09-12T02:23:35.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.918+0000 7f580fa45640 1 -- start start 2024-09-12T02:23:35.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.919+0000 7f580fa45640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58080acc30 0x7f580809cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:35.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.919+0000 7f580fa45640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58080c44b0 0x7f580806be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:35.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.919+0000 7f580fa45640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58080c8180 0x7f5808152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:35.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.919+0000 7f580fa45640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f58080c5330 con 0x7f58080acc30 2024-09-12T02:23:35.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.919+0000 7f580fa45640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f58080702b0 con 0x7f58080c44b0 2024-09-12T02:23:35.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.919+0000 7f580fa45640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f58080c63f0 con 0x7f58080c8180 2024-09-12T02:23:35.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.919+0000 7f580d7e1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58080acc30 0x7f580809cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:35.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.919+0000 7f580d7e1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58080acc30 0x7f580809cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50254/0 (socket says 172.21.15.60:50254) 2024-09-12T02:23:35.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.919+0000 7f580d7e1640 1 -- 172.21.15.60:0/2733656832 learned_addr learned my addr 172.21.15.60:0/2733656832 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:35.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.919+0000 7f580dfe2640 1 --2- 172.21.15.60:0/2733656832 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58080c8180 0x7f5808152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:35.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.919+0000 7f580cfe0640 1 --2- 172.21.15.60:0/2733656832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58080c44b0 0x7f580806be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:35.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.919+0000 7f580d7e1640 1 -- 172.21.15.60:0/2733656832 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58080c8180 msgr2=0x7f5808152060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:35.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.919+0000 7f580d7e1640 1 --2- 172.21.15.60:0/2733656832 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58080c8180 0x7f5808152060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:35.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.919+0000 7f580d7e1640 1 -- 172.21.15.60:0/2733656832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58080c44b0 msgr2=0x7f580806be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:35.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.919+0000 7f580d7e1640 1 --2- 172.21.15.60:0/2733656832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58080c44b0 0x7f580806be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:35.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.919+0000 7f580d7e1640 1 -- 172.21.15.60:0/2733656832 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58081ed8b0 con 0x7f58080acc30 2024-09-12T02:23:35.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.919+0000 7f580d7e1640 1 --2- 172.21.15.60:0/2733656832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58080acc30 0x7f580809cf40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5804035040 tx=0x7f58040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:35.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.919+0000 7f57fdffb640 1 -- 172.21.15.60:0/2733656832 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5804041020 con 0x7f58080acc30 2024-09-12T02:23:35.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.919+0000 7f57fdffb640 1 -- 172.21.15.60:0/2733656832 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f580403d620 con 0x7f58080acc30 2024-09-12T02:23:35.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.919+0000 7f580fa45640 1 -- 172.21.15.60:0/2733656832 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58081edb90 con 0x7f58080acc30 2024-09-12T02:23:35.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.919+0000 7f57fdffb640 1 -- 172.21.15.60:0/2733656832 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5804037040 con 0x7f58080acc30 2024-09-12T02:23:35.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.920+0000 7f580fa45640 1 -- 172.21.15.60:0/2733656832 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58080c26d0 con 0x7f58080acc30 2024-09-12T02:23:35.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.921+0000 7f580fa45640 1 -- 172.21.15.60:0/2733656832 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58080c7fa0 con 0x7f58080acc30 2024-09-12T02:23:35.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.921+0000 7f57fdffb640 1 -- 172.21.15.60:0/2733656832 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5804044020 con 0x7f58080acc30 2024-09-12T02:23:35.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.922+0000 7f57fdffb640 1 --2- 172.21.15.60:0/2733656832 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f57ec06be30 0x7f57ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:35.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.922+0000 7f57fdffb640 1 -- 172.21.15.60:0/2733656832 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f58040ab650 con 0x7f58080acc30 2024-09-12T02:23:35.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.922+0000 7f580cfe0640 1 --2- 172.21.15.60:0/2733656832 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f57ec06be30 0x7f57ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:35.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.922+0000 7f580cfe0640 1 --2- 172.21.15.60:0/2733656832 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f57ec06be30 0x7f57ec06e2f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f57f8001eb0 tx=0x7f57f8001c40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:35.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:35.926+0000 7f57fdffb640 1 -- 172.21.15.60:0/2733656832 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f58080c7fa0 con 0x7f58080acc30 2024-09-12T02:23:36.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.101+0000 7f580fa45640 1 -- 172.21.15.60:0/2733656832 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f58080abc10 con 0x7f58080acc30 2024-09-12T02:23:36.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.102+0000 7f57fdffb640 1 -- 172.21.15.60:0/2733656832 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+20439 (secure 0 0 0) 0x7f580404b030 con 0x7f58080acc30 2024-09-12T02:23:36.103 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:23:36.103 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":26,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","created":"2024-09-12T02:22:39.869862+0000","modified":"2024-09-12T02:23:17.835334+0000","last_up_change":"2024-09-12T02:22:53.459371+0000","last_in_change":"2024-09-12T02:22:42.817076+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:22:52.130579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-09-12T02:23:01.854763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-09-12T02:23:03.104847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-09-12T02:23:14.175168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-09-12T02:23:15.166293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0f0c7386-002f-47e2-a7a3-6c8a70264cc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6819","nonce":1789465659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6821","nonce":1789465659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6825","nonce":1789465659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6823","nonce":1789465659}]},"public_addr":"172.21.15.60:6819/1789465659","cluster_addr":"172.21.15.60:6821/1789465659","heartbeat_back_addr":"172.21.15.60:6825/1789465659","heartbeat_front_addr":"172.21.15.60:6823/1789465659","state":["exists","up"]},{"osd":1,"uuid":"64be7b84-36fc-43c0-9e70-a617e5b68941","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6811","nonce":1109822408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6813","nonce":1109822408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6817","nonce":1109822408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6815","nonce":1109822408}]},"public_addr":"172.21.15.60:6811/1109822408","cluster_addr":"172.21.15.60:6813/1109822408","heartbeat_back_addr":"172.21.15.60:6817/1109822408","heartbeat_front_addr":"172.21.15.60:6815/1109822408","state":["exists","up"]},{"osd":2,"uuid":"df00caa1-d45e-4b87-ac1e-8bc098d509d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6827","nonce":278470077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6829","nonce":278470077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6833","nonce":278470077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6831","nonce":278470077}]},"public_addr":"172.21.15.60:6827/278470077","cluster_addr":"172.21.15.60:6829/278470077","heartbeat_back_addr":"172.21.15.60:6833/278470077","heartbeat_front_addr":"172.21.15.60:6831/278470077","state":["exists","up"]},{"osd":3,"uuid":"f6453471-893a-490b-b0c7-f196a0f574e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6803","nonce":3606424156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6805","nonce":3606424156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6809","nonce":3606424156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6807","nonce":3606424156}]},"public_addr":"172.21.15.60:6803/3606424156","cluster_addr":"172.21.15.60:6805/3606424156","heartbeat_back_addr":"172.21.15.60:6809/3606424156","heartbeat_front_addr":"172.21.15.60:6807/3606424156","state":["exists","up"]},{"osd":4,"uuid":"96e908b6-ce3e-466c-b02d-08fc71a1dba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6809","nonce":1581641129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6811","nonce":1581641129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6815","nonce":1581641129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6813","nonce":1581641129}]},"public_addr":"172.21.15.105:6809/1581641129","cluster_addr":"172.21.15.105:6811/1581641129","heartbeat_back_addr":"172.21.15.105:6815/1581641129","heartbeat_front_addr":"172.21.15.105:6813/1581641129","state":["exists","up"]},{"osd":5,"uuid":"7ebc26f0-a462-4364-9303-7351f7cba21f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6825","nonce":1392337793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6827","nonce":1392337793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6831","nonce":1392337793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6829","nonce":1392337793}]},"public_addr":"172.21.15.105:6825/1392337793","cluster_addr":"172.21.15.105:6827/1392337793","heartbeat_back_addr":"172.21.15.105:6831/1392337793","heartbeat_front_addr":"172.21.15.105:6829/1392337793","state":["exists","up"]},{"osd":6,"uuid":"49487ea1-9c6d-4090-bbcc-f28b33040eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6801","nonce":50951309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6803","nonce":50951309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6807","nonce":50951309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6805","nonce":50951309}]},"public_addr":"172.21.15.105:6801/50951309","cluster_addr":"172.21.15.105:6803/50951309","heartbeat_back_addr":"172.21.15.105:6807/50951309","heartbeat_front_addr":"172.21.15.105:6805/50951309","state":["exists","up"]},{"osd":7,"uuid":"1e3a0aa9-7e29-4785-8506-6b5d3be2be35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6817","nonce":3745331251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6819","nonce":3745331251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6823","nonce":3745331251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6821","nonce":3745331251}]},"public_addr":"172.21.15.105:6817/3745331251","cluster_addr":"172.21.15.105:6819/3745331251","heartbeat_back_addr":"172.21.15.105:6823/3745331251","heartbeat_front_addr":"172.21.15.105:6821/3745331251","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:50.112629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.307689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.542851+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.334773+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:50.096967+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:50.259633+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.888988+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.917421+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:23:36.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.104+0000 7f580fa45640 1 -- 172.21.15.60:0/2733656832 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f57ec06be30 msgr2=0x7f57ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:36.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.104+0000 7f580fa45640 1 --2- 172.21.15.60:0/2733656832 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f57ec06be30 0x7f57ec06e2f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f57f8001eb0 tx=0x7f57f8001c40 comp rx=0 tx=0).stop 2024-09-12T02:23:36.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.104+0000 7f580fa45640 1 -- 172.21.15.60:0/2733656832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58080acc30 msgr2=0x7f580809cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:36.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.104+0000 7f580fa45640 1 --2- 172.21.15.60:0/2733656832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58080acc30 0x7f580809cf40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5804035040 tx=0x7f58040046c0 comp rx=0 tx=0).stop 2024-09-12T02:23:36.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.104+0000 7f580fa45640 1 -- 172.21.15.60:0/2733656832 shutdown_connections 2024-09-12T02:23:36.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.104+0000 7f580fa45640 1 --2- 172.21.15.60:0/2733656832 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f57ec06be30 0x7f57ec06e2f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:36.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.104+0000 7f580fa45640 1 --2- 172.21.15.60:0/2733656832 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58080c8180 0x7f5808152060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:36.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.104+0000 7f580fa45640 1 --2- 172.21.15.60:0/2733656832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58080c44b0 0x7f580806be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:36.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.104+0000 7f580fa45640 1 --2- 172.21.15.60:0/2733656832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58080acc30 0x7f580809cf40 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:36.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.104+0000 7f580fa45640 1 -- 172.21.15.60:0/2733656832 >> 172.21.15.60:0/2733656832 conn(0x7f58080c5660 msgr2=0x7f58080aa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:36.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.104+0000 7f580fa45640 1 -- 172.21.15.60:0/2733656832 shutdown_connections 2024-09-12T02:23:36.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.104+0000 7f580fa45640 1 -- 172.21.15.60:0/2733656832 wait complete. 2024-09-12T02:23:36.116 INFO:tasks.mon_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T02:22:52.130579+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-09-12T02:23:01.854763+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-09-12T02:23:03.104847+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-09-12T02:23:14.175168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-09-12T02:23:15.166293+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T02:23:36.116 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T02:23:36.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.221+0000 7fd17ac37640 1 Processor -- start 2024-09-12T02:23:36.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.221+0000 7fd17ac37640 1 -- start start 2024-09-12T02:23:36.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.222+0000 7fd17ac37640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd174153f50 0x7fd174158cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:36.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.222+0000 7fd17ac37640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd174157c30 con 0x7fd174153b70 2024-09-12T02:23:36.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.222+0000 7fd17ac37640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd174157f10 con 0x7fd1740bf900 2024-09-12T02:23:36.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.222+0000 7fd17ac37640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fd1741581f0 con 0x7fd174153f50 2024-09-12T02:23:36.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.222+0000 7fd1789d3640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fd174153b70 0x7fd174157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:35380/0 (socket says 172.21.15.60:35380) 2024-09-12T02:23:36.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.222+0000 7fd1791d4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd174153f50 0x7fd174158cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:36.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.222+0000 7fd1789d3640 1 -- 172.21.15.60:0/2720705098 learned_addr learned my addr 172.21.15.60:0/2720705098 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:36.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.222+0000 7fd1791d4640 1 -- 172.21.15.60:0/2720705098 >> v1:172.21.15.105:6789/0 conn(0x7fd1740bf900 legacy=0x7fd1740ae740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:36.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.222+0000 7fd1791d4640 1 -- 172.21.15.60:0/2720705098 >> v1:172.21.15.60:6789/0 conn(0x7fd174153b70 legacy=0x7fd174157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:36.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.223+0000 7fd1737fe640 1 -- 172.21.15.60:0/2720705098 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2354681180 0 0) 0x7fd174157c30 con 0x7fd174153b70 2024-09-12T02:23:36.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.223+0000 7fd1791d4640 1 -- 172.21.15.60:0/2720705098 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1741584d0 con 0x7fd174153f50 2024-09-12T02:23:36.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.223+0000 7fd1791d4640 1 --2- 172.21.15.60:0/2720705098 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd174153f50 0x7fd174158cd0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd16c009d90 tx=0x7fd16c02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=378e04fa3b9a5c32 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:36.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.223+0000 7fd1737fe640 1 -- 172.21.15.60:0/2720705098 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd16c031600 con 0x7fd174153f50 2024-09-12T02:23:36.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.223+0000 7fd1737fe640 1 -- 172.21.15.60:0/2720705098 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd16c0317a0 con 0x7fd174153f50 2024-09-12T02:23:36.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.223+0000 7fd1737fe640 1 -- 172.21.15.60:0/2720705098 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd16c031b70 con 0x7fd174153f50 2024-09-12T02:23:36.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.224+0000 7fd17ac37640 1 -- 172.21.15.60:0/2720705098 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd174153f50 msgr2=0x7fd174158cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:36.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.224+0000 7fd17ac37640 1 --2- 172.21.15.60:0/2720705098 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd174153f50 0x7fd174158cd0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd16c009d90 tx=0x7fd16c02a5d0 comp rx=0 tx=0).stop 2024-09-12T02:23:36.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.224+0000 7fd17ac37640 1 -- 172.21.15.60:0/2720705098 shutdown_connections 2024-09-12T02:23:36.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.224+0000 7fd17ac37640 1 --2- 172.21.15.60:0/2720705098 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd174153f50 0x7fd174158cd0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:36.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.224+0000 7fd17ac37640 1 -- 172.21.15.60:0/2720705098 >> 172.21.15.60:0/2720705098 conn(0x7fd1740c6a30 msgr2=0x7fd1740c6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:36.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.224+0000 7fd17ac37640 1 -- 172.21.15.60:0/2720705098 shutdown_connections 2024-09-12T02:23:36.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.224+0000 7fd17ac37640 1 -- 172.21.15.60:0/2720705098 wait complete. 2024-09-12T02:23:36.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.225+0000 7fd17ac37640 1 Processor -- start 2024-09-12T02:23:36.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.225+0000 7fd17ac37640 1 -- start start 2024-09-12T02:23:36.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.226+0000 7fd17ac37640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1740bf900 0x7fd1740c7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:36.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.226+0000 7fd17ac37640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd174153b70 0x7fd174152910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:36.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.226+0000 7fd17ac37640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd174153f50 0x7fd174152e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:36.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.226+0000 7fd17ac37640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd174159390 con 0x7fd174153b70 2024-09-12T02:23:36.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.226+0000 7fd17ac37640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd174159210 con 0x7fd174153f50 2024-09-12T02:23:36.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.226+0000 7fd17ac37640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd174159510 con 0x7fd1740bf900 2024-09-12T02:23:36.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.226+0000 7fd173fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd174153b70 0x7fd174152910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:36.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.226+0000 7fd173fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd174153b70 0x7fd174152910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50282/0 (socket says 172.21.15.60:50282) 2024-09-12T02:23:36.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.226+0000 7fd173fff640 1 -- 172.21.15.60:0/2420465061 learned_addr learned my addr 172.21.15.60:0/2420465061 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:36.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.226+0000 7fd1789d3640 1 --2- 172.21.15.60:0/2420465061 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1740bf900 0x7fd1740c7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:36.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.226+0000 7fd1791d4640 1 --2- 172.21.15.60:0/2420465061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd174153f50 0x7fd174152e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:36.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.226+0000 7fd1789d3640 1 -- 172.21.15.60:0/2420465061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd174153f50 msgr2=0x7fd174152e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:36.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.226+0000 7fd1789d3640 1 --2- 172.21.15.60:0/2420465061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd174153f50 0x7fd174152e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:36.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.226+0000 7fd1789d3640 1 -- 172.21.15.60:0/2420465061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd174153b70 msgr2=0x7fd174152910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:36.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.226+0000 7fd1789d3640 1 --2- 172.21.15.60:0/2420465061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd174153b70 0x7fd174152910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:36.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.226+0000 7fd1789d3640 1 -- 172.21.15.60:0/2420465061 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1740ad1b0 con 0x7fd1740bf900 2024-09-12T02:23:36.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.226+0000 7fd173fff640 1 --2- 172.21.15.60:0/2420465061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd174153b70 0x7fd174152910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:23:36.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.227+0000 7fd1789d3640 1 --2- 172.21.15.60:0/2420465061 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1740bf900 0x7fd1740c7080 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd16400c3e0 tx=0x7fd16400c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:36.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.227+0000 7fd1717fa640 1 -- 172.21.15.60:0/2420465061 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1640074e0 con 0x7fd1740bf900 2024-09-12T02:23:36.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.227+0000 7fd1717fa640 1 -- 172.21.15.60:0/2420465061 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd164007680 con 0x7fd1740bf900 2024-09-12T02:23:36.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.227+0000 7fd1717fa640 1 -- 172.21.15.60:0/2420465061 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd164004a20 con 0x7fd1740bf900 2024-09-12T02:23:36.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.227+0000 7fd17ac37640 1 -- 172.21.15.60:0/2420465061 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1740aced0 con 0x7fd1740bf900 2024-09-12T02:23:36.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.227+0000 7fd17ac37640 1 -- 172.21.15.60:0/2420465061 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1741e2c00 con 0x7fd1740bf900 2024-09-12T02:23:36.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.228+0000 7fd17ac37640 1 -- 172.21.15.60:0/2420465061 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1741598d0 con 0x7fd1740bf900 2024-09-12T02:23:36.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.228+0000 7fd1717fa640 1 -- 172.21.15.60:0/2420465061 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd164011070 con 0x7fd1740bf900 2024-09-12T02:23:36.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.229+0000 7fd1717fa640 1 --2- 172.21.15.60:0/2420465061 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd16006be30 0x7fd16006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:36.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.229+0000 7fd1717fa640 1 -- 172.21.15.60:0/2420465061 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7fd16408ab90 con 0x7fd1740bf900 2024-09-12T02:23:36.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.229+0000 7fd173fff640 1 --2- 172.21.15.60:0/2420465061 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd16006be30 0x7fd16006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:36.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.229+0000 7fd173fff640 1 --2- 172.21.15.60:0/2420465061 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd16006be30 0x7fd16006e2f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd1740acae0 tx=0x7fd168009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:36.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.234+0000 7fd1717fa640 1 -- 172.21.15.60:0/2420465061 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd164058c50 con 0x7fd1740bf900 2024-09-12T02:23:36.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.407+0000 7fd17ac37640 1 -- 172.21.15.60:0/2420465061 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd1741569d0 con 0x7fd1740bf900 2024-09-12T02:23:36.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.408+0000 7fd1717fa640 1 -- 172.21.15.60:0/2420465061 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7fd16408a030 con 0x7fd1740bf900 2024-09-12T02:23:36.409 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2024-09-12T02:23:36.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.411+0000 7fd17ac37640 1 -- 172.21.15.60:0/2420465061 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd16006be30 msgr2=0x7fd16006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:36.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.411+0000 7fd17ac37640 1 --2- 172.21.15.60:0/2420465061 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd16006be30 0x7fd16006e2f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd1740acae0 tx=0x7fd168009040 comp rx=0 tx=0).stop 2024-09-12T02:23:36.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.411+0000 7fd17ac37640 1 -- 172.21.15.60:0/2420465061 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1740bf900 msgr2=0x7fd1740c7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:36.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.411+0000 7fd17ac37640 1 --2- 172.21.15.60:0/2420465061 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1740bf900 0x7fd1740c7080 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd16400c3e0 tx=0x7fd16400c8a0 comp rx=0 tx=0).stop 2024-09-12T02:23:36.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.411+0000 7fd17ac37640 1 -- 172.21.15.60:0/2420465061 shutdown_connections 2024-09-12T02:23:36.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.411+0000 7fd17ac37640 1 --2- 172.21.15.60:0/2420465061 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd16006be30 0x7fd16006e2f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:36.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.411+0000 7fd17ac37640 1 --2- 172.21.15.60:0/2420465061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd174153f50 0x7fd174152e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:36.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.411+0000 7fd17ac37640 1 --2- 172.21.15.60:0/2420465061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd174153b70 0x7fd174152910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:36.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.411+0000 7fd17ac37640 1 --2- 172.21.15.60:0/2420465061 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1740bf900 0x7fd1740c7080 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:36.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.411+0000 7fd17ac37640 1 -- 172.21.15.60:0/2420465061 >> 172.21.15.60:0/2420465061 conn(0x7fd1740c6a30 msgr2=0x7fd1740c3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:36.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.411+0000 7fd17ac37640 1 -- 172.21.15.60:0/2420465061 shutdown_connections 2024-09-12T02:23:36.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.411+0000 7fd17ac37640 1 -- 172.21.15.60:0/2420465061 wait complete. 2024-09-12T02:23:36.422 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-09-12T02:23:36.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.527+0000 7f2ca316d640 1 Processor -- start 2024-09-12T02:23:36.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.527+0000 7f2ca316d640 1 -- start start 2024-09-12T02:23:36.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.528+0000 7f2ca316d640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2c9c0c47d0 0x7f2c9c158090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:36.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.528+0000 7f2ca316d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2c9c0c4bb0 0x7f2c9c0c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:36.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.528+0000 7f2ca316d640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c9c0c3f20 con 0x7f2c9c0c3170 2024-09-12T02:23:36.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.528+0000 7f2ca316d640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f2c9c0c2440 con 0x7f2c9c0c4bb0 2024-09-12T02:23:36.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.528+0000 7f2ca316d640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f2c9c0ace70 con 0x7f2c9c0c47d0 2024-09-12T02:23:36.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.528+0000 7f2c9bfff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2c9c0c4bb0 0x7f2c9c0c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:36.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.528+0000 7f2c9bfff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2c9c0c4bb0 0x7f2c9c0c39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50286/0 (socket says 172.21.15.60:50286) 2024-09-12T02:23:36.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.528+0000 7f2ca170a640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f2c9c0c3170 0x7f2c9c1575c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:35386/0 (socket says 172.21.15.60:35386) 2024-09-12T02:23:36.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.528+0000 7f2c9bfff640 1 -- 172.21.15.60:0/2412076360 learned_addr learned my addr 172.21.15.60:0/2412076360 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:36.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.528+0000 7f2c9bfff640 1 -- 172.21.15.60:0/2412076360 >> v2:172.21.15.105:3300/0 conn(0x7f2c9c0c47d0 msgr2=0x7f2c9c158090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:36.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.528+0000 7f2ca0f09640 1 --2- 172.21.15.60:0/2412076360 >> v2:172.21.15.105:3300/0 conn(0x7f2c9c0c47d0 0x7f2c9c158090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:36.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.528+0000 7f2c9bfff640 1 --2- 172.21.15.60:0/2412076360 >> v2:172.21.15.105:3300/0 conn(0x7f2c9c0c47d0 0x7f2c9c158090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:36.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.528+0000 7f2c9b7fe640 1 -- 172.21.15.60:0/2412076360 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3402695092 0 0) 0x7f2c9c0c3f20 con 0x7f2c9c0c3170 2024-09-12T02:23:36.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.528+0000 7f2c9bfff640 1 -- 172.21.15.60:0/2412076360 >> v1:172.21.15.60:6789/0 conn(0x7f2c9c0c3170 legacy=0x7f2c9c1575c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:36.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.528+0000 7f2c9bfff640 1 -- 172.21.15.60:0/2412076360 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c9c0c2690 con 0x7f2c9c0c4bb0 2024-09-12T02:23:36.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.529+0000 7f2c9bfff640 1 --2- 172.21.15.60:0/2412076360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c9c0c4bb0 0x7f2c9c0c39e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c0c5010 tx=0x7f2c9002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=257a93a80efe504e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:36.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.529+0000 7f2c9b7fe640 1 -- 172.21.15.60:0/2412076360 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c90037070 con 0x7f2c9c0c4bb0 2024-09-12T02:23:36.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.529+0000 7f2c9b7fe640 1 -- 172.21.15.60:0/2412076360 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c90032440 con 0x7f2c9c0c4bb0 2024-09-12T02:23:36.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.529+0000 7f2c9b7fe640 1 -- 172.21.15.60:0/2412076360 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c90032810 con 0x7f2c9c0c4bb0 2024-09-12T02:23:36.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.530+0000 7f2ca316d640 1 -- 172.21.15.60:0/2412076360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c9c0c4bb0 msgr2=0x7f2c9c0c39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:36.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.530+0000 7f2ca316d640 1 --2- 172.21.15.60:0/2412076360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c9c0c4bb0 0x7f2c9c0c39e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c0c5010 tx=0x7f2c9002a1e0 comp rx=0 tx=0).stop 2024-09-12T02:23:36.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.530+0000 7f2ca316d640 1 -- 172.21.15.60:0/2412076360 shutdown_connections 2024-09-12T02:23:36.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.530+0000 7f2ca316d640 1 --2- 172.21.15.60:0/2412076360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c9c0c4bb0 0x7f2c9c0c39e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:36.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.530+0000 7f2ca316d640 1 --2- 172.21.15.60:0/2412076360 >> v2:172.21.15.105:3300/0 conn(0x7f2c9c0c47d0 0x7f2c9c158090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:36.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.530+0000 7f2ca316d640 1 -- 172.21.15.60:0/2412076360 >> 172.21.15.60:0/2412076360 conn(0x7f2c9c06c210 msgr2=0x7f2c9c0c7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:36.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.530+0000 7f2ca316d640 1 -- 172.21.15.60:0/2412076360 shutdown_connections 2024-09-12T02:23:36.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.530+0000 7f2ca316d640 1 -- 172.21.15.60:0/2412076360 wait complete. 2024-09-12T02:23:36.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.531+0000 7f2ca316d640 1 Processor -- start 2024-09-12T02:23:36.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.531+0000 7f2ca316d640 1 -- start start 2024-09-12T02:23:36.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.532+0000 7f2ca316d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c9c0c3170 0x7f2c9c0a84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:36.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.532+0000 7f2ca316d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c9c0c47d0 0x7f2c9c1ec180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:36.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.532+0000 7f2ca316d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c9c0c4bb0 0x7f2c9c1ec6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:36.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.532+0000 7f2ca316d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9c0a7340 con 0x7f2c9c0c47d0 2024-09-12T02:23:36.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.532+0000 7f2ca316d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9c0c2c50 con 0x7f2c9c0c4bb0 2024-09-12T02:23:36.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.532+0000 7f2ca316d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2c9c0a74c0 con 0x7f2c9c0c3170 2024-09-12T02:23:36.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.532+0000 7f2c9bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c9c0c47d0 0x7f2c9c1ec180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:36.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.532+0000 7f2c9bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c9c0c47d0 0x7f2c9c1ec180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50294/0 (socket says 172.21.15.60:50294) 2024-09-12T02:23:36.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.532+0000 7f2c9bfff640 1 -- 172.21.15.60:0/1766827419 learned_addr learned my addr 172.21.15.60:0/1766827419 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:36.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.532+0000 7f2ca0f09640 1 --2- 172.21.15.60:0/1766827419 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c9c0c3170 0x7f2c9c0a84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:36.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.532+0000 7f2ca170a640 1 --2- 172.21.15.60:0/1766827419 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c9c0c4bb0 0x7f2c9c1ec6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:36.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.532+0000 7f2c9bfff640 1 -- 172.21.15.60:0/1766827419 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c9c0c3170 msgr2=0x7f2c9c0a84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:36.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.532+0000 7f2c9bfff640 1 --2- 172.21.15.60:0/1766827419 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c9c0c3170 0x7f2c9c0a84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:36.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.532+0000 7f2c9bfff640 1 -- 172.21.15.60:0/1766827419 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c9c0c4bb0 msgr2=0x7f2c9c1ec6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:36.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.532+0000 7f2c9bfff640 1 --2- 172.21.15.60:0/1766827419 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c9c0c4bb0 0x7f2c9c1ec6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:36.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.532+0000 7f2c9bfff640 1 -- 172.21.15.60:0/1766827419 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c9c070ad0 con 0x7f2c9c0c47d0 2024-09-12T02:23:36.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.532+0000 7f2ca0f09640 1 --2- 172.21.15.60:0/1766827419 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c9c0c3170 0x7f2c9c0a84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:23:36.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.532+0000 7f2c9bfff640 1 --2- 172.21.15.60:0/1766827419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c9c0c47d0 0x7f2c9c1ec180 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2c90000c00 tx=0x7f2c900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:36.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.533+0000 7f2c997fa640 1 -- 172.21.15.60:0/1766827419 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c90037040 con 0x7f2c9c0c47d0 2024-09-12T02:23:36.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.533+0000 7f2c997fa640 1 -- 172.21.15.60:0/1766827419 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c90004230 con 0x7f2c9c0c47d0 2024-09-12T02:23:36.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.533+0000 7f2ca316d640 1 -- 172.21.15.60:0/1766827419 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c9c1eda70 con 0x7f2c9c0c47d0 2024-09-12T02:23:36.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.533+0000 7f2c997fa640 1 -- 172.21.15.60:0/1766827419 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c90003610 con 0x7f2c9c0c47d0 2024-09-12T02:23:36.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.533+0000 7f2ca316d640 1 -- 172.21.15.60:0/1766827419 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c9c1ecc00 con 0x7f2c9c0c47d0 2024-09-12T02:23:36.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.534+0000 7f2ca316d640 1 -- 172.21.15.60:0/1766827419 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c9c0aca90 con 0x7f2c9c0c47d0 2024-09-12T02:23:36.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.534+0000 7f2c997fa640 1 -- 172.21.15.60:0/1766827419 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2c900037b0 con 0x7f2c9c0c47d0 2024-09-12T02:23:36.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.535+0000 7f2c997fa640 1 --2- 172.21.15.60:0/1766827419 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2c8806be30 0x7f2c8806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:36.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.535+0000 7f2c997fa640 1 -- 172.21.15.60:0/1766827419 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f2c900ac090 con 0x7f2c9c0c47d0 2024-09-12T02:23:36.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.535+0000 7f2ca0f09640 1 --2- 172.21.15.60:0/1766827419 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2c8806be30 0x7f2c8806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:36.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.535+0000 7f2ca0f09640 1 --2- 172.21.15.60:0/1766827419 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2c8806be30 0x7f2c8806e2f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c00a9d0 tx=0x7f2c8c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:36.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.539+0000 7f2c997fa640 1 -- 172.21.15.60:0/1766827419 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2c9007a7a0 con 0x7f2c9c0c47d0 2024-09-12T02:23:36.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.715+0000 7f2ca316d640 1 -- 172.21.15.60:0/1766827419 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) -- 0x7f2c9c156370 con 0x7f2c9c0c47d0 2024-09-12T02:23:36.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.716+0000 7f2c997fa640 1 -- 172.21.15.60:0/1766827419 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v26) ==== 99+0+11 (secure 0 0 0) 0x7f2c9007a0a0 con 0x7f2c9c0c47d0 2024-09-12T02:23:36.716 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2024-09-12T02:23:36.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.718+0000 7f2ca316d640 1 -- 172.21.15.60:0/1766827419 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2c8806be30 msgr2=0x7f2c8806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:36.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.718+0000 7f2ca316d640 1 --2- 172.21.15.60:0/1766827419 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2c8806be30 0x7f2c8806e2f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c00a9d0 tx=0x7f2c8c008040 comp rx=0 tx=0).stop 2024-09-12T02:23:36.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.718+0000 7f2ca316d640 1 -- 172.21.15.60:0/1766827419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c9c0c47d0 msgr2=0x7f2c9c1ec180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:36.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.718+0000 7f2ca316d640 1 --2- 172.21.15.60:0/1766827419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c9c0c47d0 0x7f2c9c1ec180 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2c90000c00 tx=0x7f2c900046c0 comp rx=0 tx=0).stop 2024-09-12T02:23:36.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.718+0000 7f2ca316d640 1 -- 172.21.15.60:0/1766827419 shutdown_connections 2024-09-12T02:23:36.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.718+0000 7f2ca316d640 1 --2- 172.21.15.60:0/1766827419 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2c8806be30 0x7f2c8806e2f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:36.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.718+0000 7f2ca316d640 1 --2- 172.21.15.60:0/1766827419 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c9c0c4bb0 0x7f2c9c1ec6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:36.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.718+0000 7f2ca316d640 1 --2- 172.21.15.60:0/1766827419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c9c0c47d0 0x7f2c9c1ec180 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:36.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.718+0000 7f2ca316d640 1 --2- 172.21.15.60:0/1766827419 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c9c0c3170 0x7f2c9c0a84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:36.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.718+0000 7f2ca316d640 1 -- 172.21.15.60:0/1766827419 >> 172.21.15.60:0/1766827419 conn(0x7f2c9c06c210 msgr2=0x7f2c9c0c39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:36.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.718+0000 7f2ca316d640 1 -- 172.21.15.60:0/1766827419 shutdown_connections 2024-09-12T02:23:36.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.718+0000 7f2ca316d640 1 -- 172.21.15.60:0/1766827419 wait complete. 2024-09-12T02:23:36.730 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-09-12T02:23:36.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.837+0000 7f940a5e4640 1 Processor -- start 2024-09-12T02:23:36.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.837+0000 7f940a5e4640 1 -- start start 2024-09-12T02:23:36.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.838+0000 7f940a5e4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9404153a40 0x7f940406c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:36.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.838+0000 7f940a5e4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9404156310 0x7f94041567a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:36.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.838+0000 7f940a5e4640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9404159900 con 0x7f940406cbe0 2024-09-12T02:23:36.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.838+0000 7f940a5e4640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f9404159be0 con 0x7f9404153a40 2024-09-12T02:23:36.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.838+0000 7f940a5e4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9404159ec0 con 0x7f9404156310 2024-09-12T02:23:36.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.838+0000 7f9403fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9404153a40 0x7f940406c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:36.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.838+0000 7f9403fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9404153a40 0x7f940406c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50296/0 (socket says 172.21.15.60:50296) 2024-09-12T02:23:36.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.838+0000 7f9403fff640 1 -- 172.21.15.60:0/2490704566 learned_addr learned my addr 172.21.15.60:0/2490704566 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:36.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.838+0000 7f9408b81640 1 --2- 172.21.15.60:0/2490704566 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9404156310 0x7f94041567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:36.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.838+0000 7f9403fff640 1 -- 172.21.15.60:0/2490704566 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9404156310 msgr2=0x7f94041567a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:36.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.838+0000 7f9403fff640 1 --2- 172.21.15.60:0/2490704566 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9404156310 0x7f94041567a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:36.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.838+0000 7f9403fff640 1 -- 172.21.15.60:0/2490704566 >> v1:172.21.15.105:6789/0 conn(0x7f940406cbe0 legacy=0x7f94040c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:36.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.838+0000 7f9403fff640 1 -- 172.21.15.60:0/2490704566 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f940415a1a0 con 0x7f9404153a40 2024-09-12T02:23:36.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.839+0000 7f9403fff640 1 --2- 172.21.15.60:0/2490704566 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9404153a40 0x7f940406c6a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f93f4009870 tx=0x7f93f402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=778ef019343036c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:36.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.839+0000 7f9402ffd640 1 -- 172.21.15.60:0/2490704566 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f4037070 con 0x7f9404153a40 2024-09-12T02:23:36.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.839+0000 7f9402ffd640 1 -- 172.21.15.60:0/2490704566 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93f4032440 con 0x7f9404153a40 2024-09-12T02:23:36.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.839+0000 7f9402ffd640 1 -- 172.21.15.60:0/2490704566 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f4032810 con 0x7f9404153a40 2024-09-12T02:23:36.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.840+0000 7f940a5e4640 1 -- 172.21.15.60:0/2490704566 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9404153a40 msgr2=0x7f940406c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:36.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.840+0000 7f940a5e4640 1 --2- 172.21.15.60:0/2490704566 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9404153a40 0x7f940406c6a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f93f4009870 tx=0x7f93f402a270 comp rx=0 tx=0).stop 2024-09-12T02:23:36.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.840+0000 7f940a5e4640 1 -- 172.21.15.60:0/2490704566 shutdown_connections 2024-09-12T02:23:36.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.840+0000 7f940a5e4640 1 --2- 172.21.15.60:0/2490704566 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9404156310 0x7f94041567a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:36.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.840+0000 7f940a5e4640 1 --2- 172.21.15.60:0/2490704566 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9404153a40 0x7f940406c6a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:36.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.840+0000 7f940a5e4640 1 -- 172.21.15.60:0/2490704566 >> 172.21.15.60:0/2490704566 conn(0x7f9404073310 msgr2=0x7f94040736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:36.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.840+0000 7f940a5e4640 1 -- 172.21.15.60:0/2490704566 shutdown_connections 2024-09-12T02:23:36.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.840+0000 7f940a5e4640 1 -- 172.21.15.60:0/2490704566 wait complete. 2024-09-12T02:23:36.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.841+0000 7f940a5e4640 1 Processor -- start 2024-09-12T02:23:36.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.841+0000 7f940a5e4640 1 -- start start 2024-09-12T02:23:36.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.842+0000 7f940a5e4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f940406cbe0 0x7f94041ec930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:36.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.842+0000 7f940a5e4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9404153a40 0x7f9404152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:36.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.842+0000 7f940a5e4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9404156310 0x7f94041589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:36.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.842+0000 7f940a5e4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9404153e20 con 0x7f940406cbe0 2024-09-12T02:23:36.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.842+0000 7f940a5e4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f94040c9270 con 0x7f9404153a40 2024-09-12T02:23:36.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.842+0000 7f940a5e4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9404153fa0 con 0x7f9404156310 2024-09-12T02:23:36.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.842+0000 7f9403fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f940406cbe0 0x7f94041ec930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:36.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.842+0000 7f9403fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f940406cbe0 0x7f94041ec930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50298/0 (socket says 172.21.15.60:50298) 2024-09-12T02:23:36.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.842+0000 7f9403fff640 1 -- 172.21.15.60:0/3904671676 learned_addr learned my addr 172.21.15.60:0/3904671676 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:36.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.842+0000 7f9408b81640 1 --2- 172.21.15.60:0/3904671676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9404156310 0x7f94041589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:36.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.842+0000 7f94037fe640 1 --2- 172.21.15.60:0/3904671676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9404153a40 0x7f9404152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:36.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.842+0000 7f9403fff640 1 -- 172.21.15.60:0/3904671676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9404156310 msgr2=0x7f94041589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:36.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.842+0000 7f9403fff640 1 --2- 172.21.15.60:0/3904671676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9404156310 0x7f94041589c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:36.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.842+0000 7f9403fff640 1 -- 172.21.15.60:0/3904671676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9404153a40 msgr2=0x7f9404152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:36.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.842+0000 7f9403fff640 1 --2- 172.21.15.60:0/3904671676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9404153a40 0x7f9404152860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:36.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.842+0000 7f9403fff640 1 -- 172.21.15.60:0/3904671676 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94041ebec0 con 0x7f940406cbe0 2024-09-12T02:23:36.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.842+0000 7f9403fff640 1 --2- 172.21.15.60:0/3904671676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f940406cbe0 0x7f94041ec930 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f93f4000c00 tx=0x7f93f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:36.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.842+0000 7f9400ff9640 1 -- 172.21.15.60:0/3904671676 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f4037040 con 0x7f940406cbe0 2024-09-12T02:23:36.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.843+0000 7f9400ff9640 1 -- 172.21.15.60:0/3904671676 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93f4042070 con 0x7f940406cbe0 2024-09-12T02:23:36.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.843+0000 7f940a5e4640 1 -- 172.21.15.60:0/3904671676 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9404159480 con 0x7f940406cbe0 2024-09-12T02:23:36.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.843+0000 7f9400ff9640 1 -- 172.21.15.60:0/3904671676 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f4030880 con 0x7f940406cbe0 2024-09-12T02:23:36.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.843+0000 7f940a5e4640 1 -- 172.21.15.60:0/3904671676 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94041ec130 con 0x7f940406cbe0 2024-09-12T02:23:36.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.844+0000 7f940a5e4640 1 -- 172.21.15.60:0/3904671676 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f940406c6a0 con 0x7f940406cbe0 2024-09-12T02:23:36.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.844+0000 7f9400ff9640 1 -- 172.21.15.60:0/3904671676 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f93f4030a20 con 0x7f940406cbe0 2024-09-12T02:23:36.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.845+0000 7f9400ff9640 1 --2- 172.21.15.60:0/3904671676 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f93f006be30 0x7f93f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:36.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.845+0000 7f9400ff9640 1 -- 172.21.15.60:0/3904671676 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f93f40ab9c0 con 0x7f940406cbe0 2024-09-12T02:23:36.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.845+0000 7f94037fe640 1 --2- 172.21.15.60:0/3904671676 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f93f006be30 0x7f93f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:36.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.845+0000 7f94037fe640 1 --2- 172.21.15.60:0/3904671676 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f93f006be30 0x7f93f006e2f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f940414de40 tx=0x7f93f8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:36.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:36.849+0000 7f9400ff9640 1 -- 172.21.15.60:0/3904671676 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f93f40ade20 con 0x7f940406cbe0 2024-09-12T02:23:37.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.028+0000 7f940a5e4640 1 -- 172.21.15.60:0/3904671676 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) -- 0x7f94040c9c60 con 0x7f940406cbe0 2024-09-12T02:23:37.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.029+0000 7f9400ff9640 1 -- 172.21.15.60:0/3904671676 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v26) ==== 95+0+11 (secure 0 0 0) 0x7f93f4045360 con 0x7f940406cbe0 2024-09-12T02:23:37.029 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2024-09-12T02:23:37.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.031+0000 7f940a5e4640 1 -- 172.21.15.60:0/3904671676 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f93f006be30 msgr2=0x7f93f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:37.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.031+0000 7f940a5e4640 1 --2- 172.21.15.60:0/3904671676 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f93f006be30 0x7f93f006e2f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f940414de40 tx=0x7f93f8009040 comp rx=0 tx=0).stop 2024-09-12T02:23:37.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.031+0000 7f940a5e4640 1 -- 172.21.15.60:0/3904671676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f940406cbe0 msgr2=0x7f94041ec930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:37.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.031+0000 7f940a5e4640 1 --2- 172.21.15.60:0/3904671676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f940406cbe0 0x7f94041ec930 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f93f4000c00 tx=0x7f93f40046c0 comp rx=0 tx=0).stop 2024-09-12T02:23:37.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.031+0000 7f940a5e4640 1 -- 172.21.15.60:0/3904671676 shutdown_connections 2024-09-12T02:23:37.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.031+0000 7f940a5e4640 1 --2- 172.21.15.60:0/3904671676 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f93f006be30 0x7f93f006e2f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:37.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.031+0000 7f940a5e4640 1 --2- 172.21.15.60:0/3904671676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9404156310 0x7f94041589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:37.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.031+0000 7f940a5e4640 1 --2- 172.21.15.60:0/3904671676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9404153a40 0x7f9404152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:37.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.031+0000 7f940a5e4640 1 --2- 172.21.15.60:0/3904671676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f940406cbe0 0x7f94041ec930 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:37.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.031+0000 7f940a5e4640 1 -- 172.21.15.60:0/3904671676 >> 172.21.15.60:0/3904671676 conn(0x7f9404073310 msgr2=0x7f94041545c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:37.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.031+0000 7f940a5e4640 1 -- 172.21.15.60:0/3904671676 shutdown_connections 2024-09-12T02:23:37.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.031+0000 7f940a5e4640 1 -- 172.21.15.60:0/3904671676 wait complete. 2024-09-12T02:23:37.042 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-09-12T02:23:37.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.148+0000 7f0f84c53640 1 Processor -- start 2024-09-12T02:23:37.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.148+0000 7f0f84c53640 1 -- start start 2024-09-12T02:23:37.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.149+0000 7f0f84c53640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f800a8200 0x7f0f800701e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:37.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.149+0000 7f0f84c53640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0f800c3b20 0x7f0f800c3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:37.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.149+0000 7f0f84c53640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f801535d0 con 0x7f0f80152fa0 2024-09-12T02:23:37.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.149+0000 7f0f84c53640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f0f800c5450 con 0x7f0f800c3b20 2024-09-12T02:23:37.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.149+0000 7f0f84c53640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0f800c3690 con 0x7f0f800a8200 2024-09-12T02:23:37.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.149+0000 7f0f7dd9b640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f0f80152fa0 0x7f0f800c7a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:35402/0 (socket says 172.21.15.60:35402) 2024-09-12T02:23:37.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.149+0000 7f0f7dd9b640 1 -- 172.21.15.60:0/1956912696 learned_addr learned my addr 172.21.15.60:0/1956912696 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:37.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.150+0000 7f0f7e59c640 1 --2- 172.21.15.60:0/1956912696 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f800a8200 0x7f0f800701e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:37.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.150+0000 7f0f7ed9d640 1 --2- 172.21.15.60:0/1956912696 >> v2:172.21.15.105:3300/0 conn(0x7f0f800c3b20 0x7f0f800c3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:37.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.150+0000 7f0f7d59a640 1 -- 172.21.15.60:0/1956912696 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2853749047 0 0) 0x7f0f801535d0 con 0x7f0f80152fa0 2024-09-12T02:23:37.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.150+0000 7f0f7d59a640 1 -- 172.21.15.60:0/1956912696 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f6c003520 con 0x7f0f80152fa0 2024-09-12T02:23:37.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.150+0000 7f0f7e59c640 1 -- 172.21.15.60:0/1956912696 >> v2:172.21.15.105:3300/0 conn(0x7f0f800c3b20 msgr2=0x7f0f800c3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:37.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.150+0000 7f0f7e59c640 1 --2- 172.21.15.60:0/1956912696 >> v2:172.21.15.105:3300/0 conn(0x7f0f800c3b20 0x7f0f800c3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:37.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.150+0000 7f0f7e59c640 1 -- 172.21.15.60:0/1956912696 >> v1:172.21.15.60:6789/0 conn(0x7f0f80152fa0 legacy=0x7f0f800c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:37.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.150+0000 7f0f7e59c640 1 -- 172.21.15.60:0/1956912696 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f801538b0 con 0x7f0f800a8200 2024-09-12T02:23:37.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.150+0000 7f0f7ed9d640 1 --2- 172.21.15.60:0/1956912696 >> v2:172.21.15.105:3300/0 conn(0x7f0f800c3b20 0x7f0f800c3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:23:37.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.151+0000 7f0f7e59c640 1 --2- 172.21.15.60:0/1956912696 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f800a8200 0x7f0f800701e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0f780097a0 tx=0x7f0f7802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=520ad4adc1f7df0d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:37.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.151+0000 7f0f7d59a640 1 -- 172.21.15.60:0/1956912696 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f78037070 con 0x7f0f800a8200 2024-09-12T02:23:37.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.151+0000 7f0f7d59a640 1 -- 172.21.15.60:0/1956912696 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f78032440 con 0x7f0f800a8200 2024-09-12T02:23:37.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.151+0000 7f0f7d59a640 1 -- 172.21.15.60:0/1956912696 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f780327f0 con 0x7f0f800a8200 2024-09-12T02:23:37.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.151+0000 7f0f84c53640 1 -- 172.21.15.60:0/1956912696 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f800a8200 msgr2=0x7f0f800701e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:37.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.151+0000 7f0f84c53640 1 --2- 172.21.15.60:0/1956912696 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f800a8200 0x7f0f800701e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0f780097a0 tx=0x7f0f7802a180 comp rx=0 tx=0).stop 2024-09-12T02:23:37.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.152+0000 7f0f84c53640 1 -- 172.21.15.60:0/1956912696 shutdown_connections 2024-09-12T02:23:37.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.152+0000 7f0f84c53640 1 --2- 172.21.15.60:0/1956912696 >> v2:172.21.15.105:3300/0 conn(0x7f0f800c3b20 0x7f0f800c3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:37.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.152+0000 7f0f84c53640 1 --2- 172.21.15.60:0/1956912696 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f800a8200 0x7f0f800701e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:37.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.152+0000 7f0f84c53640 1 -- 172.21.15.60:0/1956912696 >> 172.21.15.60:0/1956912696 conn(0x7f0f800c5660 msgr2=0x7f0f800c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:37.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.152+0000 7f0f84c53640 1 -- 172.21.15.60:0/1956912696 shutdown_connections 2024-09-12T02:23:37.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.152+0000 7f0f84c53640 1 -- 172.21.15.60:0/1956912696 wait complete. 2024-09-12T02:23:37.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.153+0000 7f0f84c53640 1 Processor -- start 2024-09-12T02:23:37.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.153+0000 7f0f84c53640 1 -- start start 2024-09-12T02:23:37.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.154+0000 7f0f84c53640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f800a8200 0x7f0f801dc790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:37.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.154+0000 7f0f84c53640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f800c3b20 0x7f0f80154da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:37.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.154+0000 7f0f84c53640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f80152fa0 0x7f0f801552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:37.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.154+0000 7f0f84c53640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0f800c4510 con 0x7f0f80152fa0 2024-09-12T02:23:37.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.154+0000 7f0f84c53640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0f80153e70 con 0x7f0f800c3b20 2024-09-12T02:23:37.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.154+0000 7f0f84c53640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0f800a85e0 con 0x7f0f800a8200 2024-09-12T02:23:37.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.154+0000 7f0f7ed9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f80152fa0 0x7f0f801552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:37.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.154+0000 7f0f7ed9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f80152fa0 0x7f0f801552e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50304/0 (socket says 172.21.15.60:50304) 2024-09-12T02:23:37.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.154+0000 7f0f7ed9d640 1 -- 172.21.15.60:0/1936633289 learned_addr learned my addr 172.21.15.60:0/1936633289 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:37.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.154+0000 7f0f7e59c640 1 --2- 172.21.15.60:0/1936633289 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f800a8200 0x7f0f801dc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:37.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.154+0000 7f0f7dd9b640 1 --2- 172.21.15.60:0/1936633289 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f800c3b20 0x7f0f80154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:37.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.154+0000 7f0f7ed9d640 1 -- 172.21.15.60:0/1936633289 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f800a8200 msgr2=0x7f0f801dc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:37.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.154+0000 7f0f7ed9d640 1 --2- 172.21.15.60:0/1936633289 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f800a8200 0x7f0f801dc790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:37.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.154+0000 7f0f7ed9d640 1 -- 172.21.15.60:0/1936633289 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f800c3b20 msgr2=0x7f0f80154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:37.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.154+0000 7f0f7ed9d640 1 --2- 172.21.15.60:0/1936633289 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f800c3b20 0x7f0f80154da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:37.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.154+0000 7f0f7ed9d640 1 -- 172.21.15.60:0/1936633289 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f80073500 con 0x7f0f80152fa0 2024-09-12T02:23:37.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.154+0000 7f0f7ed9d640 1 --2- 172.21.15.60:0/1936633289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f80152fa0 0x7f0f801552e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0f7000efc0 tx=0x7f0f70009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:37.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.154+0000 7f0f76ffd640 1 -- 172.21.15.60:0/1936633289 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f70018030 con 0x7f0f80152fa0 2024-09-12T02:23:37.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.154+0000 7f0f76ffd640 1 -- 172.21.15.60:0/1936633289 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f7000cde0 con 0x7f0f80152fa0 2024-09-12T02:23:37.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.154+0000 7f0f84c53640 1 -- 172.21.15.60:0/1936633289 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f8014b080 con 0x7f0f80152fa0 2024-09-12T02:23:37.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.154+0000 7f0f76ffd640 1 -- 172.21.15.60:0/1936633289 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f70003bb0 con 0x7f0f80152fa0 2024-09-12T02:23:37.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.155+0000 7f0f84c53640 1 -- 172.21.15.60:0/1936633289 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f80072a20 con 0x7f0f80152fa0 2024-09-12T02:23:37.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.156+0000 7f0f84c53640 1 -- 172.21.15.60:0/1936633289 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f800ad760 con 0x7f0f80152fa0 2024-09-12T02:23:37.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.156+0000 7f0f76ffd640 1 -- 172.21.15.60:0/1936633289 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0f70005d10 con 0x7f0f80152fa0 2024-09-12T02:23:37.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.156+0000 7f0f76ffd640 1 --2- 172.21.15.60:0/1936633289 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0f6006be30 0x7f0f6006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:37.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.157+0000 7f0f76ffd640 1 -- 172.21.15.60:0/1936633289 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f0f7008bda0 con 0x7f0f80152fa0 2024-09-12T02:23:37.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.157+0000 7f0f7e59c640 1 --2- 172.21.15.60:0/1936633289 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0f6006be30 0x7f0f6006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:37.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.157+0000 7f0f7e59c640 1 --2- 172.21.15.60:0/1936633289 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0f6006be30 0x7f0f6006e2f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0f78034000 tx=0x7f0f7802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:37.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.161+0000 7f0f76ffd640 1 -- 172.21.15.60:0/1936633289 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0f70022070 con 0x7f0f80152fa0 2024-09-12T02:23:37.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.335+0000 7f0f84c53640 1 -- 172.21.15.60:0/1936633289 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) -- 0x7f0f800c7990 con 0x7f0f80152fa0 2024-09-12T02:23:37.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.335+0000 7f0f76ffd640 1 -- 172.21.15.60:0/1936633289 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v26) ==== 99+0+11 (secure 0 0 0) 0x7f0f70010040 con 0x7f0f80152fa0 2024-09-12T02:23:37.336 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2024-09-12T02:23:37.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.337+0000 7f0f84c53640 1 -- 172.21.15.60:0/1936633289 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0f6006be30 msgr2=0x7f0f6006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:37.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.337+0000 7f0f84c53640 1 --2- 172.21.15.60:0/1936633289 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0f6006be30 0x7f0f6006e2f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0f78034000 tx=0x7f0f7802e000 comp rx=0 tx=0).stop 2024-09-12T02:23:37.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.337+0000 7f0f84c53640 1 -- 172.21.15.60:0/1936633289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f80152fa0 msgr2=0x7f0f801552e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:37.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.337+0000 7f0f84c53640 1 --2- 172.21.15.60:0/1936633289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f80152fa0 0x7f0f801552e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0f7000efc0 tx=0x7f0f70009f90 comp rx=0 tx=0).stop 2024-09-12T02:23:37.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.337+0000 7f0f84c53640 1 -- 172.21.15.60:0/1936633289 shutdown_connections 2024-09-12T02:23:37.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.337+0000 7f0f84c53640 1 --2- 172.21.15.60:0/1936633289 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0f6006be30 0x7f0f6006e2f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:37.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.337+0000 7f0f84c53640 1 --2- 172.21.15.60:0/1936633289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f80152fa0 0x7f0f801552e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:37.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.337+0000 7f0f84c53640 1 --2- 172.21.15.60:0/1936633289 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f800c3b20 0x7f0f80154da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:37.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.337+0000 7f0f84c53640 1 --2- 172.21.15.60:0/1936633289 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f800a8200 0x7f0f801dc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:37.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.337+0000 7f0f84c53640 1 -- 172.21.15.60:0/1936633289 >> 172.21.15.60:0/1936633289 conn(0x7f0f800c5660 msgr2=0x7f0f80150e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:37.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.338+0000 7f0f84c53640 1 -- 172.21.15.60:0/1936633289 shutdown_connections 2024-09-12T02:23:37.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.338+0000 7f0f84c53640 1 -- 172.21.15.60:0/1936633289 wait complete. 2024-09-12T02:23:37.349 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-09-12T02:23:37.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.453+0000 7ff2679d6640 1 Processor -- start 2024-09-12T02:23:37.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.453+0000 7ff2679d6640 1 -- start start 2024-09-12T02:23:37.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.454+0000 7ff2679d6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff260159b30 0x7ff260159f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:37.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.454+0000 7ff2679d6640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff260067a50 0x7ff260067f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:37.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.454+0000 7ff2679d6640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff26006cbc0 con 0x7ff2600c9c60 2024-09-12T02:23:37.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.454+0000 7ff2679d6640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff2600c66e0 con 0x7ff260067a50 2024-09-12T02:23:37.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.454+0000 7ff2679d6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff26006cea0 con 0x7ff260159b30 2024-09-12T02:23:37.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.454+0000 7ff264f71640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff2600c9c60 0x7ff26014feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:35416/0 (socket says 172.21.15.60:35416) 2024-09-12T02:23:37.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.454+0000 7ff264f71640 1 -- 172.21.15.60:0/1305213142 learned_addr learned my addr 172.21.15.60:0/1305213142 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:37.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.455+0000 7ff265772640 1 --2- 172.21.15.60:0/1305213142 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff260159b30 0x7ff260159f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:37.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.455+0000 7ff265f73640 1 --2- 172.21.15.60:0/1305213142 >> v2:172.21.15.105:3300/0 conn(0x7ff260067a50 0x7ff260067f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:37.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.455+0000 7ff25ffff640 1 -- 172.21.15.60:0/1305213142 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1866513261 0 0) 0x7ff26006cbc0 con 0x7ff2600c9c60 2024-09-12T02:23:37.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.455+0000 7ff25ffff640 1 -- 172.21.15.60:0/1305213142 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff248003520 con 0x7ff2600c9c60 2024-09-12T02:23:37.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.455+0000 7ff25ffff640 1 -- 172.21.15.60:0/1305213142 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 440953930 0 0) 0x7ff248003520 con 0x7ff2600c9c60 2024-09-12T02:23:37.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.455+0000 7ff265772640 1 -- 172.21.15.60:0/1305213142 >> v2:172.21.15.105:3300/0 conn(0x7ff260067a50 msgr2=0x7ff260067f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:37.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.455+0000 7ff265772640 1 --2- 172.21.15.60:0/1305213142 >> v2:172.21.15.105:3300/0 conn(0x7ff260067a50 0x7ff260067f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:37.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.455+0000 7ff265772640 1 -- 172.21.15.60:0/1305213142 >> v1:172.21.15.60:6789/0 conn(0x7ff2600c9c60 legacy=0x7ff26014feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:37.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.455+0000 7ff265772640 1 -- 172.21.15.60:0/1305213142 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2600c6930 con 0x7ff260159b30 2024-09-12T02:23:37.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.456+0000 7ff265772640 1 --2- 172.21.15.60:0/1305213142 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff260159b30 0x7ff260159f10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff2580097a0 tx=0x7ff25802a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ce79c51bff2398a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:37.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.456+0000 7ff25ffff640 1 -- 172.21.15.60:0/1305213142 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff258037070 con 0x7ff260159b30 2024-09-12T02:23:37.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.456+0000 7ff25ffff640 1 -- 172.21.15.60:0/1305213142 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff25802aa90 con 0x7ff260159b30 2024-09-12T02:23:37.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.456+0000 7ff25ffff640 1 -- 172.21.15.60:0/1305213142 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff254001670 con 0x7ff260159b30 2024-09-12T02:23:37.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.456+0000 7ff2679d6640 1 -- 172.21.15.60:0/1305213142 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff260159b30 msgr2=0x7ff260159f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:37.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.456+0000 7ff2679d6640 1 --2- 172.21.15.60:0/1305213142 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff260159b30 0x7ff260159f10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff2580097a0 tx=0x7ff25802a000 comp rx=0 tx=0).stop 2024-09-12T02:23:37.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.456+0000 7ff2679d6640 1 -- 172.21.15.60:0/1305213142 shutdown_connections 2024-09-12T02:23:37.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.456+0000 7ff2679d6640 1 --2- 172.21.15.60:0/1305213142 >> v2:172.21.15.105:3300/0 conn(0x7ff260067a50 0x7ff260067f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:37.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.456+0000 7ff2679d6640 1 --2- 172.21.15.60:0/1305213142 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff260159b30 0x7ff260159f10 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:37.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.456+0000 7ff2679d6640 1 -- 172.21.15.60:0/1305213142 >> 172.21.15.60:0/1305213142 conn(0x7ff2600cbd60 msgr2=0x7ff2600cc170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:37.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.457+0000 7ff2679d6640 1 -- 172.21.15.60:0/1305213142 shutdown_connections 2024-09-12T02:23:37.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.457+0000 7ff2679d6640 1 -- 172.21.15.60:0/1305213142 wait complete. 2024-09-12T02:23:37.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.458+0000 7ff2679d6640 1 Processor -- start 2024-09-12T02:23:37.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.458+0000 7ff2679d6640 1 -- start start 2024-09-12T02:23:37.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.458+0000 7ff2679d6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff260067a50 0x7ff26014cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:37.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.458+0000 7ff2679d6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff2600c9c60 0x7ff2601e0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:37.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.458+0000 7ff2679d6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff260159b30 0x7ff260158980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:37.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.458+0000 7ff2679d6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff2600cca00 con 0x7ff260067a50 2024-09-12T02:23:37.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.458+0000 7ff2679d6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff2600cc880 con 0x7ff2600c9c60 2024-09-12T02:23:37.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.458+0000 7ff2679d6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff26015a450 con 0x7ff260159b30 2024-09-12T02:23:37.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.459+0000 7ff265772640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff260067a50 0x7ff26014cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:37.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.459+0000 7ff265772640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff260067a50 0x7ff26014cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50320/0 (socket says 172.21.15.60:50320) 2024-09-12T02:23:37.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.459+0000 7ff265772640 1 -- 172.21.15.60:0/3065072684 learned_addr learned my addr 172.21.15.60:0/3065072684 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:37.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.459+0000 7ff264f71640 1 --2- 172.21.15.60:0/3065072684 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff2600c9c60 0x7ff2601e0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:37.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.459+0000 7ff265f73640 1 --2- 172.21.15.60:0/3065072684 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff260159b30 0x7ff260158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:37.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.459+0000 7ff265772640 1 -- 172.21.15.60:0/3065072684 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff260159b30 msgr2=0x7ff260158980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:37.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.459+0000 7ff265772640 1 --2- 172.21.15.60:0/3065072684 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff260159b30 0x7ff260158980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:37.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.459+0000 7ff265772640 1 -- 172.21.15.60:0/3065072684 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff2600c9c60 msgr2=0x7ff2601e0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:37.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.459+0000 7ff265772640 1 --2- 172.21.15.60:0/3065072684 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff2600c9c60 0x7ff2601e0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:37.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.459+0000 7ff265772640 1 -- 172.21.15.60:0/3065072684 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2601e0a80 con 0x7ff260067a50 2024-09-12T02:23:37.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.459+0000 7ff264f71640 1 --2- 172.21.15.60:0/3065072684 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff2600c9c60 0x7ff2601e0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:23:37.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.459+0000 7ff265772640 1 --2- 172.21.15.60:0/3065072684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff260067a50 0x7ff26014cf40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff2580098c0 tx=0x7ff2580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:37.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.459+0000 7ff25dffb640 1 -- 172.21.15.60:0/3065072684 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff258037050 con 0x7ff260067a50 2024-09-12T02:23:37.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.459+0000 7ff25dffb640 1 -- 172.21.15.60:0/3065072684 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff258043070 con 0x7ff260067a50 2024-09-12T02:23:37.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.459+0000 7ff2679d6640 1 -- 172.21.15.60:0/3065072684 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff26014a3c0 con 0x7ff260067a50 2024-09-12T02:23:37.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.459+0000 7ff25dffb640 1 -- 172.21.15.60:0/3065072684 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff258006e10 con 0x7ff260067a50 2024-09-12T02:23:37.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.460+0000 7ff2679d6640 1 -- 172.21.15.60:0/3065072684 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2601dfa60 con 0x7ff260067a50 2024-09-12T02:23:37.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.460+0000 7ff2679d6640 1 -- 172.21.15.60:0/3065072684 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff260159f10 con 0x7ff260067a50 2024-09-12T02:23:37.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.461+0000 7ff25dffb640 1 -- 172.21.15.60:0/3065072684 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff25803ca10 con 0x7ff260067a50 2024-09-12T02:23:37.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.462+0000 7ff25dffb640 1 --2- 172.21.15.60:0/3065072684 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff24c06be60 0x7ff24c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:37.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.462+0000 7ff264f71640 1 --2- 172.21.15.60:0/3065072684 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff24c06be60 0x7ff24c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:37.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.462+0000 7ff25dffb640 1 -- 172.21.15.60:0/3065072684 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7ff2580abbf0 con 0x7ff260067a50 2024-09-12T02:23:37.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.462+0000 7ff264f71640 1 --2- 172.21.15.60:0/3065072684 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff24c06be60 0x7ff24c06e320 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff26014d480 tx=0x7ff254009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:37.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.466+0000 7ff25dffb640 1 -- 172.21.15.60:0/3065072684 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff258030e20 con 0x7ff260067a50 2024-09-12T02:23:37.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.639+0000 7ff2679d6640 1 -- 172.21.15.60:0/3065072684 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) -- 0x7ff2600ad7c0 con 0x7ff260067a50 2024-09-12T02:23:37.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.639+0000 7ff25dffb640 1 -- 172.21.15.60:0/3065072684 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v26) ==== 95+0+11 (secure 0 0 0) 0x7ff25807a420 con 0x7ff260067a50 2024-09-12T02:23:37.640 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2024-09-12T02:23:37.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.641+0000 7ff2679d6640 1 -- 172.21.15.60:0/3065072684 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff24c06be60 msgr2=0x7ff24c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:37.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.641+0000 7ff2679d6640 1 --2- 172.21.15.60:0/3065072684 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff24c06be60 0x7ff24c06e320 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff26014d480 tx=0x7ff254009040 comp rx=0 tx=0).stop 2024-09-12T02:23:37.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.641+0000 7ff2679d6640 1 -- 172.21.15.60:0/3065072684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff260067a50 msgr2=0x7ff26014cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:37.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.641+0000 7ff2679d6640 1 --2- 172.21.15.60:0/3065072684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff260067a50 0x7ff26014cf40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff2580098c0 tx=0x7ff2580046c0 comp rx=0 tx=0).stop 2024-09-12T02:23:37.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.641+0000 7ff2679d6640 1 -- 172.21.15.60:0/3065072684 shutdown_connections 2024-09-12T02:23:37.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.641+0000 7ff2679d6640 1 --2- 172.21.15.60:0/3065072684 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff24c06be60 0x7ff24c06e320 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:37.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.641+0000 7ff2679d6640 1 --2- 172.21.15.60:0/3065072684 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff260159b30 0x7ff260158980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:37.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.641+0000 7ff2679d6640 1 --2- 172.21.15.60:0/3065072684 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff2600c9c60 0x7ff2601e0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:37.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.641+0000 7ff2679d6640 1 --2- 172.21.15.60:0/3065072684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff260067a50 0x7ff26014cf40 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:37.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.641+0000 7ff2679d6640 1 -- 172.21.15.60:0/3065072684 >> 172.21.15.60:0/3065072684 conn(0x7ff2600cbd60 msgr2=0x7ff2600cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:37.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.641+0000 7ff2679d6640 1 -- 172.21.15.60:0/3065072684 shutdown_connections 2024-09-12T02:23:37.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.641+0000 7ff2679d6640 1 -- 172.21.15.60:0/3065072684 wait complete. 2024-09-12T02:23:37.653 INFO:tasks.mon_thrash.ceph_manager:waiting for clean 2024-09-12T02:23:37.653 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:23:37.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.754+0000 7fc4e160a640 1 Processor -- start 2024-09-12T02:23:37.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.754+0000 7fc4e160a640 1 -- start start 2024-09-12T02:23:37.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.755+0000 7fc4e160a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc4dc153af0 0x7fc4dc1563a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:37.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.755+0000 7fc4e160a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc4dc0af870 0x7fc4dc0c4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:37.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.755+0000 7fc4e160a640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4dc0c54e0 con 0x7fc4dc0afdd0 2024-09-12T02:23:37.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.755+0000 7fc4e160a640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fc4dc0c74a0 con 0x7fc4dc0af870 2024-09-12T02:23:37.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.755+0000 7fc4e160a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc4dc0c7740 con 0x7fc4dc153af0 2024-09-12T02:23:37.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.755+0000 7fc4db7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc4dc0af870 0x7fc4dc0c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:37.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.755+0000 7fc4da7fc640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fc4dc0afdd0 0x7fc4dc0c5900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:35424/0 (socket says 172.21.15.60:35424) 2024-09-12T02:23:37.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.755+0000 7fc4da7fc640 1 -- 172.21.15.60:0/738867156 learned_addr learned my addr 172.21.15.60:0/738867156 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:37.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.755+0000 7fc4daffd640 1 --2- 172.21.15.60:0/738867156 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc4dc153af0 0x7fc4dc1563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:37.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.755+0000 7fc4db7fe640 1 -- 172.21.15.60:0/738867156 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc4dc153af0 msgr2=0x7fc4dc1563a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:37.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.755+0000 7fc4db7fe640 1 --2- 172.21.15.60:0/738867156 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc4dc153af0 0x7fc4dc1563a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:37.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.755+0000 7fc4db7fe640 1 -- 172.21.15.60:0/738867156 >> v1:172.21.15.60:6789/0 conn(0x7fc4dc0afdd0 legacy=0x7fc4dc0c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:37.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.755+0000 7fc4db7fe640 1 -- 172.21.15.60:0/738867156 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4dc15a3c0 con 0x7fc4dc0af870 2024-09-12T02:23:37.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.756+0000 7fc4db7fe640 1 --2- 172.21.15.60:0/738867156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4dc0af870 0x7fc4dc0c4780 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc009d90 tx=0x7fc4cc02a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f61b78f0b2d8173f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:37.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.756+0000 7fc4d9ffb640 1 -- 172.21.15.60:0/738867156 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc007740 con 0x7fc4dc0af870 2024-09-12T02:23:37.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.756+0000 7fc4d9ffb640 1 -- 172.21.15.60:0/738867156 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4cc0078e0 con 0x7fc4dc0af870 2024-09-12T02:23:37.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.756+0000 7fc4d9ffb640 1 -- 172.21.15.60:0/738867156 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc007cb0 con 0x7fc4dc0af870 2024-09-12T02:23:37.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.757+0000 7fc4e160a640 1 -- 172.21.15.60:0/738867156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4dc0af870 msgr2=0x7fc4dc0c4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:37.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.757+0000 7fc4e160a640 1 --2- 172.21.15.60:0/738867156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4dc0af870 0x7fc4dc0c4780 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc009d90 tx=0x7fc4cc02a530 comp rx=0 tx=0).stop 2024-09-12T02:23:37.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.757+0000 7fc4e160a640 1 -- 172.21.15.60:0/738867156 shutdown_connections 2024-09-12T02:23:37.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.757+0000 7fc4e160a640 1 --2- 172.21.15.60:0/738867156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4dc0af870 0x7fc4dc0c4780 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:37.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.757+0000 7fc4e160a640 1 --2- 172.21.15.60:0/738867156 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc4dc153af0 0x7fc4dc1563a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:37.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.757+0000 7fc4e160a640 1 -- 172.21.15.60:0/738867156 >> 172.21.15.60:0/738867156 conn(0x7fc4dc0c6880 msgr2=0x7fc4dc0c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:37.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.757+0000 7fc4e160a640 1 -- 172.21.15.60:0/738867156 shutdown_connections 2024-09-12T02:23:37.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.757+0000 7fc4e160a640 1 -- 172.21.15.60:0/738867156 wait complete. 2024-09-12T02:23:37.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.758+0000 7fc4e160a640 1 Processor -- start 2024-09-12T02:23:37.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.758+0000 7fc4e160a640 1 -- start start 2024-09-12T02:23:37.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.759+0000 7fc4e160a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc4dc0af870 0x7fc4dc1e1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:37.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.759+0000 7fc4e160a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4dc0afdd0 0x7fc4dc0c1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:37.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.759+0000 7fc4e160a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc4dc153af0 0x7fc4dc0c32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:37.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.759+0000 7fc4e160a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc4dc154050 con 0x7fc4dc0afdd0 2024-09-12T02:23:37.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.759+0000 7fc4e160a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc4dc153ed0 con 0x7fc4dc153af0 2024-09-12T02:23:37.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.759+0000 7fc4e160a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc4dc0c4cc0 con 0x7fc4dc0af870 2024-09-12T02:23:37.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.759+0000 7fc4da7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4dc0afdd0 0x7fc4dc0c1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:37.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.759+0000 7fc4da7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4dc0afdd0 0x7fc4dc0c1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50342/0 (socket says 172.21.15.60:50342) 2024-09-12T02:23:37.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.759+0000 7fc4da7fc640 1 -- 172.21.15.60:0/4059245257 learned_addr learned my addr 172.21.15.60:0/4059245257 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:37.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.759+0000 7fc4daffd640 1 --2- 172.21.15.60:0/4059245257 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc4dc0af870 0x7fc4dc1e1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:37.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.759+0000 7fc4db7fe640 1 --2- 172.21.15.60:0/4059245257 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc4dc153af0 0x7fc4dc0c32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:37.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.759+0000 7fc4da7fc640 1 -- 172.21.15.60:0/4059245257 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc4dc0af870 msgr2=0x7fc4dc1e1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:37.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.759+0000 7fc4da7fc640 1 --2- 172.21.15.60:0/4059245257 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc4dc0af870 0x7fc4dc1e1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:37.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.759+0000 7fc4da7fc640 1 -- 172.21.15.60:0/4059245257 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc4dc153af0 msgr2=0x7fc4dc0c32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:37.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.759+0000 7fc4da7fc640 1 --2- 172.21.15.60:0/4059245257 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc4dc153af0 0x7fc4dc0c32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:37.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.759+0000 7fc4da7fc640 1 -- 172.21.15.60:0/4059245257 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4dc0c4400 con 0x7fc4dc0afdd0 2024-09-12T02:23:37.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.759+0000 7fc4daffd640 1 --2- 172.21.15.60:0/4059245257 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc4dc0af870 0x7fc4dc1e1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:23:37.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.759+0000 7fc4da7fc640 1 --2- 172.21.15.60:0/4059245257 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4dc0afdd0 0x7fc4dc0c1110 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc0c9d30 tx=0x7fc4c400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:37.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.760+0000 7fc4d37fe640 1 -- 172.21.15.60:0/4059245257 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c4017070 con 0x7fc4dc0afdd0 2024-09-12T02:23:37.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.760+0000 7fc4d37fe640 1 -- 172.21.15.60:0/4059245257 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4c4005ce0 con 0x7fc4dc0afdd0 2024-09-12T02:23:37.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.760+0000 7fc4e160a640 1 -- 172.21.15.60:0/4059245257 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4dc0c3e40 con 0x7fc4dc0afdd0 2024-09-12T02:23:37.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.760+0000 7fc4d37fe640 1 -- 172.21.15.60:0/4059245257 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c4007310 con 0x7fc4dc0afdd0 2024-09-12T02:23:37.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.760+0000 7fc4e160a640 1 -- 172.21.15.60:0/4059245257 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4dc0c2d80 con 0x7fc4dc0afdd0 2024-09-12T02:23:37.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.761+0000 7fc4e160a640 1 -- 172.21.15.60:0/4059245257 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4dc157270 con 0x7fc4dc0afdd0 2024-09-12T02:23:37.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.761+0000 7fc4d37fe640 1 -- 172.21.15.60:0/4059245257 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc4c401a070 con 0x7fc4dc0afdd0 2024-09-12T02:23:37.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.761+0000 7fc4d37fe640 1 --2- 172.21.15.60:0/4059245257 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc4bc06be60 0x7fc4bc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:37.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.762+0000 7fc4d37fe640 1 -- 172.21.15.60:0/4059245257 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7fc4c408a4a0 con 0x7fc4dc0afdd0 2024-09-12T02:23:37.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.762+0000 7fc4daffd640 1 --2- 172.21.15.60:0/4059245257 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc4bc06be60 0x7fc4bc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:37.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.762+0000 7fc4daffd640 1 --2- 172.21.15.60:0/4059245257 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc4bc06be60 0x7fc4bc06e320 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4006fd0 tx=0x7fc4d4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:37.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.766+0000 7fc4d37fe640 1 -- 172.21.15.60:0/4059245257 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc4dc157270 con 0x7fc4dc0afdd0 2024-09-12T02:23:37.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.940+0000 7fc4e160a640 1 -- 172.21.15.60:0/4059245257 --> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc4dc0c6f20 con 0x7fc4bc06be60 2024-09-12T02:23:37.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.951+0000 7fc4d37fe640 1 -- 172.21.15.60:0/4059245257 <== mgr.4098 v2:172.21.15.60:6800/3549430091 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490301 (secure 0 0 0) 0x7fc4dc0c6f20 con 0x7fc4bc06be60 2024-09-12T02:23:37.957 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:23:37.961 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T02:23:37.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.955+0000 7fc4e160a640 1 -- 172.21.15.60:0/4059245257 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc4bc06be60 msgr2=0x7fc4bc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:37.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.955+0000 7fc4e160a640 1 --2- 172.21.15.60:0/4059245257 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc4bc06be60 0x7fc4bc06e320 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4006fd0 tx=0x7fc4d4008040 comp rx=0 tx=0).stop 2024-09-12T02:23:37.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.955+0000 7fc4e160a640 1 -- 172.21.15.60:0/4059245257 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4dc0afdd0 msgr2=0x7fc4dc0c1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:37.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.955+0000 7fc4e160a640 1 --2- 172.21.15.60:0/4059245257 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4dc0afdd0 0x7fc4dc0c1110 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc0c9d30 tx=0x7fc4c400c800 comp rx=0 tx=0).stop 2024-09-12T02:23:37.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.955+0000 7fc4e160a640 1 -- 172.21.15.60:0/4059245257 shutdown_connections 2024-09-12T02:23:37.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.955+0000 7fc4e160a640 1 --2- 172.21.15.60:0/4059245257 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc4bc06be60 0x7fc4bc06e320 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:37.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.955+0000 7fc4e160a640 1 --2- 172.21.15.60:0/4059245257 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc4dc153af0 0x7fc4dc0c32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:37.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.955+0000 7fc4e160a640 1 --2- 172.21.15.60:0/4059245257 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4dc0afdd0 0x7fc4dc0c1110 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:37.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.955+0000 7fc4e160a640 1 --2- 172.21.15.60:0/4059245257 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc4dc0af870 0x7fc4dc1e1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:37.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.955+0000 7fc4e160a640 1 -- 172.21.15.60:0/4059245257 >> 172.21.15.60:0/4059245257 conn(0x7fc4dc0c6880 msgr2=0x7fc4dc06f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:37.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.955+0000 7fc4e160a640 1 -- 172.21.15.60:0/4059245257 shutdown_connections 2024-09-12T02:23:37.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:37.955+0000 7fc4e160a640 1 -- 172.21.15.60:0/4059245257 wait complete. 2024-09-12T02:23:37.967 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-09-12T02:23:36.093768+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595631,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252876,"kb_used_data":3368,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754721844,"statfs":{"total":773094113280,"available":772835168256,"internally_reserved":0,"allocated":3448832,"data_stored":2026971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":443,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003205"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840458+0000","last_change":"2024-09-12T02:23:16.851521+0000","last_active":"2024-09-12T02:23:17.840458+0000","last_peered":"2024-09-12T02:23:17.840458+0000","last_clean":"2024-09-12T02:23:17.840458+0000","last_became_active":"2024-09-12T02:23:16.851220+0000","last_became_peered":"2024-09-12T02:23:16.851220+0000","last_unstale":"2024-09-12T02:23:17.840458+0000","last_undegraded":"2024-09-12T02:23:17.840458+0000","last_fullsized":"2024-09-12T02:23:17.840458+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:28.680072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331964+0000","last_change":"2024-09-12T02:23:03.757848+0000","last_active":"2024-09-12T02:23:18.331964+0000","last_peered":"2024-09-12T02:23:18.331964+0000","last_clean":"2024-09-12T02:23:18.331964+0000","last_became_active":"2024-09-12T02:23:03.757544+0000","last_became_peered":"2024-09-12T02:23:03.757544+0000","last_unstale":"2024-09-12T02:23:18.331964+0000","last_undegraded":"2024-09-12T02:23:18.331964+0000","last_fullsized":"2024-09-12T02:23:18.331964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:43.576128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840084+0000","last_change":"2024-09-12T02:23:04.790549+0000","last_active":"2024-09-12T02:23:17.840084+0000","last_peered":"2024-09-12T02:23:17.840084+0000","last_clean":"2024-09-12T02:23:17.840084+0000","last_became_active":"2024-09-12T02:23:04.790187+0000","last_became_peered":"2024-09-12T02:23:04.790187+0000","last_unstale":"2024-09-12T02:23:17.840084+0000","last_undegraded":"2024-09-12T02:23:17.840084+0000","last_fullsized":"2024-09-12T02:23:17.840084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:49.656395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.838950+0000","last_change":"2024-09-12T02:23:15.829383+0000","last_active":"2024-09-12T02:23:17.838950+0000","last_peered":"2024-09-12T02:23:17.838950+0000","last_clean":"2024-09-12T02:23:17.838950+0000","last_became_active":"2024-09-12T02:23:15.828295+0000","last_became_peered":"2024-09-12T02:23:15.828295+0000","last_unstale":"2024-09-12T02:23:17.838950+0000","last_undegraded":"2024-09-12T02:23:17.838950+0000","last_fullsized":"2024-09-12T02:23:17.838950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:13.217846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444073+0000","last_change":"2024-09-12T02:23:16.853675+0000","last_active":"2024-09-12T02:23:18.444073+0000","last_peered":"2024-09-12T02:23:18.444073+0000","last_clean":"2024-09-12T02:23:18.444073+0000","last_became_active":"2024-09-12T02:23:16.853371+0000","last_became_peered":"2024-09-12T02:23:16.853371+0000","last_unstale":"2024-09-12T02:23:18.444073+0000","last_undegraded":"2024-09-12T02:23:18.444073+0000","last_fullsized":"2024-09-12T02:23:18.444073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:10.323501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840125+0000","last_change":"2024-09-12T02:23:03.767076+0000","last_active":"2024-09-12T02:23:17.840125+0000","last_peered":"2024-09-12T02:23:17.840125+0000","last_clean":"2024-09-12T02:23:17.840125+0000","last_became_active":"2024-09-12T02:23:03.766686+0000","last_became_peered":"2024-09-12T02:23:03.766686+0000","last_unstale":"2024-09-12T02:23:17.840125+0000","last_undegraded":"2024-09-12T02:23:17.840125+0000","last_fullsized":"2024-09-12T02:23:17.840125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:45.706208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331882+0000","last_change":"2024-09-12T02:23:04.782108+0000","last_active":"2024-09-12T02:23:18.331882+0000","last_peered":"2024-09-12T02:23:18.331882+0000","last_clean":"2024-09-12T02:23:18.331882+0000","last_became_active":"2024-09-12T02:23:04.781829+0000","last_became_peered":"2024-09-12T02:23:04.781829+0000","last_unstale":"2024-09-12T02:23:18.331882+0000","last_undegraded":"2024-09-12T02:23:18.331882+0000","last_fullsized":"2024-09-12T02:23:18.331882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:07:33.165742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840554+0000","last_change":"2024-09-12T02:23:15.828697+0000","last_active":"2024-09-12T02:23:17.840554+0000","last_peered":"2024-09-12T02:23:17.840554+0000","last_clean":"2024-09-12T02:23:17.840554+0000","last_became_active":"2024-09-12T02:23:15.828317+0000","last_became_peered":"2024-09-12T02:23:15.828317+0000","last_unstale":"2024-09-12T02:23:17.840554+0000","last_undegraded":"2024-09-12T02:23:17.840554+0000","last_fullsized":"2024-09-12T02:23:17.840554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:55.347515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840938+0000","last_change":"2024-09-12T02:23:16.856209+0000","last_active":"2024-09-12T02:23:17.840938+0000","last_peered":"2024-09-12T02:23:17.840938+0000","last_clean":"2024-09-12T02:23:17.840938+0000","last_became_active":"2024-09-12T02:23:16.855874+0000","last_became_peered":"2024-09-12T02:23:16.855874+0000","last_unstale":"2024-09-12T02:23:17.840938+0000","last_undegraded":"2024-09-12T02:23:17.840938+0000","last_fullsized":"2024-09-12T02:23:17.840938+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:44.299638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842447+0000","last_change":"2024-09-12T02:23:03.767875+0000","last_active":"2024-09-12T02:23:17.842447+0000","last_peered":"2024-09-12T02:23:17.842447+0000","last_clean":"2024-09-12T02:23:17.842447+0000","last_became_active":"2024-09-12T02:23:03.767596+0000","last_became_peered":"2024-09-12T02:23:03.767596+0000","last_unstale":"2024-09-12T02:23:17.842447+0000","last_undegraded":"2024-09-12T02:23:17.842447+0000","last_fullsized":"2024-09-12T02:23:17.842447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:22.605725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325618+0000","last_change":"2024-09-12T02:23:04.791903+0000","last_active":"2024-09-12T02:23:18.325618+0000","last_peered":"2024-09-12T02:23:18.325618+0000","last_clean":"2024-09-12T02:23:18.325618+0000","last_became_active":"2024-09-12T02:23:04.791635+0000","last_became_peered":"2024-09-12T02:23:04.791635+0000","last_unstale":"2024-09-12T02:23:18.325618+0000","last_undegraded":"2024-09-12T02:23:18.325618+0000","last_fullsized":"2024-09-12T02:23:18.325618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:08.192088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841943+0000","last_change":"2024-09-12T02:23:15.833369+0000","last_active":"2024-09-12T02:23:17.841943+0000","last_peered":"2024-09-12T02:23:17.841943+0000","last_clean":"2024-09-12T02:23:17.841943+0000","last_became_active":"2024-09-12T02:23:15.833010+0000","last_became_peered":"2024-09-12T02:23:15.833010+0000","last_unstale":"2024-09-12T02:23:17.841943+0000","last_undegraded":"2024-09-12T02:23:17.841943+0000","last_fullsized":"2024-09-12T02:23:17.841943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:51.465462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325378+0000","last_change":"2024-09-12T02:23:16.853013+0000","last_active":"2024-09-12T02:23:18.325378+0000","last_peered":"2024-09-12T02:23:18.325378+0000","last_clean":"2024-09-12T02:23:18.325378+0000","last_became_active":"2024-09-12T02:23:16.852698+0000","last_became_peered":"2024-09-12T02:23:16.852698+0000","last_unstale":"2024-09-12T02:23:18.325378+0000","last_undegraded":"2024-09-12T02:23:18.325378+0000","last_fullsized":"2024-09-12T02:23:18.325378+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:11.709531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842467+0000","last_change":"2024-09-12T02:23:03.763480+0000","last_active":"2024-09-12T02:23:17.842467+0000","last_peered":"2024-09-12T02:23:17.842467+0000","last_clean":"2024-09-12T02:23:17.842467+0000","last_became_active":"2024-09-12T02:23:03.762464+0000","last_became_peered":"2024-09-12T02:23:03.762464+0000","last_unstale":"2024-09-12T02:23:17.842467+0000","last_undegraded":"2024-09-12T02:23:17.842467+0000","last_fullsized":"2024-09-12T02:23:17.842467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:24.308289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325931+0000","last_change":"2024-09-12T02:23:04.791109+0000","last_active":"2024-09-12T02:23:18.325931+0000","last_peered":"2024-09-12T02:23:18.325931+0000","last_clean":"2024-09-12T02:23:18.325931+0000","last_became_active":"2024-09-12T02:23:04.790201+0000","last_became_peered":"2024-09-12T02:23:04.790201+0000","last_unstale":"2024-09-12T02:23:18.325931+0000","last_undegraded":"2024-09-12T02:23:18.325931+0000","last_fullsized":"2024-09-12T02:23:18.325931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:13.166139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840837+0000","last_change":"2024-09-12T02:23:15.834261+0000","last_active":"2024-09-12T02:23:17.840837+0000","last_peered":"2024-09-12T02:23:17.840837+0000","last_clean":"2024-09-12T02:23:17.840837+0000","last_became_active":"2024-09-12T02:23:15.833982+0000","last_became_peered":"2024-09-12T02:23:15.833982+0000","last_unstale":"2024-09-12T02:23:17.840837+0000","last_undegraded":"2024-09-12T02:23:17.840837+0000","last_fullsized":"2024-09-12T02:23:17.840837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:04.987961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444359+0000","last_change":"2024-09-12T02:23:16.861432+0000","last_active":"2024-09-12T02:23:18.444359+0000","last_peered":"2024-09-12T02:23:18.444359+0000","last_clean":"2024-09-12T02:23:18.444359+0000","last_became_active":"2024-09-12T02:23:16.861003+0000","last_became_peered":"2024-09-12T02:23:16.861003+0000","last_unstale":"2024-09-12T02:23:18.444359+0000","last_undegraded":"2024-09-12T02:23:18.444359+0000","last_fullsized":"2024-09-12T02:23:18.444359+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:01.777500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597613+0000","last_change":"2024-09-12T02:23:04.788754+0000","last_active":"2024-09-12T02:23:19.597613+0000","last_peered":"2024-09-12T02:23:19.597613+0000","last_clean":"2024-09-12T02:23:19.597613+0000","last_became_active":"2024-09-12T02:23:04.788350+0000","last_became_peered":"2024-09-12T02:23:04.788350+0000","last_unstale":"2024-09-12T02:23:19.597613+0000","last_undegraded":"2024-09-12T02:23:19.597613+0000","last_fullsized":"2024-09-12T02:23:19.597613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:08.192088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841873+0000","last_change":"2024-09-12T02:23:03.763423+0000","last_active":"2024-09-12T02:23:17.841873+0000","last_peered":"2024-09-12T02:23:17.841873+0000","last_clean":"2024-09-12T02:23:17.841873+0000","last_became_active":"2024-09-12T02:23:03.762627+0000","last_became_peered":"2024-09-12T02:23:03.762627+0000","last_unstale":"2024-09-12T02:23:17.841873+0000","last_undegraded":"2024-09-12T02:23:17.841873+0000","last_fullsized":"2024-09-12T02:23:17.841873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:18.090657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841725+0000","last_change":"2024-09-12T02:23:15.831604+0000","last_active":"2024-09-12T02:23:17.841725+0000","last_peered":"2024-09-12T02:23:17.841725+0000","last_clean":"2024-09-12T02:23:17.841725+0000","last_became_active":"2024-09-12T02:23:15.831292+0000","last_became_peered":"2024-09-12T02:23:15.831292+0000","last_unstale":"2024-09-12T02:23:17.841725+0000","last_undegraded":"2024-09-12T02:23:17.841725+0000","last_fullsized":"2024-09-12T02:23:17.841725+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:30.234721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673393+0000","last_change":"2024-09-12T02:23:16.842506+0000","last_active":"2024-09-12T02:23:18.673393+0000","last_peered":"2024-09-12T02:23:18.673393+0000","last_clean":"2024-09-12T02:23:18.673393+0000","last_became_active":"2024-09-12T02:23:16.842210+0000","last_became_peered":"2024-09-12T02:23:16.842210+0000","last_unstale":"2024-09-12T02:23:18.673393+0000","last_undegraded":"2024-09-12T02:23:18.673393+0000","last_fullsized":"2024-09-12T02:23:18.673393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:52.806704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839230+0000","last_change":"2024-09-12T02:23:04.782769+0000","last_active":"2024-09-12T02:23:17.839230+0000","last_peered":"2024-09-12T02:23:17.839230+0000","last_clean":"2024-09-12T02:23:17.839230+0000","last_became_active":"2024-09-12T02:23:04.782472+0000","last_became_peered":"2024-09-12T02:23:04.782472+0000","last_unstale":"2024-09-12T02:23:17.839230+0000","last_undegraded":"2024-09-12T02:23:17.839230+0000","last_fullsized":"2024-09-12T02:23:17.839230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:46.144471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444704+0000","last_change":"2024-09-12T02:23:03.771468+0000","last_active":"2024-09-12T02:23:18.444704+0000","last_peered":"2024-09-12T02:23:18.444704+0000","last_clean":"2024-09-12T02:23:18.444704+0000","last_became_active":"2024-09-12T02:23:03.769619+0000","last_became_peered":"2024-09-12T02:23:03.769619+0000","last_unstale":"2024-09-12T02:23:18.444704+0000","last_undegraded":"2024-09-12T02:23:18.444704+0000","last_fullsized":"2024-09-12T02:23:18.444704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:38.422369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841394+0000","last_change":"2024-09-12T02:23:15.833359+0000","last_active":"2024-09-12T02:23:17.841394+0000","last_peered":"2024-09-12T02:23:17.841394+0000","last_clean":"2024-09-12T02:23:17.841394+0000","last_became_active":"2024-09-12T02:23:15.832995+0000","last_became_peered":"2024-09-12T02:23:15.832995+0000","last_unstale":"2024-09-12T02:23:17.841394+0000","last_undegraded":"2024-09-12T02:23:17.841394+0000","last_fullsized":"2024-09-12T02:23:17.841394+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:57.922845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841919+0000","last_change":"2024-09-12T02:23:16.856439+0000","last_active":"2024-09-12T02:23:17.841919+0000","last_peered":"2024-09-12T02:23:17.841919+0000","last_clean":"2024-09-12T02:23:17.841919+0000","last_became_active":"2024-09-12T02:23:16.856166+0000","last_became_peered":"2024-09-12T02:23:16.856166+0000","last_unstale":"2024-09-12T02:23:17.841919+0000","last_undegraded":"2024-09-12T02:23:17.841919+0000","last_fullsized":"2024-09-12T02:23:17.841919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:42:56.534517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839424+0000","last_change":"2024-09-12T02:23:04.783991+0000","last_active":"2024-09-12T02:23:17.839424+0000","last_peered":"2024-09-12T02:23:17.839424+0000","last_clean":"2024-09-12T02:23:17.839424+0000","last_became_active":"2024-09-12T02:23:04.783143+0000","last_became_peered":"2024-09-12T02:23:04.783143+0000","last_unstale":"2024-09-12T02:23:17.839424+0000","last_undegraded":"2024-09-12T02:23:17.839424+0000","last_fullsized":"2024-09-12T02:23:17.839424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:53.940843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444206+0000","last_change":"2024-09-12T02:23:03.770581+0000","last_active":"2024-09-12T02:23:18.444206+0000","last_peered":"2024-09-12T02:23:18.444206+0000","last_clean":"2024-09-12T02:23:18.444206+0000","last_became_active":"2024-09-12T02:23:03.769406+0000","last_became_peered":"2024-09-12T02:23:03.769406+0000","last_unstale":"2024-09-12T02:23:18.444206+0000","last_undegraded":"2024-09-12T02:23:18.444206+0000","last_fullsized":"2024-09-12T02:23:18.444206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:20.963819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444698+0000","last_change":"2024-09-12T02:23:15.835033+0000","last_active":"2024-09-12T02:23:18.444698+0000","last_peered":"2024-09-12T02:23:18.444698+0000","last_clean":"2024-09-12T02:23:18.444698+0000","last_became_active":"2024-09-12T02:23:15.834753+0000","last_became_peered":"2024-09-12T02:23:15.834753+0000","last_unstale":"2024-09-12T02:23:18.444698+0000","last_undegraded":"2024-09-12T02:23:18.444698+0000","last_fullsized":"2024-09-12T02:23:18.444698+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:57.434162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.326093+0000","last_change":"2024-09-12T02:23:16.860867+0000","last_active":"2024-09-12T02:23:18.326093+0000","last_peered":"2024-09-12T02:23:18.326093+0000","last_clean":"2024-09-12T02:23:18.326093+0000","last_became_active":"2024-09-12T02:23:16.860656+0000","last_became_peered":"2024-09-12T02:23:16.860656+0000","last_unstale":"2024-09-12T02:23:18.326093+0000","last_undegraded":"2024-09-12T02:23:18.326093+0000","last_fullsized":"2024-09-12T02:23:18.326093+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:11.375287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842133+0000","last_change":"2024-09-12T02:23:04.780821+0000","last_active":"2024-09-12T02:23:17.842133+0000","last_peered":"2024-09-12T02:23:17.842133+0000","last_clean":"2024-09-12T02:23:17.842133+0000","last_became_active":"2024-09-12T02:23:04.779984+0000","last_became_peered":"2024-09-12T02:23:04.779984+0000","last_unstale":"2024-09-12T02:23:17.842133+0000","last_undegraded":"2024-09-12T02:23:17.842133+0000","last_fullsized":"2024-09-12T02:23:17.842133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:25.724116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841013+0000","last_change":"2024-09-12T02:23:03.764530+0000","last_active":"2024-09-12T02:23:17.841013+0000","last_peered":"2024-09-12T02:23:17.841013+0000","last_clean":"2024-09-12T02:23:17.841013+0000","last_became_active":"2024-09-12T02:23:03.764218+0000","last_became_peered":"2024-09-12T02:23:03.764218+0000","last_unstale":"2024-09-12T02:23:17.841013+0000","last_undegraded":"2024-09-12T02:23:17.841013+0000","last_fullsized":"2024-09-12T02:23:17.841013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:55.445619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842053+0000","last_change":"2024-09-12T02:23:15.831621+0000","last_active":"2024-09-12T02:23:17.842053+0000","last_peered":"2024-09-12T02:23:17.842053+0000","last_clean":"2024-09-12T02:23:17.842053+0000","last_became_active":"2024-09-12T02:23:15.831331+0000","last_became_peered":"2024-09-12T02:23:15.831331+0000","last_unstale":"2024-09-12T02:23:17.842053+0000","last_undegraded":"2024-09-12T02:23:17.842053+0000","last_fullsized":"2024-09-12T02:23:17.842053+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:06.494392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.838770+0000","last_change":"2024-09-12T02:23:16.847556+0000","last_active":"2024-09-12T02:23:17.838770+0000","last_peered":"2024-09-12T02:23:17.838770+0000","last_clean":"2024-09-12T02:23:17.838770+0000","last_became_active":"2024-09-12T02:23:16.845749+0000","last_became_peered":"2024-09-12T02:23:16.845749+0000","last_unstale":"2024-09-12T02:23:17.838770+0000","last_undegraded":"2024-09-12T02:23:17.838770+0000","last_fullsized":"2024-09-12T02:23:17.838770+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:39.542842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.332030+0000","last_change":"2024-09-12T02:23:04.786895+0000","last_active":"2024-09-12T02:23:18.332030+0000","last_peered":"2024-09-12T02:23:18.332030+0000","last_clean":"2024-09-12T02:23:18.332030+0000","last_became_active":"2024-09-12T02:23:04.786591+0000","last_became_peered":"2024-09-12T02:23:04.786591+0000","last_unstale":"2024-09-12T02:23:18.332030+0000","last_undegraded":"2024-09-12T02:23:18.332030+0000","last_fullsized":"2024-09-12T02:23:18.332030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:14.751707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.598264+0000","last_change":"2024-09-12T02:23:03.771259+0000","last_active":"2024-09-12T02:23:19.598264+0000","last_peered":"2024-09-12T02:23:19.598264+0000","last_clean":"2024-09-12T02:23:19.598264+0000","last_became_active":"2024-09-12T02:23:03.770687+0000","last_became_peered":"2024-09-12T02:23:03.770687+0000","last_unstale":"2024-09-12T02:23:19.598264+0000","last_undegraded":"2024-09-12T02:23:19.598264+0000","last_fullsized":"2024-09-12T02:23:19.598264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:38.516959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841319+0000","last_change":"2024-09-12T02:23:15.829406+0000","last_active":"2024-09-12T02:23:17.841319+0000","last_peered":"2024-09-12T02:23:17.841319+0000","last_clean":"2024-09-12T02:23:17.841319+0000","last_became_active":"2024-09-12T02:23:15.829135+0000","last_became_peered":"2024-09-12T02:23:15.829135+0000","last_unstale":"2024-09-12T02:23:17.841319+0000","last_undegraded":"2024-09-12T02:23:17.841319+0000","last_fullsized":"2024-09-12T02:23:17.841319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:22.365804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840867+0000","last_change":"2024-09-12T02:23:16.857016+0000","last_active":"2024-09-12T02:23:17.840867+0000","last_peered":"2024-09-12T02:23:17.840867+0000","last_clean":"2024-09-12T02:23:17.840867+0000","last_became_active":"2024-09-12T02:23:16.856705+0000","last_became_peered":"2024-09-12T02:23:16.856705+0000","last_unstale":"2024-09-12T02:23:17.840867+0000","last_undegraded":"2024-09-12T02:23:17.840867+0000","last_fullsized":"2024-09-12T02:23:17.840867+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:03.672668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840282+0000","last_change":"2024-09-12T02:23:04.786424+0000","last_active":"2024-09-12T02:23:17.840282+0000","last_peered":"2024-09-12T02:23:17.840282+0000","last_clean":"2024-09-12T02:23:17.840282+0000","last_became_active":"2024-09-12T02:23:04.786136+0000","last_became_peered":"2024-09-12T02:23:04.786136+0000","last_unstale":"2024-09-12T02:23:17.840282+0000","last_undegraded":"2024-09-12T02:23:17.840282+0000","last_fullsized":"2024-09-12T02:23:17.840282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:31.214894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444621+0000","last_change":"2024-09-12T02:23:03.769745+0000","last_active":"2024-09-12T02:23:18.444621+0000","last_peered":"2024-09-12T02:23:18.444621+0000","last_clean":"2024-09-12T02:23:18.444621+0000","last_became_active":"2024-09-12T02:23:03.769410+0000","last_became_peered":"2024-09-12T02:23:03.769410+0000","last_unstale":"2024-09-12T02:23:18.444621+0000","last_undegraded":"2024-09-12T02:23:18.444621+0000","last_fullsized":"2024-09-12T02:23:18.444621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:00.414459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.838725+0000","last_change":"2024-09-12T02:23:15.827211+0000","last_active":"2024-09-12T02:23:17.838725+0000","last_peered":"2024-09-12T02:23:17.838725+0000","last_clean":"2024-09-12T02:23:17.838725+0000","last_became_active":"2024-09-12T02:23:15.826564+0000","last_became_peered":"2024-09-12T02:23:15.826564+0000","last_unstale":"2024-09-12T02:23:17.838725+0000","last_undegraded":"2024-09-12T02:23:17.838725+0000","last_fullsized":"2024-09-12T02:23:17.838725+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:32.389443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597488+0000","last_change":"2024-09-12T02:23:16.837434+0000","last_active":"2024-09-12T02:23:19.597488+0000","last_peered":"2024-09-12T02:23:19.597488+0000","last_clean":"2024-09-12T02:23:19.597488+0000","last_became_active":"2024-09-12T02:23:16.837162+0000","last_became_peered":"2024-09-12T02:23:16.837162+0000","last_unstale":"2024-09-12T02:23:19.597488+0000","last_undegraded":"2024-09-12T02:23:19.597488+0000","last_fullsized":"2024-09-12T02:23:19.597488+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:09.146064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444511+0000","last_change":"2024-09-12T02:23:04.775876+0000","last_active":"2024-09-12T02:23:18.444511+0000","last_peered":"2024-09-12T02:23:18.444511+0000","last_clean":"2024-09-12T02:23:18.444511+0000","last_became_active":"2024-09-12T02:23:04.775571+0000","last_became_peered":"2024-09-12T02:23:04.775571+0000","last_unstale":"2024-09-12T02:23:18.444511+0000","last_undegraded":"2024-09-12T02:23:18.444511+0000","last_fullsized":"2024-09-12T02:23:18.444511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:05.070528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842890+0000","last_change":"2024-09-12T02:23:03.764093+0000","last_active":"2024-09-12T02:23:17.842890+0000","last_peered":"2024-09-12T02:23:17.842890+0000","last_clean":"2024-09-12T02:23:17.842890+0000","last_became_active":"2024-09-12T02:23:03.763147+0000","last_became_peered":"2024-09-12T02:23:03.763147+0000","last_unstale":"2024-09-12T02:23:17.842890+0000","last_undegraded":"2024-09-12T02:23:17.842890+0000","last_fullsized":"2024-09-12T02:23:17.842890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:13.317894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331728+0000","last_change":"2024-09-12T02:23:15.832461+0000","last_active":"2024-09-12T02:23:18.331728+0000","last_peered":"2024-09-12T02:23:18.331728+0000","last_clean":"2024-09-12T02:23:18.331728+0000","last_became_active":"2024-09-12T02:23:15.831637+0000","last_became_peered":"2024-09-12T02:23:15.831637+0000","last_unstale":"2024-09-12T02:23:18.331728+0000","last_undegraded":"2024-09-12T02:23:18.331728+0000","last_fullsized":"2024-09-12T02:23:18.331728+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:30.909927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.332020+0000","last_change":"2024-09-12T02:23:16.835824+0000","last_active":"2024-09-12T02:23:18.332020+0000","last_peered":"2024-09-12T02:23:18.332020+0000","last_clean":"2024-09-12T02:23:18.332020+0000","last_became_active":"2024-09-12T02:23:16.835520+0000","last_became_peered":"2024-09-12T02:23:16.835520+0000","last_unstale":"2024-09-12T02:23:18.332020+0000","last_undegraded":"2024-09-12T02:23:18.332020+0000","last_fullsized":"2024-09-12T02:23:18.332020+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:32.797100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.326009+0000","last_change":"2024-09-12T02:23:04.787557+0000","last_active":"2024-09-12T02:23:18.326009+0000","last_peered":"2024-09-12T02:23:18.326009+0000","last_clean":"2024-09-12T02:23:18.326009+0000","last_became_active":"2024-09-12T02:23:04.786527+0000","last_became_peered":"2024-09-12T02:23:04.786527+0000","last_unstale":"2024-09-12T02:23:18.326009+0000","last_undegraded":"2024-09-12T02:23:18.326009+0000","last_fullsized":"2024-09-12T02:23:18.326009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:23.273457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444585+0000","last_change":"2024-09-12T02:23:03.769913+0000","last_active":"2024-09-12T02:23:18.444585+0000","last_peered":"2024-09-12T02:23:18.444585+0000","last_clean":"2024-09-12T02:23:18.444585+0000","last_became_active":"2024-09-12T02:23:03.769444+0000","last_became_peered":"2024-09-12T02:23:03.769444+0000","last_unstale":"2024-09-12T02:23:18.444585+0000","last_undegraded":"2024-09-12T02:23:18.444585+0000","last_fullsized":"2024-09-12T02:23:18.444585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:21.243182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444133+0000","last_change":"2024-09-12T02:23:15.829080+0000","last_active":"2024-09-12T02:23:18.444133+0000","last_peered":"2024-09-12T02:23:18.444133+0000","last_clean":"2024-09-12T02:23:18.444133+0000","last_became_active":"2024-09-12T02:23:15.828256+0000","last_became_peered":"2024-09-12T02:23:15.828256+0000","last_unstale":"2024-09-12T02:23:18.444133+0000","last_undegraded":"2024-09-12T02:23:18.444133+0000","last_fullsized":"2024-09-12T02:23:18.444133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:07.743952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331720+0000","last_change":"2024-09-12T02:23:16.845710+0000","last_active":"2024-09-12T02:23:18.331720+0000","last_peered":"2024-09-12T02:23:18.331720+0000","last_clean":"2024-09-12T02:23:18.331720+0000","last_became_active":"2024-09-12T02:23:16.845379+0000","last_became_peered":"2024-09-12T02:23:16.845379+0000","last_unstale":"2024-09-12T02:23:18.331720+0000","last_undegraded":"2024-09-12T02:23:18.331720+0000","last_fullsized":"2024-09-12T02:23:18.331720+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:16.769410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842948+0000","last_change":"2024-09-12T02:23:04.790723+0000","last_active":"2024-09-12T02:23:17.842948+0000","last_peered":"2024-09-12T02:23:17.842948+0000","last_clean":"2024-09-12T02:23:17.842948+0000","last_became_active":"2024-09-12T02:23:04.786877+0000","last_became_peered":"2024-09-12T02:23:04.786877+0000","last_unstale":"2024-09-12T02:23:17.842948+0000","last_undegraded":"2024-09-12T02:23:17.842948+0000","last_fullsized":"2024-09-12T02:23:17.842948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:48.516002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325581+0000","last_change":"2024-09-12T02:23:03.771518+0000","last_active":"2024-09-12T02:23:18.325581+0000","last_peered":"2024-09-12T02:23:18.325581+0000","last_clean":"2024-09-12T02:23:18.325581+0000","last_became_active":"2024-09-12T02:23:03.771063+0000","last_became_peered":"2024-09-12T02:23:03.771063+0000","last_unstale":"2024-09-12T02:23:18.325581+0000","last_undegraded":"2024-09-12T02:23:18.325581+0000","last_fullsized":"2024-09-12T02:23:18.325581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:43.974555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444509+0000","last_change":"2024-09-12T02:23:15.827028+0000","last_active":"2024-09-12T02:23:18.444509+0000","last_peered":"2024-09-12T02:23:18.444509+0000","last_clean":"2024-09-12T02:23:18.444509+0000","last_became_active":"2024-09-12T02:23:15.826708+0000","last_became_peered":"2024-09-12T02:23:15.826708+0000","last_unstale":"2024-09-12T02:23:18.444509+0000","last_undegraded":"2024-09-12T02:23:18.444509+0000","last_fullsized":"2024-09-12T02:23:18.444509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:34.642396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673336+0000","last_change":"2024-09-12T02:23:16.849429+0000","last_active":"2024-09-12T02:23:18.673336+0000","last_peered":"2024-09-12T02:23:18.673336+0000","last_clean":"2024-09-12T02:23:18.673336+0000","last_became_active":"2024-09-12T02:23:16.849119+0000","last_became_peered":"2024-09-12T02:23:16.849119+0000","last_unstale":"2024-09-12T02:23:18.673336+0000","last_undegraded":"2024-09-12T02:23:18.673336+0000","last_fullsized":"2024-09-12T02:23:18.673336+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:10.688619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444107+0000","last_change":"2024-09-12T02:23:04.773745+0000","last_active":"2024-09-12T02:23:18.444107+0000","last_peered":"2024-09-12T02:23:18.444107+0000","last_clean":"2024-09-12T02:23:18.444107+0000","last_became_active":"2024-09-12T02:23:04.773360+0000","last_became_peered":"2024-09-12T02:23:04.773360+0000","last_unstale":"2024-09-12T02:23:18.444107+0000","last_undegraded":"2024-09-12T02:23:18.444107+0000","last_fullsized":"2024-09-12T02:23:18.444107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:33.097774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673252+0000","last_change":"2024-09-12T02:23:03.760700+0000","last_active":"2024-09-12T02:23:18.673252+0000","last_peered":"2024-09-12T02:23:18.673252+0000","last_clean":"2024-09-12T02:23:18.673252+0000","last_became_active":"2024-09-12T02:23:03.760397+0000","last_became_peered":"2024-09-12T02:23:03.760397+0000","last_unstale":"2024-09-12T02:23:18.673252+0000","last_undegraded":"2024-09-12T02:23:18.673252+0000","last_fullsized":"2024-09-12T02:23:18.673252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:36.788864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444739+0000","last_change":"2024-09-12T02:23:15.828714+0000","last_active":"2024-09-12T02:23:18.444739+0000","last_peered":"2024-09-12T02:23:18.444739+0000","last_clean":"2024-09-12T02:23:18.444739+0000","last_became_active":"2024-09-12T02:23:15.827458+0000","last_became_peered":"2024-09-12T02:23:15.827458+0000","last_unstale":"2024-09-12T02:23:18.444739+0000","last_undegraded":"2024-09-12T02:23:18.444739+0000","last_fullsized":"2024-09-12T02:23:18.444739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:12.581897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.326108+0000","last_change":"2024-09-12T02:23:16.855212+0000","last_active":"2024-09-12T02:23:18.326108+0000","last_peered":"2024-09-12T02:23:18.326108+0000","last_clean":"2024-09-12T02:23:18.326108+0000","last_became_active":"2024-09-12T02:23:16.854938+0000","last_became_peered":"2024-09-12T02:23:16.854938+0000","last_unstale":"2024-09-12T02:23:18.326108+0000","last_undegraded":"2024-09-12T02:23:18.326108+0000","last_fullsized":"2024-09-12T02:23:18.326108+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:02.944057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331430+0000","last_change":"2024-09-12T02:23:04.787820+0000","last_active":"2024-09-12T02:23:18.331430+0000","last_peered":"2024-09-12T02:23:18.331430+0000","last_clean":"2024-09-12T02:23:18.331430+0000","last_became_active":"2024-09-12T02:23:04.787523+0000","last_became_peered":"2024-09-12T02:23:04.787523+0000","last_unstale":"2024-09-12T02:23:18.331430+0000","last_undegraded":"2024-09-12T02:23:18.331430+0000","last_fullsized":"2024-09-12T02:23:18.331430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:52.784171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841124+0000","last_change":"2024-09-12T02:23:03.771625+0000","last_active":"2024-09-12T02:23:17.841124+0000","last_peered":"2024-09-12T02:23:17.841124+0000","last_clean":"2024-09-12T02:23:17.841124+0000","last_became_active":"2024-09-12T02:23:03.771163+0000","last_became_peered":"2024-09-12T02:23:03.771163+0000","last_unstale":"2024-09-12T02:23:17.841124+0000","last_undegraded":"2024-09-12T02:23:17.841124+0000","last_fullsized":"2024-09-12T02:23:17.841124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:32.772569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.404274+0000","last_change":"2024-09-12T02:23:15.833889+0000","last_active":"2024-09-12T02:23:18.404274+0000","last_peered":"2024-09-12T02:23:18.404274+0000","last_clean":"2024-09-12T02:23:18.404274+0000","last_became_active":"2024-09-12T02:23:15.833587+0000","last_became_peered":"2024-09-12T02:23:15.833587+0000","last_unstale":"2024-09-12T02:23:18.404274+0000","last_undegraded":"2024-09-12T02:23:18.404274+0000","last_fullsized":"2024-09-12T02:23:18.404274+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:32.787861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842295+0000","last_change":"2024-09-12T02:23:16.848864+0000","last_active":"2024-09-12T02:23:17.842295+0000","last_peered":"2024-09-12T02:23:17.842295+0000","last_clean":"2024-09-12T02:23:17.842295+0000","last_became_active":"2024-09-12T02:23:16.848385+0000","last_became_peered":"2024-09-12T02:23:16.848385+0000","last_unstale":"2024-09-12T02:23:17.842295+0000","last_undegraded":"2024-09-12T02:23:17.842295+0000","last_fullsized":"2024-09-12T02:23:17.842295+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:03.656397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839490+0000","last_change":"2024-09-12T02:23:04.781839+0000","last_active":"2024-09-12T02:23:17.839490+0000","last_peered":"2024-09-12T02:23:17.839490+0000","last_clean":"2024-09-12T02:23:17.839490+0000","last_became_active":"2024-09-12T02:23:04.780984+0000","last_became_peered":"2024-09-12T02:23:04.780984+0000","last_unstale":"2024-09-12T02:23:17.839490+0000","last_undegraded":"2024-09-12T02:23:17.839490+0000","last_fullsized":"2024-09-12T02:23:17.839490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:07.692791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325299+0000","last_change":"2024-09-12T02:23:03.765100+0000","last_active":"2024-09-12T02:23:18.325299+0000","last_peered":"2024-09-12T02:23:18.325299+0000","last_clean":"2024-09-12T02:23:18.325299+0000","last_became_active":"2024-09-12T02:23:03.764801+0000","last_became_peered":"2024-09-12T02:23:03.764801+0000","last_unstale":"2024-09-12T02:23:18.325299+0000","last_undegraded":"2024-09-12T02:23:18.325299+0000","last_fullsized":"2024-09-12T02:23:18.325299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:06.891040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":178,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841644+0000","last_change":"2024-09-12T02:22:55.143869+0000","last_active":"2024-09-12T02:23:17.841644+0000","last_peered":"2024-09-12T02:23:17.841644+0000","last_clean":"2024-09-12T02:23:17.841644+0000","last_became_active":"2024-09-12T02:22:55.142784+0000","last_became_peered":"2024-09-12T02:22:55.142784+0000","last_unstale":"2024-09-12T02:23:17.841644+0000","last_undegraded":"2024-09-12T02:23:17.841644+0000","last_fullsized":"2024-09-12T02:23:17.841644+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:22:52.457979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:22:52.457979+0000","last_clean_scrub_stamp":"2024-09-12T02:22:52.457979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:46.152602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597751+0000","last_change":"2024-09-12T02:23:15.831362+0000","last_active":"2024-09-12T02:23:19.597751+0000","last_peered":"2024-09-12T02:23:19.597751+0000","last_clean":"2024-09-12T02:23:19.597751+0000","last_became_active":"2024-09-12T02:23:15.831084+0000","last_became_peered":"2024-09-12T02:23:15.831084+0000","last_unstale":"2024-09-12T02:23:19.597751+0000","last_undegraded":"2024-09-12T02:23:19.597751+0000","last_fullsized":"2024-09-12T02:23:19.597751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:17.754173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673475+0000","last_change":"2024-09-12T02:23:16.838831+0000","last_active":"2024-09-12T02:23:18.673475+0000","last_peered":"2024-09-12T02:23:18.673475+0000","last_clean":"2024-09-12T02:23:18.673475+0000","last_became_active":"2024-09-12T02:23:16.838523+0000","last_became_peered":"2024-09-12T02:23:16.838523+0000","last_unstale":"2024-09-12T02:23:18.673475+0000","last_undegraded":"2024-09-12T02:23:18.673475+0000","last_fullsized":"2024-09-12T02:23:18.673475+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:35:42.088332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842398+0000","last_change":"2024-09-12T02:23:04.783483+0000","last_active":"2024-09-12T02:23:17.842398+0000","last_peered":"2024-09-12T02:23:17.842398+0000","last_clean":"2024-09-12T02:23:17.842398+0000","last_became_active":"2024-09-12T02:23:04.782878+0000","last_became_peered":"2024-09-12T02:23:04.782878+0000","last_unstale":"2024-09-12T02:23:17.842398+0000","last_undegraded":"2024-09-12T02:23:17.842398+0000","last_fullsized":"2024-09-12T02:23:17.842398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:52.335065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673508+0000","last_change":"2024-09-12T02:23:03.762507+0000","last_active":"2024-09-12T02:23:18.673508+0000","last_peered":"2024-09-12T02:23:18.673508+0000","last_clean":"2024-09-12T02:23:18.673508+0000","last_became_active":"2024-09-12T02:23:03.762164+0000","last_became_peered":"2024-09-12T02:23:03.762164+0000","last_unstale":"2024-09-12T02:23:18.673508+0000","last_undegraded":"2024-09-12T02:23:18.673508+0000","last_fullsized":"2024-09-12T02:23:18.673508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:34.569630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597483+0000","last_change":"2024-09-12T02:23:15.830783+0000","last_active":"2024-09-12T02:23:19.597483+0000","last_peered":"2024-09-12T02:23:19.597483+0000","last_clean":"2024-09-12T02:23:19.597483+0000","last_became_active":"2024-09-12T02:23:15.830471+0000","last_became_peered":"2024-09-12T02:23:15.830471+0000","last_unstale":"2024-09-12T02:23:19.597483+0000","last_undegraded":"2024-09-12T02:23:19.597483+0000","last_fullsized":"2024-09-12T02:23:19.597483+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:22.927201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673175+0000","last_change":"2024-09-12T02:23:16.856328+0000","last_active":"2024-09-12T02:23:18.673175+0000","last_peered":"2024-09-12T02:23:18.673175+0000","last_clean":"2024-09-12T02:23:18.673175+0000","last_became_active":"2024-09-12T02:23:16.855992+0000","last_became_peered":"2024-09-12T02:23:16.855992+0000","last_unstale":"2024-09-12T02:23:18.673175+0000","last_undegraded":"2024-09-12T02:23:18.673175+0000","last_fullsized":"2024-09-12T02:23:18.673175+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:47.682103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325763+0000","last_change":"2024-09-12T02:23:04.784318+0000","last_active":"2024-09-12T02:23:18.325763+0000","last_peered":"2024-09-12T02:23:18.325763+0000","last_clean":"2024-09-12T02:23:18.325763+0000","last_became_active":"2024-09-12T02:23:04.784012+0000","last_became_peered":"2024-09-12T02:23:04.784012+0000","last_unstale":"2024-09-12T02:23:18.325763+0000","last_undegraded":"2024-09-12T02:23:18.325763+0000","last_fullsized":"2024-09-12T02:23:18.325763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:51.352859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444936+0000","last_change":"2024-09-12T02:23:03.766034+0000","last_active":"2024-09-12T02:23:18.444936+0000","last_peered":"2024-09-12T02:23:18.444936+0000","last_clean":"2024-09-12T02:23:18.444936+0000","last_became_active":"2024-09-12T02:23:03.765735+0000","last_became_peered":"2024-09-12T02:23:03.765735+0000","last_unstale":"2024-09-12T02:23:18.444936+0000","last_undegraded":"2024-09-12T02:23:18.444936+0000","last_fullsized":"2024-09-12T02:23:18.444936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:19.691229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331594+0000","last_change":"2024-09-12T02:23:15.832527+0000","last_active":"2024-09-12T02:23:18.331594+0000","last_peered":"2024-09-12T02:23:18.331594+0000","last_clean":"2024-09-12T02:23:18.331594+0000","last_became_active":"2024-09-12T02:23:15.832184+0000","last_became_peered":"2024-09-12T02:23:15.832184+0000","last_unstale":"2024-09-12T02:23:18.331594+0000","last_undegraded":"2024-09-12T02:23:18.331594+0000","last_fullsized":"2024-09-12T02:23:18.331594+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:29.131198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840742+0000","last_change":"2024-09-12T02:23:16.849357+0000","last_active":"2024-09-12T02:23:17.840742+0000","last_peered":"2024-09-12T02:23:17.840742+0000","last_clean":"2024-09-12T02:23:17.840742+0000","last_became_active":"2024-09-12T02:23:16.849067+0000","last_became_peered":"2024-09-12T02:23:16.849067+0000","last_unstale":"2024-09-12T02:23:17.840742+0000","last_undegraded":"2024-09-12T02:23:17.840742+0000","last_fullsized":"2024-09-12T02:23:17.840742+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:06.887523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.843122+0000","last_change":"2024-09-12T02:23:04.791152+0000","last_active":"2024-09-12T02:23:17.843122+0000","last_peered":"2024-09-12T02:23:17.843122+0000","last_clean":"2024-09-12T02:23:17.843122+0000","last_became_active":"2024-09-12T02:23:04.790707+0000","last_became_peered":"2024-09-12T02:23:04.790707+0000","last_unstale":"2024-09-12T02:23:17.843122+0000","last_undegraded":"2024-09-12T02:23:17.843122+0000","last_fullsized":"2024-09-12T02:23:17.843122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:42.798507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673465+0000","last_change":"2024-09-12T02:23:03.763327+0000","last_active":"2024-09-12T02:23:18.673465+0000","last_peered":"2024-09-12T02:23:18.673465+0000","last_clean":"2024-09-12T02:23:18.673465+0000","last_became_active":"2024-09-12T02:23:03.763005+0000","last_became_peered":"2024-09-12T02:23:03.763005+0000","last_unstale":"2024-09-12T02:23:18.673465+0000","last_undegraded":"2024-09-12T02:23:18.673465+0000","last_fullsized":"2024-09-12T02:23:18.673465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:09.500459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325022+0000","last_change":"2024-09-12T02:23:15.819644+0000","last_active":"2024-09-12T02:23:18.325022+0000","last_peered":"2024-09-12T02:23:18.325022+0000","last_clean":"2024-09-12T02:23:18.325022+0000","last_became_active":"2024-09-12T02:23:15.819370+0000","last_became_peered":"2024-09-12T02:23:15.819370+0000","last_unstale":"2024-09-12T02:23:18.325022+0000","last_undegraded":"2024-09-12T02:23:18.325022+0000","last_fullsized":"2024-09-12T02:23:18.325022+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:56.384531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673028+0000","last_change":"2024-09-12T02:23:16.838234+0000","last_active":"2024-09-12T02:23:18.673028+0000","last_peered":"2024-09-12T02:23:18.673028+0000","last_clean":"2024-09-12T02:23:18.673028+0000","last_became_active":"2024-09-12T02:23:16.837942+0000","last_became_peered":"2024-09-12T02:23:16.837942+0000","last_unstale":"2024-09-12T02:23:18.673028+0000","last_undegraded":"2024-09-12T02:23:18.673028+0000","last_fullsized":"2024-09-12T02:23:18.673028+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:41.842931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842558+0000","last_change":"2024-09-12T02:23:04.781196+0000","last_active":"2024-09-12T02:23:17.842558+0000","last_peered":"2024-09-12T02:23:17.842558+0000","last_clean":"2024-09-12T02:23:17.842558+0000","last_became_active":"2024-09-12T02:23:04.780893+0000","last_became_peered":"2024-09-12T02:23:04.780893+0000","last_unstale":"2024-09-12T02:23:17.842558+0000","last_undegraded":"2024-09-12T02:23:17.842558+0000","last_fullsized":"2024-09-12T02:23:17.842558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:26.527539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842742+0000","last_change":"2024-09-12T02:23:03.769541+0000","last_active":"2024-09-12T02:23:17.842742+0000","last_peered":"2024-09-12T02:23:17.842742+0000","last_clean":"2024-09-12T02:23:17.842742+0000","last_became_active":"2024-09-12T02:23:03.765281+0000","last_became_peered":"2024-09-12T02:23:03.765281+0000","last_unstale":"2024-09-12T02:23:17.842742+0000","last_undegraded":"2024-09-12T02:23:17.842742+0000","last_fullsized":"2024-09-12T02:23:17.842742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:53.409370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841039+0000","last_change":"2024-09-12T02:23:15.841592+0000","last_active":"2024-09-12T02:23:17.841039+0000","last_peered":"2024-09-12T02:23:17.841039+0000","last_clean":"2024-09-12T02:23:17.841039+0000","last_became_active":"2024-09-12T02:23:15.841380+0000","last_became_peered":"2024-09-12T02:23:15.841380+0000","last_unstale":"2024-09-12T02:23:17.841039+0000","last_undegraded":"2024-09-12T02:23:17.841039+0000","last_fullsized":"2024-09-12T02:23:17.841039+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:38.396332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840229+0000","last_change":"2024-09-12T02:23:16.846596+0000","last_active":"2024-09-12T02:23:17.840229+0000","last_peered":"2024-09-12T02:23:17.840229+0000","last_clean":"2024-09-12T02:23:17.840229+0000","last_became_active":"2024-09-12T02:23:16.846273+0000","last_became_peered":"2024-09-12T02:23:16.846273+0000","last_unstale":"2024-09-12T02:23:17.840229+0000","last_undegraded":"2024-09-12T02:23:17.840229+0000","last_fullsized":"2024-09-12T02:23:17.840229+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:03.628494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841299+0000","last_change":"2024-09-12T02:23:04.781856+0000","last_active":"2024-09-12T02:23:17.841299+0000","last_peered":"2024-09-12T02:23:17.841299+0000","last_clean":"2024-09-12T02:23:17.841299+0000","last_became_active":"2024-09-12T02:23:04.781575+0000","last_became_peered":"2024-09-12T02:23:04.781575+0000","last_unstale":"2024-09-12T02:23:17.841299+0000","last_undegraded":"2024-09-12T02:23:17.841299+0000","last_fullsized":"2024-09-12T02:23:17.841299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:26.630558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673048+0000","last_change":"2024-09-12T02:23:03.771368+0000","last_active":"2024-09-12T02:23:18.673048+0000","last_peered":"2024-09-12T02:23:18.673048+0000","last_clean":"2024-09-12T02:23:18.673048+0000","last_became_active":"2024-09-12T02:23:03.771061+0000","last_became_peered":"2024-09-12T02:23:03.771061+0000","last_unstale":"2024-09-12T02:23:18.673048+0000","last_undegraded":"2024-09-12T02:23:18.673048+0000","last_fullsized":"2024-09-12T02:23:18.673048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:57.476458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.332045+0000","last_change":"2024-09-12T02:23:15.833158+0000","last_active":"2024-09-12T02:23:18.332045+0000","last_peered":"2024-09-12T02:23:18.332045+0000","last_clean":"2024-09-12T02:23:18.332045+0000","last_became_active":"2024-09-12T02:23:15.831707+0000","last_became_peered":"2024-09-12T02:23:15.831707+0000","last_unstale":"2024-09-12T02:23:18.332045+0000","last_undegraded":"2024-09-12T02:23:18.332045+0000","last_fullsized":"2024-09-12T02:23:18.332045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:30.000066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325904+0000","last_change":"2024-09-12T02:23:16.858757+0000","last_active":"2024-09-12T02:23:18.325904+0000","last_peered":"2024-09-12T02:23:18.325904+0000","last_clean":"2024-09-12T02:23:18.325904+0000","last_became_active":"2024-09-12T02:23:16.858469+0000","last_became_peered":"2024-09-12T02:23:16.858469+0000","last_unstale":"2024-09-12T02:23:18.325904+0000","last_undegraded":"2024-09-12T02:23:18.325904+0000","last_fullsized":"2024-09-12T02:23:18.325904+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:22.288143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597329+0000","last_change":"2024-09-12T02:23:04.785248+0000","last_active":"2024-09-12T02:23:19.597329+0000","last_peered":"2024-09-12T02:23:19.597329+0000","last_clean":"2024-09-12T02:23:19.597329+0000","last_became_active":"2024-09-12T02:23:04.784977+0000","last_became_peered":"2024-09-12T02:23:04.784977+0000","last_unstale":"2024-09-12T02:23:19.597329+0000","last_undegraded":"2024-09-12T02:23:19.597329+0000","last_fullsized":"2024-09-12T02:23:19.597329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:23.273457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597715+0000","last_change":"2024-09-12T02:23:03.767842+0000","last_active":"2024-09-12T02:23:19.597715+0000","last_peered":"2024-09-12T02:23:19.597715+0000","last_clean":"2024-09-12T02:23:19.597715+0000","last_became_active":"2024-09-12T02:23:03.767066+0000","last_became_peered":"2024-09-12T02:23:03.767066+0000","last_unstale":"2024-09-12T02:23:19.597715+0000","last_undegraded":"2024-09-12T02:23:19.597715+0000","last_fullsized":"2024-09-12T02:23:19.597715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:50.800749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840199+0000","last_change":"2024-09-12T02:23:15.826104+0000","last_active":"2024-09-12T02:23:17.840199+0000","last_peered":"2024-09-12T02:23:17.840199+0000","last_clean":"2024-09-12T02:23:17.840199+0000","last_became_active":"2024-09-12T02:23:15.825779+0000","last_became_peered":"2024-09-12T02:23:15.825779+0000","last_unstale":"2024-09-12T02:23:17.840199+0000","last_undegraded":"2024-09-12T02:23:17.840199+0000","last_fullsized":"2024-09-12T02:23:17.840199+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:32.661083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325654+0000","last_change":"2024-09-12T02:23:16.856543+0000","last_active":"2024-09-12T02:23:18.325654+0000","last_peered":"2024-09-12T02:23:18.325654+0000","last_clean":"2024-09-12T02:23:18.325654+0000","last_became_active":"2024-09-12T02:23:16.855538+0000","last_became_peered":"2024-09-12T02:23:16.855538+0000","last_unstale":"2024-09-12T02:23:18.325654+0000","last_undegraded":"2024-09-12T02:23:18.325654+0000","last_fullsized":"2024-09-12T02:23:18.325654+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:05.857593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841758+0000","last_change":"2024-09-12T02:23:04.783671+0000","last_active":"2024-09-12T02:23:17.841758+0000","last_peered":"2024-09-12T02:23:17.841758+0000","last_clean":"2024-09-12T02:23:17.841758+0000","last_became_active":"2024-09-12T02:23:04.783399+0000","last_became_peered":"2024-09-12T02:23:04.783399+0000","last_unstale":"2024-09-12T02:23:17.841758+0000","last_undegraded":"2024-09-12T02:23:17.841758+0000","last_fullsized":"2024-09-12T02:23:17.841758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:04.321789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325480+0000","last_change":"2024-09-12T02:23:03.767217+0000","last_active":"2024-09-12T02:23:18.325480+0000","last_peered":"2024-09-12T02:23:18.325480+0000","last_clean":"2024-09-12T02:23:18.325480+0000","last_became_active":"2024-09-12T02:23:03.766551+0000","last_became_peered":"2024-09-12T02:23:03.766551+0000","last_unstale":"2024-09-12T02:23:18.325480+0000","last_undegraded":"2024-09-12T02:23:18.325480+0000","last_fullsized":"2024-09-12T02:23:18.325480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:09.963450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"25'6","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839572+0000","last_change":"2024-09-12T02:23:15.832638+0000","last_active":"2024-09-12T02:23:17.839572+0000","last_peered":"2024-09-12T02:23:17.839572+0000","last_clean":"2024-09-12T02:23:17.839572+0000","last_became_active":"2024-09-12T02:23:15.832152+0000","last_became_peered":"2024-09-12T02:23:15.832152+0000","last_unstale":"2024-09-12T02:23:17.839572+0000","last_undegraded":"2024-09-12T02:23:17.839572+0000","last_fullsized":"2024-09-12T02:23:17.839572+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:06.820636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839619+0000","last_change":"2024-09-12T02:23:16.846920+0000","last_active":"2024-09-12T02:23:17.839619+0000","last_peered":"2024-09-12T02:23:17.839619+0000","last_clean":"2024-09-12T02:23:17.839619+0000","last_became_active":"2024-09-12T02:23:16.846454+0000","last_became_peered":"2024-09-12T02:23:16.846454+0000","last_unstale":"2024-09-12T02:23:17.839619+0000","last_undegraded":"2024-09-12T02:23:17.839619+0000","last_fullsized":"2024-09-12T02:23:17.839619+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:51.782998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331516+0000","last_change":"2024-09-12T02:23:04.784379+0000","last_active":"2024-09-12T02:23:18.331516+0000","last_peered":"2024-09-12T02:23:18.331516+0000","last_clean":"2024-09-12T02:23:18.331516+0000","last_became_active":"2024-09-12T02:23:04.784094+0000","last_became_peered":"2024-09-12T02:23:04.784094+0000","last_unstale":"2024-09-12T02:23:18.331516+0000","last_undegraded":"2024-09-12T02:23:18.331516+0000","last_fullsized":"2024-09-12T02:23:18.331516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:22.103008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.332137+0000","last_change":"2024-09-12T02:23:03.762859+0000","last_active":"2024-09-12T02:23:18.332137+0000","last_peered":"2024-09-12T02:23:18.332137+0000","last_clean":"2024-09-12T02:23:18.332137+0000","last_became_active":"2024-09-12T02:23:03.762557+0000","last_became_peered":"2024-09-12T02:23:03.762557+0000","last_unstale":"2024-09-12T02:23:18.332137+0000","last_undegraded":"2024-09-12T02:23:18.332137+0000","last_fullsized":"2024-09-12T02:23:18.332137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:34.863435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"25'3","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325835+0000","last_change":"2024-09-12T02:23:15.823090+0000","last_active":"2024-09-12T02:23:18.325835+0000","last_peered":"2024-09-12T02:23:18.325835+0000","last_clean":"2024-09-12T02:23:18.325835+0000","last_became_active":"2024-09-12T02:23:15.822441+0000","last_became_peered":"2024-09-12T02:23:15.822441+0000","last_unstale":"2024-09-12T02:23:18.325835+0000","last_undegraded":"2024-09-12T02:23:18.325835+0000","last_fullsized":"2024-09-12T02:23:18.325835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:35.125478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839147+0000","last_change":"2024-09-12T02:23:16.839875+0000","last_active":"2024-09-12T02:23:17.839147+0000","last_peered":"2024-09-12T02:23:17.839147+0000","last_clean":"2024-09-12T02:23:17.839147+0000","last_became_active":"2024-09-12T02:23:16.838277+0000","last_became_peered":"2024-09-12T02:23:16.838277+0000","last_unstale":"2024-09-12T02:23:17.839147+0000","last_undegraded":"2024-09-12T02:23:17.839147+0000","last_fullsized":"2024-09-12T02:23:17.839147+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:09.370310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842288+0000","last_change":"2024-09-12T02:23:04.780843+0000","last_active":"2024-09-12T02:23:17.842288+0000","last_peered":"2024-09-12T02:23:17.842288+0000","last_clean":"2024-09-12T02:23:17.842288+0000","last_became_active":"2024-09-12T02:23:04.780475+0000","last_became_peered":"2024-09-12T02:23:04.780475+0000","last_unstale":"2024-09-12T02:23:17.842288+0000","last_undegraded":"2024-09-12T02:23:17.842288+0000","last_fullsized":"2024-09-12T02:23:17.842288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:38.074872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:33.256453+0000","last_change":"2024-09-12T02:23:03.768425+0000","last_active":"2024-09-12T02:23:33.256453+0000","last_peered":"2024-09-12T02:23:33.256453+0000","last_clean":"2024-09-12T02:23:33.256453+0000","last_became_active":"2024-09-12T02:23:03.768092+0000","last_became_peered":"2024-09-12T02:23:03.768092+0000","last_unstale":"2024-09-12T02:23:33.256453+0000","last_undegraded":"2024-09-12T02:23:33.256453+0000","last_fullsized":"2024-09-12T02:23:33.256453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:18.572070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2055,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444109+0000","last_change":"2024-09-12T02:23:15.829364+0000","last_active":"2024-09-12T02:23:18.444109+0000","last_peered":"2024-09-12T02:23:18.444109+0000","last_clean":"2024-09-12T02:23:18.444109+0000","last_became_active":"2024-09-12T02:23:15.827936+0000","last_became_peered":"2024-09-12T02:23:15.827936+0000","last_unstale":"2024-09-12T02:23:18.444109+0000","last_undegraded":"2024-09-12T02:23:18.444109+0000","last_fullsized":"2024-09-12T02:23:18.444109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:04.973202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444416+0000","last_change":"2024-09-12T02:23:16.854209+0000","last_active":"2024-09-12T02:23:18.444416+0000","last_peered":"2024-09-12T02:23:18.444416+0000","last_clean":"2024-09-12T02:23:18.444416+0000","last_became_active":"2024-09-12T02:23:16.853900+0000","last_became_peered":"2024-09-12T02:23:16.853900+0000","last_unstale":"2024-09-12T02:23:18.444416+0000","last_undegraded":"2024-09-12T02:23:18.444416+0000","last_fullsized":"2024-09-12T02:23:18.444416+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:52.831434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842656+0000","last_change":"2024-09-12T02:23:04.777953+0000","last_active":"2024-09-12T02:23:17.842656+0000","last_peered":"2024-09-12T02:23:17.842656+0000","last_clean":"2024-09-12T02:23:17.842656+0000","last_became_active":"2024-09-12T02:23:04.777081+0000","last_became_peered":"2024-09-12T02:23:04.777081+0000","last_unstale":"2024-09-12T02:23:17.842656+0000","last_undegraded":"2024-09-12T02:23:17.842656+0000","last_fullsized":"2024-09-12T02:23:17.842656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:14.103378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444886+0000","last_change":"2024-09-12T02:23:03.771271+0000","last_active":"2024-09-12T02:23:18.444886+0000","last_peered":"2024-09-12T02:23:18.444886+0000","last_clean":"2024-09-12T02:23:18.444886+0000","last_became_active":"2024-09-12T02:23:03.769601+0000","last_became_peered":"2024-09-12T02:23:03.769601+0000","last_unstale":"2024-09-12T02:23:18.444886+0000","last_undegraded":"2024-09-12T02:23:18.444886+0000","last_fullsized":"2024-09-12T02:23:18.444886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:22.910072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842076+0000","last_change":"2024-09-12T02:23:15.831522+0000","last_active":"2024-09-12T02:23:17.842076+0000","last_peered":"2024-09-12T02:23:17.842076+0000","last_clean":"2024-09-12T02:23:17.842076+0000","last_became_active":"2024-09-12T02:23:15.831220+0000","last_became_peered":"2024-09-12T02:23:15.831220+0000","last_unstale":"2024-09-12T02:23:17.842076+0000","last_undegraded":"2024-09-12T02:23:17.842076+0000","last_fullsized":"2024-09-12T02:23:17.842076+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:54.337051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597564+0000","last_change":"2024-09-12T02:23:16.858361+0000","last_active":"2024-09-12T02:23:19.597564+0000","last_peered":"2024-09-12T02:23:19.597564+0000","last_clean":"2024-09-12T02:23:19.597564+0000","last_became_active":"2024-09-12T02:23:16.858075+0000","last_became_peered":"2024-09-12T02:23:16.858075+0000","last_unstale":"2024-09-12T02:23:19.597564+0000","last_undegraded":"2024-09-12T02:23:19.597564+0000","last_fullsized":"2024-09-12T02:23:19.597564+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:35.038604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331887+0000","last_change":"2024-09-12T02:23:04.779171+0000","last_active":"2024-09-12T02:23:18.331887+0000","last_peered":"2024-09-12T02:23:18.331887+0000","last_clean":"2024-09-12T02:23:18.331887+0000","last_became_active":"2024-09-12T02:23:04.778850+0000","last_became_peered":"2024-09-12T02:23:04.778850+0000","last_unstale":"2024-09-12T02:23:18.331887+0000","last_undegraded":"2024-09-12T02:23:18.331887+0000","last_fullsized":"2024-09-12T02:23:18.331887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:21.746490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325975+0000","last_change":"2024-09-12T02:23:03.769710+0000","last_active":"2024-09-12T02:23:18.325975+0000","last_peered":"2024-09-12T02:23:18.325975+0000","last_clean":"2024-09-12T02:23:18.325975+0000","last_became_active":"2024-09-12T02:23:03.769436+0000","last_became_peered":"2024-09-12T02:23:03.769436+0000","last_unstale":"2024-09-12T02:23:18.325975+0000","last_undegraded":"2024-09-12T02:23:18.325975+0000","last_fullsized":"2024-09-12T02:23:18.325975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:11.194147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"25'8","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.838898+0000","last_change":"2024-09-12T02:23:15.833196+0000","last_active":"2024-09-12T02:23:17.838898+0000","last_peered":"2024-09-12T02:23:17.838898+0000","last_clean":"2024-09-12T02:23:17.838898+0000","last_became_active":"2024-09-12T02:23:15.832873+0000","last_became_peered":"2024-09-12T02:23:15.832873+0000","last_unstale":"2024-09-12T02:23:17.838898+0000","last_undegraded":"2024-09-12T02:23:17.838898+0000","last_fullsized":"2024-09-12T02:23:17.838898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:15.238046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840614+0000","last_change":"2024-09-12T02:23:16.856735+0000","last_active":"2024-09-12T02:23:17.840614+0000","last_peered":"2024-09-12T02:23:17.840614+0000","last_clean":"2024-09-12T02:23:17.840614+0000","last_became_active":"2024-09-12T02:23:16.856455+0000","last_became_peered":"2024-09-12T02:23:16.856455+0000","last_unstale":"2024-09-12T02:23:17.840614+0000","last_undegraded":"2024-09-12T02:23:17.840614+0000","last_fullsized":"2024-09-12T02:23:17.840614+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:55.376194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325968+0000","last_change":"2024-09-12T02:23:04.786100+0000","last_active":"2024-09-12T02:23:18.325968+0000","last_peered":"2024-09-12T02:23:18.325968+0000","last_clean":"2024-09-12T02:23:18.325968+0000","last_became_active":"2024-09-12T02:23:04.785795+0000","last_became_peered":"2024-09-12T02:23:04.785795+0000","last_unstale":"2024-09-12T02:23:18.325968+0000","last_undegraded":"2024-09-12T02:23:18.325968+0000","last_fullsized":"2024-09-12T02:23:18.325968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:58.597807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.598224+0000","last_change":"2024-09-12T02:23:03.770668+0000","last_active":"2024-09-12T02:23:19.598224+0000","last_peered":"2024-09-12T02:23:19.598224+0000","last_clean":"2024-09-12T02:23:19.598224+0000","last_became_active":"2024-09-12T02:23:03.769302+0000","last_became_peered":"2024-09-12T02:23:03.769302+0000","last_unstale":"2024-09-12T02:23:19.598224+0000","last_undegraded":"2024-09-12T02:23:19.598224+0000","last_fullsized":"2024-09-12T02:23:19.598224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:18.948922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.838826+0000","last_change":"2024-09-12T02:23:15.825585+0000","last_active":"2024-09-12T02:23:17.838826+0000","last_peered":"2024-09-12T02:23:17.838826+0000","last_clean":"2024-09-12T02:23:17.838826+0000","last_became_active":"2024-09-12T02:23:15.825305+0000","last_became_peered":"2024-09-12T02:23:15.825305+0000","last_unstale":"2024-09-12T02:23:17.838826+0000","last_undegraded":"2024-09-12T02:23:17.838826+0000","last_fullsized":"2024-09-12T02:23:17.838826+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:43.818922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.598136+0000","last_change":"2024-09-12T02:23:16.852415+0000","last_active":"2024-09-12T02:23:19.598136+0000","last_peered":"2024-09-12T02:23:19.598136+0000","last_clean":"2024-09-12T02:23:19.598136+0000","last_became_active":"2024-09-12T02:23:16.852061+0000","last_became_peered":"2024-09-12T02:23:16.852061+0000","last_unstale":"2024-09-12T02:23:19.598136+0000","last_undegraded":"2024-09-12T02:23:19.598136+0000","last_fullsized":"2024-09-12T02:23:19.598136+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:30:49.720576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331783+0000","last_change":"2024-09-12T02:23:15.833414+0000","last_active":"2024-09-12T02:23:18.331783+0000","last_peered":"2024-09-12T02:23:18.331783+0000","last_clean":"2024-09-12T02:23:18.331783+0000","last_became_active":"2024-09-12T02:23:15.832837+0000","last_became_peered":"2024-09-12T02:23:15.832837+0000","last_unstale":"2024-09-12T02:23:18.331783+0000","last_undegraded":"2024-09-12T02:23:18.331783+0000","last_fullsized":"2024-09-12T02:23:18.331783+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:31.510160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444086+0000","last_change":"2024-09-12T02:23:04.776572+0000","last_active":"2024-09-12T02:23:18.444086+0000","last_peered":"2024-09-12T02:23:18.444086+0000","last_clean":"2024-09-12T02:23:18.444086+0000","last_became_active":"2024-09-12T02:23:04.776270+0000","last_became_peered":"2024-09-12T02:23:04.776270+0000","last_unstale":"2024-09-12T02:23:18.444086+0000","last_undegraded":"2024-09-12T02:23:18.444086+0000","last_fullsized":"2024-09-12T02:23:18.444086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:12.807907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325207+0000","last_change":"2024-09-12T02:23:03.762450+0000","last_active":"2024-09-12T02:23:18.325207+0000","last_peered":"2024-09-12T02:23:18.325207+0000","last_clean":"2024-09-12T02:23:18.325207+0000","last_became_active":"2024-09-12T02:23:03.762161+0000","last_became_peered":"2024-09-12T02:23:03.762161+0000","last_unstale":"2024-09-12T02:23:18.325207+0000","last_undegraded":"2024-09-12T02:23:18.325207+0000","last_fullsized":"2024-09-12T02:23:18.325207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:42.256395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331804+0000","last_change":"2024-09-12T02:23:16.844537+0000","last_active":"2024-09-12T02:23:18.331804+0000","last_peered":"2024-09-12T02:23:18.331804+0000","last_clean":"2024-09-12T02:23:18.331804+0000","last_became_active":"2024-09-12T02:23:16.844248+0000","last_became_peered":"2024-09-12T02:23:16.844248+0000","last_unstale":"2024-09-12T02:23:18.331804+0000","last_undegraded":"2024-09-12T02:23:18.331804+0000","last_fullsized":"2024-09-12T02:23:18.331804+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:45.801324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"25'4","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.598147+0000","last_change":"2024-09-12T02:23:15.826010+0000","last_active":"2024-09-12T02:23:19.598147+0000","last_peered":"2024-09-12T02:23:19.598147+0000","last_clean":"2024-09-12T02:23:19.598147+0000","last_became_active":"2024-09-12T02:23:15.825730+0000","last_became_peered":"2024-09-12T02:23:15.825730+0000","last_unstale":"2024-09-12T02:23:19.598147+0000","last_undegraded":"2024-09-12T02:23:19.598147+0000","last_fullsized":"2024-09-12T02:23:19.598147+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:17.920975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839339+0000","last_change":"2024-09-12T02:23:04.783317+0000","last_active":"2024-09-12T02:23:17.839339+0000","last_peered":"2024-09-12T02:23:17.839339+0000","last_clean":"2024-09-12T02:23:17.839339+0000","last_became_active":"2024-09-12T02:23:04.783039+0000","last_became_peered":"2024-09-12T02:23:04.783039+0000","last_unstale":"2024-09-12T02:23:17.839339+0000","last_undegraded":"2024-09-12T02:23:17.839339+0000","last_fullsized":"2024-09-12T02:23:17.839339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:17.577991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839055+0000","last_change":"2024-09-12T02:23:03.768361+0000","last_active":"2024-09-12T02:23:17.839055+0000","last_peered":"2024-09-12T02:23:17.839055+0000","last_clean":"2024-09-12T02:23:17.839055+0000","last_became_active":"2024-09-12T02:23:03.768137+0000","last_became_peered":"2024-09-12T02:23:03.768137+0000","last_unstale":"2024-09-12T02:23:17.839055+0000","last_undegraded":"2024-09-12T02:23:17.839055+0000","last_fullsized":"2024-09-12T02:23:17.839055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:29.721363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444813+0000","last_change":"2024-09-12T02:23:16.861251+0000","last_active":"2024-09-12T02:23:18.444813+0000","last_peered":"2024-09-12T02:23:18.444813+0000","last_clean":"2024-09-12T02:23:18.444813+0000","last_became_active":"2024-09-12T02:23:16.860980+0000","last_became_peered":"2024-09-12T02:23:16.860980+0000","last_unstale":"2024-09-12T02:23:18.444813+0000","last_undegraded":"2024-09-12T02:23:18.444813+0000","last_fullsized":"2024-09-12T02:23:18.444813+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:16.177179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597691+0000","last_change":"2024-09-12T02:23:03.768186+0000","last_active":"2024-09-12T02:23:19.597691+0000","last_peered":"2024-09-12T02:23:19.597691+0000","last_clean":"2024-09-12T02:23:19.597691+0000","last_became_active":"2024-09-12T02:23:03.767916+0000","last_became_peered":"2024-09-12T02:23:03.767916+0000","last_unstale":"2024-09-12T02:23:19.597691+0000","last_undegraded":"2024-09-12T02:23:19.597691+0000","last_fullsized":"2024-09-12T02:23:19.597691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:04.424540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.332085+0000","last_change":"2024-09-12T02:23:04.793412+0000","last_active":"2024-09-12T02:23:18.332085+0000","last_peered":"2024-09-12T02:23:18.332085+0000","last_clean":"2024-09-12T02:23:18.332085+0000","last_became_active":"2024-09-12T02:23:04.793100+0000","last_became_peered":"2024-09-12T02:23:04.793100+0000","last_unstale":"2024-09-12T02:23:18.332085+0000","last_undegraded":"2024-09-12T02:23:18.332085+0000","last_fullsized":"2024-09-12T02:23:18.332085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:50.446212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673306+0000","last_change":"2024-09-12T02:23:15.830776+0000","last_active":"2024-09-12T02:23:18.673306+0000","last_peered":"2024-09-12T02:23:18.673306+0000","last_clean":"2024-09-12T02:23:18.673306+0000","last_became_active":"2024-09-12T02:23:15.830492+0000","last_became_peered":"2024-09-12T02:23:15.830492+0000","last_unstale":"2024-09-12T02:23:18.673306+0000","last_undegraded":"2024-09-12T02:23:18.673306+0000","last_fullsized":"2024-09-12T02:23:18.673306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:40.517292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840575+0000","last_change":"2024-09-12T02:23:16.851953+0000","last_active":"2024-09-12T02:23:17.840575+0000","last_peered":"2024-09-12T02:23:17.840575+0000","last_clean":"2024-09-12T02:23:17.840575+0000","last_became_active":"2024-09-12T02:23:16.851558+0000","last_became_peered":"2024-09-12T02:23:16.851558+0000","last_unstale":"2024-09-12T02:23:17.840575+0000","last_undegraded":"2024-09-12T02:23:17.840575+0000","last_fullsized":"2024-09-12T02:23:17.840575+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:29.852193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839423+0000","last_change":"2024-09-12T02:23:03.764310+0000","last_active":"2024-09-12T02:23:17.839423+0000","last_peered":"2024-09-12T02:23:17.839423+0000","last_clean":"2024-09-12T02:23:17.839423+0000","last_became_active":"2024-09-12T02:23:03.764020+0000","last_became_peered":"2024-09-12T02:23:03.764020+0000","last_unstale":"2024-09-12T02:23:17.839423+0000","last_undegraded":"2024-09-12T02:23:17.839423+0000","last_fullsized":"2024-09-12T02:23:17.839423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:25.892874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841038+0000","last_change":"2024-09-12T02:23:04.771579+0000","last_active":"2024-09-12T02:23:17.841038+0000","last_peered":"2024-09-12T02:23:17.841038+0000","last_clean":"2024-09-12T02:23:17.841038+0000","last_became_active":"2024-09-12T02:23:04.771310+0000","last_became_peered":"2024-09-12T02:23:04.771310+0000","last_unstale":"2024-09-12T02:23:17.841038+0000","last_undegraded":"2024-09-12T02:23:17.841038+0000","last_fullsized":"2024-09-12T02:23:17.841038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:05.115474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839742+0000","last_change":"2024-09-12T02:23:15.832757+0000","last_active":"2024-09-12T02:23:17.839742+0000","last_peered":"2024-09-12T02:23:17.839742+0000","last_clean":"2024-09-12T02:23:17.839742+0000","last_became_active":"2024-09-12T02:23:15.832478+0000","last_became_peered":"2024-09-12T02:23:15.832478+0000","last_unstale":"2024-09-12T02:23:17.839742+0000","last_undegraded":"2024-09-12T02:23:17.839742+0000","last_fullsized":"2024-09-12T02:23:17.839742+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:29.301251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839974+0000","last_change":"2024-09-12T02:23:16.848437+0000","last_active":"2024-09-12T02:23:17.839974+0000","last_peered":"2024-09-12T02:23:17.839974+0000","last_clean":"2024-09-12T02:23:17.839974+0000","last_became_active":"2024-09-12T02:23:16.847063+0000","last_became_peered":"2024-09-12T02:23:16.847063+0000","last_unstale":"2024-09-12T02:23:17.839974+0000","last_undegraded":"2024-09-12T02:23:17.839974+0000","last_fullsized":"2024-09-12T02:23:17.839974+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:49.979448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597310+0000","last_change":"2024-09-12T02:23:04.788489+0000","last_active":"2024-09-12T02:23:19.597310+0000","last_peered":"2024-09-12T02:23:19.597310+0000","last_clean":"2024-09-12T02:23:19.597310+0000","last_became_active":"2024-09-12T02:23:04.788195+0000","last_became_peered":"2024-09-12T02:23:04.788195+0000","last_unstale":"2024-09-12T02:23:19.597310+0000","last_undegraded":"2024-09-12T02:23:19.597310+0000","last_fullsized":"2024-09-12T02:23:19.597310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:51.352859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444586+0000","last_change":"2024-09-12T02:23:16.843805+0000","last_active":"2024-09-12T02:23:18.444586+0000","last_peered":"2024-09-12T02:23:18.444586+0000","last_clean":"2024-09-12T02:23:18.444586+0000","last_became_active":"2024-09-12T02:23:16.843517+0000","last_became_peered":"2024-09-12T02:23:16.843517+0000","last_unstale":"2024-09-12T02:23:18.444586+0000","last_undegraded":"2024-09-12T02:23:18.444586+0000","last_fullsized":"2024-09-12T02:23:18.444586+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:30.873311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673159+0000","last_change":"2024-09-12T02:23:04.780662+0000","last_active":"2024-09-12T02:23:18.673159+0000","last_peered":"2024-09-12T02:23:18.673159+0000","last_clean":"2024-09-12T02:23:18.673159+0000","last_became_active":"2024-09-12T02:23:04.780402+0000","last_became_peered":"2024-09-12T02:23:04.780402+0000","last_unstale":"2024-09-12T02:23:18.673159+0000","last_undegraded":"2024-09-12T02:23:18.673159+0000","last_fullsized":"2024-09-12T02:23:18.673159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:23:00.556487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325531+0000","last_change":"2024-09-12T02:23:16.852992+0000","last_active":"2024-09-12T02:23:18.325531+0000","last_peered":"2024-09-12T02:23:18.325531+0000","last_clean":"2024-09-12T02:23:18.325531+0000","last_became_active":"2024-09-12T02:23:16.852706+0000","last_became_peered":"2024-09-12T02:23:16.852706+0000","last_unstale":"2024-09-12T02:23:18.325531+0000","last_undegraded":"2024-09-12T02:23:18.325531+0000","last_fullsized":"2024-09-12T02:23:18.325531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:56.896457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325468+0000","last_change":"2024-09-12T02:23:04.785920+0000","last_active":"2024-09-12T02:23:18.325468+0000","last_peered":"2024-09-12T02:23:18.325468+0000","last_clean":"2024-09-12T02:23:18.325468+0000","last_became_active":"2024-09-12T02:23:04.785422+0000","last_became_peered":"2024-09-12T02:23:04.785422+0000","last_unstale":"2024-09-12T02:23:18.325468+0000","last_undegraded":"2024-09-12T02:23:18.325468+0000","last_fullsized":"2024-09-12T02:23:18.325468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:55.106703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444779+0000","last_change":"2024-09-12T02:23:16.861939+0000","last_active":"2024-09-12T02:23:18.444779+0000","last_peered":"2024-09-12T02:23:18.444779+0000","last_clean":"2024-09-12T02:23:18.444779+0000","last_became_active":"2024-09-12T02:23:16.861658+0000","last_became_peered":"2024-09-12T02:23:16.861658+0000","last_unstale":"2024-09-12T02:23:18.444779+0000","last_undegraded":"2024-09-12T02:23:18.444779+0000","last_fullsized":"2024-09-12T02:23:18.444779+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:06.755715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331991+0000","last_change":"2024-09-12T02:23:04.777018+0000","last_active":"2024-09-12T02:23:18.331991+0000","last_peered":"2024-09-12T02:23:18.331991+0000","last_clean":"2024-09-12T02:23:18.331991+0000","last_became_active":"2024-09-12T02:23:04.776736+0000","last_became_peered":"2024-09-12T02:23:04.776736+0000","last_unstale":"2024-09-12T02:23:18.331991+0000","last_undegraded":"2024-09-12T02:23:18.331991+0000","last_fullsized":"2024-09-12T02:23:18.331991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:08.668990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840760+0000","last_change":"2024-09-12T02:23:16.847615+0000","last_active":"2024-09-12T02:23:17.840760+0000","last_peered":"2024-09-12T02:23:17.840760+0000","last_clean":"2024-09-12T02:23:17.840760+0000","last_became_active":"2024-09-12T02:23:16.847260+0000","last_became_peered":"2024-09-12T02:23:16.847260+0000","last_unstale":"2024-09-12T02:23:17.840760+0000","last_undegraded":"2024-09-12T02:23:17.840760+0000","last_fullsized":"2024-09-12T02:23:17.840760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:48.920477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839828+0000","last_change":"2024-09-12T02:23:04.789372+0000","last_active":"2024-09-12T02:23:17.839828+0000","last_peered":"2024-09-12T02:23:17.839828+0000","last_clean":"2024-09-12T02:23:17.839828+0000","last_became_active":"2024-09-12T02:23:04.789090+0000","last_became_peered":"2024-09-12T02:23:04.789090+0000","last_unstale":"2024-09-12T02:23:17.839828+0000","last_undegraded":"2024-09-12T02:23:17.839828+0000","last_fullsized":"2024-09-12T02:23:17.839828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:49.533491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841815+0000","last_change":"2024-09-12T02:23:16.859000+0000","last_active":"2024-09-12T02:23:17.841815+0000","last_peered":"2024-09-12T02:23:17.841815+0000","last_clean":"2024-09-12T02:23:17.841815+0000","last_became_active":"2024-09-12T02:23:16.858637+0000","last_became_peered":"2024-09-12T02:23:16.858637+0000","last_unstale":"2024-09-12T02:23:17.841815+0000","last_undegraded":"2024-09-12T02:23:17.841815+0000","last_fullsized":"2024-09-12T02:23:17.841815+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:47.915947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444881+0000","last_change":"2024-09-12T02:23:04.776435+0000","last_active":"2024-09-12T02:23:18.444881+0000","last_peered":"2024-09-12T02:23:18.444881+0000","last_clean":"2024-09-12T02:23:18.444881+0000","last_became_active":"2024-09-12T02:23:04.776120+0000","last_became_peered":"2024-09-12T02:23:04.776120+0000","last_unstale":"2024-09-12T02:23:18.444881+0000","last_undegraded":"2024-09-12T02:23:18.444881+0000","last_fullsized":"2024-09-12T02:23:18.444881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:27.985094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840466+0000","last_change":"2024-09-12T02:23:16.856477+0000","last_active":"2024-09-12T02:23:17.840466+0000","last_peered":"2024-09-12T02:23:17.840466+0000","last_clean":"2024-09-12T02:23:17.840466+0000","last_became_active":"2024-09-12T02:23:16.855839+0000","last_became_peered":"2024-09-12T02:23:16.855839+0000","last_unstale":"2024-09-12T02:23:17.840466+0000","last_undegraded":"2024-09-12T02:23:17.840466+0000","last_fullsized":"2024-09-12T02:23:17.840466+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:42.510184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.598050+0000","last_change":"2024-09-12T02:23:04.788827+0000","last_active":"2024-09-12T02:23:19.598050+0000","last_peered":"2024-09-12T02:23:19.598050+0000","last_clean":"2024-09-12T02:23:19.598050+0000","last_became_active":"2024-09-12T02:23:04.788521+0000","last_became_peered":"2024-09-12T02:23:04.788521+0000","last_unstale":"2024-09-12T02:23:19.598050+0000","last_undegraded":"2024-09-12T02:23:19.598050+0000","last_fullsized":"2024-09-12T02:23:19.598050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:24.470245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597525+0000","last_change":"2024-09-12T02:23:16.838421+0000","last_active":"2024-09-12T02:23:19.597525+0000","last_peered":"2024-09-12T02:23:19.597525+0000","last_clean":"2024-09-12T02:23:19.597525+0000","last_became_active":"2024-09-12T02:23:16.837606+0000","last_became_peered":"2024-09-12T02:23:16.837606+0000","last_unstale":"2024-09-12T02:23:19.597525+0000","last_undegraded":"2024-09-12T02:23:19.597525+0000","last_fullsized":"2024-09-12T02:23:19.597525+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:09.704007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840259+0000","last_change":"2024-09-12T02:23:04.787899+0000","last_active":"2024-09-12T02:23:17.840259+0000","last_peered":"2024-09-12T02:23:17.840259+0000","last_clean":"2024-09-12T02:23:17.840259+0000","last_became_active":"2024-09-12T02:23:04.787619+0000","last_became_peered":"2024-09-12T02:23:04.787619+0000","last_unstale":"2024-09-12T02:23:17.840259+0000","last_undegraded":"2024-09-12T02:23:17.840259+0000","last_fullsized":"2024-09-12T02:23:17.840259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:57.732453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839922+0000","last_change":"2024-09-12T02:23:16.845296+0000","last_active":"2024-09-12T02:23:17.839922+0000","last_peered":"2024-09-12T02:23:17.839922+0000","last_clean":"2024-09-12T02:23:17.839922+0000","last_became_active":"2024-09-12T02:23:16.844939+0000","last_became_peered":"2024-09-12T02:23:16.844939+0000","last_unstale":"2024-09-12T02:23:17.839922+0000","last_undegraded":"2024-09-12T02:23:17.839922+0000","last_fullsized":"2024-09-12T02:23:17.839922+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:16.790822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325133+0000","last_change":"2024-09-12T02:23:04.787389+0000","last_active":"2024-09-12T02:23:18.325133+0000","last_peered":"2024-09-12T02:23:18.325133+0000","last_clean":"2024-09-12T02:23:18.325133+0000","last_became_active":"2024-09-12T02:23:04.787092+0000","last_became_peered":"2024-09-12T02:23:04.787092+0000","last_unstale":"2024-09-12T02:23:18.325133+0000","last_undegraded":"2024-09-12T02:23:18.325133+0000","last_fullsized":"2024-09-12T02:23:18.325133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:02.924906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.843281+0000","last_change":"2024-09-12T02:23:16.849846+0000","last_active":"2024-09-12T02:23:17.843281+0000","last_peered":"2024-09-12T02:23:17.843281+0000","last_clean":"2024-09-12T02:23:17.843281+0000","last_became_active":"2024-09-12T02:23:16.849585+0000","last_became_peered":"2024-09-12T02:23:16.849585+0000","last_unstale":"2024-09-12T02:23:17.843281+0000","last_undegraded":"2024-09-12T02:23:17.843281+0000","last_fullsized":"2024-09-12T02:23:17.843281+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:58.775679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839012+0000","last_change":"2024-09-12T02:23:04.788624+0000","last_active":"2024-09-12T02:23:17.839012+0000","last_peered":"2024-09-12T02:23:17.839012+0000","last_clean":"2024-09-12T02:23:17.839012+0000","last_became_active":"2024-09-12T02:23:04.788352+0000","last_became_peered":"2024-09-12T02:23:04.788352+0000","last_unstale":"2024-09-12T02:23:17.839012+0000","last_undegraded":"2024-09-12T02:23:17.839012+0000","last_fullsized":"2024-09-12T02:23:17.839012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:13.961110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673339+0000","last_change":"2024-09-12T02:23:16.850112+0000","last_active":"2024-09-12T02:23:18.673339+0000","last_peered":"2024-09-12T02:23:18.673339+0000","last_clean":"2024-09-12T02:23:18.673339+0000","last_became_active":"2024-09-12T02:23:16.849831+0000","last_became_peered":"2024-09-12T02:23:16.849831+0000","last_unstale":"2024-09-12T02:23:18.673339+0000","last_undegraded":"2024-09-12T02:23:18.673339+0000","last_fullsized":"2024-09-12T02:23:18.673339+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:42.625762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325319+0000","last_change":"2024-09-12T02:23:04.785685+0000","last_active":"2024-09-12T02:23:18.325319+0000","last_peered":"2024-09-12T02:23:18.325319+0000","last_clean":"2024-09-12T02:23:18.325319+0000","last_became_active":"2024-09-12T02:23:04.784945+0000","last_became_peered":"2024-09-12T02:23:04.784945+0000","last_unstale":"2024-09-12T02:23:18.325319+0000","last_undegraded":"2024-09-12T02:23:18.325319+0000","last_fullsized":"2024-09-12T02:23:18.325319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:36.658436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839639+0000","last_change":"2024-09-12T02:23:16.846108+0000","last_active":"2024-09-12T02:23:17.839639+0000","last_peered":"2024-09-12T02:23:17.839639+0000","last_clean":"2024-09-12T02:23:17.839639+0000","last_became_active":"2024-09-12T02:23:16.845793+0000","last_became_peered":"2024-09-12T02:23:16.845793+0000","last_unstale":"2024-09-12T02:23:17.839639+0000","last_undegraded":"2024-09-12T02:23:17.839639+0000","last_fullsized":"2024-09-12T02:23:17.839639+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:36.274858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331880+0000","last_change":"2024-09-12T02:23:04.785849+0000","last_active":"2024-09-12T02:23:18.331880+0000","last_peered":"2024-09-12T02:23:18.331880+0000","last_clean":"2024-09-12T02:23:18.331880+0000","last_became_active":"2024-09-12T02:23:04.785511+0000","last_became_peered":"2024-09-12T02:23:04.785511+0000","last_unstale":"2024-09-12T02:23:18.331880+0000","last_undegraded":"2024-09-12T02:23:18.331880+0000","last_fullsized":"2024-09-12T02:23:18.331880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:28.670102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840717+0000","last_change":"2024-09-12T02:23:16.855615+0000","last_active":"2024-09-12T02:23:17.840717+0000","last_peered":"2024-09-12T02:23:17.840717+0000","last_clean":"2024-09-12T02:23:17.840717+0000","last_became_active":"2024-09-12T02:23:16.855278+0000","last_became_peered":"2024-09-12T02:23:16.855278+0000","last_unstale":"2024-09-12T02:23:17.840717+0000","last_undegraded":"2024-09-12T02:23:17.840717+0000","last_fullsized":"2024-09-12T02:23:17.840717+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:34.214175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597577+0000","last_change":"2024-09-12T02:23:04.789575+0000","last_active":"2024-09-12T02:23:19.597577+0000","last_peered":"2024-09-12T02:23:19.597577+0000","last_clean":"2024-09-12T02:23:19.597577+0000","last_became_active":"2024-09-12T02:23:04.789296+0000","last_became_peered":"2024-09-12T02:23:04.789296+0000","last_unstale":"2024-09-12T02:23:19.597577+0000","last_undegraded":"2024-09-12T02:23:19.597577+0000","last_fullsized":"2024-09-12T02:23:19.597577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:13.166139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841521+0000","last_change":"2024-09-12T02:23:16.858045+0000","last_active":"2024-09-12T02:23:17.841521+0000","last_peered":"2024-09-12T02:23:17.841521+0000","last_clean":"2024-09-12T02:23:17.841521+0000","last_became_active":"2024-09-12T02:23:16.857772+0000","last_became_peered":"2024-09-12T02:23:16.857772+0000","last_unstale":"2024-09-12T02:23:17.841521+0000","last_undegraded":"2024-09-12T02:23:17.841521+0000","last_fullsized":"2024-09-12T02:23:17.841521+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:35.598279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842504+0000","last_change":"2024-09-12T02:23:04.777450+0000","last_active":"2024-09-12T02:23:17.842504+0000","last_peered":"2024-09-12T02:23:17.842504+0000","last_clean":"2024-09-12T02:23:17.842504+0000","last_became_active":"2024-09-12T02:23:04.776825+0000","last_became_peered":"2024-09-12T02:23:04.776825+0000","last_unstale":"2024-09-12T02:23:17.842504+0000","last_undegraded":"2024-09-12T02:23:17.842504+0000","last_fullsized":"2024-09-12T02:23:17.842504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:40.315075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325062+0000","last_change":"2024-09-12T02:23:16.846032+0000","last_active":"2024-09-12T02:23:18.325062+0000","last_peered":"2024-09-12T02:23:18.325062+0000","last_clean":"2024-09-12T02:23:18.325062+0000","last_became_active":"2024-09-12T02:23:16.845492+0000","last_became_peered":"2024-09-12T02:23:16.845492+0000","last_unstale":"2024-09-12T02:23:18.325062+0000","last_undegraded":"2024-09-12T02:23:18.325062+0000","last_fullsized":"2024-09-12T02:23:18.325062+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:18.785798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673368+0000","last_change":"2024-09-12T02:23:04.791378+0000","last_active":"2024-09-12T02:23:18.673368+0000","last_peered":"2024-09-12T02:23:18.673368+0000","last_clean":"2024-09-12T02:23:18.673368+0000","last_became_active":"2024-09-12T02:23:04.790926+0000","last_became_peered":"2024-09-12T02:23:04.790926+0000","last_unstale":"2024-09-12T02:23:18.673368+0000","last_undegraded":"2024-09-12T02:23:18.673368+0000","last_fullsized":"2024-09-12T02:23:18.673368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:34.764210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331435+0000","last_change":"2024-09-12T02:23:16.851099+0000","last_active":"2024-09-12T02:23:18.331435+0000","last_peered":"2024-09-12T02:23:18.331435+0000","last_clean":"2024-09-12T02:23:18.331435+0000","last_became_active":"2024-09-12T02:23:16.850747+0000","last_became_peered":"2024-09-12T02:23:16.850747+0000","last_unstale":"2024-09-12T02:23:18.331435+0000","last_undegraded":"2024-09-12T02:23:18.331435+0000","last_fullsized":"2024-09-12T02:23:18.331435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:01:31.445590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.326232+0000","last_change":"2024-09-12T02:23:04.789439+0000","last_active":"2024-09-12T02:23:18.326232+0000","last_peered":"2024-09-12T02:23:18.326232+0000","last_clean":"2024-09-12T02:23:18.326232+0000","last_became_active":"2024-09-12T02:23:04.787421+0000","last_became_peered":"2024-09-12T02:23:04.787421+0000","last_unstale":"2024-09-12T02:23:18.326232+0000","last_undegraded":"2024-09-12T02:23:18.326232+0000","last_fullsized":"2024-09-12T02:23:18.326232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:44.295056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444485+0000","last_change":"2024-09-12T02:23:16.850923+0000","last_active":"2024-09-12T02:23:18.444485+0000","last_peered":"2024-09-12T02:23:18.444485+0000","last_clean":"2024-09-12T02:23:18.444485+0000","last_became_active":"2024-09-12T02:23:16.850609+0000","last_became_peered":"2024-09-12T02:23:16.850609+0000","last_unstale":"2024-09-12T02:23:18.444485+0000","last_undegraded":"2024-09-12T02:23:18.444485+0000","last_fullsized":"2024-09-12T02:23:18.444485+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:52.110438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325085+0000","last_change":"2024-09-12T02:23:04.790532+0000","last_active":"2024-09-12T02:23:18.325085+0000","last_peered":"2024-09-12T02:23:18.325085+0000","last_clean":"2024-09-12T02:23:18.325085+0000","last_became_active":"2024-09-12T02:23:04.789229+0000","last_became_peered":"2024-09-12T02:23:04.789229+0000","last_unstale":"2024-09-12T02:23:18.325085+0000","last_undegraded":"2024-09-12T02:23:18.325085+0000","last_fullsized":"2024-09-12T02:23:18.325085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:59.901665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841478+0000","last_change":"2024-09-12T02:23:16.856612+0000","last_active":"2024-09-12T02:23:17.841478+0000","last_peered":"2024-09-12T02:23:17.841478+0000","last_clean":"2024-09-12T02:23:17.841478+0000","last_became_active":"2024-09-12T02:23:16.856290+0000","last_became_peered":"2024-09-12T02:23:16.856290+0000","last_unstale":"2024-09-12T02:23:17.841478+0000","last_undegraded":"2024-09-12T02:23:17.841478+0000","last_fullsized":"2024-09-12T02:23:17.841478+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:14.846281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444198+0000","last_change":"2024-09-12T02:23:04.782490+0000","last_active":"2024-09-12T02:23:18.444198+0000","last_peered":"2024-09-12T02:23:18.444198+0000","last_clean":"2024-09-12T02:23:18.444198+0000","last_became_active":"2024-09-12T02:23:04.782183+0000","last_became_peered":"2024-09-12T02:23:04.782183+0000","last_unstale":"2024-09-12T02:23:18.444198+0000","last_undegraded":"2024-09-12T02:23:18.444198+0000","last_fullsized":"2024-09-12T02:23:18.444198+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:28.699880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325361+0000","last_change":"2024-09-12T02:23:16.858100+0000","last_active":"2024-09-12T02:23:18.325361+0000","last_peered":"2024-09-12T02:23:18.325361+0000","last_clean":"2024-09-12T02:23:18.325361+0000","last_became_active":"2024-09-12T02:23:16.857818+0000","last_became_peered":"2024-09-12T02:23:16.857818+0000","last_unstale":"2024-09-12T02:23:18.325361+0000","last_undegraded":"2024-09-12T02:23:18.325361+0000","last_fullsized":"2024-09-12T02:23:18.325361+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:45.991170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331508+0000","last_change":"2024-09-12T02:23:04.787140+0000","last_active":"2024-09-12T02:23:18.331508+0000","last_peered":"2024-09-12T02:23:18.331508+0000","last_clean":"2024-09-12T02:23:18.331508+0000","last_became_active":"2024-09-12T02:23:04.786799+0000","last_became_peered":"2024-09-12T02:23:04.786799+0000","last_unstale":"2024-09-12T02:23:18.331508+0000","last_undegraded":"2024-09-12T02:23:18.331508+0000","last_fullsized":"2024-09-12T02:23:18.331508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:31.639605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842225+0000","last_change":"2024-09-12T02:23:16.846100+0000","last_active":"2024-09-12T02:23:17.842225+0000","last_peered":"2024-09-12T02:23:17.842225+0000","last_clean":"2024-09-12T02:23:17.842225+0000","last_became_active":"2024-09-12T02:23:16.845749+0000","last_became_peered":"2024-09-12T02:23:16.845749+0000","last_unstale":"2024-09-12T02:23:17.842225+0000","last_undegraded":"2024-09-12T02:23:17.842225+0000","last_fullsized":"2024-09-12T02:23:17.842225+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:42.783366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839149+0000","last_change":"2024-09-12T02:23:04.782128+0000","last_active":"2024-09-12T02:23:17.839149+0000","last_peered":"2024-09-12T02:23:17.839149+0000","last_clean":"2024-09-12T02:23:17.839149+0000","last_became_active":"2024-09-12T02:23:04.781101+0000","last_became_peered":"2024-09-12T02:23:04.781101+0000","last_unstale":"2024-09-12T02:23:17.839149+0000","last_undegraded":"2024-09-12T02:23:17.839149+0000","last_fullsized":"2024-09-12T02:23:17.839149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:49.421147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839296+0000","last_change":"2024-09-12T02:23:16.836968+0000","last_active":"2024-09-12T02:23:17.839296+0000","last_peered":"2024-09-12T02:23:17.839296+0000","last_clean":"2024-09-12T02:23:17.839296+0000","last_became_active":"2024-09-12T02:23:16.836561+0000","last_became_peered":"2024-09-12T02:23:16.836561+0000","last_unstale":"2024-09-12T02:23:17.839296+0000","last_undegraded":"2024-09-12T02:23:17.839296+0000","last_fullsized":"2024-09-12T02:23:17.839296+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:08.765569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842555+0000","last_change":"2024-09-12T02:23:04.787034+0000","last_active":"2024-09-12T02:23:17.842555+0000","last_peered":"2024-09-12T02:23:17.842555+0000","last_clean":"2024-09-12T02:23:17.842555+0000","last_became_active":"2024-09-12T02:23:04.786044+0000","last_became_peered":"2024-09-12T02:23:04.786044+0000","last_unstale":"2024-09-12T02:23:17.842555+0000","last_undegraded":"2024-09-12T02:23:17.842555+0000","last_fullsized":"2024-09-12T02:23:17.842555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:07.183028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673151+0000","last_change":"2024-09-12T02:23:16.846114+0000","last_active":"2024-09-12T02:23:18.673151+0000","last_peered":"2024-09-12T02:23:18.673151+0000","last_clean":"2024-09-12T02:23:18.673151+0000","last_became_active":"2024-09-12T02:23:16.845757+0000","last_became_peered":"2024-09-12T02:23:16.845757+0000","last_unstale":"2024-09-12T02:23:18.673151+0000","last_undegraded":"2024-09-12T02:23:18.673151+0000","last_fullsized":"2024-09-12T02:23:18.673151+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:17:52.019813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597793+0000","last_change":"2024-09-12T02:23:04.785662+0000","last_active":"2024-09-12T02:23:19.597793+0000","last_peered":"2024-09-12T02:23:19.597793+0000","last_clean":"2024-09-12T02:23:19.597793+0000","last_became_active":"2024-09-12T02:23:04.785375+0000","last_became_peered":"2024-09-12T02:23:04.785375+0000","last_unstale":"2024-09-12T02:23:19.597793+0000","last_undegraded":"2024-09-12T02:23:19.597793+0000","last_fullsized":"2024-09-12T02:23:19.597793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:44.295056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841351+0000","last_change":"2024-09-12T02:23:16.858175+0000","last_active":"2024-09-12T02:23:17.841351+0000","last_peered":"2024-09-12T02:23:17.841351+0000","last_clean":"2024-09-12T02:23:17.841351+0000","last_became_active":"2024-09-12T02:23:16.857873+0000","last_became_peered":"2024-09-12T02:23:16.857873+0000","last_unstale":"2024-09-12T02:23:17.841351+0000","last_undegraded":"2024-09-12T02:23:17.841351+0000","last_fullsized":"2024-09-12T02:23:17.841351+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:54.535867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597940+0000","last_change":"2024-09-12T02:23:04.791929+0000","last_active":"2024-09-12T02:23:19.597940+0000","last_peered":"2024-09-12T02:23:19.597940+0000","last_clean":"2024-09-12T02:23:19.597940+0000","last_became_active":"2024-09-12T02:23:04.791622+0000","last_became_peered":"2024-09-12T02:23:04.791622+0000","last_unstale":"2024-09-12T02:23:19.597940+0000","last_undegraded":"2024-09-12T02:23:19.597940+0000","last_fullsized":"2024-09-12T02:23:19.597940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:35.012685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325239+0000","last_change":"2024-09-12T02:23:16.849985+0000","last_active":"2024-09-12T02:23:18.325239+0000","last_peered":"2024-09-12T02:23:18.325239+0000","last_clean":"2024-09-12T02:23:18.325239+0000","last_became_active":"2024-09-12T02:23:16.849641+0000","last_became_peered":"2024-09-12T02:23:16.849641+0000","last_unstale":"2024-09-12T02:23:18.325239+0000","last_undegraded":"2024-09-12T02:23:18.325239+0000","last_fullsized":"2024-09-12T02:23:18.325239+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:28.373543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.843012+0000","last_change":"2024-09-12T02:23:04.781090+0000","last_active":"2024-09-12T02:23:17.843012+0000","last_peered":"2024-09-12T02:23:17.843012+0000","last_clean":"2024-09-12T02:23:17.843012+0000","last_became_active":"2024-09-12T02:23:04.780740+0000","last_became_peered":"2024-09-12T02:23:04.780740+0000","last_unstale":"2024-09-12T02:23:17.843012+0000","last_undegraded":"2024-09-12T02:23:17.843012+0000","last_fullsized":"2024-09-12T02:23:17.843012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:30.639111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839819+0000","last_change":"2024-09-12T02:23:16.840250+0000","last_active":"2024-09-12T02:23:17.839819+0000","last_peered":"2024-09-12T02:23:17.839819+0000","last_clean":"2024-09-12T02:23:17.839819+0000","last_became_active":"2024-09-12T02:23:16.839914+0000","last_became_peered":"2024-09-12T02:23:16.839914+0000","last_unstale":"2024-09-12T02:23:17.839819+0000","last_undegraded":"2024-09-12T02:23:17.839819+0000","last_fullsized":"2024-09-12T02:23:17.839819+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:04.798197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.838971+0000","last_change":"2024-09-12T02:23:04.779648+0000","last_active":"2024-09-12T02:23:17.838971+0000","last_peered":"2024-09-12T02:23:17.838971+0000","last_clean":"2024-09-12T02:23:17.838971+0000","last_became_active":"2024-09-12T02:23:04.779384+0000","last_became_peered":"2024-09-12T02:23:04.779384+0000","last_unstale":"2024-09-12T02:23:17.838971+0000","last_undegraded":"2024-09-12T02:23:17.838971+0000","last_fullsized":"2024-09-12T02:23:17.838971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:41.491471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.598038+0000","last_change":"2024-09-12T02:23:16.850060+0000","last_active":"2024-09-12T02:23:19.598038+0000","last_peered":"2024-09-12T02:23:19.598038+0000","last_clean":"2024-09-12T02:23:19.598038+0000","last_became_active":"2024-09-12T02:23:16.849744+0000","last_became_peered":"2024-09-12T02:23:16.849744+0000","last_unstale":"2024-09-12T02:23:19.598038+0000","last_undegraded":"2024-09-12T02:23:19.598038+0000","last_fullsized":"2024-09-12T02:23:19.598038+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:34.130685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841118+0000","last_change":"2024-09-12T02:23:04.779265+0000","last_active":"2024-09-12T02:23:17.841118+0000","last_peered":"2024-09-12T02:23:17.841118+0000","last_clean":"2024-09-12T02:23:17.841118+0000","last_became_active":"2024-09-12T02:23:04.778968+0000","last_became_peered":"2024-09-12T02:23:04.778968+0000","last_unstale":"2024-09-12T02:23:17.841118+0000","last_undegraded":"2024-09-12T02:23:17.841118+0000","last_fullsized":"2024-09-12T02:23:17.841118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:53.022598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444316+0000","last_change":"2024-09-12T02:23:16.862034+0000","last_active":"2024-09-12T02:23:18.444316+0000","last_peered":"2024-09-12T02:23:18.444316+0000","last_clean":"2024-09-12T02:23:18.444316+0000","last_became_active":"2024-09-12T02:23:16.861441+0000","last_became_peered":"2024-09-12T02:23:16.861441+0000","last_unstale":"2024-09-12T02:23:18.444316+0000","last_undegraded":"2024-09-12T02:23:18.444316+0000","last_fullsized":"2024-09-12T02:23:18.444316+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:24.332614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325312+0000","last_change":"2024-09-12T02:23:04.788890+0000","last_active":"2024-09-12T02:23:18.325312+0000","last_peered":"2024-09-12T02:23:18.325312+0000","last_clean":"2024-09-12T02:23:18.325312+0000","last_became_active":"2024-09-12T02:23:04.788617+0000","last_became_peered":"2024-09-12T02:23:04.788617+0000","last_unstale":"2024-09-12T02:23:18.325312+0000","last_undegraded":"2024-09-12T02:23:18.325312+0000","last_fullsized":"2024-09-12T02:23:18.325312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:24.194151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325951+0000","last_change":"2024-09-12T02:23:16.855853+0000","last_active":"2024-09-12T02:23:18.325951+0000","last_peered":"2024-09-12T02:23:18.325951+0000","last_clean":"2024-09-12T02:23:18.325951+0000","last_became_active":"2024-09-12T02:23:16.855437+0000","last_became_peered":"2024-09-12T02:23:16.855437+0000","last_unstale":"2024-09-12T02:23:18.325951+0000","last_undegraded":"2024-09-12T02:23:18.325951+0000","last_fullsized":"2024-09-12T02:23:18.325951+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:27.557862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841894+0000","last_change":"2024-09-12T02:23:04.777165+0000","last_active":"2024-09-12T02:23:17.841894+0000","last_peered":"2024-09-12T02:23:17.841894+0000","last_clean":"2024-09-12T02:23:17.841894+0000","last_became_active":"2024-09-12T02:23:04.776857+0000","last_became_peered":"2024-09-12T02:23:04.776857+0000","last_unstale":"2024-09-12T02:23:17.841894+0000","last_undegraded":"2024-09-12T02:23:17.841894+0000","last_fullsized":"2024-09-12T02:23:17.841894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:28.309591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839032+0000","last_change":"2024-09-12T02:23:16.849235+0000","last_active":"2024-09-12T02:23:17.839032+0000","last_peered":"2024-09-12T02:23:17.839032+0000","last_clean":"2024-09-12T02:23:17.839032+0000","last_became_active":"2024-09-12T02:23:16.848936+0000","last_became_peered":"2024-09-12T02:23:16.848936+0000","last_unstale":"2024-09-12T02:23:17.839032+0000","last_undegraded":"2024-09-12T02:23:17.839032+0000","last_fullsized":"2024-09-12T02:23:17.839032+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:32.415375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325607+0000","last_change":"2024-09-12T02:23:04.786772+0000","last_active":"2024-09-12T02:23:18.325607+0000","last_peered":"2024-09-12T02:23:18.325607+0000","last_clean":"2024-09-12T02:23:18.325607+0000","last_became_active":"2024-09-12T02:23:04.786509+0000","last_became_peered":"2024-09-12T02:23:04.786509+0000","last_unstale":"2024-09-12T02:23:18.325607+0000","last_undegraded":"2024-09-12T02:23:18.325607+0000","last_fullsized":"2024-09-12T02:23:18.325607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:01.755827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673170+0000","last_change":"2024-09-12T02:23:16.834788+0000","last_active":"2024-09-12T02:23:18.673170+0000","last_peered":"2024-09-12T02:23:18.673170+0000","last_clean":"2024-09-12T02:23:18.673170+0000","last_became_active":"2024-09-12T02:23:16.834483+0000","last_became_peered":"2024-09-12T02:23:16.834483+0000","last_unstale":"2024-09-12T02:23:18.673170+0000","last_undegraded":"2024-09-12T02:23:18.673170+0000","last_fullsized":"2024-09-12T02:23:18.673170+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:23.441282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331724+0000","last_change":"2024-09-12T02:23:04.778772+0000","last_active":"2024-09-12T02:23:18.331724+0000","last_peered":"2024-09-12T02:23:18.331724+0000","last_clean":"2024-09-12T02:23:18.331724+0000","last_became_active":"2024-09-12T02:23:04.778445+0000","last_became_peered":"2024-09-12T02:23:04.778445+0000","last_unstale":"2024-09-12T02:23:18.331724+0000","last_undegraded":"2024-09-12T02:23:18.331724+0000","last_fullsized":"2024-09-12T02:23:18.331724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:58.292023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840431+0000","last_change":"2024-09-12T02:23:16.844170+0000","last_active":"2024-09-12T02:23:17.840431+0000","last_peered":"2024-09-12T02:23:17.840431+0000","last_clean":"2024-09-12T02:23:17.840431+0000","last_became_active":"2024-09-12T02:23:16.843880+0000","last_became_peered":"2024-09-12T02:23:16.843880+0000","last_unstale":"2024-09-12T02:23:17.840431+0000","last_undegraded":"2024-09-12T02:23:17.840431+0000","last_fullsized":"2024-09-12T02:23:17.840431+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:59.283416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444520+0000","last_change":"2024-09-12T02:23:04.785821+0000","last_active":"2024-09-12T02:23:18.444520+0000","last_peered":"2024-09-12T02:23:18.444520+0000","last_clean":"2024-09-12T02:23:18.444520+0000","last_became_active":"2024-09-12T02:23:04.785516+0000","last_became_peered":"2024-09-12T02:23:04.785516+0000","last_unstale":"2024-09-12T02:23:18.444520+0000","last_undegraded":"2024-09-12T02:23:18.444520+0000","last_fullsized":"2024-09-12T02:23:18.444520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:42.400040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840987+0000","last_change":"2024-09-12T02:23:16.844145+0000","last_active":"2024-09-12T02:23:17.840987+0000","last_peered":"2024-09-12T02:23:17.840987+0000","last_clean":"2024-09-12T02:23:17.840987+0000","last_became_active":"2024-09-12T02:23:16.843815+0000","last_became_peered":"2024-09-12T02:23:16.843815+0000","last_unstale":"2024-09-12T02:23:17.840987+0000","last_undegraded":"2024-09-12T02:23:17.840987+0000","last_fullsized":"2024-09-12T02:23:17.840987+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:31.789317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842753+0000","last_change":"2024-09-12T02:23:04.791204+0000","last_active":"2024-09-12T02:23:17.842753+0000","last_peered":"2024-09-12T02:23:17.842753+0000","last_clean":"2024-09-12T02:23:17.842753+0000","last_became_active":"2024-09-12T02:23:04.790906+0000","last_became_peered":"2024-09-12T02:23:04.790906+0000","last_unstale":"2024-09-12T02:23:17.842753+0000","last_undegraded":"2024-09-12T02:23:17.842753+0000","last_fullsized":"2024-09-12T02:23:17.842753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:16.336873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2853,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476748,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":695559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476748,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":107190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476749,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":105281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509451,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":286720,"data_stored":104749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35612,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336228,"statfs":{"total":96636764160,"available":96600297472,"internally_reserved":0,"allocated":270336,"data_stored":104589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509452,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36200,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335640,"statfs":{"total":96636764160,"available":96599695360,"internally_reserved":0,"allocated":872448,"data_stored":695525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542156,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35636,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336204,"statfs":{"total":96636764160,"available":96600272896,"internally_reserved":0,"allocated":294912,"data_stored":107765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542155,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35632,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336208,"statfs":{"total":96636764160,"available":96600276992,"internally_reserved":0,"allocated":290816,"data_stored":106313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:23:37.978 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:23:38.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.109+0000 7ffa22b11640 1 Processor -- start 2024-09-12T02:23:38.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.109+0000 7ffa22b11640 1 -- start start 2024-09-12T02:23:38.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.109+0000 7ffa22b11640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ffa1c0ca390 0x7ffa1c161c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:38.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.110+0000 7ffa22b11640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa1c15a7c0 con 0x7ffa1c150480 2024-09-12T02:23:38.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.110+0000 7ffa22b11640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa1c159a00 con 0x7ffa1c06c650 2024-09-12T02:23:38.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.110+0000 7ffa22b11640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ffa1c06c240 con 0x7ffa1c0ca390 2024-09-12T02:23:38.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.110+0000 7ffa208ad640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ffa1c150480 0x7ffa1c0c7a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:35434/0 (socket says 172.21.15.60:35434) 2024-09-12T02:23:38.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.110+0000 7ffa208ad640 1 -- 172.21.15.60:0/1216185141 learned_addr learned my addr 172.21.15.60:0/1216185141 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:38.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.110+0000 7ffa210ae640 1 --2- 172.21.15.60:0/1216185141 >> v2:172.21.15.105:3300/0 conn(0x7ffa1c0ca390 0x7ffa1c161c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:38.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.110+0000 7ffa1b7fe640 1 -- 172.21.15.60:0/1216185141 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 786352231 0 0) 0x7ffa1c15a7c0 con 0x7ffa1c150480 2024-09-12T02:23:38.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.110+0000 7ffa1b7fe640 1 -- 172.21.15.60:0/1216185141 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa0c003520 con 0x7ffa1c150480 2024-09-12T02:23:38.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.110+0000 7ffa1b7fe640 1 -- 172.21.15.60:0/1216185141 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1735990258 0 0) 0x7ffa0c003520 con 0x7ffa1c150480 2024-09-12T02:23:38.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.110+0000 7ffa1b7fe640 1 -- 172.21.15.60:0/1216185141 >> v2:172.21.15.105:3300/0 conn(0x7ffa1c0ca390 msgr2=0x7ffa1c161c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:38.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.110+0000 7ffa1b7fe640 1 --2- 172.21.15.60:0/1216185141 >> v2:172.21.15.105:3300/0 conn(0x7ffa1c0ca390 0x7ffa1c161c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:38.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.110+0000 7ffa1b7fe640 1 -- 172.21.15.60:0/1216185141 >> v1:172.21.15.105:6789/0 conn(0x7ffa1c06c650 legacy=0x7ffa1c0c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:38.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.110+0000 7ffa1b7fe640 1 -- 172.21.15.60:0/1216185141 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa1c159ce0 con 0x7ffa1c150480 2024-09-12T02:23:38.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.110+0000 7ffa1b7fe640 1 -- 172.21.15.60:0/1216185141 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7ffa10001670 con 0x7ffa1c150480 2024-09-12T02:23:38.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.110+0000 7ffa1b7fe640 1 -- 172.21.15.60:0/1216185141 >> v1:172.21.15.60:6789/0 conn(0x7ffa1c150480 legacy=0x7ffa1c0c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:38.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.110+0000 7ffa1b7fe640 1 --2- 172.21.15.60:0/1216185141 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa0c0039b0 0x7ffa0c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:38.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.110+0000 7ffa1b7fe640 1 --2- 172.21.15.60:0/1216185141 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa0c004800 0x7ffa0c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:38.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.110+0000 7ffa1b7fe640 1 --2- 172.21.15.60:0/1216185141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa0c0051c0 0x7ffa0c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:38.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.110+0000 7ffa1b7fe640 1 -- 172.21.15.60:0/1216185141 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ffa0c00c030 con 0x7ffa0c0051c0 2024-09-12T02:23:38.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.110+0000 7ffa1b7fe640 1 -- 172.21.15.60:0/1216185141 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ffa0c00c1e0 con 0x7ffa0c0039b0 2024-09-12T02:23:38.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.110+0000 7ffa1b7fe640 1 -- 172.21.15.60:0/1216185141 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ffa0c00c3e0 con 0x7ffa0c004800 2024-09-12T02:23:38.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.110+0000 7ffa210ae640 1 --2- 172.21.15.60:0/1216185141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa0c0051c0 0x7ffa0c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:38.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.110+0000 7ffa208ad640 1 --2- 172.21.15.60:0/1216185141 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa0c0039b0 0x7ffa0c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:38.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.111+0000 7ffa1bfff640 1 --2- 172.21.15.60:0/1216185141 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa0c004800 0x7ffa0c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:38.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.111+0000 7ffa210ae640 1 -- 172.21.15.60:0/1216185141 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa0c004800 msgr2=0x7ffa0c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:38.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.111+0000 7ffa210ae640 1 --2- 172.21.15.60:0/1216185141 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa0c004800 0x7ffa0c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:38.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.111+0000 7ffa210ae640 1 -- 172.21.15.60:0/1216185141 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa0c0039b0 msgr2=0x7ffa0c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:38.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.111+0000 7ffa210ae640 1 --2- 172.21.15.60:0/1216185141 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa0c0039b0 0x7ffa0c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:38.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.111+0000 7ffa210ae640 1 -- 172.21.15.60:0/1216185141 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa0c003520 con 0x7ffa0c0051c0 2024-09-12T02:23:38.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.111+0000 7ffa1bfff640 1 --2- 172.21.15.60:0/1216185141 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa0c004800 0x7ffa0c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:23:38.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.111+0000 7ffa210ae640 1 -- 172.21.15.60:0/1216185141 reap_dead start 2024-09-12T02:23:38.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.111+0000 7ffa210ae640 1 --2- 172.21.15.60:0/1216185141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa0c0051c0 0x7ffa0c00b9c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ffa14009fc0 tx=0x7ffa0c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ef2c3048bf90461 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:38.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.112+0000 7ffa1b7fe640 1 -- 172.21.15.60:0/1216185141 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa14035020 con 0x7ffa0c0051c0 2024-09-12T02:23:38.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.112+0000 7ffa1b7fe640 1 -- 172.21.15.60:0/1216185141 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa14003bd0 con 0x7ffa0c0051c0 2024-09-12T02:23:38.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.112+0000 7ffa1b7fe640 1 -- 172.21.15.60:0/1216185141 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa14009c10 con 0x7ffa0c0051c0 2024-09-12T02:23:38.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.112+0000 7ffa22b11640 1 -- 172.21.15.60:0/1216185141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa0c0051c0 msgr2=0x7ffa0c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:38.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.112+0000 7ffa22b11640 1 --2- 172.21.15.60:0/1216185141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa0c0051c0 0x7ffa0c00b9c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ffa14009fc0 tx=0x7ffa0c005830 comp rx=0 tx=0).stop 2024-09-12T02:23:38.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.112+0000 7ffa22b11640 1 -- 172.21.15.60:0/1216185141 shutdown_connections 2024-09-12T02:23:38.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.112+0000 7ffa22b11640 1 --2- 172.21.15.60:0/1216185141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa0c0051c0 0x7ffa0c00b9c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:38.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.112+0000 7ffa22b11640 1 -- 172.21.15.60:0/1216185141 >> 172.21.15.60:0/1216185141 conn(0x7ffa1c068030 msgr2=0x7ffa1c073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:38.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.112+0000 7ffa22b11640 1 -- 172.21.15.60:0/1216185141 shutdown_connections 2024-09-12T02:23:38.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.112+0000 7ffa22b11640 1 -- 172.21.15.60:0/1216185141 wait complete. 2024-09-12T02:23:38.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.113+0000 7ffa22b11640 1 Processor -- start 2024-09-12T02:23:38.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.113+0000 7ffa22b11640 1 -- start start 2024-09-12T02:23:38.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.114+0000 7ffa22b11640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa0c0051c0 0x7ffa1c14de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:38.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.114+0000 7ffa22b11640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa1c149ab0 0x7ffa1c149120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:38.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.114+0000 7ffa22b11640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa1c0acb40 0x7ffa1c158f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:38.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.114+0000 7ffa22b11640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ffa1c06d270 con 0x7ffa0c0051c0 2024-09-12T02:23:38.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.114+0000 7ffa22b11640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ffa1c15a330 con 0x7ffa1c0acb40 2024-09-12T02:23:38.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.114+0000 7ffa22b11640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ffa1c156270 con 0x7ffa1c149ab0 2024-09-12T02:23:38.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.114+0000 7ffa208ad640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa0c0051c0 0x7ffa1c14de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:38.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.114+0000 7ffa208ad640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa0c0051c0 0x7ffa1c14de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50348/0 (socket says 172.21.15.60:50348) 2024-09-12T02:23:38.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.114+0000 7ffa208ad640 1 -- 172.21.15.60:0/3340831893 learned_addr learned my addr 172.21.15.60:0/3340831893 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:38.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.115+0000 7ffa1bfff640 1 --2- 172.21.15.60:0/3340831893 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa1c149ab0 0x7ffa1c149120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:38.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.115+0000 7ffa210ae640 1 --2- 172.21.15.60:0/3340831893 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa1c0acb40 0x7ffa1c158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:38.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.115+0000 7ffa208ad640 1 -- 172.21.15.60:0/3340831893 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa1c149ab0 msgr2=0x7ffa1c149120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:38.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.115+0000 7ffa208ad640 1 --2- 172.21.15.60:0/3340831893 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa1c149ab0 0x7ffa1c149120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:38.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.115+0000 7ffa208ad640 1 -- 172.21.15.60:0/3340831893 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa1c0acb40 msgr2=0x7ffa1c158f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:38.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.115+0000 7ffa208ad640 1 --2- 172.21.15.60:0/3340831893 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa1c0acb40 0x7ffa1c158f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:38.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.115+0000 7ffa208ad640 1 -- 172.21.15.60:0/3340831893 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa1c1ec970 con 0x7ffa0c0051c0 2024-09-12T02:23:38.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.115+0000 7ffa210ae640 1 --2- 172.21.15.60:0/3340831893 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa1c0acb40 0x7ffa1c158f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:23:38.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.115+0000 7ffa1bfff640 1 --2- 172.21.15.60:0/3340831893 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa1c149ab0 0x7ffa1c149120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:23:38.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.115+0000 7ffa208ad640 1 --2- 172.21.15.60:0/3340831893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa0c0051c0 0x7ffa1c14de00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ffa10007320 tx=0x7ffa100077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:38.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.115+0000 7ffa197fa640 1 -- 172.21.15.60:0/3340831893 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa1001a070 con 0x7ffa0c0051c0 2024-09-12T02:23:38.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.115+0000 7ffa197fa640 1 -- 172.21.15.60:0/3340831893 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa1000f8e0 con 0x7ffa0c0051c0 2024-09-12T02:23:38.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.115+0000 7ffa197fa640 1 -- 172.21.15.60:0/3340831893 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa1000fcd0 con 0x7ffa0c0051c0 2024-09-12T02:23:38.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.115+0000 7ffa22b11640 1 -- 172.21.15.60:0/3340831893 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa1c157560 con 0x7ffa0c0051c0 2024-09-12T02:23:38.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.115+0000 7ffa22b11640 1 -- 172.21.15.60:0/3340831893 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa1c0acfc0 con 0x7ffa0c0051c0 2024-09-12T02:23:38.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.116+0000 7ffa22b11640 1 -- 172.21.15.60:0/3340831893 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa1c0c9c80 con 0x7ffa0c0051c0 2024-09-12T02:23:38.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.117+0000 7ffa197fa640 1 -- 172.21.15.60:0/3340831893 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffa1001d070 con 0x7ffa0c0051c0 2024-09-12T02:23:38.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.117+0000 7ffa197fa640 1 --2- 172.21.15.60:0/3340831893 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ffa0006be30 0x7ffa0006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:38.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.117+0000 7ffa197fa640 1 -- 172.21.15.60:0/3340831893 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7ffa1008aa50 con 0x7ffa0c0051c0 2024-09-12T02:23:38.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.117+0000 7ffa1bfff640 1 --2- 172.21.15.60:0/3340831893 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ffa0006be30 0x7ffa0006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:38.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.118+0000 7ffa1bfff640 1 --2- 172.21.15.60:0/3340831893 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ffa0006be30 0x7ffa0006e2f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ffa08000c00 tx=0x7ffa08009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:38.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.121+0000 7ffa197fa640 1 -- 172.21.15.60:0/3340831893 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffa10059160 con 0x7ffa0c0051c0 2024-09-12T02:23:38.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.293+0000 7ffa22b11640 1 -- 172.21.15.60:0/3340831893 --> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffa1c1ec720 con 0x7ffa0006be30 2024-09-12T02:23:38.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.305+0000 7ffa197fa640 1 -- 172.21.15.60:0/3340831893 <== mgr.4098 v2:172.21.15.60:6800/3549430091 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490301 (secure 0 0 0) 0x7ffa1c1ec720 con 0x7ffa0006be30 2024-09-12T02:23:38.312 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:23:38.315 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T02:23:38.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.308+0000 7ffa22b11640 1 -- 172.21.15.60:0/3340831893 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ffa0006be30 msgr2=0x7ffa0006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:38.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.308+0000 7ffa22b11640 1 --2- 172.21.15.60:0/3340831893 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ffa0006be30 0x7ffa0006e2f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ffa08000c00 tx=0x7ffa08009040 comp rx=0 tx=0).stop 2024-09-12T02:23:38.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.308+0000 7ffa22b11640 1 -- 172.21.15.60:0/3340831893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa0c0051c0 msgr2=0x7ffa1c14de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:38.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.308+0000 7ffa22b11640 1 --2- 172.21.15.60:0/3340831893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa0c0051c0 0x7ffa1c14de00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ffa10007320 tx=0x7ffa100077e0 comp rx=0 tx=0).stop 2024-09-12T02:23:38.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.309+0000 7ffa22b11640 1 -- 172.21.15.60:0/3340831893 shutdown_connections 2024-09-12T02:23:38.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.309+0000 7ffa22b11640 1 --2- 172.21.15.60:0/3340831893 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ffa0006be30 0x7ffa0006e2f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:38.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.309+0000 7ffa22b11640 1 --2- 172.21.15.60:0/3340831893 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa1c0acb40 0x7ffa1c158f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:38.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.309+0000 7ffa22b11640 1 --2- 172.21.15.60:0/3340831893 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa1c149ab0 0x7ffa1c149120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:38.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.309+0000 7ffa22b11640 1 --2- 172.21.15.60:0/3340831893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa0c0051c0 0x7ffa1c14de00 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:38.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.309+0000 7ffa22b11640 1 -- 172.21.15.60:0/3340831893 >> 172.21.15.60:0/3340831893 conn(0x7ffa1c068030 msgr2=0x7ffa1c0ca770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:38.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.309+0000 7ffa22b11640 1 -- 172.21.15.60:0/3340831893 shutdown_connections 2024-09-12T02:23:38.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.309+0000 7ffa22b11640 1 -- 172.21.15.60:0/3340831893 wait complete. 2024-09-12T02:23:38.320 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2024-09-12T02:23:38.094219+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596074,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":253,"num_write_kb":2448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252868,"kb_used_data":3368,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754721852,"statfs":{"total":773094113280,"available":772835176448,"internally_reserved":0,"allocated":3448832,"data_stored":2028300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":886,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002964"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840458+0000","last_change":"2024-09-12T02:23:16.851521+0000","last_active":"2024-09-12T02:23:17.840458+0000","last_peered":"2024-09-12T02:23:17.840458+0000","last_clean":"2024-09-12T02:23:17.840458+0000","last_became_active":"2024-09-12T02:23:16.851220+0000","last_became_peered":"2024-09-12T02:23:16.851220+0000","last_unstale":"2024-09-12T02:23:17.840458+0000","last_undegraded":"2024-09-12T02:23:17.840458+0000","last_fullsized":"2024-09-12T02:23:17.840458+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:28.680072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331964+0000","last_change":"2024-09-12T02:23:03.757848+0000","last_active":"2024-09-12T02:23:18.331964+0000","last_peered":"2024-09-12T02:23:18.331964+0000","last_clean":"2024-09-12T02:23:18.331964+0000","last_became_active":"2024-09-12T02:23:03.757544+0000","last_became_peered":"2024-09-12T02:23:03.757544+0000","last_unstale":"2024-09-12T02:23:18.331964+0000","last_undegraded":"2024-09-12T02:23:18.331964+0000","last_fullsized":"2024-09-12T02:23:18.331964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:43.576128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840084+0000","last_change":"2024-09-12T02:23:04.790549+0000","last_active":"2024-09-12T02:23:17.840084+0000","last_peered":"2024-09-12T02:23:17.840084+0000","last_clean":"2024-09-12T02:23:17.840084+0000","last_became_active":"2024-09-12T02:23:04.790187+0000","last_became_peered":"2024-09-12T02:23:04.790187+0000","last_unstale":"2024-09-12T02:23:17.840084+0000","last_undegraded":"2024-09-12T02:23:17.840084+0000","last_fullsized":"2024-09-12T02:23:17.840084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:49.656395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.838950+0000","last_change":"2024-09-12T02:23:15.829383+0000","last_active":"2024-09-12T02:23:17.838950+0000","last_peered":"2024-09-12T02:23:17.838950+0000","last_clean":"2024-09-12T02:23:17.838950+0000","last_became_active":"2024-09-12T02:23:15.828295+0000","last_became_peered":"2024-09-12T02:23:15.828295+0000","last_unstale":"2024-09-12T02:23:17.838950+0000","last_undegraded":"2024-09-12T02:23:17.838950+0000","last_fullsized":"2024-09-12T02:23:17.838950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:13.217846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444073+0000","last_change":"2024-09-12T02:23:16.853675+0000","last_active":"2024-09-12T02:23:18.444073+0000","last_peered":"2024-09-12T02:23:18.444073+0000","last_clean":"2024-09-12T02:23:18.444073+0000","last_became_active":"2024-09-12T02:23:16.853371+0000","last_became_peered":"2024-09-12T02:23:16.853371+0000","last_unstale":"2024-09-12T02:23:18.444073+0000","last_undegraded":"2024-09-12T02:23:18.444073+0000","last_fullsized":"2024-09-12T02:23:18.444073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:10.323501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840125+0000","last_change":"2024-09-12T02:23:03.767076+0000","last_active":"2024-09-12T02:23:17.840125+0000","last_peered":"2024-09-12T02:23:17.840125+0000","last_clean":"2024-09-12T02:23:17.840125+0000","last_became_active":"2024-09-12T02:23:03.766686+0000","last_became_peered":"2024-09-12T02:23:03.766686+0000","last_unstale":"2024-09-12T02:23:17.840125+0000","last_undegraded":"2024-09-12T02:23:17.840125+0000","last_fullsized":"2024-09-12T02:23:17.840125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:45.706208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331882+0000","last_change":"2024-09-12T02:23:04.782108+0000","last_active":"2024-09-12T02:23:18.331882+0000","last_peered":"2024-09-12T02:23:18.331882+0000","last_clean":"2024-09-12T02:23:18.331882+0000","last_became_active":"2024-09-12T02:23:04.781829+0000","last_became_peered":"2024-09-12T02:23:04.781829+0000","last_unstale":"2024-09-12T02:23:18.331882+0000","last_undegraded":"2024-09-12T02:23:18.331882+0000","last_fullsized":"2024-09-12T02:23:18.331882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:07:33.165742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840554+0000","last_change":"2024-09-12T02:23:15.828697+0000","last_active":"2024-09-12T02:23:17.840554+0000","last_peered":"2024-09-12T02:23:17.840554+0000","last_clean":"2024-09-12T02:23:17.840554+0000","last_became_active":"2024-09-12T02:23:15.828317+0000","last_became_peered":"2024-09-12T02:23:15.828317+0000","last_unstale":"2024-09-12T02:23:17.840554+0000","last_undegraded":"2024-09-12T02:23:17.840554+0000","last_fullsized":"2024-09-12T02:23:17.840554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:55.347515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840938+0000","last_change":"2024-09-12T02:23:16.856209+0000","last_active":"2024-09-12T02:23:17.840938+0000","last_peered":"2024-09-12T02:23:17.840938+0000","last_clean":"2024-09-12T02:23:17.840938+0000","last_became_active":"2024-09-12T02:23:16.855874+0000","last_became_peered":"2024-09-12T02:23:16.855874+0000","last_unstale":"2024-09-12T02:23:17.840938+0000","last_undegraded":"2024-09-12T02:23:17.840938+0000","last_fullsized":"2024-09-12T02:23:17.840938+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:44.299638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842447+0000","last_change":"2024-09-12T02:23:03.767875+0000","last_active":"2024-09-12T02:23:17.842447+0000","last_peered":"2024-09-12T02:23:17.842447+0000","last_clean":"2024-09-12T02:23:17.842447+0000","last_became_active":"2024-09-12T02:23:03.767596+0000","last_became_peered":"2024-09-12T02:23:03.767596+0000","last_unstale":"2024-09-12T02:23:17.842447+0000","last_undegraded":"2024-09-12T02:23:17.842447+0000","last_fullsized":"2024-09-12T02:23:17.842447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:22.605725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325618+0000","last_change":"2024-09-12T02:23:04.791903+0000","last_active":"2024-09-12T02:23:18.325618+0000","last_peered":"2024-09-12T02:23:18.325618+0000","last_clean":"2024-09-12T02:23:18.325618+0000","last_became_active":"2024-09-12T02:23:04.791635+0000","last_became_peered":"2024-09-12T02:23:04.791635+0000","last_unstale":"2024-09-12T02:23:18.325618+0000","last_undegraded":"2024-09-12T02:23:18.325618+0000","last_fullsized":"2024-09-12T02:23:18.325618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:08.192088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841943+0000","last_change":"2024-09-12T02:23:15.833369+0000","last_active":"2024-09-12T02:23:17.841943+0000","last_peered":"2024-09-12T02:23:17.841943+0000","last_clean":"2024-09-12T02:23:17.841943+0000","last_became_active":"2024-09-12T02:23:15.833010+0000","last_became_peered":"2024-09-12T02:23:15.833010+0000","last_unstale":"2024-09-12T02:23:17.841943+0000","last_undegraded":"2024-09-12T02:23:17.841943+0000","last_fullsized":"2024-09-12T02:23:17.841943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:51.465462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325378+0000","last_change":"2024-09-12T02:23:16.853013+0000","last_active":"2024-09-12T02:23:18.325378+0000","last_peered":"2024-09-12T02:23:18.325378+0000","last_clean":"2024-09-12T02:23:18.325378+0000","last_became_active":"2024-09-12T02:23:16.852698+0000","last_became_peered":"2024-09-12T02:23:16.852698+0000","last_unstale":"2024-09-12T02:23:18.325378+0000","last_undegraded":"2024-09-12T02:23:18.325378+0000","last_fullsized":"2024-09-12T02:23:18.325378+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:11.709531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842467+0000","last_change":"2024-09-12T02:23:03.763480+0000","last_active":"2024-09-12T02:23:17.842467+0000","last_peered":"2024-09-12T02:23:17.842467+0000","last_clean":"2024-09-12T02:23:17.842467+0000","last_became_active":"2024-09-12T02:23:03.762464+0000","last_became_peered":"2024-09-12T02:23:03.762464+0000","last_unstale":"2024-09-12T02:23:17.842467+0000","last_undegraded":"2024-09-12T02:23:17.842467+0000","last_fullsized":"2024-09-12T02:23:17.842467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:24.308289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325931+0000","last_change":"2024-09-12T02:23:04.791109+0000","last_active":"2024-09-12T02:23:18.325931+0000","last_peered":"2024-09-12T02:23:18.325931+0000","last_clean":"2024-09-12T02:23:18.325931+0000","last_became_active":"2024-09-12T02:23:04.790201+0000","last_became_peered":"2024-09-12T02:23:04.790201+0000","last_unstale":"2024-09-12T02:23:18.325931+0000","last_undegraded":"2024-09-12T02:23:18.325931+0000","last_fullsized":"2024-09-12T02:23:18.325931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:13.166139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840837+0000","last_change":"2024-09-12T02:23:15.834261+0000","last_active":"2024-09-12T02:23:17.840837+0000","last_peered":"2024-09-12T02:23:17.840837+0000","last_clean":"2024-09-12T02:23:17.840837+0000","last_became_active":"2024-09-12T02:23:15.833982+0000","last_became_peered":"2024-09-12T02:23:15.833982+0000","last_unstale":"2024-09-12T02:23:17.840837+0000","last_undegraded":"2024-09-12T02:23:17.840837+0000","last_fullsized":"2024-09-12T02:23:17.840837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:04.987961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444359+0000","last_change":"2024-09-12T02:23:16.861432+0000","last_active":"2024-09-12T02:23:18.444359+0000","last_peered":"2024-09-12T02:23:18.444359+0000","last_clean":"2024-09-12T02:23:18.444359+0000","last_became_active":"2024-09-12T02:23:16.861003+0000","last_became_peered":"2024-09-12T02:23:16.861003+0000","last_unstale":"2024-09-12T02:23:18.444359+0000","last_undegraded":"2024-09-12T02:23:18.444359+0000","last_fullsized":"2024-09-12T02:23:18.444359+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:01.777500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597613+0000","last_change":"2024-09-12T02:23:04.788754+0000","last_active":"2024-09-12T02:23:19.597613+0000","last_peered":"2024-09-12T02:23:19.597613+0000","last_clean":"2024-09-12T02:23:19.597613+0000","last_became_active":"2024-09-12T02:23:04.788350+0000","last_became_peered":"2024-09-12T02:23:04.788350+0000","last_unstale":"2024-09-12T02:23:19.597613+0000","last_undegraded":"2024-09-12T02:23:19.597613+0000","last_fullsized":"2024-09-12T02:23:19.597613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:08.192088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841873+0000","last_change":"2024-09-12T02:23:03.763423+0000","last_active":"2024-09-12T02:23:17.841873+0000","last_peered":"2024-09-12T02:23:17.841873+0000","last_clean":"2024-09-12T02:23:17.841873+0000","last_became_active":"2024-09-12T02:23:03.762627+0000","last_became_peered":"2024-09-12T02:23:03.762627+0000","last_unstale":"2024-09-12T02:23:17.841873+0000","last_undegraded":"2024-09-12T02:23:17.841873+0000","last_fullsized":"2024-09-12T02:23:17.841873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:18.090657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841725+0000","last_change":"2024-09-12T02:23:15.831604+0000","last_active":"2024-09-12T02:23:17.841725+0000","last_peered":"2024-09-12T02:23:17.841725+0000","last_clean":"2024-09-12T02:23:17.841725+0000","last_became_active":"2024-09-12T02:23:15.831292+0000","last_became_peered":"2024-09-12T02:23:15.831292+0000","last_unstale":"2024-09-12T02:23:17.841725+0000","last_undegraded":"2024-09-12T02:23:17.841725+0000","last_fullsized":"2024-09-12T02:23:17.841725+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:30.234721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673393+0000","last_change":"2024-09-12T02:23:16.842506+0000","last_active":"2024-09-12T02:23:18.673393+0000","last_peered":"2024-09-12T02:23:18.673393+0000","last_clean":"2024-09-12T02:23:18.673393+0000","last_became_active":"2024-09-12T02:23:16.842210+0000","last_became_peered":"2024-09-12T02:23:16.842210+0000","last_unstale":"2024-09-12T02:23:18.673393+0000","last_undegraded":"2024-09-12T02:23:18.673393+0000","last_fullsized":"2024-09-12T02:23:18.673393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:52.806704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839230+0000","last_change":"2024-09-12T02:23:04.782769+0000","last_active":"2024-09-12T02:23:17.839230+0000","last_peered":"2024-09-12T02:23:17.839230+0000","last_clean":"2024-09-12T02:23:17.839230+0000","last_became_active":"2024-09-12T02:23:04.782472+0000","last_became_peered":"2024-09-12T02:23:04.782472+0000","last_unstale":"2024-09-12T02:23:17.839230+0000","last_undegraded":"2024-09-12T02:23:17.839230+0000","last_fullsized":"2024-09-12T02:23:17.839230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:46.144471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444704+0000","last_change":"2024-09-12T02:23:03.771468+0000","last_active":"2024-09-12T02:23:18.444704+0000","last_peered":"2024-09-12T02:23:18.444704+0000","last_clean":"2024-09-12T02:23:18.444704+0000","last_became_active":"2024-09-12T02:23:03.769619+0000","last_became_peered":"2024-09-12T02:23:03.769619+0000","last_unstale":"2024-09-12T02:23:18.444704+0000","last_undegraded":"2024-09-12T02:23:18.444704+0000","last_fullsized":"2024-09-12T02:23:18.444704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:38.422369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841394+0000","last_change":"2024-09-12T02:23:15.833359+0000","last_active":"2024-09-12T02:23:17.841394+0000","last_peered":"2024-09-12T02:23:17.841394+0000","last_clean":"2024-09-12T02:23:17.841394+0000","last_became_active":"2024-09-12T02:23:15.832995+0000","last_became_peered":"2024-09-12T02:23:15.832995+0000","last_unstale":"2024-09-12T02:23:17.841394+0000","last_undegraded":"2024-09-12T02:23:17.841394+0000","last_fullsized":"2024-09-12T02:23:17.841394+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:57.922845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841919+0000","last_change":"2024-09-12T02:23:16.856439+0000","last_active":"2024-09-12T02:23:17.841919+0000","last_peered":"2024-09-12T02:23:17.841919+0000","last_clean":"2024-09-12T02:23:17.841919+0000","last_became_active":"2024-09-12T02:23:16.856166+0000","last_became_peered":"2024-09-12T02:23:16.856166+0000","last_unstale":"2024-09-12T02:23:17.841919+0000","last_undegraded":"2024-09-12T02:23:17.841919+0000","last_fullsized":"2024-09-12T02:23:17.841919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:42:56.534517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839424+0000","last_change":"2024-09-12T02:23:04.783991+0000","last_active":"2024-09-12T02:23:17.839424+0000","last_peered":"2024-09-12T02:23:17.839424+0000","last_clean":"2024-09-12T02:23:17.839424+0000","last_became_active":"2024-09-12T02:23:04.783143+0000","last_became_peered":"2024-09-12T02:23:04.783143+0000","last_unstale":"2024-09-12T02:23:17.839424+0000","last_undegraded":"2024-09-12T02:23:17.839424+0000","last_fullsized":"2024-09-12T02:23:17.839424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:53.940843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444206+0000","last_change":"2024-09-12T02:23:03.770581+0000","last_active":"2024-09-12T02:23:18.444206+0000","last_peered":"2024-09-12T02:23:18.444206+0000","last_clean":"2024-09-12T02:23:18.444206+0000","last_became_active":"2024-09-12T02:23:03.769406+0000","last_became_peered":"2024-09-12T02:23:03.769406+0000","last_unstale":"2024-09-12T02:23:18.444206+0000","last_undegraded":"2024-09-12T02:23:18.444206+0000","last_fullsized":"2024-09-12T02:23:18.444206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:20.963819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444698+0000","last_change":"2024-09-12T02:23:15.835033+0000","last_active":"2024-09-12T02:23:18.444698+0000","last_peered":"2024-09-12T02:23:18.444698+0000","last_clean":"2024-09-12T02:23:18.444698+0000","last_became_active":"2024-09-12T02:23:15.834753+0000","last_became_peered":"2024-09-12T02:23:15.834753+0000","last_unstale":"2024-09-12T02:23:18.444698+0000","last_undegraded":"2024-09-12T02:23:18.444698+0000","last_fullsized":"2024-09-12T02:23:18.444698+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:57.434162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.326093+0000","last_change":"2024-09-12T02:23:16.860867+0000","last_active":"2024-09-12T02:23:18.326093+0000","last_peered":"2024-09-12T02:23:18.326093+0000","last_clean":"2024-09-12T02:23:18.326093+0000","last_became_active":"2024-09-12T02:23:16.860656+0000","last_became_peered":"2024-09-12T02:23:16.860656+0000","last_unstale":"2024-09-12T02:23:18.326093+0000","last_undegraded":"2024-09-12T02:23:18.326093+0000","last_fullsized":"2024-09-12T02:23:18.326093+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:11.375287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842133+0000","last_change":"2024-09-12T02:23:04.780821+0000","last_active":"2024-09-12T02:23:17.842133+0000","last_peered":"2024-09-12T02:23:17.842133+0000","last_clean":"2024-09-12T02:23:17.842133+0000","last_became_active":"2024-09-12T02:23:04.779984+0000","last_became_peered":"2024-09-12T02:23:04.779984+0000","last_unstale":"2024-09-12T02:23:17.842133+0000","last_undegraded":"2024-09-12T02:23:17.842133+0000","last_fullsized":"2024-09-12T02:23:17.842133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:25.724116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841013+0000","last_change":"2024-09-12T02:23:03.764530+0000","last_active":"2024-09-12T02:23:17.841013+0000","last_peered":"2024-09-12T02:23:17.841013+0000","last_clean":"2024-09-12T02:23:17.841013+0000","last_became_active":"2024-09-12T02:23:03.764218+0000","last_became_peered":"2024-09-12T02:23:03.764218+0000","last_unstale":"2024-09-12T02:23:17.841013+0000","last_undegraded":"2024-09-12T02:23:17.841013+0000","last_fullsized":"2024-09-12T02:23:17.841013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:55.445619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842053+0000","last_change":"2024-09-12T02:23:15.831621+0000","last_active":"2024-09-12T02:23:17.842053+0000","last_peered":"2024-09-12T02:23:17.842053+0000","last_clean":"2024-09-12T02:23:17.842053+0000","last_became_active":"2024-09-12T02:23:15.831331+0000","last_became_peered":"2024-09-12T02:23:15.831331+0000","last_unstale":"2024-09-12T02:23:17.842053+0000","last_undegraded":"2024-09-12T02:23:17.842053+0000","last_fullsized":"2024-09-12T02:23:17.842053+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:06.494392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.838770+0000","last_change":"2024-09-12T02:23:16.847556+0000","last_active":"2024-09-12T02:23:17.838770+0000","last_peered":"2024-09-12T02:23:17.838770+0000","last_clean":"2024-09-12T02:23:17.838770+0000","last_became_active":"2024-09-12T02:23:16.845749+0000","last_became_peered":"2024-09-12T02:23:16.845749+0000","last_unstale":"2024-09-12T02:23:17.838770+0000","last_undegraded":"2024-09-12T02:23:17.838770+0000","last_fullsized":"2024-09-12T02:23:17.838770+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:39.542842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.332030+0000","last_change":"2024-09-12T02:23:04.786895+0000","last_active":"2024-09-12T02:23:18.332030+0000","last_peered":"2024-09-12T02:23:18.332030+0000","last_clean":"2024-09-12T02:23:18.332030+0000","last_became_active":"2024-09-12T02:23:04.786591+0000","last_became_peered":"2024-09-12T02:23:04.786591+0000","last_unstale":"2024-09-12T02:23:18.332030+0000","last_undegraded":"2024-09-12T02:23:18.332030+0000","last_fullsized":"2024-09-12T02:23:18.332030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:14.751707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.598264+0000","last_change":"2024-09-12T02:23:03.771259+0000","last_active":"2024-09-12T02:23:19.598264+0000","last_peered":"2024-09-12T02:23:19.598264+0000","last_clean":"2024-09-12T02:23:19.598264+0000","last_became_active":"2024-09-12T02:23:03.770687+0000","last_became_peered":"2024-09-12T02:23:03.770687+0000","last_unstale":"2024-09-12T02:23:19.598264+0000","last_undegraded":"2024-09-12T02:23:19.598264+0000","last_fullsized":"2024-09-12T02:23:19.598264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:38.516959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841319+0000","last_change":"2024-09-12T02:23:15.829406+0000","last_active":"2024-09-12T02:23:17.841319+0000","last_peered":"2024-09-12T02:23:17.841319+0000","last_clean":"2024-09-12T02:23:17.841319+0000","last_became_active":"2024-09-12T02:23:15.829135+0000","last_became_peered":"2024-09-12T02:23:15.829135+0000","last_unstale":"2024-09-12T02:23:17.841319+0000","last_undegraded":"2024-09-12T02:23:17.841319+0000","last_fullsized":"2024-09-12T02:23:17.841319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:22.365804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840867+0000","last_change":"2024-09-12T02:23:16.857016+0000","last_active":"2024-09-12T02:23:17.840867+0000","last_peered":"2024-09-12T02:23:17.840867+0000","last_clean":"2024-09-12T02:23:17.840867+0000","last_became_active":"2024-09-12T02:23:16.856705+0000","last_became_peered":"2024-09-12T02:23:16.856705+0000","last_unstale":"2024-09-12T02:23:17.840867+0000","last_undegraded":"2024-09-12T02:23:17.840867+0000","last_fullsized":"2024-09-12T02:23:17.840867+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:03.672668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840282+0000","last_change":"2024-09-12T02:23:04.786424+0000","last_active":"2024-09-12T02:23:17.840282+0000","last_peered":"2024-09-12T02:23:17.840282+0000","last_clean":"2024-09-12T02:23:17.840282+0000","last_became_active":"2024-09-12T02:23:04.786136+0000","last_became_peered":"2024-09-12T02:23:04.786136+0000","last_unstale":"2024-09-12T02:23:17.840282+0000","last_undegraded":"2024-09-12T02:23:17.840282+0000","last_fullsized":"2024-09-12T02:23:17.840282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:31.214894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444621+0000","last_change":"2024-09-12T02:23:03.769745+0000","last_active":"2024-09-12T02:23:18.444621+0000","last_peered":"2024-09-12T02:23:18.444621+0000","last_clean":"2024-09-12T02:23:18.444621+0000","last_became_active":"2024-09-12T02:23:03.769410+0000","last_became_peered":"2024-09-12T02:23:03.769410+0000","last_unstale":"2024-09-12T02:23:18.444621+0000","last_undegraded":"2024-09-12T02:23:18.444621+0000","last_fullsized":"2024-09-12T02:23:18.444621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:00.414459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.838725+0000","last_change":"2024-09-12T02:23:15.827211+0000","last_active":"2024-09-12T02:23:17.838725+0000","last_peered":"2024-09-12T02:23:17.838725+0000","last_clean":"2024-09-12T02:23:17.838725+0000","last_became_active":"2024-09-12T02:23:15.826564+0000","last_became_peered":"2024-09-12T02:23:15.826564+0000","last_unstale":"2024-09-12T02:23:17.838725+0000","last_undegraded":"2024-09-12T02:23:17.838725+0000","last_fullsized":"2024-09-12T02:23:17.838725+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:32.389443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597488+0000","last_change":"2024-09-12T02:23:16.837434+0000","last_active":"2024-09-12T02:23:19.597488+0000","last_peered":"2024-09-12T02:23:19.597488+0000","last_clean":"2024-09-12T02:23:19.597488+0000","last_became_active":"2024-09-12T02:23:16.837162+0000","last_became_peered":"2024-09-12T02:23:16.837162+0000","last_unstale":"2024-09-12T02:23:19.597488+0000","last_undegraded":"2024-09-12T02:23:19.597488+0000","last_fullsized":"2024-09-12T02:23:19.597488+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:09.146064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444511+0000","last_change":"2024-09-12T02:23:04.775876+0000","last_active":"2024-09-12T02:23:18.444511+0000","last_peered":"2024-09-12T02:23:18.444511+0000","last_clean":"2024-09-12T02:23:18.444511+0000","last_became_active":"2024-09-12T02:23:04.775571+0000","last_became_peered":"2024-09-12T02:23:04.775571+0000","last_unstale":"2024-09-12T02:23:18.444511+0000","last_undegraded":"2024-09-12T02:23:18.444511+0000","last_fullsized":"2024-09-12T02:23:18.444511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:05.070528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842890+0000","last_change":"2024-09-12T02:23:03.764093+0000","last_active":"2024-09-12T02:23:17.842890+0000","last_peered":"2024-09-12T02:23:17.842890+0000","last_clean":"2024-09-12T02:23:17.842890+0000","last_became_active":"2024-09-12T02:23:03.763147+0000","last_became_peered":"2024-09-12T02:23:03.763147+0000","last_unstale":"2024-09-12T02:23:17.842890+0000","last_undegraded":"2024-09-12T02:23:17.842890+0000","last_fullsized":"2024-09-12T02:23:17.842890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:13.317894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331728+0000","last_change":"2024-09-12T02:23:15.832461+0000","last_active":"2024-09-12T02:23:18.331728+0000","last_peered":"2024-09-12T02:23:18.331728+0000","last_clean":"2024-09-12T02:23:18.331728+0000","last_became_active":"2024-09-12T02:23:15.831637+0000","last_became_peered":"2024-09-12T02:23:15.831637+0000","last_unstale":"2024-09-12T02:23:18.331728+0000","last_undegraded":"2024-09-12T02:23:18.331728+0000","last_fullsized":"2024-09-12T02:23:18.331728+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:30.909927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.332020+0000","last_change":"2024-09-12T02:23:16.835824+0000","last_active":"2024-09-12T02:23:18.332020+0000","last_peered":"2024-09-12T02:23:18.332020+0000","last_clean":"2024-09-12T02:23:18.332020+0000","last_became_active":"2024-09-12T02:23:16.835520+0000","last_became_peered":"2024-09-12T02:23:16.835520+0000","last_unstale":"2024-09-12T02:23:18.332020+0000","last_undegraded":"2024-09-12T02:23:18.332020+0000","last_fullsized":"2024-09-12T02:23:18.332020+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:32.797100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.326009+0000","last_change":"2024-09-12T02:23:04.787557+0000","last_active":"2024-09-12T02:23:18.326009+0000","last_peered":"2024-09-12T02:23:18.326009+0000","last_clean":"2024-09-12T02:23:18.326009+0000","last_became_active":"2024-09-12T02:23:04.786527+0000","last_became_peered":"2024-09-12T02:23:04.786527+0000","last_unstale":"2024-09-12T02:23:18.326009+0000","last_undegraded":"2024-09-12T02:23:18.326009+0000","last_fullsized":"2024-09-12T02:23:18.326009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:23.273457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444585+0000","last_change":"2024-09-12T02:23:03.769913+0000","last_active":"2024-09-12T02:23:18.444585+0000","last_peered":"2024-09-12T02:23:18.444585+0000","last_clean":"2024-09-12T02:23:18.444585+0000","last_became_active":"2024-09-12T02:23:03.769444+0000","last_became_peered":"2024-09-12T02:23:03.769444+0000","last_unstale":"2024-09-12T02:23:18.444585+0000","last_undegraded":"2024-09-12T02:23:18.444585+0000","last_fullsized":"2024-09-12T02:23:18.444585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:21.243182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444133+0000","last_change":"2024-09-12T02:23:15.829080+0000","last_active":"2024-09-12T02:23:18.444133+0000","last_peered":"2024-09-12T02:23:18.444133+0000","last_clean":"2024-09-12T02:23:18.444133+0000","last_became_active":"2024-09-12T02:23:15.828256+0000","last_became_peered":"2024-09-12T02:23:15.828256+0000","last_unstale":"2024-09-12T02:23:18.444133+0000","last_undegraded":"2024-09-12T02:23:18.444133+0000","last_fullsized":"2024-09-12T02:23:18.444133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:07.743952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331720+0000","last_change":"2024-09-12T02:23:16.845710+0000","last_active":"2024-09-12T02:23:18.331720+0000","last_peered":"2024-09-12T02:23:18.331720+0000","last_clean":"2024-09-12T02:23:18.331720+0000","last_became_active":"2024-09-12T02:23:16.845379+0000","last_became_peered":"2024-09-12T02:23:16.845379+0000","last_unstale":"2024-09-12T02:23:18.331720+0000","last_undegraded":"2024-09-12T02:23:18.331720+0000","last_fullsized":"2024-09-12T02:23:18.331720+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:16.769410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842948+0000","last_change":"2024-09-12T02:23:04.790723+0000","last_active":"2024-09-12T02:23:17.842948+0000","last_peered":"2024-09-12T02:23:17.842948+0000","last_clean":"2024-09-12T02:23:17.842948+0000","last_became_active":"2024-09-12T02:23:04.786877+0000","last_became_peered":"2024-09-12T02:23:04.786877+0000","last_unstale":"2024-09-12T02:23:17.842948+0000","last_undegraded":"2024-09-12T02:23:17.842948+0000","last_fullsized":"2024-09-12T02:23:17.842948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:48.516002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325581+0000","last_change":"2024-09-12T02:23:03.771518+0000","last_active":"2024-09-12T02:23:18.325581+0000","last_peered":"2024-09-12T02:23:18.325581+0000","last_clean":"2024-09-12T02:23:18.325581+0000","last_became_active":"2024-09-12T02:23:03.771063+0000","last_became_peered":"2024-09-12T02:23:03.771063+0000","last_unstale":"2024-09-12T02:23:18.325581+0000","last_undegraded":"2024-09-12T02:23:18.325581+0000","last_fullsized":"2024-09-12T02:23:18.325581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:43.974555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444509+0000","last_change":"2024-09-12T02:23:15.827028+0000","last_active":"2024-09-12T02:23:18.444509+0000","last_peered":"2024-09-12T02:23:18.444509+0000","last_clean":"2024-09-12T02:23:18.444509+0000","last_became_active":"2024-09-12T02:23:15.826708+0000","last_became_peered":"2024-09-12T02:23:15.826708+0000","last_unstale":"2024-09-12T02:23:18.444509+0000","last_undegraded":"2024-09-12T02:23:18.444509+0000","last_fullsized":"2024-09-12T02:23:18.444509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:34.642396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673336+0000","last_change":"2024-09-12T02:23:16.849429+0000","last_active":"2024-09-12T02:23:18.673336+0000","last_peered":"2024-09-12T02:23:18.673336+0000","last_clean":"2024-09-12T02:23:18.673336+0000","last_became_active":"2024-09-12T02:23:16.849119+0000","last_became_peered":"2024-09-12T02:23:16.849119+0000","last_unstale":"2024-09-12T02:23:18.673336+0000","last_undegraded":"2024-09-12T02:23:18.673336+0000","last_fullsized":"2024-09-12T02:23:18.673336+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:10.688619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444107+0000","last_change":"2024-09-12T02:23:04.773745+0000","last_active":"2024-09-12T02:23:18.444107+0000","last_peered":"2024-09-12T02:23:18.444107+0000","last_clean":"2024-09-12T02:23:18.444107+0000","last_became_active":"2024-09-12T02:23:04.773360+0000","last_became_peered":"2024-09-12T02:23:04.773360+0000","last_unstale":"2024-09-12T02:23:18.444107+0000","last_undegraded":"2024-09-12T02:23:18.444107+0000","last_fullsized":"2024-09-12T02:23:18.444107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:33.097774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673252+0000","last_change":"2024-09-12T02:23:03.760700+0000","last_active":"2024-09-12T02:23:18.673252+0000","last_peered":"2024-09-12T02:23:18.673252+0000","last_clean":"2024-09-12T02:23:18.673252+0000","last_became_active":"2024-09-12T02:23:03.760397+0000","last_became_peered":"2024-09-12T02:23:03.760397+0000","last_unstale":"2024-09-12T02:23:18.673252+0000","last_undegraded":"2024-09-12T02:23:18.673252+0000","last_fullsized":"2024-09-12T02:23:18.673252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:36.788864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444739+0000","last_change":"2024-09-12T02:23:15.828714+0000","last_active":"2024-09-12T02:23:18.444739+0000","last_peered":"2024-09-12T02:23:18.444739+0000","last_clean":"2024-09-12T02:23:18.444739+0000","last_became_active":"2024-09-12T02:23:15.827458+0000","last_became_peered":"2024-09-12T02:23:15.827458+0000","last_unstale":"2024-09-12T02:23:18.444739+0000","last_undegraded":"2024-09-12T02:23:18.444739+0000","last_fullsized":"2024-09-12T02:23:18.444739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:12.581897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.326108+0000","last_change":"2024-09-12T02:23:16.855212+0000","last_active":"2024-09-12T02:23:18.326108+0000","last_peered":"2024-09-12T02:23:18.326108+0000","last_clean":"2024-09-12T02:23:18.326108+0000","last_became_active":"2024-09-12T02:23:16.854938+0000","last_became_peered":"2024-09-12T02:23:16.854938+0000","last_unstale":"2024-09-12T02:23:18.326108+0000","last_undegraded":"2024-09-12T02:23:18.326108+0000","last_fullsized":"2024-09-12T02:23:18.326108+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:02.944057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331430+0000","last_change":"2024-09-12T02:23:04.787820+0000","last_active":"2024-09-12T02:23:18.331430+0000","last_peered":"2024-09-12T02:23:18.331430+0000","last_clean":"2024-09-12T02:23:18.331430+0000","last_became_active":"2024-09-12T02:23:04.787523+0000","last_became_peered":"2024-09-12T02:23:04.787523+0000","last_unstale":"2024-09-12T02:23:18.331430+0000","last_undegraded":"2024-09-12T02:23:18.331430+0000","last_fullsized":"2024-09-12T02:23:18.331430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:52.784171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841124+0000","last_change":"2024-09-12T02:23:03.771625+0000","last_active":"2024-09-12T02:23:17.841124+0000","last_peered":"2024-09-12T02:23:17.841124+0000","last_clean":"2024-09-12T02:23:17.841124+0000","last_became_active":"2024-09-12T02:23:03.771163+0000","last_became_peered":"2024-09-12T02:23:03.771163+0000","last_unstale":"2024-09-12T02:23:17.841124+0000","last_undegraded":"2024-09-12T02:23:17.841124+0000","last_fullsized":"2024-09-12T02:23:17.841124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:32.772569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.404274+0000","last_change":"2024-09-12T02:23:15.833889+0000","last_active":"2024-09-12T02:23:18.404274+0000","last_peered":"2024-09-12T02:23:18.404274+0000","last_clean":"2024-09-12T02:23:18.404274+0000","last_became_active":"2024-09-12T02:23:15.833587+0000","last_became_peered":"2024-09-12T02:23:15.833587+0000","last_unstale":"2024-09-12T02:23:18.404274+0000","last_undegraded":"2024-09-12T02:23:18.404274+0000","last_fullsized":"2024-09-12T02:23:18.404274+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:32.787861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842295+0000","last_change":"2024-09-12T02:23:16.848864+0000","last_active":"2024-09-12T02:23:17.842295+0000","last_peered":"2024-09-12T02:23:17.842295+0000","last_clean":"2024-09-12T02:23:17.842295+0000","last_became_active":"2024-09-12T02:23:16.848385+0000","last_became_peered":"2024-09-12T02:23:16.848385+0000","last_unstale":"2024-09-12T02:23:17.842295+0000","last_undegraded":"2024-09-12T02:23:17.842295+0000","last_fullsized":"2024-09-12T02:23:17.842295+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:03.656397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839490+0000","last_change":"2024-09-12T02:23:04.781839+0000","last_active":"2024-09-12T02:23:17.839490+0000","last_peered":"2024-09-12T02:23:17.839490+0000","last_clean":"2024-09-12T02:23:17.839490+0000","last_became_active":"2024-09-12T02:23:04.780984+0000","last_became_peered":"2024-09-12T02:23:04.780984+0000","last_unstale":"2024-09-12T02:23:17.839490+0000","last_undegraded":"2024-09-12T02:23:17.839490+0000","last_fullsized":"2024-09-12T02:23:17.839490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:07.692791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325299+0000","last_change":"2024-09-12T02:23:03.765100+0000","last_active":"2024-09-12T02:23:18.325299+0000","last_peered":"2024-09-12T02:23:18.325299+0000","last_clean":"2024-09-12T02:23:18.325299+0000","last_became_active":"2024-09-12T02:23:03.764801+0000","last_became_peered":"2024-09-12T02:23:03.764801+0000","last_unstale":"2024-09-12T02:23:18.325299+0000","last_undegraded":"2024-09-12T02:23:18.325299+0000","last_fullsized":"2024-09-12T02:23:18.325299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:06.891040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":178,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841644+0000","last_change":"2024-09-12T02:22:55.143869+0000","last_active":"2024-09-12T02:23:17.841644+0000","last_peered":"2024-09-12T02:23:17.841644+0000","last_clean":"2024-09-12T02:23:17.841644+0000","last_became_active":"2024-09-12T02:22:55.142784+0000","last_became_peered":"2024-09-12T02:22:55.142784+0000","last_unstale":"2024-09-12T02:23:17.841644+0000","last_undegraded":"2024-09-12T02:23:17.841644+0000","last_fullsized":"2024-09-12T02:23:17.841644+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:22:52.457979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:22:52.457979+0000","last_clean_scrub_stamp":"2024-09-12T02:22:52.457979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:46.152602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597751+0000","last_change":"2024-09-12T02:23:15.831362+0000","last_active":"2024-09-12T02:23:19.597751+0000","last_peered":"2024-09-12T02:23:19.597751+0000","last_clean":"2024-09-12T02:23:19.597751+0000","last_became_active":"2024-09-12T02:23:15.831084+0000","last_became_peered":"2024-09-12T02:23:15.831084+0000","last_unstale":"2024-09-12T02:23:19.597751+0000","last_undegraded":"2024-09-12T02:23:19.597751+0000","last_fullsized":"2024-09-12T02:23:19.597751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:17.754173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673475+0000","last_change":"2024-09-12T02:23:16.838831+0000","last_active":"2024-09-12T02:23:18.673475+0000","last_peered":"2024-09-12T02:23:18.673475+0000","last_clean":"2024-09-12T02:23:18.673475+0000","last_became_active":"2024-09-12T02:23:16.838523+0000","last_became_peered":"2024-09-12T02:23:16.838523+0000","last_unstale":"2024-09-12T02:23:18.673475+0000","last_undegraded":"2024-09-12T02:23:18.673475+0000","last_fullsized":"2024-09-12T02:23:18.673475+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:35:42.088332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842398+0000","last_change":"2024-09-12T02:23:04.783483+0000","last_active":"2024-09-12T02:23:17.842398+0000","last_peered":"2024-09-12T02:23:17.842398+0000","last_clean":"2024-09-12T02:23:17.842398+0000","last_became_active":"2024-09-12T02:23:04.782878+0000","last_became_peered":"2024-09-12T02:23:04.782878+0000","last_unstale":"2024-09-12T02:23:17.842398+0000","last_undegraded":"2024-09-12T02:23:17.842398+0000","last_fullsized":"2024-09-12T02:23:17.842398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:52.335065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673508+0000","last_change":"2024-09-12T02:23:03.762507+0000","last_active":"2024-09-12T02:23:18.673508+0000","last_peered":"2024-09-12T02:23:18.673508+0000","last_clean":"2024-09-12T02:23:18.673508+0000","last_became_active":"2024-09-12T02:23:03.762164+0000","last_became_peered":"2024-09-12T02:23:03.762164+0000","last_unstale":"2024-09-12T02:23:18.673508+0000","last_undegraded":"2024-09-12T02:23:18.673508+0000","last_fullsized":"2024-09-12T02:23:18.673508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:34.569630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597483+0000","last_change":"2024-09-12T02:23:15.830783+0000","last_active":"2024-09-12T02:23:19.597483+0000","last_peered":"2024-09-12T02:23:19.597483+0000","last_clean":"2024-09-12T02:23:19.597483+0000","last_became_active":"2024-09-12T02:23:15.830471+0000","last_became_peered":"2024-09-12T02:23:15.830471+0000","last_unstale":"2024-09-12T02:23:19.597483+0000","last_undegraded":"2024-09-12T02:23:19.597483+0000","last_fullsized":"2024-09-12T02:23:19.597483+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:22.927201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673175+0000","last_change":"2024-09-12T02:23:16.856328+0000","last_active":"2024-09-12T02:23:18.673175+0000","last_peered":"2024-09-12T02:23:18.673175+0000","last_clean":"2024-09-12T02:23:18.673175+0000","last_became_active":"2024-09-12T02:23:16.855992+0000","last_became_peered":"2024-09-12T02:23:16.855992+0000","last_unstale":"2024-09-12T02:23:18.673175+0000","last_undegraded":"2024-09-12T02:23:18.673175+0000","last_fullsized":"2024-09-12T02:23:18.673175+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:47.682103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325763+0000","last_change":"2024-09-12T02:23:04.784318+0000","last_active":"2024-09-12T02:23:18.325763+0000","last_peered":"2024-09-12T02:23:18.325763+0000","last_clean":"2024-09-12T02:23:18.325763+0000","last_became_active":"2024-09-12T02:23:04.784012+0000","last_became_peered":"2024-09-12T02:23:04.784012+0000","last_unstale":"2024-09-12T02:23:18.325763+0000","last_undegraded":"2024-09-12T02:23:18.325763+0000","last_fullsized":"2024-09-12T02:23:18.325763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:51.352859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444936+0000","last_change":"2024-09-12T02:23:03.766034+0000","last_active":"2024-09-12T02:23:18.444936+0000","last_peered":"2024-09-12T02:23:18.444936+0000","last_clean":"2024-09-12T02:23:18.444936+0000","last_became_active":"2024-09-12T02:23:03.765735+0000","last_became_peered":"2024-09-12T02:23:03.765735+0000","last_unstale":"2024-09-12T02:23:18.444936+0000","last_undegraded":"2024-09-12T02:23:18.444936+0000","last_fullsized":"2024-09-12T02:23:18.444936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:19.691229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331594+0000","last_change":"2024-09-12T02:23:15.832527+0000","last_active":"2024-09-12T02:23:18.331594+0000","last_peered":"2024-09-12T02:23:18.331594+0000","last_clean":"2024-09-12T02:23:18.331594+0000","last_became_active":"2024-09-12T02:23:15.832184+0000","last_became_peered":"2024-09-12T02:23:15.832184+0000","last_unstale":"2024-09-12T02:23:18.331594+0000","last_undegraded":"2024-09-12T02:23:18.331594+0000","last_fullsized":"2024-09-12T02:23:18.331594+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:29.131198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840742+0000","last_change":"2024-09-12T02:23:16.849357+0000","last_active":"2024-09-12T02:23:17.840742+0000","last_peered":"2024-09-12T02:23:17.840742+0000","last_clean":"2024-09-12T02:23:17.840742+0000","last_became_active":"2024-09-12T02:23:16.849067+0000","last_became_peered":"2024-09-12T02:23:16.849067+0000","last_unstale":"2024-09-12T02:23:17.840742+0000","last_undegraded":"2024-09-12T02:23:17.840742+0000","last_fullsized":"2024-09-12T02:23:17.840742+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:06.887523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.843122+0000","last_change":"2024-09-12T02:23:04.791152+0000","last_active":"2024-09-12T02:23:17.843122+0000","last_peered":"2024-09-12T02:23:17.843122+0000","last_clean":"2024-09-12T02:23:17.843122+0000","last_became_active":"2024-09-12T02:23:04.790707+0000","last_became_peered":"2024-09-12T02:23:04.790707+0000","last_unstale":"2024-09-12T02:23:17.843122+0000","last_undegraded":"2024-09-12T02:23:17.843122+0000","last_fullsized":"2024-09-12T02:23:17.843122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:42.798507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673465+0000","last_change":"2024-09-12T02:23:03.763327+0000","last_active":"2024-09-12T02:23:18.673465+0000","last_peered":"2024-09-12T02:23:18.673465+0000","last_clean":"2024-09-12T02:23:18.673465+0000","last_became_active":"2024-09-12T02:23:03.763005+0000","last_became_peered":"2024-09-12T02:23:03.763005+0000","last_unstale":"2024-09-12T02:23:18.673465+0000","last_undegraded":"2024-09-12T02:23:18.673465+0000","last_fullsized":"2024-09-12T02:23:18.673465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:09.500459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325022+0000","last_change":"2024-09-12T02:23:15.819644+0000","last_active":"2024-09-12T02:23:18.325022+0000","last_peered":"2024-09-12T02:23:18.325022+0000","last_clean":"2024-09-12T02:23:18.325022+0000","last_became_active":"2024-09-12T02:23:15.819370+0000","last_became_peered":"2024-09-12T02:23:15.819370+0000","last_unstale":"2024-09-12T02:23:18.325022+0000","last_undegraded":"2024-09-12T02:23:18.325022+0000","last_fullsized":"2024-09-12T02:23:18.325022+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:56.384531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673028+0000","last_change":"2024-09-12T02:23:16.838234+0000","last_active":"2024-09-12T02:23:18.673028+0000","last_peered":"2024-09-12T02:23:18.673028+0000","last_clean":"2024-09-12T02:23:18.673028+0000","last_became_active":"2024-09-12T02:23:16.837942+0000","last_became_peered":"2024-09-12T02:23:16.837942+0000","last_unstale":"2024-09-12T02:23:18.673028+0000","last_undegraded":"2024-09-12T02:23:18.673028+0000","last_fullsized":"2024-09-12T02:23:18.673028+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:41.842931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842558+0000","last_change":"2024-09-12T02:23:04.781196+0000","last_active":"2024-09-12T02:23:17.842558+0000","last_peered":"2024-09-12T02:23:17.842558+0000","last_clean":"2024-09-12T02:23:17.842558+0000","last_became_active":"2024-09-12T02:23:04.780893+0000","last_became_peered":"2024-09-12T02:23:04.780893+0000","last_unstale":"2024-09-12T02:23:17.842558+0000","last_undegraded":"2024-09-12T02:23:17.842558+0000","last_fullsized":"2024-09-12T02:23:17.842558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:26.527539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842742+0000","last_change":"2024-09-12T02:23:03.769541+0000","last_active":"2024-09-12T02:23:17.842742+0000","last_peered":"2024-09-12T02:23:17.842742+0000","last_clean":"2024-09-12T02:23:17.842742+0000","last_became_active":"2024-09-12T02:23:03.765281+0000","last_became_peered":"2024-09-12T02:23:03.765281+0000","last_unstale":"2024-09-12T02:23:17.842742+0000","last_undegraded":"2024-09-12T02:23:17.842742+0000","last_fullsized":"2024-09-12T02:23:17.842742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:53.409370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841039+0000","last_change":"2024-09-12T02:23:15.841592+0000","last_active":"2024-09-12T02:23:17.841039+0000","last_peered":"2024-09-12T02:23:17.841039+0000","last_clean":"2024-09-12T02:23:17.841039+0000","last_became_active":"2024-09-12T02:23:15.841380+0000","last_became_peered":"2024-09-12T02:23:15.841380+0000","last_unstale":"2024-09-12T02:23:17.841039+0000","last_undegraded":"2024-09-12T02:23:17.841039+0000","last_fullsized":"2024-09-12T02:23:17.841039+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:38.396332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840229+0000","last_change":"2024-09-12T02:23:16.846596+0000","last_active":"2024-09-12T02:23:17.840229+0000","last_peered":"2024-09-12T02:23:17.840229+0000","last_clean":"2024-09-12T02:23:17.840229+0000","last_became_active":"2024-09-12T02:23:16.846273+0000","last_became_peered":"2024-09-12T02:23:16.846273+0000","last_unstale":"2024-09-12T02:23:17.840229+0000","last_undegraded":"2024-09-12T02:23:17.840229+0000","last_fullsized":"2024-09-12T02:23:17.840229+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:03.628494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841299+0000","last_change":"2024-09-12T02:23:04.781856+0000","last_active":"2024-09-12T02:23:17.841299+0000","last_peered":"2024-09-12T02:23:17.841299+0000","last_clean":"2024-09-12T02:23:17.841299+0000","last_became_active":"2024-09-12T02:23:04.781575+0000","last_became_peered":"2024-09-12T02:23:04.781575+0000","last_unstale":"2024-09-12T02:23:17.841299+0000","last_undegraded":"2024-09-12T02:23:17.841299+0000","last_fullsized":"2024-09-12T02:23:17.841299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:26.630558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673048+0000","last_change":"2024-09-12T02:23:03.771368+0000","last_active":"2024-09-12T02:23:18.673048+0000","last_peered":"2024-09-12T02:23:18.673048+0000","last_clean":"2024-09-12T02:23:18.673048+0000","last_became_active":"2024-09-12T02:23:03.771061+0000","last_became_peered":"2024-09-12T02:23:03.771061+0000","last_unstale":"2024-09-12T02:23:18.673048+0000","last_undegraded":"2024-09-12T02:23:18.673048+0000","last_fullsized":"2024-09-12T02:23:18.673048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:57.476458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.332045+0000","last_change":"2024-09-12T02:23:15.833158+0000","last_active":"2024-09-12T02:23:18.332045+0000","last_peered":"2024-09-12T02:23:18.332045+0000","last_clean":"2024-09-12T02:23:18.332045+0000","last_became_active":"2024-09-12T02:23:15.831707+0000","last_became_peered":"2024-09-12T02:23:15.831707+0000","last_unstale":"2024-09-12T02:23:18.332045+0000","last_undegraded":"2024-09-12T02:23:18.332045+0000","last_fullsized":"2024-09-12T02:23:18.332045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:30.000066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325904+0000","last_change":"2024-09-12T02:23:16.858757+0000","last_active":"2024-09-12T02:23:18.325904+0000","last_peered":"2024-09-12T02:23:18.325904+0000","last_clean":"2024-09-12T02:23:18.325904+0000","last_became_active":"2024-09-12T02:23:16.858469+0000","last_became_peered":"2024-09-12T02:23:16.858469+0000","last_unstale":"2024-09-12T02:23:18.325904+0000","last_undegraded":"2024-09-12T02:23:18.325904+0000","last_fullsized":"2024-09-12T02:23:18.325904+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:22.288143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597329+0000","last_change":"2024-09-12T02:23:04.785248+0000","last_active":"2024-09-12T02:23:19.597329+0000","last_peered":"2024-09-12T02:23:19.597329+0000","last_clean":"2024-09-12T02:23:19.597329+0000","last_became_active":"2024-09-12T02:23:04.784977+0000","last_became_peered":"2024-09-12T02:23:04.784977+0000","last_unstale":"2024-09-12T02:23:19.597329+0000","last_undegraded":"2024-09-12T02:23:19.597329+0000","last_fullsized":"2024-09-12T02:23:19.597329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:23.273457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597715+0000","last_change":"2024-09-12T02:23:03.767842+0000","last_active":"2024-09-12T02:23:19.597715+0000","last_peered":"2024-09-12T02:23:19.597715+0000","last_clean":"2024-09-12T02:23:19.597715+0000","last_became_active":"2024-09-12T02:23:03.767066+0000","last_became_peered":"2024-09-12T02:23:03.767066+0000","last_unstale":"2024-09-12T02:23:19.597715+0000","last_undegraded":"2024-09-12T02:23:19.597715+0000","last_fullsized":"2024-09-12T02:23:19.597715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:50.800749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840199+0000","last_change":"2024-09-12T02:23:15.826104+0000","last_active":"2024-09-12T02:23:17.840199+0000","last_peered":"2024-09-12T02:23:17.840199+0000","last_clean":"2024-09-12T02:23:17.840199+0000","last_became_active":"2024-09-12T02:23:15.825779+0000","last_became_peered":"2024-09-12T02:23:15.825779+0000","last_unstale":"2024-09-12T02:23:17.840199+0000","last_undegraded":"2024-09-12T02:23:17.840199+0000","last_fullsized":"2024-09-12T02:23:17.840199+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:32.661083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325654+0000","last_change":"2024-09-12T02:23:16.856543+0000","last_active":"2024-09-12T02:23:18.325654+0000","last_peered":"2024-09-12T02:23:18.325654+0000","last_clean":"2024-09-12T02:23:18.325654+0000","last_became_active":"2024-09-12T02:23:16.855538+0000","last_became_peered":"2024-09-12T02:23:16.855538+0000","last_unstale":"2024-09-12T02:23:18.325654+0000","last_undegraded":"2024-09-12T02:23:18.325654+0000","last_fullsized":"2024-09-12T02:23:18.325654+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:05.857593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841758+0000","last_change":"2024-09-12T02:23:04.783671+0000","last_active":"2024-09-12T02:23:17.841758+0000","last_peered":"2024-09-12T02:23:17.841758+0000","last_clean":"2024-09-12T02:23:17.841758+0000","last_became_active":"2024-09-12T02:23:04.783399+0000","last_became_peered":"2024-09-12T02:23:04.783399+0000","last_unstale":"2024-09-12T02:23:17.841758+0000","last_undegraded":"2024-09-12T02:23:17.841758+0000","last_fullsized":"2024-09-12T02:23:17.841758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:04.321789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325480+0000","last_change":"2024-09-12T02:23:03.767217+0000","last_active":"2024-09-12T02:23:18.325480+0000","last_peered":"2024-09-12T02:23:18.325480+0000","last_clean":"2024-09-12T02:23:18.325480+0000","last_became_active":"2024-09-12T02:23:03.766551+0000","last_became_peered":"2024-09-12T02:23:03.766551+0000","last_unstale":"2024-09-12T02:23:18.325480+0000","last_undegraded":"2024-09-12T02:23:18.325480+0000","last_fullsized":"2024-09-12T02:23:18.325480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:09.963450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"26'8","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:35.328948+0000","last_change":"2024-09-12T02:23:15.832638+0000","last_active":"2024-09-12T02:23:35.328948+0000","last_peered":"2024-09-12T02:23:35.328948+0000","last_clean":"2024-09-12T02:23:35.328948+0000","last_became_active":"2024-09-12T02:23:15.832152+0000","last_became_peered":"2024-09-12T02:23:15.832152+0000","last_unstale":"2024-09-12T02:23:35.328948+0000","last_undegraded":"2024-09-12T02:23:35.328948+0000","last_fullsized":"2024-09-12T02:23:35.328948+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:06.820636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2055,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839619+0000","last_change":"2024-09-12T02:23:16.846920+0000","last_active":"2024-09-12T02:23:17.839619+0000","last_peered":"2024-09-12T02:23:17.839619+0000","last_clean":"2024-09-12T02:23:17.839619+0000","last_became_active":"2024-09-12T02:23:16.846454+0000","last_became_peered":"2024-09-12T02:23:16.846454+0000","last_unstale":"2024-09-12T02:23:17.839619+0000","last_undegraded":"2024-09-12T02:23:17.839619+0000","last_fullsized":"2024-09-12T02:23:17.839619+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:51.782998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331516+0000","last_change":"2024-09-12T02:23:04.784379+0000","last_active":"2024-09-12T02:23:18.331516+0000","last_peered":"2024-09-12T02:23:18.331516+0000","last_clean":"2024-09-12T02:23:18.331516+0000","last_became_active":"2024-09-12T02:23:04.784094+0000","last_became_peered":"2024-09-12T02:23:04.784094+0000","last_unstale":"2024-09-12T02:23:18.331516+0000","last_undegraded":"2024-09-12T02:23:18.331516+0000","last_fullsized":"2024-09-12T02:23:18.331516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:22.103008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.332137+0000","last_change":"2024-09-12T02:23:03.762859+0000","last_active":"2024-09-12T02:23:18.332137+0000","last_peered":"2024-09-12T02:23:18.332137+0000","last_clean":"2024-09-12T02:23:18.332137+0000","last_became_active":"2024-09-12T02:23:03.762557+0000","last_became_peered":"2024-09-12T02:23:03.762557+0000","last_unstale":"2024-09-12T02:23:18.332137+0000","last_undegraded":"2024-09-12T02:23:18.332137+0000","last_fullsized":"2024-09-12T02:23:18.332137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:34.863435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"25'3","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325835+0000","last_change":"2024-09-12T02:23:15.823090+0000","last_active":"2024-09-12T02:23:18.325835+0000","last_peered":"2024-09-12T02:23:18.325835+0000","last_clean":"2024-09-12T02:23:18.325835+0000","last_became_active":"2024-09-12T02:23:15.822441+0000","last_became_peered":"2024-09-12T02:23:15.822441+0000","last_unstale":"2024-09-12T02:23:18.325835+0000","last_undegraded":"2024-09-12T02:23:18.325835+0000","last_fullsized":"2024-09-12T02:23:18.325835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:35.125478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839147+0000","last_change":"2024-09-12T02:23:16.839875+0000","last_active":"2024-09-12T02:23:17.839147+0000","last_peered":"2024-09-12T02:23:17.839147+0000","last_clean":"2024-09-12T02:23:17.839147+0000","last_became_active":"2024-09-12T02:23:16.838277+0000","last_became_peered":"2024-09-12T02:23:16.838277+0000","last_unstale":"2024-09-12T02:23:17.839147+0000","last_undegraded":"2024-09-12T02:23:17.839147+0000","last_fullsized":"2024-09-12T02:23:17.839147+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:09.370310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842288+0000","last_change":"2024-09-12T02:23:04.780843+0000","last_active":"2024-09-12T02:23:17.842288+0000","last_peered":"2024-09-12T02:23:17.842288+0000","last_clean":"2024-09-12T02:23:17.842288+0000","last_became_active":"2024-09-12T02:23:04.780475+0000","last_became_peered":"2024-09-12T02:23:04.780475+0000","last_unstale":"2024-09-12T02:23:17.842288+0000","last_undegraded":"2024-09-12T02:23:17.842288+0000","last_fullsized":"2024-09-12T02:23:17.842288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:38.074872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:33.256453+0000","last_change":"2024-09-12T02:23:03.768425+0000","last_active":"2024-09-12T02:23:33.256453+0000","last_peered":"2024-09-12T02:23:33.256453+0000","last_clean":"2024-09-12T02:23:33.256453+0000","last_became_active":"2024-09-12T02:23:03.768092+0000","last_became_peered":"2024-09-12T02:23:03.768092+0000","last_unstale":"2024-09-12T02:23:33.256453+0000","last_undegraded":"2024-09-12T02:23:33.256453+0000","last_fullsized":"2024-09-12T02:23:33.256453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:18.572070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2055,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444109+0000","last_change":"2024-09-12T02:23:15.829364+0000","last_active":"2024-09-12T02:23:18.444109+0000","last_peered":"2024-09-12T02:23:18.444109+0000","last_clean":"2024-09-12T02:23:18.444109+0000","last_became_active":"2024-09-12T02:23:15.827936+0000","last_became_peered":"2024-09-12T02:23:15.827936+0000","last_unstale":"2024-09-12T02:23:18.444109+0000","last_undegraded":"2024-09-12T02:23:18.444109+0000","last_fullsized":"2024-09-12T02:23:18.444109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:04.973202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444416+0000","last_change":"2024-09-12T02:23:16.854209+0000","last_active":"2024-09-12T02:23:18.444416+0000","last_peered":"2024-09-12T02:23:18.444416+0000","last_clean":"2024-09-12T02:23:18.444416+0000","last_became_active":"2024-09-12T02:23:16.853900+0000","last_became_peered":"2024-09-12T02:23:16.853900+0000","last_unstale":"2024-09-12T02:23:18.444416+0000","last_undegraded":"2024-09-12T02:23:18.444416+0000","last_fullsized":"2024-09-12T02:23:18.444416+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:52.831434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842656+0000","last_change":"2024-09-12T02:23:04.777953+0000","last_active":"2024-09-12T02:23:17.842656+0000","last_peered":"2024-09-12T02:23:17.842656+0000","last_clean":"2024-09-12T02:23:17.842656+0000","last_became_active":"2024-09-12T02:23:04.777081+0000","last_became_peered":"2024-09-12T02:23:04.777081+0000","last_unstale":"2024-09-12T02:23:17.842656+0000","last_undegraded":"2024-09-12T02:23:17.842656+0000","last_fullsized":"2024-09-12T02:23:17.842656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:14.103378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444886+0000","last_change":"2024-09-12T02:23:03.771271+0000","last_active":"2024-09-12T02:23:18.444886+0000","last_peered":"2024-09-12T02:23:18.444886+0000","last_clean":"2024-09-12T02:23:18.444886+0000","last_became_active":"2024-09-12T02:23:03.769601+0000","last_became_peered":"2024-09-12T02:23:03.769601+0000","last_unstale":"2024-09-12T02:23:18.444886+0000","last_undegraded":"2024-09-12T02:23:18.444886+0000","last_fullsized":"2024-09-12T02:23:18.444886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:22.910072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842076+0000","last_change":"2024-09-12T02:23:15.831522+0000","last_active":"2024-09-12T02:23:17.842076+0000","last_peered":"2024-09-12T02:23:17.842076+0000","last_clean":"2024-09-12T02:23:17.842076+0000","last_became_active":"2024-09-12T02:23:15.831220+0000","last_became_peered":"2024-09-12T02:23:15.831220+0000","last_unstale":"2024-09-12T02:23:17.842076+0000","last_undegraded":"2024-09-12T02:23:17.842076+0000","last_fullsized":"2024-09-12T02:23:17.842076+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:54.337051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597564+0000","last_change":"2024-09-12T02:23:16.858361+0000","last_active":"2024-09-12T02:23:19.597564+0000","last_peered":"2024-09-12T02:23:19.597564+0000","last_clean":"2024-09-12T02:23:19.597564+0000","last_became_active":"2024-09-12T02:23:16.858075+0000","last_became_peered":"2024-09-12T02:23:16.858075+0000","last_unstale":"2024-09-12T02:23:19.597564+0000","last_undegraded":"2024-09-12T02:23:19.597564+0000","last_fullsized":"2024-09-12T02:23:19.597564+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:35.038604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331887+0000","last_change":"2024-09-12T02:23:04.779171+0000","last_active":"2024-09-12T02:23:18.331887+0000","last_peered":"2024-09-12T02:23:18.331887+0000","last_clean":"2024-09-12T02:23:18.331887+0000","last_became_active":"2024-09-12T02:23:04.778850+0000","last_became_peered":"2024-09-12T02:23:04.778850+0000","last_unstale":"2024-09-12T02:23:18.331887+0000","last_undegraded":"2024-09-12T02:23:18.331887+0000","last_fullsized":"2024-09-12T02:23:18.331887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:21.746490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325975+0000","last_change":"2024-09-12T02:23:03.769710+0000","last_active":"2024-09-12T02:23:18.325975+0000","last_peered":"2024-09-12T02:23:18.325975+0000","last_clean":"2024-09-12T02:23:18.325975+0000","last_became_active":"2024-09-12T02:23:03.769436+0000","last_became_peered":"2024-09-12T02:23:03.769436+0000","last_unstale":"2024-09-12T02:23:18.325975+0000","last_undegraded":"2024-09-12T02:23:18.325975+0000","last_fullsized":"2024-09-12T02:23:18.325975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:11.194147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"25'8","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.838898+0000","last_change":"2024-09-12T02:23:15.833196+0000","last_active":"2024-09-12T02:23:17.838898+0000","last_peered":"2024-09-12T02:23:17.838898+0000","last_clean":"2024-09-12T02:23:17.838898+0000","last_became_active":"2024-09-12T02:23:15.832873+0000","last_became_peered":"2024-09-12T02:23:15.832873+0000","last_unstale":"2024-09-12T02:23:17.838898+0000","last_undegraded":"2024-09-12T02:23:17.838898+0000","last_fullsized":"2024-09-12T02:23:17.838898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:15.238046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840614+0000","last_change":"2024-09-12T02:23:16.856735+0000","last_active":"2024-09-12T02:23:17.840614+0000","last_peered":"2024-09-12T02:23:17.840614+0000","last_clean":"2024-09-12T02:23:17.840614+0000","last_became_active":"2024-09-12T02:23:16.856455+0000","last_became_peered":"2024-09-12T02:23:16.856455+0000","last_unstale":"2024-09-12T02:23:17.840614+0000","last_undegraded":"2024-09-12T02:23:17.840614+0000","last_fullsized":"2024-09-12T02:23:17.840614+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:55.376194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325968+0000","last_change":"2024-09-12T02:23:04.786100+0000","last_active":"2024-09-12T02:23:18.325968+0000","last_peered":"2024-09-12T02:23:18.325968+0000","last_clean":"2024-09-12T02:23:18.325968+0000","last_became_active":"2024-09-12T02:23:04.785795+0000","last_became_peered":"2024-09-12T02:23:04.785795+0000","last_unstale":"2024-09-12T02:23:18.325968+0000","last_undegraded":"2024-09-12T02:23:18.325968+0000","last_fullsized":"2024-09-12T02:23:18.325968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:58.597807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.598224+0000","last_change":"2024-09-12T02:23:03.770668+0000","last_active":"2024-09-12T02:23:19.598224+0000","last_peered":"2024-09-12T02:23:19.598224+0000","last_clean":"2024-09-12T02:23:19.598224+0000","last_became_active":"2024-09-12T02:23:03.769302+0000","last_became_peered":"2024-09-12T02:23:03.769302+0000","last_unstale":"2024-09-12T02:23:19.598224+0000","last_undegraded":"2024-09-12T02:23:19.598224+0000","last_fullsized":"2024-09-12T02:23:19.598224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:18.948922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.838826+0000","last_change":"2024-09-12T02:23:15.825585+0000","last_active":"2024-09-12T02:23:17.838826+0000","last_peered":"2024-09-12T02:23:17.838826+0000","last_clean":"2024-09-12T02:23:17.838826+0000","last_became_active":"2024-09-12T02:23:15.825305+0000","last_became_peered":"2024-09-12T02:23:15.825305+0000","last_unstale":"2024-09-12T02:23:17.838826+0000","last_undegraded":"2024-09-12T02:23:17.838826+0000","last_fullsized":"2024-09-12T02:23:17.838826+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:43.818922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.598136+0000","last_change":"2024-09-12T02:23:16.852415+0000","last_active":"2024-09-12T02:23:19.598136+0000","last_peered":"2024-09-12T02:23:19.598136+0000","last_clean":"2024-09-12T02:23:19.598136+0000","last_became_active":"2024-09-12T02:23:16.852061+0000","last_became_peered":"2024-09-12T02:23:16.852061+0000","last_unstale":"2024-09-12T02:23:19.598136+0000","last_undegraded":"2024-09-12T02:23:19.598136+0000","last_fullsized":"2024-09-12T02:23:19.598136+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:30:49.720576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"25'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331783+0000","last_change":"2024-09-12T02:23:15.833414+0000","last_active":"2024-09-12T02:23:18.331783+0000","last_peered":"2024-09-12T02:23:18.331783+0000","last_clean":"2024-09-12T02:23:18.331783+0000","last_became_active":"2024-09-12T02:23:15.832837+0000","last_became_peered":"2024-09-12T02:23:15.832837+0000","last_unstale":"2024-09-12T02:23:18.331783+0000","last_undegraded":"2024-09-12T02:23:18.331783+0000","last_fullsized":"2024-09-12T02:23:18.331783+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:31.510160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444086+0000","last_change":"2024-09-12T02:23:04.776572+0000","last_active":"2024-09-12T02:23:18.444086+0000","last_peered":"2024-09-12T02:23:18.444086+0000","last_clean":"2024-09-12T02:23:18.444086+0000","last_became_active":"2024-09-12T02:23:04.776270+0000","last_became_peered":"2024-09-12T02:23:04.776270+0000","last_unstale":"2024-09-12T02:23:18.444086+0000","last_undegraded":"2024-09-12T02:23:18.444086+0000","last_fullsized":"2024-09-12T02:23:18.444086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:12.807907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325207+0000","last_change":"2024-09-12T02:23:03.762450+0000","last_active":"2024-09-12T02:23:18.325207+0000","last_peered":"2024-09-12T02:23:18.325207+0000","last_clean":"2024-09-12T02:23:18.325207+0000","last_became_active":"2024-09-12T02:23:03.762161+0000","last_became_peered":"2024-09-12T02:23:03.762161+0000","last_unstale":"2024-09-12T02:23:18.325207+0000","last_undegraded":"2024-09-12T02:23:18.325207+0000","last_fullsized":"2024-09-12T02:23:18.325207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:42.256395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331804+0000","last_change":"2024-09-12T02:23:16.844537+0000","last_active":"2024-09-12T02:23:18.331804+0000","last_peered":"2024-09-12T02:23:18.331804+0000","last_clean":"2024-09-12T02:23:18.331804+0000","last_became_active":"2024-09-12T02:23:16.844248+0000","last_became_peered":"2024-09-12T02:23:16.844248+0000","last_unstale":"2024-09-12T02:23:18.331804+0000","last_undegraded":"2024-09-12T02:23:18.331804+0000","last_fullsized":"2024-09-12T02:23:18.331804+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:45.801324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"25'4","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.598147+0000","last_change":"2024-09-12T02:23:15.826010+0000","last_active":"2024-09-12T02:23:19.598147+0000","last_peered":"2024-09-12T02:23:19.598147+0000","last_clean":"2024-09-12T02:23:19.598147+0000","last_became_active":"2024-09-12T02:23:15.825730+0000","last_became_peered":"2024-09-12T02:23:15.825730+0000","last_unstale":"2024-09-12T02:23:19.598147+0000","last_undegraded":"2024-09-12T02:23:19.598147+0000","last_fullsized":"2024-09-12T02:23:19.598147+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:17.920975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839339+0000","last_change":"2024-09-12T02:23:04.783317+0000","last_active":"2024-09-12T02:23:17.839339+0000","last_peered":"2024-09-12T02:23:17.839339+0000","last_clean":"2024-09-12T02:23:17.839339+0000","last_became_active":"2024-09-12T02:23:04.783039+0000","last_became_peered":"2024-09-12T02:23:04.783039+0000","last_unstale":"2024-09-12T02:23:17.839339+0000","last_undegraded":"2024-09-12T02:23:17.839339+0000","last_fullsized":"2024-09-12T02:23:17.839339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:17.577991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839055+0000","last_change":"2024-09-12T02:23:03.768361+0000","last_active":"2024-09-12T02:23:17.839055+0000","last_peered":"2024-09-12T02:23:17.839055+0000","last_clean":"2024-09-12T02:23:17.839055+0000","last_became_active":"2024-09-12T02:23:03.768137+0000","last_became_peered":"2024-09-12T02:23:03.768137+0000","last_unstale":"2024-09-12T02:23:17.839055+0000","last_undegraded":"2024-09-12T02:23:17.839055+0000","last_fullsized":"2024-09-12T02:23:17.839055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:29.721363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444813+0000","last_change":"2024-09-12T02:23:16.861251+0000","last_active":"2024-09-12T02:23:18.444813+0000","last_peered":"2024-09-12T02:23:18.444813+0000","last_clean":"2024-09-12T02:23:18.444813+0000","last_became_active":"2024-09-12T02:23:16.860980+0000","last_became_peered":"2024-09-12T02:23:16.860980+0000","last_unstale":"2024-09-12T02:23:18.444813+0000","last_undegraded":"2024-09-12T02:23:18.444813+0000","last_fullsized":"2024-09-12T02:23:18.444813+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:16.177179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597691+0000","last_change":"2024-09-12T02:23:03.768186+0000","last_active":"2024-09-12T02:23:19.597691+0000","last_peered":"2024-09-12T02:23:19.597691+0000","last_clean":"2024-09-12T02:23:19.597691+0000","last_became_active":"2024-09-12T02:23:03.767916+0000","last_became_peered":"2024-09-12T02:23:03.767916+0000","last_unstale":"2024-09-12T02:23:19.597691+0000","last_undegraded":"2024-09-12T02:23:19.597691+0000","last_fullsized":"2024-09-12T02:23:19.597691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:04.424540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.332085+0000","last_change":"2024-09-12T02:23:04.793412+0000","last_active":"2024-09-12T02:23:18.332085+0000","last_peered":"2024-09-12T02:23:18.332085+0000","last_clean":"2024-09-12T02:23:18.332085+0000","last_became_active":"2024-09-12T02:23:04.793100+0000","last_became_peered":"2024-09-12T02:23:04.793100+0000","last_unstale":"2024-09-12T02:23:18.332085+0000","last_undegraded":"2024-09-12T02:23:18.332085+0000","last_fullsized":"2024-09-12T02:23:18.332085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:50.446212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673306+0000","last_change":"2024-09-12T02:23:15.830776+0000","last_active":"2024-09-12T02:23:18.673306+0000","last_peered":"2024-09-12T02:23:18.673306+0000","last_clean":"2024-09-12T02:23:18.673306+0000","last_became_active":"2024-09-12T02:23:15.830492+0000","last_became_peered":"2024-09-12T02:23:15.830492+0000","last_unstale":"2024-09-12T02:23:18.673306+0000","last_undegraded":"2024-09-12T02:23:18.673306+0000","last_fullsized":"2024-09-12T02:23:18.673306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:40.517292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840575+0000","last_change":"2024-09-12T02:23:16.851953+0000","last_active":"2024-09-12T02:23:17.840575+0000","last_peered":"2024-09-12T02:23:17.840575+0000","last_clean":"2024-09-12T02:23:17.840575+0000","last_became_active":"2024-09-12T02:23:16.851558+0000","last_became_peered":"2024-09-12T02:23:16.851558+0000","last_unstale":"2024-09-12T02:23:17.840575+0000","last_undegraded":"2024-09-12T02:23:17.840575+0000","last_fullsized":"2024-09-12T02:23:17.840575+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:29.852193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839423+0000","last_change":"2024-09-12T02:23:03.764310+0000","last_active":"2024-09-12T02:23:17.839423+0000","last_peered":"2024-09-12T02:23:17.839423+0000","last_clean":"2024-09-12T02:23:17.839423+0000","last_became_active":"2024-09-12T02:23:03.764020+0000","last_became_peered":"2024-09-12T02:23:03.764020+0000","last_unstale":"2024-09-12T02:23:17.839423+0000","last_undegraded":"2024-09-12T02:23:17.839423+0000","last_fullsized":"2024-09-12T02:23:17.839423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:25.892874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841038+0000","last_change":"2024-09-12T02:23:04.771579+0000","last_active":"2024-09-12T02:23:17.841038+0000","last_peered":"2024-09-12T02:23:17.841038+0000","last_clean":"2024-09-12T02:23:17.841038+0000","last_became_active":"2024-09-12T02:23:04.771310+0000","last_became_peered":"2024-09-12T02:23:04.771310+0000","last_unstale":"2024-09-12T02:23:17.841038+0000","last_undegraded":"2024-09-12T02:23:17.841038+0000","last_fullsized":"2024-09-12T02:23:17.841038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:05.115474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"25'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839742+0000","last_change":"2024-09-12T02:23:15.832757+0000","last_active":"2024-09-12T02:23:17.839742+0000","last_peered":"2024-09-12T02:23:17.839742+0000","last_clean":"2024-09-12T02:23:17.839742+0000","last_became_active":"2024-09-12T02:23:15.832478+0000","last_became_peered":"2024-09-12T02:23:15.832478+0000","last_unstale":"2024-09-12T02:23:17.839742+0000","last_undegraded":"2024-09-12T02:23:17.839742+0000","last_fullsized":"2024-09-12T02:23:17.839742+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:29.301251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839974+0000","last_change":"2024-09-12T02:23:16.848437+0000","last_active":"2024-09-12T02:23:17.839974+0000","last_peered":"2024-09-12T02:23:17.839974+0000","last_clean":"2024-09-12T02:23:17.839974+0000","last_became_active":"2024-09-12T02:23:16.847063+0000","last_became_peered":"2024-09-12T02:23:16.847063+0000","last_unstale":"2024-09-12T02:23:17.839974+0000","last_undegraded":"2024-09-12T02:23:17.839974+0000","last_fullsized":"2024-09-12T02:23:17.839974+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:49.979448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597310+0000","last_change":"2024-09-12T02:23:04.788489+0000","last_active":"2024-09-12T02:23:19.597310+0000","last_peered":"2024-09-12T02:23:19.597310+0000","last_clean":"2024-09-12T02:23:19.597310+0000","last_became_active":"2024-09-12T02:23:04.788195+0000","last_became_peered":"2024-09-12T02:23:04.788195+0000","last_unstale":"2024-09-12T02:23:19.597310+0000","last_undegraded":"2024-09-12T02:23:19.597310+0000","last_fullsized":"2024-09-12T02:23:19.597310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:51.352859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444586+0000","last_change":"2024-09-12T02:23:16.843805+0000","last_active":"2024-09-12T02:23:18.444586+0000","last_peered":"2024-09-12T02:23:18.444586+0000","last_clean":"2024-09-12T02:23:18.444586+0000","last_became_active":"2024-09-12T02:23:16.843517+0000","last_became_peered":"2024-09-12T02:23:16.843517+0000","last_unstale":"2024-09-12T02:23:18.444586+0000","last_undegraded":"2024-09-12T02:23:18.444586+0000","last_fullsized":"2024-09-12T02:23:18.444586+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:30.873311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673159+0000","last_change":"2024-09-12T02:23:04.780662+0000","last_active":"2024-09-12T02:23:18.673159+0000","last_peered":"2024-09-12T02:23:18.673159+0000","last_clean":"2024-09-12T02:23:18.673159+0000","last_became_active":"2024-09-12T02:23:04.780402+0000","last_became_peered":"2024-09-12T02:23:04.780402+0000","last_unstale":"2024-09-12T02:23:18.673159+0000","last_undegraded":"2024-09-12T02:23:18.673159+0000","last_fullsized":"2024-09-12T02:23:18.673159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:23:00.556487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325531+0000","last_change":"2024-09-12T02:23:16.852992+0000","last_active":"2024-09-12T02:23:18.325531+0000","last_peered":"2024-09-12T02:23:18.325531+0000","last_clean":"2024-09-12T02:23:18.325531+0000","last_became_active":"2024-09-12T02:23:16.852706+0000","last_became_peered":"2024-09-12T02:23:16.852706+0000","last_unstale":"2024-09-12T02:23:18.325531+0000","last_undegraded":"2024-09-12T02:23:18.325531+0000","last_fullsized":"2024-09-12T02:23:18.325531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:56.896457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325468+0000","last_change":"2024-09-12T02:23:04.785920+0000","last_active":"2024-09-12T02:23:18.325468+0000","last_peered":"2024-09-12T02:23:18.325468+0000","last_clean":"2024-09-12T02:23:18.325468+0000","last_became_active":"2024-09-12T02:23:04.785422+0000","last_became_peered":"2024-09-12T02:23:04.785422+0000","last_unstale":"2024-09-12T02:23:18.325468+0000","last_undegraded":"2024-09-12T02:23:18.325468+0000","last_fullsized":"2024-09-12T02:23:18.325468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:55.106703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444779+0000","last_change":"2024-09-12T02:23:16.861939+0000","last_active":"2024-09-12T02:23:18.444779+0000","last_peered":"2024-09-12T02:23:18.444779+0000","last_clean":"2024-09-12T02:23:18.444779+0000","last_became_active":"2024-09-12T02:23:16.861658+0000","last_became_peered":"2024-09-12T02:23:16.861658+0000","last_unstale":"2024-09-12T02:23:18.444779+0000","last_undegraded":"2024-09-12T02:23:18.444779+0000","last_fullsized":"2024-09-12T02:23:18.444779+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:06.755715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331991+0000","last_change":"2024-09-12T02:23:04.777018+0000","last_active":"2024-09-12T02:23:18.331991+0000","last_peered":"2024-09-12T02:23:18.331991+0000","last_clean":"2024-09-12T02:23:18.331991+0000","last_became_active":"2024-09-12T02:23:04.776736+0000","last_became_peered":"2024-09-12T02:23:04.776736+0000","last_unstale":"2024-09-12T02:23:18.331991+0000","last_undegraded":"2024-09-12T02:23:18.331991+0000","last_fullsized":"2024-09-12T02:23:18.331991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:08.668990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840760+0000","last_change":"2024-09-12T02:23:16.847615+0000","last_active":"2024-09-12T02:23:17.840760+0000","last_peered":"2024-09-12T02:23:17.840760+0000","last_clean":"2024-09-12T02:23:17.840760+0000","last_became_active":"2024-09-12T02:23:16.847260+0000","last_became_peered":"2024-09-12T02:23:16.847260+0000","last_unstale":"2024-09-12T02:23:17.840760+0000","last_undegraded":"2024-09-12T02:23:17.840760+0000","last_fullsized":"2024-09-12T02:23:17.840760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:48.920477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839828+0000","last_change":"2024-09-12T02:23:04.789372+0000","last_active":"2024-09-12T02:23:17.839828+0000","last_peered":"2024-09-12T02:23:17.839828+0000","last_clean":"2024-09-12T02:23:17.839828+0000","last_became_active":"2024-09-12T02:23:04.789090+0000","last_became_peered":"2024-09-12T02:23:04.789090+0000","last_unstale":"2024-09-12T02:23:17.839828+0000","last_undegraded":"2024-09-12T02:23:17.839828+0000","last_fullsized":"2024-09-12T02:23:17.839828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:49.533491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841815+0000","last_change":"2024-09-12T02:23:16.859000+0000","last_active":"2024-09-12T02:23:17.841815+0000","last_peered":"2024-09-12T02:23:17.841815+0000","last_clean":"2024-09-12T02:23:17.841815+0000","last_became_active":"2024-09-12T02:23:16.858637+0000","last_became_peered":"2024-09-12T02:23:16.858637+0000","last_unstale":"2024-09-12T02:23:17.841815+0000","last_undegraded":"2024-09-12T02:23:17.841815+0000","last_fullsized":"2024-09-12T02:23:17.841815+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:47.915947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444881+0000","last_change":"2024-09-12T02:23:04.776435+0000","last_active":"2024-09-12T02:23:18.444881+0000","last_peered":"2024-09-12T02:23:18.444881+0000","last_clean":"2024-09-12T02:23:18.444881+0000","last_became_active":"2024-09-12T02:23:04.776120+0000","last_became_peered":"2024-09-12T02:23:04.776120+0000","last_unstale":"2024-09-12T02:23:18.444881+0000","last_undegraded":"2024-09-12T02:23:18.444881+0000","last_fullsized":"2024-09-12T02:23:18.444881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:27.985094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840466+0000","last_change":"2024-09-12T02:23:16.856477+0000","last_active":"2024-09-12T02:23:17.840466+0000","last_peered":"2024-09-12T02:23:17.840466+0000","last_clean":"2024-09-12T02:23:17.840466+0000","last_became_active":"2024-09-12T02:23:16.855839+0000","last_became_peered":"2024-09-12T02:23:16.855839+0000","last_unstale":"2024-09-12T02:23:17.840466+0000","last_undegraded":"2024-09-12T02:23:17.840466+0000","last_fullsized":"2024-09-12T02:23:17.840466+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:42.510184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.598050+0000","last_change":"2024-09-12T02:23:04.788827+0000","last_active":"2024-09-12T02:23:19.598050+0000","last_peered":"2024-09-12T02:23:19.598050+0000","last_clean":"2024-09-12T02:23:19.598050+0000","last_became_active":"2024-09-12T02:23:04.788521+0000","last_became_peered":"2024-09-12T02:23:04.788521+0000","last_unstale":"2024-09-12T02:23:19.598050+0000","last_undegraded":"2024-09-12T02:23:19.598050+0000","last_fullsized":"2024-09-12T02:23:19.598050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:24.470245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597525+0000","last_change":"2024-09-12T02:23:16.838421+0000","last_active":"2024-09-12T02:23:19.597525+0000","last_peered":"2024-09-12T02:23:19.597525+0000","last_clean":"2024-09-12T02:23:19.597525+0000","last_became_active":"2024-09-12T02:23:16.837606+0000","last_became_peered":"2024-09-12T02:23:16.837606+0000","last_unstale":"2024-09-12T02:23:19.597525+0000","last_undegraded":"2024-09-12T02:23:19.597525+0000","last_fullsized":"2024-09-12T02:23:19.597525+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:09.704007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840259+0000","last_change":"2024-09-12T02:23:04.787899+0000","last_active":"2024-09-12T02:23:17.840259+0000","last_peered":"2024-09-12T02:23:17.840259+0000","last_clean":"2024-09-12T02:23:17.840259+0000","last_became_active":"2024-09-12T02:23:04.787619+0000","last_became_peered":"2024-09-12T02:23:04.787619+0000","last_unstale":"2024-09-12T02:23:17.840259+0000","last_undegraded":"2024-09-12T02:23:17.840259+0000","last_fullsized":"2024-09-12T02:23:17.840259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:57.732453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839922+0000","last_change":"2024-09-12T02:23:16.845296+0000","last_active":"2024-09-12T02:23:17.839922+0000","last_peered":"2024-09-12T02:23:17.839922+0000","last_clean":"2024-09-12T02:23:17.839922+0000","last_became_active":"2024-09-12T02:23:16.844939+0000","last_became_peered":"2024-09-12T02:23:16.844939+0000","last_unstale":"2024-09-12T02:23:17.839922+0000","last_undegraded":"2024-09-12T02:23:17.839922+0000","last_fullsized":"2024-09-12T02:23:17.839922+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:16.790822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325133+0000","last_change":"2024-09-12T02:23:04.787389+0000","last_active":"2024-09-12T02:23:18.325133+0000","last_peered":"2024-09-12T02:23:18.325133+0000","last_clean":"2024-09-12T02:23:18.325133+0000","last_became_active":"2024-09-12T02:23:04.787092+0000","last_became_peered":"2024-09-12T02:23:04.787092+0000","last_unstale":"2024-09-12T02:23:18.325133+0000","last_undegraded":"2024-09-12T02:23:18.325133+0000","last_fullsized":"2024-09-12T02:23:18.325133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:02.924906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.843281+0000","last_change":"2024-09-12T02:23:16.849846+0000","last_active":"2024-09-12T02:23:17.843281+0000","last_peered":"2024-09-12T02:23:17.843281+0000","last_clean":"2024-09-12T02:23:17.843281+0000","last_became_active":"2024-09-12T02:23:16.849585+0000","last_became_peered":"2024-09-12T02:23:16.849585+0000","last_unstale":"2024-09-12T02:23:17.843281+0000","last_undegraded":"2024-09-12T02:23:17.843281+0000","last_fullsized":"2024-09-12T02:23:17.843281+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:58.775679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839012+0000","last_change":"2024-09-12T02:23:04.788624+0000","last_active":"2024-09-12T02:23:17.839012+0000","last_peered":"2024-09-12T02:23:17.839012+0000","last_clean":"2024-09-12T02:23:17.839012+0000","last_became_active":"2024-09-12T02:23:04.788352+0000","last_became_peered":"2024-09-12T02:23:04.788352+0000","last_unstale":"2024-09-12T02:23:17.839012+0000","last_undegraded":"2024-09-12T02:23:17.839012+0000","last_fullsized":"2024-09-12T02:23:17.839012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:13.961110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673339+0000","last_change":"2024-09-12T02:23:16.850112+0000","last_active":"2024-09-12T02:23:18.673339+0000","last_peered":"2024-09-12T02:23:18.673339+0000","last_clean":"2024-09-12T02:23:18.673339+0000","last_became_active":"2024-09-12T02:23:16.849831+0000","last_became_peered":"2024-09-12T02:23:16.849831+0000","last_unstale":"2024-09-12T02:23:18.673339+0000","last_undegraded":"2024-09-12T02:23:18.673339+0000","last_fullsized":"2024-09-12T02:23:18.673339+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:42.625762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325319+0000","last_change":"2024-09-12T02:23:04.785685+0000","last_active":"2024-09-12T02:23:18.325319+0000","last_peered":"2024-09-12T02:23:18.325319+0000","last_clean":"2024-09-12T02:23:18.325319+0000","last_became_active":"2024-09-12T02:23:04.784945+0000","last_became_peered":"2024-09-12T02:23:04.784945+0000","last_unstale":"2024-09-12T02:23:18.325319+0000","last_undegraded":"2024-09-12T02:23:18.325319+0000","last_fullsized":"2024-09-12T02:23:18.325319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:36.658436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839639+0000","last_change":"2024-09-12T02:23:16.846108+0000","last_active":"2024-09-12T02:23:17.839639+0000","last_peered":"2024-09-12T02:23:17.839639+0000","last_clean":"2024-09-12T02:23:17.839639+0000","last_became_active":"2024-09-12T02:23:16.845793+0000","last_became_peered":"2024-09-12T02:23:16.845793+0000","last_unstale":"2024-09-12T02:23:17.839639+0000","last_undegraded":"2024-09-12T02:23:17.839639+0000","last_fullsized":"2024-09-12T02:23:17.839639+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:36.274858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331880+0000","last_change":"2024-09-12T02:23:04.785849+0000","last_active":"2024-09-12T02:23:18.331880+0000","last_peered":"2024-09-12T02:23:18.331880+0000","last_clean":"2024-09-12T02:23:18.331880+0000","last_became_active":"2024-09-12T02:23:04.785511+0000","last_became_peered":"2024-09-12T02:23:04.785511+0000","last_unstale":"2024-09-12T02:23:18.331880+0000","last_undegraded":"2024-09-12T02:23:18.331880+0000","last_fullsized":"2024-09-12T02:23:18.331880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:28.670102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840717+0000","last_change":"2024-09-12T02:23:16.855615+0000","last_active":"2024-09-12T02:23:17.840717+0000","last_peered":"2024-09-12T02:23:17.840717+0000","last_clean":"2024-09-12T02:23:17.840717+0000","last_became_active":"2024-09-12T02:23:16.855278+0000","last_became_peered":"2024-09-12T02:23:16.855278+0000","last_unstale":"2024-09-12T02:23:17.840717+0000","last_undegraded":"2024-09-12T02:23:17.840717+0000","last_fullsized":"2024-09-12T02:23:17.840717+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:34.214175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597577+0000","last_change":"2024-09-12T02:23:04.789575+0000","last_active":"2024-09-12T02:23:19.597577+0000","last_peered":"2024-09-12T02:23:19.597577+0000","last_clean":"2024-09-12T02:23:19.597577+0000","last_became_active":"2024-09-12T02:23:04.789296+0000","last_became_peered":"2024-09-12T02:23:04.789296+0000","last_unstale":"2024-09-12T02:23:19.597577+0000","last_undegraded":"2024-09-12T02:23:19.597577+0000","last_fullsized":"2024-09-12T02:23:19.597577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:13.166139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841521+0000","last_change":"2024-09-12T02:23:16.858045+0000","last_active":"2024-09-12T02:23:17.841521+0000","last_peered":"2024-09-12T02:23:17.841521+0000","last_clean":"2024-09-12T02:23:17.841521+0000","last_became_active":"2024-09-12T02:23:16.857772+0000","last_became_peered":"2024-09-12T02:23:16.857772+0000","last_unstale":"2024-09-12T02:23:17.841521+0000","last_undegraded":"2024-09-12T02:23:17.841521+0000","last_fullsized":"2024-09-12T02:23:17.841521+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:35.598279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842504+0000","last_change":"2024-09-12T02:23:04.777450+0000","last_active":"2024-09-12T02:23:17.842504+0000","last_peered":"2024-09-12T02:23:17.842504+0000","last_clean":"2024-09-12T02:23:17.842504+0000","last_became_active":"2024-09-12T02:23:04.776825+0000","last_became_peered":"2024-09-12T02:23:04.776825+0000","last_unstale":"2024-09-12T02:23:17.842504+0000","last_undegraded":"2024-09-12T02:23:17.842504+0000","last_fullsized":"2024-09-12T02:23:17.842504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:40.315075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325062+0000","last_change":"2024-09-12T02:23:16.846032+0000","last_active":"2024-09-12T02:23:18.325062+0000","last_peered":"2024-09-12T02:23:18.325062+0000","last_clean":"2024-09-12T02:23:18.325062+0000","last_became_active":"2024-09-12T02:23:16.845492+0000","last_became_peered":"2024-09-12T02:23:16.845492+0000","last_unstale":"2024-09-12T02:23:18.325062+0000","last_undegraded":"2024-09-12T02:23:18.325062+0000","last_fullsized":"2024-09-12T02:23:18.325062+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:18.785798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673368+0000","last_change":"2024-09-12T02:23:04.791378+0000","last_active":"2024-09-12T02:23:18.673368+0000","last_peered":"2024-09-12T02:23:18.673368+0000","last_clean":"2024-09-12T02:23:18.673368+0000","last_became_active":"2024-09-12T02:23:04.790926+0000","last_became_peered":"2024-09-12T02:23:04.790926+0000","last_unstale":"2024-09-12T02:23:18.673368+0000","last_undegraded":"2024-09-12T02:23:18.673368+0000","last_fullsized":"2024-09-12T02:23:18.673368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:34.764210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331435+0000","last_change":"2024-09-12T02:23:16.851099+0000","last_active":"2024-09-12T02:23:18.331435+0000","last_peered":"2024-09-12T02:23:18.331435+0000","last_clean":"2024-09-12T02:23:18.331435+0000","last_became_active":"2024-09-12T02:23:16.850747+0000","last_became_peered":"2024-09-12T02:23:16.850747+0000","last_unstale":"2024-09-12T02:23:18.331435+0000","last_undegraded":"2024-09-12T02:23:18.331435+0000","last_fullsized":"2024-09-12T02:23:18.331435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:01:31.445590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.326232+0000","last_change":"2024-09-12T02:23:04.789439+0000","last_active":"2024-09-12T02:23:18.326232+0000","last_peered":"2024-09-12T02:23:18.326232+0000","last_clean":"2024-09-12T02:23:18.326232+0000","last_became_active":"2024-09-12T02:23:04.787421+0000","last_became_peered":"2024-09-12T02:23:04.787421+0000","last_unstale":"2024-09-12T02:23:18.326232+0000","last_undegraded":"2024-09-12T02:23:18.326232+0000","last_fullsized":"2024-09-12T02:23:18.326232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:44.295056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444485+0000","last_change":"2024-09-12T02:23:16.850923+0000","last_active":"2024-09-12T02:23:18.444485+0000","last_peered":"2024-09-12T02:23:18.444485+0000","last_clean":"2024-09-12T02:23:18.444485+0000","last_became_active":"2024-09-12T02:23:16.850609+0000","last_became_peered":"2024-09-12T02:23:16.850609+0000","last_unstale":"2024-09-12T02:23:18.444485+0000","last_undegraded":"2024-09-12T02:23:18.444485+0000","last_fullsized":"2024-09-12T02:23:18.444485+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:52.110438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325085+0000","last_change":"2024-09-12T02:23:04.790532+0000","last_active":"2024-09-12T02:23:18.325085+0000","last_peered":"2024-09-12T02:23:18.325085+0000","last_clean":"2024-09-12T02:23:18.325085+0000","last_became_active":"2024-09-12T02:23:04.789229+0000","last_became_peered":"2024-09-12T02:23:04.789229+0000","last_unstale":"2024-09-12T02:23:18.325085+0000","last_undegraded":"2024-09-12T02:23:18.325085+0000","last_fullsized":"2024-09-12T02:23:18.325085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:59.901665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841478+0000","last_change":"2024-09-12T02:23:16.856612+0000","last_active":"2024-09-12T02:23:17.841478+0000","last_peered":"2024-09-12T02:23:17.841478+0000","last_clean":"2024-09-12T02:23:17.841478+0000","last_became_active":"2024-09-12T02:23:16.856290+0000","last_became_peered":"2024-09-12T02:23:16.856290+0000","last_unstale":"2024-09-12T02:23:17.841478+0000","last_undegraded":"2024-09-12T02:23:17.841478+0000","last_fullsized":"2024-09-12T02:23:17.841478+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:14.846281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444198+0000","last_change":"2024-09-12T02:23:04.782490+0000","last_active":"2024-09-12T02:23:18.444198+0000","last_peered":"2024-09-12T02:23:18.444198+0000","last_clean":"2024-09-12T02:23:18.444198+0000","last_became_active":"2024-09-12T02:23:04.782183+0000","last_became_peered":"2024-09-12T02:23:04.782183+0000","last_unstale":"2024-09-12T02:23:18.444198+0000","last_undegraded":"2024-09-12T02:23:18.444198+0000","last_fullsized":"2024-09-12T02:23:18.444198+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:28.699880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325361+0000","last_change":"2024-09-12T02:23:16.858100+0000","last_active":"2024-09-12T02:23:18.325361+0000","last_peered":"2024-09-12T02:23:18.325361+0000","last_clean":"2024-09-12T02:23:18.325361+0000","last_became_active":"2024-09-12T02:23:16.857818+0000","last_became_peered":"2024-09-12T02:23:16.857818+0000","last_unstale":"2024-09-12T02:23:18.325361+0000","last_undegraded":"2024-09-12T02:23:18.325361+0000","last_fullsized":"2024-09-12T02:23:18.325361+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:45.991170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331508+0000","last_change":"2024-09-12T02:23:04.787140+0000","last_active":"2024-09-12T02:23:18.331508+0000","last_peered":"2024-09-12T02:23:18.331508+0000","last_clean":"2024-09-12T02:23:18.331508+0000","last_became_active":"2024-09-12T02:23:04.786799+0000","last_became_peered":"2024-09-12T02:23:04.786799+0000","last_unstale":"2024-09-12T02:23:18.331508+0000","last_undegraded":"2024-09-12T02:23:18.331508+0000","last_fullsized":"2024-09-12T02:23:18.331508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:31.639605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842225+0000","last_change":"2024-09-12T02:23:16.846100+0000","last_active":"2024-09-12T02:23:17.842225+0000","last_peered":"2024-09-12T02:23:17.842225+0000","last_clean":"2024-09-12T02:23:17.842225+0000","last_became_active":"2024-09-12T02:23:16.845749+0000","last_became_peered":"2024-09-12T02:23:16.845749+0000","last_unstale":"2024-09-12T02:23:17.842225+0000","last_undegraded":"2024-09-12T02:23:17.842225+0000","last_fullsized":"2024-09-12T02:23:17.842225+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:42.783366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839149+0000","last_change":"2024-09-12T02:23:04.782128+0000","last_active":"2024-09-12T02:23:17.839149+0000","last_peered":"2024-09-12T02:23:17.839149+0000","last_clean":"2024-09-12T02:23:17.839149+0000","last_became_active":"2024-09-12T02:23:04.781101+0000","last_became_peered":"2024-09-12T02:23:04.781101+0000","last_unstale":"2024-09-12T02:23:17.839149+0000","last_undegraded":"2024-09-12T02:23:17.839149+0000","last_fullsized":"2024-09-12T02:23:17.839149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:49.421147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839296+0000","last_change":"2024-09-12T02:23:16.836968+0000","last_active":"2024-09-12T02:23:17.839296+0000","last_peered":"2024-09-12T02:23:17.839296+0000","last_clean":"2024-09-12T02:23:17.839296+0000","last_became_active":"2024-09-12T02:23:16.836561+0000","last_became_peered":"2024-09-12T02:23:16.836561+0000","last_unstale":"2024-09-12T02:23:17.839296+0000","last_undegraded":"2024-09-12T02:23:17.839296+0000","last_fullsized":"2024-09-12T02:23:17.839296+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:08.765569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842555+0000","last_change":"2024-09-12T02:23:04.787034+0000","last_active":"2024-09-12T02:23:17.842555+0000","last_peered":"2024-09-12T02:23:17.842555+0000","last_clean":"2024-09-12T02:23:17.842555+0000","last_became_active":"2024-09-12T02:23:04.786044+0000","last_became_peered":"2024-09-12T02:23:04.786044+0000","last_unstale":"2024-09-12T02:23:17.842555+0000","last_undegraded":"2024-09-12T02:23:17.842555+0000","last_fullsized":"2024-09-12T02:23:17.842555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:07.183028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673151+0000","last_change":"2024-09-12T02:23:16.846114+0000","last_active":"2024-09-12T02:23:18.673151+0000","last_peered":"2024-09-12T02:23:18.673151+0000","last_clean":"2024-09-12T02:23:18.673151+0000","last_became_active":"2024-09-12T02:23:16.845757+0000","last_became_peered":"2024-09-12T02:23:16.845757+0000","last_unstale":"2024-09-12T02:23:18.673151+0000","last_undegraded":"2024-09-12T02:23:18.673151+0000","last_fullsized":"2024-09-12T02:23:18.673151+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:17:52.019813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597793+0000","last_change":"2024-09-12T02:23:04.785662+0000","last_active":"2024-09-12T02:23:19.597793+0000","last_peered":"2024-09-12T02:23:19.597793+0000","last_clean":"2024-09-12T02:23:19.597793+0000","last_became_active":"2024-09-12T02:23:04.785375+0000","last_became_peered":"2024-09-12T02:23:04.785375+0000","last_unstale":"2024-09-12T02:23:19.597793+0000","last_undegraded":"2024-09-12T02:23:19.597793+0000","last_fullsized":"2024-09-12T02:23:19.597793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:44.295056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841351+0000","last_change":"2024-09-12T02:23:16.858175+0000","last_active":"2024-09-12T02:23:17.841351+0000","last_peered":"2024-09-12T02:23:17.841351+0000","last_clean":"2024-09-12T02:23:17.841351+0000","last_became_active":"2024-09-12T02:23:16.857873+0000","last_became_peered":"2024-09-12T02:23:16.857873+0000","last_unstale":"2024-09-12T02:23:17.841351+0000","last_undegraded":"2024-09-12T02:23:17.841351+0000","last_fullsized":"2024-09-12T02:23:17.841351+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:54.535867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.597940+0000","last_change":"2024-09-12T02:23:04.791929+0000","last_active":"2024-09-12T02:23:19.597940+0000","last_peered":"2024-09-12T02:23:19.597940+0000","last_clean":"2024-09-12T02:23:19.597940+0000","last_became_active":"2024-09-12T02:23:04.791622+0000","last_became_peered":"2024-09-12T02:23:04.791622+0000","last_unstale":"2024-09-12T02:23:19.597940+0000","last_undegraded":"2024-09-12T02:23:19.597940+0000","last_fullsized":"2024-09-12T02:23:19.597940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:35.012685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325239+0000","last_change":"2024-09-12T02:23:16.849985+0000","last_active":"2024-09-12T02:23:18.325239+0000","last_peered":"2024-09-12T02:23:18.325239+0000","last_clean":"2024-09-12T02:23:18.325239+0000","last_became_active":"2024-09-12T02:23:16.849641+0000","last_became_peered":"2024-09-12T02:23:16.849641+0000","last_unstale":"2024-09-12T02:23:18.325239+0000","last_undegraded":"2024-09-12T02:23:18.325239+0000","last_fullsized":"2024-09-12T02:23:18.325239+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:28.373543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.843012+0000","last_change":"2024-09-12T02:23:04.781090+0000","last_active":"2024-09-12T02:23:17.843012+0000","last_peered":"2024-09-12T02:23:17.843012+0000","last_clean":"2024-09-12T02:23:17.843012+0000","last_became_active":"2024-09-12T02:23:04.780740+0000","last_became_peered":"2024-09-12T02:23:04.780740+0000","last_unstale":"2024-09-12T02:23:17.843012+0000","last_undegraded":"2024-09-12T02:23:17.843012+0000","last_fullsized":"2024-09-12T02:23:17.843012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:30.639111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839819+0000","last_change":"2024-09-12T02:23:16.840250+0000","last_active":"2024-09-12T02:23:17.839819+0000","last_peered":"2024-09-12T02:23:17.839819+0000","last_clean":"2024-09-12T02:23:17.839819+0000","last_became_active":"2024-09-12T02:23:16.839914+0000","last_became_peered":"2024-09-12T02:23:16.839914+0000","last_unstale":"2024-09-12T02:23:17.839819+0000","last_undegraded":"2024-09-12T02:23:17.839819+0000","last_fullsized":"2024-09-12T02:23:17.839819+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:04.798197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.838971+0000","last_change":"2024-09-12T02:23:04.779648+0000","last_active":"2024-09-12T02:23:17.838971+0000","last_peered":"2024-09-12T02:23:17.838971+0000","last_clean":"2024-09-12T02:23:17.838971+0000","last_became_active":"2024-09-12T02:23:04.779384+0000","last_became_peered":"2024-09-12T02:23:04.779384+0000","last_unstale":"2024-09-12T02:23:17.838971+0000","last_undegraded":"2024-09-12T02:23:17.838971+0000","last_fullsized":"2024-09-12T02:23:17.838971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:41.491471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:19.598038+0000","last_change":"2024-09-12T02:23:16.850060+0000","last_active":"2024-09-12T02:23:19.598038+0000","last_peered":"2024-09-12T02:23:19.598038+0000","last_clean":"2024-09-12T02:23:19.598038+0000","last_became_active":"2024-09-12T02:23:16.849744+0000","last_became_peered":"2024-09-12T02:23:16.849744+0000","last_unstale":"2024-09-12T02:23:19.598038+0000","last_undegraded":"2024-09-12T02:23:19.598038+0000","last_fullsized":"2024-09-12T02:23:19.598038+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:34.130685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841118+0000","last_change":"2024-09-12T02:23:04.779265+0000","last_active":"2024-09-12T02:23:17.841118+0000","last_peered":"2024-09-12T02:23:17.841118+0000","last_clean":"2024-09-12T02:23:17.841118+0000","last_became_active":"2024-09-12T02:23:04.778968+0000","last_became_peered":"2024-09-12T02:23:04.778968+0000","last_unstale":"2024-09-12T02:23:17.841118+0000","last_undegraded":"2024-09-12T02:23:17.841118+0000","last_fullsized":"2024-09-12T02:23:17.841118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:53.022598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444316+0000","last_change":"2024-09-12T02:23:16.862034+0000","last_active":"2024-09-12T02:23:18.444316+0000","last_peered":"2024-09-12T02:23:18.444316+0000","last_clean":"2024-09-12T02:23:18.444316+0000","last_became_active":"2024-09-12T02:23:16.861441+0000","last_became_peered":"2024-09-12T02:23:16.861441+0000","last_unstale":"2024-09-12T02:23:18.444316+0000","last_undegraded":"2024-09-12T02:23:18.444316+0000","last_fullsized":"2024-09-12T02:23:18.444316+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:24.332614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325312+0000","last_change":"2024-09-12T02:23:04.788890+0000","last_active":"2024-09-12T02:23:18.325312+0000","last_peered":"2024-09-12T02:23:18.325312+0000","last_clean":"2024-09-12T02:23:18.325312+0000","last_became_active":"2024-09-12T02:23:04.788617+0000","last_became_peered":"2024-09-12T02:23:04.788617+0000","last_unstale":"2024-09-12T02:23:18.325312+0000","last_undegraded":"2024-09-12T02:23:18.325312+0000","last_fullsized":"2024-09-12T02:23:18.325312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:24.194151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325951+0000","last_change":"2024-09-12T02:23:16.855853+0000","last_active":"2024-09-12T02:23:18.325951+0000","last_peered":"2024-09-12T02:23:18.325951+0000","last_clean":"2024-09-12T02:23:18.325951+0000","last_became_active":"2024-09-12T02:23:16.855437+0000","last_became_peered":"2024-09-12T02:23:16.855437+0000","last_unstale":"2024-09-12T02:23:18.325951+0000","last_undegraded":"2024-09-12T02:23:18.325951+0000","last_fullsized":"2024-09-12T02:23:18.325951+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:27.557862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.841894+0000","last_change":"2024-09-12T02:23:04.777165+0000","last_active":"2024-09-12T02:23:17.841894+0000","last_peered":"2024-09-12T02:23:17.841894+0000","last_clean":"2024-09-12T02:23:17.841894+0000","last_became_active":"2024-09-12T02:23:04.776857+0000","last_became_peered":"2024-09-12T02:23:04.776857+0000","last_unstale":"2024-09-12T02:23:17.841894+0000","last_undegraded":"2024-09-12T02:23:17.841894+0000","last_fullsized":"2024-09-12T02:23:17.841894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:28.309591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.839032+0000","last_change":"2024-09-12T02:23:16.849235+0000","last_active":"2024-09-12T02:23:17.839032+0000","last_peered":"2024-09-12T02:23:17.839032+0000","last_clean":"2024-09-12T02:23:17.839032+0000","last_became_active":"2024-09-12T02:23:16.848936+0000","last_became_peered":"2024-09-12T02:23:16.848936+0000","last_unstale":"2024-09-12T02:23:17.839032+0000","last_undegraded":"2024-09-12T02:23:17.839032+0000","last_fullsized":"2024-09-12T02:23:17.839032+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:32.415375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.325607+0000","last_change":"2024-09-12T02:23:04.786772+0000","last_active":"2024-09-12T02:23:18.325607+0000","last_peered":"2024-09-12T02:23:18.325607+0000","last_clean":"2024-09-12T02:23:18.325607+0000","last_became_active":"2024-09-12T02:23:04.786509+0000","last_became_peered":"2024-09-12T02:23:04.786509+0000","last_unstale":"2024-09-12T02:23:18.325607+0000","last_undegraded":"2024-09-12T02:23:18.325607+0000","last_fullsized":"2024-09-12T02:23:18.325607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:01.755827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.673170+0000","last_change":"2024-09-12T02:23:16.834788+0000","last_active":"2024-09-12T02:23:18.673170+0000","last_peered":"2024-09-12T02:23:18.673170+0000","last_clean":"2024-09-12T02:23:18.673170+0000","last_became_active":"2024-09-12T02:23:16.834483+0000","last_became_peered":"2024-09-12T02:23:16.834483+0000","last_unstale":"2024-09-12T02:23:18.673170+0000","last_undegraded":"2024-09-12T02:23:18.673170+0000","last_fullsized":"2024-09-12T02:23:18.673170+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:23.441282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.331724+0000","last_change":"2024-09-12T02:23:04.778772+0000","last_active":"2024-09-12T02:23:18.331724+0000","last_peered":"2024-09-12T02:23:18.331724+0000","last_clean":"2024-09-12T02:23:18.331724+0000","last_became_active":"2024-09-12T02:23:04.778445+0000","last_became_peered":"2024-09-12T02:23:04.778445+0000","last_unstale":"2024-09-12T02:23:18.331724+0000","last_undegraded":"2024-09-12T02:23:18.331724+0000","last_fullsized":"2024-09-12T02:23:18.331724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:58.292023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840431+0000","last_change":"2024-09-12T02:23:16.844170+0000","last_active":"2024-09-12T02:23:17.840431+0000","last_peered":"2024-09-12T02:23:17.840431+0000","last_clean":"2024-09-12T02:23:17.840431+0000","last_became_active":"2024-09-12T02:23:16.843880+0000","last_became_peered":"2024-09-12T02:23:16.843880+0000","last_unstale":"2024-09-12T02:23:17.840431+0000","last_undegraded":"2024-09-12T02:23:17.840431+0000","last_fullsized":"2024-09-12T02:23:17.840431+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:59.283416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:18.444520+0000","last_change":"2024-09-12T02:23:04.785821+0000","last_active":"2024-09-12T02:23:18.444520+0000","last_peered":"2024-09-12T02:23:18.444520+0000","last_clean":"2024-09-12T02:23:18.444520+0000","last_became_active":"2024-09-12T02:23:04.785516+0000","last_became_peered":"2024-09-12T02:23:04.785516+0000","last_unstale":"2024-09-12T02:23:18.444520+0000","last_undegraded":"2024-09-12T02:23:18.444520+0000","last_fullsized":"2024-09-12T02:23:18.444520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:42.400040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.840987+0000","last_change":"2024-09-12T02:23:16.844145+0000","last_active":"2024-09-12T02:23:17.840987+0000","last_peered":"2024-09-12T02:23:17.840987+0000","last_clean":"2024-09-12T02:23:17.840987+0000","last_became_active":"2024-09-12T02:23:16.843815+0000","last_became_peered":"2024-09-12T02:23:16.843815+0000","last_unstale":"2024-09-12T02:23:17.840987+0000","last_undegraded":"2024-09-12T02:23:17.840987+0000","last_fullsized":"2024-09-12T02:23:17.840987+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:31.789317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:23:17.842753+0000","last_change":"2024-09-12T02:23:04.791204+0000","last_active":"2024-09-12T02:23:17.842753+0000","last_peered":"2024-09-12T02:23:17.842753+0000","last_clean":"2024-09-12T02:23:17.842753+0000","last_became_active":"2024-09-12T02:23:04.790906+0000","last_became_peered":"2024-09-12T02:23:04.790906+0000","last_unstale":"2024-09-12T02:23:17.842753+0000","last_undegraded":"2024-09-12T02:23:17.842753+0000","last_fullsized":"2024-09-12T02:23:17.842753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:16.336873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2853,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2853,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476748,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":695559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476748,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":107190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476749,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":105281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509451,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":286720,"data_stored":104749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35612,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336228,"statfs":{"total":96636764160,"available":96600297472,"internally_reserved":0,"allocated":270336,"data_stored":104589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509452,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36200,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335640,"statfs":{"total":96636764160,"available":96599695360,"internally_reserved":0,"allocated":872448,"data_stored":695525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542157,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35632,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336208,"statfs":{"total":96636764160,"available":96600276992,"internally_reserved":0,"allocated":294912,"data_stored":108651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542156,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35628,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336212,"statfs":{"total":96636764160,"available":96600281088,"internally_reserved":0,"allocated":290816,"data_stored":106756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:23:38.328 INFO:tasks.mon_thrash.ceph_manager:clean! 2024-09-12T02:23:38.328 DEBUG:tasks.mon_thrash:Yielding 2024-09-12T02:23:38.328 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T02:23:38.342 INFO:tasks.workunit:Pulling workunits from ref 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T02:23:38.343 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T02:23:38.343 INFO:tasks.workunit:timeout=3h 2024-09-12T02:23:38.343 INFO:tasks.workunit:cleanup=True 2024-09-12T02:23:38.343 DEBUG:teuthology.orchestra.run.smithi060:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T02:23:38.344 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:23:38.378 INFO:teuthology.orchestra.run.smithi060.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-12T02:23:38.378 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-12T02:23:38.378 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 2bh/43d Inode: 1 Links: 2 2024-09-12T02:23:38.378 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:23:38.378 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-12T02:23:38.378 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-12T02:23:38.379 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-09-12 02:23:04.763982321 +0000 2024-09-12T02:23:38.379 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-09-12 02:23:35.702689401 +0000 2024-09-12T02:23:38.379 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: - 2024-09-12T02:23:38.379 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-12T02:23:38.379 DEBUG:teuthology.orchestra.run.smithi060:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-12T02:23:38.451 DEBUG:teuthology.orchestra.run.smithi105:> stat -- /home/ubuntu/cephtest/mnt.1 2024-09-12T02:23:38.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.464+0000 7fd76625e640 1 Processor -- start 2024-09-12T02:23:38.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.464+0000 7fd76625e640 1 -- start start 2024-09-12T02:23:38.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.465+0000 7fd76625e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd760150480 0x7fd7600c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:38.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.465+0000 7fd76625e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd76006c650 0x7fd7600c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:38.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.465+0000 7fd76625e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd7600c9c80 0x7fd7600ca130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:38.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.465+0000 7fd76625e640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fd76006c240 con 0x7fd76006c650 2024-09-12T02:23:38.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.465+0000 7fd76625e640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fd76015a330 con 0x7fd7600c9c80 2024-09-12T02:23:38.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.465+0000 7fd76625e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd76015a7c0 con 0x7fd760150480 2024-09-12T02:23:38.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.465+0000 7fd75effd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd76006c650 0x7fd7600c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:38.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.465+0000 7fd75effd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd76006c650 0x7fd7600c7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50360/0 (socket says 172.21.15.60:50360) 2024-09-12T02:23:38.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.465+0000 7fd75effd640 1 -- 172.21.15.60:0/3753476254 learned_addr learned my addr 172.21.15.60:0/3753476254 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:38.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.465+0000 7fd75f7fe640 1 --2- 172.21.15.60:0/3753476254 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd760150480 0x7fd7600c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:38.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.465+0000 7fd75ffff640 1 --2- 172.21.15.60:0/3753476254 >> v2:172.21.15.105:3300/0 conn(0x7fd7600c9c80 0x7fd7600ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:38.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.466+0000 7fd75effd640 1 -- 172.21.15.60:0/3753476254 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd760150480 msgr2=0x7fd7600c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:38.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.466+0000 7fd75effd640 1 --2- 172.21.15.60:0/3753476254 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd760150480 0x7fd7600c7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:38.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.466+0000 7fd75effd640 1 -- 172.21.15.60:0/3753476254 >> v2:172.21.15.105:3300/0 conn(0x7fd7600c9c80 msgr2=0x7fd7600ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:38.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.466+0000 7fd75effd640 1 --2- 172.21.15.60:0/3753476254 >> v2:172.21.15.105:3300/0 conn(0x7fd7600c9c80 0x7fd7600ca130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:38.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.466+0000 7fd75effd640 1 -- 172.21.15.60:0/3753476254 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd760159a00 con 0x7fd76006c650 2024-09-12T02:23:38.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.466+0000 7fd75effd640 1 --2- 172.21.15.60:0/3753476254 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd76006c650 0x7fd7600c7fd0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd7600c62d0 tx=0x7fd75402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9719cfede2e2a0d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:38.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.466+0000 7fd75e7fc640 1 -- 172.21.15.60:0/3753476254 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd754037070 con 0x7fd76006c650 2024-09-12T02:23:38.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.467+0000 7fd75e7fc640 1 -- 172.21.15.60:0/3753476254 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd754032440 con 0x7fd76006c650 2024-09-12T02:23:38.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.467+0000 7fd75e7fc640 1 -- 172.21.15.60:0/3753476254 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd754032810 con 0x7fd76006c650 2024-09-12T02:23:38.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.467+0000 7fd76625e640 1 -- 172.21.15.60:0/3753476254 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd76006c650 msgr2=0x7fd7600c7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:38.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.467+0000 7fd76625e640 1 --2- 172.21.15.60:0/3753476254 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd76006c650 0x7fd7600c7fd0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd7600c62d0 tx=0x7fd75402a1e0 comp rx=0 tx=0).stop 2024-09-12T02:23:38.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.467+0000 7fd76625e640 1 -- 172.21.15.60:0/3753476254 shutdown_connections 2024-09-12T02:23:38.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.467+0000 7fd76625e640 1 --2- 172.21.15.60:0/3753476254 >> v2:172.21.15.105:3300/0 conn(0x7fd7600c9c80 0x7fd7600ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:38.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.467+0000 7fd76625e640 1 --2- 172.21.15.60:0/3753476254 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd76006c650 0x7fd7600c7fd0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:38.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.467+0000 7fd76625e640 1 --2- 172.21.15.60:0/3753476254 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd760150480 0x7fd7600c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:38.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.467+0000 7fd76625e640 1 -- 172.21.15.60:0/3753476254 >> 172.21.15.60:0/3753476254 conn(0x7fd760068030 msgr2=0x7fd760073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:38.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.467+0000 7fd76625e640 1 -- 172.21.15.60:0/3753476254 shutdown_connections 2024-09-12T02:23:38.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.467+0000 7fd76625e640 1 -- 172.21.15.60:0/3753476254 wait complete. 2024-09-12T02:23:38.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.468+0000 7fd76625e640 1 Processor -- start 2024-09-12T02:23:38.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.468+0000 7fd76625e640 1 -- start start 2024-09-12T02:23:38.472 INFO:teuthology.orchestra.run.smithi105.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-09-12T02:23:38.472 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-12T02:23:38.472 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 2ah/42d Inode: 1 Links: 2 2024-09-12T02:23:38.473 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:23:38.473 INFO:teuthology.orchestra.run.smithi105.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-12T02:23:38.473 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-12T02:23:38.473 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2024-09-12 02:23:16.837482866 +0000 2024-09-12T02:23:38.473 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2024-09-12 02:23:35.786961571 +0000 2024-09-12T02:23:38.473 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: - 2024-09-12T02:23:38.473 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-09-12T02:23:38.473 DEBUG:teuthology.orchestra.run.smithi105:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-09-12T02:23:38.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.469+0000 7fd76625e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd76006c650 0x7fd760158f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:38.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.469+0000 7fd76625e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7600c9c80 0x7fd7601e3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:38.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.469+0000 7fd76625e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd760150480 0x7fd7601eb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:38.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.469+0000 7fd76625e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd7600ca670 con 0x7fd7600c9c80 2024-09-12T02:23:38.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.469+0000 7fd76625e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd760159fc0 con 0x7fd76006c650 2024-09-12T02:23:38.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.469+0000 7fd76625e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd76006d270 con 0x7fd760150480 2024-09-12T02:23:38.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.469+0000 7fd75effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7600c9c80 0x7fd7601e3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:38.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.469+0000 7fd75effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7600c9c80 0x7fd7601e3390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50372/0 (socket says 172.21.15.60:50372) 2024-09-12T02:23:38.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.469+0000 7fd75effd640 1 -- 172.21.15.60:0/2122273073 learned_addr learned my addr 172.21.15.60:0/2122273073 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:38.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.469+0000 7fd75f7fe640 1 --2- 172.21.15.60:0/2122273073 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd76006c650 0x7fd760158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:38.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.469+0000 7fd75ffff640 1 --2- 172.21.15.60:0/2122273073 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd760150480 0x7fd7601eb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:38.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.470+0000 7fd75effd640 1 -- 172.21.15.60:0/2122273073 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd760150480 msgr2=0x7fd7601eb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:38.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.470+0000 7fd75effd640 1 --2- 172.21.15.60:0/2122273073 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd760150480 0x7fd7601eb8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:38.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.470+0000 7fd75effd640 1 -- 172.21.15.60:0/2122273073 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd76006c650 msgr2=0x7fd760158f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:38.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.470+0000 7fd75effd640 1 --2- 172.21.15.60:0/2122273073 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd76006c650 0x7fd760158f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:38.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.470+0000 7fd75effd640 1 -- 172.21.15.60:0/2122273073 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7600b0070 con 0x7fd7600c9c80 2024-09-12T02:23:38.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.470+0000 7fd75ffff640 1 --2- 172.21.15.60:0/2122273073 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd760150480 0x7fd7601eb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:23:38.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.470+0000 7fd75effd640 1 --2- 172.21.15.60:0/2122273073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7600c9c80 0x7fd7601e3390 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd754000c00 tx=0x7fd7540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:38.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.470+0000 7fd747fff640 1 -- 172.21.15.60:0/2122273073 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd754041020 con 0x7fd7600c9c80 2024-09-12T02:23:38.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.470+0000 7fd747fff640 1 -- 172.21.15.60:0/2122273073 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd75403d620 con 0x7fd7600c9c80 2024-09-12T02:23:38.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.470+0000 7fd76625e640 1 -- 172.21.15.60:0/2122273073 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd760159460 con 0x7fd7600c9c80 2024-09-12T02:23:38.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.470+0000 7fd747fff640 1 -- 172.21.15.60:0/2122273073 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd754037040 con 0x7fd7600c9c80 2024-09-12T02:23:38.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.470+0000 7fd76625e640 1 -- 172.21.15.60:0/2122273073 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7600b05c0 con 0x7fd7600c9c80 2024-09-12T02:23:38.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.471+0000 7fd76625e640 1 -- 172.21.15.60:0/2122273073 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd760156270 con 0x7fd7600c9c80 2024-09-12T02:23:38.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.471+0000 7fd747fff640 1 -- 172.21.15.60:0/2122273073 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd754044020 con 0x7fd7600c9c80 2024-09-12T02:23:38.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.472+0000 7fd747fff640 1 --2- 172.21.15.60:0/2122273073 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd74c06be30 0x7fd74c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:38.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.472+0000 7fd747fff640 1 -- 172.21.15.60:0/2122273073 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7fd7540ab790 con 0x7fd7600c9c80 2024-09-12T02:23:38.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.472+0000 7fd75f7fe640 1 --2- 172.21.15.60:0/2122273073 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd74c06be30 0x7fd74c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:38.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.472+0000 7fd75f7fe640 1 --2- 172.21.15.60:0/2122273073 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd74c06be30 0x7fd74c06e2f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd7600c8260 tx=0x7fd750009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:38.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.476+0000 7fd747fff640 1 -- 172.21.15.60:0/2122273073 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd75404b030 con 0x7fd7600c9c80 2024-09-12T02:23:38.549 DEBUG:teuthology.orchestra.run.smithi060:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T02:23:38.550 DEBUG:teuthology.orchestra.run.smithi105:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T02:23:38.566 INFO:tasks.workunit.client.0.smithi060.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T02:23:38.607 INFO:tasks.workunit.client.1.smithi105.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-09-12T02:23:38.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.691+0000 7fd76625e640 1 -- 172.21.15.60:0/2122273073 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd760076510 con 0x7fd7600c9c80 2024-09-12T02:23:38.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.691+0000 7fd747fff640 1 -- 172.21.15.60:0/2122273073 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+6524 (secure 0 0 0) 0x7fd754079ea0 con 0x7fd7600c9c80 2024-09-12T02:23:38.692 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:23:38.692 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":11,"btime":"2024-09-12T02:23:19:846521+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3208837169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3208837169},{"type":"v1","addr":"172.21.15.60:6836","nonce":3208837169}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/664538827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":664538827},{"type":"v1","addr":"172.21.15.60:6837","nonce":664538827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:23:04.113913+0000","modified":"2024-09-12T02:23:07.140885+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/2854563525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2854563525},{"type":"v1","addr":"172.21.15.105:6835","nonce":2854563525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1},{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:23:16.184151+0000","modified":"2024-09-12T02:23:19.195177+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"d","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6834/248466084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":248466084},{"type":"v1","addr":"172.21.15.105:6834","nonce":248466084}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":2}]} 2024-09-12T02:23:38.692 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 11 2024-09-12T02:23:38.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.693+0000 7fd76625e640 1 -- 172.21.15.60:0/2122273073 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd74c06be30 msgr2=0x7fd74c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:38.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.693+0000 7fd76625e640 1 --2- 172.21.15.60:0/2122273073 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd74c06be30 0x7fd74c06e2f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd7600c8260 tx=0x7fd750009190 comp rx=0 tx=0).stop 2024-09-12T02:23:38.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.693+0000 7fd76625e640 1 -- 172.21.15.60:0/2122273073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7600c9c80 msgr2=0x7fd7601e3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:38.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.693+0000 7fd76625e640 1 --2- 172.21.15.60:0/2122273073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7600c9c80 0x7fd7601e3390 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd754000c00 tx=0x7fd7540046c0 comp rx=0 tx=0).stop 2024-09-12T02:23:38.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.693+0000 7fd76625e640 1 -- 172.21.15.60:0/2122273073 shutdown_connections 2024-09-12T02:23:38.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.693+0000 7fd76625e640 1 --2- 172.21.15.60:0/2122273073 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd74c06be30 0x7fd74c06e2f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:38.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.693+0000 7fd76625e640 1 --2- 172.21.15.60:0/2122273073 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd760150480 0x7fd7601eb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:38.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.693+0000 7fd76625e640 1 --2- 172.21.15.60:0/2122273073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7600c9c80 0x7fd7601e3390 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:38.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.693+0000 7fd76625e640 1 --2- 172.21.15.60:0/2122273073 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd76006c650 0x7fd760158f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:38.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.693+0000 7fd76625e640 1 -- 172.21.15.60:0/2122273073 >> 172.21.15.60:0/2122273073 conn(0x7fd760068030 msgr2=0x7fd7600cb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:38.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.694+0000 7fd76625e640 1 -- 172.21.15.60:0/2122273073 shutdown_connections 2024-09-12T02:23:38.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.694+0000 7fd76625e640 1 -- 172.21.15.60:0/2122273073 wait complete. 2024-09-12T02:23:38.706 INFO:tasks.mon_thrash.mon_thrasher:start thrashing 2024-09-12T02:23:38.706 INFO:tasks.mon_thrash.mon_thrasher:seed: 1726107818, revive delay: 20.0, thrash delay: 10.0 thrash many: False, maintain quorum: True store thrash: False, probability: 50 freeze mon: prob 10.0 duration 15.0 2024-09-12T02:23:38.706 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-12T02:23:38.706 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:23:38.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.848+0000 7f3ed29bd640 1 Processor -- start 2024-09-12T02:23:38.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.848+0000 7f3ed29bd640 1 -- start start 2024-09-12T02:23:38.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.849+0000 7f3ed29bd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3ecc0c8b10 0x7f3ecc15a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:38.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.849+0000 7f3ed29bd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ecc06cd80 0x7f3ecc1534d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:38.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.849+0000 7f3ed29bd640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ecc0c7070 con 0x7f3ecc153a10 2024-09-12T02:23:38.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.849+0000 7f3ed29bd640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f3ecc06d210 con 0x7f3ecc0c8b10 2024-09-12T02:23:38.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.849+0000 7f3ed29bd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3ecc0c69b0 con 0x7f3ecc06cd80 2024-09-12T02:23:38.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.849+0000 7f3ed0f5a640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f3ecc153a10 0x7f3ecc156660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:35450/0 (socket says 172.21.15.60:35450) 2024-09-12T02:23:38.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.849+0000 7f3ed0f5a640 1 -- 172.21.15.60:0/1980687232 learned_addr learned my addr 172.21.15.60:0/1980687232 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:38.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.849+0000 7f3ecbfff640 1 --2- 172.21.15.60:0/1980687232 >> v2:172.21.15.105:3300/0 conn(0x7f3ecc0c8b10 0x7f3ecc15a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:38.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.849+0000 7f3ecb7fe640 1 --2- 172.21.15.60:0/1980687232 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ecc06cd80 0x7f3ecc1534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:38.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.849+0000 7f3ecaffd640 1 -- 172.21.15.60:0/1980687232 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3207265925 0 0) 0x7f3ecc0c7070 con 0x7f3ecc153a10 2024-09-12T02:23:38.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.850+0000 7f3ecaffd640 1 -- 172.21.15.60:0/1980687232 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3eb4003520 con 0x7f3ecc153a10 2024-09-12T02:23:38.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.850+0000 7f3ecbfff640 1 -- 172.21.15.60:0/1980687232 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ecc06cd80 msgr2=0x7f3ecc1534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:38.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.850+0000 7f3ecbfff640 1 --2- 172.21.15.60:0/1980687232 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ecc06cd80 0x7f3ecc1534d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:38.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.850+0000 7f3ecbfff640 1 -- 172.21.15.60:0/1980687232 >> v1:172.21.15.60:6789/0 conn(0x7f3ecc153a10 legacy=0x7f3ecc156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:38.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.850+0000 7f3ecbfff640 1 -- 172.21.15.60:0/1980687232 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ecc0c6c90 con 0x7f3ecc0c8b10 2024-09-12T02:23:38.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.850+0000 7f3ecb7fe640 1 --2- 172.21.15.60:0/1980687232 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ecc06cd80 0x7f3ecc1534d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:23:38.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.850+0000 7f3ecbfff640 1 --2- 172.21.15.60:0/1980687232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ecc0c8b10 0x7f3ecc15a4a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc0097a0 tx=0x7f3ebc02a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62c4d457458f93b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:38.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.851+0000 7f3ecaffd640 1 -- 172.21.15.60:0/1980687232 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc037070 con 0x7f3ecc0c8b10 2024-09-12T02:23:38.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.851+0000 7f3ecaffd640 1 -- 172.21.15.60:0/1980687232 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ebc02ae50 con 0x7f3ecc0c8b10 2024-09-12T02:23:38.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.851+0000 7f3ecaffd640 1 -- 172.21.15.60:0/1980687232 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc032660 con 0x7f3ecc0c8b10 2024-09-12T02:23:38.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.851+0000 7f3ed29bd640 1 -- 172.21.15.60:0/1980687232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ecc0c8b10 msgr2=0x7f3ecc15a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:38.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.851+0000 7f3ed29bd640 1 --2- 172.21.15.60:0/1980687232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ecc0c8b10 0x7f3ecc15a4a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc0097a0 tx=0x7f3ebc02a100 comp rx=0 tx=0).stop 2024-09-12T02:23:38.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.851+0000 7f3ed29bd640 1 -- 172.21.15.60:0/1980687232 shutdown_connections 2024-09-12T02:23:38.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.851+0000 7f3ed29bd640 1 --2- 172.21.15.60:0/1980687232 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ecc06cd80 0x7f3ecc1534d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:38.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.851+0000 7f3ed29bd640 1 --2- 172.21.15.60:0/1980687232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ecc0c8b10 0x7f3ecc15a4a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:38.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.851+0000 7f3ed29bd640 1 -- 172.21.15.60:0/1980687232 >> 172.21.15.60:0/1980687232 conn(0x7f3ecc0adb80 msgr2=0x7f3ecc0adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:38.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.851+0000 7f3ed29bd640 1 -- 172.21.15.60:0/1980687232 shutdown_connections 2024-09-12T02:23:38.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.851+0000 7f3ed29bd640 1 -- 172.21.15.60:0/1980687232 wait complete. 2024-09-12T02:23:38.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.852+0000 7f3ed29bd640 1 Processor -- start 2024-09-12T02:23:38.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.853+0000 7f3ed29bd640 1 -- start start 2024-09-12T02:23:38.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.853+0000 7f3ed29bd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ecc0c8b10 0x7f3ecc15a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:38.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.853+0000 7f3ed29bd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ecc153a10 0x7f3ecc1ef570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:38.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.853+0000 7f3ed29bd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ecc1efab0 0x7f3ecc1492b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:38.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.853+0000 7f3ed29bd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3ecc154020 con 0x7f3ecc0c8b10 2024-09-12T02:23:38.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.853+0000 7f3ed29bd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3ecc153ea0 con 0x7f3ecc153a10 2024-09-12T02:23:38.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.853+0000 7f3ed29bd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3ecc0c8ef0 con 0x7f3ecc1efab0 2024-09-12T02:23:38.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.854+0000 7f3ecbfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ecc0c8b10 0x7f3ecc15a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:38.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.854+0000 7f3ecbfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ecc0c8b10 0x7f3ecc15a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50376/0 (socket says 172.21.15.60:50376) 2024-09-12T02:23:38.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.854+0000 7f3ecbfff640 1 -- 172.21.15.60:0/1174448730 learned_addr learned my addr 172.21.15.60:0/1174448730 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:38.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.854+0000 7f3ecb7fe640 1 --2- 172.21.15.60:0/1174448730 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ecc153a10 0x7f3ecc1ef570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:38.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.854+0000 7f3ed0f5a640 1 --2- 172.21.15.60:0/1174448730 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ecc1efab0 0x7f3ecc1492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:38.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.854+0000 7f3ecbfff640 1 -- 172.21.15.60:0/1174448730 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ecc1efab0 msgr2=0x7f3ecc1492b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:38.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.854+0000 7f3ecbfff640 1 --2- 172.21.15.60:0/1174448730 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ecc1efab0 0x7f3ecc1492b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:38.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.854+0000 7f3ecbfff640 1 -- 172.21.15.60:0/1174448730 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ecc153a10 msgr2=0x7f3ecc1ef570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:38.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.854+0000 7f3ecbfff640 1 --2- 172.21.15.60:0/1174448730 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ecc153a10 0x7f3ecc1ef570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:38.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.854+0000 7f3ecbfff640 1 -- 172.21.15.60:0/1174448730 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ecc1f0050 con 0x7f3ecc0c8b10 2024-09-12T02:23:38.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.854+0000 7f3ecbfff640 1 --2- 172.21.15.60:0/1174448730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ecc0c8b10 0x7f3ecc15a250 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc0098c0 tx=0x7f3ebc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:38.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.854+0000 7f3ec8ff9640 1 -- 172.21.15.60:0/1174448730 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc041030 con 0x7f3ecc0c8b10 2024-09-12T02:23:38.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.854+0000 7f3ec8ff9640 1 -- 172.21.15.60:0/1174448730 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ebc02ac50 con 0x7f3ecc0c8b10 2024-09-12T02:23:38.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.854+0000 7f3ed29bd640 1 -- 172.21.15.60:0/1174448730 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ecc149f80 con 0x7f3ecc0c8b10 2024-09-12T02:23:38.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.854+0000 7f3ec8ff9640 1 -- 172.21.15.60:0/1174448730 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc037040 con 0x7f3ecc0c8b10 2024-09-12T02:23:38.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.854+0000 7f3ed29bd640 1 -- 172.21.15.60:0/1174448730 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ecc1ed400 con 0x7f3ecc0c8b10 2024-09-12T02:23:38.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.855+0000 7f3ed29bd640 1 -- 172.21.15.60:0/1174448730 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ecc14a4a0 con 0x7f3ecc0c8b10 2024-09-12T02:23:38.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.856+0000 7f3ec8ff9640 1 -- 172.21.15.60:0/1174448730 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3ebc044070 con 0x7f3ecc0c8b10 2024-09-12T02:23:38.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.856+0000 7f3ec8ff9640 1 --2- 172.21.15.60:0/1174448730 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3eb806be60 0x7f3eb806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:38.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.857+0000 7f3ec8ff9640 1 -- 172.21.15.60:0/1174448730 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f3ebc0ab660 con 0x7f3ecc0c8b10 2024-09-12T02:23:38.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.857+0000 7f3ecb7fe640 1 --2- 172.21.15.60:0/1174448730 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3eb806be60 0x7f3eb806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:38.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.857+0000 7f3ecb7fe640 1 --2- 172.21.15.60:0/1174448730 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3eb806be60 0x7f3eb806e320 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0009560 tx=0x7f3ec0009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:38.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:38.861+0000 7f3ec8ff9640 1 -- 172.21.15.60:0/1174448730 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3ecc14a4a0 con 0x7f3ecc0c8b10 2024-09-12T02:23:39.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.111+0000 7f3ed29bd640 1 -- 172.21.15.60:0/1174448730 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3ecc1534d0 con 0x7f3ecc0c8b10 2024-09-12T02:23:39.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.111+0000 7f3ec8ff9640 1 -- 172.21.15.60:0/1174448730 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7f3ebc079710 con 0x7f3ecc0c8b10 2024-09-12T02:23:39.112 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":59,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:23:39.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.114+0000 7f3ed29bd640 1 -- 172.21.15.60:0/1174448730 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3eb806be60 msgr2=0x7f3eb806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:39.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.114+0000 7f3ed29bd640 1 --2- 172.21.15.60:0/1174448730 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3eb806be60 0x7f3eb806e320 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0009560 tx=0x7f3ec0009190 comp rx=0 tx=0).stop 2024-09-12T02:23:39.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.114+0000 7f3ed29bd640 1 -- 172.21.15.60:0/1174448730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ecc0c8b10 msgr2=0x7f3ecc15a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:39.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.114+0000 7f3ed29bd640 1 --2- 172.21.15.60:0/1174448730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ecc0c8b10 0x7f3ecc15a250 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc0098c0 tx=0x7f3ebc0046c0 comp rx=0 tx=0).stop 2024-09-12T02:23:39.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.114+0000 7f3ed29bd640 1 -- 172.21.15.60:0/1174448730 shutdown_connections 2024-09-12T02:23:39.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.114+0000 7f3ed29bd640 1 --2- 172.21.15.60:0/1174448730 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3eb806be60 0x7f3eb806e320 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:39.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.114+0000 7f3ed29bd640 1 --2- 172.21.15.60:0/1174448730 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ecc1efab0 0x7f3ecc1492b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:39.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.114+0000 7f3ed29bd640 1 --2- 172.21.15.60:0/1174448730 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ecc153a10 0x7f3ecc1ef570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:39.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.114+0000 7f3ed29bd640 1 --2- 172.21.15.60:0/1174448730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ecc0c8b10 0x7f3ecc15a250 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:39.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.114+0000 7f3ed29bd640 1 -- 172.21.15.60:0/1174448730 >> 172.21.15.60:0/1174448730 conn(0x7f3ecc0adb80 msgr2=0x7f3ecc06bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:39.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.114+0000 7f3ed29bd640 1 -- 172.21.15.60:0/1174448730 shutdown_connections 2024-09-12T02:23:39.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.114+0000 7f3ed29bd640 1 -- 172.21.15.60:0/1174448730 wait complete. 2024-09-12T02:23:39.125 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-12T02:23:39.126 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-12T02:23:39.126 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-12T02:23:39.126 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-12T02:23:39.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.230+0000 7f85b39b7640 1 Processor -- start 2024-09-12T02:23:39.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.230+0000 7f85b39b7640 1 -- start start 2024-09-12T02:23:39.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.231+0000 7f85b39b7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85ac0acc30 0x7f85ac0c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:39.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.231+0000 7f85b39b7640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85ac070590 con 0x7f85ac0c44b0 2024-09-12T02:23:39.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.231+0000 7f85b39b7640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85ac0a8220 con 0x7f85ac0c8180 2024-09-12T02:23:39.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.231+0000 7f85b39b7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f85ac0c4ea0 con 0x7f85ac0acc30 2024-09-12T02:23:39.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.231+0000 7f85b0f52640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f85ac0c44b0 0x7f85ac0c7a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:35464/0 (socket says 172.21.15.60:35464) 2024-09-12T02:23:39.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.231+0000 7f85b0f52640 1 -- 172.21.15.60:0/2764770764 learned_addr learned my addr 172.21.15.60:0/2764770764 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:39.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.231+0000 7f85b1753640 1 --2- 172.21.15.60:0/2764770764 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85ac0acc30 0x7f85ac0c3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:39.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.232+0000 7f859ffff640 1 -- 172.21.15.60:0/2764770764 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2117247591 0 0) 0x7f85ac070590 con 0x7f85ac0c44b0 2024-09-12T02:23:39.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.232+0000 7f859ffff640 1 -- 172.21.15.60:0/2764770764 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8598003520 con 0x7f85ac0c44b0 2024-09-12T02:23:39.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.232+0000 7f859ffff640 1 -- 172.21.15.60:0/2764770764 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2097327525 0 0) 0x7f85ac0a8220 con 0x7f85ac0c8180 2024-09-12T02:23:39.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.232+0000 7f859ffff640 1 -- 172.21.15.60:0/2764770764 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85ac070590 con 0x7f85ac0c8180 2024-09-12T02:23:39.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.232+0000 7f85b1753640 1 -- 172.21.15.60:0/2764770764 >> v1:172.21.15.105:6789/0 conn(0x7f85ac0c8180 legacy=0x7f85ac15dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:39.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.232+0000 7f85b1753640 1 -- 172.21.15.60:0/2764770764 >> v1:172.21.15.60:6789/0 conn(0x7f85ac0c44b0 legacy=0x7f85ac0c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:39.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.232+0000 7f85b1753640 1 -- 172.21.15.60:0/2764770764 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85ac0a84f0 con 0x7f85ac0acc30 2024-09-12T02:23:39.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.232+0000 7f85b1753640 1 --2- 172.21.15.60:0/2764770764 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85ac0acc30 0x7f85ac0c3f70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f85a0009dc0 tx=0x7f85a002a5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4249ab7cdc4adc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:39.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.233+0000 7f859ffff640 1 -- 172.21.15.60:0/2764770764 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a0007740 con 0x7f85ac0acc30 2024-09-12T02:23:39.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.233+0000 7f859ffff640 1 -- 172.21.15.60:0/2764770764 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85a00078e0 con 0x7f85ac0acc30 2024-09-12T02:23:39.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.233+0000 7f859ffff640 1 -- 172.21.15.60:0/2764770764 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a0007cb0 con 0x7f85ac0acc30 2024-09-12T02:23:39.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.233+0000 7f85b39b7640 1 -- 172.21.15.60:0/2764770764 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85ac0acc30 msgr2=0x7f85ac0c3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:39.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.233+0000 7f85b39b7640 1 --2- 172.21.15.60:0/2764770764 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85ac0acc30 0x7f85ac0c3f70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f85a0009dc0 tx=0x7f85a002a5b0 comp rx=0 tx=0).stop 2024-09-12T02:23:39.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.233+0000 7f85b39b7640 1 -- 172.21.15.60:0/2764770764 shutdown_connections 2024-09-12T02:23:39.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.233+0000 7f85b39b7640 1 --2- 172.21.15.60:0/2764770764 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85ac0acc30 0x7f85ac0c3f70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:39.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.233+0000 7f85b39b7640 1 -- 172.21.15.60:0/2764770764 >> 172.21.15.60:0/2764770764 conn(0x7f85ac0c5660 msgr2=0x7f85ac0c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:39.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.233+0000 7f85b39b7640 1 -- 172.21.15.60:0/2764770764 shutdown_connections 2024-09-12T02:23:39.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.233+0000 7f85b39b7640 1 -- 172.21.15.60:0/2764770764 wait complete. 2024-09-12T02:23:39.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.234+0000 7f85b39b7640 1 Processor -- start 2024-09-12T02:23:39.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.235+0000 7f85b39b7640 1 -- start start 2024-09-12T02:23:39.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.235+0000 7f85b39b7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85ac0acc30 0x7f85ac155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:39.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.235+0000 7f85b39b7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85ac0c44b0 0x7f85ac0a76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:39.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.235+0000 7f85b39b7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85ac0c8180 0x7f85ac0a7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:39.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.235+0000 7f85b39b7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f85ac0c5330 con 0x7f85ac0c8180 2024-09-12T02:23:39.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.235+0000 7f85b39b7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f85ac0702b0 con 0x7f85ac0acc30 2024-09-12T02:23:39.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.235+0000 7f85b39b7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f85ac0c63f0 con 0x7f85ac0c44b0 2024-09-12T02:23:39.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.235+0000 7f85b1f54640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85ac0c8180 0x7f85ac0a7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:39.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.235+0000 7f85b1f54640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85ac0c8180 0x7f85ac0a7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50384/0 (socket says 172.21.15.60:50384) 2024-09-12T02:23:39.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.235+0000 7f85b1f54640 1 -- 172.21.15.60:0/3518417709 learned_addr learned my addr 172.21.15.60:0/3518417709 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:39.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.235+0000 7f85b0f52640 1 --2- 172.21.15.60:0/3518417709 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85ac0c44b0 0x7f85ac0a76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:39.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.235+0000 7f85b1753640 1 --2- 172.21.15.60:0/3518417709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85ac0acc30 0x7f85ac155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:39.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.236+0000 7f85b1f54640 1 -- 172.21.15.60:0/3518417709 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85ac0c44b0 msgr2=0x7f85ac0a76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:39.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.236+0000 7f85b1f54640 1 --2- 172.21.15.60:0/3518417709 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85ac0c44b0 0x7f85ac0a76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:39.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.236+0000 7f85b1f54640 1 -- 172.21.15.60:0/3518417709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85ac0acc30 msgr2=0x7f85ac155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:39.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.236+0000 7f85b1f54640 1 --2- 172.21.15.60:0/3518417709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85ac0acc30 0x7f85ac155270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:39.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.236+0000 7f85b1f54640 1 -- 172.21.15.60:0/3518417709 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85ac1ec960 con 0x7f85ac0c8180 2024-09-12T02:23:39.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.236+0000 7f85b0f52640 1 --2- 172.21.15.60:0/3518417709 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85ac0c44b0 0x7f85ac0a76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:23:39.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.236+0000 7f85b1753640 1 --2- 172.21.15.60:0/3518417709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85ac0acc30 0x7f85ac155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:23:39.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.236+0000 7f85b1f54640 1 --2- 172.21.15.60:0/3518417709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85ac0c8180 0x7f85ac0a7c10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f85a400c430 tx=0x7f85a400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:39.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.236+0000 7f859dffb640 1 -- 172.21.15.60:0/3518417709 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a4017070 con 0x7f85ac0c8180 2024-09-12T02:23:39.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.236+0000 7f859dffb640 1 -- 172.21.15.60:0/3518417709 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85a40052d0 con 0x7f85ac0c8180 2024-09-12T02:23:39.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.236+0000 7f859dffb640 1 -- 172.21.15.60:0/3518417709 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a40037f0 con 0x7f85ac0c8180 2024-09-12T02:23:39.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.236+0000 7f85b39b7640 1 -- 172.21.15.60:0/3518417709 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85ac1ecc40 con 0x7f85ac0c8180 2024-09-12T02:23:39.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.236+0000 7f85b39b7640 1 -- 172.21.15.60:0/3518417709 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85ac1ed200 con 0x7f85ac0c8180 2024-09-12T02:23:39.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.237+0000 7f85b39b7640 1 --2- 172.21.15.60:0/3518417709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85ac151d10 0x7f85ac1520f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:39.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.237+0000 7f85b39b7640 1 -- 172.21.15.60:0/3518417709 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f85ac1ed720 con 0x7f85ac151d10 2024-09-12T02:23:39.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.237+0000 7f85b1753640 1 --2- 172.21.15.60:0/3518417709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85ac151d10 0x7f85ac1520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:39.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.238+0000 7f85b1753640 1 -- 172.21.15.60:0/3518417709 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f85ac1ed550 con 0x7f85ac151d10 2024-09-12T02:23:39.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.238+0000 7f85b1753640 1 --2- 172.21.15.60:0/3518417709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85ac151d10 0x7f85ac1520f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f85ac074190 tx=0x7f85a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:39.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.238+0000 7f859dffb640 1 -- 172.21.15.60:0/3518417709 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a0049070 con 0x7f85ac151d10 2024-09-12T02:23:39.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.238+0000 7f859dffb640 1 -- 172.21.15.60:0/3518417709 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f85a401a070 con 0x7f85ac0c8180 2024-09-12T02:23:39.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.239+0000 7f859dffb640 1 --2- 172.21.15.60:0/3518417709 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f859006bd60 0x7f859006e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:39.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.239+0000 7f85b0f52640 1 --2- 172.21.15.60:0/3518417709 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f859006bd60 0x7f859006e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:39.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.239+0000 7f859dffb640 1 -- 172.21.15.60:0/3518417709 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f85a408a3a0 con 0x7f85ac0c8180 2024-09-12T02:23:39.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.239+0000 7f859dffb640 1 -- 172.21.15.60:0/3518417709 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f85a0007e40 con 0x7f85ac151d10 2024-09-12T02:23:39.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.239+0000 7f859dffb640 1 -- 172.21.15.60:0/3518417709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85ac151d10 msgr2=0x7f85ac1520f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:39.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.239+0000 7f859dffb640 1 --2- 172.21.15.60:0/3518417709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85ac151d10 0x7f85ac1520f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f85ac074190 tx=0x7f85a0004a40 comp rx=0 tx=0).stop 2024-09-12T02:23:39.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.239+0000 7f859dffb640 1 -- 172.21.15.60:0/3518417709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85ac151d10 msgr2=0x7f85ac1520f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:23:39.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.239+0000 7f859dffb640 1 --2- 172.21.15.60:0/3518417709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85ac151d10 0x7f85ac1520f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:39.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.240+0000 7f85b0f52640 1 --2- 172.21.15.60:0/3518417709 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f859006bd60 0x7f859006e220 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f85ac0c0350 tx=0x7f85a8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:39.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.246+0000 7f85b39b7640 1 --2- 172.21.15.60:0/3518417709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85ac0bdb80 0x7f85ac0bdf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:39.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.246+0000 7f85b39b7640 1 -- 172.21.15.60:0/3518417709 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f85ac0abc10 con 0x7f85ac0bdb80 2024-09-12T02:23:39.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.246+0000 7f85b1753640 1 --2- 172.21.15.60:0/3518417709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85ac0bdb80 0x7f85ac0bdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:39.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.246+0000 7f85b1753640 1 -- 172.21.15.60:0/3518417709 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f85ac0764a0 con 0x7f85ac0bdb80 2024-09-12T02:23:39.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.246+0000 7f85b1753640 1 --2- 172.21.15.60:0/3518417709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85ac0bdb80 0x7f85ac0bdf60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f85ac0adb20 tx=0x7f85a0030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:39.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.246+0000 7f859dffb640 1 -- 172.21.15.60:0/3518417709 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a0009450 con 0x7f85ac0bdb80 2024-09-12T02:23:39.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.247+0000 7f859dffb640 1 -- 172.21.15.60:0/3518417709 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5051 (secure 0 0 0) 0x7f85a0009a30 con 0x7f85ac0bdb80 2024-09-12T02:23:39.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.247+0000 7f859dffb640 1 -- 172.21.15.60:0/3518417709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85ac0bdb80 msgr2=0x7f85ac0bdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:39.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.247+0000 7f859dffb640 1 --2- 172.21.15.60:0/3518417709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85ac0bdb80 0x7f85ac0bdf60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f85ac0adb20 tx=0x7f85a0030000 comp rx=0 tx=0).stop 2024-09-12T02:23:39.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.247+0000 7f859dffb640 1 -- 172.21.15.60:0/3518417709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85ac0bdb80 msgr2=0x7f85ac0bdf60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:23:39.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.247+0000 7f859dffb640 1 --2- 172.21.15.60:0/3518417709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85ac0bdb80 0x7f85ac0bdf60 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:39.248 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:23:39.248 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:23:39.248 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:23:39.248 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:23:39.248 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 8, 2024-09-12T02:23:39.248 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 64599, 2024-09-12T02:23:39.248 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:23:39.248 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:23:39.248 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:23:39.249 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:23:39.249 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:23:39.249 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 59, 2024-09-12T02:23:39.249 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:23:39.249 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:23:39.249 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:23:39.249 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:23:39.249 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:23:39.249 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:23:39.249 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:23:39.249 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:23:39.249 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:23:39.249 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:23:39.250 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:23:39.250 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:23:39.250 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:23:39.250 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:23:39.250 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:23:39.250 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:23:39.250 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:23:39.250 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:23:39.250 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:23:39.250 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:23:39.250 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:23:39.250 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:23:39.250 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:23:39.251 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:23:39.251 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:23:39.251 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:23:39.251 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:23:39.251 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:23:39.251 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:23:39.251 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:39.251 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:23:39.251 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:23:39.251 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:23:39.251 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:23:39.251 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:23:39.251 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:23:39.251 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:23:39.252 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:23:39.252 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:23:39.252 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:23:39.252 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:23:39.252 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:23:39.252 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:23:39.252 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:23:39.252 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:23:39.252 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:23:39.252 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:23:39.252 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:23:39.252 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:23:39.252 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:23:39.253 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:23:39.253 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:23:39.253 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:23:39.253 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:23:39.253 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:23:39.253 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:23:39.253 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:23:39.253 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:23:39.253 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:23:39.253 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:23:39.253 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:39.253 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:23:39.253 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:39.253 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:23:39.254 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:23:39.254 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:23:39.254 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:23:39.254 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:39.254 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:23:39.254 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:23:39.254 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:23:39.254 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:39.254 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:39.254 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:23:39.254 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:23:39.254 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:23:39.254 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:23:39.255 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:23:39.255 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:39.255 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:23:39.255 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:23:39.255 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:23:39.255 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:23:39.255 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:23:39.255 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:39.255 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:39.255 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:23:39.255 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:23:39.255 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:23:39.255 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:23:39.255 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:39.256 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:23:39.256 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:23:39.256 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:23:39.256 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:39.256 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:39.256 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:23:39.256 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:23:39.256 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:23:39.256 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:23:39.256 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:23:39.256 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:39.256 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:23:39.256 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:23:39.256 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:23:39.257 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:23:39.257 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:23:39.257 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:39.257 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:39.257 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:23:39.257 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:23:39.257 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:23:39.257 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:23:39.257 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:39.257 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:23:39.257 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:23:39.257 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:23:39.257 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:39.258 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:39.258 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:23:39.258 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:23:39.258 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:23:39.258 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:23:39.258 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:23:39.258 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:39.258 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:23:39.258 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:23:39.258 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:23:39.258 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:23:39.258 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:23:39.258 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:23:39.259 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:23:39.259 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:39.259 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:23:39.259 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:23:39.259 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:39.259 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:23:39.259 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:23:39.259 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:23:39.259 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:23:39.259 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:23:39.259 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:23:39.259 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:39.259 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:23:39.259 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:23:39.260 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:23:39.260 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:23:39.260 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:23:39.260 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:23:39.260 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:39.260 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:23:39.260 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:23:39.260 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:23:39.260 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:23:39.260 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:23:39.260 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:23:39.260 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:39.260 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:23:39.261 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:23:39.261 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-09-12T02:23:39.261 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:23:39.261 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:23:39.261 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:23:39.261 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:39.261 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:23:39.261 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:23:39.261 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:23:39.261 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:23:39.261 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:23:39.261 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:39.261 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:23:39.261 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:23:39.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.247+0000 7f85b39b7640 1 -- 172.21.15.60:0/3518417709 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f859006bd60 msgr2=0x7f859006e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:39.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.247+0000 7f85b39b7640 1 --2- 172.21.15.60:0/3518417709 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f859006bd60 0x7f859006e220 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f85ac0c0350 tx=0x7f85a8009040 comp rx=0 tx=0).stop 2024-09-12T02:23:39.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.247+0000 7f85b39b7640 1 -- 172.21.15.60:0/3518417709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85ac0c8180 msgr2=0x7f85ac0a7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:39.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.247+0000 7f85b39b7640 1 --2- 172.21.15.60:0/3518417709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85ac0c8180 0x7f85ac0a7c10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f85a400c430 tx=0x7f85a400c8f0 comp rx=0 tx=0).stop 2024-09-12T02:23:39.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.247+0000 7f85b1f54640 1 -- 172.21.15.60:0/3518417709 reap_dead start 2024-09-12T02:23:39.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.247+0000 7f85b1f54640 1 -- 172.21.15.60:0/3518417709 reap_dead start 2024-09-12T02:23:39.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.247+0000 7f85b39b7640 1 -- 172.21.15.60:0/3518417709 shutdown_connections 2024-09-12T02:23:39.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.247+0000 7f85b39b7640 1 -- 172.21.15.60:0/3518417709 >> 172.21.15.60:0/3518417709 conn(0x7f85ac0c5660 msgr2=0x7f85ac0742e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:39.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.247+0000 7f85b39b7640 1 -- 172.21.15.60:0/3518417709 shutdown_connections 2024-09-12T02:23:39.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.247+0000 7f85b39b7640 1 -- 172.21.15.60:0/3518417709 wait complete. 2024-09-12T02:23:39.264 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:23:39.264 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-12T02:23:39.264 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-12T02:23:39.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.366+0000 7f8da7853640 1 Processor -- start 2024-09-12T02:23:39.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.367+0000 7f8da7853640 1 -- start start 2024-09-12T02:23:39.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.367+0000 7f8da7853640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8da0156f50 0x7f8da0161ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:39.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.367+0000 7f8da7853640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8da006dd50 con 0x7f8da0073ae0 2024-09-12T02:23:39.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.367+0000 7f8da7853640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8da006e030 con 0x7f8da00733d0 2024-09-12T02:23:39.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.367+0000 7f8da7853640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f8da006e310 con 0x7f8da0156f50 2024-09-12T02:23:39.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.368+0000 7f8da5df0640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8da0156f50 0x7f8da0161ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:39.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.368+0000 7f8da55ef640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f8da0073ae0 0x7f8da0153380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:35466/0 (socket says 172.21.15.60:35466) 2024-09-12T02:23:39.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.368+0000 7f8da55ef640 1 -- 172.21.15.60:0/713265837 learned_addr learned my addr 172.21.15.60:0/713265837 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:39.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.368+0000 7f8da5df0640 1 -- 172.21.15.60:0/713265837 >> v1:172.21.15.105:6789/0 conn(0x7f8da00733d0 legacy=0x7f8da0156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:39.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.368+0000 7f8da5df0640 1 -- 172.21.15.60:0/713265837 >> v1:172.21.15.60:6789/0 conn(0x7f8da0073ae0 legacy=0x7f8da0153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:39.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.368+0000 7f8da5df0640 1 -- 172.21.15.60:0/713265837 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8da006e5f0 con 0x7f8da0156f50 2024-09-12T02:23:39.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.369+0000 7f8da5df0640 1 --2- 172.21.15.60:0/713265837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8da0156f50 0x7f8da0161ba0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8d90009d90 tx=0x7f8d9002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b64cd7d404c6598 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:39.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.369+0000 7f8d9ffff640 1 -- 172.21.15.60:0/713265837 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d90007740 con 0x7f8da0156f50 2024-09-12T02:23:39.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.369+0000 7f8d9ffff640 1 -- 172.21.15.60:0/713265837 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d900078e0 con 0x7f8da0156f50 2024-09-12T02:23:39.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.369+0000 7f8d9ffff640 1 -- 172.21.15.60:0/713265837 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d90007cb0 con 0x7f8da0156f50 2024-09-12T02:23:39.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.369+0000 7f8da7853640 1 -- 172.21.15.60:0/713265837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8da0156f50 msgr2=0x7f8da0161ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:39.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.369+0000 7f8da7853640 1 --2- 172.21.15.60:0/713265837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8da0156f50 0x7f8da0161ba0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8d90009d90 tx=0x7f8d9002a6f0 comp rx=0 tx=0).stop 2024-09-12T02:23:39.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.369+0000 7f8da7853640 1 -- 172.21.15.60:0/713265837 shutdown_connections 2024-09-12T02:23:39.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.369+0000 7f8da7853640 1 --2- 172.21.15.60:0/713265837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8da0156f50 0x7f8da0161ba0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:39.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.369+0000 7f8da7853640 1 -- 172.21.15.60:0/713265837 >> 172.21.15.60:0/713265837 conn(0x7f8da00c9d80 msgr2=0x7f8da00ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:39.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.370+0000 7f8da7853640 1 -- 172.21.15.60:0/713265837 shutdown_connections 2024-09-12T02:23:39.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.370+0000 7f8da7853640 1 -- 172.21.15.60:0/713265837 wait complete. 2024-09-12T02:23:39.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.371+0000 7f8da7853640 1 Processor -- start 2024-09-12T02:23:39.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.371+0000 7f8da7853640 1 -- start start 2024-09-12T02:23:39.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.371+0000 7f8da7853640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8da00733d0 0x7f8da01e13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:39.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.371+0000 7f8da7853640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8da0073ae0 0x7f8da0154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:39.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.371+0000 7f8da7853640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8da0156f50 0x7f8da01dfab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:39.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.371+0000 7f8da7853640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8da006edd0 con 0x7f8da0073ae0 2024-09-12T02:23:39.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.371+0000 7f8da7853640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8da006ec50 con 0x7f8da0156f50 2024-09-12T02:23:39.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.371+0000 7f8da7853640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8da0153a90 con 0x7f8da00733d0 2024-09-12T02:23:39.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.372+0000 7f8da4dee640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8da0073ae0 0x7f8da0154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:39.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.372+0000 7f8da4dee640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8da0073ae0 0x7f8da0154960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50438/0 (socket says 172.21.15.60:50438) 2024-09-12T02:23:39.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.372+0000 7f8da5df0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8da0156f50 0x7f8da01dfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:39.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.372+0000 7f8da4dee640 1 -- 172.21.15.60:0/2192670635 learned_addr learned my addr 172.21.15.60:0/2192670635 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:39.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.372+0000 7f8da55ef640 1 --2- 172.21.15.60:0/2192670635 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8da00733d0 0x7f8da01e13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:39.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.372+0000 7f8da4dee640 1 -- 172.21.15.60:0/2192670635 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8da00733d0 msgr2=0x7f8da01e13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:39.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.372+0000 7f8da4dee640 1 --2- 172.21.15.60:0/2192670635 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8da00733d0 0x7f8da01e13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:39.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.372+0000 7f8da4dee640 1 -- 172.21.15.60:0/2192670635 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8da0156f50 msgr2=0x7f8da01dfab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:39.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.372+0000 7f8da4dee640 1 --2- 172.21.15.60:0/2192670635 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8da0156f50 0x7f8da01dfab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:39.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.372+0000 7f8da4dee640 1 -- 172.21.15.60:0/2192670635 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8da01ec8e0 con 0x7f8da0073ae0 2024-09-12T02:23:39.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.372+0000 7f8da4dee640 1 --2- 172.21.15.60:0/2192670635 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8da0073ae0 0x7f8da0154960 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8d9400c440 tx=0x7f8d9400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:39.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.372+0000 7f8d9dffb640 1 -- 172.21.15.60:0/2192670635 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d940052d0 con 0x7f8da0073ae0 2024-09-12T02:23:39.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.372+0000 7f8d9dffb640 1 -- 172.21.15.60:0/2192670635 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d94005470 con 0x7f8da0073ae0 2024-09-12T02:23:39.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.372+0000 7f8da7853640 1 -- 172.21.15.60:0/2192670635 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8da01ecc20 con 0x7f8da0073ae0 2024-09-12T02:23:39.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.372+0000 7f8d9dffb640 1 -- 172.21.15.60:0/2192670635 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d94007260 con 0x7f8da0073ae0 2024-09-12T02:23:39.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.373+0000 7f8da7853640 1 -- 172.21.15.60:0/2192670635 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8da01e1ad0 con 0x7f8da0073ae0 2024-09-12T02:23:39.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.373+0000 7f8da7853640 1 --2- 172.21.15.60:0/2192670635 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8da0155240 0x7f8da01dfff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:39.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.373+0000 7f8da7853640 1 -- 172.21.15.60:0/2192670635 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8da00695d0 con 0x7f8da0155240 2024-09-12T02:23:39.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.373+0000 7f8da55ef640 1 --2- 172.21.15.60:0/2192670635 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8da0155240 0x7f8da01dfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:39.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.374+0000 7f8da55ef640 1 -- 172.21.15.60:0/2192670635 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8da0073ec0 con 0x7f8da0155240 2024-09-12T02:23:39.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.374+0000 7f8d9dffb640 1 -- 172.21.15.60:0/2192670635 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8d940074c0 con 0x7f8da0073ae0 2024-09-12T02:23:39.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.374+0000 7f8da55ef640 1 --2- 172.21.15.60:0/2192670635 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8da0155240 0x7f8da01dfff0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8d98000f60 tx=0x7f8d9800fc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:39.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.374+0000 7f8d9dffb640 1 --2- 172.21.15.60:0/2192670635 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8d8c06be30 0x7f8d8c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:39.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.374+0000 7f8d9dffb640 1 -- 172.21.15.60:0/2192670635 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f8d9408a4e0 con 0x7f8da0073ae0 2024-09-12T02:23:39.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.374+0000 7f8da5df0640 1 --2- 172.21.15.60:0/2192670635 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8d8c06be30 0x7f8d8c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:39.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.375+0000 7f8d9dffb640 1 -- 172.21.15.60:0/2192670635 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d980058b0 con 0x7f8da0155240 2024-09-12T02:23:39.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.375+0000 7f8d9dffb640 1 -- 172.21.15.60:0/2192670635 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f8d98018070 con 0x7f8da0155240 2024-09-12T02:23:39.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.375+0000 7f8d9dffb640 1 -- 172.21.15.60:0/2192670635 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8da0155240 msgr2=0x7f8da01dfff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:39.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.375+0000 7f8d9dffb640 1 --2- 172.21.15.60:0/2192670635 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8da0155240 0x7f8da01dfff0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8d98000f60 tx=0x7f8d9800fc00 comp rx=0 tx=0).stop 2024-09-12T02:23:39.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.375+0000 7f8d9dffb640 1 -- 172.21.15.60:0/2192670635 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8da0155240 msgr2=0x7f8da01dfff0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:23:39.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.375+0000 7f8d9dffb640 1 --2- 172.21.15.60:0/2192670635 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8da0155240 0x7f8da01dfff0 secure :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8d98000f60 tx=0x7f8d9800fc00 comp rx=0 tx=0).stop 2024-09-12T02:23:39.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.375+0000 7f8da5df0640 1 --2- 172.21.15.60:0/2192670635 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8d8c06be30 0x7f8d8c06e2f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8d90034000 tx=0x7f8d9002f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:39.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.381+0000 7f8da7853640 1 --2- 172.21.15.60:0/2192670635 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8da01e0530 0x7f8da01ef2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:39.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.381+0000 7f8da7853640 1 -- 172.21.15.60:0/2192670635 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8da00c7700 con 0x7f8da01e0530 2024-09-12T02:23:39.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.381+0000 7f8da55ef640 1 --2- 172.21.15.60:0/2192670635 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8da01e0530 0x7f8da01ef2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:39.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.381+0000 7f8da55ef640 1 -- 172.21.15.60:0/2192670635 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8da0153500 con 0x7f8da01e0530 2024-09-12T02:23:39.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.382+0000 7f8da55ef640 1 --2- 172.21.15.60:0/2192670635 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8da01e0530 0x7f8da01ef2c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8d98000f60 tx=0x7f8d980057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:39.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.382+0000 7f8d9dffb640 1 -- 172.21.15.60:0/2192670635 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9801d7c0 con 0x7f8da01e0530 2024-09-12T02:23:39.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.382+0000 7f8d9dffb640 1 -- 172.21.15.60:0/2192670635 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4882 (secure 0 0 0) 0x7f8d9801d7c0 con 0x7f8da01e0530 2024-09-12T02:23:39.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.382+0000 7f8d9dffb640 1 -- 172.21.15.60:0/2192670635 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8da01e0530 msgr2=0x7f8da01ef2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:39.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.382+0000 7f8d9dffb640 1 --2- 172.21.15.60:0/2192670635 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8da01e0530 0x7f8da01ef2c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8d98000f60 tx=0x7f8d980057f0 comp rx=0 tx=0).stop 2024-09-12T02:23:39.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.382+0000 7f8d9dffb640 1 -- 172.21.15.60:0/2192670635 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8da01e0530 msgr2=0x7f8da01ef2c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:23:39.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.382+0000 7f8d9dffb640 1 --2- 172.21.15.60:0/2192670635 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8da01e0530 0x7f8da01ef2c0 secure :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8d98000f60 tx=0x7f8d980057f0 comp rx=0 tx=0).stop 2024-09-12T02:23:39.383 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:23:39.384 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:23:39.384 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:23:39.384 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:23:39.384 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 8, 2024-09-12T02:23:39.384 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 64702, 2024-09-12T02:23:39.384 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:23:39.384 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:23:39.384 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:23:39.384 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:23:39.384 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:23:39.384 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 59, 2024-09-12T02:23:39.384 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:23:39.384 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:23:39.385 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:23:39.385 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:23:39.385 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:23:39.385 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:23:39.385 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:23:39.385 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:23:39.385 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:23:39.385 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:23:39.385 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:23:39.385 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:23:39.385 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:23:39.385 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:23:39.385 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:23:39.386 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:23:39.386 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:23:39.386 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:23:39.386 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:23:39.386 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:23:39.386 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:23:39.386 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:23:39.386 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:23:39.386 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:23:39.386 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:23:39.386 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:23:39.386 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:23:39.386 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:23:39.386 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:23:39.387 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:39.387 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:23:39.387 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:23:39.387 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:23:39.387 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:23:39.387 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:23:39.387 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:23:39.387 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:23:39.387 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:23:39.387 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:23:39.387 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:23:39.387 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:23:39.387 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:23:39.388 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:23:39.388 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:23:39.388 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:23:39.388 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:23:39.388 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:23:39.388 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:23:39.388 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:23:39.388 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:23:39.388 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:23:39.388 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:23:39.388 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:23:39.388 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:23:39.388 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:23:39.389 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:23:39.389 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:23:39.389 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:23:39.389 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:23:39.389 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:23:39.389 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:39.389 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:23:39.389 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:39.389 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:23:39.389 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:23:39.389 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:23:39.389 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:23:39.389 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:39.389 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:23:39.390 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:23:39.390 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:23:39.390 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:39.390 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:39.390 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:23:39.390 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:23:39.390 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:23:39.390 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:23:39.391 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:23:39.391 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:39.391 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:23:39.391 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:23:39.391 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:23:39.391 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:23:39.391 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:23:39.391 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:39.391 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:39.392 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:23:39.392 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:23:39.392 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:23:39.392 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:23:39.392 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:39.392 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:23:39.392 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:23:39.392 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:23:39.392 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:39.392 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:39.392 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:23:39.392 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:23:39.392 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:23:39.393 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:23:39.393 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:23:39.393 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:39.393 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:23:39.393 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:23:39.393 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:23:39.393 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:23:39.393 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:23:39.393 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:39.393 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:39.394 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:23:39.394 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:23:39.394 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:23:39.394 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:23:39.394 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:39.394 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:23:39.394 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:23:39.394 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:23:39.394 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:39.394 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:39.394 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:23:39.394 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:23:39.394 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:23:39.394 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:23:39.394 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:23:39.395 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:39.395 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:23:39.395 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:23:39.395 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:23:39.395 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:23:39.395 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:23:39.395 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:23:39.395 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:23:39.395 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:39.395 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:23:39.396 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:23:39.396 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:39.396 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:23:39.396 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:23:39.396 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:23:39.396 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:23:39.396 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:23:39.396 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:23:39.396 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:39.396 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:23:39.396 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:23:39.396 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:23:39.396 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:23:39.397 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:23:39.397 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:23:39.397 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:39.397 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:23:39.397 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:23:39.397 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:23:39.397 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:23:39.397 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:23:39.397 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:23:39.397 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:39.397 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:23:39.397 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:23:39.397 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:23:39.398 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:23:39.398 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:23:39.398 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:39.398 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:23:39.398 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:23:39.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.383+0000 7f8da7853640 1 -- 172.21.15.60:0/2192670635 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8d8c06be30 msgr2=0x7f8d8c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:39.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.383+0000 7f8da7853640 1 --2- 172.21.15.60:0/2192670635 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8d8c06be30 0x7f8d8c06e2f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8d90034000 tx=0x7f8d9002f000 comp rx=0 tx=0).stop 2024-09-12T02:23:39.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.383+0000 7f8da7853640 1 -- 172.21.15.60:0/2192670635 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8da0073ae0 msgr2=0x7f8da0154960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:39.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.383+0000 7f8da7853640 1 --2- 172.21.15.60:0/2192670635 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8da0073ae0 0x7f8da0154960 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8d9400c440 tx=0x7f8d9400c900 comp rx=0 tx=0).stop 2024-09-12T02:23:39.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.383+0000 7f8da5df0640 1 -- 172.21.15.60:0/2192670635 reap_dead start 2024-09-12T02:23:39.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.383+0000 7f8da5df0640 1 -- 172.21.15.60:0/2192670635 reap_dead start 2024-09-12T02:23:39.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.383+0000 7f8da7853640 1 -- 172.21.15.60:0/2192670635 shutdown_connections 2024-09-12T02:23:39.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.383+0000 7f8da7853640 1 -- 172.21.15.60:0/2192670635 >> 172.21.15.60:0/2192670635 conn(0x7f8da00c9d80 msgr2=0x7f8da00c4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:39.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.383+0000 7f8da7853640 1 -- 172.21.15.60:0/2192670635 shutdown_connections 2024-09-12T02:23:39.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.383+0000 7f8da7853640 1 -- 172.21.15.60:0/2192670635 wait complete. 2024-09-12T02:23:39.400 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:23:39.400 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-12T02:23:39.400 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-12T02:23:39.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.502+0000 7f72a08a4640 1 Processor -- start 2024-09-12T02:23:39.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.503+0000 7f72a08a4640 1 -- start start 2024-09-12T02:23:39.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.503+0000 7f72a08a4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f729c073ae0 0x7f729c153380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:39.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.503+0000 7f72a08a4640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f729c156f50 0x7f729c1538c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:39.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.503+0000 7f72a08a4640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f729c06dd50 con 0x7f729c0733d0 2024-09-12T02:23:39.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.503+0000 7f72a08a4640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f729c06e030 con 0x7f729c073ae0 2024-09-12T02:23:39.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.503+0000 7f72a08a4640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f729c06e310 con 0x7f729c156f50 2024-09-12T02:23:39.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.504+0000 7f729a59c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f729c073ae0 0x7f729c153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:39.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.504+0000 7f7299d9b640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f729c0733d0 0x7f729c156840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:43342/0 (socket says 172.21.15.60:43342) 2024-09-12T02:23:39.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.504+0000 7f7299d9b640 1 -- 172.21.15.60:0/2386434082 learned_addr learned my addr 172.21.15.60:0/2386434082 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:39.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.504+0000 7f729ad9d640 1 --2- 172.21.15.60:0/2386434082 >> v2:172.21.15.105:3300/0 conn(0x7f729c156f50 0x7f729c1538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:39.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.504+0000 7f729a59c640 1 -- 172.21.15.60:0/2386434082 >> v2:172.21.15.105:3300/0 conn(0x7f729c156f50 msgr2=0x7f729c1538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:39.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.504+0000 7f729a59c640 1 --2- 172.21.15.60:0/2386434082 >> v2:172.21.15.105:3300/0 conn(0x7f729c156f50 0x7f729c1538c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:39.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.504+0000 7f729a59c640 1 -- 172.21.15.60:0/2386434082 >> v1:172.21.15.60:6789/0 conn(0x7f729c0733d0 legacy=0x7f729c156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:39.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.504+0000 7f729a59c640 1 -- 172.21.15.60:0/2386434082 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f729c06e5f0 con 0x7f729c073ae0 2024-09-12T02:23:39.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.505+0000 7f729a59c640 1 --2- 172.21.15.60:0/2386434082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f729c073ae0 0x7f729c153380 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f729c0b0110 tx=0x7f728c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3bae0f595256d03 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:39.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.505+0000 7f729959a640 1 -- 172.21.15.60:0/2386434082 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f728c037070 con 0x7f729c073ae0 2024-09-12T02:23:39.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.505+0000 7f729959a640 1 -- 172.21.15.60:0/2386434082 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f728c032440 con 0x7f729c073ae0 2024-09-12T02:23:39.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.505+0000 7f729959a640 1 -- 172.21.15.60:0/2386434082 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f728c032810 con 0x7f729c073ae0 2024-09-12T02:23:39.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.505+0000 7f72a08a4640 1 -- 172.21.15.60:0/2386434082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f729c073ae0 msgr2=0x7f729c153380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:39.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.505+0000 7f72a08a4640 1 --2- 172.21.15.60:0/2386434082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f729c073ae0 0x7f729c153380 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f729c0b0110 tx=0x7f728c02a1a0 comp rx=0 tx=0).stop 2024-09-12T02:23:39.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.505+0000 7f72a08a4640 1 -- 172.21.15.60:0/2386434082 shutdown_connections 2024-09-12T02:23:39.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.505+0000 7f72a08a4640 1 --2- 172.21.15.60:0/2386434082 >> v2:172.21.15.105:3300/0 conn(0x7f729c156f50 0x7f729c1538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:39.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.505+0000 7f72a08a4640 1 --2- 172.21.15.60:0/2386434082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f729c073ae0 0x7f729c153380 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:39.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.505+0000 7f72a08a4640 1 -- 172.21.15.60:0/2386434082 >> 172.21.15.60:0/2386434082 conn(0x7f729c0c9d80 msgr2=0x7f729c0ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:39.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.506+0000 7f72a08a4640 1 -- 172.21.15.60:0/2386434082 shutdown_connections 2024-09-12T02:23:39.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.506+0000 7f72a08a4640 1 -- 172.21.15.60:0/2386434082 wait complete. 2024-09-12T02:23:39.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.507+0000 7f72a08a4640 1 Processor -- start 2024-09-12T02:23:39.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.507+0000 7f72a08a4640 1 -- start start 2024-09-12T02:23:39.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.507+0000 7f72a08a4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f729c0733d0 0x7f729c1518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:39.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.507+0000 7f72a08a4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f729c073ae0 0x7f729c1e32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:39.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.507+0000 7f72a08a4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f729c156f50 0x7f729c147470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:39.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.507+0000 7f72a08a4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f729c06edd0 con 0x7f729c0733d0 2024-09-12T02:23:39.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.507+0000 7f72a08a4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f729c06ec50 con 0x7f729c156f50 2024-09-12T02:23:39.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.507+0000 7f72a08a4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f729c073ec0 con 0x7f729c073ae0 2024-09-12T02:23:39.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.508+0000 7f729a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f729c0733d0 0x7f729c1518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:39.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.508+0000 7f729a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f729c0733d0 0x7f729c1518e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51804/0 (socket says 172.21.15.60:51804) 2024-09-12T02:23:39.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.508+0000 7f729a59c640 1 -- 172.21.15.60:0/2442936800 learned_addr learned my addr 172.21.15.60:0/2442936800 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:39.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.508+0000 7f729ad9d640 1 --2- 172.21.15.60:0/2442936800 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f729c156f50 0x7f729c147470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:39.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.508+0000 7f7299d9b640 1 --2- 172.21.15.60:0/2442936800 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f729c073ae0 0x7f729c1e32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:39.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.508+0000 7f729a59c640 1 -- 172.21.15.60:0/2442936800 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f729c073ae0 msgr2=0x7f729c1e32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:39.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.508+0000 7f729a59c640 1 --2- 172.21.15.60:0/2442936800 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f729c073ae0 0x7f729c1e32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:39.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.508+0000 7f729a59c640 1 -- 172.21.15.60:0/2442936800 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f729c156f50 msgr2=0x7f729c147470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:39.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.508+0000 7f729a59c640 1 --2- 172.21.15.60:0/2442936800 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f729c156f50 0x7f729c147470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:39.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.508+0000 7f729a59c640 1 -- 172.21.15.60:0/2442936800 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f729c1e2860 con 0x7f729c0733d0 2024-09-12T02:23:39.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.508+0000 7f729a59c640 1 --2- 172.21.15.60:0/2442936800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f729c0733d0 0x7f729c1518e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f728c009890 tx=0x7f728c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:39.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.508+0000 7f728affd640 1 -- 172.21.15.60:0/2442936800 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f728c037040 con 0x7f729c0733d0 2024-09-12T02:23:39.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.508+0000 7f728affd640 1 -- 172.21.15.60:0/2442936800 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f728c042070 con 0x7f729c0733d0 2024-09-12T02:23:39.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.508+0000 7f72a08a4640 1 -- 172.21.15.60:0/2442936800 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f729c1efef0 con 0x7f729c0733d0 2024-09-12T02:23:39.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.508+0000 7f728affd640 1 -- 172.21.15.60:0/2442936800 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f728c030bd0 con 0x7f729c0733d0 2024-09-12T02:23:39.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.508+0000 7f72a08a4640 1 -- 172.21.15.60:0/2442936800 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f729c146de0 con 0x7f729c0733d0 2024-09-12T02:23:39.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.509+0000 7f72a08a4640 1 --2- 172.21.15.60:0/2442936800 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f729c1e1da0 0x7f729c149e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:39.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.509+0000 7f72a08a4640 1 -- 172.21.15.60:0/2442936800 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f729c06d850 con 0x7f729c1e1da0 2024-09-12T02:23:39.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.509+0000 7f7299d9b640 1 --2- 172.21.15.60:0/2442936800 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f729c1e1da0 0x7f729c149e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:39.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.510+0000 7f7299d9b640 1 -- 172.21.15.60:0/2442936800 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f729c151500 con 0x7f729c1e1da0 2024-09-12T02:23:39.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.510+0000 7f728affd640 1 -- 172.21.15.60:0/2442936800 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f728c047460 con 0x7f729c0733d0 2024-09-12T02:23:39.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.510+0000 7f7299d9b640 1 --2- 172.21.15.60:0/2442936800 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f729c1e1da0 0x7f729c149e30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7290007fd0 tx=0x7f7290001920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:39.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.510+0000 7f728affd640 1 --2- 172.21.15.60:0/2442936800 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f727c06be30 0x7f727c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:39.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.510+0000 7f728affd640 1 -- 172.21.15.60:0/2442936800 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f728c0abbd0 con 0x7f729c0733d0 2024-09-12T02:23:39.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.510+0000 7f729ad9d640 1 --2- 172.21.15.60:0/2442936800 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f727c06be30 0x7f727c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:39.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.510+0000 7f728affd640 1 -- 172.21.15.60:0/2442936800 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7290011580 con 0x7f729c1e1da0 2024-09-12T02:23:39.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.510+0000 7f728affd640 1 -- 172.21.15.60:0/2442936800 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f7290011720 con 0x7f729c1e1da0 2024-09-12T02:23:39.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.510+0000 7f728affd640 1 -- 172.21.15.60:0/2442936800 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f729c1e1da0 msgr2=0x7f729c149e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:39.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.510+0000 7f728affd640 1 --2- 172.21.15.60:0/2442936800 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f729c1e1da0 0x7f729c149e30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7290007fd0 tx=0x7f7290001920 comp rx=0 tx=0).stop 2024-09-12T02:23:39.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.510+0000 7f728affd640 1 -- 172.21.15.60:0/2442936800 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f729c1e1da0 msgr2=0x7f729c149e30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:23:39.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.510+0000 7f728affd640 1 --2- 172.21.15.60:0/2442936800 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f729c1e1da0 0x7f729c149e30 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7290007fd0 tx=0x7f7290001920 comp rx=0 tx=0).stop 2024-09-12T02:23:39.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.511+0000 7f729ad9d640 1 --2- 172.21.15.60:0/2442936800 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f727c06be30 0x7f727c06e2f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f729c146530 tx=0x7f7294009780 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:39.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.517+0000 7f72a08a4640 1 --2- 172.21.15.60:0/2442936800 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f729c14a370 0x7f729c14a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:39.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.517+0000 7f72a08a4640 1 -- 172.21.15.60:0/2442936800 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f729c14acc0 con 0x7f729c14a370 2024-09-12T02:23:39.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.517+0000 7f7299d9b640 1 --2- 172.21.15.60:0/2442936800 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f729c14a370 0x7f729c14a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:39.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.517+0000 7f7299d9b640 1 -- 172.21.15.60:0/2442936800 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f729c150bc0 con 0x7f729c14a370 2024-09-12T02:23:39.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.517+0000 7f7299d9b640 1 --2- 172.21.15.60:0/2442936800 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f729c14a370 0x7f729c14a780 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7290016000 tx=0x7f7290000ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:39.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.517+0000 7f728affd640 1 -- 172.21.15.60:0/2442936800 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7290011e40 con 0x7f729c14a370 2024-09-12T02:23:39.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.518+0000 7f728affd640 1 -- 172.21.15.60:0/2442936800 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4882 (secure 0 0 0) 0x7f7290011e40 con 0x7f729c14a370 2024-09-12T02:23:39.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.518+0000 7f728affd640 1 -- 172.21.15.60:0/2442936800 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f729c14a370 msgr2=0x7f729c14a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:39.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.518+0000 7f728affd640 1 --2- 172.21.15.60:0/2442936800 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f729c14a370 0x7f729c14a780 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7290016000 tx=0x7f7290000ed0 comp rx=0 tx=0).stop 2024-09-12T02:23:39.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.518+0000 7f728affd640 1 -- 172.21.15.60:0/2442936800 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f729c14a370 msgr2=0x7f729c14a780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:23:39.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.518+0000 7f728affd640 1 --2- 172.21.15.60:0/2442936800 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f729c14a370 0x7f729c14a780 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:39.519 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:23:39.519 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:23:39.519 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:23:39.519 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:23:39.519 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 8, 2024-09-12T02:23:39.519 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 64832, 2024-09-12T02:23:39.519 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:23:39.520 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:23:39.520 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:23:39.520 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:23:39.520 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:23:39.520 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 59, 2024-09-12T02:23:39.520 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:23:39.520 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:23:39.520 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:23:39.521 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:23:39.521 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:23:39.521 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:23:39.521 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:23:39.521 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:23:39.521 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:23:39.521 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:23:39.521 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:23:39.521 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:23:39.521 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:23:39.521 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:23:39.521 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:23:39.521 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:23:39.521 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:23:39.521 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:23:39.522 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:23:39.522 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:23:39.522 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:23:39.522 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:23:39.522 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:23:39.522 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:23:39.522 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:23:39.522 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:23:39.522 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:23:39.522 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:23:39.522 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:23:39.522 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:39.522 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:23:39.523 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:23:39.523 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:23:39.523 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:23:39.523 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:23:39.523 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:23:39.523 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:23:39.523 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:23:39.523 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:23:39.523 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:23:39.523 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:23:39.523 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:23:39.523 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:23:39.523 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:23:39.524 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:23:39.524 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:23:39.524 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:23:39.524 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:23:39.524 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:23:39.524 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:23:39.524 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:23:39.524 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:23:39.524 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:23:39.524 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:23:39.524 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:23:39.524 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:23:39.524 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:23:39.525 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:23:39.525 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:23:39.525 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:23:39.525 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:39.525 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:23:39.525 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:39.525 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:23:39.525 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:23:39.525 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:23:39.525 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:23:39.525 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:39.525 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:23:39.525 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:23:39.525 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:23:39.526 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:39.526 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:39.526 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:23:39.526 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:23:39.526 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:23:39.526 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:23:39.526 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:23:39.526 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:39.526 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:23:39.526 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:23:39.526 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:23:39.526 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:23:39.526 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:23:39.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:39.527 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:39.527 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:23:39.527 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:23:39.527 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:23:39.527 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:23:39.527 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:39.527 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:23:39.527 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:23:39.527 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:23:39.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:39.527 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:39.527 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:23:39.528 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:23:39.528 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:23:39.528 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:23:39.528 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:23:39.528 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:39.528 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:23:39.528 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:23:39.528 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:23:39.528 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:23:39.528 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:23:39.528 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:39.528 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:39.529 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:23:39.529 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:23:39.529 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:23:39.529 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:23:39.529 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:39.529 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:23:39.529 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:23:39.529 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:23:39.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:39.529 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:39.529 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:23:39.529 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:23:39.529 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:23:39.529 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:23:39.530 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:23:39.530 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:39.530 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:23:39.530 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:23:39.530 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:23:39.530 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:23:39.530 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:23:39.530 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:23:39.530 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:23:39.530 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:39.530 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:23:39.530 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:23:39.530 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:39.530 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:23:39.531 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:23:39.531 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:23:39.531 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:23:39.531 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:23:39.531 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:23:39.531 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:39.531 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:23:39.531 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:23:39.531 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:23:39.531 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:23:39.531 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:23:39.531 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:23:39.531 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:39.531 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:23:39.532 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:23:39.532 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:23:39.532 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:23:39.532 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:23:39.532 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:23:39.532 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:39.532 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:23:39.532 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:23:39.532 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:23:39.532 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:23:39.532 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:23:39.532 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:39.532 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:23:39.533 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:23:39.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.518+0000 7f72a08a4640 1 -- 172.21.15.60:0/2442936800 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f727c06be30 msgr2=0x7f727c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:39.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.518+0000 7f72a08a4640 1 --2- 172.21.15.60:0/2442936800 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f727c06be30 0x7f727c06e2f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f729c146530 tx=0x7f7294009780 comp rx=0 tx=0).stop 2024-09-12T02:23:39.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.518+0000 7f72a08a4640 1 -- 172.21.15.60:0/2442936800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f729c0733d0 msgr2=0x7f729c1518e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:39.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.518+0000 7f72a08a4640 1 --2- 172.21.15.60:0/2442936800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f729c0733d0 0x7f729c1518e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f728c009890 tx=0x7f728c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:23:39.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.518+0000 7f729ad9d640 1 -- 172.21.15.60:0/2442936800 reap_dead start 2024-09-12T02:23:39.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.518+0000 7f72a08a4640 1 -- 172.21.15.60:0/2442936800 shutdown_connections 2024-09-12T02:23:39.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.518+0000 7f72a08a4640 1 --2- 172.21.15.60:0/2442936800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f729c0733d0 0x7f729c1518e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:39.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.518+0000 7f72a08a4640 1 -- 172.21.15.60:0/2442936800 >> 172.21.15.60:0/2442936800 conn(0x7f729c0c9d80 msgr2=0x7f729c070590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:39.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.518+0000 7f72a08a4640 1 -- 172.21.15.60:0/2442936800 shutdown_connections 2024-09-12T02:23:39.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.518+0000 7f72a08a4640 1 -- 172.21.15.60:0/2442936800 wait complete. 2024-09-12T02:23:39.535 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:23:39.535 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-09-12T02:23:39.536 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-12T02:23:39.536 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-09-12T02:23:39.536 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-09-12T02:23:39.536 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T02:23:39.536 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:23:39.547 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T02:23:39.547 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-12T02:23:39.547 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:23:39.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.648+0000 7f0e7ec53640 1 Processor -- start 2024-09-12T02:23:39.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.648+0000 7f0e7ec53640 1 -- start start 2024-09-12T02:23:39.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.649+0000 7f0e7ec53640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e78157be0 0x7f0e78155430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:39.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.649+0000 7f0e7ec53640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e78070480 con 0x7f0e780afc20 2024-09-12T02:23:39.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.649+0000 7f0e7ec53640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e78158190 con 0x7f0e780af5c0 2024-09-12T02:23:39.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.649+0000 7f0e7ec53640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0e78158470 con 0x7f0e78157be0 2024-09-12T02:23:39.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.649+0000 7f0e7c9ef640 1 -- >> v1:172.21.15.105:6789/0 conn(0x7f0e780af5c0 legacy=0x7f0e78070f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.105:6789/0 2024-09-12T02:23:39.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.649+0000 7f0e77fff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f0e780afc20 0x7f0e781574d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:43352/0 (socket says 172.21.15.60:43352) 2024-09-12T02:23:39.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.649+0000 7f0e77fff640 1 -- 172.21.15.60:0/1138179761 learned_addr learned my addr 172.21.15.60:0/1138179761 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:39.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.649+0000 7f0e7d1f0640 1 --2- 172.21.15.60:0/1138179761 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e78157be0 0x7f0e78155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:39.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.649+0000 7f0e777fe640 1 -- 172.21.15.60:0/1138179761 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3788273676 0 0) 0x7f0e78070480 con 0x7f0e780afc20 2024-09-12T02:23:39.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.650+0000 7f0e777fe640 1 -- 172.21.15.60:0/1138179761 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e68003520 con 0x7f0e780afc20 2024-09-12T02:23:39.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.650+0000 7f0e7d1f0640 1 -- 172.21.15.60:0/1138179761 >> v1:172.21.15.105:6789/0 conn(0x7f0e780af5c0 legacy=0x7f0e78070f20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:23:39.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.650+0000 7f0e7d1f0640 1 -- 172.21.15.60:0/1138179761 >> v1:172.21.15.60:6789/0 conn(0x7f0e780afc20 legacy=0x7f0e781574d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:39.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.650+0000 7f0e7d1f0640 1 -- 172.21.15.60:0/1138179761 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e78070720 con 0x7f0e78157be0 2024-09-12T02:23:39.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.650+0000 7f0e7d1f0640 1 --2- 172.21.15.60:0/1138179761 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e78157be0 0x7f0e78155430 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0e70009dc0 tx=0x7f0e7002a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7fef2afa5e500cd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:39.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.651+0000 7f0e777fe640 1 -- 172.21.15.60:0/1138179761 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e70007740 con 0x7f0e78157be0 2024-09-12T02:23:39.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.651+0000 7f0e777fe640 1 -- 172.21.15.60:0/1138179761 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e700078e0 con 0x7f0e78157be0 2024-09-12T02:23:39.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.651+0000 7f0e777fe640 1 -- 172.21.15.60:0/1138179761 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e70007cb0 con 0x7f0e78157be0 2024-09-12T02:23:39.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.651+0000 7f0e7ec53640 1 -- 172.21.15.60:0/1138179761 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e78157be0 msgr2=0x7f0e78155430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:39.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.651+0000 7f0e7ec53640 1 --2- 172.21.15.60:0/1138179761 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e78157be0 0x7f0e78155430 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0e70009dc0 tx=0x7f0e7002a5f0 comp rx=0 tx=0).stop 2024-09-12T02:23:39.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.651+0000 7f0e7ec53640 1 -- 172.21.15.60:0/1138179761 shutdown_connections 2024-09-12T02:23:39.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.651+0000 7f0e7ec53640 1 --2- 172.21.15.60:0/1138179761 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e78157be0 0x7f0e78155430 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:39.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.651+0000 7f0e7ec53640 1 -- 172.21.15.60:0/1138179761 >> 172.21.15.60:0/1138179761 conn(0x7f0e780c6880 msgr2=0x7f0e780c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:39.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.651+0000 7f0e7ec53640 1 -- 172.21.15.60:0/1138179761 shutdown_connections 2024-09-12T02:23:39.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.651+0000 7f0e7ec53640 1 -- 172.21.15.60:0/1138179761 wait complete. 2024-09-12T02:23:39.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.652+0000 7f0e7ec53640 1 Processor -- start 2024-09-12T02:23:39.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.652+0000 7f0e7ec53640 1 -- start start 2024-09-12T02:23:39.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.653+0000 7f0e7ec53640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e780af5c0 0x7f0e780ad630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:39.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.653+0000 7f0e7ec53640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e780afc20 0x7f0e780c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:39.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.653+0000 7f0e7ec53640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e78157be0 0x7f0e781eba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:39.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.653+0000 7f0e7ec53640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0e780c7690 con 0x7f0e780afc20 2024-09-12T02:23:39.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.653+0000 7f0e7ec53640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0e78070a90 con 0x7f0e780af5c0 2024-09-12T02:23:39.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.653+0000 7f0e7ec53640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0e78073ca0 con 0x7f0e78157be0 2024-09-12T02:23:39.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.653+0000 7f0e7c9ef640 1 -- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e780af5c0 msgr2=0x7f0e780ad630 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3300/0 2024-09-12T02:23:39.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.653+0000 7f0e7c9ef640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e780af5c0 0x7f0e780ad630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:23:39.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.653+0000 7f0e77fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e780afc20 0x7f0e780c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:39.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.653+0000 7f0e77fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e780afc20 0x7f0e780c34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51812/0 (socket says 172.21.15.60:51812) 2024-09-12T02:23:39.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.653+0000 7f0e77fff640 1 -- 172.21.15.60:0/484951231 learned_addr learned my addr 172.21.15.60:0/484951231 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:39.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.654+0000 7f0e7d1f0640 1 --2- 172.21.15.60:0/484951231 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e78157be0 0x7f0e781eba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:39.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.654+0000 7f0e77fff640 1 -- 172.21.15.60:0/484951231 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e78157be0 msgr2=0x7f0e781eba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:39.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.654+0000 7f0e77fff640 1 --2- 172.21.15.60:0/484951231 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e78157be0 0x7f0e781eba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:39.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.654+0000 7f0e77fff640 1 -- 172.21.15.60:0/484951231 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e780af5c0 msgr2=0x7f0e780ad630 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:23:39.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.654+0000 7f0e77fff640 1 --2- 172.21.15.60:0/484951231 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e780af5c0 0x7f0e780ad630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:39.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.654+0000 7f0e77fff640 1 -- 172.21.15.60:0/484951231 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e780ae980 con 0x7f0e780afc20 2024-09-12T02:23:39.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.654+0000 7f0e77fff640 1 --2- 172.21.15.60:0/484951231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e780afc20 0x7f0e780c34b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0e6400c430 tx=0x7f0e6400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:39.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.654+0000 7f0e757fa640 1 -- 172.21.15.60:0/484951231 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e64017070 con 0x7f0e780afc20 2024-09-12T02:23:39.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.654+0000 7f0e757fa640 1 -- 172.21.15.60:0/484951231 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e64005ce0 con 0x7f0e780afc20 2024-09-12T02:23:39.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.654+0000 7f0e7ec53640 1 -- 172.21.15.60:0/484951231 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e781efbd0 con 0x7f0e780afc20 2024-09-12T02:23:39.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.654+0000 7f0e757fa640 1 -- 172.21.15.60:0/484951231 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e640072f0 con 0x7f0e780afc20 2024-09-12T02:23:39.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.654+0000 7f0e7ec53640 1 -- 172.21.15.60:0/484951231 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e780c6310 con 0x7f0e780afc20 2024-09-12T02:23:39.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.655+0000 7f0e7ec53640 1 -- 172.21.15.60:0/484951231 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e78155430 con 0x7f0e780afc20 2024-09-12T02:23:39.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.656+0000 7f0e757fa640 1 -- 172.21.15.60:0/484951231 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0e6401a070 con 0x7f0e780afc20 2024-09-12T02:23:39.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.656+0000 7f0e757fa640 1 --2- 172.21.15.60:0/484951231 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0e5c06bde0 0x7f0e5c06e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:39.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.656+0000 7f0e757fa640 1 -- 172.21.15.60:0/484951231 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f0e6408a580 con 0x7f0e780afc20 2024-09-12T02:23:39.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.656+0000 7f0e7c9ef640 1 --2- 172.21.15.60:0/484951231 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0e5c06bde0 0x7f0e5c06e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:39.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.657+0000 7f0e7c9ef640 1 --2- 172.21.15.60:0/484951231 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0e5c06bde0 0x7f0e5c06e2a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c006fd0 tx=0x7f0e6c006d80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:39.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.660+0000 7f0e757fa640 1 -- 172.21.15.60:0/484951231 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0e64058c90 con 0x7f0e780afc20 2024-09-12T02:23:39.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.904+0000 7f0e7ec53640 1 -- 172.21.15.60:0/484951231 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f0e7806f120 con 0x7f0e780afc20 2024-09-12T02:23:39.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.904+0000 7f0e757fa640 1 -- 172.21.15.60:0/484951231 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7f0e64058590 con 0x7f0e780afc20 2024-09-12T02:23:39.905 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":60,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:23:39.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.906+0000 7f0e7ec53640 1 -- 172.21.15.60:0/484951231 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0e5c06bde0 msgr2=0x7f0e5c06e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:39.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.906+0000 7f0e7ec53640 1 --2- 172.21.15.60:0/484951231 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0e5c06bde0 0x7f0e5c06e2a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c006fd0 tx=0x7f0e6c006d80 comp rx=0 tx=0).stop 2024-09-12T02:23:39.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.906+0000 7f0e7ec53640 1 -- 172.21.15.60:0/484951231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e780afc20 msgr2=0x7f0e780c34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:39.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.906+0000 7f0e7ec53640 1 --2- 172.21.15.60:0/484951231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e780afc20 0x7f0e780c34b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0e6400c430 tx=0x7f0e6400c8f0 comp rx=0 tx=0).stop 2024-09-12T02:23:39.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.906+0000 7f0e7ec53640 1 -- 172.21.15.60:0/484951231 shutdown_connections 2024-09-12T02:23:39.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.906+0000 7f0e7ec53640 1 --2- 172.21.15.60:0/484951231 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0e5c06bde0 0x7f0e5c06e2a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:39.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.906+0000 7f0e7ec53640 1 --2- 172.21.15.60:0/484951231 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e78157be0 0x7f0e781eba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:39.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.906+0000 7f0e7ec53640 1 --2- 172.21.15.60:0/484951231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e780afc20 0x7f0e780c34b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:39.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.906+0000 7f0e7ec53640 1 --2- 172.21.15.60:0/484951231 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e780af5c0 0x7f0e780ad630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:39.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.906+0000 7f0e7ec53640 1 -- 172.21.15.60:0/484951231 >> 172.21.15.60:0/484951231 conn(0x7f0e780c6880 msgr2=0x7f0e78072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:39.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.907+0000 7f0e7ec53640 1 -- 172.21.15.60:0/484951231 shutdown_connections 2024-09-12T02:23:39.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:39.907+0000 7f0e7ec53640 1 -- 172.21.15.60:0/484951231 wait complete. 2024-09-12T02:23:42.919 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:23:43.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.030+0000 7f4d2b3a8640 1 Processor -- start 2024-09-12T02:23:43.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.030+0000 7f4d2b3a8640 1 -- start start 2024-09-12T02:23:43.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.031+0000 7f4d2b3a8640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4d240709d0 0x7f4d24161c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:43.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.031+0000 7f4d2b3a8640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d240c4320 con 0x7f4d24153d60 2024-09-12T02:23:43.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.031+0000 7f4d2b3a8640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d24156f20 con 0x7f4d240c5830 2024-09-12T02:23:43.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.031+0000 7f4d2b3a8640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f4d240c4c90 con 0x7f4d240709d0 2024-09-12T02:23:43.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.031+0000 7f4d29945640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4d240709d0 0x7f4d24161c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:43.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.031+0000 7f4d29945640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4d240709d0 0x7f4d24161c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51826/0 (socket says 172.21.15.60:51826) 2024-09-12T02:23:43.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.031+0000 7f4d29945640 1 -- 172.21.15.60:0/2361049565 learned_addr learned my addr 172.21.15.60:0/2361049565 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:43.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.031+0000 7f4d29144640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f4d24153d60 0x7f4d240c5120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:43366/0 (socket says 172.21.15.60:43366) 2024-09-12T02:23:43.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.031+0000 7f4d28943640 1 -- 172.21.15.60:0/2361049565 >> v1:172.21.15.105:6789/0 conn(0x7f4d240c5830 legacy=0x7f4d240702c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.105:6789/0 2024-09-12T02:23:43.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.032+0000 7f4d29945640 1 -- 172.21.15.60:0/2361049565 >> v1:172.21.15.105:6789/0 conn(0x7f4d240c5830 legacy=0x7f4d240702c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:23:43.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.032+0000 7f4d29945640 1 -- 172.21.15.60:0/2361049565 >> v1:172.21.15.60:6789/0 conn(0x7f4d24153d60 legacy=0x7f4d240c5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:43.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.032+0000 7f4d29945640 1 -- 172.21.15.60:0/2361049565 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d24157200 con 0x7f4d240709d0 2024-09-12T02:23:43.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.032+0000 7f4d1bfff640 1 -- 172.21.15.60:0/2361049565 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 949472258 0 0) 0x7f4d20001110 con 0x7f4d24153d60 2024-09-12T02:23:43.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.033+0000 7f4d29945640 1 --2- 172.21.15.60:0/2361049565 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d240709d0 0x7f4d24161c90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c009e50 tx=0x7f4d1c02a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8089d687b0db9da server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:43.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.033+0000 7f4d1bfff640 1 -- 172.21.15.60:0/2361049565 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c036070 con 0x7f4d240709d0 2024-09-12T02:23:43.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.033+0000 7f4d1bfff640 1 -- 172.21.15.60:0/2361049565 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d1c031600 con 0x7f4d240709d0 2024-09-12T02:23:43.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.033+0000 7f4d1bfff640 1 -- 172.21.15.60:0/2361049565 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c0319d0 con 0x7f4d240709d0 2024-09-12T02:23:43.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.033+0000 7f4d2b3a8640 1 -- 172.21.15.60:0/2361049565 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d240709d0 msgr2=0x7f4d24161c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:43.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.033+0000 7f4d2b3a8640 1 --2- 172.21.15.60:0/2361049565 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d240709d0 0x7f4d24161c90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c009e50 tx=0x7f4d1c02a760 comp rx=0 tx=0).stop 2024-09-12T02:23:43.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.033+0000 7f4d2b3a8640 1 -- 172.21.15.60:0/2361049565 shutdown_connections 2024-09-12T02:23:43.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.033+0000 7f4d2b3a8640 1 --2- 172.21.15.60:0/2361049565 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d240709d0 0x7f4d24161c90 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:43.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.033+0000 7f4d2b3a8640 1 -- 172.21.15.60:0/2361049565 >> 172.21.15.60:0/2361049565 conn(0x7f4d240c6980 msgr2=0x7f4d240c6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:43.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.033+0000 7f4d2b3a8640 1 -- 172.21.15.60:0/2361049565 shutdown_connections 2024-09-12T02:23:43.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.033+0000 7f4d2b3a8640 1 -- 172.21.15.60:0/2361049565 wait complete. 2024-09-12T02:23:43.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.035+0000 7f4d2b3a8640 1 Processor -- start 2024-09-12T02:23:43.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.035+0000 7f4d2b3a8640 1 -- start start 2024-09-12T02:23:43.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.035+0000 7f4d2b3a8640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4d240709d0 0x7f4d24150000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:43.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.035+0000 7f4d2b3a8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d240c5830 0x7f4d2414b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:43.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.035+0000 7f4d2b3a8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d24153d60 0x7f4d2414bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:43.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.035+0000 7f4d2b3a8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4d24073e20 con 0x7f4d240c5830 2024-09-12T02:23:43.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.035+0000 7f4d2b3a8640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4d24073ca0 con 0x7f4d24153d60 2024-09-12T02:23:43.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.035+0000 7f4d2b3a8640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4d240c7690 con 0x7f4d240709d0 2024-09-12T02:23:43.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.035+0000 7f4d28943640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d240c5830 0x7f4d2414b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:43.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.035+0000 7f4d28943640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d240c5830 0x7f4d2414b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51828/0 (socket says 172.21.15.60:51828) 2024-09-12T02:23:43.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.035+0000 7f4d28943640 1 -- 172.21.15.60:0/2176371775 learned_addr learned my addr 172.21.15.60:0/2176371775 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:43.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.035+0000 7f4d29945640 1 -- 172.21.15.60:0/2176371775 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d24153d60 msgr2=0x7f4d2414bd10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3300/0 2024-09-12T02:23:43.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.035+0000 7f4d29945640 1 --2- 172.21.15.60:0/2176371775 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d24153d60 0x7f4d2414bd10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:23:43.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.036+0000 7f4d29144640 1 --2- 172.21.15.60:0/2176371775 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4d240709d0 0x7f4d24150000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:43.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.036+0000 7f4d28943640 1 -- 172.21.15.60:0/2176371775 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4d240709d0 msgr2=0x7f4d24150000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:43.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.036+0000 7f4d28943640 1 --2- 172.21.15.60:0/2176371775 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4d240709d0 0x7f4d24150000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:43.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.036+0000 7f4d28943640 1 -- 172.21.15.60:0/2176371775 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d24153d60 msgr2=0x7f4d2414bd10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:23:43.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.036+0000 7f4d28943640 1 --2- 172.21.15.60:0/2176371775 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d24153d60 0x7f4d2414bd10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:43.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.036+0000 7f4d28943640 1 -- 172.21.15.60:0/2176371775 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d2414c250 con 0x7f4d240c5830 2024-09-12T02:23:43.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.036+0000 7f4d28943640 1 --2- 172.21.15.60:0/2176371775 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d240c5830 0x7f4d2414b7d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4d1400b550 tx=0x7f4d1400ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:43.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.036+0000 7f4d19ffb640 1 -- 172.21.15.60:0/2176371775 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d14003d70 con 0x7f4d240c5830 2024-09-12T02:23:43.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.036+0000 7f4d19ffb640 1 -- 172.21.15.60:0/2176371775 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d14015070 con 0x7f4d240c5830 2024-09-12T02:23:43.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.036+0000 7f4d2b3a8640 1 -- 172.21.15.60:0/2176371775 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d2414cca0 con 0x7f4d240c5830 2024-09-12T02:23:43.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.036+0000 7f4d19ffb640 1 -- 172.21.15.60:0/2176371775 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d140052b0 con 0x7f4d240c5830 2024-09-12T02:23:43.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.036+0000 7f4d2b3a8640 1 -- 172.21.15.60:0/2176371775 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d241ecd20 con 0x7f4d240c5830 2024-09-12T02:23:43.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.037+0000 7f4d2b3a8640 1 -- 172.21.15.60:0/2176371775 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d2406ed10 con 0x7f4d240c5830 2024-09-12T02:23:43.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.038+0000 7f4d19ffb640 1 -- 172.21.15.60:0/2176371775 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4d14005450 con 0x7f4d240c5830 2024-09-12T02:23:43.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.038+0000 7f4d19ffb640 1 --2- 172.21.15.60:0/2176371775 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4d0806bde0 0x7f4d0806e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:43.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.038+0000 7f4d19ffb640 1 -- 172.21.15.60:0/2176371775 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f4d1408af50 con 0x7f4d240c5830 2024-09-12T02:23:43.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.038+0000 7f4d29144640 1 --2- 172.21.15.60:0/2176371775 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4d0806bde0 0x7f4d0806e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:43.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.039+0000 7f4d29144640 1 --2- 172.21.15.60:0/2176371775 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4d0806bde0 0x7f4d0806e2a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4d20000f60 tx=0x7f4d20009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:43.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.043+0000 7f4d19ffb640 1 -- 172.21.15.60:0/2176371775 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4d14059640 con 0x7f4d240c5830 2024-09-12T02:23:43.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.284+0000 7f4d2b3a8640 1 -- 172.21.15.60:0/2176371775 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f4d240c6370 con 0x7f4d240c5830 2024-09-12T02:23:43.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.284+0000 7f4d19ffb640 1 -- 172.21.15.60:0/2176371775 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7f4d14058f40 con 0x7f4d240c5830 2024-09-12T02:23:43.285 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":63,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:23:43.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.286+0000 7f4d2b3a8640 1 -- 172.21.15.60:0/2176371775 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4d0806bde0 msgr2=0x7f4d0806e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:43.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.286+0000 7f4d2b3a8640 1 --2- 172.21.15.60:0/2176371775 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4d0806bde0 0x7f4d0806e2a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4d20000f60 tx=0x7f4d20009040 comp rx=0 tx=0).stop 2024-09-12T02:23:43.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.286+0000 7f4d2b3a8640 1 -- 172.21.15.60:0/2176371775 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d240c5830 msgr2=0x7f4d2414b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:43.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.286+0000 7f4d2b3a8640 1 --2- 172.21.15.60:0/2176371775 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d240c5830 0x7f4d2414b7d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4d1400b550 tx=0x7f4d1400ba10 comp rx=0 tx=0).stop 2024-09-12T02:23:43.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.286+0000 7f4d2b3a8640 1 -- 172.21.15.60:0/2176371775 shutdown_connections 2024-09-12T02:23:43.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.286+0000 7f4d2b3a8640 1 --2- 172.21.15.60:0/2176371775 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4d0806bde0 0x7f4d0806e2a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:43.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.286+0000 7f4d2b3a8640 1 --2- 172.21.15.60:0/2176371775 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d24153d60 0x7f4d2414bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:43.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.286+0000 7f4d2b3a8640 1 --2- 172.21.15.60:0/2176371775 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d240c5830 0x7f4d2414b7d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:43.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.286+0000 7f4d2b3a8640 1 --2- 172.21.15.60:0/2176371775 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4d240709d0 0x7f4d24150000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:43.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.286+0000 7f4d2b3a8640 1 -- 172.21.15.60:0/2176371775 >> 172.21.15.60:0/2176371775 conn(0x7f4d240c6980 msgr2=0x7f4d2414d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:43.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.286+0000 7f4d2b3a8640 1 -- 172.21.15.60:0/2176371775 shutdown_connections 2024-09-12T02:23:43.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:43.287+0000 7f4d2b3a8640 1 -- 172.21.15.60:0/2176371775 wait complete. 2024-09-12T02:23:46.299 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:23:46.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.414+0000 7fb61cf42640 1 Processor -- start 2024-09-12T02:23:46.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.414+0000 7fb61cf42640 1 -- start start 2024-09-12T02:23:46.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.415+0000 7fb61cf42640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb6181505f0 0x7fb618153910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:46.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.415+0000 7fb61cf42640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb6180c42b0 0x7fb6180c4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:46.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.415+0000 7fb61cf42640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6180c5940 con 0x7fb6180c69c0 2024-09-12T02:23:46.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.415+0000 7fb61cf42640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fb6180c7860 con 0x7fb6180c42b0 2024-09-12T02:23:46.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.415+0000 7fb61cf42640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fb6180c5c00 con 0x7fb6181505f0 2024-09-12T02:23:46.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.415+0000 7fb616d9d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb6180c42b0 0x7fb6180c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:46.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.415+0000 7fb60ffff640 1 -- >> v1:172.21.15.105:6789/0 conn(0x7fb6180c69c0 legacy=0x7fb6180c2440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.105:6789/0 2024-09-12T02:23:46.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.415+0000 7fb61659c640 1 -- >> v2:172.21.15.105:3300/0 conn(0x7fb6181505f0 msgr2=0x7fb618153910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3300/0 2024-09-12T02:23:46.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.415+0000 7fb616d9d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb6180c42b0 0x7fb6180c4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51838/0 (socket says 172.21.15.60:51838) 2024-09-12T02:23:46.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.415+0000 7fb61659c640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb6181505f0 0x7fb618153910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:23:46.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.415+0000 7fb616d9d640 1 -- 172.21.15.60:0/256404800 learned_addr learned my addr 172.21.15.60:0/256404800 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:46.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.415+0000 7fb616d9d640 1 -- 172.21.15.60:0/256404800 >> v2:172.21.15.105:3300/0 conn(0x7fb6181505f0 msgr2=0x7fb618153910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:23:46.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.415+0000 7fb616d9d640 1 --2- 172.21.15.60:0/256404800 >> v2:172.21.15.105:3300/0 conn(0x7fb6181505f0 0x7fb618153910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:46.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.415+0000 7fb616d9d640 1 -- 172.21.15.60:0/256404800 >> v1:172.21.15.105:6789/0 conn(0x7fb6180c69c0 legacy=0x7fb6180c2440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:23:46.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.415+0000 7fb616d9d640 1 -- 172.21.15.60:0/256404800 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6180c5ee0 con 0x7fb6180c42b0 2024-09-12T02:23:46.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.416+0000 7fb616d9d640 1 --2- 172.21.15.60:0/256404800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6180c42b0 0x7fb6180c4700 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb6180702a0 tx=0x7fb61002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=515d0eca237b0bb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:46.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.416+0000 7fb615d9b640 1 -- 172.21.15.60:0/256404800 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb610036070 con 0x7fb6180c42b0 2024-09-12T02:23:46.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.416+0000 7fb615d9b640 1 -- 172.21.15.60:0/256404800 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb610031600 con 0x7fb6180c42b0 2024-09-12T02:23:46.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.416+0000 7fb615d9b640 1 -- 172.21.15.60:0/256404800 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb61002ae60 con 0x7fb6180c42b0 2024-09-12T02:23:46.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.417+0000 7fb61cf42640 1 -- 172.21.15.60:0/256404800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6180c42b0 msgr2=0x7fb6180c4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:46.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.417+0000 7fb61cf42640 1 --2- 172.21.15.60:0/256404800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6180c42b0 0x7fb6180c4700 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb6180702a0 tx=0x7fb61002a680 comp rx=0 tx=0).stop 2024-09-12T02:23:46.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.417+0000 7fb61cf42640 1 -- 172.21.15.60:0/256404800 shutdown_connections 2024-09-12T02:23:46.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.417+0000 7fb61cf42640 1 --2- 172.21.15.60:0/256404800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6180c42b0 0x7fb6180c4700 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:46.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.417+0000 7fb61cf42640 1 --2- 172.21.15.60:0/256404800 >> v2:172.21.15.105:3300/0 conn(0x7fb6181505f0 0x7fb618153910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:46.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.417+0000 7fb61cf42640 1 -- 172.21.15.60:0/256404800 >> 172.21.15.60:0/256404800 conn(0x7fb6180c7a40 msgr2=0x7fb6180c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:46.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.417+0000 7fb61cf42640 1 -- 172.21.15.60:0/256404800 shutdown_connections 2024-09-12T02:23:46.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.417+0000 7fb61cf42640 1 -- 172.21.15.60:0/256404800 wait complete. 2024-09-12T02:23:46.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.418+0000 7fb61cf42640 1 Processor -- start 2024-09-12T02:23:46.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.418+0000 7fb61cf42640 1 -- start start 2024-09-12T02:23:46.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.419+0000 7fb61cf42640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb6180c42b0 0x7fb6181549b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:46.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.419+0000 7fb61cf42640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6181505f0 0x7fb6181ec180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:46.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.419+0000 7fb61cf42640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb6181ec6c0 0x7fb618155770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:46.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.419+0000 7fb61cf42640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb6181509d0 con 0x7fb6181505f0 2024-09-12T02:23:46.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.419+0000 7fb61cf42640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb6180c64a0 con 0x7fb6180c42b0 2024-09-12T02:23:46.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.419+0000 7fb61cf42640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb618150b50 con 0x7fb6181ec6c0 2024-09-12T02:23:46.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.419+0000 7fb60ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6181505f0 0x7fb6181ec180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:46.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.419+0000 7fb60ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6181505f0 0x7fb6181ec180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51840/0 (socket says 172.21.15.60:51840) 2024-09-12T02:23:46.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.419+0000 7fb60ffff640 1 -- 172.21.15.60:0/3733027624 learned_addr learned my addr 172.21.15.60:0/3733027624 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:46.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.419+0000 7fb61659c640 1 -- 172.21.15.60:0/3733027624 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb6180c42b0 msgr2=0x7fb6181549b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3300/0 2024-09-12T02:23:46.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.419+0000 7fb61659c640 1 --2- 172.21.15.60:0/3733027624 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb6180c42b0 0x7fb6181549b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:23:46.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.419+0000 7fb616d9d640 1 --2- 172.21.15.60:0/3733027624 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb6181ec6c0 0x7fb618155770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:46.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.419+0000 7fb60ffff640 1 -- 172.21.15.60:0/3733027624 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb6181ec6c0 msgr2=0x7fb618155770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:46.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.419+0000 7fb60ffff640 1 --2- 172.21.15.60:0/3733027624 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb6181ec6c0 0x7fb618155770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:46.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.419+0000 7fb60ffff640 1 -- 172.21.15.60:0/3733027624 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb6180c42b0 msgr2=0x7fb6181549b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:23:46.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.419+0000 7fb60ffff640 1 --2- 172.21.15.60:0/3733027624 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb6180c42b0 0x7fb6181549b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:46.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.419+0000 7fb60ffff640 1 -- 172.21.15.60:0/3733027624 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6181575c0 con 0x7fb6181505f0 2024-09-12T02:23:46.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.420+0000 7fb60ffff640 1 --2- 172.21.15.60:0/3733027624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6181505f0 0x7fb6181ec180 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb60000d970 tx=0x7fb60000de30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:46.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.420+0000 7fb60effd640 1 -- 172.21.15.60:0/3733027624 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb60000ede0 con 0x7fb6181505f0 2024-09-12T02:23:46.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.420+0000 7fb60effd640 1 -- 172.21.15.60:0/3733027624 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb600012070 con 0x7fb6181505f0 2024-09-12T02:23:46.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.420+0000 7fb61cf42640 1 -- 172.21.15.60:0/3733027624 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb61814bcd0 con 0x7fb6181505f0 2024-09-12T02:23:46.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.420+0000 7fb60effd640 1 -- 172.21.15.60:0/3733027624 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb600003ba0 con 0x7fb6181505f0 2024-09-12T02:23:46.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.420+0000 7fb61cf42640 1 -- 172.21.15.60:0/3733027624 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6181ebc60 con 0x7fb6181505f0 2024-09-12T02:23:46.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.421+0000 7fb61cf42640 1 -- 172.21.15.60:0/3733027624 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6181ecad0 con 0x7fb6181505f0 2024-09-12T02:23:46.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.421+0000 7fb60effd640 1 -- 172.21.15.60:0/3733027624 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb600005070 con 0x7fb6181505f0 2024-09-12T02:23:46.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.422+0000 7fb60effd640 1 --2- 172.21.15.60:0/3733027624 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb5f806bde0 0x7fb5f806e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:46.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.422+0000 7fb60effd640 1 -- 172.21.15.60:0/3733027624 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7fb60008d1f0 con 0x7fb6181505f0 2024-09-12T02:23:46.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.422+0000 7fb61659c640 1 --2- 172.21.15.60:0/3733027624 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb5f806bde0 0x7fb5f806e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:46.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.423+0000 7fb61659c640 1 --2- 172.21.15.60:0/3733027624 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb5f806bde0 0x7fb5f806e2a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb6080038b0 tx=0x7fb608006d30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:46.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.427+0000 7fb60effd640 1 -- 172.21.15.60:0/3733027624 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb6181ecad0 con 0x7fb6181505f0 2024-09-12T02:23:46.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.671+0000 7fb61cf42640 1 -- 172.21.15.60:0/3733027624 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb6181ebe30 con 0x7fb6181505f0 2024-09-12T02:23:46.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.671+0000 7fb60effd640 1 -- 172.21.15.60:0/3733027624 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7fb60005b900 con 0x7fb6181505f0 2024-09-12T02:23:46.672 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":66,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:23:46.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.673+0000 7fb61cf42640 1 -- 172.21.15.60:0/3733027624 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb5f806bde0 msgr2=0x7fb5f806e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:46.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.673+0000 7fb61cf42640 1 --2- 172.21.15.60:0/3733027624 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb5f806bde0 0x7fb5f806e2a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb6080038b0 tx=0x7fb608006d30 comp rx=0 tx=0).stop 2024-09-12T02:23:46.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.673+0000 7fb61cf42640 1 -- 172.21.15.60:0/3733027624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6181505f0 msgr2=0x7fb6181ec180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:46.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.673+0000 7fb61cf42640 1 --2- 172.21.15.60:0/3733027624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6181505f0 0x7fb6181ec180 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb60000d970 tx=0x7fb60000de30 comp rx=0 tx=0).stop 2024-09-12T02:23:46.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.673+0000 7fb61cf42640 1 -- 172.21.15.60:0/3733027624 shutdown_connections 2024-09-12T02:23:46.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.673+0000 7fb61cf42640 1 --2- 172.21.15.60:0/3733027624 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb5f806bde0 0x7fb5f806e2a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:46.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.673+0000 7fb61cf42640 1 --2- 172.21.15.60:0/3733027624 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb6181ec6c0 0x7fb618155770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:46.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.673+0000 7fb61cf42640 1 --2- 172.21.15.60:0/3733027624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6181505f0 0x7fb6181ec180 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:46.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.673+0000 7fb61cf42640 1 --2- 172.21.15.60:0/3733027624 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb6180c42b0 0x7fb6181549b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:46.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.673+0000 7fb61cf42640 1 -- 172.21.15.60:0/3733027624 >> 172.21.15.60:0/3733027624 conn(0x7fb6180c7a40 msgr2=0x7fb61814e560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:46.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.673+0000 7fb61cf42640 1 -- 172.21.15.60:0/3733027624 shutdown_connections 2024-09-12T02:23:46.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:46.673+0000 7fb61cf42640 1 -- 172.21.15.60:0/3733027624 wait complete. 2024-09-12T02:23:49.686 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:23:49.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:49.800+0000 7f2e82542640 1 Processor -- start 2024-09-12T02:23:49.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:49.800+0000 7f2e82542640 1 -- start start 2024-09-12T02:23:49.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:49.801+0000 7f2e82542640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e7c0aa6b0 0x7f2e7c1549a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:49.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:49.801+0000 7f2e82542640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2e7c0adb70 0x7f2e7c1514c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:49.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:49.801+0000 7f2e82542640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2e7c154ee0 0x7f2e7c151a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:49.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:49.801+0000 7f2e82542640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f2e7c0abc20 con 0x7f2e7c154ee0 2024-09-12T02:23:49.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:49.801+0000 7f2e82542640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f2e7c151f40 con 0x7f2e7c0adb70 2024-09-12T02:23:49.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:49.801+0000 7f2e82542640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2e7c067d50 con 0x7f2e7c0aa6b0 2024-09-12T02:23:49.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:49.801+0000 7f2e7b7fe640 1 -- >> v2:172.21.15.105:3300/0 conn(0x7f2e7c0adb70 msgr2=0x7f2e7c1514c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3300/0 2024-09-12T02:23:49.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:49.801+0000 7f2e80adf640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2e7c154ee0 0x7f2e7c151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:49.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:49.801+0000 7f2e7b7fe640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2e7c0adb70 0x7f2e7c1514c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:23:49.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:49.801+0000 7f2e80adf640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2e7c154ee0 0x7f2e7c151a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51556/0 (socket says 172.21.15.60:51556) 2024-09-12T02:23:49.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:49.801+0000 7f2e80adf640 1 -- 172.21.15.60:0/4176354694 learned_addr learned my addr 172.21.15.60:0/4176354694 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:49.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:49.801+0000 7f2e80adf640 1 -- 172.21.15.60:0/4176354694 >> v2:172.21.15.60:3300/0 conn(0x7f2e7c154ee0 msgr2=0x7f2e7c151a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:23:49.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:49.801+0000 7f2e80adf640 1 -- 172.21.15.60:0/4176354694 >> v2:172.21.15.60:3300/0 conn(0x7f2e7c154ee0 msgr2=0x7f2e7c151a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:23:49.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:49.801+0000 7f2e80adf640 1 --2- 172.21.15.60:0/4176354694 >> v2:172.21.15.60:3300/0 conn(0x7f2e7c154ee0 0x7f2e7c151a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:23:49.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:49.801+0000 7f2e80adf640 1 --2- 172.21.15.60:0/4176354694 >> v2:172.21.15.60:3300/0 conn(0x7f2e7c154ee0 0x7f2e7c151a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:23:49.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:49.801+0000 7f2e7bfff640 1 --2- 172.21.15.60:0/4176354694 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e7c0aa6b0 0x7f2e7c1549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:49.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:49.801+0000 7f2e7bfff640 1 -- 172.21.15.60:0/4176354694 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e7c0aa6b0 msgr2=0x7f2e7c1549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:23:49.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:49.801+0000 7f2e7bfff640 1 -- 172.21.15.60:0/4176354694 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e7c0aa6b0 msgr2=0x7f2e7c1549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:23:49.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:49.801+0000 7f2e7bfff640 1 --2- 172.21.15.60:0/4176354694 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e7c0aa6b0 0x7f2e7c1549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:23:49.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:49.801+0000 7f2e7bfff640 1 --2- 172.21.15.60:0/4176354694 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e7c0aa6b0 0x7f2e7c1549a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:23:50.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:50.002+0000 7f2e80adf640 1 --2- 172.21.15.60:0/4176354694 >> v2:172.21.15.60:3300/0 conn(0x7f2e7c154ee0 0x7f2e7c151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:50.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:50.002+0000 7f2e7b7fe640 1 -- 172.21.15.60:0/4176354694 >> v2:172.21.15.105:3300/0 conn(0x7f2e7c0adb70 msgr2=0x7f2e7c1514c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3300/0 2024-09-12T02:23:50.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:50.002+0000 7f2e7b7fe640 1 --2- 172.21.15.60:0/4176354694 >> v2:172.21.15.105:3300/0 conn(0x7f2e7c0adb70 0x7f2e7c1514c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:23:50.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:50.002+0000 7f2e80adf640 1 -- 172.21.15.60:0/4176354694 >> v2:172.21.15.60:3300/0 conn(0x7f2e7c154ee0 msgr2=0x7f2e7c151a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:23:50.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:50.002+0000 7f2e80adf640 1 -- 172.21.15.60:0/4176354694 >> v2:172.21.15.60:3300/0 conn(0x7f2e7c154ee0 msgr2=0x7f2e7c151a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:23:50.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:50.002+0000 7f2e80adf640 1 --2- 172.21.15.60:0/4176354694 >> v2:172.21.15.60:3300/0 conn(0x7f2e7c154ee0 0x7f2e7c151a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:23:50.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:50.002+0000 7f2e80adf640 1 --2- 172.21.15.60:0/4176354694 >> v2:172.21.15.60:3300/0 conn(0x7f2e7c154ee0 0x7f2e7c151a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:23:50.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:50.002+0000 7f2e7bfff640 1 --2- 172.21.15.60:0/4176354694 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e7c0aa6b0 0x7f2e7c1549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:50.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:50.002+0000 7f2e7bfff640 1 -- 172.21.15.60:0/4176354694 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e7c0aa6b0 msgr2=0x7f2e7c1549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:23:50.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:50.002+0000 7f2e7bfff640 1 -- 172.21.15.60:0/4176354694 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e7c0aa6b0 msgr2=0x7f2e7c1549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:23:50.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:50.002+0000 7f2e7bfff640 1 --2- 172.21.15.60:0/4176354694 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e7c0aa6b0 0x7f2e7c1549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:23:50.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:50.002+0000 7f2e7bfff640 1 --2- 172.21.15.60:0/4176354694 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e7c0aa6b0 0x7f2e7c1549a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:23:50.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:50.403+0000 7f2e7b7fe640 1 -- 172.21.15.60:0/4176354694 >> v2:172.21.15.105:3300/0 conn(0x7f2e7c0adb70 msgr2=0x7f2e7c1514c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3300/0 2024-09-12T02:23:50.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:50.403+0000 7f2e80adf640 1 --2- 172.21.15.60:0/4176354694 >> v2:172.21.15.60:3300/0 conn(0x7f2e7c154ee0 0x7f2e7c151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:50.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:50.403+0000 7f2e7b7fe640 1 --2- 172.21.15.60:0/4176354694 >> v2:172.21.15.105:3300/0 conn(0x7f2e7c0adb70 0x7f2e7c1514c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:23:50.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:50.403+0000 7f2e7bfff640 1 --2- 172.21.15.60:0/4176354694 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e7c0aa6b0 0x7f2e7c1549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:50.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:50.403+0000 7f2e80adf640 1 -- 172.21.15.60:0/4176354694 >> v2:172.21.15.60:3300/0 conn(0x7f2e7c154ee0 msgr2=0x7f2e7c151a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:23:50.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:50.403+0000 7f2e80adf640 1 -- 172.21.15.60:0/4176354694 >> v2:172.21.15.60:3300/0 conn(0x7f2e7c154ee0 msgr2=0x7f2e7c151a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:23:50.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:50.403+0000 7f2e80adf640 1 --2- 172.21.15.60:0/4176354694 >> v2:172.21.15.60:3300/0 conn(0x7f2e7c154ee0 0x7f2e7c151a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:23:50.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:50.403+0000 7f2e80adf640 1 --2- 172.21.15.60:0/4176354694 >> v2:172.21.15.60:3300/0 conn(0x7f2e7c154ee0 0x7f2e7c151a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:23:50.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:50.403+0000 7f2e7bfff640 1 -- 172.21.15.60:0/4176354694 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e7c0aa6b0 msgr2=0x7f2e7c1549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:23:50.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:50.403+0000 7f2e7bfff640 1 -- 172.21.15.60:0/4176354694 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e7c0aa6b0 msgr2=0x7f2e7c1549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:23:50.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:50.403+0000 7f2e7bfff640 1 --2- 172.21.15.60:0/4176354694 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e7c0aa6b0 0x7f2e7c1549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:23:50.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:50.403+0000 7f2e7bfff640 1 --2- 172.21.15.60:0/4176354694 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e7c0aa6b0 0x7f2e7c1549a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:23:51.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:51.204+0000 7f2e7b7fe640 1 -- 172.21.15.60:0/4176354694 >> v2:172.21.15.105:3300/0 conn(0x7f2e7c0adb70 msgr2=0x7f2e7c1514c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3300/0 2024-09-12T02:23:51.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:51.204+0000 7f2e7b7fe640 1 --2- 172.21.15.60:0/4176354694 >> v2:172.21.15.105:3300/0 conn(0x7f2e7c0adb70 0x7f2e7c1514c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:23:51.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:51.204+0000 7f2e80adf640 1 --2- 172.21.15.60:0/4176354694 >> v2:172.21.15.60:3300/0 conn(0x7f2e7c154ee0 0x7f2e7c151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:51.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:51.204+0000 7f2e80adf640 1 -- 172.21.15.60:0/4176354694 >> v2:172.21.15.60:3300/0 conn(0x7f2e7c154ee0 msgr2=0x7f2e7c151a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:23:51.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:51.204+0000 7f2e80adf640 1 -- 172.21.15.60:0/4176354694 >> v2:172.21.15.60:3300/0 conn(0x7f2e7c154ee0 msgr2=0x7f2e7c151a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:23:51.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:51.204+0000 7f2e80adf640 1 --2- 172.21.15.60:0/4176354694 >> v2:172.21.15.60:3300/0 conn(0x7f2e7c154ee0 0x7f2e7c151a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:23:51.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:51.204+0000 7f2e80adf640 1 --2- 172.21.15.60:0/4176354694 >> v2:172.21.15.60:3300/0 conn(0x7f2e7c154ee0 0x7f2e7c151a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:23:51.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:51.204+0000 7f2e7bfff640 1 --2- 172.21.15.60:0/4176354694 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e7c0aa6b0 0x7f2e7c1549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:51.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:51.205+0000 7f2e7bfff640 1 -- 172.21.15.60:0/4176354694 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e7c0aa6b0 msgr2=0x7f2e7c1549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:23:51.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:51.205+0000 7f2e7bfff640 1 -- 172.21.15.60:0/4176354694 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e7c0aa6b0 msgr2=0x7f2e7c1549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:23:51.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:51.205+0000 7f2e7bfff640 1 --2- 172.21.15.60:0/4176354694 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e7c0aa6b0 0x7f2e7c1549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:23:51.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:51.205+0000 7f2e7bfff640 1 --2- 172.21.15.60:0/4176354694 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e7c0aa6b0 0x7f2e7c1549a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:23:52.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:52.801+0000 7f2e79ffb640 1 -- 172.21.15.60:0/4176354694 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e7c0aa6b0 msgr2=0x7f2e7c1549a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:23:52.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:52.801+0000 7f2e79ffb640 1 --2- 172.21.15.60:0/4176354694 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e7c0aa6b0 0x7f2e7c1549a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:52.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:52.801+0000 7f2e79ffb640 1 -- 172.21.15.60:0/4176354694 >> v2:172.21.15.105:3300/0 conn(0x7f2e7c0adb70 msgr2=0x7f2e7c1514c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:23:52.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:52.801+0000 7f2e79ffb640 1 --2- 172.21.15.60:0/4176354694 >> v2:172.21.15.105:3300/0 conn(0x7f2e7c0adb70 0x7f2e7c1514c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:52.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:52.801+0000 7f2e79ffb640 1 -- 172.21.15.60:0/4176354694 >> v2:172.21.15.60:3300/0 conn(0x7f2e7c154ee0 msgr2=0x7f2e7c151a00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:23:52.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:52.801+0000 7f2e79ffb640 1 --2- 172.21.15.60:0/4176354694 >> v2:172.21.15.60:3300/0 conn(0x7f2e7c154ee0 0x7f2e7c151a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:52.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:52.801+0000 7f2e79ffb640 1 -- 172.21.15.60:0/4176354694 --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e7c067a70 con 0x7f2e68003710 2024-09-12T02:23:52.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:52.801+0000 7f2e79ffb640 1 -- 172.21.15.60:0/4176354694 --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e6800c0c0 con 0x7f2e68007380 2024-09-12T02:23:52.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:52.801+0000 7f2e7b7fe640 1 -- 172.21.15.60:0/4176354694 >> v1:172.21.15.105:6789/0 conn(0x7f2e68007380 legacy=0x7f2e68009840 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.105:6789/0 2024-09-12T02:23:53.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.002+0000 7f2e7b7fe640 1 -- 172.21.15.60:0/4176354694 >> v1:172.21.15.105:6789/0 conn(0x7f2e68007380 legacy=0x7f2e68009840 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.105:6789/0 2024-09-12T02:23:53.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.403+0000 7f2e7b7fe640 1 -- 172.21.15.60:0/4176354694 >> v1:172.21.15.105:6789/0 conn(0x7f2e68007380 legacy=0x7f2e68009840 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.105:6789/0 2024-09-12T02:23:53.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.915+0000 7f2e7affd640 1 -- 172.21.15.60:0/4176354694 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3461939941 0 0) 0x7f2e7c067a70 con 0x7f2e68003710 2024-09-12T02:23:53.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.915+0000 7f2e7affd640 1 -- 172.21.15.60:0/4176354694 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e64003520 con 0x7f2e68003710 2024-09-12T02:23:53.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.916+0000 7f2e7affd640 1 -- 172.21.15.60:0/4176354694 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2612685481 0 0) 0x7f2e64003520 con 0x7f2e68003710 2024-09-12T02:23:53.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.916+0000 7f2e7affd640 1 -- 172.21.15.60:0/4176354694 >> v1:172.21.15.105:6789/0 conn(0x7f2e68007380 legacy=0x7f2e68009840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:23:53.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.916+0000 7f2e7affd640 1 -- 172.21.15.60:0/4176354694 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e6800d2c0 con 0x7f2e68003710 2024-09-12T02:23:53.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.916+0000 7f2e7affd640 1 -- 172.21.15.60:0/4176354694 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7f2e6c00d580 con 0x7f2e68003710 2024-09-12T02:23:53.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.916+0000 7f2e7affd640 1 -- 172.21.15.60:0/4176354694 >> v1:172.21.15.60:6789/0 conn(0x7f2e68003710 legacy=0x7f2e68005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:53.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.916+0000 7f2e7affd640 1 --2- 172.21.15.60:0/4176354694 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e640039e0 0x7f2e64003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:53.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.916+0000 7f2e80adf640 1 -- 172.21.15.60:0/4176354694 reap_dead start 2024-09-12T02:23:53.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.916+0000 7f2e7affd640 1 --2- 172.21.15.60:0/4176354694 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e64004800 0x7f2e64004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:53.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.916+0000 7f2e7affd640 1 --2- 172.21.15.60:0/4176354694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e640052e0 0x7f2e6400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:53.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.916+0000 7f2e7affd640 1 -- 172.21.15.60:0/4176354694 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2e640105e0 con 0x7f2e640052e0 2024-09-12T02:23:53.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.916+0000 7f2e7affd640 1 -- 172.21.15.60:0/4176354694 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2e64010790 con 0x7f2e640039e0 2024-09-12T02:23:53.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.916+0000 7f2e7affd640 1 -- 172.21.15.60:0/4176354694 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2e64010990 con 0x7f2e64004800 2024-09-12T02:23:53.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.916+0000 7f2e7bfff640 1 -- 172.21.15.60:0/4176354694 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e640039e0 msgr2=0x7f2e64003dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3300/0 2024-09-12T02:23:53.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.916+0000 7f2e7bfff640 1 --2- 172.21.15.60:0/4176354694 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e640039e0 0x7f2e64003dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:23:53.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.916+0000 7f2e80adf640 1 --2- 172.21.15.60:0/4176354694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e640052e0 0x7f2e6400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:53.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.916+0000 7f2e7b7fe640 1 --2- 172.21.15.60:0/4176354694 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e64004800 0x7f2e64004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:53.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.917+0000 7f2e80adf640 1 -- 172.21.15.60:0/4176354694 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e64004800 msgr2=0x7f2e64004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:53.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.917+0000 7f2e80adf640 1 --2- 172.21.15.60:0/4176354694 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e64004800 0x7f2e64004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:53.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.917+0000 7f2e80adf640 1 -- 172.21.15.60:0/4176354694 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e640039e0 msgr2=0x7f2e64003dc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:23:53.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.917+0000 7f2e80adf640 1 --2- 172.21.15.60:0/4176354694 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e640039e0 0x7f2e64003dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:53.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.917+0000 7f2e80adf640 1 -- 172.21.15.60:0/4176354694 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e64003520 con 0x7f2e640052e0 2024-09-12T02:23:53.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.918+0000 7f2e80adf640 1 --2- 172.21.15.60:0/4176354694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e640052e0 0x7f2e6400b9c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c1552c0 tx=0x7f2e64005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fab95d5154602c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:53.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.918+0000 7f2e7affd640 1 -- 172.21.15.60:0/4176354694 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e74031070 con 0x7f2e640052e0 2024-09-12T02:23:53.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.918+0000 7f2e7affd640 1 -- 172.21.15.60:0/4176354694 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e7402b510 con 0x7f2e640052e0 2024-09-12T02:23:53.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.918+0000 7f2e7affd640 1 -- 172.21.15.60:0/4176354694 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e74009700 con 0x7f2e640052e0 2024-09-12T02:23:53.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.919+0000 7f2e82542640 1 -- 172.21.15.60:0/4176354694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e640052e0 msgr2=0x7f2e6400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:53.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.919+0000 7f2e82542640 1 --2- 172.21.15.60:0/4176354694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e640052e0 0x7f2e6400b9c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c1552c0 tx=0x7f2e64005830 comp rx=0 tx=0).stop 2024-09-12T02:23:53.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.919+0000 7f2e82542640 1 -- 172.21.15.60:0/4176354694 shutdown_connections 2024-09-12T02:23:53.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.919+0000 7f2e82542640 1 --2- 172.21.15.60:0/4176354694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e640052e0 0x7f2e6400b9c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:53.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.919+0000 7f2e82542640 1 --2- 172.21.15.60:0/4176354694 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e64004800 0x7f2e64004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:53.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.919+0000 7f2e82542640 1 --2- 172.21.15.60:0/4176354694 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e640039e0 0x7f2e64003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:53.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.919+0000 7f2e82542640 1 -- 172.21.15.60:0/4176354694 >> 172.21.15.60:0/4176354694 conn(0x7f2e7c0c4fa0 msgr2=0x7f2e7c0c5380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:53.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.920+0000 7f2e82542640 1 -- 172.21.15.60:0/4176354694 shutdown_connections 2024-09-12T02:23:53.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.920+0000 7f2e82542640 1 -- 172.21.15.60:0/4176354694 wait complete. 2024-09-12T02:23:53.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.922+0000 7f2e82542640 1 Processor -- start 2024-09-12T02:23:53.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.922+0000 7f2e82542640 1 -- start start 2024-09-12T02:23:53.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.923+0000 7f2e82542640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e640039e0 0x7f2e7c1eac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:53.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.923+0000 7f2e82542640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e64004800 0x7f2e7c150a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:53.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.923+0000 7f2e82542640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e640052e0 0x7f2e7c1e6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:53.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.923+0000 7f2e82542640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2e7c154480 con 0x7f2e64004800 2024-09-12T02:23:53.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.923+0000 7f2e82542640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2e7c0ab940 con 0x7f2e640052e0 2024-09-12T02:23:53.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.923+0000 7f2e82542640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2e7c0c5d10 con 0x7f2e640039e0 2024-09-12T02:23:53.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.924+0000 7f2e80adf640 1 -- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e640052e0 msgr2=0x7f2e7c1e6d70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3300/0 2024-09-12T02:23:53.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.924+0000 7f2e80adf640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e640052e0 0x7f2e7c1e6d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:23:53.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.924+0000 7f2e7b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e64004800 0x7f2e7c150a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:53.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.924+0000 7f2e7b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e64004800 0x7f2e7c150a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51594/0 (socket says 172.21.15.60:51594) 2024-09-12T02:23:53.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.924+0000 7f2e7bfff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e640039e0 0x7f2e7c1eac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:53.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.924+0000 7f2e7b7fe640 1 -- 172.21.15.60:0/1774958739 learned_addr learned my addr 172.21.15.60:0/1774958739 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:53.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.924+0000 7f2e7bfff640 1 -- 172.21.15.60:0/1774958739 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e640052e0 msgr2=0x7f2e7c1e6d70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:23:53.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.924+0000 7f2e7bfff640 1 --2- 172.21.15.60:0/1774958739 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e640052e0 0x7f2e7c1e6d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:53.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.924+0000 7f2e7bfff640 1 -- 172.21.15.60:0/1774958739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e64004800 msgr2=0x7f2e7c150a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:53.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.924+0000 7f2e7bfff640 1 --2- 172.21.15.60:0/1774958739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e64004800 0x7f2e7c150a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:53.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.924+0000 7f2e7bfff640 1 -- 172.21.15.60:0/1774958739 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e7c1eb1c0 con 0x7f2e640039e0 2024-09-12T02:23:53.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.924+0000 7f2e7bfff640 1 --2- 172.21.15.60:0/1774958739 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e640039e0 0x7f2e7c1eac80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c0135c0 tx=0x7f2e6c013a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:53.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.924+0000 7f2e78ff9640 1 -- 172.21.15.60:0/1774958739 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c01c070 con 0x7f2e640039e0 2024-09-12T02:23:53.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.925+0000 7f2e78ff9640 1 -- 172.21.15.60:0/1774958739 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e6c0116b0 con 0x7f2e640039e0 2024-09-12T02:23:53.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.925+0000 7f2e78ff9640 1 -- 172.21.15.60:0/1774958739 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c011a80 con 0x7f2e640039e0 2024-09-12T02:23:53.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.925+0000 7f2e82542640 1 -- 172.21.15.60:0/1774958739 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e7c0715a0 con 0x7f2e640039e0 2024-09-12T02:23:53.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.925+0000 7f2e82542640 1 -- 172.21.15.60:0/1774958739 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e7c1ea480 con 0x7f2e640039e0 2024-09-12T02:23:53.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.926+0000 7f2e82542640 1 -- 172.21.15.60:0/1774958739 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e7c071ac0 con 0x7f2e640039e0 2024-09-12T02:23:53.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.926+0000 7f2e78ff9640 1 -- 172.21.15.60:0/1774958739 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2e6c01f070 con 0x7f2e640039e0 2024-09-12T02:23:53.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.927+0000 7f2e78ff9640 1 --2- 172.21.15.60:0/1774958739 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2e6806c550 0x7f2e6806ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:53.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.927+0000 7f2e78ff9640 1 -- 172.21.15.60:0/1774958739 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f2e6c08b3c0 con 0x7f2e640039e0 2024-09-12T02:23:53.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.927+0000 7f2e7b7fe640 1 --2- 172.21.15.60:0/1774958739 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2e6806c550 0x7f2e6806ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:53.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.928+0000 7f2e7b7fe640 1 --2- 172.21.15.60:0/1774958739 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2e6806c550 0x7f2e6806ea10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2e70003db0 tx=0x7f2e70003910 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:53.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:53.932+0000 7f2e78ff9640 1 -- 172.21.15.60:0/1774958739 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2e7c071ac0 con 0x7f2e640039e0 2024-09-12T02:23:54.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.181+0000 7f2e82542640 1 -- 172.21.15.60:0/1774958739 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f2e7c0a7e90 con 0x7f2e640039e0 2024-09-12T02:23:54.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.181+0000 7f2e78ff9640 1 -- 172.21.15.60:0/1774958739 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7f2e6c026030 con 0x7f2e640039e0 2024-09-12T02:23:54.182 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":12,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:23:54.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.183+0000 7f2e82542640 1 -- 172.21.15.60:0/1774958739 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2e6806c550 msgr2=0x7f2e6806ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:54.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.183+0000 7f2e82542640 1 --2- 172.21.15.60:0/1774958739 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2e6806c550 0x7f2e6806ea10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2e70003db0 tx=0x7f2e70003910 comp rx=0 tx=0).stop 2024-09-12T02:23:54.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.183+0000 7f2e82542640 1 -- 172.21.15.60:0/1774958739 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e640039e0 msgr2=0x7f2e7c1eac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:54.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.183+0000 7f2e82542640 1 --2- 172.21.15.60:0/1774958739 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e640039e0 0x7f2e7c1eac80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c0135c0 tx=0x7f2e6c013a80 comp rx=0 tx=0).stop 2024-09-12T02:23:54.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.184+0000 7f2e82542640 1 -- 172.21.15.60:0/1774958739 shutdown_connections 2024-09-12T02:23:54.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.184+0000 7f2e82542640 1 --2- 172.21.15.60:0/1774958739 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2e6806c550 0x7f2e6806ea10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:54.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.184+0000 7f2e82542640 1 --2- 172.21.15.60:0/1774958739 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e640052e0 0x7f2e7c1e6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:54.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.184+0000 7f2e82542640 1 --2- 172.21.15.60:0/1774958739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e64004800 0x7f2e7c150a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:54.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.184+0000 7f2e82542640 1 --2- 172.21.15.60:0/1774958739 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e640039e0 0x7f2e7c1eac80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:54.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.184+0000 7f2e82542640 1 -- 172.21.15.60:0/1774958739 >> 172.21.15.60:0/1774958739 conn(0x7f2e7c0c4fa0 msgr2=0x7f2e7c14d940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:54.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.184+0000 7f2e82542640 1 -- 172.21.15.60:0/1774958739 shutdown_connections 2024-09-12T02:23:54.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.184+0000 7f2e82542640 1 -- 172.21.15.60:0/1774958739 wait complete. 2024-09-12T02:23:54.195 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-12T02:23:54.195 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-09-12T02:23:54.196 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-12T02:23:54.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.301+0000 7fe07295f640 1 Processor -- start 2024-09-12T02:23:54.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.301+0000 7fe07295f640 1 -- start start 2024-09-12T02:23:54.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.302+0000 7fe07295f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe06c1505f0 0x7fe06c153910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:54.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.302+0000 7fe07295f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe06c0c42b0 0x7fe06c0c46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:54.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.302+0000 7fe07295f640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe06c0c5940 con 0x7fe06c0c69c0 2024-09-12T02:23:54.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.302+0000 7fe07295f640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fe06c0c7860 con 0x7fe06c1505f0 2024-09-12T02:23:54.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.302+0000 7fe07295f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe06c0c5c00 con 0x7fe06c0c42b0 2024-09-12T02:23:54.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.302+0000 7fe06bfff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe06c1505f0 0x7fe06c153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:54.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.302+0000 7fe06b7fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe06c0c69c0 0x7fe06c0c2440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:58520/0 (socket says 172.21.15.60:58520) 2024-09-12T02:23:54.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.302+0000 7fe06b7fe640 1 -- 172.21.15.60:0/2768941102 learned_addr learned my addr 172.21.15.60:0/2768941102 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:23:54.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.302+0000 7fe070efc640 1 --2- 172.21.15.60:0/2768941102 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe06c0c42b0 0x7fe06c0c46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:54.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.302+0000 7fe06affd640 1 -- 172.21.15.60:0/2768941102 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2562920749 0 0) 0x7fe06c0c5940 con 0x7fe06c0c69c0 2024-09-12T02:23:54.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.303+0000 7fe06affd640 1 -- 172.21.15.60:0/2768941102 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe054003520 con 0x7fe06c0c69c0 2024-09-12T02:23:54.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.303+0000 7fe06bfff640 1 -- 172.21.15.60:0/2768941102 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe06c0c42b0 msgr2=0x7fe06c0c46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:23:54.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.303+0000 7fe06bfff640 1 --2- 172.21.15.60:0/2768941102 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe06c0c42b0 0x7fe06c0c46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:54.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.303+0000 7fe06bfff640 1 -- 172.21.15.60:0/2768941102 >> v1:172.21.15.60:6789/0 conn(0x7fe06c0c69c0 legacy=0x7fe06c0c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:54.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.303+0000 7fe06bfff640 1 -- 172.21.15.60:0/2768941102 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe06c0c5ee0 con 0x7fe06c1505f0 2024-09-12T02:23:54.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.304+0000 7fe06bfff640 1 --2- 172.21.15.60:0/2768941102 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe06c1505f0 0x7fe06c153910 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe05c0097a0 tx=0x7fe05c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3863b699536ee55 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:54.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.304+0000 7fe06affd640 1 -- 172.21.15.60:0/2768941102 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe05c037070 con 0x7fe06c1505f0 2024-09-12T02:23:54.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.304+0000 7fe06affd640 1 -- 172.21.15.60:0/2768941102 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe05c02ae50 con 0x7fe06c1505f0 2024-09-12T02:23:54.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.304+0000 7fe06affd640 1 -- 172.21.15.60:0/2768941102 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe05c032660 con 0x7fe06c1505f0 2024-09-12T02:23:54.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.304+0000 7fe07295f640 1 -- 172.21.15.60:0/2768941102 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe06c1505f0 msgr2=0x7fe06c153910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:54.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.304+0000 7fe07295f640 1 --2- 172.21.15.60:0/2768941102 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe06c1505f0 0x7fe06c153910 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe05c0097a0 tx=0x7fe05c02a100 comp rx=0 tx=0).stop 2024-09-12T02:23:54.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.304+0000 7fe07295f640 1 -- 172.21.15.60:0/2768941102 shutdown_connections 2024-09-12T02:23:54.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.304+0000 7fe07295f640 1 --2- 172.21.15.60:0/2768941102 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe06c0c42b0 0x7fe06c0c46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:54.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.304+0000 7fe07295f640 1 --2- 172.21.15.60:0/2768941102 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe06c1505f0 0x7fe06c153910 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:54.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.304+0000 7fe07295f640 1 -- 172.21.15.60:0/2768941102 >> 172.21.15.60:0/2768941102 conn(0x7fe06c0c7a40 msgr2=0x7fe06c0c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:54.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.304+0000 7fe07295f640 1 -- 172.21.15.60:0/2768941102 shutdown_connections 2024-09-12T02:23:54.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.304+0000 7fe07295f640 1 -- 172.21.15.60:0/2768941102 wait complete. 2024-09-12T02:23:54.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.306+0000 7fe07295f640 1 Processor -- start 2024-09-12T02:23:54.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.306+0000 7fe07295f640 1 -- start start 2024-09-12T02:23:54.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.306+0000 7fe07295f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe06c0c42b0 0x7fe06c1ebed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:54.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.306+0000 7fe07295f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe06c1505f0 0x7fe06c1e2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:54.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.306+0000 7fe07295f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe06c147af0 0x7fe06c0abfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:54.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.307+0000 7fe07295f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe06c1509d0 con 0x7fe06c1505f0 2024-09-12T02:23:54.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.307+0000 7fe070efc640 1 -- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe06c147af0 msgr2=0x7fe06c0abfe0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3300/0 2024-09-12T02:23:54.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.307+0000 7fe07295f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe06c0c64a0 con 0x7fe06c147af0 2024-09-12T02:23:54.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.307+0000 7fe07295f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe06c150b50 con 0x7fe06c0c42b0 2024-09-12T02:23:54.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.307+0000 7fe070efc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe06c147af0 0x7fe06c0abfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:23:54.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.307+0000 7fe06b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe06c1505f0 0x7fe06c1e2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:54.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.307+0000 7fe06b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe06c1505f0 0x7fe06c1e2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51612/0 (socket says 172.21.15.60:51612) 2024-09-12T02:23:54.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.307+0000 7fe06bfff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe06c0c42b0 0x7fe06c1ebed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:54.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.307+0000 7fe06b7fe640 1 -- 172.21.15.60:0/2682130631 learned_addr learned my addr 172.21.15.60:0/2682130631 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:54.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.307+0000 7fe06b7fe640 1 -- 172.21.15.60:0/2682130631 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe06c0c42b0 msgr2=0x7fe06c1ebed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:54.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.307+0000 7fe06b7fe640 1 --2- 172.21.15.60:0/2682130631 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe06c0c42b0 0x7fe06c1ebed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:54.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.307+0000 7fe06b7fe640 1 -- 172.21.15.60:0/2682130631 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe06c147af0 msgr2=0x7fe06c0abfe0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:23:54.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.307+0000 7fe06b7fe640 1 --2- 172.21.15.60:0/2682130631 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe06c147af0 0x7fe06c0abfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:54.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.307+0000 7fe06b7fe640 1 -- 172.21.15.60:0/2682130631 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe06c14c420 con 0x7fe06c1505f0 2024-09-12T02:23:54.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.307+0000 7fe06bfff640 1 --2- 172.21.15.60:0/2682130631 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe06c0c42b0 0x7fe06c1ebed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:23:54.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.307+0000 7fe06b7fe640 1 --2- 172.21.15.60:0/2682130631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe06c1505f0 0x7fe06c1e2a40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe06000c430 tx=0x7fe06000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:54.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.307+0000 7fe068ff9640 1 -- 172.21.15.60:0/2682130631 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe060017070 con 0x7fe06c1505f0 2024-09-12T02:23:54.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.307+0000 7fe068ff9640 1 -- 172.21.15.60:0/2682130631 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe060005ce0 con 0x7fe06c1505f0 2024-09-12T02:23:54.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.307+0000 7fe07295f640 1 -- 172.21.15.60:0/2682130631 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe06c148330 con 0x7fe06c1505f0 2024-09-12T02:23:54.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.307+0000 7fe068ff9640 1 -- 172.21.15.60:0/2682130631 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0600072f0 con 0x7fe06c1505f0 2024-09-12T02:23:54.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.307+0000 7fe07295f640 1 -- 172.21.15.60:0/2682130631 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe06c148cf0 con 0x7fe06c1505f0 2024-09-12T02:23:54.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.308+0000 7fe07295f640 1 --2- 172.21.15.60:0/2682130631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe06c0c69c0 0x7fe06c146220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:54.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.308+0000 7fe07295f640 1 -- 172.21.15.60:0/2682130631 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe06c148870 con 0x7fe06c0c69c0 2024-09-12T02:23:54.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.309+0000 7fe06bfff640 1 --2- 172.21.15.60:0/2682130631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe06c0c69c0 0x7fe06c146220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:54.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.309+0000 7fe06bfff640 1 -- 172.21.15.60:0/2682130631 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe06c0c5840 con 0x7fe06c0c69c0 2024-09-12T02:23:54.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.309+0000 7fe06bfff640 1 --2- 172.21.15.60:0/2682130631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe06c0c69c0 0x7fe06c146220 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe06c0c5580 tx=0x7fe05c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:54.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.309+0000 7fe068ff9640 1 -- 172.21.15.60:0/2682130631 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe06001a070 con 0x7fe06c1505f0 2024-09-12T02:23:54.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.310+0000 7fe068ff9640 1 --2- 172.21.15.60:0/2682130631 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe05806be10 0x7fe05806e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:54.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.310+0000 7fe068ff9640 1 -- 172.21.15.60:0/2682130631 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7fe06008a3d0 con 0x7fe06c1505f0 2024-09-12T02:23:54.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.310+0000 7fe070efc640 1 --2- 172.21.15.60:0/2682130631 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe05806be10 0x7fe05806e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:54.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.310+0000 7fe068ff9640 1 -- 172.21.15.60:0/2682130631 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe05c037040 con 0x7fe06c0c69c0 2024-09-12T02:23:54.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.310+0000 7fe068ff9640 1 -- 172.21.15.60:0/2682130631 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fe05c03c640 con 0x7fe06c0c69c0 2024-09-12T02:23:54.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.310+0000 7fe068ff9640 1 -- 172.21.15.60:0/2682130631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe06c0c69c0 msgr2=0x7fe06c146220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:54.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.310+0000 7fe068ff9640 1 --2- 172.21.15.60:0/2682130631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe06c0c69c0 0x7fe06c146220 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe06c0c5580 tx=0x7fe05c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:23:54.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.310+0000 7fe068ff9640 1 -- 172.21.15.60:0/2682130631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe06c0c69c0 msgr2=0x7fe06c146220 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:23:54.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.310+0000 7fe068ff9640 1 --2- 172.21.15.60:0/2682130631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe06c0c69c0 0x7fe06c146220 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:54.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.310+0000 7fe070efc640 1 --2- 172.21.15.60:0/2682130631 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe05806be10 0x7fe05806e2d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe064009a70 tx=0x7fe06400b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:54.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.316+0000 7fe07295f640 1 --2- 172.21.15.60:0/2682130631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe06c146760 0x7fe06c1ef440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:54.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.316+0000 7fe07295f640 1 -- 172.21.15.60:0/2682130631 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe06c153910 con 0x7fe06c146760 2024-09-12T02:23:54.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.316+0000 7fe06bfff640 1 --2- 172.21.15.60:0/2682130631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe06c146760 0x7fe06c1ef440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:54.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.316+0000 7fe06bfff640 1 -- 172.21.15.60:0/2682130631 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe06c0c4d90 con 0x7fe06c146760 2024-09-12T02:23:54.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.317+0000 7fe06bfff640 1 --2- 172.21.15.60:0/2682130631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe06c146760 0x7fe06c1ef440 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe06c0ad410 tx=0x7fe05c008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:54.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.317+0000 7fe068ff9640 1 -- 172.21.15.60:0/2682130631 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe05c052620 con 0x7fe06c146760 2024-09-12T02:23:54.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.317+0000 7fe068ff9640 1 -- 172.21.15.60:0/2682130631 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5040 (secure 0 0 0) 0x7fe05c052620 con 0x7fe06c146760 2024-09-12T02:23:54.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.317+0000 7fe068ff9640 1 -- 172.21.15.60:0/2682130631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe06c146760 msgr2=0x7fe06c1ef440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:54.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.317+0000 7fe068ff9640 1 --2- 172.21.15.60:0/2682130631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe06c146760 0x7fe06c1ef440 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe06c0ad410 tx=0x7fe05c008030 comp rx=0 tx=0).stop 2024-09-12T02:23:54.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.317+0000 7fe068ff9640 1 -- 172.21.15.60:0/2682130631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe06c146760 msgr2=0x7fe06c1ef440 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:23:54.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.317+0000 7fe068ff9640 1 --2- 172.21.15.60:0/2682130631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe06c146760 0x7fe06c1ef440 secure :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe06c0ad410 tx=0x7fe05c008030 comp rx=0 tx=0).stop 2024-09-12T02:23:54.319 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:23:54.319 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:23:54.319 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:23:54.319 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:23:54.319 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 12, 2024-09-12T02:23:54.319 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 79670, 2024-09-12T02:23:54.319 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:23:54.319 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:23:54.319 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:23:54.320 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:23:54.320 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-09-12T02:23:54.320 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:23:54.320 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:23:54.320 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:23:54.320 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:23:54.320 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:23:54.320 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:23:54.320 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:23:54.320 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:23:54.320 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:23:54.320 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:23:54.321 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:23:54.321 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:23:54.321 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:23:54.321 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:23:54.321 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:23:54.321 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:23:54.321 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:23:54.321 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:23:54.321 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:23:54.321 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:23:54.322 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:23:54.322 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:23:54.322 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:23:54.322 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:23:54.322 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:23:54.322 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:23:54.322 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:23:54.322 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:23:54.322 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:23:54.322 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:54.322 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:23:54.323 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:23:54.323 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:23:54.323 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:23:54.323 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:23:54.323 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:23:54.323 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:23:54.323 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:23:54.323 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:23:54.323 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:23:54.323 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:23:54.323 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:23:54.323 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:23:54.323 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:23:54.324 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:23:54.324 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:23:54.324 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:23:54.324 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:23:54.324 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:23:54.324 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:23:54.324 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:23:54.324 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:23:54.324 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:23:54.324 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:23:54.324 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:23:54.324 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:23:54.325 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:23:54.325 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:23:54.325 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:23:54.325 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:23:54.325 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:54.325 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:23:54.325 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:54.325 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:23:54.325 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:23:54.325 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:23:54.325 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:23:54.325 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:54.326 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:23:54.326 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:23:54.326 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:23:54.326 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:54.326 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:54.326 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:23:54.326 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:23:54.326 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:23:54.326 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:23:54.326 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:23:54.326 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:54.326 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:23:54.327 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:23:54.327 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:23:54.327 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:23:54.327 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:23:54.327 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:54.327 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:54.327 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:23:54.327 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:23:54.327 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:23:54.327 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:23:54.327 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:54.327 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:23:54.328 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:23:54.328 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:23:54.328 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:54.328 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:54.328 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:23:54.328 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:23:54.328 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:23:54.328 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:23:54.328 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:23:54.328 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:54.328 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:23:54.328 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:23:54.328 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:23:54.328 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:23:54.328 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:23:54.329 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:54.329 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:54.329 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:23:54.329 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:23:54.329 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:23:54.329 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:23:54.329 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:54.329 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:23:54.329 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:23:54.329 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:23:54.329 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:54.329 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:54.329 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:23:54.329 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:23:54.329 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:23:54.330 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:23:54.330 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:23:54.330 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:54.330 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:23:54.330 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:23:54.330 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:23:54.330 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:23:54.330 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:23:54.330 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:23:54.330 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:23:54.330 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:54.330 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:23:54.330 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:23:54.330 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:54.330 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:23:54.331 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:23:54.331 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:23:54.331 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:23:54.331 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:23:54.331 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:23:54.331 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:54.331 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:23:54.331 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:23:54.331 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:23:54.331 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:23:54.331 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:23:54.331 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:23:54.331 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:54.332 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:23:54.332 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:23:54.332 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:23:54.332 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:23:54.332 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:23:54.332 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:23:54.332 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:54.332 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:23:54.332 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:23:54.332 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-09-12T02:23:54.332 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:23:54.332 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:23:54.332 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:23:54.332 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:54.333 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:23:54.333 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:23:54.333 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:23:54.333 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:23:54.333 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:23:54.333 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:54.333 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:23:54.333 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:23:54.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.317+0000 7fe07295f640 1 -- 172.21.15.60:0/2682130631 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe05806be10 msgr2=0x7fe05806e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:54.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.317+0000 7fe07295f640 1 --2- 172.21.15.60:0/2682130631 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe05806be10 0x7fe05806e2d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe064009a70 tx=0x7fe06400b040 comp rx=0 tx=0).stop 2024-09-12T02:23:54.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.317+0000 7fe07295f640 1 -- 172.21.15.60:0/2682130631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe06c1505f0 msgr2=0x7fe06c1e2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:54.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.317+0000 7fe07295f640 1 --2- 172.21.15.60:0/2682130631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe06c1505f0 0x7fe06c1e2a40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe06000c430 tx=0x7fe06000c8f0 comp rx=0 tx=0).stop 2024-09-12T02:23:54.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.317+0000 7fe070efc640 1 -- 172.21.15.60:0/2682130631 reap_dead start 2024-09-12T02:23:54.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.317+0000 7fe070efc640 1 -- 172.21.15.60:0/2682130631 reap_dead start 2024-09-12T02:23:54.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.317+0000 7fe07295f640 1 -- 172.21.15.60:0/2682130631 shutdown_connections 2024-09-12T02:23:54.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.317+0000 7fe07295f640 1 -- 172.21.15.60:0/2682130631 >> 172.21.15.60:0/2682130631 conn(0x7fe06c0c7a40 msgr2=0x7fe06c0c14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:54.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.318+0000 7fe07295f640 1 -- 172.21.15.60:0/2682130631 shutdown_connections 2024-09-12T02:23:54.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.318+0000 7fe07295f640 1 -- 172.21.15.60:0/2682130631 wait complete. 2024-09-12T02:23:54.335 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-12T02:23:54.335 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-12T02:23:54.335 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-12T02:23:54.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.440+0000 7f2254a17640 1 Processor -- start 2024-09-12T02:23:54.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.440+0000 7f2254a17640 1 -- start start 2024-09-12T02:23:54.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.441+0000 7f2254a17640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f225014df40 0x7f2250072b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:54.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.441+0000 7f2254a17640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2250153fe0 0x7f225015e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:54.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.441+0000 7f2254a17640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22500ac4f0 con 0x7f22500c44d0 2024-09-12T02:23:54.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.441+0000 7f2254a17640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f225006f9a0 con 0x7f2250153fe0 2024-09-12T02:23:54.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.441+0000 7f2254a17640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2250070520 con 0x7f225014df40 2024-09-12T02:23:54.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.441+0000 7f2247fff640 1 -- >> v1:172.21.15.105:6789/0 conn(0x7f22500c44d0 legacy=0x7f22500709b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.105:6789/0 2024-09-12T02:23:54.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.441+0000 7f224ed9d640 1 -- >> v2:172.21.15.105:3300/0 conn(0x7f2250153fe0 msgr2=0x7f225015e960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3300/0 2024-09-12T02:23:54.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.442+0000 7f224ed9d640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2250153fe0 0x7f225015e960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:23:54.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.442+0000 7f224e59c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f225014df40 0x7f2250072b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:54.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.442+0000 7f224e59c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f225014df40 0x7f2250072b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:35838/0 (socket says 172.21.15.60:35838) 2024-09-12T02:23:54.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.442+0000 7f224e59c640 1 -- 172.21.15.60:0/826562680 learned_addr learned my addr 172.21.15.60:0/826562680 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:54.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.442+0000 7f224e59c640 1 -- 172.21.15.60:0/826562680 >> v2:172.21.15.105:3300/0 conn(0x7f2250153fe0 msgr2=0x7f225015e960 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:23:54.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.442+0000 7f224e59c640 1 --2- 172.21.15.60:0/826562680 >> v2:172.21.15.105:3300/0 conn(0x7f2250153fe0 0x7f225015e960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:54.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.442+0000 7f224e59c640 1 -- 172.21.15.60:0/826562680 >> v1:172.21.15.105:6789/0 conn(0x7f22500c44d0 legacy=0x7f22500709b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:23:54.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.442+0000 7f224e59c640 1 -- 172.21.15.60:0/826562680 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f225006fbf0 con 0x7f225014df40 2024-09-12T02:23:54.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.443+0000 7f224e59c640 1 --2- 172.21.15.60:0/826562680 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f225014df40 0x7f2250072b90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2240009870 tx=0x7f224002a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e419c0fe9d37c12d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:54.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.443+0000 7f224dd9b640 1 -- 172.21.15.60:0/826562680 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2240037070 con 0x7f225014df40 2024-09-12T02:23:54.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.443+0000 7f224dd9b640 1 -- 172.21.15.60:0/826562680 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2240032440 con 0x7f225014df40 2024-09-12T02:23:54.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.443+0000 7f224dd9b640 1 -- 172.21.15.60:0/826562680 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2240032810 con 0x7f225014df40 2024-09-12T02:23:54.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.443+0000 7f2254a17640 1 -- 172.21.15.60:0/826562680 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f225014df40 msgr2=0x7f2250072b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:54.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.443+0000 7f2254a17640 1 --2- 172.21.15.60:0/826562680 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f225014df40 0x7f2250072b90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2240009870 tx=0x7f224002a1a0 comp rx=0 tx=0).stop 2024-09-12T02:23:54.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.444+0000 7f2254a17640 1 -- 172.21.15.60:0/826562680 shutdown_connections 2024-09-12T02:23:54.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.444+0000 7f2254a17640 1 --2- 172.21.15.60:0/826562680 >> v2:172.21.15.105:3300/0 conn(0x7f2250153fe0 0x7f225015e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:54.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.444+0000 7f2254a17640 1 --2- 172.21.15.60:0/826562680 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f225014df40 0x7f2250072b90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:54.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.444+0000 7f2254a17640 1 -- 172.21.15.60:0/826562680 >> 172.21.15.60:0/826562680 conn(0x7f22500c9ad0 msgr2=0x7f22500c9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:54.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.444+0000 7f2254a17640 1 -- 172.21.15.60:0/826562680 shutdown_connections 2024-09-12T02:23:54.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.444+0000 7f2254a17640 1 -- 172.21.15.60:0/826562680 wait complete. 2024-09-12T02:23:54.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.445+0000 7f2254a17640 1 Processor -- start 2024-09-12T02:23:54.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.445+0000 7f2254a17640 1 -- start start 2024-09-12T02:23:54.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.446+0000 7f2254a17640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22500c44d0 0x7f2250150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:54.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.446+0000 7f2254a17640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f225014df40 0x7f22501e1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:54.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.446+0000 7f2254a17640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2250153fe0 0x7f22501ed090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:54.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.446+0000 7f2254a17640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f22500afe60 con 0x7f2250153fe0 2024-09-12T02:23:54.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.446+0000 7f2254a17640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f22500701b0 con 0x7f22500c44d0 2024-09-12T02:23:54.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.446+0000 7f2254a17640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f22500affe0 con 0x7f225014df40 2024-09-12T02:23:54.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.446+0000 7f224e59c640 1 -- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22500c44d0 msgr2=0x7f2250150ec0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3300/0 2024-09-12T02:23:54.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.446+0000 7f224e59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22500c44d0 0x7f2250150ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:23:54.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.446+0000 7f224ed9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2250153fe0 0x7f22501ed090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:54.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.446+0000 7f2247fff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f225014df40 0x7f22501e1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:54.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.446+0000 7f224ed9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2250153fe0 0x7f22501ed090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51636/0 (socket says 172.21.15.60:51636) 2024-09-12T02:23:54.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.446+0000 7f2247fff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f225014df40 0x7f22501e1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:35840/0 (socket says 172.21.15.60:35840) 2024-09-12T02:23:54.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.446+0000 7f224ed9d640 1 -- 172.21.15.60:0/1721659792 learned_addr learned my addr 172.21.15.60:0/1721659792 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:23:54.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.446+0000 7f2247fff640 1 -- 172.21.15.60:0/1721659792 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22500c44d0 msgr2=0x7f2250150ec0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:23:54.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.446+0000 7f2247fff640 1 --2- 172.21.15.60:0/1721659792 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22500c44d0 0x7f2250150ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:54.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.446+0000 7f2247fff640 1 -- 172.21.15.60:0/1721659792 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2250153fe0 msgr2=0x7f22501ed090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:54.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.446+0000 7f2247fff640 1 --2- 172.21.15.60:0/1721659792 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2250153fe0 0x7f22501ed090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:54.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.446+0000 7f2247fff640 1 -- 172.21.15.60:0/1721659792 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22501509c0 con 0x7f225014df40 2024-09-12T02:23:54.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.446+0000 7f224ed9d640 1 --2- 172.21.15.60:0/1721659792 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2250153fe0 0x7f22501ed090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:23:54.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.446+0000 7f2247fff640 1 --2- 172.21.15.60:0/1721659792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f225014df40 0x7f22501e1170 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2250073e50 tx=0x7f223800b8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:54.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.446+0000 7f2246ffd640 1 -- 172.21.15.60:0/1721659792 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2238003d70 con 0x7f225014df40 2024-09-12T02:23:54.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.447+0000 7f2246ffd640 1 -- 172.21.15.60:0/1721659792 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2238005070 con 0x7f225014df40 2024-09-12T02:23:54.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.447+0000 7f2254a17640 1 -- 172.21.15.60:0/1721659792 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22501dff90 con 0x7f225014df40 2024-09-12T02:23:54.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.447+0000 7f2246ffd640 1 -- 172.21.15.60:0/1721659792 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2238005420 con 0x7f225014df40 2024-09-12T02:23:54.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.447+0000 7f2254a17640 1 -- 172.21.15.60:0/1721659792 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2250148a70 con 0x7f225014df40 2024-09-12T02:23:54.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.447+0000 7f2254a17640 1 --2- 172.21.15.60:0/1721659792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2250147f70 0x7f225014e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:54.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.447+0000 7f2254a17640 1 -- 172.21.15.60:0/1721659792 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f22501528c0 con 0x7f2250147f70 2024-09-12T02:23:54.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.448+0000 7f224e59c640 1 --2- 172.21.15.60:0/1721659792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2250147f70 0x7f225014e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:54.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.448+0000 7f224e59c640 1 -- 172.21.15.60:0/1721659792 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f22501525e0 con 0x7f2250147f70 2024-09-12T02:23:54.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.448+0000 7f2246ffd640 1 -- 172.21.15.60:0/1721659792 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f22380055c0 con 0x7f225014df40 2024-09-12T02:23:54.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.448+0000 7f224e59c640 1 --2- 172.21.15.60:0/1721659792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2250147f70 0x7f225014e320 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f22500c7690 tx=0x7f22400046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:54.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.449+0000 7f2246ffd640 1 --2- 172.21.15.60:0/1721659792 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f223006bde0 0x7f223006e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:54.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.449+0000 7f2246ffd640 1 -- 172.21.15.60:0/1721659792 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6521+0+0 (secure 0 0 0) 0x7f223808abf0 con 0x7f225014df40 2024-09-12T02:23:54.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.449+0000 7f224ed9d640 1 --2- 172.21.15.60:0/1721659792 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f223006bde0 0x7f223006e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:54.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.449+0000 7f2246ffd640 1 -- 172.21.15.60:0/1721659792 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2240037040 con 0x7f2250147f70 2024-09-12T02:23:54.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.449+0000 7f2246ffd640 1 -- 172.21.15.60:0/1721659792 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f2240004020 con 0x7f2250147f70 2024-09-12T02:23:54.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.449+0000 7f2246ffd640 1 -- 172.21.15.60:0/1721659792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2250147f70 msgr2=0x7f225014e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:54.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.449+0000 7f2246ffd640 1 --2- 172.21.15.60:0/1721659792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2250147f70 0x7f225014e320 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f22500c7690 tx=0x7f22400046c0 comp rx=0 tx=0).stop 2024-09-12T02:23:54.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.449+0000 7f2246ffd640 1 -- 172.21.15.60:0/1721659792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2250147f70 msgr2=0x7f225014e320 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:23:54.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.449+0000 7f2246ffd640 1 --2- 172.21.15.60:0/1721659792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2250147f70 0x7f225014e320 secure :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f22500c7690 tx=0x7f22400046c0 comp rx=0 tx=0).stop 2024-09-12T02:23:54.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.449+0000 7f224ed9d640 1 --2- 172.21.15.60:0/1721659792 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f223006bde0 0x7f223006e2a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f224800b7a0 tx=0x7f224800d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:54.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.455+0000 7f2254a17640 1 --2- 172.21.15.60:0/1721659792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2250147390 0x7f2250147770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:23:54.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.455+0000 7f2254a17640 1 -- 172.21.15.60:0/1721659792 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2250150be0 con 0x7f2250147390 2024-09-12T02:23:54.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.455+0000 7f224e59c640 1 --2- 172.21.15.60:0/1721659792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2250147390 0x7f2250147770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:23:54.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.456+0000 7f224e59c640 1 -- 172.21.15.60:0/1721659792 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f22501dfc90 con 0x7f2250147390 2024-09-12T02:23:54.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.456+0000 7f224e59c640 1 --2- 172.21.15.60:0/1721659792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2250147390 0x7f2250147770 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2240000c00 tx=0x7f2240008030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:23:54.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.456+0000 7f2246ffd640 1 -- 172.21.15.60:0/1721659792 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2240037040 con 0x7f2250147390 2024-09-12T02:23:54.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.456+0000 7f2246ffd640 1 -- 172.21.15.60:0/1721659792 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4871 (secure 0 0 0) 0x7f2240047230 con 0x7f2250147390 2024-09-12T02:23:54.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.456+0000 7f2246ffd640 1 -- 172.21.15.60:0/1721659792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2250147390 msgr2=0x7f2250147770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:54.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.456+0000 7f2246ffd640 1 --2- 172.21.15.60:0/1721659792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2250147390 0x7f2250147770 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2240000c00 tx=0x7f2240008030 comp rx=0 tx=0).stop 2024-09-12T02:23:54.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.456+0000 7f2246ffd640 1 -- 172.21.15.60:0/1721659792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2250147390 msgr2=0x7f2250147770 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:23:54.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.456+0000 7f2246ffd640 1 --2- 172.21.15.60:0/1721659792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2250147390 0x7f2250147770 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:23:54.458 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:23:54.458 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:23:54.458 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:23:54.458 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:23:54.458 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 12, 2024-09-12T02:23:54.458 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 79772, 2024-09-12T02:23:54.458 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:23:54.458 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:23:54.458 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:23:54.458 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:23:54.458 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-09-12T02:23:54.458 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:23:54.459 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:23:54.459 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:23:54.459 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:23:54.459 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:23:54.459 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:23:54.459 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:23:54.459 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:23:54.459 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:23:54.459 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:23:54.459 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:23:54.459 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:23:54.459 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:23:54.459 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:23:54.460 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:23:54.460 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:23:54.460 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:23:54.460 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:23:54.460 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:23:54.460 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:23:54.460 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:23:54.460 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:23:54.460 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:23:54.460 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:23:54.460 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:23:54.460 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:23:54.460 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:23:54.461 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:23:54.461 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:23:54.461 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:54.461 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:23:54.461 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:23:54.461 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:23:54.461 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:23:54.461 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:23:54.461 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:23:54.461 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:23:54.461 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:23:54.461 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:23:54.461 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:23:54.462 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:23:54.462 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:23:54.462 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:23:54.462 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:23:54.462 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:23:54.462 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:23:54.462 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:23:54.462 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:23:54.462 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:23:54.462 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:23:54.462 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:23:54.462 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:23:54.462 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:23:54.463 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:23:54.463 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:23:54.463 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:23:54.463 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:23:54.463 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:23:54.463 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:23:54.463 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:23:54.463 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:54.463 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:23:54.463 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:54.463 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:23:54.463 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:23:54.463 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:23:54.463 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:23:54.464 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:54.464 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:23:54.464 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:23:54.464 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:23:54.464 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:54.464 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:54.464 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:23:54.464 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:23:54.464 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:23:54.464 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:23:54.464 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:23:54.464 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:54.464 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:23:54.465 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:23:54.465 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:23:54.465 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:23:54.465 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:23:54.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:54.465 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:54.465 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:23:54.465 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:23:54.465 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:23:54.466 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:23:54.466 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:54.466 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:23:54.466 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:23:54.466 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:23:54.466 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:54.466 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:54.466 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:23:54.466 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:23:54.466 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:23:54.466 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:23:54.466 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:23:54.466 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:54.467 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:23:54.467 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:23:54.467 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:23:54.467 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:23:54.467 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:23:54.467 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:54.467 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:54.467 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:23:54.467 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:23:54.467 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:23:54.467 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:23:54.467 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:54.467 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:23:54.467 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:23:54.468 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:23:54.468 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:54.468 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:54.468 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:23:54.468 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:23:54.468 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:23:54.468 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:23:54.468 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:23:54.468 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:54.468 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:23:54.468 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:23:54.468 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:23:54.468 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:23:54.468 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:23:54.469 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:23:54.469 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:23:54.469 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:54.469 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:23:54.469 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:23:54.469 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:54.469 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:23:54.469 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:23:54.469 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:23:54.469 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:23:54.469 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:23:54.469 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:23:54.469 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:54.470 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:23:54.470 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:23:54.470 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:23:54.470 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:23:54.470 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:23:54.470 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:23:54.470 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:54.470 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:23:54.470 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:23:54.470 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:23:54.470 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:23:54.470 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:23:54.470 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:23:54.470 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:23:54.471 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:23:54.471 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:23:54.471 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:23:54.471 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:23:54.471 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:23:54.471 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:23:54.471 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:23:54.471 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:23:54.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.457+0000 7f2254a17640 1 -- 172.21.15.60:0/1721659792 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f223006bde0 msgr2=0x7f223006e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:54.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.457+0000 7f2254a17640 1 --2- 172.21.15.60:0/1721659792 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f223006bde0 0x7f223006e2a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f224800b7a0 tx=0x7f224800d040 comp rx=0 tx=0).stop 2024-09-12T02:23:54.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.457+0000 7f2254a17640 1 -- 172.21.15.60:0/1721659792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f225014df40 msgr2=0x7f22501e1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:23:54.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.457+0000 7f2254a17640 1 --2- 172.21.15.60:0/1721659792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f225014df40 0x7f22501e1170 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2250073e50 tx=0x7f223800b8e0 comp rx=0 tx=0).stop 2024-09-12T02:23:54.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.457+0000 7f224ed9d640 1 -- 172.21.15.60:0/1721659792 reap_dead start 2024-09-12T02:23:54.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.457+0000 7f224ed9d640 1 -- 172.21.15.60:0/1721659792 reap_dead start 2024-09-12T02:23:54.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.457+0000 7f2254a17640 1 -- 172.21.15.60:0/1721659792 shutdown_connections 2024-09-12T02:23:54.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.457+0000 7f2254a17640 1 -- 172.21.15.60:0/1721659792 >> 172.21.15.60:0/1721659792 conn(0x7f22500c9ad0 msgr2=0x7f2250154540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:23:54.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.457+0000 7f2254a17640 1 -- 172.21.15.60:0/1721659792 shutdown_connections 2024-09-12T02:23:54.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:23:54.457+0000 7f2254a17640 1 -- 172.21.15.60:0/1721659792 wait complete. 2024-09-12T02:23:54.473 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-12T02:23:54.473 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-12T02:23:55.980 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:23:55.982 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:24:14.475 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-09-12T02:24:14.475 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-09-12T02:24:14.476 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T02:24:14.476 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T02:24:14.479 INFO:tasks.ceph.mon.b:Started 2024-09-12T02:24:14.479 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-12T02:24:14.480 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:24:14.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.585+0000 7f7583978640 1 Processor -- start 2024-09-12T02:24:14.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.585+0000 7f7583978640 1 -- start start 2024-09-12T02:24:14.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.586+0000 7f7583978640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f757c0c8b10 0x7f757c15a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:14.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.586+0000 7f7583978640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f757c0c7070 con 0x7f757c06cd80 2024-09-12T02:24:14.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.586+0000 7f7583978640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f757c06d210 con 0x7f757c153be0 2024-09-12T02:24:14.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.586+0000 7f7583978640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f757c0c69b0 con 0x7f757c0c8b10 2024-09-12T02:24:14.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.586+0000 7f7581714640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f757c0c8b10 0x7f757c15a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:14.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.586+0000 7f7581f15640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f757c153be0 0x7f757c156660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:46264/0 (socket says 172.21.15.60:46264) 2024-09-12T02:24:14.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.586+0000 7f7581f15640 1 -- 172.21.15.60:0/3704750793 learned_addr learned my addr 172.21.15.60:0/3704750793 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:24:14.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.587+0000 7f7581714640 1 -- 172.21.15.60:0/3704750793 >> v1:172.21.15.105:6789/0 conn(0x7f757c153be0 legacy=0x7f757c156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:14.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.587+0000 7f7581714640 1 -- 172.21.15.60:0/3704750793 >> v1:172.21.15.60:6789/0 conn(0x7f757c06cd80 legacy=0x7f757c1534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:14.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.587+0000 7f7581714640 1 -- 172.21.15.60:0/3704750793 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f757c0c6c90 con 0x7f757c0c8b10 2024-09-12T02:24:14.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.588+0000 7f7581714640 1 --2- 172.21.15.60:0/3704750793 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f757c0c8b10 0x7f757c15a4a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f75780097a0 tx=0x7f757802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cac482662b8b43f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:14.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.588+0000 7f7573fff640 1 -- 172.21.15.60:0/3704750793 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7578037070 con 0x7f757c0c8b10 2024-09-12T02:24:14.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.588+0000 7f7573fff640 1 -- 172.21.15.60:0/3704750793 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7578032440 con 0x7f757c0c8b10 2024-09-12T02:24:14.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.588+0000 7f7573fff640 1 -- 172.21.15.60:0/3704750793 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7578037070 con 0x7f757c0c8b10 2024-09-12T02:24:14.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.588+0000 7f7583978640 1 -- 172.21.15.60:0/3704750793 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f757c0c8b10 msgr2=0x7f757c15a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:14.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.588+0000 7f7583978640 1 --2- 172.21.15.60:0/3704750793 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f757c0c8b10 0x7f757c15a4a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f75780097a0 tx=0x7f757802a1a0 comp rx=0 tx=0).stop 2024-09-12T02:24:14.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.589+0000 7f7583978640 1 -- 172.21.15.60:0/3704750793 shutdown_connections 2024-09-12T02:24:14.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.589+0000 7f7583978640 1 --2- 172.21.15.60:0/3704750793 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f757c0c8b10 0x7f757c15a4a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:14.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.589+0000 7f7583978640 1 -- 172.21.15.60:0/3704750793 >> 172.21.15.60:0/3704750793 conn(0x7f757c0adb80 msgr2=0x7f757c0adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:24:14.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.589+0000 7f7583978640 1 -- 172.21.15.60:0/3704750793 shutdown_connections 2024-09-12T02:24:14.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.589+0000 7f7583978640 1 -- 172.21.15.60:0/3704750793 wait complete. 2024-09-12T02:24:14.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.590+0000 7f7583978640 1 Processor -- start 2024-09-12T02:24:14.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.590+0000 7f7583978640 1 -- start start 2024-09-12T02:24:14.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.591+0000 7f7583978640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f757c0c8b10 0x7f757c0b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:14.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.591+0000 7f7583978640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f757c153be0 0x7f757c14b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:14.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.591+0000 7f7583978640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f757c14f9c0 0x7f757c1ef380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:14.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.591+0000 7f7583978640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f757c0c9070 con 0x7f757c0c8b10 2024-09-12T02:24:14.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.591+0000 7f7583978640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f757c0c8ef0 con 0x7f757c14f9c0 2024-09-12T02:24:14.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.591+0000 7f7583978640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f757c156d70 con 0x7f757c153be0 2024-09-12T02:24:14.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.592+0000 7f7581714640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f757c0c8b10 0x7f757c0b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:14.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.592+0000 7f7581f15640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f757c14f9c0 0x7f757c1ef380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:14.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.592+0000 7f7581714640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f757c0c8b10 0x7f757c0b1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49332/0 (socket says 172.21.15.60:49332) 2024-09-12T02:24:14.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.592+0000 7f7581714640 1 -- 172.21.15.60:0/1137749686 learned_addr learned my addr 172.21.15.60:0/1137749686 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:24:14.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.592+0000 7f7580f13640 1 --2- 172.21.15.60:0/1137749686 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f757c153be0 0x7f757c14b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:14.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.592+0000 7f7581f15640 1 -- 172.21.15.60:0/1137749686 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f757c14f9c0 msgr2=0x7f757c1ef380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-12T02:24:14.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.592+0000 7f7581f15640 1 -- 172.21.15.60:0/1137749686 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f757c14f9c0 msgr2=0x7f757c1ef380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:24:14.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.592+0000 7f7581f15640 1 --2- 172.21.15.60:0/1137749686 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f757c14f9c0 0x7f757c1ef380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:24:14.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.592+0000 7f7581f15640 1 --2- 172.21.15.60:0/1137749686 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f757c14f9c0 0x7f757c1ef380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:24:14.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.592+0000 7f7581714640 1 -- 172.21.15.60:0/1137749686 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f757c153be0 msgr2=0x7f757c14b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:14.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.592+0000 7f7581714640 1 --2- 172.21.15.60:0/1137749686 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f757c153be0 0x7f757c14b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:14.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.592+0000 7f7581714640 1 -- 172.21.15.60:0/1137749686 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f757c14f9c0 msgr2=0x7f757c1ef380 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:24:14.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.592+0000 7f7581714640 1 --2- 172.21.15.60:0/1137749686 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f757c14f9c0 0x7f757c1ef380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:14.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.592+0000 7f7581714640 1 -- 172.21.15.60:0/1137749686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f757c0b1740 con 0x7f757c0c8b10 2024-09-12T02:24:14.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.592+0000 7f7581714640 1 --2- 172.21.15.60:0/1137749686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f757c0c8b10 0x7f757c0b1b60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f757802a1e0 tx=0x7f75780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:14.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.593+0000 7f7571ffb640 1 -- 172.21.15.60:0/1137749686 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7578041030 con 0x7f757c0c8b10 2024-09-12T02:24:14.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.593+0000 7f7571ffb640 1 -- 172.21.15.60:0/1137749686 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7578030980 con 0x7f757c0c8b10 2024-09-12T02:24:14.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.593+0000 7f7583978640 1 -- 172.21.15.60:0/1137749686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f757c1ecbd0 con 0x7f757c0c8b10 2024-09-12T02:24:14.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.593+0000 7f7571ffb640 1 -- 172.21.15.60:0/1137749686 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7578037070 con 0x7f757c0c8b10 2024-09-12T02:24:14.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.593+0000 7f7583978640 1 -- 172.21.15.60:0/1137749686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f757c14b7b0 con 0x7f757c0c8b10 2024-09-12T02:24:14.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.594+0000 7f7583978640 1 -- 172.21.15.60:0/1137749686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f757c1570d0 con 0x7f757c0c8b10 2024-09-12T02:24:14.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.595+0000 7f7571ffb640 1 -- 172.21.15.60:0/1137749686 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7578044070 con 0x7f757c0c8b10 2024-09-12T02:24:14.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.596+0000 7f7571ffb640 1 --2- 172.21.15.60:0/1137749686 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f756006be30 0x7f756006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:14.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.596+0000 7f7571ffb640 1 -- 172.21.15.60:0/1137749686 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f75780ab9f0 con 0x7f757c0c8b10 2024-09-12T02:24:14.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.597+0000 7f7580f13640 1 --2- 172.21.15.60:0/1137749686 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f756006be30 0x7f756006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:14.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.597+0000 7f7580f13640 1 --2- 172.21.15.60:0/1137749686 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f756006be30 0x7f756006e2f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f757c0b20a0 tx=0x7f756c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:14.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.605+0000 7f7571ffb640 1 -- 172.21.15.60:0/1137749686 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7578032e20 con 0x7f757c0c8b10 2024-09-12T02:24:14.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.851+0000 7f7583978640 1 -- 172.21.15.60:0/1137749686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f757c0b2160 con 0x7f757c0c8b10 2024-09-12T02:24:14.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.852+0000 7f7571ffb640 1 -- 172.21.15.60:0/1137749686 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7f7578079ff0 con 0x7f757c0c8b10 2024-09-12T02:24:14.852 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:24:14.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.855+0000 7f7583978640 1 -- 172.21.15.60:0/1137749686 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f756006be30 msgr2=0x7f756006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:14.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.855+0000 7f7583978640 1 --2- 172.21.15.60:0/1137749686 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f756006be30 0x7f756006e2f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f757c0b20a0 tx=0x7f756c009040 comp rx=0 tx=0).stop 2024-09-12T02:24:14.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.855+0000 7f7583978640 1 -- 172.21.15.60:0/1137749686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f757c0c8b10 msgr2=0x7f757c0b1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:14.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.855+0000 7f7583978640 1 --2- 172.21.15.60:0/1137749686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f757c0c8b10 0x7f757c0b1b60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f757802a1e0 tx=0x7f75780046c0 comp rx=0 tx=0).stop 2024-09-12T02:24:14.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.855+0000 7f7583978640 1 -- 172.21.15.60:0/1137749686 shutdown_connections 2024-09-12T02:24:14.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.855+0000 7f7583978640 1 --2- 172.21.15.60:0/1137749686 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f756006be30 0x7f756006e2f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:14.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.855+0000 7f7583978640 1 --2- 172.21.15.60:0/1137749686 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f757c14f9c0 0x7f757c1ef380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:14.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.855+0000 7f7583978640 1 --2- 172.21.15.60:0/1137749686 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f757c153be0 0x7f757c14b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:14.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.855+0000 7f7583978640 1 --2- 172.21.15.60:0/1137749686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f757c0c8b10 0x7f757c0b1b60 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:14.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.855+0000 7f7583978640 1 -- 172.21.15.60:0/1137749686 >> 172.21.15.60:0/1137749686 conn(0x7f757c0adb80 msgr2=0x7f757c1494c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:24:14.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.855+0000 7f7583978640 1 -- 172.21.15.60:0/1137749686 shutdown_connections 2024-09-12T02:24:14.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.855+0000 7f7583978640 1 -- 172.21.15.60:0/1137749686 wait complete. 2024-09-12T02:24:14.869 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-12T02:24:14.869 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-12T02:24:14.870 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-12T02:24:14.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.974+0000 7fb9a9f8d640 1 Processor -- start 2024-09-12T02:24:14.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.975+0000 7fb9a9f8d640 1 -- start start 2024-09-12T02:24:14.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.976+0000 7fb9a9f8d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9a4150480 0x7fb9a40c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:14.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.976+0000 7fb9a9f8d640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9a415a7c0 con 0x7fb9a406c650 2024-09-12T02:24:14.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.976+0000 7fb9a9f8d640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9a4159a00 con 0x7fb9a40ca390 2024-09-12T02:24:14.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.976+0000 7fb9a9f8d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb9a406c240 con 0x7fb9a4150480 2024-09-12T02:24:14.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.976+0000 7fb99bfff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb9a406c650 0x7fb9a40c9c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:35222/0 (socket says 172.21.15.60:35222) 2024-09-12T02:24:14.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.976+0000 7fb99bfff640 1 -- 172.21.15.60:0/1480477759 learned_addr learned my addr 172.21.15.60:0/1480477759 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:24:14.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.976+0000 7fb9a37fe640 1 --2- 172.21.15.60:0/1480477759 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9a4150480 0x7fb9a40c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:14.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.976+0000 7fb9a2ffd640 1 -- 172.21.15.60:0/1480477759 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4078146755 0 0) 0x7fb9a415a7c0 con 0x7fb9a406c650 2024-09-12T02:24:14.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.977+0000 7fb9a2ffd640 1 -- 172.21.15.60:0/1480477759 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb990003520 con 0x7fb9a406c650 2024-09-12T02:24:14.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.977+0000 7fb9a37fe640 1 -- 172.21.15.60:0/1480477759 >> v1:172.21.15.105:6789/0 conn(0x7fb9a40ca390 legacy=0x7fb9a4160bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:14.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.977+0000 7fb9a37fe640 1 -- 172.21.15.60:0/1480477759 >> v1:172.21.15.60:6789/0 conn(0x7fb9a406c650 legacy=0x7fb9a40c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:14.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.977+0000 7fb9a37fe640 1 -- 172.21.15.60:0/1480477759 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9a4159ce0 con 0x7fb9a4150480 2024-09-12T02:24:14.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.978+0000 7fb9a37fe640 1 --2- 172.21.15.60:0/1480477759 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9a4150480 0x7fb9a40c7a90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb9940097d0 tx=0x7fb99402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99951347adf7d3e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:14.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.986+0000 7fb9a2ffd640 1 -- 172.21.15.60:0/1480477759 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb994037070 con 0x7fb9a4150480 2024-09-12T02:24:14.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.986+0000 7fb9a2ffd640 1 -- 172.21.15.60:0/1480477759 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb994032440 con 0x7fb9a4150480 2024-09-12T02:24:14.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.986+0000 7fb9a2ffd640 1 -- 172.21.15.60:0/1480477759 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb994032810 con 0x7fb9a4150480 2024-09-12T02:24:14.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.986+0000 7fb9a9f8d640 1 -- 172.21.15.60:0/1480477759 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9a4150480 msgr2=0x7fb9a40c7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:14.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.986+0000 7fb9a9f8d640 1 --2- 172.21.15.60:0/1480477759 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9a4150480 0x7fb9a40c7a90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb9940097d0 tx=0x7fb99402a210 comp rx=0 tx=0).stop 2024-09-12T02:24:14.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.986+0000 7fb9a9f8d640 1 -- 172.21.15.60:0/1480477759 shutdown_connections 2024-09-12T02:24:14.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.986+0000 7fb9a9f8d640 1 --2- 172.21.15.60:0/1480477759 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9a4150480 0x7fb9a40c7a90 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:14.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.986+0000 7fb9a9f8d640 1 -- 172.21.15.60:0/1480477759 >> 172.21.15.60:0/1480477759 conn(0x7fb9a4068030 msgr2=0x7fb9a4073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:24:14.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.986+0000 7fb9a9f8d640 1 -- 172.21.15.60:0/1480477759 shutdown_connections 2024-09-12T02:24:14.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.986+0000 7fb9a9f8d640 1 -- 172.21.15.60:0/1480477759 wait complete. 2024-09-12T02:24:14.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.988+0000 7fb9a9f8d640 1 Processor -- start 2024-09-12T02:24:14.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.988+0000 7fb9a9f8d640 1 -- start start 2024-09-12T02:24:14.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.988+0000 7fb9a9f8d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb9a406c650 0x7fb9a41efe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:14.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.988+0000 7fb9a9f8d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9a40ca390 0x7fb9a40afda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:14.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.988+0000 7fb9a9f8d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9a4150480 0x7fb9a414ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:14.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.988+0000 7fb9a9f8d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a406d270 con 0x7fb9a40ca390 2024-09-12T02:24:14.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.988+0000 7fb9a9f8d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a415a330 con 0x7fb9a406c650 2024-09-12T02:24:14.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.988+0000 7fb9a9f8d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb9a4156270 con 0x7fb9a4150480 2024-09-12T02:24:14.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.988+0000 7fb99bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9a40ca390 0x7fb9a40afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:14.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.988+0000 7fb9a3fff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9a4150480 0x7fb9a414ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:14.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.989+0000 7fb9a37fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb9a406c650 0x7fb9a41efe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:14.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.989+0000 7fb9a3fff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9a4150480 0x7fb9a414ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:37670/0 (socket says 172.21.15.60:37670) 2024-09-12T02:24:14.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.989+0000 7fb9a3fff640 1 -- 172.21.15.60:0/1829977422 learned_addr learned my addr 172.21.15.60:0/1829977422 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:24:14.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.989+0000 7fb99bfff640 1 -- 172.21.15.60:0/1829977422 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9a4150480 msgr2=0x7fb9a414ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:14.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.989+0000 7fb99bfff640 1 --2- 172.21.15.60:0/1829977422 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9a4150480 0x7fb9a414ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:14.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.989+0000 7fb99bfff640 1 -- 172.21.15.60:0/1829977422 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb9a406c650 msgr2=0x7fb9a41efe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:14.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.989+0000 7fb99bfff640 1 --2- 172.21.15.60:0/1829977422 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb9a406c650 0x7fb9a41efe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:14.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.989+0000 7fb99bfff640 1 -- 172.21.15.60:0/1829977422 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9a40b08b0 con 0x7fb9a40ca390 2024-09-12T02:24:14.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.989+0000 7fb9a3fff640 1 --2- 172.21.15.60:0/1829977422 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9a4150480 0x7fb9a414ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:24:14.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.989+0000 7fb9a37fe640 1 --2- 172.21.15.60:0/1829977422 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb9a406c650 0x7fb9a41efe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:24:14.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.989+0000 7fb99bfff640 1 --2- 172.21.15.60:0/1829977422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9a40ca390 0x7fb9a40afda0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb9a40c6110 tx=0x7fb98c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:14.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.989+0000 7fb9a0ff9640 1 -- 172.21.15.60:0/1829977422 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98c017070 con 0x7fb9a40ca390 2024-09-12T02:24:14.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.989+0000 7fb9a0ff9640 1 -- 172.21.15.60:0/1829977422 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb98c005ce0 con 0x7fb9a40ca390 2024-09-12T02:24:14.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.989+0000 7fb9a9f8d640 1 -- 172.21.15.60:0/1829977422 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9a414fda0 con 0x7fb9a40ca390 2024-09-12T02:24:14.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.989+0000 7fb9a0ff9640 1 -- 172.21.15.60:0/1829977422 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98c0072f0 con 0x7fb9a40ca390 2024-09-12T02:24:14.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.990+0000 7fb9a9f8d640 1 -- 172.21.15.60:0/1829977422 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9a4151280 con 0x7fb9a40ca390 2024-09-12T02:24:14.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.992+0000 7fb999ffb640 1 --2- 172.21.15.60:0/1829977422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb988002a70 0x7fb988004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:14.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.992+0000 7fb999ffb640 1 -- 172.21.15.60:0/1829977422 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb988007ec0 con 0x7fb988002a70 2024-09-12T02:24:14.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.992+0000 7fb9a0ff9640 1 -- 172.21.15.60:0/1829977422 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb98c01a070 con 0x7fb9a40ca390 2024-09-12T02:24:14.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.992+0000 7fb9a37fe640 1 --2- 172.21.15.60:0/1829977422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb988002a70 0x7fb988004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:14.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.992+0000 7fb9a37fe640 1 -- 172.21.15.60:0/1829977422 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb9880080c0 con 0x7fb988002a70 2024-09-12T02:24:14.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.992+0000 7fb9a0ff9640 1 --2- 172.21.15.60:0/1829977422 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb98406beb0 0x7fb98406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:14.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.992+0000 7fb9a0ff9640 1 -- 172.21.15.60:0/1829977422 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fb98c08a290 con 0x7fb9a40ca390 2024-09-12T02:24:14.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.992+0000 7fb9a3fff640 1 --2- 172.21.15.60:0/1829977422 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb98406beb0 0x7fb98406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:14.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.993+0000 7fb9a37fe640 1 --2- 172.21.15.60:0/1829977422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb988002a70 0x7fb988004f30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb9a40cc830 tx=0x7fb9940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:14.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.993+0000 7fb9a3fff640 1 --2- 172.21.15.60:0/1829977422 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb98406beb0 0x7fb98406e370 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb9a41501c0 tx=0x7fb99c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:14.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.993+0000 7fb9a0ff9640 1 -- 172.21.15.60:0/1829977422 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb994037040 con 0x7fb988002a70 2024-09-12T02:24:14.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.994+0000 7fb9a0ff9640 1 -- 172.21.15.60:0/1829977422 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fb994032440 con 0x7fb988002a70 2024-09-12T02:24:14.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.994+0000 7fb9a0ff9640 1 -- 172.21.15.60:0/1829977422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb988002a70 msgr2=0x7fb988004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:14.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.994+0000 7fb9a0ff9640 1 --2- 172.21.15.60:0/1829977422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb988002a70 0x7fb988004f30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb9a40cc830 tx=0x7fb9940046c0 comp rx=0 tx=0).stop 2024-09-12T02:24:14.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.994+0000 7fb9a0ff9640 1 -- 172.21.15.60:0/1829977422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb988002a70 msgr2=0x7fb988004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:24:14.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:14.994+0000 7fb9a0ff9640 1 --2- 172.21.15.60:0/1829977422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb988002a70 0x7fb988004f30 secure :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb9a40cc830 tx=0x7fb9940046c0 comp rx=0 tx=0).stop 2024-09-12T02:24:15.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.006+0000 7fb999ffb640 1 --2- 172.21.15.60:0/1829977422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb988006eb0 0x7fb988007340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:15.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.006+0000 7fb999ffb640 1 -- 172.21.15.60:0/1829977422 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb98800a4a0 con 0x7fb988006eb0 2024-09-12T02:24:15.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.006+0000 7fb9a37fe640 1 --2- 172.21.15.60:0/1829977422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb988006eb0 0x7fb988007340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:15.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.007+0000 7fb9a37fe640 1 -- 172.21.15.60:0/1829977422 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb988007880 con 0x7fb988006eb0 2024-09-12T02:24:15.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.007+0000 7fb9a37fe640 1 --2- 172.21.15.60:0/1829977422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb988006eb0 0x7fb988007340 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb994009720 tx=0x7fb994008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:15.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.007+0000 7fb9a0ff9640 1 -- 172.21.15.60:0/1829977422 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb994037070 con 0x7fb988006eb0 2024-09-12T02:24:15.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.007+0000 7fb9a0ff9640 1 -- 172.21.15.60:0/1829977422 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5052 (secure 0 0 0) 0x7fb994003690 con 0x7fb988006eb0 2024-09-12T02:24:15.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.007+0000 7fb9a0ff9640 1 -- 172.21.15.60:0/1829977422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb988006eb0 msgr2=0x7fb988007340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:15.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.007+0000 7fb9a0ff9640 1 --2- 172.21.15.60:0/1829977422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb988006eb0 0x7fb988007340 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb994009720 tx=0x7fb994008030 comp rx=0 tx=0).stop 2024-09-12T02:24:15.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.007+0000 7fb9a0ff9640 1 -- 172.21.15.60:0/1829977422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb988006eb0 msgr2=0x7fb988007340 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:24:15.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.007+0000 7fb9a0ff9640 1 --2- 172.21.15.60:0/1829977422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb988006eb0 0x7fb988007340 secure :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb994009720 tx=0x7fb994008030 comp rx=0 tx=0).stop 2024-09-12T02:24:15.009 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:24:15.009 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:24:15.009 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:24:15.009 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:24:15.009 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 14, 2024-09-12T02:24:15.009 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 100361, 2024-09-12T02:24:15.010 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:24:15.010 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:24:15.010 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:24:15.010 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:24:15.010 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:15.010 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-09-12T02:24:15.010 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:24:15.010 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:24:15.010 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:24:15.011 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:24:15.011 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:24:15.011 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:24:15.011 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:24:15.011 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:24:15.011 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:24:15.011 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:24:15.011 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:24:15.011 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:24:15.011 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:24:15.011 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:24:15.011 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:15.011 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:24:15.012 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:24:15.012 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:24:15.012 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:24:15.012 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:24:15.012 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:24:15.012 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:24:15.012 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:24:15.012 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:24:15.012 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:24:15.012 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:24:15.012 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:24:15.012 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:24:15.013 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:15.013 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:15.013 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:24:15.013 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:24:15.013 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:24:15.013 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:24:15.013 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:24:15.013 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:24:15.013 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:24:15.013 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:24:15.013 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:24:15.013 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:24:15.013 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:24:15.014 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:24:15.014 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:24:15.014 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:24:15.014 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:24:15.014 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:24:15.014 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:24:15.014 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:24:15.014 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:24:15.014 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:24:15.014 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:24:15.014 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:24:15.014 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:24:15.014 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:24:15.015 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:24:15.015 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:24:15.015 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:24:15.015 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:24:15.015 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:15.015 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:24:15.015 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:15.015 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:24:15.015 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:15.015 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:24:15.015 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:24:15.015 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:24:15.016 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:24:15.016 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:15.016 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:24:15.016 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:24:15.016 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:15.016 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:15.016 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:15.016 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:24:15.016 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:24:15.016 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:15.016 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:15.016 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:15.016 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:15.017 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:24:15.017 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:24:15.017 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:24:15.017 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:24:15.017 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:24:15.017 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:15.017 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:15.017 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:24:15.017 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:24:15.017 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:24:15.017 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:24:15.017 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:15.017 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:24:15.018 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:24:15.018 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:15.018 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:15.018 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:15.018 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:24:15.018 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:24:15.018 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:15.018 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:15.018 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:15.018 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:15.018 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:24:15.018 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:24:15.018 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:24:15.019 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:24:15.019 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:24:15.019 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:15.019 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:15.019 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:24:15.019 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:24:15.019 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:24:15.019 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:24:15.019 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:15.020 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:24:15.020 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:24:15.020 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:15.020 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:15.020 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:15.020 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:24:15.020 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:24:15.020 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:15.020 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:15.020 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:15.020 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:15.021 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:24:15.021 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:24:15.021 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:24:15.021 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:24:15.021 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:24:15.021 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:15.021 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:15.021 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:15.021 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:24:15.021 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:24:15.021 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:15.021 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:24:15.021 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:24:15.021 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:24:15.022 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:15.022 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:15.022 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:24:15.022 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:15.022 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:24:15.022 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:24:15.022 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:24:15.022 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:15.022 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:15.022 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:24:15.022 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:15.022 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:24:15.022 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:24:15.023 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:24:15.023 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:15.023 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:15.023 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:24:15.023 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:15.023 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:24:15.023 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:24:15.023 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-09-12T02:24:15.023 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:15.023 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:15.023 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:24:15.023 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:15.023 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:24:15.024 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:24:15.024 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:24:15.024 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:15.024 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:15.024 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:15.024 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:24:15.024 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:24:15.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.008+0000 7fb999ffb640 1 -- 172.21.15.60:0/1829977422 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb98406beb0 msgr2=0x7fb98406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:15.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.008+0000 7fb999ffb640 1 --2- 172.21.15.60:0/1829977422 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb98406beb0 0x7fb98406e370 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb9a41501c0 tx=0x7fb99c009040 comp rx=0 tx=0).stop 2024-09-12T02:24:15.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.008+0000 7fb999ffb640 1 -- 172.21.15.60:0/1829977422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9a40ca390 msgr2=0x7fb9a40afda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:15.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.008+0000 7fb999ffb640 1 --2- 172.21.15.60:0/1829977422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9a40ca390 0x7fb9a40afda0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb9a40c6110 tx=0x7fb98c001e70 comp rx=0 tx=0).stop 2024-09-12T02:24:15.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.008+0000 7fb9a3fff640 1 -- 172.21.15.60:0/1829977422 reap_dead start 2024-09-12T02:24:15.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.008+0000 7fb9a3fff640 1 -- 172.21.15.60:0/1829977422 reap_dead start 2024-09-12T02:24:15.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.008+0000 7fb999ffb640 1 -- 172.21.15.60:0/1829977422 shutdown_connections 2024-09-12T02:24:15.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.008+0000 7fb999ffb640 1 -- 172.21.15.60:0/1829977422 >> 172.21.15.60:0/1829977422 conn(0x7fb9a4068030 msgr2=0x7fb9a41553a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:24:15.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.008+0000 7fb999ffb640 1 -- 172.21.15.60:0/1829977422 shutdown_connections 2024-09-12T02:24:15.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.008+0000 7fb999ffb640 1 -- 172.21.15.60:0/1829977422 wait complete. 2024-09-12T02:24:15.027 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:24:15.027 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-12T02:24:15.027 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-12T02:24:15.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.131+0000 7f9c02318640 1 Processor -- start 2024-09-12T02:24:15.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.131+0000 7f9c02318640 1 -- start start 2024-09-12T02:24:15.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.132+0000 7f9c02318640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9bfc073ae0 0x7f9bfc153380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:15.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.132+0000 7f9c02318640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9bfc156f50 0x7f9bfc1538c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:15.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.132+0000 7f9c02318640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bfc06dd50 con 0x7f9bfc0733d0 2024-09-12T02:24:15.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.132+0000 7f9c02318640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f9bfc06e030 con 0x7f9bfc073ae0 2024-09-12T02:24:15.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.132+0000 7f9c02318640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9bfc06e310 con 0x7f9bfc156f50 2024-09-12T02:24:15.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.132+0000 7f9bfbfff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9bfc073ae0 0x7f9bfc153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:15.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.133+0000 7f9bfbfff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9bfc073ae0 0x7f9bfc153380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49370/0 (socket says 172.21.15.60:49370) 2024-09-12T02:24:15.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.133+0000 7f9bfbfff640 1 -- 172.21.15.60:0/2578384536 learned_addr learned my addr 172.21.15.60:0/2578384536 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:24:15.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.133+0000 7f9c008b5640 1 --2- 172.21.15.60:0/2578384536 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9bfc156f50 0x7f9bfc1538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:15.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.133+0000 7f9bfbfff640 1 -- 172.21.15.60:0/2578384536 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9bfc156f50 msgr2=0x7f9bfc1538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:24:15.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.133+0000 7f9bfbfff640 1 --2- 172.21.15.60:0/2578384536 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9bfc156f50 0x7f9bfc1538c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:15.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.133+0000 7f9bfbfff640 1 -- 172.21.15.60:0/2578384536 >> v1:172.21.15.105:6789/0 conn(0x7f9bfc0733d0 legacy=0x7f9bfc156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:15.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.133+0000 7f9bfaffd640 1 -- 172.21.15.60:0/2578384536 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1811037506 0 0) 0x7f9bfc06dd50 con 0x7f9bfc0733d0 2024-09-12T02:24:15.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.133+0000 7f9bfbfff640 1 -- 172.21.15.60:0/2578384536 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bfc06e5f0 con 0x7f9bfc073ae0 2024-09-12T02:24:15.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.133+0000 7f9c008b5640 1 --2- 172.21.15.60:0/2578384536 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9bfc156f50 0x7f9bfc1538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:24:15.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.134+0000 7f9bfbfff640 1 --2- 172.21.15.60:0/2578384536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bfc073ae0 0x7f9bfc153380 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9bec009ad0 tx=0x7f9bec02a4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=379886311ec2997d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:15.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.134+0000 7f9bfaffd640 1 -- 172.21.15.60:0/2578384536 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bec036070 con 0x7f9bfc073ae0 2024-09-12T02:24:15.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.134+0000 7f9bfaffd640 1 -- 172.21.15.60:0/2578384536 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bec031600 con 0x7f9bfc073ae0 2024-09-12T02:24:15.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.134+0000 7f9bfaffd640 1 -- 172.21.15.60:0/2578384536 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bec0319d0 con 0x7f9bfc073ae0 2024-09-12T02:24:15.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.135+0000 7f9c02318640 1 -- 172.21.15.60:0/2578384536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bfc073ae0 msgr2=0x7f9bfc153380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:15.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.135+0000 7f9c02318640 1 --2- 172.21.15.60:0/2578384536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bfc073ae0 0x7f9bfc153380 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9bec009ad0 tx=0x7f9bec02a4c0 comp rx=0 tx=0).stop 2024-09-12T02:24:15.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.135+0000 7f9c02318640 1 -- 172.21.15.60:0/2578384536 shutdown_connections 2024-09-12T02:24:15.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.135+0000 7f9c02318640 1 --2- 172.21.15.60:0/2578384536 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9bfc156f50 0x7f9bfc1538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:15.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.135+0000 7f9c02318640 1 --2- 172.21.15.60:0/2578384536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bfc073ae0 0x7f9bfc153380 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:15.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.135+0000 7f9c02318640 1 -- 172.21.15.60:0/2578384536 >> 172.21.15.60:0/2578384536 conn(0x7f9bfc0c9d80 msgr2=0x7f9bfc0ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:24:15.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.135+0000 7f9c02318640 1 -- 172.21.15.60:0/2578384536 shutdown_connections 2024-09-12T02:24:15.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.136+0000 7f9c02318640 1 -- 172.21.15.60:0/2578384536 wait complete. 2024-09-12T02:24:15.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.137+0000 7f9c02318640 1 Processor -- start 2024-09-12T02:24:15.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.137+0000 7f9c02318640 1 -- start start 2024-09-12T02:24:15.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.138+0000 7f9c02318640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9bfc0733d0 0x7f9bfc15a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:15.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.138+0000 7f9c02318640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bfc073ae0 0x7f9bfc1eedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:15.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.138+0000 7f9c02318640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9bfc156f50 0x7f9bfc155340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:15.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.138+0000 7f9c02318640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9bfc06edd0 con 0x7f9bfc073ae0 2024-09-12T02:24:15.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.138+0000 7f9c02318640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9bfc06ec50 con 0x7f9bfc156f50 2024-09-12T02:24:15.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.138+0000 7f9c02318640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9bfc073ec0 con 0x7f9bfc0733d0 2024-09-12T02:24:15.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.138+0000 7f9bfbfff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9bfc0733d0 0x7f9bfc15a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:15.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.138+0000 7f9c008b5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9bfc156f50 0x7f9bfc155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:15.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.138+0000 7f9bfbfff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9bfc0733d0 0x7f9bfc15a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:37690/0 (socket says 172.21.15.60:37690) 2024-09-12T02:24:15.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.138+0000 7f9c008b5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9bfc156f50 0x7f9bfc155340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:57998/0 (socket says 172.21.15.60:57998) 2024-09-12T02:24:15.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.138+0000 7f9bfbfff640 1 -- 172.21.15.60:0/1097188118 learned_addr learned my addr 172.21.15.60:0/1097188118 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:24:15.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.138+0000 7f9bfb7fe640 1 --2- 172.21.15.60:0/1097188118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bfc073ae0 0x7f9bfc1eedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:15.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.139+0000 7f9bfbfff640 1 -- 172.21.15.60:0/1097188118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9bfc156f50 msgr2=0x7f9bfc155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:15.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.139+0000 7f9bfbfff640 1 --2- 172.21.15.60:0/1097188118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9bfc156f50 0x7f9bfc155340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:15.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.139+0000 7f9bfbfff640 1 -- 172.21.15.60:0/1097188118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bfc073ae0 msgr2=0x7f9bfc1eedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:15.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.139+0000 7f9bfbfff640 1 --2- 172.21.15.60:0/1097188118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bfc073ae0 0x7f9bfc1eedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:15.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.139+0000 7f9bfbfff640 1 -- 172.21.15.60:0/1097188118 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bfc14fa00 con 0x7f9bfc0733d0 2024-09-12T02:24:15.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.139+0000 7f9bfbfff640 1 --2- 172.21.15.60:0/1097188118 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9bfc0733d0 0x7f9bfc15a170 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9bec000c00 tx=0x7f9bec0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:15.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.139+0000 7f9bf8ff9640 1 -- 172.21.15.60:0/1097188118 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bec040070 con 0x7f9bfc0733d0 2024-09-12T02:24:15.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.139+0000 7f9bf8ff9640 1 -- 172.21.15.60:0/1097188118 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bec031df0 con 0x7f9bfc0733d0 2024-09-12T02:24:15.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.139+0000 7f9bf8ff9640 1 -- 172.21.15.60:0/1097188118 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bec036040 con 0x7f9bfc0733d0 2024-09-12T02:24:15.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.139+0000 7f9c02318640 1 -- 172.21.15.60:0/1097188118 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bfc14e3d0 con 0x7f9bfc0733d0 2024-09-12T02:24:15.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.140+0000 7f9c02318640 1 -- 172.21.15.60:0/1097188118 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bfc1ef330 con 0x7f9bfc0733d0 2024-09-12T02:24:15.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.141+0000 7f9c02318640 1 --2- 172.21.15.60:0/1097188118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9bfc14d890 0x7f9bfc155880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:15.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.141+0000 7f9c02318640 1 -- 172.21.15.60:0/1097188118 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9bfc14e9e0 con 0x7f9bfc14d890 2024-09-12T02:24:15.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.141+0000 7f9bfb7fe640 1 --2- 172.21.15.60:0/1097188118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9bfc14d890 0x7f9bfc155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:15.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.141+0000 7f9bfb7fe640 1 -- 172.21.15.60:0/1097188118 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9bfc06d3c0 con 0x7f9bfc14d890 2024-09-12T02:24:15.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.141+0000 7f9bfb7fe640 1 --2- 172.21.15.60:0/1097188118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9bfc14d890 0x7f9bfc155880 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc0c4090 tx=0x7f9bf000f9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:15.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.142+0000 7f9bf8ff9640 1 -- 172.21.15.60:0/1097188118 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf00052e0 con 0x7f9bfc14d890 2024-09-12T02:24:15.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.142+0000 7f9bf8ff9640 1 -- 172.21.15.60:0/1097188118 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9bec043070 con 0x7f9bfc0733d0 2024-09-12T02:24:15.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.142+0000 7f9bf8ff9640 1 --2- 172.21.15.60:0/1097188118 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9be806bd60 0x7f9be806e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:15.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.142+0000 7f9bf8ff9640 1 -- 172.21.15.60:0/1097188118 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f9bec0ab930 con 0x7f9bfc0733d0 2024-09-12T02:24:15.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.143+0000 7f9c008b5640 1 --2- 172.21.15.60:0/1097188118 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9be806bd60 0x7f9be806e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:15.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.143+0000 7f9bf8ff9640 1 -- 172.21.15.60:0/1097188118 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f9bf0018070 con 0x7f9bfc14d890 2024-09-12T02:24:15.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.143+0000 7f9bf8ff9640 1 -- 172.21.15.60:0/1097188118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9bfc14d890 msgr2=0x7f9bfc155880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:15.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.143+0000 7f9bf8ff9640 1 --2- 172.21.15.60:0/1097188118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9bfc14d890 0x7f9bfc155880 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc0c4090 tx=0x7f9bf000f9d0 comp rx=0 tx=0).stop 2024-09-12T02:24:15.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.143+0000 7f9bf8ff9640 1 -- 172.21.15.60:0/1097188118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9bfc14d890 msgr2=0x7f9bfc155880 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:24:15.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.143+0000 7f9bf8ff9640 1 --2- 172.21.15.60:0/1097188118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9bfc14d890 0x7f9bfc155880 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:15.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.143+0000 7f9c008b5640 1 --2- 172.21.15.60:0/1097188118 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9be806bd60 0x7f9be806e220 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc0c5480 tx=0x7f9bf400b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:15.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.154+0000 7f9c02318640 1 --2- 172.21.15.60:0/1097188118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9bfc1581b0 0x7f9bfc148b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:15.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.154+0000 7f9c02318640 1 -- 172.21.15.60:0/1097188118 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9bfc0708d0 con 0x7f9bfc1581b0 2024-09-12T02:24:15.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.154+0000 7f9bfb7fe640 1 --2- 172.21.15.60:0/1097188118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9bfc1581b0 0x7f9bfc148b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:15.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.155+0000 7f9bfb7fe640 1 -- 172.21.15.60:0/1097188118 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9bfc075900 con 0x7f9bfc1581b0 2024-09-12T02:24:15.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.155+0000 7f9bfb7fe640 1 --2- 172.21.15.60:0/1097188118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9bfc1581b0 0x7f9bfc148b60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0017000 tx=0x7f9bf0001080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:15.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.155+0000 7f9bf8ff9640 1 -- 172.21.15.60:0/1097188118 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf0003dd0 con 0x7f9bfc1581b0 2024-09-12T02:24:15.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.156+0000 7f9bf8ff9640 1 -- 172.21.15.60:0/1097188118 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4546 (secure 0 0 0) 0x7f9bf0003dd0 con 0x7f9bfc1581b0 2024-09-12T02:24:15.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.156+0000 7f9bf8ff9640 1 -- 172.21.15.60:0/1097188118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9bfc1581b0 msgr2=0x7f9bfc148b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:15.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.156+0000 7f9bf8ff9640 1 --2- 172.21.15.60:0/1097188118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9bfc1581b0 0x7f9bfc148b60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0017000 tx=0x7f9bf0001080 comp rx=0 tx=0).stop 2024-09-12T02:24:15.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.156+0000 7f9bf8ff9640 1 -- 172.21.15.60:0/1097188118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9bfc1581b0 msgr2=0x7f9bfc148b60 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:24:15.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.156+0000 7f9bf8ff9640 1 --2- 172.21.15.60:0/1097188118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9bfc1581b0 0x7f9bfc148b60 secure :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0017000 tx=0x7f9bf0001080 comp rx=0 tx=0).stop 2024-09-12T02:24:15.157 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:24:15.157 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:24:15.158 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:24:15.158 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:24:15.158 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 14, 2024-09-12T02:24:15.158 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 589, 2024-09-12T02:24:15.158 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:24:15.158 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:24:15.158 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:24:15.158 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:24:15.158 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:15.158 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-09-12T02:24:15.158 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:24:15.158 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:24:15.159 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:24:15.159 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:24:15.159 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:24:15.159 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:24:15.159 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:24:15.159 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:24:15.159 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:24:15.159 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:24:15.159 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:24:15.159 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:24:15.159 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:24:15.159 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:24:15.159 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:15.159 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:24:15.160 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:24:15.160 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:24:15.160 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:24:15.160 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:24:15.160 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:24:15.160 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:24:15.160 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:24:15.160 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:24:15.160 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:24:15.160 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:24:15.160 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:24:15.161 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:24:15.161 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:15.161 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:15.161 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:24:15.161 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:24:15.161 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:24:15.161 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:24:15.161 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:24:15.161 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:24:15.161 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:24:15.162 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:24:15.162 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:24:15.162 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:24:15.162 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:24:15.162 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:24:15.163 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:24:15.163 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:24:15.163 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:24:15.163 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:24:15.163 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:24:15.163 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:24:15.164 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:24:15.164 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:24:15.164 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:24:15.164 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:24:15.164 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:24:15.164 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:24:15.164 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:24:15.165 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:24:15.165 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:24:15.165 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:24:15.165 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:15.165 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:24:15.165 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:15.165 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:24:15.165 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:15.165 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:24:15.165 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:24:15.165 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:24:15.165 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:24:15.165 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:15.166 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:24:15.166 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:24:15.166 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:15.166 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:15.166 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:15.166 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:24:15.166 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:24:15.166 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:15.167 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:15.167 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:15.167 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:15.167 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:24:15.167 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:24:15.167 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:24:15.167 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:24:15.167 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:24:15.167 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:15.167 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:15.167 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:24:15.168 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:24:15.168 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:24:15.168 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:24:15.168 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:15.168 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:24:15.168 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:24:15.168 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:15.168 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:15.168 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:15.168 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:24:15.168 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:24:15.168 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:15.169 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:15.169 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:15.169 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:15.169 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:24:15.169 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:24:15.169 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:24:15.169 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:24:15.169 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:24:15.169 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:15.170 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:15.170 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:24:15.170 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:24:15.170 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:24:15.171 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:24:15.171 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:15.171 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:24:15.171 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:24:15.171 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:15.171 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:15.171 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:15.171 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:24:15.171 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:24:15.171 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:15.172 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:15.172 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:15.172 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:15.172 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:24:15.173 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:24:15.173 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:24:15.173 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:24:15.174 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:24:15.174 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:15.174 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:15.174 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:15.174 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:24:15.174 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:24:15.174 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:15.174 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:24:15.175 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:24:15.175 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:24:15.175 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:15.175 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:15.175 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:24:15.175 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:15.175 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:24:15.176 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:24:15.176 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:24:15.176 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:15.176 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:15.176 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:15.176 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:24:15.176 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:24:15.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.156+0000 7f9c02318640 1 -- 172.21.15.60:0/1097188118 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9be806bd60 msgr2=0x7f9be806e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:15.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.156+0000 7f9c02318640 1 --2- 172.21.15.60:0/1097188118 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9be806bd60 0x7f9be806e220 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc0c5480 tx=0x7f9bf400b040 comp rx=0 tx=0).stop 2024-09-12T02:24:15.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.156+0000 7f9c02318640 1 -- 172.21.15.60:0/1097188118 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9bfc0733d0 msgr2=0x7f9bfc15a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:15.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.156+0000 7f9c02318640 1 --2- 172.21.15.60:0/1097188118 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9bfc0733d0 0x7f9bfc15a170 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9bec000c00 tx=0x7f9bec0046c0 comp rx=0 tx=0).stop 2024-09-12T02:24:15.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.156+0000 7f9c008b5640 1 -- 172.21.15.60:0/1097188118 reap_dead start 2024-09-12T02:24:15.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.156+0000 7f9c008b5640 1 -- 172.21.15.60:0/1097188118 reap_dead start 2024-09-12T02:24:15.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.156+0000 7f9c02318640 1 -- 172.21.15.60:0/1097188118 shutdown_connections 2024-09-12T02:24:15.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.156+0000 7f9c02318640 1 -- 172.21.15.60:0/1097188118 >> 172.21.15.60:0/1097188118 conn(0x7f9bfc0c9d80 msgr2=0x7f9bfc0c5cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:24:15.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.156+0000 7f9c02318640 1 -- 172.21.15.60:0/1097188118 shutdown_connections 2024-09-12T02:24:15.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.156+0000 7f9c02318640 1 -- 172.21.15.60:0/1097188118 wait complete. 2024-09-12T02:24:15.179 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:24:15.180 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-12T02:24:15.180 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-12T02:24:15.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.283+0000 7f47d39d6640 1 Processor -- start 2024-09-12T02:24:15.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.284+0000 7f47d39d6640 1 -- start start 2024-09-12T02:24:15.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.284+0000 7f47d39d6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f47cc150480 0x7f47cc0c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:15.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.284+0000 7f47d39d6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47cc0ca390 0x7f47cc0c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:15.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.284+0000 7f47d39d6640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47cc15a7c0 con 0x7f47cc06c650 2024-09-12T02:24:15.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.284+0000 7f47d39d6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f47cc06c240 con 0x7f47cc150480 2024-09-12T02:24:15.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.284+0000 7f47d39d6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f47cc15a330 con 0x7f47cc0ca390 2024-09-12T02:24:15.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.285+0000 7f47d1772640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f47cc150480 0x7f47cc0c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:15.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.285+0000 7f47d1772640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f47cc150480 0x7f47cc0c7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49386/0 (socket says 172.21.15.60:49386) 2024-09-12T02:24:15.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.285+0000 7f47d1772640 1 -- 172.21.15.60:0/1988413017 learned_addr learned my addr 172.21.15.60:0/1988413017 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:24:15.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.285+0000 7f47d1f73640 1 --2- 172.21.15.60:0/1988413017 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47cc0ca390 0x7f47cc0c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:15.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.285+0000 7f47d1772640 1 -- 172.21.15.60:0/1988413017 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47cc0ca390 msgr2=0x7f47cc0c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:24:15.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.285+0000 7f47c3fff640 1 -- 172.21.15.60:0/1988413017 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 192998951 0 0) 0x7f47cc15a7c0 con 0x7f47cc06c650 2024-09-12T02:24:15.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.285+0000 7f47d1772640 1 --2- 172.21.15.60:0/1988413017 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47cc0ca390 0x7f47cc0c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:15.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.285+0000 7f47d1772640 1 -- 172.21.15.60:0/1988413017 >> v1:172.21.15.105:6789/0 conn(0x7f47cc06c650 legacy=0x7f47cc0c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:15.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.285+0000 7f47d1772640 1 -- 172.21.15.60:0/1988413017 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47cc159a00 con 0x7f47cc150480 2024-09-12T02:24:15.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.286+0000 7f47d1772640 1 --2- 172.21.15.60:0/1988413017 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47cc150480 0x7f47cc0c7a90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f47c8009870 tx=0x7f47c802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2465187040bb0901 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:15.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.286+0000 7f47c3fff640 1 -- 172.21.15.60:0/1988413017 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c8037070 con 0x7f47cc150480 2024-09-12T02:24:15.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.286+0000 7f47c3fff640 1 -- 172.21.15.60:0/1988413017 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47c8032440 con 0x7f47cc150480 2024-09-12T02:24:15.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.286+0000 7f47c3fff640 1 -- 172.21.15.60:0/1988413017 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c8032810 con 0x7f47cc150480 2024-09-12T02:24:15.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.287+0000 7f47d39d6640 1 -- 172.21.15.60:0/1988413017 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47cc150480 msgr2=0x7f47cc0c7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:15.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.287+0000 7f47d39d6640 1 --2- 172.21.15.60:0/1988413017 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47cc150480 0x7f47cc0c7a90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f47c8009870 tx=0x7f47c802a250 comp rx=0 tx=0).stop 2024-09-12T02:24:15.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.287+0000 7f47d39d6640 1 -- 172.21.15.60:0/1988413017 shutdown_connections 2024-09-12T02:24:15.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.287+0000 7f47d39d6640 1 --2- 172.21.15.60:0/1988413017 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47cc0ca390 0x7f47cc0c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:15.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.287+0000 7f47d39d6640 1 --2- 172.21.15.60:0/1988413017 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47cc150480 0x7f47cc0c7a90 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:15.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.287+0000 7f47d39d6640 1 -- 172.21.15.60:0/1988413017 >> 172.21.15.60:0/1988413017 conn(0x7f47cc068030 msgr2=0x7f47cc073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:24:15.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.287+0000 7f47d39d6640 1 -- 172.21.15.60:0/1988413017 shutdown_connections 2024-09-12T02:24:15.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.287+0000 7f47d39d6640 1 -- 172.21.15.60:0/1988413017 wait complete. 2024-09-12T02:24:15.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.289+0000 7f47d39d6640 1 Processor -- start 2024-09-12T02:24:15.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.289+0000 7f47d39d6640 1 -- start start 2024-09-12T02:24:15.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.290+0000 7f47d39d6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47cc06c650 0x7f47cc0c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:15.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.290+0000 7f47d39d6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47cc0ca390 0x7f47cc1ebdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:15.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.290+0000 7f47d39d6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47cc150480 0x7f47cc1ec330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:15.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.290+0000 7f47d39d6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f47cc06d270 con 0x7f47cc0ca390 2024-09-12T02:24:15.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.290+0000 7f47d39d6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f47cc159fc0 con 0x7f47cc150480 2024-09-12T02:24:15.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.290+0000 7f47d39d6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f47cc156270 con 0x7f47cc06c650 2024-09-12T02:24:15.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.290+0000 7f47d0f71640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47cc0ca390 0x7f47cc1ebdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:15.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.290+0000 7f47d1772640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47cc06c650 0x7f47cc0c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:15.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.290+0000 7f47d1f73640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47cc150480 0x7f47cc1ec330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:15.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.290+0000 7f47d0f71640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47cc0ca390 0x7f47cc1ebdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49392/0 (socket says 172.21.15.60:49392) 2024-09-12T02:24:15.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.290+0000 7f47d0f71640 1 -- 172.21.15.60:0/215321996 learned_addr learned my addr 172.21.15.60:0/215321996 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:24:15.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.290+0000 7f47d1772640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47cc06c650 0x7f47cc0c8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:37700/0 (socket says 172.21.15.60:37700) 2024-09-12T02:24:15.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.291+0000 7f47d1f73640 1 -- 172.21.15.60:0/215321996 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47cc06c650 msgr2=0x7f47cc0c8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:15.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.291+0000 7f47d1f73640 1 --2- 172.21.15.60:0/215321996 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47cc06c650 0x7f47cc0c8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:15.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.291+0000 7f47d1f73640 1 -- 172.21.15.60:0/215321996 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47cc0ca390 msgr2=0x7f47cc1ebdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:15.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.291+0000 7f47d1f73640 1 --2- 172.21.15.60:0/215321996 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47cc0ca390 0x7f47cc1ebdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:15.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.291+0000 7f47d1f73640 1 -- 172.21.15.60:0/215321996 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47cc1efcc0 con 0x7f47cc150480 2024-09-12T02:24:15.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.291+0000 7f47d0f71640 1 --2- 172.21.15.60:0/215321996 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47cc0ca390 0x7f47cc1ebdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:24:15.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.291+0000 7f47d1f73640 1 --2- 172.21.15.60:0/215321996 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47cc150480 0x7f47cc1ec330 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f47c400ebd0 tx=0x7f47c400c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:15.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.291+0000 7f47c1ffb640 1 -- 172.21.15.60:0/215321996 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c4018020 con 0x7f47cc150480 2024-09-12T02:24:15.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.291+0000 7f47c1ffb640 1 -- 172.21.15.60:0/215321996 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47c400cd20 con 0x7f47cc150480 2024-09-12T02:24:15.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.291+0000 7f47c1ffb640 1 -- 172.21.15.60:0/215321996 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c40146c0 con 0x7f47cc150480 2024-09-12T02:24:15.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.292+0000 7f47d39d6640 1 -- 172.21.15.60:0/215321996 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47cc1effa0 con 0x7f47cc150480 2024-09-12T02:24:15.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.292+0000 7f47d39d6640 1 -- 172.21.15.60:0/215321996 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47cc1dfd00 con 0x7f47cc150480 2024-09-12T02:24:15.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.293+0000 7f47d39d6640 1 --2- 172.21.15.60:0/215321996 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47cc1dfed0 0x7f47cc1586b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:15.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.293+0000 7f47d39d6640 1 -- 172.21.15.60:0/215321996 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f47cc0c9c80 con 0x7f47cc1dfed0 2024-09-12T02:24:15.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.293+0000 7f47d1772640 1 --2- 172.21.15.60:0/215321996 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47cc1dfed0 0x7f47cc1586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:15.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.294+0000 7f47d1772640 1 -- 172.21.15.60:0/215321996 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f47cc06c430 con 0x7f47cc1dfed0 2024-09-12T02:24:15.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.294+0000 7f47d1772640 1 --2- 172.21.15.60:0/215321996 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47cc1dfed0 0x7f47cc1586b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f47cc0c6110 tx=0x7f47c80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:15.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.294+0000 7f47c1ffb640 1 -- 172.21.15.60:0/215321996 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c8042070 con 0x7f47cc1dfed0 2024-09-12T02:24:15.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.294+0000 7f47c1ffb640 1 -- 172.21.15.60:0/215321996 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f47c4005d10 con 0x7f47cc150480 2024-09-12T02:24:15.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.295+0000 7f47c1ffb640 1 --2- 172.21.15.60:0/215321996 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f47b006bed0 0x7f47b006e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:15.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.295+0000 7f47c1ffb640 1 -- 172.21.15.60:0/215321996 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f47c8009490 con 0x7f47cc1dfed0 2024-09-12T02:24:15.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.295+0000 7f47c1ffb640 1 -- 172.21.15.60:0/215321996 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47cc1dfed0 msgr2=0x7f47cc1586b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:15.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.295+0000 7f47c1ffb640 1 --2- 172.21.15.60:0/215321996 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47cc1dfed0 0x7f47cc1586b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f47cc0c6110 tx=0x7f47c80046c0 comp rx=0 tx=0).stop 2024-09-12T02:24:15.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.295+0000 7f47c1ffb640 1 -- 172.21.15.60:0/215321996 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47cc1dfed0 msgr2=0x7f47cc1586b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:24:15.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.295+0000 7f47c1ffb640 1 --2- 172.21.15.60:0/215321996 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47cc1dfed0 0x7f47cc1586b0 secure :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f47cc0c6110 tx=0x7f47c80046c0 comp rx=0 tx=0).stop 2024-09-12T02:24:15.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.295+0000 7f47c1ffb640 1 -- 172.21.15.60:0/215321996 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f47c408bdf0 con 0x7f47cc150480 2024-09-12T02:24:15.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.295+0000 7f47d0f71640 1 --2- 172.21.15.60:0/215321996 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f47b006bed0 0x7f47b006e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:15.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.296+0000 7f47d0f71640 1 --2- 172.21.15.60:0/215321996 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f47b006bed0 0x7f47b006e390 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f47cc159750 tx=0x7f47bc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:15.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.307+0000 7f47d39d6640 1 --2- 172.21.15.60:0/215321996 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47cc1ec870 0x7f47cc158bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:15.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.307+0000 7f47d39d6640 1 -- 172.21.15.60:0/215321996 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f47cc155290 con 0x7f47cc1ec870 2024-09-12T02:24:15.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.307+0000 7f47d1772640 1 --2- 172.21.15.60:0/215321996 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47cc1ec870 0x7f47cc158bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:15.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.307+0000 7f47d1772640 1 -- 172.21.15.60:0/215321996 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f47cc0c8f40 con 0x7f47cc1ec870 2024-09-12T02:24:15.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.308+0000 7f47d1772640 1 --2- 172.21.15.60:0/215321996 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47cc1ec870 0x7f47cc158bf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f47c802a290 tx=0x7f47c8009240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:15.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.308+0000 7f47c1ffb640 1 -- 172.21.15.60:0/215321996 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c804c070 con 0x7f47cc1ec870 2024-09-12T02:24:15.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.308+0000 7f47c1ffb640 1 -- 172.21.15.60:0/215321996 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4883 (secure 0 0 0) 0x7f47c803d650 con 0x7f47cc1ec870 2024-09-12T02:24:15.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.308+0000 7f47c1ffb640 1 -- 172.21.15.60:0/215321996 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47cc1ec870 msgr2=0x7f47cc158bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:15.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.308+0000 7f47c1ffb640 1 --2- 172.21.15.60:0/215321996 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47cc1ec870 0x7f47cc158bf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f47c802a290 tx=0x7f47c8009240 comp rx=0 tx=0).stop 2024-09-12T02:24:15.309 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:24:15.310 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:24:15.310 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:24:15.310 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:24:15.310 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 14, 2024-09-12T02:24:15.310 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 100623, 2024-09-12T02:24:15.310 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:24:15.310 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:24:15.310 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:24:15.310 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:24:15.310 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:15.310 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-09-12T02:24:15.310 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:24:15.310 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:24:15.311 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:24:15.311 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:24:15.311 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:24:15.311 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:24:15.311 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:24:15.311 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:24:15.311 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:24:15.311 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:24:15.311 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:24:15.311 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:24:15.311 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:24:15.311 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:24:15.311 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:15.311 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:24:15.311 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:24:15.312 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:24:15.312 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:24:15.312 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:24:15.312 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:24:15.312 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:24:15.312 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:24:15.312 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:24:15.312 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:24:15.312 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:24:15.312 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:24:15.312 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:24:15.312 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:15.312 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:15.313 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:24:15.313 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:24:15.313 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:24:15.313 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:24:15.313 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:24:15.313 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:24:15.313 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:24:15.313 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:24:15.313 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:24:15.313 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:24:15.313 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:24:15.313 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:24:15.313 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:24:15.313 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:24:15.314 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:24:15.314 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:24:15.314 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:24:15.314 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:24:15.314 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:24:15.314 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:24:15.314 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:24:15.314 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:24:15.314 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:24:15.314 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:24:15.314 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:24:15.314 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:24:15.315 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:24:15.315 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:24:15.315 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:15.315 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:24:15.315 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:15.315 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:24:15.315 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:15.315 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:24:15.315 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:24:15.315 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:24:15.316 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:24:15.316 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:15.316 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:24:15.316 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:24:15.316 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:15.316 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:15.316 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:15.316 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:24:15.317 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:24:15.317 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:15.317 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:15.317 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:15.317 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:15.317 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:24:15.317 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:24:15.317 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:24:15.317 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:24:15.318 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:24:15.318 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:15.318 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:15.318 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:24:15.318 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:24:15.318 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:24:15.318 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:24:15.318 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:15.318 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:24:15.318 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:24:15.318 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:15.318 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:15.318 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:15.318 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:24:15.319 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:24:15.319 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:15.319 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:15.319 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:15.319 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:15.319 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:24:15.319 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:24:15.319 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:24:15.319 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:24:15.319 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:24:15.319 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:15.319 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:15.320 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:24:15.320 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:24:15.320 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:24:15.320 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:24:15.320 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:15.320 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:24:15.320 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:24:15.320 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:15.320 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:15.320 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:15.320 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:24:15.320 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:24:15.320 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:15.320 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:15.321 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:15.321 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:15.321 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:24:15.321 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:24:15.321 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:24:15.321 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:24:15.321 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:24:15.321 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:15.321 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:15.321 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:15.321 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:24:15.321 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:24:15.321 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:15.321 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:24:15.322 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:24:15.322 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:24:15.322 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:15.322 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:15.322 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:24:15.322 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:15.322 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:24:15.322 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:24:15.322 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:24:15.322 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:15.322 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:15.322 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:24:15.322 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:15.322 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:24:15.323 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:24:15.323 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:24:15.323 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:15.323 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:15.323 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:24:15.323 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:15.323 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:24:15.323 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:24:15.323 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:24:15.323 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:15.323 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:15.323 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:15.323 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:24:15.323 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:24:15.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.308+0000 7f47c1ffb640 1 -- 172.21.15.60:0/215321996 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47cc1ec870 msgr2=0x7f47cc158bf0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:24:15.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.308+0000 7f47c1ffb640 1 --2- 172.21.15.60:0/215321996 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47cc1ec870 0x7f47cc158bf0 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f47c802a290 tx=0x7f47c8009240 comp rx=0 tx=0).stop 2024-09-12T02:24:15.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.309+0000 7f47d39d6640 1 -- 172.21.15.60:0/215321996 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f47b006bed0 msgr2=0x7f47b006e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:15.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.309+0000 7f47d39d6640 1 --2- 172.21.15.60:0/215321996 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f47b006bed0 0x7f47b006e390 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f47cc159750 tx=0x7f47bc009040 comp rx=0 tx=0).stop 2024-09-12T02:24:15.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.309+0000 7f47d1f73640 1 -- 172.21.15.60:0/215321996 reap_dead start 2024-09-12T02:24:15.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.309+0000 7f47d39d6640 1 -- 172.21.15.60:0/215321996 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47cc150480 msgr2=0x7f47cc1ec330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:15.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.309+0000 7f47d39d6640 1 --2- 172.21.15.60:0/215321996 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47cc150480 0x7f47cc1ec330 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f47c400ebd0 tx=0x7f47c400c490 comp rx=0 tx=0).stop 2024-09-12T02:24:15.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.309+0000 7f47d39d6640 1 -- 172.21.15.60:0/215321996 shutdown_connections 2024-09-12T02:24:15.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.309+0000 7f47d39d6640 1 --2- 172.21.15.60:0/215321996 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47cc150480 0x7f47cc1ec330 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:15.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.309+0000 7f47d39d6640 1 -- 172.21.15.60:0/215321996 >> 172.21.15.60:0/215321996 conn(0x7f47cc068030 msgr2=0x7f47cc0c79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:24:15.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.309+0000 7f47d39d6640 1 -- 172.21.15.60:0/215321996 shutdown_connections 2024-09-12T02:24:15.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.309+0000 7f47d39d6640 1 -- 172.21.15.60:0/215321996 wait complete. 2024-09-12T02:24:15.327 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:24:15.327 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-12T02:24:15.327 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-12T02:24:15.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.430+0000 7fab3058d640 1 Processor -- start 2024-09-12T02:24:15.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.431+0000 7fab3058d640 1 -- start start 2024-09-12T02:24:15.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.432+0000 7fab3058d640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fab28072ec0 0x7fab28153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:15.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.432+0000 7fab3058d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fab280c4ac0 0x7fab28070040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:15.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.432+0000 7fab3058d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab280afc60 0x7fab28151380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:15.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.432+0000 7fab3058d640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fab2806efa0 con 0x7fab280c4ac0 2024-09-12T02:24:15.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.432+0000 7fab3058d640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fab2806f280 con 0x7fab28072ec0 2024-09-12T02:24:15.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.432+0000 7fab3058d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fab2806f560 con 0x7fab280afc60 2024-09-12T02:24:15.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.432+0000 7fab2db28640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fab280c4ac0 0x7fab28070040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:15.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.432+0000 7fab2e329640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fab28072ec0 0x7fab28153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:15.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.432+0000 7fab2eb2a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab280afc60 0x7fab28151380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:15.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.432+0000 7fab2e329640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fab28072ec0 0x7fab28153ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:58034/0 (socket says 172.21.15.60:58034) 2024-09-12T02:24:15.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.432+0000 7fab2e329640 1 -- 172.21.15.60:0/2929300204 learned_addr learned my addr 172.21.15.60:0/2929300204 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:24:15.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.432+0000 7fab2e329640 1 -- 172.21.15.60:0/2929300204 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab280afc60 msgr2=0x7fab28151380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:24:15.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.432+0000 7fab2e329640 1 --2- 172.21.15.60:0/2929300204 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab280afc60 0x7fab28151380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:15.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.432+0000 7fab2e329640 1 -- 172.21.15.60:0/2929300204 >> v2:172.21.15.60:3300/0 conn(0x7fab280c4ac0 msgr2=0x7fab28070040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:24:15.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.432+0000 7fab2e329640 1 --2- 172.21.15.60:0/2929300204 >> v2:172.21.15.60:3300/0 conn(0x7fab280c4ac0 0x7fab28070040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:15.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.432+0000 7fab2e329640 1 -- 172.21.15.60:0/2929300204 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab2806f840 con 0x7fab28072ec0 2024-09-12T02:24:15.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.432+0000 7fab2eb2a640 1 --2- 172.21.15.60:0/2929300204 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab280afc60 0x7fab28151380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:24:15.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.433+0000 7fab2e329640 1 --2- 172.21.15.60:0/2929300204 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab28072ec0 0x7fab28153ff0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fab280766f0 tx=0x7fab2402a0b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8f1069ccc1211df server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:15.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.434+0000 7fab2d327640 1 -- 172.21.15.60:0/2929300204 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab24037070 con 0x7fab28072ec0 2024-09-12T02:24:15.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.434+0000 7fab2d327640 1 -- 172.21.15.60:0/2929300204 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab2402ae00 con 0x7fab28072ec0 2024-09-12T02:24:15.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.434+0000 7fab2d327640 1 -- 172.21.15.60:0/2929300204 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab24032660 con 0x7fab28072ec0 2024-09-12T02:24:15.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.434+0000 7fab3058d640 1 -- 172.21.15.60:0/2929300204 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab28072ec0 msgr2=0x7fab28153ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:15.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.434+0000 7fab3058d640 1 --2- 172.21.15.60:0/2929300204 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab28072ec0 0x7fab28153ff0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fab280766f0 tx=0x7fab2402a0b0 comp rx=0 tx=0).stop 2024-09-12T02:24:15.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.434+0000 7fab3058d640 1 -- 172.21.15.60:0/2929300204 shutdown_connections 2024-09-12T02:24:15.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.435+0000 7fab3058d640 1 --2- 172.21.15.60:0/2929300204 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab280afc60 0x7fab28151380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:15.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.435+0000 7fab3058d640 1 --2- 172.21.15.60:0/2929300204 >> v2:172.21.15.60:3300/0 conn(0x7fab280c4ac0 0x7fab28070040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:15.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.435+0000 7fab3058d640 1 --2- 172.21.15.60:0/2929300204 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab28072ec0 0x7fab28153ff0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:15.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.435+0000 7fab3058d640 1 -- 172.21.15.60:0/2929300204 >> 172.21.15.60:0/2929300204 conn(0x7fab280c9d80 msgr2=0x7fab280ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:24:15.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.435+0000 7fab3058d640 1 -- 172.21.15.60:0/2929300204 shutdown_connections 2024-09-12T02:24:15.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.435+0000 7fab3058d640 1 -- 172.21.15.60:0/2929300204 wait complete. 2024-09-12T02:24:15.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.436+0000 7fab3058d640 1 Processor -- start 2024-09-12T02:24:15.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.436+0000 7fab3058d640 1 -- start start 2024-09-12T02:24:15.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.438+0000 7fab3058d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab28072ec0 0x7fab280c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:15.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.438+0000 7fab3058d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab280afc60 0x7fab281ec470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:15.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.438+0000 7fab3058d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab280c4ac0 0x7fab281ec9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:15.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.438+0000 7fab3058d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fab280732a0 con 0x7fab280afc60 2024-09-12T02:24:15.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.438+0000 7fab3058d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fab280c47f0 con 0x7fab28072ec0 2024-09-12T02:24:15.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.438+0000 7fab3058d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fab28073420 con 0x7fab280c4ac0 2024-09-12T02:24:15.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.438+0000 7fab2db28640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab280afc60 0x7fab281ec470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:15.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.438+0000 7fab2e329640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab28072ec0 0x7fab280c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:15.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.438+0000 7fab2db28640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab280afc60 0x7fab281ec470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49406/0 (socket says 172.21.15.60:49406) 2024-09-12T02:24:15.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.438+0000 7fab2db28640 1 -- 172.21.15.60:0/2395124444 learned_addr learned my addr 172.21.15.60:0/2395124444 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:24:15.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.438+0000 7fab2e329640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab28072ec0 0x7fab280c93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:58044/0 (socket says 172.21.15.60:58044) 2024-09-12T02:24:15.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.438+0000 7fab2eb2a640 1 --2- 172.21.15.60:0/2395124444 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab280c4ac0 0x7fab281ec9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:15.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.438+0000 7fab2e329640 1 -- 172.21.15.60:0/2395124444 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab280c4ac0 msgr2=0x7fab281ec9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:15.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.438+0000 7fab2e329640 1 --2- 172.21.15.60:0/2395124444 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab280c4ac0 0x7fab281ec9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:15.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.438+0000 7fab2e329640 1 -- 172.21.15.60:0/2395124444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab280afc60 msgr2=0x7fab281ec470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:15.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.438+0000 7fab2e329640 1 --2- 172.21.15.60:0/2395124444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab280afc60 0x7fab281ec470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:15.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.438+0000 7fab2e329640 1 -- 172.21.15.60:0/2395124444 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab280c3cf0 con 0x7fab28072ec0 2024-09-12T02:24:15.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.438+0000 7fab2eb2a640 1 --2- 172.21.15.60:0/2395124444 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab280c4ac0 0x7fab281ec9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:24:15.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.438+0000 7fab2e329640 1 --2- 172.21.15.60:0/2395124444 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab28072ec0 0x7fab280c93e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fab24031000 tx=0x7fab240046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:15.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.439+0000 7fab1effd640 1 -- 172.21.15.60:0/2395124444 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab24041070 con 0x7fab28072ec0 2024-09-12T02:24:15.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.439+0000 7fab1effd640 1 -- 172.21.15.60:0/2395124444 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab2403c460 con 0x7fab28072ec0 2024-09-12T02:24:15.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.439+0000 7fab3058d640 1 -- 172.21.15.60:0/2395124444 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab28150610 con 0x7fab28072ec0 2024-09-12T02:24:15.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.439+0000 7fab1effd640 1 -- 172.21.15.60:0/2395124444 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab24037040 con 0x7fab28072ec0 2024-09-12T02:24:15.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.439+0000 7fab3058d640 1 -- 172.21.15.60:0/2395124444 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab2806e660 con 0x7fab28072ec0 2024-09-12T02:24:15.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.440+0000 7fab3058d640 1 -- 172.21.15.60:0/2395124444 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab28153ff0 con 0x7fab28072ec0 2024-09-12T02:24:15.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.441+0000 7fab1effd640 1 -- 172.21.15.60:0/2395124444 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fab2403a070 con 0x7fab28072ec0 2024-09-12T02:24:15.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.441+0000 7fab1effd640 1 --2- 172.21.15.60:0/2395124444 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fab0c06be30 0x7fab0c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:15.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.441+0000 7fab1effd640 1 -- 172.21.15.60:0/2395124444 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fab240ab430 con 0x7fab28072ec0 2024-09-12T02:24:15.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.441+0000 7fab2db28640 1 --2- 172.21.15.60:0/2395124444 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fab0c06be30 0x7fab0c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:15.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.442+0000 7fab2db28640 1 --2- 172.21.15.60:0/2395124444 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fab0c06be30 0x7fab0c06e2f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fab2814dba0 tx=0x7fab18009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:15.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.450+0000 7fab1effd640 1 -- 172.21.15.60:0/2395124444 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fab24079480 con 0x7fab28072ec0 2024-09-12T02:24:15.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.792+0000 7fab3058d640 1 -- 172.21.15.60:0/2395124444 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fab2814b670 con 0x7fab28072ec0 2024-09-12T02:24:15.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.794+0000 7fab1effd640 1 -- 172.21.15.60:0/2395124444 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fab2407d780 con 0x7fab28072ec0 2024-09-12T02:24:15.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.797+0000 7fab3058d640 1 -- 172.21.15.60:0/2395124444 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fab0c06be30 msgr2=0x7fab0c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:15.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.797+0000 7fab3058d640 1 --2- 172.21.15.60:0/2395124444 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fab0c06be30 0x7fab0c06e2f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fab2814dba0 tx=0x7fab18009190 comp rx=0 tx=0).stop 2024-09-12T02:24:15.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.797+0000 7fab3058d640 1 -- 172.21.15.60:0/2395124444 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab28072ec0 msgr2=0x7fab280c93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:15.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.797+0000 7fab3058d640 1 --2- 172.21.15.60:0/2395124444 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab28072ec0 0x7fab280c93e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fab24031000 tx=0x7fab240046c0 comp rx=0 tx=0).stop 2024-09-12T02:24:15.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.797+0000 7fab3058d640 1 -- 172.21.15.60:0/2395124444 shutdown_connections 2024-09-12T02:24:15.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.797+0000 7fab3058d640 1 --2- 172.21.15.60:0/2395124444 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fab0c06be30 0x7fab0c06e2f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:15.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.797+0000 7fab3058d640 1 --2- 172.21.15.60:0/2395124444 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab280c4ac0 0x7fab281ec9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:15.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.797+0000 7fab3058d640 1 --2- 172.21.15.60:0/2395124444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab280afc60 0x7fab281ec470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:15.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.797+0000 7fab3058d640 1 --2- 172.21.15.60:0/2395124444 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab28072ec0 0x7fab280c93e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:15.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.797+0000 7fab3058d640 1 -- 172.21.15.60:0/2395124444 >> 172.21.15.60:0/2395124444 conn(0x7fab280c9d80 msgr2=0x7fab2806ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:24:15.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.797+0000 7fab3058d640 1 -- 172.21.15.60:0/2395124444 shutdown_connections 2024-09-12T02:24:15.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:15.797+0000 7fab3058d640 1 -- 172.21.15.60:0/2395124444 wait complete. 2024-09-12T02:24:15.811 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-12T02:24:25.812 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-12T02:24:25.825 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:24:25.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.930+0000 7f6bbcc67640 1 Processor -- start 2024-09-12T02:24:25.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.931+0000 7f6bbcc67640 1 -- start start 2024-09-12T02:24:25.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.931+0000 7f6bbcc67640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6bb80ca150 0x7f6bb806fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:25.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.932+0000 7f6bbcc67640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6bb8158260 0x7f6bb8072b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:25.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.932+0000 7f6bbcc67640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bb80af1e0 con 0x7f6bb80c7b00 2024-09-12T02:24:25.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.932+0000 7f6bbcc67640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f6bb8070210 con 0x7f6bb8158260 2024-09-12T02:24:25.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.932+0000 7f6bbcc67640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f6bb8070450 con 0x7f6bb80ca150 2024-09-12T02:24:25.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.932+0000 7f6bb5d9b640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f6bb80c7b00 0x7f6bb8157b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52254/0 (socket says 172.21.15.60:52254) 2024-09-12T02:24:25.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.932+0000 7f6bb659c640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6bb80ca150 0x7f6bb806fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:25.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.932+0000 7f6bb5d9b640 1 -- 172.21.15.60:0/2577754371 learned_addr learned my addr 172.21.15.60:0/2577754371 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:24:25.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.932+0000 7f6bb6d9d640 1 --2- 172.21.15.60:0/2577754371 >> v2:172.21.15.60:3300/0 conn(0x7f6bb8158260 0x7f6bb8072b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:25.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.932+0000 7f6bb659c640 1 -- 172.21.15.60:0/2577754371 >> v2:172.21.15.60:3300/0 conn(0x7f6bb8158260 msgr2=0x7f6bb8072b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:24:25.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.932+0000 7f6bb659c640 1 --2- 172.21.15.60:0/2577754371 >> v2:172.21.15.60:3300/0 conn(0x7f6bb8158260 0x7f6bb8072b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:25.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.932+0000 7f6bb559a640 1 -- 172.21.15.60:0/2577754371 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 207289119 0 0) 0x7f6bb80af1e0 con 0x7f6bb80c7b00 2024-09-12T02:24:25.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.932+0000 7f6bb659c640 1 -- 172.21.15.60:0/2577754371 >> v1:172.21.15.60:6789/0 conn(0x7f6bb80c7b00 legacy=0x7f6bb8157b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:25.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.932+0000 7f6bb659c640 1 -- 172.21.15.60:0/2577754371 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bb815e830 con 0x7f6bb80ca150 2024-09-12T02:24:25.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.932+0000 7f6bb6d9d640 1 --2- 172.21.15.60:0/2577754371 >> v2:172.21.15.60:3300/0 conn(0x7f6bb8158260 0x7f6bb8072b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:24:25.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.933+0000 7f6bb659c640 1 --2- 172.21.15.60:0/2577754371 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bb80ca150 0x7f6bb806fcd0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6bb80caa50 tx=0x7f6ba802a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fef8eb8b94809225 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:25.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.933+0000 7f6bb559a640 1 -- 172.21.15.60:0/2577754371 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba8037070 con 0x7f6bb80ca150 2024-09-12T02:24:25.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.933+0000 7f6bb559a640 1 -- 172.21.15.60:0/2577754371 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ba802add0 con 0x7f6bb80ca150 2024-09-12T02:24:25.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.933+0000 7f6bb559a640 1 -- 172.21.15.60:0/2577754371 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba8032660 con 0x7f6bb80ca150 2024-09-12T02:24:25.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.934+0000 7f6bbcc67640 1 -- 172.21.15.60:0/2577754371 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bb80ca150 msgr2=0x7f6bb806fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:25.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.934+0000 7f6bbcc67640 1 --2- 172.21.15.60:0/2577754371 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bb80ca150 0x7f6bb806fcd0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6bb80caa50 tx=0x7f6ba802a080 comp rx=0 tx=0).stop 2024-09-12T02:24:25.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.934+0000 7f6bbcc67640 1 -- 172.21.15.60:0/2577754371 shutdown_connections 2024-09-12T02:24:25.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.934+0000 7f6bbcc67640 1 --2- 172.21.15.60:0/2577754371 >> v2:172.21.15.60:3300/0 conn(0x7f6bb8158260 0x7f6bb8072b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:25.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.934+0000 7f6bbcc67640 1 --2- 172.21.15.60:0/2577754371 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bb80ca150 0x7f6bb806fcd0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:25.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.934+0000 7f6bbcc67640 1 -- 172.21.15.60:0/2577754371 >> 172.21.15.60:0/2577754371 conn(0x7f6bb8067b30 msgr2=0x7f6bb8067f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:24:25.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.934+0000 7f6bbcc67640 1 -- 172.21.15.60:0/2577754371 shutdown_connections 2024-09-12T02:24:25.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.934+0000 7f6bbcc67640 1 -- 172.21.15.60:0/2577754371 wait complete. 2024-09-12T02:24:25.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.936+0000 7f6bbcc67640 1 Processor -- start 2024-09-12T02:24:25.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.936+0000 7f6bbcc67640 1 -- start start 2024-09-12T02:24:25.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.936+0000 7f6bbcc67640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bb80c7b00 0x7f6bb81ecf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:25.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.936+0000 7f6bbcc67640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bb80ca150 0x7f6bb81ed480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:25.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.936+0000 7f6bbcc67640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bb8158260 0x7f6bb815a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:25.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.936+0000 7f6bbcc67640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb80c92c0 con 0x7f6bb80ca150 2024-09-12T02:24:25.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.936+0000 7f6bbcc67640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb80c95c0 con 0x7f6bb8158260 2024-09-12T02:24:25.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.936+0000 7f6bbcc67640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6bb80ca530 con 0x7f6bb80c7b00 2024-09-12T02:24:25.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.937+0000 7f6bb5d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bb80ca150 0x7f6bb81ed480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:25.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.937+0000 7f6bb5d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bb80ca150 0x7f6bb81ed480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53600/0 (socket says 172.21.15.60:53600) 2024-09-12T02:24:25.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.937+0000 7f6bb5d9b640 1 -- 172.21.15.60:0/1562190583 learned_addr learned my addr 172.21.15.60:0/1562190583 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:24:25.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.937+0000 7f6bb659c640 1 --2- 172.21.15.60:0/1562190583 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bb80c7b00 0x7f6bb81ecf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:25.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.937+0000 7f6bb6d9d640 1 --2- 172.21.15.60:0/1562190583 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bb8158260 0x7f6bb815a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:25.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.937+0000 7f6bb5d9b640 1 -- 172.21.15.60:0/1562190583 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bb80c7b00 msgr2=0x7f6bb81ecf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:25.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.937+0000 7f6bb5d9b640 1 --2- 172.21.15.60:0/1562190583 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bb80c7b00 0x7f6bb81ecf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:25.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.937+0000 7f6bb5d9b640 1 -- 172.21.15.60:0/1562190583 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bb8158260 msgr2=0x7f6bb815a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:25.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.937+0000 7f6bb5d9b640 1 --2- 172.21.15.60:0/1562190583 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bb8158260 0x7f6bb815a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:25.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.937+0000 7f6bb5d9b640 1 -- 172.21.15.60:0/1562190583 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bb8157ab0 con 0x7f6bb80ca150 2024-09-12T02:24:25.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.937+0000 7f6bb5d9b640 1 --2- 172.21.15.60:0/1562190583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bb80ca150 0x7f6bb81ed480 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6bac00c4d0 tx=0x7f6bac00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:25.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.937+0000 7f6ba6ffd640 1 -- 172.21.15.60:0/1562190583 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bac0074e0 con 0x7f6bb80ca150 2024-09-12T02:24:25.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.937+0000 7f6bbcc67640 1 -- 172.21.15.60:0/1562190583 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bb8158c80 con 0x7f6bb80ca150 2024-09-12T02:24:25.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.937+0000 7f6ba6ffd640 1 -- 172.21.15.60:0/1562190583 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bac0047e0 con 0x7f6bb80ca150 2024-09-12T02:24:25.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.937+0000 7f6ba6ffd640 1 -- 172.21.15.60:0/1562190583 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bac004bd0 con 0x7f6bb80ca150 2024-09-12T02:24:25.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.937+0000 7f6bbcc67640 1 -- 172.21.15.60:0/1562190583 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bb815b0a0 con 0x7f6bb80ca150 2024-09-12T02:24:25.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.939+0000 7f6bbcc67640 1 -- 172.21.15.60:0/1562190583 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bb806fcd0 con 0x7f6bb80ca150 2024-09-12T02:24:25.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.940+0000 7f6ba6ffd640 1 -- 172.21.15.60:0/1562190583 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6bac011070 con 0x7f6bb80ca150 2024-09-12T02:24:25.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.940+0000 7f6ba6ffd640 1 --2- 172.21.15.60:0/1562190583 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f6b9806be30 0x7f6b9806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:25.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.940+0000 7f6ba6ffd640 1 -- 172.21.15.60:0/1562190583 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f6bac08ae10 con 0x7f6bb80ca150 2024-09-12T02:24:25.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.940+0000 7f6bb659c640 1 --2- 172.21.15.60:0/1562190583 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f6b9806be30 0x7f6b9806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:25.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.941+0000 7f6bb659c640 1 --2- 172.21.15.60:0/1562190583 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f6b9806be30 0x7f6b9806e2f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8034000 tx=0x7f6ba802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:25.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:25.949+0000 7f6ba6ffd640 1 -- 172.21.15.60:0/1562190583 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6bac0593a0 con 0x7f6bb80ca150 2024-09-12T02:24:26.040 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:24:26.044 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:24:26.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.342+0000 7f6bbcc67640 1 -- 172.21.15.60:0/1562190583 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6bb80c7480 con 0x7f6bb80ca150 2024-09-12T02:24:26.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.343+0000 7f6ba6ffd640 1 -- 172.21.15.60:0/1562190583 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f6bac058ca0 con 0x7f6bb80ca150 2024-09-12T02:24:26.344 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:24:26.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.346+0000 7f6bbcc67640 1 -- 172.21.15.60:0/1562190583 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f6b9806be30 msgr2=0x7f6b9806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:26.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.346+0000 7f6bbcc67640 1 --2- 172.21.15.60:0/1562190583 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f6b9806be30 0x7f6b9806e2f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8034000 tx=0x7f6ba802e000 comp rx=0 tx=0).stop 2024-09-12T02:24:26.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.346+0000 7f6bbcc67640 1 -- 172.21.15.60:0/1562190583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bb80ca150 msgr2=0x7f6bb81ed480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:26.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.346+0000 7f6bbcc67640 1 --2- 172.21.15.60:0/1562190583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bb80ca150 0x7f6bb81ed480 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6bac00c4d0 tx=0x7f6bac00c8d0 comp rx=0 tx=0).stop 2024-09-12T02:24:26.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.346+0000 7f6bbcc67640 1 -- 172.21.15.60:0/1562190583 shutdown_connections 2024-09-12T02:24:26.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.346+0000 7f6bbcc67640 1 --2- 172.21.15.60:0/1562190583 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f6b9806be30 0x7f6b9806e2f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:26.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.346+0000 7f6bbcc67640 1 --2- 172.21.15.60:0/1562190583 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bb8158260 0x7f6bb815a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:26.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.346+0000 7f6bbcc67640 1 --2- 172.21.15.60:0/1562190583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bb80ca150 0x7f6bb81ed480 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:26.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.346+0000 7f6bbcc67640 1 --2- 172.21.15.60:0/1562190583 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bb80c7b00 0x7f6bb81ecf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:26.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.346+0000 7f6bbcc67640 1 -- 172.21.15.60:0/1562190583 >> 172.21.15.60:0/1562190583 conn(0x7f6bb8067b30 msgr2=0x7f6bb81549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:24:26.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.346+0000 7f6bbcc67640 1 -- 172.21.15.60:0/1562190583 shutdown_connections 2024-09-12T02:24:26.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.346+0000 7f6bbcc67640 1 -- 172.21.15.60:0/1562190583 wait complete. 2024-09-12T02:24:26.362 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-12T02:24:26.362 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-12T02:24:26.362 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-12T02:24:26.362 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-12T02:24:26.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.466+0000 7f60297f1640 1 Processor -- start 2024-09-12T02:24:26.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.466+0000 7f60297f1640 1 -- start start 2024-09-12T02:24:26.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.467+0000 7f60297f1640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6024073ae0 0x7f6024153380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:26.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.467+0000 7f60297f1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6024156f50 0x7f60241538c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:26.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.467+0000 7f60297f1640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f602406dd50 con 0x7f60240733d0 2024-09-12T02:24:26.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.467+0000 7f60297f1640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f602406e030 con 0x7f6024073ae0 2024-09-12T02:24:26.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.467+0000 7f60297f1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f602406e310 con 0x7f6024156f50 2024-09-12T02:24:26.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.467+0000 7f60237fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6024156f50 0x7f60241538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:26.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.467+0000 7f60227fc640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f60240733d0 0x7f6024156840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:41900/0 (socket says 172.21.15.60:41900) 2024-09-12T02:24:26.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.467+0000 7f60227fc640 1 -- 172.21.15.60:0/183862212 learned_addr learned my addr 172.21.15.60:0/183862212 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:24:26.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.467+0000 7f6022ffd640 1 --2- 172.21.15.60:0/183862212 >> v2:172.21.15.105:3300/0 conn(0x7f6024073ae0 0x7f6024153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:26.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.468+0000 7f6022ffd640 1 -- 172.21.15.60:0/183862212 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6024156f50 msgr2=0x7f60241538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:24:26.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.468+0000 7f6022ffd640 1 --2- 172.21.15.60:0/183862212 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6024156f50 0x7f60241538c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:26.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.468+0000 7f6022ffd640 1 -- 172.21.15.60:0/183862212 >> v1:172.21.15.105:6789/0 conn(0x7f60240733d0 legacy=0x7f6024156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:26.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.468+0000 7f6022ffd640 1 -- 172.21.15.60:0/183862212 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f602406e5f0 con 0x7f6024073ae0 2024-09-12T02:24:26.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.468+0000 7f60237fe640 1 --2- 172.21.15.60:0/183862212 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6024156f50 0x7f60241538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:24:26.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.469+0000 7f6022ffd640 1 --2- 172.21.15.60:0/183862212 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6024073ae0 0x7f6024153380 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f60140097a0 tx=0x7f601402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=655b8fcea70fed67 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:26.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.469+0000 7f6021ffb640 1 -- 172.21.15.60:0/183862212 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6014037070 con 0x7f6024073ae0 2024-09-12T02:24:26.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.469+0000 7f6021ffb640 1 -- 172.21.15.60:0/183862212 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6014032440 con 0x7f6024073ae0 2024-09-12T02:24:26.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.469+0000 7f6021ffb640 1 -- 172.21.15.60:0/183862212 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6014032810 con 0x7f6024073ae0 2024-09-12T02:24:26.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.469+0000 7f60297f1640 1 -- 172.21.15.60:0/183862212 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6024073ae0 msgr2=0x7f6024153380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:26.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.469+0000 7f60297f1640 1 --2- 172.21.15.60:0/183862212 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6024073ae0 0x7f6024153380 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f60140097a0 tx=0x7f601402a180 comp rx=0 tx=0).stop 2024-09-12T02:24:26.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.469+0000 7f60297f1640 1 -- 172.21.15.60:0/183862212 shutdown_connections 2024-09-12T02:24:26.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.469+0000 7f60297f1640 1 --2- 172.21.15.60:0/183862212 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6024156f50 0x7f60241538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:26.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.469+0000 7f60297f1640 1 --2- 172.21.15.60:0/183862212 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6024073ae0 0x7f6024153380 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:26.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.469+0000 7f60297f1640 1 -- 172.21.15.60:0/183862212 >> 172.21.15.60:0/183862212 conn(0x7f60240c9d80 msgr2=0x7f60240ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:24:26.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.469+0000 7f60297f1640 1 -- 172.21.15.60:0/183862212 shutdown_connections 2024-09-12T02:24:26.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.470+0000 7f60297f1640 1 -- 172.21.15.60:0/183862212 wait complete. 2024-09-12T02:24:26.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.471+0000 7f60297f1640 1 Processor -- start 2024-09-12T02:24:26.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.471+0000 7f60297f1640 1 -- start start 2024-09-12T02:24:26.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.471+0000 7f60297f1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60240733d0 0x7f60240c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:26.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.471+0000 7f60297f1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6024073ae0 0x7f6024154080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:26.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.471+0000 7f60297f1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6024156f50 0x7f60241ef3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:26.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.472+0000 7f60297f1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f602406edd0 con 0x7f6024156f50 2024-09-12T02:24:26.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.472+0000 7f60297f1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f602406ec50 con 0x7f60240733d0 2024-09-12T02:24:26.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.472+0000 7f60297f1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6024073ec0 con 0x7f6024073ae0 2024-09-12T02:24:26.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.472+0000 7f60227fc640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6024073ae0 0x7f6024154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:26.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.472+0000 7f60227fc640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6024073ae0 0x7f6024154080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:48704/0 (socket says 172.21.15.60:48704) 2024-09-12T02:24:26.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.472+0000 7f6022ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60240733d0 0x7f60240c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:26.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.472+0000 7f60227fc640 1 -- 172.21.15.60:0/915989527 learned_addr learned my addr 172.21.15.60:0/915989527 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:24:26.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.472+0000 7f60237fe640 1 --2- 172.21.15.60:0/915989527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6024156f50 0x7f60241ef3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:26.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.472+0000 7f6022ffd640 1 -- 172.21.15.60:0/915989527 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6024073ae0 msgr2=0x7f6024154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:26.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.472+0000 7f6022ffd640 1 --2- 172.21.15.60:0/915989527 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6024073ae0 0x7f6024154080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:26.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.472+0000 7f6022ffd640 1 -- 172.21.15.60:0/915989527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6024156f50 msgr2=0x7f60241ef3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:26.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.472+0000 7f6022ffd640 1 --2- 172.21.15.60:0/915989527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6024156f50 0x7f60241ef3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:26.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.472+0000 7f6022ffd640 1 -- 172.21.15.60:0/915989527 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6024155f20 con 0x7f60240733d0 2024-09-12T02:24:26.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.472+0000 7f60227fc640 1 --2- 172.21.15.60:0/915989527 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6024073ae0 0x7f6024154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:24:26.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.472+0000 7f6022ffd640 1 --2- 172.21.15.60:0/915989527 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60240733d0 0x7f60240c89f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f60240c7940 tx=0x7f60140046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:26.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.473+0000 7f600b7fe640 1 -- 172.21.15.60:0/915989527 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6014041030 con 0x7f60240733d0 2024-09-12T02:24:26.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.473+0000 7f600b7fe640 1 -- 172.21.15.60:0/915989527 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6014030440 con 0x7f60240733d0 2024-09-12T02:24:26.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.473+0000 7f600b7fe640 1 -- 172.21.15.60:0/915989527 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6014037040 con 0x7f60240733d0 2024-09-12T02:24:26.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.473+0000 7f60297f1640 1 -- 172.21.15.60:0/915989527 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f602414c5c0 con 0x7f60240733d0 2024-09-12T02:24:26.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.473+0000 7f60297f1640 1 -- 172.21.15.60:0/915989527 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60241ecd50 con 0x7f60240733d0 2024-09-12T02:24:26.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.474+0000 7f60297f1640 1 --2- 172.21.15.60:0/915989527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60241545c0 0x7f60241ef900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:26.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.474+0000 7f60297f1640 1 -- 172.21.15.60:0/915989527 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6024155cf0 con 0x7f60241545c0 2024-09-12T02:24:26.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.474+0000 7f60227fc640 1 --2- 172.21.15.60:0/915989527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60241545c0 0x7f60241ef900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:26.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.474+0000 7f60227fc640 1 -- 172.21.15.60:0/915989527 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f602406d850 con 0x7f60241545c0 2024-09-12T02:24:26.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.474+0000 7f60227fc640 1 --2- 172.21.15.60:0/915989527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60241545c0 0x7f60241ef900 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f60240c9c00 tx=0x7f6018007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:26.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.475+0000 7f600b7fe640 1 -- 172.21.15.60:0/915989527 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f601800f9b0 con 0x7f60241545c0 2024-09-12T02:24:26.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.475+0000 7f600b7fe640 1 -- 172.21.15.60:0/915989527 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6014044070 con 0x7f60240733d0 2024-09-12T02:24:26.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.475+0000 7f600b7fe640 1 --2- 172.21.15.60:0/915989527 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f601006bd30 0x7f601006e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:26.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.475+0000 7f600b7fe640 1 -- 172.21.15.60:0/915989527 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f60140ab690 con 0x7f60240733d0 2024-09-12T02:24:26.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.475+0000 7f60237fe640 1 --2- 172.21.15.60:0/915989527 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f601006bd30 0x7f601006e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:26.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.476+0000 7f600b7fe640 1 -- 172.21.15.60:0/915989527 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f6018018070 con 0x7f60241545c0 2024-09-12T02:24:26.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.476+0000 7f600b7fe640 1 -- 172.21.15.60:0/915989527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60241545c0 msgr2=0x7f60241ef900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:26.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.476+0000 7f600b7fe640 1 --2- 172.21.15.60:0/915989527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60241545c0 0x7f60241ef900 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f60240c9c00 tx=0x7f6018007720 comp rx=0 tx=0).stop 2024-09-12T02:24:26.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.476+0000 7f600b7fe640 1 -- 172.21.15.60:0/915989527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60241545c0 msgr2=0x7f60241ef900 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:24:26.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.476+0000 7f600b7fe640 1 --2- 172.21.15.60:0/915989527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60241545c0 0x7f60241ef900 secure :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f60240c9c00 tx=0x7f6018007720 comp rx=0 tx=0).stop 2024-09-12T02:24:26.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.476+0000 7f60237fe640 1 --2- 172.21.15.60:0/915989527 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f601006bd30 0x7f601006e1f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f601c009c10 tx=0x7f601c00b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:26.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.482+0000 7f60297f1640 1 --2- 172.21.15.60:0/915989527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60241e2410 0x7f60241efe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:26.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.482+0000 7f60297f1640 1 -- 172.21.15.60:0/915989527 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f60241ec8d0 con 0x7f60241e2410 2024-09-12T02:24:26.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.482+0000 7f60227fc640 1 --2- 172.21.15.60:0/915989527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60241e2410 0x7f60241efe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:26.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.482+0000 7f60227fc640 1 -- 172.21.15.60:0/915989527 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f60240ca440 con 0x7f60241e2410 2024-09-12T02:24:26.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.483+0000 7f60227fc640 1 --2- 172.21.15.60:0/915989527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60241e2410 0x7f60241efe40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f60240c9c00 tx=0x7f6018000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:26.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.483+0000 7f600b7fe640 1 -- 172.21.15.60:0/915989527 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6018013600 con 0x7f60241e2410 2024-09-12T02:24:26.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.483+0000 7f600b7fe640 1 -- 172.21.15.60:0/915989527 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5053 (secure 0 0 0) 0x7f6018013600 con 0x7f60241e2410 2024-09-12T02:24:26.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.483+0000 7f600b7fe640 1 -- 172.21.15.60:0/915989527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60241e2410 msgr2=0x7f60241efe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:26.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.483+0000 7f600b7fe640 1 --2- 172.21.15.60:0/915989527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60241e2410 0x7f60241efe40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f60240c9c00 tx=0x7f6018000ed0 comp rx=0 tx=0).stop 2024-09-12T02:24:26.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.483+0000 7f600b7fe640 1 -- 172.21.15.60:0/915989527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60241e2410 msgr2=0x7f60241efe40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:24:26.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.483+0000 7f600b7fe640 1 --2- 172.21.15.60:0/915989527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60241e2410 0x7f60241efe40 secure :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f60240c9c00 tx=0x7f6018000ed0 comp rx=0 tx=0).stop 2024-09-12T02:24:26.486 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:24:26.486 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:24:26.486 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:24:26.486 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:24:26.486 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 14, 2024-09-12T02:24:26.486 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 111836, 2024-09-12T02:24:26.486 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:24:26.486 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:24:26.487 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:24:26.487 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:24:26.487 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:26.487 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 11, 2024-09-12T02:24:26.487 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:24:26.487 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:24:26.487 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:24:26.487 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:24:26.487 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:24:26.487 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:24:26.487 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:24:26.488 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:24:26.488 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:24:26.488 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:24:26.488 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:24:26.488 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:24:26.488 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:24:26.488 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:24:26.488 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:26.488 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:24:26.488 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:24:26.488 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:24:26.489 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:24:26.489 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:24:26.489 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:24:26.489 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:24:26.489 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:24:26.489 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:24:26.489 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:24:26.489 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:24:26.489 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:24:26.489 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:24:26.490 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:26.490 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:26.490 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:24:26.490 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:24:26.490 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:24:26.490 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:24:26.490 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:24:26.490 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:24:26.490 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:24:26.490 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:24:26.490 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:24:26.491 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:24:26.491 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:24:26.491 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:24:26.491 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:24:26.491 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:24:26.491 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:24:26.491 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:24:26.491 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:24:26.491 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:24:26.491 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:24:26.491 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:24:26.491 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:24:26.492 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:24:26.492 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:24:26.492 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:24:26.492 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:24:26.492 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:24:26.492 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:24:26.492 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:24:26.492 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:26.492 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:24:26.492 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:26.492 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:24:26.493 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:26.493 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:24:26.493 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:24:26.493 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:24:26.493 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:24:26.493 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:26.493 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:24:26.493 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:24:26.493 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:26.493 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:26.493 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:26.493 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:24:26.494 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:24:26.494 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:26.494 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:26.494 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:26.494 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:26.494 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:24:26.494 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:24:26.494 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:24:26.494 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:24:26.494 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:24:26.494 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:26.494 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:26.494 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:24:26.495 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:24:26.495 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:24:26.495 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:24:26.495 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:26.495 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:24:26.495 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:24:26.495 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:26.495 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:26.495 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:26.495 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:24:26.495 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:24:26.496 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:26.496 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:26.496 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:26.496 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:26.496 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:24:26.496 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:24:26.496 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:24:26.496 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:24:26.496 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:24:26.496 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:26.496 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:26.496 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:24:26.497 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:24:26.497 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:24:26.497 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:24:26.497 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:26.497 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:24:26.497 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:24:26.497 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:26.497 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:26.497 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:26.497 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:24:26.497 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:24:26.498 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:26.498 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:26.498 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:26.498 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:26.498 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:24:26.498 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:24:26.498 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:24:26.498 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:24:26.498 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:24:26.498 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:26.498 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:26.499 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:26.499 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:24:26.499 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:24:26.499 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:26.499 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:24:26.499 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:24:26.499 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:24:26.499 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:26.499 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:26.499 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:24:26.499 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:26.499 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:24:26.499 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:24:26.500 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:24:26.500 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:26.500 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:26.500 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:24:26.500 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:26.500 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:24:26.500 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:24:26.500 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:24:26.500 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:26.500 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:26.501 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:24:26.501 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:26.501 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:24:26.501 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:24:26.501 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-09-12T02:24:26.501 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:26.501 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:26.501 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:24:26.501 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:26.501 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:24:26.501 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:24:26.501 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:24:26.502 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:26.502 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:26.502 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:26.502 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:24:26.502 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:24:26.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.484+0000 7f60097fa640 1 -- 172.21.15.60:0/915989527 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f601006bd30 msgr2=0x7f601006e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:26.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.484+0000 7f60097fa640 1 --2- 172.21.15.60:0/915989527 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f601006bd30 0x7f601006e1f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f601c009c10 tx=0x7f601c00b040 comp rx=0 tx=0).stop 2024-09-12T02:24:26.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.484+0000 7f60097fa640 1 -- 172.21.15.60:0/915989527 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60240733d0 msgr2=0x7f60240c89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:26.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.484+0000 7f60097fa640 1 --2- 172.21.15.60:0/915989527 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60240733d0 0x7f60240c89f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f60240c7940 tx=0x7f60140046c0 comp rx=0 tx=0).stop 2024-09-12T02:24:26.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.484+0000 7f60237fe640 1 -- 172.21.15.60:0/915989527 reap_dead start 2024-09-12T02:24:26.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.484+0000 7f60097fa640 1 -- 172.21.15.60:0/915989527 shutdown_connections 2024-09-12T02:24:26.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.484+0000 7f60097fa640 1 --2- 172.21.15.60:0/915989527 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60240733d0 0x7f60240c89f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:26.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.484+0000 7f60097fa640 1 -- 172.21.15.60:0/915989527 >> 172.21.15.60:0/915989527 conn(0x7f60240c9d80 msgr2=0x7f60240c55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:24:26.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.484+0000 7f60097fa640 1 -- 172.21.15.60:0/915989527 shutdown_connections 2024-09-12T02:24:26.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.484+0000 7f60097fa640 1 -- 172.21.15.60:0/915989527 wait complete. 2024-09-12T02:24:26.505 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:24:26.505 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-12T02:24:26.505 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-12T02:24:26.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.643+0000 7f1ebb0f1640 1 Processor -- start 2024-09-12T02:24:26.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.643+0000 7f1ebb0f1640 1 -- start start 2024-09-12T02:24:26.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.644+0000 7f1ebb0f1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1eb415a450 0x7f1eb40c3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:26.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.644+0000 7f1ebb0f1640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1eb415a830 con 0x7f1eb40c3fd0 2024-09-12T02:24:26.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.644+0000 7f1ebb0f1640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1eb40c7490 con 0x7f1eb40c84e0 2024-09-12T02:24:26.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.644+0000 7f1ebb0f1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1eb406e240 con 0x7f1eb415a450 2024-09-12T02:24:26.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.644+0000 7f1eb3fff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f1eb40c3fd0 0x7f1eb406e6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52258/0 (socket says 172.21.15.60:52258) 2024-09-12T02:24:26.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.644+0000 7f1eb3fff640 1 -- 172.21.15.60:0/1334751260 learned_addr learned my addr 172.21.15.60:0/1334751260 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:24:26.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.644+0000 7f1eb8e8d640 1 --2- 172.21.15.60:0/1334751260 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1eb415a450 0x7f1eb40c3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:26.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.644+0000 7f1eb37fe640 1 -- 172.21.15.60:0/1334751260 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1213642928 0 0) 0x7f1eb415a830 con 0x7f1eb40c3fd0 2024-09-12T02:24:26.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.644+0000 7f1eb37fe640 1 -- 172.21.15.60:0/1334751260 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ea4003520 con 0x7f1eb40c3fd0 2024-09-12T02:24:26.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.645+0000 7f1eb8e8d640 1 -- 172.21.15.60:0/1334751260 >> v1:172.21.15.105:6789/0 conn(0x7f1eb40c84e0 legacy=0x7f1eb406ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:26.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.645+0000 7f1eb8e8d640 1 -- 172.21.15.60:0/1334751260 >> v1:172.21.15.60:6789/0 conn(0x7f1eb40c3fd0 legacy=0x7f1eb406e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:26.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.645+0000 7f1eb8e8d640 1 -- 172.21.15.60:0/1334751260 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eb40c7770 con 0x7f1eb415a450 2024-09-12T02:24:26.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.645+0000 7f1eb8e8d640 1 --2- 172.21.15.60:0/1334751260 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1eb415a450 0x7f1eb40c3a90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8009750 tx=0x7f1ea802a010 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee6832903c02144e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:26.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.646+0000 7f1eb37fe640 1 -- 172.21.15.60:0/1334751260 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea8037070 con 0x7f1eb415a450 2024-09-12T02:24:26.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.646+0000 7f1eb37fe640 1 -- 172.21.15.60:0/1334751260 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ea802ad20 con 0x7f1eb415a450 2024-09-12T02:24:26.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.646+0000 7f1eb37fe640 1 -- 172.21.15.60:0/1334751260 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea8032640 con 0x7f1eb415a450 2024-09-12T02:24:26.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.646+0000 7f1ebb0f1640 1 -- 172.21.15.60:0/1334751260 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1eb415a450 msgr2=0x7f1eb40c3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:26.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.646+0000 7f1ebb0f1640 1 --2- 172.21.15.60:0/1334751260 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1eb415a450 0x7f1eb40c3a90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8009750 tx=0x7f1ea802a010 comp rx=0 tx=0).stop 2024-09-12T02:24:26.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.646+0000 7f1ebb0f1640 1 -- 172.21.15.60:0/1334751260 shutdown_connections 2024-09-12T02:24:26.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.646+0000 7f1ebb0f1640 1 --2- 172.21.15.60:0/1334751260 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1eb415a450 0x7f1eb40c3a90 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:26.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.646+0000 7f1ebb0f1640 1 -- 172.21.15.60:0/1334751260 >> 172.21.15.60:0/1334751260 conn(0x7f1eb40c5660 msgr2=0x7f1eb40c5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:24:26.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.646+0000 7f1ebb0f1640 1 -- 172.21.15.60:0/1334751260 shutdown_connections 2024-09-12T02:24:26.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.646+0000 7f1ebb0f1640 1 -- 172.21.15.60:0/1334751260 wait complete. 2024-09-12T02:24:26.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.648+0000 7f1ebb0f1640 1 Processor -- start 2024-09-12T02:24:26.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.648+0000 7f1ebb0f1640 1 -- start start 2024-09-12T02:24:26.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.649+0000 7f1ebb0f1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1eb40c3fd0 0x7f1eb41ef630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:26.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.649+0000 7f1ebb0f1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1eb40c84e0 0x7f1eb4072cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:26.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.649+0000 7f1ebb0f1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1eb415a450 0x7f1eb4073210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:26.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.649+0000 7f1ebb0f1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb40c70d0 con 0x7f1eb415a450 2024-09-12T02:24:26.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.649+0000 7f1ebb0f1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb40c7d30 con 0x7f1eb40c84e0 2024-09-12T02:24:26.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.649+0000 7f1ebb0f1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1eb40c7250 con 0x7f1eb40c3fd0 2024-09-12T02:24:26.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.650+0000 7f1eb968e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1eb415a450 0x7f1eb4073210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:26.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.650+0000 7f1eb8e8d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1eb40c3fd0 0x7f1eb41ef630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:26.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.650+0000 7f1eb3fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1eb40c84e0 0x7f1eb4072cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:26.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.650+0000 7f1eb968e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1eb415a450 0x7f1eb4073210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53644/0 (socket says 172.21.15.60:53644) 2024-09-12T02:24:26.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.650+0000 7f1eb968e640 1 -- 172.21.15.60:0/133312926 learned_addr learned my addr 172.21.15.60:0/133312926 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:24:26.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.650+0000 7f1eb3fff640 1 -- 172.21.15.60:0/133312926 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1eb40c3fd0 msgr2=0x7f1eb41ef630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:26.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.650+0000 7f1eb3fff640 1 --2- 172.21.15.60:0/133312926 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1eb40c3fd0 0x7f1eb41ef630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:26.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.650+0000 7f1eb3fff640 1 -- 172.21.15.60:0/133312926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1eb415a450 msgr2=0x7f1eb4073210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:26.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.650+0000 7f1eb3fff640 1 --2- 172.21.15.60:0/133312926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1eb415a450 0x7f1eb4073210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:26.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.650+0000 7f1eb3fff640 1 -- 172.21.15.60:0/133312926 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eb41efe70 con 0x7f1eb40c84e0 2024-09-12T02:24:26.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.650+0000 7f1eb8e8d640 1 --2- 172.21.15.60:0/133312926 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1eb40c3fd0 0x7f1eb41ef630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:24:26.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.650+0000 7f1eb968e640 1 --2- 172.21.15.60:0/133312926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1eb415a450 0x7f1eb4073210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:24:26.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.650+0000 7f1eb3fff640 1 --2- 172.21.15.60:0/133312926 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1eb40c84e0 0x7f1eb4072cd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1ea000c430 tx=0x7f1ea000c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:26.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.651+0000 7f1eb17fa640 1 -- 172.21.15.60:0/133312926 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea0017070 con 0x7f1eb40c84e0 2024-09-12T02:24:26.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.651+0000 7f1eb17fa640 1 -- 172.21.15.60:0/133312926 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ea0005ce0 con 0x7f1eb40c84e0 2024-09-12T02:24:26.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.651+0000 7f1ebb0f1640 1 -- 172.21.15.60:0/133312926 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1eb41f0150 con 0x7f1eb40c84e0 2024-09-12T02:24:26.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.651+0000 7f1ebb0f1640 1 -- 172.21.15.60:0/133312926 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1eb41e08b0 con 0x7f1eb40c84e0 2024-09-12T02:24:26.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.651+0000 7f1eb17fa640 1 -- 172.21.15.60:0/133312926 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea00072d0 con 0x7f1eb40c84e0 2024-09-12T02:24:26.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.652+0000 7f1ebb0f1640 1 --2- 172.21.15.60:0/133312926 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1eb4073750 0x7f1eb41ebe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:26.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.652+0000 7f1ebb0f1640 1 -- 172.21.15.60:0/133312926 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb4072a90 con 0x7f1eb4073750 2024-09-12T02:24:26.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.652+0000 7f1eb8e8d640 1 --2- 172.21.15.60:0/133312926 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1eb4073750 0x7f1eb41ebe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:26.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.652+0000 7f1eb8e8d640 1 -- 172.21.15.60:0/133312926 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1eb406c5c0 con 0x7f1eb4073750 2024-09-12T02:24:26.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.652+0000 7f1eb17fa640 1 -- 172.21.15.60:0/133312926 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1ea001a070 con 0x7f1eb40c84e0 2024-09-12T02:24:26.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.653+0000 7f1eb8e8d640 1 --2- 172.21.15.60:0/133312926 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1eb4073750 0x7f1eb41ebe50 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4075bc0 tx=0x7f1ea80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:26.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.653+0000 7f1eb17fa640 1 --2- 172.21.15.60:0/133312926 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1e9806be30 0x7f1e9806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:26.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.653+0000 7f1eb17fa640 1 -- 172.21.15.60:0/133312926 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f1ea008a570 con 0x7f1eb40c84e0 2024-09-12T02:24:26.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.653+0000 7f1eb968e640 1 --2- 172.21.15.60:0/133312926 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1e9806be30 0x7f1e9806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:26.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.653+0000 7f1eb17fa640 1 -- 172.21.15.60:0/133312926 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea8044070 con 0x7f1eb4073750 2024-09-12T02:24:26.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.653+0000 7f1eb17fa640 1 -- 172.21.15.60:0/133312926 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f1ea803e460 con 0x7f1eb4073750 2024-09-12T02:24:26.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.653+0000 7f1eb17fa640 1 -- 172.21.15.60:0/133312926 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1eb4073750 msgr2=0x7f1eb41ebe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:26.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.653+0000 7f1eb17fa640 1 --2- 172.21.15.60:0/133312926 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1eb4073750 0x7f1eb41ebe50 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4075bc0 tx=0x7f1ea80046c0 comp rx=0 tx=0).stop 2024-09-12T02:24:26.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.654+0000 7f1eb17fa640 1 -- 172.21.15.60:0/133312926 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1eb4073750 msgr2=0x7f1eb41ebe50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:24:26.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.654+0000 7f1eb17fa640 1 --2- 172.21.15.60:0/133312926 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1eb4073750 0x7f1eb41ebe50 secure :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4075bc0 tx=0x7f1ea80046c0 comp rx=0 tx=0).stop 2024-09-12T02:24:26.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.654+0000 7f1eb968e640 1 --2- 172.21.15.60:0/133312926 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1e9806be30 0x7f1e9806e2f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1eac00f420 tx=0x7f1eac009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:26.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.665+0000 7f1ebb0f1640 1 --2- 172.21.15.60:0/133312926 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1eb4073fd0 0x7f1eb41ec390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:26.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.665+0000 7f1ebb0f1640 1 -- 172.21.15.60:0/133312926 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb40c3660 con 0x7f1eb4073fd0 2024-09-12T02:24:26.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.666+0000 7f1eb8e8d640 1 --2- 172.21.15.60:0/133312926 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1eb4073fd0 0x7f1eb41ec390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:26.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.666+0000 7f1eb8e8d640 1 -- 172.21.15.60:0/133312926 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1eb40c6ba0 con 0x7f1eb4073fd0 2024-09-12T02:24:26.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.666+0000 7f1eb8e8d640 1 --2- 172.21.15.60:0/133312926 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1eb4073fd0 0x7f1eb41ec390 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1eb40a86c0 tx=0x7f1ea8008030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:26.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.667+0000 7f1eb17fa640 1 -- 172.21.15.60:0/133312926 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea8037040 con 0x7f1eb4073fd0 2024-09-12T02:24:26.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.667+0000 7f1eb17fa640 1 -- 172.21.15.60:0/133312926 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4549 (secure 0 0 0) 0x7f1ea803e610 con 0x7f1eb4073fd0 2024-09-12T02:24:26.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.667+0000 7f1eb17fa640 1 -- 172.21.15.60:0/133312926 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1eb4073fd0 msgr2=0x7f1eb41ec390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:26.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.667+0000 7f1eb17fa640 1 --2- 172.21.15.60:0/133312926 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1eb4073fd0 0x7f1eb41ec390 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1eb40a86c0 tx=0x7f1ea8008030 comp rx=0 tx=0).stop 2024-09-12T02:24:26.668 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:24:26.668 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:24:26.668 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:24:26.668 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:24:26.668 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 14, 2024-09-12T02:24:26.668 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 12101, 2024-09-12T02:24:26.669 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:24:26.669 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:24:26.669 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:24:26.669 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:24:26.669 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:26.669 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 11, 2024-09-12T02:24:26.669 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:24:26.669 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:24:26.669 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:24:26.669 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:24:26.669 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:24:26.669 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:24:26.670 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:24:26.670 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:24:26.670 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:24:26.670 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:24:26.670 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:24:26.670 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:24:26.670 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:24:26.670 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:24:26.670 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:26.670 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:24:26.670 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:24:26.670 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:24:26.670 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:24:26.670 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:24:26.671 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:24:26.671 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:24:26.671 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:24:26.671 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:24:26.671 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:24:26.671 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:24:26.671 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:24:26.671 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:24:26.671 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:26.671 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:26.671 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:24:26.671 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:24:26.672 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:24:26.672 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:24:26.672 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:24:26.672 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:24:26.672 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:24:26.672 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:24:26.672 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:24:26.672 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:24:26.672 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:24:26.672 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:24:26.672 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:24:26.672 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:24:26.672 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:24:26.673 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:24:26.673 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:24:26.673 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:24:26.673 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:24:26.673 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:24:26.673 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:24:26.673 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:24:26.673 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:24:26.673 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:24:26.673 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:24:26.673 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:24:26.673 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:24:26.674 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:24:26.674 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:26.674 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:24:26.674 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:26.674 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:24:26.674 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:26.674 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:24:26.674 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:24:26.674 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:24:26.674 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:24:26.674 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:26.674 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:24:26.675 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:24:26.675 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:26.675 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:26.675 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:26.675 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:24:26.675 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:24:26.675 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:26.675 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:26.675 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:26.675 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:26.675 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:24:26.675 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:24:26.675 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:24:26.676 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:24:26.676 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:24:26.676 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:26.676 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:26.676 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:24:26.676 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:24:26.676 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:24:26.676 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:24:26.676 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:26.676 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:24:26.676 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:24:26.676 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:26.676 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:26.677 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:26.677 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:24:26.677 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:24:26.677 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:26.677 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:26.677 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:26.677 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:26.677 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:24:26.677 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:24:26.677 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:24:26.677 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:24:26.677 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:24:26.677 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:26.678 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:26.678 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:24:26.678 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:24:26.678 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:24:26.678 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:24:26.678 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:26.678 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:24:26.678 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:24:26.678 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:26.678 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:26.678 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:26.678 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:24:26.678 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:24:26.678 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:26.679 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:26.679 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:26.679 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:26.679 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:24:26.679 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:24:26.679 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:24:26.679 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:24:26.679 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:24:26.679 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:26.679 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:26.679 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:26.679 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:24:26.679 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:24:26.679 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:26.680 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:24:26.680 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:24:26.680 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:24:26.680 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:26.680 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:26.680 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:24:26.680 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:26.680 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:24:26.680 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:24:26.680 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:24:26.680 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:26.680 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:26.680 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:26.680 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:24:26.681 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:24:26.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.667+0000 7f1eb17fa640 1 -- 172.21.15.60:0/133312926 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1eb4073fd0 msgr2=0x7f1eb41ec390 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:24:26.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.667+0000 7f1eb17fa640 1 --2- 172.21.15.60:0/133312926 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1eb4073fd0 0x7f1eb41ec390 secure :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1eb40a86c0 tx=0x7f1ea8008030 comp rx=0 tx=0).stop 2024-09-12T02:24:26.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.667+0000 7f1ebb0f1640 1 -- 172.21.15.60:0/133312926 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1e9806be30 msgr2=0x7f1e9806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:26.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.667+0000 7f1ebb0f1640 1 --2- 172.21.15.60:0/133312926 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1e9806be30 0x7f1e9806e2f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1eac00f420 tx=0x7f1eac009040 comp rx=0 tx=0).stop 2024-09-12T02:24:26.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.667+0000 7f1ebb0f1640 1 -- 172.21.15.60:0/133312926 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1eb40c84e0 msgr2=0x7f1eb4072cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:26.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.667+0000 7f1ebb0f1640 1 --2- 172.21.15.60:0/133312926 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1eb40c84e0 0x7f1eb4072cd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1ea000c430 tx=0x7f1ea000c8f0 comp rx=0 tx=0).stop 2024-09-12T02:24:26.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.667+0000 7f1eb968e640 1 -- 172.21.15.60:0/133312926 reap_dead start 2024-09-12T02:24:26.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.667+0000 7f1ebb0f1640 1 -- 172.21.15.60:0/133312926 shutdown_connections 2024-09-12T02:24:26.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.667+0000 7f1ebb0f1640 1 --2- 172.21.15.60:0/133312926 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1eb40c84e0 0x7f1eb4072cd0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:26.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.668+0000 7f1ebb0f1640 1 -- 172.21.15.60:0/133312926 >> 172.21.15.60:0/133312926 conn(0x7f1eb40c5660 msgr2=0x7f1eb406bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:24:26.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.668+0000 7f1ebb0f1640 1 -- 172.21.15.60:0/133312926 shutdown_connections 2024-09-12T02:24:26.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.668+0000 7f1ebb0f1640 1 -- 172.21.15.60:0/133312926 wait complete. 2024-09-12T02:24:26.683 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:24:26.683 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-12T02:24:26.684 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-12T02:24:26.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.787+0000 7fc03b8d0640 1 Processor -- start 2024-09-12T02:24:26.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.787+0000 7fc03b8d0640 1 -- start start 2024-09-12T02:24:26.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.788+0000 7fc03b8d0640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc034073ae0 0x7fc034153380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:26.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.788+0000 7fc03b8d0640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc03406dd50 con 0x7fc0340733d0 2024-09-12T02:24:26.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.788+0000 7fc03b8d0640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc03406e030 con 0x7fc034156f50 2024-09-12T02:24:26.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.788+0000 7fc03b8d0640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc03406e310 con 0x7fc034073ae0 2024-09-12T02:24:26.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.788+0000 7fc038e6b640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fc0340733d0 0x7fc034156840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52268/0 (socket says 172.21.15.60:52268) 2024-09-12T02:24:26.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.788+0000 7fc038e6b640 1 -- 172.21.15.60:0/3837842825 learned_addr learned my addr 172.21.15.60:0/3837842825 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:24:26.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.788+0000 7fc03966c640 1 --2- 172.21.15.60:0/3837842825 >> v2:172.21.15.105:3300/0 conn(0x7fc034073ae0 0x7fc034153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:26.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.789+0000 7fc02bfff640 1 -- 172.21.15.60:0/3837842825 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 471562655 0 0) 0x7fc03406dd50 con 0x7fc0340733d0 2024-09-12T02:24:26.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.789+0000 7fc02bfff640 1 -- 172.21.15.60:0/3837842825 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc020003520 con 0x7fc0340733d0 2024-09-12T02:24:26.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.789+0000 7fc03966c640 1 -- 172.21.15.60:0/3837842825 >> v1:172.21.15.105:6789/0 conn(0x7fc034156f50 legacy=0x7fc034160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:26.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.789+0000 7fc02bfff640 1 -- 172.21.15.60:0/3837842825 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3860205607 0 0) 0x7fc03406e030 con 0x7fc034156f50 2024-09-12T02:24:26.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.789+0000 7fc03966c640 1 -- 172.21.15.60:0/3837842825 >> v1:172.21.15.60:6789/0 conn(0x7fc0340733d0 legacy=0x7fc034156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:26.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.789+0000 7fc03966c640 1 -- 172.21.15.60:0/3837842825 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc03406e5f0 con 0x7fc034073ae0 2024-09-12T02:24:26.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.790+0000 7fc03966c640 1 --2- 172.21.15.60:0/3837842825 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc034073ae0 0x7fc034153380 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc0300097a0 tx=0x7fc03002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f0fa5051bf8fc9c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:26.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.790+0000 7fc02bfff640 1 -- 172.21.15.60:0/3837842825 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc030037070 con 0x7fc034073ae0 2024-09-12T02:24:26.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.790+0000 7fc02bfff640 1 -- 172.21.15.60:0/3837842825 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc030032440 con 0x7fc034073ae0 2024-09-12T02:24:26.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.790+0000 7fc02bfff640 1 -- 172.21.15.60:0/3837842825 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0300327f0 con 0x7fc034073ae0 2024-09-12T02:24:26.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.791+0000 7fc03b8d0640 1 -- 172.21.15.60:0/3837842825 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc034073ae0 msgr2=0x7fc034153380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:26.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.791+0000 7fc03b8d0640 1 --2- 172.21.15.60:0/3837842825 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc034073ae0 0x7fc034153380 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc0300097a0 tx=0x7fc03002a230 comp rx=0 tx=0).stop 2024-09-12T02:24:26.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.791+0000 7fc03b8d0640 1 -- 172.21.15.60:0/3837842825 shutdown_connections 2024-09-12T02:24:26.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.791+0000 7fc03b8d0640 1 --2- 172.21.15.60:0/3837842825 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc034073ae0 0x7fc034153380 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:26.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.791+0000 7fc03b8d0640 1 -- 172.21.15.60:0/3837842825 >> 172.21.15.60:0/3837842825 conn(0x7fc0340c9d80 msgr2=0x7fc0340ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:24:26.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.791+0000 7fc03b8d0640 1 -- 172.21.15.60:0/3837842825 shutdown_connections 2024-09-12T02:24:26.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.791+0000 7fc03b8d0640 1 -- 172.21.15.60:0/3837842825 wait complete. 2024-09-12T02:24:26.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.792+0000 7fc03b8d0640 1 Processor -- start 2024-09-12T02:24:26.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.792+0000 7fc03b8d0640 1 -- start start 2024-09-12T02:24:26.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.793+0000 7fc03b8d0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0340733d0 0x7fc0341efa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:26.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.793+0000 7fc03b8d0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc034073ae0 0x7fc034152200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:26.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.793+0000 7fc03b8d0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc034156f50 0x7fc03414f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:26.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.793+0000 7fc03b8d0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc03406edd0 con 0x7fc034073ae0 2024-09-12T02:24:26.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.793+0000 7fc03b8d0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc03406ec50 con 0x7fc034156f50 2024-09-12T02:24:26.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.793+0000 7fc03b8d0640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc034073ec0 con 0x7fc0340733d0 2024-09-12T02:24:26.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.793+0000 7fc038e6b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc034073ae0 0x7fc034152200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:26.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.793+0000 7fc038e6b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc034073ae0 0x7fc034152200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53660/0 (socket says 172.21.15.60:53660) 2024-09-12T02:24:26.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.793+0000 7fc038e6b640 1 -- 172.21.15.60:0/1086318897 learned_addr learned my addr 172.21.15.60:0/1086318897 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:24:26.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.793+0000 7fc03966c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0340733d0 0x7fc0341efa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:26.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.793+0000 7fc039e6d640 1 --2- 172.21.15.60:0/1086318897 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc034156f50 0x7fc03414f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:26.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.793+0000 7fc038e6b640 1 -- 172.21.15.60:0/1086318897 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0340733d0 msgr2=0x7fc0341efa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:26.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.793+0000 7fc038e6b640 1 --2- 172.21.15.60:0/1086318897 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0340733d0 0x7fc0341efa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:26.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.793+0000 7fc038e6b640 1 -- 172.21.15.60:0/1086318897 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc034156f50 msgr2=0x7fc03414f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:26.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.793+0000 7fc038e6b640 1 --2- 172.21.15.60:0/1086318897 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc034156f50 0x7fc03414f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:26.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.793+0000 7fc038e6b640 1 -- 172.21.15.60:0/1086318897 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc03413f580 con 0x7fc034073ae0 2024-09-12T02:24:26.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.794+0000 7fc038e6b640 1 --2- 172.21.15.60:0/1086318897 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc034073ae0 0x7fc034152200 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc02400c450 tx=0x7fc02400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:26.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.794+0000 7fc029ffb640 1 -- 172.21.15.60:0/1086318897 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc024017070 con 0x7fc034073ae0 2024-09-12T02:24:26.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.794+0000 7fc029ffb640 1 -- 172.21.15.60:0/1086318897 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc024005ce0 con 0x7fc034073ae0 2024-09-12T02:24:26.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.794+0000 7fc029ffb640 1 -- 172.21.15.60:0/1086318897 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc024007290 con 0x7fc034073ae0 2024-09-12T02:24:26.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.794+0000 7fc03b8d0640 1 -- 172.21.15.60:0/1086318897 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0341ef250 con 0x7fc034073ae0 2024-09-12T02:24:26.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.794+0000 7fc03b8d0640 1 -- 172.21.15.60:0/1086318897 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc034152d10 con 0x7fc034073ae0 2024-09-12T02:24:26.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.795+0000 7fc03b8d0640 1 --2- 172.21.15.60:0/1086318897 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc03413f750 0x7fc03413e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:26.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.795+0000 7fc03b8d0640 1 -- 172.21.15.60:0/1086318897 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc0341eff90 con 0x7fc03413f750 2024-09-12T02:24:26.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.795+0000 7fc03966c640 1 --2- 172.21.15.60:0/1086318897 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc03413f750 0x7fc03413e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:26.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.796+0000 7fc029ffb640 1 -- 172.21.15.60:0/1086318897 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc02401a070 con 0x7fc034073ae0 2024-09-12T02:24:26.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.796+0000 7fc03966c640 1 -- 172.21.15.60:0/1086318897 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc0341ef580 con 0x7fc03413f750 2024-09-12T02:24:26.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.796+0000 7fc03966c640 1 --2- 172.21.15.60:0/1086318897 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc03413f750 0x7fc03413e370 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc0340ca980 tx=0x7fc0300046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:26.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.796+0000 7fc029ffb640 1 --2- 172.21.15.60:0/1086318897 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc01806be30 0x7fc01806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:26.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.796+0000 7fc029ffb640 1 -- 172.21.15.60:0/1086318897 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fc02408a4b0 con 0x7fc034073ae0 2024-09-12T02:24:26.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.796+0000 7fc039e6d640 1 --2- 172.21.15.60:0/1086318897 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc01806be30 0x7fc01806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:26.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.797+0000 7fc029ffb640 1 -- 172.21.15.60:0/1086318897 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc030043070 con 0x7fc03413f750 2024-09-12T02:24:26.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.797+0000 7fc029ffb640 1 -- 172.21.15.60:0/1086318897 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc030038040 con 0x7fc03413f750 2024-09-12T02:24:26.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.797+0000 7fc029ffb640 1 -- 172.21.15.60:0/1086318897 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc03413f750 msgr2=0x7fc03413e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:26.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.797+0000 7fc029ffb640 1 --2- 172.21.15.60:0/1086318897 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc03413f750 0x7fc03413e370 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc0340ca980 tx=0x7fc0300046c0 comp rx=0 tx=0).stop 2024-09-12T02:24:26.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.797+0000 7fc029ffb640 1 -- 172.21.15.60:0/1086318897 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc03413f750 msgr2=0x7fc03413e370 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:24:26.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.797+0000 7fc029ffb640 1 --2- 172.21.15.60:0/1086318897 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc03413f750 0x7fc03413e370 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc0340ca980 tx=0x7fc0300046c0 comp rx=0 tx=0).stop 2024-09-12T02:24:26.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.797+0000 7fc039e6d640 1 --2- 172.21.15.60:0/1086318897 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc01806be30 0x7fc01806e2f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc02c0012e0 tx=0x7fc02c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:26.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.809+0000 7fc03b8d0640 1 --2- 172.21.15.60:0/1086318897 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc03413e8b0 0x7fc03413ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:26.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.809+0000 7fc03b8d0640 1 -- 172.21.15.60:0/1086318897 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc0341ef770 con 0x7fc03413e8b0 2024-09-12T02:24:26.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.809+0000 7fc03966c640 1 --2- 172.21.15.60:0/1086318897 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc03413e8b0 0x7fc03413ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:26.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.810+0000 7fc03966c640 1 -- 172.21.15.60:0/1086318897 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc03413f200 con 0x7fc03413e8b0 2024-09-12T02:24:26.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.810+0000 7fc03966c640 1 --2- 172.21.15.60:0/1086318897 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc03413e8b0 0x7fc03413ecc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc030000c00 tx=0x7fc030009190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:26.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.810+0000 7fc029ffb640 1 -- 172.21.15.60:0/1086318897 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc030037040 con 0x7fc03413e8b0 2024-09-12T02:24:26.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.810+0000 7fc029ffb640 1 -- 172.21.15.60:0/1086318897 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4884 (secure 0 0 0) 0x7fc03003d3f0 con 0x7fc03413e8b0 2024-09-12T02:24:26.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.810+0000 7fc029ffb640 1 -- 172.21.15.60:0/1086318897 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc03413e8b0 msgr2=0x7fc03413ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:26.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.810+0000 7fc029ffb640 1 --2- 172.21.15.60:0/1086318897 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc03413e8b0 0x7fc03413ecc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc030000c00 tx=0x7fc030009190 comp rx=0 tx=0).stop 2024-09-12T02:24:26.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.810+0000 7fc029ffb640 1 -- 172.21.15.60:0/1086318897 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc03413e8b0 msgr2=0x7fc03413ecc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:24:26.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.810+0000 7fc029ffb640 1 --2- 172.21.15.60:0/1086318897 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc03413e8b0 0x7fc03413ecc0 secure :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc030000c00 tx=0x7fc030009190 comp rx=0 tx=0).stop 2024-09-12T02:24:26.811 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:24:26.812 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:24:26.812 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:24:26.812 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:24:26.812 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 14, 2024-09-12T02:24:26.812 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 112125, 2024-09-12T02:24:26.812 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:24:26.812 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:24:26.812 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:24:26.812 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:24:26.812 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:26.812 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 12, 2024-09-12T02:24:26.813 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:24:26.813 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:24:26.813 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:24:26.813 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:24:26.813 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:24:26.813 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:24:26.813 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:24:26.813 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:24:26.813 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:24:26.813 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:24:26.813 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:24:26.813 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:24:26.813 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:24:26.814 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:24:26.814 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:26.814 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:24:26.814 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:24:26.814 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:24:26.814 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:24:26.814 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:24:26.814 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:24:26.814 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:24:26.814 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:24:26.814 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:24:26.814 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:24:26.814 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:24:26.814 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:24:26.815 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:24:26.815 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:26.815 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:26.815 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:24:26.815 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:24:26.815 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:24:26.815 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:24:26.815 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:24:26.815 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:24:26.815 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:24:26.815 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:24:26.815 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:24:26.815 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:24:26.816 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:24:26.816 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:24:26.816 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:24:26.816 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:24:26.816 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:24:26.816 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:24:26.816 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:24:26.816 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:24:26.816 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:24:26.816 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:24:26.816 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:24:26.816 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:24:26.817 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:24:26.817 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:24:26.817 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:24:26.817 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:24:26.817 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:24:26.817 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:24:26.817 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:26.817 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:24:26.817 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:26.817 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:24:26.817 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:26.817 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:24:26.817 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:24:26.817 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:24:26.818 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:24:26.818 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:26.818 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:24:26.818 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:24:26.818 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:26.818 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:26.818 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:26.818 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:24:26.818 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:24:26.818 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:26.818 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:26.818 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:26.818 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:26.819 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:24:26.819 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:24:26.819 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:24:26.819 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:24:26.819 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:24:26.819 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:26.819 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:26.819 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:24:26.819 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:24:26.819 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:24:26.819 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:24:26.819 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:26.819 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:24:26.819 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:24:26.819 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:26.820 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:26.820 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:26.820 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:24:26.820 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:24:26.820 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:26.820 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:26.820 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:26.820 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:26.820 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:24:26.820 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:24:26.820 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:24:26.820 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:24:26.820 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:24:26.820 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:26.821 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:26.821 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:24:26.821 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:24:26.821 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:24:26.821 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:24:26.821 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:26.821 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:24:26.821 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:24:26.821 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:26.821 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:26.821 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:26.821 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:24:26.821 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:24:26.821 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:26.822 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:26.822 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:26.822 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:26.822 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:24:26.822 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:24:26.822 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:24:26.822 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:24:26.822 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:24:26.822 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:26.822 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:26.822 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:26.822 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:24:26.822 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:24:26.822 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:26.823 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:24:26.823 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:24:26.823 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:24:26.823 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:26.823 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:26.823 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:24:26.823 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:26.823 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:24:26.823 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:24:26.823 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:24:26.823 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:26.823 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:26.823 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:24:26.823 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:26.824 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:24:26.824 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:24:26.824 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:24:26.824 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:26.824 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:26.824 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:24:26.824 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:26.824 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:24:26.824 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:24:26.824 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:24:26.824 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:26.824 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:26.824 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:26.824 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:24:26.825 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:24:26.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.811+0000 7fc03b8d0640 1 -- 172.21.15.60:0/1086318897 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc01806be30 msgr2=0x7fc01806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:26.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.811+0000 7fc03b8d0640 1 --2- 172.21.15.60:0/1086318897 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc01806be30 0x7fc01806e2f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc02c0012e0 tx=0x7fc02c009040 comp rx=0 tx=0).stop 2024-09-12T02:24:26.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.811+0000 7fc039e6d640 1 -- 172.21.15.60:0/1086318897 reap_dead start 2024-09-12T02:24:26.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.811+0000 7fc03b8d0640 1 -- 172.21.15.60:0/1086318897 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc034073ae0 msgr2=0x7fc034152200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:26.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.811+0000 7fc03b8d0640 1 --2- 172.21.15.60:0/1086318897 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc034073ae0 0x7fc034152200 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc02400c450 tx=0x7fc02400c910 comp rx=0 tx=0).stop 2024-09-12T02:24:26.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.811+0000 7fc03b8d0640 1 -- 172.21.15.60:0/1086318897 shutdown_connections 2024-09-12T02:24:26.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.811+0000 7fc03b8d0640 1 --2- 172.21.15.60:0/1086318897 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc034073ae0 0x7fc034152200 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:26.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.811+0000 7fc03b8d0640 1 -- 172.21.15.60:0/1086318897 >> 172.21.15.60:0/1086318897 conn(0x7fc0340c9d80 msgr2=0x7fc0340c5710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:24:26.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.811+0000 7fc03b8d0640 1 -- 172.21.15.60:0/1086318897 shutdown_connections 2024-09-12T02:24:26.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.811+0000 7fc03b8d0640 1 -- 172.21.15.60:0/1086318897 wait complete. 2024-09-12T02:24:26.827 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:24:26.828 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-09-12T02:24:26.828 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-12T02:24:26.828 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-09-12T02:24:26.828 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-12T02:24:26.828 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T02:24:26.828 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:24:26.846 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T02:24:26.846 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-12T02:24:26.846 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:24:26.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.989+0000 7f364deac640 1 Processor -- start 2024-09-12T02:24:26.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.989+0000 7f364deac640 1 -- start start 2024-09-12T02:24:26.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.990+0000 7f364deac640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f364806cd80 0x7f3648153be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:26.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.990+0000 7f364deac640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f364815a4a0 0x7f3648156660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:26.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.990+0000 7f364deac640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36480c7070 con 0x7f36480c8b10 2024-09-12T02:24:26.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.990+0000 7f364deac640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f364806d210 con 0x7f364815a4a0 2024-09-12T02:24:26.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.990+0000 7f364deac640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f36480c69b0 con 0x7f364806cd80 2024-09-12T02:24:26.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.990+0000 7f36477fe640 1 -- >> v1:172.21.15.60:6789/0 conn(0x7f36480c8b10 legacy=0x7f36481534d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:24:26.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.990+0000 7f3646ffd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f364806cd80 0x7f3648153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:26.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.990+0000 7f3647fff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f364815a4a0 0x7f3648156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:26.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.990+0000 7f3646ffd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f364806cd80 0x7f3648153be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:48806/0 (socket says 172.21.15.60:48806) 2024-09-12T02:24:26.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.990+0000 7f3647fff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f364815a4a0 0x7f3648156660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:43934/0 (socket says 172.21.15.60:43934) 2024-09-12T02:24:26.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.990+0000 7f3646ffd640 1 -- 172.21.15.60:0/2768079956 learned_addr learned my addr 172.21.15.60:0/2768079956 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:24:26.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.990+0000 7f3646ffd640 1 -- 172.21.15.60:0/2768079956 >> v2:172.21.15.105:3300/0 conn(0x7f364815a4a0 msgr2=0x7f3648156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:24:26.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.990+0000 7f3646ffd640 1 --2- 172.21.15.60:0/2768079956 >> v2:172.21.15.105:3300/0 conn(0x7f364815a4a0 0x7f3648156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:26.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.990+0000 7f3646ffd640 1 -- 172.21.15.60:0/2768079956 >> v1:172.21.15.60:6789/0 conn(0x7f36480c8b10 legacy=0x7f36481534d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:24:26.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.990+0000 7f3646ffd640 1 -- 172.21.15.60:0/2768079956 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36480c6c90 con 0x7f364806cd80 2024-09-12T02:24:26.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.990+0000 7f3647fff640 1 --2- 172.21.15.60:0/2768079956 >> v2:172.21.15.105:3300/0 conn(0x7f364815a4a0 0x7f3648156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:24:26.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.991+0000 7f3646ffd640 1 --2- 172.21.15.60:0/2768079956 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f364806cd80 0x7f3648153be0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f363c009870 tx=0x7f363c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12c367836a748b69 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:26.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.991+0000 7f36467fc640 1 -- 172.21.15.60:0/2768079956 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363c037070 con 0x7f364806cd80 2024-09-12T02:24:26.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.991+0000 7f36467fc640 1 -- 172.21.15.60:0/2768079956 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f363c032440 con 0x7f364806cd80 2024-09-12T02:24:26.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.991+0000 7f36467fc640 1 -- 172.21.15.60:0/2768079956 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363c032810 con 0x7f364806cd80 2024-09-12T02:24:26.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.992+0000 7f364deac640 1 -- 172.21.15.60:0/2768079956 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f364806cd80 msgr2=0x7f3648153be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:26.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.992+0000 7f364deac640 1 --2- 172.21.15.60:0/2768079956 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f364806cd80 0x7f3648153be0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f363c009870 tx=0x7f363c02a180 comp rx=0 tx=0).stop 2024-09-12T02:24:26.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.992+0000 7f364deac640 1 -- 172.21.15.60:0/2768079956 shutdown_connections 2024-09-12T02:24:26.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.992+0000 7f364deac640 1 --2- 172.21.15.60:0/2768079956 >> v2:172.21.15.105:3300/0 conn(0x7f364815a4a0 0x7f3648156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:26.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.992+0000 7f364deac640 1 --2- 172.21.15.60:0/2768079956 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f364806cd80 0x7f3648153be0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:26.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.992+0000 7f364deac640 1 -- 172.21.15.60:0/2768079956 >> 172.21.15.60:0/2768079956 conn(0x7f36480adb80 msgr2=0x7f36480adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:24:26.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.992+0000 7f364deac640 1 -- 172.21.15.60:0/2768079956 shutdown_connections 2024-09-12T02:24:26.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.992+0000 7f364deac640 1 -- 172.21.15.60:0/2768079956 wait complete. 2024-09-12T02:24:26.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.993+0000 7f364deac640 1 Processor -- start 2024-09-12T02:24:26.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.994+0000 7f364deac640 1 -- start start 2024-09-12T02:24:26.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.994+0000 7f364deac640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36480c8b10 0x7f36481521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:26.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.994+0000 7f364deac640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f364815a4a0 0x7f364814d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:26.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.994+0000 7f364deac640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36481505d0 0x7f364814df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:26.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.994+0000 7f364deac640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f36480c9070 con 0x7f36481505d0 2024-09-12T02:24:26.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.994+0000 7f364deac640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f36480c8ef0 con 0x7f364815a4a0 2024-09-12T02:24:26.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.994+0000 7f364deac640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3648156ba0 con 0x7f36480c8b10 2024-09-12T02:24:26.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.994+0000 7f3647fff640 1 -- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36481505d0 msgr2=0x7f364814df20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:24:26.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.994+0000 7f3647fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36481505d0 0x7f364814df20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:24:26.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.995+0000 7f3646ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f364815a4a0 0x7f364814d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:26.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.995+0000 7f36477fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36480c8b10 0x7f36481521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:26.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.995+0000 7f3646ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f364815a4a0 0x7f364814d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:43942/0 (socket says 172.21.15.60:43942) 2024-09-12T02:24:26.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.995+0000 7f3646ffd640 1 -- 172.21.15.60:0/4279016026 learned_addr learned my addr 172.21.15.60:0/4279016026 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:24:26.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.995+0000 7f36477fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36480c8b10 0x7f36481521e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:48814/0 (socket says 172.21.15.60:48814) 2024-09-12T02:24:26.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.995+0000 7f36477fe640 1 -- 172.21.15.60:0/4279016026 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f364815a4a0 msgr2=0x7f364814d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:26.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.995+0000 7f36477fe640 1 --2- 172.21.15.60:0/4279016026 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f364815a4a0 0x7f364814d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:26.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.995+0000 7f36477fe640 1 -- 172.21.15.60:0/4279016026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36481505d0 msgr2=0x7f364814df20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:24:26.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.995+0000 7f36477fe640 1 --2- 172.21.15.60:0/4279016026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36481505d0 0x7f364814df20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:26.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.995+0000 7f36477fe640 1 -- 172.21.15.60:0/4279016026 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36481e06a0 con 0x7f36480c8b10 2024-09-12T02:24:26.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.995+0000 7f3646ffd640 1 --2- 172.21.15.60:0/4279016026 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f364815a4a0 0x7f364814d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:24:26.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.995+0000 7f36477fe640 1 --2- 172.21.15.60:0/4279016026 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36480c8b10 0x7f36481521e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f363800b400 tx=0x7f363800b8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:26.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.996+0000 7f362ffff640 1 -- 172.21.15.60:0/4279016026 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3638016070 con 0x7f36480c8b10 2024-09-12T02:24:26.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.996+0000 7f362ffff640 1 -- 172.21.15.60:0/4279016026 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3638003de0 con 0x7f36480c8b10 2024-09-12T02:24:26.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.996+0000 7f364deac640 1 -- 172.21.15.60:0/4279016026 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36481e0980 con 0x7f36480c8b10 2024-09-12T02:24:26.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.996+0000 7f362ffff640 1 -- 172.21.15.60:0/4279016026 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36380052b0 con 0x7f36480c8b10 2024-09-12T02:24:26.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.996+0000 7f364deac640 1 -- 172.21.15.60:0/4279016026 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f36481e18a0 con 0x7f36480c8b10 2024-09-12T02:24:26.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.997+0000 7f364deac640 1 -- 172.21.15.60:0/4279016026 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36480c9d90 con 0x7f36480c8b10 2024-09-12T02:24:26.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.997+0000 7f362ffff640 1 -- 172.21.15.60:0/4279016026 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3638019070 con 0x7f36480c8b10 2024-09-12T02:24:26.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.998+0000 7f362ffff640 1 --2- 172.21.15.60:0/4279016026 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f363406bde0 0x7f363406e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:26.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.998+0000 7f362ffff640 1 -- 172.21.15.60:0/4279016026 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f363808a3c0 con 0x7f36480c8b10 2024-09-12T02:24:26.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.998+0000 7f3646ffd640 1 --2- 172.21.15.60:0/4279016026 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f363406bde0 0x7f363406e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:26.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:26.998+0000 7f3646ffd640 1 --2- 172.21.15.60:0/4279016026 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f363406bde0 0x7f363406e2a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f363c0090b0 tx=0x7f363c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:27.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:27.002+0000 7f362ffff640 1 -- 172.21.15.60:0/4279016026 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3638058410 con 0x7f36480c8b10 2024-09-12T02:24:27.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:27.352+0000 7f364deac640 1 -- 172.21.15.60:0/4279016026 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f36480ae2e0 con 0x7f36480c8b10 2024-09-12T02:24:27.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:27.353+0000 7f362ffff640 1 -- 172.21.15.60:0/4279016026 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f363805c710 con 0x7f36480c8b10 2024-09-12T02:24:27.354 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:24:27.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:27.356+0000 7f364deac640 1 -- 172.21.15.60:0/4279016026 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f363406bde0 msgr2=0x7f363406e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:27.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:27.356+0000 7f364deac640 1 --2- 172.21.15.60:0/4279016026 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f363406bde0 0x7f363406e2a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f363c0090b0 tx=0x7f363c02e000 comp rx=0 tx=0).stop 2024-09-12T02:24:27.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:27.356+0000 7f364deac640 1 -- 172.21.15.60:0/4279016026 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36480c8b10 msgr2=0x7f36481521e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:27.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:27.356+0000 7f364deac640 1 --2- 172.21.15.60:0/4279016026 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36480c8b10 0x7f36481521e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f363800b400 tx=0x7f363800b8c0 comp rx=0 tx=0).stop 2024-09-12T02:24:27.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:27.356+0000 7f364deac640 1 -- 172.21.15.60:0/4279016026 shutdown_connections 2024-09-12T02:24:27.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:27.356+0000 7f364deac640 1 --2- 172.21.15.60:0/4279016026 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f363406bde0 0x7f363406e2a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:27.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:27.356+0000 7f364deac640 1 --2- 172.21.15.60:0/4279016026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36481505d0 0x7f364814df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:27.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:27.356+0000 7f364deac640 1 --2- 172.21.15.60:0/4279016026 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f364815a4a0 0x7f364814d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:27.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:27.356+0000 7f364deac640 1 --2- 172.21.15.60:0/4279016026 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36480c8b10 0x7f36481521e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:27.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:27.356+0000 7f364deac640 1 -- 172.21.15.60:0/4279016026 >> 172.21.15.60:0/4279016026 conn(0x7f36480adb80 msgr2=0x7f3648154c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:24:27.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:27.356+0000 7f364deac640 1 -- 172.21.15.60:0/4279016026 shutdown_connections 2024-09-12T02:24:27.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:27.356+0000 7f364deac640 1 -- 172.21.15.60:0/4279016026 wait complete. 2024-09-12T02:24:30.372 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:24:30.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.524+0000 7f1fc0511640 1 Processor -- start 2024-09-12T02:24:30.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.525+0000 7f1fc0511640 1 -- start start 2024-09-12T02:24:30.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.526+0000 7f1fc0511640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fb80c8b10 0x7f1fb815a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:30.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.526+0000 7f1fc0511640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1fb8153be0 0x7f1fb8156660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:30.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.526+0000 7f1fc0511640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fb80c7070 con 0x7f1fb806cd80 2024-09-12T02:24:30.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.526+0000 7f1fc0511640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f1fb806d210 con 0x7f1fb8153be0 2024-09-12T02:24:30.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.526+0000 7f1fc0511640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1fb80c69b0 con 0x7f1fb80c8b10 2024-09-12T02:24:30.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.526+0000 7f1fbdaac640 1 -- >> v1:172.21.15.60:6789/0 conn(0x7f1fb806cd80 legacy=0x7f1fb81534d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:24:30.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.526+0000 7f1fbeaae640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1fb8153be0 0x7f1fb8156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:30.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.526+0000 7f1fbe2ad640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fb80c8b10 0x7f1fb815a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:30.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.526+0000 7f1fbeaae640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1fb8153be0 0x7f1fb8156660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:33198/0 (socket says 172.21.15.60:33198) 2024-09-12T02:24:30.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.526+0000 7f1fbeaae640 1 -- 172.21.15.60:0/2586693968 learned_addr learned my addr 172.21.15.60:0/2586693968 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:24:30.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.527+0000 7f1fbeaae640 1 -- 172.21.15.60:0/2586693968 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fb80c8b10 msgr2=0x7f1fb815a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:24:30.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.527+0000 7f1fbeaae640 1 --2- 172.21.15.60:0/2586693968 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fb80c8b10 0x7f1fb815a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:30.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.527+0000 7f1fbeaae640 1 -- 172.21.15.60:0/2586693968 >> v1:172.21.15.60:6789/0 conn(0x7f1fb806cd80 legacy=0x7f1fb81534d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:24:30.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.527+0000 7f1fbeaae640 1 -- 172.21.15.60:0/2586693968 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fb80c6c90 con 0x7f1fb8153be0 2024-09-12T02:24:30.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.527+0000 7f1fbe2ad640 1 --2- 172.21.15.60:0/2586693968 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fb80c8b10 0x7f1fb815a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:24:30.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.528+0000 7f1fbeaae640 1 --2- 172.21.15.60:0/2586693968 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fb8153be0 0x7f1fb8156660 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0009e50 tx=0x7f1fb002a630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71e06679bf4fca52 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:30.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.528+0000 7f1fbd2ab640 1 -- 172.21.15.60:0/2586693968 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb0036070 con 0x7f1fb8153be0 2024-09-12T02:24:30.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.528+0000 7f1fbd2ab640 1 -- 172.21.15.60:0/2586693968 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fb0031600 con 0x7f1fb8153be0 2024-09-12T02:24:30.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.528+0000 7f1fbd2ab640 1 -- 172.21.15.60:0/2586693968 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb00319d0 con 0x7f1fb8153be0 2024-09-12T02:24:30.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.529+0000 7f1fc0511640 1 -- 172.21.15.60:0/2586693968 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fb8153be0 msgr2=0x7f1fb8156660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:30.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.529+0000 7f1fc0511640 1 --2- 172.21.15.60:0/2586693968 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fb8153be0 0x7f1fb8156660 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0009e50 tx=0x7f1fb002a630 comp rx=0 tx=0).stop 2024-09-12T02:24:30.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.529+0000 7f1fc0511640 1 -- 172.21.15.60:0/2586693968 shutdown_connections 2024-09-12T02:24:30.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.529+0000 7f1fc0511640 1 --2- 172.21.15.60:0/2586693968 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fb8153be0 0x7f1fb8156660 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:30.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.529+0000 7f1fc0511640 1 --2- 172.21.15.60:0/2586693968 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fb80c8b10 0x7f1fb815a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:30.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.529+0000 7f1fc0511640 1 -- 172.21.15.60:0/2586693968 >> 172.21.15.60:0/2586693968 conn(0x7f1fb80adb80 msgr2=0x7f1fb80adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:24:30.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.529+0000 7f1fc0511640 1 -- 172.21.15.60:0/2586693968 shutdown_connections 2024-09-12T02:24:30.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.529+0000 7f1fc0511640 1 -- 172.21.15.60:0/2586693968 wait complete. 2024-09-12T02:24:30.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.531+0000 7f1fc0511640 1 Processor -- start 2024-09-12T02:24:30.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.531+0000 7f1fc0511640 1 -- start start 2024-09-12T02:24:30.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.532+0000 7f1fc0511640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fb80c8b10 0x7f1fb81ec2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:30.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.532+0000 7f1fc0511640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fb8153be0 0x7f1fb8158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:30.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.532+0000 7f1fc0511640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fb814dff0 0x7f1fb81f0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:30.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.532+0000 7f1fc0511640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb80c9070 con 0x7f1fb80c8b10 2024-09-12T02:24:30.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.532+0000 7f1fc0511640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb80c8ef0 con 0x7f1fb8153be0 2024-09-12T02:24:30.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.532+0000 7f1fc0511640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1fb8156ba0 con 0x7f1fb814dff0 2024-09-12T02:24:30.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.532+0000 7f1fbe2ad640 1 -- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fb80c8b10 msgr2=0x7f1fb81ec2f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:24:30.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.532+0000 7f1fbe2ad640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fb80c8b10 0x7f1fb81ec2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:24:30.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.532+0000 7f1fbdaac640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fb8153be0 0x7f1fb8158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:30.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.532+0000 7f1fbdaac640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fb8153be0 0x7f1fb8158fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:33204/0 (socket says 172.21.15.60:33204) 2024-09-12T02:24:30.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.532+0000 7f1fbdaac640 1 -- 172.21.15.60:0/1667540672 learned_addr learned my addr 172.21.15.60:0/1667540672 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:24:30.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.532+0000 7f1fbeaae640 1 --2- 172.21.15.60:0/1667540672 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fb814dff0 0x7f1fb81f0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:30.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.533+0000 7f1fbdaac640 1 -- 172.21.15.60:0/1667540672 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fb814dff0 msgr2=0x7f1fb81f0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:30.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.533+0000 7f1fbdaac640 1 --2- 172.21.15.60:0/1667540672 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fb814dff0 0x7f1fb81f0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:30.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.533+0000 7f1fbdaac640 1 -- 172.21.15.60:0/1667540672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fb80c8b10 msgr2=0x7f1fb81ec2f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:24:30.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.533+0000 7f1fbdaac640 1 --2- 172.21.15.60:0/1667540672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fb80c8b10 0x7f1fb81ec2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:30.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.533+0000 7f1fbdaac640 1 -- 172.21.15.60:0/1667540672 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fb81ef900 con 0x7f1fb8153be0 2024-09-12T02:24:30.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.533+0000 7f1fbdaac640 1 --2- 172.21.15.60:0/1667540672 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fb8153be0 0x7f1fb8158fa0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1fa800b450 tx=0x7f1fa800b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:30.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.533+0000 7f1faeffd640 1 -- 172.21.15.60:0/1667540672 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa8003dc0 con 0x7f1fb8153be0 2024-09-12T02:24:30.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.533+0000 7f1faeffd640 1 -- 172.21.15.60:0/1667540672 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fa8015070 con 0x7f1fb8153be0 2024-09-12T02:24:30.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.533+0000 7f1faeffd640 1 -- 172.21.15.60:0/1667540672 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa8005290 con 0x7f1fb8153be0 2024-09-12T02:24:30.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.533+0000 7f1fc0511640 1 -- 172.21.15.60:0/1667540672 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fb81506d0 con 0x7f1fb8153be0 2024-09-12T02:24:30.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.533+0000 7f1fc0511640 1 -- 172.21.15.60:0/1667540672 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fb81efb70 con 0x7f1fb8153be0 2024-09-12T02:24:30.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.535+0000 7f1fc0511640 1 -- 172.21.15.60:0/1667540672 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fb8157030 con 0x7f1fb8153be0 2024-09-12T02:24:30.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.535+0000 7f1faeffd640 1 -- 172.21.15.60:0/1667540672 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1fa800f070 con 0x7f1fb8153be0 2024-09-12T02:24:30.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.536+0000 7f1faeffd640 1 --2- 172.21.15.60:0/1667540672 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1f9c06bde0 0x7f1f9c06e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:30.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.536+0000 7f1faeffd640 1 -- 172.21.15.60:0/1667540672 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f1fa808aaf0 con 0x7f1fb8153be0 2024-09-12T02:24:30.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.536+0000 7f1fbe2ad640 1 --2- 172.21.15.60:0/1667540672 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1f9c06bde0 0x7f1f9c06e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:30.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.536+0000 7f1fbe2ad640 1 --2- 172.21.15.60:0/1667540672 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1f9c06bde0 0x7f1f9c06e2a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1fb8159ad0 tx=0x7f1fb4009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:30.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.545+0000 7f1faeffd640 1 -- 172.21.15.60:0/1667540672 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1fa800d040 con 0x7f1fb8153be0 2024-09-12T02:24:30.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.787+0000 7f1fc0511640 1 -- 172.21.15.60:0/1667540672 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1fb81efd40 con 0x7f1fb8153be0 2024-09-12T02:24:30.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.787+0000 7f1faeffd640 1 -- 172.21.15.60:0/1667540672 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f1fa8059060 con 0x7f1fb8153be0 2024-09-12T02:24:30.788 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:24:30.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.790+0000 7f1fc0511640 1 -- 172.21.15.60:0/1667540672 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1f9c06bde0 msgr2=0x7f1f9c06e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:30.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.790+0000 7f1fc0511640 1 --2- 172.21.15.60:0/1667540672 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1f9c06bde0 0x7f1f9c06e2a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1fb8159ad0 tx=0x7f1fb4009190 comp rx=0 tx=0).stop 2024-09-12T02:24:30.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.790+0000 7f1fc0511640 1 -- 172.21.15.60:0/1667540672 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fb8153be0 msgr2=0x7f1fb8158fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:30.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.790+0000 7f1fc0511640 1 --2- 172.21.15.60:0/1667540672 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fb8153be0 0x7f1fb8158fa0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1fa800b450 tx=0x7f1fa800b910 comp rx=0 tx=0).stop 2024-09-12T02:24:30.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.790+0000 7f1fc0511640 1 -- 172.21.15.60:0/1667540672 shutdown_connections 2024-09-12T02:24:30.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.790+0000 7f1fc0511640 1 --2- 172.21.15.60:0/1667540672 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1f9c06bde0 0x7f1f9c06e2a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:30.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.790+0000 7f1fc0511640 1 --2- 172.21.15.60:0/1667540672 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fb814dff0 0x7f1fb81f0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:30.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.790+0000 7f1fc0511640 1 --2- 172.21.15.60:0/1667540672 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fb8153be0 0x7f1fb8158fa0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:30.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.790+0000 7f1fc0511640 1 --2- 172.21.15.60:0/1667540672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fb80c8b10 0x7f1fb81ec2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:30.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.790+0000 7f1fc0511640 1 -- 172.21.15.60:0/1667540672 >> 172.21.15.60:0/1667540672 conn(0x7f1fb80adb80 msgr2=0x7f1fb806c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:24:30.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.790+0000 7f1fc0511640 1 -- 172.21.15.60:0/1667540672 shutdown_connections 2024-09-12T02:24:30.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:30.790+0000 7f1fc0511640 1 -- 172.21.15.60:0/1667540672 wait complete. 2024-09-12T02:24:33.807 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:24:33.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.916+0000 7f2ef3bbd640 1 Processor -- start 2024-09-12T02:24:33.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.916+0000 7f2ef3bbd640 1 -- start start 2024-09-12T02:24:33.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.917+0000 7f2ef3bbd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2eec06cd80 0x7f2eec153be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:33.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.917+0000 7f2ef3bbd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2eec15a4a0 0x7f2eec156660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:33.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.917+0000 7f2ef3bbd640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2eec0c7070 con 0x7f2eec0c8b10 2024-09-12T02:24:33.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.917+0000 7f2ef3bbd640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f2eec06d210 con 0x7f2eec15a4a0 2024-09-12T02:24:33.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.917+0000 7f2ef3bbd640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f2eec0c69b0 con 0x7f2eec06cd80 2024-09-12T02:24:33.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.917+0000 7f2ef215a640 1 -- >> v2:172.21.15.60:3300/0 conn(0x7f2eec15a4a0 msgr2=0x7f2eec156660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:24:33.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.917+0000 7f2ef215a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2eec15a4a0 0x7f2eec156660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:24:33.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.917+0000 7f2ef1158640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2eec06cd80 0x7f2eec153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:33.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.917+0000 7f2ef1158640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2eec06cd80 0x7f2eec153be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:33218/0 (socket says 172.21.15.60:33218) 2024-09-12T02:24:33.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.917+0000 7f2ef1959640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f2eec0c8b10 0x7f2eec1534d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:45516/0 (socket says 172.21.15.60:45516) 2024-09-12T02:24:33.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.917+0000 7f2ef1158640 1 -- 172.21.15.60:0/828980026 learned_addr learned my addr 172.21.15.60:0/828980026 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:24:33.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.917+0000 7f2ef1158640 1 -- 172.21.15.60:0/828980026 >> v2:172.21.15.60:3300/0 conn(0x7f2eec15a4a0 msgr2=0x7f2eec156660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:24:33.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.917+0000 7f2ef1158640 1 --2- 172.21.15.60:0/828980026 >> v2:172.21.15.60:3300/0 conn(0x7f2eec15a4a0 0x7f2eec156660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:33.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.917+0000 7f2ef1158640 1 -- 172.21.15.60:0/828980026 >> v1:172.21.15.105:6789/0 conn(0x7f2eec0c8b10 legacy=0x7f2eec1534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:33.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.917+0000 7f2ef1158640 1 -- 172.21.15.60:0/828980026 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eec0c6c90 con 0x7f2eec06cd80 2024-09-12T02:24:33.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.918+0000 7f2ef1158640 1 --2- 172.21.15.60:0/828980026 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2eec06cd80 0x7f2eec153be0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2eec06ec00 tx=0x7f2edc02a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f68bd626d30ea50 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:33.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.918+0000 7f2ef0957640 1 -- 172.21.15.60:0/828980026 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2edc037070 con 0x7f2eec06cd80 2024-09-12T02:24:33.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.918+0000 7f2ef0957640 1 -- 172.21.15.60:0/828980026 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2edc032440 con 0x7f2eec06cd80 2024-09-12T02:24:33.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.918+0000 7f2ef0957640 1 -- 172.21.15.60:0/828980026 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2edc032810 con 0x7f2eec06cd80 2024-09-12T02:24:33.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.919+0000 7f2ef3bbd640 1 -- 172.21.15.60:0/828980026 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2eec06cd80 msgr2=0x7f2eec153be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:33.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.919+0000 7f2ef3bbd640 1 --2- 172.21.15.60:0/828980026 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2eec06cd80 0x7f2eec153be0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2eec06ec00 tx=0x7f2edc02a210 comp rx=0 tx=0).stop 2024-09-12T02:24:33.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.919+0000 7f2ef3bbd640 1 -- 172.21.15.60:0/828980026 shutdown_connections 2024-09-12T02:24:33.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.919+0000 7f2ef3bbd640 1 --2- 172.21.15.60:0/828980026 >> v2:172.21.15.60:3300/0 conn(0x7f2eec15a4a0 0x7f2eec156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:33.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.919+0000 7f2ef3bbd640 1 --2- 172.21.15.60:0/828980026 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2eec06cd80 0x7f2eec153be0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:33.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.919+0000 7f2ef3bbd640 1 -- 172.21.15.60:0/828980026 >> 172.21.15.60:0/828980026 conn(0x7f2eec0adb80 msgr2=0x7f2eec0adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:24:33.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.919+0000 7f2ef3bbd640 1 -- 172.21.15.60:0/828980026 shutdown_connections 2024-09-12T02:24:33.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.919+0000 7f2ef3bbd640 1 -- 172.21.15.60:0/828980026 wait complete. 2024-09-12T02:24:33.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.920+0000 7f2ef3bbd640 1 Processor -- start 2024-09-12T02:24:33.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.920+0000 7f2ef3bbd640 1 -- start start 2024-09-12T02:24:33.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.921+0000 7f2ef3bbd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2eec0c8b10 0x7f2eec1ebf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:33.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.921+0000 7f2ef3bbd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2eec15a4a0 0x7f2eec14df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:33.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.921+0000 7f2ef3bbd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2eec14cae0 0x7f2eec1efc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:33.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.921+0000 7f2ef3bbd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2eec0c9070 con 0x7f2eec14cae0 2024-09-12T02:24:33.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.921+0000 7f2ef3bbd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2eec0c8ef0 con 0x7f2eec0c8b10 2024-09-12T02:24:33.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.921+0000 7f2ef3bbd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2eec156ba0 con 0x7f2eec15a4a0 2024-09-12T02:24:33.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.921+0000 7f2ef215a640 1 -- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2eec14cae0 msgr2=0x7f2eec1efc90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:24:33.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.921+0000 7f2ef215a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2eec14cae0 0x7f2eec1efc90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:24:33.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.921+0000 7f2ef1959640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2eec0c8b10 0x7f2eec1ebf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:33.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.921+0000 7f2ef1959640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2eec0c8b10 0x7f2eec1ebf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:33226/0 (socket says 172.21.15.60:33226) 2024-09-12T02:24:33.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.921+0000 7f2ef1959640 1 -- 172.21.15.60:0/654761733 learned_addr learned my addr 172.21.15.60:0/654761733 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:24:33.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.921+0000 7f2ef1158640 1 --2- 172.21.15.60:0/654761733 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2eec15a4a0 0x7f2eec14df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:33.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.921+0000 7f2ef1959640 1 -- 172.21.15.60:0/654761733 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2eec15a4a0 msgr2=0x7f2eec14df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:33.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.921+0000 7f2ef1959640 1 --2- 172.21.15.60:0/654761733 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2eec15a4a0 0x7f2eec14df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:33.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.921+0000 7f2ef1959640 1 -- 172.21.15.60:0/654761733 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2eec14cae0 msgr2=0x7f2eec1efc90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:24:33.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.921+0000 7f2ef1959640 1 --2- 172.21.15.60:0/654761733 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2eec14cae0 0x7f2eec1efc90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:33.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.921+0000 7f2ef1959640 1 -- 172.21.15.60:0/654761733 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eec1ef4b0 con 0x7f2eec0c8b10 2024-09-12T02:24:33.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.922+0000 7f2ef1959640 1 --2- 172.21.15.60:0/654761733 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2eec0c8b10 0x7f2eec1ebf40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2ee800c400 tx=0x7f2ee800c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:33.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.922+0000 7f2ee27fc640 1 -- 172.21.15.60:0/654761733 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee80074e0 con 0x7f2eec0c8b10 2024-09-12T02:24:33.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.922+0000 7f2ee27fc640 1 -- 172.21.15.60:0/654761733 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ee8007680 con 0x7f2eec0c8b10 2024-09-12T02:24:33.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.922+0000 7f2ef3bbd640 1 -- 172.21.15.60:0/654761733 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2eec1e21d0 con 0x7f2eec0c8b10 2024-09-12T02:24:33.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.922+0000 7f2ee27fc640 1 -- 172.21.15.60:0/654761733 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee8004a00 con 0x7f2eec0c8b10 2024-09-12T02:24:33.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.922+0000 7f2ef3bbd640 1 -- 172.21.15.60:0/654761733 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2eec1e2790 con 0x7f2eec0c8b10 2024-09-12T02:24:33.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.923+0000 7f2ef3bbd640 1 -- 172.21.15.60:0/654761733 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2eec156660 con 0x7f2eec0c8b10 2024-09-12T02:24:33.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.923+0000 7f2ee27fc640 1 -- 172.21.15.60:0/654761733 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2ee801a020 con 0x7f2eec0c8b10 2024-09-12T02:24:33.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.924+0000 7f2ee27fc640 1 --2- 172.21.15.60:0/654761733 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2ed006bde0 0x7f2ed006e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:33.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.924+0000 7f2ee27fc640 1 -- 172.21.15.60:0/654761733 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f2ee808a8f0 con 0x7f2eec0c8b10 2024-09-12T02:24:33.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.924+0000 7f2ef1158640 1 --2- 172.21.15.60:0/654761733 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2ed006bde0 0x7f2ed006e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:33.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.925+0000 7f2ef1158640 1 --2- 172.21.15.60:0/654761733 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2ed006bde0 0x7f2ed006e2a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2edc034000 tx=0x7f2edc02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:33.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:33.932+0000 7f2ee27fc640 1 -- 172.21.15.60:0/654761733 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2ee8058ef0 con 0x7f2eec0c8b10 2024-09-12T02:24:34.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:34.176+0000 7f2ef3bbd640 1 -- 172.21.15.60:0/654761733 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f2eec0c9d90 con 0x7f2eec0c8b10 2024-09-12T02:24:34.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:34.177+0000 7f2ee27fc640 1 -- 172.21.15.60:0/654761733 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f2ee805f0c0 con 0x7f2eec0c8b10 2024-09-12T02:24:34.177 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":19,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:24:34.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:34.179+0000 7f2ef3bbd640 1 -- 172.21.15.60:0/654761733 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2ed006bde0 msgr2=0x7f2ed006e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:34.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:34.179+0000 7f2ef3bbd640 1 --2- 172.21.15.60:0/654761733 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2ed006bde0 0x7f2ed006e2a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2edc034000 tx=0x7f2edc02e000 comp rx=0 tx=0).stop 2024-09-12T02:24:34.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:34.179+0000 7f2ef3bbd640 1 -- 172.21.15.60:0/654761733 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2eec0c8b10 msgr2=0x7f2eec1ebf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:34.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:34.179+0000 7f2ef3bbd640 1 --2- 172.21.15.60:0/654761733 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2eec0c8b10 0x7f2eec1ebf40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2ee800c400 tx=0x7f2ee800c8c0 comp rx=0 tx=0).stop 2024-09-12T02:24:34.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:34.179+0000 7f2ef3bbd640 1 -- 172.21.15.60:0/654761733 shutdown_connections 2024-09-12T02:24:34.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:34.179+0000 7f2ef3bbd640 1 --2- 172.21.15.60:0/654761733 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2ed006bde0 0x7f2ed006e2a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:34.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:34.179+0000 7f2ef3bbd640 1 --2- 172.21.15.60:0/654761733 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2eec14cae0 0x7f2eec1efc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:34.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:34.179+0000 7f2ef3bbd640 1 --2- 172.21.15.60:0/654761733 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2eec15a4a0 0x7f2eec14df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:34.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:34.179+0000 7f2ef3bbd640 1 --2- 172.21.15.60:0/654761733 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2eec0c8b10 0x7f2eec1ebf40 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:34.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:34.179+0000 7f2ef3bbd640 1 -- 172.21.15.60:0/654761733 >> 172.21.15.60:0/654761733 conn(0x7f2eec0adb80 msgr2=0x7f2eec150f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:24:34.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:34.179+0000 7f2ef3bbd640 1 -- 172.21.15.60:0/654761733 shutdown_connections 2024-09-12T02:24:34.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:34.179+0000 7f2ef3bbd640 1 -- 172.21.15.60:0/654761733 wait complete. 2024-09-12T02:24:34.623 INFO:tasks.workunit.client.1.smithi105.stderr:Note: switching to '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'. 2024-09-12T02:24:34.623 INFO:tasks.workunit.client.1.smithi105.stderr: 2024-09-12T02:24:34.624 INFO:tasks.workunit.client.1.smithi105.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T02:24:34.624 INFO:tasks.workunit.client.1.smithi105.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T02:24:34.624 INFO:tasks.workunit.client.1.smithi105.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T02:24:34.624 INFO:tasks.workunit.client.1.smithi105.stderr: 2024-09-12T02:24:34.624 INFO:tasks.workunit.client.1.smithi105.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T02:24:34.624 INFO:tasks.workunit.client.1.smithi105.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T02:24:34.624 INFO:tasks.workunit.client.1.smithi105.stderr: 2024-09-12T02:24:34.624 INFO:tasks.workunit.client.1.smithi105.stderr: git switch -c 2024-09-12T02:24:34.624 INFO:tasks.workunit.client.1.smithi105.stderr: 2024-09-12T02:24:34.624 INFO:tasks.workunit.client.1.smithi105.stderr:Or undo this operation with: 2024-09-12T02:24:34.624 INFO:tasks.workunit.client.1.smithi105.stderr: 2024-09-12T02:24:34.624 INFO:tasks.workunit.client.1.smithi105.stderr: git switch - 2024-09-12T02:24:34.624 INFO:tasks.workunit.client.1.smithi105.stderr: 2024-09-12T02:24:34.625 INFO:tasks.workunit.client.1.smithi105.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T02:24:34.625 INFO:tasks.workunit.client.1.smithi105.stderr: 2024-09-12T02:24:34.625 INFO:tasks.workunit.client.1.smithi105.stderr:HEAD is now at 086c737fa75 Merge pull request #59733 from zdover23/wip-doc-2024-09-11-backport-59635-to-squid 2024-09-12T02:24:34.628 DEBUG:teuthology.orchestra.run.smithi105:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-09-12T02:24:34.923 INFO:tasks.workunit.client.1.smithi105.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T02:24:34.925 INFO:tasks.workunit.client.1.smithi105.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-12T02:24:34.925 INFO:tasks.workunit.client.1.smithi105.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T02:24:35.535 INFO:tasks.workunit.client.1.smithi105.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T02:24:35.593 INFO:tasks.workunit.client.1.smithi105.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T02:24:35.632 INFO:tasks.workunit.client.1.smithi105.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-12T02:24:35.634 INFO:tasks.workunit.client.1.smithi105.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-12T02:24:35.634 INFO:tasks.workunit.client.1.smithi105.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T02:24:35.672 INFO:tasks.workunit.client.1.smithi105.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-12T02:24:35.675 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T02:24:35.676 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-09-12T02:24:35.691 INFO:tasks.workunit:Running workunits matching suites/ffsb.sh on client.1... 2024-09-12T02:24:35.692 INFO:tasks.workunit:Running workunit suites/ffsb.sh... 2024-09-12T02:24:35.693 DEBUG:teuthology.orchestra.run.smithi105:workunit test suites/ffsb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/ffsb.sh 2024-09-12T02:24:35.757 INFO:tasks.workunit.client.1.smithi105.stderr:++ dirname /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/ffsb.sh 2024-09-12T02:24:35.758 INFO:tasks.workunit.client.1.smithi105.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.1/qa/workunits/suites 2024-09-12T02:24:35.758 INFO:tasks.workunit.client.1.smithi105.stderr:+ trap -- retry EXIT 2024-09-12T02:24:35.758 INFO:tasks.workunit.client.1.smithi105.stderr:+ rm -rf ffsb 2024-09-12T02:24:35.759 INFO:tasks.workunit.client.1.smithi105.stderr:+ timeout 1800 git clone https://git.ceph.com/ffsb.git --depth 1 2024-09-12T02:24:35.763 INFO:tasks.workunit.client.1.smithi105.stderr:Cloning into 'ffsb'... 2024-09-12T02:24:36.634 INFO:tasks.workunit.client.0.smithi060.stderr:Updating files: 93% (12062/12903) Updating files: 94% (12129/12903) Updating files: 95% (12258/12903) Updating files: 96% (12387/12903) Updating files: 97% (12516/12903) Updating files: 98% (12645/12903) Updating files: 99% (12774/12903) Updating files: 100% (12903/12903) Updating files: 100% (12903/12903), done. 2024-09-12T02:24:37.191 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:24:37.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:37.302+0000 7f218fdfd640 1 Processor -- start 2024-09-12T02:24:37.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:37.302+0000 7f218fdfd640 1 -- start start 2024-09-12T02:24:37.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:37.304+0000 7f218fdfd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21880a8270 0x7f2188153ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:37.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:37.304+0000 7f218fdfd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2188071bb0 0x7f21880c4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:37.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:37.304+0000 7f218fdfd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f21880c51b0 0x7f21880c3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:37.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:37.304+0000 7f218fdfd640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f21880c7c30 con 0x7f21880c51b0 2024-09-12T02:24:37.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:37.304+0000 7f218fdfd640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f21880c7f10 con 0x7f2188071bb0 2024-09-12T02:24:37.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:37.304+0000 7f218fdfd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f21880c81f0 con 0x7f21880a8270 2024-09-12T02:24:37.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:37.304+0000 7f218e39a640 1 -- >> v2:172.21.15.60:3300/0 conn(0x7f21880c51b0 msgr2=0x7f21880c3c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:24:37.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:37.304+0000 7f218e39a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f21880c51b0 0x7f21880c3c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:24:37.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:37.304+0000 7f218db99640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21880a8270 0x7f2188153ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:37.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:37.304+0000 7f218d398640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2188071bb0 0x7f21880c4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:37.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:37.304+0000 7f218db99640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21880a8270 0x7f2188153ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:35960/0 (socket says 172.21.15.60:35960) 2024-09-12T02:24:37.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:37.304+0000 7f218d398640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2188071bb0 0x7f21880c4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:33238/0 (socket says 172.21.15.60:33238) 2024-09-12T02:24:37.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:37.304+0000 7f218db99640 1 -- 172.21.15.60:0/2405744741 learned_addr learned my addr 172.21.15.60:0/2405744741 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:24:37.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:37.304+0000 7f218db99640 1 -- 172.21.15.60:0/2405744741 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21880a8270 msgr2=0x7f2188153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:24:37.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:37.304+0000 7f218db99640 1 -- 172.21.15.60:0/2405744741 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21880a8270 msgr2=0x7f2188153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:24:37.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:37.304+0000 7f218db99640 1 --2- 172.21.15.60:0/2405744741 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21880a8270 0x7f2188153ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:24:37.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:37.304+0000 7f218d398640 1 -- 172.21.15.60:0/2405744741 >> v2:172.21.15.105:3300/0 conn(0x7f2188071bb0 msgr2=0x7f21880c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:24:37.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:37.304+0000 7f218d398640 1 -- 172.21.15.60:0/2405744741 >> v2:172.21.15.105:3300/0 conn(0x7f2188071bb0 msgr2=0x7f21880c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:24:37.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:37.304+0000 7f218db99640 1 --2- 172.21.15.60:0/2405744741 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21880a8270 0x7f2188153ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:24:37.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:37.304+0000 7f218d398640 1 --2- 172.21.15.60:0/2405744741 >> v2:172.21.15.105:3300/0 conn(0x7f2188071bb0 0x7f21880c4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:24:37.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:37.304+0000 7f218d398640 1 --2- 172.21.15.60:0/2405744741 >> v2:172.21.15.105:3300/0 conn(0x7f2188071bb0 0x7f21880c4c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:24:37.491 INFO:tasks.workunit.client.0.smithi060.stderr:Note: switching to '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'. 2024-09-12T02:24:37.491 INFO:tasks.workunit.client.0.smithi060.stderr: 2024-09-12T02:24:37.491 INFO:tasks.workunit.client.0.smithi060.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T02:24:37.491 INFO:tasks.workunit.client.0.smithi060.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T02:24:37.491 INFO:tasks.workunit.client.0.smithi060.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T02:24:37.491 INFO:tasks.workunit.client.0.smithi060.stderr: 2024-09-12T02:24:37.491 INFO:tasks.workunit.client.0.smithi060.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T02:24:37.491 INFO:tasks.workunit.client.0.smithi060.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T02:24:37.491 INFO:tasks.workunit.client.0.smithi060.stderr: 2024-09-12T02:24:37.492 INFO:tasks.workunit.client.0.smithi060.stderr: git switch -c 2024-09-12T02:24:37.492 INFO:tasks.workunit.client.0.smithi060.stderr: 2024-09-12T02:24:37.492 INFO:tasks.workunit.client.0.smithi060.stderr:Or undo this operation with: 2024-09-12T02:24:37.492 INFO:tasks.workunit.client.0.smithi060.stderr: 2024-09-12T02:24:37.492 INFO:tasks.workunit.client.0.smithi060.stderr: git switch - 2024-09-12T02:24:37.492 INFO:tasks.workunit.client.0.smithi060.stderr: 2024-09-12T02:24:37.492 INFO:tasks.workunit.client.0.smithi060.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T02:24:37.492 INFO:tasks.workunit.client.0.smithi060.stderr: 2024-09-12T02:24:37.492 INFO:tasks.workunit.client.0.smithi060.stderr:HEAD is now at 086c737fa75 Merge pull request #59733 from zdover23/wip-doc-2024-09-11-backport-59635-to-squid 2024-09-12T02:24:37.497 DEBUG:teuthology.orchestra.run.smithi060:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T02:24:37.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:37.505+0000 7f218e39a640 1 -- 172.21.15.60:0/2405744741 >> v2:172.21.15.60:3300/0 conn(0x7f21880c51b0 msgr2=0x7f21880c3c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:24:37.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:37.505+0000 7f218e39a640 1 --2- 172.21.15.60:0/2405744741 >> v2:172.21.15.60:3300/0 conn(0x7f21880c51b0 0x7f21880c3c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:24:37.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:37.505+0000 7f218d398640 1 --2- 172.21.15.60:0/2405744741 >> v2:172.21.15.105:3300/0 conn(0x7f2188071bb0 0x7f21880c4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:37.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:37.505+0000 7f218db99640 1 --2- 172.21.15.60:0/2405744741 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21880a8270 0x7f2188153ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:37.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:37.505+0000 7f218d398640 1 -- 172.21.15.60:0/2405744741 >> v2:172.21.15.105:3300/0 conn(0x7f2188071bb0 msgr2=0x7f21880c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:24:37.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:37.505+0000 7f218d398640 1 -- 172.21.15.60:0/2405744741 >> v2:172.21.15.105:3300/0 conn(0x7f2188071bb0 msgr2=0x7f21880c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:24:37.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:37.505+0000 7f218db99640 1 -- 172.21.15.60:0/2405744741 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21880a8270 msgr2=0x7f2188153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:24:37.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:37.505+0000 7f218d398640 1 --2- 172.21.15.60:0/2405744741 >> v2:172.21.15.105:3300/0 conn(0x7f2188071bb0 0x7f21880c4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:24:37.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:37.505+0000 7f218db99640 1 -- 172.21.15.60:0/2405744741 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21880a8270 msgr2=0x7f2188153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:24:37.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:37.505+0000 7f218db99640 1 --2- 172.21.15.60:0/2405744741 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21880a8270 0x7f2188153ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:24:37.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:37.505+0000 7f218d398640 1 --2- 172.21.15.60:0/2405744741 >> v2:172.21.15.105:3300/0 conn(0x7f2188071bb0 0x7f21880c4c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:24:37.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:37.505+0000 7f218db99640 1 --2- 172.21.15.60:0/2405744741 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21880a8270 0x7f2188153ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:24:37.525 INFO:tasks.workunit.client.0.smithi060.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T02:24:37.527 INFO:tasks.workunit.client.0.smithi060.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T02:24:37.527 INFO:tasks.workunit.client.0.smithi060.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T02:24:37.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:37.906+0000 7f218e39a640 1 -- 172.21.15.60:0/2405744741 >> v2:172.21.15.60:3300/0 conn(0x7f21880c51b0 msgr2=0x7f21880c3c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:24:37.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:37.906+0000 7f218e39a640 1 --2- 172.21.15.60:0/2405744741 >> v2:172.21.15.60:3300/0 conn(0x7f21880c51b0 0x7f21880c3c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:24:37.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:37.906+0000 7f218d398640 1 --2- 172.21.15.60:0/2405744741 >> v2:172.21.15.105:3300/0 conn(0x7f2188071bb0 0x7f21880c4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:37.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:37.906+0000 7f218db99640 1 --2- 172.21.15.60:0/2405744741 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21880a8270 0x7f2188153ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:37.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:37.906+0000 7f218d398640 1 -- 172.21.15.60:0/2405744741 >> v2:172.21.15.105:3300/0 conn(0x7f2188071bb0 msgr2=0x7f21880c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:24:37.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:37.906+0000 7f218d398640 1 -- 172.21.15.60:0/2405744741 >> v2:172.21.15.105:3300/0 conn(0x7f2188071bb0 msgr2=0x7f21880c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:24:37.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:37.906+0000 7f218d398640 1 --2- 172.21.15.60:0/2405744741 >> v2:172.21.15.105:3300/0 conn(0x7f2188071bb0 0x7f21880c4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:24:37.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:37.906+0000 7f218d398640 1 --2- 172.21.15.60:0/2405744741 >> v2:172.21.15.105:3300/0 conn(0x7f2188071bb0 0x7f21880c4c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:24:37.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:37.906+0000 7f218db99640 1 -- 172.21.15.60:0/2405744741 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21880a8270 msgr2=0x7f2188153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:24:37.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:37.906+0000 7f218db99640 1 -- 172.21.15.60:0/2405744741 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21880a8270 msgr2=0x7f2188153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:24:37.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:37.906+0000 7f218db99640 1 --2- 172.21.15.60:0/2405744741 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21880a8270 0x7f2188153ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:24:37.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:37.906+0000 7f218db99640 1 --2- 172.21.15.60:0/2405744741 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21880a8270 0x7f2188153ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:24:38.133 INFO:tasks.workunit.client.0.smithi060.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T02:24:38.203 INFO:tasks.workunit.client.0.smithi060.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T02:24:38.244 INFO:tasks.workunit.client.0.smithi060.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T02:24:38.245 INFO:tasks.workunit.client.0.smithi060.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T02:24:38.245 INFO:tasks.workunit.client.0.smithi060.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T02:24:38.285 INFO:tasks.workunit.client.0.smithi060.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T02:24:38.289 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T02:24:38.289 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T02:24:38.346 INFO:tasks.workunit:Running workunits matching suites/ffsb.sh on client.0... 2024-09-12T02:24:38.347 INFO:tasks.workunit:Running workunit suites/ffsb.sh... 2024-09-12T02:24:38.347 DEBUG:teuthology.orchestra.run.smithi060:workunit test suites/ffsb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-09-12T02:24:38.414 INFO:tasks.workunit.client.0.smithi060.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-09-12T02:24:38.415 INFO:tasks.workunit.client.0.smithi060.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/suites 2024-09-12T02:24:38.415 INFO:tasks.workunit.client.0.smithi060.stderr:+ trap -- retry EXIT 2024-09-12T02:24:38.415 INFO:tasks.workunit.client.0.smithi060.stderr:+ rm -rf ffsb 2024-09-12T02:24:38.415 INFO:tasks.workunit.client.0.smithi060.stderr:+ timeout 1800 git clone https://git.ceph.com/ffsb.git --depth 1 2024-09-12T02:24:38.420 INFO:tasks.workunit.client.0.smithi060.stderr:Cloning into 'ffsb'... 2024-09-12T02:24:38.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:38.707+0000 7f218e39a640 1 -- 172.21.15.60:0/2405744741 >> v2:172.21.15.60:3300/0 conn(0x7f21880c51b0 msgr2=0x7f21880c3c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:24:38.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:38.707+0000 7f218e39a640 1 --2- 172.21.15.60:0/2405744741 >> v2:172.21.15.60:3300/0 conn(0x7f21880c51b0 0x7f21880c3c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:24:38.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:38.707+0000 7f218d398640 1 --2- 172.21.15.60:0/2405744741 >> v2:172.21.15.105:3300/0 conn(0x7f2188071bb0 0x7f21880c4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:38.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:38.707+0000 7f218db99640 1 --2- 172.21.15.60:0/2405744741 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21880a8270 0x7f2188153ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:38.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:38.707+0000 7f218d398640 1 -- 172.21.15.60:0/2405744741 >> v2:172.21.15.105:3300/0 conn(0x7f2188071bb0 msgr2=0x7f21880c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:24:38.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:38.707+0000 7f218d398640 1 -- 172.21.15.60:0/2405744741 >> v2:172.21.15.105:3300/0 conn(0x7f2188071bb0 msgr2=0x7f21880c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:24:38.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:38.707+0000 7f218d398640 1 --2- 172.21.15.60:0/2405744741 >> v2:172.21.15.105:3300/0 conn(0x7f2188071bb0 0x7f21880c4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:24:38.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:38.707+0000 7f218d398640 1 --2- 172.21.15.60:0/2405744741 >> v2:172.21.15.105:3300/0 conn(0x7f2188071bb0 0x7f21880c4c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:24:38.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:38.707+0000 7f218db99640 1 -- 172.21.15.60:0/2405744741 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21880a8270 msgr2=0x7f2188153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:24:38.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:38.707+0000 7f218db99640 1 -- 172.21.15.60:0/2405744741 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21880a8270 msgr2=0x7f2188153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:24:38.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:38.707+0000 7f218db99640 1 --2- 172.21.15.60:0/2405744741 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21880a8270 0x7f2188153ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:24:38.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:38.707+0000 7f218db99640 1 --2- 172.21.15.60:0/2405744741 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21880a8270 0x7f2188153ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:24:40.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:40.304+0000 7f217f7fe640 1 -- 172.21.15.60:0/2405744741 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21880a8270 msgr2=0x7f2188153ae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:24:40.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:40.304+0000 7f217f7fe640 1 --2- 172.21.15.60:0/2405744741 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21880a8270 0x7f2188153ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:40.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:40.304+0000 7f217f7fe640 1 -- 172.21.15.60:0/2405744741 >> v2:172.21.15.105:3300/0 conn(0x7f2188071bb0 msgr2=0x7f21880c4c70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:24:40.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:40.304+0000 7f217f7fe640 1 --2- 172.21.15.60:0/2405744741 >> v2:172.21.15.105:3300/0 conn(0x7f2188071bb0 0x7f21880c4c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:40.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:40.304+0000 7f217f7fe640 1 -- 172.21.15.60:0/2405744741 >> v2:172.21.15.60:3300/0 conn(0x7f21880c51b0 msgr2=0x7f21880c3c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:24:40.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:40.304+0000 7f217f7fe640 1 --2- 172.21.15.60:0/2405744741 >> v2:172.21.15.60:3300/0 conn(0x7f21880c51b0 0x7f21880c3c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:40.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:40.304+0000 7f217f7fe640 1 -- 172.21.15.60:0/2405744741 --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21880c3720 con 0x7f216c0058b0 2024-09-12T02:24:40.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:40.304+0000 7f217f7fe640 1 -- 172.21.15.60:0/2405744741 --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f216c00e2a0 con 0x7f216c009560 2024-09-12T02:24:40.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:40.304+0000 7f218db99640 1 -- 172.21.15.60:0/2405744741 >> v1:172.21.15.60:6789/0 conn(0x7f216c0058b0 legacy=0x7f216c007d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:24:40.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:40.505+0000 7f218db99640 1 -- 172.21.15.60:0/2405744741 >> v1:172.21.15.60:6789/0 conn(0x7f216c0058b0 legacy=0x7f216c007d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:24:40.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:40.906+0000 7f218db99640 1 -- 172.21.15.60:0/2405744741 >> v1:172.21.15.60:6789/0 conn(0x7f216c0058b0 legacy=0x7f216c007d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:24:41.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:41.707+0000 7f218db99640 1 -- 172.21.15.60:0/2405744741 >> v1:172.21.15.60:6789/0 conn(0x7f216c0058b0 legacy=0x7f216c007d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:24:43.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:43.304+0000 7f217f7fe640 1 -- 172.21.15.60:0/2405744741 >> v1:172.21.15.105:6789/0 conn(0x7f216c009560 legacy=0x7f216c00ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:43.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:43.304+0000 7f217f7fe640 1 -- 172.21.15.60:0/2405744741 >> v1:172.21.15.60:6789/0 conn(0x7f216c0058b0 legacy=0x7f216c007d30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:24:43.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:43.304+0000 7f218e39a640 1 -- 172.21.15.60:0/2405744741 reap_dead start 2024-09-12T02:24:43.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:43.304+0000 7f217f7fe640 1 --2- 172.21.15.60:0/2405744741 >> v2:172.21.15.60:3300/0 conn(0x7f216c00e5e0 0x7f216c00e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:43.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:43.304+0000 7f217f7fe640 1 --2- 172.21.15.60:0/2405744741 >> v2:172.21.15.105:3300/0 conn(0x7f216c00f030 0x7f216c00d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:43.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:43.304+0000 7f217f7fe640 1 -- 172.21.15.60:0/2405744741 --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f216c00f540 con 0x7f216c009560 2024-09-12T02:24:43.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:43.305+0000 7f218d398640 1 -- 172.21.15.60:0/2405744741 >> v2:172.21.15.60:3300/0 conn(0x7f216c00e5e0 msgr2=0x7f216c00e9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:24:43.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:43.305+0000 7f217f7fe640 1 -- 172.21.15.60:0/2405744741 --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f21880c7c30 con 0x7f216c00e5e0 2024-09-12T02:24:43.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:43.305+0000 7f218d398640 1 --2- 172.21.15.60:0/2405744741 >> v2:172.21.15.60:3300/0 conn(0x7f216c00e5e0 0x7f216c00e9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:24:43.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:43.305+0000 7f217f7fe640 1 -- 172.21.15.60:0/2405744741 --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f21880c7f10 con 0x7f216c00f030 2024-09-12T02:24:43.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:43.305+0000 7f218e39a640 1 --2- 172.21.15.60:0/2405744741 >> v2:172.21.15.105:3300/0 conn(0x7f216c00f030 0x7f216c00d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:43.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:43.305+0000 7f218e39a640 1 -- 172.21.15.60:0/2405744741 >> v2:172.21.15.105:3300/0 conn(0x7f216c00f030 msgr2=0x7f216c00d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:24:43.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:43.305+0000 7f218e39a640 1 -- 172.21.15.60:0/2405744741 >> v2:172.21.15.105:3300/0 conn(0x7f216c00f030 msgr2=0x7f216c00d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:24:43.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:43.305+0000 7f218e39a640 1 --2- 172.21.15.60:0/2405744741 >> v2:172.21.15.105:3300/0 conn(0x7f216c00f030 0x7f216c00d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:24:43.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:43.305+0000 7f218e39a640 1 --2- 172.21.15.60:0/2405744741 >> v2:172.21.15.105:3300/0 conn(0x7f216c00f030 0x7f216c00d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:24:43.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:43.506+0000 7f218d398640 1 -- 172.21.15.60:0/2405744741 >> v2:172.21.15.60:3300/0 conn(0x7f216c00e5e0 msgr2=0x7f216c00e9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:24:43.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:43.506+0000 7f218d398640 1 --2- 172.21.15.60:0/2405744741 >> v2:172.21.15.60:3300/0 conn(0x7f216c00e5e0 0x7f216c00e9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:24:43.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:43.506+0000 7f218e39a640 1 --2- 172.21.15.60:0/2405744741 >> v2:172.21.15.105:3300/0 conn(0x7f216c00f030 0x7f216c00d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:43.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:43.506+0000 7f218e39a640 1 -- 172.21.15.60:0/2405744741 >> v2:172.21.15.105:3300/0 conn(0x7f216c00f030 msgr2=0x7f216c00d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:24:43.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:43.506+0000 7f218e39a640 1 -- 172.21.15.60:0/2405744741 >> v2:172.21.15.105:3300/0 conn(0x7f216c00f030 msgr2=0x7f216c00d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:24:43.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:43.506+0000 7f218e39a640 1 --2- 172.21.15.60:0/2405744741 >> v2:172.21.15.105:3300/0 conn(0x7f216c00f030 0x7f216c00d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:24:43.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:43.506+0000 7f218e39a640 1 --2- 172.21.15.60:0/2405744741 >> v2:172.21.15.105:3300/0 conn(0x7f216c00f030 0x7f216c00d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:24:43.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:43.907+0000 7f218d398640 1 -- 172.21.15.60:0/2405744741 >> v2:172.21.15.60:3300/0 conn(0x7f216c00e5e0 msgr2=0x7f216c00e9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:24:43.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:43.907+0000 7f218d398640 1 --2- 172.21.15.60:0/2405744741 >> v2:172.21.15.60:3300/0 conn(0x7f216c00e5e0 0x7f216c00e9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:24:43.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:43.907+0000 7f218e39a640 1 --2- 172.21.15.60:0/2405744741 >> v2:172.21.15.105:3300/0 conn(0x7f216c00f030 0x7f216c00d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:43.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:43.907+0000 7f218e39a640 1 -- 172.21.15.60:0/2405744741 >> v2:172.21.15.105:3300/0 conn(0x7f216c00f030 msgr2=0x7f216c00d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:24:43.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:43.907+0000 7f218e39a640 1 -- 172.21.15.60:0/2405744741 >> v2:172.21.15.105:3300/0 conn(0x7f216c00f030 msgr2=0x7f216c00d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:24:43.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:43.907+0000 7f218e39a640 1 --2- 172.21.15.60:0/2405744741 >> v2:172.21.15.105:3300/0 conn(0x7f216c00f030 0x7f216c00d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:24:43.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:43.907+0000 7f218e39a640 1 --2- 172.21.15.60:0/2405744741 >> v2:172.21.15.105:3300/0 conn(0x7f216c00f030 0x7f216c00d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:24:44.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:44.708+0000 7f218d398640 1 -- 172.21.15.60:0/2405744741 >> v2:172.21.15.60:3300/0 conn(0x7f216c00e5e0 msgr2=0x7f216c00e9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:24:44.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:44.708+0000 7f218d398640 1 --2- 172.21.15.60:0/2405744741 >> v2:172.21.15.60:3300/0 conn(0x7f216c00e5e0 0x7f216c00e9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:24:44.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:44.708+0000 7f218e39a640 1 --2- 172.21.15.60:0/2405744741 >> v2:172.21.15.105:3300/0 conn(0x7f216c00f030 0x7f216c00d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:44.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:44.708+0000 7f218e39a640 1 -- 172.21.15.60:0/2405744741 >> v2:172.21.15.105:3300/0 conn(0x7f216c00f030 msgr2=0x7f216c00d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:24:44.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:44.708+0000 7f218e39a640 1 -- 172.21.15.60:0/2405744741 >> v2:172.21.15.105:3300/0 conn(0x7f216c00f030 msgr2=0x7f216c00d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:24:44.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:44.708+0000 7f218e39a640 1 --2- 172.21.15.60:0/2405744741 >> v2:172.21.15.105:3300/0 conn(0x7f216c00f030 0x7f216c00d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:24:44.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:44.708+0000 7f218e39a640 1 --2- 172.21.15.60:0/2405744741 >> v2:172.21.15.105:3300/0 conn(0x7f216c00f030 0x7f216c00d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:24:46.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.198+0000 7f218cb97640 1 -- 172.21.15.60:0/2405744741 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 336921596 0 0) 0x7f216c00f540 con 0x7f216c009560 2024-09-12T02:24:46.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.198+0000 7f218cb97640 1 -- 172.21.15.60:0/2405744741 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2174003520 con 0x7f216c009560 2024-09-12T02:24:46.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.203+0000 7f218cb97640 1 -- 172.21.15.60:0/2405744741 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3642042043 0 0) 0x7f2174003520 con 0x7f216c009560 2024-09-12T02:24:46.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.203+0000 7f218cb97640 1 -- 172.21.15.60:0/2405744741 >> v2:172.21.15.105:3300/0 conn(0x7f216c00f030 msgr2=0x7f216c00d2c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:24:46.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.203+0000 7f218cb97640 1 --2- 172.21.15.60:0/2405744741 >> v2:172.21.15.105:3300/0 conn(0x7f216c00f030 0x7f216c00d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:46.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.203+0000 7f218cb97640 1 -- 172.21.15.60:0/2405744741 >> v2:172.21.15.60:3300/0 conn(0x7f216c00e5e0 msgr2=0x7f216c00e9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:24:46.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.203+0000 7f218cb97640 1 --2- 172.21.15.60:0/2405744741 >> v2:172.21.15.60:3300/0 conn(0x7f216c00e5e0 0x7f216c00e9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:46.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.203+0000 7f218cb97640 1 -- 172.21.15.60:0/2405744741 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21880c3720 con 0x7f216c009560 2024-09-12T02:24:46.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.203+0000 7f218cb97640 1 -- 172.21.15.60:0/2405744741 <== mon.1 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7f218400f040 con 0x7f216c009560 2024-09-12T02:24:46.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.203+0000 7f218cb97640 1 -- 172.21.15.60:0/2405744741 >> v1:172.21.15.105:6789/0 conn(0x7f216c009560 legacy=0x7f216c00ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:46.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.203+0000 7f218cb97640 1 --2- 172.21.15.60:0/2405744741 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21740039b0 0x7f2174003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:46.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.203+0000 7f218cb97640 1 --2- 172.21.15.60:0/2405744741 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2174004800 0x7f2174004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:46.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.203+0000 7f218cb97640 1 --2- 172.21.15.60:0/2405744741 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2174005210 0x7f217400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:46.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.203+0000 7f218cb97640 1 -- 172.21.15.60:0/2405744741 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f21880c7c30 con 0x7f21740039b0 2024-09-12T02:24:46.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.203+0000 7f218cb97640 1 -- 172.21.15.60:0/2405744741 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f21880c7f10 con 0x7f2174004800 2024-09-12T02:24:46.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.203+0000 7f218cb97640 1 -- 172.21.15.60:0/2405744741 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f217400c1e0 con 0x7f2174005210 2024-09-12T02:24:46.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.203+0000 7f218db99640 1 -- 172.21.15.60:0/2405744741 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21740039b0 msgr2=0x7f2174003dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:24:46.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.203+0000 7f218db99640 1 --2- 172.21.15.60:0/2405744741 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21740039b0 0x7f2174003dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:24:46.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.203+0000 7f218d398640 1 --2- 172.21.15.60:0/2405744741 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2174004800 0x7f2174004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:46.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.203+0000 7f218e39a640 1 --2- 172.21.15.60:0/2405744741 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2174005210 0x7f217400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:46.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.204+0000 7f218d398640 1 -- 172.21.15.60:0/2405744741 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2174005210 msgr2=0x7f217400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:24:46.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.204+0000 7f218d398640 1 --2- 172.21.15.60:0/2405744741 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2174005210 0x7f217400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:46.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.204+0000 7f218d398640 1 -- 172.21.15.60:0/2405744741 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21740039b0 msgr2=0x7f2174003dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:24:46.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.204+0000 7f218d398640 1 --2- 172.21.15.60:0/2405744741 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21740039b0 0x7f2174003dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:46.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.204+0000 7f218d398640 1 -- 172.21.15.60:0/2405744741 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2174003520 con 0x7f2174004800 2024-09-12T02:24:46.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.204+0000 7f218e39a640 1 -- 172.21.15.60:0/2405744741 reap_dead start 2024-09-12T02:24:46.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.205+0000 7f218d398640 1 --2- 172.21.15.60:0/2405744741 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2174004800 0x7f2174004c80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2178006fd0 tx=0x7f2174005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91f2524ab02a4a48 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:46.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.206+0000 7f218cb97640 1 -- 172.21.15.60:0/2405744741 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2178031070 con 0x7f2174004800 2024-09-12T02:24:46.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.206+0000 7f218cb97640 1 -- 172.21.15.60:0/2405744741 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f217802b720 con 0x7f2174004800 2024-09-12T02:24:46.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.206+0000 7f218cb97640 1 -- 172.21.15.60:0/2405744741 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2178011740 con 0x7f2174004800 2024-09-12T02:24:46.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.207+0000 7f218fdfd640 1 -- 172.21.15.60:0/2405744741 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2174004800 msgr2=0x7f2174004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:46.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.207+0000 7f218fdfd640 1 --2- 172.21.15.60:0/2405744741 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2174004800 0x7f2174004c80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2178006fd0 tx=0x7f2174005830 comp rx=0 tx=0).stop 2024-09-12T02:24:46.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.207+0000 7f218fdfd640 1 -- 172.21.15.60:0/2405744741 shutdown_connections 2024-09-12T02:24:46.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.207+0000 7f218fdfd640 1 --2- 172.21.15.60:0/2405744741 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2174004800 0x7f2174004c80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:46.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.207+0000 7f218fdfd640 1 -- 172.21.15.60:0/2405744741 >> 172.21.15.60:0/2405744741 conn(0x7f21880c5680 msgr2=0x7f21880c5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:24:46.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.207+0000 7f218fdfd640 1 -- 172.21.15.60:0/2405744741 shutdown_connections 2024-09-12T02:24:46.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.207+0000 7f218fdfd640 1 -- 172.21.15.60:0/2405744741 wait complete. 2024-09-12T02:24:46.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.209+0000 7f218fdfd640 1 Processor -- start 2024-09-12T02:24:46.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.209+0000 7f218fdfd640 1 -- start start 2024-09-12T02:24:46.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.210+0000 7f218fdfd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2174004800 0x7f21881ec870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:46.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.210+0000 7f218fdfd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21880c1fb0 0x7f21880c2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:46.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.210+0000 7f218fdfd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f218814ab30 0x7f218814afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:46.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.210+0000 7f218fdfd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2188072310 con 0x7f218814ab30 2024-09-12T02:24:46.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.210+0000 7f218fdfd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2188072190 con 0x7f2174004800 2024-09-12T02:24:46.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.210+0000 7f218fdfd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f21880c4c70 con 0x7f21880c1fb0 2024-09-12T02:24:46.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.210+0000 7f218e39a640 1 -- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f218814ab30 msgr2=0x7f218814afb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:24:46.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.210+0000 7f218e39a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f218814ab30 0x7f218814afb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:24:46.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.210+0000 7f218db99640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2174004800 0x7f21881ec870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:46.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.210+0000 7f218d398640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21880c1fb0 0x7f21880c2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:46.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.210+0000 7f218db99640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2174004800 0x7f21881ec870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:54890/0 (socket says 172.21.15.60:54890) 2024-09-12T02:24:46.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.210+0000 7f218d398640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21880c1fb0 0x7f21880c2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:49876/0 (socket says 172.21.15.60:49876) 2024-09-12T02:24:46.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.210+0000 7f218db99640 1 -- 172.21.15.60:0/3406464278 learned_addr learned my addr 172.21.15.60:0/3406464278 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:24:46.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.210+0000 7f218db99640 1 -- 172.21.15.60:0/3406464278 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21880c1fb0 msgr2=0x7f21880c2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:46.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.210+0000 7f218db99640 1 --2- 172.21.15.60:0/3406464278 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21880c1fb0 0x7f21880c2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:46.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.210+0000 7f218db99640 1 -- 172.21.15.60:0/3406464278 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f218814ab30 msgr2=0x7f218814afb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:24:46.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.210+0000 7f218db99640 1 --2- 172.21.15.60:0/3406464278 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f218814ab30 0x7f218814afb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:46.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.211+0000 7f218db99640 1 -- 172.21.15.60:0/3406464278 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21881de1f0 con 0x7f2174004800 2024-09-12T02:24:46.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.211+0000 7f218d398640 1 --2- 172.21.15.60:0/3406464278 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21880c1fb0 0x7f21880c2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:24:46.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.211+0000 7f218db99640 1 --2- 172.21.15.60:0/3406464278 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2174004800 0x7f21881ec870 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2184012940 tx=0x7f2184012e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:46.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.211+0000 7f217e7fc640 1 -- 172.21.15.60:0/3406464278 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f218401a070 con 0x7f2174004800 2024-09-12T02:24:46.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.211+0000 7f217e7fc640 1 -- 172.21.15.60:0/3406464278 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2184010040 con 0x7f2174004800 2024-09-12T02:24:46.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.211+0000 7f217e7fc640 1 -- 172.21.15.60:0/3406464278 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21840153f0 con 0x7f2174004800 2024-09-12T02:24:46.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.211+0000 7f218fdfd640 1 -- 172.21.15.60:0/3406464278 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21881de4d0 con 0x7f2174004800 2024-09-12T02:24:46.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.211+0000 7f218fdfd640 1 -- 172.21.15.60:0/3406464278 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2188152540 con 0x7f2174004800 2024-09-12T02:24:46.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.213+0000 7f218fdfd640 1 -- 172.21.15.60:0/3406464278 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2188153ae0 con 0x7f2174004800 2024-09-12T02:24:46.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.213+0000 7f217e7fc640 1 -- 172.21.15.60:0/3406464278 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f218401d070 con 0x7f2174004800 2024-09-12T02:24:46.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.214+0000 7f217e7fc640 1 --2- 172.21.15.60:0/3406464278 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f216c06caa0 0x7f216c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:46.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.214+0000 7f218d398640 1 --2- 172.21.15.60:0/3406464278 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f216c06caa0 0x7f216c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:46.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.214+0000 7f217e7fc640 1 -- 172.21.15.60:0/3406464278 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f218408b500 con 0x7f2174004800 2024-09-12T02:24:46.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.214+0000 7f218d398640 1 --2- 172.21.15.60:0/3406464278 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f216c06caa0 0x7f216c06ef60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2178036000 tx=0x7f2178031000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:46.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.219+0000 7f217e7fc640 1 -- 172.21.15.60:0/3406464278 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f21840594b0 con 0x7f2174004800 2024-09-12T02:24:46.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.466+0000 7f218fdfd640 1 -- 172.21.15.60:0/3406464278 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f21880c4a50 con 0x7f2174004800 2024-09-12T02:24:46.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.467+0000 7f217e7fc640 1 -- 172.21.15.60:0/3406464278 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7f218405d7b0 con 0x7f2174004800 2024-09-12T02:24:46.467 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":18,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:24:46.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.468+0000 7f218fdfd640 1 -- 172.21.15.60:0/3406464278 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f216c06caa0 msgr2=0x7f216c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:46.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.468+0000 7f218fdfd640 1 --2- 172.21.15.60:0/3406464278 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f216c06caa0 0x7f216c06ef60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2178036000 tx=0x7f2178031000 comp rx=0 tx=0).stop 2024-09-12T02:24:46.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.468+0000 7f218fdfd640 1 -- 172.21.15.60:0/3406464278 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2174004800 msgr2=0x7f21881ec870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:46.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.468+0000 7f218fdfd640 1 --2- 172.21.15.60:0/3406464278 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2174004800 0x7f21881ec870 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2184012940 tx=0x7f2184012e00 comp rx=0 tx=0).stop 2024-09-12T02:24:46.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.468+0000 7f218fdfd640 1 -- 172.21.15.60:0/3406464278 shutdown_connections 2024-09-12T02:24:46.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.468+0000 7f218fdfd640 1 --2- 172.21.15.60:0/3406464278 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f216c06caa0 0x7f216c06ef60 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:46.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.468+0000 7f218fdfd640 1 --2- 172.21.15.60:0/3406464278 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f218814ab30 0x7f218814afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:46.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.468+0000 7f218fdfd640 1 --2- 172.21.15.60:0/3406464278 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21880c1fb0 0x7f21880c2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:46.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.468+0000 7f218fdfd640 1 --2- 172.21.15.60:0/3406464278 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2174004800 0x7f21881ec870 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:46.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.468+0000 7f218fdfd640 1 -- 172.21.15.60:0/3406464278 >> 172.21.15.60:0/3406464278 conn(0x7f21880c5680 msgr2=0x7f21880c3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:24:46.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.469+0000 7f218fdfd640 1 -- 172.21.15.60:0/3406464278 shutdown_connections 2024-09-12T02:24:46.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.469+0000 7f218fdfd640 1 -- 172.21.15.60:0/3406464278 wait complete. 2024-09-12T02:24:46.480 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-12T02:24:46.480 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-12T02:24:46.480 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-12T02:24:46.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.623+0000 7f7d3b04c640 1 Processor -- start 2024-09-12T02:24:46.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.623+0000 7f7d3b04c640 1 -- start start 2024-09-12T02:24:46.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.624+0000 7f7d3b04c640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7d34073ae0 0x7f7d34153380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:46.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.624+0000 7f7d3b04c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d340733d0 0x7f7d341538c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:46.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.624+0000 7f7d3b04c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7d3406d850 0x7f7d34156840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:46.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.624+0000 7f7d3b04c640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f7d3406dd50 con 0x7f7d3406d850 2024-09-12T02:24:46.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.624+0000 7f7d3b04c640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f7d3406e030 con 0x7f7d34073ae0 2024-09-12T02:24:46.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.624+0000 7f7d3b04c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7d3406e310 con 0x7f7d340733d0 2024-09-12T02:24:46.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.624+0000 7f7d395e9640 1 -- >> v2:172.21.15.60:3300/0 conn(0x7f7d3406d850 msgr2=0x7f7d34156840 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:24:46.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.624+0000 7f7d395e9640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7d3406d850 0x7f7d34156840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:24:46.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.624+0000 7f7d38de8640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7d34073ae0 0x7f7d34153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:46.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.624+0000 7f7d38de8640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7d34073ae0 0x7f7d34153380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:54902/0 (socket says 172.21.15.60:54902) 2024-09-12T02:24:46.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.624+0000 7f7d38de8640 1 -- 172.21.15.60:0/614532143 learned_addr learned my addr 172.21.15.60:0/614532143 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:24:46.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.624+0000 7f7d33fff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d340733d0 0x7f7d341538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:46.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.625+0000 7f7d38de8640 1 -- 172.21.15.60:0/614532143 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d340733d0 msgr2=0x7f7d341538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:24:46.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.625+0000 7f7d38de8640 1 --2- 172.21.15.60:0/614532143 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d340733d0 0x7f7d341538c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:46.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.625+0000 7f7d38de8640 1 -- 172.21.15.60:0/614532143 >> v2:172.21.15.60:3300/0 conn(0x7f7d3406d850 msgr2=0x7f7d34156840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:24:46.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.625+0000 7f7d38de8640 1 --2- 172.21.15.60:0/614532143 >> v2:172.21.15.60:3300/0 conn(0x7f7d3406d850 0x7f7d34156840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:46.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.625+0000 7f7d38de8640 1 -- 172.21.15.60:0/614532143 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d3406e5f0 con 0x7f7d34073ae0 2024-09-12T02:24:46.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.625+0000 7f7d33fff640 1 --2- 172.21.15.60:0/614532143 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d340733d0 0x7f7d341538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:24:46.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.625+0000 7f7d38de8640 1 --2- 172.21.15.60:0/614532143 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d34073ae0 0x7f7d34153380 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7d34076720 tx=0x7f7d2402a6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f9adf0922ea2da server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:46.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.626+0000 7f7d337fe640 1 -- 172.21.15.60:0/614532143 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d24036070 con 0x7f7d34073ae0 2024-09-12T02:24:46.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.626+0000 7f7d337fe640 1 -- 172.21.15.60:0/614532143 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d24031600 con 0x7f7d34073ae0 2024-09-12T02:24:46.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.626+0000 7f7d337fe640 1 -- 172.21.15.60:0/614532143 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d240319d0 con 0x7f7d34073ae0 2024-09-12T02:24:46.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.626+0000 7f7d3b04c640 1 -- 172.21.15.60:0/614532143 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d34073ae0 msgr2=0x7f7d34153380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:46.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.626+0000 7f7d3b04c640 1 --2- 172.21.15.60:0/614532143 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d34073ae0 0x7f7d34153380 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7d34076720 tx=0x7f7d2402a6c0 comp rx=0 tx=0).stop 2024-09-12T02:24:46.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.626+0000 7f7d3b04c640 1 -- 172.21.15.60:0/614532143 shutdown_connections 2024-09-12T02:24:46.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.626+0000 7f7d3b04c640 1 --2- 172.21.15.60:0/614532143 >> v2:172.21.15.60:3300/0 conn(0x7f7d3406d850 0x7f7d34156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:46.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.626+0000 7f7d3b04c640 1 --2- 172.21.15.60:0/614532143 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d340733d0 0x7f7d341538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:46.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.626+0000 7f7d3b04c640 1 --2- 172.21.15.60:0/614532143 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d34073ae0 0x7f7d34153380 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:46.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.626+0000 7f7d3b04c640 1 -- 172.21.15.60:0/614532143 >> 172.21.15.60:0/614532143 conn(0x7f7d340c9d80 msgr2=0x7f7d340ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:24:46.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.626+0000 7f7d3b04c640 1 -- 172.21.15.60:0/614532143 shutdown_connections 2024-09-12T02:24:46.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.626+0000 7f7d3b04c640 1 -- 172.21.15.60:0/614532143 wait complete. 2024-09-12T02:24:46.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.627+0000 7f7d3b04c640 1 Processor -- start 2024-09-12T02:24:46.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.628+0000 7f7d3b04c640 1 -- start start 2024-09-12T02:24:46.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.628+0000 7f7d3b04c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d3406d850 0x7f7d341454e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:46.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.628+0000 7f7d3b04c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d340733d0 0x7f7d34147b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:46.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.628+0000 7f7d3b04c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d34073ae0 0x7f7d341ef620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:46.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.628+0000 7f7d3b04c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7d3406edd0 con 0x7f7d34073ae0 2024-09-12T02:24:46.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.628+0000 7f7d3b04c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7d3406ec50 con 0x7f7d3406d850 2024-09-12T02:24:46.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.628+0000 7f7d3b04c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7d34073ec0 con 0x7f7d340733d0 2024-09-12T02:24:46.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.628+0000 7f7d395e9640 1 -- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d34073ae0 msgr2=0x7f7d341ef620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:24:46.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.628+0000 7f7d395e9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d34073ae0 0x7f7d341ef620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:24:46.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.629+0000 7f7d38de8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d3406d850 0x7f7d341454e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:46.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.629+0000 7f7d33fff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d340733d0 0x7f7d34147b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:46.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.629+0000 7f7d38de8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d3406d850 0x7f7d341454e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:54916/0 (socket says 172.21.15.60:54916) 2024-09-12T02:24:46.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.629+0000 7f7d33fff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d340733d0 0x7f7d34147b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:49884/0 (socket says 172.21.15.60:49884) 2024-09-12T02:24:46.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.629+0000 7f7d38de8640 1 -- 172.21.15.60:0/2384289538 learned_addr learned my addr 172.21.15.60:0/2384289538 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:24:46.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.629+0000 7f7d33fff640 1 -- 172.21.15.60:0/2384289538 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d3406d850 msgr2=0x7f7d341454e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:46.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.629+0000 7f7d33fff640 1 --2- 172.21.15.60:0/2384289538 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d3406d850 0x7f7d341454e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:46.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.629+0000 7f7d33fff640 1 -- 172.21.15.60:0/2384289538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d34073ae0 msgr2=0x7f7d341ef620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:24:46.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.629+0000 7f7d33fff640 1 --2- 172.21.15.60:0/2384289538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d34073ae0 0x7f7d341ef620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:46.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.629+0000 7f7d33fff640 1 -- 172.21.15.60:0/2384289538 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d34155440 con 0x7f7d340733d0 2024-09-12T02:24:46.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.629+0000 7f7d38de8640 1 --2- 172.21.15.60:0/2384289538 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d3406d850 0x7f7d341454e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:24:46.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.629+0000 7f7d33fff640 1 --2- 172.21.15.60:0/2384289538 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d340733d0 0x7f7d34147b30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c00e840 tx=0x7f7d1c00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:46.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.629+0000 7f7d317fa640 1 -- 172.21.15.60:0/2384289538 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c017070 con 0x7f7d340733d0 2024-09-12T02:24:46.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.629+0000 7f7d317fa640 1 -- 172.21.15.60:0/2384289538 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d1c00c940 con 0x7f7d340733d0 2024-09-12T02:24:46.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.630+0000 7f7d3b04c640 1 -- 172.21.15.60:0/2384289538 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d341556e0 con 0x7f7d340733d0 2024-09-12T02:24:46.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.630+0000 7f7d317fa640 1 -- 172.21.15.60:0/2384289538 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c00cd30 con 0x7f7d340733d0 2024-09-12T02:24:46.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.630+0000 7f7d3b04c640 1 -- 172.21.15.60:0/2384289538 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d341ef100 con 0x7f7d340733d0 2024-09-12T02:24:46.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.630+0000 7f7d3b04c640 1 --2- 172.21.15.60:0/2384289538 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d3414d890 0x7f7d341524b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:46.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.630+0000 7f7d3b04c640 1 -- 172.21.15.60:0/2384289538 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7d341eef60 con 0x7f7d3414d890 2024-09-12T02:24:46.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.631+0000 7f7d38de8640 1 --2- 172.21.15.60:0/2384289538 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d3414d890 0x7f7d341524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:46.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.631+0000 7f7d38de8640 1 -- 172.21.15.60:0/2384289538 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7d34155c00 con 0x7f7d3414d890 2024-09-12T02:24:46.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.631+0000 7f7d317fa640 1 -- 172.21.15.60:0/2384289538 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7d1c01a070 con 0x7f7d340733d0 2024-09-12T02:24:46.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.631+0000 7f7d38de8640 1 --2- 172.21.15.60:0/2384289538 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d3414d890 0x7f7d341524b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7d340c5d30 tx=0x7f7d24004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:46.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.632+0000 7f7d317fa640 1 --2- 172.21.15.60:0/2384289538 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f7d1406bde0 0x7f7d1406e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:46.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.632+0000 7f7d317fa640 1 -- 172.21.15.60:0/2384289538 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f7d1c08af60 con 0x7f7d340733d0 2024-09-12T02:24:46.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.632+0000 7f7d395e9640 1 --2- 172.21.15.60:0/2384289538 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f7d1406bde0 0x7f7d1406e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:46.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.632+0000 7f7d317fa640 1 -- 172.21.15.60:0/2384289538 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d24043070 con 0x7f7d3414d890 2024-09-12T02:24:46.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.632+0000 7f7d317fa640 1 -- 172.21.15.60:0/2384289538 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f7d2403d870 con 0x7f7d3414d890 2024-09-12T02:24:46.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.632+0000 7f7d317fa640 1 -- 172.21.15.60:0/2384289538 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d3414d890 msgr2=0x7f7d341524b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:46.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.632+0000 7f7d317fa640 1 --2- 172.21.15.60:0/2384289538 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d3414d890 0x7f7d341524b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7d340c5d30 tx=0x7f7d24004a40 comp rx=0 tx=0).stop 2024-09-12T02:24:46.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.632+0000 7f7d317fa640 1 -- 172.21.15.60:0/2384289538 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d3414d890 msgr2=0x7f7d341524b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:24:46.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.632+0000 7f7d317fa640 1 --2- 172.21.15.60:0/2384289538 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d3414d890 0x7f7d341524b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:46.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.632+0000 7f7d395e9640 1 --2- 172.21.15.60:0/2384289538 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f7d1406bde0 0x7f7d1406e2a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c003930 tx=0x7f7d2c006c40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:46.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.638+0000 7f7d3b04c640 1 --2- 172.21.15.60:0/2384289538 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d341efb60 0x7f7d341529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:46.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.638+0000 7f7d3b04c640 1 -- 172.21.15.60:0/2384289538 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7d34072c50 con 0x7f7d341efb60 2024-09-12T02:24:46.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.638+0000 7f7d38de8640 1 --2- 172.21.15.60:0/2384289538 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d341efb60 0x7f7d341529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:46.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.639+0000 7f7d38de8640 1 -- 172.21.15.60:0/2384289538 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7d340701b0 con 0x7f7d341efb60 2024-09-12T02:24:46.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.639+0000 7f7d38de8640 1 --2- 172.21.15.60:0/2384289538 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d341efb60 0x7f7d341529f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7d3414d6a0 tx=0x7f7d2402f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:46.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.639+0000 7f7d317fa640 1 -- 172.21.15.60:0/2384289538 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d24036040 con 0x7f7d341efb60 2024-09-12T02:24:46.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.639+0000 7f7d317fa640 1 -- 172.21.15.60:0/2384289538 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5040 (secure 0 0 0) 0x7f7d24004590 con 0x7f7d341efb60 2024-09-12T02:24:46.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.639+0000 7f7d317fa640 1 -- 172.21.15.60:0/2384289538 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d341efb60 msgr2=0x7f7d341529f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:46.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.639+0000 7f7d317fa640 1 --2- 172.21.15.60:0/2384289538 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d341efb60 0x7f7d341529f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7d3414d6a0 tx=0x7f7d2402f000 comp rx=0 tx=0).stop 2024-09-12T02:24:46.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.639+0000 7f7d317fa640 1 -- 172.21.15.60:0/2384289538 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d341efb60 msgr2=0x7f7d341529f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:24:46.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.639+0000 7f7d317fa640 1 --2- 172.21.15.60:0/2384289538 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d341efb60 0x7f7d341529f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:46.640 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:24:46.641 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:24:46.641 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:24:46.641 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:24:46.641 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 18, 2024-09-12T02:24:46.641 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 32074, 2024-09-12T02:24:46.641 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:24:46.641 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:24:46.641 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:24:46.641 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:46.641 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-09-12T02:24:46.641 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:24:46.641 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:24:46.642 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:24:46.642 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:24:46.642 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:24:46.642 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:24:46.642 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:24:46.642 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:24:46.642 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:24:46.642 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:24:46.642 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:24:46.642 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:24:46.642 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:24:46.642 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:24:46.642 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:46.643 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:24:46.643 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:24:46.643 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:24:46.643 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:24:46.643 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:24:46.643 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:24:46.643 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:24:46.643 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:24:46.643 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:24:46.643 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:24:46.643 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:24:46.643 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:24:46.643 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:24:46.643 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:46.644 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:46.644 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:24:46.644 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:24:46.644 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:24:46.644 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:24:46.644 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:24:46.644 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:24:46.644 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:24:46.644 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:24:46.644 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:24:46.644 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:24:46.644 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:24:46.645 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:24:46.645 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:24:46.645 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:24:46.645 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:24:46.645 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:24:46.645 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:24:46.645 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:24:46.645 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:24:46.645 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:24:46.645 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:24:46.645 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:24:46.645 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:24:46.645 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:24:46.646 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:24:46.646 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:24:46.646 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:24:46.646 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:24:46.646 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:46.646 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:24:46.646 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:46.646 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:24:46.646 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:46.646 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:24:46.646 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:24:46.646 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:24:46.646 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:24:46.646 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:46.647 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:24:46.647 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:24:46.647 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:46.647 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:46.647 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:46.647 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:24:46.647 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:24:46.647 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:46.647 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:46.647 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:46.647 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:46.647 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:24:46.647 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:24:46.648 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:24:46.648 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:24:46.648 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:24:46.648 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:46.648 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:46.648 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:24:46.648 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:24:46.648 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:24:46.648 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:24:46.648 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:46.648 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:24:46.648 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:24:46.648 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:46.649 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:46.649 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:46.649 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:24:46.649 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:24:46.649 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:46.649 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:46.649 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:46.649 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:46.649 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:24:46.649 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:24:46.649 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:24:46.649 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:24:46.649 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:24:46.650 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:46.650 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:46.650 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:24:46.650 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:24:46.650 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:24:46.650 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:24:46.650 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:46.650 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:24:46.650 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:24:46.650 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:46.650 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:46.650 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:46.650 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:24:46.651 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:24:46.651 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:46.651 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:46.651 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:46.651 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:46.651 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:24:46.651 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:24:46.651 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:24:46.651 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:24:46.651 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:24:46.651 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:46.651 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:46.651 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:46.651 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:24:46.652 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:24:46.652 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:46.652 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:24:46.652 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:24:46.652 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:24:46.652 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:46.652 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:46.652 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:24:46.652 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:46.652 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:24:46.652 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:24:46.652 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:24:46.652 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:46.652 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:46.653 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:24:46.653 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:46.653 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:24:46.653 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:24:46.653 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:24:46.653 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:46.653 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:46.653 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:24:46.653 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:46.653 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:24:46.653 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:24:46.653 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:24:46.653 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:46.653 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:46.654 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:24:46.654 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:46.654 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:24:46.654 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:24:46.654 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:24:46.654 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:46.654 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:46.654 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:46.654 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:24:46.654 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:24:46.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.640+0000 7f7d3b04c640 1 -- 172.21.15.60:0/2384289538 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f7d1406bde0 msgr2=0x7f7d1406e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:46.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.640+0000 7f7d3b04c640 1 --2- 172.21.15.60:0/2384289538 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f7d1406bde0 0x7f7d1406e2a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c003930 tx=0x7f7d2c006c40 comp rx=0 tx=0).stop 2024-09-12T02:24:46.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.640+0000 7f7d3b04c640 1 -- 172.21.15.60:0/2384289538 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d340733d0 msgr2=0x7f7d34147b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:46.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.640+0000 7f7d3b04c640 1 --2- 172.21.15.60:0/2384289538 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d340733d0 0x7f7d34147b30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c00e840 tx=0x7f7d1c00ed00 comp rx=0 tx=0).stop 2024-09-12T02:24:46.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.640+0000 7f7d395e9640 1 -- 172.21.15.60:0/2384289538 reap_dead start 2024-09-12T02:24:46.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.640+0000 7f7d395e9640 1 -- 172.21.15.60:0/2384289538 reap_dead start 2024-09-12T02:24:46.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.640+0000 7f7d3b04c640 1 -- 172.21.15.60:0/2384289538 shutdown_connections 2024-09-12T02:24:46.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.640+0000 7f7d3b04c640 1 -- 172.21.15.60:0/2384289538 >> 172.21.15.60:0/2384289538 conn(0x7f7d340c9d80 msgr2=0x7f7d34070490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:24:46.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.640+0000 7f7d3b04c640 1 -- 172.21.15.60:0/2384289538 shutdown_connections 2024-09-12T02:24:46.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.640+0000 7f7d3b04c640 1 -- 172.21.15.60:0/2384289538 wait complete. 2024-09-12T02:24:46.657 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-12T02:24:46.657 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-12T02:24:46.657 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-12T02:24:46.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.760+0000 7f46f035f640 1 Processor -- start 2024-09-12T02:24:46.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.760+0000 7f46f035f640 1 -- start start 2024-09-12T02:24:46.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.761+0000 7f46f035f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f46e8153de0 0x7f46e80ca640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:46.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.761+0000 7f46f035f640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46e80cab80 con 0x7f46e81598c0 2024-09-12T02:24:46.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.761+0000 7f46f035f640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46e80c6b20 con 0x7f46e806bbe0 2024-09-12T02:24:46.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.761+0000 7f46f035f640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f46e80c9480 con 0x7f46e8153de0 2024-09-12T02:24:46.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.761+0000 7f46ee8fc640 1 -- >> v1:172.21.15.60:6789/0 conn(0x7f46e81598c0 legacy=0x7f46e8159d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:24:46.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.761+0000 7f46ee0fb640 1 -- >> v2:172.21.15.60:3300/0 conn(0x7f46e8153de0 msgr2=0x7f46e80ca640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:24:46.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.761+0000 7f46ee0fb640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f46e8153de0 0x7f46e80ca640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:24:46.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.761+0000 7f46ed8fa640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f46e806bbe0 0x7f46e806c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:48530/0 (socket says 172.21.15.60:48530) 2024-09-12T02:24:46.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.761+0000 7f46ed8fa640 1 -- 172.21.15.60:0/1881541874 learned_addr learned my addr 172.21.15.60:0/1881541874 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:24:46.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.761+0000 7f46ed0f9640 1 -- 172.21.15.60:0/1881541874 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3292038082 0 0) 0x7f46e80c6b20 con 0x7f46e806bbe0 2024-09-12T02:24:46.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.761+0000 7f46ed0f9640 1 -- 172.21.15.60:0/1881541874 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46d4003520 con 0x7f46e806bbe0 2024-09-12T02:24:46.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.762+0000 7f46ed0f9640 1 -- 172.21.15.60:0/1881541874 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1734049310 0 0) 0x7f46d4003520 con 0x7f46e806bbe0 2024-09-12T02:24:46.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.762+0000 7f46ed0f9640 1 -- 172.21.15.60:0/1881541874 >> v2:172.21.15.60:3300/0 conn(0x7f46e8153de0 msgr2=0x7f46e80ca640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:24:46.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.762+0000 7f46ed0f9640 1 --2- 172.21.15.60:0/1881541874 >> v2:172.21.15.60:3300/0 conn(0x7f46e8153de0 0x7f46e80ca640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:46.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.762+0000 7f46ed0f9640 1 -- 172.21.15.60:0/1881541874 >> v1:172.21.15.60:6789/0 conn(0x7f46e81598c0 legacy=0x7f46e8159d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:24:46.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.762+0000 7f46ed0f9640 1 -- 172.21.15.60:0/1881541874 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46e80c6e00 con 0x7f46e806bbe0 2024-09-12T02:24:46.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.762+0000 7f46ed0f9640 1 -- 172.21.15.60:0/1881541874 <== mon.1 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7f46d8001670 con 0x7f46e806bbe0 2024-09-12T02:24:46.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.762+0000 7f46ed0f9640 1 -- 172.21.15.60:0/1881541874 >> v1:172.21.15.105:6789/0 conn(0x7f46e806bbe0 legacy=0x7f46e806c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:46.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.762+0000 7f46ed0f9640 1 --2- 172.21.15.60:0/1881541874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46d40039b0 0x7f46d4003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:46.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.762+0000 7f46ed0f9640 1 --2- 172.21.15.60:0/1881541874 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46d4004800 0x7f46d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:46.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.762+0000 7f46ed0f9640 1 --2- 172.21.15.60:0/1881541874 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46d4005230 0x7f46d400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:46.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.762+0000 7f46ee0fb640 1 -- 172.21.15.60:0/1881541874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46d40039b0 msgr2=0x7f46d4003db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:24:46.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.762+0000 7f46ed0f9640 1 -- 172.21.15.60:0/1881541874 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f46e80c9480 con 0x7f46d40039b0 2024-09-12T02:24:46.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.762+0000 7f46ee0fb640 1 --2- 172.21.15.60:0/1881541874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46d40039b0 0x7f46d4003db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:24:46.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.762+0000 7f46ed0f9640 1 -- 172.21.15.60:0/1881541874 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f46d400c190 con 0x7f46d4004800 2024-09-12T02:24:46.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.762+0000 7f46ed0f9640 1 -- 172.21.15.60:0/1881541874 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f46d400c390 con 0x7f46d4005230 2024-09-12T02:24:46.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.762+0000 7f46ed8fa640 1 --2- 172.21.15.60:0/1881541874 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46d4004800 0x7f46d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:46.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.762+0000 7f46ee8fc640 1 --2- 172.21.15.60:0/1881541874 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46d4005230 0x7f46d400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:46.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.762+0000 7f46ed8fa640 1 -- 172.21.15.60:0/1881541874 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46d4005230 msgr2=0x7f46d400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:24:46.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.762+0000 7f46ed8fa640 1 --2- 172.21.15.60:0/1881541874 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46d4005230 0x7f46d400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:46.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.762+0000 7f46ed8fa640 1 -- 172.21.15.60:0/1881541874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46d40039b0 msgr2=0x7f46d4003db0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:24:46.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.762+0000 7f46ed8fa640 1 --2- 172.21.15.60:0/1881541874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46d40039b0 0x7f46d4003db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:46.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.762+0000 7f46ed8fa640 1 -- 172.21.15.60:0/1881541874 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46d4003520 con 0x7f46d4004800 2024-09-12T02:24:46.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.762+0000 7f46ee8fc640 1 -- 172.21.15.60:0/1881541874 reap_dead start 2024-09-12T02:24:46.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.763+0000 7f46ed8fa640 1 --2- 172.21.15.60:0/1881541874 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46d4004800 0x7f46d4004c80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f46d800c210 tx=0x7f46d4005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=269702946df9674f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:46.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.763+0000 7f46ed0f9640 1 -- 172.21.15.60:0/1881541874 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d8007d10 con 0x7f46d4004800 2024-09-12T02:24:46.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.763+0000 7f46ed0f9640 1 -- 172.21.15.60:0/1881541874 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46d8005ad0 con 0x7f46d4004800 2024-09-12T02:24:46.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.763+0000 7f46ed0f9640 1 -- 172.21.15.60:0/1881541874 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d8007070 con 0x7f46d4004800 2024-09-12T02:24:46.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.764+0000 7f46f035f640 1 -- 172.21.15.60:0/1881541874 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46d4004800 msgr2=0x7f46d4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:46.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.764+0000 7f46f035f640 1 --2- 172.21.15.60:0/1881541874 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46d4004800 0x7f46d4004c80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f46d800c210 tx=0x7f46d4005830 comp rx=0 tx=0).stop 2024-09-12T02:24:46.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.764+0000 7f46f035f640 1 -- 172.21.15.60:0/1881541874 shutdown_connections 2024-09-12T02:24:46.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.764+0000 7f46f035f640 1 --2- 172.21.15.60:0/1881541874 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46d4004800 0x7f46d4004c80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:46.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.764+0000 7f46f035f640 1 -- 172.21.15.60:0/1881541874 >> 172.21.15.60:0/1881541874 conn(0x7f46e80c8800 msgr2=0x7f46e80c8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:24:46.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.764+0000 7f46f035f640 1 -- 172.21.15.60:0/1881541874 shutdown_connections 2024-09-12T02:24:46.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.764+0000 7f46f035f640 1 -- 172.21.15.60:0/1881541874 wait complete. 2024-09-12T02:24:46.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.765+0000 7f46f035f640 1 Processor -- start 2024-09-12T02:24:46.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.765+0000 7f46f035f640 1 -- start start 2024-09-12T02:24:46.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.766+0000 7f46f035f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46d4004800 0x7f46e80aea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:46.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.766+0000 7f46f035f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46e80af730 0x7f46e8148aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:46.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.766+0000 7f46f035f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46e8148fe0 0x7f46e81ef200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:46.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.766+0000 7f46f035f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f46e80cbab0 con 0x7f46e80af730 2024-09-12T02:24:46.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.766+0000 7f46f035f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f46e80cb620 con 0x7f46d4004800 2024-09-12T02:24:46.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.766+0000 7f46f035f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f46e80ca640 con 0x7f46e8148fe0 2024-09-12T02:24:46.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.766+0000 7f46ed8fa640 1 -- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46e80af730 msgr2=0x7f46e8148aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:24:46.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.766+0000 7f46ed8fa640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46e80af730 0x7f46e8148aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:24:46.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.766+0000 7f46ee0fb640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46d4004800 0x7f46e80aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:46.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.766+0000 7f46ee0fb640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46d4004800 0x7f46e80aea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:54962/0 (socket says 172.21.15.60:54962) 2024-09-12T02:24:46.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.766+0000 7f46ee8fc640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46e8148fe0 0x7f46e81ef200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:46.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.766+0000 7f46ee0fb640 1 -- 172.21.15.60:0/1477456032 learned_addr learned my addr 172.21.15.60:0/1477456032 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:24:46.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.766+0000 7f46ee0fb640 1 -- 172.21.15.60:0/1477456032 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46e8148fe0 msgr2=0x7f46e81ef200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:46.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.766+0000 7f46ee0fb640 1 --2- 172.21.15.60:0/1477456032 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46e8148fe0 0x7f46e81ef200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:46.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.766+0000 7f46ee0fb640 1 -- 172.21.15.60:0/1477456032 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46e80af730 msgr2=0x7f46e8148aa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:24:46.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.766+0000 7f46ee0fb640 1 --2- 172.21.15.60:0/1477456032 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46e80af730 0x7f46e8148aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:46.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.766+0000 7f46ee0fb640 1 -- 172.21.15.60:0/1477456032 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46e80b15b0 con 0x7f46d4004800 2024-09-12T02:24:46.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.766+0000 7f46ee8fc640 1 --2- 172.21.15.60:0/1477456032 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46e8148fe0 0x7f46e81ef200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:24:46.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.766+0000 7f46ee0fb640 1 --2- 172.21.15.60:0/1477456032 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46d4004800 0x7f46e80aea20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f46e400b5b0 tx=0x7f46e400ba70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:46.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.767+0000 7f46deffd640 1 -- 172.21.15.60:0/1477456032 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e4013020 con 0x7f46d4004800 2024-09-12T02:24:46.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.767+0000 7f46deffd640 1 -- 172.21.15.60:0/1477456032 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46e4003d10 con 0x7f46d4004800 2024-09-12T02:24:46.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.767+0000 7f46deffd640 1 -- 172.21.15.60:0/1477456032 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e40052b0 con 0x7f46d4004800 2024-09-12T02:24:46.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.767+0000 7f46f035f640 1 -- 172.21.15.60:0/1477456032 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46e8156d00 con 0x7f46d4004800 2024-09-12T02:24:46.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.767+0000 7f46f035f640 1 -- 172.21.15.60:0/1477456032 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46e8157540 con 0x7f46d4004800 2024-09-12T02:24:46.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.768+0000 7f46f035f640 1 --2- 172.21.15.60:0/1477456032 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46e81ef740 0x7f46e81efb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:46.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.768+0000 7f46f035f640 1 -- 172.21.15.60:0/1477456032 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f46e80b1380 con 0x7f46e81ef740 2024-09-12T02:24:46.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.768+0000 7f46ed8fa640 1 --2- 172.21.15.60:0/1477456032 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46e81ef740 0x7f46e81efb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:46.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.768+0000 7f46ed8fa640 1 -- 172.21.15.60:0/1477456032 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f46e80ca9d0 con 0x7f46e81ef740 2024-09-12T02:24:46.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.768+0000 7f46deffd640 1 -- 172.21.15.60:0/1477456032 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f46e4016020 con 0x7f46d4004800 2024-09-12T02:24:46.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.768+0000 7f46ed8fa640 1 --2- 172.21.15.60:0/1477456032 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46e81ef740 0x7f46e81efb20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f46d8001eb0 tx=0x7f46e80b1f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:46.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.769+0000 7f46deffd640 1 --2- 172.21.15.60:0/1477456032 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f46cc06be10 0x7f46cc06e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:46.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.769+0000 7f46ee8fc640 1 --2- 172.21.15.60:0/1477456032 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f46cc06be10 0x7f46cc06e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:46.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.769+0000 7f46deffd640 1 -- 172.21.15.60:0/1477456032 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f46e408aec0 con 0x7f46d4004800 2024-09-12T02:24:46.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.769+0000 7f46deffd640 1 -- 172.21.15.60:0/1477456032 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d8040030 con 0x7f46e81ef740 2024-09-12T02:24:46.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.769+0000 7f46deffd640 1 -- 172.21.15.60:0/1477456032 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f46d8001470 con 0x7f46e81ef740 2024-09-12T02:24:46.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.769+0000 7f46deffd640 1 -- 172.21.15.60:0/1477456032 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46e81ef740 msgr2=0x7f46e81efb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:46.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.769+0000 7f46deffd640 1 --2- 172.21.15.60:0/1477456032 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46e81ef740 0x7f46e81efb20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f46d8001eb0 tx=0x7f46e80b1f80 comp rx=0 tx=0).stop 2024-09-12T02:24:46.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.769+0000 7f46deffd640 1 -- 172.21.15.60:0/1477456032 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46e81ef740 msgr2=0x7f46e81efb20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:24:46.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.769+0000 7f46deffd640 1 --2- 172.21.15.60:0/1477456032 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46e81ef740 0x7f46e81efb20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:46.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.769+0000 7f46ee8fc640 1 --2- 172.21.15.60:0/1477456032 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f46cc06be10 0x7f46cc06e2d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f46e80c8760 tx=0x7f46e0009520 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:46.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.775+0000 7f46f035f640 1 --2- 172.21.15.60:0/1477456032 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46e8152650 0x7f46e8152a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:24:46.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.775+0000 7f46f035f640 1 -- 172.21.15.60:0/1477456032 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f46e814c220 con 0x7f46e8152650 2024-09-12T02:24:46.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.775+0000 7f46ed8fa640 1 --2- 172.21.15.60:0/1477456032 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46e8152650 0x7f46e8152a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:24:46.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.776+0000 7f46ed8fa640 1 -- 172.21.15.60:0/1477456032 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f46e80c9600 con 0x7f46e8152650 2024-09-12T02:24:46.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.776+0000 7f46ed8fa640 1 --2- 172.21.15.60:0/1477456032 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46e8152650 0x7f46e8152a70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f46e8069bc0 tx=0x7f46d80078f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:24:46.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.776+0000 7f46deffd640 1 -- 172.21.15.60:0/1477456032 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d8040070 con 0x7f46e8152650 2024-09-12T02:24:46.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.776+0000 7f46deffd640 1 -- 172.21.15.60:0/1477456032 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5039 (secure 0 0 0) 0x7f46d804a030 con 0x7f46e8152650 2024-09-12T02:24:46.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.776+0000 7f46deffd640 1 -- 172.21.15.60:0/1477456032 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46e8152650 msgr2=0x7f46e8152a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:46.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.776+0000 7f46deffd640 1 --2- 172.21.15.60:0/1477456032 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46e8152650 0x7f46e8152a70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f46e8069bc0 tx=0x7f46d80078f0 comp rx=0 tx=0).stop 2024-09-12T02:24:46.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.776+0000 7f46deffd640 1 -- 172.21.15.60:0/1477456032 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46e8152650 msgr2=0x7f46e8152a70 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:24:46.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.776+0000 7f46deffd640 1 --2- 172.21.15.60:0/1477456032 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46e8152650 0x7f46e8152a70 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f46e8069bc0 tx=0x7f46d80078f0 comp rx=0 tx=0).stop 2024-09-12T02:24:46.778 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:24:46.778 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:24:46.778 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:24:46.778 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:24:46.778 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 18, 2024-09-12T02:24:46.778 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 132092, 2024-09-12T02:24:46.779 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:24:46.779 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:24:46.779 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:24:46.779 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:46.779 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-09-12T02:24:46.779 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:24:46.779 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:24:46.779 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:24:46.779 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:24:46.779 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:24:46.779 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:24:46.779 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:24:46.780 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:24:46.780 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:24:46.780 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:24:46.780 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:24:46.780 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:24:46.780 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:24:46.780 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:24:46.780 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:46.780 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:24:46.780 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:24:46.780 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:24:46.781 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:24:46.781 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:24:46.781 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:24:46.781 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:24:46.781 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:24:46.781 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:24:46.781 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:24:46.781 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:24:46.781 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:24:46.781 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:24:46.781 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:46.782 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:46.782 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:24:46.782 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:24:46.782 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:24:46.782 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:24:46.782 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:24:46.782 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:24:46.782 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:24:46.782 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:24:46.782 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:24:46.782 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:24:46.782 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:24:46.783 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:24:46.783 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:24:46.783 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:24:46.783 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:24:46.783 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:24:46.783 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:24:46.783 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:24:46.783 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:24:46.783 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:24:46.783 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:24:46.783 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:24:46.783 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:24:46.784 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:24:46.784 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:24:46.784 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:24:46.784 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:24:46.784 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:24:46.784 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:46.784 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:24:46.784 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:46.784 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:24:46.784 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:46.784 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:24:46.784 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:24:46.785 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:24:46.785 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:24:46.785 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:46.785 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:24:46.785 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:24:46.785 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:46.785 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:46.785 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:46.785 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:24:46.785 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:24:46.786 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:46.786 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:46.786 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:46.786 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:46.786 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:24:46.786 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:24:46.786 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:24:46.786 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:24:46.786 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:24:46.786 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:46.786 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:46.786 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:24:46.787 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:24:46.787 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:24:46.787 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:24:46.787 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:46.787 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:24:46.787 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:24:46.787 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:46.787 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:46.787 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:46.787 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:24:46.787 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:24:46.787 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:46.787 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:46.788 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:46.788 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:46.788 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:24:46.788 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:24:46.788 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:24:46.788 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:24:46.788 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:24:46.788 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:46.788 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:46.788 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:24:46.788 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:24:46.788 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:24:46.789 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:24:46.789 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:46.789 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:24:46.789 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:24:46.789 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:46.789 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:46.789 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:46.789 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:24:46.789 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:24:46.789 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:24:46.789 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:46.789 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:46.790 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:46.790 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:24:46.790 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:24:46.790 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:24:46.790 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:24:46.790 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:24:46.790 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:46.790 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:46.790 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:46.790 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:24:46.790 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:24:46.790 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:46.791 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:24:46.791 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:24:46.791 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:24:46.791 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:46.791 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:46.791 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:24:46.791 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:46.791 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:24:46.791 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:24:46.791 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:24:46.791 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:46.791 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:46.792 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:24:46.792 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:46.792 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:24:46.792 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:24:46.792 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:24:46.792 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:46.792 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:46.792 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:24:46.792 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:46.792 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:24:46.792 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:24:46.793 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:24:46.793 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:46.793 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:24:46.793 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:24:46.793 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:24:46.793 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:24:46.793 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:24:46.793 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:24:46.793 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:24:46.793 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:24:46.793 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:24:46.794 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:24:46.794 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:24:46.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.777+0000 7f46f035f640 1 -- 172.21.15.60:0/1477456032 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f46cc06be10 msgr2=0x7f46cc06e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:46.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.777+0000 7f46f035f640 1 --2- 172.21.15.60:0/1477456032 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f46cc06be10 0x7f46cc06e2d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f46e80c8760 tx=0x7f46e0009520 comp rx=0 tx=0).stop 2024-09-12T02:24:46.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.777+0000 7f46f035f640 1 -- 172.21.15.60:0/1477456032 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46d4004800 msgr2=0x7f46e80aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:24:46.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.777+0000 7f46f035f640 1 --2- 172.21.15.60:0/1477456032 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46d4004800 0x7f46e80aea20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f46e400b5b0 tx=0x7f46e400ba70 comp rx=0 tx=0).stop 2024-09-12T02:24:46.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.777+0000 7f46ee8fc640 1 -- 172.21.15.60:0/1477456032 reap_dead start 2024-09-12T02:24:46.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.777+0000 7f46f035f640 1 -- 172.21.15.60:0/1477456032 shutdown_connections 2024-09-12T02:24:46.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.777+0000 7f46f035f640 1 --2- 172.21.15.60:0/1477456032 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46d4004800 0x7f46e80aea20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:24:46.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.777+0000 7f46f035f640 1 -- 172.21.15.60:0/1477456032 >> 172.21.15.60:0/1477456032 conn(0x7f46e80c8800 msgr2=0x7f46e814e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:24:46.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.777+0000 7f46f035f640 1 -- 172.21.15.60:0/1477456032 shutdown_connections 2024-09-12T02:24:46.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:24:46.777+0000 7f46f035f640 1 -- 172.21.15.60:0/1477456032 wait complete. 2024-09-12T02:24:46.796 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-12T02:24:46.796 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-12T02:24:49.428 INFO:tasks.workunit.client.1.smithi105.stderr:+ trap - EXIT 2024-09-12T02:24:49.428 INFO:tasks.workunit.client.1.smithi105.stderr:+ cd ffsb 2024-09-12T02:24:49.429 INFO:tasks.workunit.client.1.smithi105.stderr:+ ./configure 2024-09-12T02:24:49.593 INFO:tasks.workunit.client.1.smithi105.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-12T02:24:50.601 INFO:tasks.workunit.client.1.smithi105.stdout:checking whether build environment is sane... yes 2024-09-12T02:24:50.615 INFO:tasks.workunit.client.1.smithi105.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-09-12T02:24:50.616 INFO:tasks.workunit.client.1.smithi105.stdout:checking for gawk... gawk 2024-09-12T02:24:50.636 INFO:tasks.workunit.client.1.smithi105.stdout:checking whether make sets $(MAKE)... yes 2024-09-12T02:24:50.677 INFO:tasks.workunit.client.1.smithi105.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-12T02:24:50.677 INFO:tasks.workunit.client.1.smithi105.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-12T02:24:50.873 INFO:tasks.workunit.client.1.smithi105.stdout:checking for style of include used by make... GNU 2024-09-12T02:24:50.877 INFO:tasks.workunit.client.1.smithi105.stdout:checking for gcc... gcc 2024-09-12T02:24:50.956 INFO:tasks.workunit.client.1.smithi105.stdout:checking for C compiler default output file name... a.out 2024-09-12T02:24:50.958 INFO:tasks.workunit.client.1.smithi105.stdout:checking whether the C compiler works... yes 2024-09-12T02:24:50.961 INFO:tasks.workunit.client.1.smithi105.stdout:checking whether we are cross compiling... no 2024-09-12T02:24:51.010 INFO:tasks.workunit.client.1.smithi105.stdout:checking for suffix of executables... 2024-09-12T02:24:51.050 INFO:tasks.workunit.client.1.smithi105.stdout:checking for suffix of object files... o 2024-09-12T02:24:51.089 INFO:tasks.workunit.client.1.smithi105.stdout:checking whether we are using the GNU C compiler... yes 2024-09-12T02:24:51.129 INFO:tasks.workunit.client.1.smithi105.stdout:checking whether gcc accepts -g... yes 2024-09-12T02:24:51.213 INFO:tasks.workunit.client.1.smithi105.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-12T02:24:51.411 INFO:tasks.workunit.client.0.smithi060.stderr:Updating files: 50% (30/59) Updating files: 52% (31/59) Updating files: 54% (32/59) Updating files: 55% (33/59) Updating files: 57% (34/59) Updating files: 59% (35/59) Updating files: 61% (36/59) Updating files: 62% (37/59) Updating files: 64% (38/59) Updating files: 66% (39/59) Updating files: 67% (40/59) Updating files: 69% (41/59) Updating files: 71% (42/59) Updating files: 72% (43/59) Updating files: 74% (44/59) Updating files: 76% (45/59) Updating files: 77% (46/59) Updating files: 79% (47/59) Updating files: 81% (48/59) Updating files: 83% (49/59) Updating files: 84% (50/59) Updating files: 86% (51/59) Updating files: 88% (52/59) Updating files: 89% (53/59) Updating files: 91% (54/59) Updating files: 93% (55/59) Updating files: 94% (56/59) Updating files: 96% (57/59) Updating files: 98% (58/59) Updating files: 100% (59/59) Updating files: 100% (59/59), done. 2024-09-12T02:24:51.451 INFO:tasks.workunit.client.0.smithi060.stderr:+ trap - EXIT 2024-09-12T02:24:51.451 INFO:tasks.workunit.client.0.smithi060.stderr:+ cd ffsb 2024-09-12T02:24:51.452 INFO:tasks.workunit.client.0.smithi060.stderr:+ ./configure 2024-09-12T02:24:51.593 INFO:tasks.workunit.client.0.smithi060.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-12T02:24:52.016 INFO:tasks.workunit.client.1.smithi105.stdout:checking dependency style of gcc... gcc3 2024-09-12T02:24:52.085 INFO:tasks.workunit.client.1.smithi105.stdout:checking how to run the C preprocessor... gcc -E 2024-09-12T02:24:52.139 INFO:tasks.workunit.client.1.smithi105.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-12T02:24:52.141 INFO:tasks.workunit.client.1.smithi105.stdout:checking for egrep... /usr/bin/grep -E 2024-09-12T02:24:52.154 INFO:tasks.workunit.client.1.smithi105.stdout:checking for AIX... no 2024-09-12T02:24:52.177 INFO:tasks.workunit.client.1.smithi105.stdout:checking for gcc... (cached) gcc 2024-09-12T02:24:52.188 INFO:tasks.workunit.client.1.smithi105.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-12T02:24:52.190 INFO:tasks.workunit.client.1.smithi105.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-12T02:24:52.190 INFO:tasks.workunit.client.1.smithi105.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-12T02:24:52.191 INFO:tasks.workunit.client.1.smithi105.stdout:checking dependency style of gcc... (cached) gcc3 2024-09-12T02:24:52.264 INFO:tasks.workunit.client.1.smithi105.stdout:checking for main in -lm... yes 2024-09-12T02:24:52.333 INFO:tasks.workunit.client.1.smithi105.stdout:checking for main in -lpthread... yes 2024-09-12T02:24:52.526 INFO:tasks.workunit.client.1.smithi105.stdout:checking for ANSI C header files... yes 2024-09-12T02:24:52.601 INFO:tasks.workunit.client.0.smithi060.stdout:checking whether build environment is sane... yes 2024-09-12T02:24:52.615 INFO:tasks.workunit.client.0.smithi060.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-09-12T02:24:52.615 INFO:tasks.workunit.client.0.smithi060.stdout:checking for gawk... gawk 2024-09-12T02:24:52.640 INFO:tasks.workunit.client.0.smithi060.stdout:checking whether make sets $(MAKE)... yes 2024-09-12T02:24:52.683 INFO:tasks.workunit.client.0.smithi060.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-12T02:24:52.683 INFO:tasks.workunit.client.0.smithi060.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-12T02:24:52.700 INFO:tasks.workunit.client.0.smithi060.stdout:checking for style of include used by make... GNU 2024-09-12T02:24:52.705 INFO:tasks.workunit.client.0.smithi060.stdout:checking for gcc... gcc 2024-09-12T02:24:52.722 INFO:tasks.workunit.client.1.smithi105.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-09-12T02:24:52.782 INFO:tasks.workunit.client.1.smithi105.stdout:checking for sys/types.h... yes 2024-09-12T02:24:52.791 INFO:tasks.workunit.client.0.smithi060.stdout:checking for C compiler default output file name... a.out 2024-09-12T02:24:52.793 INFO:tasks.workunit.client.0.smithi060.stdout:checking whether the C compiler works... yes 2024-09-12T02:24:52.797 INFO:tasks.workunit.client.0.smithi060.stdout:checking whether we are cross compiling... no 2024-09-12T02:24:52.851 INFO:tasks.workunit.client.0.smithi060.stdout:checking for suffix of executables... 2024-09-12T02:24:52.897 INFO:tasks.workunit.client.0.smithi060.stdout:checking for suffix of object files... o 2024-09-12T02:24:52.939 INFO:tasks.workunit.client.0.smithi060.stdout:checking whether we are using the GNU C compiler... yes 2024-09-12T02:24:52.981 INFO:tasks.workunit.client.0.smithi060.stdout:checking whether gcc accepts -g... yes 2024-09-12T02:24:53.050 INFO:tasks.workunit.client.0.smithi060.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-12T02:24:53.209 INFO:tasks.workunit.client.0.smithi060.stdout:checking dependency style of gcc... gcc3 2024-09-12T02:24:53.280 INFO:tasks.workunit.client.0.smithi060.stdout:checking how to run the C preprocessor... gcc -E 2024-09-12T02:24:53.338 INFO:tasks.workunit.client.0.smithi060.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-12T02:24:53.339 INFO:tasks.workunit.client.0.smithi060.stdout:checking for egrep... /usr/bin/grep -E 2024-09-12T02:24:53.353 INFO:tasks.workunit.client.0.smithi060.stdout:checking for AIX... no 2024-09-12T02:24:53.375 INFO:tasks.workunit.client.0.smithi060.stdout:checking for gcc... (cached) gcc 2024-09-12T02:24:53.388 INFO:tasks.workunit.client.0.smithi060.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-12T02:24:53.389 INFO:tasks.workunit.client.0.smithi060.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-12T02:24:53.389 INFO:tasks.workunit.client.0.smithi060.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-12T02:24:53.390 INFO:tasks.workunit.client.0.smithi060.stdout:checking dependency style of gcc... (cached) gcc3 2024-09-12T02:24:53.394 INFO:tasks.workunit.client.1.smithi105.stdout:checking for sys/stat.h... yes 2024-09-12T02:24:53.457 INFO:tasks.workunit.client.1.smithi105.stdout:checking for stdlib.h... yes 2024-09-12T02:24:53.469 INFO:tasks.workunit.client.0.smithi060.stdout:checking for main in -lm... yes 2024-09-12T02:24:53.520 INFO:tasks.workunit.client.1.smithi105.stdout:checking for string.h... yes 2024-09-12T02:24:53.550 INFO:tasks.workunit.client.0.smithi060.stdout:checking for main in -lpthread... yes 2024-09-12T02:24:53.584 INFO:tasks.workunit.client.1.smithi105.stdout:checking for memory.h... yes 2024-09-12T02:24:53.651 INFO:tasks.workunit.client.1.smithi105.stdout:checking for strings.h... yes 2024-09-12T02:24:53.714 INFO:tasks.workunit.client.1.smithi105.stdout:checking for inttypes.h... yes 2024-09-12T02:24:53.775 INFO:tasks.workunit.client.1.smithi105.stdout:checking for stdint.h... yes 2024-09-12T02:24:53.840 INFO:tasks.workunit.client.1.smithi105.stdout:checking for unistd.h... yes 2024-09-12T02:24:53.917 INFO:tasks.workunit.client.1.smithi105.stdout:checking pthread.h usability... yes 2024-09-12T02:24:53.945 INFO:tasks.workunit.client.1.smithi105.stdout:checking pthread.h presence... yes 2024-09-12T02:24:53.945 INFO:tasks.workunit.client.1.smithi105.stdout:checking for pthread.h... yes 2024-09-12T02:24:54.016 INFO:tasks.workunit.client.1.smithi105.stdout:checking fcntl.h usability... yes 2024-09-12T02:24:54.043 INFO:tasks.workunit.client.1.smithi105.stdout:checking fcntl.h presence... yes 2024-09-12T02:24:54.043 INFO:tasks.workunit.client.1.smithi105.stdout:checking for fcntl.h... yes 2024-09-12T02:24:54.108 INFO:tasks.workunit.client.1.smithi105.stdout:checking limits.h usability... yes 2024-09-12T02:24:54.133 INFO:tasks.workunit.client.1.smithi105.stdout:checking limits.h presence... yes 2024-09-12T02:24:54.133 INFO:tasks.workunit.client.1.smithi105.stdout:checking for limits.h... yes 2024-09-12T02:24:54.155 INFO:tasks.workunit.client.1.smithi105.stdout:checking for stdint.h... (cached) yes 2024-09-12T02:24:54.219 INFO:tasks.workunit.client.1.smithi105.stdout:checking sys/time.h usability... yes 2024-09-12T02:24:54.245 INFO:tasks.workunit.client.1.smithi105.stdout:checking sys/time.h presence... yes 2024-09-12T02:24:54.245 INFO:tasks.workunit.client.1.smithi105.stdout:checking for sys/time.h... yes 2024-09-12T02:24:54.271 INFO:tasks.workunit.client.1.smithi105.stdout:checking for unistd.h... (cached) yes 2024-09-12T02:24:54.332 INFO:tasks.workunit.client.1.smithi105.stdout:checking sys/vfs.h usability... yes 2024-09-12T02:24:54.376 INFO:tasks.workunit.client.1.smithi105.stdout:checking sys/vfs.h presence... yes 2024-09-12T02:24:54.377 INFO:tasks.workunit.client.1.smithi105.stdout:checking for sys/vfs.h... yes 2024-09-12T02:24:54.458 INFO:tasks.workunit.client.1.smithi105.stdout:checking sys/limits.h usability... no 2024-09-12T02:24:54.727 INFO:tasks.workunit.client.0.smithi060.stdout:checking for ANSI C header files... yes 2024-09-12T02:24:54.809 INFO:tasks.workunit.client.0.smithi060.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-09-12T02:24:54.866 INFO:tasks.workunit.client.0.smithi060.stdout:checking for sys/types.h... yes 2024-09-12T02:24:54.932 INFO:tasks.workunit.client.0.smithi060.stdout:checking for sys/stat.h... yes 2024-09-12T02:24:54.971 INFO:tasks.workunit.client.1.smithi105.stdout:checking sys/limits.h presence... no 2024-09-12T02:24:54.971 INFO:tasks.workunit.client.1.smithi105.stdout:checking for sys/limits.h... no 2024-09-12T02:24:54.995 INFO:tasks.workunit.client.0.smithi060.stdout:checking for stdlib.h... yes 2024-09-12T02:24:55.039 INFO:tasks.workunit.client.1.smithi105.stdout:checking for an ANSI C-conforming const... yes 2024-09-12T02:24:55.058 INFO:tasks.workunit.client.0.smithi060.stdout:checking for string.h... yes 2024-09-12T02:24:55.110 INFO:tasks.workunit.client.1.smithi105.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-12T02:24:55.113 INFO:tasks.workunit.client.1.smithi105.stdout:checking for function prototypes... yes 2024-09-12T02:24:55.123 INFO:tasks.workunit.client.0.smithi060.stdout:checking for memory.h... yes 2024-09-12T02:24:55.187 INFO:tasks.workunit.client.0.smithi060.stdout:checking for strings.h... yes 2024-09-12T02:24:55.253 INFO:tasks.workunit.client.0.smithi060.stdout:checking for inttypes.h... yes 2024-09-12T02:24:55.254 INFO:tasks.workunit.client.1.smithi105.stdout:checking whether setvbuf arguments are reversed... no 2024-09-12T02:24:55.318 INFO:tasks.workunit.client.0.smithi060.stdout:checking for stdint.h... yes 2024-09-12T02:24:55.470 INFO:tasks.workunit.client.1.smithi105.stdout:checking for system... yes 2024-09-12T02:24:55.720 INFO:tasks.workunit.client.1.smithi105.stdout:checking for gettimeofday... yes 2024-09-12T02:24:55.863 INFO:tasks.workunit.client.1.smithi105.stdout:checking for mkdir... yes 2024-09-12T02:24:55.951 INFO:tasks.workunit.client.0.smithi060.stdout:checking for unistd.h... yes 2024-09-12T02:24:56.027 INFO:tasks.workunit.client.0.smithi060.stdout:checking pthread.h usability... yes 2024-09-12T02:24:56.056 INFO:tasks.workunit.client.0.smithi060.stdout:checking pthread.h presence... yes 2024-09-12T02:24:56.057 INFO:tasks.workunit.client.0.smithi060.stdout:checking for pthread.h... yes 2024-09-12T02:24:56.083 INFO:tasks.workunit.client.1.smithi105.stdout:checking for strerror... yes 2024-09-12T02:24:56.111 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:24:56.114 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:24:56.130 INFO:tasks.workunit.client.0.smithi060.stdout:checking fcntl.h usability... yes 2024-09-12T02:24:56.158 INFO:tasks.workunit.client.0.smithi060.stdout:checking fcntl.h presence... yes 2024-09-12T02:24:56.158 INFO:tasks.workunit.client.0.smithi060.stdout:checking for fcntl.h... yes 2024-09-12T02:24:56.240 INFO:tasks.workunit.client.0.smithi060.stdout:checking limits.h usability... yes 2024-09-12T02:24:56.268 INFO:tasks.workunit.client.0.smithi060.stdout:checking limits.h presence... yes 2024-09-12T02:24:56.268 INFO:tasks.workunit.client.0.smithi060.stdout:checking for limits.h... yes 2024-09-12T02:24:56.279 INFO:tasks.workunit.client.1.smithi105.stdout:checking for open64... yes 2024-09-12T02:24:56.528 INFO:tasks.workunit.client.0.smithi060.stdout:checking for stdint.h... (cached) yes 2024-09-12T02:24:56.723 INFO:tasks.workunit.client.1.smithi105.stdout:checking for stat64... yes 2024-09-12T02:24:56.724 INFO:tasks.workunit.client.0.smithi060.stdout:checking sys/time.h usability... yes 2024-09-12T02:24:56.724 INFO:tasks.workunit.client.0.smithi060.stdout:checking sys/time.h presence... yes 2024-09-12T02:24:56.724 INFO:tasks.workunit.client.0.smithi060.stdout:checking for sys/time.h... yes 2024-09-12T02:24:56.724 INFO:tasks.workunit.client.0.smithi060.stdout:checking for unistd.h... (cached) yes 2024-09-12T02:24:56.724 INFO:tasks.workunit.client.0.smithi060.stdout:checking sys/vfs.h usability... yes 2024-09-12T02:24:56.738 INFO:tasks.workunit.client.0.smithi060.stdout:checking sys/vfs.h presence... yes 2024-09-12T02:24:56.739 INFO:tasks.workunit.client.0.smithi060.stdout:checking for sys/vfs.h... yes 2024-09-12T02:24:56.888 INFO:tasks.workunit.client.1.smithi105.stdout:checking for fseeko64... yes 2024-09-12T02:24:56.936 INFO:tasks.workunit.client.0.smithi060.stdout:checking sys/limits.h usability... no 2024-09-12T02:24:57.076 INFO:tasks.workunit.client.1.smithi105.stdout:checking for lrand48_r... yes 2024-09-12T02:24:57.244 INFO:tasks.workunit.client.1.smithi105.stdout:checking for srand48_r... yes 2024-09-12T02:24:57.272 INFO:tasks.workunit.client.1.smithi105.stdout:configure: creating ./config.status 2024-09-12T02:24:57.643 INFO:tasks.workunit.client.0.smithi060.stdout:checking sys/limits.h presence... no 2024-09-12T02:24:57.644 INFO:tasks.workunit.client.0.smithi060.stdout:checking for sys/limits.h... no 2024-09-12T02:24:57.694 INFO:tasks.workunit.client.0.smithi060.stdout:checking for an ANSI C-conforming const... yes 2024-09-12T02:24:57.741 INFO:tasks.workunit.client.0.smithi060.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-12T02:24:57.743 INFO:tasks.workunit.client.0.smithi060.stdout:checking for function prototypes... yes 2024-09-12T02:24:57.785 INFO:tasks.workunit.client.0.smithi060.stdout:checking whether setvbuf arguments are reversed... no 2024-09-12T02:24:57.895 INFO:tasks.workunit.client.0.smithi060.stdout:checking for system... yes 2024-09-12T02:24:57.987 INFO:tasks.workunit.client.0.smithi060.stdout:checking for gettimeofday... yes 2024-09-12T02:24:58.078 INFO:tasks.workunit.client.0.smithi060.stdout:checking for mkdir... yes 2024-09-12T02:24:58.166 INFO:tasks.workunit.client.0.smithi060.stdout:checking for strerror... yes 2024-09-12T02:24:58.182 INFO:tasks.workunit.client.1.smithi105.stdout:config.status: creating Makefile 2024-09-12T02:24:58.199 INFO:tasks.workunit.client.1.smithi105.stdout:config.status: creating config.h 2024-09-12T02:24:58.478 INFO:tasks.workunit.client.0.smithi060.stdout:checking for open64... yes 2024-09-12T02:24:58.567 INFO:tasks.workunit.client.0.smithi060.stdout:checking for stat64... yes 2024-09-12T02:24:58.661 INFO:tasks.workunit.client.0.smithi060.stdout:checking for fseeko64... yes 2024-09-12T02:24:58.747 INFO:tasks.workunit.client.0.smithi060.stdout:checking for lrand48_r... yes 2024-09-12T02:24:58.835 INFO:tasks.workunit.client.0.smithi060.stdout:checking for srand48_r... yes 2024-09-12T02:24:58.843 INFO:tasks.workunit.client.1.smithi105.stdout:config.status: executing depfiles commands 2024-09-12T02:24:58.867 INFO:tasks.workunit.client.0.smithi060.stdout:configure: creating ./config.status 2024-09-12T02:24:58.917 INFO:tasks.workunit.client.1.smithi105.stdout:config.status: executing default commands 2024-09-12T02:24:58.983 INFO:tasks.workunit.client.1.smithi105.stderr:+ make 2024-09-12T02:24:59.012 INFO:tasks.workunit.client.0.smithi060.stdout:config.status: creating Makefile 2024-09-12T02:24:59.013 INFO:tasks.workunit.client.1.smithi105.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb/missing --run aclocal-1.10 2024-09-12T02:24:59.021 INFO:tasks.workunit.client.1.smithi105.stderr:/home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb/missing: line 46: aclocal-1.10: command not found 2024-09-12T02:24:59.022 INFO:tasks.workunit.client.1.smithi105.stderr:WARNING: `aclocal-1.10' is missing on your system. You should only need it if 2024-09-12T02:24:59.022 INFO:tasks.workunit.client.1.smithi105.stderr: you modified `acinclude.m4' or `configure.in'. You might want 2024-09-12T02:24:59.022 INFO:tasks.workunit.client.1.smithi105.stderr: to install the `Automake' and `Perl' packages. Grab them from 2024-09-12T02:24:59.022 INFO:tasks.workunit.client.1.smithi105.stderr: any GNU archive site. 2024-09-12T02:24:59.027 INFO:tasks.workunit.client.1.smithi105.stdout: cd . && /bin/sh /home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb/missing --run automake-1.10 --gnu 2024-09-12T02:24:59.032 INFO:tasks.workunit.client.0.smithi060.stdout:config.status: creating config.h 2024-09-12T02:24:59.033 INFO:tasks.workunit.client.1.smithi105.stderr:/home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb/missing: line 46: automake-1.10: command not found 2024-09-12T02:24:59.034 INFO:tasks.workunit.client.1.smithi105.stderr:WARNING: `automake-1.10' is missing on your system. You should only need it if 2024-09-12T02:24:59.034 INFO:tasks.workunit.client.1.smithi105.stderr: you modified `Makefile.am', `acinclude.m4' or `configure.in'. 2024-09-12T02:24:59.034 INFO:tasks.workunit.client.1.smithi105.stderr: You might want to install the `Automake' and `Perl' packages. 2024-09-12T02:24:59.034 INFO:tasks.workunit.client.1.smithi105.stderr: Grab them from any GNU archive site. 2024-09-12T02:24:59.059 INFO:tasks.workunit.client.0.smithi060.stdout:config.status: executing depfiles commands 2024-09-12T02:24:59.131 INFO:tasks.workunit.client.0.smithi060.stdout:config.status: executing default commands 2024-09-12T02:24:59.191 INFO:tasks.workunit.client.0.smithi060.stderr:+ make 2024-09-12T02:24:59.219 INFO:tasks.workunit.client.0.smithi060.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run aclocal-1.10 2024-09-12T02:24:59.226 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: aclocal-1.10: command not found 2024-09-12T02:24:59.227 INFO:tasks.workunit.client.0.smithi060.stderr:WARNING: `aclocal-1.10' is missing on your system. You should only need it if 2024-09-12T02:24:59.227 INFO:tasks.workunit.client.0.smithi060.stderr: you modified `acinclude.m4' or `configure.in'. You might want 2024-09-12T02:24:59.227 INFO:tasks.workunit.client.0.smithi060.stderr: to install the `Automake' and `Perl' packages. Grab them from 2024-09-12T02:24:59.227 INFO:tasks.workunit.client.0.smithi060.stderr: any GNU archive site. 2024-09-12T02:24:59.232 INFO:tasks.workunit.client.0.smithi060.stdout: cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run automake-1.10 --gnu 2024-09-12T02:24:59.237 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: automake-1.10: command not found 2024-09-12T02:24:59.238 INFO:tasks.workunit.client.0.smithi060.stderr:WARNING: `automake-1.10' is missing on your system. You should only need it if 2024-09-12T02:24:59.238 INFO:tasks.workunit.client.0.smithi060.stderr: you modified `Makefile.am', `acinclude.m4' or `configure.in'. 2024-09-12T02:24:59.238 INFO:tasks.workunit.client.0.smithi060.stderr: You might want to install the `Automake' and `Perl' packages. 2024-09-12T02:24:59.238 INFO:tasks.workunit.client.0.smithi060.stderr: Grab them from any GNU archive site. 2024-09-12T02:24:59.350 INFO:tasks.workunit.client.1.smithi105.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb/missing --run autoconf 2024-09-12T02:24:59.676 INFO:tasks.workunit.client.1.smithi105.stderr:aclocal.m4:16: warning: this file was generated for autoconf 2.61. 2024-09-12T02:24:59.676 INFO:tasks.workunit.client.1.smithi105.stderr:You have another version of autoconf. It may work, but is not guaranteed to. 2024-09-12T02:24:59.676 INFO:tasks.workunit.client.1.smithi105.stderr:If you have problems, you may need to regenerate the build system entirely. 2024-09-12T02:24:59.677 INFO:tasks.workunit.client.1.smithi105.stderr:To do so, use the procedure documented by the package, typically `autoreconf'. 2024-09-12T02:24:59.808 INFO:tasks.workunit.client.1.smithi105.stdout:/bin/sh ./config.status --recheck 2024-09-12T02:24:59.870 INFO:tasks.workunit.client.1.smithi105.stdout:running CONFIG_SHELL=/bin/sh /bin/sh ./configure --no-create --no-recursion 2024-09-12T02:24:59.978 INFO:tasks.workunit.client.0.smithi060.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoconf 2024-09-12T02:25:00.012 INFO:tasks.workunit.client.1.smithi105.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-12T02:25:00.333 INFO:tasks.workunit.client.0.smithi060.stderr:aclocal.m4:16: warning: this file was generated for autoconf 2.61. 2024-09-12T02:25:00.333 INFO:tasks.workunit.client.0.smithi060.stderr:You have another version of autoconf. It may work, but is not guaranteed to. 2024-09-12T02:25:00.333 INFO:tasks.workunit.client.0.smithi060.stderr:If you have problems, you may need to regenerate the build system entirely. 2024-09-12T02:25:00.333 INFO:tasks.workunit.client.0.smithi060.stderr:To do so, use the procedure documented by the package, typically `autoreconf'. 2024-09-12T02:25:00.464 INFO:tasks.workunit.client.0.smithi060.stdout:/bin/sh ./config.status --recheck 2024-09-12T02:25:00.525 INFO:tasks.workunit.client.0.smithi060.stdout:running CONFIG_SHELL=/bin/sh /bin/sh ./configure --no-create --no-recursion 2024-09-12T02:25:00.670 INFO:tasks.workunit.client.0.smithi060.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-12T02:25:01.019 INFO:tasks.workunit.client.1.smithi105.stdout:checking whether build environment is sane... yes 2024-09-12T02:25:01.027 INFO:tasks.workunit.client.1.smithi105.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-09-12T02:25:01.028 INFO:tasks.workunit.client.1.smithi105.stdout:checking for gawk... gawk 2024-09-12T02:25:01.046 INFO:tasks.workunit.client.1.smithi105.stdout:checking whether make sets $(MAKE)... yes 2024-09-12T02:25:01.085 INFO:tasks.workunit.client.1.smithi105.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-12T02:25:01.085 INFO:tasks.workunit.client.1.smithi105.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-12T02:25:01.103 INFO:tasks.workunit.client.1.smithi105.stdout:checking for style of include used by make... GNU 2024-09-12T02:25:01.107 INFO:tasks.workunit.client.1.smithi105.stdout:checking for gcc... gcc 2024-09-12T02:25:01.679 INFO:tasks.workunit.client.0.smithi060.stdout:checking whether build environment is sane... yes 2024-09-12T02:25:01.690 INFO:tasks.workunit.client.0.smithi060.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-09-12T02:25:01.691 INFO:tasks.workunit.client.0.smithi060.stdout:checking for gawk... gawk 2024-09-12T02:25:01.716 INFO:tasks.workunit.client.0.smithi060.stdout:checking whether make sets $(MAKE)... yes 2024-09-12T02:25:01.763 INFO:tasks.workunit.client.0.smithi060.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-12T02:25:01.764 INFO:tasks.workunit.client.0.smithi060.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-12T02:25:01.831 INFO:tasks.workunit.client.0.smithi060.stdout:checking for style of include used by make... GNU 2024-09-12T02:25:01.837 INFO:tasks.workunit.client.0.smithi060.stdout:checking for gcc... gcc 2024-09-12T02:25:01.958 INFO:tasks.workunit.client.0.smithi060.stdout:checking whether the C compiler works... yes 2024-09-12T02:25:01.958 INFO:tasks.workunit.client.0.smithi060.stdout:checking for C compiler default output file name... a.out 2024-09-12T02:25:02.012 INFO:tasks.workunit.client.0.smithi060.stdout:checking for suffix of executables... 2024-09-12T02:25:02.025 INFO:tasks.workunit.client.1.smithi105.stdout:checking whether the C compiler works... yes 2024-09-12T02:25:02.025 INFO:tasks.workunit.client.1.smithi105.stdout:checking for C compiler default output file name... a.out 2024-09-12T02:25:02.068 INFO:tasks.workunit.client.0.smithi060.stdout:checking whether we are cross compiling... no 2024-09-12T02:25:02.079 INFO:tasks.workunit.client.1.smithi105.stdout:checking for suffix of executables... 2024-09-12T02:25:02.116 INFO:tasks.workunit.client.0.smithi060.stdout:checking for suffix of object files... o 2024-09-12T02:25:02.132 INFO:tasks.workunit.client.1.smithi105.stdout:checking whether we are cross compiling... no 2024-09-12T02:25:02.150 INFO:tasks.workunit.client.0.smithi060.stdout:checking whether we are using the GNU C compiler... yes 2024-09-12T02:25:02.177 INFO:tasks.workunit.client.1.smithi105.stdout:checking for suffix of object files... o 2024-09-12T02:25:02.183 INFO:tasks.workunit.client.0.smithi060.stdout:checking whether gcc accepts -g... yes 2024-09-12T02:25:02.208 INFO:tasks.workunit.client.1.smithi105.stdout:checking whether we are using the GNU C compiler... yes 2024-09-12T02:25:02.238 INFO:tasks.workunit.client.0.smithi060.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-12T02:25:02.240 INFO:tasks.workunit.client.1.smithi105.stdout:checking whether gcc accepts -g... yes 2024-09-12T02:25:02.288 INFO:tasks.workunit.client.1.smithi105.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-12T02:25:02.388 INFO:tasks.workunit.client.0.smithi060.stdout:checking dependency style of gcc... gcc3 2024-09-12T02:25:02.439 INFO:tasks.workunit.client.1.smithi105.stdout:checking dependency style of gcc... gcc3 2024-09-12T02:25:02.455 INFO:tasks.workunit.client.0.smithi060.stdout:checking how to run the C preprocessor... gcc -E 2024-09-12T02:25:02.504 INFO:tasks.workunit.client.1.smithi105.stdout:checking how to run the C preprocessor... gcc -E 2024-09-12T02:25:02.526 INFO:tasks.workunit.client.0.smithi060.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-12T02:25:02.527 INFO:tasks.workunit.client.0.smithi060.stdout:checking for egrep... /usr/bin/grep -E 2024-09-12T02:25:02.567 INFO:tasks.workunit.client.1.smithi105.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-12T02:25:02.569 INFO:tasks.workunit.client.1.smithi105.stdout:checking for egrep... /usr/bin/grep -E 2024-09-12T02:25:02.701 INFO:tasks.workunit.client.0.smithi060.stdout:checking for ANSI C header files... yes 2024-09-12T02:25:02.731 INFO:tasks.workunit.client.1.smithi105.stdout:checking for ANSI C header files... yes 2024-09-12T02:25:02.748 INFO:tasks.workunit.client.0.smithi060.stdout:checking for sys/types.h... yes 2024-09-12T02:25:02.780 INFO:tasks.workunit.client.1.smithi105.stdout:checking for sys/types.h... yes 2024-09-12T02:25:02.804 INFO:tasks.workunit.client.0.smithi060.stdout:checking for sys/stat.h... yes 2024-09-12T02:25:02.835 INFO:tasks.workunit.client.1.smithi105.stdout:checking for sys/stat.h... yes 2024-09-12T02:25:02.862 INFO:tasks.workunit.client.0.smithi060.stdout:checking for stdlib.h... yes 2024-09-12T02:25:02.892 INFO:tasks.workunit.client.1.smithi105.stdout:checking for stdlib.h... yes 2024-09-12T02:25:02.924 INFO:tasks.workunit.client.0.smithi060.stdout:checking for string.h... yes 2024-09-12T02:25:02.950 INFO:tasks.workunit.client.1.smithi105.stdout:checking for string.h... yes 2024-09-12T02:25:03.000 INFO:tasks.workunit.client.1.smithi105.stdout:checking for memory.h... yes 2024-09-12T02:25:03.052 INFO:tasks.workunit.client.1.smithi105.stdout:checking for strings.h... yes 2024-09-12T02:25:03.103 INFO:tasks.workunit.client.1.smithi105.stdout:checking for inttypes.h... yes 2024-09-12T02:25:03.155 INFO:tasks.workunit.client.1.smithi105.stdout:checking for stdint.h... yes 2024-09-12T02:25:03.212 INFO:tasks.workunit.client.1.smithi105.stdout:checking for unistd.h... yes 2024-09-12T02:25:03.334 INFO:tasks.workunit.client.1.smithi105.stdout:checking minix/config.h usability... no 2024-09-12T02:25:03.370 INFO:tasks.workunit.client.1.smithi105.stdout:checking minix/config.h presence... no 2024-09-12T02:25:03.370 INFO:tasks.workunit.client.1.smithi105.stdout:checking for minix/config.h... no 2024-09-12T02:25:03.412 INFO:tasks.workunit.client.1.smithi105.stdout:checking whether it is safe to define __EXTENSIONS__... yes 2024-09-12T02:25:03.421 INFO:tasks.workunit.client.1.smithi105.stdout:checking for gcc... (cached) gcc 2024-09-12T02:25:03.468 INFO:tasks.workunit.client.1.smithi105.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-12T02:25:03.468 INFO:tasks.workunit.client.1.smithi105.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-12T02:25:03.468 INFO:tasks.workunit.client.1.smithi105.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-12T02:25:03.469 INFO:tasks.workunit.client.1.smithi105.stdout:checking dependency style of gcc... (cached) gcc3 2024-09-12T02:25:03.525 INFO:tasks.workunit.client.0.smithi060.stdout:checking for memory.h... yes 2024-09-12T02:25:03.580 INFO:tasks.workunit.client.0.smithi060.stdout:checking for strings.h... yes 2024-09-12T02:25:03.638 INFO:tasks.workunit.client.0.smithi060.stdout:checking for inttypes.h... yes 2024-09-12T02:25:03.694 INFO:tasks.workunit.client.0.smithi060.stdout:checking for stdint.h... yes 2024-09-12T02:25:03.901 INFO:tasks.workunit.client.0.smithi060.stdout:checking for unistd.h... yes 2024-09-12T02:25:03.970 INFO:tasks.workunit.client.0.smithi060.stdout:checking minix/config.h usability... no 2024-09-12T02:25:04.137 INFO:tasks.workunit.client.1.smithi105.stdout:checking for main in -lm... yes 2024-09-12T02:25:04.198 INFO:tasks.workunit.client.1.smithi105.stdout:checking for main in -lpthread... yes 2024-09-12T02:25:04.201 INFO:tasks.workunit.client.1.smithi105.stdout:checking for ANSI C header files... (cached) yes 2024-09-12T02:25:04.240 INFO:tasks.workunit.client.1.smithi105.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-09-12T02:25:04.296 INFO:tasks.workunit.client.1.smithi105.stdout:checking pthread.h usability... yes 2024-09-12T02:25:04.320 INFO:tasks.workunit.client.1.smithi105.stdout:checking pthread.h presence... yes 2024-09-12T02:25:04.320 INFO:tasks.workunit.client.1.smithi105.stdout:checking for pthread.h... yes 2024-09-12T02:25:04.379 INFO:tasks.workunit.client.1.smithi105.stdout:checking fcntl.h usability... yes 2024-09-12T02:25:04.399 INFO:tasks.workunit.client.1.smithi105.stdout:checking fcntl.h presence... yes 2024-09-12T02:25:04.400 INFO:tasks.workunit.client.1.smithi105.stdout:checking for fcntl.h... yes 2024-09-12T02:25:04.452 INFO:tasks.workunit.client.0.smithi060.stdout:checking minix/config.h presence... no 2024-09-12T02:25:04.452 INFO:tasks.workunit.client.0.smithi060.stdout:checking for minix/config.h... no 2024-09-12T02:25:04.472 INFO:tasks.workunit.client.1.smithi105.stdout:checking limits.h usability... yes 2024-09-12T02:25:04.493 INFO:tasks.workunit.client.1.smithi105.stdout:checking limits.h presence... yes 2024-09-12T02:25:04.493 INFO:tasks.workunit.client.1.smithi105.stdout:checking for limits.h... yes 2024-09-12T02:25:04.517 INFO:tasks.workunit.client.1.smithi105.stdout:checking for stdint.h... (cached) yes 2024-09-12T02:25:04.568 INFO:tasks.workunit.client.1.smithi105.stdout:checking sys/time.h usability... yes 2024-09-12T02:25:04.590 INFO:tasks.workunit.client.1.smithi105.stdout:checking sys/time.h presence... yes 2024-09-12T02:25:04.590 INFO:tasks.workunit.client.1.smithi105.stdout:checking for sys/time.h... yes 2024-09-12T02:25:04.608 INFO:tasks.workunit.client.1.smithi105.stdout:checking for unistd.h... (cached) yes 2024-09-12T02:25:04.657 INFO:tasks.workunit.client.1.smithi105.stdout:checking sys/vfs.h usability... yes 2024-09-12T02:25:04.678 INFO:tasks.workunit.client.1.smithi105.stdout:checking sys/vfs.h presence... yes 2024-09-12T02:25:04.678 INFO:tasks.workunit.client.1.smithi105.stdout:checking for sys/vfs.h... yes 2024-09-12T02:25:05.029 INFO:tasks.workunit.client.0.smithi060.stdout:checking whether it is safe to define __EXTENSIONS__... yes 2024-09-12T02:25:05.043 INFO:tasks.workunit.client.0.smithi060.stdout:checking for gcc... (cached) gcc 2024-09-12T02:25:05.094 INFO:tasks.workunit.client.0.smithi060.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-12T02:25:05.095 INFO:tasks.workunit.client.0.smithi060.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-12T02:25:05.095 INFO:tasks.workunit.client.0.smithi060.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-12T02:25:05.096 INFO:tasks.workunit.client.0.smithi060.stdout:checking dependency style of gcc... (cached) gcc3 2024-09-12T02:25:05.158 INFO:tasks.workunit.client.0.smithi060.stdout:checking for main in -lm... yes 2024-09-12T02:25:05.224 INFO:tasks.workunit.client.0.smithi060.stdout:checking for main in -lpthread... yes 2024-09-12T02:25:05.229 INFO:tasks.workunit.client.0.smithi060.stdout:checking for ANSI C header files... (cached) yes 2024-09-12T02:25:05.267 INFO:tasks.workunit.client.1.smithi105.stdout:checking sys/limits.h usability... no 2024-09-12T02:25:05.306 INFO:tasks.workunit.client.1.smithi105.stdout:checking sys/limits.h presence... no 2024-09-12T02:25:05.307 INFO:tasks.workunit.client.1.smithi105.stdout:checking for sys/limits.h... no 2024-09-12T02:25:05.340 INFO:tasks.workunit.client.1.smithi105.stdout:checking for an ANSI C-conforming const... yes 2024-09-12T02:25:05.375 INFO:tasks.workunit.client.1.smithi105.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-12T02:25:05.453 INFO:tasks.workunit.client.1.smithi105.stdout:checking for system... yes 2024-09-12T02:25:05.975 INFO:tasks.workunit.client.1.smithi105.stdout:checking for gettimeofday... yes 2024-09-12T02:25:06.125 INFO:tasks.workunit.client.0.smithi060.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-09-12T02:25:06.184 INFO:tasks.workunit.client.1.smithi105.stdout:checking for mkdir... yes 2024-09-12T02:25:06.187 INFO:tasks.workunit.client.0.smithi060.stdout:checking pthread.h usability... yes 2024-09-12T02:25:06.213 INFO:tasks.workunit.client.0.smithi060.stdout:checking pthread.h presence... yes 2024-09-12T02:25:06.213 INFO:tasks.workunit.client.0.smithi060.stdout:checking for pthread.h... yes 2024-09-12T02:25:06.275 INFO:tasks.workunit.client.0.smithi060.stdout:checking fcntl.h usability... yes 2024-09-12T02:25:06.297 INFO:tasks.workunit.client.0.smithi060.stdout:checking fcntl.h presence... yes 2024-09-12T02:25:06.298 INFO:tasks.workunit.client.0.smithi060.stdout:checking for fcntl.h... yes 2024-09-12T02:25:06.373 INFO:tasks.workunit.client.0.smithi060.stdout:checking limits.h usability... yes 2024-09-12T02:25:06.398 INFO:tasks.workunit.client.0.smithi060.stdout:checking limits.h presence... yes 2024-09-12T02:25:06.398 INFO:tasks.workunit.client.0.smithi060.stdout:checking for limits.h... yes 2024-09-12T02:25:06.417 INFO:tasks.workunit.client.0.smithi060.stdout:checking for stdint.h... (cached) yes 2024-09-12T02:25:06.473 INFO:tasks.workunit.client.0.smithi060.stdout:checking sys/time.h usability... yes 2024-09-12T02:25:06.498 INFO:tasks.workunit.client.0.smithi060.stdout:checking sys/time.h presence... yes 2024-09-12T02:25:06.498 INFO:tasks.workunit.client.0.smithi060.stdout:checking for sys/time.h... yes 2024-09-12T02:25:06.522 INFO:tasks.workunit.client.0.smithi060.stdout:checking for unistd.h... (cached) yes 2024-09-12T02:25:06.574 INFO:tasks.workunit.client.0.smithi060.stdout:checking sys/vfs.h usability... yes 2024-09-12T02:25:06.596 INFO:tasks.workunit.client.0.smithi060.stdout:checking sys/vfs.h presence... yes 2024-09-12T02:25:06.596 INFO:tasks.workunit.client.0.smithi060.stdout:checking for sys/vfs.h... yes 2024-09-12T02:25:06.666 INFO:tasks.workunit.client.0.smithi060.stdout:checking sys/limits.h usability... no 2024-09-12T02:25:06.704 INFO:tasks.workunit.client.0.smithi060.stdout:checking sys/limits.h presence... no 2024-09-12T02:25:06.705 INFO:tasks.workunit.client.0.smithi060.stdout:checking for sys/limits.h... no 2024-09-12T02:25:06.738 INFO:tasks.workunit.client.0.smithi060.stdout:checking for an ANSI C-conforming const... yes 2024-09-12T02:25:06.776 INFO:tasks.workunit.client.0.smithi060.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-12T02:25:06.797 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-12T02:25:06.798 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-09-12T02:25:06.798 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T02:25:06.798 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T02:25:06.800 INFO:tasks.ceph.mon.a:Started 2024-09-12T02:25:06.800 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-12T02:25:06.800 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:25:06.868 INFO:tasks.workunit.client.0.smithi060.stdout:checking for system... yes 2024-09-12T02:25:06.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.918+0000 7f4ed9566640 1 Processor -- start 2024-09-12T02:25:06.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.918+0000 7f4ed9566640 1 -- start start 2024-09-12T02:25:06.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.919+0000 7f4ed9566640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4ed40aeb10 0x7f4ed4156c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:06.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.919+0000 7f4ed9566640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ed40a7cc0 con 0x7f4ed40c7a90 2024-09-12T02:25:06.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.919+0000 7f4ed9566640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ed4157160 con 0x7f4ed40c7ef0 2024-09-12T02:25:06.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.919+0000 7f4ed9566640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f4ed40c3580 con 0x7f4ed40aeb10 2024-09-12T02:25:06.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.919+0000 7f4ed2ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4ed40aeb10 0x7f4ed4156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:06.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.919+0000 7f4ed2ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4ed40aeb10 0x7f4ed4156c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47096/0 (socket says 172.21.15.60:47096) 2024-09-12T02:25:06.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.919+0000 7f4ed2ffd640 1 -- 172.21.15.60:0/1199957451 learned_addr learned my addr 172.21.15.60:0/1199957451 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:25:06.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.919+0000 7f4ecbfff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f4ed40c7a90 0x7f4ed40c3cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:38200/0 (socket says 172.21.15.60:38200) 2024-09-12T02:25:06.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.919+0000 7f4ed2ffd640 1 -- 172.21.15.60:0/1199957451 >> v2:172.21.15.60:3300/0 conn(0x7f4ed40aeb10 msgr2=0x7f4ed4156c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:25:06.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.919+0000 7f4ed2ffd640 1 -- 172.21.15.60:0/1199957451 >> v2:172.21.15.60:3300/0 conn(0x7f4ed40aeb10 msgr2=0x7f4ed4156c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:25:06.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.919+0000 7f4ed2ffd640 1 --2- 172.21.15.60:0/1199957451 >> v2:172.21.15.60:3300/0 conn(0x7f4ed40aeb10 0x7f4ed4156c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:25:06.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.919+0000 7f4ed2ffd640 1 --2- 172.21.15.60:0/1199957451 >> v2:172.21.15.60:3300/0 conn(0x7f4ed40aeb10 0x7f4ed4156c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:25:06.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.919+0000 7f4ed27fc640 1 -- 172.21.15.60:0/1199957451 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2980353024 0 0) 0x7f4ed4157160 con 0x7f4ed40c7ef0 2024-09-12T02:25:06.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.919+0000 7f4ed27fc640 1 -- 172.21.15.60:0/1199957451 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ec0003520 con 0x7f4ed40c7ef0 2024-09-12T02:25:06.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.919+0000 7f4ed27fc640 1 -- 172.21.15.60:0/1199957451 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2259682713 0 0) 0x7f4ec0003520 con 0x7f4ed40c7ef0 2024-09-12T02:25:06.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.919+0000 7f4ed27fc640 1 -- 172.21.15.60:0/1199957451 >> v2:172.21.15.60:3300/0 conn(0x7f4ed40aeb10 msgr2=0x7f4ed4156c20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:25:06.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.919+0000 7f4ed27fc640 1 --2- 172.21.15.60:0/1199957451 >> v2:172.21.15.60:3300/0 conn(0x7f4ed40aeb10 0x7f4ed4156c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:06.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.919+0000 7f4ed27fc640 1 -- 172.21.15.60:0/1199957451 >> v1:172.21.15.60:6789/0 conn(0x7f4ed40c7a90 legacy=0x7f4ed40c3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:06.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.919+0000 7f4ed27fc640 1 -- 172.21.15.60:0/1199957451 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ed40a7f60 con 0x7f4ed40c7ef0 2024-09-12T02:25:06.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.919+0000 7f4ed27fc640 1 -- 172.21.15.60:0/1199957451 <== mon.1 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7f4ecc001a10 con 0x7f4ed40c7ef0 2024-09-12T02:25:06.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.919+0000 7f4ed27fc640 1 -- 172.21.15.60:0/1199957451 >> v1:172.21.15.105:6789/0 conn(0x7f4ed40c7ef0 legacy=0x7f4ed40c4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:06.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.919+0000 7f4ed27fc640 1 --2- 172.21.15.60:0/1199957451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ec00039b0 0x7f4ec0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:06.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.919+0000 7f4ed27fc640 1 --2- 172.21.15.60:0/1199957451 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ec0004800 0x7f4ec0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:06.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.920+0000 7f4ed27fc640 1 --2- 172.21.15.60:0/1199957451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ec00053c0 0x7f4ec000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:06.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.920+0000 7f4ed27fc640 1 -- 172.21.15.60:0/1199957451 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4ed40c3580 con 0x7f4ec00039b0 2024-09-12T02:25:06.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.920+0000 7f4ed27fc640 1 -- 172.21.15.60:0/1199957451 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec000c250 con 0x7f4ec00053c0 2024-09-12T02:25:06.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.920+0000 7f4ed27fc640 1 -- 172.21.15.60:0/1199957451 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4ec000c450 con 0x7f4ec0004800 2024-09-12T02:25:06.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.920+0000 7f4ed2ffd640 1 --2- 172.21.15.60:0/1199957451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ec00039b0 0x7f4ec0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:06.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.920+0000 7f4ecbfff640 1 --2- 172.21.15.60:0/1199957451 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ec0004800 0x7f4ec0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:06.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.920+0000 7f4ed37fe640 1 --2- 172.21.15.60:0/1199957451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ec00053c0 0x7f4ec000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:06.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.920+0000 7f4ed2ffd640 1 -- 172.21.15.60:0/1199957451 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ec0004800 msgr2=0x7f4ec0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:25:06.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.920+0000 7f4ed2ffd640 1 --2- 172.21.15.60:0/1199957451 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ec0004800 0x7f4ec0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:06.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.920+0000 7f4ed2ffd640 1 -- 172.21.15.60:0/1199957451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ec00053c0 msgr2=0x7f4ec000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:25:06.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.920+0000 7f4ed2ffd640 1 --2- 172.21.15.60:0/1199957451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ec00053c0 0x7f4ec000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:06.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.920+0000 7f4ed2ffd640 1 -- 172.21.15.60:0/1199957451 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ec0003520 con 0x7f4ec00039b0 2024-09-12T02:25:06.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.920+0000 7f4ed37fe640 1 -- 172.21.15.60:0/1199957451 reap_dead start 2024-09-12T02:25:06.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.921+0000 7f4ed2ffd640 1 --2- 172.21.15.60:0/1199957451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ec00039b0 0x7f4ec0003dd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4009890 tx=0x7f4ec0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97a1b8a9164042ee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:06.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.921+0000 7f4ed27fc640 1 -- 172.21.15.60:0/1199957451 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ec4037070 con 0x7f4ec00039b0 2024-09-12T02:25:06.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.921+0000 7f4ed27fc640 1 -- 172.21.15.60:0/1199957451 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ec402ad00 con 0x7f4ec00039b0 2024-09-12T02:25:06.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.921+0000 7f4ed27fc640 1 -- 172.21.15.60:0/1199957451 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ec400f040 con 0x7f4ec00039b0 2024-09-12T02:25:06.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.922+0000 7f4ed9566640 1 -- 172.21.15.60:0/1199957451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ec00039b0 msgr2=0x7f4ec0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:06.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.922+0000 7f4ed9566640 1 --2- 172.21.15.60:0/1199957451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ec00039b0 0x7f4ec0003dd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4009890 tx=0x7f4ec0005830 comp rx=0 tx=0).stop 2024-09-12T02:25:06.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.922+0000 7f4ed9566640 1 -- 172.21.15.60:0/1199957451 shutdown_connections 2024-09-12T02:25:06.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.922+0000 7f4ed9566640 1 --2- 172.21.15.60:0/1199957451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ec00039b0 0x7f4ec0003dd0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:06.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.922+0000 7f4ed9566640 1 -- 172.21.15.60:0/1199957451 >> 172.21.15.60:0/1199957451 conn(0x7f4ed40c5680 msgr2=0x7f4ed40c5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:25:06.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.922+0000 7f4ed9566640 1 -- 172.21.15.60:0/1199957451 shutdown_connections 2024-09-12T02:25:06.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.922+0000 7f4ed9566640 1 -- 172.21.15.60:0/1199957451 wait complete. 2024-09-12T02:25:06.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.923+0000 7f4ed9566640 1 Processor -- start 2024-09-12T02:25:06.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.923+0000 7f4ed9566640 1 -- start start 2024-09-12T02:25:06.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.924+0000 7f4ed9566640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ec00039b0 0x7f4ed41e1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:06.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.924+0000 7f4ed9566640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ed41e0ea0 0x7f4ed41e1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:06.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.924+0000 7f4ed9566640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ed414c9c0 0x7f4ed414ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:06.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.924+0000 7f4ed9566640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4ed40a8520 con 0x7f4ed41e0ea0 2024-09-12T02:25:06.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.924+0000 7f4ed9566640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4ed40c3860 con 0x7f4ed414c9c0 2024-09-12T02:25:06.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.924+0000 7f4ed9566640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4ed40c5240 con 0x7f4ec00039b0 2024-09-12T02:25:06.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.924+0000 7f4ecbfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ed41e0ea0 0x7f4ed41e1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:06.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.924+0000 7f4ecbfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ed41e0ea0 0x7f4ed41e1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47114/0 (socket says 172.21.15.60:47114) 2024-09-12T02:25:06.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.924+0000 7f4ecbfff640 1 -- 172.21.15.60:0/3923737335 learned_addr learned my addr 172.21.15.60:0/3923737335 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:25:06.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.924+0000 7f4ed37fe640 1 --2- 172.21.15.60:0/3923737335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ed414c9c0 0x7f4ed414ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:06.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.924+0000 7f4ecbfff640 1 -- 172.21.15.60:0/3923737335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ed41e0ea0 msgr2=0x7f4ed41e1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-12T02:25:06.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.924+0000 7f4ecbfff640 1 -- 172.21.15.60:0/3923737335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ed41e0ea0 msgr2=0x7f4ed41e1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:25:06.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.924+0000 7f4ecbfff640 1 --2- 172.21.15.60:0/3923737335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ed41e0ea0 0x7f4ed41e1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:25:06.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.924+0000 7f4ecbfff640 1 --2- 172.21.15.60:0/3923737335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ed41e0ea0 0x7f4ed41e1d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:25:06.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.924+0000 7f4ed2ffd640 1 --2- 172.21.15.60:0/3923737335 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ec00039b0 0x7f4ed41e1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:06.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.924+0000 7f4ed37fe640 1 -- 172.21.15.60:0/3923737335 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ec00039b0 msgr2=0x7f4ed41e1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:06.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.924+0000 7f4ed37fe640 1 --2- 172.21.15.60:0/3923737335 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ec00039b0 0x7f4ed41e1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:06.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.924+0000 7f4ed37fe640 1 -- 172.21.15.60:0/3923737335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ed41e0ea0 msgr2=0x7f4ed41e1d50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:25:06.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.924+0000 7f4ed37fe640 1 --2- 172.21.15.60:0/3923737335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ed41e0ea0 0x7f4ed41e1d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:06.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.924+0000 7f4ed37fe640 1 -- 172.21.15.60:0/3923737335 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ed4151080 con 0x7f4ed414c9c0 2024-09-12T02:25:06.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.924+0000 7f4ed37fe640 1 --2- 172.21.15.60:0/3923737335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ed414c9c0 0x7f4ed414ce40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4ed40c62e0 tx=0x7f4ecc00d520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:06.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.925+0000 7f4ecb7fe640 1 -- 172.21.15.60:0/3923737335 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc00db20 con 0x7f4ed414c9c0 2024-09-12T02:25:06.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.925+0000 7f4ecb7fe640 1 -- 172.21.15.60:0/3923737335 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ecc018070 con 0x7f4ed414c9c0 2024-09-12T02:25:06.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.925+0000 7f4ed9566640 1 -- 172.21.15.60:0/3923737335 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ed40a9f40 con 0x7f4ed414c9c0 2024-09-12T02:25:06.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.925+0000 7f4ecb7fe640 1 -- 172.21.15.60:0/3923737335 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc003970 con 0x7f4ed414c9c0 2024-09-12T02:25:06.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.925+0000 7f4ed9566640 1 -- 172.21.15.60:0/3923737335 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ed41f0030 con 0x7f4ed414c9c0 2024-09-12T02:25:06.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.926+0000 7f4ed9566640 1 -- 172.21.15.60:0/3923737335 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ed4156c20 con 0x7f4ed414c9c0 2024-09-12T02:25:06.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.927+0000 7f4ecb7fe640 1 -- 172.21.15.60:0/3923737335 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4ecc003b10 con 0x7f4ed414c9c0 2024-09-12T02:25:06.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.927+0000 7f4ecb7fe640 1 --2- 172.21.15.60:0/3923737335 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4eb406be30 0x7f4eb406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:06.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.927+0000 7f4ecb7fe640 1 -- 172.21.15.60:0/3923737335 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f4ecc08b020 con 0x7f4ed414c9c0 2024-09-12T02:25:06.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.927+0000 7f4ed2ffd640 1 --2- 172.21.15.60:0/3923737335 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4eb406be30 0x7f4eb406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:06.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.928+0000 7f4ed2ffd640 1 --2- 172.21.15.60:0/3923737335 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4eb406be30 0x7f4eb406e2f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4034000 tx=0x7f4ec402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:06.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:06.932+0000 7f4ecb7fe640 1 -- 172.21.15.60:0/3923737335 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4ecc0596c0 con 0x7f4ed414c9c0 2024-09-12T02:25:06.959 INFO:tasks.workunit.client.0.smithi060.stdout:checking for gettimeofday... yes 2024-09-12T02:25:07.041 INFO:tasks.workunit.client.0.smithi060.stdout:checking for mkdir... yes 2024-09-12T02:25:07.063 INFO:tasks.workunit.client.1.smithi105.stdout:checking for strerror... yes 2024-09-12T02:25:07.126 INFO:tasks.workunit.client.0.smithi060.stdout:checking for strerror... yes 2024-09-12T02:25:07.144 INFO:tasks.workunit.client.1.smithi105.stdout:checking for open64... yes 2024-09-12T02:25:07.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.200+0000 7f4ed9566640 1 -- 172.21.15.60:0/3923737335 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f4ed40704b0 con 0x7f4ed414c9c0 2024-09-12T02:25:07.218 INFO:tasks.workunit.client.1.smithi105.stdout:checking for stat64... yes 2024-09-12T02:25:07.292 INFO:tasks.workunit.client.1.smithi105.stdout:checking for fseeko64... yes 2024-09-12T02:25:07.366 INFO:tasks.workunit.client.1.smithi105.stdout:checking for lrand48_r... yes 2024-09-12T02:25:07.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.519+0000 7f4ecb7fe640 1 -- 172.21.15.60:0/3923737335 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7f4ecc058fc0 con 0x7f4ed414c9c0 2024-09-12T02:25:07.520 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":22,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:25:07.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.522+0000 7f4ed9566640 1 -- 172.21.15.60:0/3923737335 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4eb406be30 msgr2=0x7f4eb406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:07.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.522+0000 7f4ed9566640 1 --2- 172.21.15.60:0/3923737335 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4eb406be30 0x7f4eb406e2f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4034000 tx=0x7f4ec402e000 comp rx=0 tx=0).stop 2024-09-12T02:25:07.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.522+0000 7f4ed9566640 1 -- 172.21.15.60:0/3923737335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ed414c9c0 msgr2=0x7f4ed414ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:07.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.522+0000 7f4ed9566640 1 --2- 172.21.15.60:0/3923737335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ed414c9c0 0x7f4ed414ce40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4ed40c62e0 tx=0x7f4ecc00d520 comp rx=0 tx=0).stop 2024-09-12T02:25:07.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.522+0000 7f4ed9566640 1 -- 172.21.15.60:0/3923737335 shutdown_connections 2024-09-12T02:25:07.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.522+0000 7f4ed9566640 1 --2- 172.21.15.60:0/3923737335 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4eb406be30 0x7f4eb406e2f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:07.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.522+0000 7f4ed9566640 1 --2- 172.21.15.60:0/3923737335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ed414c9c0 0x7f4ed414ce40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:07.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.522+0000 7f4ed9566640 1 --2- 172.21.15.60:0/3923737335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ed41e0ea0 0x7f4ed41e1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:07.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.522+0000 7f4ed9566640 1 --2- 172.21.15.60:0/3923737335 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ec00039b0 0x7f4ed41e1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:07.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.522+0000 7f4ed9566640 1 -- 172.21.15.60:0/3923737335 >> 172.21.15.60:0/3923737335 conn(0x7f4ed40c5680 msgr2=0x7f4ed40a90c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:25:07.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.522+0000 7f4ed9566640 1 -- 172.21.15.60:0/3923737335 shutdown_connections 2024-09-12T02:25:07.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.522+0000 7f4ed9566640 1 -- 172.21.15.60:0/3923737335 wait complete. 2024-09-12T02:25:07.533 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-12T02:25:07.534 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-12T02:25:07.534 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-12T02:25:07.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.637+0000 7f2960ff6640 1 Processor -- start 2024-09-12T02:25:07.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.637+0000 7f2960ff6640 1 -- start start 2024-09-12T02:25:07.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.638+0000 7f2960ff6640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f295c0afdd0 0x7f295c0c5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:07.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.638+0000 7f2960ff6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f295c0af870 0x7f295c0c4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:07.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.638+0000 7f2960ff6640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f295c0c54e0 con 0x7f295c153af0 2024-09-12T02:25:07.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.638+0000 7f2960ff6640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f295c0c74a0 con 0x7f295c0afdd0 2024-09-12T02:25:07.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.638+0000 7f2960ff6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f295c0c7740 con 0x7f295c0af870 2024-09-12T02:25:07.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.638+0000 7f295a59c640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f295c153af0 0x7f295c1563a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:38216/0 (socket says 172.21.15.60:38216) 2024-09-12T02:25:07.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.638+0000 7f295a59c640 1 -- 172.21.15.60:0/2692259231 learned_addr learned my addr 172.21.15.60:0/2692259231 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:25:07.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.638+0000 7f2959d9b640 1 --2- 172.21.15.60:0/2692259231 >> v2:172.21.15.105:3300/0 conn(0x7f295c0afdd0 0x7f295c0c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:07.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.638+0000 7f295ad9d640 1 --2- 172.21.15.60:0/2692259231 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f295c0af870 0x7f295c0c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:07.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.638+0000 7f295959a640 1 -- 172.21.15.60:0/2692259231 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2043797661 0 0) 0x7f295c0c54e0 con 0x7f295c153af0 2024-09-12T02:25:07.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.638+0000 7f295959a640 1 -- 172.21.15.60:0/2692259231 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2948003520 con 0x7f295c153af0 2024-09-12T02:25:07.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.639+0000 7f295959a640 1 -- 172.21.15.60:0/2692259231 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1967379807 0 0) 0x7f2948003520 con 0x7f295c153af0 2024-09-12T02:25:07.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.639+0000 7f295959a640 1 -- 172.21.15.60:0/2692259231 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f295c0af870 msgr2=0x7f295c0c4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:25:07.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.639+0000 7f295959a640 1 --2- 172.21.15.60:0/2692259231 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f295c0af870 0x7f295c0c4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:07.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.639+0000 7f295959a640 1 -- 172.21.15.60:0/2692259231 >> v2:172.21.15.105:3300/0 conn(0x7f295c0afdd0 msgr2=0x7f295c0c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:25:07.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.639+0000 7f295959a640 1 --2- 172.21.15.60:0/2692259231 >> v2:172.21.15.105:3300/0 conn(0x7f295c0afdd0 0x7f295c0c5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:07.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.639+0000 7f295959a640 1 -- 172.21.15.60:0/2692259231 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f295c15a3c0 con 0x7f295c153af0 2024-09-12T02:25:07.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.639+0000 7f295959a640 1 -- 172.21.15.60:0/2692259231 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7f294c0019f0 con 0x7f295c153af0 2024-09-12T02:25:07.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.639+0000 7f295959a640 1 -- 172.21.15.60:0/2692259231 >> v1:172.21.15.60:6789/0 conn(0x7f295c153af0 legacy=0x7f295c1563a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:07.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.639+0000 7f295959a640 1 --2- 172.21.15.60:0/2692259231 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f295c0af870 0x7f29480039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:07.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.639+0000 7f295959a640 1 --2- 172.21.15.60:0/2692259231 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2948003f30 0x7f2948004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:07.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.639+0000 7f295959a640 1 --2- 172.21.15.60:0/2692259231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2948004d40 0x7f29480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:07.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.639+0000 7f295959a640 1 -- 172.21.15.60:0/2692259231 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f295c0c74a0 con 0x7f2948004d40 2024-09-12T02:25:07.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.639+0000 7f295959a640 1 -- 172.21.15.60:0/2692259231 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f295c0c7740 con 0x7f2948003f30 2024-09-12T02:25:07.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.639+0000 7f295959a640 1 -- 172.21.15.60:0/2692259231 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f294800baa0 con 0x7f295c0af870 2024-09-12T02:25:07.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.639+0000 7f295ad9d640 1 --2- 172.21.15.60:0/2692259231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2948004d40 0x7f29480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:07.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.639+0000 7f295a59c640 1 --2- 172.21.15.60:0/2692259231 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f295c0af870 0x7f29480039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:07.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.639+0000 7f2959d9b640 1 --2- 172.21.15.60:0/2692259231 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2948003f30 0x7f2948004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:07.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.639+0000 7f295ad9d640 1 -- 172.21.15.60:0/2692259231 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f295c0af870 msgr2=0x7f29480039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:25:07.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.639+0000 7f295ad9d640 1 --2- 172.21.15.60:0/2692259231 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f295c0af870 0x7f29480039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:07.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.639+0000 7f295ad9d640 1 -- 172.21.15.60:0/2692259231 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2948003f30 msgr2=0x7f2948004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:25:07.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.639+0000 7f295ad9d640 1 --2- 172.21.15.60:0/2692259231 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2948003f30 0x7f2948004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:07.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.639+0000 7f295ad9d640 1 -- 172.21.15.60:0/2692259231 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2948003520 con 0x7f2948004d40 2024-09-12T02:25:07.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.640+0000 7f295ad9d640 1 --2- 172.21.15.60:0/2692259231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2948004d40 0x7f29480051c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2954009ac0 tx=0x7f2948005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa29f25a2726d7c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:07.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.640+0000 7f295959a640 1 -- 172.21.15.60:0/2692259231 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2954036070 con 0x7f2948004d40 2024-09-12T02:25:07.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.640+0000 7f295959a640 1 -- 172.21.15.60:0/2692259231 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2954031400 con 0x7f2948004d40 2024-09-12T02:25:07.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.640+0000 7f295959a640 1 -- 172.21.15.60:0/2692259231 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2954009690 con 0x7f2948004d40 2024-09-12T02:25:07.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.641+0000 7f2960ff6640 1 -- 172.21.15.60:0/2692259231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2948004d40 msgr2=0x7f29480051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:07.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.641+0000 7f2960ff6640 1 --2- 172.21.15.60:0/2692259231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2948004d40 0x7f29480051c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2954009ac0 tx=0x7f2948005830 comp rx=0 tx=0).stop 2024-09-12T02:25:07.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.641+0000 7f295ad9d640 1 -- 172.21.15.60:0/2692259231 reap_dead start 2024-09-12T02:25:07.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.641+0000 7f2960ff6640 1 -- 172.21.15.60:0/2692259231 shutdown_connections 2024-09-12T02:25:07.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.641+0000 7f2960ff6640 1 -- 172.21.15.60:0/2692259231 >> 172.21.15.60:0/2692259231 conn(0x7f295c0c6880 msgr2=0x7f295c0c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:25:07.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.641+0000 7f2960ff6640 1 -- 172.21.15.60:0/2692259231 shutdown_connections 2024-09-12T02:25:07.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.641+0000 7f2960ff6640 1 -- 172.21.15.60:0/2692259231 wait complete. 2024-09-12T02:25:07.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.642+0000 7f2960ff6640 1 Processor -- start 2024-09-12T02:25:07.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.642+0000 7f2960ff6640 1 -- start start 2024-09-12T02:25:07.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.643+0000 7f2960ff6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2948004d40 0x7f295c154740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:07.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.643+0000 7f2960ff6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f295c1542f0 0x7f295c14dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:07.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.643+0000 7f2960ff6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f295c1415a0 0x7f295c141a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:07.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.643+0000 7f2960ff6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f295c154050 con 0x7f295c1415a0 2024-09-12T02:25:07.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.643+0000 7f2960ff6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f295c153ed0 con 0x7f2948004d40 2024-09-12T02:25:07.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.643+0000 7f2960ff6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f295c0c4780 con 0x7f295c1542f0 2024-09-12T02:25:07.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.643+0000 7f295ad9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f295c1415a0 0x7f295c141a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:07.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.643+0000 7f295ad9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f295c1415a0 0x7f295c141a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47130/0 (socket says 172.21.15.60:47130) 2024-09-12T02:25:07.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.643+0000 7f295ad9d640 1 -- 172.21.15.60:0/2873821806 learned_addr learned my addr 172.21.15.60:0/2873821806 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:25:07.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.643+0000 7f2959d9b640 1 --2- 172.21.15.60:0/2873821806 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f295c1542f0 0x7f295c14dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:07.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.643+0000 7f295a59c640 1 --2- 172.21.15.60:0/2873821806 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2948004d40 0x7f295c154740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:07.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.643+0000 7f295ad9d640 1 -- 172.21.15.60:0/2873821806 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f295c1542f0 msgr2=0x7f295c14dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:07.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.643+0000 7f295ad9d640 1 --2- 172.21.15.60:0/2873821806 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f295c1542f0 0x7f295c14dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:07.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.643+0000 7f295ad9d640 1 -- 172.21.15.60:0/2873821806 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2948004d40 msgr2=0x7f295c154740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:07.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.643+0000 7f295ad9d640 1 --2- 172.21.15.60:0/2873821806 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2948004d40 0x7f295c154740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:07.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.643+0000 7f295ad9d640 1 -- 172.21.15.60:0/2873821806 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f295c1ebcd0 con 0x7f295c1415a0 2024-09-12T02:25:07.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.643+0000 7f295ad9d640 1 --2- 172.21.15.60:0/2873821806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f295c1415a0 0x7f295c141a50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2954009ac0 tx=0x7f2954004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:07.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.644+0000 7f2952ffd640 1 -- 172.21.15.60:0/2873821806 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2954036040 con 0x7f295c1415a0 2024-09-12T02:25:07.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.644+0000 7f2952ffd640 1 -- 172.21.15.60:0/2873821806 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2954032db0 con 0x7f295c1415a0 2024-09-12T02:25:07.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.644+0000 7f2960ff6640 1 -- 172.21.15.60:0/2873821806 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f295c1ebf70 con 0x7f295c1415a0 2024-09-12T02:25:07.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.644+0000 7f2952ffd640 1 -- 172.21.15.60:0/2873821806 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2954009690 con 0x7f295c1415a0 2024-09-12T02:25:07.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.644+0000 7f2960ff6640 1 -- 172.21.15.60:0/2873821806 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f295c1ec530 con 0x7f295c1415a0 2024-09-12T02:25:07.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.645+0000 7f2960ff6640 1 --2- 172.21.15.60:0/2873821806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f295c1ef030 0x7f295c1ef410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:07.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.645+0000 7f2960ff6640 1 -- 172.21.15.60:0/2873821806 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f295c1eca50 con 0x7f295c1ef030 2024-09-12T02:25:07.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.645+0000 7f295a59c640 1 --2- 172.21.15.60:0/2873821806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f295c1ef030 0x7f295c1ef410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:07.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.645+0000 7f295a59c640 1 -- 172.21.15.60:0/2873821806 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f295c070cd0 con 0x7f295c1ef030 2024-09-12T02:25:07.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.645+0000 7f2952ffd640 1 -- 172.21.15.60:0/2873821806 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2954043020 con 0x7f295c1415a0 2024-09-12T02:25:07.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.645+0000 7f295a59c640 1 --2- 172.21.15.60:0/2873821806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f295c1ef030 0x7f295c1ef410 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f294c001460 tx=0x7f294c00a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:07.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.646+0000 7f2952ffd640 1 --2- 172.21.15.60:0/2873821806 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f293c06be30 0x7f293c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:07.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.646+0000 7f2959d9b640 1 --2- 172.21.15.60:0/2873821806 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f293c06be30 0x7f293c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:07.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.646+0000 7f2952ffd640 1 -- 172.21.15.60:0/2873821806 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f29540aab50 con 0x7f295c1415a0 2024-09-12T02:25:07.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.646+0000 7f2952ffd640 1 -- 172.21.15.60:0/2873821806 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f294c019020 con 0x7f295c1ef030 2024-09-12T02:25:07.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.646+0000 7f2952ffd640 1 -- 172.21.15.60:0/2873821806 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f294c00ae00 con 0x7f295c1ef030 2024-09-12T02:25:07.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.646+0000 7f2952ffd640 1 -- 172.21.15.60:0/2873821806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f295c1ef030 msgr2=0x7f295c1ef410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:07.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.646+0000 7f2952ffd640 1 --2- 172.21.15.60:0/2873821806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f295c1ef030 0x7f295c1ef410 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f294c001460 tx=0x7f294c00a730 comp rx=0 tx=0).stop 2024-09-12T02:25:07.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.646+0000 7f2952ffd640 1 -- 172.21.15.60:0/2873821806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f295c1ef030 msgr2=0x7f295c1ef410 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:25:07.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.646+0000 7f2952ffd640 1 --2- 172.21.15.60:0/2873821806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f295c1ef030 0x7f295c1ef410 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:07.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.646+0000 7f2959d9b640 1 --2- 172.21.15.60:0/2873821806 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f293c06be30 0x7f293c06e2f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f295c1546f0 tx=0x7f2944009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:07.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.652+0000 7f2960ff6640 1 --2- 172.21.15.60:0/2873821806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f295c1ef950 0x7f295c158d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:07.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.652+0000 7f2960ff6640 1 -- 172.21.15.60:0/2873821806 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f295c154d20 con 0x7f295c1ef950 2024-09-12T02:25:07.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.652+0000 7f295a59c640 1 --2- 172.21.15.60:0/2873821806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f295c1ef950 0x7f295c158d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:07.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.653+0000 7f295a59c640 1 -- 172.21.15.60:0/2873821806 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f295c0c5900 con 0x7f295c1ef950 2024-09-12T02:25:07.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.653+0000 7f295a59c640 1 --2- 172.21.15.60:0/2873821806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f295c1ef950 0x7f295c158d80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f294c001460 tx=0x7f294c001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:07.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.653+0000 7f2952ffd640 1 -- 172.21.15.60:0/2873821806 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f294c019030 con 0x7f295c1ef950 2024-09-12T02:25:07.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.653+0000 7f2952ffd640 1 -- 172.21.15.60:0/2873821806 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4548 (secure 0 0 0) 0x7f294c01e640 con 0x7f295c1ef950 2024-09-12T02:25:07.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.653+0000 7f2952ffd640 1 -- 172.21.15.60:0/2873821806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f295c1ef950 msgr2=0x7f295c158d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:07.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.653+0000 7f2952ffd640 1 --2- 172.21.15.60:0/2873821806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f295c1ef950 0x7f295c158d80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f294c001460 tx=0x7f294c001dc0 comp rx=0 tx=0).stop 2024-09-12T02:25:07.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.653+0000 7f2952ffd640 1 -- 172.21.15.60:0/2873821806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f295c1ef950 msgr2=0x7f295c158d80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:25:07.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.653+0000 7f2952ffd640 1 --2- 172.21.15.60:0/2873821806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f295c1ef950 0x7f295c158d80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:07.654 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:25:07.655 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:25:07.655 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:25:07.655 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:25:07.655 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 22, 2024-09-12T02:25:07.655 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 751, 2024-09-12T02:25:07.655 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:25:07.655 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:25:07.655 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:25:07.655 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:25:07.655 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:07.655 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-09-12T02:25:07.655 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:25:07.655 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:25:07.656 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:25:07.656 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:25:07.656 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:25:07.656 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:25:07.656 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:25:07.656 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:25:07.656 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:25:07.656 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:25:07.656 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:25:07.656 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:25:07.656 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:25:07.656 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:25:07.656 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:07.656 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:25:07.657 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:25:07.657 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:25:07.657 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:25:07.657 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:25:07.657 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:25:07.657 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:25:07.657 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:25:07.657 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:25:07.657 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:25:07.657 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:25:07.657 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:25:07.657 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:25:07.658 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:07.658 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:07.658 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:25:07.658 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:25:07.658 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:25:07.658 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:25:07.658 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:25:07.658 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:25:07.658 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:25:07.658 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:25:07.658 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:25:07.658 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:25:07.658 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:25:07.658 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:25:07.659 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:25:07.659 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:25:07.659 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:25:07.659 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:25:07.659 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:25:07.659 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:25:07.659 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:25:07.659 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:25:07.659 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:25:07.659 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:25:07.659 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:25:07.659 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:25:07.659 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:25:07.659 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:25:07.660 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:25:07.660 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:25:07.660 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:07.660 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:25:07.660 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:07.660 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:25:07.660 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:07.660 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:25:07.660 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:25:07.660 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:25:07.660 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:25:07.660 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:07.660 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:25:07.661 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:25:07.661 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:07.661 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:07.661 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:07.661 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:25:07.661 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:25:07.661 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:07.661 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:07.661 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:07.661 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:07.661 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:25:07.661 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:25:07.661 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:25:07.662 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:25:07.662 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:25:07.662 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:07.662 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:07.662 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:25:07.662 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:25:07.662 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:25:07.662 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:25:07.662 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:07.662 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:25:07.662 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:25:07.662 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:07.662 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:07.663 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:07.663 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:25:07.663 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:25:07.663 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:07.663 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:07.663 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:07.663 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:07.663 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:25:07.663 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:25:07.663 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:25:07.663 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:25:07.663 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:25:07.663 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:07.663 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:07.664 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:25:07.664 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:25:07.664 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:25:07.664 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:25:07.664 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:07.664 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:25:07.664 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:25:07.664 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:07.664 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:07.664 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:07.664 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:25:07.664 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:25:07.664 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:07.665 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:07.665 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:07.665 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:07.665 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:25:07.665 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:25:07.665 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:25:07.665 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:25:07.665 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:25:07.665 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:07.665 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:07.665 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:07.665 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:25:07.665 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:25:07.666 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:07.666 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:25:07.666 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:25:07.666 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:25:07.666 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:07.666 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:07.666 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:25:07.666 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:07.666 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:25:07.666 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:25:07.666 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:25:07.666 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:07.666 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:07.667 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:07.667 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:25:07.667 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:25:07.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.653+0000 7f2960ff6640 1 -- 172.21.15.60:0/2873821806 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f293c06be30 msgr2=0x7f293c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:07.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.653+0000 7f2960ff6640 1 --2- 172.21.15.60:0/2873821806 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f293c06be30 0x7f293c06e2f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f295c1546f0 tx=0x7f2944009190 comp rx=0 tx=0).stop 2024-09-12T02:25:07.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.653+0000 7f2960ff6640 1 -- 172.21.15.60:0/2873821806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f295c1415a0 msgr2=0x7f295c141a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:07.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.653+0000 7f2960ff6640 1 --2- 172.21.15.60:0/2873821806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f295c1415a0 0x7f295c141a50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2954009ac0 tx=0x7f2954004730 comp rx=0 tx=0).stop 2024-09-12T02:25:07.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.653+0000 7f295ad9d640 1 -- 172.21.15.60:0/2873821806 reap_dead start 2024-09-12T02:25:07.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.653+0000 7f2960ff6640 1 -- 172.21.15.60:0/2873821806 shutdown_connections 2024-09-12T02:25:07.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.653+0000 7f2960ff6640 1 --2- 172.21.15.60:0/2873821806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f295c1415a0 0x7f295c141a50 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:07.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.653+0000 7f2960ff6640 1 -- 172.21.15.60:0/2873821806 >> 172.21.15.60:0/2873821806 conn(0x7f295c0c6880 msgr2=0x7f295c0c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:25:07.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.654+0000 7f2960ff6640 1 -- 172.21.15.60:0/2873821806 shutdown_connections 2024-09-12T02:25:07.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.654+0000 7f2960ff6640 1 -- 172.21.15.60:0/2873821806 wait complete. 2024-09-12T02:25:07.669 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:25:07.669 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-12T02:25:07.669 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-12T02:25:07.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.771+0000 7fa3d68b7640 1 Processor -- start 2024-09-12T02:25:07.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.771+0000 7fa3d68b7640 1 -- start start 2024-09-12T02:25:07.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.772+0000 7fa3d68b7640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa3d00ca390 0x7fa3d0161c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:07.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.772+0000 7fa3d68b7640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3d015a7c0 con 0x7fa3d006c650 2024-09-12T02:25:07.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.772+0000 7fa3d68b7640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3d0159a00 con 0x7fa3d0150480 2024-09-12T02:25:07.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.772+0000 7fa3d68b7640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fa3d006c240 con 0x7fa3d00ca390 2024-09-12T02:25:07.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.772+0000 7fa3cf7fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa3d006c650 0x7fa3d00c9c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:38226/0 (socket says 172.21.15.60:38226) 2024-09-12T02:25:07.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.772+0000 7fa3cf7fe640 1 -- 172.21.15.60:0/1485682678 learned_addr learned my addr 172.21.15.60:0/1485682678 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:25:07.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.772+0000 7fa3d4e54640 1 --2- 172.21.15.60:0/1485682678 >> v2:172.21.15.105:3300/0 conn(0x7fa3d00ca390 0x7fa3d0161c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:07.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.773+0000 7fa3ceffd640 1 -- 172.21.15.60:0/1485682678 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2043243433 0 0) 0x7fa3d015a7c0 con 0x7fa3d006c650 2024-09-12T02:25:07.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.773+0000 7fa3ceffd640 1 -- 172.21.15.60:0/1485682678 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3b8003520 con 0x7fa3d006c650 2024-09-12T02:25:07.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.773+0000 7fa3d4e54640 1 -- 172.21.15.60:0/1485682678 >> v1:172.21.15.105:6789/0 conn(0x7fa3d0150480 legacy=0x7fa3d00c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:07.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.773+0000 7fa3d4e54640 1 -- 172.21.15.60:0/1485682678 >> v1:172.21.15.60:6789/0 conn(0x7fa3d006c650 legacy=0x7fa3d00c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:07.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.773+0000 7fa3d4e54640 1 -- 172.21.15.60:0/1485682678 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3d0159ce0 con 0x7fa3d00ca390 2024-09-12T02:25:07.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.774+0000 7fa3d4e54640 1 --2- 172.21.15.60:0/1485682678 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3d00ca390 0x7fa3d0161c00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8009d90 tx=0x7fa3c802a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=829875f5c4710af7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:07.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.774+0000 7fa3ceffd640 1 -- 172.21.15.60:0/1485682678 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c8007740 con 0x7fa3d00ca390 2024-09-12T02:25:07.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.774+0000 7fa3ceffd640 1 -- 172.21.15.60:0/1485682678 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3c80078e0 con 0x7fa3d00ca390 2024-09-12T02:25:07.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.774+0000 7fa3ceffd640 1 -- 172.21.15.60:0/1485682678 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c8007c90 con 0x7fa3d00ca390 2024-09-12T02:25:07.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.774+0000 7fa3d68b7640 1 -- 172.21.15.60:0/1485682678 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3d00ca390 msgr2=0x7fa3d0161c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:07.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.774+0000 7fa3d68b7640 1 --2- 172.21.15.60:0/1485682678 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3d00ca390 0x7fa3d0161c00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8009d90 tx=0x7fa3c802a6f0 comp rx=0 tx=0).stop 2024-09-12T02:25:07.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.774+0000 7fa3d68b7640 1 -- 172.21.15.60:0/1485682678 shutdown_connections 2024-09-12T02:25:07.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.774+0000 7fa3d68b7640 1 --2- 172.21.15.60:0/1485682678 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3d00ca390 0x7fa3d0161c00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:07.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.774+0000 7fa3d68b7640 1 -- 172.21.15.60:0/1485682678 >> 172.21.15.60:0/1485682678 conn(0x7fa3d0068030 msgr2=0x7fa3d0073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:25:07.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.774+0000 7fa3d68b7640 1 -- 172.21.15.60:0/1485682678 shutdown_connections 2024-09-12T02:25:07.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.774+0000 7fa3d68b7640 1 -- 172.21.15.60:0/1485682678 wait complete. 2024-09-12T02:25:07.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.775+0000 7fa3d68b7640 1 Processor -- start 2024-09-12T02:25:07.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.776+0000 7fa3d68b7640 1 -- start start 2024-09-12T02:25:07.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.776+0000 7fa3d68b7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3d006c650 0x7fa3d01e2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:07.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.776+0000 7fa3d68b7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3d00ca390 0x7fa3d014e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:07.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.776+0000 7fa3d68b7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3d0150480 0x7fa3d014ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:07.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.776+0000 7fa3d68b7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d006d270 con 0x7fa3d00ca390 2024-09-12T02:25:07.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.776+0000 7fa3d68b7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d015a330 con 0x7fa3d0150480 2024-09-12T02:25:07.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.776+0000 7fa3d68b7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa3d00c81a0 con 0x7fa3d006c650 2024-09-12T02:25:07.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.776+0000 7fa3cf7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3d00ca390 0x7fa3d014e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:07.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.777+0000 7fa3cf7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3d00ca390 0x7fa3d014e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47158/0 (socket says 172.21.15.60:47158) 2024-09-12T02:25:07.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.777+0000 7fa3cf7fe640 1 -- 172.21.15.60:0/2268038816 learned_addr learned my addr 172.21.15.60:0/2268038816 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:25:07.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.777+0000 7fa3d4e54640 1 --2- 172.21.15.60:0/2268038816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3d0150480 0x7fa3d014ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:07.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.777+0000 7fa3cffff640 1 --2- 172.21.15.60:0/2268038816 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3d006c650 0x7fa3d01e2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:07.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.777+0000 7fa3cf7fe640 1 -- 172.21.15.60:0/2268038816 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3d006c650 msgr2=0x7fa3d01e2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:07.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.777+0000 7fa3cf7fe640 1 --2- 172.21.15.60:0/2268038816 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3d006c650 0x7fa3d01e2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:07.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.777+0000 7fa3cf7fe640 1 -- 172.21.15.60:0/2268038816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3d0150480 msgr2=0x7fa3d014ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:07.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.777+0000 7fa3cf7fe640 1 --2- 172.21.15.60:0/2268038816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3d0150480 0x7fa3d014ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:07.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.777+0000 7fa3cf7fe640 1 -- 172.21.15.60:0/2268038816 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3d014fcb0 con 0x7fa3d00ca390 2024-09-12T02:25:07.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.777+0000 7fa3cf7fe640 1 --2- 172.21.15.60:0/2268038816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3d00ca390 0x7fa3d014e8e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa3c400c500 tx=0x7fa3c400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:07.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.777+0000 7fa3ccff9640 1 -- 172.21.15.60:0/2268038816 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c4017070 con 0x7fa3d00ca390 2024-09-12T02:25:07.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.777+0000 7fa3ccff9640 1 -- 172.21.15.60:0/2268038816 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3c4005ce0 con 0x7fa3d00ca390 2024-09-12T02:25:07.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.777+0000 7fa3ccff9640 1 -- 172.21.15.60:0/2268038816 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c4007330 con 0x7fa3d00ca390 2024-09-12T02:25:07.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.777+0000 7fa3d68b7640 1 -- 172.21.15.60:0/2268038816 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3d00ccbc0 con 0x7fa3d00ca390 2024-09-12T02:25:07.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.777+0000 7fa3d68b7640 1 -- 172.21.15.60:0/2268038816 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3d014f530 con 0x7fa3d00ca390 2024-09-12T02:25:07.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.778+0000 7fa3d68b7640 1 --2- 172.21.15.60:0/2268038816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3d00b0910 0x7fa3d0150a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:07.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.778+0000 7fa3d68b7640 1 -- 172.21.15.60:0/2268038816 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d0154c60 con 0x7fa3d00b0910 2024-09-12T02:25:07.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.778+0000 7fa3cffff640 1 --2- 172.21.15.60:0/2268038816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3d00b0910 0x7fa3d0150a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:07.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.779+0000 7fa3cffff640 1 -- 172.21.15.60:0/2268038816 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa3d0156270 con 0x7fa3d00b0910 2024-09-12T02:25:07.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.779+0000 7fa3ccff9640 1 -- 172.21.15.60:0/2268038816 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa3c401a070 con 0x7fa3d00ca390 2024-09-12T02:25:07.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.779+0000 7fa3cffff640 1 --2- 172.21.15.60:0/2268038816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3d00b0910 0x7fa3d0150a70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa3c000e370 tx=0x7fa3c000e830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:07.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.779+0000 7fa3ccff9640 1 --2- 172.21.15.60:0/2268038816 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa3bc06be30 0x7fa3bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:07.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.779+0000 7fa3ccff9640 1 -- 172.21.15.60:0/2268038816 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fa3c408a750 con 0x7fa3d00ca390 2024-09-12T02:25:07.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.779+0000 7fa3d4e54640 1 --2- 172.21.15.60:0/2268038816 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa3bc06be30 0x7fa3bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:07.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.780+0000 7fa3ccff9640 1 -- 172.21.15.60:0/2268038816 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c0019070 con 0x7fa3d00b0910 2024-09-12T02:25:07.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.780+0000 7fa3ccff9640 1 -- 172.21.15.60:0/2268038816 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fa3c00052e0 con 0x7fa3d00b0910 2024-09-12T02:25:07.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.780+0000 7fa3ccff9640 1 -- 172.21.15.60:0/2268038816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3d00b0910 msgr2=0x7fa3d0150a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:07.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.780+0000 7fa3ccff9640 1 --2- 172.21.15.60:0/2268038816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3d00b0910 0x7fa3d0150a70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa3c000e370 tx=0x7fa3c000e830 comp rx=0 tx=0).stop 2024-09-12T02:25:07.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.780+0000 7fa3ccff9640 1 -- 172.21.15.60:0/2268038816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3d00b0910 msgr2=0x7fa3d0150a70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:25:07.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.780+0000 7fa3ccff9640 1 --2- 172.21.15.60:0/2268038816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3d00b0910 0x7fa3d0150a70 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:07.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.780+0000 7fa3d4e54640 1 --2- 172.21.15.60:0/2268038816 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa3bc06be30 0x7fa3bc06e2f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8034000 tx=0x7fa3c802f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:07.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.786+0000 7fa3d68b7640 1 --2- 172.21.15.60:0/2268038816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3d01521c0 0x7fa3d01528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:07.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.786+0000 7fa3d68b7640 1 -- 172.21.15.60:0/2268038816 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d006c430 con 0x7fa3d01521c0 2024-09-12T02:25:07.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.787+0000 7fa3cffff640 1 --2- 172.21.15.60:0/2268038816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3d01521c0 0x7fa3d01528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:07.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.787+0000 7fa3cffff640 1 -- 172.21.15.60:0/2268038816 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa3d00c9d00 con 0x7fa3d01521c0 2024-09-12T02:25:07.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.787+0000 7fa3cffff640 1 --2- 172.21.15.60:0/2268038816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3d01521c0 0x7fa3d01528c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa3c000e370 tx=0x7fa3c0000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:07.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.787+0000 7fa3ccff9640 1 -- 172.21.15.60:0/2268038816 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c0019040 con 0x7fa3d01521c0 2024-09-12T02:25:07.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.787+0000 7fa3ccff9640 1 -- 172.21.15.60:0/2268038816 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5049 (secure 0 0 0) 0x7fa3c0007220 con 0x7fa3d01521c0 2024-09-12T02:25:07.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.787+0000 7fa3ccff9640 1 -- 172.21.15.60:0/2268038816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3d01521c0 msgr2=0x7fa3d01528c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:07.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.787+0000 7fa3ccff9640 1 --2- 172.21.15.60:0/2268038816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3d01521c0 0x7fa3d01528c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa3c000e370 tx=0x7fa3c0000ed0 comp rx=0 tx=0).stop 2024-09-12T02:25:07.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.787+0000 7fa3ccff9640 1 -- 172.21.15.60:0/2268038816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3d01521c0 msgr2=0x7fa3d01528c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:25:07.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.787+0000 7fa3ccff9640 1 --2- 172.21.15.60:0/2268038816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3d01521c0 0x7fa3d01528c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:07.789 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:25:07.789 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:25:07.789 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:25:07.789 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:25:07.789 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 22, 2024-09-12T02:25:07.789 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 53221, 2024-09-12T02:25:07.789 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:25:07.789 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:25:07.790 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:25:07.790 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:25:07.790 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:07.790 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-09-12T02:25:07.790 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:25:07.790 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:25:07.790 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:25:07.790 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:25:07.790 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:25:07.790 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:25:07.790 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:25:07.790 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:25:07.790 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:25:07.791 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:25:07.791 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:25:07.791 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:25:07.791 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:25:07.791 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:25:07.791 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:07.791 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:25:07.791 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:25:07.791 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:25:07.791 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:25:07.791 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:25:07.791 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:25:07.791 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:25:07.791 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:25:07.792 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:25:07.792 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:25:07.792 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:25:07.792 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:25:07.792 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:25:07.792 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:07.792 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:07.792 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:25:07.792 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:25:07.792 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:25:07.792 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:25:07.792 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:25:07.793 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:25:07.793 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:25:07.793 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:25:07.793 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:25:07.793 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:25:07.793 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:25:07.793 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:25:07.793 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:25:07.793 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:25:07.793 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:25:07.793 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:25:07.793 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:25:07.793 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:25:07.794 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:25:07.794 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:25:07.794 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:25:07.794 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:25:07.794 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:25:07.794 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:25:07.794 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:25:07.794 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:25:07.794 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:25:07.794 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:25:07.794 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:07.794 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:25:07.794 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:07.794 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:25:07.795 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:07.795 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:25:07.795 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:25:07.795 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:25:07.795 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:25:07.795 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:07.795 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:25:07.795 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:25:07.795 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:07.795 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:07.795 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:07.795 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:25:07.795 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:25:07.796 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:07.796 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:07.796 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:07.796 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:07.796 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:25:07.796 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:25:07.796 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:25:07.796 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:25:07.796 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:25:07.796 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:07.796 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:07.796 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:25:07.796 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:25:07.797 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:25:07.797 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:25:07.797 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:07.797 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:25:07.797 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:25:07.797 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:07.797 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:07.797 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:07.797 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:25:07.797 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:25:07.797 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:07.797 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:07.797 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:07.798 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:07.798 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:25:07.798 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:25:07.798 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:25:07.798 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:25:07.798 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:25:07.798 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:07.798 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:07.798 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:25:07.798 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:25:07.798 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:25:07.798 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:25:07.798 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:07.799 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:25:07.799 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:25:07.799 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:07.799 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:07.799 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:07.799 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:25:07.799 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:25:07.799 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:07.799 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:07.799 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:07.799 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:07.799 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:25:07.799 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:25:07.799 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:25:07.800 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:25:07.800 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:25:07.800 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:07.800 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:07.800 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:07.800 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:25:07.800 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:25:07.800 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:07.800 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:25:07.800 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:25:07.800 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:25:07.800 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:07.800 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:07.800 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:25:07.801 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:07.801 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:25:07.801 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:25:07.801 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:25:07.801 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:07.801 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:07.801 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:25:07.801 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:07.801 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:25:07.801 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:25:07.801 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:25:07.801 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:07.802 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:07.802 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:25:07.802 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:07.802 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:25:07.802 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:25:07.802 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:25:07.802 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:07.802 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:07.802 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:25:07.802 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:07.802 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:25:07.802 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:25:07.802 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:25:07.802 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:07.803 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:07.803 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:07.803 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:25:07.803 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:25:07.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.788+0000 7fa3d68b7640 1 -- 172.21.15.60:0/2268038816 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa3bc06be30 msgr2=0x7fa3bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:07.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.788+0000 7fa3d68b7640 1 --2- 172.21.15.60:0/2268038816 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa3bc06be30 0x7fa3bc06e2f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8034000 tx=0x7fa3c802f000 comp rx=0 tx=0).stop 2024-09-12T02:25:07.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.788+0000 7fa3d68b7640 1 -- 172.21.15.60:0/2268038816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3d00ca390 msgr2=0x7fa3d014e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:07.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.788+0000 7fa3d68b7640 1 --2- 172.21.15.60:0/2268038816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3d00ca390 0x7fa3d014e8e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa3c400c500 tx=0x7fa3c400c9c0 comp rx=0 tx=0).stop 2024-09-12T02:25:07.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.788+0000 7fa3d4e54640 1 -- 172.21.15.60:0/2268038816 reap_dead start 2024-09-12T02:25:07.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.788+0000 7fa3d4e54640 1 -- 172.21.15.60:0/2268038816 reap_dead start 2024-09-12T02:25:07.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.788+0000 7fa3d68b7640 1 -- 172.21.15.60:0/2268038816 shutdown_connections 2024-09-12T02:25:07.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.788+0000 7fa3d68b7640 1 -- 172.21.15.60:0/2268038816 >> 172.21.15.60:0/2268038816 conn(0x7fa3d0068030 msgr2=0x7fa3d0073310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:25:07.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.788+0000 7fa3d68b7640 1 -- 172.21.15.60:0/2268038816 shutdown_connections 2024-09-12T02:25:07.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.788+0000 7fa3d68b7640 1 -- 172.21.15.60:0/2268038816 wait complete. 2024-09-12T02:25:07.805 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:25:07.805 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-12T02:25:07.805 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-12T02:25:07.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.911+0000 7f8eaba8d640 1 Processor -- start 2024-09-12T02:25:07.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.911+0000 7f8eaba8d640 1 -- start start 2024-09-12T02:25:07.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.912+0000 7f8eaba8d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ea4151840 0x7f8ea40ace00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:07.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.912+0000 7f8eaba8d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8ea40c3a00 0x7f8ea415e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:07.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.912+0000 7f8eaba8d640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ea40c3e50 con 0x7f8ea40ad340 2024-09-12T02:25:07.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.912+0000 7f8eaba8d640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f8ea41550f0 con 0x7f8ea40c3a00 2024-09-12T02:25:07.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.912+0000 7f8eaba8d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8ea4154330 con 0x7f8ea4151840 2024-09-12T02:25:07.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.912+0000 7f8eaa02a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8ea40c3a00 0x7f8ea415e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:07.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.912+0000 7f8eaa02a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8ea40c3a00 0x7f8ea415e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47160/0 (socket says 172.21.15.60:47160) 2024-09-12T02:25:07.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.912+0000 7f8eaa02a640 1 -- 172.21.15.60:0/1267911408 learned_addr learned my addr 172.21.15.60:0/1267911408 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:25:07.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.912+0000 7f8ea9829640 1 --2- 172.21.15.60:0/1267911408 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ea4151840 0x7f8ea40ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:07.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.913+0000 7f8eaa02a640 1 -- 172.21.15.60:0/1267911408 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ea4151840 msgr2=0x7f8ea40ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:25:07.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.913+0000 7f8eaa02a640 1 --2- 172.21.15.60:0/1267911408 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ea4151840 0x7f8ea40ace00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:07.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.913+0000 7f8eaa02a640 1 -- 172.21.15.60:0/1267911408 >> v1:172.21.15.105:6789/0 conn(0x7f8ea40ad340 legacy=0x7f8ea40c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:07.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.913+0000 7f8eaa02a640 1 -- 172.21.15.60:0/1267911408 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ea4154610 con 0x7f8ea40c3a00 2024-09-12T02:25:07.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.913+0000 7f8ea9829640 1 --2- 172.21.15.60:0/1267911408 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ea4151840 0x7f8ea40ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:25:07.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.913+0000 7f8eaa02a640 1 --2- 172.21.15.60:0/1267911408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ea40c3a00 0x7f8ea415e9c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c009e50 tx=0x7f8e9c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdff08c26d37e665 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:07.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.914+0000 7f8ea8827640 1 -- 172.21.15.60:0/1267911408 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c036070 con 0x7f8ea40c3a00 2024-09-12T02:25:07.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.914+0000 7f8ea8827640 1 -- 172.21.15.60:0/1267911408 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e9c031600 con 0x7f8ea40c3a00 2024-09-12T02:25:07.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.914+0000 7f8ea8827640 1 -- 172.21.15.60:0/1267911408 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c0319d0 con 0x7f8ea40c3a00 2024-09-12T02:25:07.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.914+0000 7f8eaba8d640 1 -- 172.21.15.60:0/1267911408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ea40c3a00 msgr2=0x7f8ea415e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:07.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.914+0000 7f8eaba8d640 1 --2- 172.21.15.60:0/1267911408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ea40c3a00 0x7f8ea415e9c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c009e50 tx=0x7f8e9c02a710 comp rx=0 tx=0).stop 2024-09-12T02:25:07.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.914+0000 7f8eaba8d640 1 -- 172.21.15.60:0/1267911408 shutdown_connections 2024-09-12T02:25:07.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.914+0000 7f8eaba8d640 1 --2- 172.21.15.60:0/1267911408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ea40c3a00 0x7f8ea415e9c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:07.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.914+0000 7f8eaba8d640 1 --2- 172.21.15.60:0/1267911408 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ea4151840 0x7f8ea40ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:07.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.914+0000 7f8eaba8d640 1 -- 172.21.15.60:0/1267911408 >> 172.21.15.60:0/1267911408 conn(0x7f8ea40c7a40 msgr2=0x7f8ea40c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:25:07.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.914+0000 7f8eaba8d640 1 -- 172.21.15.60:0/1267911408 shutdown_connections 2024-09-12T02:25:07.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.914+0000 7f8eaba8d640 1 -- 172.21.15.60:0/1267911408 wait complete. 2024-09-12T02:25:07.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.915+0000 7f8eaba8d640 1 Processor -- start 2024-09-12T02:25:07.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.916+0000 7f8eaba8d640 1 -- start start 2024-09-12T02:25:07.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.916+0000 7f8eaba8d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ea40ad340 0x7f8ea40c10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:07.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.916+0000 7f8eaba8d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ea40c3a00 0x7f8ea41497c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:07.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.916+0000 7f8eaba8d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ea4151840 0x7f8ea4149d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:07.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.916+0000 7f8eaba8d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea406dda0 con 0x7f8ea40ad340 2024-09-12T02:25:07.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.916+0000 7f8eaba8d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea4154bd0 con 0x7f8ea4151840 2024-09-12T02:25:07.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.916+0000 7f8eaba8d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8ea406e030 con 0x7f8ea40c3a00 2024-09-12T02:25:07.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.916+0000 7f8ea9829640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ea40ad340 0x7f8ea40c10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:07.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.916+0000 7f8ea9829640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ea40ad340 0x7f8ea40c10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47164/0 (socket says 172.21.15.60:47164) 2024-09-12T02:25:07.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.916+0000 7f8ea9829640 1 -- 172.21.15.60:0/3103946205 learned_addr learned my addr 172.21.15.60:0/3103946205 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:25:07.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.916+0000 7f8ea9028640 1 --2- 172.21.15.60:0/3103946205 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ea40c3a00 0x7f8ea41497c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:07.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.916+0000 7f8eaa02a640 1 --2- 172.21.15.60:0/3103946205 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ea4151840 0x7f8ea4149d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:07.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.917+0000 7f8ea9829640 1 -- 172.21.15.60:0/3103946205 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ea40c3a00 msgr2=0x7f8ea41497c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:07.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.917+0000 7f8ea9829640 1 --2- 172.21.15.60:0/3103946205 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ea40c3a00 0x7f8ea41497c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:07.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.917+0000 7f8ea9829640 1 -- 172.21.15.60:0/3103946205 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ea4151840 msgr2=0x7f8ea4149d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:07.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.917+0000 7f8ea9829640 1 --2- 172.21.15.60:0/3103946205 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ea4151840 0x7f8ea4149d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:07.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.917+0000 7f8ea9829640 1 -- 172.21.15.60:0/3103946205 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ea41f00b0 con 0x7f8ea40ad340 2024-09-12T02:25:07.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.917+0000 7f8ea9829640 1 --2- 172.21.15.60:0/3103946205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ea40ad340 0x7f8ea40c10e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8ea000d7d0 tx=0x7f8ea000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:07.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.917+0000 7f8e9a7fc640 1 -- 172.21.15.60:0/3103946205 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0004030 con 0x7f8ea40ad340 2024-09-12T02:25:07.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.917+0000 7f8e9a7fc640 1 -- 172.21.15.60:0/3103946205 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ea00041d0 con 0x7f8ea40ad340 2024-09-12T02:25:07.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.917+0000 7f8eaba8d640 1 -- 172.21.15.60:0/3103946205 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ea41f0390 con 0x7f8ea40ad340 2024-09-12T02:25:07.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.917+0000 7f8e9a7fc640 1 -- 172.21.15.60:0/3103946205 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea00096a0 con 0x7f8ea40ad340 2024-09-12T02:25:07.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.917+0000 7f8eaba8d640 1 -- 172.21.15.60:0/3103946205 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ea40ac320 con 0x7f8ea40ad340 2024-09-12T02:25:07.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.918+0000 7f8eaba8d640 1 --2- 172.21.15.60:0/3103946205 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ea40ac9a0 0x7f8ea41ec0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:07.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.918+0000 7f8eaba8d640 1 -- 172.21.15.60:0/3103946205 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8ea40ac4f0 con 0x7f8ea40ac9a0 2024-09-12T02:25:07.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.918+0000 7f8ea9028640 1 --2- 172.21.15.60:0/3103946205 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ea40ac9a0 0x7f8ea41ec0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:07.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.919+0000 7f8ea9028640 1 -- 172.21.15.60:0/3103946205 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8ea414a640 con 0x7f8ea40ac9a0 2024-09-12T02:25:07.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.919+0000 7f8e9a7fc640 1 -- 172.21.15.60:0/3103946205 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8ea0009840 con 0x7f8ea40ad340 2024-09-12T02:25:07.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.919+0000 7f8ea9028640 1 --2- 172.21.15.60:0/3103946205 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ea40ac9a0 0x7f8ea41ec0e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4153550 tx=0x7f8e9400f9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:07.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.919+0000 7f8e9a7fc640 1 --2- 172.21.15.60:0/3103946205 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8e8806be30 0x7f8e8806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:07.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.919+0000 7f8eaa02a640 1 --2- 172.21.15.60:0/3103946205 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8e8806be30 0x7f8e8806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:07.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.919+0000 7f8e9a7fc640 1 -- 172.21.15.60:0/3103946205 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f8ea008b320 con 0x7f8ea40ad340 2024-09-12T02:25:07.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.919+0000 7f8e9a7fc640 1 -- 172.21.15.60:0/3103946205 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e94019070 con 0x7f8ea40ac9a0 2024-09-12T02:25:07.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.919+0000 7f8e9a7fc640 1 -- 172.21.15.60:0/3103946205 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f8e94005320 con 0x7f8ea40ac9a0 2024-09-12T02:25:07.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.919+0000 7f8e9a7fc640 1 -- 172.21.15.60:0/3103946205 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ea40ac9a0 msgr2=0x7f8ea41ec0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:07.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.919+0000 7f8e9a7fc640 1 --2- 172.21.15.60:0/3103946205 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ea40ac9a0 0x7f8ea41ec0e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4153550 tx=0x7f8e9400f9d0 comp rx=0 tx=0).stop 2024-09-12T02:25:07.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.919+0000 7f8e9a7fc640 1 -- 172.21.15.60:0/3103946205 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ea40ac9a0 msgr2=0x7f8ea41ec0e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:25:07.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.919+0000 7f8e9a7fc640 1 --2- 172.21.15.60:0/3103946205 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ea40ac9a0 0x7f8ea41ec0e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:07.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.920+0000 7f8eaa02a640 1 --2- 172.21.15.60:0/3103946205 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8e8806be30 0x7f8e8806e2f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c033000 tx=0x7f8e9c009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:07.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.926+0000 7f8eaba8d640 1 --2- 172.21.15.60:0/3103946205 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ea41e0330 0x7f8ea41ec620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:07.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.926+0000 7f8eaba8d640 1 -- 172.21.15.60:0/3103946205 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8ea40c2600 con 0x7f8ea41e0330 2024-09-12T02:25:07.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.926+0000 7f8ea9028640 1 --2- 172.21.15.60:0/3103946205 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ea41e0330 0x7f8ea41ec620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:07.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.926+0000 7f8ea9028640 1 -- 172.21.15.60:0/3103946205 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8ea4151c20 con 0x7f8ea41e0330 2024-09-12T02:25:07.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.926+0000 7f8ea9028640 1 --2- 172.21.15.60:0/3103946205 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ea41e0330 0x7f8ea41ec620 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8e94016000 tx=0x7f8e94000ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:07.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.927+0000 7f8e9a7fc640 1 -- 172.21.15.60:0/3103946205 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e94019030 con 0x7f8ea41e0330 2024-09-12T02:25:07.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.927+0000 7f8e9a7fc640 1 -- 172.21.15.60:0/3103946205 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5050 (secure 0 0 0) 0x7f8e94006bf0 con 0x7f8ea41e0330 2024-09-12T02:25:07.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.927+0000 7f8e9a7fc640 1 -- 172.21.15.60:0/3103946205 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ea41e0330 msgr2=0x7f8ea41ec620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:07.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.927+0000 7f8e9a7fc640 1 --2- 172.21.15.60:0/3103946205 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ea41e0330 0x7f8ea41ec620 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8e94016000 tx=0x7f8e94000ed0 comp rx=0 tx=0).stop 2024-09-12T02:25:07.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.927+0000 7f8e9a7fc640 1 -- 172.21.15.60:0/3103946205 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ea41e0330 msgr2=0x7f8ea41ec620 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:25:07.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.927+0000 7f8e9a7fc640 1 --2- 172.21.15.60:0/3103946205 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ea41e0330 0x7f8ea41ec620 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:07.928 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:25:07.928 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:25:07.928 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:25:07.928 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:25:07.928 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 22, 2024-09-12T02:25:07.929 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 153242, 2024-09-12T02:25:07.929 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:25:07.929 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:25:07.929 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:25:07.929 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:25:07.929 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:07.929 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-09-12T02:25:07.929 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:25:07.929 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:25:07.929 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:25:07.929 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:25:07.929 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:25:07.929 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:25:07.929 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:25:07.930 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:25:07.930 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:25:07.930 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:25:07.930 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:25:07.930 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:25:07.930 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:25:07.930 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:25:07.930 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:07.930 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:25:07.930 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:25:07.930 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:25:07.930 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:25:07.930 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:25:07.930 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:25:07.931 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:25:07.931 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:25:07.931 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:25:07.931 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:25:07.931 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:25:07.931 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:25:07.931 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:25:07.931 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:07.931 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:07.931 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:25:07.931 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:25:07.931 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:25:07.931 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:25:07.931 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:25:07.932 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:25:07.932 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:25:07.932 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:25:07.932 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:25:07.932 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:25:07.932 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:25:07.932 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:25:07.932 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:25:07.932 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:25:07.932 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:25:07.932 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:25:07.932 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:25:07.933 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:25:07.933 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:25:07.933 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:25:07.933 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:25:07.933 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:25:07.933 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:25:07.933 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:25:07.933 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:25:07.933 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:25:07.933 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:25:07.933 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:25:07.933 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:07.933 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:25:07.933 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:07.934 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:25:07.934 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:07.934 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:25:07.934 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:25:07.934 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:25:07.934 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:25:07.934 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:07.934 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:25:07.934 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:25:07.934 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:07.934 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:07.934 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:07.934 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:25:07.934 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:25:07.935 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:07.935 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:07.935 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:07.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:07.935 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:25:07.935 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:25:07.935 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:25:07.935 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:25:07.935 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:25:07.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:07.935 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:07.935 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:25:07.935 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:25:07.935 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:25:07.936 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:25:07.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:07.936 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:25:07.936 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:25:07.936 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:07.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:07.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:07.936 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:25:07.936 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:25:07.936 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:07.936 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:07.936 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:07.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:07.937 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:25:07.937 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:25:07.937 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:25:07.937 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:25:07.937 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:25:07.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:07.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:07.937 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:25:07.937 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:25:07.937 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:25:07.937 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:25:07.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:07.937 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:25:07.937 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:25:07.938 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:07.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:07.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:07.938 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:25:07.938 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:25:07.938 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:07.938 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:07.938 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:07.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:07.938 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:25:07.938 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:25:07.938 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:25:07.938 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:25:07.938 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:25:07.939 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:07.939 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:07.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:07.939 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:25:07.939 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:25:07.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:07.939 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:25:07.939 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:25:07.939 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:25:07.939 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:07.939 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:07.939 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:25:07.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:07.939 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:25:07.940 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:25:07.940 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:25:07.940 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:07.940 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:07.940 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:25:07.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:07.940 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:25:07.940 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:25:07.940 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:25:07.940 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:07.940 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:07.940 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:25:07.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:07.940 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:25:07.941 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:25:07.941 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:25:07.941 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:07.941 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:07.941 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:25:07.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:07.941 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:25:07.941 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:25:07.941 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:25:07.941 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:07.941 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:07.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:07.941 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:25:07.941 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:25:07.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.927+0000 7f8eaba8d640 1 -- 172.21.15.60:0/3103946205 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8e8806be30 msgr2=0x7f8e8806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:07.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.927+0000 7f8eaba8d640 1 --2- 172.21.15.60:0/3103946205 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8e8806be30 0x7f8e8806e2f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c033000 tx=0x7f8e9c009000 comp rx=0 tx=0).stop 2024-09-12T02:25:07.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.927+0000 7f8eaba8d640 1 -- 172.21.15.60:0/3103946205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ea40ad340 msgr2=0x7f8ea40c10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:07.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.927+0000 7f8eaba8d640 1 --2- 172.21.15.60:0/3103946205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ea40ad340 0x7f8ea40c10e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8ea000d7d0 tx=0x7f8ea000dc90 comp rx=0 tx=0).stop 2024-09-12T02:25:07.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.927+0000 7f8eaa02a640 1 -- 172.21.15.60:0/3103946205 reap_dead start 2024-09-12T02:25:07.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.927+0000 7f8eaa02a640 1 -- 172.21.15.60:0/3103946205 reap_dead start 2024-09-12T02:25:07.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.927+0000 7f8eaba8d640 1 -- 172.21.15.60:0/3103946205 shutdown_connections 2024-09-12T02:25:07.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.927+0000 7f8eaba8d640 1 -- 172.21.15.60:0/3103946205 >> 172.21.15.60:0/3103946205 conn(0x7f8ea40c7a40 msgr2=0x7f8ea40c64a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:25:07.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.927+0000 7f8eaba8d640 1 -- 172.21.15.60:0/3103946205 shutdown_connections 2024-09-12T02:25:07.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:07.927+0000 7f8eaba8d640 1 -- 172.21.15.60:0/3103946205 wait complete. 2024-09-12T02:25:07.944 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:25:07.944 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-12T02:25:07.944 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-12T02:25:07.992 INFO:tasks.workunit.client.1.smithi105.stdout:checking for srand48_r... yes 2024-09-12T02:25:08.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.047+0000 7fa866c82640 1 Processor -- start 2024-09-12T02:25:08.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.047+0000 7fa866c82640 1 -- start start 2024-09-12T02:25:08.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.048+0000 7fa866c82640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa860153910 0x7fa8600c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:08.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.048+0000 7fa866c82640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8600c5940 con 0x7fa8600c69c0 2024-09-12T02:25:08.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.048+0000 7fa866c82640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8600c5c00 con 0x7fa8601505f0 2024-09-12T02:25:08.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.048+0000 7fa866c82640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa8600c7860 con 0x7fa860153910 2024-09-12T02:25:08.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.048+0000 7fa85ffff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa8600c69c0 0x7fa8600c42b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:38236/0 (socket says 172.21.15.60:38236) 2024-09-12T02:25:08.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.048+0000 7fa85ffff640 1 -- 172.21.15.60:0/2614174138 learned_addr learned my addr 172.21.15.60:0/2614174138 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:25:08.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.048+0000 7fa86521f640 1 --2- 172.21.15.60:0/2614174138 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa860153910 0x7fa8600c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:08.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.048+0000 7fa85f7fe640 1 -- 172.21.15.60:0/2614174138 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 489105331 0 0) 0x7fa8600c5940 con 0x7fa8600c69c0 2024-09-12T02:25:08.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.048+0000 7fa85f7fe640 1 -- 172.21.15.60:0/2614174138 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa848003520 con 0x7fa8600c69c0 2024-09-12T02:25:08.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.049+0000 7fa85f7fe640 1 -- 172.21.15.60:0/2614174138 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3864250680 0 0) 0x7fa8600c5c00 con 0x7fa8601505f0 2024-09-12T02:25:08.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.049+0000 7fa85f7fe640 1 -- 172.21.15.60:0/2614174138 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8600c5940 con 0x7fa8601505f0 2024-09-12T02:25:08.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.049+0000 7fa85f7fe640 1 -- 172.21.15.60:0/2614174138 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4229872960 0 0) 0x7fa848003520 con 0x7fa8600c69c0 2024-09-12T02:25:08.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.049+0000 7fa85f7fe640 1 -- 172.21.15.60:0/2614174138 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa860153910 msgr2=0x7fa8600c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:25:08.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.049+0000 7fa85f7fe640 1 --2- 172.21.15.60:0/2614174138 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa860153910 0x7fa8600c49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:08.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.049+0000 7fa85f7fe640 1 -- 172.21.15.60:0/2614174138 >> v1:172.21.15.105:6789/0 conn(0x7fa8601505f0 legacy=0x7fa8600c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:08.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.049+0000 7fa85f7fe640 1 -- 172.21.15.60:0/2614174138 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8600c5ee0 con 0x7fa8600c69c0 2024-09-12T02:25:08.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.049+0000 7fa85f7fe640 1 -- 172.21.15.60:0/2614174138 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7fa854001670 con 0x7fa8600c69c0 2024-09-12T02:25:08.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.049+0000 7fa85f7fe640 1 -- 172.21.15.60:0/2614174138 >> v1:172.21.15.60:6789/0 conn(0x7fa8600c69c0 legacy=0x7fa8600c42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:08.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.049+0000 7fa85f7fe640 1 --2- 172.21.15.60:0/2614174138 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa848003b70 0x7fa848003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:08.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.049+0000 7fa85f7fe640 1 --2- 172.21.15.60:0/2614174138 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa848004800 0x7fa848004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:08.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.049+0000 7fa85f7fe640 1 --2- 172.21.15.60:0/2614174138 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa860153910 0x7fa8480051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:08.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.049+0000 7fa85f7fe640 1 -- 172.21.15.60:0/2614174138 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa84800dcb0 con 0x7fa848003b70 2024-09-12T02:25:08.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.049+0000 7fa85f7fe640 1 -- 172.21.15.60:0/2614174138 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa84800de60 con 0x7fa848004800 2024-09-12T02:25:08.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.049+0000 7fa85f7fe640 1 -- 172.21.15.60:0/2614174138 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa84800e060 con 0x7fa860153910 2024-09-12T02:25:08.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.049+0000 7fa864a1e640 1 --2- 172.21.15.60:0/2614174138 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa848003b70 0x7fa848003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:08.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.049+0000 7fa85ffff640 1 --2- 172.21.15.60:0/2614174138 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa848004800 0x7fa848004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:08.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.049+0000 7fa86521f640 1 --2- 172.21.15.60:0/2614174138 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa860153910 0x7fa8480051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:08.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.049+0000 7fa864a1e640 1 -- 172.21.15.60:0/2614174138 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa860153910 msgr2=0x7fa8480051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:25:08.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.049+0000 7fa864a1e640 1 --2- 172.21.15.60:0/2614174138 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa860153910 0x7fa8480051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:08.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.049+0000 7fa864a1e640 1 -- 172.21.15.60:0/2614174138 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa848004800 msgr2=0x7fa848004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:25:08.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.049+0000 7fa864a1e640 1 --2- 172.21.15.60:0/2614174138 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa848004800 0x7fa848004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:08.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.049+0000 7fa864a1e640 1 -- 172.21.15.60:0/2614174138 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa848003520 con 0x7fa848003b70 2024-09-12T02:25:08.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.049+0000 7fa86521f640 1 --2- 172.21.15.60:0/2614174138 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa860153910 0x7fa8480051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:25:08.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.049+0000 7fa85ffff640 1 --2- 172.21.15.60:0/2614174138 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa848004800 0x7fa848004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:25:08.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.050+0000 7fa864a1e640 1 --2- 172.21.15.60:0/2614174138 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa848003b70 0x7fa848003f70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa8500018d0 tx=0x7fa848005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee29da47c2cf7599 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:08.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.050+0000 7fa85f7fe640 1 -- 172.21.15.60:0/2614174138 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8500014f0 con 0x7fa848003b70 2024-09-12T02:25:08.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.050+0000 7fa85f7fe640 1 -- 172.21.15.60:0/2614174138 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8500052d0 con 0x7fa848003b70 2024-09-12T02:25:08.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.050+0000 7fa85f7fe640 1 -- 172.21.15.60:0/2614174138 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa85002aca0 con 0x7fa848003b70 2024-09-12T02:25:08.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.051+0000 7fa866c82640 1 -- 172.21.15.60:0/2614174138 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa848003b70 msgr2=0x7fa848003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:08.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.051+0000 7fa866c82640 1 --2- 172.21.15.60:0/2614174138 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa848003b70 0x7fa848003f70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa8500018d0 tx=0x7fa848005830 comp rx=0 tx=0).stop 2024-09-12T02:25:08.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.051+0000 7fa86521f640 1 -- 172.21.15.60:0/2614174138 reap_dead start 2024-09-12T02:25:08.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.051+0000 7fa866c82640 1 -- 172.21.15.60:0/2614174138 shutdown_connections 2024-09-12T02:25:08.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.051+0000 7fa866c82640 1 -- 172.21.15.60:0/2614174138 >> 172.21.15.60:0/2614174138 conn(0x7fa8600c7a40 msgr2=0x7fa8600c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:25:08.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.051+0000 7fa866c82640 1 -- 172.21.15.60:0/2614174138 shutdown_connections 2024-09-12T02:25:08.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.051+0000 7fa866c82640 1 -- 172.21.15.60:0/2614174138 wait complete. 2024-09-12T02:25:08.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.052+0000 7fa866c82640 1 Processor -- start 2024-09-12T02:25:08.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.052+0000 7fa866c82640 1 -- start start 2024-09-12T02:25:08.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.053+0000 7fa866c82640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa848003b70 0x7fa8600c10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:08.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.053+0000 7fa866c82640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa86014ae30 0x7fa860144ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:08.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.053+0000 7fa866c82640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa860145430 0x7fa8601496e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:08.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.053+0000 7fa866c82640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa860153d30 con 0x7fa848003b70 2024-09-12T02:25:08.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.053+0000 7fa866c82640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa8600c64a0 con 0x7fa86014ae30 2024-09-12T02:25:08.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.053+0000 7fa866c82640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa8601509d0 con 0x7fa860145430 2024-09-12T02:25:08.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.053+0000 7fa864a1e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa848003b70 0x7fa8600c10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:08.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.053+0000 7fa864a1e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa848003b70 0x7fa8600c10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47180/0 (socket says 172.21.15.60:47180) 2024-09-12T02:25:08.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.053+0000 7fa864a1e640 1 -- 172.21.15.60:0/1086099976 learned_addr learned my addr 172.21.15.60:0/1086099976 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:25:08.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.053+0000 7fa85ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa86014ae30 0x7fa860144ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:08.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.053+0000 7fa86521f640 1 --2- 172.21.15.60:0/1086099976 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa860145430 0x7fa8601496e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:08.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.053+0000 7fa864a1e640 1 -- 172.21.15.60:0/1086099976 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa860145430 msgr2=0x7fa8601496e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:08.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.053+0000 7fa864a1e640 1 --2- 172.21.15.60:0/1086099976 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa860145430 0x7fa8601496e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:08.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.053+0000 7fa864a1e640 1 -- 172.21.15.60:0/1086099976 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa86014ae30 msgr2=0x7fa860144ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:08.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.053+0000 7fa864a1e640 1 --2- 172.21.15.60:0/1086099976 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa86014ae30 0x7fa860144ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:08.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.053+0000 7fa864a1e640 1 -- 172.21.15.60:0/1086099976 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa86014de10 con 0x7fa848003b70 2024-09-12T02:25:08.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.053+0000 7fa85ffff640 1 --2- 172.21.15.60:0/1086099976 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa86014ae30 0x7fa860144ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:25:08.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.053+0000 7fa864a1e640 1 --2- 172.21.15.60:0/1086099976 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa848003b70 0x7fa8600c10e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa850005040 tx=0x7fa8500012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:08.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.054+0000 7fa85d7fa640 1 -- 172.21.15.60:0/1086099976 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa850040020 con 0x7fa848003b70 2024-09-12T02:25:08.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.054+0000 7fa85d7fa640 1 -- 172.21.15.60:0/1086099976 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa850005480 con 0x7fa848003b70 2024-09-12T02:25:08.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.054+0000 7fa85d7fa640 1 -- 172.21.15.60:0/1086099976 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8500014f0 con 0x7fa848003b70 2024-09-12T02:25:08.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.054+0000 7fa866c82640 1 -- 172.21.15.60:0/1086099976 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8600c38a0 con 0x7fa848003b70 2024-09-12T02:25:08.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.054+0000 7fa866c82640 1 -- 172.21.15.60:0/1086099976 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8601eec20 con 0x7fa848003b70 2024-09-12T02:25:08.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.055+0000 7fa866c82640 1 -- 172.21.15.60:0/1086099976 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8600c2440 con 0x7fa848003b70 2024-09-12T02:25:08.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.055+0000 7fa85d7fa640 1 -- 172.21.15.60:0/1086099976 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa850043020 con 0x7fa848003b70 2024-09-12T02:25:08.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.056+0000 7fa85d7fa640 1 --2- 172.21.15.60:0/1086099976 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa84c06be60 0x7fa84c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:08.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.056+0000 7fa85d7fa640 1 -- 172.21.15.60:0/1086099976 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fa8500ab1d0 con 0x7fa848003b70 2024-09-12T02:25:08.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.056+0000 7fa85ffff640 1 --2- 172.21.15.60:0/1086099976 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa84c06be60 0x7fa84c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:08.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.056+0000 7fa85ffff640 1 --2- 172.21.15.60:0/1086099976 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa84c06be60 0x7fa84c06e320 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa8601528e0 tx=0x7fa854001e40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:08.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.061+0000 7fa85d7fa640 1 -- 172.21.15.60:0/1086099976 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa85004a030 con 0x7fa848003b70 2024-09-12T02:25:08.144 INFO:tasks.workunit.client.0.smithi060.stdout:checking for open64... yes 2024-09-12T02:25:08.179 INFO:tasks.workunit.client.1.smithi105.stdout:configure: creating ./config.status 2024-09-12T02:25:08.237 INFO:tasks.workunit.client.0.smithi060.stdout:checking for stat64... yes 2024-09-12T02:25:08.289 INFO:tasks.workunit.client.1.smithi105.stdout: /bin/sh ./config.status 2024-09-12T02:25:08.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.336+0000 7fa866c82640 1 -- 172.21.15.60:0/1086099976 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fa8600c1620 con 0x7fa848003b70 2024-09-12T02:25:08.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.337+0000 7fa85d7fa640 1 -- 172.21.15.60:0/1086099976 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fa850079180 con 0x7fa848003b70 2024-09-12T02:25:08.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.339+0000 7fa866c82640 1 -- 172.21.15.60:0/1086099976 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa84c06be60 msgr2=0x7fa84c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:08.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.339+0000 7fa866c82640 1 --2- 172.21.15.60:0/1086099976 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa84c06be60 0x7fa84c06e320 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa8601528e0 tx=0x7fa854001e40 comp rx=0 tx=0).stop 2024-09-12T02:25:08.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.339+0000 7fa866c82640 1 -- 172.21.15.60:0/1086099976 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa848003b70 msgr2=0x7fa8600c10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:08.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.339+0000 7fa866c82640 1 --2- 172.21.15.60:0/1086099976 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa848003b70 0x7fa8600c10e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa850005040 tx=0x7fa8500012d0 comp rx=0 tx=0).stop 2024-09-12T02:25:08.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.339+0000 7fa866c82640 1 -- 172.21.15.60:0/1086099976 shutdown_connections 2024-09-12T02:25:08.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.339+0000 7fa866c82640 1 --2- 172.21.15.60:0/1086099976 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa84c06be60 0x7fa84c06e320 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:08.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.339+0000 7fa866c82640 1 --2- 172.21.15.60:0/1086099976 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa860145430 0x7fa8601496e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:08.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.339+0000 7fa866c82640 1 --2- 172.21.15.60:0/1086099976 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa86014ae30 0x7fa860144ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:08.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.339+0000 7fa866c82640 1 --2- 172.21.15.60:0/1086099976 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa848003b70 0x7fa8600c10e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:08.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.339+0000 7fa866c82640 1 -- 172.21.15.60:0/1086099976 >> 172.21.15.60:0/1086099976 conn(0x7fa8600c7a40 msgr2=0x7fa8600c6e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:25:08.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.340+0000 7fa866c82640 1 -- 172.21.15.60:0/1086099976 shutdown_connections 2024-09-12T02:25:08.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:08.340+0000 7fa866c82640 1 -- 172.21.15.60:0/1086099976 wait complete. 2024-09-12T02:25:08.349 INFO:tasks.workunit.client.1.smithi105.stdout:config.status: creating Makefile 2024-09-12T02:25:08.352 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-12T02:25:08.365 INFO:tasks.workunit.client.1.smithi105.stdout:config.status: creating config.h 2024-09-12T02:25:08.390 INFO:tasks.workunit.client.1.smithi105.stdout:config.status: executing depfiles commands 2024-09-12T02:25:08.407 INFO:tasks.workunit.client.1.smithi105.stdout:config.status: executing default commands 2024-09-12T02:25:08.460 INFO:tasks.workunit.client.1.smithi105.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb/missing --run autoheader 2024-09-12T02:25:09.111 INFO:tasks.workunit.client.0.smithi060.stdout:checking for fseeko64... yes 2024-09-12T02:25:09.165 INFO:tasks.workunit.client.1.smithi105.stdout:rm -f stamp-h1 2024-09-12T02:25:09.167 INFO:tasks.workunit.client.1.smithi105.stdout:touch config.h.in 2024-09-12T02:25:09.169 INFO:tasks.workunit.client.1.smithi105.stdout:cd . && /bin/sh ./config.status config.h 2024-09-12T02:25:09.193 INFO:tasks.workunit.client.0.smithi060.stdout:checking for lrand48_r... yes 2024-09-12T02:25:09.221 INFO:tasks.workunit.client.1.smithi105.stdout:config.status: creating config.h 2024-09-12T02:25:09.256 INFO:tasks.workunit.client.1.smithi105.stdout:make all-am 2024-09-12T02:25:09.280 INFO:tasks.workunit.client.1.smithi105.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb' 2024-09-12T02:25:09.280 INFO:tasks.workunit.client.1.smithi105.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fileops.o -MD -MP -MF .deps/fileops.Tpo -c -o fileops.o fileops.c 2024-09-12T02:25:09.431 INFO:tasks.workunit.client.0.smithi060.stdout:checking for srand48_r... yes 2024-09-12T02:25:09.457 INFO:tasks.workunit.client.0.smithi060.stdout:configure: creating ./config.status 2024-09-12T02:25:09.482 INFO:tasks.workunit.client.1.smithi105.stdout:mv -f .deps/fileops.Tpo .deps/fileops.Po 2024-09-12T02:25:09.487 INFO:tasks.workunit.client.1.smithi105.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rand.o -MD -MP -MF .deps/rand.Tpo -c -o rand.o rand.c 2024-09-12T02:25:09.594 INFO:tasks.workunit.client.1.smithi105.stdout:mv -f .deps/rand.Tpo .deps/rand.Po 2024-09-12T02:25:09.599 INFO:tasks.workunit.client.1.smithi105.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT main.o -MD -MP -MF .deps/main.Tpo -c -o main.o main.c 2024-09-12T02:25:09.716 INFO:tasks.workunit.client.1.smithi105.stdout:mv -f .deps/main.Tpo .deps/main.Po 2024-09-12T02:25:09.721 INFO:tasks.workunit.client.1.smithi105.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fh.o -MD -MP -MF .deps/fh.Tpo -c -o fh.o fh.c 2024-09-12T02:25:09.832 INFO:tasks.workunit.client.1.smithi105.stdout:mv -f .deps/fh.Tpo .deps/fh.Po 2024-09-12T02:25:09.837 INFO:tasks.workunit.client.1.smithi105.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT filelist.o -MD -MP -MF .deps/filelist.Tpo -c -o filelist.o filelist.c 2024-09-12T02:25:09.984 INFO:tasks.workunit.client.1.smithi105.stdout:mv -f .deps/filelist.Tpo .deps/filelist.Po 2024-09-12T02:25:09.988 INFO:tasks.workunit.client.1.smithi105.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT metaops.o -MD -MP -MF .deps/metaops.Tpo -c -o metaops.o metaops.c 2024-09-12T02:25:10.086 INFO:tasks.workunit.client.1.smithi105.stdout:mv -f .deps/metaops.Tpo .deps/metaops.Po 2024-09-12T02:25:10.091 INFO:tasks.workunit.client.0.smithi060.stdout: /bin/sh ./config.status 2024-09-12T02:25:10.091 INFO:tasks.workunit.client.1.smithi105.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rwlock.o -MD -MP -MF .deps/rwlock.Tpo -c -o rwlock.o rwlock.c 2024-09-12T02:25:10.145 INFO:tasks.workunit.client.1.smithi105.stdout:mv -f .deps/rwlock.Tpo .deps/rwlock.Po 2024-09-12T02:25:10.149 INFO:tasks.workunit.client.1.smithi105.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT cirlist.o -MD -MP -MF .deps/cirlist.Tpo -c -o cirlist.o cirlist.c 2024-09-12T02:25:10.209 INFO:tasks.workunit.client.1.smithi105.stdout:mv -f .deps/cirlist.Tpo .deps/cirlist.Po 2024-09-12T02:25:10.214 INFO:tasks.workunit.client.1.smithi105.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rbt.o -MD -MP -MF .deps/rbt.Tpo -c -o rbt.o rbt.c 2024-09-12T02:25:10.304 INFO:tasks.workunit.client.0.smithi060.stdout:config.status: creating Makefile 2024-09-12T02:25:10.321 INFO:tasks.workunit.client.0.smithi060.stdout:config.status: creating config.h 2024-09-12T02:25:10.431 INFO:tasks.workunit.client.1.smithi105.stdout:mv -f .deps/rbt.Tpo .deps/rbt.Po 2024-09-12T02:25:10.435 INFO:tasks.workunit.client.1.smithi105.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_tg.o -MD -MP -MF .deps/ffsb_tg.Tpo -c -o ffsb_tg.o ffsb_tg.c 2024-09-12T02:25:10.580 INFO:tasks.workunit.client.1.smithi105.stdout:mv -f .deps/ffsb_tg.Tpo .deps/ffsb_tg.Po 2024-09-12T02:25:10.584 INFO:tasks.workunit.client.1.smithi105.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fs.o -MD -MP -MF .deps/ffsb_fs.Tpo -c -o ffsb_fs.o ffsb_fs.c 2024-09-12T02:25:10.610 INFO:tasks.workunit.client.0.smithi060.stdout:config.status: executing depfiles commands 2024-09-12T02:25:10.629 INFO:tasks.workunit.client.0.smithi060.stdout:config.status: executing default commands 2024-09-12T02:25:10.679 INFO:tasks.workunit.client.0.smithi060.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoheader 2024-09-12T02:25:10.764 INFO:tasks.workunit.client.1.smithi105.stdout:mv -f .deps/ffsb_fs.Tpo .deps/ffsb_fs.Po 2024-09-12T02:25:10.769 INFO:tasks.workunit.client.1.smithi105.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_thread.o -MD -MP -MF .deps/ffsb_thread.Tpo -c -o ffsb_thread.o ffsb_thread.c 2024-09-12T02:25:10.855 INFO:tasks.workunit.client.1.smithi105.stdout:mv -f .deps/ffsb_thread.Tpo .deps/ffsb_thread.Po 2024-09-12T02:25:10.860 INFO:tasks.workunit.client.1.smithi105.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_op.o -MD -MP -MF .deps/ffsb_op.Tpo -c -o ffsb_op.o ffsb_op.c 2024-09-12T02:25:10.951 INFO:tasks.workunit.client.1.smithi105.stdout:mv -f .deps/ffsb_op.Tpo .deps/ffsb_op.Po 2024-09-12T02:25:10.956 INFO:tasks.workunit.client.1.smithi105.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT util.o -MD -MP -MF .deps/util.Tpo -c -o util.o util.c 2024-09-12T02:25:11.081 INFO:tasks.workunit.client.1.smithi105.stdout:mv -f .deps/util.Tpo .deps/util.Po 2024-09-12T02:25:11.086 INFO:tasks.workunit.client.1.smithi105.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT parser.o -MD -MP -MF .deps/parser.Tpo -c -o parser.o parser.c 2024-09-12T02:25:11.128 INFO:tasks.workunit.client.1.smithi105.stderr:In file included from parser.h:22, 2024-09-12T02:25:11.128 INFO:tasks.workunit.client.1.smithi105.stderr: from parser.c:25: 2024-09-12T02:25:11.128 INFO:tasks.workunit.client.1.smithi105.stderr:parser.c: In function ‘init_filesys’: 2024-09-12T02:25:11.130 INFO:tasks.workunit.client.1.smithi105.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-12T02:25:11.130 INFO:tasks.workunit.client.1.smithi105.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-12T02:25:11.130 INFO:tasks.workunit.client.1.smithi105.stderr: | ^ 2024-09-12T02:25:11.130 INFO:tasks.workunit.client.1.smithi105.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-12T02:25:11.130 INFO:tasks.workunit.client.1.smithi105.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-12T02:25:11.130 INFO:tasks.workunit.client.1.smithi105.stderr: | ^~~~~~~~ 2024-09-12T02:25:11.130 INFO:tasks.workunit.client.1.smithi105.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-12T02:25:11.130 INFO:tasks.workunit.client.1.smithi105.stderr: 36 | container_of(ptr, type, member) 2024-09-12T02:25:11.130 INFO:tasks.workunit.client.1.smithi105.stderr: | ^~~~~~~~~~~~ 2024-09-12T02:25:11.130 INFO:tasks.workunit.client.1.smithi105.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-12T02:25:11.131 INFO:tasks.workunit.client.1.smithi105.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-12T02:25:11.131 INFO:tasks.workunit.client.1.smithi105.stderr: | ^~~~~~~~~~ 2024-09-12T02:25:11.131 INFO:tasks.workunit.client.1.smithi105.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-12T02:25:11.131 INFO:tasks.workunit.client.1.smithi105.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-09-12T02:25:11.131 INFO:tasks.workunit.client.1.smithi105.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-12T02:25:11.131 INFO:tasks.workunit.client.1.smithi105.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-12T02:25:11.131 INFO:tasks.workunit.client.1.smithi105.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-12T02:25:11.131 INFO:tasks.workunit.client.1.smithi105.stderr: | ^ 2024-09-12T02:25:11.131 INFO:tasks.workunit.client.1.smithi105.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-12T02:25:11.131 INFO:tasks.workunit.client.1.smithi105.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-12T02:25:11.131 INFO:tasks.workunit.client.1.smithi105.stderr: | ^~~~~~~~ 2024-09-12T02:25:11.131 INFO:tasks.workunit.client.1.smithi105.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-12T02:25:11.131 INFO:tasks.workunit.client.1.smithi105.stderr: 36 | container_of(ptr, type, member) 2024-09-12T02:25:11.131 INFO:tasks.workunit.client.1.smithi105.stderr: | ^~~~~~~~~~~~ 2024-09-12T02:25:11.132 INFO:tasks.workunit.client.1.smithi105.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-12T02:25:11.132 INFO:tasks.workunit.client.1.smithi105.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-12T02:25:11.132 INFO:tasks.workunit.client.1.smithi105.stderr: | ^~~~~~~~~~ 2024-09-12T02:25:11.132 INFO:tasks.workunit.client.1.smithi105.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-12T02:25:11.132 INFO:tasks.workunit.client.1.smithi105.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-09-12T02:25:11.132 INFO:tasks.workunit.client.1.smithi105.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-12T02:25:11.132 INFO:tasks.workunit.client.1.smithi105.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-12T02:25:11.132 INFO:tasks.workunit.client.1.smithi105.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-12T02:25:11.132 INFO:tasks.workunit.client.1.smithi105.stderr: | ^ 2024-09-12T02:25:11.132 INFO:tasks.workunit.client.1.smithi105.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-12T02:25:11.133 INFO:tasks.workunit.client.1.smithi105.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-12T02:25:11.133 INFO:tasks.workunit.client.1.smithi105.stderr: | ^~~~~~~~ 2024-09-12T02:25:11.133 INFO:tasks.workunit.client.1.smithi105.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-12T02:25:11.133 INFO:tasks.workunit.client.1.smithi105.stderr: 36 | container_of(ptr, type, member) 2024-09-12T02:25:11.133 INFO:tasks.workunit.client.1.smithi105.stderr: | ^~~~~~~~~~~~ 2024-09-12T02:25:11.133 INFO:tasks.workunit.client.1.smithi105.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-12T02:25:11.133 INFO:tasks.workunit.client.1.smithi105.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-12T02:25:11.133 INFO:tasks.workunit.client.1.smithi105.stderr: | ^~~~~~~~~~ 2024-09-12T02:25:11.133 INFO:tasks.workunit.client.1.smithi105.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-12T02:25:11.133 INFO:tasks.workunit.client.1.smithi105.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-09-12T02:25:11.133 INFO:tasks.workunit.client.1.smithi105.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-12T02:25:11.134 INFO:tasks.workunit.client.1.smithi105.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-12T02:25:11.134 INFO:tasks.workunit.client.1.smithi105.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-12T02:25:11.134 INFO:tasks.workunit.client.1.smithi105.stderr: | ^ 2024-09-12T02:25:11.134 INFO:tasks.workunit.client.1.smithi105.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-12T02:25:11.134 INFO:tasks.workunit.client.1.smithi105.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-12T02:25:11.134 INFO:tasks.workunit.client.1.smithi105.stderr: | ^~~~~~~~ 2024-09-12T02:25:11.134 INFO:tasks.workunit.client.1.smithi105.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-12T02:25:11.134 INFO:tasks.workunit.client.1.smithi105.stderr: 36 | container_of(ptr, type, member) 2024-09-12T02:25:11.134 INFO:tasks.workunit.client.1.smithi105.stderr: | ^~~~~~~~~~~~ 2024-09-12T02:25:11.134 INFO:tasks.workunit.client.1.smithi105.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-12T02:25:11.134 INFO:tasks.workunit.client.1.smithi105.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-12T02:25:11.134 INFO:tasks.workunit.client.1.smithi105.stderr: | ^~~~~~~~~~ 2024-09-12T02:25:11.134 INFO:tasks.workunit.client.1.smithi105.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-12T02:25:11.134 INFO:tasks.workunit.client.1.smithi105.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-09-12T02:25:11.135 INFO:tasks.workunit.client.1.smithi105.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-12T02:25:11.135 INFO:tasks.workunit.client.1.smithi105.stderr:parser.c: In function ‘init_tg_stats’: 2024-09-12T02:25:11.135 INFO:tasks.workunit.client.1.smithi105.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-12T02:25:11.135 INFO:tasks.workunit.client.1.smithi105.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-12T02:25:11.135 INFO:tasks.workunit.client.1.smithi105.stderr: | ^ 2024-09-12T02:25:11.135 INFO:tasks.workunit.client.1.smithi105.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-12T02:25:11.135 INFO:tasks.workunit.client.1.smithi105.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-12T02:25:11.135 INFO:tasks.workunit.client.1.smithi105.stderr: | ^~~~~~~~ 2024-09-12T02:25:11.135 INFO:tasks.workunit.client.1.smithi105.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-12T02:25:11.135 INFO:tasks.workunit.client.1.smithi105.stderr: 36 | container_of(ptr, type, member) 2024-09-12T02:25:11.135 INFO:tasks.workunit.client.1.smithi105.stderr: | ^~~~~~~~~~~~ 2024-09-12T02:25:11.135 INFO:tasks.workunit.client.1.smithi105.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-12T02:25:11.135 INFO:tasks.workunit.client.1.smithi105.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-12T02:25:11.136 INFO:tasks.workunit.client.1.smithi105.stderr: | ^~~~~~~~~~ 2024-09-12T02:25:11.136 INFO:tasks.workunit.client.1.smithi105.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-12T02:25:11.136 INFO:tasks.workunit.client.1.smithi105.stderr: 971 | list_for_each_entry(tmp_list, 2024-09-12T02:25:11.136 INFO:tasks.workunit.client.1.smithi105.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-12T02:25:11.136 INFO:tasks.workunit.client.1.smithi105.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-12T02:25:11.136 INFO:tasks.workunit.client.1.smithi105.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-12T02:25:11.136 INFO:tasks.workunit.client.1.smithi105.stderr: | ^ 2024-09-12T02:25:11.136 INFO:tasks.workunit.client.1.smithi105.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-12T02:25:11.136 INFO:tasks.workunit.client.1.smithi105.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-12T02:25:11.136 INFO:tasks.workunit.client.1.smithi105.stderr: | ^~~~~~~~ 2024-09-12T02:25:11.136 INFO:tasks.workunit.client.1.smithi105.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-12T02:25:11.136 INFO:tasks.workunit.client.1.smithi105.stderr: 36 | container_of(ptr, type, member) 2024-09-12T02:25:11.136 INFO:tasks.workunit.client.1.smithi105.stderr: | ^~~~~~~~~~~~ 2024-09-12T02:25:11.136 INFO:tasks.workunit.client.1.smithi105.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-12T02:25:11.137 INFO:tasks.workunit.client.1.smithi105.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-12T02:25:11.137 INFO:tasks.workunit.client.1.smithi105.stderr: | ^~~~~~~~~~ 2024-09-12T02:25:11.137 INFO:tasks.workunit.client.1.smithi105.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-12T02:25:11.137 INFO:tasks.workunit.client.1.smithi105.stderr: 971 | list_for_each_entry(tmp_list, 2024-09-12T02:25:11.137 INFO:tasks.workunit.client.1.smithi105.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-12T02:25:11.137 INFO:tasks.workunit.client.1.smithi105.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-12T02:25:11.137 INFO:tasks.workunit.client.1.smithi105.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-12T02:25:11.137 INFO:tasks.workunit.client.1.smithi105.stderr: | ^ 2024-09-12T02:25:11.137 INFO:tasks.workunit.client.1.smithi105.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-12T02:25:11.137 INFO:tasks.workunit.client.1.smithi105.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-12T02:25:11.137 INFO:tasks.workunit.client.1.smithi105.stderr: | ^~~~~~~~ 2024-09-12T02:25:11.137 INFO:tasks.workunit.client.1.smithi105.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-12T02:25:11.137 INFO:tasks.workunit.client.1.smithi105.stderr: 36 | container_of(ptr, type, member) 2024-09-12T02:25:11.137 INFO:tasks.workunit.client.1.smithi105.stderr: | ^~~~~~~~~~~~ 2024-09-12T02:25:11.138 INFO:tasks.workunit.client.1.smithi105.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-12T02:25:11.138 INFO:tasks.workunit.client.1.smithi105.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-12T02:25:11.138 INFO:tasks.workunit.client.1.smithi105.stderr: | ^~~~~~~~~~ 2024-09-12T02:25:11.138 INFO:tasks.workunit.client.1.smithi105.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-12T02:25:11.138 INFO:tasks.workunit.client.1.smithi105.stderr: 980 | list_for_each_entry(tmp_list, 2024-09-12T02:25:11.138 INFO:tasks.workunit.client.1.smithi105.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-12T02:25:11.138 INFO:tasks.workunit.client.1.smithi105.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-12T02:25:11.138 INFO:tasks.workunit.client.1.smithi105.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-12T02:25:11.138 INFO:tasks.workunit.client.1.smithi105.stderr: | ^ 2024-09-12T02:25:11.138 INFO:tasks.workunit.client.1.smithi105.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-12T02:25:11.138 INFO:tasks.workunit.client.1.smithi105.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-12T02:25:11.138 INFO:tasks.workunit.client.1.smithi105.stderr: | ^~~~~~~~ 2024-09-12T02:25:11.138 INFO:tasks.workunit.client.1.smithi105.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-12T02:25:11.138 INFO:tasks.workunit.client.1.smithi105.stderr: 36 | container_of(ptr, type, member) 2024-09-12T02:25:11.139 INFO:tasks.workunit.client.1.smithi105.stderr: | ^~~~~~~~~~~~ 2024-09-12T02:25:11.139 INFO:tasks.workunit.client.1.smithi105.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-12T02:25:11.139 INFO:tasks.workunit.client.1.smithi105.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-12T02:25:11.139 INFO:tasks.workunit.client.1.smithi105.stderr: | ^~~~~~~~~~ 2024-09-12T02:25:11.139 INFO:tasks.workunit.client.1.smithi105.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-12T02:25:11.139 INFO:tasks.workunit.client.1.smithi105.stderr: 980 | list_for_each_entry(tmp_list, 2024-09-12T02:25:11.139 INFO:tasks.workunit.client.1.smithi105.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-12T02:25:11.175 INFO:tasks.workunit.client.1.smithi105.stderr:parser.c: In function ‘get_optstr’: 2024-09-12T02:25:11.175 INFO:tasks.workunit.client.1.smithi105.stderr:parser.c:206:23: warning: ‘strnlen’ specified bound 4095 exceeds source size 1024 [-Wstringop-overread] 2024-09-12T02:25:11.175 INFO:tasks.workunit.client.1.smithi105.stderr: 206 | len = strnlen(temp, 4095) + 1; 2024-09-12T02:25:11.175 INFO:tasks.workunit.client.1.smithi105.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-12T02:25:11.175 INFO:tasks.workunit.client.1.smithi105.stderr:parser.c:200:14: note: source object declared here 2024-09-12T02:25:11.175 INFO:tasks.workunit.client.1.smithi105.stderr: 200 | char temp[BUFSIZE]; 2024-09-12T02:25:11.175 INFO:tasks.workunit.client.1.smithi105.stderr: | ^~~~ 2024-09-12T02:25:11.181 INFO:tasks.workunit.client.1.smithi105.stderr:parser.c: In function ‘size64_convert’: 2024-09-12T02:25:11.181 INFO:tasks.workunit.client.1.smithi105.stderr:parser.c:119:9: warning: ‘memcpy’ reading 3 bytes from a region of size 2 [-Wstringop-overread] 2024-09-12T02:25:11.181 INFO:tasks.workunit.client.1.smithi105.stderr: 119 | memcpy(unit, "\0", 3); 2024-09-12T02:25:11.181 INFO:tasks.workunit.client.1.smithi105.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-09-12T02:25:11.582 INFO:tasks.workunit.client.0.smithi060.stdout:rm -f stamp-h1 2024-09-12T02:25:11.584 INFO:tasks.workunit.client.0.smithi060.stdout:touch config.h.in 2024-09-12T02:25:11.587 INFO:tasks.workunit.client.0.smithi060.stdout:cd . && /bin/sh ./config.status config.h 2024-09-12T02:25:11.651 INFO:tasks.workunit.client.0.smithi060.stdout:config.status: creating config.h 2024-09-12T02:25:11.692 INFO:tasks.workunit.client.0.smithi060.stdout:make all-am 2024-09-12T02:25:11.718 INFO:tasks.workunit.client.0.smithi060.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-09-12T02:25:11.718 INFO:tasks.workunit.client.0.smithi060.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fileops.o -MD -MP -MF .deps/fileops.Tpo -c -o fileops.o fileops.c 2024-09-12T02:25:11.876 INFO:tasks.workunit.client.1.smithi105.stdout:mv -f .deps/parser.Tpo .deps/parser.Po 2024-09-12T02:25:11.881 INFO:tasks.workunit.client.1.smithi105.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fc.o -MD -MP -MF .deps/ffsb_fc.Tpo -c -o ffsb_fc.o ffsb_fc.c 2024-09-12T02:25:11.929 INFO:tasks.workunit.client.0.smithi060.stdout:mv -f .deps/fileops.Tpo .deps/fileops.Po 2024-09-12T02:25:11.934 INFO:tasks.workunit.client.0.smithi060.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rand.o -MD -MP -MF .deps/rand.Tpo -c -o rand.o rand.c 2024-09-12T02:25:11.956 INFO:tasks.workunit.client.1.smithi105.stdout:mv -f .deps/ffsb_fc.Tpo .deps/ffsb_fc.Po 2024-09-12T02:25:11.960 INFO:tasks.workunit.client.1.smithi105.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_stats.o -MD -MP -MF .deps/ffsb_stats.Tpo -c -o ffsb_stats.o ffsb_stats.c 2024-09-12T02:25:12.045 INFO:tasks.workunit.client.0.smithi060.stdout:mv -f .deps/rand.Tpo .deps/rand.Po 2024-09-12T02:25:12.051 INFO:tasks.workunit.client.0.smithi060.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT main.o -MD -MP -MF .deps/main.Tpo -c -o main.o main.c 2024-09-12T02:25:12.063 INFO:tasks.workunit.client.1.smithi105.stdout:mv -f .deps/ffsb_stats.Tpo .deps/ffsb_stats.Po 2024-09-12T02:25:12.069 INFO:tasks.workunit.client.1.smithi105.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT list.o -MD -MP -MF .deps/list.Tpo -c -o list.o list.c 2024-09-12T02:25:12.108 INFO:tasks.workunit.client.1.smithi105.stdout:mv -f .deps/list.Tpo .deps/list.Po 2024-09-12T02:25:12.114 INFO:tasks.workunit.client.1.smithi105.stdout:gcc -D_GNU_SOURCE -g -O2 -D_REENTRANT -o ffsb fileops.o rand.o main.o fh.o filelist.o metaops.o rwlock.o cirlist.o rbt.o ffsb_tg.o ffsb_fs.o ffsb_thread.o ffsb_op.o util.o parser.o ffsb_fc.o ffsb_stats.o list.o -lpthread -lm 2024-09-12T02:25:12.163 INFO:tasks.workunit.client.0.smithi060.stdout:mv -f .deps/main.Tpo .deps/main.Po 2024-09-12T02:25:12.169 INFO:tasks.workunit.client.0.smithi060.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fh.o -MD -MP -MF .deps/fh.Tpo -c -o fh.o fh.c 2024-09-12T02:25:12.216 INFO:tasks.workunit.client.1.smithi105.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb' 2024-09-12T02:25:12.217 INFO:tasks.workunit.client.1.smithi105.stderr:+ cd .. 2024-09-12T02:25:12.218 INFO:tasks.workunit.client.1.smithi105.stderr:+ mkdir tmp 2024-09-12T02:25:12.220 INFO:tasks.workunit.client.1.smithi105.stderr:+ cd tmp 2024-09-12T02:25:12.221 INFO:tasks.workunit.client.1.smithi105.stderr:+ for f in $mydir/*.ffsb 2024-09-12T02:25:12.221 INFO:tasks.workunit.client.1.smithi105.stderr:+ ../ffsb/ffsb /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/random_write.32.ffsb 2024-09-12T02:25:12.222 INFO:tasks.workunit.client.1.smithi105.stdout:FFSB version 6.0-RC2 started 2024-09-12T02:25:12.222 INFO:tasks.workunit.client.1.smithi105.stdout: 2024-09-12T02:25:12.225 INFO:tasks.workunit.client.1.smithi105.stdout:benchmark time = 300 2024-09-12T02:25:12.225 INFO:tasks.workunit.client.1.smithi105.stdout:ThreadGroup 0 2024-09-12T02:25:12.225 INFO:tasks.workunit.client.1.smithi105.stdout:================ 2024-09-12T02:25:12.225 INFO:tasks.workunit.client.1.smithi105.stdout: num_threads = 32 2024-09-12T02:25:12.225 INFO:tasks.workunit.client.1.smithi105.stdout: 2024-09-12T02:25:12.225 INFO:tasks.workunit.client.1.smithi105.stdout: read_random = off 2024-09-12T02:25:12.226 INFO:tasks.workunit.client.1.smithi105.stdout: read_size = 0 (0B) 2024-09-12T02:25:12.226 INFO:tasks.workunit.client.1.smithi105.stdout: read_blocksize = 0 (0B) 2024-09-12T02:25:12.226 INFO:tasks.workunit.client.1.smithi105.stdout: read_skip = off 2024-09-12T02:25:12.226 INFO:tasks.workunit.client.1.smithi105.stdout: read_skipsize = 0 (0B) 2024-09-12T02:25:12.226 INFO:tasks.workunit.client.1.smithi105.stdout: 2024-09-12T02:25:12.226 INFO:tasks.workunit.client.1.smithi105.stdout: write_random = on 2024-09-12T02:25:12.226 INFO:tasks.workunit.client.1.smithi105.stdout: write_size = 5242880 (5MB) 2024-09-12T02:25:12.226 INFO:tasks.workunit.client.1.smithi105.stdout: fsync_file = 0 2024-09-12T02:25:12.226 INFO:tasks.workunit.client.1.smithi105.stdout: write_blocksize = 4096 (4KB) 2024-09-12T02:25:12.226 INFO:tasks.workunit.client.1.smithi105.stdout: wait time = 0 2024-09-12T02:25:12.226 INFO:tasks.workunit.client.1.smithi105.stdout: 2024-09-12T02:25:12.226 INFO:tasks.workunit.client.1.smithi105.stdout: op weights 2024-09-12T02:25:12.226 INFO:tasks.workunit.client.1.smithi105.stdout: read = 0 (0.00%) 2024-09-12T02:25:12.226 INFO:tasks.workunit.client.1.smithi105.stdout: readall = 0 (0.00%) 2024-09-12T02:25:12.227 INFO:tasks.workunit.client.1.smithi105.stdout: write = 1 (100.00%) 2024-09-12T02:25:12.227 INFO:tasks.workunit.client.1.smithi105.stdout: create = 0 (0.00%) 2024-09-12T02:25:12.227 INFO:tasks.workunit.client.1.smithi105.stdout: append = 0 (0.00%) 2024-09-12T02:25:12.227 INFO:tasks.workunit.client.1.smithi105.stdout: delete = 0 (0.00%) 2024-09-12T02:25:12.227 INFO:tasks.workunit.client.1.smithi105.stdout: metaop = 0 (0.00%) 2024-09-12T02:25:12.227 INFO:tasks.workunit.client.1.smithi105.stdout: createdir = 0 (0.00%) 2024-09-12T02:25:12.227 INFO:tasks.workunit.client.1.smithi105.stdout: stat = 0 (0.00%) 2024-09-12T02:25:12.227 INFO:tasks.workunit.client.1.smithi105.stdout: writeall = 0 (0.00%) 2024-09-12T02:25:12.227 INFO:tasks.workunit.client.1.smithi105.stdout: writeall_fsync = 0 (0.00%) 2024-09-12T02:25:12.227 INFO:tasks.workunit.client.1.smithi105.stdout: open_close = 0 (0.00%) 2024-09-12T02:25:12.227 INFO:tasks.workunit.client.1.smithi105.stdout: write_fsync = 0 (0.00%) 2024-09-12T02:25:12.227 INFO:tasks.workunit.client.1.smithi105.stdout: create_fsync = 0 (0.00%) 2024-09-12T02:25:12.227 INFO:tasks.workunit.client.1.smithi105.stdout: append_fsync = 0 (0.00%) 2024-09-12T02:25:12.227 INFO:tasks.workunit.client.1.smithi105.stdout: 2024-09-12T02:25:12.228 INFO:tasks.workunit.client.1.smithi105.stdout:FileSystem . 2024-09-12T02:25:12.228 INFO:tasks.workunit.client.1.smithi105.stdout:========== 2024-09-12T02:25:12.228 INFO:tasks.workunit.client.1.smithi105.stdout: num_dirs = 0 2024-09-12T02:25:12.228 INFO:tasks.workunit.client.1.smithi105.stdout: starting files = 128 2024-09-12T02:25:12.228 INFO:tasks.workunit.client.1.smithi105.stdout: 2024-09-12T02:25:12.228 INFO:tasks.workunit.client.1.smithi105.stdout: min file size = 104857600 (100MB) 2024-09-12T02:25:12.228 INFO:tasks.workunit.client.1.smithi105.stdout: max file size = 104857600 (100MB) 2024-09-12T02:25:12.228 INFO:tasks.workunit.client.1.smithi105.stdout: directio = off 2024-09-12T02:25:12.228 INFO:tasks.workunit.client.1.smithi105.stdout: alignedio = on 2024-09-12T02:25:12.228 INFO:tasks.workunit.client.1.smithi105.stdout: bufferedio = off 2024-09-12T02:25:12.228 INFO:tasks.workunit.client.1.smithi105.stdout: 2024-09-12T02:25:12.228 INFO:tasks.workunit.client.1.smithi105.stdout: aging is off 2024-09-12T02:25:12.228 INFO:tasks.workunit.client.1.smithi105.stdout: current utilization = 0.00% 2024-09-12T02:25:12.228 INFO:tasks.workunit.client.1.smithi105.stdout: 2024-09-12T02:25:12.229 INFO:tasks.workunit.client.1.smithi105.stdout:checking existing fs: . 2024-09-12T02:25:12.229 INFO:tasks.workunit.client.1.smithi105.stdout:recreating new fileset 2024-09-12T02:25:12.229 INFO:tasks.workunit.client.1.smithi105.stderr:opendir: No such file or directory 2024-09-12T02:25:12.281 INFO:tasks.workunit.client.0.smithi060.stdout:mv -f .deps/fh.Tpo .deps/fh.Po 2024-09-12T02:25:12.285 INFO:tasks.workunit.client.0.smithi060.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT filelist.o -MD -MP -MF .deps/filelist.Tpo -c -o filelist.o filelist.c 2024-09-12T02:25:12.444 INFO:tasks.workunit.client.0.smithi060.stdout:mv -f .deps/filelist.Tpo .deps/filelist.Po 2024-09-12T02:25:12.449 INFO:tasks.workunit.client.0.smithi060.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT metaops.o -MD -MP -MF .deps/metaops.Tpo -c -o metaops.o metaops.c 2024-09-12T02:25:12.521 INFO:tasks.workunit.client.0.smithi060.stdout:mv -f .deps/metaops.Tpo .deps/metaops.Po 2024-09-12T02:25:12.525 INFO:tasks.workunit.client.0.smithi060.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rwlock.o -MD -MP -MF .deps/rwlock.Tpo -c -o rwlock.o rwlock.c 2024-09-12T02:25:12.580 INFO:tasks.workunit.client.0.smithi060.stdout:mv -f .deps/rwlock.Tpo .deps/rwlock.Po 2024-09-12T02:25:12.586 INFO:tasks.workunit.client.0.smithi060.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT cirlist.o -MD -MP -MF .deps/cirlist.Tpo -c -o cirlist.o cirlist.c 2024-09-12T02:25:12.651 INFO:tasks.workunit.client.0.smithi060.stdout:mv -f .deps/cirlist.Tpo .deps/cirlist.Po 2024-09-12T02:25:12.657 INFO:tasks.workunit.client.0.smithi060.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rbt.o -MD -MP -MF .deps/rbt.Tpo -c -o rbt.o rbt.c 2024-09-12T02:25:12.887 INFO:tasks.workunit.client.0.smithi060.stdout:mv -f .deps/rbt.Tpo .deps/rbt.Po 2024-09-12T02:25:12.893 INFO:tasks.workunit.client.0.smithi060.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_tg.o -MD -MP -MF .deps/ffsb_tg.Tpo -c -o ffsb_tg.o ffsb_tg.c 2024-09-12T02:25:13.049 INFO:tasks.workunit.client.0.smithi060.stdout:mv -f .deps/ffsb_tg.Tpo .deps/ffsb_tg.Po 2024-09-12T02:25:13.054 INFO:tasks.workunit.client.0.smithi060.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fs.o -MD -MP -MF .deps/ffsb_fs.Tpo -c -o ffsb_fs.o ffsb_fs.c 2024-09-12T02:25:13.243 INFO:tasks.workunit.client.0.smithi060.stdout:mv -f .deps/ffsb_fs.Tpo .deps/ffsb_fs.Po 2024-09-12T02:25:13.248 INFO:tasks.workunit.client.0.smithi060.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_thread.o -MD -MP -MF .deps/ffsb_thread.Tpo -c -o ffsb_thread.o ffsb_thread.c 2024-09-12T02:25:13.338 INFO:tasks.workunit.client.0.smithi060.stdout:mv -f .deps/ffsb_thread.Tpo .deps/ffsb_thread.Po 2024-09-12T02:25:13.342 INFO:tasks.workunit.client.0.smithi060.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_op.o -MD -MP -MF .deps/ffsb_op.Tpo -c -o ffsb_op.o ffsb_op.c 2024-09-12T02:25:13.438 INFO:tasks.workunit.client.0.smithi060.stdout:mv -f .deps/ffsb_op.Tpo .deps/ffsb_op.Po 2024-09-12T02:25:14.411 INFO:tasks.workunit.client.0.smithi060.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT util.o -MD -MP -MF .deps/util.Tpo -c -o util.o util.c 2024-09-12T02:25:14.553 INFO:tasks.workunit.client.0.smithi060.stdout:mv -f .deps/util.Tpo .deps/util.Po 2024-09-12T02:25:14.558 INFO:tasks.workunit.client.0.smithi060.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT parser.o -MD -MP -MF .deps/parser.Tpo -c -o parser.o parser.c 2024-09-12T02:25:14.604 INFO:tasks.workunit.client.0.smithi060.stderr:In file included from parser.h:22, 2024-09-12T02:25:14.604 INFO:tasks.workunit.client.0.smithi060.stderr: from parser.c:25: 2024-09-12T02:25:14.604 INFO:tasks.workunit.client.0.smithi060.stderr:parser.c: In function ‘init_filesys’: 2024-09-12T02:25:14.606 INFO:tasks.workunit.client.0.smithi060.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-12T02:25:14.606 INFO:tasks.workunit.client.0.smithi060.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-12T02:25:14.606 INFO:tasks.workunit.client.0.smithi060.stderr: | ^ 2024-09-12T02:25:14.606 INFO:tasks.workunit.client.0.smithi060.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-12T02:25:14.606 INFO:tasks.workunit.client.0.smithi060.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-12T02:25:14.606 INFO:tasks.workunit.client.0.smithi060.stderr: | ^~~~~~~~ 2024-09-12T02:25:14.607 INFO:tasks.workunit.client.0.smithi060.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-12T02:25:14.607 INFO:tasks.workunit.client.0.smithi060.stderr: 36 | container_of(ptr, type, member) 2024-09-12T02:25:14.607 INFO:tasks.workunit.client.0.smithi060.stderr: | ^~~~~~~~~~~~ 2024-09-12T02:25:14.607 INFO:tasks.workunit.client.0.smithi060.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-12T02:25:14.607 INFO:tasks.workunit.client.0.smithi060.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-12T02:25:14.607 INFO:tasks.workunit.client.0.smithi060.stderr: | ^~~~~~~~~~ 2024-09-12T02:25:14.607 INFO:tasks.workunit.client.0.smithi060.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-12T02:25:14.607 INFO:tasks.workunit.client.0.smithi060.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-09-12T02:25:14.607 INFO:tasks.workunit.client.0.smithi060.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-12T02:25:14.607 INFO:tasks.workunit.client.0.smithi060.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-12T02:25:14.608 INFO:tasks.workunit.client.0.smithi060.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-12T02:25:14.608 INFO:tasks.workunit.client.0.smithi060.stderr: | ^ 2024-09-12T02:25:14.608 INFO:tasks.workunit.client.0.smithi060.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-12T02:25:14.608 INFO:tasks.workunit.client.0.smithi060.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-12T02:25:14.608 INFO:tasks.workunit.client.0.smithi060.stderr: | ^~~~~~~~ 2024-09-12T02:25:14.608 INFO:tasks.workunit.client.0.smithi060.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-12T02:25:14.608 INFO:tasks.workunit.client.0.smithi060.stderr: 36 | container_of(ptr, type, member) 2024-09-12T02:25:14.608 INFO:tasks.workunit.client.0.smithi060.stderr: | ^~~~~~~~~~~~ 2024-09-12T02:25:14.608 INFO:tasks.workunit.client.0.smithi060.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-12T02:25:14.608 INFO:tasks.workunit.client.0.smithi060.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-12T02:25:14.608 INFO:tasks.workunit.client.0.smithi060.stderr: | ^~~~~~~~~~ 2024-09-12T02:25:14.609 INFO:tasks.workunit.client.0.smithi060.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-12T02:25:14.609 INFO:tasks.workunit.client.0.smithi060.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-09-12T02:25:14.609 INFO:tasks.workunit.client.0.smithi060.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-12T02:25:14.609 INFO:tasks.workunit.client.0.smithi060.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-12T02:25:14.609 INFO:tasks.workunit.client.0.smithi060.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-12T02:25:14.609 INFO:tasks.workunit.client.0.smithi060.stderr: | ^ 2024-09-12T02:25:14.609 INFO:tasks.workunit.client.0.smithi060.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-12T02:25:14.609 INFO:tasks.workunit.client.0.smithi060.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-12T02:25:14.609 INFO:tasks.workunit.client.0.smithi060.stderr: | ^~~~~~~~ 2024-09-12T02:25:14.609 INFO:tasks.workunit.client.0.smithi060.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-12T02:25:14.609 INFO:tasks.workunit.client.0.smithi060.stderr: 36 | container_of(ptr, type, member) 2024-09-12T02:25:14.609 INFO:tasks.workunit.client.0.smithi060.stderr: | ^~~~~~~~~~~~ 2024-09-12T02:25:14.609 INFO:tasks.workunit.client.0.smithi060.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-12T02:25:14.610 INFO:tasks.workunit.client.0.smithi060.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-12T02:25:14.610 INFO:tasks.workunit.client.0.smithi060.stderr: | ^~~~~~~~~~ 2024-09-12T02:25:14.610 INFO:tasks.workunit.client.0.smithi060.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-12T02:25:14.610 INFO:tasks.workunit.client.0.smithi060.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-09-12T02:25:14.610 INFO:tasks.workunit.client.0.smithi060.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-12T02:25:14.610 INFO:tasks.workunit.client.0.smithi060.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-12T02:25:14.610 INFO:tasks.workunit.client.0.smithi060.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-12T02:25:14.610 INFO:tasks.workunit.client.0.smithi060.stderr: | ^ 2024-09-12T02:25:14.610 INFO:tasks.workunit.client.0.smithi060.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-12T02:25:14.610 INFO:tasks.workunit.client.0.smithi060.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-12T02:25:14.610 INFO:tasks.workunit.client.0.smithi060.stderr: | ^~~~~~~~ 2024-09-12T02:25:14.611 INFO:tasks.workunit.client.0.smithi060.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-12T02:25:14.611 INFO:tasks.workunit.client.0.smithi060.stderr: 36 | container_of(ptr, type, member) 2024-09-12T02:25:14.611 INFO:tasks.workunit.client.0.smithi060.stderr: | ^~~~~~~~~~~~ 2024-09-12T02:25:14.611 INFO:tasks.workunit.client.0.smithi060.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-12T02:25:14.611 INFO:tasks.workunit.client.0.smithi060.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-12T02:25:14.611 INFO:tasks.workunit.client.0.smithi060.stderr: | ^~~~~~~~~~ 2024-09-12T02:25:14.611 INFO:tasks.workunit.client.0.smithi060.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-12T02:25:14.611 INFO:tasks.workunit.client.0.smithi060.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-09-12T02:25:14.611 INFO:tasks.workunit.client.0.smithi060.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-12T02:25:14.611 INFO:tasks.workunit.client.0.smithi060.stderr:parser.c: In function ‘init_tg_stats’: 2024-09-12T02:25:14.611 INFO:tasks.workunit.client.0.smithi060.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-12T02:25:14.612 INFO:tasks.workunit.client.0.smithi060.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-12T02:25:14.612 INFO:tasks.workunit.client.0.smithi060.stderr: | ^ 2024-09-12T02:25:14.612 INFO:tasks.workunit.client.0.smithi060.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-12T02:25:14.612 INFO:tasks.workunit.client.0.smithi060.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-12T02:25:14.612 INFO:tasks.workunit.client.0.smithi060.stderr: | ^~~~~~~~ 2024-09-12T02:25:14.612 INFO:tasks.workunit.client.0.smithi060.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-12T02:25:14.612 INFO:tasks.workunit.client.0.smithi060.stderr: 36 | container_of(ptr, type, member) 2024-09-12T02:25:14.612 INFO:tasks.workunit.client.0.smithi060.stderr: | ^~~~~~~~~~~~ 2024-09-12T02:25:14.612 INFO:tasks.workunit.client.0.smithi060.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-12T02:25:14.612 INFO:tasks.workunit.client.0.smithi060.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-12T02:25:14.612 INFO:tasks.workunit.client.0.smithi060.stderr: | ^~~~~~~~~~ 2024-09-12T02:25:14.612 INFO:tasks.workunit.client.0.smithi060.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-12T02:25:14.612 INFO:tasks.workunit.client.0.smithi060.stderr: 971 | list_for_each_entry(tmp_list, 2024-09-12T02:25:14.612 INFO:tasks.workunit.client.0.smithi060.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-12T02:25:14.613 INFO:tasks.workunit.client.0.smithi060.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-12T02:25:14.613 INFO:tasks.workunit.client.0.smithi060.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-12T02:25:14.613 INFO:tasks.workunit.client.0.smithi060.stderr: | ^ 2024-09-12T02:25:14.613 INFO:tasks.workunit.client.0.smithi060.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-12T02:25:14.613 INFO:tasks.workunit.client.0.smithi060.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-12T02:25:14.613 INFO:tasks.workunit.client.0.smithi060.stderr: | ^~~~~~~~ 2024-09-12T02:25:14.613 INFO:tasks.workunit.client.0.smithi060.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-12T02:25:14.613 INFO:tasks.workunit.client.0.smithi060.stderr: 36 | container_of(ptr, type, member) 2024-09-12T02:25:14.613 INFO:tasks.workunit.client.0.smithi060.stderr: | ^~~~~~~~~~~~ 2024-09-12T02:25:14.613 INFO:tasks.workunit.client.0.smithi060.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-12T02:25:14.613 INFO:tasks.workunit.client.0.smithi060.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-12T02:25:14.613 INFO:tasks.workunit.client.0.smithi060.stderr: | ^~~~~~~~~~ 2024-09-12T02:25:14.613 INFO:tasks.workunit.client.0.smithi060.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-12T02:25:14.613 INFO:tasks.workunit.client.0.smithi060.stderr: 971 | list_for_each_entry(tmp_list, 2024-09-12T02:25:14.614 INFO:tasks.workunit.client.0.smithi060.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-12T02:25:14.614 INFO:tasks.workunit.client.0.smithi060.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-12T02:25:14.614 INFO:tasks.workunit.client.0.smithi060.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-12T02:25:14.614 INFO:tasks.workunit.client.0.smithi060.stderr: | ^ 2024-09-12T02:25:14.614 INFO:tasks.workunit.client.0.smithi060.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-12T02:25:14.614 INFO:tasks.workunit.client.0.smithi060.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-12T02:25:14.614 INFO:tasks.workunit.client.0.smithi060.stderr: | ^~~~~~~~ 2024-09-12T02:25:14.614 INFO:tasks.workunit.client.0.smithi060.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-12T02:25:14.614 INFO:tasks.workunit.client.0.smithi060.stderr: 36 | container_of(ptr, type, member) 2024-09-12T02:25:14.614 INFO:tasks.workunit.client.0.smithi060.stderr: | ^~~~~~~~~~~~ 2024-09-12T02:25:14.614 INFO:tasks.workunit.client.0.smithi060.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-12T02:25:14.614 INFO:tasks.workunit.client.0.smithi060.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-12T02:25:14.614 INFO:tasks.workunit.client.0.smithi060.stderr: | ^~~~~~~~~~ 2024-09-12T02:25:14.615 INFO:tasks.workunit.client.0.smithi060.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-12T02:25:14.615 INFO:tasks.workunit.client.0.smithi060.stderr: 980 | list_for_each_entry(tmp_list, 2024-09-12T02:25:14.615 INFO:tasks.workunit.client.0.smithi060.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-12T02:25:14.615 INFO:tasks.workunit.client.0.smithi060.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-12T02:25:14.615 INFO:tasks.workunit.client.0.smithi060.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-12T02:25:14.615 INFO:tasks.workunit.client.0.smithi060.stderr: | ^ 2024-09-12T02:25:14.615 INFO:tasks.workunit.client.0.smithi060.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-12T02:25:14.615 INFO:tasks.workunit.client.0.smithi060.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-12T02:25:14.615 INFO:tasks.workunit.client.0.smithi060.stderr: | ^~~~~~~~ 2024-09-12T02:25:14.615 INFO:tasks.workunit.client.0.smithi060.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-12T02:25:14.615 INFO:tasks.workunit.client.0.smithi060.stderr: 36 | container_of(ptr, type, member) 2024-09-12T02:25:14.615 INFO:tasks.workunit.client.0.smithi060.stderr: | ^~~~~~~~~~~~ 2024-09-12T02:25:14.615 INFO:tasks.workunit.client.0.smithi060.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-12T02:25:14.616 INFO:tasks.workunit.client.0.smithi060.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-12T02:25:14.616 INFO:tasks.workunit.client.0.smithi060.stderr: | ^~~~~~~~~~ 2024-09-12T02:25:14.616 INFO:tasks.workunit.client.0.smithi060.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-12T02:25:14.616 INFO:tasks.workunit.client.0.smithi060.stderr: 980 | list_for_each_entry(tmp_list, 2024-09-12T02:25:14.616 INFO:tasks.workunit.client.0.smithi060.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-12T02:25:14.665 INFO:tasks.workunit.client.0.smithi060.stderr:parser.c: In function ‘get_optstr’: 2024-09-12T02:25:14.665 INFO:tasks.workunit.client.0.smithi060.stderr:parser.c:206:23: warning: ‘strnlen’ specified bound 4095 exceeds source size 1024 [-Wstringop-overread] 2024-09-12T02:25:14.665 INFO:tasks.workunit.client.0.smithi060.stderr: 206 | len = strnlen(temp, 4095) + 1; 2024-09-12T02:25:14.665 INFO:tasks.workunit.client.0.smithi060.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-12T02:25:14.665 INFO:tasks.workunit.client.0.smithi060.stderr:parser.c:200:14: note: source object declared here 2024-09-12T02:25:14.665 INFO:tasks.workunit.client.0.smithi060.stderr: 200 | char temp[BUFSIZE]; 2024-09-12T02:25:14.666 INFO:tasks.workunit.client.0.smithi060.stderr: | ^~~~ 2024-09-12T02:25:14.672 INFO:tasks.workunit.client.0.smithi060.stderr:parser.c: In function ‘size64_convert’: 2024-09-12T02:25:14.673 INFO:tasks.workunit.client.0.smithi060.stderr:parser.c:119:9: warning: ‘memcpy’ reading 3 bytes from a region of size 2 [-Wstringop-overread] 2024-09-12T02:25:14.673 INFO:tasks.workunit.client.0.smithi060.stderr: 119 | memcpy(unit, "\0", 3); 2024-09-12T02:25:14.673 INFO:tasks.workunit.client.0.smithi060.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-09-12T02:25:14.980 INFO:tasks.workunit.client.0.smithi060.stdout:mv -f .deps/parser.Tpo .deps/parser.Po 2024-09-12T02:25:14.985 INFO:tasks.workunit.client.0.smithi060.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fc.o -MD -MP -MF .deps/ffsb_fc.Tpo -c -o ffsb_fc.o ffsb_fc.c 2024-09-12T02:25:15.064 INFO:tasks.workunit.client.0.smithi060.stdout:mv -f .deps/ffsb_fc.Tpo .deps/ffsb_fc.Po 2024-09-12T02:25:15.069 INFO:tasks.workunit.client.0.smithi060.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_stats.o -MD -MP -MF .deps/ffsb_stats.Tpo -c -o ffsb_stats.o ffsb_stats.c 2024-09-12T02:25:15.179 INFO:tasks.workunit.client.0.smithi060.stdout:mv -f .deps/ffsb_stats.Tpo .deps/ffsb_stats.Po 2024-09-12T02:25:15.184 INFO:tasks.workunit.client.0.smithi060.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT list.o -MD -MP -MF .deps/list.Tpo -c -o list.o list.c 2024-09-12T02:25:15.226 INFO:tasks.workunit.client.0.smithi060.stdout:mv -f .deps/list.Tpo .deps/list.Po 2024-09-12T02:25:15.232 INFO:tasks.workunit.client.0.smithi060.stdout:gcc -D_GNU_SOURCE -g -O2 -D_REENTRANT -o ffsb fileops.o rand.o main.o fh.o filelist.o metaops.o rwlock.o cirlist.o rbt.o ffsb_tg.o ffsb_fs.o ffsb_thread.o ffsb_op.o util.o parser.o ffsb_fc.o ffsb_stats.o list.o -lpthread -lm 2024-09-12T02:25:15.338 INFO:tasks.workunit.client.0.smithi060.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-09-12T02:25:15.338 INFO:tasks.workunit.client.0.smithi060.stderr:+ cd .. 2024-09-12T02:25:15.340 INFO:tasks.workunit.client.0.smithi060.stderr:+ mkdir tmp 2024-09-12T02:25:15.342 INFO:tasks.workunit.client.0.smithi060.stderr:+ cd tmp 2024-09-12T02:25:15.343 INFO:tasks.workunit.client.0.smithi060.stderr:+ for f in $mydir/*.ffsb 2024-09-12T02:25:15.343 INFO:tasks.workunit.client.0.smithi060.stderr:+ ../ffsb/ffsb /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/random_write.32.ffsb 2024-09-12T02:25:15.344 INFO:tasks.workunit.client.0.smithi060.stdout:FFSB version 6.0-RC2 started 2024-09-12T02:25:15.344 INFO:tasks.workunit.client.0.smithi060.stdout: 2024-09-12T02:25:15.347 INFO:tasks.workunit.client.0.smithi060.stdout:benchmark time = 300 2024-09-12T02:25:15.347 INFO:tasks.workunit.client.0.smithi060.stdout:ThreadGroup 0 2024-09-12T02:25:15.347 INFO:tasks.workunit.client.0.smithi060.stdout:================ 2024-09-12T02:25:15.347 INFO:tasks.workunit.client.0.smithi060.stdout: num_threads = 32 2024-09-12T02:25:15.347 INFO:tasks.workunit.client.0.smithi060.stdout: 2024-09-12T02:25:15.347 INFO:tasks.workunit.client.0.smithi060.stdout: read_random = off 2024-09-12T02:25:15.347 INFO:tasks.workunit.client.0.smithi060.stdout: read_size = 0 (0B) 2024-09-12T02:25:15.348 INFO:tasks.workunit.client.0.smithi060.stdout: read_blocksize = 0 (0B) 2024-09-12T02:25:15.348 INFO:tasks.workunit.client.0.smithi060.stdout: read_skip = off 2024-09-12T02:25:15.348 INFO:tasks.workunit.client.0.smithi060.stdout: read_skipsize = 0 (0B) 2024-09-12T02:25:15.348 INFO:tasks.workunit.client.0.smithi060.stdout: 2024-09-12T02:25:15.348 INFO:tasks.workunit.client.0.smithi060.stdout: write_random = on 2024-09-12T02:25:15.348 INFO:tasks.workunit.client.0.smithi060.stdout: write_size = 5242880 (5MB) 2024-09-12T02:25:15.348 INFO:tasks.workunit.client.0.smithi060.stdout: fsync_file = 0 2024-09-12T02:25:15.348 INFO:tasks.workunit.client.0.smithi060.stdout: write_blocksize = 4096 (4KB) 2024-09-12T02:25:15.348 INFO:tasks.workunit.client.0.smithi060.stdout: wait time = 0 2024-09-12T02:25:15.348 INFO:tasks.workunit.client.0.smithi060.stdout: 2024-09-12T02:25:15.348 INFO:tasks.workunit.client.0.smithi060.stdout: op weights 2024-09-12T02:25:15.348 INFO:tasks.workunit.client.0.smithi060.stdout: read = 0 (0.00%) 2024-09-12T02:25:15.348 INFO:tasks.workunit.client.0.smithi060.stdout: readall = 0 (0.00%) 2024-09-12T02:25:15.348 INFO:tasks.workunit.client.0.smithi060.stdout: write = 1 (100.00%) 2024-09-12T02:25:15.349 INFO:tasks.workunit.client.0.smithi060.stdout: create = 0 (0.00%) 2024-09-12T02:25:15.349 INFO:tasks.workunit.client.0.smithi060.stdout: append = 0 (0.00%) 2024-09-12T02:25:15.349 INFO:tasks.workunit.client.0.smithi060.stdout: delete = 0 (0.00%) 2024-09-12T02:25:15.349 INFO:tasks.workunit.client.0.smithi060.stdout: metaop = 0 (0.00%) 2024-09-12T02:25:15.349 INFO:tasks.workunit.client.0.smithi060.stdout: createdir = 0 (0.00%) 2024-09-12T02:25:15.349 INFO:tasks.workunit.client.0.smithi060.stdout: stat = 0 (0.00%) 2024-09-12T02:25:15.349 INFO:tasks.workunit.client.0.smithi060.stdout: writeall = 0 (0.00%) 2024-09-12T02:25:15.349 INFO:tasks.workunit.client.0.smithi060.stdout: writeall_fsync = 0 (0.00%) 2024-09-12T02:25:15.349 INFO:tasks.workunit.client.0.smithi060.stdout: open_close = 0 (0.00%) 2024-09-12T02:25:15.349 INFO:tasks.workunit.client.0.smithi060.stdout: write_fsync = 0 (0.00%) 2024-09-12T02:25:15.349 INFO:tasks.workunit.client.0.smithi060.stdout: create_fsync = 0 (0.00%) 2024-09-12T02:25:15.349 INFO:tasks.workunit.client.0.smithi060.stdout: append_fsync = 0 (0.00%) 2024-09-12T02:25:15.349 INFO:tasks.workunit.client.0.smithi060.stdout: 2024-09-12T02:25:15.349 INFO:tasks.workunit.client.0.smithi060.stdout:FileSystem . 2024-09-12T02:25:15.349 INFO:tasks.workunit.client.0.smithi060.stdout:========== 2024-09-12T02:25:15.350 INFO:tasks.workunit.client.0.smithi060.stdout: num_dirs = 0 2024-09-12T02:25:15.350 INFO:tasks.workunit.client.0.smithi060.stdout: starting files = 128 2024-09-12T02:25:15.350 INFO:tasks.workunit.client.0.smithi060.stdout: 2024-09-12T02:25:15.350 INFO:tasks.workunit.client.0.smithi060.stdout: min file size = 104857600 (100MB) 2024-09-12T02:25:15.350 INFO:tasks.workunit.client.0.smithi060.stdout: max file size = 104857600 (100MB) 2024-09-12T02:25:15.350 INFO:tasks.workunit.client.0.smithi060.stdout: directio = off 2024-09-12T02:25:15.350 INFO:tasks.workunit.client.0.smithi060.stdout: alignedio = on 2024-09-12T02:25:15.350 INFO:tasks.workunit.client.0.smithi060.stdout: bufferedio = off 2024-09-12T02:25:15.350 INFO:tasks.workunit.client.0.smithi060.stdout: 2024-09-12T02:25:15.350 INFO:tasks.workunit.client.0.smithi060.stdout: aging is off 2024-09-12T02:25:15.350 INFO:tasks.workunit.client.0.smithi060.stdout: current utilization = 0.00% 2024-09-12T02:25:15.350 INFO:tasks.workunit.client.0.smithi060.stdout: 2024-09-12T02:25:15.350 INFO:tasks.workunit.client.0.smithi060.stdout:checking existing fs: . 2024-09-12T02:25:15.350 INFO:tasks.workunit.client.0.smithi060.stdout:recreating new fileset 2024-09-12T02:25:15.351 INFO:tasks.workunit.client.0.smithi060.stderr:opendir: No such file or directory 2024-09-12T02:25:18.352 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-12T02:25:18.353 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:25:18.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.461+0000 7f47f40e4640 1 Processor -- start 2024-09-12T02:25:18.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.461+0000 7f47f40e4640 1 -- start start 2024-09-12T02:25:18.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.462+0000 7f47f40e4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47ec0708f0 0x7f47ec06ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:18.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.462+0000 7f47f40e4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f47ec0c4c40 0x7f47ec153550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:18.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.462+0000 7f47f40e4640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47ec15a580 con 0x7f47ec0c56e0 2024-09-12T02:25:18.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.462+0000 7f47f40e4640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f47ec159700 con 0x7f47ec0c4c40 2024-09-12T02:25:18.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.462+0000 7f47f40e4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f47ec06e5f0 con 0x7f47ec0708f0 2024-09-12T02:25:18.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.462+0000 7f47f2681640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f47ec0c4c40 0x7f47ec153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:18.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.462+0000 7f47f1e80640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f47ec0c56e0 0x7f47ec159e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45170/0 (socket says 172.21.15.60:45170) 2024-09-12T02:25:18.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.462+0000 7f47f1e80640 1 -- 172.21.15.60:0/3924686658 learned_addr learned my addr 172.21.15.60:0/3924686658 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:25:18.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.462+0000 7f47f167f640 1 --2- 172.21.15.60:0/3924686658 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47ec0708f0 0x7f47ec06ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:18.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.463+0000 7f47f2681640 1 -- 172.21.15.60:0/3924686658 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47ec0708f0 msgr2=0x7f47ec06ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:25:18.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.463+0000 7f47f2681640 1 --2- 172.21.15.60:0/3924686658 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47ec0708f0 0x7f47ec06ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:18.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.463+0000 7f47f2681640 1 -- 172.21.15.60:0/3924686658 >> v1:172.21.15.60:6789/0 conn(0x7f47ec0c56e0 legacy=0x7f47ec159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:18.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.463+0000 7f47f2681640 1 -- 172.21.15.60:0/3924686658 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47ec0702c0 con 0x7f47ec0c4c40 2024-09-12T02:25:18.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.463+0000 7f47f0e7e640 1 -- 172.21.15.60:0/3924686658 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2248448958 0 0) 0x7f47ec15a580 con 0x7f47ec0c56e0 2024-09-12T02:25:18.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.463+0000 7f47f2681640 1 --2- 172.21.15.60:0/3924686658 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47ec0c4c40 0x7f47ec153550 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f47e4009d90 tx=0x7f47e402a540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe4768208af0d381 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:18.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.463+0000 7f47f0e7e640 1 -- 172.21.15.60:0/3924686658 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e4007740 con 0x7f47ec0c4c40 2024-09-12T02:25:18.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.464+0000 7f47f0e7e640 1 -- 172.21.15.60:0/3924686658 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47e40078e0 con 0x7f47ec0c4c40 2024-09-12T02:25:18.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.464+0000 7f47f0e7e640 1 -- 172.21.15.60:0/3924686658 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e4007cb0 con 0x7f47ec0c4c40 2024-09-12T02:25:18.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.464+0000 7f47f40e4640 1 -- 172.21.15.60:0/3924686658 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47ec0c4c40 msgr2=0x7f47ec153550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:18.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.464+0000 7f47f40e4640 1 --2- 172.21.15.60:0/3924686658 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47ec0c4c40 0x7f47ec153550 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f47e4009d90 tx=0x7f47e402a540 comp rx=0 tx=0).stop 2024-09-12T02:25:18.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.464+0000 7f47f40e4640 1 -- 172.21.15.60:0/3924686658 shutdown_connections 2024-09-12T02:25:18.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.464+0000 7f47f40e4640 1 --2- 172.21.15.60:0/3924686658 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47ec0c4c40 0x7f47ec153550 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:18.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.464+0000 7f47f40e4640 1 --2- 172.21.15.60:0/3924686658 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47ec0708f0 0x7f47ec06ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:18.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.464+0000 7f47f40e4640 1 -- 172.21.15.60:0/3924686658 >> 172.21.15.60:0/3924686658 conn(0x7f47ec0c9d80 msgr2=0x7f47ec0ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:25:18.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.464+0000 7f47f40e4640 1 -- 172.21.15.60:0/3924686658 shutdown_connections 2024-09-12T02:25:18.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.464+0000 7f47f40e4640 1 -- 172.21.15.60:0/3924686658 wait complete. 2024-09-12T02:25:18.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.465+0000 7f47f40e4640 1 Processor -- start 2024-09-12T02:25:18.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.466+0000 7f47f40e4640 1 -- start start 2024-09-12T02:25:18.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.466+0000 7f47f40e4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47ec0708f0 0x7f47ec154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:18.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.466+0000 7f47f40e4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47ec0c4c40 0x7f47ec148360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:18.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.466+0000 7f47f40e4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47ec0c56e0 0x7f47ec1488a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:18.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.466+0000 7f47f40e4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f47ec06e2f0 con 0x7f47ec0c4c40 2024-09-12T02:25:18.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.466+0000 7f47f40e4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f47ec159950 con 0x7f47ec0708f0 2024-09-12T02:25:18.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.466+0000 7f47f40e4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f47ec0c5ac0 con 0x7f47ec0c56e0 2024-09-12T02:25:18.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.466+0000 7f47f167f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47ec0c4c40 0x7f47ec148360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:18.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.466+0000 7f47f1e80640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47ec0708f0 0x7f47ec154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:18.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.466+0000 7f47f167f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47ec0c4c40 0x7f47ec148360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59576/0 (socket says 172.21.15.60:59576) 2024-09-12T02:25:18.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.466+0000 7f47f167f640 1 -- 172.21.15.60:0/3528214770 learned_addr learned my addr 172.21.15.60:0/3528214770 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:25:18.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.467+0000 7f47f2681640 1 --2- 172.21.15.60:0/3528214770 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47ec0c56e0 0x7f47ec1488a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:18.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.467+0000 7f47f167f640 1 -- 172.21.15.60:0/3528214770 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47ec0c56e0 msgr2=0x7f47ec1488a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:18.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.467+0000 7f47f167f640 1 --2- 172.21.15.60:0/3528214770 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47ec0c56e0 0x7f47ec1488a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:18.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.467+0000 7f47f167f640 1 -- 172.21.15.60:0/3528214770 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47ec0708f0 msgr2=0x7f47ec154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:18.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.467+0000 7f47f167f640 1 --2- 172.21.15.60:0/3528214770 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47ec0708f0 0x7f47ec154270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:18.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.467+0000 7f47f167f640 1 -- 172.21.15.60:0/3528214770 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47ec1eb420 con 0x7f47ec0c4c40 2024-09-12T02:25:18.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.467+0000 7f47f167f640 1 --2- 172.21.15.60:0/3528214770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47ec0c4c40 0x7f47ec148360 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f47dc00e9b0 tx=0x7f47dc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:18.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.467+0000 7f47e27fc640 1 -- 172.21.15.60:0/3528214770 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47dc017070 con 0x7f47ec0c4c40 2024-09-12T02:25:18.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.467+0000 7f47e27fc640 1 -- 172.21.15.60:0/3528214770 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47dc00c9a0 con 0x7f47ec0c4c40 2024-09-12T02:25:18.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.467+0000 7f47e27fc640 1 -- 172.21.15.60:0/3528214770 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47dc00cd90 con 0x7f47ec0c4c40 2024-09-12T02:25:18.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.467+0000 7f47f40e4640 1 -- 172.21.15.60:0/3528214770 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47ec1eb6e0 con 0x7f47ec0c4c40 2024-09-12T02:25:18.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.467+0000 7f47f40e4640 1 -- 172.21.15.60:0/3528214770 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47ec1ebca0 con 0x7f47ec0c4c40 2024-09-12T02:25:18.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.468+0000 7f47f40e4640 1 -- 172.21.15.60:0/3528214770 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47ec06ebe0 con 0x7f47ec0c4c40 2024-09-12T02:25:18.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.469+0000 7f47e27fc640 1 -- 172.21.15.60:0/3528214770 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f47dc01a070 con 0x7f47ec0c4c40 2024-09-12T02:25:18.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.470+0000 7f47e27fc640 1 --2- 172.21.15.60:0/3528214770 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f47d006be30 0x7f47d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:18.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.470+0000 7f47e27fc640 1 -- 172.21.15.60:0/3528214770 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f47dc08b4c0 con 0x7f47ec0c4c40 2024-09-12T02:25:18.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.470+0000 7f47f1e80640 1 --2- 172.21.15.60:0/3528214770 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f47d006be30 0x7f47d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:18.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.470+0000 7f47f1e80640 1 --2- 172.21.15.60:0/3528214770 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f47d006be30 0x7f47d006e2f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f47e8007fd0 tx=0x7f47e8007de0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:18.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.475+0000 7f47e27fc640 1 -- 172.21.15.60:0/3528214770 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f47dc059510 con 0x7f47ec0c4c40 2024-09-12T02:25:18.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.749+0000 7f47f40e4640 1 -- 172.21.15.60:0/3528214770 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f47ec1547b0 con 0x7f47ec0c4c40 2024-09-12T02:25:18.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.749+0000 7f47e27fc640 1 -- 172.21.15.60:0/3528214770 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f47dc05d810 con 0x7f47ec0c4c40 2024-09-12T02:25:18.750 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":22,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:25:18.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.751+0000 7f47f40e4640 1 -- 172.21.15.60:0/3528214770 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f47d006be30 msgr2=0x7f47d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:18.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.751+0000 7f47f40e4640 1 --2- 172.21.15.60:0/3528214770 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f47d006be30 0x7f47d006e2f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f47e8007fd0 tx=0x7f47e8007de0 comp rx=0 tx=0).stop 2024-09-12T02:25:18.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.751+0000 7f47f40e4640 1 -- 172.21.15.60:0/3528214770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47ec0c4c40 msgr2=0x7f47ec148360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:18.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.751+0000 7f47f40e4640 1 --2- 172.21.15.60:0/3528214770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47ec0c4c40 0x7f47ec148360 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f47dc00e9b0 tx=0x7f47dc00ee70 comp rx=0 tx=0).stop 2024-09-12T02:25:18.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.752+0000 7f47f40e4640 1 -- 172.21.15.60:0/3528214770 shutdown_connections 2024-09-12T02:25:18.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.752+0000 7f47f40e4640 1 --2- 172.21.15.60:0/3528214770 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f47d006be30 0x7f47d006e2f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:18.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.752+0000 7f47f40e4640 1 --2- 172.21.15.60:0/3528214770 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47ec0c56e0 0x7f47ec1488a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:18.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.752+0000 7f47f40e4640 1 --2- 172.21.15.60:0/3528214770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47ec0c4c40 0x7f47ec148360 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:18.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.752+0000 7f47f40e4640 1 --2- 172.21.15.60:0/3528214770 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47ec0708f0 0x7f47ec154270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:18.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.752+0000 7f47f40e4640 1 -- 172.21.15.60:0/3528214770 >> 172.21.15.60:0/3528214770 conn(0x7f47ec0c9d80 msgr2=0x7f47ec157e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:25:18.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.752+0000 7f47f40e4640 1 -- 172.21.15.60:0/3528214770 shutdown_connections 2024-09-12T02:25:18.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.752+0000 7f47f40e4640 1 -- 172.21.15.60:0/3528214770 wait complete. 2024-09-12T02:25:18.764 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-12T02:25:18.764 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-12T02:25:18.764 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-12T02:25:18.764 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-12T02:25:18.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.888+0000 7f1ebf8ed640 1 Processor -- start 2024-09-12T02:25:18.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.889+0000 7f1ebf8ed640 1 -- start start 2024-09-12T02:25:18.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.889+0000 7f1ebf8ed640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1eb80ca390 0x7f1eb8161c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:18.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.890+0000 7f1ebf8ed640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1eb815a7c0 con 0x7f1eb8150480 2024-09-12T02:25:18.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.890+0000 7f1ebf8ed640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1eb8159a00 con 0x7f1eb806c650 2024-09-12T02:25:18.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.890+0000 7f1ebf8ed640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f1eb806c240 con 0x7f1eb80ca390 2024-09-12T02:25:18.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.890+0000 7f1ebde8a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1eb80ca390 0x7f1eb8161c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:18.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.890+0000 7f1ebde8a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1eb80ca390 0x7f1eb8161c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59578/0 (socket says 172.21.15.60:59578) 2024-09-12T02:25:18.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.890+0000 7f1ebd689640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f1eb8150480 0x7f1eb80c7a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45176/0 (socket says 172.21.15.60:45176) 2024-09-12T02:25:18.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.890+0000 7f1ebde8a640 1 -- 172.21.15.60:0/1560547985 learned_addr learned my addr 172.21.15.60:0/1560547985 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:25:18.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.890+0000 7f1ebde8a640 1 -- 172.21.15.60:0/1560547985 >> v1:172.21.15.105:6789/0 conn(0x7f1eb806c650 legacy=0x7f1eb80c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:18.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.890+0000 7f1ebde8a640 1 -- 172.21.15.60:0/1560547985 >> v1:172.21.15.60:6789/0 conn(0x7f1eb8150480 legacy=0x7f1eb80c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:18.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.890+0000 7f1ebde8a640 1 -- 172.21.15.60:0/1560547985 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eb8159ce0 con 0x7f1eb80ca390 2024-09-12T02:25:18.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.890+0000 7f1eaffff640 1 -- 172.21.15.60:0/1560547985 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 737318894 0 0) 0x7f1eb815a7c0 con 0x7f1eb8150480 2024-09-12T02:25:18.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.891+0000 7f1ebde8a640 1 --2- 172.21.15.60:0/1560547985 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1eb80ca390 0x7f1eb8161c00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1eb0009e50 tx=0x7f1eb002a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef659ae131a3afbc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:18.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.891+0000 7f1eaffff640 1 -- 172.21.15.60:0/1560547985 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb0036070 con 0x7f1eb80ca390 2024-09-12T02:25:18.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.891+0000 7f1eaffff640 1 -- 172.21.15.60:0/1560547985 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1eb0031600 con 0x7f1eb80ca390 2024-09-12T02:25:18.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.891+0000 7f1eaffff640 1 -- 172.21.15.60:0/1560547985 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb00319f0 con 0x7f1eb80ca390 2024-09-12T02:25:18.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.892+0000 7f1ebf8ed640 1 -- 172.21.15.60:0/1560547985 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1eb80ca390 msgr2=0x7f1eb8161c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:18.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.892+0000 7f1ebf8ed640 1 --2- 172.21.15.60:0/1560547985 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1eb80ca390 0x7f1eb8161c00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1eb0009e50 tx=0x7f1eb002a7c0 comp rx=0 tx=0).stop 2024-09-12T02:25:18.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.892+0000 7f1ebf8ed640 1 -- 172.21.15.60:0/1560547985 shutdown_connections 2024-09-12T02:25:18.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.892+0000 7f1ebf8ed640 1 --2- 172.21.15.60:0/1560547985 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1eb80ca390 0x7f1eb8161c00 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:18.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.892+0000 7f1ebf8ed640 1 -- 172.21.15.60:0/1560547985 >> 172.21.15.60:0/1560547985 conn(0x7f1eb8068030 msgr2=0x7f1eb8073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:25:18.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.892+0000 7f1ebf8ed640 1 -- 172.21.15.60:0/1560547985 shutdown_connections 2024-09-12T02:25:18.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.892+0000 7f1ebf8ed640 1 -- 172.21.15.60:0/1560547985 wait complete. 2024-09-12T02:25:18.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.893+0000 7f1ebf8ed640 1 Processor -- start 2024-09-12T02:25:18.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.893+0000 7f1ebf8ed640 1 -- start start 2024-09-12T02:25:18.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.894+0000 7f1ebf8ed640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1eb806c650 0x7f1eb80afda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:18.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.894+0000 7f1ebf8ed640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1eb80ca390 0x7f1eb81ed370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:18.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.894+0000 7f1ebf8ed640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1eb8150480 0x7f1eb81ed8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:18.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.894+0000 7f1ebf8ed640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb806d270 con 0x7f1eb8150480 2024-09-12T02:25:18.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.894+0000 7f1ebf8ed640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb815a330 con 0x7f1eb80ca390 2024-09-12T02:25:18.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.894+0000 7f1ebf8ed640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1eb80c81a0 con 0x7f1eb806c650 2024-09-12T02:25:18.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.894+0000 7f1ebde8a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1eb8150480 0x7f1eb81ed8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:18.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.894+0000 7f1ebd689640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1eb806c650 0x7f1eb80afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:18.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.894+0000 7f1ebde8a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1eb8150480 0x7f1eb81ed8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59586/0 (socket says 172.21.15.60:59586) 2024-09-12T02:25:18.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.894+0000 7f1ebde8a640 1 -- 172.21.15.60:0/3115315149 learned_addr learned my addr 172.21.15.60:0/3115315149 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:25:18.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.894+0000 7f1ebce88640 1 --2- 172.21.15.60:0/3115315149 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1eb80ca390 0x7f1eb81ed370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:18.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.895+0000 7f1ebde8a640 1 -- 172.21.15.60:0/3115315149 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1eb806c650 msgr2=0x7f1eb80afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:18.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.895+0000 7f1ebde8a640 1 --2- 172.21.15.60:0/3115315149 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1eb806c650 0x7f1eb80afda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:18.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.895+0000 7f1ebde8a640 1 -- 172.21.15.60:0/3115315149 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1eb80ca390 msgr2=0x7f1eb81ed370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:18.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.895+0000 7f1ebde8a640 1 --2- 172.21.15.60:0/3115315149 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1eb80ca390 0x7f1eb81ed370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:18.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.895+0000 7f1ebde8a640 1 -- 172.21.15.60:0/3115315149 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eb8153770 con 0x7f1eb8150480 2024-09-12T02:25:18.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.895+0000 7f1ebde8a640 1 --2- 172.21.15.60:0/3115315149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1eb8150480 0x7f1eb81ed8b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1eb002adb0 tx=0x7f1eb0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:18.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.895+0000 7f1eadffb640 1 -- 172.21.15.60:0/3115315149 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb0036050 con 0x7f1eb8150480 2024-09-12T02:25:18.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.895+0000 7f1eadffb640 1 -- 172.21.15.60:0/3115315149 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1eb0042070 con 0x7f1eb8150480 2024-09-12T02:25:18.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.895+0000 7f1ebf8ed640 1 -- 172.21.15.60:0/3115315149 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1eb8153a50 con 0x7f1eb8150480 2024-09-12T02:25:18.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.895+0000 7f1eadffb640 1 -- 172.21.15.60:0/3115315149 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb0009510 con 0x7f1eb8150480 2024-09-12T02:25:18.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.895+0000 7f1ebf8ed640 1 -- 172.21.15.60:0/3115315149 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1eb8154e00 con 0x7f1eb8150480 2024-09-12T02:25:18.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.896+0000 7f1ebf8ed640 1 --2- 172.21.15.60:0/3115315149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1eb81eddf0 0x7f1eb81ef390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:18.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.896+0000 7f1ebf8ed640 1 -- 172.21.15.60:0/3115315149 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb806c430 con 0x7f1eb81eddf0 2024-09-12T02:25:18.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.896+0000 7f1ebd689640 1 --2- 172.21.15.60:0/3115315149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1eb81eddf0 0x7f1eb81ef390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:18.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.896+0000 7f1ebd689640 1 -- 172.21.15.60:0/3115315149 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1eb80ca910 con 0x7f1eb81eddf0 2024-09-12T02:25:18.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.897+0000 7f1ebd689640 1 --2- 172.21.15.60:0/3115315149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1eb81eddf0 0x7f1eb81ef390 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4007fd0 tx=0x7f1eb4001880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:18.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.897+0000 7f1eadffb640 1 -- 172.21.15.60:0/3115315149 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb4011580 con 0x7f1eb81eddf0 2024-09-12T02:25:18.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.897+0000 7f1eadffb640 1 -- 172.21.15.60:0/3115315149 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1eb0004470 con 0x7f1eb8150480 2024-09-12T02:25:18.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.897+0000 7f1eadffb640 1 --2- 172.21.15.60:0/3115315149 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1e9c06bd30 0x7f1e9c06e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:18.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.898+0000 7f1ebce88640 1 --2- 172.21.15.60:0/3115315149 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1e9c06bd30 0x7f1e9c06e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:18.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.898+0000 7f1eadffb640 1 -- 172.21.15.60:0/3115315149 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f1eb00abf60 con 0x7f1eb8150480 2024-09-12T02:25:18.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.898+0000 7f1eadffb640 1 -- 172.21.15.60:0/3115315149 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f1eb4011720 con 0x7f1eb81eddf0 2024-09-12T02:25:18.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.898+0000 7f1eadffb640 1 -- 172.21.15.60:0/3115315149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1eb81eddf0 msgr2=0x7f1eb81ef390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:18.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.898+0000 7f1eadffb640 1 --2- 172.21.15.60:0/3115315149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1eb81eddf0 0x7f1eb81ef390 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4007fd0 tx=0x7f1eb4001880 comp rx=0 tx=0).stop 2024-09-12T02:25:18.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.898+0000 7f1eadffb640 1 -- 172.21.15.60:0/3115315149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1eb81eddf0 msgr2=0x7f1eb81ef390 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:25:18.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.898+0000 7f1eadffb640 1 --2- 172.21.15.60:0/3115315149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1eb81eddf0 0x7f1eb81ef390 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:18.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.898+0000 7f1ebce88640 1 --2- 172.21.15.60:0/3115315149 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1e9c06bd30 0x7f1e9c06e1f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1eb814ff30 tx=0x7f1ea8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:18.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.905+0000 7f1ebf8ed640 1 --2- 172.21.15.60:0/3115315149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1eb81515d0 0x7f1eb81ef8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:18.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.905+0000 7f1ebf8ed640 1 -- 172.21.15.60:0/3115315149 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb80c9f70 con 0x7f1eb81515d0 2024-09-12T02:25:18.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.905+0000 7f1ebd689640 1 --2- 172.21.15.60:0/3115315149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1eb81515d0 0x7f1eb81ef8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:18.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.906+0000 7f1ebd689640 1 -- 172.21.15.60:0/3115315149 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1eb80b02e0 con 0x7f1eb81515d0 2024-09-12T02:25:18.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.906+0000 7f1ebd689640 1 --2- 172.21.15.60:0/3115315149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1eb81515d0 0x7f1eb81ef8d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4007fd0 tx=0x7f1eb4000fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:18.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.906+0000 7f1eadffb640 1 -- 172.21.15.60:0/3115315149 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb401e320 con 0x7f1eb81515d0 2024-09-12T02:25:18.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.906+0000 7f1eadffb640 1 -- 172.21.15.60:0/3115315149 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4551 (secure 0 0 0) 0x7f1eb401e320 con 0x7f1eb81515d0 2024-09-12T02:25:18.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.906+0000 7f1eadffb640 1 -- 172.21.15.60:0/3115315149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1eb81515d0 msgr2=0x7f1eb81ef8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:18.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.906+0000 7f1eadffb640 1 --2- 172.21.15.60:0/3115315149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1eb81515d0 0x7f1eb81ef8d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4007fd0 tx=0x7f1eb4000fb0 comp rx=0 tx=0).stop 2024-09-12T02:25:18.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.906+0000 7f1eadffb640 1 -- 172.21.15.60:0/3115315149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1eb81515d0 msgr2=0x7f1eb81ef8d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:25:18.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.906+0000 7f1eadffb640 1 --2- 172.21.15.60:0/3115315149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1eb81515d0 0x7f1eb81ef8d0 secure :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4007fd0 tx=0x7f1eb4000fb0 comp rx=0 tx=0).stop 2024-09-12T02:25:18.908 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:25:18.908 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:25:18.908 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:25:18.908 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:25:18.908 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 22, 2024-09-12T02:25:18.908 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 12004, 2024-09-12T02:25:18.908 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:25:18.908 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:25:18.908 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:25:18.908 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:25:18.908 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:18.908 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 11, 2024-09-12T02:25:18.909 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:25:18.909 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:25:18.909 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:25:18.909 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:25:18.909 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:25:18.909 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:25:18.909 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:25:18.909 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:25:18.909 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:25:18.909 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:25:18.909 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:25:18.909 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:25:18.909 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:25:18.909 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:25:18.910 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:18.910 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:25:18.910 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:25:18.910 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:25:18.910 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:25:18.910 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:25:18.910 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:25:18.910 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:25:18.910 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:25:18.910 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:25:18.910 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:25:18.910 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:25:18.910 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:25:18.911 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:25:18.911 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:18.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:18.911 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:25:18.911 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:25:18.911 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:25:18.911 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:25:18.911 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:25:18.911 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:25:18.911 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:25:18.911 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:25:18.911 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:25:18.911 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:25:18.911 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:25:18.912 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:25:18.912 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:25:18.912 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:25:18.912 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:25:18.912 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:25:18.912 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:25:18.912 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:25:18.912 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:25:18.912 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:25:18.912 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:25:18.912 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:25:18.912 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:25:18.912 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:25:18.912 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:25:18.913 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:25:18.913 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:25:18.913 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:25:18.913 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:18.913 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:25:18.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:18.913 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:25:18.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:18.913 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:25:18.913 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:25:18.913 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:25:18.913 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:25:18.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:18.914 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:25:18.914 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:25:18.914 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:18.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:18.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:18.914 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:25:18.914 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:25:18.914 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:18.914 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:18.914 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:18.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:18.914 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:25:18.914 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:25:18.914 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:25:18.915 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:25:18.915 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:25:18.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:18.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:18.915 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:25:18.915 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:25:18.915 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:25:18.915 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:25:18.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:18.915 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:25:18.915 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:25:18.915 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:18.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:18.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:18.915 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:25:18.916 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:25:18.916 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:18.916 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:18.916 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:18.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:18.916 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:25:18.916 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:25:18.916 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:25:18.916 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:25:18.916 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:25:18.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:18.916 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:18.916 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:25:18.917 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:25:18.917 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:25:18.917 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:25:18.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:18.917 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:25:18.917 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:25:18.917 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:18.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:18.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:18.917 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:25:18.917 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:25:18.917 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:18.917 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:18.918 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:18.918 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:18.918 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:25:18.918 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:25:18.918 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:25:18.918 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:25:18.918 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:25:18.918 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:18.918 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:18.918 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:18.918 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:25:18.918 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:25:18.918 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:18.918 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:25:18.919 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:25:18.919 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:25:18.919 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:18.919 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:18.919 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:25:18.919 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:18.919 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:25:18.919 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:25:18.919 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:25:18.919 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:18.919 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:18.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:18.919 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:25:18.919 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:25:18.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.907+0000 7f1ebf8ed640 1 -- 172.21.15.60:0/3115315149 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1e9c06bd30 msgr2=0x7f1e9c06e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:18.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.907+0000 7f1ebf8ed640 1 --2- 172.21.15.60:0/3115315149 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1e9c06bd30 0x7f1e9c06e1f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1eb814ff30 tx=0x7f1ea8009040 comp rx=0 tx=0).stop 2024-09-12T02:25:18.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.907+0000 7f1ebf8ed640 1 -- 172.21.15.60:0/3115315149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1eb8150480 msgr2=0x7f1eb81ed8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:18.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.907+0000 7f1ebf8ed640 1 --2- 172.21.15.60:0/3115315149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1eb8150480 0x7f1eb81ed8b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1eb002adb0 tx=0x7f1eb0004a40 comp rx=0 tx=0).stop 2024-09-12T02:25:18.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.907+0000 7f1ebde8a640 1 -- 172.21.15.60:0/3115315149 reap_dead start 2024-09-12T02:25:18.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.907+0000 7f1ebde8a640 1 -- 172.21.15.60:0/3115315149 reap_dead start 2024-09-12T02:25:18.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.907+0000 7f1ebf8ed640 1 -- 172.21.15.60:0/3115315149 shutdown_connections 2024-09-12T02:25:18.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.907+0000 7f1ebf8ed640 1 -- 172.21.15.60:0/3115315149 >> 172.21.15.60:0/3115315149 conn(0x7f1eb8068030 msgr2=0x7f1eb80c8790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:25:18.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.907+0000 7f1ebf8ed640 1 -- 172.21.15.60:0/3115315149 shutdown_connections 2024-09-12T02:25:18.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:18.907+0000 7f1ebf8ed640 1 -- 172.21.15.60:0/3115315149 wait complete. 2024-09-12T02:25:18.922 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:25:18.922 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-12T02:25:18.923 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-12T02:25:19.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.031+0000 7f0dbfd81640 1 Processor -- start 2024-09-12T02:25:19.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.031+0000 7f0dbfd81640 1 -- start start 2024-09-12T02:25:19.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.032+0000 7f0dbfd81640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0db806c650 0x7f0db80c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:19.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.032+0000 7f0dbfd81640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0db80ca1c0 0x7f0db8160bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:19.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.032+0000 7f0dbfd81640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0db815a7c0 con 0x7f0db8150480 2024-09-12T02:25:19.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.032+0000 7f0dbfd81640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f0db806c240 con 0x7f0db80ca1c0 2024-09-12T02:25:19.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.032+0000 7f0dbfd81640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f0db815a330 con 0x7f0db806c650 2024-09-12T02:25:19.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.032+0000 7f0dbe31e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0db80ca1c0 0x7f0db8160bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:19.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.032+0000 7f0dbe31e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0db80ca1c0 0x7f0db8160bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59622/0 (socket says 172.21.15.60:59622) 2024-09-12T02:25:19.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.032+0000 7f0dbe31e640 1 -- 172.21.15.60:0/4877344 learned_addr learned my addr 172.21.15.60:0/4877344 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:25:19.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.032+0000 7f0dbd31c640 1 --2- 172.21.15.60:0/4877344 >> v2:172.21.15.105:3300/0 conn(0x7f0db806c650 0x7f0db80c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:19.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.033+0000 7f0dbe31e640 1 -- 172.21.15.60:0/4877344 >> v2:172.21.15.105:3300/0 conn(0x7f0db806c650 msgr2=0x7f0db80c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:25:19.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.033+0000 7f0dbe31e640 1 --2- 172.21.15.60:0/4877344 >> v2:172.21.15.105:3300/0 conn(0x7f0db806c650 0x7f0db80c9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:19.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.033+0000 7f0dbe31e640 1 -- 172.21.15.60:0/4877344 >> v1:172.21.15.105:6789/0 conn(0x7f0db8150480 legacy=0x7f0db80c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:19.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.033+0000 7f0dbe31e640 1 -- 172.21.15.60:0/4877344 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0db8159a00 con 0x7f0db80ca1c0 2024-09-12T02:25:19.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.033+0000 7f0dbe31e640 1 --2- 172.21.15.60:0/4877344 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0db80ca1c0 0x7f0db8160bf0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0db80c6110 tx=0x7f0db002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a66847b1f6d78756 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:19.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.033+0000 7f0dbcb1b640 1 -- 172.21.15.60:0/4877344 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db0036070 con 0x7f0db80ca1c0 2024-09-12T02:25:19.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.034+0000 7f0dbcb1b640 1 -- 172.21.15.60:0/4877344 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0db0031600 con 0x7f0db80ca1c0 2024-09-12T02:25:19.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.034+0000 7f0dbcb1b640 1 -- 172.21.15.60:0/4877344 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db00319d0 con 0x7f0db80ca1c0 2024-09-12T02:25:19.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.034+0000 7f0dbfd81640 1 -- 172.21.15.60:0/4877344 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0db80ca1c0 msgr2=0x7f0db8160bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:19.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.034+0000 7f0dbfd81640 1 --2- 172.21.15.60:0/4877344 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0db80ca1c0 0x7f0db8160bf0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0db80c6110 tx=0x7f0db002a730 comp rx=0 tx=0).stop 2024-09-12T02:25:19.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.034+0000 7f0dbfd81640 1 -- 172.21.15.60:0/4877344 shutdown_connections 2024-09-12T02:25:19.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.034+0000 7f0dbfd81640 1 --2- 172.21.15.60:0/4877344 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0db80ca1c0 0x7f0db8160bf0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:19.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.034+0000 7f0dbfd81640 1 --2- 172.21.15.60:0/4877344 >> v2:172.21.15.105:3300/0 conn(0x7f0db806c650 0x7f0db80c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:19.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.034+0000 7f0dbfd81640 1 -- 172.21.15.60:0/4877344 >> 172.21.15.60:0/4877344 conn(0x7f0db8068030 msgr2=0x7f0db8073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:25:19.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.034+0000 7f0dbfd81640 1 -- 172.21.15.60:0/4877344 shutdown_connections 2024-09-12T02:25:19.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.034+0000 7f0dbfd81640 1 -- 172.21.15.60:0/4877344 wait complete. 2024-09-12T02:25:19.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.036+0000 7f0dbfd81640 1 Processor -- start 2024-09-12T02:25:19.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.036+0000 7f0dbfd81640 1 -- start start 2024-09-12T02:25:19.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.036+0000 7f0dbfd81640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0db806c650 0x7f0db80afed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:19.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.036+0000 7f0dbfd81640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0db80ca1c0 0x7f0db814f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:19.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.036+0000 7f0dbfd81640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0db8150480 0x7f0db814fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:19.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.036+0000 7f0dbfd81640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0db806d270 con 0x7f0db8150480 2024-09-12T02:25:19.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.036+0000 7f0dbfd81640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0db8159fc0 con 0x7f0db806c650 2024-09-12T02:25:19.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.036+0000 7f0dbfd81640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0db80ca5f0 con 0x7f0db80ca1c0 2024-09-12T02:25:19.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.036+0000 7f0dbe31e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0db8150480 0x7f0db814fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:19.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.037+0000 7f0dbdb1d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0db806c650 0x7f0db80afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:19.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.037+0000 7f0dbe31e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0db8150480 0x7f0db814fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59624/0 (socket says 172.21.15.60:59624) 2024-09-12T02:25:19.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.037+0000 7f0dbe31e640 1 -- 172.21.15.60:0/1086844705 learned_addr learned my addr 172.21.15.60:0/1086844705 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:25:19.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.037+0000 7f0dbd31c640 1 --2- 172.21.15.60:0/1086844705 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0db80ca1c0 0x7f0db814f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:19.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.037+0000 7f0dbdb1d640 1 -- 172.21.15.60:0/1086844705 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0db80ca1c0 msgr2=0x7f0db814f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:19.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.037+0000 7f0dbdb1d640 1 --2- 172.21.15.60:0/1086844705 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0db80ca1c0 0x7f0db814f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:19.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.037+0000 7f0dbdb1d640 1 -- 172.21.15.60:0/1086844705 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0db8150480 msgr2=0x7f0db814fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:19.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.037+0000 7f0dbdb1d640 1 --2- 172.21.15.60:0/1086844705 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0db8150480 0x7f0db814fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:19.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.037+0000 7f0dbdb1d640 1 -- 172.21.15.60:0/1086844705 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0db8152ac0 con 0x7f0db806c650 2024-09-12T02:25:19.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.037+0000 7f0dbe31e640 1 --2- 172.21.15.60:0/1086844705 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0db8150480 0x7f0db814fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:25:19.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.037+0000 7f0dbdb1d640 1 --2- 172.21.15.60:0/1086844705 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0db806c650 0x7f0db80afed0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0db400c370 tx=0x7f0db400c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:19.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.037+0000 7f0dae7fc640 1 -- 172.21.15.60:0/1086844705 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db40052d0 con 0x7f0db806c650 2024-09-12T02:25:19.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.037+0000 7f0dae7fc640 1 -- 172.21.15.60:0/1086844705 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0db4005490 con 0x7f0db806c650 2024-09-12T02:25:19.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.037+0000 7f0dbfd81640 1 -- 172.21.15.60:0/1086844705 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0db8152da0 con 0x7f0db806c650 2024-09-12T02:25:19.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.037+0000 7f0dae7fc640 1 -- 172.21.15.60:0/1086844705 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db4007260 con 0x7f0db806c650 2024-09-12T02:25:19.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.037+0000 7f0dbfd81640 1 -- 172.21.15.60:0/1086844705 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0db8153360 con 0x7f0db806c650 2024-09-12T02:25:19.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.038+0000 7f0dbfd81640 1 --2- 172.21.15.60:0/1086844705 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0db8151db0 0x7f0db81ec350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:19.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.038+0000 7f0dbfd81640 1 -- 172.21.15.60:0/1086844705 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0db8156270 con 0x7f0db8151db0 2024-09-12T02:25:19.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.038+0000 7f0dbd31c640 1 --2- 172.21.15.60:0/1086844705 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0db8151db0 0x7f0db81ec350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:19.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.039+0000 7f0dbd31c640 1 -- 172.21.15.60:0/1086844705 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0db806c430 con 0x7f0db8151db0 2024-09-12T02:25:19.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.039+0000 7f0dbd31c640 1 --2- 172.21.15.60:0/1086844705 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0db8151db0 0x7f0db81ec350 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0db81e2940 tx=0x7f0da8011cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:19.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.039+0000 7f0dae7fc640 1 -- 172.21.15.60:0/1086844705 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da8019070 con 0x7f0db8151db0 2024-09-12T02:25:19.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.039+0000 7f0dae7fc640 1 -- 172.21.15.60:0/1086844705 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0db4007400 con 0x7f0db806c650 2024-09-12T02:25:19.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.040+0000 7f0dae7fc640 1 --2- 172.21.15.60:0/1086844705 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0d9c06bd60 0x7f0d9c06e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:19.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.040+0000 7f0dae7fc640 1 -- 172.21.15.60:0/1086844705 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f0db408a580 con 0x7f0db806c650 2024-09-12T02:25:19.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.040+0000 7f0dbe31e640 1 --2- 172.21.15.60:0/1086844705 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0d9c06bd60 0x7f0d9c06e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:19.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.040+0000 7f0dae7fc640 1 -- 172.21.15.60:0/1086844705 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f0da8004240 con 0x7f0db8151db0 2024-09-12T02:25:19.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.040+0000 7f0dae7fc640 1 -- 172.21.15.60:0/1086844705 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0db8151db0 msgr2=0x7f0db81ec350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:19.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.040+0000 7f0dae7fc640 1 --2- 172.21.15.60:0/1086844705 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0db8151db0 0x7f0db81ec350 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0db81e2940 tx=0x7f0da8011cf0 comp rx=0 tx=0).stop 2024-09-12T02:25:19.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.040+0000 7f0dae7fc640 1 -- 172.21.15.60:0/1086844705 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0db8151db0 msgr2=0x7f0db81ec350 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:25:19.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.040+0000 7f0dae7fc640 1 --2- 172.21.15.60:0/1086844705 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0db8151db0 0x7f0db81ec350 secure :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0db81e2940 tx=0x7f0da8011cf0 comp rx=0 tx=0).stop 2024-09-12T02:25:19.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.040+0000 7f0dbe31e640 1 --2- 172.21.15.60:0/1086844705 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0d9c06bd60 0x7f0d9c06e220 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0db0009c90 tx=0x7f0db0009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:19.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.048+0000 7f0dbfd81640 1 --2- 172.21.15.60:0/1086844705 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0db80b0df0 0x7f0db81ec890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:19.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.048+0000 7f0dbfd81640 1 -- 172.21.15.60:0/1086844705 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0db80ab920 con 0x7f0db80b0df0 2024-09-12T02:25:19.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.048+0000 7f0dbd31c640 1 --2- 172.21.15.60:0/1086844705 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0db80b0df0 0x7f0db81ec890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:19.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.048+0000 7f0dbd31c640 1 -- 172.21.15.60:0/1086844705 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0db80734b0 con 0x7f0db80b0df0 2024-09-12T02:25:19.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.049+0000 7f0dbd31c640 1 --2- 172.21.15.60:0/1086844705 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0db80b0df0 0x7f0db81ec890 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0da8018000 tx=0x7f0da80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:19.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.049+0000 7f0dae7fc640 1 -- 172.21.15.60:0/1086844705 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da8003d90 con 0x7f0db80b0df0 2024-09-12T02:25:19.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.049+0000 7f0dae7fc640 1 -- 172.21.15.60:0/1086844705 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5050 (secure 0 0 0) 0x7f0da8003d70 con 0x7f0db80b0df0 2024-09-12T02:25:19.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.049+0000 7f0dae7fc640 1 -- 172.21.15.60:0/1086844705 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0db80b0df0 msgr2=0x7f0db81ec890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:19.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.049+0000 7f0dae7fc640 1 --2- 172.21.15.60:0/1086844705 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0db80b0df0 0x7f0db81ec890 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0da8018000 tx=0x7f0da80046c0 comp rx=0 tx=0).stop 2024-09-12T02:25:19.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.049+0000 7f0dae7fc640 1 -- 172.21.15.60:0/1086844705 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0db80b0df0 msgr2=0x7f0db81ec890 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:25:19.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.049+0000 7f0dae7fc640 1 --2- 172.21.15.60:0/1086844705 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0db80b0df0 0x7f0db81ec890 secure :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0da8018000 tx=0x7f0da80046c0 comp rx=0 tx=0).stop 2024-09-12T02:25:19.050 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:25:19.050 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:25:19.050 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:25:19.050 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:25:19.051 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 22, 2024-09-12T02:25:19.051 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 64483, 2024-09-12T02:25:19.051 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:25:19.051 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:25:19.051 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:25:19.051 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:25:19.051 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:19.051 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 11, 2024-09-12T02:25:19.051 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:25:19.051 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:25:19.051 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:25:19.052 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:25:19.052 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:25:19.052 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:25:19.052 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:25:19.052 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:25:19.052 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:25:19.052 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:25:19.052 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:25:19.052 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:25:19.052 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:25:19.052 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:25:19.052 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:19.052 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:25:19.052 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:25:19.053 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:25:19.053 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:25:19.053 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:25:19.053 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:25:19.053 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:25:19.053 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:25:19.053 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:25:19.053 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:25:19.053 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:25:19.053 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:25:19.053 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:25:19.053 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:19.053 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:19.054 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:25:19.054 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:25:19.054 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:25:19.054 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:25:19.054 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:25:19.054 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:25:19.054 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:25:19.054 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:25:19.054 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:25:19.054 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:25:19.054 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:25:19.054 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:25:19.054 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:25:19.054 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:25:19.055 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:25:19.055 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:25:19.055 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:25:19.055 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:25:19.055 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:25:19.055 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:25:19.055 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:25:19.055 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:25:19.055 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:25:19.055 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:25:19.055 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:25:19.055 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:25:19.055 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:25:19.055 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:25:19.056 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:19.056 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:25:19.056 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:19.056 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:25:19.056 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:19.056 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:25:19.056 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:25:19.056 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:25:19.056 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:25:19.056 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:19.056 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:25:19.056 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:25:19.056 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:19.056 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:19.057 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:19.057 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:25:19.057 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:25:19.057 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:19.057 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:19.057 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:19.057 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:19.057 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:25:19.057 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:25:19.057 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:25:19.057 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:25:19.057 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:25:19.057 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:19.057 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:19.058 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:25:19.058 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:25:19.058 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:25:19.058 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:25:19.058 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:19.058 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:25:19.058 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:25:19.058 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:19.058 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:19.058 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:19.058 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:25:19.058 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:25:19.058 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:19.058 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:19.059 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:19.059 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:19.059 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:25:19.059 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:25:19.059 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:25:19.059 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:25:19.059 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:25:19.059 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:19.059 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:19.059 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:25:19.059 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:25:19.059 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:25:19.059 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:25:19.059 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:19.060 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:25:19.060 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:25:19.060 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:19.060 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:19.060 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:19.060 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:25:19.060 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:25:19.060 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:19.060 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:19.060 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:19.060 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:19.060 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:25:19.060 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:25:19.061 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:25:19.061 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:25:19.061 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:25:19.061 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:19.061 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:19.061 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:19.061 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:25:19.061 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:25:19.061 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:19.061 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:25:19.061 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:25:19.061 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:25:19.061 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:19.061 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:19.062 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:25:19.062 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:19.062 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:25:19.062 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:25:19.062 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:25:19.062 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:19.062 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:19.062 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:25:19.062 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:19.062 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:25:19.062 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:25:19.062 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:25:19.062 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:19.062 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:19.063 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:25:19.063 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:19.063 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:25:19.063 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:25:19.063 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-09-12T02:25:19.063 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:19.063 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:19.063 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:25:19.063 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:19.063 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:25:19.063 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:25:19.063 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:25:19.063 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:19.063 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:19.064 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:19.064 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:25:19.064 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:25:19.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.049+0000 7f0dbfd81640 1 -- 172.21.15.60:0/1086844705 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0d9c06bd60 msgr2=0x7f0d9c06e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:19.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.049+0000 7f0dbfd81640 1 --2- 172.21.15.60:0/1086844705 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0d9c06bd60 0x7f0d9c06e220 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0db0009c90 tx=0x7f0db0009000 comp rx=0 tx=0).stop 2024-09-12T02:25:19.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.049+0000 7f0dbfd81640 1 -- 172.21.15.60:0/1086844705 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0db806c650 msgr2=0x7f0db80afed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:19.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.049+0000 7f0dbfd81640 1 --2- 172.21.15.60:0/1086844705 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0db806c650 0x7f0db80afed0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0db400c370 tx=0x7f0db400c830 comp rx=0 tx=0).stop 2024-09-12T02:25:19.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.049+0000 7f0dbe31e640 1 -- 172.21.15.60:0/1086844705 reap_dead start 2024-09-12T02:25:19.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.049+0000 7f0dbe31e640 1 -- 172.21.15.60:0/1086844705 reap_dead start 2024-09-12T02:25:19.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.049+0000 7f0dbfd81640 1 -- 172.21.15.60:0/1086844705 shutdown_connections 2024-09-12T02:25:19.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.049+0000 7f0dbfd81640 1 -- 172.21.15.60:0/1086844705 >> 172.21.15.60:0/1086844705 conn(0x7f0db8068030 msgr2=0x7f0db80cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:25:19.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.050+0000 7f0dbfd81640 1 -- 172.21.15.60:0/1086844705 shutdown_connections 2024-09-12T02:25:19.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.050+0000 7f0dbfd81640 1 -- 172.21.15.60:0/1086844705 wait complete. 2024-09-12T02:25:19.066 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:25:19.066 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-12T02:25:19.066 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-12T02:25:19.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.185+0000 7efee75fd640 1 Processor -- start 2024-09-12T02:25:19.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.185+0000 7efee75fd640 1 -- start start 2024-09-12T02:25:19.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.186+0000 7efee75fd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efee00c5830 0x7efee00702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:19.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.186+0000 7efee75fd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efee0070800 0x7efee0160c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:19.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.186+0000 7efee75fd640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efee00c4320 con 0x7efee0153d60 2024-09-12T02:25:19.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.186+0000 7efee75fd640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7efee00c4c90 con 0x7efee0070800 2024-09-12T02:25:19.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.186+0000 7efee75fd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efee0156f20 con 0x7efee00c5830 2024-09-12T02:25:19.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.187+0000 7efee5b9a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efee0070800 0x7efee0160c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:19.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.187+0000 7efee5b9a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efee0070800 0x7efee0160c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59632/0 (socket says 172.21.15.60:59632) 2024-09-12T02:25:19.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.187+0000 7efee5b9a640 1 -- 172.21.15.60:0/2763541548 learned_addr learned my addr 172.21.15.60:0/2763541548 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:25:19.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.187+0000 7efee4b98640 1 --2- 172.21.15.60:0/2763541548 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efee00c5830 0x7efee00702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:19.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.187+0000 7efee5b9a640 1 -- 172.21.15.60:0/2763541548 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efee00c5830 msgr2=0x7efee00702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:25:19.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.187+0000 7efee5b9a640 1 --2- 172.21.15.60:0/2763541548 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efee00c5830 0x7efee00702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:19.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.187+0000 7efee5b9a640 1 -- 172.21.15.60:0/2763541548 >> v1:172.21.15.105:6789/0 conn(0x7efee0153d60 legacy=0x7efee00c5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:19.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.187+0000 7efee5b9a640 1 -- 172.21.15.60:0/2763541548 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efee0157200 con 0x7efee0070800 2024-09-12T02:25:19.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.188+0000 7efee5b9a640 1 --2- 172.21.15.60:0/2763541548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efee0070800 0x7efee0160c80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7efed8009e50 tx=0x7efed802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82afb161ae907c47 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:19.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.188+0000 7efed7fff640 1 -- 172.21.15.60:0/2763541548 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed8036070 con 0x7efee0070800 2024-09-12T02:25:19.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.188+0000 7efed7fff640 1 -- 172.21.15.60:0/2763541548 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efed8031600 con 0x7efee0070800 2024-09-12T02:25:19.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.188+0000 7efed7fff640 1 -- 172.21.15.60:0/2763541548 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed80319d0 con 0x7efee0070800 2024-09-12T02:25:19.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.188+0000 7efee75fd640 1 -- 172.21.15.60:0/2763541548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efee0070800 msgr2=0x7efee0160c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:19.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.188+0000 7efee75fd640 1 --2- 172.21.15.60:0/2763541548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efee0070800 0x7efee0160c80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7efed8009e50 tx=0x7efed802a710 comp rx=0 tx=0).stop 2024-09-12T02:25:19.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.189+0000 7efee75fd640 1 -- 172.21.15.60:0/2763541548 shutdown_connections 2024-09-12T02:25:19.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.189+0000 7efee75fd640 1 --2- 172.21.15.60:0/2763541548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efee0070800 0x7efee0160c80 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:19.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.189+0000 7efee75fd640 1 --2- 172.21.15.60:0/2763541548 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efee00c5830 0x7efee00702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:19.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.189+0000 7efee75fd640 1 -- 172.21.15.60:0/2763541548 >> 172.21.15.60:0/2763541548 conn(0x7efee00c6980 msgr2=0x7efee00c6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:25:19.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.189+0000 7efee75fd640 1 -- 172.21.15.60:0/2763541548 shutdown_connections 2024-09-12T02:25:19.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.189+0000 7efee75fd640 1 -- 172.21.15.60:0/2763541548 wait complete. 2024-09-12T02:25:19.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.190+0000 7efee75fd640 1 Processor -- start 2024-09-12T02:25:19.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.190+0000 7efee75fd640 1 -- start start 2024-09-12T02:25:19.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.191+0000 7efee75fd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efee0070800 0x7efee01dfea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:19.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.191+0000 7efee75fd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efee00c5830 0x7efee0159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:19.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.191+0000 7efee75fd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efee0153d60 0x7efee015a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:19.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.191+0000 7efee75fd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7efee0073e20 con 0x7efee0070800 2024-09-12T02:25:19.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.191+0000 7efee75fd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efee0073ca0 con 0x7efee00c5830 2024-09-12T02:25:19.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.191+0000 7efee75fd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efee00c7690 con 0x7efee0153d60 2024-09-12T02:25:19.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.191+0000 7efee5399640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efee0070800 0x7efee01dfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:19.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.191+0000 7efee4b98640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efee00c5830 0x7efee0159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:19.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.191+0000 7efee5399640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efee0070800 0x7efee01dfea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59638/0 (socket says 172.21.15.60:59638) 2024-09-12T02:25:19.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.191+0000 7efee5399640 1 -- 172.21.15.60:0/2619602910 learned_addr learned my addr 172.21.15.60:0/2619602910 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:25:19.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.191+0000 7efee5b9a640 1 --2- 172.21.15.60:0/2619602910 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efee0153d60 0x7efee015a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:19.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.191+0000 7efee5399640 1 -- 172.21.15.60:0/2619602910 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efee0153d60 msgr2=0x7efee015a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:19.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.191+0000 7efee5399640 1 --2- 172.21.15.60:0/2619602910 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efee0153d60 0x7efee015a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:19.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.191+0000 7efee5399640 1 -- 172.21.15.60:0/2619602910 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efee00c5830 msgr2=0x7efee0159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:19.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.191+0000 7efee5399640 1 --2- 172.21.15.60:0/2619602910 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efee00c5830 0x7efee0159fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:19.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.191+0000 7efee5399640 1 -- 172.21.15.60:0/2619602910 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efee015aa60 con 0x7efee0070800 2024-09-12T02:25:19.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.191+0000 7efee4b98640 1 --2- 172.21.15.60:0/2619602910 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efee00c5830 0x7efee0159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:25:19.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.191+0000 7efee5399640 1 --2- 172.21.15.60:0/2619602910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efee0070800 0x7efee01dfea0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7efedc00c3c0 tx=0x7efedc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:19.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.192+0000 7efed5ffb640 1 -- 172.21.15.60:0/2619602910 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efedc0052d0 con 0x7efee0070800 2024-09-12T02:25:19.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.192+0000 7efed5ffb640 1 -- 172.21.15.60:0/2619602910 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efedc005490 con 0x7efee0070800 2024-09-12T02:25:19.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.192+0000 7efee75fd640 1 -- 172.21.15.60:0/2619602910 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efee0155cd0 con 0x7efee0070800 2024-09-12T02:25:19.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.192+0000 7efed5ffb640 1 -- 172.21.15.60:0/2619602910 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efedc007260 con 0x7efee0070800 2024-09-12T02:25:19.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.192+0000 7efee75fd640 1 -- 172.21.15.60:0/2619602910 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efee01f0300 con 0x7efee0070800 2024-09-12T02:25:19.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.193+0000 7efee75fd640 1 --2- 172.21.15.60:0/2619602910 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efee014ce50 0x7efee0154710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:19.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.193+0000 7efee75fd640 1 -- 172.21.15.60:0/2619602910 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efee00c5120 con 0x7efee014ce50 2024-09-12T02:25:19.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.193+0000 7efee4b98640 1 --2- 172.21.15.60:0/2619602910 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efee014ce50 0x7efee0154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:19.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.194+0000 7efee4b98640 1 -- 172.21.15.60:0/2619602910 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efee01f0110 con 0x7efee014ce50 2024-09-12T02:25:19.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.194+0000 7efed5ffb640 1 -- 172.21.15.60:0/2619602910 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efedc007400 con 0x7efee0070800 2024-09-12T02:25:19.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.194+0000 7efee4b98640 1 --2- 172.21.15.60:0/2619602910 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efee014ce50 0x7efee0154710 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efee00742a0 tx=0x7efed000f610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:19.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.194+0000 7efed5ffb640 1 --2- 172.21.15.60:0/2619602910 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7efec406be30 0x7efec406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:19.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.194+0000 7efed5ffb640 1 -- 172.21.15.60:0/2619602910 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7efedc08a5a0 con 0x7efee0070800 2024-09-12T02:25:19.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.194+0000 7efee5b9a640 1 --2- 172.21.15.60:0/2619602910 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7efec406be30 0x7efec406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:19.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.194+0000 7efed5ffb640 1 -- 172.21.15.60:0/2619602910 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed0004030 con 0x7efee014ce50 2024-09-12T02:25:19.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.194+0000 7efed5ffb640 1 -- 172.21.15.60:0/2619602910 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7efed00041d0 con 0x7efee014ce50 2024-09-12T02:25:19.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.194+0000 7efed5ffb640 1 -- 172.21.15.60:0/2619602910 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efee014ce50 msgr2=0x7efee0154710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:19.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.194+0000 7efed5ffb640 1 --2- 172.21.15.60:0/2619602910 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efee014ce50 0x7efee0154710 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efee00742a0 tx=0x7efed000f610 comp rx=0 tx=0).stop 2024-09-12T02:25:19.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.194+0000 7efed5ffb640 1 -- 172.21.15.60:0/2619602910 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efee014ce50 msgr2=0x7efee0154710 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:25:19.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.194+0000 7efed5ffb640 1 --2- 172.21.15.60:0/2619602910 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efee014ce50 0x7efee0154710 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:19.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.195+0000 7efee5b9a640 1 --2- 172.21.15.60:0/2619602910 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7efec406be30 0x7efec406e2f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7efed8033000 tx=0x7efed8009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:19.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.201+0000 7efee75fd640 1 --2- 172.21.15.60:0/2619602910 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efee01576f0 0x7efee0154c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:19.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.201+0000 7efee75fd640 1 -- 172.21.15.60:0/2619602910 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efee00c5c70 con 0x7efee01576f0 2024-09-12T02:25:19.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.202+0000 7efee4b98640 1 --2- 172.21.15.60:0/2619602910 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efee01576f0 0x7efee0154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:19.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.203+0000 7efee4b98640 1 -- 172.21.15.60:0/2619602910 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7efee006ed10 con 0x7efee01576f0 2024-09-12T02:25:19.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.203+0000 7efee4b98640 1 --2- 172.21.15.60:0/2619602910 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efee01576f0 0x7efee0154c50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efee00742a0 tx=0x7efed00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:19.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.203+0000 7efed5ffb640 1 -- 172.21.15.60:0/2619602910 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed0003e20 con 0x7efee01576f0 2024-09-12T02:25:19.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.204+0000 7efed5ffb640 1 -- 172.21.15.60:0/2619602910 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5051 (secure 0 0 0) 0x7efed0003e20 con 0x7efee01576f0 2024-09-12T02:25:19.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.204+0000 7efed5ffb640 1 -- 172.21.15.60:0/2619602910 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efee01576f0 msgr2=0x7efee0154c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:19.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.204+0000 7efed5ffb640 1 --2- 172.21.15.60:0/2619602910 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efee01576f0 0x7efee0154c50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efee00742a0 tx=0x7efed00046c0 comp rx=0 tx=0).stop 2024-09-12T02:25:19.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.204+0000 7efed5ffb640 1 -- 172.21.15.60:0/2619602910 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efee01576f0 msgr2=0x7efee0154c50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:25:19.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.204+0000 7efed5ffb640 1 --2- 172.21.15.60:0/2619602910 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efee01576f0 0x7efee0154c50 secure :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efee00742a0 tx=0x7efed00046c0 comp rx=0 tx=0).stop 2024-09-12T02:25:19.205 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:25:19.205 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:25:19.205 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:25:19.205 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:25:19.205 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 22, 2024-09-12T02:25:19.205 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 164518, 2024-09-12T02:25:19.205 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:25:19.205 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:25:19.205 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:25:19.206 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:25:19.206 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:19.206 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 11, 2024-09-12T02:25:19.206 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:25:19.206 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:25:19.206 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:25:19.206 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:25:19.206 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:25:19.206 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:25:19.206 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:25:19.206 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:25:19.206 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:25:19.206 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:25:19.206 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:25:19.207 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:25:19.207 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:25:19.207 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:25:19.207 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:19.207 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:25:19.207 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:25:19.207 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:25:19.207 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:25:19.207 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:25:19.207 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:25:19.207 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:25:19.207 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:25:19.207 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:25:19.207 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:25:19.208 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:25:19.208 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:25:19.208 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:25:19.208 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:19.208 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:19.208 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:25:19.208 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:25:19.208 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:25:19.208 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:25:19.208 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:25:19.208 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:25:19.208 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:25:19.208 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:25:19.209 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:25:19.209 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:25:19.209 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:25:19.209 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:25:19.209 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:25:19.209 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:25:19.209 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:25:19.209 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:25:19.209 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:25:19.209 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:25:19.209 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:25:19.209 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:25:19.210 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:25:19.210 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:25:19.210 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:25:19.210 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:25:19.210 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:25:19.210 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:25:19.210 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:25:19.210 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:25:19.210 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:19.210 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:25:19.210 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:19.210 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:25:19.210 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:19.210 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:25:19.211 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:25:19.211 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:25:19.211 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:25:19.211 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:19.211 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:25:19.211 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:25:19.211 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:19.211 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:19.211 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:19.211 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:25:19.211 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:25:19.211 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:19.211 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:19.211 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:19.212 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:19.212 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:25:19.212 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:25:19.212 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:25:19.212 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:25:19.212 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:25:19.212 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:19.212 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:19.212 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:25:19.212 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:25:19.212 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:25:19.212 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:25:19.212 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:19.213 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:25:19.213 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:25:19.213 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:19.213 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:19.213 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:19.213 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:25:19.213 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:25:19.213 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:19.213 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:19.213 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:19.213 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:19.213 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:25:19.213 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:25:19.213 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:25:19.214 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:25:19.214 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:25:19.214 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:19.214 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:19.214 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:25:19.214 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:25:19.214 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:25:19.214 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:25:19.214 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:19.214 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:25:19.214 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:25:19.214 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:19.214 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:19.215 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:19.215 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:25:19.215 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:25:19.215 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:19.215 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:19.215 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:19.215 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:19.215 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:25:19.215 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:25:19.215 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:25:19.215 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:25:19.215 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:25:19.215 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:19.215 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:19.216 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:19.216 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:25:19.216 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:25:19.216 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:19.216 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:25:19.216 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:25:19.216 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:25:19.216 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:19.216 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:19.216 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:25:19.216 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:19.216 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:25:19.216 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:25:19.217 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:25:19.217 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:19.217 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:19.217 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:25:19.217 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:19.217 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:25:19.217 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:25:19.217 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:25:19.217 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:19.217 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:19.217 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:25:19.217 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:19.217 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:25:19.217 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:25:19.218 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:25:19.218 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:19.218 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:19.218 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:25:19.218 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:19.218 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:25:19.218 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:25:19.218 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:25:19.218 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:19.218 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:19.218 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:19.218 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:25:19.218 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:25:19.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.204+0000 7efee75fd640 1 -- 172.21.15.60:0/2619602910 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7efec406be30 msgr2=0x7efec406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:19.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.204+0000 7efee75fd640 1 --2- 172.21.15.60:0/2619602910 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7efec406be30 0x7efec406e2f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7efed8033000 tx=0x7efed8009000 comp rx=0 tx=0).stop 2024-09-12T02:25:19.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.204+0000 7efee75fd640 1 -- 172.21.15.60:0/2619602910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efee0070800 msgr2=0x7efee01dfea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:19.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.204+0000 7efee75fd640 1 --2- 172.21.15.60:0/2619602910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efee0070800 0x7efee01dfea0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7efedc00c3c0 tx=0x7efedc00c880 comp rx=0 tx=0).stop 2024-09-12T02:25:19.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.204+0000 7efee5b9a640 1 -- 172.21.15.60:0/2619602910 reap_dead start 2024-09-12T02:25:19.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.204+0000 7efee75fd640 1 -- 172.21.15.60:0/2619602910 shutdown_connections 2024-09-12T02:25:19.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.204+0000 7efee75fd640 1 --2- 172.21.15.60:0/2619602910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efee0070800 0x7efee01dfea0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:19.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.204+0000 7efee75fd640 1 -- 172.21.15.60:0/2619602910 >> 172.21.15.60:0/2619602910 conn(0x7efee00c6980 msgr2=0x7efee0151580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:25:19.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.204+0000 7efee75fd640 1 -- 172.21.15.60:0/2619602910 shutdown_connections 2024-09-12T02:25:19.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:19.204+0000 7efee75fd640 1 -- 172.21.15.60:0/2619602910 wait complete. 2024-09-12T02:25:19.221 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:25:19.221 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-09-12T02:25:19.221 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['b'] 2024-09-12T02:25:19.221 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-09-12T02:25:19.221 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-12T02:25:19.221 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T02:25:19.221 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:25:19.232 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T02:25:19.232 INFO:tasks.mon_thrash:Sending STOP to mon b 2024-09-12T02:25:19.232 INFO:tasks.ceph.mon.b:Sent signal 19 2024-09-12T02:25:19.233 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-09-12T02:25:26.724 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:25:26.727 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:25:34.233 INFO:tasks.mon_thrash:Sending CONT to mon b 2024-09-12T02:25:34.234 INFO:tasks.ceph.mon.b:Sent signal 18 2024-09-12T02:25:34.234 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-12T02:25:34.234 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:25:34.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:34.348+0000 7f15c6edd640 1 Processor -- start 2024-09-12T02:25:34.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:34.349+0000 7f15c6edd640 1 -- start start 2024-09-12T02:25:34.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:34.349+0000 7f15c6edd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f15c006cd80 0x7f15c0153be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:34.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:34.349+0000 7f15c6edd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f15c015a4a0 0x7f15c0156660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:34.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:34.349+0000 7f15c6edd640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15c00c7070 con 0x7f15c00c8b10 2024-09-12T02:25:34.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:34.349+0000 7f15c6edd640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f15c006d210 con 0x7f15c015a4a0 2024-09-12T02:25:34.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:34.349+0000 7f15c6edd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f15c00c69b0 con 0x7f15c006cd80 2024-09-12T02:25:34.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:34.349+0000 7f15c4c79640 1 -- >> v1:172.21.15.60:6789/0 conn(0x7f15c00c8b10 legacy=0x7f15c01534d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:25:34.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:34.349+0000 7f15c547a640 1 -- >> v2:172.21.15.60:3300/0 conn(0x7f15c015a4a0 msgr2=0x7f15c0156660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:25:34.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:34.349+0000 7f15c547a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f15c015a4a0 0x7f15c0156660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:25:34.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:34.350+0000 7f15bffff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f15c006cd80 0x7f15c0153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:34.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:34.350+0000 7f15bffff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f15c006cd80 0x7f15c0153be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:52192/0 (socket says 172.21.15.60:52192) 2024-09-12T02:25:34.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:34.350+0000 7f15bffff640 1 -- 172.21.15.60:0/1718812830 learned_addr learned my addr 172.21.15.60:0/1718812830 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:25:34.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:34.350+0000 7f15bffff640 1 -- 172.21.15.60:0/1718812830 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f15c006cd80 msgr2=0x7f15c0153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:25:34.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:34.350+0000 7f15bffff640 1 -- 172.21.15.60:0/1718812830 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f15c006cd80 msgr2=0x7f15c0153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:25:34.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:34.350+0000 7f15bffff640 1 --2- 172.21.15.60:0/1718812830 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f15c006cd80 0x7f15c0153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:25:34.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:34.350+0000 7f15bffff640 1 --2- 172.21.15.60:0/1718812830 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f15c006cd80 0x7f15c0153be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:25:34.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:34.550+0000 7f15c547a640 1 -- 172.21.15.60:0/1718812830 >> v2:172.21.15.60:3300/0 conn(0x7f15c015a4a0 msgr2=0x7f15c0156660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:25:34.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:34.550+0000 7f15c4c79640 1 -- 172.21.15.60:0/1718812830 >> v1:172.21.15.60:6789/0 conn(0x7f15c00c8b10 legacy=0x7f15c01534d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:25:34.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:34.550+0000 7f15c547a640 1 --2- 172.21.15.60:0/1718812830 >> v2:172.21.15.60:3300/0 conn(0x7f15c015a4a0 0x7f15c0156660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:25:34.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:34.551+0000 7f15bffff640 1 --2- 172.21.15.60:0/1718812830 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f15c006cd80 0x7f15c0153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:34.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:34.551+0000 7f15bffff640 1 -- 172.21.15.60:0/1718812830 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f15c006cd80 msgr2=0x7f15c0153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:25:34.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:34.551+0000 7f15bffff640 1 -- 172.21.15.60:0/1718812830 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f15c006cd80 msgr2=0x7f15c0153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:25:34.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:34.551+0000 7f15bffff640 1 --2- 172.21.15.60:0/1718812830 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f15c006cd80 0x7f15c0153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:25:34.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:34.551+0000 7f15bffff640 1 --2- 172.21.15.60:0/1718812830 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f15c006cd80 0x7f15c0153be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:25:34.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:34.951+0000 7f15c547a640 1 -- 172.21.15.60:0/1718812830 >> v2:172.21.15.60:3300/0 conn(0x7f15c015a4a0 msgr2=0x7f15c0156660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:25:34.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:34.951+0000 7f15c4c79640 1 -- 172.21.15.60:0/1718812830 >> v1:172.21.15.60:6789/0 conn(0x7f15c00c8b10 legacy=0x7f15c01534d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:25:34.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:34.951+0000 7f15c547a640 1 --2- 172.21.15.60:0/1718812830 >> v2:172.21.15.60:3300/0 conn(0x7f15c015a4a0 0x7f15c0156660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:25:34.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:34.952+0000 7f15bffff640 1 --2- 172.21.15.60:0/1718812830 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f15c006cd80 0x7f15c0153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:34.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:34.952+0000 7f15bffff640 1 -- 172.21.15.60:0/1718812830 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f15c006cd80 msgr2=0x7f15c0153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:25:34.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:34.952+0000 7f15bffff640 1 -- 172.21.15.60:0/1718812830 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f15c006cd80 msgr2=0x7f15c0153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:25:34.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:34.952+0000 7f15bffff640 1 --2- 172.21.15.60:0/1718812830 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f15c006cd80 0x7f15c0153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:25:34.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:34.952+0000 7f15bffff640 1 --2- 172.21.15.60:0/1718812830 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f15c006cd80 0x7f15c0153be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:25:35.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:35.752+0000 7f15c547a640 1 -- 172.21.15.60:0/1718812830 >> v2:172.21.15.60:3300/0 conn(0x7f15c015a4a0 msgr2=0x7f15c0156660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:25:35.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:35.752+0000 7f15c4c79640 1 -- 172.21.15.60:0/1718812830 >> v1:172.21.15.60:6789/0 conn(0x7f15c00c8b10 legacy=0x7f15c01534d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:25:35.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:35.752+0000 7f15c547a640 1 --2- 172.21.15.60:0/1718812830 >> v2:172.21.15.60:3300/0 conn(0x7f15c015a4a0 0x7f15c0156660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:25:35.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:35.753+0000 7f15bffff640 1 --2- 172.21.15.60:0/1718812830 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f15c006cd80 0x7f15c0153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:35.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:35.754+0000 7f15bffff640 1 -- 172.21.15.60:0/1718812830 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f15c006cd80 msgr2=0x7f15c0153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:25:35.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:35.754+0000 7f15bffff640 1 -- 172.21.15.60:0/1718812830 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f15c006cd80 msgr2=0x7f15c0153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:25:35.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:35.754+0000 7f15bffff640 1 --2- 172.21.15.60:0/1718812830 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f15c006cd80 0x7f15c0153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:25:35.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:35.754+0000 7f15bffff640 1 --2- 172.21.15.60:0/1718812830 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f15c006cd80 0x7f15c0153be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:25:37.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:37.349+0000 7f15be7fc640 1 -- 172.21.15.60:0/1718812830 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f15c006cd80 msgr2=0x7f15c0153be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:25:37.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:37.349+0000 7f15be7fc640 1 --2- 172.21.15.60:0/1718812830 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f15c006cd80 0x7f15c0153be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:37.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:37.349+0000 7f15be7fc640 1 -- 172.21.15.60:0/1718812830 >> v2:172.21.15.60:3300/0 conn(0x7f15c015a4a0 msgr2=0x7f15c0156660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:25:37.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:37.349+0000 7f15be7fc640 1 --2- 172.21.15.60:0/1718812830 >> v2:172.21.15.60:3300/0 conn(0x7f15c015a4a0 0x7f15c0156660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:37.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:37.349+0000 7f15be7fc640 1 -- 172.21.15.60:0/1718812830 >> v1:172.21.15.60:6789/0 conn(0x7f15c00c8b10 legacy=0x7f15c01534d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:25:37.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:37.350+0000 7f15be7fc640 1 --2- 172.21.15.60:0/1718812830 >> v2:172.21.15.105:3300/0 conn(0x7f15a0007350 0x7f15a0009810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:37.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:37.350+0000 7f15be7fc640 1 -- 172.21.15.60:0/1718812830 --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15c00c6c90 con 0x7f15a00036c0 2024-09-12T02:25:37.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:37.350+0000 7f15be7fc640 1 -- 172.21.15.60:0/1718812830 --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f15c006d210 con 0x7f15a0007350 2024-09-12T02:25:37.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:37.350+0000 7f15bffff640 1 --2- 172.21.15.60:0/1718812830 >> v2:172.21.15.105:3300/0 conn(0x7f15a0007350 0x7f15a0009810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:37.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:37.350+0000 7f15bffff640 1 -- 172.21.15.60:0/1718812830 >> v2:172.21.15.105:3300/0 conn(0x7f15a0007350 msgr2=0x7f15a0009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:25:37.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:37.350+0000 7f15bffff640 1 -- 172.21.15.60:0/1718812830 >> v2:172.21.15.105:3300/0 conn(0x7f15a0007350 msgr2=0x7f15a0009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:25:37.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:37.350+0000 7f15bffff640 1 --2- 172.21.15.60:0/1718812830 >> v2:172.21.15.105:3300/0 conn(0x7f15a0007350 0x7f15a0009810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:25:37.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:37.350+0000 7f15bffff640 1 --2- 172.21.15.60:0/1718812830 >> v2:172.21.15.105:3300/0 conn(0x7f15a0007350 0x7f15a0009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:25:37.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:37.551+0000 7f15bffff640 1 --2- 172.21.15.60:0/1718812830 >> v2:172.21.15.105:3300/0 conn(0x7f15a0007350 0x7f15a0009810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:37.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:37.551+0000 7f15bffff640 1 -- 172.21.15.60:0/1718812830 >> v2:172.21.15.105:3300/0 conn(0x7f15a0007350 msgr2=0x7f15a0009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:25:37.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:37.551+0000 7f15bffff640 1 -- 172.21.15.60:0/1718812830 >> v2:172.21.15.105:3300/0 conn(0x7f15a0007350 msgr2=0x7f15a0009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:25:37.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:37.551+0000 7f15bffff640 1 --2- 172.21.15.60:0/1718812830 >> v2:172.21.15.105:3300/0 conn(0x7f15a0007350 0x7f15a0009810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:25:37.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:37.551+0000 7f15bffff640 1 --2- 172.21.15.60:0/1718812830 >> v2:172.21.15.105:3300/0 conn(0x7f15a0007350 0x7f15a0009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:25:37.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:37.952+0000 7f15bffff640 1 --2- 172.21.15.60:0/1718812830 >> v2:172.21.15.105:3300/0 conn(0x7f15a0007350 0x7f15a0009810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:37.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:37.952+0000 7f15bffff640 1 -- 172.21.15.60:0/1718812830 >> v2:172.21.15.105:3300/0 conn(0x7f15a0007350 msgr2=0x7f15a0009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:25:37.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:37.952+0000 7f15bffff640 1 -- 172.21.15.60:0/1718812830 >> v2:172.21.15.105:3300/0 conn(0x7f15a0007350 msgr2=0x7f15a0009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:25:37.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:37.952+0000 7f15bffff640 1 --2- 172.21.15.60:0/1718812830 >> v2:172.21.15.105:3300/0 conn(0x7f15a0007350 0x7f15a0009810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:25:37.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:37.952+0000 7f15bffff640 1 --2- 172.21.15.60:0/1718812830 >> v2:172.21.15.105:3300/0 conn(0x7f15a0007350 0x7f15a0009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:25:38.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:38.754+0000 7f15bffff640 1 --2- 172.21.15.60:0/1718812830 >> v2:172.21.15.105:3300/0 conn(0x7f15a0007350 0x7f15a0009810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:38.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:38.754+0000 7f15bffff640 1 -- 172.21.15.60:0/1718812830 >> v2:172.21.15.105:3300/0 conn(0x7f15a0007350 msgr2=0x7f15a0009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:25:38.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:38.754+0000 7f15bffff640 1 -- 172.21.15.60:0/1718812830 >> v2:172.21.15.105:3300/0 conn(0x7f15a0007350 msgr2=0x7f15a0009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:25:38.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:38.754+0000 7f15bffff640 1 --2- 172.21.15.60:0/1718812830 >> v2:172.21.15.105:3300/0 conn(0x7f15a0007350 0x7f15a0009810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:25:38.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:38.754+0000 7f15bffff640 1 --2- 172.21.15.60:0/1718812830 >> v2:172.21.15.105:3300/0 conn(0x7f15a0007350 0x7f15a0009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:25:39.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.244+0000 7f15bf7fe640 1 -- 172.21.15.60:0/1718812830 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3446063655 0 0) 0x7f15c00c6c90 con 0x7f15a00036c0 2024-09-12T02:25:39.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.244+0000 7f15bf7fe640 1 -- 172.21.15.60:0/1718812830 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15ac003520 con 0x7f15a00036c0 2024-09-12T02:25:39.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.247+0000 7f15bf7fe640 1 -- 172.21.15.60:0/1718812830 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 548606574 0 0) 0x7f15ac003520 con 0x7f15a00036c0 2024-09-12T02:25:39.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.247+0000 7f15bf7fe640 1 -- 172.21.15.60:0/1718812830 >> v2:172.21.15.105:3300/0 conn(0x7f15a0007350 msgr2=0x7f15a0009810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:25:39.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.247+0000 7f15bf7fe640 1 --2- 172.21.15.60:0/1718812830 >> v2:172.21.15.105:3300/0 conn(0x7f15a0007350 0x7f15a0009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:39.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.247+0000 7f15bf7fe640 1 -- 172.21.15.60:0/1718812830 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15c00c7070 con 0x7f15a00036c0 2024-09-12T02:25:39.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.247+0000 7f15bf7fe640 1 -- 172.21.15.60:0/1718812830 <== mon.1 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7f15b8004010 con 0x7f15a00036c0 2024-09-12T02:25:39.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.247+0000 7f15bf7fe640 1 -- 172.21.15.60:0/1718812830 >> v1:172.21.15.105:6789/0 conn(0x7f15a00036c0 legacy=0x7f15a0005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:39.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.247+0000 7f15c547a640 1 -- 172.21.15.60:0/1718812830 reap_dead start 2024-09-12T02:25:39.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.247+0000 7f15bf7fe640 1 --2- 172.21.15.60:0/1718812830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15ac0039b0 0x7f15ac003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:39.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.247+0000 7f15bf7fe640 1 --2- 172.21.15.60:0/1718812830 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f15ac004800 0x7f15ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:39.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.247+0000 7f15bf7fe640 1 --2- 172.21.15.60:0/1718812830 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f15ac0052e0 0x7f15ac00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:39.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.247+0000 7f15bf7fe640 1 -- 172.21.15.60:0/1718812830 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f15c006d210 con 0x7f15ac0039b0 2024-09-12T02:25:39.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.247+0000 7f15bf7fe640 1 -- 172.21.15.60:0/1718812830 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f15ac00bfb0 con 0x7f15ac004800 2024-09-12T02:25:39.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.247+0000 7f15bf7fe640 1 -- 172.21.15.60:0/1718812830 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f15ac00c1b0 con 0x7f15ac0052e0 2024-09-12T02:25:39.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.247+0000 7f15c4c79640 1 -- 172.21.15.60:0/1718812830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15ac0039b0 msgr2=0x7f15ac003db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:25:39.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.247+0000 7f15c4c79640 1 --2- 172.21.15.60:0/1718812830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15ac0039b0 0x7f15ac003db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:25:39.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.247+0000 7f15bffff640 1 --2- 172.21.15.60:0/1718812830 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f15ac004800 0x7f15ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:39.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.247+0000 7f15c547a640 1 --2- 172.21.15.60:0/1718812830 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f15ac0052e0 0x7f15ac00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:39.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.248+0000 7f15bffff640 1 -- 172.21.15.60:0/1718812830 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f15ac0052e0 msgr2=0x7f15ac00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:25:39.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.248+0000 7f15bffff640 1 --2- 172.21.15.60:0/1718812830 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f15ac0052e0 0x7f15ac00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:39.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.248+0000 7f15bffff640 1 -- 172.21.15.60:0/1718812830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15ac0039b0 msgr2=0x7f15ac003db0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:25:39.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.248+0000 7f15bffff640 1 --2- 172.21.15.60:0/1718812830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15ac0039b0 0x7f15ac003db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:39.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.248+0000 7f15bffff640 1 -- 172.21.15.60:0/1718812830 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15ac003520 con 0x7f15ac004800 2024-09-12T02:25:39.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.248+0000 7f15c547a640 1 --2- 172.21.15.60:0/1718812830 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f15ac0052e0 0x7f15ac00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:25:39.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.248+0000 7f15bffff640 1 --2- 172.21.15.60:0/1718812830 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f15ac004800 0x7f15ac004c80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f15c006ec00 tx=0x7f15ac005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=677ef9c5e48637a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:39.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.250+0000 7f15bf7fe640 1 -- 172.21.15.60:0/1718812830 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a800f040 con 0x7f15ac004800 2024-09-12T02:25:39.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.250+0000 7f15bf7fe640 1 -- 172.21.15.60:0/1718812830 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15a8019230 con 0x7f15ac004800 2024-09-12T02:25:39.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.250+0000 7f15bf7fe640 1 -- 172.21.15.60:0/1718812830 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a802c7e0 con 0x7f15ac004800 2024-09-12T02:25:39.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.251+0000 7f15c6edd640 1 -- 172.21.15.60:0/1718812830 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f15ac004800 msgr2=0x7f15ac004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:39.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.251+0000 7f15c6edd640 1 --2- 172.21.15.60:0/1718812830 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f15ac004800 0x7f15ac004c80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f15c006ec00 tx=0x7f15ac005830 comp rx=0 tx=0).stop 2024-09-12T02:25:39.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.251+0000 7f15c6edd640 1 -- 172.21.15.60:0/1718812830 shutdown_connections 2024-09-12T02:25:39.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.251+0000 7f15c6edd640 1 --2- 172.21.15.60:0/1718812830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15ac0039b0 0x7f15ac003db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:39.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.251+0000 7f15c6edd640 1 --2- 172.21.15.60:0/1718812830 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f15ac0052e0 0x7f15ac00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:39.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.251+0000 7f15c6edd640 1 --2- 172.21.15.60:0/1718812830 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f15ac004800 0x7f15ac004c80 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:39.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.251+0000 7f15c6edd640 1 -- 172.21.15.60:0/1718812830 >> 172.21.15.60:0/1718812830 conn(0x7f15c00adb80 msgr2=0x7f15c00adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:25:39.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.251+0000 7f15c6edd640 1 -- 172.21.15.60:0/1718812830 shutdown_connections 2024-09-12T02:25:39.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.251+0000 7f15c6edd640 1 -- 172.21.15.60:0/1718812830 wait complete. 2024-09-12T02:25:39.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.253+0000 7f15c6edd640 1 Processor -- start 2024-09-12T02:25:39.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.253+0000 7f15c6edd640 1 -- start start 2024-09-12T02:25:39.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.254+0000 7f15c6edd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15ac0039b0 0x7f15c00ad530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:39.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.254+0000 7f15c6edd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f15ac004800 0x7f15c0147a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:39.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.254+0000 7f15c6edd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f15ac0052e0 0x7f15c00ab9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:39.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.254+0000 7f15c6edd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f15c00c9070 con 0x7f15ac0039b0 2024-09-12T02:25:39.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.254+0000 7f15c6edd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f15c00c8ef0 con 0x7f15ac0052e0 2024-09-12T02:25:39.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.254+0000 7f15c6edd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f15c01534d0 con 0x7f15ac004800 2024-09-12T02:25:39.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.254+0000 7f15c4c79640 1 -- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15ac0039b0 msgr2=0x7f15c00ad530 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:25:39.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.254+0000 7f15c4c79640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15ac0039b0 0x7f15c00ad530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:25:39.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.254+0000 7f15bffff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f15ac004800 0x7f15c0147a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:39.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.254+0000 7f15c547a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f15ac0052e0 0x7f15c00ab9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:39.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.254+0000 7f15bffff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f15ac004800 0x7f15c0147a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:52244/0 (socket says 172.21.15.60:52244) 2024-09-12T02:25:39.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.254+0000 7f15bffff640 1 -- 172.21.15.60:0/820849191 learned_addr learned my addr 172.21.15.60:0/820849191 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:25:39.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.255+0000 7f15bffff640 1 -- 172.21.15.60:0/820849191 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f15ac0052e0 msgr2=0x7f15c00ab9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:39.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.255+0000 7f15bffff640 1 --2- 172.21.15.60:0/820849191 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f15ac0052e0 0x7f15c00ab9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:39.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.255+0000 7f15bffff640 1 -- 172.21.15.60:0/820849191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15ac0039b0 msgr2=0x7f15c00ad530 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:25:39.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.255+0000 7f15bffff640 1 --2- 172.21.15.60:0/820849191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15ac0039b0 0x7f15c00ad530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:39.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.255+0000 7f15bffff640 1 -- 172.21.15.60:0/820849191 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15c00ad0b0 con 0x7f15ac004800 2024-09-12T02:25:39.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.255+0000 7f15bffff640 1 --2- 172.21.15.60:0/820849191 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f15ac004800 0x7f15c0147a20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f15a802c2b0 tx=0x7f15a80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:39.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.255+0000 7f15bd7fa640 1 -- 172.21.15.60:0/820849191 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a8042070 con 0x7f15ac004800 2024-09-12T02:25:39.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.255+0000 7f15bd7fa640 1 -- 172.21.15.60:0/820849191 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15a8004500 con 0x7f15ac004800 2024-09-12T02:25:39.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.255+0000 7f15c6edd640 1 -- 172.21.15.60:0/820849191 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15c0151430 con 0x7f15ac004800 2024-09-12T02:25:39.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.255+0000 7f15bd7fa640 1 -- 172.21.15.60:0/820849191 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a800f040 con 0x7f15ac004800 2024-09-12T02:25:39.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.255+0000 7f15c6edd640 1 -- 172.21.15.60:0/820849191 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f15c01519f0 con 0x7f15ac004800 2024-09-12T02:25:39.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.257+0000 7f15c6edd640 1 -- 172.21.15.60:0/820849191 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15c00c7270 con 0x7f15ac004800 2024-09-12T02:25:39.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.257+0000 7f15bd7fa640 1 -- 172.21.15.60:0/820849191 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f15a8045070 con 0x7f15ac004800 2024-09-12T02:25:39.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.257+0000 7f15bd7fa640 1 --2- 172.21.15.60:0/820849191 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f15a006c5c0 0x7f15a006ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:39.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.258+0000 7f15bd7fa640 1 -- 172.21.15.60:0/820849191 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f15a80ad200 con 0x7f15ac004800 2024-09-12T02:25:39.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.258+0000 7f15c4c79640 1 --2- 172.21.15.60:0/820849191 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f15a006c5c0 0x7f15a006ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:39.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.258+0000 7f15c4c79640 1 --2- 172.21.15.60:0/820849191 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f15a006c5c0 0x7f15a006ea80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f15b8003980 tx=0x7f15b8004020 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:39.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.262+0000 7f15bd7fa640 1 -- 172.21.15.60:0/820849191 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f15c00c7270 con 0x7f15ac004800 2024-09-12T02:25:39.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.512+0000 7f15c6edd640 1 -- 172.21.15.60:0/820849191 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f15c00c69b0 con 0x7f15ac004800 2024-09-12T02:25:39.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.512+0000 7f15bd7fa640 1 -- 172.21.15.60:0/820849191 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7f15a807b090 con 0x7f15ac004800 2024-09-12T02:25:39.513 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":24,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:25:39.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.515+0000 7f15c6edd640 1 -- 172.21.15.60:0/820849191 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f15a006c5c0 msgr2=0x7f15a006ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:39.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.515+0000 7f15c6edd640 1 --2- 172.21.15.60:0/820849191 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f15a006c5c0 0x7f15a006ea80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f15b8003980 tx=0x7f15b8004020 comp rx=0 tx=0).stop 2024-09-12T02:25:39.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.515+0000 7f15c6edd640 1 -- 172.21.15.60:0/820849191 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f15ac004800 msgr2=0x7f15c0147a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:39.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.515+0000 7f15c6edd640 1 --2- 172.21.15.60:0/820849191 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f15ac004800 0x7f15c0147a20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f15a802c2b0 tx=0x7f15a80046c0 comp rx=0 tx=0).stop 2024-09-12T02:25:39.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.515+0000 7f15c6edd640 1 -- 172.21.15.60:0/820849191 shutdown_connections 2024-09-12T02:25:39.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.515+0000 7f15c6edd640 1 --2- 172.21.15.60:0/820849191 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f15a006c5c0 0x7f15a006ea80 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:39.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.515+0000 7f15c6edd640 1 --2- 172.21.15.60:0/820849191 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f15ac0052e0 0x7f15c00ab9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:39.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.515+0000 7f15c6edd640 1 --2- 172.21.15.60:0/820849191 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f15ac004800 0x7f15c0147a20 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:39.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.515+0000 7f15c6edd640 1 --2- 172.21.15.60:0/820849191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15ac0039b0 0x7f15c00ad530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:39.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.515+0000 7f15c6edd640 1 -- 172.21.15.60:0/820849191 >> 172.21.15.60:0/820849191 conn(0x7f15c00adb80 msgr2=0x7f15c014b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:25:39.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.515+0000 7f15c6edd640 1 -- 172.21.15.60:0/820849191 shutdown_connections 2024-09-12T02:25:39.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.515+0000 7f15c6edd640 1 -- 172.21.15.60:0/820849191 wait complete. 2024-09-12T02:25:39.526 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-12T02:25:39.526 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-12T02:25:39.526 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-12T02:25:39.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.629+0000 7f6601da2640 1 Processor -- start 2024-09-12T02:25:39.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.630+0000 7f6601da2640 1 -- start start 2024-09-12T02:25:39.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.630+0000 7f6601da2640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f65fc153890 0x7f65fc15a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:39.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.630+0000 7f6601da2640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65fc156130 0x7f65fc1565c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:39.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.630+0000 7f6601da2640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65fc15a570 con 0x7f65fc0c8050 2024-09-12T02:25:39.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.630+0000 7f6601da2640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f65fc0ca290 con 0x7f65fc153890 2024-09-12T02:25:39.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.630+0000 7f6601da2640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f65fc0c6b50 con 0x7f65fc156130 2024-09-12T02:25:39.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.630+0000 7f6600da0640 1 -- >> v2:172.21.15.60:3300/0 conn(0x7f65fc153890 msgr2=0x7f65fc15a030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:25:39.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.630+0000 7f6600da0640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f65fc153890 0x7f65fc15a030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:25:39.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.631+0000 7f66015a1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65fc156130 0x7f65fc1565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:39.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.631+0000 7f65fbfff640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f65fc0c8050 0x7f65fc073310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:49338/0 (socket says 172.21.15.60:49338) 2024-09-12T02:25:39.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.631+0000 7f65fbfff640 1 -- 172.21.15.60:0/3407088336 learned_addr learned my addr 172.21.15.60:0/3407088336 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:25:39.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.631+0000 7f65fb7fe640 1 -- 172.21.15.60:0/3407088336 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1550807721 0 0) 0x7f65e4001490 con 0x7f65fc0c8050 2024-09-12T02:25:39.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.631+0000 7f65fb7fe640 1 -- 172.21.15.60:0/3407088336 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65e8003520 con 0x7f65fc0c8050 2024-09-12T02:25:39.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.631+0000 7f66015a1640 1 -- 172.21.15.60:0/3407088336 >> v2:172.21.15.60:3300/0 conn(0x7f65fc153890 msgr2=0x7f65fc15a030 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:25:39.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.631+0000 7f66015a1640 1 --2- 172.21.15.60:0/3407088336 >> v2:172.21.15.60:3300/0 conn(0x7f65fc153890 0x7f65fc15a030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:39.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.631+0000 7f66015a1640 1 -- 172.21.15.60:0/3407088336 >> v1:172.21.15.105:6789/0 conn(0x7f65fc0c8050 legacy=0x7f65fc073310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:39.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.631+0000 7f66015a1640 1 -- 172.21.15.60:0/3407088336 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65fc153c70 con 0x7f65fc156130 2024-09-12T02:25:39.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.632+0000 7f66015a1640 1 --2- 172.21.15.60:0/3407088336 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65fc156130 0x7f65fc1565c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f65f40097a0 tx=0x7f65f402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46e7c0a6969432f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:39.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.632+0000 7f65fb7fe640 1 -- 172.21.15.60:0/3407088336 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f4037070 con 0x7f65fc156130 2024-09-12T02:25:39.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.632+0000 7f65fb7fe640 1 -- 172.21.15.60:0/3407088336 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65f4032440 con 0x7f65fc156130 2024-09-12T02:25:39.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.632+0000 7f65fb7fe640 1 -- 172.21.15.60:0/3407088336 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f4032810 con 0x7f65fc156130 2024-09-12T02:25:39.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.633+0000 7f6601da2640 1 -- 172.21.15.60:0/3407088336 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65fc156130 msgr2=0x7f65fc1565c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:39.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.633+0000 7f6601da2640 1 --2- 172.21.15.60:0/3407088336 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65fc156130 0x7f65fc1565c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f65f40097a0 tx=0x7f65f402a1a0 comp rx=0 tx=0).stop 2024-09-12T02:25:39.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.633+0000 7f6601da2640 1 -- 172.21.15.60:0/3407088336 shutdown_connections 2024-09-12T02:25:39.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.633+0000 7f6601da2640 1 --2- 172.21.15.60:0/3407088336 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65fc156130 0x7f65fc1565c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:39.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.633+0000 7f6601da2640 1 --2- 172.21.15.60:0/3407088336 >> v2:172.21.15.60:3300/0 conn(0x7f65fc153890 0x7f65fc15a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:39.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.633+0000 7f6601da2640 1 -- 172.21.15.60:0/3407088336 >> 172.21.15.60:0/3407088336 conn(0x7f65fc0cbb70 msgr2=0x7f65fc0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:25:39.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.633+0000 7f6601da2640 1 -- 172.21.15.60:0/3407088336 shutdown_connections 2024-09-12T02:25:39.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.633+0000 7f6601da2640 1 -- 172.21.15.60:0/3407088336 wait complete. 2024-09-12T02:25:39.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.634+0000 7f6601da2640 1 Processor -- start 2024-09-12T02:25:39.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.634+0000 7f6601da2640 1 -- start start 2024-09-12T02:25:39.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.635+0000 7f6601da2640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65fc0c8050 0x7f65fc1df900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:39.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.635+0000 7f6601da2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65fc153890 0x7f65fc157860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:39.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.635+0000 7f6601da2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65fc156130 0x7f65fc157da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:39.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.635+0000 7f6601da2640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f65fc06d330 con 0x7f65fc156130 2024-09-12T02:25:39.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.635+0000 7f6601da2640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f65fc0c6870 con 0x7f65fc153890 2024-09-12T02:25:39.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.635+0000 7f6601da2640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f65fc06d610 con 0x7f65fc0c8050 2024-09-12T02:25:39.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.635+0000 7f66015a1640 1 -- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65fc156130 msgr2=0x7f65fc157da0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:25:39.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.635+0000 7f66015a1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65fc156130 0x7f65fc157da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:25:39.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.635+0000 7f65fbfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65fc153890 0x7f65fc157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:39.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.635+0000 7f6600da0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65fc0c8050 0x7f65fc1df900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:39.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.635+0000 7f6600da0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65fc0c8050 0x7f65fc1df900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:48136/0 (socket says 172.21.15.60:48136) 2024-09-12T02:25:39.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.635+0000 7f6600da0640 1 -- 172.21.15.60:0/3919967367 learned_addr learned my addr 172.21.15.60:0/3919967367 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:25:39.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.635+0000 7f65fbfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65fc153890 0x7f65fc157860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:35496/0 (socket says 172.21.15.60:35496) 2024-09-12T02:25:39.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.636+0000 7f6600da0640 1 -- 172.21.15.60:0/3919967367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65fc153890 msgr2=0x7f65fc157860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:39.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.636+0000 7f6600da0640 1 --2- 172.21.15.60:0/3919967367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65fc153890 0x7f65fc157860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:39.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.636+0000 7f6600da0640 1 -- 172.21.15.60:0/3919967367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65fc156130 msgr2=0x7f65fc157da0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:25:39.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.636+0000 7f6600da0640 1 --2- 172.21.15.60:0/3919967367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65fc156130 0x7f65fc157da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:39.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.636+0000 7f6600da0640 1 -- 172.21.15.60:0/3919967367 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65fc1589e0 con 0x7f65fc0c8050 2024-09-12T02:25:39.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.636+0000 7f65fbfff640 1 --2- 172.21.15.60:0/3919967367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65fc153890 0x7f65fc157860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:25:39.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.636+0000 7f6600da0640 1 --2- 172.21.15.60:0/3919967367 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65fc0c8050 0x7f65fc1df900 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f65ec00b580 tx=0x7f65ec00ba40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:39.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.636+0000 7f65f97fa640 1 -- 172.21.15.60:0/3919967367 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ec013020 con 0x7f65fc0c8050 2024-09-12T02:25:39.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.636+0000 7f65f97fa640 1 -- 172.21.15.60:0/3919967367 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65ec003de0 con 0x7f65fc0c8050 2024-09-12T02:25:39.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.636+0000 7f65f97fa640 1 -- 172.21.15.60:0/3919967367 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ec0052b0 con 0x7f65fc0c8050 2024-09-12T02:25:39.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.636+0000 7f6601da2640 1 -- 172.21.15.60:0/3919967367 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65fc1ef770 con 0x7f65fc0c8050 2024-09-12T02:25:39.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.636+0000 7f6601da2640 1 -- 172.21.15.60:0/3919967367 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f65fc1dfe40 con 0x7f65fc0c8050 2024-09-12T02:25:39.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.637+0000 7f6601da2640 1 --2- 172.21.15.60:0/3919967367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65fc159990 0x7f65fc148700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:39.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.637+0000 7f6601da2640 1 -- 172.21.15.60:0/3919967367 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f65fc1594c0 con 0x7f65fc159990 2024-09-12T02:25:39.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.637+0000 7f65fbfff640 1 --2- 172.21.15.60:0/3919967367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65fc159990 0x7f65fc148700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:39.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.638+0000 7f65fbfff640 1 -- 172.21.15.60:0/3919967367 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f65fc15a030 con 0x7f65fc159990 2024-09-12T02:25:39.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.638+0000 7f65f97fa640 1 -- 172.21.15.60:0/3919967367 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f65ec016020 con 0x7f65fc0c8050 2024-09-12T02:25:39.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.638+0000 7f65fbfff640 1 --2- 172.21.15.60:0/3919967367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65fc159990 0x7f65fc148700 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f65fc1e34f0 tx=0x7f65e400d810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:39.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.638+0000 7f65f97fa640 1 --2- 172.21.15.60:0/3919967367 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f65dc06bde0 0x7f65dc06e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:39.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.638+0000 7f65f97fa640 1 -- 172.21.15.60:0/3919967367 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f65ec08aef0 con 0x7f65fc0c8050 2024-09-12T02:25:39.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.638+0000 7f66015a1640 1 --2- 172.21.15.60:0/3919967367 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f65dc06bde0 0x7f65dc06e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:39.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.638+0000 7f65f97fa640 1 -- 172.21.15.60:0/3919967367 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e4019070 con 0x7f65fc159990 2024-09-12T02:25:39.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.638+0000 7f65f97fa640 1 -- 172.21.15.60:0/3919967367 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f65e4007320 con 0x7f65fc159990 2024-09-12T02:25:39.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.638+0000 7f65f97fa640 1 -- 172.21.15.60:0/3919967367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65fc159990 msgr2=0x7f65fc148700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:39.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.638+0000 7f65f97fa640 1 --2- 172.21.15.60:0/3919967367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65fc159990 0x7f65fc148700 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f65fc1e34f0 tx=0x7f65e400d810 comp rx=0 tx=0).stop 2024-09-12T02:25:39.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.638+0000 7f65f97fa640 1 -- 172.21.15.60:0/3919967367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65fc159990 msgr2=0x7f65fc148700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:25:39.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.638+0000 7f65f97fa640 1 --2- 172.21.15.60:0/3919967367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65fc159990 0x7f65fc148700 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f65fc1e34f0 tx=0x7f65e400d810 comp rx=0 tx=0).stop 2024-09-12T02:25:39.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.639+0000 7f66015a1640 1 --2- 172.21.15.60:0/3919967367 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f65dc06bde0 0x7f65dc06e2a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f65f4034000 tx=0x7f65f402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:39.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.645+0000 7f6601da2640 1 --2- 172.21.15.60:0/3919967367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65fc148c40 0x7f65fc1e1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:39.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.645+0000 7f6601da2640 1 -- 172.21.15.60:0/3919967367 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f65fc0ac8d0 con 0x7f65fc148c40 2024-09-12T02:25:39.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.645+0000 7f65fbfff640 1 --2- 172.21.15.60:0/3919967367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65fc148c40 0x7f65fc1e1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:39.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.645+0000 7f65fbfff640 1 -- 172.21.15.60:0/3919967367 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f65fc149750 con 0x7f65fc148c40 2024-09-12T02:25:39.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.646+0000 7f65fbfff640 1 --2- 172.21.15.60:0/3919967367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65fc148c40 0x7f65fc1e1650 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f65fc159640 tx=0x7f65e4001250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:39.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.646+0000 7f65f97fa640 1 -- 172.21.15.60:0/3919967367 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e4019050 con 0x7f65fc148c40 2024-09-12T02:25:39.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.646+0000 7f65f97fa640 1 -- 172.21.15.60:0/3919967367 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5040 (secure 0 0 0) 0x7f65e401a040 con 0x7f65fc148c40 2024-09-12T02:25:39.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.646+0000 7f65f97fa640 1 -- 172.21.15.60:0/3919967367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65fc148c40 msgr2=0x7f65fc1e1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:39.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.646+0000 7f65f97fa640 1 --2- 172.21.15.60:0/3919967367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65fc148c40 0x7f65fc1e1650 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f65fc159640 tx=0x7f65e4001250 comp rx=0 tx=0).stop 2024-09-12T02:25:39.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.646+0000 7f65f97fa640 1 -- 172.21.15.60:0/3919967367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65fc148c40 msgr2=0x7f65fc1e1650 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:25:39.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.646+0000 7f65f97fa640 1 --2- 172.21.15.60:0/3919967367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65fc148c40 0x7f65fc1e1650 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:39.647 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:25:39.647 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:25:39.647 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:25:39.647 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:25:39.647 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 24, 2024-09-12T02:25:39.648 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 85081, 2024-09-12T02:25:39.648 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:25:39.648 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:25:39.648 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:25:39.648 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:39.648 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-09-12T02:25:39.648 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:25:39.648 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:25:39.648 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:25:39.648 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:25:39.648 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:25:39.648 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:25:39.648 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:25:39.649 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:25:39.649 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:25:39.649 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:25:39.649 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:25:39.649 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:25:39.649 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:25:39.649 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:25:39.649 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:39.649 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:25:39.649 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:25:39.649 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:25:39.649 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:25:39.649 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:25:39.649 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:25:39.650 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:25:39.650 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:25:39.650 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:25:39.650 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:25:39.650 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:25:39.650 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:25:39.650 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:25:39.650 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:39.650 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:39.650 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:25:39.650 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:25:39.651 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:25:39.651 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:25:39.651 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:25:39.651 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:25:39.651 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:25:39.651 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:25:39.651 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:25:39.652 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:25:39.652 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:25:39.652 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:25:39.652 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:25:39.652 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:25:39.652 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:25:39.652 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:25:39.652 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:25:39.652 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:25:39.652 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:25:39.652 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:25:39.652 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:25:39.653 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:25:39.653 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:25:39.653 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:25:39.653 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:25:39.653 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:25:39.653 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:25:39.653 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:25:39.653 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:39.653 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:25:39.653 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:39.653 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:25:39.653 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:39.653 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:25:39.653 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:25:39.654 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:25:39.654 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:25:39.654 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:39.654 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:25:39.654 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:25:39.654 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:39.654 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:39.654 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:39.654 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:25:39.654 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:25:39.654 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:39.654 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:39.654 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:39.654 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:39.655 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:25:39.655 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:25:39.655 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:25:39.655 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:25:39.655 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:25:39.655 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:39.655 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:39.655 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:25:39.655 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:25:39.655 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:25:39.655 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:25:39.655 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:39.655 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:25:39.655 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:25:39.656 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:39.656 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:39.656 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:39.656 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:25:39.656 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:25:39.656 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:39.656 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:39.656 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:39.656 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:39.656 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:25:39.656 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:25:39.656 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:25:39.657 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:25:39.657 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:25:39.657 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:39.657 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:39.657 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:25:39.657 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:25:39.657 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:25:39.657 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:25:39.657 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:39.657 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:25:39.657 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:25:39.657 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:39.657 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:39.658 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:39.658 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:25:39.658 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:25:39.658 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:39.658 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:39.658 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:39.658 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:39.658 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:25:39.658 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:25:39.658 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:25:39.658 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:25:39.658 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:25:39.658 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:39.658 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:39.658 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:39.658 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:25:39.659 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:25:39.659 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:39.659 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:25:39.659 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:25:39.659 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:25:39.659 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:39.659 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:39.659 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:25:39.659 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:39.659 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:25:39.660 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:25:39.660 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:25:39.660 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:39.660 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:39.660 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:25:39.660 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:39.660 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:25:39.660 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:25:39.660 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:25:39.660 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:39.660 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:39.660 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:25:39.660 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:39.660 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:25:39.660 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:25:39.661 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:25:39.661 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:39.661 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:39.661 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:25:39.661 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:39.661 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:25:39.661 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:25:39.661 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:25:39.661 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:39.662 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:39.662 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:39.662 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:25:39.662 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:25:39.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.646+0000 7f6601da2640 1 -- 172.21.15.60:0/3919967367 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f65dc06bde0 msgr2=0x7f65dc06e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:39.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.646+0000 7f6601da2640 1 --2- 172.21.15.60:0/3919967367 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f65dc06bde0 0x7f65dc06e2a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f65f4034000 tx=0x7f65f402e000 comp rx=0 tx=0).stop 2024-09-12T02:25:39.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.646+0000 7f6601da2640 1 -- 172.21.15.60:0/3919967367 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65fc0c8050 msgr2=0x7f65fc1df900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:39.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.646+0000 7f6601da2640 1 --2- 172.21.15.60:0/3919967367 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65fc0c8050 0x7f65fc1df900 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f65ec00b580 tx=0x7f65ec00ba40 comp rx=0 tx=0).stop 2024-09-12T02:25:39.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.646+0000 7f66015a1640 1 -- 172.21.15.60:0/3919967367 reap_dead start 2024-09-12T02:25:39.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.646+0000 7f66015a1640 1 -- 172.21.15.60:0/3919967367 reap_dead start 2024-09-12T02:25:39.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.646+0000 7f6601da2640 1 -- 172.21.15.60:0/3919967367 shutdown_connections 2024-09-12T02:25:39.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.646+0000 7f6601da2640 1 -- 172.21.15.60:0/3919967367 >> 172.21.15.60:0/3919967367 conn(0x7f65fc0cbb70 msgr2=0x7f65fc0ca420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:25:39.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.646+0000 7f6601da2640 1 -- 172.21.15.60:0/3919967367 shutdown_connections 2024-09-12T02:25:39.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.646+0000 7f6601da2640 1 -- 172.21.15.60:0/3919967367 wait complete. 2024-09-12T02:25:39.664 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-12T02:25:39.664 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-12T02:25:39.664 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-12T02:25:39.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.766+0000 7fe674e9b640 1 Processor -- start 2024-09-12T02:25:39.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.766+0000 7fe674e9b640 1 -- start start 2024-09-12T02:25:39.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.767+0000 7fe674e9b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6701500a0 0x7fe6700c3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:39.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.767+0000 7fe674e9b640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe6700c3e00 0x7fe67006dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:39.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.767+0000 7fe674e9b640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6700ad5c0 con 0x7fe67006e650 2024-09-12T02:25:39.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.767+0000 7fe674e9b640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fe67006ef50 con 0x7fe6700c3e00 2024-09-12T02:25:39.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.767+0000 7fe674e9b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe6700ad860 con 0x7fe6701500a0 2024-09-12T02:25:39.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.767+0000 7fe66dd9b640 1 -- >> v1:172.21.15.60:6789/0 conn(0x7fe67006e650 legacy=0x7fe670150930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:25:39.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.768+0000 7fe66ed9d640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe6700c3e00 0x7fe67006dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:39.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.768+0000 7fe66e59c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6701500a0 0x7fe6700c3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:39.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.768+0000 7fe66e59c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6701500a0 0x7fe6700c3000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:48140/0 (socket says 172.21.15.60:48140) 2024-09-12T02:25:39.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.768+0000 7fe66e59c640 1 -- 172.21.15.60:0/2086462593 learned_addr learned my addr 172.21.15.60:0/2086462593 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:25:39.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.768+0000 7fe66e59c640 1 -- 172.21.15.60:0/2086462593 >> v2:172.21.15.105:3300/0 conn(0x7fe6700c3e00 msgr2=0x7fe67006dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:25:39.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.768+0000 7fe66e59c640 1 --2- 172.21.15.60:0/2086462593 >> v2:172.21.15.105:3300/0 conn(0x7fe6700c3e00 0x7fe67006dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:39.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.768+0000 7fe66e59c640 1 -- 172.21.15.60:0/2086462593 >> v1:172.21.15.60:6789/0 conn(0x7fe67006e650 legacy=0x7fe670150930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:25:39.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.768+0000 7fe66e59c640 1 -- 172.21.15.60:0/2086462593 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe67006ec70 con 0x7fe6701500a0 2024-09-12T02:25:39.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.769+0000 7fe66e59c640 1 --2- 172.21.15.60:0/2086462593 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6701500a0 0x7fe6700c3000 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe660009870 tx=0x7fe66002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8222aeef5d8d2f1d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:39.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.769+0000 7fe66d59a640 1 -- 172.21.15.60:0/2086462593 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe660037070 con 0x7fe6701500a0 2024-09-12T02:25:39.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.769+0000 7fe66d59a640 1 -- 172.21.15.60:0/2086462593 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe660032440 con 0x7fe6701500a0 2024-09-12T02:25:39.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.769+0000 7fe66d59a640 1 -- 172.21.15.60:0/2086462593 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe660032810 con 0x7fe6701500a0 2024-09-12T02:25:39.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.769+0000 7fe674e9b640 1 -- 172.21.15.60:0/2086462593 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6701500a0 msgr2=0x7fe6700c3000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:39.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.769+0000 7fe674e9b640 1 --2- 172.21.15.60:0/2086462593 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6701500a0 0x7fe6700c3000 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe660009870 tx=0x7fe66002a180 comp rx=0 tx=0).stop 2024-09-12T02:25:39.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.770+0000 7fe674e9b640 1 -- 172.21.15.60:0/2086462593 shutdown_connections 2024-09-12T02:25:39.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.770+0000 7fe674e9b640 1 --2- 172.21.15.60:0/2086462593 >> v2:172.21.15.105:3300/0 conn(0x7fe6700c3e00 0x7fe67006dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:39.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.770+0000 7fe674e9b640 1 --2- 172.21.15.60:0/2086462593 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6701500a0 0x7fe6700c3000 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:39.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.770+0000 7fe674e9b640 1 -- 172.21.15.60:0/2086462593 >> 172.21.15.60:0/2086462593 conn(0x7fe6700c7a40 msgr2=0x7fe6700c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:25:39.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.770+0000 7fe674e9b640 1 -- 172.21.15.60:0/2086462593 shutdown_connections 2024-09-12T02:25:39.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.770+0000 7fe674e9b640 1 -- 172.21.15.60:0/2086462593 wait complete. 2024-09-12T02:25:39.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.771+0000 7fe674e9b640 1 Processor -- start 2024-09-12T02:25:39.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.771+0000 7fe674e9b640 1 -- start start 2024-09-12T02:25:39.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.771+0000 7fe674e9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe67006e650 0x7fe6700a7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:39.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.771+0000 7fe674e9b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6700c3e00 0x7fe6701401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:39.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.772+0000 7fe674e9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6701500a0 0x7fe670140ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:39.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.772+0000 7fe674e9b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe6700adb10 con 0x7fe6701500a0 2024-09-12T02:25:39.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.772+0000 7fe674e9b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe6700c3540 con 0x7fe67006e650 2024-09-12T02:25:39.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.772+0000 7fe674e9b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe670150480 con 0x7fe6700c3e00 2024-09-12T02:25:39.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.772+0000 7fe66ed9d640 1 -- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6701500a0 msgr2=0x7fe670140ab0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:25:39.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.772+0000 7fe66ed9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6701500a0 0x7fe670140ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:25:39.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.772+0000 7fe66e59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe67006e650 0x7fe6700a7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:39.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.772+0000 7fe66dd9b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6700c3e00 0x7fe6701401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:39.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.772+0000 7fe66dd9b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6700c3e00 0x7fe6701401a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:48152/0 (socket says 172.21.15.60:48152) 2024-09-12T02:25:39.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.772+0000 7fe66dd9b640 1 -- 172.21.15.60:0/639987808 learned_addr learned my addr 172.21.15.60:0/639987808 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:25:39.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.772+0000 7fe66e59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe67006e650 0x7fe6700a7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:35524/0 (socket says 172.21.15.60:35524) 2024-09-12T02:25:39.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.772+0000 7fe66e59c640 1 -- 172.21.15.60:0/639987808 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6700c3e00 msgr2=0x7fe6701401a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:39.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.772+0000 7fe66e59c640 1 --2- 172.21.15.60:0/639987808 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6700c3e00 0x7fe6701401a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:39.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.772+0000 7fe66e59c640 1 -- 172.21.15.60:0/639987808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6701500a0 msgr2=0x7fe670140ab0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:25:39.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.772+0000 7fe66e59c640 1 --2- 172.21.15.60:0/639987808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6701500a0 0x7fe670140ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:39.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.772+0000 7fe66e59c640 1 -- 172.21.15.60:0/639987808 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe670156880 con 0x7fe67006e650 2024-09-12T02:25:39.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.772+0000 7fe66dd9b640 1 --2- 172.21.15.60:0/639987808 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6700c3e00 0x7fe6701401a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:25:39.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.772+0000 7fe66e59c640 1 --2- 172.21.15.60:0/639987808 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe67006e650 0x7fe6700a7f80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe660031000 tx=0x7fe6600046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:39.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.773+0000 7fe65effd640 1 -- 172.21.15.60:0/639987808 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe660041070 con 0x7fe67006e650 2024-09-12T02:25:39.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.773+0000 7fe65effd640 1 -- 172.21.15.60:0/639987808 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe66003c870 con 0x7fe67006e650 2024-09-12T02:25:39.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.773+0000 7fe65effd640 1 -- 172.21.15.60:0/639987808 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe660037040 con 0x7fe67006e650 2024-09-12T02:25:39.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.773+0000 7fe674e9b640 1 -- 172.21.15.60:0/639987808 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe670156b60 con 0x7fe67006e650 2024-09-12T02:25:39.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.773+0000 7fe674e9b640 1 -- 172.21.15.60:0/639987808 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe67014dc80 con 0x7fe67006e650 2024-09-12T02:25:39.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.773+0000 7fe674e9b640 1 --2- 172.21.15.60:0/639987808 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe670146600 0x7fe670140ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:39.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.773+0000 7fe674e9b640 1 -- 172.21.15.60:0/639987808 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe6700c73f0 con 0x7fe670146600 2024-09-12T02:25:39.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.774+0000 7fe66dd9b640 1 --2- 172.21.15.60:0/639987808 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe670146600 0x7fe670140ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:39.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.774+0000 7fe66dd9b640 1 -- 172.21.15.60:0/639987808 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe6700c3000 con 0x7fe670146600 2024-09-12T02:25:39.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.774+0000 7fe66dd9b640 1 --2- 172.21.15.60:0/639987808 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe670146600 0x7fe670140ff0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe6640052d0 tx=0x7fe664005790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:39.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.774+0000 7fe65effd640 1 -- 172.21.15.60:0/639987808 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe664016070 con 0x7fe670146600 2024-09-12T02:25:39.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.774+0000 7fe65effd640 1 -- 172.21.15.60:0/639987808 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe660044070 con 0x7fe67006e650 2024-09-12T02:25:39.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.775+0000 7fe65effd640 1 --2- 172.21.15.60:0/639987808 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe65006bd60 0x7fe65006e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:39.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.775+0000 7fe65effd640 1 -- 172.21.15.60:0/639987808 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fe6600ab5b0 con 0x7fe67006e650 2024-09-12T02:25:39.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.775+0000 7fe66ed9d640 1 --2- 172.21.15.60:0/639987808 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe65006bd60 0x7fe65006e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:39.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.775+0000 7fe65effd640 1 -- 172.21.15.60:0/639987808 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fe66400eaf0 con 0x7fe670146600 2024-09-12T02:25:39.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.775+0000 7fe65effd640 1 -- 172.21.15.60:0/639987808 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe670146600 msgr2=0x7fe670140ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:39.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.775+0000 7fe65effd640 1 --2- 172.21.15.60:0/639987808 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe670146600 0x7fe670140ff0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe6640052d0 tx=0x7fe664005790 comp rx=0 tx=0).stop 2024-09-12T02:25:39.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.775+0000 7fe65effd640 1 -- 172.21.15.60:0/639987808 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe670146600 msgr2=0x7fe670140ff0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:25:39.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.775+0000 7fe65effd640 1 --2- 172.21.15.60:0/639987808 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe670146600 0x7fe670140ff0 secure :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe6640052d0 tx=0x7fe664005790 comp rx=0 tx=0).stop 2024-09-12T02:25:39.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.775+0000 7fe66ed9d640 1 --2- 172.21.15.60:0/639987808 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe65006bd60 0x7fe65006e220 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe668009ac0 tx=0x7fe66800b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:39.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.781+0000 7fe674e9b640 1 --2- 172.21.15.60:0/639987808 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6700a9150 0x7fe6700a9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:25:39.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.781+0000 7fe674e9b640 1 -- 172.21.15.60:0/639987808 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe6700c2770 con 0x7fe6700a9150 2024-09-12T02:25:39.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.782+0000 7fe66dd9b640 1 --2- 172.21.15.60:0/639987808 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6700a9150 0x7fe6700a9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:25:39.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.782+0000 7fe66dd9b640 1 -- 172.21.15.60:0/639987808 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe6700c7790 con 0x7fe6700a9150 2024-09-12T02:25:39.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.782+0000 7fe66dd9b640 1 --2- 172.21.15.60:0/639987808 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6700a9150 0x7fe6700a9530 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe664018000 tx=0x7fe6640059a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:25:39.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.783+0000 7fe65effd640 1 -- 172.21.15.60:0/639987808 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe664026600 con 0x7fe6700a9150 2024-09-12T02:25:39.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.783+0000 7fe65effd640 1 -- 172.21.15.60:0/639987808 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5039 (secure 0 0 0) 0x7fe6640123f0 con 0x7fe6700a9150 2024-09-12T02:25:39.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.783+0000 7fe65effd640 1 -- 172.21.15.60:0/639987808 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6700a9150 msgr2=0x7fe6700a9530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:39.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.783+0000 7fe65effd640 1 --2- 172.21.15.60:0/639987808 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6700a9150 0x7fe6700a9530 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe664018000 tx=0x7fe6640059a0 comp rx=0 tx=0).stop 2024-09-12T02:25:39.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.783+0000 7fe65effd640 1 -- 172.21.15.60:0/639987808 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6700a9150 msgr2=0x7fe6700a9530 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:25:39.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.783+0000 7fe65effd640 1 --2- 172.21.15.60:0/639987808 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6700a9150 0x7fe6700a9530 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:25:39.784 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:25:39.784 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:25:39.784 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:25:39.784 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:25:39.784 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 24, 2024-09-12T02:25:39.784 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 185098, 2024-09-12T02:25:39.784 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:25:39.784 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:25:39.784 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:25:39.785 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:39.785 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-09-12T02:25:39.785 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:25:39.785 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:25:39.785 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:25:39.785 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:25:39.785 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:25:39.785 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:25:39.785 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:25:39.785 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:25:39.785 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:25:39.785 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:25:39.785 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:25:39.786 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:25:39.786 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:25:39.786 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:25:39.786 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:39.786 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:25:39.786 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:25:39.786 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:25:39.786 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:25:39.786 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:25:39.786 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:25:39.786 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:25:39.786 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:25:39.787 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:25:39.787 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:25:39.787 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:25:39.787 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:25:39.787 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:25:39.787 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:39.787 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:39.787 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:25:39.787 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:25:39.787 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:25:39.787 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:25:39.787 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:25:39.787 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:25:39.787 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:25:39.788 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:25:39.788 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:25:39.788 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:25:39.788 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:25:39.788 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:25:39.788 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:25:39.788 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:25:39.788 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:25:39.788 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:25:39.788 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:25:39.788 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:25:39.788 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:25:39.789 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:25:39.789 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:25:39.789 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:25:39.789 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:25:39.789 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:25:39.789 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:25:39.789 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:25:39.789 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:25:39.789 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:25:39.789 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:39.789 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:25:39.789 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:39.789 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:25:39.789 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:39.790 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:25:39.790 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:25:39.790 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:25:39.790 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:25:39.790 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:39.790 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:25:39.790 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:25:39.790 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:39.790 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:39.790 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:39.790 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:25:39.790 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:25:39.790 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:39.791 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:39.791 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:39.791 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:39.791 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:25:39.791 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:25:39.791 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:25:39.791 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:25:39.791 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:25:39.791 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:39.791 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:39.791 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:25:39.791 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:25:39.791 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:25:39.791 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:25:39.792 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:39.792 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:25:39.792 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:25:39.792 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:39.792 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:39.792 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:39.792 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:25:39.792 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:25:39.792 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:39.792 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:39.792 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:39.792 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:39.792 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:25:39.793 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:25:39.793 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:25:39.793 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:25:39.793 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:25:39.793 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:39.793 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:39.793 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:25:39.793 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:25:39.793 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:25:39.793 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:25:39.793 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:39.793 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:25:39.794 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:25:39.794 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:39.794 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:39.794 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:39.794 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:25:39.794 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:25:39.794 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:25:39.794 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:39.794 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:39.794 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:39.794 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:25:39.794 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:25:39.794 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:25:39.795 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:25:39.795 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:25:39.795 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:39.795 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:39.795 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:39.795 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:25:39.795 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:25:39.795 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:39.796 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:25:39.796 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:25:39.796 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:25:39.796 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:39.796 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:39.796 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:25:39.796 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:39.796 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:25:39.796 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:25:39.797 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:25:39.797 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:39.797 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:39.797 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:25:39.797 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:39.797 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:25:39.797 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:25:39.797 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:25:39.797 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:39.797 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:39.797 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:25:39.797 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:39.798 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:25:39.798 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:25:39.798 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:25:39.798 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:39.798 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:25:39.798 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:25:39.798 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:25:39.798 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:25:39.798 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:25:39.798 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:25:39.798 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:25:39.798 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:25:39.799 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:25:39.799 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:25:39.799 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:25:39.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.783+0000 7fe674e9b640 1 -- 172.21.15.60:0/639987808 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe65006bd60 msgr2=0x7fe65006e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:39.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.783+0000 7fe674e9b640 1 --2- 172.21.15.60:0/639987808 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe65006bd60 0x7fe65006e220 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe668009ac0 tx=0x7fe66800b040 comp rx=0 tx=0).stop 2024-09-12T02:25:39.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.783+0000 7fe674e9b640 1 -- 172.21.15.60:0/639987808 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe67006e650 msgr2=0x7fe6700a7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:25:39.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.783+0000 7fe674e9b640 1 --2- 172.21.15.60:0/639987808 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe67006e650 0x7fe6700a7f80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe660031000 tx=0x7fe6600046c0 comp rx=0 tx=0).stop 2024-09-12T02:25:39.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.783+0000 7fe66ed9d640 1 -- 172.21.15.60:0/639987808 reap_dead start 2024-09-12T02:25:39.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.783+0000 7fe66ed9d640 1 -- 172.21.15.60:0/639987808 reap_dead start 2024-09-12T02:25:39.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.783+0000 7fe674e9b640 1 -- 172.21.15.60:0/639987808 shutdown_connections 2024-09-12T02:25:39.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.783+0000 7fe674e9b640 1 -- 172.21.15.60:0/639987808 >> 172.21.15.60:0/639987808 conn(0x7fe6700c7a40 msgr2=0x7fe6700c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:25:39.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.783+0000 7fe674e9b640 1 -- 172.21.15.60:0/639987808 shutdown_connections 2024-09-12T02:25:39.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:25:39.783+0000 7fe674e9b640 1 -- 172.21.15.60:0/639987808 wait complete. 2024-09-12T02:25:39.801 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-12T02:25:39.801 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-12T02:25:56.781 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:25:56.784 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:25:59.802 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-12T02:25:59.802 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-09-12T02:25:59.802 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T02:25:59.803 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T02:25:59.805 INFO:tasks.ceph.mon.a:Started 2024-09-12T02:25:59.805 INFO:tasks.mon_thrash:Sending STOP to mon b 2024-09-12T02:25:59.805 INFO:tasks.ceph.mon.b:Sent signal 19 2024-09-12T02:25:59.805 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-09-12T02:26:14.806 INFO:tasks.mon_thrash:Sending CONT to mon b 2024-09-12T02:26:14.807 INFO:tasks.ceph.mon.b:Sent signal 18 2024-09-12T02:26:14.807 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-12T02:26:14.807 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:26:14.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.917+0000 7fb4d0f6d640 1 Processor -- start 2024-09-12T02:26:14.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.917+0000 7fb4d0f6d640 1 -- start start 2024-09-12T02:26:14.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.918+0000 7fb4d0f6d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4cc153be0 0x7fb4cc15a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:14.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.918+0000 7fb4d0f6d640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4cc0c7070 con 0x7fb4cc0c8b10 2024-09-12T02:26:14.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.918+0000 7fb4d0f6d640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4cc06d210 con 0x7fb4cc06cd80 2024-09-12T02:26:14.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.918+0000 7fb4d0f6d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb4cc0c69b0 con 0x7fb4cc153be0 2024-09-12T02:26:14.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.919+0000 7fb4ca59c640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb4cc0c8b10 0x7fb4cc1534d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47848/0 (socket says 172.21.15.60:47848) 2024-09-12T02:26:14.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.919+0000 7fb4ca59c640 1 -- 172.21.15.60:0/1499851591 learned_addr learned my addr 172.21.15.60:0/1499851591 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:26:14.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.919+0000 7fb4cad9d640 1 --2- 172.21.15.60:0/1499851591 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4cc153be0 0x7fb4cc15a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:14.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.919+0000 7fb4c959a640 1 -- 172.21.15.60:0/1499851591 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 833171297 0 0) 0x7fb4cc0c7070 con 0x7fb4cc0c8b10 2024-09-12T02:26:14.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.919+0000 7fb4c959a640 1 -- 172.21.15.60:0/1499851591 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4b4003520 con 0x7fb4cc0c8b10 2024-09-12T02:26:14.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.919+0000 7fb4c959a640 1 -- 172.21.15.60:0/1499851591 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3471673745 0 0) 0x7fb4cc06d210 con 0x7fb4cc06cd80 2024-09-12T02:26:14.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.919+0000 7fb4c959a640 1 -- 172.21.15.60:0/1499851591 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4cc0c7070 con 0x7fb4cc06cd80 2024-09-12T02:26:14.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.919+0000 7fb4c959a640 1 -- 172.21.15.60:0/1499851591 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3007594118 0 0) 0x7fb4b4003520 con 0x7fb4cc0c8b10 2024-09-12T02:26:14.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.919+0000 7fb4c959a640 1 -- 172.21.15.60:0/1499851591 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4cc153be0 msgr2=0x7fb4cc15a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:26:14.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.919+0000 7fb4c959a640 1 --2- 172.21.15.60:0/1499851591 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4cc153be0 0x7fb4cc15a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:14.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.919+0000 7fb4c959a640 1 -- 172.21.15.60:0/1499851591 >> v1:172.21.15.105:6789/0 conn(0x7fb4cc06cd80 legacy=0x7fb4cc156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:14.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.919+0000 7fb4c959a640 1 -- 172.21.15.60:0/1499851591 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4cc0c6c90 con 0x7fb4cc0c8b10 2024-09-12T02:26:14.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.919+0000 7fb4c959a640 1 -- 172.21.15.60:0/1499851591 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7fb4bc001670 con 0x7fb4cc0c8b10 2024-09-12T02:26:14.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.919+0000 7fb4cad9d640 1 --2- 172.21.15.60:0/1499851591 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4cc153be0 0x7fb4cc15a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:26:14.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.919+0000 7fb4c959a640 1 -- 172.21.15.60:0/1499851591 >> v1:172.21.15.60:6789/0 conn(0x7fb4cc0c8b10 legacy=0x7fb4cc1534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:14.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.919+0000 7fb4c959a640 1 --2- 172.21.15.60:0/1499851591 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4b4003b70 0x7fb4b4003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:14.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.919+0000 7fb4c959a640 1 --2- 172.21.15.60:0/1499851591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4b4004800 0x7fb4b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:14.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.919+0000 7fb4c959a640 1 --2- 172.21.15.60:0/1499851591 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4cc153be0 0x7fb4b40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:14.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.919+0000 7fb4c959a640 1 -- 172.21.15.60:0/1499851591 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb4cc0c69b0 con 0x7fb4b4004800 2024-09-12T02:26:14.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.919+0000 7fb4c959a640 1 -- 172.21.15.60:0/1499851591 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb4b400baa0 con 0x7fb4b4003b70 2024-09-12T02:26:14.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.919+0000 7fb4c959a640 1 -- 172.21.15.60:0/1499851591 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb4b400bca0 con 0x7fb4cc153be0 2024-09-12T02:26:14.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.919+0000 7fb4c9d9b640 1 --2- 172.21.15.60:0/1499851591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4b4004800 0x7fb4b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:14.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.920+0000 7fb4ca59c640 1 --2- 172.21.15.60:0/1499851591 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4b4003b70 0x7fb4b4003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:14.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.920+0000 7fb4cad9d640 1 --2- 172.21.15.60:0/1499851591 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4cc153be0 0x7fb4b40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:14.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.920+0000 7fb4c9d9b640 1 -- 172.21.15.60:0/1499851591 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4cc153be0 msgr2=0x7fb4b40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:26:14.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.920+0000 7fb4c9d9b640 1 --2- 172.21.15.60:0/1499851591 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4cc153be0 0x7fb4b40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:14.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.920+0000 7fb4c9d9b640 1 -- 172.21.15.60:0/1499851591 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4b4003b70 msgr2=0x7fb4b4003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:26:14.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.920+0000 7fb4c9d9b640 1 --2- 172.21.15.60:0/1499851591 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4b4003b70 0x7fb4b4003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:14.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.920+0000 7fb4c9d9b640 1 -- 172.21.15.60:0/1499851591 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4b4003520 con 0x7fb4b4004800 2024-09-12T02:26:14.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.921+0000 7fb4c9d9b640 1 --2- 172.21.15.60:0/1499851591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4b4004800 0x7fb4b4004c80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb4c00018a0 tx=0x7fb4b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7efd9bf17c1d72d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:14.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.921+0000 7fb4c959a640 1 -- 172.21.15.60:0/1499851591 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c00014f0 con 0x7fb4b4004800 2024-09-12T02:26:14.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.921+0000 7fb4c959a640 1 -- 172.21.15.60:0/1499851591 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4c00052d0 con 0x7fb4b4004800 2024-09-12T02:26:14.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.921+0000 7fb4c959a640 1 -- 172.21.15.60:0/1499851591 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c002ac40 con 0x7fb4b4004800 2024-09-12T02:26:14.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.921+0000 7fb4d0f6d640 1 -- 172.21.15.60:0/1499851591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4b4004800 msgr2=0x7fb4b4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:14.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.921+0000 7fb4d0f6d640 1 --2- 172.21.15.60:0/1499851591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4b4004800 0x7fb4b4004c80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb4c00018a0 tx=0x7fb4b4005830 comp rx=0 tx=0).stop 2024-09-12T02:26:14.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.921+0000 7fb4cad9d640 1 -- 172.21.15.60:0/1499851591 reap_dead start 2024-09-12T02:26:14.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.922+0000 7fb4d0f6d640 1 -- 172.21.15.60:0/1499851591 shutdown_connections 2024-09-12T02:26:14.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.922+0000 7fb4d0f6d640 1 -- 172.21.15.60:0/1499851591 >> 172.21.15.60:0/1499851591 conn(0x7fb4cc0adb80 msgr2=0x7fb4cc0adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:26:14.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.922+0000 7fb4d0f6d640 1 -- 172.21.15.60:0/1499851591 shutdown_connections 2024-09-12T02:26:14.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.922+0000 7fb4d0f6d640 1 -- 172.21.15.60:0/1499851591 wait complete. 2024-09-12T02:26:14.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.923+0000 7fb4d0f6d640 1 Processor -- start 2024-09-12T02:26:14.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.923+0000 7fb4d0f6d640 1 -- start start 2024-09-12T02:26:14.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.924+0000 7fb4d0f6d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4b4004800 0x7fb4cc14cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:14.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.924+0000 7fb4d0f6d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4cc14c8c0 0x7fb4cc1ef650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:14.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.924+0000 7fb4d0f6d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4cc1efb90 0x7fb4cc0b0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:14.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.924+0000 7fb4d0f6d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb4cc0c9070 con 0x7fb4cc1efb90 2024-09-12T02:26:14.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.924+0000 7fb4d0f6d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb4cc0c8ef0 con 0x7fb4cc14c8c0 2024-09-12T02:26:14.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.924+0000 7fb4d0f6d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb4cc15a4a0 con 0x7fb4b4004800 2024-09-12T02:26:14.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.924+0000 7fb4cad9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4cc1efb90 0x7fb4cc0b0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:14.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.924+0000 7fb4cad9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4cc1efb90 0x7fb4cc0b0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50536/0 (socket says 172.21.15.60:50536) 2024-09-12T02:26:14.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.924+0000 7fb4cad9d640 1 -- 172.21.15.60:0/1850787950 learned_addr learned my addr 172.21.15.60:0/1850787950 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:26:14.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.925+0000 7fb4ca59c640 1 --2- 172.21.15.60:0/1850787950 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4b4004800 0x7fb4cc14cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:14.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.925+0000 7fb4c9d9b640 1 --2- 172.21.15.60:0/1850787950 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4cc14c8c0 0x7fb4cc1ef650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:14.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.925+0000 7fb4c9d9b640 1 -- 172.21.15.60:0/1850787950 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4b4004800 msgr2=0x7fb4cc14cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:14.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.925+0000 7fb4c9d9b640 1 --2- 172.21.15.60:0/1850787950 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4b4004800 0x7fb4cc14cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:14.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.925+0000 7fb4c9d9b640 1 -- 172.21.15.60:0/1850787950 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4cc1efb90 msgr2=0x7fb4cc0b0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:14.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.925+0000 7fb4c9d9b640 1 --2- 172.21.15.60:0/1850787950 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4cc1efb90 0x7fb4cc0b0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:14.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.925+0000 7fb4c9d9b640 1 -- 172.21.15.60:0/1850787950 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4cc1f0100 con 0x7fb4cc14c8c0 2024-09-12T02:26:14.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.925+0000 7fb4cad9d640 1 --2- 172.21.15.60:0/1850787950 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4cc1efb90 0x7fb4cc0b0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:26:14.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.925+0000 7fb4ca59c640 1 --2- 172.21.15.60:0/1850787950 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4b4004800 0x7fb4cc14cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:26:14.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.925+0000 7fb4c9d9b640 1 --2- 172.21.15.60:0/1850787950 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4cc14c8c0 0x7fb4cc1ef650 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb4c0004000 tx=0x7fb4c00012d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:14.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.925+0000 7fb4baffd640 1 -- 172.21.15.60:0/1850787950 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c0037040 con 0x7fb4cc14c8c0 2024-09-12T02:26:14.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.925+0000 7fb4baffd640 1 -- 172.21.15.60:0/1850787950 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4c0042070 con 0x7fb4cc14c8c0 2024-09-12T02:26:14.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.925+0000 7fb4baffd640 1 -- 172.21.15.60:0/1850787950 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c00014f0 con 0x7fb4cc14c8c0 2024-09-12T02:26:14.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.926+0000 7fb4d0f6d640 1 -- 172.21.15.60:0/1850787950 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4cc1f03e0 con 0x7fb4cc14c8c0 2024-09-12T02:26:14.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.926+0000 7fb4d0f6d640 1 -- 172.21.15.60:0/1850787950 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4cc1500e0 con 0x7fb4cc14c8c0 2024-09-12T02:26:14.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.927+0000 7fb4baffd640 1 -- 172.21.15.60:0/1850787950 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb4c00052d0 con 0x7fb4cc14c8c0 2024-09-12T02:26:14.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.927+0000 7fb4d0f6d640 1 -- 172.21.15.60:0/1850787950 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4cc15a860 con 0x7fb4cc14c8c0 2024-09-12T02:26:14.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.928+0000 7fb4baffd640 1 --2- 172.21.15.60:0/1850787950 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb4ac06be30 0x7fb4ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:14.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.928+0000 7fb4baffd640 1 -- 172.21.15.60:0/1850787950 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fb4c00aaff0 con 0x7fb4cc14c8c0 2024-09-12T02:26:14.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.928+0000 7fb4ca59c640 1 --2- 172.21.15.60:0/1850787950 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb4ac06be30 0x7fb4ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:14.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.929+0000 7fb4ca59c640 1 --2- 172.21.15.60:0/1850787950 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb4ac06be30 0x7fb4ac06e2f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc001200 tx=0x7fb4bc001e20 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:14.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:14.933+0000 7fb4baffd640 1 -- 172.21.15.60:0/1850787950 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb4c0078fc0 con 0x7fb4cc14c8c0 2024-09-12T02:26:15.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.226+0000 7fb4d0f6d640 1 -- 172.21.15.60:0/1850787950 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb4cc1502b0 con 0x7fb4cc14c8c0 2024-09-12T02:26:15.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.226+0000 7fb4baffd640 1 -- 172.21.15.60:0/1850787950 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7fb4c007d2c0 con 0x7fb4cc14c8c0 2024-09-12T02:26:15.227 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":30,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:26:15.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.229+0000 7fb4d0f6d640 1 -- 172.21.15.60:0/1850787950 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb4ac06be30 msgr2=0x7fb4ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:15.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.229+0000 7fb4d0f6d640 1 --2- 172.21.15.60:0/1850787950 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb4ac06be30 0x7fb4ac06e2f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc001200 tx=0x7fb4bc001e20 comp rx=0 tx=0).stop 2024-09-12T02:26:15.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.229+0000 7fb4d0f6d640 1 -- 172.21.15.60:0/1850787950 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4cc14c8c0 msgr2=0x7fb4cc1ef650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:15.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.229+0000 7fb4d0f6d640 1 --2- 172.21.15.60:0/1850787950 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4cc14c8c0 0x7fb4cc1ef650 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb4c0004000 tx=0x7fb4c00012d0 comp rx=0 tx=0).stop 2024-09-12T02:26:15.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.229+0000 7fb4d0f6d640 1 -- 172.21.15.60:0/1850787950 shutdown_connections 2024-09-12T02:26:15.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.229+0000 7fb4d0f6d640 1 --2- 172.21.15.60:0/1850787950 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb4ac06be30 0x7fb4ac06e2f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:15.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.229+0000 7fb4d0f6d640 1 --2- 172.21.15.60:0/1850787950 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4cc1efb90 0x7fb4cc0b0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:15.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.229+0000 7fb4d0f6d640 1 --2- 172.21.15.60:0/1850787950 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4cc14c8c0 0x7fb4cc1ef650 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:15.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.229+0000 7fb4d0f6d640 1 --2- 172.21.15.60:0/1850787950 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4b4004800 0x7fb4cc14cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:15.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.229+0000 7fb4d0f6d640 1 -- 172.21.15.60:0/1850787950 >> 172.21.15.60:0/1850787950 conn(0x7fb4cc0adb80 msgr2=0x7fb4cc155570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:26:15.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.229+0000 7fb4d0f6d640 1 -- 172.21.15.60:0/1850787950 shutdown_connections 2024-09-12T02:26:15.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.229+0000 7fb4d0f6d640 1 -- 172.21.15.60:0/1850787950 wait complete. 2024-09-12T02:26:15.240 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-12T02:26:15.241 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-12T02:26:15.241 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-12T02:26:15.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.347+0000 7fdf38623640 1 Processor -- start 2024-09-12T02:26:15.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.347+0000 7fdf38623640 1 -- start start 2024-09-12T02:26:15.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.348+0000 7fdf38623640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fdf30150480 0x7fdf300c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:15.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.348+0000 7fdf38623640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdf3006c650 0x7fdf300c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:15.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.348+0000 7fdf38623640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf3015a7c0 con 0x7fdf300c9c80 2024-09-12T02:26:15.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.348+0000 7fdf38623640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fdf3006c240 con 0x7fdf30150480 2024-09-12T02:26:15.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.348+0000 7fdf38623640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdf3015a330 con 0x7fdf3006c650 2024-09-12T02:26:15.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.349+0000 7fdf35bbe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdf3006c650 0x7fdf300c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:15.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.349+0000 7fdf363bf640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fdf30150480 0x7fdf300c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:15.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.349+0000 7fdf35bbe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdf3006c650 0x7fdf300c7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:33096/0 (socket says 172.21.15.60:33096) 2024-09-12T02:26:15.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.349+0000 7fdf35bbe640 1 -- 172.21.15.60:0/1550970689 learned_addr learned my addr 172.21.15.60:0/1550970689 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:26:15.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.349+0000 7fdf363bf640 1 -- 172.21.15.60:0/1550970689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdf3006c650 msgr2=0x7fdf300c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:26:15.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.349+0000 7fdf363bf640 1 --2- 172.21.15.60:0/1550970689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdf3006c650 0x7fdf300c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:15.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.349+0000 7fdf363bf640 1 -- 172.21.15.60:0/1550970689 >> v1:172.21.15.105:6789/0 conn(0x7fdf300c9c80 legacy=0x7fdf300ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:15.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.349+0000 7fdf363bf640 1 -- 172.21.15.60:0/1550970689 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf30159a00 con 0x7fdf30150480 2024-09-12T02:26:15.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.349+0000 7fdf35bbe640 1 --2- 172.21.15.60:0/1550970689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdf3006c650 0x7fdf300c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:26:15.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.350+0000 7fdf363bf640 1 --2- 172.21.15.60:0/1550970689 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf30150480 0x7fdf300c7a90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c0097a0 tx=0x7fdf2c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e8be3c2c9fefd21 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:15.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.350+0000 7fdf353bd640 1 -- 172.21.15.60:0/1550970689 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c037070 con 0x7fdf30150480 2024-09-12T02:26:15.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.350+0000 7fdf353bd640 1 -- 172.21.15.60:0/1550970689 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf2c032440 con 0x7fdf30150480 2024-09-12T02:26:15.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.350+0000 7fdf353bd640 1 -- 172.21.15.60:0/1550970689 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c032810 con 0x7fdf30150480 2024-09-12T02:26:15.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.351+0000 7fdf38623640 1 -- 172.21.15.60:0/1550970689 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf30150480 msgr2=0x7fdf300c7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:15.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.351+0000 7fdf38623640 1 --2- 172.21.15.60:0/1550970689 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf30150480 0x7fdf300c7a90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c0097a0 tx=0x7fdf2c02a180 comp rx=0 tx=0).stop 2024-09-12T02:26:15.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.351+0000 7fdf38623640 1 -- 172.21.15.60:0/1550970689 shutdown_connections 2024-09-12T02:26:15.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.351+0000 7fdf38623640 1 --2- 172.21.15.60:0/1550970689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdf3006c650 0x7fdf300c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:15.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.351+0000 7fdf38623640 1 --2- 172.21.15.60:0/1550970689 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf30150480 0x7fdf300c7a90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:15.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.351+0000 7fdf38623640 1 -- 172.21.15.60:0/1550970689 >> 172.21.15.60:0/1550970689 conn(0x7fdf30068030 msgr2=0x7fdf30073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:26:15.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.351+0000 7fdf38623640 1 -- 172.21.15.60:0/1550970689 shutdown_connections 2024-09-12T02:26:15.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.351+0000 7fdf38623640 1 -- 172.21.15.60:0/1550970689 wait complete. 2024-09-12T02:26:15.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.352+0000 7fdf38623640 1 Processor -- start 2024-09-12T02:26:15.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.352+0000 7fdf38623640 1 -- start start 2024-09-12T02:26:15.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.353+0000 7fdf38623640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf3006c650 0x7fdf301e2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:15.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.353+0000 7fdf38623640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdf300c9c80 0x7fdf3014fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:15.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.353+0000 7fdf38623640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf30150480 0x7fdf300ac420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:15.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.353+0000 7fdf38623640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdf3006d270 con 0x7fdf30150480 2024-09-12T02:26:15.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.353+0000 7fdf38623640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdf30159fc0 con 0x7fdf3006c650 2024-09-12T02:26:15.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.353+0000 7fdf38623640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdf30156270 con 0x7fdf300c9c80 2024-09-12T02:26:15.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.353+0000 7fdf36bc0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf30150480 0x7fdf300ac420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:15.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.353+0000 7fdf36bc0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf30150480 0x7fdf300ac420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50540/0 (socket says 172.21.15.60:50540) 2024-09-12T02:26:15.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.353+0000 7fdf36bc0640 1 -- 172.21.15.60:0/4053719889 learned_addr learned my addr 172.21.15.60:0/4053719889 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:26:15.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.353+0000 7fdf35bbe640 1 --2- 172.21.15.60:0/4053719889 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdf300c9c80 0x7fdf3014fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:15.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.353+0000 7fdf363bf640 1 --2- 172.21.15.60:0/4053719889 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf3006c650 0x7fdf301e2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:15.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.353+0000 7fdf36bc0640 1 -- 172.21.15.60:0/4053719889 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdf300c9c80 msgr2=0x7fdf3014fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:15.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.353+0000 7fdf36bc0640 1 --2- 172.21.15.60:0/4053719889 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdf300c9c80 0x7fdf3014fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:15.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.353+0000 7fdf36bc0640 1 -- 172.21.15.60:0/4053719889 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf3006c650 msgr2=0x7fdf301e2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:15.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.353+0000 7fdf36bc0640 1 --2- 172.21.15.60:0/4053719889 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf3006c650 0x7fdf301e2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:15.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.353+0000 7fdf36bc0640 1 -- 172.21.15.60:0/4053719889 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf30152ad0 con 0x7fdf30150480 2024-09-12T02:26:15.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.354+0000 7fdf363bf640 1 --2- 172.21.15.60:0/4053719889 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf3006c650 0x7fdf301e2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:26:15.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.354+0000 7fdf36bc0640 1 --2- 172.21.15.60:0/4053719889 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf30150480 0x7fdf300ac420 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fdf2800c6b0 tx=0x7fdf2800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:15.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.354+0000 7fdf26ffd640 1 -- 172.21.15.60:0/4053719889 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf28003b70 con 0x7fdf30150480 2024-09-12T02:26:15.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.354+0000 7fdf26ffd640 1 -- 172.21.15.60:0/4053719889 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf28003d30 con 0x7fdf30150480 2024-09-12T02:26:15.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.354+0000 7fdf26ffd640 1 -- 172.21.15.60:0/4053719889 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf28005310 con 0x7fdf30150480 2024-09-12T02:26:15.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.354+0000 7fdf38623640 1 -- 172.21.15.60:0/4053719889 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf30152d70 con 0x7fdf30150480 2024-09-12T02:26:15.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.354+0000 7fdf38623640 1 -- 172.21.15.60:0/4053719889 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf30153850 con 0x7fdf30150480 2024-09-12T02:26:15.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.355+0000 7fdf38623640 1 --2- 172.21.15.60:0/4053719889 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf301ef6a0 0x7fdf301efa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:15.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.355+0000 7fdf38623640 1 -- 172.21.15.60:0/4053719889 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdf30153160 con 0x7fdf301ef6a0 2024-09-12T02:26:15.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.355+0000 7fdf363bf640 1 --2- 172.21.15.60:0/4053719889 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf301ef6a0 0x7fdf301efa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:15.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.355+0000 7fdf363bf640 1 -- 172.21.15.60:0/4053719889 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdf30152f40 con 0x7fdf301ef6a0 2024-09-12T02:26:15.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.356+0000 7fdf363bf640 1 --2- 172.21.15.60:0/4053719889 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf301ef6a0 0x7fdf301efa80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdf300c62d0 tx=0x7fdf2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:15.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.356+0000 7fdf26ffd640 1 -- 172.21.15.60:0/4053719889 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c043070 con 0x7fdf301ef6a0 2024-09-12T02:26:15.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.356+0000 7fdf26ffd640 1 -- 172.21.15.60:0/4053719889 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdf280054b0 con 0x7fdf30150480 2024-09-12T02:26:15.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.356+0000 7fdf26ffd640 1 --2- 172.21.15.60:0/4053719889 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fdf1406bd60 0x7fdf1406e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:15.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.356+0000 7fdf26ffd640 1 -- 172.21.15.60:0/4053719889 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fdf2808ae40 con 0x7fdf30150480 2024-09-12T02:26:15.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.356+0000 7fdf35bbe640 1 --2- 172.21.15.60:0/4053719889 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fdf1406bd60 0x7fdf1406e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:15.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.357+0000 7fdf26ffd640 1 -- 172.21.15.60:0/4053719889 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fdf2c032440 con 0x7fdf301ef6a0 2024-09-12T02:26:15.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.357+0000 7fdf26ffd640 1 -- 172.21.15.60:0/4053719889 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf301ef6a0 msgr2=0x7fdf301efa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:15.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.357+0000 7fdf26ffd640 1 --2- 172.21.15.60:0/4053719889 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf301ef6a0 0x7fdf301efa80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdf300c62d0 tx=0x7fdf2c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:26:15.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.357+0000 7fdf26ffd640 1 -- 172.21.15.60:0/4053719889 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf301ef6a0 msgr2=0x7fdf301efa80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:26:15.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.357+0000 7fdf26ffd640 1 --2- 172.21.15.60:0/4053719889 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf301ef6a0 0x7fdf301efa80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:15.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.357+0000 7fdf35bbe640 1 --2- 172.21.15.60:0/4053719889 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fdf1406bd60 0x7fdf1406e220 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdf300c6720 tx=0x7fdf20009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:15.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.365+0000 7fdf38623640 1 --2- 172.21.15.60:0/4053719889 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf3014eb00 0x7fdf3014ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:15.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.365+0000 7fdf38623640 1 -- 172.21.15.60:0/4053719889 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdf3006c430 con 0x7fdf3014eb00 2024-09-12T02:26:15.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.365+0000 7fdf363bf640 1 --2- 172.21.15.60:0/4053719889 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf3014eb00 0x7fdf3014ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:15.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.365+0000 7fdf363bf640 1 -- 172.21.15.60:0/4053719889 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdf30050040 con 0x7fdf3014eb00 2024-09-12T02:26:15.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.365+0000 7fdf363bf640 1 --2- 172.21.15.60:0/4053719889 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf3014eb00 0x7fdf3014ef10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c02a1c0 tx=0x7fdf2c009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:15.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.366+0000 7fdf26ffd640 1 -- 172.21.15.60:0/4053719889 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c037040 con 0x7fdf3014eb00 2024-09-12T02:26:15.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.366+0000 7fdf26ffd640 1 -- 172.21.15.60:0/4053719889 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4550 (secure 0 0 0) 0x7fdf2c047400 con 0x7fdf3014eb00 2024-09-12T02:26:15.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.366+0000 7fdf26ffd640 1 -- 172.21.15.60:0/4053719889 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf3014eb00 msgr2=0x7fdf3014ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:15.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.366+0000 7fdf26ffd640 1 --2- 172.21.15.60:0/4053719889 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf3014eb00 0x7fdf3014ef10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c02a1c0 tx=0x7fdf2c009190 comp rx=0 tx=0).stop 2024-09-12T02:26:15.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.366+0000 7fdf26ffd640 1 -- 172.21.15.60:0/4053719889 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf3014eb00 msgr2=0x7fdf3014ef10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:26:15.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.366+0000 7fdf26ffd640 1 --2- 172.21.15.60:0/4053719889 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf3014eb00 0x7fdf3014ef10 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:15.367 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:26:15.367 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:26:15.367 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:26:15.367 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:26:15.367 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 30, 2024-09-12T02:26:15.368 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 15475, 2024-09-12T02:26:15.368 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:26:15.368 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:26:15.368 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:26:15.368 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:26:15.368 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:15.368 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-09-12T02:26:15.368 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:26:15.368 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:26:15.368 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:26:15.368 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:26:15.368 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:26:15.368 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:26:15.369 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:26:15.369 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:26:15.369 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:26:15.369 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:26:15.369 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:26:15.369 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:26:15.369 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:26:15.369 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:26:15.369 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:15.369 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:26:15.369 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:26:15.370 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:26:15.370 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:26:15.370 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:26:15.370 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:26:15.370 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:26:15.370 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:26:15.370 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:26:15.370 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:26:15.370 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:26:15.370 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:26:15.370 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:26:15.370 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:15.370 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:15.371 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:26:15.371 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:26:15.371 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:26:15.371 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:26:15.371 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:26:15.371 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:26:15.371 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:26:15.371 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:26:15.371 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:26:15.371 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:26:15.371 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:26:15.371 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:26:15.371 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:26:15.371 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:26:15.372 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:26:15.372 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:26:15.372 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:26:15.372 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:26:15.372 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:26:15.372 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:26:15.372 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:26:15.372 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:26:15.372 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:26:15.372 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:26:15.372 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:26:15.372 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:26:15.372 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:26:15.373 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:26:15.373 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:15.373 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:26:15.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:15.373 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:26:15.373 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:15.373 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:26:15.373 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:26:15.373 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:26:15.373 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:26:15.373 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:15.373 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:26:15.373 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:26:15.374 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:15.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:15.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:15.374 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:26:15.374 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:26:15.374 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:15.374 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:15.374 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:15.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:15.374 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:26:15.374 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:26:15.374 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:26:15.374 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:26:15.374 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:26:15.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:15.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:15.375 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:26:15.375 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:26:15.375 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:26:15.375 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:26:15.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:15.375 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:26:15.375 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:26:15.375 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:15.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:15.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:15.375 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:26:15.376 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:26:15.376 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:15.376 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:15.376 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:15.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:15.376 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:26:15.376 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:26:15.376 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:26:15.376 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:26:15.376 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:26:15.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:15.376 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:15.376 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:26:15.377 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:26:15.377 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:26:15.377 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:26:15.377 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:15.377 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:26:15.377 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:26:15.377 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:15.377 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:15.377 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:15.378 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:26:15.378 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:26:15.378 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:15.378 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:15.378 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:15.378 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:15.378 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:26:15.378 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:26:15.378 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:26:15.379 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:26:15.379 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:26:15.379 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:15.379 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:15.379 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:15.379 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:26:15.379 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:26:15.379 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:15.379 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:26:15.379 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:26:15.379 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:26:15.379 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:15.379 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:15.379 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:26:15.380 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:15.380 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:26:15.380 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:26:15.380 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:26:15.380 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:15.380 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:15.380 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:15.380 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:26:15.380 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:26:15.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.366+0000 7fdf38623640 1 -- 172.21.15.60:0/4053719889 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fdf1406bd60 msgr2=0x7fdf1406e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:15.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.366+0000 7fdf38623640 1 --2- 172.21.15.60:0/4053719889 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fdf1406bd60 0x7fdf1406e220 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdf300c6720 tx=0x7fdf20009240 comp rx=0 tx=0).stop 2024-09-12T02:26:15.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.366+0000 7fdf38623640 1 -- 172.21.15.60:0/4053719889 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf30150480 msgr2=0x7fdf300ac420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:15.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.366+0000 7fdf38623640 1 --2- 172.21.15.60:0/4053719889 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf30150480 0x7fdf300ac420 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fdf2800c6b0 tx=0x7fdf2800cb70 comp rx=0 tx=0).stop 2024-09-12T02:26:15.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.366+0000 7fdf36bc0640 1 -- 172.21.15.60:0/4053719889 reap_dead start 2024-09-12T02:26:15.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.366+0000 7fdf36bc0640 1 -- 172.21.15.60:0/4053719889 reap_dead start 2024-09-12T02:26:15.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.366+0000 7fdf38623640 1 -- 172.21.15.60:0/4053719889 shutdown_connections 2024-09-12T02:26:15.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.366+0000 7fdf38623640 1 -- 172.21.15.60:0/4053719889 >> 172.21.15.60:0/4053719889 conn(0x7fdf30068030 msgr2=0x7fdf30073310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:26:15.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.366+0000 7fdf38623640 1 -- 172.21.15.60:0/4053719889 shutdown_connections 2024-09-12T02:26:15.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.366+0000 7fdf38623640 1 -- 172.21.15.60:0/4053719889 wait complete. 2024-09-12T02:26:15.383 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:26:15.383 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-12T02:26:15.383 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-12T02:26:15.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.502+0000 7f682a7af640 1 Processor -- start 2024-09-12T02:26:15.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.502+0000 7f682a7af640 1 -- start start 2024-09-12T02:26:15.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.503+0000 7f682a7af640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f68240addf0 0x7f68240acb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:15.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.503+0000 7f682a7af640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68240c3e60 con 0x7f68240c59d0 2024-09-12T02:26:15.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.503+0000 7f682a7af640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68240c8580 con 0x7f68240c55f0 2024-09-12T02:26:15.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.503+0000 7f682a7af640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f68240c4120 con 0x7f68240addf0 2024-09-12T02:26:15.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.503+0000 7f6828d4c640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f68240c59d0 0x7f6824157c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47864/0 (socket says 172.21.15.60:47864) 2024-09-12T02:26:15.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.503+0000 7f6828d4c640 1 -- 172.21.15.60:0/2641348202 learned_addr learned my addr 172.21.15.60:0/2641348202 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:26:15.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.503+0000 7f68237fe640 1 --2- 172.21.15.60:0/2641348202 >> v2:172.21.15.105:3300/0 conn(0x7f68240addf0 0x7f68240acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:15.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.504+0000 7f6822ffd640 1 -- 172.21.15.60:0/2641348202 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2055088288 0 0) 0x7f68240c3e60 con 0x7f68240c59d0 2024-09-12T02:26:15.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.504+0000 7f6822ffd640 1 -- 172.21.15.60:0/2641348202 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f680c003520 con 0x7f68240c59d0 2024-09-12T02:26:15.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.504+0000 7f68237fe640 1 -- 172.21.15.60:0/2641348202 >> v1:172.21.15.105:6789/0 conn(0x7f68240c55f0 legacy=0x7f68240ac470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:15.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.504+0000 7f68237fe640 1 -- 172.21.15.60:0/2641348202 >> v1:172.21.15.60:6789/0 conn(0x7f68240c59d0 legacy=0x7f6824157c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:15.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.504+0000 7f68237fe640 1 -- 172.21.15.60:0/2641348202 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68240c4400 con 0x7f68240addf0 2024-09-12T02:26:15.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.505+0000 7f68237fe640 1 --2- 172.21.15.60:0/2641348202 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68240addf0 0x7f68240acb80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f68180097a0 tx=0x7f681802a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f32d2b42e83595f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:15.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.505+0000 7f6822ffd640 1 -- 172.21.15.60:0/2641348202 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6818037070 con 0x7f68240addf0 2024-09-12T02:26:15.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.505+0000 7f6822ffd640 1 -- 172.21.15.60:0/2641348202 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6818032440 con 0x7f68240addf0 2024-09-12T02:26:15.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.505+0000 7f6822ffd640 1 -- 172.21.15.60:0/2641348202 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f681802ae60 con 0x7f68240addf0 2024-09-12T02:26:15.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.505+0000 7f682a7af640 1 -- 172.21.15.60:0/2641348202 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68240addf0 msgr2=0x7f68240acb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:15.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.505+0000 7f682a7af640 1 --2- 172.21.15.60:0/2641348202 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68240addf0 0x7f68240acb80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f68180097a0 tx=0x7f681802a110 comp rx=0 tx=0).stop 2024-09-12T02:26:15.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.505+0000 7f682a7af640 1 -- 172.21.15.60:0/2641348202 shutdown_connections 2024-09-12T02:26:15.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.505+0000 7f682a7af640 1 --2- 172.21.15.60:0/2641348202 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68240addf0 0x7f68240acb80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:15.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.505+0000 7f682a7af640 1 -- 172.21.15.60:0/2641348202 >> 172.21.15.60:0/2641348202 conn(0x7f68240c8a50 msgr2=0x7f68240c8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:26:15.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.506+0000 7f682a7af640 1 -- 172.21.15.60:0/2641348202 shutdown_connections 2024-09-12T02:26:15.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.506+0000 7f682a7af640 1 -- 172.21.15.60:0/2641348202 wait complete. 2024-09-12T02:26:15.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.507+0000 7f682a7af640 1 Processor -- start 2024-09-12T02:26:15.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.507+0000 7f682a7af640 1 -- start start 2024-09-12T02:26:15.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.508+0000 7f682a7af640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68240addf0 0x7f68240c0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:15.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.508+0000 7f682a7af640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68240c55f0 0x7f68240726d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:15.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.508+0000 7f682a7af640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68240c59d0 0x7f6824151d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:15.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.508+0000 7f682a7af640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f68240c35d0 con 0x7f68240addf0 2024-09-12T02:26:15.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.508+0000 7f682a7af640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f68240c3450 con 0x7f68240c55f0 2024-09-12T02:26:15.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.508+0000 7f682a7af640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f68240abb00 con 0x7f68240c59d0 2024-09-12T02:26:15.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.508+0000 7f6823fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68240addf0 0x7f68240c0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:15.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.508+0000 7f6823fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68240addf0 0x7f68240c0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50556/0 (socket says 172.21.15.60:50556) 2024-09-12T02:26:15.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.508+0000 7f6823fff640 1 -- 172.21.15.60:0/288230625 learned_addr learned my addr 172.21.15.60:0/288230625 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:26:15.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.508+0000 7f68237fe640 1 --2- 172.21.15.60:0/288230625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68240c55f0 0x7f68240726d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:15.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.508+0000 7f6828d4c640 1 --2- 172.21.15.60:0/288230625 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68240c59d0 0x7f6824151d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:15.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.509+0000 7f6823fff640 1 -- 172.21.15.60:0/288230625 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68240c59d0 msgr2=0x7f6824151d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:15.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.509+0000 7f6823fff640 1 --2- 172.21.15.60:0/288230625 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68240c59d0 0x7f6824151d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:15.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.509+0000 7f6823fff640 1 -- 172.21.15.60:0/288230625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68240c55f0 msgr2=0x7f68240726d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:15.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.509+0000 7f6823fff640 1 --2- 172.21.15.60:0/288230625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68240c55f0 0x7f68240726d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:15.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.509+0000 7f6823fff640 1 -- 172.21.15.60:0/288230625 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68241ec930 con 0x7f68240addf0 2024-09-12T02:26:15.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.509+0000 7f6823fff640 1 --2- 172.21.15.60:0/288230625 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68240addf0 0x7f68240c0790 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f681400c450 tx=0x7f681400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:15.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.509+0000 7f6820ff9640 1 -- 172.21.15.60:0/288230625 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6814017070 con 0x7f68240addf0 2024-09-12T02:26:15.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.509+0000 7f6820ff9640 1 -- 172.21.15.60:0/288230625 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68140052d0 con 0x7f68240addf0 2024-09-12T02:26:15.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.509+0000 7f6820ff9640 1 -- 172.21.15.60:0/288230625 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6814003830 con 0x7f68240addf0 2024-09-12T02:26:15.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.510+0000 7f682a7af640 1 -- 172.21.15.60:0/288230625 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68240c0cd0 con 0x7f68240addf0 2024-09-12T02:26:15.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.510+0000 7f682a7af640 1 -- 172.21.15.60:0/288230625 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68240a8b80 con 0x7f68240addf0 2024-09-12T02:26:15.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.511+0000 7f682a7af640 1 --2- 172.21.15.60:0/288230625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68241ecec0 0x7f6824152240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:15.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.511+0000 7f682a7af640 1 -- 172.21.15.60:0/288230625 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6824069a00 con 0x7f68241ecec0 2024-09-12T02:26:15.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.511+0000 7f68237fe640 1 --2- 172.21.15.60:0/288230625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68241ecec0 0x7f6824152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:15.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.511+0000 7f68237fe640 1 -- 172.21.15.60:0/288230625 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f68240ac470 con 0x7f68241ecec0 2024-09-12T02:26:15.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.511+0000 7f68237fe640 1 --2- 172.21.15.60:0/288230625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68241ecec0 0x7f6824152240 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f68240c50f0 tx=0x7f68180046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:15.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.512+0000 7f6820ff9640 1 -- 172.21.15.60:0/288230625 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f681401a070 con 0x7f68240addf0 2024-09-12T02:26:15.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.512+0000 7f6820ff9640 1 --2- 172.21.15.60:0/288230625 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f681006be30 0x7f681006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:15.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.512+0000 7f6820ff9640 1 -- 172.21.15.60:0/288230625 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f681408a450 con 0x7f68240addf0 2024-09-12T02:26:15.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.512+0000 7f6828d4c640 1 --2- 172.21.15.60:0/288230625 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f681006be30 0x7f681006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:15.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.512+0000 7f6820ff9640 1 -- 172.21.15.60:0/288230625 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6818041030 con 0x7f68241ecec0 2024-09-12T02:26:15.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.512+0000 7f6820ff9640 1 -- 172.21.15.60:0/288230625 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f6818038040 con 0x7f68241ecec0 2024-09-12T02:26:15.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.513+0000 7f6820ff9640 1 -- 172.21.15.60:0/288230625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68241ecec0 msgr2=0x7f6824152240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:15.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.513+0000 7f6820ff9640 1 --2- 172.21.15.60:0/288230625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68241ecec0 0x7f6824152240 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f68240c50f0 tx=0x7f68180046c0 comp rx=0 tx=0).stop 2024-09-12T02:26:15.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.513+0000 7f6820ff9640 1 -- 172.21.15.60:0/288230625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68241ecec0 msgr2=0x7f6824152240 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:26:15.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.513+0000 7f6820ff9640 1 --2- 172.21.15.60:0/288230625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68241ecec0 0x7f6824152240 secure :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f68240c50f0 tx=0x7f68180046c0 comp rx=0 tx=0).stop 2024-09-12T02:26:15.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.513+0000 7f6828d4c640 1 --2- 172.21.15.60:0/288230625 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f681006be30 0x7f681006e2f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f681c001560 tx=0x7f681c001970 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:15.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.519+0000 7f682a7af640 1 --2- 172.21.15.60:0/288230625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68241ec400 0x7f68241ef580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:15.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.519+0000 7f682a7af640 1 -- 172.21.15.60:0/288230625 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f68240704c0 con 0x7f68241ec400 2024-09-12T02:26:15.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.519+0000 7f68237fe640 1 --2- 172.21.15.60:0/288230625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68241ec400 0x7f68241ef580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:15.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.520+0000 7f68237fe640 1 -- 172.21.15.60:0/288230625 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f68240c7650 con 0x7f68241ec400 2024-09-12T02:26:15.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.520+0000 7f68237fe640 1 --2- 172.21.15.60:0/288230625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68241ec400 0x7f68241ef580 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f681802a150 tx=0x7f6818008030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:15.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.520+0000 7f6820ff9640 1 -- 172.21.15.60:0/288230625 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6818041050 con 0x7f68241ec400 2024-09-12T02:26:15.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.520+0000 7f6820ff9640 1 -- 172.21.15.60:0/288230625 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5050 (secure 0 0 0) 0x7f68180093c0 con 0x7f68241ec400 2024-09-12T02:26:15.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.520+0000 7f6820ff9640 1 -- 172.21.15.60:0/288230625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68241ec400 msgr2=0x7f68241ef580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:15.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.520+0000 7f6820ff9640 1 --2- 172.21.15.60:0/288230625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68241ec400 0x7f68241ef580 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f681802a150 tx=0x7f6818008030 comp rx=0 tx=0).stop 2024-09-12T02:26:15.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.520+0000 7f6820ff9640 1 -- 172.21.15.60:0/288230625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68241ec400 msgr2=0x7f68241ef580 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:26:15.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.520+0000 7f6820ff9640 1 --2- 172.21.15.60:0/288230625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68241ec400 0x7f68241ef580 secure :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f681802a150 tx=0x7f6818008030 comp rx=0 tx=0).stop 2024-09-12T02:26:15.522 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:26:15.522 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:26:15.522 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:26:15.522 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:26:15.522 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 30, 2024-09-12T02:26:15.522 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 120954, 2024-09-12T02:26:15.522 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:26:15.523 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:26:15.523 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:26:15.523 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:26:15.523 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:15.523 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-09-12T02:26:15.523 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:26:15.523 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:26:15.523 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:26:15.523 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:26:15.523 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:26:15.523 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:26:15.523 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:26:15.523 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:26:15.524 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:26:15.524 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:26:15.524 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:26:15.524 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:26:15.524 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:26:15.524 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:26:15.524 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:15.524 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:26:15.524 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:26:15.524 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:26:15.524 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:26:15.524 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:26:15.524 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:26:15.525 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:26:15.525 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:26:15.525 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:26:15.525 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:26:15.525 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:26:15.525 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:26:15.525 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:26:15.525 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:15.525 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:15.525 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:26:15.525 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:26:15.525 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:26:15.525 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:26:15.526 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:26:15.526 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:26:15.526 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:26:15.526 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:26:15.526 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:26:15.526 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:26:15.526 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:26:15.526 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:26:15.526 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:26:15.526 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:26:15.526 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:26:15.526 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:26:15.526 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:26:15.526 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:26:15.527 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:26:15.527 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:26:15.527 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:26:15.527 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:26:15.527 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:26:15.527 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:26:15.527 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:26:15.527 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:26:15.527 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:26:15.527 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:26:15.527 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:15.527 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:26:15.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:15.527 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:26:15.528 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:15.528 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:26:15.528 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:26:15.528 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:26:15.528 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:26:15.528 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:15.528 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:26:15.528 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:26:15.528 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:15.528 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:15.528 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:15.528 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:26:15.528 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:26:15.529 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:15.529 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:15.529 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:15.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:15.529 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:26:15.529 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:26:15.529 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:26:15.529 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:26:15.529 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:26:15.530 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:15.530 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:15.530 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:26:15.530 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:26:15.530 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:26:15.530 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:26:15.530 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:15.530 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:26:15.530 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:26:15.530 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:15.530 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:15.530 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:15.531 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:26:15.531 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:26:15.531 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:15.531 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:15.531 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:15.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:15.531 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:26:15.531 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:26:15.531 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:26:15.531 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:26:15.532 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:26:15.532 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:15.532 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:15.532 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:26:15.532 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:26:15.532 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:26:15.532 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:26:15.532 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:15.532 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:26:15.532 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:26:15.532 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:15.532 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:15.532 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:15.532 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:26:15.532 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:26:15.533 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:15.533 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:15.533 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:15.533 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:15.533 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:26:15.533 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:26:15.533 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:26:15.533 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:26:15.533 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:26:15.533 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:15.533 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:15.533 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:15.534 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:26:15.534 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:26:15.534 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:15.534 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:26:15.534 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:26:15.534 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:26:15.534 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:15.534 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:15.534 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:26:15.534 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:15.534 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:26:15.534 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:26:15.534 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:26:15.535 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:15.535 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:15.535 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:26:15.535 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:15.535 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:26:15.535 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:26:15.535 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:26:15.535 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:15.535 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:15.535 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:26:15.535 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:15.535 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:26:15.535 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:26:15.536 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:26:15.536 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:15.536 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:15.536 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:26:15.536 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:15.536 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:26:15.536 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:26:15.536 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:26:15.536 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:15.536 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:15.536 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:15.536 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:26:15.536 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:26:15.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.521+0000 7f682a7af640 1 -- 172.21.15.60:0/288230625 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f681006be30 msgr2=0x7f681006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:15.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.521+0000 7f682a7af640 1 --2- 172.21.15.60:0/288230625 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f681006be30 0x7f681006e2f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f681c001560 tx=0x7f681c001970 comp rx=0 tx=0).stop 2024-09-12T02:26:15.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.521+0000 7f682a7af640 1 -- 172.21.15.60:0/288230625 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68240addf0 msgr2=0x7f68240c0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:15.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.521+0000 7f682a7af640 1 --2- 172.21.15.60:0/288230625 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68240addf0 0x7f68240c0790 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f681400c450 tx=0x7f681400c910 comp rx=0 tx=0).stop 2024-09-12T02:26:15.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.521+0000 7f6828d4c640 1 -- 172.21.15.60:0/288230625 reap_dead start 2024-09-12T02:26:15.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.521+0000 7f682a7af640 1 -- 172.21.15.60:0/288230625 shutdown_connections 2024-09-12T02:26:15.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.521+0000 7f682a7af640 1 --2- 172.21.15.60:0/288230625 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68240addf0 0x7f68240c0790 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:15.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.521+0000 7f682a7af640 1 -- 172.21.15.60:0/288230625 >> 172.21.15.60:0/288230625 conn(0x7f68240c8a50 msgr2=0x7f6824156c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:26:15.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.521+0000 7f682a7af640 1 -- 172.21.15.60:0/288230625 shutdown_connections 2024-09-12T02:26:15.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.521+0000 7f682a7af640 1 -- 172.21.15.60:0/288230625 wait complete. 2024-09-12T02:26:15.539 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:26:15.539 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-12T02:26:15.539 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-12T02:26:15.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.656+0000 7f6a03827640 1 Processor -- start 2024-09-12T02:26:15.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.656+0000 7f6a03827640 1 -- start start 2024-09-12T02:26:15.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.657+0000 7f6a03827640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f69fc0c7a70 0x7f69fc0744a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:15.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.657+0000 7f6a03827640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f69fc158300 0x7f69fc0c8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:15.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.657+0000 7f6a03827640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69fc154e00 con 0x7f69fc0c7e50 2024-09-12T02:26:15.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.657+0000 7f6a03827640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f69fc0c4ba0 con 0x7f69fc158300 2024-09-12T02:26:15.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.657+0000 7f6a03827640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f69fc0c50e0 con 0x7f69fc0c7a70 2024-09-12T02:26:15.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.657+0000 7f6a01dc4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f69fc158300 0x7f69fc0c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:15.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.657+0000 7f6a01dc4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f69fc158300 0x7f69fc0c8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50560/0 (socket says 172.21.15.60:50560) 2024-09-12T02:26:15.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.657+0000 7f6a00dc2640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f69fc0c7e50 0x7f69fc157bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47878/0 (socket says 172.21.15.60:47878) 2024-09-12T02:26:15.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.657+0000 7f6a01dc4640 1 -- 172.21.15.60:0/3369717550 learned_addr learned my addr 172.21.15.60:0/3369717550 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:26:15.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.657+0000 7f6a015c3640 1 --2- 172.21.15.60:0/3369717550 >> v2:172.21.15.105:3300/0 conn(0x7f69fc0c7a70 0x7f69fc0744a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:15.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.657+0000 7f6a01dc4640 1 -- 172.21.15.60:0/3369717550 >> v2:172.21.15.105:3300/0 conn(0x7f69fc0c7a70 msgr2=0x7f69fc0744a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:26:15.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.657+0000 7f6a01dc4640 1 --2- 172.21.15.60:0/3369717550 >> v2:172.21.15.105:3300/0 conn(0x7f69fc0c7a70 0x7f69fc0744a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:15.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.657+0000 7f6a01dc4640 1 -- 172.21.15.60:0/3369717550 >> v1:172.21.15.60:6789/0 conn(0x7f69fc0c7e50 legacy=0x7f69fc157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:15.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.657+0000 7f69f3fff640 1 -- 172.21.15.60:0/3369717550 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2239252836 0 0) 0x7f69fc154e00 con 0x7f69fc0c7e50 2024-09-12T02:26:15.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.657+0000 7f6a01dc4640 1 -- 172.21.15.60:0/3369717550 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69fc1576d0 con 0x7f69fc158300 2024-09-12T02:26:15.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.658+0000 7f6a01dc4640 1 --2- 172.21.15.60:0/3369717550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69fc158300 0x7f69fc0c8270 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f69fc068700 tx=0x7f69f402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae7a0aa462bc0136 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:15.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.658+0000 7f69f3fff640 1 -- 172.21.15.60:0/3369717550 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f4036070 con 0x7f69fc158300 2024-09-12T02:26:15.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.658+0000 7f69f3fff640 1 -- 172.21.15.60:0/3369717550 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69f4031600 con 0x7f69fc158300 2024-09-12T02:26:15.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.658+0000 7f69f3fff640 1 -- 172.21.15.60:0/3369717550 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f40319d0 con 0x7f69fc158300 2024-09-12T02:26:15.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.659+0000 7f6a03827640 1 -- 172.21.15.60:0/3369717550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69fc158300 msgr2=0x7f69fc0c8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:15.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.659+0000 7f6a03827640 1 --2- 172.21.15.60:0/3369717550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69fc158300 0x7f69fc0c8270 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f69fc068700 tx=0x7f69f402a730 comp rx=0 tx=0).stop 2024-09-12T02:26:15.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.659+0000 7f6a03827640 1 -- 172.21.15.60:0/3369717550 shutdown_connections 2024-09-12T02:26:15.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.659+0000 7f6a03827640 1 --2- 172.21.15.60:0/3369717550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69fc158300 0x7f69fc0c8270 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:15.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.659+0000 7f6a03827640 1 --2- 172.21.15.60:0/3369717550 >> v2:172.21.15.105:3300/0 conn(0x7f69fc0c7a70 0x7f69fc0744a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:15.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.659+0000 7f6a03827640 1 -- 172.21.15.60:0/3369717550 >> 172.21.15.60:0/3369717550 conn(0x7f69fc0c5660 msgr2=0x7f69fc0c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:26:15.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.659+0000 7f6a03827640 1 -- 172.21.15.60:0/3369717550 shutdown_connections 2024-09-12T02:26:15.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.659+0000 7f6a03827640 1 -- 172.21.15.60:0/3369717550 wait complete. 2024-09-12T02:26:15.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.661+0000 7f6a03827640 1 Processor -- start 2024-09-12T02:26:15.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.661+0000 7f6a03827640 1 -- start start 2024-09-12T02:26:15.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.661+0000 7f6a03827640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69fc0c7a70 0x7f69fc06c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:15.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.661+0000 7f6a03827640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69fc0c7e50 0x7f69fc14fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:15.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.661+0000 7f6a03827640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69fc158300 0x7f69fc1501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:15.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.661+0000 7f6a03827640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f69fc071bb0 con 0x7f69fc158300 2024-09-12T02:26:15.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.661+0000 7f6a03827640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f69fc0c53c0 con 0x7f69fc0c7a70 2024-09-12T02:26:15.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.661+0000 7f6a03827640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f69fc071d30 con 0x7f69fc0c7e50 2024-09-12T02:26:15.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.661+0000 7f6a015c3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69fc0c7a70 0x7f69fc06c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:15.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.661+0000 7f6a01dc4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69fc158300 0x7f69fc1501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:15.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.661+0000 7f6a015c3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69fc0c7a70 0x7f69fc06c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:43052/0 (socket says 172.21.15.60:43052) 2024-09-12T02:26:15.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.662+0000 7f6a01dc4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69fc158300 0x7f69fc1501f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50572/0 (socket says 172.21.15.60:50572) 2024-09-12T02:26:15.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.662+0000 7f6a015c3640 1 -- 172.21.15.60:0/2388782632 learned_addr learned my addr 172.21.15.60:0/2388782632 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:26:15.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.662+0000 7f6a00dc2640 1 --2- 172.21.15.60:0/2388782632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69fc0c7e50 0x7f69fc14fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:15.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.662+0000 7f6a01dc4640 1 -- 172.21.15.60:0/2388782632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69fc0c7e50 msgr2=0x7f69fc14fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:15.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.662+0000 7f6a01dc4640 1 --2- 172.21.15.60:0/2388782632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69fc0c7e50 0x7f69fc14fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:15.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.662+0000 7f6a01dc4640 1 -- 172.21.15.60:0/2388782632 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69fc0c7a70 msgr2=0x7f69fc06c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:15.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.662+0000 7f6a01dc4640 1 --2- 172.21.15.60:0/2388782632 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69fc0c7a70 0x7f69fc06c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:15.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.662+0000 7f6a01dc4640 1 -- 172.21.15.60:0/2388782632 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69fc1dfd00 con 0x7f69fc158300 2024-09-12T02:26:15.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.662+0000 7f6a015c3640 1 --2- 172.21.15.60:0/2388782632 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69fc0c7a70 0x7f69fc06c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:26:15.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.662+0000 7f6a01dc4640 1 --2- 172.21.15.60:0/2388782632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69fc158300 0x7f69fc1501f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f69f4030000 tx=0x7f69f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:15.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.662+0000 7f69f1ffb640 1 -- 172.21.15.60:0/2388782632 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f4047070 con 0x7f69fc158300 2024-09-12T02:26:15.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.662+0000 7f69f1ffb640 1 -- 172.21.15.60:0/2388782632 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69f403ab50 con 0x7f69fc158300 2024-09-12T02:26:15.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.662+0000 7f69f1ffb640 1 -- 172.21.15.60:0/2388782632 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f4009510 con 0x7f69fc158300 2024-09-12T02:26:15.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.662+0000 7f6a03827640 1 -- 172.21.15.60:0/2388782632 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69fc1dffe0 con 0x7f69fc158300 2024-09-12T02:26:15.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.663+0000 7f6a03827640 1 -- 172.21.15.60:0/2388782632 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69fc1562b0 con 0x7f69fc158300 2024-09-12T02:26:15.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.663+0000 7f6a03827640 1 --2- 172.21.15.60:0/2388782632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69fc150dc0 0x7f69fc1ed460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:15.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.663+0000 7f6a03827640 1 -- 172.21.15.60:0/2388782632 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f69fc06f8e0 con 0x7f69fc150dc0 2024-09-12T02:26:15.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.664+0000 7f6a015c3640 1 --2- 172.21.15.60:0/2388782632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69fc150dc0 0x7f69fc1ed460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:15.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.664+0000 7f69f1ffb640 1 -- 172.21.15.60:0/2388782632 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f69f404a070 con 0x7f69fc158300 2024-09-12T02:26:15.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.664+0000 7f6a015c3640 1 -- 172.21.15.60:0/2388782632 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f69fc150be0 con 0x7f69fc150dc0 2024-09-12T02:26:15.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.664+0000 7f6a015c3640 1 --2- 172.21.15.60:0/2388782632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69fc150dc0 0x7f69fc1ed460 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f69f8011db0 tx=0x7f69f800f610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:15.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.664+0000 7f69f1ffb640 1 --2- 172.21.15.60:0/2388782632 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f69e006be30 0x7f69e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:15.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.665+0000 7f69f1ffb640 1 -- 172.21.15.60:0/2388782632 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f69f40aef10 con 0x7f69fc158300 2024-09-12T02:26:15.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.665+0000 7f6a00dc2640 1 --2- 172.21.15.60:0/2388782632 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f69e006be30 0x7f69e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:15.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.665+0000 7f69f1ffb640 1 -- 172.21.15.60:0/2388782632 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f8004030 con 0x7f69fc150dc0 2024-09-12T02:26:15.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.665+0000 7f69f1ffb640 1 -- 172.21.15.60:0/2388782632 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f69f8004030 con 0x7f69fc150dc0 2024-09-12T02:26:15.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.665+0000 7f69f1ffb640 1 -- 172.21.15.60:0/2388782632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69fc150dc0 msgr2=0x7f69fc1ed460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:15.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.665+0000 7f69f1ffb640 1 --2- 172.21.15.60:0/2388782632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69fc150dc0 0x7f69fc1ed460 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f69f8011db0 tx=0x7f69f800f610 comp rx=0 tx=0).stop 2024-09-12T02:26:15.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.665+0000 7f69f1ffb640 1 -- 172.21.15.60:0/2388782632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69fc150dc0 msgr2=0x7f69fc1ed460 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:26:15.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.665+0000 7f69f1ffb640 1 --2- 172.21.15.60:0/2388782632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69fc150dc0 0x7f69fc1ed460 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:15.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.665+0000 7f6a00dc2640 1 --2- 172.21.15.60:0/2388782632 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f69e006be30 0x7f69e006e2f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f69fc0749e0 tx=0x7f69ec007d50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:15.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.672+0000 7f6a03827640 1 --2- 172.21.15.60:0/2388782632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69fc1ed9a0 0x7f69fc152f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:15.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.672+0000 7f6a03827640 1 -- 172.21.15.60:0/2388782632 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f69fc06d420 con 0x7f69fc1ed9a0 2024-09-12T02:26:15.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.672+0000 7f6a015c3640 1 --2- 172.21.15.60:0/2388782632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69fc1ed9a0 0x7f69fc152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:15.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.673+0000 7f6a015c3640 1 -- 172.21.15.60:0/2388782632 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f69fc069190 con 0x7f69fc1ed9a0 2024-09-12T02:26:15.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.673+0000 7f6a015c3640 1 --2- 172.21.15.60:0/2388782632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69fc1ed9a0 0x7f69fc152f80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f69f801b000 tx=0x7f69f80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:15.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.673+0000 7f69f1ffb640 1 -- 172.21.15.60:0/2388782632 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f8014910 con 0x7f69fc1ed9a0 2024-09-12T02:26:15.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.673+0000 7f69f1ffb640 1 -- 172.21.15.60:0/2388782632 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5050 (secure 0 0 0) 0x7f69f80133a0 con 0x7f69fc1ed9a0 2024-09-12T02:26:15.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.673+0000 7f69f1ffb640 1 -- 172.21.15.60:0/2388782632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69fc1ed9a0 msgr2=0x7f69fc152f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:15.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.673+0000 7f69f1ffb640 1 --2- 172.21.15.60:0/2388782632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69fc1ed9a0 0x7f69fc152f80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f69f801b000 tx=0x7f69f80046c0 comp rx=0 tx=0).stop 2024-09-12T02:26:15.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.674+0000 7f69f1ffb640 1 -- 172.21.15.60:0/2388782632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69fc1ed9a0 msgr2=0x7f69fc152f80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:26:15.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.674+0000 7f69f1ffb640 1 --2- 172.21.15.60:0/2388782632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69fc1ed9a0 0x7f69fc152f80 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:15.675 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:26:15.675 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:26:15.675 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:26:15.675 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:26:15.675 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 30, 2024-09-12T02:26:15.675 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 220988, 2024-09-12T02:26:15.675 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:26:15.675 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:26:15.675 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:26:15.675 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:26:15.675 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:15.676 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-09-12T02:26:15.676 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:26:15.676 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:26:15.676 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:26:15.676 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:26:15.676 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:26:15.676 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:26:15.676 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:26:15.676 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:26:15.676 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:26:15.676 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:26:15.676 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:26:15.676 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:26:15.676 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:26:15.677 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:26:15.677 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:15.677 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:26:15.677 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:26:15.677 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:26:15.677 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:26:15.680 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:26:15.680 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:26:15.680 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:26:15.680 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:26:15.680 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:26:15.680 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:26:15.680 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:26:15.680 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:26:15.680 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:26:15.680 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:15.681 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:15.681 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:26:15.681 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:26:15.681 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:26:15.681 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:26:15.681 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:26:15.681 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:26:15.681 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:26:15.681 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:26:15.681 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:26:15.681 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:26:15.681 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:26:15.681 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:26:15.681 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:26:15.682 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:26:15.682 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:26:15.682 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:26:15.682 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:26:15.682 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:26:15.682 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:26:15.682 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:26:15.682 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:26:15.682 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:26:15.682 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:26:15.682 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:26:15.682 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:26:15.682 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:26:15.682 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:26:15.683 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:26:15.683 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:15.683 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:26:15.683 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:15.683 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:26:15.683 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:15.683 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:26:15.683 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:26:15.683 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:26:15.683 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:26:15.683 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:15.683 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:26:15.683 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:26:15.683 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:15.684 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:15.684 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:15.684 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:26:15.684 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:26:15.684 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:15.684 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:15.684 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:15.684 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:15.684 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:26:15.684 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:26:15.684 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:26:15.684 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:26:15.684 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:26:15.684 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:15.685 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:15.685 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:26:15.685 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:26:15.685 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:26:15.685 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:26:15.685 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:15.685 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:26:15.685 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:26:15.685 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:15.685 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:15.685 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:15.685 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:26:15.685 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:26:15.686 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:15.686 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:15.686 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:15.686 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:15.686 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:26:15.686 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:26:15.686 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:26:15.686 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:26:15.686 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:26:15.686 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:15.686 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:15.686 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:26:15.686 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:26:15.687 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:26:15.687 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:26:15.687 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:15.687 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:26:15.687 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:26:15.687 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:15.687 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:15.687 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:15.687 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:26:15.687 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:26:15.687 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:15.687 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:15.687 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:15.687 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:15.688 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:26:15.688 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:26:15.688 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:26:15.688 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:26:15.688 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:26:15.688 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:15.688 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:15.688 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:15.688 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:26:15.688 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:26:15.688 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:15.688 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:26:15.688 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:26:15.688 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:26:15.688 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:15.689 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:15.689 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:26:15.689 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:15.689 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:26:15.689 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:26:15.689 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:26:15.689 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:15.689 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:15.689 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:26:15.689 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:15.689 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:26:15.689 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:26:15.689 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:26:15.689 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:15.690 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:15.690 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:26:15.690 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:15.690 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:26:15.690 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:26:15.690 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:26:15.690 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:15.690 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:15.690 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:26:15.690 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:15.690 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:26:15.690 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:26:15.690 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:26:15.690 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:15.690 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:15.691 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:15.691 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:26:15.691 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:26:15.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.674+0000 7f6a03827640 1 -- 172.21.15.60:0/2388782632 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f69e006be30 msgr2=0x7f69e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:15.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.674+0000 7f6a03827640 1 --2- 172.21.15.60:0/2388782632 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f69e006be30 0x7f69e006e2f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f69fc0749e0 tx=0x7f69ec007d50 comp rx=0 tx=0).stop 2024-09-12T02:26:15.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.674+0000 7f6a03827640 1 -- 172.21.15.60:0/2388782632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69fc158300 msgr2=0x7f69fc1501f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:15.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.674+0000 7f6a03827640 1 --2- 172.21.15.60:0/2388782632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69fc158300 0x7f69fc1501f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f69f4030000 tx=0x7f69f4004a40 comp rx=0 tx=0).stop 2024-09-12T02:26:15.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.674+0000 7f6a01dc4640 1 -- 172.21.15.60:0/2388782632 reap_dead start 2024-09-12T02:26:15.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.674+0000 7f6a03827640 1 -- 172.21.15.60:0/2388782632 shutdown_connections 2024-09-12T02:26:15.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.674+0000 7f6a03827640 1 --2- 172.21.15.60:0/2388782632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69fc158300 0x7f69fc1501f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:15.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.674+0000 7f6a03827640 1 -- 172.21.15.60:0/2388782632 >> 172.21.15.60:0/2388782632 conn(0x7f69fc0c5660 msgr2=0x7f69fc156500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:26:15.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.674+0000 7f6a03827640 1 -- 172.21.15.60:0/2388782632 shutdown_connections 2024-09-12T02:26:15.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.674+0000 7f6a03827640 1 -- 172.21.15.60:0/2388782632 wait complete. 2024-09-12T02:26:15.693 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:26:15.693 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-12T02:26:15.693 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-12T02:26:15.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.810+0000 7f4c9b78d640 1 Processor -- start 2024-09-12T02:26:15.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.810+0000 7f4c9b78d640 1 -- start start 2024-09-12T02:26:15.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.811+0000 7f4c9b78d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4c94151780 0x7f4c94155560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:15.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.811+0000 7f4c9b78d640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4c94154ac0 0x7f4c940708a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:15.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.811+0000 7f4c9b78d640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c94154ff0 con 0x7f4c940703b0 2024-09-12T02:26:15.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.811+0000 7f4c9b78d640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f4c9406f5f0 con 0x7f4c94151780 2024-09-12T02:26:15.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.811+0000 7f4c9b78d640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f4c9406f8d0 con 0x7f4c94154ac0 2024-09-12T02:26:15.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.812+0000 7f4c99529640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4c94151780 0x7f4c94155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:15.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.812+0000 7f4c98d28640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4c94154ac0 0x7f4c940708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:15.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.812+0000 7f4c99529640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4c94151780 0x7f4c94155560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50580/0 (socket says 172.21.15.60:50580) 2024-09-12T02:26:15.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.812+0000 7f4c99529640 1 -- 172.21.15.60:0/4206122885 learned_addr learned my addr 172.21.15.60:0/4206122885 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:26:15.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.812+0000 7f4c99529640 1 -- 172.21.15.60:0/4206122885 >> v2:172.21.15.105:3300/0 conn(0x7f4c94154ac0 msgr2=0x7f4c940708a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:26:15.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.812+0000 7f4c99529640 1 --2- 172.21.15.60:0/4206122885 >> v2:172.21.15.105:3300/0 conn(0x7f4c94154ac0 0x7f4c940708a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:15.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.812+0000 7f4c99529640 1 -- 172.21.15.60:0/4206122885 >> v1:172.21.15.60:6789/0 conn(0x7f4c940703b0 legacy=0x7f4c94157660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:15.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.812+0000 7f4c99529640 1 -- 172.21.15.60:0/4206122885 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c9406fbb0 con 0x7f4c94151780 2024-09-12T02:26:15.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.813+0000 7f4c99529640 1 --2- 172.21.15.60:0/4206122885 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c94151780 0x7f4c94155560 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4c94072620 tx=0x7f4c9002a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f5f5de33e9eab39 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:15.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.813+0000 7f4c8bfff640 1 -- 172.21.15.60:0/4206122885 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c90037070 con 0x7f4c94151780 2024-09-12T02:26:15.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.813+0000 7f4c8bfff640 1 -- 172.21.15.60:0/4206122885 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c90032440 con 0x7f4c94151780 2024-09-12T02:26:15.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.813+0000 7f4c8bfff640 1 -- 172.21.15.60:0/4206122885 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c90032810 con 0x7f4c94151780 2024-09-12T02:26:15.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.813+0000 7f4c9b78d640 1 -- 172.21.15.60:0/4206122885 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c94151780 msgr2=0x7f4c94155560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:15.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.813+0000 7f4c9b78d640 1 --2- 172.21.15.60:0/4206122885 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c94151780 0x7f4c94155560 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4c94072620 tx=0x7f4c9002a150 comp rx=0 tx=0).stop 2024-09-12T02:26:15.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.813+0000 7f4c9b78d640 1 -- 172.21.15.60:0/4206122885 shutdown_connections 2024-09-12T02:26:15.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.813+0000 7f4c9b78d640 1 --2- 172.21.15.60:0/4206122885 >> v2:172.21.15.105:3300/0 conn(0x7f4c94154ac0 0x7f4c940708a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:15.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.813+0000 7f4c9b78d640 1 --2- 172.21.15.60:0/4206122885 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c94151780 0x7f4c94155560 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:15.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.813+0000 7f4c9b78d640 1 -- 172.21.15.60:0/4206122885 >> 172.21.15.60:0/4206122885 conn(0x7f4c940c6980 msgr2=0x7f4c940c6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:26:15.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.813+0000 7f4c9b78d640 1 -- 172.21.15.60:0/4206122885 shutdown_connections 2024-09-12T02:26:15.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.814+0000 7f4c9b78d640 1 -- 172.21.15.60:0/4206122885 wait complete. 2024-09-12T02:26:15.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.815+0000 7f4c9b78d640 1 Processor -- start 2024-09-12T02:26:15.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.815+0000 7f4c9b78d640 1 -- start start 2024-09-12T02:26:15.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.815+0000 7f4c9b78d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4c940703b0 0x7f4c941eb400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:15.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.815+0000 7f4c9b78d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c94151780 0x7f4c9414a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:15.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.815+0000 7f4c9b78d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c94154ac0 0x7f4c94152a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:15.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.815+0000 7f4c9b78d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4c940740b0 con 0x7f4c94154ac0 2024-09-12T02:26:15.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.815+0000 7f4c9b78d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4c94073f30 con 0x7f4c940703b0 2024-09-12T02:26:15.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.815+0000 7f4c9b78d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4c94155aa0 con 0x7f4c94151780 2024-09-12T02:26:15.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.815+0000 7f4c99d2a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c94154ac0 0x7f4c94152a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:15.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.815+0000 7f4c99529640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4c940703b0 0x7f4c941eb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:15.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.815+0000 7f4c98d28640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c94151780 0x7f4c9414a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:15.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.815+0000 7f4c99d2a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c94154ac0 0x7f4c94152a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50582/0 (socket says 172.21.15.60:50582) 2024-09-12T02:26:15.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.815+0000 7f4c99d2a640 1 -- 172.21.15.60:0/3979825782 learned_addr learned my addr 172.21.15.60:0/3979825782 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:26:15.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.816+0000 7f4c99529640 1 -- 172.21.15.60:0/3979825782 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c94151780 msgr2=0x7f4c9414a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:15.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.816+0000 7f4c99529640 1 --2- 172.21.15.60:0/3979825782 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c94151780 0x7f4c9414a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:15.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.816+0000 7f4c99529640 1 -- 172.21.15.60:0/3979825782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c94154ac0 msgr2=0x7f4c94152a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:15.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.816+0000 7f4c99529640 1 --2- 172.21.15.60:0/3979825782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c94154ac0 0x7f4c94152a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:15.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.816+0000 7f4c99529640 1 -- 172.21.15.60:0/3979825782 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c940c5cc0 con 0x7f4c940703b0 2024-09-12T02:26:15.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.816+0000 7f4c99d2a640 1 --2- 172.21.15.60:0/3979825782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c94154ac0 0x7f4c94152a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:26:15.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.816+0000 7f4c99529640 1 --2- 172.21.15.60:0/3979825782 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4c940703b0 0x7f4c941eb400 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4c90031000 tx=0x7f4c900046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:15.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.816+0000 7f4c89ffb640 1 -- 172.21.15.60:0/3979825782 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c90041020 con 0x7f4c940703b0 2024-09-12T02:26:15.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.816+0000 7f4c89ffb640 1 -- 172.21.15.60:0/3979825782 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c90030700 con 0x7f4c940703b0 2024-09-12T02:26:15.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.816+0000 7f4c9b78d640 1 -- 172.21.15.60:0/3979825782 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c941eb940 con 0x7f4c940703b0 2024-09-12T02:26:15.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.816+0000 7f4c89ffb640 1 -- 172.21.15.60:0/3979825782 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c90037040 con 0x7f4c940703b0 2024-09-12T02:26:15.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.817+0000 7f4c9b78d640 1 -- 172.21.15.60:0/3979825782 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c940c8a10 con 0x7f4c940703b0 2024-09-12T02:26:15.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.818+0000 7f4c9b78d640 1 -- 172.21.15.60:0/3979825782 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c940af630 con 0x7f4c940703b0 2024-09-12T02:26:15.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.818+0000 7f4c89ffb640 1 -- 172.21.15.60:0/3979825782 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4c90044020 con 0x7f4c940703b0 2024-09-12T02:26:15.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.819+0000 7f4c89ffb640 1 --2- 172.21.15.60:0/3979825782 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4c7806be30 0x7f4c7806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:15.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.819+0000 7f4c89ffb640 1 -- 172.21.15.60:0/3979825782 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f4c900ab900 con 0x7f4c940703b0 2024-09-12T02:26:15.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.819+0000 7f4c98d28640 1 --2- 172.21.15.60:0/3979825782 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4c7806be30 0x7f4c7806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:15.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.819+0000 7f4c98d28640 1 --2- 172.21.15.60:0/3979825782 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4c7806be30 0x7f4c7806e2f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4c9414b020 tx=0x7f4c8400f040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:15.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:15.823+0000 7f4c89ffb640 1 -- 172.21.15.60:0/3979825782 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4c9004b030 con 0x7f4c940703b0 2024-09-12T02:26:16.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:16.128+0000 7f4c9b78d640 1 -- 172.21.15.60:0/3979825782 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f4c9414ada0 con 0x7f4c940703b0 2024-09-12T02:26:16.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:16.129+0000 7f4c89ffb640 1 -- 172.21.15.60:0/3979825782 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f4c940c5cc0 con 0x7f4c940703b0 2024-09-12T02:26:16.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:16.132+0000 7f4c9b78d640 1 -- 172.21.15.60:0/3979825782 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4c7806be30 msgr2=0x7f4c7806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:16.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:16.132+0000 7f4c9b78d640 1 --2- 172.21.15.60:0/3979825782 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4c7806be30 0x7f4c7806e2f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4c9414b020 tx=0x7f4c8400f040 comp rx=0 tx=0).stop 2024-09-12T02:26:16.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:16.132+0000 7f4c9b78d640 1 -- 172.21.15.60:0/3979825782 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4c940703b0 msgr2=0x7f4c941eb400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:16.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:16.132+0000 7f4c9b78d640 1 --2- 172.21.15.60:0/3979825782 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4c940703b0 0x7f4c941eb400 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4c90031000 tx=0x7f4c900046c0 comp rx=0 tx=0).stop 2024-09-12T02:26:16.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:16.132+0000 7f4c9b78d640 1 -- 172.21.15.60:0/3979825782 shutdown_connections 2024-09-12T02:26:16.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:16.132+0000 7f4c9b78d640 1 --2- 172.21.15.60:0/3979825782 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4c7806be30 0x7f4c7806e2f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:16.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:16.132+0000 7f4c9b78d640 1 --2- 172.21.15.60:0/3979825782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c94154ac0 0x7f4c94152a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:16.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:16.132+0000 7f4c9b78d640 1 --2- 172.21.15.60:0/3979825782 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c94151780 0x7f4c9414a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:16.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:16.132+0000 7f4c9b78d640 1 --2- 172.21.15.60:0/3979825782 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4c940703b0 0x7f4c941eb400 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:16.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:16.132+0000 7f4c9b78d640 1 -- 172.21.15.60:0/3979825782 >> 172.21.15.60:0/3979825782 conn(0x7f4c940c6980 msgr2=0x7f4c941575f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:26:16.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:16.132+0000 7f4c9b78d640 1 -- 172.21.15.60:0/3979825782 shutdown_connections 2024-09-12T02:26:16.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:16.132+0000 7f4c9b78d640 1 -- 172.21.15.60:0/3979825782 wait complete. 2024-09-12T02:26:16.144 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-12T02:26:26.145 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-12T02:26:26.146 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:26:26.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.259+0000 7f98fca8d640 1 Processor -- start 2024-09-12T02:26:26.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.259+0000 7f98fca8d640 1 -- start start 2024-09-12T02:26:26.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.260+0000 7f98fca8d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f98f8150480 0x7f98f80c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:26.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.260+0000 7f98fca8d640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f98f806c650 0x7f98f80c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:26.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.260+0000 7f98fca8d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98f80c9c80 0x7f98f80ca130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:26.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.260+0000 7f98fca8d640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f98f806c240 con 0x7f98f8150480 2024-09-12T02:26:26.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.260+0000 7f98fca8d640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f98f815a330 con 0x7f98f806c650 2024-09-12T02:26:26.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.260+0000 7f98fca8d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f98f815a7c0 con 0x7f98f80c9c80 2024-09-12T02:26:26.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.260+0000 7f98f659c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f98f8150480 0x7f98f80c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:26.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.261+0000 7f98f659c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f98f8150480 0x7f98f80c7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34948/0 (socket says 172.21.15.60:34948) 2024-09-12T02:26:26.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.261+0000 7f98f659c640 1 -- 172.21.15.60:0/3221719955 learned_addr learned my addr 172.21.15.60:0/3221719955 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:26:26.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.261+0000 7f98f5d9b640 1 --2- 172.21.15.60:0/3221719955 >> v2:172.21.15.105:3300/0 conn(0x7f98f806c650 0x7f98f80c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:26.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.261+0000 7f98f6d9d640 1 --2- 172.21.15.60:0/3221719955 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98f80c9c80 0x7f98f80ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:26.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.261+0000 7f98f659c640 1 -- 172.21.15.60:0/3221719955 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98f80c9c80 msgr2=0x7f98f80ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:26:26.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.261+0000 7f98f659c640 1 --2- 172.21.15.60:0/3221719955 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98f80c9c80 0x7f98f80ca130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:26.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.261+0000 7f98f659c640 1 -- 172.21.15.60:0/3221719955 >> v2:172.21.15.105:3300/0 conn(0x7f98f806c650 msgr2=0x7f98f80c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:26:26.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.261+0000 7f98f659c640 1 --2- 172.21.15.60:0/3221719955 >> v2:172.21.15.105:3300/0 conn(0x7f98f806c650 0x7f98f80c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:26.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.261+0000 7f98f659c640 1 -- 172.21.15.60:0/3221719955 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98f8159a00 con 0x7f98f8150480 2024-09-12T02:26:26.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.262+0000 7f98f659c640 1 --2- 172.21.15.60:0/3221719955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98f8150480 0x7f98f80c7a90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f98f80c6110 tx=0x7f98e802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61902b7979ed69f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:26.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.262+0000 7f98f559a640 1 -- 172.21.15.60:0/3221719955 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e8037070 con 0x7f98f8150480 2024-09-12T02:26:26.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.262+0000 7f98f559a640 1 -- 172.21.15.60:0/3221719955 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98e8032440 con 0x7f98f8150480 2024-09-12T02:26:26.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.262+0000 7f98f559a640 1 -- 172.21.15.60:0/3221719955 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e8032810 con 0x7f98f8150480 2024-09-12T02:26:26.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.263+0000 7f98fca8d640 1 -- 172.21.15.60:0/3221719955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98f8150480 msgr2=0x7f98f80c7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:26.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.263+0000 7f98fca8d640 1 --2- 172.21.15.60:0/3221719955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98f8150480 0x7f98f80c7a90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f98f80c6110 tx=0x7f98e802a1e0 comp rx=0 tx=0).stop 2024-09-12T02:26:26.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.263+0000 7f98fca8d640 1 -- 172.21.15.60:0/3221719955 shutdown_connections 2024-09-12T02:26:26.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.263+0000 7f98fca8d640 1 --2- 172.21.15.60:0/3221719955 >> v2:172.21.15.105:3300/0 conn(0x7f98f806c650 0x7f98f80c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:26.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.263+0000 7f98fca8d640 1 --2- 172.21.15.60:0/3221719955 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98f80c9c80 0x7f98f80ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:26.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.263+0000 7f98fca8d640 1 --2- 172.21.15.60:0/3221719955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98f8150480 0x7f98f80c7a90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:26.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.263+0000 7f98fca8d640 1 -- 172.21.15.60:0/3221719955 >> 172.21.15.60:0/3221719955 conn(0x7f98f8068030 msgr2=0x7f98f8073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:26:26.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.263+0000 7f98fca8d640 1 -- 172.21.15.60:0/3221719955 shutdown_connections 2024-09-12T02:26:26.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.263+0000 7f98fca8d640 1 -- 172.21.15.60:0/3221719955 wait complete. 2024-09-12T02:26:26.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.264+0000 7f98fca8d640 1 Processor -- start 2024-09-12T02:26:26.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.264+0000 7f98fca8d640 1 -- start start 2024-09-12T02:26:26.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.265+0000 7f98fca8d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98f806c650 0x7f98f814abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:26.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.265+0000 7f98fca8d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98f80c9c80 0x7f98f81466a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:26.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.265+0000 7f98fca8d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f98f8150480 0x7f98f80b0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:26.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.265+0000 7f98fca8d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f98f80ca670 con 0x7f98f806c650 2024-09-12T02:26:26.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.265+0000 7f98fca8d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f98f8159fc0 con 0x7f98f8150480 2024-09-12T02:26:26.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.265+0000 7f98fca8d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f98f806d270 con 0x7f98f80c9c80 2024-09-12T02:26:26.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.265+0000 7f98f659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98f806c650 0x7f98f814abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:26.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.265+0000 7f98f659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98f806c650 0x7f98f814abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34956/0 (socket says 172.21.15.60:34956) 2024-09-12T02:26:26.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.265+0000 7f98f659c640 1 -- 172.21.15.60:0/2905818084 learned_addr learned my addr 172.21.15.60:0/2905818084 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:26:26.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.265+0000 7f98f5d9b640 1 --2- 172.21.15.60:0/2905818084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98f80c9c80 0x7f98f81466a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:26.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.265+0000 7f98f6d9d640 1 --2- 172.21.15.60:0/2905818084 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f98f8150480 0x7f98f80b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:26.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.265+0000 7f98f659c640 1 -- 172.21.15.60:0/2905818084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98f80c9c80 msgr2=0x7f98f81466a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:26.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.265+0000 7f98f659c640 1 --2- 172.21.15.60:0/2905818084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98f80c9c80 0x7f98f81466a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:26.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.265+0000 7f98f659c640 1 -- 172.21.15.60:0/2905818084 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f98f8150480 msgr2=0x7f98f80b0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:26.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.265+0000 7f98f659c640 1 --2- 172.21.15.60:0/2905818084 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f98f8150480 0x7f98f80b0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:26.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.265+0000 7f98f659c640 1 -- 172.21.15.60:0/2905818084 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98f81463c0 con 0x7f98f806c650 2024-09-12T02:26:26.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.266+0000 7f98f5d9b640 1 --2- 172.21.15.60:0/2905818084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98f80c9c80 0x7f98f81466a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:26:26.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.266+0000 7f98f659c640 1 --2- 172.21.15.60:0/2905818084 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98f806c650 0x7f98f814abe0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f98e802a220 tx=0x7f98e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:26.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.266+0000 7f98eeffd640 1 -- 172.21.15.60:0/2905818084 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e8041020 con 0x7f98f806c650 2024-09-12T02:26:26.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.266+0000 7f98eeffd640 1 -- 172.21.15.60:0/2905818084 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98e803d620 con 0x7f98f806c650 2024-09-12T02:26:26.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.266+0000 7f98eeffd640 1 -- 172.21.15.60:0/2905818084 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e8037040 con 0x7f98f806c650 2024-09-12T02:26:26.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.266+0000 7f98fca8d640 1 -- 172.21.15.60:0/2905818084 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98f81592a0 con 0x7f98f806c650 2024-09-12T02:26:26.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.266+0000 7f98fca8d640 1 -- 172.21.15.60:0/2905818084 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98f80b0ac0 con 0x7f98f806c650 2024-09-12T02:26:26.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.267+0000 7f98fca8d640 1 -- 172.21.15.60:0/2905818084 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98f8156270 con 0x7f98f806c650 2024-09-12T02:26:26.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.268+0000 7f98eeffd640 1 -- 172.21.15.60:0/2905818084 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f98e8044020 con 0x7f98f806c650 2024-09-12T02:26:26.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.268+0000 7f98eeffd640 1 --2- 172.21.15.60:0/2905818084 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f98d806be30 0x7f98d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:26.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.268+0000 7f98eeffd640 1 -- 172.21.15.60:0/2905818084 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f98e80ab710 con 0x7f98f806c650 2024-09-12T02:26:26.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.268+0000 7f98f5d9b640 1 --2- 172.21.15.60:0/2905818084 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f98d806be30 0x7f98d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:26.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.269+0000 7f98f5d9b640 1 --2- 172.21.15.60:0/2905818084 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f98d806be30 0x7f98d806e2f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f98f814dd10 tx=0x7f98e0009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:26.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.273+0000 7f98eeffd640 1 -- 172.21.15.60:0/2905818084 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f98e804b030 con 0x7f98f806c650 2024-09-12T02:26:26.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.554+0000 7f98fca8d640 1 -- 172.21.15.60:0/2905818084 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f98f80c5e60 con 0x7f98f806c650 2024-09-12T02:26:26.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.554+0000 7f98eeffd640 1 -- 172.21.15.60:0/2905818084 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f98e80796d0 con 0x7f98f806c650 2024-09-12T02:26:26.554 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":30,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:26:26.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.556+0000 7f98fca8d640 1 -- 172.21.15.60:0/2905818084 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f98d806be30 msgr2=0x7f98d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:26.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.556+0000 7f98fca8d640 1 --2- 172.21.15.60:0/2905818084 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f98d806be30 0x7f98d806e2f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f98f814dd10 tx=0x7f98e0009190 comp rx=0 tx=0).stop 2024-09-12T02:26:26.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.556+0000 7f98fca8d640 1 -- 172.21.15.60:0/2905818084 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98f806c650 msgr2=0x7f98f814abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:26.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.556+0000 7f98fca8d640 1 --2- 172.21.15.60:0/2905818084 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98f806c650 0x7f98f814abe0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f98e802a220 tx=0x7f98e80046c0 comp rx=0 tx=0).stop 2024-09-12T02:26:26.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.556+0000 7f98fca8d640 1 -- 172.21.15.60:0/2905818084 shutdown_connections 2024-09-12T02:26:26.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.556+0000 7f98fca8d640 1 --2- 172.21.15.60:0/2905818084 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f98d806be30 0x7f98d806e2f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:26.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.556+0000 7f98fca8d640 1 --2- 172.21.15.60:0/2905818084 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f98f8150480 0x7f98f80b0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:26.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.556+0000 7f98fca8d640 1 --2- 172.21.15.60:0/2905818084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98f80c9c80 0x7f98f81466a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:26.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.556+0000 7f98fca8d640 1 --2- 172.21.15.60:0/2905818084 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98f806c650 0x7f98f814abe0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:26.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.556+0000 7f98fca8d640 1 -- 172.21.15.60:0/2905818084 >> 172.21.15.60:0/2905818084 conn(0x7f98f8068030 msgr2=0x7f98f8073310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:26:26.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.556+0000 7f98fca8d640 1 -- 172.21.15.60:0/2905818084 shutdown_connections 2024-09-12T02:26:26.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.556+0000 7f98fca8d640 1 -- 172.21.15.60:0/2905818084 wait complete. 2024-09-12T02:26:26.567 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-12T02:26:26.567 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-12T02:26:26.567 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-12T02:26:26.567 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-12T02:26:26.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.671+0000 7f2ff105c640 1 Processor -- start 2024-09-12T02:26:26.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.671+0000 7f2ff105c640 1 -- start start 2024-09-12T02:26:26.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.672+0000 7f2ff105c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2fec1598c0 0x7f2fec159d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:26.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.672+0000 7f2ff105c640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fec0c6b20 con 0x7f2fec153de0 2024-09-12T02:26:26.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.672+0000 7f2ff105c640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fec0c6e00 con 0x7f2fec06bbe0 2024-09-12T02:26:26.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.672+0000 7f2ff105c640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f2fec0c9480 con 0x7f2fec1598c0 2024-09-12T02:26:26.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.672+0000 7f2feb59e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2fec1598c0 0x7f2fec159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:26.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.672+0000 7f2fead9d640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f2fec153de0 0x7f2fec0ca640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:33832/0 (socket says 172.21.15.60:33832) 2024-09-12T02:26:26.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.672+0000 7f2fead9d640 1 -- 172.21.15.60:0/211441005 learned_addr learned my addr 172.21.15.60:0/211441005 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:26:26.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.672+0000 7f2fe9d9b640 1 -- 172.21.15.60:0/211441005 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2275549261 0 0) 0x7f2fec0c6b20 con 0x7f2fec153de0 2024-09-12T02:26:26.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.672+0000 7f2fe9d9b640 1 -- 172.21.15.60:0/211441005 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fd8003520 con 0x7f2fec153de0 2024-09-12T02:26:26.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.672+0000 7f2feb59e640 1 -- 172.21.15.60:0/211441005 >> v1:172.21.15.105:6789/0 conn(0x7f2fec06bbe0 legacy=0x7f2fec06c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:26.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.672+0000 7f2feb59e640 1 -- 172.21.15.60:0/211441005 >> v1:172.21.15.60:6789/0 conn(0x7f2fec153de0 legacy=0x7f2fec0ca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:26.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.672+0000 7f2feb59e640 1 -- 172.21.15.60:0/211441005 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fec0c70e0 con 0x7f2fec1598c0 2024-09-12T02:26:26.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.673+0000 7f2feb59e640 1 --2- 172.21.15.60:0/211441005 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fec1598c0 0x7f2fec159d50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc0097a0 tx=0x7f2fdc02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bd984f85bef8eb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:26.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.673+0000 7f2fe9d9b640 1 -- 172.21.15.60:0/211441005 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc037070 con 0x7f2fec1598c0 2024-09-12T02:26:26.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.673+0000 7f2fe9d9b640 1 -- 172.21.15.60:0/211441005 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fdc032440 con 0x7f2fec1598c0 2024-09-12T02:26:26.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.673+0000 7f2fe9d9b640 1 -- 172.21.15.60:0/211441005 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc032810 con 0x7f2fec1598c0 2024-09-12T02:26:26.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.674+0000 7f2ff105c640 1 -- 172.21.15.60:0/211441005 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fec1598c0 msgr2=0x7f2fec159d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:26.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.674+0000 7f2ff105c640 1 --2- 172.21.15.60:0/211441005 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fec1598c0 0x7f2fec159d50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc0097a0 tx=0x7f2fdc02a230 comp rx=0 tx=0).stop 2024-09-12T02:26:26.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.674+0000 7f2ff105c640 1 -- 172.21.15.60:0/211441005 shutdown_connections 2024-09-12T02:26:26.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.674+0000 7f2ff105c640 1 --2- 172.21.15.60:0/211441005 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fec1598c0 0x7f2fec159d50 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:26.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.674+0000 7f2ff105c640 1 -- 172.21.15.60:0/211441005 >> 172.21.15.60:0/211441005 conn(0x7f2fec0c8800 msgr2=0x7f2fec0c8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:26:26.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.674+0000 7f2ff105c640 1 -- 172.21.15.60:0/211441005 shutdown_connections 2024-09-12T02:26:26.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.674+0000 7f2ff105c640 1 -- 172.21.15.60:0/211441005 wait complete. 2024-09-12T02:26:26.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.675+0000 7f2ff105c640 1 Processor -- start 2024-09-12T02:26:26.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.675+0000 7f2ff105c640 1 -- start start 2024-09-12T02:26:26.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.676+0000 7f2ff105c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fec06bbe0 0x7f2fec1ed030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:26.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.676+0000 7f2ff105c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fec153de0 0x7f2fec1e12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:26.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.676+0000 7f2ff105c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2fec1598c0 0x7f2fec150960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:26.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.676+0000 7f2ff105c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2fec15a290 con 0x7f2fec06bbe0 2024-09-12T02:26:26.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.676+0000 7f2ff105c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2fec0cb620 con 0x7f2fec153de0 2024-09-12T02:26:26.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.676+0000 7f2ff105c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2fec15a410 con 0x7f2fec1598c0 2024-09-12T02:26:26.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.676+0000 7f2fead9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fec06bbe0 0x7f2fec1ed030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:26.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.676+0000 7f2fead9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fec06bbe0 0x7f2fec1ed030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34962/0 (socket says 172.21.15.60:34962) 2024-09-12T02:26:26.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.676+0000 7f2fead9d640 1 -- 172.21.15.60:0/4193308242 learned_addr learned my addr 172.21.15.60:0/4193308242 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:26:26.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.676+0000 7f2fea59c640 1 --2- 172.21.15.60:0/4193308242 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fec153de0 0x7f2fec1e12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:26.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.676+0000 7f2feb59e640 1 --2- 172.21.15.60:0/4193308242 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2fec1598c0 0x7f2fec150960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:26.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.676+0000 7f2fead9d640 1 -- 172.21.15.60:0/4193308242 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2fec1598c0 msgr2=0x7f2fec150960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:26.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.676+0000 7f2fead9d640 1 --2- 172.21.15.60:0/4193308242 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2fec1598c0 0x7f2fec150960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:26.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.677+0000 7f2fead9d640 1 -- 172.21.15.60:0/4193308242 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fec153de0 msgr2=0x7f2fec1e12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:26.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.677+0000 7f2fead9d640 1 --2- 172.21.15.60:0/4193308242 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fec153de0 0x7f2fec1e12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:26.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.677+0000 7f2fead9d640 1 -- 172.21.15.60:0/4193308242 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fec1e17e0 con 0x7f2fec06bbe0 2024-09-12T02:26:26.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.677+0000 7f2fead9d640 1 --2- 172.21.15.60:0/4193308242 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fec06bbe0 0x7f2fec1ed030 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2fe400cbf0 tx=0x7f2fe400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:26.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.677+0000 7f2fe37fe640 1 -- 172.21.15.60:0/4193308242 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe4017070 con 0x7f2fec06bbe0 2024-09-12T02:26:26.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.677+0000 7f2fe37fe640 1 -- 172.21.15.60:0/4193308242 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fe400ad40 con 0x7f2fec06bbe0 2024-09-12T02:26:26.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.677+0000 7f2ff105c640 1 -- 172.21.15.60:0/4193308242 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fec1e0340 con 0x7f2fec06bbe0 2024-09-12T02:26:26.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.677+0000 7f2fe37fe640 1 -- 172.21.15.60:0/4193308242 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe4012620 con 0x7f2fec06bbe0 2024-09-12T02:26:26.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.677+0000 7f2ff105c640 1 -- 172.21.15.60:0/4193308242 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fec1ef1d0 con 0x7f2fec06bbe0 2024-09-12T02:26:26.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.678+0000 7f2ff105c640 1 --2- 172.21.15.60:0/4193308242 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fec1e0510 0x7f2fec1ef820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:26.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.678+0000 7f2ff105c640 1 -- 172.21.15.60:0/4193308242 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2fec1567c0 con 0x7f2fec1e0510 2024-09-12T02:26:26.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.678+0000 7f2fea59c640 1 --2- 172.21.15.60:0/4193308242 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fec1e0510 0x7f2fec1ef820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:26.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.678+0000 7f2fea59c640 1 -- 172.21.15.60:0/4193308242 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2fec159d50 con 0x7f2fec1e0510 2024-09-12T02:26:26.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.678+0000 7f2fea59c640 1 --2- 172.21.15.60:0/4193308242 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fec1e0510 0x7f2fec1ef820 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2fec1e0200 tx=0x7f2fd400f900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:26.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.678+0000 7f2fe37fe640 1 -- 172.21.15.60:0/4193308242 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2fe401a070 con 0x7f2fec06bbe0 2024-09-12T02:26:26.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.679+0000 7f2fe37fe640 1 --2- 172.21.15.60:0/4193308242 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2fcc06be30 0x7f2fcc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:26.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.679+0000 7f2fe37fe640 1 -- 172.21.15.60:0/4193308242 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f2fe408af20 con 0x7f2fec06bbe0 2024-09-12T02:26:26.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.679+0000 7f2feb59e640 1 --2- 172.21.15.60:0/4193308242 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2fcc06be30 0x7f2fcc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:26.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.679+0000 7f2fe37fe640 1 -- 172.21.15.60:0/4193308242 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd4019070 con 0x7f2fec1e0510 2024-09-12T02:26:26.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.679+0000 7f2fe37fe640 1 -- 172.21.15.60:0/4193308242 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f2fd4005320 con 0x7f2fec1e0510 2024-09-12T02:26:26.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.679+0000 7f2fe37fe640 1 -- 172.21.15.60:0/4193308242 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fec1e0510 msgr2=0x7f2fec1ef820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:26.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.679+0000 7f2fe37fe640 1 --2- 172.21.15.60:0/4193308242 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fec1e0510 0x7f2fec1ef820 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2fec1e0200 tx=0x7f2fd400f900 comp rx=0 tx=0).stop 2024-09-12T02:26:26.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.679+0000 7f2fe37fe640 1 -- 172.21.15.60:0/4193308242 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fec1e0510 msgr2=0x7f2fec1ef820 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:26:26.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.679+0000 7f2fe37fe640 1 --2- 172.21.15.60:0/4193308242 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fec1e0510 0x7f2fec1ef820 secure :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2fec1e0200 tx=0x7f2fd400f900 comp rx=0 tx=0).stop 2024-09-12T02:26:26.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.679+0000 7f2feb59e640 1 --2- 172.21.15.60:0/4193308242 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2fcc06be30 0x7f2fcc06e2f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc034000 tx=0x7f2fdc02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:26.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.685+0000 7f2ff105c640 1 --2- 172.21.15.60:0/4193308242 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fec1efd60 0x7f2fec149580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:26.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.685+0000 7f2ff105c640 1 -- 172.21.15.60:0/4193308242 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2fec153600 con 0x7f2fec1efd60 2024-09-12T02:26:26.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.686+0000 7f2fea59c640 1 --2- 172.21.15.60:0/4193308242 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fec1efd60 0x7f2fec149580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:26.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.686+0000 7f2fea59c640 1 -- 172.21.15.60:0/4193308242 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2fec0c9600 con 0x7f2fec1efd60 2024-09-12T02:26:26.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.686+0000 7f2fea59c640 1 --2- 172.21.15.60:0/4193308242 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fec1efd60 0x7f2fec149580 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4016000 tx=0x7f2fd4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:26.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.686+0000 7f2fe37fe640 1 -- 172.21.15.60:0/4193308242 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd4019030 con 0x7f2fec1efd60 2024-09-12T02:26:26.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.686+0000 7f2fe37fe640 1 -- 172.21.15.60:0/4193308242 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4551 (secure 0 0 0) 0x7f2fd40069e0 con 0x7f2fec1efd60 2024-09-12T02:26:26.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.686+0000 7f2fe37fe640 1 -- 172.21.15.60:0/4193308242 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fec1efd60 msgr2=0x7f2fec149580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:26.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.686+0000 7f2fe37fe640 1 --2- 172.21.15.60:0/4193308242 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fec1efd60 0x7f2fec149580 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4016000 tx=0x7f2fd4000ed0 comp rx=0 tx=0).stop 2024-09-12T02:26:26.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.686+0000 7f2fe37fe640 1 -- 172.21.15.60:0/4193308242 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fec1efd60 msgr2=0x7f2fec149580 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:26:26.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.686+0000 7f2fe37fe640 1 --2- 172.21.15.60:0/4193308242 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fec1efd60 0x7f2fec149580 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:26.688 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:26:26.688 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:26:26.688 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:26:26.688 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:26:26.688 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 30, 2024-09-12T02:26:26.688 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 26795, 2024-09-12T02:26:26.688 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:26:26.688 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:26:26.688 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:26:26.688 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:26:26.689 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:26.689 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 11, 2024-09-12T02:26:26.689 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:26:26.689 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:26:26.689 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:26:26.689 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:26:26.689 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:26:26.689 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:26:26.689 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:26:26.689 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:26:26.689 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:26:26.689 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:26:26.689 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:26:26.690 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:26:26.690 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:26:26.690 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:26:26.690 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:26.690 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:26:26.690 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:26:26.690 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:26:26.690 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:26:26.690 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:26:26.690 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:26:26.690 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:26:26.690 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:26:26.690 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:26:26.691 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:26:26.691 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:26:26.691 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:26:26.691 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:26:26.691 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:26.691 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:26.691 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:26:26.691 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:26:26.691 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:26:26.691 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:26:26.691 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:26:26.691 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:26:26.691 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:26:26.691 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:26:26.692 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:26:26.692 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:26:26.692 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:26:26.692 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:26:26.692 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:26:26.692 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:26:26.692 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:26:26.692 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:26:26.692 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:26:26.692 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:26:26.692 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:26:26.692 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:26:26.692 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:26:26.692 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:26:26.692 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:26:26.693 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:26:26.693 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:26:26.693 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:26:26.693 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:26:26.693 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:26:26.693 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:26.693 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:26:26.693 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:26.693 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:26:26.693 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:26.693 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:26:26.693 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:26:26.693 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:26:26.694 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:26:26.694 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:26.694 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:26:26.694 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:26:26.694 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:26.694 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:26.694 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:26.694 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:26:26.694 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:26:26.694 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:26.694 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:26.694 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:26.694 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:26.694 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:26:26.695 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:26:26.695 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:26:26.695 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:26:26.695 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:26:26.695 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:26.695 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:26.695 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:26:26.695 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:26:26.695 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:26:26.695 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:26:26.695 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:26.695 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:26:26.695 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:26:26.695 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:26.695 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:26.695 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:26.696 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:26:26.696 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:26:26.696 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:26.696 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:26.696 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:26.696 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:26.696 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:26:26.696 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:26:26.696 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:26:26.696 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:26:26.696 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:26:26.696 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:26.696 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:26.697 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:26:26.697 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:26:26.697 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:26:26.697 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:26:26.697 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:26.697 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:26:26.697 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:26:26.697 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:26.697 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:26.697 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:26.697 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:26:26.697 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:26:26.697 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:26.698 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:26.698 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:26.698 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:26.698 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:26:26.698 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:26:26.698 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:26:26.698 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:26:26.698 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:26:26.698 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:26.698 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:26.698 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:26.698 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:26:26.698 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:26:26.698 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:26.698 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:26:26.699 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:26:26.699 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:26:26.699 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:26.699 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:26.699 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:26:26.699 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:26.699 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:26:26.699 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:26:26.699 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:26:26.699 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:26.699 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:26.699 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:26.699 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:26:26.699 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:26:26.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.687+0000 7f2ff105c640 1 -- 172.21.15.60:0/4193308242 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2fcc06be30 msgr2=0x7f2fcc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:26.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.687+0000 7f2ff105c640 1 --2- 172.21.15.60:0/4193308242 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2fcc06be30 0x7f2fcc06e2f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc034000 tx=0x7f2fdc02e000 comp rx=0 tx=0).stop 2024-09-12T02:26:26.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.687+0000 7f2ff105c640 1 -- 172.21.15.60:0/4193308242 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fec06bbe0 msgr2=0x7f2fec1ed030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:26.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.687+0000 7f2ff105c640 1 --2- 172.21.15.60:0/4193308242 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fec06bbe0 0x7f2fec1ed030 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2fe400cbf0 tx=0x7f2fe400a430 comp rx=0 tx=0).stop 2024-09-12T02:26:26.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.687+0000 7f2feb59e640 1 -- 172.21.15.60:0/4193308242 reap_dead start 2024-09-12T02:26:26.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.687+0000 7f2feb59e640 1 -- 172.21.15.60:0/4193308242 reap_dead start 2024-09-12T02:26:26.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.687+0000 7f2ff105c640 1 -- 172.21.15.60:0/4193308242 shutdown_connections 2024-09-12T02:26:26.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.687+0000 7f2ff105c640 1 -- 172.21.15.60:0/4193308242 >> 172.21.15.60:0/4193308242 conn(0x7f2fec0c8800 msgr2=0x7f2fec0ac900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:26:26.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.687+0000 7f2ff105c640 1 -- 172.21.15.60:0/4193308242 shutdown_connections 2024-09-12T02:26:26.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.687+0000 7f2ff105c640 1 -- 172.21.15.60:0/4193308242 wait complete. 2024-09-12T02:26:26.701 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:26:26.701 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-12T02:26:26.702 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-12T02:26:26.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.806+0000 7f453c96f640 1 Processor -- start 2024-09-12T02:26:26.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.806+0000 7f453c96f640 1 -- start start 2024-09-12T02:26:26.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.807+0000 7f453c96f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4538153af0 0x7f45381563a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:26.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.807+0000 7f453c96f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f45380af870 0x7f45380c4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:26.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.807+0000 7f453c96f640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45380c54e0 con 0x7f45380afdd0 2024-09-12T02:26:26.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.807+0000 7f453c96f640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f45380c74a0 con 0x7f45380af870 2024-09-12T02:26:26.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.807+0000 7f453c96f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f45380c7740 con 0x7f4538153af0 2024-09-12T02:26:26.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.807+0000 7f4536d9d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f45380af870 0x7f45380c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:26.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.807+0000 7f4536d9d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f45380af870 0x7f45380c4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34980/0 (socket says 172.21.15.60:34980) 2024-09-12T02:26:26.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.807+0000 7f4536d9d640 1 -- 172.21.15.60:0/999064772 learned_addr learned my addr 172.21.15.60:0/999064772 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:26:26.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.807+0000 7f453659c640 1 --2- 172.21.15.60:0/999064772 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4538153af0 0x7f45381563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:26.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.807+0000 7f4536d9d640 1 -- 172.21.15.60:0/999064772 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4538153af0 msgr2=0x7f45381563a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:26:26.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.807+0000 7f4536d9d640 1 --2- 172.21.15.60:0/999064772 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4538153af0 0x7f45381563a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:26.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.807+0000 7f4536d9d640 1 -- 172.21.15.60:0/999064772 >> v1:172.21.15.105:6789/0 conn(0x7f45380afdd0 legacy=0x7f45380c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:26.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.807+0000 7f4536d9d640 1 -- 172.21.15.60:0/999064772 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f453815a3c0 con 0x7f45380af870 2024-09-12T02:26:26.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.808+0000 7f4536d9d640 1 --2- 172.21.15.60:0/999064772 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45380af870 0x7f45380c4780 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4530009870 tx=0x7f453002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f164e697692df80a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:26.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.808+0000 7f453559a640 1 -- 172.21.15.60:0/999064772 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4530037070 con 0x7f45380af870 2024-09-12T02:26:26.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.808+0000 7f453559a640 1 -- 172.21.15.60:0/999064772 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4530032440 con 0x7f45380af870 2024-09-12T02:26:26.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.808+0000 7f453559a640 1 -- 172.21.15.60:0/999064772 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4530032810 con 0x7f45380af870 2024-09-12T02:26:26.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.809+0000 7f453c96f640 1 -- 172.21.15.60:0/999064772 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45380af870 msgr2=0x7f45380c4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:26.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.809+0000 7f453c96f640 1 --2- 172.21.15.60:0/999064772 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45380af870 0x7f45380c4780 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4530009870 tx=0x7f453002a130 comp rx=0 tx=0).stop 2024-09-12T02:26:26.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.809+0000 7f453c96f640 1 -- 172.21.15.60:0/999064772 shutdown_connections 2024-09-12T02:26:26.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.809+0000 7f453c96f640 1 --2- 172.21.15.60:0/999064772 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45380af870 0x7f45380c4780 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:26.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.809+0000 7f453c96f640 1 --2- 172.21.15.60:0/999064772 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4538153af0 0x7f45381563a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:26.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.809+0000 7f453c96f640 1 -- 172.21.15.60:0/999064772 >> 172.21.15.60:0/999064772 conn(0x7f45380c6880 msgr2=0x7f45380c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:26:26.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.809+0000 7f453c96f640 1 -- 172.21.15.60:0/999064772 shutdown_connections 2024-09-12T02:26:26.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.809+0000 7f453c96f640 1 -- 172.21.15.60:0/999064772 wait complete. 2024-09-12T02:26:26.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.810+0000 7f453c96f640 1 Processor -- start 2024-09-12T02:26:26.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.810+0000 7f453c96f640 1 -- start start 2024-09-12T02:26:26.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.811+0000 7f453c96f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f45380af870 0x7f453814d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:26.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.811+0000 7f453c96f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45380afdd0 0x7f4538157820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:26.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.811+0000 7f453c96f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4538153af0 0x7f45381e07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:26.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.811+0000 7f453c96f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4538154050 con 0x7f4538153af0 2024-09-12T02:26:26.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.811+0000 7f453c96f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4538153ed0 con 0x7f45380afdd0 2024-09-12T02:26:26.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.811+0000 7f453c96f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f45380c4cc0 con 0x7f45380af870 2024-09-12T02:26:26.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.811+0000 7f4536d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4538153af0 0x7f45381e07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:26.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.811+0000 7f453659c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f45380af870 0x7f453814d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:26.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.811+0000 7f4536d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4538153af0 0x7f45381e07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34992/0 (socket says 172.21.15.60:34992) 2024-09-12T02:26:26.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.811+0000 7f4536d9d640 1 -- 172.21.15.60:0/397632558 learned_addr learned my addr 172.21.15.60:0/397632558 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:26:26.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.811+0000 7f4535d9b640 1 --2- 172.21.15.60:0/397632558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45380afdd0 0x7f4538157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:26.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.811+0000 7f4536d9d640 1 -- 172.21.15.60:0/397632558 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f45380af870 msgr2=0x7f453814d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:26.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.811+0000 7f4536d9d640 1 --2- 172.21.15.60:0/397632558 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f45380af870 0x7f453814d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:26.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.811+0000 7f4536d9d640 1 -- 172.21.15.60:0/397632558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45380afdd0 msgr2=0x7f4538157820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:26.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.811+0000 7f4536d9d640 1 --2- 172.21.15.60:0/397632558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45380afdd0 0x7f4538157820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:26.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.811+0000 7f4536d9d640 1 -- 172.21.15.60:0/397632558 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45381dfc00 con 0x7f4538153af0 2024-09-12T02:26:26.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.812+0000 7f4536d9d640 1 --2- 172.21.15.60:0/397632558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4538153af0 0x7f45381e07c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4530009870 tx=0x7f45300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:26.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.812+0000 7f452effd640 1 -- 172.21.15.60:0/397632558 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4530037040 con 0x7f4538153af0 2024-09-12T02:26:26.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.812+0000 7f452effd640 1 -- 172.21.15.60:0/397632558 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4530042070 con 0x7f4538153af0 2024-09-12T02:26:26.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.812+0000 7f453c96f640 1 -- 172.21.15.60:0/397632558 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45381df920 con 0x7f4538153af0 2024-09-12T02:26:26.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.812+0000 7f452effd640 1 -- 172.21.15.60:0/397632558 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4530030900 con 0x7f4538153af0 2024-09-12T02:26:26.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.812+0000 7f453c96f640 1 -- 172.21.15.60:0/397632558 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45381efa50 con 0x7f4538153af0 2024-09-12T02:26:26.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.813+0000 7f453c96f640 1 --2- 172.21.15.60:0/397632558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45381e0d00 0x7f45381e1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:26.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.813+0000 7f453c96f640 1 -- 172.21.15.60:0/397632558 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f45381e2390 con 0x7f45381e0d00 2024-09-12T02:26:26.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.813+0000 7f453659c640 1 --2- 172.21.15.60:0/397632558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45381e0d00 0x7f45381e1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:26.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.813+0000 7f453659c640 1 -- 172.21.15.60:0/397632558 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f45381e18a0 con 0x7f45381e0d00 2024-09-12T02:26:26.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.813+0000 7f452effd640 1 -- 172.21.15.60:0/397632558 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4530030aa0 con 0x7f4538153af0 2024-09-12T02:26:26.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.813+0000 7f453659c640 1 --2- 172.21.15.60:0/397632558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45381e0d00 0x7f45381e1360 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4528009fc0 tx=0x7f452800f580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:26.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.814+0000 7f452effd640 1 --2- 172.21.15.60:0/397632558 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f451806be30 0x7f451806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:26.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.814+0000 7f452effd640 1 -- 172.21.15.60:0/397632558 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f45300ab8f0 con 0x7f4538153af0 2024-09-12T02:26:26.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.814+0000 7f4535d9b640 1 --2- 172.21.15.60:0/397632558 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f451806be30 0x7f451806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:26.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.814+0000 7f452effd640 1 -- 172.21.15.60:0/397632558 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4528019070 con 0x7f45381e0d00 2024-09-12T02:26:26.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.814+0000 7f452effd640 1 -- 172.21.15.60:0/397632558 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f4528003b90 con 0x7f45381e0d00 2024-09-12T02:26:26.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.814+0000 7f452effd640 1 -- 172.21.15.60:0/397632558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45381e0d00 msgr2=0x7f45381e1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:26.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.814+0000 7f452effd640 1 --2- 172.21.15.60:0/397632558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45381e0d00 0x7f45381e1360 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4528009fc0 tx=0x7f452800f580 comp rx=0 tx=0).stop 2024-09-12T02:26:26.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.814+0000 7f452effd640 1 -- 172.21.15.60:0/397632558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45381e0d00 msgr2=0x7f45381e1360 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:26:26.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.814+0000 7f452effd640 1 --2- 172.21.15.60:0/397632558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45381e0d00 0x7f45381e1360 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:26.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.814+0000 7f4535d9b640 1 --2- 172.21.15.60:0/397632558 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f451806be30 0x7f451806e2f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4538073d20 tx=0x7f4520009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:26.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.820+0000 7f453c96f640 1 --2- 172.21.15.60:0/397632558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f453814c6e0 0x7f453814caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:26.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.820+0000 7f453c96f640 1 -- 172.21.15.60:0/397632558 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4538157d60 con 0x7f453814c6e0 2024-09-12T02:26:26.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.820+0000 7f453659c640 1 --2- 172.21.15.60:0/397632558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f453814c6e0 0x7f453814caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:26.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.821+0000 7f453659c640 1 -- 172.21.15.60:0/397632558 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4538075850 con 0x7f453814c6e0 2024-09-12T02:26:26.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.821+0000 7f453659c640 1 --2- 172.21.15.60:0/397632558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f453814c6e0 0x7f453814caf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f452800fb20 tx=0x7f4528004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:26.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.821+0000 7f452effd640 1 -- 172.21.15.60:0/397632558 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f452801e8e0 con 0x7f453814c6e0 2024-09-12T02:26:26.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.821+0000 7f452effd640 1 -- 172.21.15.60:0/397632558 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5051 (secure 0 0 0) 0x7f4528015430 con 0x7f453814c6e0 2024-09-12T02:26:26.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.821+0000 7f452effd640 1 -- 172.21.15.60:0/397632558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f453814c6e0 msgr2=0x7f453814caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:26.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.821+0000 7f452effd640 1 --2- 172.21.15.60:0/397632558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f453814c6e0 0x7f453814caf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f452800fb20 tx=0x7f4528004a40 comp rx=0 tx=0).stop 2024-09-12T02:26:26.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.821+0000 7f452effd640 1 -- 172.21.15.60:0/397632558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f453814c6e0 msgr2=0x7f453814caf0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:26:26.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.821+0000 7f452effd640 1 --2- 172.21.15.60:0/397632558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f453814c6e0 0x7f453814caf0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:26.823 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:26:26.823 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:26:26.823 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:26:26.823 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:26:26.823 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 30, 2024-09-12T02:26:26.823 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 132256, 2024-09-12T02:26:26.823 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:26:26.823 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:26:26.823 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:26:26.823 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:26:26.823 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:26.824 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 12, 2024-09-12T02:26:26.824 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:26:26.824 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:26:26.824 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:26:26.824 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:26:26.824 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:26:26.824 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:26:26.824 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:26:26.824 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:26:26.824 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:26:26.824 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:26:26.824 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:26:26.824 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:26:26.824 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:26:26.825 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:26:26.825 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:26.825 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:26:26.825 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:26:26.825 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:26:26.825 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:26:26.825 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:26:26.825 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:26:26.825 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:26:26.825 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:26:26.825 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:26:26.825 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:26:26.825 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:26:26.826 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:26:26.826 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:26:26.826 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:26.826 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:26.826 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:26:26.826 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:26:26.826 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:26:26.826 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:26:26.826 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:26:26.826 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:26:26.826 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:26:26.826 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:26:26.826 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:26:26.826 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:26:26.827 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:26:26.827 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:26:26.827 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:26:26.827 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:26:26.827 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:26:26.827 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:26:26.827 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:26:26.827 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:26:26.827 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:26:26.827 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:26:26.827 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:26:26.828 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:26:26.828 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:26:26.828 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:26:26.828 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:26:26.828 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:26:26.828 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:26:26.828 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:26:26.828 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:26.828 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:26:26.828 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:26.828 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:26:26.828 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:26.828 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:26:26.828 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:26:26.829 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:26:26.829 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:26:26.829 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:26.829 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:26:26.829 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:26:26.829 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:26.829 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:26.829 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:26.829 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:26:26.829 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:26:26.829 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:26.829 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:26.830 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:26.830 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:26.830 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:26:26.830 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:26:26.830 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:26:26.830 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:26:26.830 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:26:26.830 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:26.830 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:26.830 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:26:26.830 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:26:26.830 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:26:26.830 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:26:26.831 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:26.831 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:26:26.831 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:26:26.831 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:26.831 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:26.831 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:26.831 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:26:26.831 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:26:26.831 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:26.831 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:26.831 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:26.831 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:26.832 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:26:26.832 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:26:26.832 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:26:26.832 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:26:26.832 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:26:26.832 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:26.832 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:26.832 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:26:26.832 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:26:26.832 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:26:26.832 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:26:26.832 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:26.833 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:26:26.833 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:26:26.833 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:26.833 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:26.833 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:26.833 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:26:26.833 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:26:26.833 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:26.833 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:26.833 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:26.833 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:26.833 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:26:26.833 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:26:26.833 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:26:26.834 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:26:26.834 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:26:26.834 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:26.834 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:26.834 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:26.834 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:26:26.834 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:26:26.834 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:26.834 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:26:26.834 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:26:26.834 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:26:26.834 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:26.835 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:26.835 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:26:26.835 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:26.835 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:26:26.835 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:26:26.835 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:26:26.835 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:26.835 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:26.835 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:26:26.835 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:26.835 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:26:26.835 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:26:26.835 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:26:26.836 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:26.836 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:26.836 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:26:26.836 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:26.836 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:26:26.836 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:26:26.836 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:26:26.836 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:26.836 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:26.836 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:26:26.836 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:26.836 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:26:26.836 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:26:26.837 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:26:26.837 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:26.837 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:26.837 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:26.837 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:26:26.837 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:26:26.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.822+0000 7f453c96f640 1 -- 172.21.15.60:0/397632558 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f451806be30 msgr2=0x7f451806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:26.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.822+0000 7f453c96f640 1 --2- 172.21.15.60:0/397632558 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f451806be30 0x7f451806e2f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4538073d20 tx=0x7f4520009040 comp rx=0 tx=0).stop 2024-09-12T02:26:26.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.822+0000 7f453c96f640 1 -- 172.21.15.60:0/397632558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4538153af0 msgr2=0x7f45381e07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:26.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.822+0000 7f4536d9d640 1 -- 172.21.15.60:0/397632558 reap_dead start 2024-09-12T02:26:26.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.822+0000 7f453c96f640 1 --2- 172.21.15.60:0/397632558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4538153af0 0x7f45381e07c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4530009870 tx=0x7f45300046c0 comp rx=0 tx=0).stop 2024-09-12T02:26:26.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.822+0000 7f453c96f640 1 -- 172.21.15.60:0/397632558 shutdown_connections 2024-09-12T02:26:26.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.822+0000 7f453c96f640 1 --2- 172.21.15.60:0/397632558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4538153af0 0x7f45381e07c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:26.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.822+0000 7f453c96f640 1 -- 172.21.15.60:0/397632558 >> 172.21.15.60:0/397632558 conn(0x7f45380c6880 msgr2=0x7f45380c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:26:26.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.822+0000 7f453c96f640 1 -- 172.21.15.60:0/397632558 shutdown_connections 2024-09-12T02:26:26.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.822+0000 7f453c96f640 1 -- 172.21.15.60:0/397632558 wait complete. 2024-09-12T02:26:26.839 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:26:26.839 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-12T02:26:26.840 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-12T02:26:26.909 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:26:26.911 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:26:26.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.951+0000 7f38f33fd640 1 Processor -- start 2024-09-12T02:26:26.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.951+0000 7f38f33fd640 1 -- start start 2024-09-12T02:26:26.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.952+0000 7f38f33fd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f38ec0c5130 0x7f38ec1538c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:26.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.952+0000 7f38f33fd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38ec067950 0x7f38ec153e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:26.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.953+0000 7f38f33fd640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38ec0c2f60 con 0x7f38ec0ad6a0 2024-09-12T02:26:26.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.953+0000 7f38f33fd640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f38ec0c1f80 con 0x7f38ec0c5130 2024-09-12T02:26:26.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.953+0000 7f38f33fd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f38ec0c3240 con 0x7f38ec067950 2024-09-12T02:26:26.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.953+0000 7f38f0998640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f38ec0ad6a0 0x7f38ec159c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:33846/0 (socket says 172.21.15.60:33846) 2024-09-12T02:26:26.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.953+0000 7f38f0998640 1 -- 172.21.15.60:0/4274595436 learned_addr learned my addr 172.21.15.60:0/4274595436 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:26:26.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.953+0000 7f38f1199640 1 --2- 172.21.15.60:0/4274595436 >> v2:172.21.15.105:3300/0 conn(0x7f38ec0c5130 0x7f38ec1538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:26.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.953+0000 7f38f199a640 1 --2- 172.21.15.60:0/4274595436 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38ec067950 0x7f38ec153e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:26.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.953+0000 7f38e3fff640 1 -- 172.21.15.60:0/4274595436 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1999932606 0 0) 0x7f38ec0c2f60 con 0x7f38ec0ad6a0 2024-09-12T02:26:26.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.953+0000 7f38e3fff640 1 -- 172.21.15.60:0/4274595436 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38d8003520 con 0x7f38ec0ad6a0 2024-09-12T02:26:26.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.953+0000 7f38f1199640 1 -- 172.21.15.60:0/4274595436 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38ec067950 msgr2=0x7f38ec153e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:26:26.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.953+0000 7f38f1199640 1 --2- 172.21.15.60:0/4274595436 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38ec067950 0x7f38ec153e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:26.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.953+0000 7f38f1199640 1 -- 172.21.15.60:0/4274595436 >> v1:172.21.15.60:6789/0 conn(0x7f38ec0ad6a0 legacy=0x7f38ec159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:26.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.953+0000 7f38f1199640 1 -- 172.21.15.60:0/4274595436 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38ec0c1c10 con 0x7f38ec0c5130 2024-09-12T02:26:26.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.953+0000 7f38f199a640 1 --2- 172.21.15.60:0/4274595436 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38ec067950 0x7f38ec153e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:26:26.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.954+0000 7f38f1199640 1 --2- 172.21.15.60:0/4274595436 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38ec0c5130 0x7f38ec1538c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f38e80097a0 tx=0x7f38e802a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fa0508c0d914b56 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:26.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.954+0000 7f38e3fff640 1 -- 172.21.15.60:0/4274595436 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e8037070 con 0x7f38ec0c5130 2024-09-12T02:26:26.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.954+0000 7f38e3fff640 1 -- 172.21.15.60:0/4274595436 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38e802adb0 con 0x7f38ec0c5130 2024-09-12T02:26:26.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.954+0000 7f38e3fff640 1 -- 172.21.15.60:0/4274595436 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e8032660 con 0x7f38ec0c5130 2024-09-12T02:26:26.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.955+0000 7f38f33fd640 1 -- 172.21.15.60:0/4274595436 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38ec0c5130 msgr2=0x7f38ec1538c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:26.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.955+0000 7f38f33fd640 1 --2- 172.21.15.60:0/4274595436 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38ec0c5130 0x7f38ec1538c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f38e80097a0 tx=0x7f38e802a060 comp rx=0 tx=0).stop 2024-09-12T02:26:26.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.955+0000 7f38f33fd640 1 -- 172.21.15.60:0/4274595436 shutdown_connections 2024-09-12T02:26:26.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.955+0000 7f38f33fd640 1 --2- 172.21.15.60:0/4274595436 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38ec067950 0x7f38ec153e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:26.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.955+0000 7f38f33fd640 1 --2- 172.21.15.60:0/4274595436 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38ec0c5130 0x7f38ec1538c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:26.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.955+0000 7f38f33fd640 1 -- 172.21.15.60:0/4274595436 >> 172.21.15.60:0/4274595436 conn(0x7f38ec0c8430 msgr2=0x7f38ec0c8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:26:26.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.955+0000 7f38f33fd640 1 -- 172.21.15.60:0/4274595436 shutdown_connections 2024-09-12T02:26:26.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.955+0000 7f38f33fd640 1 -- 172.21.15.60:0/4274595436 wait complete. 2024-09-12T02:26:26.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.957+0000 7f38f33fd640 1 Processor -- start 2024-09-12T02:26:26.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.957+0000 7f38f33fd640 1 -- start start 2024-09-12T02:26:26.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.958+0000 7f38f33fd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38ec067950 0x7f38ec1ebab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:26.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.958+0000 7f38f33fd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38ec0ad6a0 0x7f38ec0aa900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:26.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.958+0000 7f38f33fd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38ec0c5130 0x7f38ec0aae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:26.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.958+0000 7f38f33fd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f38ec0c5690 con 0x7f38ec0c5130 2024-09-12T02:26:26.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.958+0000 7f38f33fd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f38ec0c5510 con 0x7f38ec067950 2024-09-12T02:26:26.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.958+0000 7f38f33fd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f38ec15a370 con 0x7f38ec0ad6a0 2024-09-12T02:26:26.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.958+0000 7f38f199a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38ec0c5130 0x7f38ec0aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:26.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.958+0000 7f38f1199640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38ec067950 0x7f38ec1ebab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:26.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.958+0000 7f38f1199640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38ec067950 0x7f38ec1ebab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:39902/0 (socket says 172.21.15.60:39902) 2024-09-12T02:26:26.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.958+0000 7f38f199a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38ec0c5130 0x7f38ec0aae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34998/0 (socket says 172.21.15.60:34998) 2024-09-12T02:26:26.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.958+0000 7f38f1199640 1 -- 172.21.15.60:0/2923408268 learned_addr learned my addr 172.21.15.60:0/2923408268 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:26:26.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.958+0000 7f38f0998640 1 --2- 172.21.15.60:0/2923408268 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38ec0ad6a0 0x7f38ec0aa900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:26.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.958+0000 7f38f199a640 1 -- 172.21.15.60:0/2923408268 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38ec0ad6a0 msgr2=0x7f38ec0aa900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:26.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.958+0000 7f38f199a640 1 --2- 172.21.15.60:0/2923408268 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38ec0ad6a0 0x7f38ec0aa900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:26.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.958+0000 7f38f199a640 1 -- 172.21.15.60:0/2923408268 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38ec067950 msgr2=0x7f38ec1ebab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:26.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.958+0000 7f38f199a640 1 --2- 172.21.15.60:0/2923408268 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38ec067950 0x7f38ec1ebab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:26.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.958+0000 7f38f199a640 1 -- 172.21.15.60:0/2923408268 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38ec154970 con 0x7f38ec0c5130 2024-09-12T02:26:26.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.958+0000 7f38f1199640 1 --2- 172.21.15.60:0/2923408268 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38ec067950 0x7f38ec1ebab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:26:26.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.959+0000 7f38f199a640 1 --2- 172.21.15.60:0/2923408268 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38ec0c5130 0x7f38ec0aae40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f38e400efc0 tx=0x7f38e400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:26.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.959+0000 7f38e1ffb640 1 -- 172.21.15.60:0/2923408268 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e4018030 con 0x7f38ec0c5130 2024-09-12T02:26:26.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.959+0000 7f38e1ffb640 1 -- 172.21.15.60:0/2923408268 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38e400cd30 con 0x7f38ec0c5130 2024-09-12T02:26:26.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.959+0000 7f38f33fd640 1 -- 172.21.15.60:0/2923408268 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38ec0ab380 con 0x7f38ec0c5130 2024-09-12T02:26:26.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.959+0000 7f38e1ffb640 1 -- 172.21.15.60:0/2923408268 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e4003bb0 con 0x7f38ec0c5130 2024-09-12T02:26:26.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.959+0000 7f38f33fd640 1 -- 172.21.15.60:0/2923408268 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38ec1ec2f0 con 0x7f38ec0c5130 2024-09-12T02:26:26.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.960+0000 7f38f33fd640 1 --2- 172.21.15.60:0/2923408268 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38ec0a8f00 0x7f38ec072e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:26.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.960+0000 7f38f33fd640 1 -- 172.21.15.60:0/2923408268 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f38ec15a760 con 0x7f38ec0a8f00 2024-09-12T02:26:26.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.961+0000 7f38f1199640 1 --2- 172.21.15.60:0/2923408268 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38ec0a8f00 0x7f38ec072e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:26.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.961+0000 7f38f1199640 1 -- 172.21.15.60:0/2923408268 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f38ec0ad030 con 0x7f38ec0a8f00 2024-09-12T02:26:26.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.961+0000 7f38f1199640 1 --2- 172.21.15.60:0/2923408268 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38ec0a8f00 0x7f38ec072e60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f38ec1e9610 tx=0x7f38e80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:26.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.961+0000 7f38e1ffb640 1 -- 172.21.15.60:0/2923408268 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f38e4005d10 con 0x7f38ec0c5130 2024-09-12T02:26:26.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.962+0000 7f38e1ffb640 1 --2- 172.21.15.60:0/2923408268 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f38d006be30 0x7f38d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:26.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.962+0000 7f38e1ffb640 1 -- 172.21.15.60:0/2923408268 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f38e408b9d0 con 0x7f38ec0c5130 2024-09-12T02:26:26.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.962+0000 7f38f0998640 1 --2- 172.21.15.60:0/2923408268 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f38d006be30 0x7f38d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:26.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.962+0000 7f38e1ffb640 1 -- 172.21.15.60:0/2923408268 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e8037040 con 0x7f38ec0a8f00 2024-09-12T02:26:26.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.962+0000 7f38e1ffb640 1 -- 172.21.15.60:0/2923408268 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f38e8046630 con 0x7f38ec0a8f00 2024-09-12T02:26:26.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.962+0000 7f38e1ffb640 1 -- 172.21.15.60:0/2923408268 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38ec0a8f00 msgr2=0x7f38ec072e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:26.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.962+0000 7f38e1ffb640 1 --2- 172.21.15.60:0/2923408268 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38ec0a8f00 0x7f38ec072e60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f38ec1e9610 tx=0x7f38e80046c0 comp rx=0 tx=0).stop 2024-09-12T02:26:26.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.962+0000 7f38e1ffb640 1 -- 172.21.15.60:0/2923408268 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38ec0a8f00 msgr2=0x7f38ec072e60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:26:26.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.962+0000 7f38e1ffb640 1 --2- 172.21.15.60:0/2923408268 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38ec0a8f00 0x7f38ec072e60 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:26.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.962+0000 7f38f0998640 1 --2- 172.21.15.60:0/2923408268 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f38d006be30 0x7f38d006e2f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f38ec06ee20 tx=0x7f38dc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:26.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.969+0000 7f38f33fd640 1 --2- 172.21.15.60:0/2923408268 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38ec1ec4c0 0x7f38ec0733a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:26.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.969+0000 7f38f33fd640 1 -- 172.21.15.60:0/2923408268 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f38ec1ebff0 con 0x7f38ec1ec4c0 2024-09-12T02:26:26.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.969+0000 7f38f1199640 1 --2- 172.21.15.60:0/2923408268 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38ec1ec4c0 0x7f38ec0733a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:26.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.970+0000 7f38f1199640 1 -- 172.21.15.60:0/2923408268 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f38ec076430 con 0x7f38ec1ec4c0 2024-09-12T02:26:26.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.970+0000 7f38f1199640 1 --2- 172.21.15.60:0/2923408268 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38ec1ec4c0 0x7f38ec0733a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f38ec15a8e0 tx=0x7f38e8008030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:26.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.970+0000 7f38e1ffb640 1 -- 172.21.15.60:0/2923408268 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e8037030 con 0x7f38ec1ec4c0 2024-09-12T02:26:26.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.970+0000 7f38e1ffb640 1 -- 172.21.15.60:0/2923408268 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5051 (secure 0 0 0) 0x7f38e8003810 con 0x7f38ec1ec4c0 2024-09-12T02:26:26.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.970+0000 7f38e1ffb640 1 -- 172.21.15.60:0/2923408268 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38ec1ec4c0 msgr2=0x7f38ec0733a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:26.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.970+0000 7f38e1ffb640 1 --2- 172.21.15.60:0/2923408268 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38ec1ec4c0 0x7f38ec0733a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f38ec15a8e0 tx=0x7f38e8008030 comp rx=0 tx=0).stop 2024-09-12T02:26:26.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.970+0000 7f38e1ffb640 1 -- 172.21.15.60:0/2923408268 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38ec1ec4c0 msgr2=0x7f38ec0733a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:26:26.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.970+0000 7f38e1ffb640 1 --2- 172.21.15.60:0/2923408268 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38ec1ec4c0 0x7f38ec0733a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:26.972 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:26:26.972 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:26:26.972 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:26:26.972 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:26:26.972 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 30, 2024-09-12T02:26:26.972 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 232286, 2024-09-12T02:26:26.972 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:26:26.972 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:26:26.972 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:26:26.972 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:26:26.973 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:26.973 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 12, 2024-09-12T02:26:26.973 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:26:26.973 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:26:26.973 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:26:26.973 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:26:26.973 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:26:26.973 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:26:26.973 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:26:26.973 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:26:26.973 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:26:26.973 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:26:26.973 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:26:26.974 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:26:26.974 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:26:26.974 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:26:26.974 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:26.974 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:26:26.974 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:26:26.974 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:26:26.974 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:26:26.974 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:26:26.974 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:26:26.974 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:26:26.974 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:26:26.974 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:26:26.975 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:26:26.975 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:26:26.975 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:26:26.975 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:26:26.975 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:26.975 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:26.975 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:26:26.975 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:26:26.975 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:26:26.975 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:26:26.975 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:26:26.975 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:26:26.975 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:26:26.976 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:26:26.976 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:26:26.976 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:26:26.976 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:26:26.976 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:26:26.976 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:26:26.976 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:26:26.976 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:26:26.976 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:26:26.976 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:26:26.976 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:26:26.976 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:26:26.976 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:26:26.977 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:26:26.977 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:26:26.977 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:26:26.977 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:26:26.977 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:26:26.977 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:26:26.977 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:26:26.977 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:26:26.977 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:26.977 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:26:26.977 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:26.978 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:26:26.978 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:26.978 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:26:26.978 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:26:26.978 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:26:26.978 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:26:26.978 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:26.978 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:26:26.978 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:26:26.978 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:26.978 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:26.978 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:26.979 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:26:26.979 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:26:26.979 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:26.979 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:26.979 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:26.979 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:26.979 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:26:26.979 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:26:26.979 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:26:26.979 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:26:26.979 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:26:26.979 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:26.979 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:26.980 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:26:26.980 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:26:26.980 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:26:26.980 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:26:26.980 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:26.980 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:26:26.980 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:26:26.980 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:26.980 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:26.980 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:26.980 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:26:26.980 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:26:26.981 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:26.981 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:26.981 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:26.981 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:26.981 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:26:26.981 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:26:26.981 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:26:26.981 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:26:26.981 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:26:26.981 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:26.981 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:26.982 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:26:26.982 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:26:26.982 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:26:26.982 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:26:26.982 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:26.982 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:26:26.982 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:26:26.982 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:26.982 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:26.982 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:26.982 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:26:26.983 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:26:26.983 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:26.983 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:26.983 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:26.983 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:26.983 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:26:26.983 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:26:26.983 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:26:26.983 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:26:26.983 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:26:26.983 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:26.983 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:26.983 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:26.984 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:26:26.984 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:26:26.984 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:26.984 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:26:26.984 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:26:26.984 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:26:26.984 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:26.984 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:26.985 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:26:26.985 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:26.985 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:26:26.985 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:26:26.985 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:26:26.985 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:26.985 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:26.985 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:26:26.985 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:26.985 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:26:26.985 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:26:26.986 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:26:26.986 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:26.986 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:26.986 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:26:26.986 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:26.986 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:26:26.986 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:26:26.986 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:26:26.986 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:26.986 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:26.986 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:26:26.986 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:26.986 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:26:26.987 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:26:26.987 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:26:26.987 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:26.987 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:26.987 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:26.987 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:26:26.987 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:26:26.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.971+0000 7f38f33fd640 1 -- 172.21.15.60:0/2923408268 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f38d006be30 msgr2=0x7f38d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:26.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.971+0000 7f38f33fd640 1 --2- 172.21.15.60:0/2923408268 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f38d006be30 0x7f38d006e2f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f38ec06ee20 tx=0x7f38dc009040 comp rx=0 tx=0).stop 2024-09-12T02:26:26.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.971+0000 7f38f33fd640 1 -- 172.21.15.60:0/2923408268 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38ec0c5130 msgr2=0x7f38ec0aae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:26.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.971+0000 7f38f33fd640 1 --2- 172.21.15.60:0/2923408268 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38ec0c5130 0x7f38ec0aae40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f38e400efc0 tx=0x7f38e400c490 comp rx=0 tx=0).stop 2024-09-12T02:26:26.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.971+0000 7f38f199a640 1 -- 172.21.15.60:0/2923408268 reap_dead start 2024-09-12T02:26:26.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.971+0000 7f38f199a640 1 -- 172.21.15.60:0/2923408268 reap_dead start 2024-09-12T02:26:26.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.971+0000 7f38f33fd640 1 -- 172.21.15.60:0/2923408268 shutdown_connections 2024-09-12T02:26:26.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.971+0000 7f38f33fd640 1 -- 172.21.15.60:0/2923408268 >> 172.21.15.60:0/2923408268 conn(0x7f38ec0c8430 msgr2=0x7f38ec1581b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:26:26.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.971+0000 7f38f33fd640 1 -- 172.21.15.60:0/2923408268 shutdown_connections 2024-09-12T02:26:26.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:26.971+0000 7f38f33fd640 1 -- 172.21.15.60:0/2923408268 wait complete. 2024-09-12T02:26:26.990 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:26:26.990 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-09-12T02:26:26.990 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-12T02:26:26.990 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-09-12T02:26:26.990 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-09-12T02:26:26.990 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T02:26:26.991 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:26:27.004 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T02:26:27.004 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-12T02:26:27.004 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:26:27.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.154+0000 7fc548d91640 1 Processor -- start 2024-09-12T02:26:27.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.154+0000 7fc548d91640 1 -- start start 2024-09-12T02:26:27.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.156+0000 7fc548d91640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc5440c3560 0x7fc5440c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:27.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.156+0000 7fc548d91640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5440c8460 con 0x7fc5440c7fb0 2024-09-12T02:26:27.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.156+0000 7fc548d91640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc544153fc0 con 0x7fc544153be0 2024-09-12T02:26:27.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.156+0000 7fc548d91640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc544156db0 con 0x7fc5440c3560 2024-09-12T02:26:27.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.156+0000 7fc541d9b640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc5440c3560 msgr2=0x7fc5440c7a70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:26:27.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.156+0000 7fc541d9b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc5440c3560 0x7fc5440c7a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:26:27.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.156+0000 7fc542d9d640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fc5440c7fb0 0x7fc544160bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:33850/0 (socket says 172.21.15.60:33850) 2024-09-12T02:26:27.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.156+0000 7fc542d9d640 1 -- 172.21.15.60:0/2291719381 learned_addr learned my addr 172.21.15.60:0/2291719381 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:26:27.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.156+0000 7fc54159a640 1 -- 172.21.15.60:0/2291719381 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2697047713 0 0) 0x7fc5440c8460 con 0x7fc5440c7fb0 2024-09-12T02:26:27.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.156+0000 7fc54159a640 1 -- 172.21.15.60:0/2291719381 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc52c003520 con 0x7fc5440c7fb0 2024-09-12T02:26:27.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.156+0000 7fc54159a640 1 -- 172.21.15.60:0/2291719381 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3949412950 0 0) 0x7fc534001110 con 0x7fc544153be0 2024-09-12T02:26:27.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.156+0000 7fc54159a640 1 -- 172.21.15.60:0/2291719381 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5440c8460 con 0x7fc544153be0 2024-09-12T02:26:27.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.157+0000 7fc54159a640 1 -- 172.21.15.60:0/2291719381 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 227745882 0 0) 0x7fc52c003520 con 0x7fc5440c7fb0 2024-09-12T02:26:27.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.157+0000 7fc54159a640 1 -- 172.21.15.60:0/2291719381 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc5440c3560 msgr2=0x7fc5440c7a70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:26:27.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.157+0000 7fc54159a640 1 --2- 172.21.15.60:0/2291719381 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc5440c3560 0x7fc5440c7a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:27.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.157+0000 7fc54159a640 1 -- 172.21.15.60:0/2291719381 >> v1:172.21.15.105:6789/0 conn(0x7fc544153be0 legacy=0x7fc5440ac720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:27.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.157+0000 7fc54159a640 1 -- 172.21.15.60:0/2291719381 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5440a8030 con 0x7fc5440c7fb0 2024-09-12T02:26:27.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.157+0000 7fc54159a640 1 -- 172.21.15.60:0/2291719381 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7fc53c0019f0 con 0x7fc5440c7fb0 2024-09-12T02:26:27.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.157+0000 7fc54159a640 1 -- 172.21.15.60:0/2291719381 >> v1:172.21.15.60:6789/0 conn(0x7fc5440c7fb0 legacy=0x7fc544160bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:27.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.157+0000 7fc54159a640 1 --2- 172.21.15.60:0/2291719381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc52c004c00 0x7fc52c004fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:27.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.157+0000 7fc54159a640 1 --2- 172.21.15.60:0/2291719381 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc5440c3560 0x7fc52c0037a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:27.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.157+0000 7fc54159a640 1 --2- 172.21.15.60:0/2291719381 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc52c003e00 0x7fc52c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:27.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.157+0000 7fc54259c640 1 --2- 172.21.15.60:0/2291719381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc52c004c00 0x7fc52c004fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:27.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.157+0000 7fc54159a640 1 -- 172.21.15.60:0/2291719381 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc544156db0 con 0x7fc52c004c00 2024-09-12T02:26:27.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.157+0000 7fc54159a640 1 -- 172.21.15.60:0/2291719381 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc52c0045c0 con 0x7fc52c003e00 2024-09-12T02:26:27.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.157+0000 7fc54159a640 1 -- 172.21.15.60:0/2291719381 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc52c00bf00 con 0x7fc5440c3560 2024-09-12T02:26:27.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.157+0000 7fc541d9b640 1 -- 172.21.15.60:0/2291719381 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc5440c3560 msgr2=0x7fc52c0037a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:26:27.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.157+0000 7fc542d9d640 1 --2- 172.21.15.60:0/2291719381 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc52c003e00 0x7fc52c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:27.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.157+0000 7fc541d9b640 1 --2- 172.21.15.60:0/2291719381 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc5440c3560 0x7fc52c0037a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:26:27.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.157+0000 7fc54259c640 1 -- 172.21.15.60:0/2291719381 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc5440c3560 msgr2=0x7fc52c0037a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:26:27.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.157+0000 7fc54259c640 1 --2- 172.21.15.60:0/2291719381 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc5440c3560 0x7fc52c0037a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:27.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.157+0000 7fc54259c640 1 -- 172.21.15.60:0/2291719381 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc52c003e00 msgr2=0x7fc52c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:26:27.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.157+0000 7fc54259c640 1 --2- 172.21.15.60:0/2291719381 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc52c003e00 0x7fc52c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:27.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.157+0000 7fc54259c640 1 -- 172.21.15.60:0/2291719381 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc52c003520 con 0x7fc52c004c00 2024-09-12T02:26:27.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.158+0000 7fc54259c640 1 --2- 172.21.15.60:0/2291719381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc52c004c00 0x7fc52c004fe0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc53400c370 tx=0x7fc52c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=197e0215d97e3829 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:27.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.158+0000 7fc54159a640 1 -- 172.21.15.60:0/2291719381 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc534036070 con 0x7fc52c004c00 2024-09-12T02:26:27.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.158+0000 7fc54159a640 1 -- 172.21.15.60:0/2291719381 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc534005070 con 0x7fc52c004c00 2024-09-12T02:26:27.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.158+0000 7fc54159a640 1 -- 172.21.15.60:0/2291719381 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc534007dd0 con 0x7fc52c004c00 2024-09-12T02:26:27.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.159+0000 7fc548d91640 1 -- 172.21.15.60:0/2291719381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc52c004c00 msgr2=0x7fc52c004fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:27.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.159+0000 7fc548d91640 1 --2- 172.21.15.60:0/2291719381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc52c004c00 0x7fc52c004fe0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc53400c370 tx=0x7fc52c005830 comp rx=0 tx=0).stop 2024-09-12T02:26:27.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.159+0000 7fc542d9d640 1 -- 172.21.15.60:0/2291719381 reap_dead start 2024-09-12T02:26:27.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.159+0000 7fc548d91640 1 -- 172.21.15.60:0/2291719381 shutdown_connections 2024-09-12T02:26:27.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.159+0000 7fc548d91640 1 -- 172.21.15.60:0/2291719381 >> 172.21.15.60:0/2291719381 conn(0x7fc5440c5660 msgr2=0x7fc5440c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:26:27.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.160+0000 7fc548d91640 1 -- 172.21.15.60:0/2291719381 shutdown_connections 2024-09-12T02:26:27.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.160+0000 7fc548d91640 1 -- 172.21.15.60:0/2291719381 wait complete. 2024-09-12T02:26:27.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.161+0000 7fc548d91640 1 Processor -- start 2024-09-12T02:26:27.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.161+0000 7fc548d91640 1 -- start start 2024-09-12T02:26:27.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.162+0000 7fc548d91640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc52c004c00 0x7fc5441e0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:27.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.162+0000 7fc548d91640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5440734d0 0x7fc5440721d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:27.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.162+0000 7fc548d91640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc544072710 0x7fc54414d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:27.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.162+0000 7fc548d91640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc5440a83e0 con 0x7fc5440734d0 2024-09-12T02:26:27.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.162+0000 7fc548d91640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc544157240 con 0x7fc52c004c00 2024-09-12T02:26:27.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.162+0000 7fc548d91640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc5440ac370 con 0x7fc544072710 2024-09-12T02:26:27.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.162+0000 7fc542d9d640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc544072710 msgr2=0x7fc54414d210 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:26:27.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.162+0000 7fc542d9d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc544072710 0x7fc54414d210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:26:27.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.163+0000 7fc541d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5440734d0 0x7fc5440721d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:27.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.163+0000 7fc54259c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc52c004c00 0x7fc5441e0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:27.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.163+0000 7fc54259c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc52c004c00 0x7fc5441e0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:39970/0 (socket says 172.21.15.60:39970) 2024-09-12T02:26:27.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.163+0000 7fc541d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5440734d0 0x7fc5440721d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35056/0 (socket says 172.21.15.60:35056) 2024-09-12T02:26:27.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.163+0000 7fc54259c640 1 -- 172.21.15.60:0/2038925280 learned_addr learned my addr 172.21.15.60:0/2038925280 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:26:27.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.163+0000 7fc541d9b640 1 -- 172.21.15.60:0/2038925280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc544072710 msgr2=0x7fc54414d210 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:26:27.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.163+0000 7fc541d9b640 1 --2- 172.21.15.60:0/2038925280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc544072710 0x7fc54414d210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:27.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.163+0000 7fc541d9b640 1 -- 172.21.15.60:0/2038925280 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc52c004c00 msgr2=0x7fc5441e0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:27.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.163+0000 7fc541d9b640 1 --2- 172.21.15.60:0/2038925280 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc52c004c00 0x7fc5441e0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:27.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.163+0000 7fc541d9b640 1 -- 172.21.15.60:0/2038925280 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5441e1bc0 con 0x7fc5440734d0 2024-09-12T02:26:27.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.163+0000 7fc541d9b640 1 --2- 172.21.15.60:0/2038925280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5440734d0 0x7fc5440721d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc53800b450 tx=0x7fc53800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:27.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.163+0000 7fc532ffd640 1 -- 172.21.15.60:0/2038925280 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc538003db0 con 0x7fc5440734d0 2024-09-12T02:26:27.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.163+0000 7fc532ffd640 1 -- 172.21.15.60:0/2038925280 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc538015070 con 0x7fc5440734d0 2024-09-12T02:26:27.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.163+0000 7fc548d91640 1 -- 172.21.15.60:0/2038925280 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5441df9d0 con 0x7fc5440734d0 2024-09-12T02:26:27.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.163+0000 7fc532ffd640 1 -- 172.21.15.60:0/2038925280 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc538005290 con 0x7fc5440734d0 2024-09-12T02:26:27.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.163+0000 7fc548d91640 1 -- 172.21.15.60:0/2038925280 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5440731b0 con 0x7fc5440734d0 2024-09-12T02:26:27.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.165+0000 7fc548d91640 1 -- 172.21.15.60:0/2038925280 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc544069190 con 0x7fc5440734d0 2024-09-12T02:26:27.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.165+0000 7fc532ffd640 1 -- 172.21.15.60:0/2038925280 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc53800f070 con 0x7fc5440734d0 2024-09-12T02:26:27.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.165+0000 7fc532ffd640 1 --2- 172.21.15.60:0/2038925280 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc52406bde0 0x7fc52406e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:27.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.166+0000 7fc532ffd640 1 -- 172.21.15.60:0/2038925280 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fc53808aa20 con 0x7fc5440734d0 2024-09-12T02:26:27.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.166+0000 7fc54259c640 1 --2- 172.21.15.60:0/2038925280 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc52406bde0 0x7fc52406e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:27.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.166+0000 7fc54259c640 1 --2- 172.21.15.60:0/2038925280 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc52406bde0 0x7fc52406e2a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc534000f60 tx=0x7fc534009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:27.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.171+0000 7fc532ffd640 1 -- 172.21.15.60:0/2038925280 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc544069190 con 0x7fc5440734d0 2024-09-12T02:26:27.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.463+0000 7fc548d91640 1 -- 172.21.15.60:0/2038925280 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc5440c63f0 con 0x7fc5440734d0 2024-09-12T02:26:27.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.464+0000 7fc532ffd640 1 -- 172.21.15.60:0/2038925280 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7fc53800d040 con 0x7fc5440734d0 2024-09-12T02:26:27.464 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":30,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:26:27.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.466+0000 7fc548d91640 1 -- 172.21.15.60:0/2038925280 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc52406bde0 msgr2=0x7fc52406e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:27.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.466+0000 7fc548d91640 1 --2- 172.21.15.60:0/2038925280 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc52406bde0 0x7fc52406e2a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc534000f60 tx=0x7fc534009030 comp rx=0 tx=0).stop 2024-09-12T02:26:27.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.466+0000 7fc548d91640 1 -- 172.21.15.60:0/2038925280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5440734d0 msgr2=0x7fc5440721d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:27.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.466+0000 7fc548d91640 1 --2- 172.21.15.60:0/2038925280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5440734d0 0x7fc5440721d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc53800b450 tx=0x7fc53800b910 comp rx=0 tx=0).stop 2024-09-12T02:26:27.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.466+0000 7fc548d91640 1 -- 172.21.15.60:0/2038925280 shutdown_connections 2024-09-12T02:26:27.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.466+0000 7fc548d91640 1 --2- 172.21.15.60:0/2038925280 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc52406bde0 0x7fc52406e2a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:27.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.466+0000 7fc548d91640 1 --2- 172.21.15.60:0/2038925280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc544072710 0x7fc54414d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:27.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.466+0000 7fc548d91640 1 --2- 172.21.15.60:0/2038925280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5440734d0 0x7fc5440721d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:27.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.466+0000 7fc548d91640 1 --2- 172.21.15.60:0/2038925280 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc52c004c00 0x7fc5441e0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:27.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.466+0000 7fc548d91640 1 -- 172.21.15.60:0/2038925280 >> 172.21.15.60:0/2038925280 conn(0x7fc5440c5660 msgr2=0x7fc544154e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:26:27.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.466+0000 7fc548d91640 1 -- 172.21.15.60:0/2038925280 shutdown_connections 2024-09-12T02:26:27.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:27.466+0000 7fc548d91640 1 -- 172.21.15.60:0/2038925280 wait complete. 2024-09-12T02:26:30.479 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:26:30.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.590+0000 7fe04a113640 1 Processor -- start 2024-09-12T02:26:30.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.590+0000 7fe04a113640 1 -- start start 2024-09-12T02:26:30.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.591+0000 7fe04a113640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe0440c3ff0 0x7fe04406ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:30.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.591+0000 7fe04a113640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe04406d230 0x7fe044160d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:30.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.591+0000 7fe04a113640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe04406f150 con 0x7fe04415a550 2024-09-12T02:26:30.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.591+0000 7fe04a113640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fe04415a930 con 0x7fe0440c3ff0 2024-09-12T02:26:30.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.591+0000 7fe04a113640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe04406ef00 con 0x7fe04406d230 2024-09-12T02:26:30.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.591+0000 7fe043fff640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe04406d230 msgr2=0x7fe044160d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:26:30.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.591+0000 7fe042ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe0440c3ff0 0x7fe04406ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:30.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.591+0000 7fe043fff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe04406d230 0x7fe044160d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:26:30.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.591+0000 7fe042ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe0440c3ff0 0x7fe04406ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47974/0 (socket says 172.21.15.60:47974) 2024-09-12T02:26:30.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.591+0000 7fe042ffd640 1 -- 172.21.15.60:0/525975793 learned_addr learned my addr 172.21.15.60:0/525975793 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:26:30.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.591+0000 7fe042ffd640 1 -- 172.21.15.60:0/525975793 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe04406d230 msgr2=0x7fe044160d20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:26:30.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.591+0000 7fe042ffd640 1 --2- 172.21.15.60:0/525975793 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe04406d230 0x7fe044160d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:30.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.591+0000 7fe042ffd640 1 -- 172.21.15.60:0/525975793 >> v1:172.21.15.105:6789/0 conn(0x7fe04415a550 legacy=0x7fe0440c9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:30.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.591+0000 7fe042ffd640 1 -- 172.21.15.60:0/525975793 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe044072bd0 con 0x7fe0440c3ff0 2024-09-12T02:26:30.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.592+0000 7fe042ffd640 1 --2- 172.21.15.60:0/525975793 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0440c3ff0 0x7fe04406ccf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe038009870 tx=0x7fe03802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98c699e8ca2d209b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:30.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.592+0000 7fe0427fc640 1 -- 172.21.15.60:0/525975793 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe038037070 con 0x7fe0440c3ff0 2024-09-12T02:26:30.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.592+0000 7fe0427fc640 1 -- 172.21.15.60:0/525975793 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe038032440 con 0x7fe0440c3ff0 2024-09-12T02:26:30.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.592+0000 7fe0427fc640 1 -- 172.21.15.60:0/525975793 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe038032810 con 0x7fe0440c3ff0 2024-09-12T02:26:30.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.593+0000 7fe04a113640 1 -- 172.21.15.60:0/525975793 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0440c3ff0 msgr2=0x7fe04406ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:30.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.593+0000 7fe04a113640 1 --2- 172.21.15.60:0/525975793 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0440c3ff0 0x7fe04406ccf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe038009870 tx=0x7fe03802a270 comp rx=0 tx=0).stop 2024-09-12T02:26:30.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.593+0000 7fe04a113640 1 -- 172.21.15.60:0/525975793 shutdown_connections 2024-09-12T02:26:30.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.593+0000 7fe04a113640 1 --2- 172.21.15.60:0/525975793 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe04406d230 0x7fe044160d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:30.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.593+0000 7fe04a113640 1 --2- 172.21.15.60:0/525975793 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0440c3ff0 0x7fe04406ccf0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:30.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.593+0000 7fe04a113640 1 -- 172.21.15.60:0/525975793 >> 172.21.15.60:0/525975793 conn(0x7fe044067b30 msgr2=0x7fe044067f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:26:30.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.593+0000 7fe04a113640 1 -- 172.21.15.60:0/525975793 shutdown_connections 2024-09-12T02:26:30.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.593+0000 7fe04a113640 1 -- 172.21.15.60:0/525975793 wait complete. 2024-09-12T02:26:30.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.595+0000 7fe04a113640 1 Processor -- start 2024-09-12T02:26:30.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.596+0000 7fe04a113640 1 -- start start 2024-09-12T02:26:30.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.597+0000 7fe04a113640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe04406d230 0x7fe044151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:30.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.597+0000 7fe04a113640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0440c3ff0 0x7fe04414dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:30.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.597+0000 7fe04a113640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe04415a550 0x7fe04414e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:30.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.597+0000 7fe04a113640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe04406fad0 con 0x7fe0440c3ff0 2024-09-12T02:26:30.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.597+0000 7fe04a113640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe044073190 con 0x7fe04415a550 2024-09-12T02:26:30.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.597+0000 7fe04a113640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe0440ca650 con 0x7fe04406d230 2024-09-12T02:26:30.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.597+0000 7fe0437fe640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe04406d230 msgr2=0x7fe044151550 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:26:30.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.597+0000 7fe0437fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe04406d230 0x7fe044151550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:26:30.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.597+0000 7fe042ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0440c3ff0 0x7fe04414dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:30.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.597+0000 7fe042ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0440c3ff0 0x7fe04414dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47984/0 (socket says 172.21.15.60:47984) 2024-09-12T02:26:30.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.597+0000 7fe042ffd640 1 -- 172.21.15.60:0/4264218663 learned_addr learned my addr 172.21.15.60:0/4264218663 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:26:30.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.597+0000 7fe043fff640 1 --2- 172.21.15.60:0/4264218663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe04415a550 0x7fe04414e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:30.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.597+0000 7fe042ffd640 1 -- 172.21.15.60:0/4264218663 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe04406d230 msgr2=0x7fe044151550 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:26:30.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.597+0000 7fe042ffd640 1 --2- 172.21.15.60:0/4264218663 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe04406d230 0x7fe044151550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:30.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.597+0000 7fe042ffd640 1 -- 172.21.15.60:0/4264218663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe04415a550 msgr2=0x7fe04414e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:30.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.597+0000 7fe042ffd640 1 --2- 172.21.15.60:0/4264218663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe04415a550 0x7fe04414e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:30.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.597+0000 7fe042ffd640 1 -- 172.21.15.60:0/4264218663 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe04414ea30 con 0x7fe0440c3ff0 2024-09-12T02:26:30.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.598+0000 7fe042ffd640 1 --2- 172.21.15.60:0/4264218663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0440c3ff0 0x7fe04414dfb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe038000c00 tx=0x7fe0380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:30.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.598+0000 7fe02bfff640 1 -- 172.21.15.60:0/4264218663 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe038041020 con 0x7fe0440c3ff0 2024-09-12T02:26:30.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.598+0000 7fe02bfff640 1 -- 172.21.15.60:0/4264218663 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe038032e50 con 0x7fe0440c3ff0 2024-09-12T02:26:30.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.598+0000 7fe04a113640 1 -- 172.21.15.60:0/4264218663 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe04414f390 con 0x7fe0440c3ff0 2024-09-12T02:26:30.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.598+0000 7fe02bfff640 1 -- 172.21.15.60:0/4264218663 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe038037040 con 0x7fe0440c3ff0 2024-09-12T02:26:30.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.598+0000 7fe04a113640 1 -- 172.21.15.60:0/4264218663 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe04414f950 con 0x7fe0440c3ff0 2024-09-12T02:26:30.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.600+0000 7fe04a113640 1 -- 172.21.15.60:0/4264218663 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe04406d6e0 con 0x7fe0440c3ff0 2024-09-12T02:26:30.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.600+0000 7fe02bfff640 1 -- 172.21.15.60:0/4264218663 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe038044020 con 0x7fe0440c3ff0 2024-09-12T02:26:30.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.600+0000 7fe02bfff640 1 --2- 172.21.15.60:0/4264218663 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe03006bde0 0x7fe03006e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:30.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.601+0000 7fe02bfff640 1 -- 172.21.15.60:0/4264218663 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fe0380ab710 con 0x7fe0440c3ff0 2024-09-12T02:26:30.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.601+0000 7fe0437fe640 1 --2- 172.21.15.60:0/4264218663 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe03006bde0 0x7fe03006e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:30.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.601+0000 7fe0437fe640 1 --2- 172.21.15.60:0/4264218663 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe03006bde0 0x7fe03006e2a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe044152070 tx=0x7fe0340079f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:30.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.607+0000 7fe02bfff640 1 -- 172.21.15.60:0/4264218663 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe03804b070 con 0x7fe0440c3ff0 2024-09-12T02:26:30.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.905+0000 7fe04a113640 1 -- 172.21.15.60:0/4264218663 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe04406d010 con 0x7fe0440c3ff0 2024-09-12T02:26:30.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.905+0000 7fe02bfff640 1 -- 172.21.15.60:0/4264218663 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7fe038079db0 con 0x7fe0440c3ff0 2024-09-12T02:26:30.906 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":30,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:26:30.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.908+0000 7fe04a113640 1 -- 172.21.15.60:0/4264218663 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe03006bde0 msgr2=0x7fe03006e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:30.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.908+0000 7fe04a113640 1 --2- 172.21.15.60:0/4264218663 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe03006bde0 0x7fe03006e2a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe044152070 tx=0x7fe0340079f0 comp rx=0 tx=0).stop 2024-09-12T02:26:30.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.908+0000 7fe04a113640 1 -- 172.21.15.60:0/4264218663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0440c3ff0 msgr2=0x7fe04414dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:30.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.908+0000 7fe04a113640 1 --2- 172.21.15.60:0/4264218663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0440c3ff0 0x7fe04414dfb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe038000c00 tx=0x7fe0380046c0 comp rx=0 tx=0).stop 2024-09-12T02:26:30.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.908+0000 7fe04a113640 1 -- 172.21.15.60:0/4264218663 shutdown_connections 2024-09-12T02:26:30.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.908+0000 7fe04a113640 1 --2- 172.21.15.60:0/4264218663 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe03006bde0 0x7fe03006e2a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:30.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.908+0000 7fe04a113640 1 --2- 172.21.15.60:0/4264218663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe04415a550 0x7fe04414e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:30.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.908+0000 7fe04a113640 1 --2- 172.21.15.60:0/4264218663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0440c3ff0 0x7fe04414dfb0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:30.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.908+0000 7fe04a113640 1 --2- 172.21.15.60:0/4264218663 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe04406d230 0x7fe044151550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:30.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.908+0000 7fe04a113640 1 -- 172.21.15.60:0/4264218663 >> 172.21.15.60:0/4264218663 conn(0x7fe044067b30 msgr2=0x7fe044153850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:26:30.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.908+0000 7fe04a113640 1 -- 172.21.15.60:0/4264218663 shutdown_connections 2024-09-12T02:26:30.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:30.908+0000 7fe04a113640 1 -- 172.21.15.60:0/4264218663 wait complete. 2024-09-12T02:26:33.920 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:26:34.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.029+0000 7f357b8d7640 1 Processor -- start 2024-09-12T02:26:34.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.030+0000 7f357b8d7640 1 -- start start 2024-09-12T02:26:34.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.031+0000 7f357b8d7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3574067d20 0x7f35740c3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:34.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.031+0000 7f357b8d7640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f35740abc50 0x7f35740c3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:34.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.031+0000 7f357b8d7640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3574153d70 con 0x7f3574150b70 2024-09-12T02:26:34.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.031+0000 7f357b8d7640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f35740a82c0 con 0x7f35740abc50 2024-09-12T02:26:34.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.031+0000 7f357b8d7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f35741542f0 con 0x7f3574067d20 2024-09-12T02:26:34.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.031+0000 7f3578e72640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3574067d20 msgr2=0x7f35740c3350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:26:34.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.031+0000 7f3578e72640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3574067d20 0x7f35740c3350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:26:34.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.031+0000 7f3579e74640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f35740abc50 0x7f35740c3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:34.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.031+0000 7f3579e74640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f35740abc50 0x7f35740c3890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:45366/0 (socket says 172.21.15.60:45366) 2024-09-12T02:26:34.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.031+0000 7f3579e74640 1 -- 172.21.15.60:0/2078568558 learned_addr learned my addr 172.21.15.60:0/2078568558 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:26:34.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.031+0000 7f3579e74640 1 -- 172.21.15.60:0/2078568558 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3574067d20 msgr2=0x7f35740c3350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:26:34.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.031+0000 7f3579e74640 1 --2- 172.21.15.60:0/2078568558 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3574067d20 0x7f35740c3350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:34.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.031+0000 7f3579e74640 1 -- 172.21.15.60:0/2078568558 >> v1:172.21.15.105:6789/0 conn(0x7f3574150b70 legacy=0x7f35740ac1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:34.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.031+0000 7f3579e74640 1 -- 172.21.15.60:0/2078568558 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3574154010 con 0x7f35740abc50 2024-09-12T02:26:34.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.032+0000 7f3579e74640 1 --2- 172.21.15.60:0/2078568558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35740abc50 0x7f35740c3890 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f356c009e50 tx=0x7f356c02a610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b99fdb5a75991b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:34.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.032+0000 7f356bfff640 1 -- 172.21.15.60:0/2078568558 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f356c036070 con 0x7f35740abc50 2024-09-12T02:26:34.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.032+0000 7f356bfff640 1 -- 172.21.15.60:0/2078568558 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f356c031600 con 0x7f35740abc50 2024-09-12T02:26:34.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.032+0000 7f356bfff640 1 -- 172.21.15.60:0/2078568558 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f356c0319d0 con 0x7f35740abc50 2024-09-12T02:26:34.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.033+0000 7f357b8d7640 1 -- 172.21.15.60:0/2078568558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35740abc50 msgr2=0x7f35740c3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:34.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.033+0000 7f357b8d7640 1 --2- 172.21.15.60:0/2078568558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35740abc50 0x7f35740c3890 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f356c009e50 tx=0x7f356c02a610 comp rx=0 tx=0).stop 2024-09-12T02:26:34.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.033+0000 7f357b8d7640 1 -- 172.21.15.60:0/2078568558 shutdown_connections 2024-09-12T02:26:34.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.033+0000 7f357b8d7640 1 --2- 172.21.15.60:0/2078568558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35740abc50 0x7f35740c3890 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:34.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.033+0000 7f357b8d7640 1 --2- 172.21.15.60:0/2078568558 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3574067d20 0x7f35740c3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:34.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.033+0000 7f357b8d7640 1 -- 172.21.15.60:0/2078568558 >> 172.21.15.60:0/2078568558 conn(0x7f35740c8430 msgr2=0x7f35740c8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:26:34.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.033+0000 7f357b8d7640 1 -- 172.21.15.60:0/2078568558 shutdown_connections 2024-09-12T02:26:34.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.033+0000 7f357b8d7640 1 -- 172.21.15.60:0/2078568558 wait complete. 2024-09-12T02:26:34.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.034+0000 7f357b8d7640 1 Processor -- start 2024-09-12T02:26:34.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.034+0000 7f357b8d7640 1 -- start start 2024-09-12T02:26:34.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.035+0000 7f357b8d7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3574067d20 0x7f3574156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:34.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.035+0000 7f357b8d7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35740abc50 0x7f35740737d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:34.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.035+0000 7f357b8d7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3574150b70 0x7f35741e9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:34.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.035+0000 7f357b8d7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f35740c2e30 con 0x7f3574150b70 2024-09-12T02:26:34.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.035+0000 7f357b8d7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f35740ab8f0 con 0x7f3574067d20 2024-09-12T02:26:34.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.035+0000 7f357b8d7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3574150f50 con 0x7f35740abc50 2024-09-12T02:26:34.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.035+0000 7f3578e72640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35740abc50 msgr2=0x7f35740737d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:26:34.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.035+0000 7f3578e72640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35740abc50 0x7f35740737d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:26:34.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.035+0000 7f3579e74640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3574150b70 0x7f35741e9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:34.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.035+0000 7f3579e74640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3574150b70 0x7f35741e9ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47994/0 (socket says 172.21.15.60:47994) 2024-09-12T02:26:34.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.035+0000 7f3579e74640 1 -- 172.21.15.60:0/1370042554 learned_addr learned my addr 172.21.15.60:0/1370042554 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:26:34.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.035+0000 7f3579673640 1 --2- 172.21.15.60:0/1370042554 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3574067d20 0x7f3574156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:34.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.036+0000 7f3579e74640 1 -- 172.21.15.60:0/1370042554 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35740abc50 msgr2=0x7f35740737d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:26:34.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.036+0000 7f3579e74640 1 --2- 172.21.15.60:0/1370042554 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35740abc50 0x7f35740737d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:34.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.036+0000 7f3579e74640 1 -- 172.21.15.60:0/1370042554 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3574067d20 msgr2=0x7f3574156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:34.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.036+0000 7f3579e74640 1 --2- 172.21.15.60:0/1370042554 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3574067d20 0x7f3574156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:34.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.036+0000 7f3579e74640 1 -- 172.21.15.60:0/1370042554 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3574157490 con 0x7f3574150b70 2024-09-12T02:26:34.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.036+0000 7f3579e74640 1 --2- 172.21.15.60:0/1370042554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3574150b70 0x7f35741e9ba0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f356c034040 tx=0x7f356c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:34.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.036+0000 7f3569ffb640 1 -- 172.21.15.60:0/1370042554 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f356c041020 con 0x7f3574150b70 2024-09-12T02:26:34.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.036+0000 7f3569ffb640 1 -- 172.21.15.60:0/1370042554 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f356c007780 con 0x7f3574150b70 2024-09-12T02:26:34.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.036+0000 7f357b8d7640 1 -- 172.21.15.60:0/1370042554 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35741ed240 con 0x7f3574150b70 2024-09-12T02:26:34.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.036+0000 7f3569ffb640 1 -- 172.21.15.60:0/1370042554 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f356c036040 con 0x7f3574150b70 2024-09-12T02:26:34.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.037+0000 7f357b8d7640 1 -- 172.21.15.60:0/1370042554 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3574073d10 con 0x7f3574150b70 2024-09-12T02:26:34.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.038+0000 7f357b8d7640 1 -- 172.21.15.60:0/1370042554 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35740ac1a0 con 0x7f3574150b70 2024-09-12T02:26:34.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.039+0000 7f3569ffb640 1 -- 172.21.15.60:0/1370042554 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f356c044020 con 0x7f3574150b70 2024-09-12T02:26:34.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.039+0000 7f3569ffb640 1 --2- 172.21.15.60:0/1370042554 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f35580701f0 0x7f35580726b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:34.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.039+0000 7f3569ffb640 1 -- 172.21.15.60:0/1370042554 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f356c0abd80 con 0x7f3574150b70 2024-09-12T02:26:34.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.039+0000 7f3579673640 1 --2- 172.21.15.60:0/1370042554 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f35580701f0 0x7f35580726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:34.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.040+0000 7f3579673640 1 --2- 172.21.15.60:0/1370042554 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f35580701f0 0x7f35580726b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3570001640 tx=0x7f3570009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:34.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.044+0000 7f3569ffb640 1 -- 172.21.15.60:0/1370042554 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f356c04b070 con 0x7f3574150b70 2024-09-12T02:26:34.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.341+0000 7f357b8d7640 1 -- 172.21.15.60:0/1370042554 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3574067b00 con 0x7f3574150b70 2024-09-12T02:26:34.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.342+0000 7f3569ffb640 1 -- 172.21.15.60:0/1370042554 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f356c07a4e0 con 0x7f3574150b70 2024-09-12T02:26:34.342 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":30,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":19,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:26:34.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.345+0000 7f357b8d7640 1 -- 172.21.15.60:0/1370042554 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f35580701f0 msgr2=0x7f35580726b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:34.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.345+0000 7f357b8d7640 1 --2- 172.21.15.60:0/1370042554 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f35580701f0 0x7f35580726b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3570001640 tx=0x7f3570009040 comp rx=0 tx=0).stop 2024-09-12T02:26:34.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.345+0000 7f357b8d7640 1 -- 172.21.15.60:0/1370042554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3574150b70 msgr2=0x7f35741e9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:34.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.345+0000 7f357b8d7640 1 --2- 172.21.15.60:0/1370042554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3574150b70 0x7f35741e9ba0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f356c034040 tx=0x7f356c004a40 comp rx=0 tx=0).stop 2024-09-12T02:26:34.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.345+0000 7f357b8d7640 1 -- 172.21.15.60:0/1370042554 shutdown_connections 2024-09-12T02:26:34.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.345+0000 7f357b8d7640 1 --2- 172.21.15.60:0/1370042554 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f35580701f0 0x7f35580726b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:34.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.345+0000 7f357b8d7640 1 --2- 172.21.15.60:0/1370042554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3574150b70 0x7f35741e9ba0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:34.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.345+0000 7f357b8d7640 1 --2- 172.21.15.60:0/1370042554 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35740abc50 0x7f35740737d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:34.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.345+0000 7f357b8d7640 1 --2- 172.21.15.60:0/1370042554 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3574067d20 0x7f3574156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:34.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.345+0000 7f357b8d7640 1 -- 172.21.15.60:0/1370042554 >> 172.21.15.60:0/1370042554 conn(0x7f35740c8430 msgr2=0x7f357414f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:26:34.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.345+0000 7f357b8d7640 1 -- 172.21.15.60:0/1370042554 shutdown_connections 2024-09-12T02:26:34.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:34.345+0000 7f357b8d7640 1 -- 172.21.15.60:0/1370042554 wait complete. 2024-09-12T02:26:37.358 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:26:37.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:37.472+0000 7fbd4b152640 1 Processor -- start 2024-09-12T02:26:37.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:37.472+0000 7fbd4b152640 1 -- start start 2024-09-12T02:26:37.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:37.473+0000 7fbd4b152640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbd4406cd80 0x7fbd44153be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:37.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:37.473+0000 7fbd4b152640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd440c7070 con 0x7fbd4415a4a0 2024-09-12T02:26:37.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:37.473+0000 7fbd4b152640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd4406d210 con 0x7fbd440c8b10 2024-09-12T02:26:37.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:37.473+0000 7fbd4b152640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fbd440c69b0 con 0x7fbd4406cd80 2024-09-12T02:26:37.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:37.473+0000 7fbd43fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbd4406cd80 0x7fbd44153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:37.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:37.473+0000 7fbd43fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbd4406cd80 0x7fbd44153be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48002/0 (socket says 172.21.15.60:48002) 2024-09-12T02:26:37.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:37.473+0000 7fbd496ef640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fbd4415a4a0 0x7fbd44156660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:36138/0 (socket says 172.21.15.60:36138) 2024-09-12T02:26:37.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:37.473+0000 7fbd43fff640 1 -- 172.21.15.60:0/1464425702 learned_addr learned my addr 172.21.15.60:0/1464425702 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:26:37.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:37.474+0000 7fbd43fff640 1 -- 172.21.15.60:0/1464425702 >> v2:172.21.15.60:3300/0 conn(0x7fbd4406cd80 msgr2=0x7fbd44153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:26:37.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:37.474+0000 7fbd43fff640 1 -- 172.21.15.60:0/1464425702 >> v2:172.21.15.60:3300/0 conn(0x7fbd4406cd80 msgr2=0x7fbd44153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:26:37.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:37.474+0000 7fbd43fff640 1 --2- 172.21.15.60:0/1464425702 >> v2:172.21.15.60:3300/0 conn(0x7fbd4406cd80 0x7fbd44153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:26:37.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:37.474+0000 7fbd43fff640 1 --2- 172.21.15.60:0/1464425702 >> v2:172.21.15.60:3300/0 conn(0x7fbd4406cd80 0x7fbd44153be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:26:37.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:37.675+0000 7fbd43fff640 1 --2- 172.21.15.60:0/1464425702 >> v2:172.21.15.60:3300/0 conn(0x7fbd4406cd80 0x7fbd44153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:37.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:37.675+0000 7fbd43fff640 1 -- 172.21.15.60:0/1464425702 >> v2:172.21.15.60:3300/0 conn(0x7fbd4406cd80 msgr2=0x7fbd44153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:26:37.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:37.675+0000 7fbd43fff640 1 -- 172.21.15.60:0/1464425702 >> v2:172.21.15.60:3300/0 conn(0x7fbd4406cd80 msgr2=0x7fbd44153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:26:37.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:37.675+0000 7fbd43fff640 1 --2- 172.21.15.60:0/1464425702 >> v2:172.21.15.60:3300/0 conn(0x7fbd4406cd80 0x7fbd44153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:26:37.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:37.675+0000 7fbd43fff640 1 --2- 172.21.15.60:0/1464425702 >> v2:172.21.15.60:3300/0 conn(0x7fbd4406cd80 0x7fbd44153be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:26:38.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:38.076+0000 7fbd43fff640 1 --2- 172.21.15.60:0/1464425702 >> v2:172.21.15.60:3300/0 conn(0x7fbd4406cd80 0x7fbd44153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:38.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:38.076+0000 7fbd43fff640 1 -- 172.21.15.60:0/1464425702 >> v2:172.21.15.60:3300/0 conn(0x7fbd4406cd80 msgr2=0x7fbd44153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:26:38.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:38.076+0000 7fbd43fff640 1 -- 172.21.15.60:0/1464425702 >> v2:172.21.15.60:3300/0 conn(0x7fbd4406cd80 msgr2=0x7fbd44153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:26:38.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:38.076+0000 7fbd43fff640 1 --2- 172.21.15.60:0/1464425702 >> v2:172.21.15.60:3300/0 conn(0x7fbd4406cd80 0x7fbd44153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:26:38.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:38.076+0000 7fbd43fff640 1 --2- 172.21.15.60:0/1464425702 >> v2:172.21.15.60:3300/0 conn(0x7fbd4406cd80 0x7fbd44153be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:26:38.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:38.877+0000 7fbd43fff640 1 --2- 172.21.15.60:0/1464425702 >> v2:172.21.15.60:3300/0 conn(0x7fbd4406cd80 0x7fbd44153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:38.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:38.877+0000 7fbd43fff640 1 -- 172.21.15.60:0/1464425702 >> v2:172.21.15.60:3300/0 conn(0x7fbd4406cd80 msgr2=0x7fbd44153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:26:38.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:38.877+0000 7fbd43fff640 1 -- 172.21.15.60:0/1464425702 >> v2:172.21.15.60:3300/0 conn(0x7fbd4406cd80 msgr2=0x7fbd44153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:26:38.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:38.877+0000 7fbd43fff640 1 --2- 172.21.15.60:0/1464425702 >> v2:172.21.15.60:3300/0 conn(0x7fbd4406cd80 0x7fbd44153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:26:38.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:38.877+0000 7fbd43fff640 1 --2- 172.21.15.60:0/1464425702 >> v2:172.21.15.60:3300/0 conn(0x7fbd4406cd80 0x7fbd44153be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:26:40.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:40.473+0000 7fbd427fc640 1 -- 172.21.15.60:0/1464425702 >> v2:172.21.15.60:3300/0 conn(0x7fbd4406cd80 msgr2=0x7fbd44153be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:26:40.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:40.473+0000 7fbd427fc640 1 --2- 172.21.15.60:0/1464425702 >> v2:172.21.15.60:3300/0 conn(0x7fbd4406cd80 0x7fbd44153be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:40.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:40.473+0000 7fbd427fc640 1 -- 172.21.15.60:0/1464425702 >> v1:172.21.15.105:6789/0 conn(0x7fbd440c8b10 legacy=0x7fbd441534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:40.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:40.473+0000 7fbd427fc640 1 -- 172.21.15.60:0/1464425702 >> v1:172.21.15.60:6789/0 conn(0x7fbd4415a4a0 legacy=0x7fbd44156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:40.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:40.473+0000 7fbd427fc640 1 --2- 172.21.15.60:0/1464425702 >> v2:172.21.15.105:3300/0 conn(0x7fbd280036c0 0x7fbd28005b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:40.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:40.473+0000 7fbd427fc640 1 --2- 172.21.15.60:0/1464425702 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd28006180 0x7fbd28008620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:40.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:40.473+0000 7fbd427fc640 1 -- 172.21.15.60:0/1464425702 --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fbd440c69b0 con 0x7fbd280036c0 2024-09-12T02:26:40.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:40.473+0000 7fbd427fc640 1 -- 172.21.15.60:0/1464425702 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbd28008d30 con 0x7fbd28006180 2024-09-12T02:26:40.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:40.473+0000 7fbd43fff640 1 -- 172.21.15.60:0/1464425702 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd28006180 msgr2=0x7fbd28008620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:26:40.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:40.473+0000 7fbd43fff640 1 --2- 172.21.15.60:0/1464425702 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd28006180 0x7fbd28008620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:26:40.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:40.474+0000 7fbd48eee640 1 --2- 172.21.15.60:0/1464425702 >> v2:172.21.15.105:3300/0 conn(0x7fbd280036c0 0x7fbd28005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:40.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:40.474+0000 7fbd48eee640 1 -- 172.21.15.60:0/1464425702 >> v2:172.21.15.105:3300/0 conn(0x7fbd280036c0 msgr2=0x7fbd28005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:26:40.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:40.474+0000 7fbd48eee640 1 -- 172.21.15.60:0/1464425702 >> v2:172.21.15.105:3300/0 conn(0x7fbd280036c0 msgr2=0x7fbd28005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:26:40.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:40.474+0000 7fbd48eee640 1 --2- 172.21.15.60:0/1464425702 >> v2:172.21.15.105:3300/0 conn(0x7fbd280036c0 0x7fbd28005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:26:40.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:40.474+0000 7fbd48eee640 1 --2- 172.21.15.60:0/1464425702 >> v2:172.21.15.105:3300/0 conn(0x7fbd280036c0 0x7fbd28005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:26:40.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:40.674+0000 7fbd43fff640 1 -- 172.21.15.60:0/1464425702 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd28006180 msgr2=0x7fbd28008620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:26:40.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:40.674+0000 7fbd43fff640 1 --2- 172.21.15.60:0/1464425702 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd28006180 0x7fbd28008620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:26:40.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:40.675+0000 7fbd48eee640 1 --2- 172.21.15.60:0/1464425702 >> v2:172.21.15.105:3300/0 conn(0x7fbd280036c0 0x7fbd28005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:40.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:40.675+0000 7fbd48eee640 1 -- 172.21.15.60:0/1464425702 >> v2:172.21.15.105:3300/0 conn(0x7fbd280036c0 msgr2=0x7fbd28005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:26:40.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:40.675+0000 7fbd48eee640 1 -- 172.21.15.60:0/1464425702 >> v2:172.21.15.105:3300/0 conn(0x7fbd280036c0 msgr2=0x7fbd28005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:26:40.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:40.675+0000 7fbd48eee640 1 --2- 172.21.15.60:0/1464425702 >> v2:172.21.15.105:3300/0 conn(0x7fbd280036c0 0x7fbd28005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:26:40.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:40.675+0000 7fbd48eee640 1 --2- 172.21.15.60:0/1464425702 >> v2:172.21.15.105:3300/0 conn(0x7fbd280036c0 0x7fbd28005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:26:41.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.075+0000 7fbd43fff640 1 -- 172.21.15.60:0/1464425702 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd28006180 msgr2=0x7fbd28008620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:26:41.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.075+0000 7fbd43fff640 1 --2- 172.21.15.60:0/1464425702 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd28006180 0x7fbd28008620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:26:41.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.076+0000 7fbd48eee640 1 --2- 172.21.15.60:0/1464425702 >> v2:172.21.15.105:3300/0 conn(0x7fbd280036c0 0x7fbd28005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:41.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.076+0000 7fbd48eee640 1 -- 172.21.15.60:0/1464425702 >> v2:172.21.15.105:3300/0 conn(0x7fbd280036c0 msgr2=0x7fbd28005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:26:41.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.076+0000 7fbd48eee640 1 -- 172.21.15.60:0/1464425702 >> v2:172.21.15.105:3300/0 conn(0x7fbd280036c0 msgr2=0x7fbd28005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:26:41.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.076+0000 7fbd48eee640 1 --2- 172.21.15.60:0/1464425702 >> v2:172.21.15.105:3300/0 conn(0x7fbd280036c0 0x7fbd28005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:26:41.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.076+0000 7fbd48eee640 1 --2- 172.21.15.60:0/1464425702 >> v2:172.21.15.105:3300/0 conn(0x7fbd280036c0 0x7fbd28005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:26:41.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.876+0000 7fbd43fff640 1 -- 172.21.15.60:0/1464425702 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd28006180 msgr2=0x7fbd28008620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:26:41.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.876+0000 7fbd43fff640 1 --2- 172.21.15.60:0/1464425702 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd28006180 0x7fbd28008620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:26:41.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.877+0000 7fbd48eee640 1 --2- 172.21.15.60:0/1464425702 >> v2:172.21.15.105:3300/0 conn(0x7fbd280036c0 0x7fbd28005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:41.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.877+0000 7fbd48eee640 1 -- 172.21.15.60:0/1464425702 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd28006180 msgr2=0x7fbd28008620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:26:41.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.877+0000 7fbd48eee640 1 --2- 172.21.15.60:0/1464425702 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd28006180 0x7fbd28008620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:41.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.877+0000 7fbd48eee640 1 -- 172.21.15.60:0/1464425702 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd440c6c90 con 0x7fbd280036c0 2024-09-12T02:26:41.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.878+0000 7fbd48eee640 1 --2- 172.21.15.60:0/1464425702 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd280036c0 0x7fbd28005b40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbd38007c30 tx=0x7fbd3802a7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1848d43149a3055f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:41.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.878+0000 7fbd437fe640 1 -- 172.21.15.60:0/1464425702 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd38036070 con 0x7fbd280036c0 2024-09-12T02:26:41.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.878+0000 7fbd437fe640 1 -- 172.21.15.60:0/1464425702 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd380052e0 con 0x7fbd280036c0 2024-09-12T02:26:41.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.878+0000 7fbd437fe640 1 -- 172.21.15.60:0/1464425702 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd38005490 con 0x7fbd280036c0 2024-09-12T02:26:41.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.879+0000 7fbd4b152640 1 -- 172.21.15.60:0/1464425702 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd280036c0 msgr2=0x7fbd28005b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:41.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.879+0000 7fbd4b152640 1 --2- 172.21.15.60:0/1464425702 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd280036c0 0x7fbd28005b40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbd38007c30 tx=0x7fbd3802a7b0 comp rx=0 tx=0).stop 2024-09-12T02:26:41.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.879+0000 7fbd496ef640 1 -- 172.21.15.60:0/1464425702 reap_dead start 2024-09-12T02:26:41.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.879+0000 7fbd4b152640 1 -- 172.21.15.60:0/1464425702 shutdown_connections 2024-09-12T02:26:41.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.879+0000 7fbd4b152640 1 --2- 172.21.15.60:0/1464425702 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd280036c0 0x7fbd28005b40 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:41.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.879+0000 7fbd4b152640 1 -- 172.21.15.60:0/1464425702 >> 172.21.15.60:0/1464425702 conn(0x7fbd440adb80 msgr2=0x7fbd440adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:26:41.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.879+0000 7fbd4b152640 1 -- 172.21.15.60:0/1464425702 shutdown_connections 2024-09-12T02:26:41.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.879+0000 7fbd4b152640 1 -- 172.21.15.60:0/1464425702 wait complete. 2024-09-12T02:26:41.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.881+0000 7fbd4b152640 1 Processor -- start 2024-09-12T02:26:41.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.881+0000 7fbd4b152640 1 -- start start 2024-09-12T02:26:41.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.882+0000 7fbd4b152640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd280036c0 0x7fbd440b07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:41.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.882+0000 7fbd4b152640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd4414c7f0 0x7fbd4414bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:41.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.882+0000 7fbd4b152640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd4414cd20 0x7fbd440af380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:41.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.882+0000 7fbd4b152640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbd440c9070 con 0x7fbd4414c7f0 2024-09-12T02:26:41.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.882+0000 7fbd4b152640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbd440c8ef0 con 0x7fbd280036c0 2024-09-12T02:26:41.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.882+0000 7fbd4b152640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbd44156d70 con 0x7fbd4414cd20 2024-09-12T02:26:41.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.882+0000 7fbd43fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd4414c7f0 0x7fbd4414bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:41.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.882+0000 7fbd496ef640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd4414cd20 msgr2=0x7fbd440af380 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:26:41.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.882+0000 7fbd43fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd4414c7f0 0x7fbd4414bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47814/0 (socket says 172.21.15.60:47814) 2024-09-12T02:26:41.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.882+0000 7fbd496ef640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd4414cd20 0x7fbd440af380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:26:41.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.882+0000 7fbd48eee640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd280036c0 0x7fbd440b07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:41.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.882+0000 7fbd43fff640 1 -- 172.21.15.60:0/1839890506 learned_addr learned my addr 172.21.15.60:0/1839890506 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:26:41.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.882+0000 7fbd48eee640 1 -- 172.21.15.60:0/1839890506 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd4414cd20 msgr2=0x7fbd440af380 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:26:41.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.882+0000 7fbd48eee640 1 --2- 172.21.15.60:0/1839890506 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd4414cd20 0x7fbd440af380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:41.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.882+0000 7fbd48eee640 1 -- 172.21.15.60:0/1839890506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd4414c7f0 msgr2=0x7fbd4414bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:41.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.882+0000 7fbd48eee640 1 --2- 172.21.15.60:0/1839890506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd4414c7f0 0x7fbd4414bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:41.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.882+0000 7fbd48eee640 1 -- 172.21.15.60:0/1839890506 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd441ecb90 con 0x7fbd280036c0 2024-09-12T02:26:41.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.882+0000 7fbd43fff640 1 --2- 172.21.15.60:0/1839890506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd4414c7f0 0x7fbd4414bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:26:41.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.883+0000 7fbd48eee640 1 --2- 172.21.15.60:0/1839890506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd280036c0 0x7fbd440b07d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbd28008d00 tx=0x7fbd38001120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:41.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.883+0000 7fbd417fa640 1 -- 172.21.15.60:0/1839890506 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd38041020 con 0x7fbd280036c0 2024-09-12T02:26:41.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.883+0000 7fbd417fa640 1 -- 172.21.15.60:0/1839890506 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd380329e0 con 0x7fbd280036c0 2024-09-12T02:26:41.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.883+0000 7fbd417fa640 1 -- 172.21.15.60:0/1839890506 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd38036040 con 0x7fbd280036c0 2024-09-12T02:26:41.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.883+0000 7fbd4b152640 1 -- 172.21.15.60:0/1839890506 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd441ece70 con 0x7fbd280036c0 2024-09-12T02:26:41.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.883+0000 7fbd4b152640 1 -- 172.21.15.60:0/1839890506 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd44150560 con 0x7fbd280036c0 2024-09-12T02:26:41.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.884+0000 7fbd4b152640 1 -- 172.21.15.60:0/1839890506 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd44157100 con 0x7fbd280036c0 2024-09-12T02:26:41.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.884+0000 7fbd417fa640 1 -- 172.21.15.60:0/1839890506 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbd38044020 con 0x7fbd280036c0 2024-09-12T02:26:41.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.885+0000 7fbd417fa640 1 --2- 172.21.15.60:0/1839890506 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbd2806cc00 0x7fbd2806f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:41.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.885+0000 7fbd417fa640 1 -- 172.21.15.60:0/1839890506 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fbd380ab8a0 con 0x7fbd280036c0 2024-09-12T02:26:41.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.885+0000 7fbd43fff640 1 --2- 172.21.15.60:0/1839890506 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbd2806cc00 0x7fbd2806f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:41.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.885+0000 7fbd43fff640 1 --2- 172.21.15.60:0/1839890506 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbd2806cc00 0x7fbd2806f0c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbd440b2350 tx=0x7fbd30008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:41.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:41.890+0000 7fbd417fa640 1 -- 172.21.15.60:0/1839890506 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbd3804b030 con 0x7fbd280036c0 2024-09-12T02:26:42.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.180+0000 7fbd4b152640 1 -- 172.21.15.60:0/1839890506 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fbd440c9d90 con 0x7fbd280036c0 2024-09-12T02:26:42.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.180+0000 7fbd417fa640 1 -- 172.21.15.60:0/1839890506 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7fbd38079f40 con 0x7fbd280036c0 2024-09-12T02:26:42.181 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":34,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:26:42.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.182+0000 7fbd4b152640 1 -- 172.21.15.60:0/1839890506 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbd2806cc00 msgr2=0x7fbd2806f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:42.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.182+0000 7fbd4b152640 1 --2- 172.21.15.60:0/1839890506 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbd2806cc00 0x7fbd2806f0c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbd440b2350 tx=0x7fbd30008040 comp rx=0 tx=0).stop 2024-09-12T02:26:42.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.182+0000 7fbd4b152640 1 -- 172.21.15.60:0/1839890506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd280036c0 msgr2=0x7fbd440b07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:42.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.182+0000 7fbd4b152640 1 --2- 172.21.15.60:0/1839890506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd280036c0 0x7fbd440b07d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbd28008d00 tx=0x7fbd38001120 comp rx=0 tx=0).stop 2024-09-12T02:26:42.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.182+0000 7fbd4b152640 1 -- 172.21.15.60:0/1839890506 shutdown_connections 2024-09-12T02:26:42.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.182+0000 7fbd4b152640 1 --2- 172.21.15.60:0/1839890506 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbd2806cc00 0x7fbd2806f0c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:42.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.182+0000 7fbd4b152640 1 --2- 172.21.15.60:0/1839890506 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd4414cd20 0x7fbd440af380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:42.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.182+0000 7fbd4b152640 1 --2- 172.21.15.60:0/1839890506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd4414c7f0 0x7fbd4414bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:42.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.182+0000 7fbd4b152640 1 --2- 172.21.15.60:0/1839890506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd280036c0 0x7fbd440b07d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:42.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.183+0000 7fbd4b152640 1 -- 172.21.15.60:0/1839890506 >> 172.21.15.60:0/1839890506 conn(0x7fbd440adb80 msgr2=0x7fbd44155840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:26:42.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.183+0000 7fbd4b152640 1 -- 172.21.15.60:0/1839890506 shutdown_connections 2024-09-12T02:26:42.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.183+0000 7fbd4b152640 1 -- 172.21.15.60:0/1839890506 wait complete. 2024-09-12T02:26:42.194 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-12T02:26:42.194 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-09-12T02:26:42.195 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-12T02:26:42.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.304+0000 7f47c72c9640 1 Processor -- start 2024-09-12T02:26:42.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.304+0000 7f47c72c9640 1 -- start start 2024-09-12T02:26:42.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.305+0000 7f47c72c9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47c0150480 0x7f47c00c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:42.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.305+0000 7f47c72c9640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f47c006c650 0x7f47c00c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:42.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.305+0000 7f47c72c9640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47c015a7c0 con 0x7f47c00c9c80 2024-09-12T02:26:42.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.305+0000 7f47c72c9640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f47c006c240 con 0x7f47c006c650 2024-09-12T02:26:42.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.305+0000 7f47c72c9640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f47c015a330 con 0x7f47c0150480 2024-09-12T02:26:42.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.305+0000 7f47c5065640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47c0150480 msgr2=0x7f47c00c7a90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:26:42.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.306+0000 7f47c5065640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47c0150480 0x7f47c00c7a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:26:42.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.306+0000 7f47c4864640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f47c006c650 0x7f47c00c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:42.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.306+0000 7f47c4864640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f47c006c650 0x7f47c00c7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:35562/0 (socket says 172.21.15.60:35562) 2024-09-12T02:26:42.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.306+0000 7f47c4864640 1 -- 172.21.15.60:0/2328853471 learned_addr learned my addr 172.21.15.60:0/2328853471 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:26:42.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.306+0000 7f47c4864640 1 -- 172.21.15.60:0/2328853471 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47c0150480 msgr2=0x7f47c00c7a90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:26:42.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.306+0000 7f47c4864640 1 --2- 172.21.15.60:0/2328853471 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47c0150480 0x7f47c00c7a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:42.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.306+0000 7f47c4864640 1 -- 172.21.15.60:0/2328853471 >> v1:172.21.15.105:6789/0 conn(0x7f47c00c9c80 legacy=0x7f47c00ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:42.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.306+0000 7f47c4864640 1 -- 172.21.15.60:0/2328853471 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c0159a00 con 0x7f47c006c650 2024-09-12T02:26:42.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.307+0000 7f47c4864640 1 --2- 172.21.15.60:0/2328853471 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47c006c650 0x7f47c00c7fd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f47b0009870 tx=0x7f47b002a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=298c4bbfcd5191c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:42.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.307+0000 7f47b7fff640 1 -- 172.21.15.60:0/2328853471 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b0037070 con 0x7f47c006c650 2024-09-12T02:26:42.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.307+0000 7f47b7fff640 1 -- 172.21.15.60:0/2328853471 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47b0032440 con 0x7f47c006c650 2024-09-12T02:26:42.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.307+0000 7f47b7fff640 1 -- 172.21.15.60:0/2328853471 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b0032810 con 0x7f47c006c650 2024-09-12T02:26:42.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.308+0000 7f47c72c9640 1 -- 172.21.15.60:0/2328853471 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47c006c650 msgr2=0x7f47c00c7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:42.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.308+0000 7f47c72c9640 1 --2- 172.21.15.60:0/2328853471 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47c006c650 0x7f47c00c7fd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f47b0009870 tx=0x7f47b002a270 comp rx=0 tx=0).stop 2024-09-12T02:26:42.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.308+0000 7f47c72c9640 1 -- 172.21.15.60:0/2328853471 shutdown_connections 2024-09-12T02:26:42.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.308+0000 7f47c72c9640 1 --2- 172.21.15.60:0/2328853471 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47c006c650 0x7f47c00c7fd0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:42.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.308+0000 7f47c72c9640 1 --2- 172.21.15.60:0/2328853471 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47c0150480 0x7f47c00c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:42.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.308+0000 7f47c72c9640 1 -- 172.21.15.60:0/2328853471 >> 172.21.15.60:0/2328853471 conn(0x7f47c0068030 msgr2=0x7f47c0073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:26:42.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.308+0000 7f47c72c9640 1 -- 172.21.15.60:0/2328853471 shutdown_connections 2024-09-12T02:26:42.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.308+0000 7f47c72c9640 1 -- 172.21.15.60:0/2328853471 wait complete. 2024-09-12T02:26:42.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.309+0000 7f47c72c9640 1 Processor -- start 2024-09-12T02:26:42.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.309+0000 7f47c72c9640 1 -- start start 2024-09-12T02:26:42.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.310+0000 7f47c72c9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47c006c650 0x7f47c01ecc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.310+0000 7f47c72c9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47c00c9c80 0x7f47c0158b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.310+0000 7f47c72c9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47c0150480 0x7f47c00af250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.310+0000 7f47c72c9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f47c006d270 con 0x7f47c006c650 2024-09-12T02:26:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.310+0000 7f47c72c9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f47c0159fc0 con 0x7f47c00c9c80 2024-09-12T02:26:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.310+0000 7f47c72c9640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f47c0156270 con 0x7f47c0150480 2024-09-12T02:26:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.310+0000 7f47c5866640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47c0150480 msgr2=0x7f47c00af250 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:26:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.310+0000 7f47c5065640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47c006c650 0x7f47c01ecc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.310+0000 7f47c5866640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47c0150480 0x7f47c00af250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:26:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.310+0000 7f47c5065640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47c006c650 0x7f47c01ecc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47818/0 (socket says 172.21.15.60:47818) 2024-09-12T02:26:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.310+0000 7f47c5065640 1 -- 172.21.15.60:0/3793196012 learned_addr learned my addr 172.21.15.60:0/3793196012 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:26:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.310+0000 7f47c4864640 1 --2- 172.21.15.60:0/3793196012 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47c00c9c80 0x7f47c0158b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.310+0000 7f47c5065640 1 -- 172.21.15.60:0/3793196012 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47c0150480 msgr2=0x7f47c00af250 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:26:42.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.310+0000 7f47c5065640 1 --2- 172.21.15.60:0/3793196012 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47c0150480 0x7f47c00af250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:42.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.310+0000 7f47c5065640 1 -- 172.21.15.60:0/3793196012 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47c00c9c80 msgr2=0x7f47c0158b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:42.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.310+0000 7f47c5065640 1 --2- 172.21.15.60:0/3793196012 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47c00c9c80 0x7f47c0158b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:42.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.310+0000 7f47c5065640 1 -- 172.21.15.60:0/3793196012 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c00b0620 con 0x7f47c006c650 2024-09-12T02:26:42.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.310+0000 7f47c4864640 1 --2- 172.21.15.60:0/3793196012 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47c00c9c80 0x7f47c0158b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:26:42.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.310+0000 7f47c5065640 1 --2- 172.21.15.60:0/3793196012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47c006c650 0x7f47c01ecc60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f47bc00b550 tx=0x7f47bc00ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:42.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.311+0000 7f47b5ffb640 1 -- 172.21.15.60:0/3793196012 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47bc013020 con 0x7f47c006c650 2024-09-12T02:26:42.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.311+0000 7f47b5ffb640 1 -- 172.21.15.60:0/3793196012 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47bc003de0 con 0x7f47c006c650 2024-09-12T02:26:42.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.311+0000 7f47c72c9640 1 -- 172.21.15.60:0/3793196012 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47c00b0900 con 0x7f47c006c650 2024-09-12T02:26:42.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.311+0000 7f47b5ffb640 1 -- 172.21.15.60:0/3793196012 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47bc0052b0 con 0x7f47c006c650 2024-09-12T02:26:42.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.311+0000 7f47c72c9640 1 -- 172.21.15.60:0/3793196012 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47c01590a0 con 0x7f47c006c650 2024-09-12T02:26:42.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.312+0000 7f47c72c9640 1 --2- 172.21.15.60:0/3793196012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47c014fcf0 0x7f47c00af790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:42.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.312+0000 7f47c72c9640 1 -- 172.21.15.60:0/3793196012 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f47c01ed1a0 con 0x7f47c014fcf0 2024-09-12T02:26:42.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.312+0000 7f47c4864640 1 --2- 172.21.15.60:0/3793196012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47c014fcf0 0x7f47c00af790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:42.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.312+0000 7f47c4864640 1 -- 172.21.15.60:0/3793196012 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f47c00ca130 con 0x7f47c014fcf0 2024-09-12T02:26:42.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.312+0000 7f47c4864640 1 --2- 172.21.15.60:0/3793196012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47c014fcf0 0x7f47c00af790 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f47c00c62d0 tx=0x7f47b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:42.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.313+0000 7f47b5ffb640 1 -- 172.21.15.60:0/3793196012 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f47bc016020 con 0x7f47c006c650 2024-09-12T02:26:42.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.313+0000 7f47b5ffb640 1 --2- 172.21.15.60:0/3793196012 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f47a406bde0 0x7f47a406e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:42.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.313+0000 7f47b5ffb640 1 -- 172.21.15.60:0/3793196012 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f47bc08aea0 con 0x7f47c006c650 2024-09-12T02:26:42.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.313+0000 7f47c5866640 1 --2- 172.21.15.60:0/3793196012 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f47a406bde0 0x7f47a406e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:42.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.313+0000 7f47b5ffb640 1 -- 172.21.15.60:0/3793196012 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b0043070 con 0x7f47c014fcf0 2024-09-12T02:26:42.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.313+0000 7f47b5ffb640 1 -- 172.21.15.60:0/3793196012 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f47b003c910 con 0x7f47c014fcf0 2024-09-12T02:26:42.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.313+0000 7f47b5ffb640 1 -- 172.21.15.60:0/3793196012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47c014fcf0 msgr2=0x7f47c00af790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:42.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.313+0000 7f47b5ffb640 1 --2- 172.21.15.60:0/3793196012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47c014fcf0 0x7f47c00af790 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f47c00c62d0 tx=0x7f47b00046c0 comp rx=0 tx=0).stop 2024-09-12T02:26:42.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.313+0000 7f47b5ffb640 1 -- 172.21.15.60:0/3793196012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47c014fcf0 msgr2=0x7f47c00af790 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:26:42.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.313+0000 7f47b5ffb640 1 --2- 172.21.15.60:0/3793196012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47c014fcf0 0x7f47c00af790 secure :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f47c00c62d0 tx=0x7f47b00046c0 comp rx=0 tx=0).stop 2024-09-12T02:26:42.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.314+0000 7f47c5866640 1 --2- 172.21.15.60:0/3793196012 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f47a406bde0 0x7f47a406e2a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f47b80013b0 tx=0x7f47b8007d30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:42.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.320+0000 7f47c72c9640 1 --2- 172.21.15.60:0/3793196012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47c01ef750 0x7f47c01efb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:42.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.320+0000 7f47c72c9640 1 -- 172.21.15.60:0/3793196012 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f47c00698e0 con 0x7f47c01ef750 2024-09-12T02:26:42.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.321+0000 7f47c4864640 1 --2- 172.21.15.60:0/3793196012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47c01ef750 0x7f47c01efb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:42.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.321+0000 7f47c4864640 1 -- 172.21.15.60:0/3793196012 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f47c006c430 con 0x7f47c01ef750 2024-09-12T02:26:42.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.321+0000 7f47c4864640 1 --2- 172.21.15.60:0/3793196012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47c01ef750 0x7f47c01efb30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f47b0000c00 tx=0x7f47b0009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:42.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.321+0000 7f47b5ffb640 1 -- 172.21.15.60:0/3793196012 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b0037040 con 0x7f47c01ef750 2024-09-12T02:26:42.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.321+0000 7f47b5ffb640 1 -- 172.21.15.60:0/3793196012 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4873 (secure 0 0 0) 0x7f47b0049b10 con 0x7f47c01ef750 2024-09-12T02:26:42.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.321+0000 7f47b5ffb640 1 -- 172.21.15.60:0/3793196012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47c01ef750 msgr2=0x7f47c01efb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:42.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.321+0000 7f47b5ffb640 1 --2- 172.21.15.60:0/3793196012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47c01ef750 0x7f47c01efb30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f47b0000c00 tx=0x7f47b0009240 comp rx=0 tx=0).stop 2024-09-12T02:26:42.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.321+0000 7f47b5ffb640 1 -- 172.21.15.60:0/3793196012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47c01ef750 msgr2=0x7f47c01efb30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:26:42.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.321+0000 7f47b5ffb640 1 --2- 172.21.15.60:0/3793196012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47c01ef750 0x7f47c01efb30 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:42.323 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:26:42.323 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:26:42.323 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:26:42.323 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:26:42.323 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 34, 2024-09-12T02:26:42.323 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 42430, 2024-09-12T02:26:42.323 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:26:42.323 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:26:42.323 INFO:teuthology.orchestra.run.smithi060.stdout: 1 2024-09-12T02:26:42.323 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:42.324 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-09-12T02:26:42.324 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:26:42.324 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:26:42.324 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:26:42.324 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:26:42.324 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:26:42.324 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:26:42.324 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:26:42.324 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:26:42.324 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:26:42.324 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:26:42.324 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:26:42.324 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:26:42.324 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:26:42.325 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:26:42.325 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:42.325 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:26:42.325 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:26:42.325 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:26:42.325 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:26:42.325 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:26:42.325 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:26:42.325 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:26:42.325 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:26:42.325 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:26:42.325 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:26:42.325 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:26:42.325 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:26:42.326 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:26:42.326 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:42.326 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:42.326 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:26:42.326 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:26:42.326 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:26:42.326 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:26:42.326 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:26:42.326 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:26:42.326 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:26:42.326 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:26:42.326 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:26:42.326 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:26:42.326 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:26:42.326 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:26:42.327 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:26:42.327 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:26:42.327 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:26:42.327 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:26:42.327 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:26:42.327 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:26:42.327 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:26:42.327 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:26:42.327 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:26:42.327 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:26:42.327 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:26:42.327 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:26:42.327 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:26:42.328 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:26:42.328 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:26:42.328 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:26:42.328 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:42.328 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:26:42.328 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:42.328 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:26:42.328 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:42.328 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:26:42.328 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:26:42.328 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:26:42.329 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:26:42.329 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:42.329 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:26:42.329 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:26:42.329 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:42.329 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:42.329 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:42.329 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:26:42.329 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:26:42.329 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:42.329 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:42.329 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:42.329 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:42.329 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:26:42.329 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:26:42.330 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:26:42.330 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:26:42.330 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:26:42.330 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:42.330 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:42.330 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:26:42.330 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:26:42.330 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:26:42.330 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:26:42.330 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:42.330 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:26:42.330 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:26:42.330 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:42.330 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:42.330 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:42.331 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:26:42.331 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:26:42.331 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:42.331 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:42.331 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:42.331 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:42.331 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:26:42.331 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:26:42.331 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:26:42.331 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:26:42.331 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:26:42.331 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:42.331 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:42.331 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:26:42.332 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:26:42.332 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:26:42.332 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:26:42.332 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:42.332 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:26:42.332 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:26:42.332 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:42.332 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:42.332 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:42.332 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:26:42.332 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:26:42.332 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:42.332 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:42.332 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:42.332 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:42.333 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:26:42.333 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:26:42.333 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:26:42.333 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:26:42.333 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:26:42.333 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:42.333 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:42.333 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:42.333 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:26:42.333 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:26:42.333 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:42.333 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:26:42.333 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:26:42.333 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:26:42.334 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:42.334 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:42.334 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:26:42.334 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:42.334 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:26:42.334 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:26:42.334 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:26:42.334 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:42.334 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:42.334 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:26:42.335 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:42.335 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:26:42.335 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:26:42.335 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:26:42.335 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:42.335 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:42.335 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:26:42.335 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:42.335 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:26:42.335 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:26:42.335 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:26:42.335 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:42.335 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:42.335 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:42.336 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:26:42.336 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:26:42.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.322+0000 7f47c72c9640 1 -- 172.21.15.60:0/3793196012 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f47a406bde0 msgr2=0x7f47a406e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:42.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.322+0000 7f47c72c9640 1 --2- 172.21.15.60:0/3793196012 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f47a406bde0 0x7f47a406e2a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f47b80013b0 tx=0x7f47b8007d30 comp rx=0 tx=0).stop 2024-09-12T02:26:42.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.322+0000 7f47c72c9640 1 -- 172.21.15.60:0/3793196012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47c006c650 msgr2=0x7f47c01ecc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:42.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.322+0000 7f47c72c9640 1 --2- 172.21.15.60:0/3793196012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47c006c650 0x7f47c01ecc60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f47bc00b550 tx=0x7f47bc00ba10 comp rx=0 tx=0).stop 2024-09-12T02:26:42.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.322+0000 7f47c5866640 1 -- 172.21.15.60:0/3793196012 reap_dead start 2024-09-12T02:26:42.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.322+0000 7f47c5866640 1 -- 172.21.15.60:0/3793196012 reap_dead start 2024-09-12T02:26:42.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.322+0000 7f47c72c9640 1 -- 172.21.15.60:0/3793196012 shutdown_connections 2024-09-12T02:26:42.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.322+0000 7f47c72c9640 1 -- 172.21.15.60:0/3793196012 >> 172.21.15.60:0/3793196012 conn(0x7f47c0068030 msgr2=0x7f47c01e2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:26:42.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.322+0000 7f47c72c9640 1 -- 172.21.15.60:0/3793196012 shutdown_connections 2024-09-12T02:26:42.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.322+0000 7f47c72c9640 1 -- 172.21.15.60:0/3793196012 wait complete. 2024-09-12T02:26:42.338 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-12T02:26:42.338 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-12T02:26:42.338 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-12T02:26:42.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.450+0000 7f49a24d0640 1 Processor -- start 2024-09-12T02:26:42.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.450+0000 7f49a24d0640 1 -- start start 2024-09-12T02:26:42.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.451+0000 7f49a24d0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f499c150480 0x7f499c0c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:42.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.451+0000 7f49a24d0640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f499c15a7c0 con 0x7f499c0ca390 2024-09-12T02:26:42.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.451+0000 7f49a24d0640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f499c159a00 con 0x7f499c06c650 2024-09-12T02:26:42.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.451+0000 7f49a24d0640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f499c06c240 con 0x7f499c150480 2024-09-12T02:26:42.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.451+0000 7f499bfff640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f499c150480 msgr2=0x7f499c0c7a90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:26:42.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.451+0000 7f49a0a6d640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f499c0ca390 0x7f499c160bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34338/0 (socket says 172.21.15.60:34338) 2024-09-12T02:26:42.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.451+0000 7f49a0a6d640 1 -- 172.21.15.60:0/2611914209 learned_addr learned my addr 172.21.15.60:0/2611914209 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:26:42.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.451+0000 7f499bfff640 1 --2- 172.21.15.60:0/2611914209 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f499c150480 0x7f499c0c7a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:26:42.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.451+0000 7f499affd640 1 -- 172.21.15.60:0/2611914209 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3787423725 0 0) 0x7f499c15a7c0 con 0x7f499c0ca390 2024-09-12T02:26:42.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.451+0000 7f499affd640 1 -- 172.21.15.60:0/2611914209 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4984003520 con 0x7f499c0ca390 2024-09-12T02:26:42.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.452+0000 7f499affd640 1 -- 172.21.15.60:0/2611914209 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1509832022 0 0) 0x7f499c159a00 con 0x7f499c06c650 2024-09-12T02:26:42.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.452+0000 7f499affd640 1 -- 172.21.15.60:0/2611914209 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f499c15a7c0 con 0x7f499c06c650 2024-09-12T02:26:42.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.452+0000 7f499affd640 1 -- 172.21.15.60:0/2611914209 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2608208395 0 0) 0x7f4984003520 con 0x7f499c0ca390 2024-09-12T02:26:42.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.452+0000 7f499affd640 1 -- 172.21.15.60:0/2611914209 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f499c150480 msgr2=0x7f499c0c7a90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:26:42.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.452+0000 7f499affd640 1 --2- 172.21.15.60:0/2611914209 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f499c150480 0x7f499c0c7a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:42.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.452+0000 7f499affd640 1 -- 172.21.15.60:0/2611914209 >> v1:172.21.15.105:6789/0 conn(0x7f499c06c650 legacy=0x7f499c0c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:42.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.452+0000 7f499affd640 1 -- 172.21.15.60:0/2611914209 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f499c159ce0 con 0x7f499c0ca390 2024-09-12T02:26:42.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.452+0000 7f499affd640 1 -- 172.21.15.60:0/2611914209 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7f49940019f0 con 0x7f499c0ca390 2024-09-12T02:26:42.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.452+0000 7f499affd640 1 -- 172.21.15.60:0/2611914209 >> v1:172.21.15.60:6789/0 conn(0x7f499c0ca390 legacy=0x7f499c160bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:42.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.452+0000 7f499affd640 1 --2- 172.21.15.60:0/2611914209 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f499c150480 0x7f4984003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:42.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.452+0000 7f499affd640 1 --2- 172.21.15.60:0/2611914209 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49840040f0 0x7f4984004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:42.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.452+0000 7f499affd640 1 --2- 172.21.15.60:0/2611914209 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4984004e60 0x7f498400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:42.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.452+0000 7f499affd640 1 -- 172.21.15.60:0/2611914209 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4984005510 con 0x7f4984004e60 2024-09-12T02:26:42.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.452+0000 7f499affd640 1 -- 172.21.15.60:0/2611914209 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f498400bf00 con 0x7f49840040f0 2024-09-12T02:26:42.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.452+0000 7f499affd640 1 -- 172.21.15.60:0/2611914209 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f498400c080 con 0x7f499c150480 2024-09-12T02:26:42.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.452+0000 7f499bfff640 1 -- 172.21.15.60:0/2611914209 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f499c150480 msgr2=0x7f4984003b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:26:42.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.452+0000 7f499bfff640 1 --2- 172.21.15.60:0/2611914209 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f499c150480 0x7f4984003b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:26:42.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.452+0000 7f49a0a6d640 1 --2- 172.21.15.60:0/2611914209 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4984004e60 0x7f498400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:42.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.452+0000 7f499b7fe640 1 --2- 172.21.15.60:0/2611914209 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49840040f0 0x7f4984004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:42.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.452+0000 7f49a0a6d640 1 -- 172.21.15.60:0/2611914209 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f499c150480 msgr2=0x7f4984003b70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:26:42.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.452+0000 7f49a0a6d640 1 --2- 172.21.15.60:0/2611914209 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f499c150480 0x7f4984003b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:42.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.452+0000 7f49a0a6d640 1 -- 172.21.15.60:0/2611914209 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49840040f0 msgr2=0x7f4984004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:26:42.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.452+0000 7f49a0a6d640 1 --2- 172.21.15.60:0/2611914209 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49840040f0 0x7f4984004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:42.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.452+0000 7f49a0a6d640 1 -- 172.21.15.60:0/2611914209 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4984003520 con 0x7f4984004e60 2024-09-12T02:26:42.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.453+0000 7f49a0a6d640 1 --2- 172.21.15.60:0/2611914209 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4984004e60 0x7f498400b9c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f499400a760 tx=0x7f4984005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4b5335fb5ae646d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:42.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.453+0000 7f499affd640 1 -- 172.21.15.60:0/2611914209 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499400a3b0 con 0x7f4984004e60 2024-09-12T02:26:42.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.453+0000 7f499affd640 1 -- 172.21.15.60:0/2611914209 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f499402f070 con 0x7f4984004e60 2024-09-12T02:26:42.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.453+0000 7f499affd640 1 -- 172.21.15.60:0/2611914209 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499402bbc0 con 0x7f4984004e60 2024-09-12T02:26:42.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.454+0000 7f49a24d0640 1 -- 172.21.15.60:0/2611914209 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4984004e60 msgr2=0x7f498400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:42.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.454+0000 7f49a24d0640 1 --2- 172.21.15.60:0/2611914209 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4984004e60 0x7f498400b9c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f499400a760 tx=0x7f4984005830 comp rx=0 tx=0).stop 2024-09-12T02:26:42.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.454+0000 7f49a0a6d640 1 -- 172.21.15.60:0/2611914209 reap_dead start 2024-09-12T02:26:42.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.454+0000 7f49a24d0640 1 -- 172.21.15.60:0/2611914209 shutdown_connections 2024-09-12T02:26:42.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.454+0000 7f49a24d0640 1 -- 172.21.15.60:0/2611914209 >> 172.21.15.60:0/2611914209 conn(0x7f499c068030 msgr2=0x7f499c073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:26:42.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.454+0000 7f49a24d0640 1 -- 172.21.15.60:0/2611914209 shutdown_connections 2024-09-12T02:26:42.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.454+0000 7f49a24d0640 1 -- 172.21.15.60:0/2611914209 wait complete. 2024-09-12T02:26:42.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.455+0000 7f49a24d0640 1 Processor -- start 2024-09-12T02:26:42.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.456+0000 7f49a24d0640 1 -- start start 2024-09-12T02:26:42.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.456+0000 7f49a24d0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4984004e60 0x7f499c1ef0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:42.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.456+0000 7f49a24d0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f499c158b90 0x7f499c0b0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:42.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.456+0000 7f49a24d0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f499c1490f0 0x7f499c1495a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:42.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.456+0000 7f49a24d0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f499c06d270 con 0x7f499c158b90 2024-09-12T02:26:42.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.456+0000 7f49a24d0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f499c15a330 con 0x7f4984004e60 2024-09-12T02:26:42.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.456+0000 7f49a24d0640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f499c156270 con 0x7f499c1490f0 2024-09-12T02:26:42.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.456+0000 7f499b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f499c158b90 0x7f499c0b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:42.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.456+0000 7f499b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f499c158b90 0x7f499c0b0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47850/0 (socket says 172.21.15.60:47850) 2024-09-12T02:26:42.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.456+0000 7f499b7fe640 1 -- 172.21.15.60:0/1988612201 learned_addr learned my addr 172.21.15.60:0/1988612201 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:26:42.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.456+0000 7f49a0a6d640 1 -- 172.21.15.60:0/1988612201 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f499c1490f0 msgr2=0x7f499c1495a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:26:42.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.457+0000 7f49a0a6d640 1 --2- 172.21.15.60:0/1988612201 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f499c1490f0 0x7f499c1495a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:26:42.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.457+0000 7f499bfff640 1 --2- 172.21.15.60:0/1988612201 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4984004e60 0x7f499c1ef0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:42.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.457+0000 7f499b7fe640 1 -- 172.21.15.60:0/1988612201 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f499c1490f0 msgr2=0x7f499c1495a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:26:42.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.457+0000 7f499b7fe640 1 --2- 172.21.15.60:0/1988612201 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f499c1490f0 0x7f499c1495a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:42.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.457+0000 7f499b7fe640 1 -- 172.21.15.60:0/1988612201 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4984004e60 msgr2=0x7f499c1ef0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:42.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.457+0000 7f499b7fe640 1 --2- 172.21.15.60:0/1988612201 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4984004e60 0x7f499c1ef0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:42.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.457+0000 7f499b7fe640 1 -- 172.21.15.60:0/1988612201 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f499c1ef5e0 con 0x7f499c158b90 2024-09-12T02:26:42.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.457+0000 7f499b7fe640 1 --2- 172.21.15.60:0/1988612201 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f499c158b90 0x7f499c0b0100 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f499000f820 tx=0x7f499000fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:42.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.457+0000 7f4998ff9640 1 -- 172.21.15.60:0/1988612201 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49900052e0 con 0x7f499c158b90 2024-09-12T02:26:42.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.457+0000 7f4998ff9640 1 -- 172.21.15.60:0/1988612201 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4990018070 con 0x7f499c158b90 2024-09-12T02:26:42.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.457+0000 7f49a24d0640 1 -- 172.21.15.60:0/1988612201 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f499c1554d0 con 0x7f499c158b90 2024-09-12T02:26:42.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.457+0000 7f4998ff9640 1 -- 172.21.15.60:0/1988612201 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499000d8f0 con 0x7f499c158b90 2024-09-12T02:26:42.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.457+0000 7f49a24d0640 1 -- 172.21.15.60:0/1988612201 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f499c149ae0 con 0x7f499c158b90 2024-09-12T02:26:42.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.458+0000 7f49a24d0640 1 --2- 172.21.15.60:0/1988612201 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f499c14b410 0x7f499c14b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:42.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.458+0000 7f49a24d0640 1 -- 172.21.15.60:0/1988612201 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f499c1e3760 con 0x7f499c14b410 2024-09-12T02:26:42.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.458+0000 7f499bfff640 1 --2- 172.21.15.60:0/1988612201 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f499c14b410 0x7f499c14b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:42.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.459+0000 7f4998ff9640 1 -- 172.21.15.60:0/1988612201 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f499000da90 con 0x7f499c158b90 2024-09-12T02:26:42.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.459+0000 7f499bfff640 1 -- 172.21.15.60:0/1988612201 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f499c0ad490 con 0x7f499c14b410 2024-09-12T02:26:42.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.459+0000 7f499bfff640 1 --2- 172.21.15.60:0/1988612201 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f499c14b410 0x7f499c14b7f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f498c00c4c0 tx=0x7f498c00c980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:42.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.459+0000 7f4998ff9640 1 --2- 172.21.15.60:0/1988612201 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f498806be10 0x7f498806e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:42.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.459+0000 7f4998ff9640 1 -- 172.21.15.60:0/1988612201 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f499008b040 con 0x7f499c158b90 2024-09-12T02:26:42.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.459+0000 7f49a0a6d640 1 --2- 172.21.15.60:0/1988612201 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f498806be10 0x7f498806e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:42.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.460+0000 7f4998ff9640 1 -- 172.21.15.60:0/1988612201 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f498c003dc0 con 0x7f499c14b410 2024-09-12T02:26:42.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.460+0000 7f4998ff9640 1 -- 172.21.15.60:0/1988612201 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f498c016070 con 0x7f499c14b410 2024-09-12T02:26:42.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.460+0000 7f4998ff9640 1 -- 172.21.15.60:0/1988612201 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f499c14b410 msgr2=0x7f499c14b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:42.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.460+0000 7f4998ff9640 1 --2- 172.21.15.60:0/1988612201 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f499c14b410 0x7f499c14b7f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f498c00c4c0 tx=0x7f498c00c980 comp rx=0 tx=0).stop 2024-09-12T02:26:42.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.460+0000 7f4998ff9640 1 -- 172.21.15.60:0/1988612201 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f499c14b410 msgr2=0x7f499c14b7f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:26:42.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.460+0000 7f4998ff9640 1 --2- 172.21.15.60:0/1988612201 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f499c14b410 0x7f499c14b7f0 secure :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f498c00c4c0 tx=0x7f498c00c980 comp rx=0 tx=0).stop 2024-09-12T02:26:42.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.460+0000 7f49a0a6d640 1 --2- 172.21.15.60:0/1988612201 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f498806be10 0x7f498806e2d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4994033000 tx=0x7f4994038040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:42.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.467+0000 7f49a24d0640 1 --2- 172.21.15.60:0/1988612201 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f499c14bd30 0x7f499c0ab880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:42.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.467+0000 7f49a24d0640 1 -- 172.21.15.60:0/1988612201 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f499c159a00 con 0x7f499c14bd30 2024-09-12T02:26:42.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.467+0000 7f499bfff640 1 --2- 172.21.15.60:0/1988612201 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f499c14bd30 0x7f499c0ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:42.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.467+0000 7f499bfff640 1 -- 172.21.15.60:0/1988612201 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f499c06c430 con 0x7f499c14bd30 2024-09-12T02:26:42.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.468+0000 7f499bfff640 1 --2- 172.21.15.60:0/1988612201 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f499c14bd30 0x7f499c0ab880 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f498c00c4c0 tx=0x7f498c0059d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:42.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.468+0000 7f4998ff9640 1 -- 172.21.15.60:0/1988612201 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f498c0055c0 con 0x7f499c14bd30 2024-09-12T02:26:42.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.468+0000 7f4998ff9640 1 -- 172.21.15.60:0/1988612201 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5039 (secure 0 0 0) 0x7f498c0055c0 con 0x7f499c14bd30 2024-09-12T02:26:42.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.468+0000 7f4998ff9640 1 -- 172.21.15.60:0/1988612201 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f499c14bd30 msgr2=0x7f499c0ab880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:42.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.468+0000 7f4998ff9640 1 --2- 172.21.15.60:0/1988612201 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f499c14bd30 0x7f499c0ab880 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f498c00c4c0 tx=0x7f498c0059d0 comp rx=0 tx=0).stop 2024-09-12T02:26:42.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.468+0000 7f4998ff9640 1 -- 172.21.15.60:0/1988612201 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f499c14bd30 msgr2=0x7f499c0ab880 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:26:42.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.468+0000 7f4998ff9640 1 --2- 172.21.15.60:0/1988612201 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f499c14bd30 0x7f499c0ab880 secure :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f498c00c4c0 tx=0x7f498c0059d0 comp rx=0 tx=0).stop 2024-09-12T02:26:42.470 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:26:42.470 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:26:42.470 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:26:42.470 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:26:42.470 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 34, 2024-09-12T02:26:42.470 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 147903, 2024-09-12T02:26:42.470 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:26:42.470 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:26:42.471 INFO:teuthology.orchestra.run.smithi060.stdout: 1 2024-09-12T02:26:42.471 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:42.471 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 1, 2024-09-12T02:26:42.471 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:26:42.471 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:26:42.471 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:26:42.471 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:26:42.471 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:26:42.471 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:26:42.471 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:26:42.471 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:26:42.471 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:26:42.471 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:26:42.472 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:26:42.472 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:26:42.472 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:26:42.472 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:26:42.472 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:42.472 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:26:42.472 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:26:42.472 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:26:42.472 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:26:42.472 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:26:42.472 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:26:42.472 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:26:42.473 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:26:42.473 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:26:42.473 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:26:42.473 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:26:42.473 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:26:42.473 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:26:42.473 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:42.473 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:42.473 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:26:42.473 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:26:42.473 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:26:42.473 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:26:42.473 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:26:42.474 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:26:42.474 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:26:42.474 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:26:42.474 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:26:42.474 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:26:42.474 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:26:42.474 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:26:42.474 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:26:42.474 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:26:42.474 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:26:42.474 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:26:42.474 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:26:42.475 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:26:42.475 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:26:42.475 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:26:42.475 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:26:42.475 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:26:42.475 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:26:42.475 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:26:42.475 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:26:42.475 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:26:42.475 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:26:42.475 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:26:42.475 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:42.475 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:26:42.475 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:42.476 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:26:42.476 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:42.476 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:26:42.476 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:26:42.476 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:26:42.476 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:26:42.476 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:42.476 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:26:42.476 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:26:42.476 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:42.476 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:42.477 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:42.477 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:26:42.477 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:26:42.477 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:42.477 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:42.477 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:42.477 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:42.477 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:26:42.477 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:26:42.477 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:26:42.477 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:26:42.477 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:26:42.478 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:42.478 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:42.478 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:26:42.478 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:26:42.478 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:26:42.478 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:26:42.478 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:42.478 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:26:42.478 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:26:42.478 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:42.478 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:42.479 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:42.479 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:26:42.479 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:26:42.479 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:42.479 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:42.479 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:42.479 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:42.479 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:26:42.479 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:26:42.479 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:26:42.479 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:26:42.479 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:26:42.479 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:42.479 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:42.480 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:26:42.480 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:26:42.480 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:26:42.480 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:26:42.480 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:42.480 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:26:42.480 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:26:42.480 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:42.480 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:42.480 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:42.480 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:26:42.480 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:26:42.480 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:26:42.481 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:42.481 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:42.481 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:42.481 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:26:42.481 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:26:42.481 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:26:42.481 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:26:42.481 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:26:42.481 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:42.481 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:42.481 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:42.481 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:26:42.481 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:26:42.481 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:42.482 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:26:42.482 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:26:42.482 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:26:42.482 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:42.482 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:42.482 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:26:42.482 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:42.482 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:26:42.482 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:26:42.482 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:26:42.482 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:42.482 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:42.482 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:26:42.482 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:42.482 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:26:42.483 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:26:42.483 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-09-12T02:26:42.483 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:42.483 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:42.483 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:26:42.483 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:42.483 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:26:42.483 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:26:42.483 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-09-12T02:26:42.483 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:42.483 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:26:42.483 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:26:42.483 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:26:42.483 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:26:42.483 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:26:42.484 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:26:42.484 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:26:42.484 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:26:42.484 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:26:42.484 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:26:42.484 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:26:42.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.468+0000 7f49a24d0640 1 -- 172.21.15.60:0/1988612201 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f498806be10 msgr2=0x7f498806e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:42.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.468+0000 7f49a24d0640 1 --2- 172.21.15.60:0/1988612201 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f498806be10 0x7f498806e2d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4994033000 tx=0x7f4994038040 comp rx=0 tx=0).stop 2024-09-12T02:26:42.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.468+0000 7f49a24d0640 1 -- 172.21.15.60:0/1988612201 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f499c158b90 msgr2=0x7f499c0b0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:42.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.468+0000 7f49a24d0640 1 --2- 172.21.15.60:0/1988612201 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f499c158b90 0x7f499c0b0100 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f499000f820 tx=0x7f499000fce0 comp rx=0 tx=0).stop 2024-09-12T02:26:42.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.468+0000 7f49a0a6d640 1 -- 172.21.15.60:0/1988612201 reap_dead start 2024-09-12T02:26:42.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.468+0000 7f49a24d0640 1 -- 172.21.15.60:0/1988612201 shutdown_connections 2024-09-12T02:26:42.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.468+0000 7f49a24d0640 1 --2- 172.21.15.60:0/1988612201 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f499c158b90 0x7f499c0b0100 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:42.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.468+0000 7f49a24d0640 1 -- 172.21.15.60:0/1988612201 >> 172.21.15.60:0/1988612201 conn(0x7f499c068030 msgr2=0x7f499c0cbdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:26:42.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.469+0000 7f49a24d0640 1 -- 172.21.15.60:0/1988612201 shutdown_connections 2024-09-12T02:26:42.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:26:42.469+0000 7f49a24d0640 1 -- 172.21.15.60:0/1988612201 wait complete. 2024-09-12T02:26:42.486 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-12T02:26:42.486 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-12T02:26:56.965 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:26:56.968 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:27:02.487 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-09-12T02:27:02.487 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-09-12T02:27:02.487 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T02:27:02.487 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T02:27:02.490 INFO:tasks.ceph.mon.c:Started 2024-09-12T02:27:02.490 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-12T02:27:02.490 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:27:02.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.594+0000 7f05aacc3640 1 Processor -- start 2024-09-12T02:27:02.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.594+0000 7f05aacc3640 1 -- start start 2024-09-12T02:27:02.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.595+0000 7f05aacc3640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05a40c4680 0x7f05a4156a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:02.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.595+0000 7f05aacc3640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f05a4156fc0 0x7f05a4157410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:02.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.595+0000 7f05aacc3640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05a4070590 con 0x7f05a40acc30 2024-09-12T02:27:02.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.595+0000 7f05aacc3640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f05a40c4ea0 con 0x7f05a4156fc0 2024-09-12T02:27:02.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.595+0000 7f05aacc3640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f05a40c4a60 con 0x7f05a40c4680 2024-09-12T02:27:02.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.595+0000 7f05a3fff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05a40c4680 0x7f05a4156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:02.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.595+0000 7f05a8a5f640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f05a40acc30 0x7f05a40c3f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:33192/0 (socket says 172.21.15.60:33192) 2024-09-12T02:27:02.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.595+0000 7f05a8a5f640 1 -- 172.21.15.60:0/3414359691 learned_addr learned my addr 172.21.15.60:0/3414359691 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:27:02.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.595+0000 7f05a9260640 1 --2- 172.21.15.60:0/3414359691 >> v2:172.21.15.105:3300/0 conn(0x7f05a4156fc0 0x7f05a4157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:02.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.595+0000 7f05a3fff640 1 -- 172.21.15.60:0/3414359691 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05a40c4680 msgr2=0x7f05a4156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:27:02.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.595+0000 7f05a3fff640 1 -- 172.21.15.60:0/3414359691 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05a40c4680 msgr2=0x7f05a4156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:27:02.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.595+0000 7f05a3fff640 1 --2- 172.21.15.60:0/3414359691 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05a40c4680 0x7f05a4156a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:27:02.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.595+0000 7f05a3fff640 1 --2- 172.21.15.60:0/3414359691 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05a40c4680 0x7f05a4156a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:27:02.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.595+0000 7f05a9260640 1 -- 172.21.15.60:0/3414359691 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05a40c4680 msgr2=0x7f05a4156a80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:27:02.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.595+0000 7f05a9260640 1 --2- 172.21.15.60:0/3414359691 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05a40c4680 0x7f05a4156a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:02.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.595+0000 7f05a9260640 1 -- 172.21.15.60:0/3414359691 >> v1:172.21.15.105:6789/0 conn(0x7f05a40acc30 legacy=0x7f05a40c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:02.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.595+0000 7f05a9260640 1 -- 172.21.15.60:0/3414359691 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05a40a8220 con 0x7f05a4156fc0 2024-09-12T02:27:02.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.596+0000 7f05a9260640 1 --2- 172.21.15.60:0/3414359691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05a4156fc0 0x7f05a4157410 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f059c00bfa0 tx=0x7f059c02c750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c35c891ed3077db server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:02.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.597+0000 7f05a37fe640 1 -- 172.21.15.60:0/3414359691 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059c038070 con 0x7f05a4156fc0 2024-09-12T02:27:02.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.597+0000 7f05a37fe640 1 -- 172.21.15.60:0/3414359691 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f059c009540 con 0x7f05a4156fc0 2024-09-12T02:27:02.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.597+0000 7f05a37fe640 1 -- 172.21.15.60:0/3414359691 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059c009910 con 0x7f05a4156fc0 2024-09-12T02:27:02.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.597+0000 7f05aacc3640 1 -- 172.21.15.60:0/3414359691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05a4156fc0 msgr2=0x7f05a4157410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:02.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.597+0000 7f05aacc3640 1 --2- 172.21.15.60:0/3414359691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05a4156fc0 0x7f05a4157410 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f059c00bfa0 tx=0x7f059c02c750 comp rx=0 tx=0).stop 2024-09-12T02:27:02.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.597+0000 7f05aacc3640 1 -- 172.21.15.60:0/3414359691 shutdown_connections 2024-09-12T02:27:02.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.597+0000 7f05aacc3640 1 --2- 172.21.15.60:0/3414359691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05a4156fc0 0x7f05a4157410 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:02.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.597+0000 7f05aacc3640 1 --2- 172.21.15.60:0/3414359691 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05a40c4680 0x7f05a4156a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:02.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.597+0000 7f05aacc3640 1 -- 172.21.15.60:0/3414359691 >> 172.21.15.60:0/3414359691 conn(0x7f05a40c5660 msgr2=0x7f05a40c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:02.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.597+0000 7f05aacc3640 1 -- 172.21.15.60:0/3414359691 shutdown_connections 2024-09-12T02:27:02.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.597+0000 7f05aacc3640 1 -- 172.21.15.60:0/3414359691 wait complete. 2024-09-12T02:27:02.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.599+0000 7f05aacc3640 1 Processor -- start 2024-09-12T02:27:02.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.599+0000 7f05aacc3640 1 -- start start 2024-09-12T02:27:02.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.599+0000 7f05aacc3640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05a40acc30 0x7f05a41eb800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:02.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.599+0000 7f05aacc3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05a40c4680 0x7f05a40a9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:02.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.599+0000 7f05aacc3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05a4156fc0 0x7f05a41e4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:02.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.600+0000 7f05aacc3640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f05a40702b0 con 0x7f05a4156fc0 2024-09-12T02:27:02.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.600+0000 7f05aacc3640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f05a406ffd0 con 0x7f05a40c4680 2024-09-12T02:27:02.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.600+0000 7f05aacc3640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f05a40c5330 con 0x7f05a40acc30 2024-09-12T02:27:02.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.600+0000 7f05a9260640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05a4156fc0 0x7f05a41e4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:02.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.600+0000 7f05a9260640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05a4156fc0 0x7f05a41e4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55526/0 (socket says 172.21.15.60:55526) 2024-09-12T02:27:02.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.600+0000 7f05a9260640 1 -- 172.21.15.60:0/2305773077 learned_addr learned my addr 172.21.15.60:0/2305773077 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:27:02.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.600+0000 7f05a8a5f640 1 --2- 172.21.15.60:0/2305773077 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05a40acc30 0x7f05a41eb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:02.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.600+0000 7f05a3fff640 1 --2- 172.21.15.60:0/2305773077 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05a40c4680 0x7f05a40a9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:02.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.600+0000 7f05a8a5f640 1 -- 172.21.15.60:0/2305773077 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05a40acc30 msgr2=0x7f05a41eb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-12T02:27:02.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.600+0000 7f05a8a5f640 1 -- 172.21.15.60:0/2305773077 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05a40acc30 msgr2=0x7f05a41eb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:27:02.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.600+0000 7f05a8a5f640 1 --2- 172.21.15.60:0/2305773077 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05a40acc30 0x7f05a41eb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:27:02.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.600+0000 7f05a8a5f640 1 --2- 172.21.15.60:0/2305773077 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05a40acc30 0x7f05a41eb800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:27:02.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.600+0000 7f05a9260640 1 -- 172.21.15.60:0/2305773077 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05a40acc30 msgr2=0x7f05a41eb800 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:27:02.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.600+0000 7f05a9260640 1 --2- 172.21.15.60:0/2305773077 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05a40acc30 0x7f05a41eb800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:02.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.600+0000 7f05a9260640 1 -- 172.21.15.60:0/2305773077 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05a40c4680 msgr2=0x7f05a40a9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:02.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.600+0000 7f05a9260640 1 --2- 172.21.15.60:0/2305773077 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05a40c4680 0x7f05a40a9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:02.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.600+0000 7f05a9260640 1 -- 172.21.15.60:0/2305773077 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05a41ebd40 con 0x7f05a4156fc0 2024-09-12T02:27:02.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.600+0000 7f05a9260640 1 --2- 172.21.15.60:0/2305773077 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05a4156fc0 0x7f05a41e4b30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f059c00bfa0 tx=0x7f059c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:02.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.600+0000 7f05a17fa640 1 -- 172.21.15.60:0/2305773077 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059c043020 con 0x7f05a4156fc0 2024-09-12T02:27:02.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.600+0000 7f05a17fa640 1 -- 172.21.15.60:0/2305773077 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f059c03e690 con 0x7f05a4156fc0 2024-09-12T02:27:02.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.601+0000 7f05aacc3640 1 -- 172.21.15.60:0/2305773077 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05a406cd90 con 0x7f05a4156fc0 2024-09-12T02:27:02.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.601+0000 7f05a17fa640 1 -- 172.21.15.60:0/2305773077 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059c038040 con 0x7f05a4156fc0 2024-09-12T02:27:02.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.601+0000 7f05aacc3640 1 -- 172.21.15.60:0/2305773077 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05a41e8e20 con 0x7f05a4156fc0 2024-09-12T02:27:02.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.602+0000 7f05aacc3640 1 -- 172.21.15.60:0/2305773077 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05a40c63f0 con 0x7f05a4156fc0 2024-09-12T02:27:02.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.602+0000 7f05a17fa640 1 -- 172.21.15.60:0/2305773077 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f059c046020 con 0x7f05a4156fc0 2024-09-12T02:27:02.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.603+0000 7f05a17fa640 1 --2- 172.21.15.60:0/2305773077 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f058806be30 0x7f058806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:02.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.603+0000 7f05a17fa640 1 -- 172.21.15.60:0/2305773077 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f059c0ade80 con 0x7f05a4156fc0 2024-09-12T02:27:02.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.603+0000 7f05a8a5f640 1 --2- 172.21.15.60:0/2305773077 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f058806be30 0x7f058806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:02.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.603+0000 7f05a8a5f640 1 --2- 172.21.15.60:0/2305773077 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f058806be30 0x7f058806e2f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0598000f60 tx=0x7f0598009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:02.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.607+0000 7f05a17fa640 1 -- 172.21.15.60:0/2305773077 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f059c04d030 con 0x7f05a4156fc0 2024-09-12T02:27:02.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.909+0000 7f05aacc3640 1 -- 172.21.15.60:0/2305773077 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f05a40be8f0 con 0x7f05a4156fc0 2024-09-12T02:27:02.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.909+0000 7f05a17fa640 1 -- 172.21.15.60:0/2305773077 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1559 (secure 0 0 0) 0x7f059c07c520 con 0x7f05a4156fc0 2024-09-12T02:27:02.910 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":34,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:27:02.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.911+0000 7f05aacc3640 1 -- 172.21.15.60:0/2305773077 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f058806be30 msgr2=0x7f058806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:02.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.911+0000 7f05aacc3640 1 --2- 172.21.15.60:0/2305773077 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f058806be30 0x7f058806e2f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0598000f60 tx=0x7f0598009040 comp rx=0 tx=0).stop 2024-09-12T02:27:02.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.911+0000 7f05aacc3640 1 -- 172.21.15.60:0/2305773077 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05a4156fc0 msgr2=0x7f05a41e4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:02.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.911+0000 7f05aacc3640 1 --2- 172.21.15.60:0/2305773077 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05a4156fc0 0x7f05a41e4b30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f059c00bfa0 tx=0x7f059c004a40 comp rx=0 tx=0).stop 2024-09-12T02:27:02.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.912+0000 7f05aacc3640 1 -- 172.21.15.60:0/2305773077 shutdown_connections 2024-09-12T02:27:02.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.912+0000 7f05aacc3640 1 --2- 172.21.15.60:0/2305773077 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f058806be30 0x7f058806e2f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:02.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.912+0000 7f05aacc3640 1 --2- 172.21.15.60:0/2305773077 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05a4156fc0 0x7f05a41e4b30 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:02.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.912+0000 7f05aacc3640 1 --2- 172.21.15.60:0/2305773077 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05a40c4680 0x7f05a40a9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:02.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.912+0000 7f05aacc3640 1 --2- 172.21.15.60:0/2305773077 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05a40acc30 0x7f05a41eb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:02.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.912+0000 7f05aacc3640 1 -- 172.21.15.60:0/2305773077 >> 172.21.15.60:0/2305773077 conn(0x7f05a40c5660 msgr2=0x7f05a40c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:02.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.912+0000 7f05aacc3640 1 -- 172.21.15.60:0/2305773077 shutdown_connections 2024-09-12T02:27:02.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:02.912+0000 7f05aacc3640 1 -- 172.21.15.60:0/2305773077 wait complete. 2024-09-12T02:27:05.925 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:27:06.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.039+0000 7fcbc276d640 1 Processor -- start 2024-09-12T02:27:06.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.039+0000 7fcbc276d640 1 -- start start 2024-09-12T02:27:06.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.039+0000 7fcbc276d640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fcbbc0ca220 0x7fcbbc0c3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:06.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.039+0000 7fcbc276d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbbc072b30 0x7fcbbc151610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:06.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.039+0000 7fcbc276d640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbbc070800 con 0x7fcbbc0a9230 2024-09-12T02:27:06.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.039+0000 7fcbc276d640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fcbbc0c99b0 con 0x7fcbbc0ca220 2024-09-12T02:27:06.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.039+0000 7fcbc276d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcbbc0c93f0 con 0x7fcbbc072b30 2024-09-12T02:27:06.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.040+0000 7fcbbb7fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fcbbc0a9230 0x7fcbbc154b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:37048/0 (socket says 172.21.15.60:37048) 2024-09-12T02:27:06.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.040+0000 7fcbbb7fe640 1 -- 172.21.15.60:0/3358517711 learned_addr learned my addr 172.21.15.60:0/3358517711 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:27:06.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.040+0000 7fcbc0d0a640 1 --2- 172.21.15.60:0/3358517711 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbbc072b30 0x7fcbbc151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:06.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.040+0000 7fcbbbfff640 1 --2- 172.21.15.60:0/3358517711 >> v2:172.21.15.105:3300/0 conn(0x7fcbbc0ca220 0x7fcbbc0c3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:06.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.040+0000 7fcbc0d0a640 1 -- 172.21.15.60:0/3358517711 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbbc072b30 msgr2=0x7fcbbc151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:27:06.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.040+0000 7fcbc0d0a640 1 -- 172.21.15.60:0/3358517711 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbbc072b30 msgr2=0x7fcbbc151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:27:06.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.040+0000 7fcbc0d0a640 1 --2- 172.21.15.60:0/3358517711 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbbc072b30 0x7fcbbc151610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:27:06.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.040+0000 7fcbc0d0a640 1 --2- 172.21.15.60:0/3358517711 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbbc072b30 0x7fcbbc151610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:27:06.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.040+0000 7fcbbbfff640 1 -- 172.21.15.60:0/3358517711 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbbc072b30 msgr2=0x7fcbbc151610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:27:06.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.040+0000 7fcbbbfff640 1 --2- 172.21.15.60:0/3358517711 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbbc072b30 0x7fcbbc151610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:06.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.040+0000 7fcbbaffd640 1 -- 172.21.15.60:0/3358517711 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3943207007 0 0) 0x7fcbbc070800 con 0x7fcbbc0a9230 2024-09-12T02:27:06.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.040+0000 7fcbbbfff640 1 -- 172.21.15.60:0/3358517711 >> v1:172.21.15.60:6789/0 conn(0x7fcbbc0a9230 legacy=0x7fcbbc154b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:06.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.040+0000 7fcbbbfff640 1 -- 172.21.15.60:0/3358517711 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbbc0c96d0 con 0x7fcbbc0ca220 2024-09-12T02:27:06.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.041+0000 7fcbbbfff640 1 --2- 172.21.15.60:0/3358517711 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbbc0ca220 0x7fcbbc0c3f10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0097a0 tx=0x7fcbac02a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcb834170fea8830 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:06.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.041+0000 7fcbbaffd640 1 -- 172.21.15.60:0/3358517711 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbac037070 con 0x7fcbbc0ca220 2024-09-12T02:27:06.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.041+0000 7fcbbaffd640 1 -- 172.21.15.60:0/3358517711 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbac02ae50 con 0x7fcbbc0ca220 2024-09-12T02:27:06.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.041+0000 7fcbbaffd640 1 -- 172.21.15.60:0/3358517711 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbac032660 con 0x7fcbbc0ca220 2024-09-12T02:27:06.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.042+0000 7fcbc276d640 1 -- 172.21.15.60:0/3358517711 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbbc0ca220 msgr2=0x7fcbbc0c3f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:06.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.042+0000 7fcbc276d640 1 --2- 172.21.15.60:0/3358517711 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbbc0ca220 0x7fcbbc0c3f10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0097a0 tx=0x7fcbac02a100 comp rx=0 tx=0).stop 2024-09-12T02:27:06.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.042+0000 7fcbc276d640 1 -- 172.21.15.60:0/3358517711 shutdown_connections 2024-09-12T02:27:06.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.042+0000 7fcbc276d640 1 --2- 172.21.15.60:0/3358517711 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbbc072b30 0x7fcbbc151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:06.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.042+0000 7fcbc276d640 1 --2- 172.21.15.60:0/3358517711 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbbc0ca220 0x7fcbbc0c3f10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:06.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.042+0000 7fcbc276d640 1 -- 172.21.15.60:0/3358517711 >> 172.21.15.60:0/3358517711 conn(0x7fcbbc067b30 msgr2=0x7fcbbc067f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:06.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.042+0000 7fcbc276d640 1 -- 172.21.15.60:0/3358517711 shutdown_connections 2024-09-12T02:27:06.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.042+0000 7fcbc276d640 1 -- 172.21.15.60:0/3358517711 wait complete. 2024-09-12T02:27:06.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.043+0000 7fcbc276d640 1 Processor -- start 2024-09-12T02:27:06.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.044+0000 7fcbc276d640 1 -- start start 2024-09-12T02:27:06.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.044+0000 7fcbc276d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbbc072b30 0x7fcbbc0c5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:06.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.045+0000 7fcbc276d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcbbc0a9230 0x7fcbbc0c32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:06.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.045+0000 7fcbc276d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbbc0ca220 0x7fcbbc1ec190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:06.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.045+0000 7fcbc276d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcbbc072fc0 con 0x7fcbbc0a9230 2024-09-12T02:27:06.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.045+0000 7fcbc276d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcbbc154660 con 0x7fcbbc0ca220 2024-09-12T02:27:06.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.045+0000 7fcbc276d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcbbc0ca600 con 0x7fcbbc072b30 2024-09-12T02:27:06.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.045+0000 7fcbbb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcbbc0a9230 0x7fcbbc0c32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:06.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.045+0000 7fcbbbfff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbbc072b30 0x7fcbbc0c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:06.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.045+0000 7fcbbb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcbbc0a9230 0x7fcbbc0c32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55536/0 (socket says 172.21.15.60:55536) 2024-09-12T02:27:06.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.045+0000 7fcbbb7fe640 1 -- 172.21.15.60:0/156847723 learned_addr learned my addr 172.21.15.60:0/156847723 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:27:06.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.045+0000 7fcbc0d0a640 1 --2- 172.21.15.60:0/156847723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbbc0ca220 0x7fcbbc1ec190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:06.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.045+0000 7fcbbbfff640 1 -- 172.21.15.60:0/156847723 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbbc072b30 msgr2=0x7fcbbc0c5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-12T02:27:06.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.045+0000 7fcbbbfff640 1 -- 172.21.15.60:0/156847723 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbbc072b30 msgr2=0x7fcbbc0c5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:27:06.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.045+0000 7fcbbbfff640 1 --2- 172.21.15.60:0/156847723 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbbc072b30 0x7fcbbc0c5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:27:06.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.045+0000 7fcbbbfff640 1 --2- 172.21.15.60:0/156847723 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbbc072b30 0x7fcbbc0c5550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:27:06.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.045+0000 7fcbbb7fe640 1 -- 172.21.15.60:0/156847723 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbbc072b30 msgr2=0x7fcbbc0c5550 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:27:06.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.045+0000 7fcbbb7fe640 1 --2- 172.21.15.60:0/156847723 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbbc072b30 0x7fcbbc0c5550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:06.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.045+0000 7fcbbb7fe640 1 -- 172.21.15.60:0/156847723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbbc0ca220 msgr2=0x7fcbbc1ec190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:06.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.045+0000 7fcbbb7fe640 1 --2- 172.21.15.60:0/156847723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbbc0ca220 0x7fcbbc1ec190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:06.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.045+0000 7fcbbb7fe640 1 -- 172.21.15.60:0/156847723 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbbc06ed30 con 0x7fcbbc0a9230 2024-09-12T02:27:06.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.045+0000 7fcbbb7fe640 1 --2- 172.21.15.60:0/156847723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcbbc0a9230 0x7fcbbc0c32a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcbb000c500 tx=0x7fcbb000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:06.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.045+0000 7fcbb8ff9640 1 -- 172.21.15.60:0/156847723 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb0018070 con 0x7fcbbc0a9230 2024-09-12T02:27:06.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.045+0000 7fcbb8ff9640 1 -- 172.21.15.60:0/156847723 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbb0007580 con 0x7fcbbc0a9230 2024-09-12T02:27:06.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.046+0000 7fcbb8ff9640 1 -- 172.21.15.60:0/156847723 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb0004a20 con 0x7fcbbc0a9230 2024-09-12T02:27:06.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.046+0000 7fcbc276d640 1 -- 172.21.15.60:0/156847723 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbbc06e770 con 0x7fcbbc0a9230 2024-09-12T02:27:06.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.046+0000 7fcbc276d640 1 -- 172.21.15.60:0/156847723 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbbc1eb990 con 0x7fcbbc0a9230 2024-09-12T02:27:06.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.047+0000 7fcbc276d640 1 -- 172.21.15.60:0/156847723 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbbc0c3f10 con 0x7fcbbc0a9230 2024-09-12T02:27:06.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.047+0000 7fcbb8ff9640 1 -- 172.21.15.60:0/156847723 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcbb0004bc0 con 0x7fcbbc0a9230 2024-09-12T02:27:06.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.048+0000 7fcbb8ff9640 1 --2- 172.21.15.60:0/156847723 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcba806be30 0x7fcba806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:06.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.048+0000 7fcbb8ff9640 1 -- 172.21.15.60:0/156847723 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fcbb008a3f0 con 0x7fcbbc0a9230 2024-09-12T02:27:06.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.048+0000 7fcbbbfff640 1 --2- 172.21.15.60:0/156847723 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcba806be30 0x7fcba806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:06.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.048+0000 7fcbbbfff640 1 --2- 172.21.15.60:0/156847723 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcba806be30 0x7fcba806e2f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcbac034000 tx=0x7fcbac02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:06.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.052+0000 7fcbb8ff9640 1 -- 172.21.15.60:0/156847723 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcbb0058420 con 0x7fcbbc0a9230 2024-09-12T02:27:06.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.367+0000 7fcbc276d640 1 -- 172.21.15.60:0/156847723 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fcbbc14ce70 con 0x7fcbbc0a9230 2024-09-12T02:27:06.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.367+0000 7fcbb8ff9640 1 -- 172.21.15.60:0/156847723 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1559 (secure 0 0 0) 0x7fcbb005c720 con 0x7fcbbc0a9230 2024-09-12T02:27:06.368 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":34,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:27:06.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.370+0000 7fcbc276d640 1 -- 172.21.15.60:0/156847723 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcba806be30 msgr2=0x7fcba806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:06.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.370+0000 7fcbc276d640 1 --2- 172.21.15.60:0/156847723 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcba806be30 0x7fcba806e2f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcbac034000 tx=0x7fcbac02e000 comp rx=0 tx=0).stop 2024-09-12T02:27:06.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.370+0000 7fcbc276d640 1 -- 172.21.15.60:0/156847723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcbbc0a9230 msgr2=0x7fcbbc0c32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:06.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.370+0000 7fcbc276d640 1 --2- 172.21.15.60:0/156847723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcbbc0a9230 0x7fcbbc0c32a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcbb000c500 tx=0x7fcbb000c9c0 comp rx=0 tx=0).stop 2024-09-12T02:27:06.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.370+0000 7fcbc276d640 1 -- 172.21.15.60:0/156847723 shutdown_connections 2024-09-12T02:27:06.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.370+0000 7fcbc276d640 1 --2- 172.21.15.60:0/156847723 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcba806be30 0x7fcba806e2f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:06.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.370+0000 7fcbc276d640 1 --2- 172.21.15.60:0/156847723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbbc0ca220 0x7fcbbc1ec190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:06.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.370+0000 7fcbc276d640 1 --2- 172.21.15.60:0/156847723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcbbc0a9230 0x7fcbbc0c32a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:06.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.370+0000 7fcbc276d640 1 --2- 172.21.15.60:0/156847723 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbbc072b30 0x7fcbbc0c5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:06.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.370+0000 7fcbc276d640 1 -- 172.21.15.60:0/156847723 >> 172.21.15.60:0/156847723 conn(0x7fcbbc067b30 msgr2=0x7fcbbc0aa4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:06.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.370+0000 7fcbc276d640 1 -- 172.21.15.60:0/156847723 shutdown_connections 2024-09-12T02:27:06.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:06.370+0000 7fcbc276d640 1 -- 172.21.15.60:0/156847723 wait complete. 2024-09-12T02:27:09.382 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:27:09.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.488+0000 7fe96b2a5640 1 Processor -- start 2024-09-12T02:27:09.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.489+0000 7fe96b2a5640 1 -- start start 2024-09-12T02:27:09.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.490+0000 7fe96b2a5640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9640c8b10 0x7fe96415a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:09.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.490+0000 7fe96b2a5640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe964153be0 0x7fe964156660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:09.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.490+0000 7fe96b2a5640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9640c7070 con 0x7fe96406cd80 2024-09-12T02:27:09.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.490+0000 7fe96b2a5640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fe96406d210 con 0x7fe964153be0 2024-09-12T02:27:09.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.490+0000 7fe96b2a5640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe9640c69b0 con 0x7fe9640c8b10 2024-09-12T02:27:09.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.490+0000 7fe969842640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe964153be0 0x7fe964156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:09.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.490+0000 7fe969842640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe964153be0 0x7fe964156660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34852/0 (socket says 172.21.15.60:34852) 2024-09-12T02:27:09.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.490+0000 7fe969842640 1 -- 172.21.15.60:0/3333462418 learned_addr learned my addr 172.21.15.60:0/3333462418 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:27:09.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.490+0000 7fe969041640 1 --2- 172.21.15.60:0/3333462418 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9640c8b10 0x7fe96415a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:09.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.490+0000 7fe969041640 1 -- 172.21.15.60:0/3333462418 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9640c8b10 msgr2=0x7fe96415a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:27:09.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.490+0000 7fe969041640 1 -- 172.21.15.60:0/3333462418 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9640c8b10 msgr2=0x7fe96415a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:27:09.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.490+0000 7fe969041640 1 --2- 172.21.15.60:0/3333462418 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9640c8b10 0x7fe96415a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:27:09.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.490+0000 7fe969041640 1 --2- 172.21.15.60:0/3333462418 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9640c8b10 0x7fe96415a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:27:09.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.490+0000 7fe969842640 1 -- 172.21.15.60:0/3333462418 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9640c8b10 msgr2=0x7fe96415a4a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:27:09.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.490+0000 7fe969842640 1 --2- 172.21.15.60:0/3333462418 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9640c8b10 0x7fe96415a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:09.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.490+0000 7fe969842640 1 -- 172.21.15.60:0/3333462418 >> v1:172.21.15.105:6789/0 conn(0x7fe96406cd80 legacy=0x7fe9641534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:09.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.490+0000 7fe95bfff640 1 -- 172.21.15.60:0/3333462418 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3212265329 0 0) 0x7fe9640c7070 con 0x7fe96406cd80 2024-09-12T02:27:09.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.490+0000 7fe969842640 1 -- 172.21.15.60:0/3333462418 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9640c6c90 con 0x7fe964153be0 2024-09-12T02:27:09.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.491+0000 7fe969842640 1 --2- 172.21.15.60:0/3333462418 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe964153be0 0x7fe964156660 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe95c009e50 tx=0x7fe95c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c2a7b154144a7cb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:09.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.491+0000 7fe95bfff640 1 -- 172.21.15.60:0/3333462418 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe95c036070 con 0x7fe964153be0 2024-09-12T02:27:09.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.491+0000 7fe95bfff640 1 -- 172.21.15.60:0/3333462418 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe95c031600 con 0x7fe964153be0 2024-09-12T02:27:09.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.491+0000 7fe95bfff640 1 -- 172.21.15.60:0/3333462418 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe95c0319d0 con 0x7fe964153be0 2024-09-12T02:27:09.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.492+0000 7fe96b2a5640 1 -- 172.21.15.60:0/3333462418 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe964153be0 msgr2=0x7fe964156660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:09.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.492+0000 7fe96b2a5640 1 --2- 172.21.15.60:0/3333462418 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe964153be0 0x7fe964156660 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe95c009e50 tx=0x7fe95c02a680 comp rx=0 tx=0).stop 2024-09-12T02:27:09.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.492+0000 7fe96b2a5640 1 -- 172.21.15.60:0/3333462418 shutdown_connections 2024-09-12T02:27:09.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.492+0000 7fe96b2a5640 1 --2- 172.21.15.60:0/3333462418 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe964153be0 0x7fe964156660 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:09.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.492+0000 7fe96b2a5640 1 --2- 172.21.15.60:0/3333462418 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9640c8b10 0x7fe96415a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:09.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.492+0000 7fe96b2a5640 1 -- 172.21.15.60:0/3333462418 >> 172.21.15.60:0/3333462418 conn(0x7fe9640adb80 msgr2=0x7fe9640adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:09.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.492+0000 7fe96b2a5640 1 -- 172.21.15.60:0/3333462418 shutdown_connections 2024-09-12T02:27:09.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.492+0000 7fe96b2a5640 1 -- 172.21.15.60:0/3333462418 wait complete. 2024-09-12T02:27:09.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.493+0000 7fe96b2a5640 1 Processor -- start 2024-09-12T02:27:09.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.493+0000 7fe96b2a5640 1 -- start start 2024-09-12T02:27:09.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.494+0000 7fe96b2a5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9640c8b10 0x7fe964150350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:09.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.494+0000 7fe96b2a5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe964153be0 0x7fe96414dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:09.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.494+0000 7fe96b2a5640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe96414e190 0x7fe9641ef030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:09.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.494+0000 7fe96b2a5640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe9640c9070 con 0x7fe964153be0 2024-09-12T02:27:09.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.494+0000 7fe96b2a5640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe9640c8ef0 con 0x7fe9640c8b10 2024-09-12T02:27:09.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.494+0000 7fe96b2a5640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe964156ba0 con 0x7fe96414e190 2024-09-12T02:27:09.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.494+0000 7fe968840640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe964153be0 0x7fe96414dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:09.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.494+0000 7fe969041640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9640c8b10 0x7fe964150350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:09.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.494+0000 7fe968840640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe964153be0 0x7fe96414dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34862/0 (socket says 172.21.15.60:34862) 2024-09-12T02:27:09.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.494+0000 7fe968840640 1 -- 172.21.15.60:0/3424613785 learned_addr learned my addr 172.21.15.60:0/3424613785 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:27:09.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.494+0000 7fe969842640 1 --2- 172.21.15.60:0/3424613785 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe96414e190 0x7fe9641ef030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:09.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.494+0000 7fe969842640 1 -- 172.21.15.60:0/3424613785 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe96414e190 msgr2=0x7fe9641ef030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-12T02:27:09.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.494+0000 7fe969842640 1 -- 172.21.15.60:0/3424613785 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe96414e190 msgr2=0x7fe9641ef030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:27:09.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.494+0000 7fe969842640 1 --2- 172.21.15.60:0/3424613785 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe96414e190 0x7fe9641ef030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:27:09.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.494+0000 7fe969842640 1 --2- 172.21.15.60:0/3424613785 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe96414e190 0x7fe9641ef030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:27:09.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.495+0000 7fe968840640 1 -- 172.21.15.60:0/3424613785 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe96414e190 msgr2=0x7fe9641ef030 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:27:09.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.495+0000 7fe968840640 1 --2- 172.21.15.60:0/3424613785 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe96414e190 0x7fe9641ef030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:09.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.495+0000 7fe968840640 1 -- 172.21.15.60:0/3424613785 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9640c8b10 msgr2=0x7fe964150350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:09.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.495+0000 7fe968840640 1 --2- 172.21.15.60:0/3424613785 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9640c8b10 0x7fe964150350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:09.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.495+0000 7fe968840640 1 -- 172.21.15.60:0/3424613785 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe964159010 con 0x7fe964153be0 2024-09-12T02:27:09.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.495+0000 7fe969041640 1 --2- 172.21.15.60:0/3424613785 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9640c8b10 0x7fe964150350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:27:09.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.495+0000 7fe968840640 1 --2- 172.21.15.60:0/3424613785 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe964153be0 0x7fe96414dc50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe95400c450 tx=0x7fe95400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:09.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.495+0000 7fe959ffb640 1 -- 172.21.15.60:0/3424613785 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe954017070 con 0x7fe964153be0 2024-09-12T02:27:09.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.495+0000 7fe959ffb640 1 -- 172.21.15.60:0/3424613785 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe954005480 con 0x7fe964153be0 2024-09-12T02:27:09.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.495+0000 7fe96b2a5640 1 -- 172.21.15.60:0/3424613785 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9640b1620 con 0x7fe964153be0 2024-09-12T02:27:09.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.495+0000 7fe959ffb640 1 -- 172.21.15.60:0/3424613785 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe954003830 con 0x7fe964153be0 2024-09-12T02:27:09.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.495+0000 7fe96b2a5640 1 -- 172.21.15.60:0/3424613785 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe964159560 con 0x7fe964153be0 2024-09-12T02:27:09.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.496+0000 7fe96b2a5640 1 -- 172.21.15.60:0/3424613785 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe964156fe0 con 0x7fe964153be0 2024-09-12T02:27:09.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.497+0000 7fe959ffb640 1 -- 172.21.15.60:0/3424613785 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe95401a070 con 0x7fe964153be0 2024-09-12T02:27:09.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.497+0000 7fe959ffb640 1 --2- 172.21.15.60:0/3424613785 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe94806be30 0x7fe94806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:09.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.498+0000 7fe959ffb640 1 -- 172.21.15.60:0/3424613785 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fe95408a490 con 0x7fe964153be0 2024-09-12T02:27:09.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.498+0000 7fe969041640 1 --2- 172.21.15.60:0/3424613785 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe94806be30 0x7fe94806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:09.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.498+0000 7fe969041640 1 --2- 172.21.15.60:0/3424613785 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe94806be30 0x7fe94806e2f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe96414cef0 tx=0x7fe960008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:09.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.502+0000 7fe959ffb640 1 -- 172.21.15.60:0/3424613785 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe954058460 con 0x7fe964153be0 2024-09-12T02:27:09.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.788+0000 7fe96b2a5640 1 -- 172.21.15.60:0/3424613785 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe9640c9d90 con 0x7fe964153be0 2024-09-12T02:27:09.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.788+0000 7fe959ffb640 1 -- 172.21.15.60:0/3424613785 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7fe95405c760 con 0x7fe964153be0 2024-09-12T02:27:09.789 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":36,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:27:09.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.790+0000 7fe96b2a5640 1 -- 172.21.15.60:0/3424613785 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe94806be30 msgr2=0x7fe94806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:09.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.790+0000 7fe96b2a5640 1 --2- 172.21.15.60:0/3424613785 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe94806be30 0x7fe94806e2f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe96414cef0 tx=0x7fe960008040 comp rx=0 tx=0).stop 2024-09-12T02:27:09.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.790+0000 7fe96b2a5640 1 -- 172.21.15.60:0/3424613785 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe964153be0 msgr2=0x7fe96414dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:09.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.790+0000 7fe96b2a5640 1 --2- 172.21.15.60:0/3424613785 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe964153be0 0x7fe96414dc50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe95400c450 tx=0x7fe95400c910 comp rx=0 tx=0).stop 2024-09-12T02:27:09.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.790+0000 7fe96b2a5640 1 -- 172.21.15.60:0/3424613785 shutdown_connections 2024-09-12T02:27:09.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.790+0000 7fe96b2a5640 1 --2- 172.21.15.60:0/3424613785 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe94806be30 0x7fe94806e2f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:09.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.790+0000 7fe96b2a5640 1 --2- 172.21.15.60:0/3424613785 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe96414e190 0x7fe9641ef030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:09.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.791+0000 7fe96b2a5640 1 --2- 172.21.15.60:0/3424613785 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe964153be0 0x7fe96414dc50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:09.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.791+0000 7fe96b2a5640 1 --2- 172.21.15.60:0/3424613785 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9640c8b10 0x7fe964150350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:09.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.791+0000 7fe96b2a5640 1 -- 172.21.15.60:0/3424613785 >> 172.21.15.60:0/3424613785 conn(0x7fe9640adb80 msgr2=0x7fe9640abb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:09.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.791+0000 7fe96b2a5640 1 -- 172.21.15.60:0/3424613785 shutdown_connections 2024-09-12T02:27:09.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.791+0000 7fe96b2a5640 1 -- 172.21.15.60:0/3424613785 wait complete. 2024-09-12T02:27:09.802 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-12T02:27:09.802 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-12T02:27:09.802 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-12T02:27:09.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.913+0000 7f85961b7640 1 Processor -- start 2024-09-12T02:27:09.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.913+0000 7f85961b7640 1 -- start start 2024-09-12T02:27:09.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.914+0000 7f85961b7640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8590150480 0x7f85900c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:09.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.914+0000 7f85961b7640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f859015a7c0 con 0x7f85900ca390 2024-09-12T02:27:09.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.914+0000 7f85961b7640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8590159a00 con 0x7f859006c650 2024-09-12T02:27:09.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.914+0000 7f85961b7640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f859006c240 con 0x7f8590150480 2024-09-12T02:27:09.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.914+0000 7f858ffff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f85900ca390 0x7f8590160bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46612/0 (socket says 172.21.15.60:46612) 2024-09-12T02:27:09.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.914+0000 7f858ffff640 1 -- 172.21.15.60:0/2232052488 learned_addr learned my addr 172.21.15.60:0/2232052488 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:27:09.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.914+0000 7f858f7fe640 1 --2- 172.21.15.60:0/2232052488 >> v2:172.21.15.105:3300/0 conn(0x7f8590150480 0x7f85900c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:09.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.915+0000 7f858f7fe640 1 -- 172.21.15.60:0/2232052488 >> v1:172.21.15.105:6789/0 conn(0x7f859006c650 legacy=0x7f85900c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:09.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.915+0000 7f858f7fe640 1 -- 172.21.15.60:0/2232052488 >> v1:172.21.15.60:6789/0 conn(0x7f85900ca390 legacy=0x7f8590160bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:09.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.915+0000 7f858f7fe640 1 -- 172.21.15.60:0/2232052488 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8590159ce0 con 0x7f8590150480 2024-09-12T02:27:09.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.916+0000 7f858f7fe640 1 --2- 172.21.15.60:0/2232052488 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8590150480 0x7f85900c7a90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f85800097a0 tx=0x7f858002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5424476ce337684 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:09.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.918+0000 7f858e7fc640 1 -- 172.21.15.60:0/2232052488 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8580037070 con 0x7f8590150480 2024-09-12T02:27:09.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.918+0000 7f858e7fc640 1 -- 172.21.15.60:0/2232052488 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8580032440 con 0x7f8590150480 2024-09-12T02:27:09.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.918+0000 7f858e7fc640 1 -- 172.21.15.60:0/2232052488 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8580032810 con 0x7f8590150480 2024-09-12T02:27:09.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.919+0000 7f85961b7640 1 -- 172.21.15.60:0/2232052488 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8590150480 msgr2=0x7f85900c7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:09.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.919+0000 7f85961b7640 1 --2- 172.21.15.60:0/2232052488 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8590150480 0x7f85900c7a90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f85800097a0 tx=0x7f858002a230 comp rx=0 tx=0).stop 2024-09-12T02:27:09.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.919+0000 7f85961b7640 1 -- 172.21.15.60:0/2232052488 shutdown_connections 2024-09-12T02:27:09.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.919+0000 7f85961b7640 1 --2- 172.21.15.60:0/2232052488 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8590150480 0x7f85900c7a90 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:09.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.919+0000 7f85961b7640 1 -- 172.21.15.60:0/2232052488 >> 172.21.15.60:0/2232052488 conn(0x7f8590068030 msgr2=0x7f8590073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:09.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.919+0000 7f85961b7640 1 -- 172.21.15.60:0/2232052488 shutdown_connections 2024-09-12T02:27:09.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.919+0000 7f85961b7640 1 -- 172.21.15.60:0/2232052488 wait complete. 2024-09-12T02:27:09.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.920+0000 7f85961b7640 1 Processor -- start 2024-09-12T02:27:09.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.920+0000 7f85961b7640 1 -- start start 2024-09-12T02:27:09.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.921+0000 7f85961b7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f859006c650 0x7f85900c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:09.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.921+0000 7f85961b7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85900ca390 0x7f8590152cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:09.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.921+0000 7f85961b7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8590150480 0x7f85901531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:09.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.921+0000 7f85961b7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f859006d270 con 0x7f85900ca390 2024-09-12T02:27:09.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.921+0000 7f85961b7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f859015a330 con 0x7f8590150480 2024-09-12T02:27:09.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.921+0000 7f85961b7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8590156270 con 0x7f859006c650 2024-09-12T02:27:09.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.921+0000 7f858effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85900ca390 0x7f8590152cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:09.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.921+0000 7f858f7fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f859006c650 0x7f85900c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:09.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.921+0000 7f858effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85900ca390 0x7f8590152cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34878/0 (socket says 172.21.15.60:34878) 2024-09-12T02:27:09.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.921+0000 7f858effd640 1 -- 172.21.15.60:0/2329267215 learned_addr learned my addr 172.21.15.60:0/2329267215 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:27:09.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.921+0000 7f858ffff640 1 --2- 172.21.15.60:0/2329267215 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8590150480 0x7f85901531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:09.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.921+0000 7f858f7fe640 1 -- 172.21.15.60:0/2329267215 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f859006c650 msgr2=0x7f85900c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-12T02:27:09.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.921+0000 7f858f7fe640 1 -- 172.21.15.60:0/2329267215 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f859006c650 msgr2=0x7f85900c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:27:09.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.921+0000 7f858f7fe640 1 --2- 172.21.15.60:0/2329267215 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f859006c650 0x7f85900c8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:27:09.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.921+0000 7f858f7fe640 1 --2- 172.21.15.60:0/2329267215 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f859006c650 0x7f85900c8790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:27:09.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.922+0000 7f858ffff640 1 -- 172.21.15.60:0/2329267215 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f859006c650 msgr2=0x7f85900c8790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:27:09.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.922+0000 7f858ffff640 1 --2- 172.21.15.60:0/2329267215 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f859006c650 0x7f85900c8790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:09.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.922+0000 7f858ffff640 1 -- 172.21.15.60:0/2329267215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85900ca390 msgr2=0x7f8590152cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:09.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.922+0000 7f858ffff640 1 --2- 172.21.15.60:0/2329267215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85900ca390 0x7f8590152cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:09.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.922+0000 7f858ffff640 1 -- 172.21.15.60:0/2329267215 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85901f04f0 con 0x7f8590150480 2024-09-12T02:27:09.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.922+0000 7f858effd640 1 --2- 172.21.15.60:0/2329267215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85900ca390 0x7f8590152cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:27:09.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.922+0000 7f858ffff640 1 --2- 172.21.15.60:0/2329267215 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8590150480 0x7f85901531f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f858800caa0 tx=0x7f858800cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:09.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.922+0000 7f8577fff640 1 -- 172.21.15.60:0/2329267215 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8588017070 con 0x7f8590150480 2024-09-12T02:27:09.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.922+0000 7f8577fff640 1 -- 172.21.15.60:0/2329267215 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f858800ab40 con 0x7f8590150480 2024-09-12T02:27:09.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.922+0000 7f85961b7640 1 -- 172.21.15.60:0/2329267215 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8590151180 con 0x7f8590150480 2024-09-12T02:27:09.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.922+0000 7f8577fff640 1 -- 172.21.15.60:0/2329267215 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8588012400 con 0x7f8590150480 2024-09-12T02:27:09.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.922+0000 7f85961b7640 1 -- 172.21.15.60:0/2329267215 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85900af470 con 0x7f8590150480 2024-09-12T02:27:09.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.923+0000 7f85961b7640 1 --2- 172.21.15.60:0/2329267215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85901f0060 0x7f859014f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:09.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.923+0000 7f85961b7640 1 -- 172.21.15.60:0/2329267215 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8590150030 con 0x7f85901f0060 2024-09-12T02:27:09.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.923+0000 7f858f7fe640 1 --2- 172.21.15.60:0/2329267215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85901f0060 0x7f859014f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:09.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.924+0000 7f858f7fe640 1 -- 172.21.15.60:0/2329267215 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8590159440 con 0x7f85901f0060 2024-09-12T02:27:09.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.924+0000 7f8577fff640 1 -- 172.21.15.60:0/2329267215 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f858801a070 con 0x7f8590150480 2024-09-12T02:27:09.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.924+0000 7f858f7fe640 1 --2- 172.21.15.60:0/2329267215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85901f0060 0x7f859014f2e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f859006bc70 tx=0x7f85800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:09.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.924+0000 7f8577fff640 1 --2- 172.21.15.60:0/2329267215 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f857c06be60 0x7f857c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:09.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.924+0000 7f858effd640 1 --2- 172.21.15.60:0/2329267215 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f857c06be60 0x7f857c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:09.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.924+0000 7f8577fff640 1 -- 172.21.15.60:0/2329267215 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f858808acb0 con 0x7f8590150480 2024-09-12T02:27:09.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.925+0000 7f8577fff640 1 -- 172.21.15.60:0/2329267215 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8580041070 con 0x7f85901f0060 2024-09-12T02:27:09.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.925+0000 7f8577fff640 1 -- 172.21.15.60:0/2329267215 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f858003c870 con 0x7f85901f0060 2024-09-12T02:27:09.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.925+0000 7f8577fff640 1 -- 172.21.15.60:0/2329267215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85901f0060 msgr2=0x7f859014f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:09.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.925+0000 7f8577fff640 1 --2- 172.21.15.60:0/2329267215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85901f0060 0x7f859014f2e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f859006bc70 tx=0x7f85800046c0 comp rx=0 tx=0).stop 2024-09-12T02:27:09.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.925+0000 7f8577fff640 1 -- 172.21.15.60:0/2329267215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85901f0060 msgr2=0x7f859014f2e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:27:09.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.925+0000 7f8577fff640 1 --2- 172.21.15.60:0/2329267215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85901f0060 0x7f859014f2e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:09.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.925+0000 7f858effd640 1 --2- 172.21.15.60:0/2329267215 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f857c06be60 0x7f857c06e320 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f85901542e0 tx=0x7f8584009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:09.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.932+0000 7f85961b7640 1 --2- 172.21.15.60:0/2329267215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85900c8cd0 0x7f859014f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:09.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.932+0000 7f85961b7640 1 -- 172.21.15.60:0/2329267215 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f85900c9c80 con 0x7f85900c8cd0 2024-09-12T02:27:09.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.932+0000 7f858f7fe640 1 --2- 172.21.15.60:0/2329267215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85900c8cd0 0x7f859014f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:09.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.932+0000 7f858f7fe640 1 -- 172.21.15.60:0/2329267215 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f85900af640 con 0x7f85900c8cd0 2024-09-12T02:27:09.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.932+0000 7f858f7fe640 1 --2- 172.21.15.60:0/2329267215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85900c8cd0 0x7f859014f820 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8590069ba0 tx=0x7f8580008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:09.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.933+0000 7f8577fff640 1 -- 172.21.15.60:0/2329267215 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8580032e60 con 0x7f85900c8cd0 2024-09-12T02:27:09.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.933+0000 7f8577fff640 1 -- 172.21.15.60:0/2329267215 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4884 (secure 0 0 0) 0x7f8580045410 con 0x7f85900c8cd0 2024-09-12T02:27:09.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.933+0000 7f8577fff640 1 -- 172.21.15.60:0/2329267215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85900c8cd0 msgr2=0x7f859014f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:09.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.933+0000 7f8577fff640 1 --2- 172.21.15.60:0/2329267215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85900c8cd0 0x7f859014f820 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8590069ba0 tx=0x7f8580008030 comp rx=0 tx=0).stop 2024-09-12T02:27:09.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.933+0000 7f8577fff640 1 -- 172.21.15.60:0/2329267215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85900c8cd0 msgr2=0x7f859014f820 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:27:09.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.933+0000 7f8577fff640 1 --2- 172.21.15.60:0/2329267215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85900c8cd0 0x7f859014f820 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8590069ba0 tx=0x7f8580008030 comp rx=0 tx=0).stop 2024-09-12T02:27:09.935 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:27:09.935 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:27:09.935 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:27:09.935 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:27:09.935 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 36, 2024-09-12T02:27:09.935 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 70042, 2024-09-12T02:27:09.935 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:27:09.935 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:27:09.935 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:27:09.935 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:27:09.935 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:27:09.935 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 2, 2024-09-12T02:27:09.936 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:27:09.936 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:27:09.936 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:27:09.936 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:27:09.936 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:27:09.936 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:27:09.936 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:27:09.936 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:27:09.936 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:27:09.936 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:27:09.936 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:27:09.936 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:27:09.937 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:27:09.937 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:27:09.937 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:27:09.937 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:27:09.937 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:27:09.937 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:27:09.937 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:27:09.937 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:27:09.937 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:27:09.937 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:27:09.937 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:27:09.937 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:27:09.937 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:27:09.937 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:27:09.938 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:27:09.938 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:27:09.938 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:09.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:09.938 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:27:09.938 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:27:09.938 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:27:09.938 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:27:09.938 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:27:09.938 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:27:09.938 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:27:09.938 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:27:09.938 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:27:09.939 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:27:09.939 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:27:09.939 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:27:09.939 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:27:09.939 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:27:09.939 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:27:09.939 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:27:09.939 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:27:09.939 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:27:09.939 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:27:09.939 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:27:09.939 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:27:09.939 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:27:09.939 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:27:09.940 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:27:09.940 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:27:09.940 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:27:09.940 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:27:09.940 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:27:09.940 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:27:09.940 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:27:09.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:09.940 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:27:09.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:09.940 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:27:09.940 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:27:09.940 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:27:09.941 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:27:09.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:09.941 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:27:09.941 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:27:09.941 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:09.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:09.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:09.941 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:27:09.941 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:27:09.941 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:09.941 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:09.942 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:09.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:09.942 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:27:09.942 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:27:09.942 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:27:09.942 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:27:09.942 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:27:09.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:09.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:09.942 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:27:09.942 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:27:09.942 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:27:09.942 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:27:09.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:09.943 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:27:09.943 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:27:09.943 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:09.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:09.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:09.943 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:27:09.943 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:27:09.943 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:09.943 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:09.943 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:09.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:09.943 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:27:09.944 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:27:09.944 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:27:09.944 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:27:09.944 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:27:09.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:09.944 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:09.944 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:27:09.944 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:27:09.944 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:27:09.944 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:27:09.944 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:09.944 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:27:09.944 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:27:09.944 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:09.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:09.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:09.945 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:27:09.945 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:27:09.945 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:09.945 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:09.945 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:09.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:09.945 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:27:09.945 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:27:09.945 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:27:09.945 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:27:09.945 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:27:09.946 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:09.946 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:09.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:09.946 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:27:09.946 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:27:09.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:09.946 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:27:09.946 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:27:09.946 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:27:09.946 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:09.946 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:27:09.946 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:27:09.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:09.946 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:27:09.947 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:27:09.947 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:27:09.947 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:09.947 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:27:09.947 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:27:09.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:09.947 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:27:09.947 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:27:09.947 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:27:09.947 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:09.947 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:27:09.947 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:27:09.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:09.948 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:27:09.948 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:27:09.948 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:27:09.948 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:09.948 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:09.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:09.948 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:27:09.948 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:27:09.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.933+0000 7f85961b7640 1 -- 172.21.15.60:0/2329267215 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f857c06be60 msgr2=0x7f857c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:09.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.933+0000 7f85961b7640 1 --2- 172.21.15.60:0/2329267215 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f857c06be60 0x7f857c06e320 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f85901542e0 tx=0x7f8584009040 comp rx=0 tx=0).stop 2024-09-12T02:27:09.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.933+0000 7f858ffff640 1 -- 172.21.15.60:0/2329267215 reap_dead start 2024-09-12T02:27:09.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.933+0000 7f85961b7640 1 -- 172.21.15.60:0/2329267215 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8590150480 msgr2=0x7f85901531f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:09.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.933+0000 7f85961b7640 1 --2- 172.21.15.60:0/2329267215 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8590150480 0x7f85901531f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f858800caa0 tx=0x7f858800cf60 comp rx=0 tx=0).stop 2024-09-12T02:27:09.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.933+0000 7f85961b7640 1 -- 172.21.15.60:0/2329267215 shutdown_connections 2024-09-12T02:27:09.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.933+0000 7f85961b7640 1 --2- 172.21.15.60:0/2329267215 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8590150480 0x7f85901531f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:09.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.933+0000 7f85961b7640 1 -- 172.21.15.60:0/2329267215 >> 172.21.15.60:0/2329267215 conn(0x7f8590068030 msgr2=0x7f85900c7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:09.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.934+0000 7f85961b7640 1 -- 172.21.15.60:0/2329267215 shutdown_connections 2024-09-12T02:27:09.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:09.934+0000 7f85961b7640 1 -- 172.21.15.60:0/2329267215 wait complete. 2024-09-12T02:27:09.950 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:27:09.951 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-12T02:27:09.951 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-12T02:27:10.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.064+0000 7ff0565c4640 1 Processor -- start 2024-09-12T02:27:10.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.064+0000 7ff0565c4640 1 -- start start 2024-09-12T02:27:10.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.065+0000 7ff0565c4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff0500c3560 0x7ff0500c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:10.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.065+0000 7ff0565c4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0500c7fb0 0x7ff050160bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:10.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.066+0000 7ff0565c4640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff050153fc0 con 0x7ff050153be0 2024-09-12T02:27:10.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.066+0000 7ff0565c4640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7ff050156db0 con 0x7ff0500c3560 2024-09-12T02:27:10.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.066+0000 7ff0565c4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff0500c8440 con 0x7ff0500c7fb0 2024-09-12T02:27:10.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.066+0000 7ff04f7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff0500c3560 0x7ff0500c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:10.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.066+0000 7ff04f7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff0500c3560 0x7ff0500c7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34902/0 (socket says 172.21.15.60:34902) 2024-09-12T02:27:10.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.066+0000 7ff04f7fe640 1 -- 172.21.15.60:0/472554561 learned_addr learned my addr 172.21.15.60:0/472554561 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:27:10.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.066+0000 7ff054b61640 1 --2- 172.21.15.60:0/472554561 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0500c7fb0 0x7ff050160bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:10.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.066+0000 7ff054b61640 1 -- 172.21.15.60:0/472554561 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0500c7fb0 msgr2=0x7ff050160bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:27:10.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.066+0000 7ff054b61640 1 -- 172.21.15.60:0/472554561 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0500c7fb0 msgr2=0x7ff050160bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:27:10.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.066+0000 7ff054b61640 1 --2- 172.21.15.60:0/472554561 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0500c7fb0 0x7ff050160bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:27:10.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.066+0000 7ff054b61640 1 --2- 172.21.15.60:0/472554561 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0500c7fb0 0x7ff050160bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:27:10.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.066+0000 7ff04f7fe640 1 -- 172.21.15.60:0/472554561 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0500c7fb0 msgr2=0x7ff050160bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:27:10.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.066+0000 7ff04f7fe640 1 --2- 172.21.15.60:0/472554561 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0500c7fb0 0x7ff050160bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:10.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.066+0000 7ff04f7fe640 1 -- 172.21.15.60:0/472554561 >> v1:172.21.15.60:6789/0 conn(0x7ff050153be0 legacy=0x7ff0500ac720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:10.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.066+0000 7ff04f7fe640 1 -- 172.21.15.60:0/472554561 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0500a8030 con 0x7ff0500c3560 2024-09-12T02:27:10.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.067+0000 7ff04f7fe640 1 --2- 172.21.15.60:0/472554561 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0500c3560 0x7ff0500c7a70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff044009870 tx=0x7ff04402a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc749bd2c575248e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:10.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.067+0000 7ff04effd640 1 -- 172.21.15.60:0/472554561 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff044037070 con 0x7ff0500c3560 2024-09-12T02:27:10.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.067+0000 7ff04effd640 1 -- 172.21.15.60:0/472554561 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff044032440 con 0x7ff0500c3560 2024-09-12T02:27:10.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.067+0000 7ff04effd640 1 -- 172.21.15.60:0/472554561 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff044032810 con 0x7ff0500c3560 2024-09-12T02:27:10.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.068+0000 7ff0565c4640 1 -- 172.21.15.60:0/472554561 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0500c3560 msgr2=0x7ff0500c7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:10.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.068+0000 7ff0565c4640 1 --2- 172.21.15.60:0/472554561 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0500c3560 0x7ff0500c7a70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff044009870 tx=0x7ff04402a130 comp rx=0 tx=0).stop 2024-09-12T02:27:10.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.068+0000 7ff0565c4640 1 -- 172.21.15.60:0/472554561 shutdown_connections 2024-09-12T02:27:10.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.068+0000 7ff0565c4640 1 --2- 172.21.15.60:0/472554561 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0500c7fb0 0x7ff050160bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:10.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.068+0000 7ff0565c4640 1 --2- 172.21.15.60:0/472554561 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0500c3560 0x7ff0500c7a70 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:10.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.068+0000 7ff0565c4640 1 -- 172.21.15.60:0/472554561 >> 172.21.15.60:0/472554561 conn(0x7ff0500c5660 msgr2=0x7ff0500c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:10.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.068+0000 7ff0565c4640 1 -- 172.21.15.60:0/472554561 shutdown_connections 2024-09-12T02:27:10.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.068+0000 7ff0565c4640 1 -- 172.21.15.60:0/472554561 wait complete. 2024-09-12T02:27:10.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.069+0000 7ff0565c4640 1 Processor -- start 2024-09-12T02:27:10.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.069+0000 7ff0565c4640 1 -- start start 2024-09-12T02:27:10.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.070+0000 7ff0565c4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0500c3560 0x7ff0501e0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:10.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.070+0000 7ff0565c4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0500c7fb0 0x7ff0500a93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:10.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.070+0000 7ff0565c4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff050153be0 0x7ff0501ef0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:10.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.070+0000 7ff0565c4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff0500a83e0 con 0x7ff0500c7fb0 2024-09-12T02:27:10.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.070+0000 7ff0565c4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff050157240 con 0x7ff0500c3560 2024-09-12T02:27:10.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.070+0000 7ff0565c4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff0500ac370 con 0x7ff050153be0 2024-09-12T02:27:10.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.070+0000 7ff04f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0500c7fb0 0x7ff0500a93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:10.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.070+0000 7ff04f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0500c7fb0 0x7ff0500a93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34908/0 (socket says 172.21.15.60:34908) 2024-09-12T02:27:10.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.070+0000 7ff04f7fe640 1 -- 172.21.15.60:0/1686860325 learned_addr learned my addr 172.21.15.60:0/1686860325 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:27:10.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.070+0000 7ff054b61640 1 --2- 172.21.15.60:0/1686860325 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff050153be0 0x7ff0501ef0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:10.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.070+0000 7ff04ffff640 1 --2- 172.21.15.60:0/1686860325 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0500c3560 0x7ff0501e0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:10.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.071+0000 7ff054b61640 1 -- 172.21.15.60:0/1686860325 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff050153be0 msgr2=0x7ff0501ef0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-12T02:27:10.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.071+0000 7ff054b61640 1 -- 172.21.15.60:0/1686860325 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff050153be0 msgr2=0x7ff0501ef0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:27:10.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.071+0000 7ff054b61640 1 --2- 172.21.15.60:0/1686860325 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff050153be0 0x7ff0501ef0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:27:10.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.071+0000 7ff054b61640 1 --2- 172.21.15.60:0/1686860325 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff050153be0 0x7ff0501ef0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:27:10.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.071+0000 7ff04f7fe640 1 -- 172.21.15.60:0/1686860325 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff050153be0 msgr2=0x7ff0501ef0c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:27:10.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.071+0000 7ff04f7fe640 1 --2- 172.21.15.60:0/1686860325 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff050153be0 0x7ff0501ef0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:10.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.071+0000 7ff04f7fe640 1 -- 172.21.15.60:0/1686860325 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0500c3560 msgr2=0x7ff0501e0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:10.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.071+0000 7ff04f7fe640 1 --2- 172.21.15.60:0/1686860325 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0500c3560 0x7ff0501e0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:10.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.071+0000 7ff04f7fe640 1 -- 172.21.15.60:0/1686860325 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0501e0030 con 0x7ff0500c7fb0 2024-09-12T02:27:10.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.071+0000 7ff04ffff640 1 --2- 172.21.15.60:0/1686860325 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0500c3560 0x7ff0501e0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:27:10.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.071+0000 7ff04f7fe640 1 --2- 172.21.15.60:0/1686860325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0500c7fb0 0x7ff0500a93e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff044000c00 tx=0x7ff0440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:10.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.071+0000 7ff04cff9640 1 -- 172.21.15.60:0/1686860325 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff044037040 con 0x7ff0500c7fb0 2024-09-12T02:27:10.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.071+0000 7ff04cff9640 1 -- 172.21.15.60:0/1686860325 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff044042070 con 0x7ff0500c7fb0 2024-09-12T02:27:10.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.071+0000 7ff0565c4640 1 -- 172.21.15.60:0/1686860325 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0501543e0 con 0x7ff0500c7fb0 2024-09-12T02:27:10.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.071+0000 7ff04cff9640 1 -- 172.21.15.60:0/1686860325 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff044030980 con 0x7ff0500c7fb0 2024-09-12T02:27:10.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.071+0000 7ff0565c4640 1 -- 172.21.15.60:0/1686860325 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0501dfcc0 con 0x7ff0500c7fb0 2024-09-12T02:27:10.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.072+0000 7ff0565c4640 1 --2- 172.21.15.60:0/1686860325 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0501ef600 0x7ff05014dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:10.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.072+0000 7ff0565c4640 1 -- 172.21.15.60:0/1686860325 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff0501eede0 con 0x7ff0501ef600 2024-09-12T02:27:10.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.072+0000 7ff04ffff640 1 --2- 172.21.15.60:0/1686860325 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0501ef600 0x7ff05014dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:10.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.073+0000 7ff04ffff640 1 -- 172.21.15.60:0/1686860325 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff0500c63f0 con 0x7ff0501ef600 2024-09-12T02:27:10.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.073+0000 7ff04ffff640 1 --2- 172.21.15.60:0/1686860325 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0501ef600 0x7ff05014dd60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff04000e4d0 tx=0x7ff04000e990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:10.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.073+0000 7ff04cff9640 1 -- 172.21.15.60:0/1686860325 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0400052e0 con 0x7ff0501ef600 2024-09-12T02:27:10.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.073+0000 7ff04cff9640 1 -- 172.21.15.60:0/1686860325 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff044030b20 con 0x7ff0500c7fb0 2024-09-12T02:27:10.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.074+0000 7ff04cff9640 1 --2- 172.21.15.60:0/1686860325 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff03c06bd60 0x7ff03c06e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:10.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.074+0000 7ff04cff9640 1 -- 172.21.15.60:0/1686860325 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7ff0440abb70 con 0x7ff0500c7fb0 2024-09-12T02:27:10.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.074+0000 7ff054b61640 1 --2- 172.21.15.60:0/1686860325 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff03c06bd60 0x7ff03c06e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:10.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.074+0000 7ff04cff9640 1 -- 172.21.15.60:0/1686860325 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff040005480 con 0x7ff0501ef600 2024-09-12T02:27:10.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.074+0000 7ff04cff9640 1 -- 172.21.15.60:0/1686860325 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0501ef600 msgr2=0x7ff05014dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:10.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.074+0000 7ff04cff9640 1 --2- 172.21.15.60:0/1686860325 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0501ef600 0x7ff05014dd60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff04000e4d0 tx=0x7ff04000e990 comp rx=0 tx=0).stop 2024-09-12T02:27:10.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.074+0000 7ff04cff9640 1 -- 172.21.15.60:0/1686860325 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0501ef600 msgr2=0x7ff05014dd60 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:27:10.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.074+0000 7ff04cff9640 1 --2- 172.21.15.60:0/1686860325 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0501ef600 0x7ff05014dd60 secure :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff04000e4d0 tx=0x7ff04000e990 comp rx=0 tx=0).stop 2024-09-12T02:27:10.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.074+0000 7ff054b61640 1 --2- 172.21.15.60:0/1686860325 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff03c06bd60 0x7ff03c06e220 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff0501eb830 tx=0x7ff04800b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:10.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.081+0000 7ff0565c4640 1 --2- 172.21.15.60:0/1686860325 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0501ef9e0 0x7ff05014e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:10.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.081+0000 7ff0565c4640 1 -- 172.21.15.60:0/1686860325 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff05015a6d0 con 0x7ff0501ef9e0 2024-09-12T02:27:10.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.081+0000 7ff04ffff640 1 --2- 172.21.15.60:0/1686860325 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0501ef9e0 0x7ff05014e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:10.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.081+0000 7ff04ffff640 1 -- 172.21.15.60:0/1686860325 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff05014eed0 con 0x7ff0501ef9e0 2024-09-12T02:27:10.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.081+0000 7ff04ffff640 1 --2- 172.21.15.60:0/1686860325 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0501ef9e0 0x7ff05014e2a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff04000e4d0 tx=0x7ff040000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:10.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.081+0000 7ff04cff9640 1 -- 172.21.15.60:0/1686860325 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0400072f0 con 0x7ff0501ef9e0 2024-09-12T02:27:10.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.082+0000 7ff04cff9640 1 -- 172.21.15.60:0/1686860325 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5050 (secure 0 0 0) 0x7ff0400072f0 con 0x7ff0501ef9e0 2024-09-12T02:27:10.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.082+0000 7ff04cff9640 1 -- 172.21.15.60:0/1686860325 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0501ef9e0 msgr2=0x7ff05014e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:10.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.082+0000 7ff04cff9640 1 --2- 172.21.15.60:0/1686860325 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0501ef9e0 0x7ff05014e2a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff04000e4d0 tx=0x7ff040000ed0 comp rx=0 tx=0).stop 2024-09-12T02:27:10.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.082+0000 7ff04cff9640 1 -- 172.21.15.60:0/1686860325 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0501ef9e0 msgr2=0x7ff05014e2a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:27:10.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.082+0000 7ff04cff9640 1 --2- 172.21.15.60:0/1686860325 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0501ef9e0 0x7ff05014e2a0 secure :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff04000e4d0 tx=0x7ff040000ed0 comp rx=0 tx=0).stop 2024-09-12T02:27:10.083 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:27:10.083 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:27:10.083 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:27:10.083 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:27:10.083 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 36, 2024-09-12T02:27:10.083 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 175516, 2024-09-12T02:27:10.084 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:27:10.084 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:27:10.084 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:27:10.084 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:27:10.084 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:27:10.084 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 2, 2024-09-12T02:27:10.084 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:27:10.084 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:27:10.084 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:27:10.084 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:27:10.084 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:27:10.084 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:27:10.084 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:27:10.084 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:27:10.085 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:27:10.085 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:27:10.085 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:27:10.085 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:27:10.085 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:27:10.085 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:27:10.085 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:27:10.085 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:27:10.085 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:27:10.085 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:27:10.085 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:27:10.085 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:27:10.086 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:27:10.086 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:27:10.086 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:27:10.086 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:27:10.086 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:27:10.086 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:27:10.086 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:27:10.086 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:27:10.086 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:10.086 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:10.086 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:27:10.086 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:27:10.086 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:27:10.086 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:27:10.086 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:27:10.087 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:27:10.087 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:27:10.087 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:27:10.087 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:27:10.087 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:27:10.087 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:27:10.087 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:27:10.087 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:27:10.087 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:27:10.087 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:27:10.087 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:27:10.087 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:27:10.087 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:27:10.087 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:27:10.087 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:27:10.088 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:27:10.088 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:27:10.088 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:27:10.088 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:27:10.088 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:27:10.088 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:27:10.088 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:27:10.088 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:27:10.088 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:27:10.088 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:27:10.088 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:10.088 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:27:10.088 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:10.089 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:27:10.089 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:27:10.089 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:27:10.089 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:27:10.089 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:10.089 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:27:10.089 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:27:10.089 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:10.089 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:10.089 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:10.089 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:27:10.089 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:27:10.089 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:10.090 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:10.090 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:10.090 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:10.090 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:27:10.090 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:27:10.090 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:27:10.090 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:27:10.090 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:27:10.090 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:10.090 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:10.090 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:27:10.090 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:27:10.090 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:27:10.091 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:27:10.091 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:10.091 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:27:10.091 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:27:10.091 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:10.091 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:10.091 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:10.091 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:27:10.091 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:27:10.091 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:10.091 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:10.091 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:10.091 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:10.092 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:27:10.092 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:27:10.092 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:27:10.092 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:27:10.092 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:27:10.092 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:10.092 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:10.092 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:27:10.092 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:27:10.092 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:27:10.092 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:27:10.092 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:10.092 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:27:10.092 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:27:10.093 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:10.093 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:10.093 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:10.093 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:27:10.093 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:27:10.093 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:10.093 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:10.093 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:10.093 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:10.093 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:27:10.093 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:27:10.093 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:27:10.093 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:27:10.094 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:27:10.094 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:10.094 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:10.094 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:10.094 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:27:10.094 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:27:10.094 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:10.094 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:27:10.094 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:27:10.094 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:27:10.094 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:10.094 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:27:10.094 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:27:10.094 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:10.095 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:27:10.095 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:27:10.095 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:27:10.095 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:10.095 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:27:10.095 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:27:10.095 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:10.095 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:27:10.095 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:27:10.095 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-09-12T02:27:10.095 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:10.095 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:27:10.095 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:27:10.096 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:10.096 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:27:10.096 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:27:10.096 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-09-12T02:27:10.096 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:10.096 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:27:10.096 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:27:10.096 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:10.096 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:27:10.096 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:27:10.096 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:27:10.096 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:10.096 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:10.097 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:10.097 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:27:10.097 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:27:10.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.082+0000 7ff0565c4640 1 -- 172.21.15.60:0/1686860325 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff03c06bd60 msgr2=0x7ff03c06e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:10.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.082+0000 7ff0565c4640 1 --2- 172.21.15.60:0/1686860325 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff03c06bd60 0x7ff03c06e220 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff0501eb830 tx=0x7ff04800b040 comp rx=0 tx=0).stop 2024-09-12T02:27:10.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.082+0000 7ff0565c4640 1 -- 172.21.15.60:0/1686860325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0500c7fb0 msgr2=0x7ff0500a93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:10.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.082+0000 7ff0565c4640 1 --2- 172.21.15.60:0/1686860325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0500c7fb0 0x7ff0500a93e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff044000c00 tx=0x7ff0440046c0 comp rx=0 tx=0).stop 2024-09-12T02:27:10.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.082+0000 7ff054b61640 1 -- 172.21.15.60:0/1686860325 reap_dead start 2024-09-12T02:27:10.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.082+0000 7ff054b61640 1 -- 172.21.15.60:0/1686860325 reap_dead start 2024-09-12T02:27:10.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.082+0000 7ff0565c4640 1 -- 172.21.15.60:0/1686860325 shutdown_connections 2024-09-12T02:27:10.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.082+0000 7ff0565c4640 1 -- 172.21.15.60:0/1686860325 >> 172.21.15.60:0/1686860325 conn(0x7ff0500c5660 msgr2=0x7ff0500c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:10.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.082+0000 7ff0565c4640 1 -- 172.21.15.60:0/1686860325 shutdown_connections 2024-09-12T02:27:10.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.082+0000 7ff0565c4640 1 -- 172.21.15.60:0/1686860325 wait complete. 2024-09-12T02:27:10.099 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:27:10.099 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-12T02:27:10.099 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-12T02:27:10.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.218+0000 7f73320dd640 1 Processor -- start 2024-09-12T02:27:10.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.218+0000 7f73320dd640 1 -- start start 2024-09-12T02:27:10.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.219+0000 7f73320dd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f732c06bbe0 0x7f732c156370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:10.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.219+0000 7f73320dd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f732c0c2b80 0x7f732c1568b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:10.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.219+0000 7f73320dd640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f732c074070 con 0x7f732c06da50 2024-09-12T02:27:10.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.219+0000 7f73320dd640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f732c06c7c0 con 0x7f732c06bbe0 2024-09-12T02:27:10.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.219+0000 7f73320dd640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f732c15a390 con 0x7f732c0c2b80 2024-09-12T02:27:10.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.219+0000 7f732affd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f732c06bbe0 0x7f732c156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:10.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.219+0000 7f732affd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f732c06bbe0 0x7f732c156370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34922/0 (socket says 172.21.15.60:34922) 2024-09-12T02:27:10.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.219+0000 7f732affd640 1 -- 172.21.15.60:0/3369601026 learned_addr learned my addr 172.21.15.60:0/3369601026 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:27:10.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.219+0000 7f732bfff640 1 --2- 172.21.15.60:0/3369601026 >> v2:172.21.15.105:3300/0 conn(0x7f732c0c2b80 0x7f732c1568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:10.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.220+0000 7f732affd640 1 -- 172.21.15.60:0/3369601026 >> v2:172.21.15.105:3300/0 conn(0x7f732c0c2b80 msgr2=0x7f732c1568b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:27:10.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.220+0000 7f732affd640 1 --2- 172.21.15.60:0/3369601026 >> v2:172.21.15.105:3300/0 conn(0x7f732c0c2b80 0x7f732c1568b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:10.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.220+0000 7f732affd640 1 -- 172.21.15.60:0/3369601026 >> v1:172.21.15.60:6789/0 conn(0x7f732c06da50 legacy=0x7f732c1537d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:10.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.220+0000 7f732affd640 1 -- 172.21.15.60:0/3369601026 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f732c15a670 con 0x7f732c06bbe0 2024-09-12T02:27:10.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.221+0000 7f732affd640 1 --2- 172.21.15.60:0/3369601026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f732c06bbe0 0x7f732c156370 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f732c068670 tx=0x7f732002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57df8490c7abce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:10.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.221+0000 7f732a7fc640 1 -- 172.21.15.60:0/3369601026 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7320037070 con 0x7f732c06bbe0 2024-09-12T02:27:10.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.221+0000 7f732a7fc640 1 -- 172.21.15.60:0/3369601026 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7320032440 con 0x7f732c06bbe0 2024-09-12T02:27:10.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.221+0000 7f732a7fc640 1 -- 172.21.15.60:0/3369601026 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7320032810 con 0x7f732c06bbe0 2024-09-12T02:27:10.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.221+0000 7f73320dd640 1 -- 172.21.15.60:0/3369601026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f732c06bbe0 msgr2=0x7f732c156370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:10.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.221+0000 7f73320dd640 1 --2- 172.21.15.60:0/3369601026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f732c06bbe0 0x7f732c156370 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f732c068670 tx=0x7f732002a1e0 comp rx=0 tx=0).stop 2024-09-12T02:27:10.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.221+0000 7f73320dd640 1 -- 172.21.15.60:0/3369601026 shutdown_connections 2024-09-12T02:27:10.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.221+0000 7f73320dd640 1 --2- 172.21.15.60:0/3369601026 >> v2:172.21.15.105:3300/0 conn(0x7f732c0c2b80 0x7f732c1568b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:10.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.221+0000 7f73320dd640 1 --2- 172.21.15.60:0/3369601026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f732c06bbe0 0x7f732c156370 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:10.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.221+0000 7f73320dd640 1 -- 172.21.15.60:0/3369601026 >> 172.21.15.60:0/3369601026 conn(0x7f732c06ccf0 msgr2=0x7f732c06d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:10.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.222+0000 7f73320dd640 1 -- 172.21.15.60:0/3369601026 shutdown_connections 2024-09-12T02:27:10.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.222+0000 7f73320dd640 1 -- 172.21.15.60:0/3369601026 wait complete. 2024-09-12T02:27:10.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.223+0000 7f73320dd640 1 Processor -- start 2024-09-12T02:27:10.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.223+0000 7f73320dd640 1 -- start start 2024-09-12T02:27:10.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.224+0000 7f73320dd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f732c06bbe0 0x7f732c1e02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:10.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.224+0000 7f73320dd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f732c06da50 0x7f732c1593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:10.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.224+0000 7f73320dd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f732c0c2b80 0x7f732c1e1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:10.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.224+0000 7f73320dd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f732c073e10 con 0x7f732c06bbe0 2024-09-12T02:27:10.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.224+0000 7f73320dd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f732c073c90 con 0x7f732c06da50 2024-09-12T02:27:10.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.224+0000 7f73320dd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f732c06de30 con 0x7f732c0c2b80 2024-09-12T02:27:10.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.224+0000 7f732b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f732c06bbe0 0x7f732c1e02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:10.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.224+0000 7f732b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f732c06bbe0 0x7f732c1e02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34926/0 (socket says 172.21.15.60:34926) 2024-09-12T02:27:10.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.224+0000 7f732b7fe640 1 -- 172.21.15.60:0/3890644298 learned_addr learned my addr 172.21.15.60:0/3890644298 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:27:10.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.224+0000 7f732affd640 1 --2- 172.21.15.60:0/3890644298 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f732c06da50 0x7f732c1593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:10.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.224+0000 7f732bfff640 1 --2- 172.21.15.60:0/3890644298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f732c0c2b80 0x7f732c1e1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:10.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.224+0000 7f732bfff640 1 -- 172.21.15.60:0/3890644298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f732c0c2b80 msgr2=0x7f732c1e1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-12T02:27:10.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.224+0000 7f732bfff640 1 -- 172.21.15.60:0/3890644298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f732c0c2b80 msgr2=0x7f732c1e1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:27:10.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.224+0000 7f732bfff640 1 --2- 172.21.15.60:0/3890644298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f732c0c2b80 0x7f732c1e1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:27:10.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.224+0000 7f732bfff640 1 --2- 172.21.15.60:0/3890644298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f732c0c2b80 0x7f732c1e1e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:27:10.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.224+0000 7f732b7fe640 1 -- 172.21.15.60:0/3890644298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f732c0c2b80 msgr2=0x7f732c1e1e30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:27:10.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.224+0000 7f732b7fe640 1 --2- 172.21.15.60:0/3890644298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f732c0c2b80 0x7f732c1e1e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:10.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.224+0000 7f732b7fe640 1 -- 172.21.15.60:0/3890644298 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f732c06da50 msgr2=0x7f732c1593d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:10.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.224+0000 7f732b7fe640 1 --2- 172.21.15.60:0/3890644298 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f732c06da50 0x7f732c1593d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:10.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.224+0000 7f732b7fe640 1 -- 172.21.15.60:0/3890644298 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f732c1e1710 con 0x7f732c06bbe0 2024-09-12T02:27:10.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.224+0000 7f732b7fe640 1 --2- 172.21.15.60:0/3890644298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f732c06bbe0 0x7f732c1e02e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f731c00c400 tx=0x7f731c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:10.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.225+0000 7f7313fff640 1 -- 172.21.15.60:0/3890644298 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f731c0052d0 con 0x7f732c06bbe0 2024-09-12T02:27:10.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.225+0000 7f7313fff640 1 -- 172.21.15.60:0/3890644298 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f731c005490 con 0x7f732c06bbe0 2024-09-12T02:27:10.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.225+0000 7f73320dd640 1 -- 172.21.15.60:0/3890644298 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f732c1e0080 con 0x7f732c06bbe0 2024-09-12T02:27:10.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.225+0000 7f7313fff640 1 -- 172.21.15.60:0/3890644298 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f731c007260 con 0x7f732c06bbe0 2024-09-12T02:27:10.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.225+0000 7f73320dd640 1 -- 172.21.15.60:0/3890644298 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f732c14a970 con 0x7f732c06bbe0 2024-09-12T02:27:10.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.226+0000 7f73320dd640 1 --2- 172.21.15.60:0/3890644298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f732c157910 0x7f732c1e2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:10.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.226+0000 7f73320dd640 1 -- 172.21.15.60:0/3890644298 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f732c1537d0 con 0x7f732c157910 2024-09-12T02:27:10.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.226+0000 7f732affd640 1 --2- 172.21.15.60:0/3890644298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f732c157910 0x7f732c1e2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:10.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.226+0000 7f732affd640 1 -- 172.21.15.60:0/3890644298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f732c157910 msgr2=0x7f732c1e2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2024-09-12T02:27:10.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.226+0000 7f732affd640 1 -- 172.21.15.60:0/3890644298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f732c157910 msgr2=0x7f732c1e2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:27:10.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.226+0000 7f732affd640 1 --2- 172.21.15.60:0/3890644298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f732c157910 0x7f732c1e2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:27:10.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.226+0000 7f732affd640 1 --2- 172.21.15.60:0/3890644298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f732c157910 0x7f732c1e2370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:27:10.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.227+0000 7f7313fff640 1 -- 172.21.15.60:0/3890644298 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f731c007400 con 0x7f732c06bbe0 2024-09-12T02:27:10.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.227+0000 7f7313fff640 1 --2- 172.21.15.60:0/3890644298 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f731806be60 0x7f731806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:10.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.227+0000 7f7313fff640 1 -- 172.21.15.60:0/3890644298 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f731c08a5e0 con 0x7f732c06bbe0 2024-09-12T02:27:10.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.227+0000 7f732bfff640 1 --2- 172.21.15.60:0/3890644298 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f731806be60 0x7f731806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:10.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.228+0000 7f732bfff640 1 --2- 172.21.15.60:0/3890644298 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f731806be60 0x7f731806e320 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f732c14a8a0 tx=0x7f732400b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:10.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.427+0000 7f732affd640 1 --2- 172.21.15.60:0/3890644298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f732c157910 0x7f732c1e2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:10.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.427+0000 7f732affd640 1 -- 172.21.15.60:0/3890644298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f732c157910 msgr2=0x7f732c1e2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-12T02:27:10.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.427+0000 7f732affd640 1 -- 172.21.15.60:0/3890644298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f732c157910 msgr2=0x7f732c1e2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:27:10.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.427+0000 7f732affd640 1 --2- 172.21.15.60:0/3890644298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f732c157910 0x7f732c1e2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:27:10.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.427+0000 7f732affd640 1 --2- 172.21.15.60:0/3890644298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f732c157910 0x7f732c1e2370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:27:10.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.828+0000 7f732affd640 1 --2- 172.21.15.60:0/3890644298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f732c157910 0x7f732c1e2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:10.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.828+0000 7f732affd640 1 -- 172.21.15.60:0/3890644298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f732c157910 msgr2=0x7f732c1e2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-12T02:27:10.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.828+0000 7f732affd640 1 -- 172.21.15.60:0/3890644298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f732c157910 msgr2=0x7f732c1e2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:27:10.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.828+0000 7f732affd640 1 --2- 172.21.15.60:0/3890644298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f732c157910 0x7f732c1e2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:27:10.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:10.828+0000 7f732affd640 1 --2- 172.21.15.60:0/3890644298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f732c157910 0x7f732c1e2370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:27:11.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:11.629+0000 7f732affd640 1 --2- 172.21.15.60:0/3890644298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f732c157910 0x7f732c1e2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:11.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:11.629+0000 7f732affd640 1 -- 172.21.15.60:0/3890644298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f732c157910 msgr2=0x7f732c1e2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-12T02:27:11.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:11.629+0000 7f732affd640 1 -- 172.21.15.60:0/3890644298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f732c157910 msgr2=0x7f732c1e2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:27:11.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:11.629+0000 7f732affd640 1 --2- 172.21.15.60:0/3890644298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f732c157910 0x7f732c1e2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:27:11.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:11.629+0000 7f732affd640 1 --2- 172.21.15.60:0/3890644298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f732c157910 0x7f732c1e2370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:27:13.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.230+0000 7f732affd640 1 --2- 172.21.15.60:0/3890644298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f732c157910 0x7f732c1e2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:13.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.230+0000 7f732affd640 1 -- 172.21.15.60:0/3890644298 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f732c0c2960 con 0x7f732c157910 2024-09-12T02:27:13.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.230+0000 7f732affd640 1 --2- 172.21.15.60:0/3890644298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f732c157910 0x7f732c1e2370 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f732c0c66f0 tx=0x7f73200046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:13.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.231+0000 7f7313fff640 1 -- 172.21.15.60:0/3890644298 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7320037040 con 0x7f732c157910 2024-09-12T02:27:13.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.231+0000 7f7313fff640 1 -- 172.21.15.60:0/3890644298 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f7320009490 con 0x7f732c157910 2024-09-12T02:27:13.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.231+0000 7f7313fff640 1 -- 172.21.15.60:0/3890644298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f732c157910 msgr2=0x7f732c1e2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:13.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.231+0000 7f7313fff640 1 --2- 172.21.15.60:0/3890644298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f732c157910 0x7f732c1e2370 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f732c0c66f0 tx=0x7f73200046c0 comp rx=0 tx=0).stop 2024-09-12T02:27:13.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.231+0000 7f7313fff640 1 -- 172.21.15.60:0/3890644298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f732c157910 msgr2=0x7f732c1e2370 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:27:13.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.231+0000 7f7313fff640 1 --2- 172.21.15.60:0/3890644298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f732c157910 0x7f732c1e2370 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:13.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.238+0000 7f73320dd640 1 --2- 172.21.15.60:0/3890644298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f732c1ec6b0 0x7f732c1ef1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:13.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.238+0000 7f73320dd640 1 -- 172.21.15.60:0/3890644298 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f732c159c40 con 0x7f732c1ec6b0 2024-09-12T02:27:13.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.238+0000 7f732affd640 1 --2- 172.21.15.60:0/3890644298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f732c1ec6b0 0x7f732c1ef1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:13.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.238+0000 7f732affd640 1 -- 172.21.15.60:0/3890644298 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f732c159910 con 0x7f732c1ec6b0 2024-09-12T02:27:13.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.238+0000 7f732affd640 1 --2- 172.21.15.60:0/3890644298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f732c1ec6b0 0x7f732c1ef1a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f732c14adb0 tx=0x7f7320009240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:13.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.239+0000 7f7313fff640 1 -- 172.21.15.60:0/3890644298 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7320054070 con 0x7f732c1ec6b0 2024-09-12T02:27:13.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.239+0000 7f7313fff640 1 -- 172.21.15.60:0/3890644298 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4548 (secure 0 0 0) 0x7f73200044a0 con 0x7f732c1ec6b0 2024-09-12T02:27:13.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.239+0000 7f7313fff640 1 -- 172.21.15.60:0/3890644298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f732c1ec6b0 msgr2=0x7f732c1ef1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:13.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.239+0000 7f7313fff640 1 --2- 172.21.15.60:0/3890644298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f732c1ec6b0 0x7f732c1ef1a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f732c14adb0 tx=0x7f7320009240 comp rx=0 tx=0).stop 2024-09-12T02:27:13.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.239+0000 7f7313fff640 1 -- 172.21.15.60:0/3890644298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f732c1ec6b0 msgr2=0x7f732c1ef1a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:27:13.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.239+0000 7f7313fff640 1 --2- 172.21.15.60:0/3890644298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f732c1ec6b0 0x7f732c1ef1a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:13.240 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:27:13.240 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:27:13.241 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:27:13.241 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:27:13.241 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 36, 2024-09-12T02:27:13.241 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 10650, 2024-09-12T02:27:13.241 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:27:13.241 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:27:13.241 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:27:13.241 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:27:13.241 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:27:13.241 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 5, 2024-09-12T02:27:13.241 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:27:13.241 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:27:13.241 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:27:13.241 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:27:13.242 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:27:13.242 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:27:13.242 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:27:13.242 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:27:13.242 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:27:13.242 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:27:13.242 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:27:13.242 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:27:13.242 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:27:13.242 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:27:13.242 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:27:13.242 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:27:13.242 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:27:13.242 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:27:13.242 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:27:13.243 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:27:13.243 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:27:13.243 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:27:13.243 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:27:13.243 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:27:13.243 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:27:13.243 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:27:13.243 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:27:13.243 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:27:13.243 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:13.243 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:13.243 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:27:13.243 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:27:13.243 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:27:13.243 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:27:13.244 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:27:13.244 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:27:13.244 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:27:13.244 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:27:13.244 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:27:13.244 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:27:13.244 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:27:13.244 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:27:13.244 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:27:13.244 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:27:13.244 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:27:13.244 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:27:13.244 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:27:13.245 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:27:13.245 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:27:13.245 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:27:13.245 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:27:13.245 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:27:13.245 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:27:13.245 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:27:13.245 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:27:13.245 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:27:13.245 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:27:13.245 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:27:13.245 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:27:13.245 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:27:13.246 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:13.246 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:27:13.246 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:13.246 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:27:13.246 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:27:13.246 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:27:13.246 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:27:13.246 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:13.246 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:27:13.246 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:27:13.246 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:13.246 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:13.246 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:13.247 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:27:13.247 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:27:13.247 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:13.247 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:13.247 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:13.247 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:13.247 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:27:13.247 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:27:13.247 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:27:13.247 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:27:13.247 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:27:13.247 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:13.247 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:13.247 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:27:13.248 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:27:13.248 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:27:13.248 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:27:13.248 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:13.248 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:27:13.248 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:27:13.248 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:13.248 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:13.248 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:13.248 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:27:13.248 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:27:13.248 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:13.248 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:13.249 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:13.249 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:13.249 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:27:13.249 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:27:13.249 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:27:13.249 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:27:13.249 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:27:13.249 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:13.249 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:13.249 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:27:13.249 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:27:13.249 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:27:13.249 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:27:13.249 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:13.250 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:27:13.250 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:27:13.250 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:13.250 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:13.250 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:13.250 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:27:13.250 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:27:13.250 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:13.250 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:13.250 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:13.250 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:13.250 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:27:13.250 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:27:13.251 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:27:13.251 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:27:13.251 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:27:13.251 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:13.251 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:13.251 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:13.251 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:27:13.251 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:27:13.251 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:13.251 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:27:13.251 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:27:13.251 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:27:13.251 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:13.251 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:27:13.251 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:27:13.251 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:13.252 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:27:13.252 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:27:13.252 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:27:13.252 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:13.252 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:13.252 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:13.252 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:27:13.252 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:27:13.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.239+0000 7f73320dd640 1 -- 172.21.15.60:0/3890644298 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f731806be60 msgr2=0x7f731806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:13.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.239+0000 7f73320dd640 1 --2- 172.21.15.60:0/3890644298 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f731806be60 0x7f731806e320 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f732c14a8a0 tx=0x7f732400b040 comp rx=0 tx=0).stop 2024-09-12T02:27:13.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.239+0000 7f73320dd640 1 -- 172.21.15.60:0/3890644298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f732c06bbe0 msgr2=0x7f732c1e02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:13.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.239+0000 7f73320dd640 1 --2- 172.21.15.60:0/3890644298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f732c06bbe0 0x7f732c1e02e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f731c00c400 tx=0x7f731c00c8c0 comp rx=0 tx=0).stop 2024-09-12T02:27:13.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.239+0000 7f732bfff640 1 -- 172.21.15.60:0/3890644298 reap_dead start 2024-09-12T02:27:13.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.239+0000 7f732bfff640 1 -- 172.21.15.60:0/3890644298 reap_dead start 2024-09-12T02:27:13.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.239+0000 7f73320dd640 1 -- 172.21.15.60:0/3890644298 shutdown_connections 2024-09-12T02:27:13.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.239+0000 7f73320dd640 1 -- 172.21.15.60:0/3890644298 >> 172.21.15.60:0/3890644298 conn(0x7f732c06ccf0 msgr2=0x7f732c0c3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:13.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.240+0000 7f73320dd640 1 -- 172.21.15.60:0/3890644298 shutdown_connections 2024-09-12T02:27:13.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.240+0000 7f73320dd640 1 -- 172.21.15.60:0/3890644298 wait complete. 2024-09-12T02:27:13.254 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:27:13.254 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-12T02:27:13.254 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-12T02:27:13.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.380+0000 7feb92853640 1 Processor -- start 2024-09-12T02:27:13.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.381+0000 7feb92853640 1 -- start start 2024-09-12T02:27:13.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.381+0000 7feb92853640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feb8c0ca390 0x7feb8c161c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:13.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.381+0000 7feb92853640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb8c15a7c0 con 0x7feb8c150480 2024-09-12T02:27:13.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.382+0000 7feb92853640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb8c159a00 con 0x7feb8c06c650 2024-09-12T02:27:13.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.382+0000 7feb92853640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7feb8c06c240 con 0x7feb8c0ca390 2024-09-12T02:27:13.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.382+0000 7feb8bfff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7feb8c150480 0x7feb8c0c7a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46640/0 (socket says 172.21.15.60:46640) 2024-09-12T02:27:13.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.382+0000 7feb8bfff640 1 -- 172.21.15.60:0/2065430061 learned_addr learned my addr 172.21.15.60:0/2065430061 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:27:13.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.382+0000 7feb90df0640 1 --2- 172.21.15.60:0/2065430061 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feb8c0ca390 0x7feb8c161c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:13.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.382+0000 7feb8affd640 1 -- 172.21.15.60:0/2065430061 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4045189913 0 0) 0x7feb8c15a7c0 con 0x7feb8c150480 2024-09-12T02:27:13.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.382+0000 7feb8affd640 1 -- 172.21.15.60:0/2065430061 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb74003520 con 0x7feb8c150480 2024-09-12T02:27:13.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.382+0000 7feb8affd640 1 -- 172.21.15.60:0/2065430061 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4023725258 0 0) 0x7feb8c159a00 con 0x7feb8c06c650 2024-09-12T02:27:13.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.382+0000 7feb90df0640 1 -- 172.21.15.60:0/2065430061 >> v1:172.21.15.105:6789/0 conn(0x7feb8c06c650 legacy=0x7feb8c0c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:13.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.382+0000 7feb90df0640 1 -- 172.21.15.60:0/2065430061 >> v1:172.21.15.60:6789/0 conn(0x7feb8c150480 legacy=0x7feb8c0c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:13.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.382+0000 7feb90df0640 1 -- 172.21.15.60:0/2065430061 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb8c159ce0 con 0x7feb8c0ca390 2024-09-12T02:27:13.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.383+0000 7feb90df0640 1 --2- 172.21.15.60:0/2065430061 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feb8c0ca390 0x7feb8c161c00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7feb84009dc0 tx=0x7feb8402a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6aa58da98b5a6522 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:13.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.383+0000 7feb8affd640 1 -- 172.21.15.60:0/2065430061 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb84007740 con 0x7feb8c0ca390 2024-09-12T02:27:13.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.383+0000 7feb8affd640 1 -- 172.21.15.60:0/2065430061 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb840078e0 con 0x7feb8c0ca390 2024-09-12T02:27:13.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.383+0000 7feb8affd640 1 -- 172.21.15.60:0/2065430061 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb84007c90 con 0x7feb8c0ca390 2024-09-12T02:27:13.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.384+0000 7feb92853640 1 -- 172.21.15.60:0/2065430061 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feb8c0ca390 msgr2=0x7feb8c161c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:13.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.384+0000 7feb92853640 1 --2- 172.21.15.60:0/2065430061 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feb8c0ca390 0x7feb8c161c00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7feb84009dc0 tx=0x7feb8402a6d0 comp rx=0 tx=0).stop 2024-09-12T02:27:13.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.384+0000 7feb92853640 1 -- 172.21.15.60:0/2065430061 shutdown_connections 2024-09-12T02:27:13.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.384+0000 7feb92853640 1 --2- 172.21.15.60:0/2065430061 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feb8c0ca390 0x7feb8c161c00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:13.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.384+0000 7feb92853640 1 -- 172.21.15.60:0/2065430061 >> 172.21.15.60:0/2065430061 conn(0x7feb8c068030 msgr2=0x7feb8c073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:13.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.384+0000 7feb92853640 1 -- 172.21.15.60:0/2065430061 shutdown_connections 2024-09-12T02:27:13.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.384+0000 7feb92853640 1 -- 172.21.15.60:0/2065430061 wait complete. 2024-09-12T02:27:13.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.385+0000 7feb92853640 1 Processor -- start 2024-09-12T02:27:13.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.385+0000 7feb92853640 1 -- start start 2024-09-12T02:27:13.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.386+0000 7feb92853640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feb8c06c650 0x7feb8c14f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:13.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.386+0000 7feb92853640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb8c0ca390 0x7feb8c152330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:13.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.386+0000 7feb92853640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb8c150480 0x7feb8c0aff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:13.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.386+0000 7feb92853640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7feb8c06d270 con 0x7feb8c0ca390 2024-09-12T02:27:13.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.386+0000 7feb92853640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7feb8c15a330 con 0x7feb8c150480 2024-09-12T02:27:13.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.386+0000 7feb92853640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7feb8c0c81a0 con 0x7feb8c06c650 2024-09-12T02:27:13.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.386+0000 7feb8b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb8c0ca390 0x7feb8c152330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:13.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.386+0000 7feb8b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb8c0ca390 0x7feb8c152330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34950/0 (socket says 172.21.15.60:34950) 2024-09-12T02:27:13.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.386+0000 7feb8b7fe640 1 -- 172.21.15.60:0/2436830497 learned_addr learned my addr 172.21.15.60:0/2436830497 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:27:13.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.386+0000 7feb90df0640 1 --2- 172.21.15.60:0/2436830497 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb8c150480 0x7feb8c0aff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:13.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.386+0000 7feb8bfff640 1 --2- 172.21.15.60:0/2436830497 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feb8c06c650 0x7feb8c14f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:13.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.386+0000 7feb8b7fe640 1 -- 172.21.15.60:0/2436830497 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feb8c06c650 msgr2=0x7feb8c14f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:13.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.386+0000 7feb8b7fe640 1 --2- 172.21.15.60:0/2436830497 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feb8c06c650 0x7feb8c14f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:13.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.386+0000 7feb8b7fe640 1 -- 172.21.15.60:0/2436830497 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb8c150480 msgr2=0x7feb8c0aff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:13.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.386+0000 7feb8b7fe640 1 --2- 172.21.15.60:0/2436830497 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb8c150480 0x7feb8c0aff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:13.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.387+0000 7feb8b7fe640 1 -- 172.21.15.60:0/2436830497 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb8c0c5f50 con 0x7feb8c0ca390 2024-09-12T02:27:13.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.387+0000 7feb8b7fe640 1 --2- 172.21.15.60:0/2436830497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb8c0ca390 0x7feb8c152330 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7feb8000c4b0 tx=0x7feb8000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:13.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.387+0000 7feb88ff9640 1 -- 172.21.15.60:0/2436830497 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb80017070 con 0x7feb8c0ca390 2024-09-12T02:27:13.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.387+0000 7feb88ff9640 1 -- 172.21.15.60:0/2436830497 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb80005480 con 0x7feb8c0ca390 2024-09-12T02:27:13.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.387+0000 7feb88ff9640 1 -- 172.21.15.60:0/2436830497 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb80003810 con 0x7feb8c0ca390 2024-09-12T02:27:13.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.387+0000 7feb92853640 1 -- 172.21.15.60:0/2436830497 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb8c1ec870 con 0x7feb8c0ca390 2024-09-12T02:27:13.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.387+0000 7feb92853640 1 -- 172.21.15.60:0/2436830497 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb8c152870 con 0x7feb8c0ca390 2024-09-12T02:27:13.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.388+0000 7feb92853640 1 -- 172.21.15.60:0/2436830497 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb8c156270 con 0x7feb8c0ca390 2024-09-12T02:27:13.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.389+0000 7feb88ff9640 1 -- 172.21.15.60:0/2436830497 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feb8001a070 con 0x7feb8c0ca390 2024-09-12T02:27:13.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.389+0000 7feb88ff9640 1 --2- 172.21.15.60:0/2436830497 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7feb7806be30 0x7feb7806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:13.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.389+0000 7feb88ff9640 1 -- 172.21.15.60:0/2436830497 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7feb8008a420 con 0x7feb8c0ca390 2024-09-12T02:27:13.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.389+0000 7feb8bfff640 1 --2- 172.21.15.60:0/2436830497 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7feb7806be30 0x7feb7806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:13.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.390+0000 7feb8bfff640 1 --2- 172.21.15.60:0/2436830497 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7feb7806be30 0x7feb7806e2f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7feb7c005880 tx=0x7feb7c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:13.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.396+0000 7feb88ff9640 1 -- 172.21.15.60:0/2436830497 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7feb80058470 con 0x7feb8c0ca390 2024-09-12T02:27:13.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.672+0000 7feb92853640 1 -- 172.21.15.60:0/2436830497 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7feb8c06c430 con 0x7feb8c0ca390 2024-09-12T02:27:13.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.674+0000 7feb88ff9640 1 -- 172.21.15.60:0/2436830497 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7feb8005c770 con 0x7feb8c0ca390 2024-09-12T02:27:13.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.676+0000 7feb92853640 1 -- 172.21.15.60:0/2436830497 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7feb7806be30 msgr2=0x7feb7806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:13.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.676+0000 7feb92853640 1 --2- 172.21.15.60:0/2436830497 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7feb7806be30 0x7feb7806e2f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7feb7c005880 tx=0x7feb7c009040 comp rx=0 tx=0).stop 2024-09-12T02:27:13.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.676+0000 7feb92853640 1 -- 172.21.15.60:0/2436830497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb8c0ca390 msgr2=0x7feb8c152330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:13.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.676+0000 7feb92853640 1 --2- 172.21.15.60:0/2436830497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb8c0ca390 0x7feb8c152330 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7feb8000c4b0 tx=0x7feb8000c970 comp rx=0 tx=0).stop 2024-09-12T02:27:13.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.676+0000 7feb92853640 1 -- 172.21.15.60:0/2436830497 shutdown_connections 2024-09-12T02:27:13.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.676+0000 7feb92853640 1 --2- 172.21.15.60:0/2436830497 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7feb7806be30 0x7feb7806e2f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:13.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.676+0000 7feb92853640 1 --2- 172.21.15.60:0/2436830497 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb8c150480 0x7feb8c0aff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:13.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.676+0000 7feb92853640 1 --2- 172.21.15.60:0/2436830497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb8c0ca390 0x7feb8c152330 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:13.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.676+0000 7feb92853640 1 --2- 172.21.15.60:0/2436830497 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feb8c06c650 0x7feb8c14f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:13.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.676+0000 7feb92853640 1 -- 172.21.15.60:0/2436830497 >> 172.21.15.60:0/2436830497 conn(0x7feb8c068030 msgr2=0x7feb8c1540e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:13.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.676+0000 7feb92853640 1 -- 172.21.15.60:0/2436830497 shutdown_connections 2024-09-12T02:27:13.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:13.676+0000 7feb92853640 1 -- 172.21.15.60:0/2436830497 wait complete. 2024-09-12T02:27:13.690 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-12T02:27:23.691 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-12T02:27:23.691 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:27:23.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.807+0000 7ff920050640 1 Processor -- start 2024-09-12T02:27:23.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.807+0000 7ff920050640 1 -- start start 2024-09-12T02:27:23.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.808+0000 7ff920050640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff91806cd80 0x7ff918153be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:23.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.808+0000 7ff920050640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9180c7070 con 0x7ff91815a4a0 2024-09-12T02:27:23.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.808+0000 7ff920050640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff91806d210 con 0x7ff9180c8b10 2024-09-12T02:27:23.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.808+0000 7ff920050640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff9180c69b0 con 0x7ff91806cd80 2024-09-12T02:27:23.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.808+0000 7ff91e5ed640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff91815a4a0 0x7ff918156660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:35236/0 (socket says 172.21.15.60:35236) 2024-09-12T02:27:23.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.808+0000 7ff91e5ed640 1 -- 172.21.15.60:0/1572186917 learned_addr learned my addr 172.21.15.60:0/1572186917 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:27:23.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.808+0000 7ff91d5eb640 1 --2- 172.21.15.60:0/1572186917 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff91806cd80 0x7ff918153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:23.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.809+0000 7ff91cdea640 1 -- 172.21.15.60:0/1572186917 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2702451090 0 0) 0x7ff91806d210 con 0x7ff9180c8b10 2024-09-12T02:27:23.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.809+0000 7ff91cdea640 1 -- 172.21.15.60:0/1572186917 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff904003520 con 0x7ff9180c8b10 2024-09-12T02:27:23.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.809+0000 7ff91cdea640 1 -- 172.21.15.60:0/1572186917 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3914143349 0 0) 0x7ff9180c7070 con 0x7ff91815a4a0 2024-09-12T02:27:23.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.809+0000 7ff91cdea640 1 -- 172.21.15.60:0/1572186917 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff91806d210 con 0x7ff91815a4a0 2024-09-12T02:27:23.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.809+0000 7ff91d5eb640 1 -- 172.21.15.60:0/1572186917 >> v1:172.21.15.105:6789/0 conn(0x7ff9180c8b10 legacy=0x7ff9181534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:23.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.809+0000 7ff91d5eb640 1 -- 172.21.15.60:0/1572186917 >> v1:172.21.15.60:6789/0 conn(0x7ff91815a4a0 legacy=0x7ff918156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:23.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.809+0000 7ff91d5eb640 1 -- 172.21.15.60:0/1572186917 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9180c6c90 con 0x7ff91806cd80 2024-09-12T02:27:23.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.810+0000 7ff91d5eb640 1 --2- 172.21.15.60:0/1572186917 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff91806cd80 0x7ff918153be0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff9080097d0 tx=0x7ff90802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31bd373ab3f59cba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:23.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.810+0000 7ff91cdea640 1 -- 172.21.15.60:0/1572186917 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff908037070 con 0x7ff91806cd80 2024-09-12T02:27:23.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.810+0000 7ff91cdea640 1 -- 172.21.15.60:0/1572186917 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff908032440 con 0x7ff91806cd80 2024-09-12T02:27:23.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.810+0000 7ff91cdea640 1 -- 172.21.15.60:0/1572186917 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff908032810 con 0x7ff91806cd80 2024-09-12T02:27:23.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.810+0000 7ff920050640 1 -- 172.21.15.60:0/1572186917 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff91806cd80 msgr2=0x7ff918153be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:23.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.810+0000 7ff920050640 1 --2- 172.21.15.60:0/1572186917 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff91806cd80 0x7ff918153be0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff9080097d0 tx=0x7ff90802a180 comp rx=0 tx=0).stop 2024-09-12T02:27:23.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.811+0000 7ff920050640 1 -- 172.21.15.60:0/1572186917 shutdown_connections 2024-09-12T02:27:23.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.811+0000 7ff920050640 1 --2- 172.21.15.60:0/1572186917 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff91806cd80 0x7ff918153be0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:23.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.811+0000 7ff920050640 1 -- 172.21.15.60:0/1572186917 >> 172.21.15.60:0/1572186917 conn(0x7ff9180adb80 msgr2=0x7ff9180adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:23.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.811+0000 7ff920050640 1 -- 172.21.15.60:0/1572186917 shutdown_connections 2024-09-12T02:27:23.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.811+0000 7ff920050640 1 -- 172.21.15.60:0/1572186917 wait complete. 2024-09-12T02:27:23.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.812+0000 7ff920050640 1 Processor -- start 2024-09-12T02:27:23.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.812+0000 7ff920050640 1 -- start start 2024-09-12T02:27:23.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.813+0000 7ff920050640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9180c8b10 0x7ff91814cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:23.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.813+0000 7ff920050640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff91815a4a0 0x7ff9180b1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:23.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.813+0000 7ff920050640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff91814c2e0 0x7ff9181ebd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:23.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.813+0000 7ff920050640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff9180c9070 con 0x7ff91814c2e0 2024-09-12T02:27:23.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.813+0000 7ff920050640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff9180c8ef0 con 0x7ff91815a4a0 2024-09-12T02:27:23.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.813+0000 7ff920050640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff918156d70 con 0x7ff9180c8b10 2024-09-12T02:27:23.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.813+0000 7ff91ddec640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9180c8b10 0x7ff91814cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:23.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.813+0000 7ff91d5eb640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff91815a4a0 0x7ff9180b1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:23.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.813+0000 7ff91ddec640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9180c8b10 0x7ff91814cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:52204/0 (socket says 172.21.15.60:52204) 2024-09-12T02:27:23.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.813+0000 7ff91ddec640 1 -- 172.21.15.60:0/296294794 learned_addr learned my addr 172.21.15.60:0/296294794 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:27:23.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.813+0000 7ff91e5ed640 1 --2- 172.21.15.60:0/296294794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff91814c2e0 0x7ff9181ebd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:23.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.813+0000 7ff91ddec640 1 -- 172.21.15.60:0/296294794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff91815a4a0 msgr2=0x7ff9180b1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:23.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.813+0000 7ff91ddec640 1 --2- 172.21.15.60:0/296294794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff91815a4a0 0x7ff9180b1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:23.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.813+0000 7ff91ddec640 1 -- 172.21.15.60:0/296294794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff91814c2e0 msgr2=0x7ff9181ebd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:23.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.813+0000 7ff91ddec640 1 --2- 172.21.15.60:0/296294794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff91814c2e0 0x7ff9181ebd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:23.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.813+0000 7ff91ddec640 1 -- 172.21.15.60:0/296294794 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9181f0210 con 0x7ff9180c8b10 2024-09-12T02:27:23.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.813+0000 7ff91d5eb640 1 --2- 172.21.15.60:0/296294794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff91815a4a0 0x7ff9180b1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:27:23.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.814+0000 7ff91ddec640 1 --2- 172.21.15.60:0/296294794 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9180c8b10 0x7ff91814cd60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff91400c4d0 tx=0x7ff91400c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:23.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.814+0000 7ff90e7fc640 1 -- 172.21.15.60:0/296294794 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9140052d0 con 0x7ff9180c8b10 2024-09-12T02:27:23.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.814+0000 7ff90e7fc640 1 -- 172.21.15.60:0/296294794 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff914005490 con 0x7ff9180c8b10 2024-09-12T02:27:23.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.814+0000 7ff90e7fc640 1 -- 172.21.15.60:0/296294794 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff914012870 con 0x7ff9180c8b10 2024-09-12T02:27:23.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.814+0000 7ff920050640 1 -- 172.21.15.60:0/296294794 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9180b2070 con 0x7ff9180c8b10 2024-09-12T02:27:23.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.814+0000 7ff920050640 1 -- 172.21.15.60:0/296294794 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9180b1d90 con 0x7ff9180c8b10 2024-09-12T02:27:23.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.815+0000 7ff920050640 1 -- 172.21.15.60:0/296294794 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff918157160 con 0x7ff9180c8b10 2024-09-12T02:27:23.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.816+0000 7ff90e7fc640 1 -- 172.21.15.60:0/296294794 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff914012a10 con 0x7ff9180c8b10 2024-09-12T02:27:23.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.816+0000 7ff90e7fc640 1 --2- 172.21.15.60:0/296294794 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff8fc06be30 0x7ff8fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:23.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.816+0000 7ff90e7fc640 1 -- 172.21.15.60:0/296294794 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7ff91408ace0 con 0x7ff9180c8b10 2024-09-12T02:27:23.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.816+0000 7ff91d5eb640 1 --2- 172.21.15.60:0/296294794 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff8fc06be30 0x7ff8fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:23.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.817+0000 7ff91d5eb640 1 --2- 172.21.15.60:0/296294794 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff8fc06be30 0x7ff8fc06e2f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff908034000 tx=0x7ff90802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:23.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:23.823+0000 7ff90e7fc640 1 -- 172.21.15.60:0/296294794 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff914058d30 con 0x7ff9180c8b10 2024-09-12T02:27:24.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.151+0000 7ff920050640 1 -- 172.21.15.60:0/296294794 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ff9180c9d90 con 0x7ff9180c8b10 2024-09-12T02:27:24.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.151+0000 7ff90e7fc640 1 -- 172.21.15.60:0/296294794 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7ff91405d030 con 0x7ff9180c8b10 2024-09-12T02:27:24.152 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":36,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:27:24.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.154+0000 7ff920050640 1 -- 172.21.15.60:0/296294794 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff8fc06be30 msgr2=0x7ff8fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:24.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.154+0000 7ff920050640 1 --2- 172.21.15.60:0/296294794 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff8fc06be30 0x7ff8fc06e2f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff908034000 tx=0x7ff90802e000 comp rx=0 tx=0).stop 2024-09-12T02:27:24.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.154+0000 7ff920050640 1 -- 172.21.15.60:0/296294794 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9180c8b10 msgr2=0x7ff91814cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:24.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.154+0000 7ff920050640 1 --2- 172.21.15.60:0/296294794 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9180c8b10 0x7ff91814cd60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff91400c4d0 tx=0x7ff91400c990 comp rx=0 tx=0).stop 2024-09-12T02:27:24.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.154+0000 7ff920050640 1 -- 172.21.15.60:0/296294794 shutdown_connections 2024-09-12T02:27:24.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.154+0000 7ff920050640 1 --2- 172.21.15.60:0/296294794 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff8fc06be30 0x7ff8fc06e2f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:24.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.154+0000 7ff920050640 1 --2- 172.21.15.60:0/296294794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff91814c2e0 0x7ff9181ebd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:24.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.154+0000 7ff920050640 1 --2- 172.21.15.60:0/296294794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff91815a4a0 0x7ff9180b1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:24.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.154+0000 7ff920050640 1 --2- 172.21.15.60:0/296294794 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9180c8b10 0x7ff91814cd60 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:24.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.154+0000 7ff920050640 1 -- 172.21.15.60:0/296294794 >> 172.21.15.60:0/296294794 conn(0x7ff9180adb80 msgr2=0x7ff918151ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:24.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.155+0000 7ff920050640 1 -- 172.21.15.60:0/296294794 shutdown_connections 2024-09-12T02:27:24.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.155+0000 7ff920050640 1 -- 172.21.15.60:0/296294794 wait complete. 2024-09-12T02:27:24.167 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-12T02:27:24.167 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-12T02:27:24.167 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-12T02:27:24.167 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-12T02:27:24.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.278+0000 7fd9e399f640 1 Processor -- start 2024-09-12T02:27:24.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.278+0000 7fd9e399f640 1 -- start start 2024-09-12T02:27:24.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.279+0000 7fd9e399f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd9dc0c3cb0 0x7fd9dc0c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:24.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.279+0000 7fd9e399f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9dc159e00 0x7fd9dc15a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:24.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.279+0000 7fd9e399f640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9dc0c34f0 con 0x7fd9dc074230 2024-09-12T02:27:24.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.279+0000 7fd9e399f640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fd9dc0bed90 con 0x7fd9dc0c3cb0 2024-09-12T02:27:24.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.279+0000 7fd9e399f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd9dc0c3820 con 0x7fd9dc159e00 2024-09-12T02:27:24.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.279+0000 7fd9e0f3a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd9dc0c3cb0 0x7fd9dc0c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:24.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.279+0000 7fd9e0f3a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd9dc0c3cb0 0x7fd9dc0c4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40220/0 (socket says 172.21.15.60:40220) 2024-09-12T02:27:24.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.280+0000 7fd9e0f3a640 1 -- 172.21.15.60:0/2269061467 learned_addr learned my addr 172.21.15.60:0/2269061467 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:27:24.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.280+0000 7fd9e1f3c640 1 --2- 172.21.15.60:0/2269061467 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9dc159e00 0x7fd9dc15a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:24.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.280+0000 7fd9e0f3a640 1 -- 172.21.15.60:0/2269061467 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9dc159e00 msgr2=0x7fd9dc15a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:27:24.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.280+0000 7fd9e0f3a640 1 --2- 172.21.15.60:0/2269061467 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9dc159e00 0x7fd9dc15a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:24.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.280+0000 7fd9e0f3a640 1 -- 172.21.15.60:0/2269061467 >> v1:172.21.15.105:6789/0 conn(0x7fd9dc074230 legacy=0x7fd9dc0c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:24.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.280+0000 7fd9e0f3a640 1 -- 172.21.15.60:0/2269061467 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9dc0befe0 con 0x7fd9dc0c3cb0 2024-09-12T02:27:24.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.281+0000 7fd9e0f3a640 1 --2- 172.21.15.60:0/2269061467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9dc0c3cb0 0x7fd9dc0c4120 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc009870 tx=0x7fd9cc02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=234090ac3ab4072 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:24.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.281+0000 7fd9d3fff640 1 -- 172.21.15.60:0/2269061467 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc037070 con 0x7fd9dc0c3cb0 2024-09-12T02:27:24.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.281+0000 7fd9d3fff640 1 -- 172.21.15.60:0/2269061467 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9cc032440 con 0x7fd9dc0c3cb0 2024-09-12T02:27:24.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.281+0000 7fd9d3fff640 1 -- 172.21.15.60:0/2269061467 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc032810 con 0x7fd9dc0c3cb0 2024-09-12T02:27:24.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.282+0000 7fd9e399f640 1 -- 172.21.15.60:0/2269061467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9dc0c3cb0 msgr2=0x7fd9dc0c4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:24.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.282+0000 7fd9e399f640 1 --2- 172.21.15.60:0/2269061467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9dc0c3cb0 0x7fd9dc0c4120 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc009870 tx=0x7fd9cc02a1c0 comp rx=0 tx=0).stop 2024-09-12T02:27:24.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.282+0000 7fd9e399f640 1 -- 172.21.15.60:0/2269061467 shutdown_connections 2024-09-12T02:27:24.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.282+0000 7fd9e399f640 1 --2- 172.21.15.60:0/2269061467 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9dc159e00 0x7fd9dc15a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:24.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.282+0000 7fd9e399f640 1 --2- 172.21.15.60:0/2269061467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9dc0c3cb0 0x7fd9dc0c4120 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:24.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.282+0000 7fd9e399f640 1 -- 172.21.15.60:0/2269061467 >> 172.21.15.60:0/2269061467 conn(0x7fd9dc0c8a50 msgr2=0x7fd9dc0c8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:24.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.282+0000 7fd9e399f640 1 -- 172.21.15.60:0/2269061467 shutdown_connections 2024-09-12T02:27:24.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.282+0000 7fd9e399f640 1 -- 172.21.15.60:0/2269061467 wait complete. 2024-09-12T02:27:24.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.283+0000 7fd9e399f640 1 Processor -- start 2024-09-12T02:27:24.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.283+0000 7fd9e399f640 1 -- start start 2024-09-12T02:27:24.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.284+0000 7fd9e399f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9dc074230 0x7fd9dc1e2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:24.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.284+0000 7fd9e399f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9dc0c3cb0 0x7fd9dc1dfda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:24.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.284+0000 7fd9e399f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9dc159e00 0x7fd9dc152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:24.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.284+0000 7fd9e399f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd9dc0c4660 con 0x7fd9dc159e00 2024-09-12T02:27:24.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.284+0000 7fd9e399f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd9dc0bf5a0 con 0x7fd9dc074230 2024-09-12T02:27:24.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.284+0000 7fd9e399f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd9dc0c47e0 con 0x7fd9dc0c3cb0 2024-09-12T02:27:24.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.284+0000 7fd9e1f3c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9dc159e00 0x7fd9dc152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:24.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.284+0000 7fd9e173b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9dc074230 0x7fd9dc1e2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:24.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.284+0000 7fd9e0f3a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9dc0c3cb0 0x7fd9dc1dfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:24.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.284+0000 7fd9e1f3c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9dc159e00 0x7fd9dc152eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40222/0 (socket says 172.21.15.60:40222) 2024-09-12T02:27:24.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.284+0000 7fd9e1f3c640 1 -- 172.21.15.60:0/1114092878 learned_addr learned my addr 172.21.15.60:0/1114092878 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:27:24.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.285+0000 7fd9e1f3c640 1 -- 172.21.15.60:0/1114092878 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9dc0c3cb0 msgr2=0x7fd9dc1dfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:24.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.285+0000 7fd9e1f3c640 1 --2- 172.21.15.60:0/1114092878 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9dc0c3cb0 0x7fd9dc1dfda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:24.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.285+0000 7fd9e1f3c640 1 -- 172.21.15.60:0/1114092878 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9dc074230 msgr2=0x7fd9dc1e2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:24.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.285+0000 7fd9e1f3c640 1 --2- 172.21.15.60:0/1114092878 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9dc074230 0x7fd9dc1e2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:24.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.285+0000 7fd9e1f3c640 1 -- 172.21.15.60:0/1114092878 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9dc1e3350 con 0x7fd9dc159e00 2024-09-12T02:27:24.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.285+0000 7fd9e1f3c640 1 --2- 172.21.15.60:0/1114092878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9dc159e00 0x7fd9dc152eb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4009d30 tx=0x7fd9d400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:24.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.285+0000 7fd9d1ffb640 1 -- 172.21.15.60:0/1114092878 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d4018020 con 0x7fd9dc159e00 2024-09-12T02:27:24.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.285+0000 7fd9d1ffb640 1 -- 172.21.15.60:0/1114092878 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9d4014480 con 0x7fd9dc159e00 2024-09-12T02:27:24.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.285+0000 7fd9e399f640 1 -- 172.21.15.60:0/1114092878 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9dc0c2b70 con 0x7fd9dc159e00 2024-09-12T02:27:24.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.285+0000 7fd9d1ffb640 1 -- 172.21.15.60:0/1114092878 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d4014870 con 0x7fd9dc159e00 2024-09-12T02:27:24.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.285+0000 7fd9e399f640 1 -- 172.21.15.60:0/1114092878 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9dc1e08e0 con 0x7fd9dc159e00 2024-09-12T02:27:24.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.286+0000 7fd9e399f640 1 --2- 172.21.15.60:0/1114092878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9dc1e02e0 0x7fd9dc06f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:24.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.286+0000 7fd9e399f640 1 -- 172.21.15.60:0/1114092878 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd9dc069a00 con 0x7fd9dc1e02e0 2024-09-12T02:27:24.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.286+0000 7fd9e173b640 1 --2- 172.21.15.60:0/1114092878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9dc1e02e0 0x7fd9dc06f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:24.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.287+0000 7fd9e173b640 1 -- 172.21.15.60:0/1114092878 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd9dc074610 con 0x7fd9dc1e02e0 2024-09-12T02:27:24.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.287+0000 7fd9e173b640 1 --2- 172.21.15.60:0/1114092878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9dc1e02e0 0x7fd9dc06f1e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8000f60 tx=0x7fd9d800f9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:24.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.287+0000 7fd9d1ffb640 1 -- 172.21.15.60:0/1114092878 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d80052e0 con 0x7fd9dc1e02e0 2024-09-12T02:27:24.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.287+0000 7fd9d1ffb640 1 -- 172.21.15.60:0/1114092878 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd9d4005d10 con 0x7fd9dc159e00 2024-09-12T02:27:24.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.288+0000 7fd9d1ffb640 1 --2- 172.21.15.60:0/1114092878 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd9c006bd30 0x7fd9c006e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:24.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.288+0000 7fd9d1ffb640 1 -- 172.21.15.60:0/1114092878 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fd9d408ba10 con 0x7fd9dc159e00 2024-09-12T02:27:24.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.288+0000 7fd9e0f3a640 1 --2- 172.21.15.60:0/1114092878 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd9c006bd30 0x7fd9c006e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:24.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.288+0000 7fd9d1ffb640 1 -- 172.21.15.60:0/1114092878 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fd9d8007020 con 0x7fd9dc1e02e0 2024-09-12T02:27:24.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.288+0000 7fd9d1ffb640 1 -- 172.21.15.60:0/1114092878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9dc1e02e0 msgr2=0x7fd9dc06f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:24.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.288+0000 7fd9d1ffb640 1 --2- 172.21.15.60:0/1114092878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9dc1e02e0 0x7fd9dc06f1e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8000f60 tx=0x7fd9d800f9d0 comp rx=0 tx=0).stop 2024-09-12T02:27:24.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.288+0000 7fd9d1ffb640 1 -- 172.21.15.60:0/1114092878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9dc1e02e0 msgr2=0x7fd9dc06f1e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:27:24.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.288+0000 7fd9d1ffb640 1 --2- 172.21.15.60:0/1114092878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9dc1e02e0 0x7fd9dc06f1e0 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8000f60 tx=0x7fd9d800f9d0 comp rx=0 tx=0).stop 2024-09-12T02:27:24.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.288+0000 7fd9e0f3a640 1 --2- 172.21.15.60:0/1114092878 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd9c006bd30 0x7fd9c006e1f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc034000 tx=0x7fd9cc02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:24.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.295+0000 7fd9e399f640 1 --2- 172.21.15.60:0/1114092878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9dc1533f0 0x7fd9dc06f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:24.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.295+0000 7fd9e399f640 1 -- 172.21.15.60:0/1114092878 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd9dc0c6e30 con 0x7fd9dc1533f0 2024-09-12T02:27:24.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.295+0000 7fd9e173b640 1 --2- 172.21.15.60:0/1114092878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9dc1533f0 0x7fd9dc06f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:24.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.296+0000 7fd9e173b640 1 -- 172.21.15.60:0/1114092878 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd9dc0c42e0 con 0x7fd9dc1533f0 2024-09-12T02:27:24.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.296+0000 7fd9e173b640 1 --2- 172.21.15.60:0/1114092878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9dc1533f0 0x7fd9dc06f720 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8000f60 tx=0x7fd9d8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:24.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.296+0000 7fd9d1ffb640 1 -- 172.21.15.60:0/1114092878 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d8006e20 con 0x7fd9dc1533f0 2024-09-12T02:27:24.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.296+0000 7fd9d1ffb640 1 -- 172.21.15.60:0/1114092878 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4885 (secure 0 0 0) 0x7fd9d8006e20 con 0x7fd9dc1533f0 2024-09-12T02:27:24.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.296+0000 7fd9d1ffb640 1 -- 172.21.15.60:0/1114092878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9dc1533f0 msgr2=0x7fd9dc06f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:24.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.296+0000 7fd9d1ffb640 1 --2- 172.21.15.60:0/1114092878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9dc1533f0 0x7fd9dc06f720 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8000f60 tx=0x7fd9d8000ed0 comp rx=0 tx=0).stop 2024-09-12T02:27:24.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.296+0000 7fd9d1ffb640 1 -- 172.21.15.60:0/1114092878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9dc1533f0 msgr2=0x7fd9dc06f720 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:27:24.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.296+0000 7fd9d1ffb640 1 --2- 172.21.15.60:0/1114092878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9dc1533f0 0x7fd9dc06f720 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:24.298 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:27:24.298 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:27:24.298 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:27:24.298 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:27:24.298 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 36, 2024-09-12T02:27:24.298 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 84405, 2024-09-12T02:27:24.298 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:27:24.298 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:27:24.298 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:27:24.298 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:27:24.298 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:27:24.298 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 16, 2024-09-12T02:27:24.299 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:27:24.299 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:27:24.299 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:27:24.299 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:27:24.299 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:27:24.299 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:27:24.299 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:27:24.299 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:27:24.299 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:27:24.299 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:27:24.299 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:27:24.299 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:27:24.299 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:27:24.299 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:27:24.299 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:27:24.300 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:27:24.300 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:27:24.300 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:27:24.300 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:27:24.300 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:27:24.300 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:27:24.300 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:27:24.300 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:27:24.300 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:27:24.301 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:27:24.301 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:27:24.301 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:27:24.301 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:27:24.301 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:24.301 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:24.301 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:27:24.301 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:27:24.301 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:27:24.301 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:27:24.301 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:27:24.302 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:27:24.302 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:27:24.302 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:27:24.302 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:27:24.302 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:27:24.302 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:27:24.302 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:27:24.302 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:27:24.302 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:27:24.302 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:27:24.302 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:27:24.302 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:27:24.303 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:27:24.303 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:27:24.303 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:27:24.303 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:27:24.303 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:27:24.303 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:27:24.303 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:27:24.303 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:27:24.303 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:27:24.303 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:27:24.303 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:27:24.303 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:27:24.303 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:27:24.304 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:24.304 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:27:24.304 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:24.304 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:27:24.304 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:27:24.304 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:27:24.304 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:27:24.304 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:24.304 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:27:24.304 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:27:24.304 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:24.304 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:24.305 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:24.305 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:27:24.305 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:27:24.305 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:24.305 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:24.305 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:24.305 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:24.305 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:27:24.305 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:27:24.305 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:27:24.305 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:27:24.305 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:27:24.306 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:24.306 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:24.306 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:27:24.306 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:27:24.306 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:27:24.306 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:27:24.306 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:24.306 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:27:24.306 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:27:24.306 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:24.306 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:24.306 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:24.306 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:27:24.306 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:27:24.307 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:24.307 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:24.307 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:24.307 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:24.307 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:27:24.307 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:27:24.307 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:27:24.307 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:27:24.307 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:27:24.307 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:24.307 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:24.307 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:27:24.308 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:27:24.308 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:27:24.308 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:27:24.308 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:24.308 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:27:24.308 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:27:24.308 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:24.308 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:24.308 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:24.308 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:27:24.308 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:27:24.308 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:24.308 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:24.308 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:24.309 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:24.309 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:27:24.309 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:27:24.309 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:27:24.309 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:27:24.309 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:27:24.309 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:24.309 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:24.309 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:24.309 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:27:24.309 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:27:24.309 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:24.309 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:27:24.310 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:27:24.310 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:27:24.310 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:24.310 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:27:24.310 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:27:24.310 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:24.310 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:27:24.310 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:27:24.310 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:27:24.310 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:24.310 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:27:24.311 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:27:24.311 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:24.311 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:27:24.311 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:27:24.311 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:27:24.311 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:24.311 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:27:24.311 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:27:24.311 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:24.311 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:27:24.311 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:27:24.311 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:27:24.311 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:24.311 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:24.311 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:24.312 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:27:24.312 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:27:24.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.297+0000 7fd9e399f640 1 -- 172.21.15.60:0/1114092878 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd9c006bd30 msgr2=0x7fd9c006e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:24.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.297+0000 7fd9e399f640 1 --2- 172.21.15.60:0/1114092878 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd9c006bd30 0x7fd9c006e1f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc034000 tx=0x7fd9cc02e000 comp rx=0 tx=0).stop 2024-09-12T02:27:24.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.297+0000 7fd9e399f640 1 -- 172.21.15.60:0/1114092878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9dc159e00 msgr2=0x7fd9dc152eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:24.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.297+0000 7fd9e399f640 1 --2- 172.21.15.60:0/1114092878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9dc159e00 0x7fd9dc152eb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4009d30 tx=0x7fd9d400c490 comp rx=0 tx=0).stop 2024-09-12T02:27:24.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.297+0000 7fd9e1f3c640 1 -- 172.21.15.60:0/1114092878 reap_dead start 2024-09-12T02:27:24.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.297+0000 7fd9e1f3c640 1 -- 172.21.15.60:0/1114092878 reap_dead start 2024-09-12T02:27:24.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.297+0000 7fd9e399f640 1 -- 172.21.15.60:0/1114092878 shutdown_connections 2024-09-12T02:27:24.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.297+0000 7fd9e399f640 1 -- 172.21.15.60:0/1114092878 >> 172.21.15.60:0/1114092878 conn(0x7fd9dc0c8a50 msgr2=0x7fd9dc06c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:24.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.297+0000 7fd9e399f640 1 -- 172.21.15.60:0/1114092878 shutdown_connections 2024-09-12T02:27:24.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.297+0000 7fd9e399f640 1 -- 172.21.15.60:0/1114092878 wait complete. 2024-09-12T02:27:24.314 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:27:24.314 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-12T02:27:24.314 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-12T02:27:24.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.430+0000 7fbd6834b640 1 Processor -- start 2024-09-12T02:27:24.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.430+0000 7fbd6834b640 1 -- start start 2024-09-12T02:27:24.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.431+0000 7fbd6834b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbd60150480 0x7fbd600c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:24.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.431+0000 7fbd6834b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd6006c650 0x7fbd600c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:24.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.431+0000 7fbd6834b640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbd600c9c80 0x7fbd600ca130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:24.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.431+0000 7fbd6834b640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fbd6006c240 con 0x7fbd60150480 2024-09-12T02:27:24.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.431+0000 7fbd6834b640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fbd6015a330 con 0x7fbd600c9c80 2024-09-12T02:27:24.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.431+0000 7fbd6834b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbd6015a7c0 con 0x7fbd6006c650 2024-09-12T02:27:24.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.431+0000 7fbd660e7640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbd60150480 0x7fbd600c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:24.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.431+0000 7fbd660e7640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbd60150480 0x7fbd600c7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40256/0 (socket says 172.21.15.60:40256) 2024-09-12T02:27:24.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.431+0000 7fbd660e7640 1 -- 172.21.15.60:0/2421441442 learned_addr learned my addr 172.21.15.60:0/2421441442 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:27:24.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.431+0000 7fbd668e8640 1 --2- 172.21.15.60:0/2421441442 >> v2:172.21.15.105:3300/0 conn(0x7fbd600c9c80 0x7fbd600ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:24.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.432+0000 7fbd658e6640 1 --2- 172.21.15.60:0/2421441442 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd6006c650 0x7fbd600c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:24.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.432+0000 7fbd660e7640 1 -- 172.21.15.60:0/2421441442 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd6006c650 msgr2=0x7fbd600c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:27:24.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.432+0000 7fbd660e7640 1 --2- 172.21.15.60:0/2421441442 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd6006c650 0x7fbd600c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:24.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.432+0000 7fbd660e7640 1 -- 172.21.15.60:0/2421441442 >> v2:172.21.15.105:3300/0 conn(0x7fbd600c9c80 msgr2=0x7fbd600ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:27:24.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.432+0000 7fbd660e7640 1 --2- 172.21.15.60:0/2421441442 >> v2:172.21.15.105:3300/0 conn(0x7fbd600c9c80 0x7fbd600ca130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:24.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.432+0000 7fbd660e7640 1 -- 172.21.15.60:0/2421441442 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd60159a00 con 0x7fbd60150480 2024-09-12T02:27:24.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.433+0000 7fbd660e7640 1 --2- 172.21.15.60:0/2421441442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd60150480 0x7fbd600c7a90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbd600c62d0 tx=0x7fbd5c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67ecbf503056eff8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:24.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.433+0000 7fbd650e5640 1 -- 172.21.15.60:0/2421441442 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c037070 con 0x7fbd60150480 2024-09-12T02:27:24.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.433+0000 7fbd650e5640 1 -- 172.21.15.60:0/2421441442 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd5c032440 con 0x7fbd60150480 2024-09-12T02:27:24.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.433+0000 7fbd650e5640 1 -- 172.21.15.60:0/2421441442 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c032810 con 0x7fbd60150480 2024-09-12T02:27:24.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.433+0000 7fbd6834b640 1 -- 172.21.15.60:0/2421441442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd60150480 msgr2=0x7fbd600c7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:24.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.433+0000 7fbd6834b640 1 --2- 172.21.15.60:0/2421441442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd60150480 0x7fbd600c7a90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbd600c62d0 tx=0x7fbd5c02a1e0 comp rx=0 tx=0).stop 2024-09-12T02:27:24.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.434+0000 7fbd6834b640 1 -- 172.21.15.60:0/2421441442 shutdown_connections 2024-09-12T02:27:24.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.434+0000 7fbd6834b640 1 --2- 172.21.15.60:0/2421441442 >> v2:172.21.15.105:3300/0 conn(0x7fbd600c9c80 0x7fbd600ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:24.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.434+0000 7fbd6834b640 1 --2- 172.21.15.60:0/2421441442 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd6006c650 0x7fbd600c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:24.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.434+0000 7fbd6834b640 1 --2- 172.21.15.60:0/2421441442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd60150480 0x7fbd600c7a90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:24.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.434+0000 7fbd6834b640 1 -- 172.21.15.60:0/2421441442 >> 172.21.15.60:0/2421441442 conn(0x7fbd60068030 msgr2=0x7fbd60073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:24.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.434+0000 7fbd6834b640 1 -- 172.21.15.60:0/2421441442 shutdown_connections 2024-09-12T02:27:24.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.434+0000 7fbd6834b640 1 -- 172.21.15.60:0/2421441442 wait complete. 2024-09-12T02:27:24.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.435+0000 7fbd6834b640 1 Processor -- start 2024-09-12T02:27:24.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.435+0000 7fbd6834b640 1 -- start start 2024-09-12T02:27:24.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.436+0000 7fbd6834b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd6006c650 0x7fbd600b0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:24.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.436+0000 7fbd6834b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd600c9c80 0x7fbd601e0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:24.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.436+0000 7fbd6834b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd60150480 0x7fbd60149820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:24.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.436+0000 7fbd6834b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbd600ca670 con 0x7fbd60150480 2024-09-12T02:27:24.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.436+0000 7fbd6834b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbd60159fc0 con 0x7fbd6006c650 2024-09-12T02:27:24.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.436+0000 7fbd6834b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbd6006d270 con 0x7fbd600c9c80 2024-09-12T02:27:24.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.436+0000 7fbd668e8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd60150480 0x7fbd60149820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:24.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.436+0000 7fbd660e7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd6006c650 0x7fbd600b0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:24.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.436+0000 7fbd658e6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd600c9c80 0x7fbd601e0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:24.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.436+0000 7fbd668e8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd60150480 0x7fbd60149820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40260/0 (socket says 172.21.15.60:40260) 2024-09-12T02:27:24.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.436+0000 7fbd660e7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd6006c650 0x7fbd600b0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:45862/0 (socket says 172.21.15.60:45862) 2024-09-12T02:27:24.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.436+0000 7fbd668e8640 1 -- 172.21.15.60:0/3489094066 learned_addr learned my addr 172.21.15.60:0/3489094066 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:27:24.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.436+0000 7fbd668e8640 1 -- 172.21.15.60:0/3489094066 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd600c9c80 msgr2=0x7fbd601e0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:24.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.436+0000 7fbd668e8640 1 --2- 172.21.15.60:0/3489094066 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd600c9c80 0x7fbd601e0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:24.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.436+0000 7fbd668e8640 1 -- 172.21.15.60:0/3489094066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd6006c650 msgr2=0x7fbd600b0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:24.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.436+0000 7fbd668e8640 1 --2- 172.21.15.60:0/3489094066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd6006c650 0x7fbd600b0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:24.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.436+0000 7fbd668e8640 1 -- 172.21.15.60:0/3489094066 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd601ec790 con 0x7fbd60150480 2024-09-12T02:27:24.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.436+0000 7fbd660e7640 1 --2- 172.21.15.60:0/3489094066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd6006c650 0x7fbd600b0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:27:24.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.436+0000 7fbd658e6640 1 --2- 172.21.15.60:0/3489094066 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd600c9c80 0x7fbd601e0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:27:24.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.437+0000 7fbd668e8640 1 --2- 172.21.15.60:0/3489094066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd60150480 0x7fbd60149820 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbd5800efc0 tx=0x7fbd5800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:24.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.437+0000 7fbd56ffd640 1 -- 172.21.15.60:0/3489094066 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd58018020 con 0x7fbd60150480 2024-09-12T02:27:24.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.437+0000 7fbd56ffd640 1 -- 172.21.15.60:0/3489094066 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd58014480 con 0x7fbd60150480 2024-09-12T02:27:24.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.437+0000 7fbd6834b640 1 -- 172.21.15.60:0/3489094066 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd600b10c0 con 0x7fbd60150480 2024-09-12T02:27:24.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.437+0000 7fbd56ffd640 1 -- 172.21.15.60:0/3489094066 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd58014870 con 0x7fbd60150480 2024-09-12T02:27:24.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.437+0000 7fbd6834b640 1 -- 172.21.15.60:0/3489094066 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd6014f960 con 0x7fbd60150480 2024-09-12T02:27:24.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.438+0000 7fbd6834b640 1 --2- 172.21.15.60:0/3489094066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd601576f0 0x7fbd60149d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:24.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.438+0000 7fbd6834b640 1 -- 172.21.15.60:0/3489094066 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbd60156270 con 0x7fbd601576f0 2024-09-12T02:27:24.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.438+0000 7fbd660e7640 1 --2- 172.21.15.60:0/3489094066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd601576f0 0x7fbd60149d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:24.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.438+0000 7fbd660e7640 1 -- 172.21.15.60:0/3489094066 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbd6006c430 con 0x7fbd601576f0 2024-09-12T02:27:24.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.438+0000 7fbd56ffd640 1 -- 172.21.15.60:0/3489094066 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbd58005d10 con 0x7fbd60150480 2024-09-12T02:27:24.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.439+0000 7fbd660e7640 1 --2- 172.21.15.60:0/3489094066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd601576f0 0x7fbd60149d60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbd600ccac0 tx=0x7fbd5c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:24.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.439+0000 7fbd56ffd640 1 --2- 172.21.15.60:0/3489094066 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbd4406be60 0x7fbd4406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:24.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.439+0000 7fbd56ffd640 1 -- 172.21.15.60:0/3489094066 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fbd5808ba40 con 0x7fbd60150480 2024-09-12T02:27:24.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.439+0000 7fbd658e6640 1 --2- 172.21.15.60:0/3489094066 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbd4406be60 0x7fbd4406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:24.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.439+0000 7fbd56ffd640 1 -- 172.21.15.60:0/3489094066 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c037040 con 0x7fbd601576f0 2024-09-12T02:27:24.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.439+0000 7fbd56ffd640 1 -- 172.21.15.60:0/3489094066 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fbd5c032440 con 0x7fbd601576f0 2024-09-12T02:27:24.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.439+0000 7fbd56ffd640 1 -- 172.21.15.60:0/3489094066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd601576f0 msgr2=0x7fbd60149d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:24.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.439+0000 7fbd56ffd640 1 --2- 172.21.15.60:0/3489094066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd601576f0 0x7fbd60149d60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbd600ccac0 tx=0x7fbd5c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:27:24.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.439+0000 7fbd56ffd640 1 -- 172.21.15.60:0/3489094066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd601576f0 msgr2=0x7fbd60149d60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:27:24.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.439+0000 7fbd56ffd640 1 --2- 172.21.15.60:0/3489094066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd601576f0 0x7fbd60149d60 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:24.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.440+0000 7fbd658e6640 1 --2- 172.21.15.60:0/3489094066 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbd4406be60 0x7fbd4406e320 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbd60154e80 tx=0x7fbd50009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:24.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.449+0000 7fbd6834b640 1 --2- 172.21.15.60:0/3489094066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd60159040 0x7fbd60157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:24.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.449+0000 7fbd6834b640 1 -- 172.21.15.60:0/3489094066 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbd601545c0 con 0x7fbd60159040 2024-09-12T02:27:24.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.449+0000 7fbd660e7640 1 --2- 172.21.15.60:0/3489094066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd60159040 0x7fbd60157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:24.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.449+0000 7fbd660e7640 1 -- 172.21.15.60:0/3489094066 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbd601e10d0 con 0x7fbd60159040 2024-09-12T02:27:24.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.450+0000 7fbd660e7640 1 --2- 172.21.15.60:0/3489094066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd60159040 0x7fbd60157cb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c000c00 tx=0x7fbd5c008030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:24.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.450+0000 7fbd56ffd640 1 -- 172.21.15.60:0/3489094066 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c037030 con 0x7fbd60159040 2024-09-12T02:27:24.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.450+0000 7fbd56ffd640 1 -- 172.21.15.60:0/3489094066 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5051 (secure 0 0 0) 0x7fbd5c04c070 con 0x7fbd60159040 2024-09-12T02:27:24.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.450+0000 7fbd56ffd640 1 -- 172.21.15.60:0/3489094066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd60159040 msgr2=0x7fbd60157cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:24.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.450+0000 7fbd56ffd640 1 --2- 172.21.15.60:0/3489094066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd60159040 0x7fbd60157cb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c000c00 tx=0x7fbd5c008030 comp rx=0 tx=0).stop 2024-09-12T02:27:24.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.450+0000 7fbd56ffd640 1 -- 172.21.15.60:0/3489094066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd60159040 msgr2=0x7fbd60157cb0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:27:24.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.450+0000 7fbd56ffd640 1 --2- 172.21.15.60:0/3489094066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd60159040 0x7fbd60157cb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:24.452 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:27:24.452 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:27:24.452 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:27:24.453 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:27:24.453 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 36, 2024-09-12T02:27:24.453 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 189886, 2024-09-12T02:27:24.453 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:27:24.453 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:27:24.453 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:27:24.453 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:27:24.453 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:27:24.453 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 16, 2024-09-12T02:27:24.453 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:27:24.453 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:27:24.453 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:27:24.454 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:27:24.454 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:27:24.454 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:27:24.454 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:27:24.454 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:27:24.454 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:27:24.454 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:27:24.454 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:27:24.454 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:27:24.454 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:27:24.454 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:27:24.454 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:27:24.454 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:27:24.454 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:27:24.454 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:27:24.455 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:27:24.455 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:27:24.455 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:27:24.455 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:27:24.455 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:27:24.455 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:27:24.455 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:27:24.455 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:27:24.455 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:27:24.455 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:27:24.455 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:24.455 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:24.455 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:27:24.455 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:27:24.456 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:27:24.456 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:27:24.456 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:27:24.456 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:27:24.456 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:27:24.456 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:27:24.456 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:27:24.456 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:27:24.456 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:27:24.456 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:27:24.456 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:27:24.456 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:27:24.456 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:27:24.456 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:27:24.457 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:27:24.457 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:27:24.457 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:27:24.457 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:27:24.457 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:27:24.457 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:27:24.457 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:27:24.457 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:27:24.457 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:27:24.457 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:27:24.457 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:27:24.457 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:27:24.457 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:27:24.457 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:27:24.458 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:24.458 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:27:24.458 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:24.458 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:27:24.458 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:27:24.458 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:27:24.458 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:27:24.458 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:24.458 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:27:24.458 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:27:24.458 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:24.458 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:24.458 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:24.458 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:27:24.459 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:27:24.459 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:24.459 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:24.459 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:24.459 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:24.459 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:27:24.459 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:27:24.459 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:27:24.459 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:27:24.459 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:27:24.459 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:24.459 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:24.459 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:27:24.459 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:27:24.460 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:27:24.460 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:27:24.460 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:24.460 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:27:24.460 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:27:24.460 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:24.460 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:24.460 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:24.460 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:27:24.460 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:27:24.460 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:24.460 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:24.460 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:24.461 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:24.461 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:27:24.461 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:27:24.461 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:27:24.461 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:27:24.461 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:27:24.461 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:24.461 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:24.461 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:27:24.461 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:27:24.461 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:27:24.461 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:27:24.461 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:24.461 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:27:24.462 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:27:24.462 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:24.462 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:24.462 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:24.462 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:27:24.462 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:27:24.462 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:24.462 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:24.462 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:24.462 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:24.462 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:27:24.462 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:27:24.462 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:27:24.462 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:27:24.462 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:27:24.462 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:24.463 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:24.463 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:24.463 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:27:24.463 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:27:24.463 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:24.463 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:27:24.463 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:27:24.463 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:27:24.463 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:24.463 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:27:24.463 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:27:24.463 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:24.463 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:27:24.463 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:27:24.464 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:27:24.464 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:24.464 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:27:24.464 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:27:24.464 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:24.464 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:27:24.464 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:27:24.464 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-09-12T02:27:24.464 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:24.464 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:27:24.464 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:27:24.464 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:24.464 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:27:24.464 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:27:24.464 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-09-12T02:27:24.465 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:24.465 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:27:24.465 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:27:24.465 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:24.465 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:27:24.465 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:27:24.465 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:27:24.465 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:24.465 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:24.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:24.465 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:27:24.465 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:27:24.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.450+0000 7fbd6834b640 1 -- 172.21.15.60:0/3489094066 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbd4406be60 msgr2=0x7fbd4406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:24.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.450+0000 7fbd6834b640 1 --2- 172.21.15.60:0/3489094066 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbd4406be60 0x7fbd4406e320 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbd60154e80 tx=0x7fbd50009190 comp rx=0 tx=0).stop 2024-09-12T02:27:24.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.450+0000 7fbd6834b640 1 -- 172.21.15.60:0/3489094066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd60150480 msgr2=0x7fbd60149820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:24.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.450+0000 7fbd6834b640 1 --2- 172.21.15.60:0/3489094066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd60150480 0x7fbd60149820 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbd5800efc0 tx=0x7fbd5800c490 comp rx=0 tx=0).stop 2024-09-12T02:27:24.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.450+0000 7fbd668e8640 1 -- 172.21.15.60:0/3489094066 reap_dead start 2024-09-12T02:27:24.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.450+0000 7fbd668e8640 1 -- 172.21.15.60:0/3489094066 reap_dead start 2024-09-12T02:27:24.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.450+0000 7fbd6834b640 1 -- 172.21.15.60:0/3489094066 shutdown_connections 2024-09-12T02:27:24.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.450+0000 7fbd6834b640 1 -- 172.21.15.60:0/3489094066 >> 172.21.15.60:0/3489094066 conn(0x7fbd60068030 msgr2=0x7fbd600cb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:24.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.451+0000 7fbd6834b640 1 -- 172.21.15.60:0/3489094066 shutdown_connections 2024-09-12T02:27:24.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.451+0000 7fbd6834b640 1 -- 172.21.15.60:0/3489094066 wait complete. 2024-09-12T02:27:24.467 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:27:24.467 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-12T02:27:24.468 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-12T02:27:24.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.584+0000 7fb629368640 1 Processor -- start 2024-09-12T02:27:24.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.584+0000 7fb629368640 1 -- start start 2024-09-12T02:27:24.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.585+0000 7fb629368640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb6241577c0 0x7fb624157ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:24.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.585+0000 7fb629368640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb624073f20 0x7fb624151360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:24.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.585+0000 7fb629368640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb624158290 con 0x7fb6240c4190 2024-09-12T02:27:24.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.585+0000 7fb629368640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fb62406ef00 con 0x7fb624073f20 2024-09-12T02:27:24.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.585+0000 7fb629368640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb6240c54c0 con 0x7fb6241577c0 2024-09-12T02:27:24.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.585+0000 7fb6227fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb624073f20 0x7fb624151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:24.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.585+0000 7fb6227fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb624073f20 0x7fb624151360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40264/0 (socket says 172.21.15.60:40264) 2024-09-12T02:27:24.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.585+0000 7fb6227fc640 1 -- 172.21.15.60:0/3775261809 learned_addr learned my addr 172.21.15.60:0/3775261809 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:27:24.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.585+0000 7fb622ffd640 1 --2- 172.21.15.60:0/3775261809 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb6241577c0 0x7fb624157ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:24.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.586+0000 7fb6227fc640 1 -- 172.21.15.60:0/3775261809 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb6241577c0 msgr2=0x7fb624157ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:27:24.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.586+0000 7fb6227fc640 1 --2- 172.21.15.60:0/3775261809 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb6241577c0 0x7fb624157ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:24.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.586+0000 7fb621ffb640 1 -- 172.21.15.60:0/3775261809 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 30759049 0 0) 0x7fb624158290 con 0x7fb6240c4190 2024-09-12T02:27:24.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.586+0000 7fb6227fc640 1 -- 172.21.15.60:0/3775261809 >> v1:172.21.15.105:6789/0 conn(0x7fb6240c4190 legacy=0x7fb6240c5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:24.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.586+0000 7fb6227fc640 1 -- 172.21.15.60:0/3775261809 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb62406f150 con 0x7fb624073f20 2024-09-12T02:27:24.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.586+0000 7fb6227fc640 1 --2- 172.21.15.60:0/3775261809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb624073f20 0x7fb624151360 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb618009870 tx=0x7fb61802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68ba3fb4147139b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:24.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.587+0000 7fb621ffb640 1 -- 172.21.15.60:0/3775261809 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb618037070 con 0x7fb624073f20 2024-09-12T02:27:24.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.587+0000 7fb621ffb640 1 -- 172.21.15.60:0/3775261809 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb618032440 con 0x7fb624073f20 2024-09-12T02:27:24.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.587+0000 7fb621ffb640 1 -- 172.21.15.60:0/3775261809 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb618032810 con 0x7fb624073f20 2024-09-12T02:27:24.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.587+0000 7fb629368640 1 -- 172.21.15.60:0/3775261809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb624073f20 msgr2=0x7fb624151360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:24.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.587+0000 7fb629368640 1 --2- 172.21.15.60:0/3775261809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb624073f20 0x7fb624151360 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb618009870 tx=0x7fb61802a1c0 comp rx=0 tx=0).stop 2024-09-12T02:27:24.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.587+0000 7fb629368640 1 -- 172.21.15.60:0/3775261809 shutdown_connections 2024-09-12T02:27:24.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.587+0000 7fb629368640 1 --2- 172.21.15.60:0/3775261809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb624073f20 0x7fb624151360 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:24.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.587+0000 7fb629368640 1 --2- 172.21.15.60:0/3775261809 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb6241577c0 0x7fb624157ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:24.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.587+0000 7fb629368640 1 -- 172.21.15.60:0/3775261809 >> 172.21.15.60:0/3775261809 conn(0x7fb6240c6980 msgr2=0x7fb6240c6d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:24.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.587+0000 7fb629368640 1 -- 172.21.15.60:0/3775261809 shutdown_connections 2024-09-12T02:27:24.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.587+0000 7fb629368640 1 -- 172.21.15.60:0/3775261809 wait complete. 2024-09-12T02:27:24.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.589+0000 7fb629368640 1 Processor -- start 2024-09-12T02:27:24.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.589+0000 7fb629368640 1 -- start start 2024-09-12T02:27:24.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.590+0000 7fb629368640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb624073f20 0x7fb624144210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:24.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.590+0000 7fb629368640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb6240c4190 0x7fb6240c9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:24.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.590+0000 7fb629368640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6241577c0 0x7fb624147ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:24.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.590+0000 7fb629368640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb6240c61e0 con 0x7fb6241577c0 2024-09-12T02:27:24.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.590+0000 7fb629368640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb6240c6060 con 0x7fb6240c4190 2024-09-12T02:27:24.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.590+0000 7fb629368640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb6240c6360 con 0x7fb624073f20 2024-09-12T02:27:24.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.590+0000 7fb6237fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6241577c0 0x7fb624147ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:24.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.590+0000 7fb6227fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb6240c4190 0x7fb6240c9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:24.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.590+0000 7fb622ffd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb624073f20 0x7fb624144210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:24.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.590+0000 7fb6237fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6241577c0 0x7fb624147ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40274/0 (socket says 172.21.15.60:40274) 2024-09-12T02:27:24.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.590+0000 7fb6237fe640 1 -- 172.21.15.60:0/2777196777 learned_addr learned my addr 172.21.15.60:0/2777196777 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:27:24.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.590+0000 7fb6227fc640 1 -- 172.21.15.60:0/2777196777 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb624073f20 msgr2=0x7fb624144210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:24.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.590+0000 7fb6227fc640 1 --2- 172.21.15.60:0/2777196777 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb624073f20 0x7fb624144210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:24.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.590+0000 7fb6227fc640 1 -- 172.21.15.60:0/2777196777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6241577c0 msgr2=0x7fb624147ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:24.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.590+0000 7fb6227fc640 1 --2- 172.21.15.60:0/2777196777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6241577c0 0x7fb624147ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:24.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.590+0000 7fb6227fc640 1 -- 172.21.15.60:0/2777196777 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb624144750 con 0x7fb6240c4190 2024-09-12T02:27:24.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.590+0000 7fb6237fe640 1 --2- 172.21.15.60:0/2777196777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6241577c0 0x7fb624147ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:27:24.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.590+0000 7fb622ffd640 1 --2- 172.21.15.60:0/2777196777 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb624073f20 0x7fb624144210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:27:24.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.591+0000 7fb6227fc640 1 --2- 172.21.15.60:0/2777196777 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb6240c4190 0x7fb6240c9560 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb618031000 tx=0x7fb6180046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:24.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.591+0000 7fb60b7fe640 1 -- 172.21.15.60:0/2777196777 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb618041020 con 0x7fb6240c4190 2024-09-12T02:27:24.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.591+0000 7fb60b7fe640 1 -- 172.21.15.60:0/2777196777 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb618030660 con 0x7fb6240c4190 2024-09-12T02:27:24.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.591+0000 7fb629368640 1 -- 172.21.15.60:0/2777196777 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6241ef8b0 con 0x7fb6240c4190 2024-09-12T02:27:24.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.591+0000 7fb60b7fe640 1 -- 172.21.15.60:0/2777196777 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb618037040 con 0x7fb6240c4190 2024-09-12T02:27:24.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.591+0000 7fb629368640 1 -- 172.21.15.60:0/2777196777 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6241efb70 con 0x7fb6240c4190 2024-09-12T02:27:24.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.592+0000 7fb629368640 1 --2- 172.21.15.60:0/2777196777 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb624144d60 0x7fb624145a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:24.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.592+0000 7fb629368640 1 -- 172.21.15.60:0/2777196777 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb6240c7b00 con 0x7fb624144d60 2024-09-12T02:27:24.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.592+0000 7fb622ffd640 1 --2- 172.21.15.60:0/2777196777 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb624144d60 0x7fb624145a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:24.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.592+0000 7fb622ffd640 1 -- 172.21.15.60:0/2777196777 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb62414ed70 con 0x7fb624144d60 2024-09-12T02:27:24.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.592+0000 7fb622ffd640 1 --2- 172.21.15.60:0/2777196777 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb624144d60 0x7fb624145a30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb614011c70 tx=0x7fb61400f610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:24.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.592+0000 7fb60b7fe640 1 -- 172.21.15.60:0/2777196777 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb618044020 con 0x7fb6240c4190 2024-09-12T02:27:24.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.593+0000 7fb60b7fe640 1 --2- 172.21.15.60:0/2777196777 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb61006be60 0x7fb61006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:24.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.593+0000 7fb6237fe640 1 --2- 172.21.15.60:0/2777196777 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb61006be60 0x7fb61006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:24.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.593+0000 7fb60b7fe640 1 -- 172.21.15.60:0/2777196777 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fb6180ab680 con 0x7fb6240c4190 2024-09-12T02:27:24.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.593+0000 7fb60b7fe640 1 -- 172.21.15.60:0/2777196777 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb614019070 con 0x7fb624144d60 2024-09-12T02:27:24.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.593+0000 7fb60b7fe640 1 -- 172.21.15.60:0/2777196777 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fb614004030 con 0x7fb624144d60 2024-09-12T02:27:24.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.593+0000 7fb60b7fe640 1 -- 172.21.15.60:0/2777196777 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb624144d60 msgr2=0x7fb624145a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:24.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.593+0000 7fb60b7fe640 1 --2- 172.21.15.60:0/2777196777 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb624144d60 0x7fb624145a30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb614011c70 tx=0x7fb61400f610 comp rx=0 tx=0).stop 2024-09-12T02:27:24.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.593+0000 7fb60b7fe640 1 -- 172.21.15.60:0/2777196777 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb624144d60 msgr2=0x7fb624145a30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:27:24.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.593+0000 7fb60b7fe640 1 --2- 172.21.15.60:0/2777196777 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb624144d60 0x7fb624145a30 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:24.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.594+0000 7fb6237fe640 1 --2- 172.21.15.60:0/2777196777 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb61006be60 0x7fb61006e320 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb61c00f2e0 tx=0x7fb61c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:24.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.602+0000 7fb629368640 1 --2- 172.21.15.60:0/2777196777 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb62414e600 0x7fb624145f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:24.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.602+0000 7fb629368640 1 -- 172.21.15.60:0/2777196777 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb624157ba0 con 0x7fb62414e600 2024-09-12T02:27:24.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.602+0000 7fb622ffd640 1 --2- 172.21.15.60:0/2777196777 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb62414e600 0x7fb624145f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:24.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.602+0000 7fb622ffd640 1 -- 172.21.15.60:0/2777196777 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb6240c70e0 con 0x7fb62414e600 2024-09-12T02:27:24.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.602+0000 7fb622ffd640 1 --2- 172.21.15.60:0/2777196777 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb62414e600 0x7fb624145f70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb614011c70 tx=0x7fb6140046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:24.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.603+0000 7fb60b7fe640 1 -- 172.21.15.60:0/2777196777 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb614019040 con 0x7fb62414e600 2024-09-12T02:27:24.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.603+0000 7fb60b7fe640 1 -- 172.21.15.60:0/2777196777 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4549 (secure 0 0 0) 0x7fb61401e660 con 0x7fb62414e600 2024-09-12T02:27:24.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.603+0000 7fb60b7fe640 1 -- 172.21.15.60:0/2777196777 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb62414e600 msgr2=0x7fb624145f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:24.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.603+0000 7fb60b7fe640 1 --2- 172.21.15.60:0/2777196777 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb62414e600 0x7fb624145f70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb614011c70 tx=0x7fb6140046c0 comp rx=0 tx=0).stop 2024-09-12T02:27:24.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.603+0000 7fb60b7fe640 1 -- 172.21.15.60:0/2777196777 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb62414e600 msgr2=0x7fb624145f70 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:27:24.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.603+0000 7fb60b7fe640 1 --2- 172.21.15.60:0/2777196777 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb62414e600 0x7fb624145f70 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb614011c70 tx=0x7fb6140046c0 comp rx=0 tx=0).stop 2024-09-12T02:27:24.605 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:27:24.605 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:27:24.605 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:27:24.606 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:27:24.606 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 36, 2024-09-12T02:27:24.606 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 22015, 2024-09-12T02:27:24.606 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:27:24.606 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:27:24.606 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:27:24.606 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:27:24.606 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:27:24.606 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 16, 2024-09-12T02:27:24.606 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:27:24.606 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:27:24.606 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:27:24.606 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:27:24.606 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:27:24.606 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:27:24.607 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:27:24.607 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:27:24.607 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:27:24.607 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:27:24.607 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:27:24.607 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:27:24.607 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:27:24.607 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:27:24.607 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:27:24.607 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:27:24.607 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:27:24.607 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:27:24.607 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:27:24.607 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:27:24.608 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:27:24.608 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:27:24.608 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:27:24.608 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:27:24.608 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:27:24.608 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:27:24.608 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:27:24.608 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:27:24.608 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:24.608 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:24.608 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:27:24.608 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:27:24.608 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:27:24.608 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:27:24.608 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:27:24.609 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:27:24.609 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:27:24.609 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:27:24.609 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:27:24.609 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:27:24.609 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:27:24.609 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:27:24.609 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:27:24.609 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:27:24.609 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:27:24.609 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:27:24.609 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:27:24.609 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:27:24.609 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:27:24.610 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:27:24.610 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:27:24.610 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:27:24.610 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:27:24.610 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:27:24.610 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:27:24.610 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:27:24.610 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:27:24.610 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:27:24.610 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:27:24.610 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:27:24.610 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:24.610 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:27:24.610 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:24.610 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:27:24.611 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:27:24.611 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:27:24.611 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:27:24.611 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:24.611 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:27:24.611 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:27:24.611 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:24.611 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:24.611 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:24.611 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:27:24.611 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:27:24.611 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:24.611 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:24.611 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:24.611 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:24.612 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:27:24.612 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:27:24.612 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:27:24.612 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:27:24.612 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:27:24.612 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:24.612 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:24.612 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:27:24.612 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:27:24.612 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:27:24.612 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:27:24.612 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:24.613 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:27:24.613 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:27:24.613 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:24.613 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:24.613 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:24.613 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:27:24.613 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:27:24.613 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:24.613 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:24.613 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:24.613 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:24.613 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:27:24.613 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:27:24.613 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:27:24.614 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:27:24.614 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:27:24.614 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:24.614 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:24.614 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:27:24.614 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:27:24.614 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:27:24.614 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:27:24.614 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:24.614 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:27:24.614 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:27:24.614 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:24.614 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:24.614 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:24.615 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:27:24.615 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:27:24.615 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:24.615 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:24.615 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:24.615 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:24.615 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:27:24.615 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:27:24.615 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:27:24.615 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:27:24.615 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:27:24.615 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:24.615 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:24.615 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:24.615 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:27:24.616 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:27:24.616 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:24.616 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:27:24.616 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:27:24.616 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:27:24.616 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:24.616 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:27:24.616 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:27:24.616 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:24.616 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:27:24.616 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:27:24.616 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:27:24.616 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:24.616 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:24.616 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:24.617 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:27:24.617 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:27:24.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.603+0000 7fb629368640 1 -- 172.21.15.60:0/2777196777 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb61006be60 msgr2=0x7fb61006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:24.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.603+0000 7fb629368640 1 --2- 172.21.15.60:0/2777196777 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb61006be60 0x7fb61006e320 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb61c00f2e0 tx=0x7fb61c009040 comp rx=0 tx=0).stop 2024-09-12T02:27:24.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.603+0000 7fb629368640 1 -- 172.21.15.60:0/2777196777 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb6240c4190 msgr2=0x7fb6240c9560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:24.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.603+0000 7fb629368640 1 --2- 172.21.15.60:0/2777196777 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb6240c4190 0x7fb6240c9560 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb618031000 tx=0x7fb6180046c0 comp rx=0 tx=0).stop 2024-09-12T02:27:24.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.603+0000 7fb6237fe640 1 -- 172.21.15.60:0/2777196777 reap_dead start 2024-09-12T02:27:24.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.603+0000 7fb6237fe640 1 -- 172.21.15.60:0/2777196777 reap_dead start 2024-09-12T02:27:24.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.603+0000 7fb629368640 1 -- 172.21.15.60:0/2777196777 shutdown_connections 2024-09-12T02:27:24.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.603+0000 7fb629368640 1 -- 172.21.15.60:0/2777196777 >> 172.21.15.60:0/2777196777 conn(0x7fb6240c6980 msgr2=0x7fb6240c4760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:24.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.603+0000 7fb629368640 1 -- 172.21.15.60:0/2777196777 shutdown_connections 2024-09-12T02:27:24.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.603+0000 7fb629368640 1 -- 172.21.15.60:0/2777196777 wait complete. 2024-09-12T02:27:24.619 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:27:24.619 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-09-12T02:27:24.619 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-12T02:27:24.619 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-09-12T02:27:24.619 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-09-12T02:27:24.619 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T02:27:24.619 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:27:24.630 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T02:27:24.630 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-12T02:27:24.630 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:27:24.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.745+0000 7fd81b43c640 1 Processor -- start 2024-09-12T02:27:24.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.745+0000 7fd81b43c640 1 -- start start 2024-09-12T02:27:24.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.746+0000 7fd81b43c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8141538c0 0x7fd8140702d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:24.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.746+0000 7fd81b43c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd8140afd80 0x7fd814070810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:24.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.746+0000 7fd81b43c640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd814071420 0x7fd8140c4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:24.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.746+0000 7fd81b43c640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fd8140afa10 con 0x7fd8140afd80 2024-09-12T02:27:24.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.746+0000 7fd81b43c640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fd814070e10 con 0x7fd814071420 2024-09-12T02:27:24.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.746+0000 7fd81b43c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd8141562e0 con 0x7fd8141538c0 2024-09-12T02:27:24.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.746+0000 7fd8191d8640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8141538c0 msgr2=0x7fd8140702d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:27:24.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.746+0000 7fd8191d8640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8141538c0 0x7fd8140702d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:27:24.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.746+0000 7fd8189d7640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd8140afd80 0x7fd814070810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:24.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.746+0000 7fd8189d7640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd8140afd80 0x7fd814070810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40286/0 (socket says 172.21.15.60:40286) 2024-09-12T02:27:24.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.746+0000 7fd8189d7640 1 -- 172.21.15.60:0/1751762159 learned_addr learned my addr 172.21.15.60:0/1751762159 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:27:24.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.746+0000 7fd8199d9640 1 --2- 172.21.15.60:0/1751762159 >> v2:172.21.15.105:3300/0 conn(0x7fd814071420 0x7fd8140c4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:24.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.746+0000 7fd8189d7640 1 -- 172.21.15.60:0/1751762159 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8141538c0 msgr2=0x7fd8140702d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:27:24.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.746+0000 7fd8189d7640 1 --2- 172.21.15.60:0/1751762159 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8141538c0 0x7fd8140702d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:24.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.746+0000 7fd8189d7640 1 -- 172.21.15.60:0/1751762159 >> v2:172.21.15.105:3300/0 conn(0x7fd814071420 msgr2=0x7fd8140c4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:27:24.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.746+0000 7fd8189d7640 1 --2- 172.21.15.60:0/1751762159 >> v2:172.21.15.105:3300/0 conn(0x7fd814071420 0x7fd8140c4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:24.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.746+0000 7fd8189d7640 1 -- 172.21.15.60:0/1751762159 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd814153ca0 con 0x7fd8140afd80 2024-09-12T02:27:24.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.747+0000 7fd8189d7640 1 --2- 172.21.15.60:0/1751762159 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8140afd80 0x7fd814070810 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd814071800 tx=0x7fd80402a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f8697649c61eb31 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:24.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.747+0000 7fd80bfff640 1 -- 172.21.15.60:0/1751762159 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd804037070 con 0x7fd8140afd80 2024-09-12T02:27:24.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.747+0000 7fd80bfff640 1 -- 172.21.15.60:0/1751762159 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd804032440 con 0x7fd8140afd80 2024-09-12T02:27:24.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.747+0000 7fd80bfff640 1 -- 172.21.15.60:0/1751762159 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd804032810 con 0x7fd8140afd80 2024-09-12T02:27:24.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.748+0000 7fd81b43c640 1 -- 172.21.15.60:0/1751762159 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8140afd80 msgr2=0x7fd814070810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:24.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.748+0000 7fd81b43c640 1 --2- 172.21.15.60:0/1751762159 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8140afd80 0x7fd814070810 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd814071800 tx=0x7fd80402a160 comp rx=0 tx=0).stop 2024-09-12T02:27:24.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.748+0000 7fd81b43c640 1 -- 172.21.15.60:0/1751762159 shutdown_connections 2024-09-12T02:27:24.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.748+0000 7fd81b43c640 1 --2- 172.21.15.60:0/1751762159 >> v2:172.21.15.105:3300/0 conn(0x7fd814071420 0x7fd8140c4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:24.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.748+0000 7fd81b43c640 1 --2- 172.21.15.60:0/1751762159 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8140afd80 0x7fd814070810 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:24.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.748+0000 7fd81b43c640 1 --2- 172.21.15.60:0/1751762159 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8141538c0 0x7fd8140702d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:24.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.748+0000 7fd81b43c640 1 -- 172.21.15.60:0/1751762159 >> 172.21.15.60:0/1751762159 conn(0x7fd8140c6880 msgr2=0x7fd8140c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:24.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.748+0000 7fd81b43c640 1 -- 172.21.15.60:0/1751762159 shutdown_connections 2024-09-12T02:27:24.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.748+0000 7fd81b43c640 1 -- 172.21.15.60:0/1751762159 wait complete. 2024-09-12T02:27:24.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.750+0000 7fd81b43c640 1 Processor -- start 2024-09-12T02:27:24.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.750+0000 7fd81b43c640 1 -- start start 2024-09-12T02:27:24.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.751+0000 7fd81b43c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd814071420 0x7fd81414e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:24.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.751+0000 7fd81b43c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8140afd80 0x7fd8141ef7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:24.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.751+0000 7fd81b43c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8141538c0 0x7fd814145570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:24.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.751+0000 7fd81b43c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd8140c5080 con 0x7fd8141538c0 2024-09-12T02:27:24.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.751+0000 7fd81b43c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd814073eb0 con 0x7fd814071420 2024-09-12T02:27:24.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.751+0000 7fd81b43c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd8140c5200 con 0x7fd8140afd80 2024-09-12T02:27:24.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.751+0000 7fd8189d7640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8140afd80 msgr2=0x7fd8141ef7f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:27:24.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.751+0000 7fd8199d9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8141538c0 0x7fd814145570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:24.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.751+0000 7fd8189d7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8140afd80 0x7fd8141ef7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:27:24.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.751+0000 7fd8199d9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8141538c0 0x7fd814145570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40290/0 (socket says 172.21.15.60:40290) 2024-09-12T02:27:24.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.751+0000 7fd8199d9640 1 -- 172.21.15.60:0/2252820699 learned_addr learned my addr 172.21.15.60:0/2252820699 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:27:24.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.751+0000 7fd8191d8640 1 --2- 172.21.15.60:0/2252820699 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd814071420 0x7fd81414e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:24.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.751+0000 7fd8199d9640 1 -- 172.21.15.60:0/2252820699 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8140afd80 msgr2=0x7fd8141ef7f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:27:24.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.751+0000 7fd8199d9640 1 --2- 172.21.15.60:0/2252820699 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8140afd80 0x7fd8141ef7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:24.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.751+0000 7fd8199d9640 1 -- 172.21.15.60:0/2252820699 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd814071420 msgr2=0x7fd81414e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:24.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.751+0000 7fd8199d9640 1 --2- 172.21.15.60:0/2252820699 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd814071420 0x7fd81414e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:24.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.751+0000 7fd8199d9640 1 -- 172.21.15.60:0/2252820699 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8141ef310 con 0x7fd8141538c0 2024-09-12T02:27:24.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.751+0000 7fd8199d9640 1 --2- 172.21.15.60:0/2252820699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8141538c0 0x7fd814145570 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd80c00efc0 tx=0x7fd80c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:24.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.752+0000 7fd809ffb640 1 -- 172.21.15.60:0/2252820699 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd80c018020 con 0x7fd8141538c0 2024-09-12T02:27:24.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.752+0000 7fd809ffb640 1 -- 172.21.15.60:0/2252820699 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd80c014480 con 0x7fd8141538c0 2024-09-12T02:27:24.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.752+0000 7fd81b43c640 1 -- 172.21.15.60:0/2252820699 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd81414a130 con 0x7fd8141538c0 2024-09-12T02:27:24.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.752+0000 7fd809ffb640 1 -- 172.21.15.60:0/2252820699 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd80c014870 con 0x7fd8141538c0 2024-09-12T02:27:24.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.752+0000 7fd81b43c640 1 -- 172.21.15.60:0/2252820699 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd81414c930 con 0x7fd8141538c0 2024-09-12T02:27:24.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.753+0000 7fd81b43c640 1 -- 172.21.15.60:0/2252820699 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8141ef4e0 con 0x7fd8141538c0 2024-09-12T02:27:24.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.754+0000 7fd809ffb640 1 -- 172.21.15.60:0/2252820699 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd80c005d10 con 0x7fd8141538c0 2024-09-12T02:27:24.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.754+0000 7fd809ffb640 1 --2- 172.21.15.60:0/2252820699 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd7f806bde0 0x7fd7f806e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:24.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.754+0000 7fd809ffb640 1 -- 172.21.15.60:0/2252820699 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fd80c08bee0 con 0x7fd8141538c0 2024-09-12T02:27:24.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.754+0000 7fd8191d8640 1 --2- 172.21.15.60:0/2252820699 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd7f806bde0 0x7fd7f806e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:24.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.755+0000 7fd8191d8640 1 --2- 172.21.15.60:0/2252820699 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd7f806bde0 0x7fd7f806e2a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd8100093d0 tx=0x7fd810009360 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:24.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:24.759+0000 7fd809ffb640 1 -- 172.21.15.60:0/2252820699 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd80c022030 con 0x7fd8141538c0 2024-09-12T02:27:25.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:25.054+0000 7fd81b43c640 1 -- 172.21.15.60:0/2252820699 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd8140c5630 con 0x7fd8141538c0 2024-09-12T02:27:25.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:25.054+0000 7fd809ffb640 1 -- 172.21.15.60:0/2252820699 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7fd80c010040 con 0x7fd8141538c0 2024-09-12T02:27:25.056 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":36,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:27:25.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:25.057+0000 7fd81b43c640 1 -- 172.21.15.60:0/2252820699 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd7f806bde0 msgr2=0x7fd7f806e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:25.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:25.057+0000 7fd81b43c640 1 --2- 172.21.15.60:0/2252820699 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd7f806bde0 0x7fd7f806e2a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd8100093d0 tx=0x7fd810009360 comp rx=0 tx=0).stop 2024-09-12T02:27:25.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:25.057+0000 7fd81b43c640 1 -- 172.21.15.60:0/2252820699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8141538c0 msgr2=0x7fd814145570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:25.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:25.057+0000 7fd81b43c640 1 --2- 172.21.15.60:0/2252820699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8141538c0 0x7fd814145570 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd80c00efc0 tx=0x7fd80c00c490 comp rx=0 tx=0).stop 2024-09-12T02:27:25.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:25.057+0000 7fd81b43c640 1 -- 172.21.15.60:0/2252820699 shutdown_connections 2024-09-12T02:27:25.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:25.057+0000 7fd81b43c640 1 --2- 172.21.15.60:0/2252820699 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd7f806bde0 0x7fd7f806e2a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:25.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:25.057+0000 7fd81b43c640 1 --2- 172.21.15.60:0/2252820699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8141538c0 0x7fd814145570 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:25.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:25.057+0000 7fd81b43c640 1 --2- 172.21.15.60:0/2252820699 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8140afd80 0x7fd8141ef7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:25.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:25.057+0000 7fd81b43c640 1 --2- 172.21.15.60:0/2252820699 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd814071420 0x7fd81414e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:25.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:25.057+0000 7fd81b43c640 1 -- 172.21.15.60:0/2252820699 >> 172.21.15.60:0/2252820699 conn(0x7fd8140c6880 msgr2=0x7fd814156de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:25.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:25.057+0000 7fd81b43c640 1 -- 172.21.15.60:0/2252820699 shutdown_connections 2024-09-12T02:27:25.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:25.057+0000 7fd81b43c640 1 -- 172.21.15.60:0/2252820699 wait complete. 2024-09-12T02:27:27.022 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:27:27.026 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:27:28.073 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:27:28.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.190+0000 7f356928d640 1 Processor -- start 2024-09-12T02:27:28.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.191+0000 7f356928d640 1 -- start start 2024-09-12T02:27:28.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.191+0000 7f356928d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3564153be0 0x7f35640c3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:28.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.191+0000 7f356928d640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f35640ac720 0x7f35640c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:28.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.191+0000 7f356928d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f35640c7fb0 0x7f35641598a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:28.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.191+0000 7f356928d640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f3564156db0 con 0x7f35640c7fb0 2024-09-12T02:27:28.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.192+0000 7f356928d640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f35640c8460 con 0x7f35640ac720 2024-09-12T02:27:28.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.192+0000 7f356928d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3564153fc0 con 0x7f3564153be0 2024-09-12T02:27:28.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.192+0000 7f3562ffd640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3564153be0 msgr2=0x7f35640c3560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:27:28.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.192+0000 7f3562ffd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3564153be0 0x7f35640c3560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:27:28.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.192+0000 7f35637fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f35640c7fb0 0x7f35641598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:28.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.192+0000 7f35627fc640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f35640ac720 0x7f35640c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:28.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.192+0000 7f35627fc640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f35640ac720 0x7f35640c7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:45890/0 (socket says 172.21.15.60:45890) 2024-09-12T02:27:28.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.192+0000 7f35637fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f35640c7fb0 0x7f35641598a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40292/0 (socket says 172.21.15.60:40292) 2024-09-12T02:27:28.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.192+0000 7f35627fc640 1 -- 172.21.15.60:0/4187566026 learned_addr learned my addr 172.21.15.60:0/4187566026 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:27:28.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.192+0000 7f35637fe640 1 -- 172.21.15.60:0/4187566026 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3564153be0 msgr2=0x7f35640c3560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:27:28.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.192+0000 7f35637fe640 1 --2- 172.21.15.60:0/4187566026 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3564153be0 0x7f35640c3560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:28.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.192+0000 7f35637fe640 1 -- 172.21.15.60:0/4187566026 >> v2:172.21.15.105:3300/0 conn(0x7f35640ac720 msgr2=0x7f35640c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:27:28.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.192+0000 7f35637fe640 1 --2- 172.21.15.60:0/4187566026 >> v2:172.21.15.105:3300/0 conn(0x7f35640ac720 0x7f35640c7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:28.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.192+0000 7f35637fe640 1 -- 172.21.15.60:0/4187566026 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35640a8030 con 0x7f35640c7fb0 2024-09-12T02:27:28.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.193+0000 7f35637fe640 1 --2- 172.21.15.60:0/4187566026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35640c7fb0 0x7f35641598a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3564068730 tx=0x7f355c02a4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6180181f3b608237 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:28.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.193+0000 7f3561ffb640 1 -- 172.21.15.60:0/4187566026 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f355c007740 con 0x7f35640c7fb0 2024-09-12T02:27:28.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.193+0000 7f3561ffb640 1 -- 172.21.15.60:0/4187566026 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f355c0078e0 con 0x7f35640c7fb0 2024-09-12T02:27:28.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.193+0000 7f3561ffb640 1 -- 172.21.15.60:0/4187566026 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f355c007cb0 con 0x7f35640c7fb0 2024-09-12T02:27:28.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.194+0000 7f356928d640 1 -- 172.21.15.60:0/4187566026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35640c7fb0 msgr2=0x7f35641598a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:28.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.194+0000 7f356928d640 1 --2- 172.21.15.60:0/4187566026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35640c7fb0 0x7f35641598a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3564068730 tx=0x7f355c02a4d0 comp rx=0 tx=0).stop 2024-09-12T02:27:28.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.194+0000 7f356928d640 1 -- 172.21.15.60:0/4187566026 shutdown_connections 2024-09-12T02:27:28.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.194+0000 7f356928d640 1 --2- 172.21.15.60:0/4187566026 >> v2:172.21.15.105:3300/0 conn(0x7f35640ac720 0x7f35640c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:28.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.194+0000 7f356928d640 1 --2- 172.21.15.60:0/4187566026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35640c7fb0 0x7f35641598a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:28.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.194+0000 7f356928d640 1 --2- 172.21.15.60:0/4187566026 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3564153be0 0x7f35640c3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:28.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.194+0000 7f356928d640 1 -- 172.21.15.60:0/4187566026 >> 172.21.15.60:0/4187566026 conn(0x7f35640c5660 msgr2=0x7f35640c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:28.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.194+0000 7f356928d640 1 -- 172.21.15.60:0/4187566026 shutdown_connections 2024-09-12T02:27:28.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.194+0000 7f356928d640 1 -- 172.21.15.60:0/4187566026 wait complete. 2024-09-12T02:27:28.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.196+0000 7f356928d640 1 Processor -- start 2024-09-12T02:27:28.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.196+0000 7f356928d640 1 -- start start 2024-09-12T02:27:28.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.196+0000 7f356928d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35640ac720 0x7f35641e0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:28.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.197+0000 7f356928d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35640c7fb0 0x7f3564151bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:28.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.197+0000 7f356928d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3564153be0 0x7f3564155460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:28.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.197+0000 7f356928d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f35640a83e0 con 0x7f35640ac720 2024-09-12T02:27:28.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.197+0000 7f356928d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3564157240 con 0x7f3564153be0 2024-09-12T02:27:28.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.197+0000 7f356928d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f35640ac370 con 0x7f35640c7fb0 2024-09-12T02:27:28.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.197+0000 7f35627fc640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35640c7fb0 msgr2=0x7f3564151bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:27:28.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.197+0000 7f35627fc640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35640c7fb0 0x7f3564151bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:27:28.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.197+0000 7f3562ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35640ac720 0x7f35641e0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:28.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.197+0000 7f3562ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35640ac720 0x7f35641e0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40302/0 (socket says 172.21.15.60:40302) 2024-09-12T02:27:28.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.197+0000 7f3562ffd640 1 -- 172.21.15.60:0/2146340408 learned_addr learned my addr 172.21.15.60:0/2146340408 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:27:28.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.197+0000 7f35637fe640 1 --2- 172.21.15.60:0/2146340408 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3564153be0 0x7f3564155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:28.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.197+0000 7f3562ffd640 1 -- 172.21.15.60:0/2146340408 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35640c7fb0 msgr2=0x7f3564151bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:27:28.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.197+0000 7f3562ffd640 1 --2- 172.21.15.60:0/2146340408 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35640c7fb0 0x7f3564151bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:28.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.197+0000 7f3562ffd640 1 -- 172.21.15.60:0/2146340408 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3564153be0 msgr2=0x7f3564155460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:28.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.197+0000 7f3562ffd640 1 --2- 172.21.15.60:0/2146340408 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3564153be0 0x7f3564155460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:28.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.197+0000 7f3562ffd640 1 -- 172.21.15.60:0/2146340408 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3564150ca0 con 0x7f35640ac720 2024-09-12T02:27:28.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.197+0000 7f3562ffd640 1 --2- 172.21.15.60:0/2146340408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35640ac720 0x7f35641e0970 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f355400b550 tx=0x7f355400ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:28.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.197+0000 7f354b7fe640 1 -- 172.21.15.60:0/2146340408 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3554013020 con 0x7f35640ac720 2024-09-12T02:27:28.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.197+0000 7f354b7fe640 1 -- 172.21.15.60:0/2146340408 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3554003de0 con 0x7f35640ac720 2024-09-12T02:27:28.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.198+0000 7f356928d640 1 -- 172.21.15.60:0/2146340408 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3564150f80 con 0x7f35640ac720 2024-09-12T02:27:28.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.198+0000 7f354b7fe640 1 -- 172.21.15.60:0/2146340408 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35540052b0 con 0x7f35640ac720 2024-09-12T02:27:28.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.198+0000 7f356928d640 1 -- 172.21.15.60:0/2146340408 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35641559a0 con 0x7f35640ac720 2024-09-12T02:27:28.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.199+0000 7f356928d640 1 -- 172.21.15.60:0/2146340408 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35641ef1b0 con 0x7f35640ac720 2024-09-12T02:27:28.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.199+0000 7f354b7fe640 1 -- 172.21.15.60:0/2146340408 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3554016020 con 0x7f35640ac720 2024-09-12T02:27:28.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.200+0000 7f354b7fe640 1 --2- 172.21.15.60:0/2146340408 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f355006bde0 0x7f355006e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:28.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.200+0000 7f354b7fe640 1 -- 172.21.15.60:0/2146340408 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f355408acb0 con 0x7f35640ac720 2024-09-12T02:27:28.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.200+0000 7f35627fc640 1 --2- 172.21.15.60:0/2146340408 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f355006bde0 0x7f355006e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:28.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.200+0000 7f35627fc640 1 --2- 172.21.15.60:0/2146340408 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f355006bde0 0x7f355006e2a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3564156970 tx=0x7f3558009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:28.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.206+0000 7f354b7fe640 1 -- 172.21.15.60:0/2146340408 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f355401d020 con 0x7f35640ac720 2024-09-12T02:27:28.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.487+0000 7f356928d640 1 -- 172.21.15.60:0/2146340408 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f35640c63f0 con 0x7f35640ac720 2024-09-12T02:27:28.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.487+0000 7f354b7fe640 1 -- 172.21.15.60:0/2146340408 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f3554059350 con 0x7f35640ac720 2024-09-12T02:27:28.489 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":36,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:27:28.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.489+0000 7f356928d640 1 -- 172.21.15.60:0/2146340408 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f355006bde0 msgr2=0x7f355006e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:28.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.489+0000 7f356928d640 1 --2- 172.21.15.60:0/2146340408 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f355006bde0 0x7f355006e2a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3564156970 tx=0x7f3558009240 comp rx=0 tx=0).stop 2024-09-12T02:27:28.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.489+0000 7f356928d640 1 -- 172.21.15.60:0/2146340408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35640ac720 msgr2=0x7f35641e0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:28.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.489+0000 7f356928d640 1 --2- 172.21.15.60:0/2146340408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35640ac720 0x7f35641e0970 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f355400b550 tx=0x7f355400ba10 comp rx=0 tx=0).stop 2024-09-12T02:27:28.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.489+0000 7f356928d640 1 -- 172.21.15.60:0/2146340408 shutdown_connections 2024-09-12T02:27:28.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.489+0000 7f356928d640 1 --2- 172.21.15.60:0/2146340408 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f355006bde0 0x7f355006e2a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:28.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.489+0000 7f356928d640 1 --2- 172.21.15.60:0/2146340408 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3564153be0 0x7f3564155460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:28.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.489+0000 7f356928d640 1 --2- 172.21.15.60:0/2146340408 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35640c7fb0 0x7f3564151bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:28.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.489+0000 7f356928d640 1 --2- 172.21.15.60:0/2146340408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35640ac720 0x7f35641e0970 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:28.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.489+0000 7f356928d640 1 -- 172.21.15.60:0/2146340408 >> 172.21.15.60:0/2146340408 conn(0x7f35640c5660 msgr2=0x7f35640c77f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:28.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.489+0000 7f356928d640 1 -- 172.21.15.60:0/2146340408 shutdown_connections 2024-09-12T02:27:28.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:28.489+0000 7f356928d640 1 -- 172.21.15.60:0/2146340408 wait complete. 2024-09-12T02:27:31.503 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:27:31.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.608+0000 7f1269149640 1 Processor -- start 2024-09-12T02:27:31.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.608+0000 7f1269149640 1 -- start start 2024-09-12T02:27:31.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.609+0000 7f1269149640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f12640a9230 0x7f12640c3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:31.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.609+0000 7f1269149640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1264072b30 0x7f1264151610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:31.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.609+0000 7f1269149640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1264070800 con 0x7f12640ca220 2024-09-12T02:27:31.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.609+0000 7f1269149640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f12640c99b0 con 0x7f12640a9230 2024-09-12T02:27:31.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.609+0000 7f1269149640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f12640c93f0 con 0x7f1264072b30 2024-09-12T02:27:31.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.609+0000 7f126359e640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1264072b30 msgr2=0x7f1264151610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:27:31.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.609+0000 7f126359e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1264072b30 0x7f1264151610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:27:31.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.609+0000 7f126259c640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f12640a9230 0x7f12640c3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:31.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.609+0000 7f126259c640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f12640a9230 0x7f12640c3f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:58334/0 (socket says 172.21.15.60:58334) 2024-09-12T02:27:31.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.609+0000 7f126259c640 1 -- 172.21.15.60:0/746839806 learned_addr learned my addr 172.21.15.60:0/746839806 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:27:31.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.609+0000 7f126259c640 1 -- 172.21.15.60:0/746839806 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1264072b30 msgr2=0x7f1264151610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:27:31.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.609+0000 7f126259c640 1 --2- 172.21.15.60:0/746839806 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1264072b30 0x7f1264151610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:31.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.609+0000 7f126259c640 1 -- 172.21.15.60:0/746839806 >> v1:172.21.15.105:6789/0 conn(0x7f12640ca220 legacy=0x7f1264154b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:31.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.609+0000 7f126259c640 1 -- 172.21.15.60:0/746839806 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12640c96d0 con 0x7f12640a9230 2024-09-12T02:27:31.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.610+0000 7f126259c640 1 --2- 172.21.15.60:0/746839806 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12640a9230 0x7f12640c3f10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1258009870 tx=0x7f125802a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5814025132f9c101 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:31.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.610+0000 7f1261d9b640 1 -- 172.21.15.60:0/746839806 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1258037070 con 0x7f12640a9230 2024-09-12T02:27:31.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.610+0000 7f1261d9b640 1 -- 172.21.15.60:0/746839806 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1258032440 con 0x7f12640a9230 2024-09-12T02:27:31.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.611+0000 7f1261d9b640 1 -- 172.21.15.60:0/746839806 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1258032810 con 0x7f12640a9230 2024-09-12T02:27:31.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.611+0000 7f1269149640 1 -- 172.21.15.60:0/746839806 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12640a9230 msgr2=0x7f12640c3f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:31.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.611+0000 7f1269149640 1 --2- 172.21.15.60:0/746839806 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12640a9230 0x7f12640c3f10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1258009870 tx=0x7f125802a1e0 comp rx=0 tx=0).stop 2024-09-12T02:27:31.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.611+0000 7f1269149640 1 -- 172.21.15.60:0/746839806 shutdown_connections 2024-09-12T02:27:31.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.611+0000 7f1269149640 1 --2- 172.21.15.60:0/746839806 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1264072b30 0x7f1264151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:31.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.611+0000 7f1269149640 1 --2- 172.21.15.60:0/746839806 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12640a9230 0x7f12640c3f10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:31.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.611+0000 7f1269149640 1 -- 172.21.15.60:0/746839806 >> 172.21.15.60:0/746839806 conn(0x7f1264067b30 msgr2=0x7f1264067f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:31.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.611+0000 7f1269149640 1 -- 172.21.15.60:0/746839806 shutdown_connections 2024-09-12T02:27:31.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.611+0000 7f1269149640 1 -- 172.21.15.60:0/746839806 wait complete. 2024-09-12T02:27:31.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.613+0000 7f1269149640 1 Processor -- start 2024-09-12T02:27:31.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.613+0000 7f1269149640 1 -- start start 2024-09-12T02:27:31.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.614+0000 7f1269149640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1264072b30 0x7f1264150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:31.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.614+0000 7f1269149640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12640a9230 0x7f1264147860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:31.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.614+0000 7f1269149640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12640ca220 0x7f1264147030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:31.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.614+0000 7f1269149640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1264072fc0 con 0x7f1264072b30 2024-09-12T02:27:31.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.614+0000 7f1269149640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1264154660 con 0x7f12640ca220 2024-09-12T02:27:31.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.614+0000 7f1269149640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f12640ca600 con 0x7f12640a9230 2024-09-12T02:27:31.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.614+0000 7f126259c640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12640a9230 msgr2=0x7f1264147860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:27:31.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.614+0000 7f126259c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12640a9230 0x7f1264147860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:27:31.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.614+0000 7f1262d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1264072b30 0x7f1264150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:31.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.614+0000 7f1262d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1264072b30 0x7f1264150be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38378/0 (socket says 172.21.15.60:38378) 2024-09-12T02:27:31.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.614+0000 7f1262d9d640 1 -- 172.21.15.60:0/1470280891 learned_addr learned my addr 172.21.15.60:0/1470280891 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:27:31.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.614+0000 7f126359e640 1 --2- 172.21.15.60:0/1470280891 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12640ca220 0x7f1264147030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:31.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.614+0000 7f1262d9d640 1 -- 172.21.15.60:0/1470280891 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12640a9230 msgr2=0x7f1264147860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:27:31.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.614+0000 7f1262d9d640 1 --2- 172.21.15.60:0/1470280891 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12640a9230 0x7f1264147860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:31.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.614+0000 7f1262d9d640 1 -- 172.21.15.60:0/1470280891 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12640ca220 msgr2=0x7f1264147030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:31.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.614+0000 7f1262d9d640 1 --2- 172.21.15.60:0/1470280891 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12640ca220 0x7f1264147030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:31.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.614+0000 7f1262d9d640 1 -- 172.21.15.60:0/1470280891 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1264158830 con 0x7f1264072b30 2024-09-12T02:27:31.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.614+0000 7f1262d9d640 1 --2- 172.21.15.60:0/1470280891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1264072b30 0x7f1264150be0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f125400c480 tx=0x7f125400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:31.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.615+0000 7f124b7fe640 1 -- 172.21.15.60:0/1470280891 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12540052d0 con 0x7f1264072b30 2024-09-12T02:27:31.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.615+0000 7f124b7fe640 1 -- 172.21.15.60:0/1470280891 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1254005470 con 0x7f1264072b30 2024-09-12T02:27:31.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.615+0000 7f1269149640 1 -- 172.21.15.60:0/1470280891 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12641ecd40 con 0x7f1264072b30 2024-09-12T02:27:31.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.615+0000 7f124b7fe640 1 -- 172.21.15.60:0/1470280891 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1254012870 con 0x7f1264072b30 2024-09-12T02:27:31.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.615+0000 7f1269149640 1 -- 172.21.15.60:0/1470280891 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12641ed300 con 0x7f1264072b30 2024-09-12T02:27:31.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.616+0000 7f1269149640 1 -- 172.21.15.60:0/1470280891 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12640c3f10 con 0x7f1264072b30 2024-09-12T02:27:31.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.616+0000 7f124b7fe640 1 -- 172.21.15.60:0/1470280891 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1254012a10 con 0x7f1264072b30 2024-09-12T02:27:31.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.617+0000 7f124b7fe640 1 --2- 172.21.15.60:0/1470280891 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f125006bde0 0x7f125006e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:31.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.617+0000 7f124b7fe640 1 -- 172.21.15.60:0/1470280891 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f125408ad60 con 0x7f1264072b30 2024-09-12T02:27:31.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.617+0000 7f126259c640 1 --2- 172.21.15.60:0/1470280891 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f125006bde0 0x7f125006e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:31.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.618+0000 7f126259c640 1 --2- 172.21.15.60:0/1470280891 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f125006bde0 0x7f125006e2a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1258034000 tx=0x7f125802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:31.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.621+0000 7f124b7fe640 1 -- 172.21.15.60:0/1470280891 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1254059400 con 0x7f1264072b30 2024-09-12T02:27:31.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.904+0000 7f1269149640 1 -- 172.21.15.60:0/1470280891 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1264147570 con 0x7f1264072b30 2024-09-12T02:27:31.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.905+0000 7f124b7fe640 1 -- 172.21.15.60:0/1470280891 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f1254058d00 con 0x7f1264072b30 2024-09-12T02:27:31.906 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":36,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:27:31.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.907+0000 7f1269149640 1 -- 172.21.15.60:0/1470280891 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f125006bde0 msgr2=0x7f125006e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:31.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.907+0000 7f1269149640 1 --2- 172.21.15.60:0/1470280891 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f125006bde0 0x7f125006e2a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1258034000 tx=0x7f125802e000 comp rx=0 tx=0).stop 2024-09-12T02:27:31.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.907+0000 7f1269149640 1 -- 172.21.15.60:0/1470280891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1264072b30 msgr2=0x7f1264150be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:31.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.907+0000 7f1269149640 1 --2- 172.21.15.60:0/1470280891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1264072b30 0x7f1264150be0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f125400c480 tx=0x7f125400c940 comp rx=0 tx=0).stop 2024-09-12T02:27:31.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.907+0000 7f1269149640 1 -- 172.21.15.60:0/1470280891 shutdown_connections 2024-09-12T02:27:31.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.907+0000 7f1269149640 1 --2- 172.21.15.60:0/1470280891 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f125006bde0 0x7f125006e2a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:31.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.907+0000 7f1269149640 1 --2- 172.21.15.60:0/1470280891 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12640ca220 0x7f1264147030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:31.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.907+0000 7f1269149640 1 --2- 172.21.15.60:0/1470280891 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12640a9230 0x7f1264147860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:31.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.907+0000 7f1269149640 1 --2- 172.21.15.60:0/1470280891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1264072b30 0x7f1264150be0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:31.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.907+0000 7f1269149640 1 -- 172.21.15.60:0/1470280891 >> 172.21.15.60:0/1470280891 conn(0x7f1264067b30 msgr2=0x7f12640aa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:31.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.907+0000 7f1269149640 1 -- 172.21.15.60:0/1470280891 shutdown_connections 2024-09-12T02:27:31.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:31.907+0000 7f1269149640 1 -- 172.21.15.60:0/1470280891 wait complete. 2024-09-12T02:27:34.922 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:27:35.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:35.031+0000 7fc099142640 1 Processor -- start 2024-09-12T02:27:35.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:35.031+0000 7fc099142640 1 -- start start 2024-09-12T02:27:35.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:35.032+0000 7fc099142640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0940aba60 0x7fc094153390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:35.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:35.032+0000 7fc099142640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc0940c2e30 0x7fc0941567b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:35.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:35.032+0000 7fc099142640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc0940c3d60 0x7fc09414fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:35.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:35.032+0000 7fc099142640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fc0940c37a0 con 0x7fc0940c3d60 2024-09-12T02:27:35.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:35.032+0000 7fc099142640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc0940c3a80 con 0x7fc0940c2e30 2024-09-12T02:27:35.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:35.032+0000 7fc099142640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc094155fb0 con 0x7fc0940aba60 2024-09-12T02:27:35.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:35.032+0000 7fc092d9d640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0940aba60 msgr2=0x7fc094153390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:27:35.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:35.032+0000 7fc092d9d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0940aba60 0x7fc094153390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:27:35.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:35.032+0000 7fc09359e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc0940c3d60 0x7fc09414fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:35.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:35.032+0000 7fc09359e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc0940c3d60 0x7fc09414fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38390/0 (socket says 172.21.15.60:38390) 2024-09-12T02:27:35.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:35.032+0000 7fc09359e640 1 -- 172.21.15.60:0/1231875367 learned_addr learned my addr 172.21.15.60:0/1231875367 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:27:35.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:35.032+0000 7fc09259c640 1 --2- 172.21.15.60:0/1231875367 >> v2:172.21.15.105:3300/0 conn(0x7fc0940c2e30 0x7fc0941567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:35.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:35.032+0000 7fc09359e640 1 -- 172.21.15.60:0/1231875367 >> v2:172.21.15.60:3300/0 conn(0x7fc0940c3d60 msgr2=0x7fc09414fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:27:35.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:35.032+0000 7fc09359e640 1 -- 172.21.15.60:0/1231875367 >> v2:172.21.15.60:3300/0 conn(0x7fc0940c3d60 msgr2=0x7fc09414fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:27:35.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:35.032+0000 7fc09359e640 1 --2- 172.21.15.60:0/1231875367 >> v2:172.21.15.60:3300/0 conn(0x7fc0940c3d60 0x7fc09414fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:27:35.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:35.032+0000 7fc09259c640 1 -- 172.21.15.60:0/1231875367 >> v2:172.21.15.105:3300/0 conn(0x7fc0940c2e30 msgr2=0x7fc0941567b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:27:35.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:35.032+0000 7fc09359e640 1 --2- 172.21.15.60:0/1231875367 >> v2:172.21.15.60:3300/0 conn(0x7fc0940c3d60 0x7fc09414fba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:27:35.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:35.032+0000 7fc09259c640 1 -- 172.21.15.60:0/1231875367 >> v2:172.21.15.105:3300/0 conn(0x7fc0940c2e30 msgr2=0x7fc0941567b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:27:35.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:35.032+0000 7fc09259c640 1 --2- 172.21.15.60:0/1231875367 >> v2:172.21.15.105:3300/0 conn(0x7fc0940c2e30 0x7fc0941567b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:27:35.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:35.032+0000 7fc09259c640 1 --2- 172.21.15.60:0/1231875367 >> v2:172.21.15.105:3300/0 conn(0x7fc0940c2e30 0x7fc0941567b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:27:35.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:35.233+0000 7fc092d9d640 1 -- 172.21.15.60:0/1231875367 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0940aba60 msgr2=0x7fc094153390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:27:35.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:35.233+0000 7fc092d9d640 1 --2- 172.21.15.60:0/1231875367 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0940aba60 0x7fc094153390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:27:35.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:35.233+0000 7fc09359e640 1 --2- 172.21.15.60:0/1231875367 >> v2:172.21.15.60:3300/0 conn(0x7fc0940c3d60 0x7fc09414fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:35.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:35.233+0000 7fc09259c640 1 --2- 172.21.15.60:0/1231875367 >> v2:172.21.15.105:3300/0 conn(0x7fc0940c2e30 0x7fc0941567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:35.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:35.233+0000 7fc09359e640 1 -- 172.21.15.60:0/1231875367 >> v2:172.21.15.60:3300/0 conn(0x7fc0940c3d60 msgr2=0x7fc09414fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:27:35.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:35.233+0000 7fc09359e640 1 -- 172.21.15.60:0/1231875367 >> v2:172.21.15.60:3300/0 conn(0x7fc0940c3d60 msgr2=0x7fc09414fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:27:35.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:35.233+0000 7fc09359e640 1 --2- 172.21.15.60:0/1231875367 >> v2:172.21.15.60:3300/0 conn(0x7fc0940c3d60 0x7fc09414fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:27:35.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:35.233+0000 7fc09359e640 1 --2- 172.21.15.60:0/1231875367 >> v2:172.21.15.60:3300/0 conn(0x7fc0940c3d60 0x7fc09414fba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:27:35.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:35.233+0000 7fc09259c640 1 -- 172.21.15.60:0/1231875367 >> v2:172.21.15.105:3300/0 conn(0x7fc0940c2e30 msgr2=0x7fc0941567b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:27:35.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:35.233+0000 7fc09259c640 1 -- 172.21.15.60:0/1231875367 >> v2:172.21.15.105:3300/0 conn(0x7fc0940c2e30 msgr2=0x7fc0941567b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:27:35.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:35.233+0000 7fc09259c640 1 --2- 172.21.15.60:0/1231875367 >> v2:172.21.15.105:3300/0 conn(0x7fc0940c2e30 0x7fc0941567b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:27:35.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:35.233+0000 7fc09259c640 1 --2- 172.21.15.60:0/1231875367 >> v2:172.21.15.105:3300/0 conn(0x7fc0940c2e30 0x7fc0941567b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:27:35.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:35.634+0000 7fc092d9d640 1 -- 172.21.15.60:0/1231875367 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0940aba60 msgr2=0x7fc094153390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:27:35.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:35.634+0000 7fc092d9d640 1 --2- 172.21.15.60:0/1231875367 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0940aba60 0x7fc094153390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:27:35.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:35.634+0000 7fc09359e640 1 --2- 172.21.15.60:0/1231875367 >> v2:172.21.15.60:3300/0 conn(0x7fc0940c3d60 0x7fc09414fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:35.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:35.634+0000 7fc09259c640 1 --2- 172.21.15.60:0/1231875367 >> v2:172.21.15.105:3300/0 conn(0x7fc0940c2e30 0x7fc0941567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:35.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:35.634+0000 7fc09359e640 1 -- 172.21.15.60:0/1231875367 >> v2:172.21.15.60:3300/0 conn(0x7fc0940c3d60 msgr2=0x7fc09414fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:27:35.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:35.634+0000 7fc09359e640 1 -- 172.21.15.60:0/1231875367 >> v2:172.21.15.60:3300/0 conn(0x7fc0940c3d60 msgr2=0x7fc09414fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:27:35.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:35.634+0000 7fc09359e640 1 --2- 172.21.15.60:0/1231875367 >> v2:172.21.15.60:3300/0 conn(0x7fc0940c3d60 0x7fc09414fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:27:35.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:35.634+0000 7fc09359e640 1 --2- 172.21.15.60:0/1231875367 >> v2:172.21.15.60:3300/0 conn(0x7fc0940c3d60 0x7fc09414fba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:27:35.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:35.634+0000 7fc09259c640 1 -- 172.21.15.60:0/1231875367 >> v2:172.21.15.105:3300/0 conn(0x7fc0940c2e30 msgr2=0x7fc0941567b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:27:35.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:35.634+0000 7fc09259c640 1 -- 172.21.15.60:0/1231875367 >> v2:172.21.15.105:3300/0 conn(0x7fc0940c2e30 msgr2=0x7fc0941567b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:27:35.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:35.634+0000 7fc09259c640 1 --2- 172.21.15.60:0/1231875367 >> v2:172.21.15.105:3300/0 conn(0x7fc0940c2e30 0x7fc0941567b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:27:35.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:35.634+0000 7fc09259c640 1 --2- 172.21.15.60:0/1231875367 >> v2:172.21.15.105:3300/0 conn(0x7fc0940c2e30 0x7fc0941567b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:27:36.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:36.435+0000 7fc092d9d640 1 -- 172.21.15.60:0/1231875367 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0940aba60 msgr2=0x7fc094153390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:27:36.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:36.435+0000 7fc092d9d640 1 --2- 172.21.15.60:0/1231875367 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0940aba60 0x7fc094153390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:27:36.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:36.435+0000 7fc09359e640 1 --2- 172.21.15.60:0/1231875367 >> v2:172.21.15.60:3300/0 conn(0x7fc0940c3d60 0x7fc09414fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:36.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:36.435+0000 7fc09259c640 1 --2- 172.21.15.60:0/1231875367 >> v2:172.21.15.105:3300/0 conn(0x7fc0940c2e30 0x7fc0941567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:36.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:36.435+0000 7fc09359e640 1 -- 172.21.15.60:0/1231875367 >> v2:172.21.15.60:3300/0 conn(0x7fc0940c3d60 msgr2=0x7fc09414fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:27:36.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:36.435+0000 7fc09359e640 1 -- 172.21.15.60:0/1231875367 >> v2:172.21.15.60:3300/0 conn(0x7fc0940c3d60 msgr2=0x7fc09414fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:27:36.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:36.435+0000 7fc09359e640 1 --2- 172.21.15.60:0/1231875367 >> v2:172.21.15.60:3300/0 conn(0x7fc0940c3d60 0x7fc09414fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:27:36.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:36.435+0000 7fc09359e640 1 --2- 172.21.15.60:0/1231875367 >> v2:172.21.15.60:3300/0 conn(0x7fc0940c3d60 0x7fc09414fba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:27:36.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:36.435+0000 7fc09259c640 1 -- 172.21.15.60:0/1231875367 >> v2:172.21.15.105:3300/0 conn(0x7fc0940c2e30 msgr2=0x7fc0941567b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:27:36.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:36.435+0000 7fc09259c640 1 -- 172.21.15.60:0/1231875367 >> v2:172.21.15.105:3300/0 conn(0x7fc0940c2e30 msgr2=0x7fc0941567b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:27:36.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:36.435+0000 7fc09259c640 1 --2- 172.21.15.60:0/1231875367 >> v2:172.21.15.105:3300/0 conn(0x7fc0940c2e30 0x7fc0941567b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:27:36.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:36.435+0000 7fc09259c640 1 --2- 172.21.15.60:0/1231875367 >> v2:172.21.15.105:3300/0 conn(0x7fc0940c2e30 0x7fc0941567b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:27:38.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:38.032+0000 7fc090d99640 1 -- 172.21.15.60:0/1231875367 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0940aba60 msgr2=0x7fc094153390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:27:38.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:38.032+0000 7fc090d99640 1 --2- 172.21.15.60:0/1231875367 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0940aba60 0x7fc094153390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:38.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:38.032+0000 7fc090d99640 1 -- 172.21.15.60:0/1231875367 >> v2:172.21.15.105:3300/0 conn(0x7fc0940c2e30 msgr2=0x7fc0941567b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:27:38.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:38.032+0000 7fc090d99640 1 --2- 172.21.15.60:0/1231875367 >> v2:172.21.15.105:3300/0 conn(0x7fc0940c2e30 0x7fc0941567b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:38.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:38.032+0000 7fc090d99640 1 -- 172.21.15.60:0/1231875367 >> v2:172.21.15.60:3300/0 conn(0x7fc0940c3d60 msgr2=0x7fc09414fba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:27:38.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:38.032+0000 7fc090d99640 1 --2- 172.21.15.60:0/1231875367 >> v2:172.21.15.60:3300/0 conn(0x7fc0940c3d60 0x7fc09414fba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:38.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:38.032+0000 7fc090d99640 1 -- 172.21.15.60:0/1231875367 --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc094156290 con 0x7fc0800073c0 2024-09-12T02:27:38.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:38.032+0000 7fc090d99640 1 -- 172.21.15.60:0/1231875367 --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc08000c140 con 0x7fc080003690 2024-09-12T02:27:39.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.223+0000 7fc091d9b640 1 -- 172.21.15.60:0/1231875367 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2237269696 0 0) 0x7fc08000c140 con 0x7fc080003690 2024-09-12T02:27:39.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.223+0000 7fc091d9b640 1 -- 172.21.15.60:0/1231875367 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc07c003520 con 0x7fc080003690 2024-09-12T02:27:39.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.223+0000 7fc091d9b640 1 -- 172.21.15.60:0/1231875367 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1611232539 0 0) 0x7fc07c003520 con 0x7fc080003690 2024-09-12T02:27:39.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.223+0000 7fc091d9b640 1 -- 172.21.15.60:0/1231875367 >> v1:172.21.15.60:6789/0 conn(0x7fc0800073c0 legacy=0x7fc080009880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:39.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.223+0000 7fc091d9b640 1 -- 172.21.15.60:0/1231875367 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc08000d440 con 0x7fc080003690 2024-09-12T02:27:39.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.223+0000 7fc091d9b640 1 -- 172.21.15.60:0/1231875367 <== mon.1 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7fc084004340 con 0x7fc080003690 2024-09-12T02:27:39.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.223+0000 7fc091d9b640 1 -- 172.21.15.60:0/1231875367 >> v1:172.21.15.105:6789/0 conn(0x7fc080003690 legacy=0x7fc080005b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:39.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.224+0000 7fc091d9b640 1 --2- 172.21.15.60:0/1231875367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc07c0039b0 0x7fc07c003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:39.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.224+0000 7fc091d9b640 1 --2- 172.21.15.60:0/1231875367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc07c004800 0x7fc07c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:39.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.224+0000 7fc091d9b640 1 --2- 172.21.15.60:0/1231875367 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0940aba60 0x7fc07c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:39.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.224+0000 7fc091d9b640 1 -- 172.21.15.60:0/1231875367 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc07c005530 con 0x7fc07c0039b0 2024-09-12T02:27:39.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.224+0000 7fc091d9b640 1 -- 172.21.15.60:0/1231875367 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc07c00bf00 con 0x7fc07c004800 2024-09-12T02:27:39.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.224+0000 7fc091d9b640 1 -- 172.21.15.60:0/1231875367 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc07c00c080 con 0x7fc0940aba60 2024-09-12T02:27:39.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.224+0000 7fc09359e640 1 -- 172.21.15.60:0/1231875367 reap_dead start 2024-09-12T02:27:39.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.224+0000 7fc09359e640 1 -- 172.21.15.60:0/1231875367 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0940aba60 msgr2=0x7fc07c00b9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:27:39.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.224+0000 7fc09359e640 1 --2- 172.21.15.60:0/1231875367 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0940aba60 0x7fc07c00b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:27:39.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.224+0000 7fc09259c640 1 --2- 172.21.15.60:0/1231875367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc07c004800 0x7fc07c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:39.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.224+0000 7fc09259c640 1 -- 172.21.15.60:0/1231875367 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0940aba60 msgr2=0x7fc07c00b9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:27:39.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.224+0000 7fc09259c640 1 --2- 172.21.15.60:0/1231875367 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0940aba60 0x7fc07c00b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:39.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.224+0000 7fc09259c640 1 -- 172.21.15.60:0/1231875367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc07c0039b0 msgr2=0x7fc07c003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:27:39.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.224+0000 7fc09259c640 1 --2- 172.21.15.60:0/1231875367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc07c0039b0 0x7fc07c003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:39.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.224+0000 7fc09259c640 1 -- 172.21.15.60:0/1231875367 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc08000d440 con 0x7fc07c004800 2024-09-12T02:27:39.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.225+0000 7fc09259c640 1 --2- 172.21.15.60:0/1231875367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc07c004800 0x7fc07c004c80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc0940c29f0 tx=0x7fc07c005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83881735a939686d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:39.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.226+0000 7fc091d9b640 1 -- 172.21.15.60:0/1231875367 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc088031070 con 0x7fc07c004800 2024-09-12T02:27:39.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.226+0000 7fc091d9b640 1 -- 172.21.15.60:0/1231875367 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc08802f070 con 0x7fc07c004800 2024-09-12T02:27:39.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.226+0000 7fc091d9b640 1 -- 172.21.15.60:0/1231875367 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc088011720 con 0x7fc07c004800 2024-09-12T02:27:39.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.226+0000 7fc099142640 1 -- 172.21.15.60:0/1231875367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc07c004800 msgr2=0x7fc07c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:39.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.226+0000 7fc099142640 1 --2- 172.21.15.60:0/1231875367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc07c004800 0x7fc07c004c80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc0940c29f0 tx=0x7fc07c005830 comp rx=0 tx=0).stop 2024-09-12T02:27:39.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.227+0000 7fc099142640 1 -- 172.21.15.60:0/1231875367 shutdown_connections 2024-09-12T02:27:39.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.227+0000 7fc099142640 1 --2- 172.21.15.60:0/1231875367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc07c0039b0 0x7fc07c003db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:39.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.227+0000 7fc099142640 1 --2- 172.21.15.60:0/1231875367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc07c004800 0x7fc07c004c80 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:39.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.227+0000 7fc099142640 1 --2- 172.21.15.60:0/1231875367 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0940aba60 0x7fc07c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:39.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.227+0000 7fc099142640 1 -- 172.21.15.60:0/1231875367 >> 172.21.15.60:0/1231875367 conn(0x7fc0940c8430 msgr2=0x7fc0940c8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:39.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.227+0000 7fc099142640 1 -- 172.21.15.60:0/1231875367 shutdown_connections 2024-09-12T02:27:39.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.227+0000 7fc099142640 1 -- 172.21.15.60:0/1231875367 wait complete. 2024-09-12T02:27:39.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.229+0000 7fc099142640 1 Processor -- start 2024-09-12T02:27:39.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.229+0000 7fc099142640 1 -- start start 2024-09-12T02:27:39.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.230+0000 7fc099142640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc07c0039b0 0x7fc0941f3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:39.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.230+0000 7fc099142640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc07c004800 0x7fc0941de000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:39.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.230+0000 7fc099142640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0940aba60 0x7fc0941de540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:39.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.230+0000 7fc09259c640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc07c004800 msgr2=0x7fc0941de000 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:27:39.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.230+0000 7fc09259c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc07c004800 0x7fc0941de000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:27:39.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.230+0000 7fc099142640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc0940c4190 con 0x7fc0940aba60 2024-09-12T02:27:39.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.230+0000 7fc099142640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc0940ac050 con 0x7fc07c0039b0 2024-09-12T02:27:39.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.230+0000 7fc099142640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc0940c4310 con 0x7fc07c004800 2024-09-12T02:27:39.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.230+0000 7fc09359e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0940aba60 0x7fc0941de540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:39.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.230+0000 7fc09359e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0940aba60 0x7fc0941de540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38444/0 (socket says 172.21.15.60:38444) 2024-09-12T02:27:39.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.230+0000 7fc09359e640 1 -- 172.21.15.60:0/2736970616 learned_addr learned my addr 172.21.15.60:0/2736970616 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:27:39.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.230+0000 7fc092d9d640 1 --2- 172.21.15.60:0/2736970616 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc07c0039b0 0x7fc0941f3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:39.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.230+0000 7fc09359e640 1 -- 172.21.15.60:0/2736970616 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc07c004800 msgr2=0x7fc0941de000 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:27:39.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.230+0000 7fc09359e640 1 --2- 172.21.15.60:0/2736970616 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc07c004800 0x7fc0941de000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:39.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.230+0000 7fc09359e640 1 -- 172.21.15.60:0/2736970616 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc07c0039b0 msgr2=0x7fc0941f3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:39.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.230+0000 7fc09359e640 1 --2- 172.21.15.60:0/2736970616 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc07c0039b0 0x7fc0941f3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:39.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.230+0000 7fc09359e640 1 -- 172.21.15.60:0/2736970616 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc094071820 con 0x7fc0940aba60 2024-09-12T02:27:39.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.231+0000 7fc09359e640 1 --2- 172.21.15.60:0/2736970616 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0940aba60 0x7fc0941de540 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc08c00b8e0 tx=0x7fc08c0075c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:39.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.232+0000 7fc07b7fe640 1 -- 172.21.15.60:0/2736970616 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc08c01b020 con 0x7fc0940aba60 2024-09-12T02:27:39.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.232+0000 7fc099142640 1 -- 172.21.15.60:0/2736970616 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0941f3ca0 con 0x7fc0940aba60 2024-09-12T02:27:39.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.232+0000 7fc07b7fe640 1 -- 172.21.15.60:0/2736970616 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc08c00de90 con 0x7fc0940aba60 2024-09-12T02:27:39.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.232+0000 7fc07b7fe640 1 -- 172.21.15.60:0/2736970616 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc08c00bb50 con 0x7fc0940aba60 2024-09-12T02:27:39.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.232+0000 7fc099142640 1 -- 172.21.15.60:0/2736970616 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc094074860 con 0x7fc0940aba60 2024-09-12T02:27:39.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.233+0000 7fc099142640 1 -- 172.21.15.60:0/2736970616 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc094153390 con 0x7fc0940aba60 2024-09-12T02:27:39.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.234+0000 7fc07b7fe640 1 -- 172.21.15.60:0/2736970616 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc08c01e020 con 0x7fc0940aba60 2024-09-12T02:27:39.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.234+0000 7fc07b7fe640 1 --2- 172.21.15.60:0/2736970616 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc08006c910 0x7fc08006edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:39.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.234+0000 7fc07b7fe640 1 -- 172.21.15.60:0/2736970616 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fc08c08bc60 con 0x7fc0940aba60 2024-09-12T02:27:39.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.234+0000 7fc092d9d640 1 --2- 172.21.15.60:0/2736970616 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc08006c910 0x7fc08006edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:39.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.235+0000 7fc092d9d640 1 --2- 172.21.15.60:0/2736970616 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc08006c910 0x7fc08006edd0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc09414eb50 tx=0x7fc084009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:39.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.239+0000 7fc07b7fe640 1 -- 172.21.15.60:0/2736970616 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc08c025020 con 0x7fc0940aba60 2024-09-12T02:27:39.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.517+0000 7fc099142640 1 -- 172.21.15.60:0/2736970616 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc09414f610 con 0x7fc0940aba60 2024-09-12T02:27:39.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.517+0000 7fc07b7fe640 1 -- 172.21.15.60:0/2736970616 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7fc094071820 con 0x7fc0940aba60 2024-09-12T02:27:39.518 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":40,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:27:39.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.520+0000 7fc099142640 1 -- 172.21.15.60:0/2736970616 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc08006c910 msgr2=0x7fc08006edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:39.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.520+0000 7fc099142640 1 --2- 172.21.15.60:0/2736970616 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc08006c910 0x7fc08006edd0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc09414eb50 tx=0x7fc084009040 comp rx=0 tx=0).stop 2024-09-12T02:27:39.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.520+0000 7fc099142640 1 -- 172.21.15.60:0/2736970616 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0940aba60 msgr2=0x7fc0941de540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:39.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.520+0000 7fc099142640 1 --2- 172.21.15.60:0/2736970616 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0940aba60 0x7fc0941de540 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc08c00b8e0 tx=0x7fc08c0075c0 comp rx=0 tx=0).stop 2024-09-12T02:27:39.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.520+0000 7fc099142640 1 -- 172.21.15.60:0/2736970616 shutdown_connections 2024-09-12T02:27:39.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.520+0000 7fc099142640 1 --2- 172.21.15.60:0/2736970616 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc08006c910 0x7fc08006edd0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:39.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.520+0000 7fc099142640 1 --2- 172.21.15.60:0/2736970616 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0940aba60 0x7fc0941de540 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:39.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.520+0000 7fc099142640 1 --2- 172.21.15.60:0/2736970616 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc07c004800 0x7fc0941de000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:39.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.520+0000 7fc099142640 1 --2- 172.21.15.60:0/2736970616 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc07c0039b0 0x7fc0941f3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:39.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.520+0000 7fc099142640 1 -- 172.21.15.60:0/2736970616 >> 172.21.15.60:0/2736970616 conn(0x7fc0940c8430 msgr2=0x7fc09414fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:39.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.520+0000 7fc099142640 1 -- 172.21.15.60:0/2736970616 shutdown_connections 2024-09-12T02:27:39.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.520+0000 7fc099142640 1 -- 172.21.15.60:0/2736970616 wait complete. 2024-09-12T02:27:39.532 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-12T02:27:39.532 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-09-12T02:27:39.532 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-12T02:27:39.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.641+0000 7f64a20ba640 1 Processor -- start 2024-09-12T02:27:39.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.641+0000 7f64a20ba640 1 -- start start 2024-09-12T02:27:39.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.642+0000 7f64a20ba640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f649c0733d0 0x7f649c156840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:39.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.642+0000 7f64a20ba640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f649c06d850 0x7f649c156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:39.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.642+0000 7f64a20ba640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f649c06dd50 con 0x7f649c073ae0 2024-09-12T02:27:39.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.642+0000 7f64a20ba640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f649c06e030 con 0x7f649c0733d0 2024-09-12T02:27:39.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.642+0000 7f64a20ba640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f649c06e310 con 0x7f649c06d850 2024-09-12T02:27:39.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.642+0000 7f649bfff640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f649c06d850 msgr2=0x7f649c156d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:27:39.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.642+0000 7f649bfff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f649c06d850 0x7f649c156d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:27:39.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.642+0000 7f649affd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f649c0733d0 0x7f649c156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:39.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.642+0000 7f649affd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f649c0733d0 0x7f649c156840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:58710/0 (socket says 172.21.15.60:58710) 2024-09-12T02:27:39.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.642+0000 7f649affd640 1 -- 172.21.15.60:0/1066353209 learned_addr learned my addr 172.21.15.60:0/1066353209 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:27:39.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.643+0000 7f649affd640 1 -- 172.21.15.60:0/1066353209 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f649c06d850 msgr2=0x7f649c156d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:27:39.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.643+0000 7f649affd640 1 --2- 172.21.15.60:0/1066353209 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f649c06d850 0x7f649c156d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:39.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.643+0000 7f649affd640 1 -- 172.21.15.60:0/1066353209 >> v1:172.21.15.105:6789/0 conn(0x7f649c073ae0 legacy=0x7f649c153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:39.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.643+0000 7f649affd640 1 -- 172.21.15.60:0/1066353209 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f649c06e5f0 con 0x7f649c0733d0 2024-09-12T02:27:39.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.643+0000 7f649affd640 1 --2- 172.21.15.60:0/1066353209 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f649c0733d0 0x7f649c156840 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6490009870 tx=0x7f649002a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84ae3e05841d11bb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:39.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.644+0000 7f649a7fc640 1 -- 172.21.15.60:0/1066353209 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6490037070 con 0x7f649c0733d0 2024-09-12T02:27:39.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.644+0000 7f649a7fc640 1 -- 172.21.15.60:0/1066353209 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6490032440 con 0x7f649c0733d0 2024-09-12T02:27:39.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.644+0000 7f649a7fc640 1 -- 172.21.15.60:0/1066353209 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6490032810 con 0x7f649c0733d0 2024-09-12T02:27:39.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.644+0000 7f64a20ba640 1 -- 172.21.15.60:0/1066353209 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f649c0733d0 msgr2=0x7f649c156840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:39.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.644+0000 7f64a20ba640 1 --2- 172.21.15.60:0/1066353209 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f649c0733d0 0x7f649c156840 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6490009870 tx=0x7f649002a1e0 comp rx=0 tx=0).stop 2024-09-12T02:27:39.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.644+0000 7f64a20ba640 1 -- 172.21.15.60:0/1066353209 shutdown_connections 2024-09-12T02:27:39.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.644+0000 7f64a20ba640 1 --2- 172.21.15.60:0/1066353209 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f649c06d850 0x7f649c156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:39.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.644+0000 7f64a20ba640 1 --2- 172.21.15.60:0/1066353209 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f649c0733d0 0x7f649c156840 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:39.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.644+0000 7f64a20ba640 1 -- 172.21.15.60:0/1066353209 >> 172.21.15.60:0/1066353209 conn(0x7f649c0c9d80 msgr2=0x7f649c0ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:39.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.644+0000 7f64a20ba640 1 -- 172.21.15.60:0/1066353209 shutdown_connections 2024-09-12T02:27:39.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.644+0000 7f64a20ba640 1 -- 172.21.15.60:0/1066353209 wait complete. 2024-09-12T02:27:39.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.645+0000 7f64a20ba640 1 Processor -- start 2024-09-12T02:27:39.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.646+0000 7f64a20ba640 1 -- start start 2024-09-12T02:27:39.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.646+0000 7f64a20ba640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f649c06d850 0x7f649c14e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:39.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.646+0000 7f64a20ba640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f649c0733d0 0x7f649c1502f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:39.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.646+0000 7f64a20ba640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f649c073ae0 0x7f649c13a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:39.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.646+0000 7f64a20ba640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f649c06edd0 con 0x7f649c073ae0 2024-09-12T02:27:39.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.646+0000 7f64a20ba640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f649c06ec50 con 0x7f649c0733d0 2024-09-12T02:27:39.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.646+0000 7f64a20ba640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f649c153a90 con 0x7f649c06d850 2024-09-12T02:27:39.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.647+0000 7f649b7fe640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f649c06d850 msgr2=0x7f649c14e150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:27:39.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.647+0000 7f649b7fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f649c06d850 0x7f649c14e150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:27:39.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.647+0000 7f649affd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f649c0733d0 0x7f649c1502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:39.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.647+0000 7f649affd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f649c0733d0 0x7f649c1502f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:58722/0 (socket says 172.21.15.60:58722) 2024-09-12T02:27:39.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.647+0000 7f649bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f649c073ae0 0x7f649c13a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:39.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.647+0000 7f649affd640 1 -- 172.21.15.60:0/3706713057 learned_addr learned my addr 172.21.15.60:0/3706713057 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:27:39.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.647+0000 7f649bfff640 1 -- 172.21.15.60:0/3706713057 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f649c06d850 msgr2=0x7f649c14e150 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:27:39.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.647+0000 7f649bfff640 1 --2- 172.21.15.60:0/3706713057 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f649c06d850 0x7f649c14e150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:39.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.647+0000 7f649bfff640 1 -- 172.21.15.60:0/3706713057 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f649c0733d0 msgr2=0x7f649c1502f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:39.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.647+0000 7f649bfff640 1 --2- 172.21.15.60:0/3706713057 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f649c0733d0 0x7f649c1502f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:39.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.647+0000 7f649bfff640 1 -- 172.21.15.60:0/3706713057 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f649c14f7f0 con 0x7f649c073ae0 2024-09-12T02:27:39.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.647+0000 7f649affd640 1 --2- 172.21.15.60:0/3706713057 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f649c0733d0 0x7f649c1502f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:27:39.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.647+0000 7f649bfff640 1 --2- 172.21.15.60:0/3706713057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f649c073ae0 0x7f649c13a4c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f649400bd80 tx=0x7f6494009ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:39.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.647+0000 7f6483fff640 1 -- 172.21.15.60:0/3706713057 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649400ce10 con 0x7f649c073ae0 2024-09-12T02:27:39.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.647+0000 7f6483fff640 1 -- 172.21.15.60:0/3706713057 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6494010070 con 0x7f649c073ae0 2024-09-12T02:27:39.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.647+0000 7f6483fff640 1 -- 172.21.15.60:0/3706713057 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64940156b0 con 0x7f649c073ae0 2024-09-12T02:27:39.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.647+0000 7f64a20ba640 1 -- 172.21.15.60:0/3706713057 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f649c14fa90 con 0x7f649c073ae0 2024-09-12T02:27:39.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.648+0000 7f64a20ba640 1 -- 172.21.15.60:0/3706713057 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f649c14e690 con 0x7f649c073ae0 2024-09-12T02:27:39.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.648+0000 7f64a20ba640 1 --2- 172.21.15.60:0/3706713057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f649c13aa00 0x7f649c154720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:39.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.648+0000 7f64a20ba640 1 -- 172.21.15.60:0/3706713057 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f649c0c9a50 con 0x7f649c13aa00 2024-09-12T02:27:39.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.649+0000 7f649b7fe640 1 --2- 172.21.15.60:0/3706713057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f649c13aa00 0x7f649c154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:39.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.649+0000 7f649b7fe640 1 -- 172.21.15.60:0/3706713057 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f649c073ec0 con 0x7f649c13aa00 2024-09-12T02:27:39.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.649+0000 7f649b7fe640 1 --2- 172.21.15.60:0/3706713057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f649c13aa00 0x7f649c154720 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f648c001030 tx=0x7f648c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:39.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.649+0000 7f6483fff640 1 -- 172.21.15.60:0/3706713057 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648c0074e0 con 0x7f649c13aa00 2024-09-12T02:27:39.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.649+0000 7f6483fff640 1 -- 172.21.15.60:0/3706713057 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6494015850 con 0x7f649c073ae0 2024-09-12T02:27:39.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.650+0000 7f6483fff640 1 --2- 172.21.15.60:0/3706713057 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f648806bd30 0x7f648806e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:39.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.650+0000 7f6483fff640 1 -- 172.21.15.60:0/3706713057 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f649408b530 con 0x7f649c073ae0 2024-09-12T02:27:39.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.650+0000 7f649affd640 1 --2- 172.21.15.60:0/3706713057 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f648806bd30 0x7f648806e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:39.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.650+0000 7f6483fff640 1 -- 172.21.15.60:0/3706713057 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f648c004020 con 0x7f649c13aa00 2024-09-12T02:27:39.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.650+0000 7f6483fff640 1 -- 172.21.15.60:0/3706713057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f649c13aa00 msgr2=0x7f649c154720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:39.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.650+0000 7f6483fff640 1 --2- 172.21.15.60:0/3706713057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f649c13aa00 0x7f649c154720 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f648c001030 tx=0x7f648c00c810 comp rx=0 tx=0).stop 2024-09-12T02:27:39.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.650+0000 7f6483fff640 1 -- 172.21.15.60:0/3706713057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f649c13aa00 msgr2=0x7f649c154720 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:27:39.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.650+0000 7f6483fff640 1 --2- 172.21.15.60:0/3706713057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f649c13aa00 0x7f649c154720 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:39.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.651+0000 7f649affd640 1 --2- 172.21.15.60:0/3706713057 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f648806bd30 0x7f648806e1f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6490035040 tx=0x7f649002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:39.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.660+0000 7f64a20ba640 1 --2- 172.21.15.60:0/3706713057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f649c154c60 0x7f649c155040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:39.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.660+0000 7f64a20ba640 1 -- 172.21.15.60:0/3706713057 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f649c154080 con 0x7f649c154c60 2024-09-12T02:27:39.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.660+0000 7f649b7fe640 1 --2- 172.21.15.60:0/3706713057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f649c154c60 0x7f649c155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:39.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.661+0000 7f649b7fe640 1 -- 172.21.15.60:0/3706713057 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f649c14ffb0 con 0x7f649c154c60 2024-09-12T02:27:39.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.661+0000 7f649b7fe640 1 --2- 172.21.15.60:0/3706713057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f649c154c60 0x7f649c155040 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f648c001eb0 tx=0x7f648c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:39.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.661+0000 7f6483fff640 1 -- 172.21.15.60:0/3706713057 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648c019880 con 0x7f649c154c60 2024-09-12T02:27:39.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.661+0000 7f6483fff640 1 -- 172.21.15.60:0/3706713057 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4873 (secure 0 0 0) 0x7f648c019880 con 0x7f649c154c60 2024-09-12T02:27:39.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.661+0000 7f6483fff640 1 -- 172.21.15.60:0/3706713057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f649c154c60 msgr2=0x7f649c155040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:39.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.661+0000 7f6483fff640 1 --2- 172.21.15.60:0/3706713057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f649c154c60 0x7f649c155040 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f648c001eb0 tx=0x7f648c000ed0 comp rx=0 tx=0).stop 2024-09-12T02:27:39.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.661+0000 7f6483fff640 1 -- 172.21.15.60:0/3706713057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f649c154c60 msgr2=0x7f649c155040 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:27:39.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.661+0000 7f6483fff640 1 --2- 172.21.15.60:0/3706713057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f649c154c60 0x7f649c155040 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:39.663 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:27:39.663 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:27:39.663 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:27:39.663 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:27:39.663 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 40, 2024-09-12T02:27:39.663 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 99771, 2024-09-12T02:27:39.663 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:27:39.663 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:27:39.663 INFO:teuthology.orchestra.run.smithi060.stdout: 1 2024-09-12T02:27:39.663 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:27:39.663 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-09-12T02:27:39.663 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:27:39.664 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:27:39.664 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:27:39.664 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:27:39.664 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:27:39.664 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:27:39.664 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:27:39.664 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:27:39.664 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:27:39.664 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:27:39.664 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:27:39.664 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:27:39.664 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:27:39.664 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:27:39.665 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:27:39.665 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:27:39.665 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:27:39.665 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:27:39.665 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:27:39.665 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:27:39.665 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:27:39.665 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:27:39.665 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:27:39.665 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:27:39.665 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:27:39.665 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:27:39.665 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:27:39.666 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:27:39.666 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:39.666 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:39.666 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:27:39.666 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:27:39.666 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:27:39.666 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:27:39.666 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:27:39.666 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:27:39.666 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:27:39.667 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:27:39.667 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:27:39.667 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:27:39.667 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:27:39.667 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:27:39.667 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:27:39.668 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:27:39.668 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:27:39.668 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:27:39.668 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:27:39.668 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:27:39.668 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:27:39.669 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:27:39.669 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:27:39.669 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:27:39.669 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:27:39.669 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:27:39.669 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:27:39.669 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:27:39.670 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:27:39.670 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:27:39.670 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:27:39.670 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:27:39.670 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:39.670 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:27:39.671 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:39.671 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:27:39.671 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:27:39.671 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:27:39.671 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:27:39.671 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:39.671 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:27:39.672 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:27:39.672 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:39.672 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:39.672 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:39.672 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:27:39.672 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:27:39.673 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:39.673 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:39.673 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:39.673 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:39.673 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:27:39.673 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:27:39.674 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:27:39.674 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:27:39.674 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:27:39.674 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:39.674 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:39.674 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:27:39.675 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:27:39.675 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:27:39.675 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:27:39.675 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:39.675 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:27:39.675 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:27:39.676 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:39.676 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:39.676 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:39.676 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:27:39.676 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:27:39.676 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:39.677 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:39.677 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:39.677 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:39.677 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:27:39.677 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:27:39.677 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:27:39.677 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:27:39.678 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:27:39.678 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:39.678 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:39.678 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:27:39.678 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:27:39.678 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:27:39.679 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:27:39.679 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:39.679 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:27:39.679 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:27:39.679 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:39.679 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:39.680 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:39.680 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:27:39.680 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:27:39.680 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:39.680 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:39.680 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:39.681 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:39.681 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:27:39.681 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:27:39.681 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:27:39.681 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:27:39.681 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:27:39.682 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:39.682 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:39.682 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:39.682 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:27:39.682 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:27:39.682 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:39.683 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:27:39.683 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:27:39.683 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:27:39.683 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:39.683 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:27:39.683 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:27:39.683 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:39.684 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:27:39.684 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:27:39.684 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:27:39.684 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:39.684 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:27:39.684 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:27:39.685 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:39.685 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:27:39.685 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:27:39.685 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:27:39.685 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:39.686 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:27:39.686 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:27:39.686 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:39.686 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:27:39.686 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:27:39.686 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:27:39.687 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:39.687 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:39.687 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:39.687 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:27:39.687 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:27:39.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.662+0000 7f64a20ba640 1 -- 172.21.15.60:0/3706713057 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f648806bd30 msgr2=0x7f648806e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:39.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.662+0000 7f64a20ba640 1 --2- 172.21.15.60:0/3706713057 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f648806bd30 0x7f648806e1f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6490035040 tx=0x7f649002e000 comp rx=0 tx=0).stop 2024-09-12T02:27:39.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.662+0000 7f64a20ba640 1 -- 172.21.15.60:0/3706713057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f649c073ae0 msgr2=0x7f649c13a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:39.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.662+0000 7f64a20ba640 1 --2- 172.21.15.60:0/3706713057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f649c073ae0 0x7f649c13a4c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f649400bd80 tx=0x7f6494009ef0 comp rx=0 tx=0).stop 2024-09-12T02:27:39.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.662+0000 7f649bfff640 1 -- 172.21.15.60:0/3706713057 reap_dead start 2024-09-12T02:27:39.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.662+0000 7f649bfff640 1 -- 172.21.15.60:0/3706713057 reap_dead start 2024-09-12T02:27:39.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.662+0000 7f64a20ba640 1 -- 172.21.15.60:0/3706713057 shutdown_connections 2024-09-12T02:27:39.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.662+0000 7f64a20ba640 1 -- 172.21.15.60:0/3706713057 >> 172.21.15.60:0/3706713057 conn(0x7f649c0c9d80 msgr2=0x7f649c156840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:39.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.662+0000 7f64a20ba640 1 -- 172.21.15.60:0/3706713057 shutdown_connections 2024-09-12T02:27:39.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.662+0000 7f64a20ba640 1 -- 172.21.15.60:0/3706713057 wait complete. 2024-09-12T02:27:39.690 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-12T02:27:39.690 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-12T02:27:39.690 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-12T02:27:39.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.803+0000 7f1a7430a640 1 Processor -- start 2024-09-12T02:27:39.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.803+0000 7f1a7430a640 1 -- start start 2024-09-12T02:27:39.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.804+0000 7f1a7430a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1a6c072ec0 0x7f1a6c153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:39.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.805+0000 7f1a7430a640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1a6c0c4ac0 0x7f1a6c070040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:39.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.805+0000 7f1a7430a640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a6c06efa0 con 0x7f1a6c0afc60 2024-09-12T02:27:39.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.805+0000 7f1a7430a640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f1a6c06f280 con 0x7f1a6c072ec0 2024-09-12T02:27:39.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.805+0000 7f1a7430a640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f1a6c06f560 con 0x7f1a6c0c4ac0 2024-09-12T02:27:39.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.805+0000 7f1a720a6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1a6c072ec0 0x7f1a6c153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:39.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.805+0000 7f1a720a6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1a6c072ec0 0x7f1a6c153ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42788/0 (socket says 172.21.15.60:42788) 2024-09-12T02:27:39.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.805+0000 7f1a720a6640 1 -- 172.21.15.60:0/3126856446 learned_addr learned my addr 172.21.15.60:0/3126856446 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:27:39.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.805+0000 7f1a718a5640 1 --2- 172.21.15.60:0/3126856446 >> v2:172.21.15.105:3300/0 conn(0x7f1a6c0c4ac0 0x7f1a6c070040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:39.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.805+0000 7f1a720a6640 1 -- 172.21.15.60:0/3126856446 >> v2:172.21.15.105:3300/0 conn(0x7f1a6c0c4ac0 msgr2=0x7f1a6c070040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:27:39.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.805+0000 7f1a720a6640 1 --2- 172.21.15.60:0/3126856446 >> v2:172.21.15.105:3300/0 conn(0x7f1a6c0c4ac0 0x7f1a6c070040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:39.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.805+0000 7f1a720a6640 1 -- 172.21.15.60:0/3126856446 >> v1:172.21.15.105:6789/0 conn(0x7f1a6c0afc60 legacy=0x7f1a6c151380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:39.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.805+0000 7f1a720a6640 1 -- 172.21.15.60:0/3126856446 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a6c06f840 con 0x7f1a6c072ec0 2024-09-12T02:27:39.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.806+0000 7f1a720a6640 1 --2- 172.21.15.60:0/3126856446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a6c072ec0 0x7f1a6c153ff0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c074760 tx=0x7f1a6802a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=710f3f9b7bf7b85 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:39.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.806+0000 7f1a710a4640 1 -- 172.21.15.60:0/3126856446 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a68037070 con 0x7f1a6c072ec0 2024-09-12T02:27:39.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.806+0000 7f1a710a4640 1 -- 172.21.15.60:0/3126856446 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a68032440 con 0x7f1a6c072ec0 2024-09-12T02:27:39.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.806+0000 7f1a710a4640 1 -- 172.21.15.60:0/3126856446 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a68032810 con 0x7f1a6c072ec0 2024-09-12T02:27:39.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.807+0000 7f1a7430a640 1 -- 172.21.15.60:0/3126856446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a6c072ec0 msgr2=0x7f1a6c153ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:39.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.807+0000 7f1a7430a640 1 --2- 172.21.15.60:0/3126856446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a6c072ec0 0x7f1a6c153ff0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c074760 tx=0x7f1a6802a160 comp rx=0 tx=0).stop 2024-09-12T02:27:39.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.807+0000 7f1a7430a640 1 -- 172.21.15.60:0/3126856446 shutdown_connections 2024-09-12T02:27:39.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.807+0000 7f1a7430a640 1 --2- 172.21.15.60:0/3126856446 >> v2:172.21.15.105:3300/0 conn(0x7f1a6c0c4ac0 0x7f1a6c070040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:39.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.807+0000 7f1a7430a640 1 --2- 172.21.15.60:0/3126856446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a6c072ec0 0x7f1a6c153ff0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:39.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.807+0000 7f1a7430a640 1 -- 172.21.15.60:0/3126856446 >> 172.21.15.60:0/3126856446 conn(0x7f1a6c0c9d80 msgr2=0x7f1a6c0ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:39.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.807+0000 7f1a7430a640 1 -- 172.21.15.60:0/3126856446 shutdown_connections 2024-09-12T02:27:39.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.807+0000 7f1a7430a640 1 -- 172.21.15.60:0/3126856446 wait complete. 2024-09-12T02:27:39.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.808+0000 7f1a7430a640 1 Processor -- start 2024-09-12T02:27:39.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.808+0000 7f1a7430a640 1 -- start start 2024-09-12T02:27:39.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.809+0000 7f1a7430a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a6c072ec0 0x7f1a6c06e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:39.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.809+0000 7f1a7430a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a6c0afc60 0x7f1a6c146d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:39.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.809+0000 7f1a7430a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a6c0c4ac0 0x7f1a6c14cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:39.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.809+0000 7f1a7430a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6c0732a0 con 0x7f1a6c072ec0 2024-09-12T02:27:39.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.809+0000 7f1a7430a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6c0c47f0 con 0x7f1a6c0afc60 2024-09-12T02:27:39.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.809+0000 7f1a7430a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1a6c073420 con 0x7f1a6c0c4ac0 2024-09-12T02:27:39.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.809+0000 7f1a720a6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a6c072ec0 0x7f1a6c06e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:39.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.809+0000 7f1a728a7640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a6c0c4ac0 msgr2=0x7f1a6c14cf60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:27:39.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.809+0000 7f1a728a7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a6c0c4ac0 0x7f1a6c14cf60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:27:39.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.809+0000 7f1a720a6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a6c072ec0 0x7f1a6c06e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42796/0 (socket says 172.21.15.60:42796) 2024-09-12T02:27:39.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.809+0000 7f1a720a6640 1 -- 172.21.15.60:0/2727696478 learned_addr learned my addr 172.21.15.60:0/2727696478 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:27:39.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.809+0000 7f1a718a5640 1 --2- 172.21.15.60:0/2727696478 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a6c0afc60 0x7f1a6c146d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:39.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.809+0000 7f1a720a6640 1 -- 172.21.15.60:0/2727696478 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a6c0c4ac0 msgr2=0x7f1a6c14cf60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:27:39.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.809+0000 7f1a720a6640 1 --2- 172.21.15.60:0/2727696478 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a6c0c4ac0 0x7f1a6c14cf60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:39.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.809+0000 7f1a720a6640 1 -- 172.21.15.60:0/2727696478 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a6c0afc60 msgr2=0x7f1a6c146d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:39.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.809+0000 7f1a720a6640 1 --2- 172.21.15.60:0/2727696478 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a6c0afc60 0x7f1a6c146d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:39.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.809+0000 7f1a720a6640 1 -- 172.21.15.60:0/2727696478 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a6c1474a0 con 0x7f1a6c072ec0 2024-09-12T02:27:39.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.810+0000 7f1a720a6640 1 --2- 172.21.15.60:0/2727696478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a6c072ec0 0x7f1a6c06e700 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1a6802a1a0 tx=0x7f1a680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:39.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.810+0000 7f1a62ffd640 1 -- 172.21.15.60:0/2727696478 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a68037040 con 0x7f1a6c072ec0 2024-09-12T02:27:39.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.810+0000 7f1a62ffd640 1 -- 172.21.15.60:0/2727696478 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a68042070 con 0x7f1a6c072ec0 2024-09-12T02:27:39.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.810+0000 7f1a7430a640 1 -- 172.21.15.60:0/2727696478 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a6c1eeb30 con 0x7f1a6c072ec0 2024-09-12T02:27:39.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.810+0000 7f1a62ffd640 1 -- 172.21.15.60:0/2727696478 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a68030880 con 0x7f1a6c072ec0 2024-09-12T02:27:39.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.810+0000 7f1a7430a640 1 -- 172.21.15.60:0/2727696478 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a6c1ef0f0 con 0x7f1a6c072ec0 2024-09-12T02:27:39.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.811+0000 7f1a7430a640 1 --2- 172.21.15.60:0/2727696478 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a6c1ef2c0 0x7f1a6c1504e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:39.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.811+0000 7f1a7430a640 1 -- 172.21.15.60:0/2727696478 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6c06ec40 con 0x7f1a6c1ef2c0 2024-09-12T02:27:39.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.811+0000 7f1a718a5640 1 --2- 172.21.15.60:0/2727696478 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a6c1ef2c0 0x7f1a6c1504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:39.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.811+0000 7f1a718a5640 1 -- 172.21.15.60:0/2727696478 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1a6c153ff0 con 0x7f1a6c1ef2c0 2024-09-12T02:27:39.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.812+0000 7f1a718a5640 1 --2- 172.21.15.60:0/2727696478 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a6c1ef2c0 0x7f1a6c1504e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c151300 tx=0x7f1a5c011d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:39.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.812+0000 7f1a62ffd640 1 -- 172.21.15.60:0/2727696478 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1a68030a20 con 0x7f1a6c072ec0 2024-09-12T02:27:39.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.812+0000 7f1a62ffd640 1 --2- 172.21.15.60:0/2727696478 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1a5006bde0 0x7f1a5006e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:39.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.812+0000 7f1a728a7640 1 --2- 172.21.15.60:0/2727696478 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1a5006bde0 0x7f1a5006e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:39.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.812+0000 7f1a62ffd640 1 -- 172.21.15.60:0/2727696478 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f1a680ab990 con 0x7f1a6c072ec0 2024-09-12T02:27:39.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.812+0000 7f1a62ffd640 1 -- 172.21.15.60:0/2727696478 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c019070 con 0x7f1a6c1ef2c0 2024-09-12T02:27:39.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.812+0000 7f1a62ffd640 1 -- 172.21.15.60:0/2727696478 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f1a5c004300 con 0x7f1a6c1ef2c0 2024-09-12T02:27:39.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.812+0000 7f1a62ffd640 1 -- 172.21.15.60:0/2727696478 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a6c1ef2c0 msgr2=0x7f1a6c1504e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:39.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.812+0000 7f1a62ffd640 1 --2- 172.21.15.60:0/2727696478 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a6c1ef2c0 0x7f1a6c1504e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c151300 tx=0x7f1a5c011d40 comp rx=0 tx=0).stop 2024-09-12T02:27:39.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.812+0000 7f1a62ffd640 1 -- 172.21.15.60:0/2727696478 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a6c1ef2c0 msgr2=0x7f1a6c1504e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:27:39.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.812+0000 7f1a62ffd640 1 --2- 172.21.15.60:0/2727696478 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a6c1ef2c0 0x7f1a6c1504e0 secure :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c151300 tx=0x7f1a5c011d40 comp rx=0 tx=0).stop 2024-09-12T02:27:39.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.813+0000 7f1a728a7640 1 --2- 172.21.15.60:0/2727696478 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1a5006bde0 0x7f1a5006e2a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1a640013b0 tx=0x7f1a64007d30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:39.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.820+0000 7f1a7430a640 1 --2- 172.21.15.60:0/2727696478 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a6c150a20 0x7f1a6c1eb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:39.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.820+0000 7f1a7430a640 1 -- 172.21.15.60:0/2727696478 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6c150e30 con 0x7f1a6c150a20 2024-09-12T02:27:39.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.820+0000 7f1a718a5640 1 --2- 172.21.15.60:0/2727696478 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a6c150a20 0x7f1a6c1eb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:39.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.820+0000 7f1a718a5640 1 -- 172.21.15.60:0/2727696478 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1a6c0008d0 con 0x7f1a6c150a20 2024-09-12T02:27:39.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.821+0000 7f1a718a5640 1 --2- 172.21.15.60:0/2727696478 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a6c150a20 0x7f1a6c1eb5c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c151300 tx=0x7f1a5c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:39.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.821+0000 7f1a62ffd640 1 -- 172.21.15.60:0/2727696478 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c019040 con 0x7f1a6c150a20 2024-09-12T02:27:39.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.821+0000 7f1a62ffd640 1 -- 172.21.15.60:0/2727696478 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5039 (secure 0 0 0) 0x7f1a5c00fe70 con 0x7f1a6c150a20 2024-09-12T02:27:39.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.821+0000 7f1a62ffd640 1 -- 172.21.15.60:0/2727696478 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a6c150a20 msgr2=0x7f1a6c1eb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:39.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.821+0000 7f1a62ffd640 1 --2- 172.21.15.60:0/2727696478 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a6c150a20 0x7f1a6c1eb5c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c151300 tx=0x7f1a5c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:27:39.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.821+0000 7f1a62ffd640 1 -- 172.21.15.60:0/2727696478 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a6c150a20 msgr2=0x7f1a6c1eb5c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:27:39.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.821+0000 7f1a62ffd640 1 --2- 172.21.15.60:0/2727696478 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a6c150a20 0x7f1a6c1eb5c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:39.822 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:27:39.822 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:27:39.823 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:27:39.823 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:27:39.823 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 40, 2024-09-12T02:27:39.823 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 205255, 2024-09-12T02:27:39.823 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:27:39.823 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:27:39.823 INFO:teuthology.orchestra.run.smithi060.stdout: 1 2024-09-12T02:27:39.823 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:27:39.823 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-09-12T02:27:39.823 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:27:39.823 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:27:39.823 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:27:39.824 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:27:39.824 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:27:39.824 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:27:39.824 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:27:39.824 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:27:39.824 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:27:39.824 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:27:39.824 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:27:39.824 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:27:39.824 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:27:39.824 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:27:39.824 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:27:39.824 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:27:39.825 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:27:39.825 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:27:39.825 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:27:39.825 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:27:39.825 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:27:39.825 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:27:39.825 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:27:39.825 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:27:39.825 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:27:39.825 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:27:39.825 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:27:39.825 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:27:39.825 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:39.826 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:39.826 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:27:39.826 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:27:39.826 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:27:39.826 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:27:39.826 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:27:39.826 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:27:39.826 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:27:39.826 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:27:39.826 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:27:39.826 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:27:39.826 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:27:39.827 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:27:39.827 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:27:39.827 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:27:39.827 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:27:39.827 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:27:39.827 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:27:39.827 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:27:39.827 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:27:39.827 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:27:39.827 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:27:39.827 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:27:39.827 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:27:39.827 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:27:39.828 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:27:39.828 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:27:39.828 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:27:39.828 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:27:39.828 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:27:39.828 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:27:39.828 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:39.828 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:27:39.828 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:39.828 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:27:39.828 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:27:39.828 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:27:39.828 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:27:39.829 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:39.829 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:27:39.829 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:27:39.829 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:39.829 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:39.829 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:39.829 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:27:39.829 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:27:39.829 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:39.829 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:39.829 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:39.829 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:39.830 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:27:39.830 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:27:39.830 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:27:39.830 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:27:39.830 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:27:39.830 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:39.830 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:39.830 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:27:39.830 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:27:39.830 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:27:39.830 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:27:39.830 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:39.830 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:27:39.830 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:27:39.830 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:39.831 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:39.831 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:39.831 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:27:39.831 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:27:39.831 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:39.831 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:39.831 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:39.831 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:39.831 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:27:39.831 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:27:39.831 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:27:39.831 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:27:39.832 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:27:39.832 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:39.832 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:39.832 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:27:39.832 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:27:39.832 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:27:39.832 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:27:39.832 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:39.832 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:27:39.832 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:27:39.832 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:39.832 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:39.832 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:39.833 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:27:39.833 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:27:39.833 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:27:39.833 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:39.833 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:39.833 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:39.833 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:27:39.833 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:27:39.833 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:27:39.833 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:27:39.833 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:27:39.833 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:39.833 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:39.834 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:39.834 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:27:39.834 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:27:39.834 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:39.834 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:27:39.834 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:27:39.834 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:27:39.834 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:39.834 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:27:39.834 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:27:39.834 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:39.834 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:27:39.834 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:27:39.835 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:27:39.835 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:39.835 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:27:39.835 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:27:39.835 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:39.835 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:27:39.835 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:27:39.835 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-09-12T02:27:39.835 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:39.835 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:27:39.835 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:27:39.835 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:39.835 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:27:39.836 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:27:39.836 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-09-12T02:27:39.836 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:39.836 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:27:39.836 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:27:39.836 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:27:39.836 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:27:39.836 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:27:39.836 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:27:39.836 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:27:39.836 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:27:39.836 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:27:39.836 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:27:39.837 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:27:39.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.822+0000 7f1a7430a640 1 -- 172.21.15.60:0/2727696478 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1a5006bde0 msgr2=0x7f1a5006e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:39.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.822+0000 7f1a7430a640 1 --2- 172.21.15.60:0/2727696478 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1a5006bde0 0x7f1a5006e2a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1a640013b0 tx=0x7f1a64007d30 comp rx=0 tx=0).stop 2024-09-12T02:27:39.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.822+0000 7f1a7430a640 1 -- 172.21.15.60:0/2727696478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a6c072ec0 msgr2=0x7f1a6c06e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:39.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.822+0000 7f1a7430a640 1 --2- 172.21.15.60:0/2727696478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a6c072ec0 0x7f1a6c06e700 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1a6802a1a0 tx=0x7f1a680046c0 comp rx=0 tx=0).stop 2024-09-12T02:27:39.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.822+0000 7f1a728a7640 1 -- 172.21.15.60:0/2727696478 reap_dead start 2024-09-12T02:27:39.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.822+0000 7f1a728a7640 1 -- 172.21.15.60:0/2727696478 reap_dead start 2024-09-12T02:27:39.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.822+0000 7f1a7430a640 1 -- 172.21.15.60:0/2727696478 shutdown_connections 2024-09-12T02:27:39.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.822+0000 7f1a7430a640 1 -- 172.21.15.60:0/2727696478 >> 172.21.15.60:0/2727696478 conn(0x7f1a6c0c9d80 msgr2=0x7f1a6c0c4ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:39.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.822+0000 7f1a7430a640 1 -- 172.21.15.60:0/2727696478 shutdown_connections 2024-09-12T02:27:39.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:39.822+0000 7f1a7430a640 1 -- 172.21.15.60:0/2727696478 wait complete. 2024-09-12T02:27:39.839 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-12T02:27:39.839 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-12T02:27:57.429 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:27:57.432 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:27:59.840 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-09-12T02:27:59.840 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-09-12T02:27:59.841 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T02:27:59.841 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T02:27:59.843 INFO:tasks.ceph.mon.c:Started 2024-09-12T02:27:59.843 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-12T02:27:59.844 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:27:59.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.965+0000 7fdb3d4c9640 1 Processor -- start 2024-09-12T02:27:59.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.965+0000 7fdb3d4c9640 1 -- start start 2024-09-12T02:27:59.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.966+0000 7fdb3d4c9640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fdb380c8b10 0x7fdb3815a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:59.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.966+0000 7fdb3d4c9640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdb3806cd80 0x7fdb381534d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:59.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.966+0000 7fdb3d4c9640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb380c7070 con 0x7fdb38153a10 2024-09-12T02:27:59.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.966+0000 7fdb3d4c9640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fdb3806d210 con 0x7fdb3806cd80 2024-09-12T02:27:59.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.966+0000 7fdb3d4c9640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fdb380c69b0 con 0x7fdb380c8b10 2024-09-12T02:27:59.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.966+0000 7fdb367fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdb3806cd80 0x7fdb381534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:59.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.966+0000 7fdb367fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdb3806cd80 0x7fdb381534d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39392/0 (socket says 172.21.15.60:39392) 2024-09-12T02:27:59.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.966+0000 7fdb367fc640 1 -- 172.21.15.60:0/2709501385 learned_addr learned my addr 172.21.15.60:0/2709501385 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:27:59.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.967+0000 7fdb36ffd640 1 --2- 172.21.15.60:0/2709501385 >> v2:172.21.15.105:3300/0 conn(0x7fdb380c8b10 0x7fdb3815a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:59.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.967+0000 7fdb367fc640 1 -- 172.21.15.60:0/2709501385 >> v2:172.21.15.105:3300/0 conn(0x7fdb380c8b10 msgr2=0x7fdb3815a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:27:59.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.967+0000 7fdb367fc640 1 --2- 172.21.15.60:0/2709501385 >> v2:172.21.15.105:3300/0 conn(0x7fdb380c8b10 0x7fdb3815a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:59.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.967+0000 7fdb367fc640 1 -- 172.21.15.60:0/2709501385 >> v1:172.21.15.105:6789/0 conn(0x7fdb38153a10 legacy=0x7fdb38156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:59.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.967+0000 7fdb367fc640 1 -- 172.21.15.60:0/2709501385 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb380c6c90 con 0x7fdb3806cd80 2024-09-12T02:27:59.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.968+0000 7fdb367fc640 1 --2- 172.21.15.60:0/2709501385 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb3806cd80 0x7fdb381534d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdb380ae760 tx=0x7fdb2c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=787ce64a3df474df server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:59.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.968+0000 7fdb35ffb640 1 -- 172.21.15.60:0/2709501385 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c037070 con 0x7fdb3806cd80 2024-09-12T02:27:59.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.968+0000 7fdb35ffb640 1 -- 172.21.15.60:0/2709501385 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb2c032440 con 0x7fdb3806cd80 2024-09-12T02:27:59.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.968+0000 7fdb35ffb640 1 -- 172.21.15.60:0/2709501385 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c032810 con 0x7fdb3806cd80 2024-09-12T02:27:59.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.968+0000 7fdb3d4c9640 1 -- 172.21.15.60:0/2709501385 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb3806cd80 msgr2=0x7fdb381534d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:59.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.968+0000 7fdb3d4c9640 1 --2- 172.21.15.60:0/2709501385 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb3806cd80 0x7fdb381534d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdb380ae760 tx=0x7fdb2c02a1e0 comp rx=0 tx=0).stop 2024-09-12T02:27:59.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.968+0000 7fdb3d4c9640 1 -- 172.21.15.60:0/2709501385 shutdown_connections 2024-09-12T02:27:59.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.968+0000 7fdb3d4c9640 1 --2- 172.21.15.60:0/2709501385 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb3806cd80 0x7fdb381534d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:59.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.968+0000 7fdb3d4c9640 1 --2- 172.21.15.60:0/2709501385 >> v2:172.21.15.105:3300/0 conn(0x7fdb380c8b10 0x7fdb3815a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:59.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.968+0000 7fdb3d4c9640 1 -- 172.21.15.60:0/2709501385 >> 172.21.15.60:0/2709501385 conn(0x7fdb380adb80 msgr2=0x7fdb380adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:59.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.968+0000 7fdb3d4c9640 1 -- 172.21.15.60:0/2709501385 shutdown_connections 2024-09-12T02:27:59.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.968+0000 7fdb3d4c9640 1 -- 172.21.15.60:0/2709501385 wait complete. 2024-09-12T02:27:59.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.970+0000 7fdb3d4c9640 1 Processor -- start 2024-09-12T02:27:59.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.970+0000 7fdb3d4c9640 1 -- start start 2024-09-12T02:27:59.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.970+0000 7fdb3d4c9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb380c8b10 0x7fdb3814cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:59.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.971+0000 7fdb3d4c9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb38153a10 0x7fdb38159480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:59.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.971+0000 7fdb3d4c9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb3815a830 0x7fdb381580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:59.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.971+0000 7fdb3d4c9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdb38154020 con 0x7fdb380c8b10 2024-09-12T02:27:59.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.971+0000 7fdb3d4c9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdb38153ea0 con 0x7fdb38153a10 2024-09-12T02:27:59.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.971+0000 7fdb3d4c9640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdb380c8ef0 con 0x7fdb3815a830 2024-09-12T02:27:59.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.971+0000 7fdb36ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb380c8b10 0x7fdb3814cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:59.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.971+0000 7fdb36ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb380c8b10 0x7fdb3814cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39408/0 (socket says 172.21.15.60:39408) 2024-09-12T02:27:59.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.971+0000 7fdb36ffd640 1 -- 172.21.15.60:0/1479949582 learned_addr learned my addr 172.21.15.60:0/1479949582 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:27:59.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.971+0000 7fdb367fc640 1 --2- 172.21.15.60:0/1479949582 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb38153a10 0x7fdb38159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:59.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.971+0000 7fdb377fe640 1 --2- 172.21.15.60:0/1479949582 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb3815a830 0x7fdb381580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:59.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.971+0000 7fdb36ffd640 1 -- 172.21.15.60:0/1479949582 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb3815a830 msgr2=0x7fdb381580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:59.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.971+0000 7fdb36ffd640 1 --2- 172.21.15.60:0/1479949582 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb3815a830 0x7fdb381580a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:59.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.971+0000 7fdb36ffd640 1 -- 172.21.15.60:0/1479949582 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb38153a10 msgr2=0x7fdb38159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:59.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.971+0000 7fdb36ffd640 1 --2- 172.21.15.60:0/1479949582 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb38153a10 0x7fdb38159480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:59.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.971+0000 7fdb36ffd640 1 -- 172.21.15.60:0/1479949582 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb381ec000 con 0x7fdb380c8b10 2024-09-12T02:27:59.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.971+0000 7fdb36ffd640 1 --2- 172.21.15.60:0/1479949582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb380c8b10 0x7fdb3814cdf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdb2800e9e0 tx=0x7fdb2800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:59.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.971+0000 7fdb1f7fe640 1 -- 172.21.15.60:0/1479949582 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb28017070 con 0x7fdb380c8b10 2024-09-12T02:27:59.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.971+0000 7fdb1f7fe640 1 -- 172.21.15.60:0/1479949582 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb2800c9d0 con 0x7fdb380c8b10 2024-09-12T02:27:59.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.971+0000 7fdb3d4c9640 1 -- 172.21.15.60:0/1479949582 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb381ec2c0 con 0x7fdb380c8b10 2024-09-12T02:27:59.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.971+0000 7fdb1f7fe640 1 -- 172.21.15.60:0/1479949582 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb2800cdc0 con 0x7fdb380c8b10 2024-09-12T02:27:59.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.971+0000 7fdb3d4c9640 1 -- 172.21.15.60:0/1479949582 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb381ec880 con 0x7fdb380c8b10 2024-09-12T02:27:59.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.973+0000 7fdb3d4c9640 1 -- 172.21.15.60:0/1479949582 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb381534d0 con 0x7fdb380c8b10 2024-09-12T02:27:59.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.973+0000 7fdb1f7fe640 1 -- 172.21.15.60:0/1479949582 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdb2801a070 con 0x7fdb380c8b10 2024-09-12T02:27:59.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.973+0000 7fdb1f7fe640 1 --2- 172.21.15.60:0/1479949582 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fdb2406be60 0x7fdb2406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:59.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.974+0000 7fdb1f7fe640 1 -- 172.21.15.60:0/1479949582 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fdb2808b150 con 0x7fdb380c8b10 2024-09-12T02:27:59.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.974+0000 7fdb367fc640 1 --2- 172.21.15.60:0/1479949582 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fdb2406be60 0x7fdb2406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:59.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.974+0000 7fdb367fc640 1 --2- 172.21.15.60:0/1479949582 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fdb2406be60 0x7fdb2406e320 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c034000 tx=0x7fdb2c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:59.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:27:59.978+0000 7fdb1f7fe640 1 -- 172.21.15.60:0/1479949582 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdb28059100 con 0x7fdb380c8b10 2024-09-12T02:28:00.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:00.296+0000 7fdb3d4c9640 1 -- 172.21.15.60:0/1479949582 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fdb380ad8f0 con 0x7fdb380c8b10 2024-09-12T02:28:00.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:00.296+0000 7fdb1f7fe640 1 -- 172.21.15.60:0/1479949582 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1559 (secure 0 0 0) 0x7fdb2805d400 con 0x7fdb380c8b10 2024-09-12T02:28:00.297 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":40,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:28:00.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:00.299+0000 7fdb3d4c9640 1 -- 172.21.15.60:0/1479949582 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fdb2406be60 msgr2=0x7fdb2406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:00.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:00.299+0000 7fdb3d4c9640 1 --2- 172.21.15.60:0/1479949582 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fdb2406be60 0x7fdb2406e320 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c034000 tx=0x7fdb2c02e000 comp rx=0 tx=0).stop 2024-09-12T02:28:00.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:00.299+0000 7fdb3d4c9640 1 -- 172.21.15.60:0/1479949582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb380c8b10 msgr2=0x7fdb3814cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:00.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:00.299+0000 7fdb3d4c9640 1 --2- 172.21.15.60:0/1479949582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb380c8b10 0x7fdb3814cdf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdb2800e9e0 tx=0x7fdb2800eea0 comp rx=0 tx=0).stop 2024-09-12T02:28:00.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:00.299+0000 7fdb3d4c9640 1 -- 172.21.15.60:0/1479949582 shutdown_connections 2024-09-12T02:28:00.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:00.299+0000 7fdb3d4c9640 1 --2- 172.21.15.60:0/1479949582 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fdb2406be60 0x7fdb2406e320 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:00.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:00.299+0000 7fdb3d4c9640 1 --2- 172.21.15.60:0/1479949582 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb3815a830 0x7fdb381580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:00.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:00.299+0000 7fdb3d4c9640 1 --2- 172.21.15.60:0/1479949582 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb38153a10 0x7fdb38159480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:00.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:00.299+0000 7fdb3d4c9640 1 --2- 172.21.15.60:0/1479949582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb380c8b10 0x7fdb3814cdf0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:00.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:00.299+0000 7fdb3d4c9640 1 -- 172.21.15.60:0/1479949582 >> 172.21.15.60:0/1479949582 conn(0x7fdb380adb80 msgr2=0x7fdb3806bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:00.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:00.299+0000 7fdb3d4c9640 1 -- 172.21.15.60:0/1479949582 shutdown_connections 2024-09-12T02:28:00.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:00.299+0000 7fdb3d4c9640 1 -- 172.21.15.60:0/1479949582 wait complete. 2024-09-12T02:28:03.314 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:28:03.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.420+0000 7fb5c1728640 1 Processor -- start 2024-09-12T02:28:03.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.420+0000 7fb5c1728640 1 -- start start 2024-09-12T02:28:03.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.421+0000 7fb5c1728640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb5bc06cd80 0x7fb5bc153be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:03.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.421+0000 7fb5c1728640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5bc15a4a0 0x7fb5bc156660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:03.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.421+0000 7fb5c1728640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5bc0c7070 con 0x7fb5bc0c8b10 2024-09-12T02:28:03.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.421+0000 7fb5c1728640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fb5bc06d210 con 0x7fb5bc06cd80 2024-09-12T02:28:03.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.421+0000 7fb5c1728640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb5bc0c69b0 con 0x7fb5bc15a4a0 2024-09-12T02:28:03.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.421+0000 7fb5ba7fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb5bc06cd80 0x7fb5bc153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:03.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.421+0000 7fb5ba7fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb5bc06cd80 0x7fb5bc153be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39422/0 (socket says 172.21.15.60:39422) 2024-09-12T02:28:03.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.421+0000 7fb5ba7fc640 1 -- 172.21.15.60:0/3331701366 learned_addr learned my addr 172.21.15.60:0/3331701366 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:28:03.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.421+0000 7fb5bb7fe640 1 --2- 172.21.15.60:0/3331701366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5bc15a4a0 0x7fb5bc156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:03.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.422+0000 7fb5bb7fe640 1 -- 172.21.15.60:0/3331701366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5bc15a4a0 msgr2=0x7fb5bc156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:28:03.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.422+0000 7fb5bb7fe640 1 -- 172.21.15.60:0/3331701366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5bc15a4a0 msgr2=0x7fb5bc156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:28:03.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.422+0000 7fb5bb7fe640 1 --2- 172.21.15.60:0/3331701366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5bc15a4a0 0x7fb5bc156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:28:03.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.422+0000 7fb5bb7fe640 1 --2- 172.21.15.60:0/3331701366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5bc15a4a0 0x7fb5bc156660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:28:03.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.422+0000 7fb5ba7fc640 1 -- 172.21.15.60:0/3331701366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5bc15a4a0 msgr2=0x7fb5bc156660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:28:03.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.422+0000 7fb5ba7fc640 1 --2- 172.21.15.60:0/3331701366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5bc15a4a0 0x7fb5bc156660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:03.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.422+0000 7fb5ba7fc640 1 -- 172.21.15.60:0/3331701366 >> v1:172.21.15.60:6789/0 conn(0x7fb5bc0c8b10 legacy=0x7fb5bc1534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:03.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.422+0000 7fb5ba7fc640 1 -- 172.21.15.60:0/3331701366 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5bc0c6c90 con 0x7fb5bc06cd80 2024-09-12T02:28:03.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.422+0000 7fb5ba7fc640 1 --2- 172.21.15.60:0/3331701366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5bc06cd80 0x7fb5bc153be0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0009870 tx=0x7fb5b002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdd0db4dbe9b1e71 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:03.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.423+0000 7fb5b9ffb640 1 -- 172.21.15.60:0/3331701366 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b0037070 con 0x7fb5bc06cd80 2024-09-12T02:28:03.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.423+0000 7fb5b9ffb640 1 -- 172.21.15.60:0/3331701366 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5b0032440 con 0x7fb5bc06cd80 2024-09-12T02:28:03.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.423+0000 7fb5b9ffb640 1 -- 172.21.15.60:0/3331701366 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b0032810 con 0x7fb5bc06cd80 2024-09-12T02:28:03.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.423+0000 7fb5c1728640 1 -- 172.21.15.60:0/3331701366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5bc06cd80 msgr2=0x7fb5bc153be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:03.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.423+0000 7fb5c1728640 1 --2- 172.21.15.60:0/3331701366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5bc06cd80 0x7fb5bc153be0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0009870 tx=0x7fb5b002a1c0 comp rx=0 tx=0).stop 2024-09-12T02:28:03.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.423+0000 7fb5c1728640 1 -- 172.21.15.60:0/3331701366 shutdown_connections 2024-09-12T02:28:03.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.423+0000 7fb5c1728640 1 --2- 172.21.15.60:0/3331701366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5bc15a4a0 0x7fb5bc156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:03.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.423+0000 7fb5c1728640 1 --2- 172.21.15.60:0/3331701366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5bc06cd80 0x7fb5bc153be0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:03.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.423+0000 7fb5c1728640 1 -- 172.21.15.60:0/3331701366 >> 172.21.15.60:0/3331701366 conn(0x7fb5bc0adb80 msgr2=0x7fb5bc0adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:03.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.423+0000 7fb5c1728640 1 -- 172.21.15.60:0/3331701366 shutdown_connections 2024-09-12T02:28:03.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.423+0000 7fb5c1728640 1 -- 172.21.15.60:0/3331701366 wait complete. 2024-09-12T02:28:03.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.425+0000 7fb5c1728640 1 Processor -- start 2024-09-12T02:28:03.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.425+0000 7fb5c1728640 1 -- start start 2024-09-12T02:28:03.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.425+0000 7fb5c1728640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5bc0c8b10 0x7fb5bc154430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:03.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.425+0000 7fb5c1728640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5bc15a4a0 0x7fb5bc0ad190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:03.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.425+0000 7fb5c1728640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5bc148cd0 0x7fb5bc149180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:03.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.425+0000 7fb5c1728640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb5bc0c9070 con 0x7fb5bc0c8b10 2024-09-12T02:28:03.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.425+0000 7fb5c1728640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb5bc0c8ef0 con 0x7fb5bc148cd0 2024-09-12T02:28:03.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.425+0000 7fb5c1728640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb5bc156ba0 con 0x7fb5bc15a4a0 2024-09-12T02:28:03.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.425+0000 7fb5baffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5bc0c8b10 0x7fb5bc154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:03.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.425+0000 7fb5baffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5bc0c8b10 0x7fb5bc154430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39436/0 (socket says 172.21.15.60:39436) 2024-09-12T02:28:03.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.425+0000 7fb5baffd640 1 -- 172.21.15.60:0/102797446 learned_addr learned my addr 172.21.15.60:0/102797446 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:28:03.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.425+0000 7fb5ba7fc640 1 --2- 172.21.15.60:0/102797446 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5bc15a4a0 0x7fb5bc0ad190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:03.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.426+0000 7fb5bb7fe640 1 --2- 172.21.15.60:0/102797446 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5bc148cd0 0x7fb5bc149180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:03.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.426+0000 7fb5ba7fc640 1 -- 172.21.15.60:0/102797446 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5bc15a4a0 msgr2=0x7fb5bc0ad190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-12T02:28:03.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.426+0000 7fb5ba7fc640 1 -- 172.21.15.60:0/102797446 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5bc15a4a0 msgr2=0x7fb5bc0ad190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:28:03.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.426+0000 7fb5ba7fc640 1 --2- 172.21.15.60:0/102797446 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5bc15a4a0 0x7fb5bc0ad190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:28:03.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.426+0000 7fb5ba7fc640 1 --2- 172.21.15.60:0/102797446 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5bc15a4a0 0x7fb5bc0ad190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:28:03.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.426+0000 7fb5baffd640 1 -- 172.21.15.60:0/102797446 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5bc15a4a0 msgr2=0x7fb5bc0ad190 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:28:03.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.426+0000 7fb5baffd640 1 --2- 172.21.15.60:0/102797446 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5bc15a4a0 0x7fb5bc0ad190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:03.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.426+0000 7fb5baffd640 1 -- 172.21.15.60:0/102797446 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5bc148cd0 msgr2=0x7fb5bc149180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:03.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.426+0000 7fb5baffd640 1 --2- 172.21.15.60:0/102797446 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5bc148cd0 0x7fb5bc149180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:03.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.426+0000 7fb5baffd640 1 -- 172.21.15.60:0/102797446 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5bc1587b0 con 0x7fb5bc0c8b10 2024-09-12T02:28:03.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.426+0000 7fb5baffd640 1 --2- 172.21.15.60:0/102797446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5bc0c8b10 0x7fb5bc154430 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac00c430 tx=0x7fb5ac00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:03.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.426+0000 7fb5a37fe640 1 -- 172.21.15.60:0/102797446 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac0052d0 con 0x7fb5bc0c8b10 2024-09-12T02:28:03.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.426+0000 7fb5a37fe640 1 -- 172.21.15.60:0/102797446 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5ac005490 con 0x7fb5bc0c8b10 2024-09-12T02:28:03.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.426+0000 7fb5c1728640 1 -- 172.21.15.60:0/102797446 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5bc158bd0 con 0x7fb5bc0c8b10 2024-09-12T02:28:03.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.426+0000 7fb5a37fe640 1 -- 172.21.15.60:0/102797446 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac007260 con 0x7fb5bc0c8b10 2024-09-12T02:28:03.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.426+0000 7fb5c1728640 1 -- 172.21.15.60:0/102797446 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5bc159170 con 0x7fb5bc0c8b10 2024-09-12T02:28:03.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.427+0000 7fb5c1728640 1 -- 172.21.15.60:0/102797446 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5bc157030 con 0x7fb5bc0c8b10 2024-09-12T02:28:03.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.428+0000 7fb5a37fe640 1 -- 172.21.15.60:0/102797446 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb5ac007400 con 0x7fb5bc0c8b10 2024-09-12T02:28:03.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.429+0000 7fb5a37fe640 1 --2- 172.21.15.60:0/102797446 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb5a806be30 0x7fb5a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:03.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.429+0000 7fb5a37fe640 1 -- 172.21.15.60:0/102797446 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fb5ac08a6e0 con 0x7fb5bc0c8b10 2024-09-12T02:28:03.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.429+0000 7fb5ba7fc640 1 --2- 172.21.15.60:0/102797446 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb5a806be30 0x7fb5a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:03.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.429+0000 7fb5ba7fc640 1 --2- 172.21.15.60:0/102797446 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb5a806be30 0x7fb5a806e2f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0034000 tx=0x7fb5b002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:03.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.433+0000 7fb5a37fe640 1 -- 172.21.15.60:0/102797446 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb5ac0586a0 con 0x7fb5bc0c8b10 2024-09-12T02:28:03.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.736+0000 7fb5c1728640 1 -- 172.21.15.60:0/102797446 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb5bc0c9d90 con 0x7fb5bc0c8b10 2024-09-12T02:28:03.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.737+0000 7fb5a37fe640 1 -- 172.21.15.60:0/102797446 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1559 (secure 0 0 0) 0x7fb5ac05c9a0 con 0x7fb5bc0c8b10 2024-09-12T02:28:03.738 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":40,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:28:03.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.739+0000 7fb5c1728640 1 -- 172.21.15.60:0/102797446 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb5a806be30 msgr2=0x7fb5a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:03.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.739+0000 7fb5c1728640 1 --2- 172.21.15.60:0/102797446 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb5a806be30 0x7fb5a806e2f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0034000 tx=0x7fb5b002e000 comp rx=0 tx=0).stop 2024-09-12T02:28:03.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.739+0000 7fb5c1728640 1 -- 172.21.15.60:0/102797446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5bc0c8b10 msgr2=0x7fb5bc154430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:03.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.739+0000 7fb5c1728640 1 --2- 172.21.15.60:0/102797446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5bc0c8b10 0x7fb5bc154430 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac00c430 tx=0x7fb5ac00c8f0 comp rx=0 tx=0).stop 2024-09-12T02:28:03.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.739+0000 7fb5c1728640 1 -- 172.21.15.60:0/102797446 shutdown_connections 2024-09-12T02:28:03.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.739+0000 7fb5c1728640 1 --2- 172.21.15.60:0/102797446 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb5a806be30 0x7fb5a806e2f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:03.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.739+0000 7fb5c1728640 1 --2- 172.21.15.60:0/102797446 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5bc148cd0 0x7fb5bc149180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:03.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.739+0000 7fb5c1728640 1 --2- 172.21.15.60:0/102797446 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5bc15a4a0 0x7fb5bc0ad190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:03.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.739+0000 7fb5c1728640 1 --2- 172.21.15.60:0/102797446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5bc0c8b10 0x7fb5bc154430 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:03.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.739+0000 7fb5c1728640 1 -- 172.21.15.60:0/102797446 >> 172.21.15.60:0/102797446 conn(0x7fb5bc0adb80 msgr2=0x7fb5bc0adf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:03.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.739+0000 7fb5c1728640 1 -- 172.21.15.60:0/102797446 shutdown_connections 2024-09-12T02:28:03.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:03.739+0000 7fb5c1728640 1 -- 172.21.15.60:0/102797446 wait complete. 2024-09-12T02:28:06.751 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:28:06.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.868+0000 7f543ed11640 1 Processor -- start 2024-09-12T02:28:06.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.868+0000 7f543ed11640 1 -- start start 2024-09-12T02:28:06.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.869+0000 7f543ed11640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f54380a9230 0x7f54380c3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:06.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.869+0000 7f543ed11640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f5438072b30 0x7f5438151610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:06.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.869+0000 7f543ed11640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5438070800 con 0x7f54380ca220 2024-09-12T02:28:06.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.869+0000 7f543ed11640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f54380c99b0 con 0x7f5438072b30 2024-09-12T02:28:06.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.869+0000 7f543ed11640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f54380c93f0 con 0x7f54380a9230 2024-09-12T02:28:06.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.869+0000 7f543caad640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f54380ca220 0x7f5438154b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49552/0 (socket says 172.21.15.60:49552) 2024-09-12T02:28:06.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.869+0000 7f543caad640 1 -- 172.21.15.60:0/1955093275 learned_addr learned my addr 172.21.15.60:0/1955093275 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:28:06.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.869+0000 7f5437fff640 1 --2- 172.21.15.60:0/1955093275 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f54380a9230 0x7f54380c3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:06.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.869+0000 7f543d2ae640 1 --2- 172.21.15.60:0/1955093275 >> v2:172.21.15.105:3300/0 conn(0x7f5438072b30 0x7f5438151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:06.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.869+0000 7f5437fff640 1 -- 172.21.15.60:0/1955093275 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f54380a9230 msgr2=0x7f54380c3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:28:06.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.869+0000 7f5437fff640 1 -- 172.21.15.60:0/1955093275 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f54380a9230 msgr2=0x7f54380c3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:28:06.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.869+0000 7f5437fff640 1 --2- 172.21.15.60:0/1955093275 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f54380a9230 0x7f54380c3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:28:06.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.869+0000 7f5437fff640 1 --2- 172.21.15.60:0/1955093275 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f54380a9230 0x7f54380c3f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:28:06.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.869+0000 7f54377fe640 1 -- 172.21.15.60:0/1955093275 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 638101632 0 0) 0x7f5438070800 con 0x7f54380ca220 2024-09-12T02:28:06.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.869+0000 7f54377fe640 1 -- 172.21.15.60:0/1955093275 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5428003520 con 0x7f54380ca220 2024-09-12T02:28:06.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.869+0000 7f54377fe640 1 -- 172.21.15.60:0/1955093275 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2264982756 0 0) 0x7f5428003520 con 0x7f54380ca220 2024-09-12T02:28:06.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.869+0000 7f54377fe640 1 -- 172.21.15.60:0/1955093275 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f54380a9230 msgr2=0x7f54380c3f10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:28:06.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.869+0000 7f54377fe640 1 --2- 172.21.15.60:0/1955093275 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f54380a9230 0x7f54380c3f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:06.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.869+0000 7f54377fe640 1 -- 172.21.15.60:0/1955093275 >> v2:172.21.15.105:3300/0 conn(0x7f5438072b30 msgr2=0x7f5438151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:06.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.869+0000 7f54377fe640 1 --2- 172.21.15.60:0/1955093275 >> v2:172.21.15.105:3300/0 conn(0x7f5438072b30 0x7f5438151610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:06.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.869+0000 7f54377fe640 1 -- 172.21.15.60:0/1955093275 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54380c96d0 con 0x7f54380ca220 2024-09-12T02:28:06.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.869+0000 7f54377fe640 1 -- 172.21.15.60:0/1955093275 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7f542c001670 con 0x7f54380ca220 2024-09-12T02:28:06.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.869+0000 7f54377fe640 1 -- 172.21.15.60:0/1955093275 >> v1:172.21.15.60:6789/0 conn(0x7f54380ca220 legacy=0x7f5438154b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:06.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.870+0000 7f54377fe640 1 --2- 172.21.15.60:0/1955093275 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54280039b0 0x7f5428003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:06.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.870+0000 7f54377fe640 1 --2- 172.21.15.60:0/1955093275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5428004800 0x7f5428004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:06.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.870+0000 7f54377fe640 1 --2- 172.21.15.60:0/1955093275 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f54380a9230 0x7f54280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:06.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.870+0000 7f54377fe640 1 -- 172.21.15.60:0/1955093275 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f54380c99b0 con 0x7f5428004800 2024-09-12T02:28:06.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.870+0000 7f54377fe640 1 -- 172.21.15.60:0/1955093275 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f54380c93f0 con 0x7f54280039b0 2024-09-12T02:28:06.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.870+0000 7f54377fe640 1 -- 172.21.15.60:0/1955093275 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f542800ba70 con 0x7f54380a9230 2024-09-12T02:28:06.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.870+0000 7f5437fff640 1 --2- 172.21.15.60:0/1955093275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5428004800 0x7f5428004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:06.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.870+0000 7f5437fff640 1 -- 172.21.15.60:0/1955093275 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f54380a9230 msgr2=0x7f54280051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:06.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.870+0000 7f5437fff640 1 --2- 172.21.15.60:0/1955093275 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f54380a9230 0x7f54280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:06.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.870+0000 7f5437fff640 1 -- 172.21.15.60:0/1955093275 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54280039b0 msgr2=0x7f5428003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:06.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.870+0000 7f5437fff640 1 --2- 172.21.15.60:0/1955093275 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54280039b0 0x7f5428003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:06.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.870+0000 7f5437fff640 1 -- 172.21.15.60:0/1955093275 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5428003520 con 0x7f5428004800 2024-09-12T02:28:06.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.871+0000 7f5437fff640 1 --2- 172.21.15.60:0/1955093275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5428004800 0x7f5428004c80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5424006fd0 tx=0x7f5428005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23cd37d9dce71964 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:06.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.871+0000 7f54377fe640 1 -- 172.21.15.60:0/1955093275 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5424030070 con 0x7f5428004800 2024-09-12T02:28:06.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.871+0000 7f54377fe640 1 -- 172.21.15.60:0/1955093275 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f542402acc0 con 0x7f5428004800 2024-09-12T02:28:06.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.871+0000 7f54377fe640 1 -- 172.21.15.60:0/1955093275 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f542400b5e0 con 0x7f5428004800 2024-09-12T02:28:06.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.872+0000 7f543ed11640 1 -- 172.21.15.60:0/1955093275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5428004800 msgr2=0x7f5428004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:06.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.872+0000 7f543ed11640 1 --2- 172.21.15.60:0/1955093275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5428004800 0x7f5428004c80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5424006fd0 tx=0x7f5428005830 comp rx=0 tx=0).stop 2024-09-12T02:28:06.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.872+0000 7f543d2ae640 1 -- 172.21.15.60:0/1955093275 reap_dead start 2024-09-12T02:28:06.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.872+0000 7f543ed11640 1 -- 172.21.15.60:0/1955093275 shutdown_connections 2024-09-12T02:28:06.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.872+0000 7f543ed11640 1 -- 172.21.15.60:0/1955093275 >> 172.21.15.60:0/1955093275 conn(0x7f5438067b30 msgr2=0x7f5438067f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:06.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.872+0000 7f543ed11640 1 -- 172.21.15.60:0/1955093275 shutdown_connections 2024-09-12T02:28:06.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.872+0000 7f543ed11640 1 -- 172.21.15.60:0/1955093275 wait complete. 2024-09-12T02:28:06.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.874+0000 7f543ed11640 1 Processor -- start 2024-09-12T02:28:06.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.874+0000 7f543ed11640 1 -- start start 2024-09-12T02:28:06.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.875+0000 7f543ed11640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5428004800 0x7f54380ad740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:06.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.875+0000 7f543ed11640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54380adc80 0x7f5438146c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:06.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.875+0000 7f543ed11640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54381471c0 0x7f5438152950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:06.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.875+0000 7f543ed11640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5438072fc0 con 0x7f54380adc80 2024-09-12T02:28:06.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.875+0000 7f543ed11640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5438154660 con 0x7f54381471c0 2024-09-12T02:28:06.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.875+0000 7f543ed11640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f54380ca600 con 0x7f5428004800 2024-09-12T02:28:06.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.875+0000 7f5437fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54380adc80 0x7f5438146c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:06.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.875+0000 7f543caad640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5428004800 0x7f54380ad740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:06.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.875+0000 7f543d2ae640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54381471c0 0x7f5438152950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:06.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.875+0000 7f543d2ae640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54381471c0 0x7f5438152950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:41912/0 (socket says 172.21.15.60:41912) 2024-09-12T02:28:06.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.875+0000 7f543caad640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5428004800 0x7f54380ad740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:46324/0 (socket says 172.21.15.60:46324) 2024-09-12T02:28:06.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.875+0000 7f543d2ae640 1 -- 172.21.15.60:0/953666925 learned_addr learned my addr 172.21.15.60:0/953666925 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:28:06.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.875+0000 7f5437fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54380adc80 0x7f5438146c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39456/0 (socket says 172.21.15.60:39456) 2024-09-12T02:28:06.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.875+0000 7f543caad640 1 -- 172.21.15.60:0/953666925 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5428004800 msgr2=0x7f54380ad740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-12T02:28:06.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.875+0000 7f543caad640 1 -- 172.21.15.60:0/953666925 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5428004800 msgr2=0x7f54380ad740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:28:06.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.875+0000 7f543caad640 1 --2- 172.21.15.60:0/953666925 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5428004800 0x7f54380ad740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:28:06.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.875+0000 7f543caad640 1 --2- 172.21.15.60:0/953666925 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5428004800 0x7f54380ad740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:28:06.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.875+0000 7f5437fff640 1 -- 172.21.15.60:0/953666925 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5428004800 msgr2=0x7f54380ad740 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:28:06.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.875+0000 7f5437fff640 1 --2- 172.21.15.60:0/953666925 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5428004800 0x7f54380ad740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:06.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.876+0000 7f5437fff640 1 -- 172.21.15.60:0/953666925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54381471c0 msgr2=0x7f5438152950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:06.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.876+0000 7f5437fff640 1 --2- 172.21.15.60:0/953666925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54381471c0 0x7f5438152950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:06.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.876+0000 7f5437fff640 1 -- 172.21.15.60:0/953666925 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5438151eb0 con 0x7f54380adc80 2024-09-12T02:28:06.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.876+0000 7f543d2ae640 1 --2- 172.21.15.60:0/953666925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54381471c0 0x7f5438152950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:28:06.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.876+0000 7f5437fff640 1 --2- 172.21.15.60:0/953666925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54380adc80 0x7f5438146c80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5424032000 tx=0x7f5424004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:06.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.876+0000 7f54357fa640 1 -- 172.21.15.60:0/953666925 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5424043020 con 0x7f54380adc80 2024-09-12T02:28:06.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.876+0000 7f54357fa640 1 -- 172.21.15.60:0/953666925 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f542403f680 con 0x7f54380adc80 2024-09-12T02:28:06.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.876+0000 7f54357fa640 1 -- 172.21.15.60:0/953666925 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f542400b5e0 con 0x7f54380adc80 2024-09-12T02:28:06.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.876+0000 7f543ed11640 1 -- 172.21.15.60:0/953666925 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54381ea940 con 0x7f54380adc80 2024-09-12T02:28:06.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.876+0000 7f543ed11640 1 -- 172.21.15.60:0/953666925 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5438150cd0 con 0x7f54380adc80 2024-09-12T02:28:06.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.877+0000 7f543ed11640 1 -- 172.21.15.60:0/953666925 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54380a9010 con 0x7f54380adc80 2024-09-12T02:28:06.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.878+0000 7f54357fa640 1 -- 172.21.15.60:0/953666925 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5424046020 con 0x7f54380adc80 2024-09-12T02:28:06.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.879+0000 7f54357fa640 1 --2- 172.21.15.60:0/953666925 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f541c06be30 0x7f541c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:06.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.879+0000 7f54357fa640 1 -- 172.21.15.60:0/953666925 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f54240abbc0 con 0x7f54380adc80 2024-09-12T02:28:06.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.879+0000 7f543caad640 1 --2- 172.21.15.60:0/953666925 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f541c06be30 0x7f541c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:06.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.879+0000 7f543caad640 1 --2- 172.21.15.60:0/953666925 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f541c06be30 0x7f541c06e2f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f542c000fb0 tx=0x7f542c0016c0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:06.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:06.883+0000 7f54357fa640 1 -- 172.21.15.60:0/953666925 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f542404d030 con 0x7f54380adc80 2024-09-12T02:28:07.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.171+0000 7f543ed11640 1 -- 172.21.15.60:0/953666925 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f543814bde0 con 0x7f54380adc80 2024-09-12T02:28:07.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.171+0000 7f54357fa640 1 -- 172.21.15.60:0/953666925 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7f542407a240 con 0x7f54380adc80 2024-09-12T02:28:07.172 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":42,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:28:07.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.173+0000 7f543ed11640 1 -- 172.21.15.60:0/953666925 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f541c06be30 msgr2=0x7f541c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:07.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.173+0000 7f543ed11640 1 --2- 172.21.15.60:0/953666925 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f541c06be30 0x7f541c06e2f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f542c000fb0 tx=0x7f542c0016c0 comp rx=0 tx=0).stop 2024-09-12T02:28:07.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.173+0000 7f543ed11640 1 -- 172.21.15.60:0/953666925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54380adc80 msgr2=0x7f5438146c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:07.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.173+0000 7f543ed11640 1 --2- 172.21.15.60:0/953666925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54380adc80 0x7f5438146c80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5424032000 tx=0x7f5424004730 comp rx=0 tx=0).stop 2024-09-12T02:28:07.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.174+0000 7f543ed11640 1 -- 172.21.15.60:0/953666925 shutdown_connections 2024-09-12T02:28:07.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.174+0000 7f543ed11640 1 --2- 172.21.15.60:0/953666925 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f541c06be30 0x7f541c06e2f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:07.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.174+0000 7f543ed11640 1 --2- 172.21.15.60:0/953666925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54381471c0 0x7f5438152950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:07.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.174+0000 7f543ed11640 1 --2- 172.21.15.60:0/953666925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54380adc80 0x7f5438146c80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:07.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.174+0000 7f543ed11640 1 --2- 172.21.15.60:0/953666925 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5428004800 0x7f54380ad740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:07.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.174+0000 7f543ed11640 1 -- 172.21.15.60:0/953666925 >> 172.21.15.60:0/953666925 conn(0x7f5438067b30 msgr2=0x7f543806ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:07.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.174+0000 7f543ed11640 1 -- 172.21.15.60:0/953666925 shutdown_connections 2024-09-12T02:28:07.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.174+0000 7f543ed11640 1 -- 172.21.15.60:0/953666925 wait complete. 2024-09-12T02:28:07.186 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-12T02:28:07.186 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-12T02:28:07.186 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-12T02:28:07.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.315+0000 7fd79816f640 1 Processor -- start 2024-09-12T02:28:07.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.315+0000 7fd79816f640 1 -- start start 2024-09-12T02:28:07.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.316+0000 7fd79816f640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd790150480 0x7fd7900c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:07.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.316+0000 7fd79816f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd79006c650 0x7fd7900c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:07.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.316+0000 7fd79816f640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd79015a7c0 con 0x7fd7900c9c80 2024-09-12T02:28:07.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.316+0000 7fd79816f640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fd79006c240 con 0x7fd790150480 2024-09-12T02:28:07.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.316+0000 7fd79816f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd79015a330 con 0x7fd79006c650 2024-09-12T02:28:07.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.316+0000 7fd79670c640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fd7900c9c80 0x7fd7900ca130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49568/0 (socket says 172.21.15.60:49568) 2024-09-12T02:28:07.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.316+0000 7fd79670c640 1 -- 172.21.15.60:0/2315928477 learned_addr learned my addr 172.21.15.60:0/2315928477 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:28:07.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.316+0000 7fd795f0b640 1 --2- 172.21.15.60:0/2315928477 >> v2:172.21.15.105:3300/0 conn(0x7fd790150480 0x7fd7900c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:07.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.316+0000 7fd79570a640 1 --2- 172.21.15.60:0/2315928477 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd79006c650 0x7fd7900c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:07.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.316+0000 7fd79570a640 1 -- 172.21.15.60:0/2315928477 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd79006c650 msgr2=0x7fd7900c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:28:07.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.316+0000 7fd79570a640 1 -- 172.21.15.60:0/2315928477 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd79006c650 msgr2=0x7fd7900c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:28:07.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.316+0000 7fd79570a640 1 --2- 172.21.15.60:0/2315928477 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd79006c650 0x7fd7900c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:28:07.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.316+0000 7fd79570a640 1 --2- 172.21.15.60:0/2315928477 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd79006c650 0x7fd7900c7fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:28:07.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.316+0000 7fd794f09640 1 -- 172.21.15.60:0/2315928477 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 419730941 0 0) 0x7fd79015a7c0 con 0x7fd7900c9c80 2024-09-12T02:28:07.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.316+0000 7fd794f09640 1 -- 172.21.15.60:0/2315928477 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd77c003520 con 0x7fd7900c9c80 2024-09-12T02:28:07.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.316+0000 7fd795f0b640 1 -- 172.21.15.60:0/2315928477 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd79006c650 msgr2=0x7fd7900c7fd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:28:07.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.316+0000 7fd795f0b640 1 --2- 172.21.15.60:0/2315928477 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd79006c650 0x7fd7900c7fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:07.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.316+0000 7fd795f0b640 1 -- 172.21.15.60:0/2315928477 >> v1:172.21.15.60:6789/0 conn(0x7fd7900c9c80 legacy=0x7fd7900ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:07.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.316+0000 7fd795f0b640 1 -- 172.21.15.60:0/2315928477 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd790159a00 con 0x7fd790150480 2024-09-12T02:28:07.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.317+0000 7fd795f0b640 1 --2- 172.21.15.60:0/2315928477 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd790150480 0x7fd7900c7a90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd78c0097a0 tx=0x7fd78c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ff06992018540bc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:07.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.317+0000 7fd794f09640 1 -- 172.21.15.60:0/2315928477 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd78c037070 con 0x7fd790150480 2024-09-12T02:28:07.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.317+0000 7fd794f09640 1 -- 172.21.15.60:0/2315928477 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd78c032440 con 0x7fd790150480 2024-09-12T02:28:07.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.317+0000 7fd794f09640 1 -- 172.21.15.60:0/2315928477 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd78c032810 con 0x7fd790150480 2024-09-12T02:28:07.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.318+0000 7fd79816f640 1 -- 172.21.15.60:0/2315928477 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd790150480 msgr2=0x7fd7900c7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:07.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.318+0000 7fd79816f640 1 --2- 172.21.15.60:0/2315928477 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd790150480 0x7fd7900c7a90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd78c0097a0 tx=0x7fd78c02a180 comp rx=0 tx=0).stop 2024-09-12T02:28:07.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.318+0000 7fd79816f640 1 -- 172.21.15.60:0/2315928477 shutdown_connections 2024-09-12T02:28:07.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.318+0000 7fd79816f640 1 --2- 172.21.15.60:0/2315928477 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd79006c650 0x7fd7900c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:07.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.318+0000 7fd79816f640 1 --2- 172.21.15.60:0/2315928477 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd790150480 0x7fd7900c7a90 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:07.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.318+0000 7fd79816f640 1 -- 172.21.15.60:0/2315928477 >> 172.21.15.60:0/2315928477 conn(0x7fd790068030 msgr2=0x7fd790073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:07.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.318+0000 7fd79816f640 1 -- 172.21.15.60:0/2315928477 shutdown_connections 2024-09-12T02:28:07.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.318+0000 7fd79816f640 1 -- 172.21.15.60:0/2315928477 wait complete. 2024-09-12T02:28:07.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.319+0000 7fd79816f640 1 Processor -- start 2024-09-12T02:28:07.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.319+0000 7fd79816f640 1 -- start start 2024-09-12T02:28:07.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.320+0000 7fd79816f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd79006c650 0x7fd79014ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:07.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.320+0000 7fd79816f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7900c9c80 0x7fd7901e1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:07.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.320+0000 7fd79816f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd790150480 0x7fd7901e0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:07.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.320+0000 7fd79816f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd79006d270 con 0x7fd79006c650 2024-09-12T02:28:07.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.320+0000 7fd79816f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd790159fc0 con 0x7fd790150480 2024-09-12T02:28:07.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.320+0000 7fd79816f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd790156270 con 0x7fd7900c9c80 2024-09-12T02:28:07.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.320+0000 7fd795f0b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd79006c650 0x7fd79014ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:07.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.320+0000 7fd795f0b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd79006c650 0x7fd79014ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39470/0 (socket says 172.21.15.60:39470) 2024-09-12T02:28:07.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.320+0000 7fd795f0b640 1 -- 172.21.15.60:0/3768834549 learned_addr learned my addr 172.21.15.60:0/3768834549 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:28:07.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.320+0000 7fd79570a640 1 --2- 172.21.15.60:0/3768834549 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7900c9c80 0x7fd7901e1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:07.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.320+0000 7fd79670c640 1 --2- 172.21.15.60:0/3768834549 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd790150480 0x7fd7901e0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:07.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.320+0000 7fd79570a640 1 -- 172.21.15.60:0/3768834549 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7900c9c80 msgr2=0x7fd7901e1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-12T02:28:07.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.320+0000 7fd79570a640 1 -- 172.21.15.60:0/3768834549 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7900c9c80 msgr2=0x7fd7901e1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:28:07.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.320+0000 7fd79570a640 1 --2- 172.21.15.60:0/3768834549 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7900c9c80 0x7fd7901e1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:28:07.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.320+0000 7fd79570a640 1 --2- 172.21.15.60:0/3768834549 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7900c9c80 0x7fd7901e1b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:28:07.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.321+0000 7fd795f0b640 1 -- 172.21.15.60:0/3768834549 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7900c9c80 msgr2=0x7fd7901e1b50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:28:07.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.321+0000 7fd795f0b640 1 --2- 172.21.15.60:0/3768834549 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7900c9c80 0x7fd7901e1b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:07.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.321+0000 7fd795f0b640 1 -- 172.21.15.60:0/3768834549 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd790150480 msgr2=0x7fd7901e0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:07.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.321+0000 7fd795f0b640 1 --2- 172.21.15.60:0/3768834549 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd790150480 0x7fd7901e0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:07.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.321+0000 7fd795f0b640 1 -- 172.21.15.60:0/3768834549 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd79014f650 con 0x7fd79006c650 2024-09-12T02:28:07.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.321+0000 7fd795f0b640 1 --2- 172.21.15.60:0/3768834549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd79006c650 0x7fd79014ebe0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd78c000c00 tx=0x7fd78c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:07.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.321+0000 7fd7867fc640 1 -- 172.21.15.60:0/3768834549 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd78c037040 con 0x7fd79006c650 2024-09-12T02:28:07.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.321+0000 7fd7867fc640 1 -- 172.21.15.60:0/3768834549 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd78c042070 con 0x7fd79006c650 2024-09-12T02:28:07.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.321+0000 7fd79816f640 1 -- 172.21.15.60:0/3768834549 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd79014f120 con 0x7fd79006c650 2024-09-12T02:28:07.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.321+0000 7fd7867fc640 1 -- 172.21.15.60:0/3768834549 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd78c030940 con 0x7fd79006c650 2024-09-12T02:28:07.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.321+0000 7fd79816f640 1 -- 172.21.15.60:0/3768834549 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7901ec6c0 con 0x7fd79006c650 2024-09-12T02:28:07.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.322+0000 7fd79816f640 1 --2- 172.21.15.60:0/3768834549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7901e2090 0x7fd7901e0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:07.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.322+0000 7fd79816f640 1 -- 172.21.15.60:0/3768834549 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd7901565b0 con 0x7fd7901e2090 2024-09-12T02:28:07.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.322+0000 7fd79570a640 1 --2- 172.21.15.60:0/3768834549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7901e2090 0x7fd7901e0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:07.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.322+0000 7fd79570a640 1 -- 172.21.15.60:0/3768834549 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd79006c430 con 0x7fd7901e2090 2024-09-12T02:28:07.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.323+0000 7fd79570a640 1 --2- 172.21.15.60:0/3768834549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7901e2090 0x7fd7901e0580 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd7900c6640 tx=0x7fd78000f930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:07.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.323+0000 7fd7867fc640 1 -- 172.21.15.60:0/3768834549 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd780019020 con 0x7fd7901e2090 2024-09-12T02:28:07.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.323+0000 7fd7867fc640 1 -- 172.21.15.60:0/3768834549 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd78c030ae0 con 0x7fd79006c650 2024-09-12T02:28:07.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.323+0000 7fd7867fc640 1 --2- 172.21.15.60:0/3768834549 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd77406bd30 0x7fd77406e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:07.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.324+0000 7fd7867fc640 1 -- 172.21.15.60:0/3768834549 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fd78c0aba50 con 0x7fd79006c650 2024-09-12T02:28:07.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.324+0000 7fd7867fc640 1 -- 172.21.15.60:0/3768834549 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fd780014870 con 0x7fd7901e2090 2024-09-12T02:28:07.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.324+0000 7fd7867fc640 1 -- 172.21.15.60:0/3768834549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7901e2090 msgr2=0x7fd7901e0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:07.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.324+0000 7fd7867fc640 1 --2- 172.21.15.60:0/3768834549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7901e2090 0x7fd7901e0580 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd7900c6640 tx=0x7fd78000f930 comp rx=0 tx=0).stop 2024-09-12T02:28:07.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.324+0000 7fd7867fc640 1 -- 172.21.15.60:0/3768834549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7901e2090 msgr2=0x7fd7901e0580 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:28:07.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.324+0000 7fd7867fc640 1 --2- 172.21.15.60:0/3768834549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7901e2090 0x7fd7901e0580 secure :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd7900c6640 tx=0x7fd78000f930 comp rx=0 tx=0).stop 2024-09-12T02:28:07.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.324+0000 7fd79670c640 1 --2- 172.21.15.60:0/3768834549 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd77406bd30 0x7fd77406e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:07.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.324+0000 7fd79670c640 1 --2- 172.21.15.60:0/3768834549 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd77406bd30 0x7fd77406e1f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd788001560 tx=0x7fd788001970 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:07.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.331+0000 7fd79816f640 1 --2- 172.21.15.60:0/3768834549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7901e0ac0 0x7fd7901ef110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:07.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.331+0000 7fd79816f640 1 -- 172.21.15.60:0/3768834549 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd7900cc4a0 con 0x7fd7901e0ac0 2024-09-12T02:28:07.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.331+0000 7fd79570a640 1 --2- 172.21.15.60:0/3768834549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7901e0ac0 0x7fd7901ef110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:07.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.331+0000 7fd79570a640 1 -- 172.21.15.60:0/3768834549 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd7900cc1c0 con 0x7fd7901e0ac0 2024-09-12T02:28:07.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.332+0000 7fd79570a640 1 --2- 172.21.15.60:0/3768834549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7901e0ac0 0x7fd7901ef110 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd790156730 tx=0x7fd7800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:07.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.332+0000 7fd7867fc640 1 -- 172.21.15.60:0/3768834549 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd78001e420 con 0x7fd7901e0ac0 2024-09-12T02:28:07.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.332+0000 7fd7867fc640 1 -- 172.21.15.60:0/3768834549 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4885 (secure 0 0 0) 0x7fd78001e420 con 0x7fd7901e0ac0 2024-09-12T02:28:07.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.332+0000 7fd7867fc640 1 -- 172.21.15.60:0/3768834549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7901e0ac0 msgr2=0x7fd7901ef110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:07.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.332+0000 7fd7867fc640 1 --2- 172.21.15.60:0/3768834549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7901e0ac0 0x7fd7901ef110 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd790156730 tx=0x7fd7800046c0 comp rx=0 tx=0).stop 2024-09-12T02:28:07.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.332+0000 7fd7867fc640 1 -- 172.21.15.60:0/3768834549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7901e0ac0 msgr2=0x7fd7901ef110 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:28:07.333 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:28:07.333 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:28:07.334 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:28:07.334 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:28:07.334 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 42, 2024-09-12T02:28:07.334 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 127441, 2024-09-12T02:28:07.334 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:28:07.334 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:28:07.334 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:28:07.334 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:28:07.334 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:28:07.334 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 2, 2024-09-12T02:28:07.335 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:28:07.335 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:28:07.335 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:28:07.335 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:28:07.335 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:28:07.335 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:28:07.335 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:28:07.335 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:28:07.335 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:28:07.335 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:28:07.335 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:28:07.335 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:28:07.335 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:28:07.335 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:28:07.335 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:28:07.336 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:28:07.336 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:28:07.336 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:28:07.336 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:28:07.336 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:28:07.336 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:28:07.336 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:28:07.336 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:28:07.336 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:28:07.336 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:28:07.336 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:28:07.336 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:28:07.336 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:28:07.336 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:07.336 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:07.337 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:28:07.337 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:28:07.337 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:28:07.337 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:28:07.337 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:28:07.337 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:28:07.337 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:28:07.337 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:28:07.337 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:28:07.337 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:28:07.337 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:28:07.337 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:28:07.337 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:28:07.337 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:28:07.337 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:28:07.338 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:28:07.338 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:28:07.338 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:28:07.338 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:28:07.338 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:28:07.338 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:28:07.338 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:28:07.338 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:28:07.338 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:28:07.338 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:28:07.338 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:28:07.338 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:28:07.338 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:28:07.338 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:28:07.338 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:28:07.339 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:07.339 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:28:07.339 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:07.339 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:28:07.339 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:28:07.339 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:28:07.339 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:28:07.339 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:07.339 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:28:07.339 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:28:07.339 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:07.339 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:07.339 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:07.339 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:28:07.340 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:28:07.340 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:07.340 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:07.340 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:07.340 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:07.340 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:28:07.340 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:28:07.340 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:28:07.340 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:28:07.340 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:28:07.340 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:07.340 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:07.340 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:28:07.341 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:28:07.341 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:28:07.341 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:28:07.341 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:07.341 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:28:07.341 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:28:07.341 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:07.341 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:07.341 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:07.341 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:28:07.341 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:28:07.341 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:07.341 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:07.342 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:07.342 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:07.342 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:28:07.342 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:28:07.342 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:28:07.342 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:28:07.342 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:28:07.342 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:07.342 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:07.342 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:28:07.342 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:28:07.342 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:28:07.342 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:28:07.343 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:07.343 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:28:07.343 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:28:07.343 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:07.343 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:07.343 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:07.343 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:28:07.343 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:28:07.343 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:07.343 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:07.343 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:07.343 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:07.343 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:28:07.343 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:28:07.343 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:28:07.344 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:28:07.344 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:28:07.344 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:07.344 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:07.344 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:07.344 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:28:07.344 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:28:07.344 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:07.344 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:28:07.344 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:28:07.344 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:28:07.344 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:07.345 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:28:07.345 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:28:07.345 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:07.345 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:28:07.345 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:28:07.345 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:28:07.345 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:07.345 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:28:07.345 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:28:07.345 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:07.345 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:28:07.345 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:28:07.345 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:28:07.346 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:07.346 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:28:07.346 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:28:07.346 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:07.346 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:28:07.346 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:28:07.346 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:28:07.346 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:07.346 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:07.346 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:07.346 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:28:07.346 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:28:07.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.332+0000 7fd7867fc640 1 --2- 172.21.15.60:0/3768834549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7901e0ac0 0x7fd7901ef110 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:07.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.332+0000 7fd79816f640 1 -- 172.21.15.60:0/3768834549 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd77406bd30 msgr2=0x7fd77406e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:07.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.333+0000 7fd79816f640 1 --2- 172.21.15.60:0/3768834549 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd77406bd30 0x7fd77406e1f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd788001560 tx=0x7fd788001970 comp rx=0 tx=0).stop 2024-09-12T02:28:07.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.333+0000 7fd79670c640 1 -- 172.21.15.60:0/3768834549 reap_dead start 2024-09-12T02:28:07.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.333+0000 7fd79816f640 1 -- 172.21.15.60:0/3768834549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd79006c650 msgr2=0x7fd79014ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:07.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.333+0000 7fd79816f640 1 --2- 172.21.15.60:0/3768834549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd79006c650 0x7fd79014ebe0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd78c000c00 tx=0x7fd78c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:28:07.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.333+0000 7fd79816f640 1 -- 172.21.15.60:0/3768834549 shutdown_connections 2024-09-12T02:28:07.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.333+0000 7fd79816f640 1 --2- 172.21.15.60:0/3768834549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd79006c650 0x7fd79014ebe0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:07.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.333+0000 7fd79816f640 1 -- 172.21.15.60:0/3768834549 >> 172.21.15.60:0/3768834549 conn(0x7fd790068030 msgr2=0x7fd7900c79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:07.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.333+0000 7fd79816f640 1 -- 172.21.15.60:0/3768834549 shutdown_connections 2024-09-12T02:28:07.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.333+0000 7fd79816f640 1 -- 172.21.15.60:0/3768834549 wait complete. 2024-09-12T02:28:07.349 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:28:07.349 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-12T02:28:07.349 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-12T02:28:07.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.465+0000 7f84c4731640 1 Processor -- start 2024-09-12T02:28:07.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.465+0000 7f84c4731640 1 -- start start 2024-09-12T02:28:07.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.466+0000 7f84c4731640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f84bc151780 0x7f84bc155560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:07.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.466+0000 7f84c4731640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84bc154ff0 con 0x7f84bc154ac0 2024-09-12T02:28:07.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.466+0000 7f84c4731640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84bc06f5f0 con 0x7f84bc0703b0 2024-09-12T02:28:07.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.466+0000 7f84c4731640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f84bc06f8d0 con 0x7f84bc151780 2024-09-12T02:28:07.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.466+0000 7f84c1ccc640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f84bc154ac0 0x7f84bc0708a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49578/0 (socket says 172.21.15.60:49578) 2024-09-12T02:28:07.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.466+0000 7f84c1ccc640 1 -- 172.21.15.60:0/2642719435 learned_addr learned my addr 172.21.15.60:0/2642719435 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:28:07.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.467+0000 7f84c24cd640 1 --2- 172.21.15.60:0/2642719435 >> v2:172.21.15.105:3300/0 conn(0x7f84bc151780 0x7f84bc155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:07.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.467+0000 7f84c14cb640 1 -- 172.21.15.60:0/2642719435 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2458427116 0 0) 0x7f84bc154ff0 con 0x7f84bc154ac0 2024-09-12T02:28:07.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.467+0000 7f84c14cb640 1 -- 172.21.15.60:0/2642719435 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84a8003520 con 0x7f84bc154ac0 2024-09-12T02:28:07.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.467+0000 7f84c24cd640 1 -- 172.21.15.60:0/2642719435 >> v1:172.21.15.105:6789/0 conn(0x7f84bc0703b0 legacy=0x7f84bc15e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:07.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.467+0000 7f84c24cd640 1 -- 172.21.15.60:0/2642719435 >> v1:172.21.15.60:6789/0 conn(0x7f84bc154ac0 legacy=0x7f84bc0708a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:07.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.467+0000 7f84c24cd640 1 -- 172.21.15.60:0/2642719435 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84bc06fbb0 con 0x7f84bc151780 2024-09-12T02:28:07.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.468+0000 7f84c24cd640 1 --2- 172.21.15.60:0/2642719435 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84bc151780 0x7f84bc155560 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f84b80097a0 tx=0x7f84b802a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81a21e4aee5f318c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:07.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.468+0000 7f84c14cb640 1 -- 172.21.15.60:0/2642719435 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b8037070 con 0x7f84bc151780 2024-09-12T02:28:07.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.468+0000 7f84c14cb640 1 -- 172.21.15.60:0/2642719435 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84b8032440 con 0x7f84bc151780 2024-09-12T02:28:07.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.468+0000 7f84c14cb640 1 -- 172.21.15.60:0/2642719435 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b802ae60 con 0x7f84bc151780 2024-09-12T02:28:07.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.469+0000 7f84c4731640 1 -- 172.21.15.60:0/2642719435 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84bc151780 msgr2=0x7f84bc155560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:07.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.469+0000 7f84c4731640 1 --2- 172.21.15.60:0/2642719435 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84bc151780 0x7f84bc155560 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f84b80097a0 tx=0x7f84b802a110 comp rx=0 tx=0).stop 2024-09-12T02:28:07.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.469+0000 7f84c4731640 1 -- 172.21.15.60:0/2642719435 shutdown_connections 2024-09-12T02:28:07.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.469+0000 7f84c4731640 1 --2- 172.21.15.60:0/2642719435 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84bc151780 0x7f84bc155560 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:07.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.469+0000 7f84c4731640 1 -- 172.21.15.60:0/2642719435 >> 172.21.15.60:0/2642719435 conn(0x7f84bc0c6980 msgr2=0x7f84bc0c6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:07.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.469+0000 7f84c4731640 1 -- 172.21.15.60:0/2642719435 shutdown_connections 2024-09-12T02:28:07.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.469+0000 7f84c4731640 1 -- 172.21.15.60:0/2642719435 wait complete. 2024-09-12T02:28:07.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.470+0000 7f84c4731640 1 Processor -- start 2024-09-12T02:28:07.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.470+0000 7f84c4731640 1 -- start start 2024-09-12T02:28:07.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.471+0000 7f84c4731640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f84bc0703b0 0x7f84bc1e9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:07.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.471+0000 7f84c4731640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84bc151780 0x7f84bc1ed240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:07.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.471+0000 7f84c4731640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84bc154ac0 0x7f84bc151ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:07.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.471+0000 7f84c4731640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f84bc071130 con 0x7f84bc151780 2024-09-12T02:28:07.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.471+0000 7f84c4731640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f84bc070fb0 con 0x7f84bc154ac0 2024-09-12T02:28:07.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.471+0000 7f84c4731640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f84bc073f30 con 0x7f84bc0703b0 2024-09-12T02:28:07.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.471+0000 7f84c1ccc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84bc151780 0x7f84bc1ed240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:07.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.471+0000 7f84c1ccc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84bc151780 0x7f84bc1ed240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39510/0 (socket says 172.21.15.60:39510) 2024-09-12T02:28:07.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.471+0000 7f84c1ccc640 1 -- 172.21.15.60:0/1761304548 learned_addr learned my addr 172.21.15.60:0/1761304548 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:28:07.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.471+0000 7f84c2cce640 1 --2- 172.21.15.60:0/1761304548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84bc154ac0 0x7f84bc151ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:07.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.471+0000 7f84c24cd640 1 --2- 172.21.15.60:0/1761304548 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f84bc0703b0 0x7f84bc1e9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:07.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.471+0000 7f84c24cd640 1 -- 172.21.15.60:0/1761304548 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f84bc0703b0 msgr2=0x7f84bc1e9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-12T02:28:07.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.471+0000 7f84c24cd640 1 -- 172.21.15.60:0/1761304548 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f84bc0703b0 msgr2=0x7f84bc1e9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:28:07.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.471+0000 7f84c24cd640 1 --2- 172.21.15.60:0/1761304548 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f84bc0703b0 0x7f84bc1e9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:28:07.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.471+0000 7f84c24cd640 1 --2- 172.21.15.60:0/1761304548 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f84bc0703b0 0x7f84bc1e9f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:28:07.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.471+0000 7f84c1ccc640 1 -- 172.21.15.60:0/1761304548 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f84bc0703b0 msgr2=0x7f84bc1e9f50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:28:07.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.471+0000 7f84c1ccc640 1 --2- 172.21.15.60:0/1761304548 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f84bc0703b0 0x7f84bc1e9f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:07.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.471+0000 7f84c1ccc640 1 -- 172.21.15.60:0/1761304548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84bc154ac0 msgr2=0x7f84bc151ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:07.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.471+0000 7f84c1ccc640 1 --2- 172.21.15.60:0/1761304548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84bc154ac0 0x7f84bc151ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:07.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.471+0000 7f84c1ccc640 1 -- 172.21.15.60:0/1761304548 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84bc156440 con 0x7f84bc151780 2024-09-12T02:28:07.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.471+0000 7f84c2cce640 1 --2- 172.21.15.60:0/1761304548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84bc154ac0 0x7f84bc151ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:28:07.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.472+0000 7f84c1ccc640 1 --2- 172.21.15.60:0/1761304548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84bc151780 0x7f84bc1ed240 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f84ac00c3e0 tx=0x7f84ac00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:07.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.472+0000 7f84b2ffd640 1 -- 172.21.15.60:0/1761304548 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84ac017070 con 0x7f84bc151780 2024-09-12T02:28:07.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.472+0000 7f84b2ffd640 1 -- 172.21.15.60:0/1761304548 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84ac005ce0 con 0x7f84bc151780 2024-09-12T02:28:07.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.472+0000 7f84b2ffd640 1 -- 172.21.15.60:0/1761304548 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84ac0072d0 con 0x7f84bc151780 2024-09-12T02:28:07.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.472+0000 7f84c4731640 1 -- 172.21.15.60:0/1761304548 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84bc14d1e0 con 0x7f84bc151780 2024-09-12T02:28:07.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.472+0000 7f84c4731640 1 -- 172.21.15.60:0/1761304548 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84bc14d7a0 con 0x7f84bc151780 2024-09-12T02:28:07.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.473+0000 7f84c4731640 1 --2- 172.21.15.60:0/1761304548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84bc1ed780 0x7f84bc146230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:07.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.473+0000 7f84c4731640 1 -- 172.21.15.60:0/1761304548 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f84bc0af630 con 0x7f84bc1ed780 2024-09-12T02:28:07.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.473+0000 7f84c24cd640 1 --2- 172.21.15.60:0/1761304548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84bc1ed780 0x7f84bc146230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:07.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.473+0000 7f84c24cd640 1 -- 172.21.15.60:0/1761304548 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f84bc073ca0 con 0x7f84bc1ed780 2024-09-12T02:28:07.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.473+0000 7f84c24cd640 1 --2- 172.21.15.60:0/1761304548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84bc1ed780 0x7f84bc146230 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f84bc072620 tx=0x7f84b80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:07.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.474+0000 7f84b2ffd640 1 -- 172.21.15.60:0/1761304548 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b8037040 con 0x7f84bc1ed780 2024-09-12T02:28:07.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.474+0000 7f84b2ffd640 1 -- 172.21.15.60:0/1761304548 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f84ac01a070 con 0x7f84bc151780 2024-09-12T02:28:07.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.474+0000 7f84b2ffd640 1 --2- 172.21.15.60:0/1761304548 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f84a006bd30 0x7f84a006e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:07.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.474+0000 7f84b2ffd640 1 -- 172.21.15.60:0/1761304548 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f84ac08a530 con 0x7f84bc151780 2024-09-12T02:28:07.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.474+0000 7f84c2cce640 1 --2- 172.21.15.60:0/1761304548 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f84a006bd30 0x7f84a006e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:07.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.474+0000 7f84b2ffd640 1 -- 172.21.15.60:0/1761304548 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f84b803c660 con 0x7f84bc1ed780 2024-09-12T02:28:07.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.474+0000 7f84b2ffd640 1 -- 172.21.15.60:0/1761304548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84bc1ed780 msgr2=0x7f84bc146230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:07.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.475+0000 7f84b2ffd640 1 --2- 172.21.15.60:0/1761304548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84bc1ed780 0x7f84bc146230 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f84bc072620 tx=0x7f84b80046c0 comp rx=0 tx=0).stop 2024-09-12T02:28:07.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.475+0000 7f84b2ffd640 1 -- 172.21.15.60:0/1761304548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84bc1ed780 msgr2=0x7f84bc146230 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:28:07.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.475+0000 7f84b2ffd640 1 --2- 172.21.15.60:0/1761304548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84bc1ed780 0x7f84bc146230 secure :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f84bc072620 tx=0x7f84b80046c0 comp rx=0 tx=0).stop 2024-09-12T02:28:07.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.475+0000 7f84c2cce640 1 --2- 172.21.15.60:0/1761304548 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f84a006bd30 0x7f84a006e1f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f84b40012e0 tx=0x7f84b4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:07.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.481+0000 7f84c4731640 1 --2- 172.21.15.60:0/1761304548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84bc152420 0x7f84bc0ad290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:07.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.481+0000 7f84c4731640 1 -- 172.21.15.60:0/1761304548 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f84bc1eca40 con 0x7f84bc152420 2024-09-12T02:28:07.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.481+0000 7f84c24cd640 1 --2- 172.21.15.60:0/1761304548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84bc152420 0x7f84bc0ad290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:07.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.481+0000 7f84c24cd640 1 -- 172.21.15.60:0/1761304548 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f84bc1ecdb0 con 0x7f84bc152420 2024-09-12T02:28:07.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.482+0000 7f84c24cd640 1 --2- 172.21.15.60:0/1761304548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84bc152420 0x7f84bc0ad290 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f84bc0c4450 tx=0x7f84b8008030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:07.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.482+0000 7f84b2ffd640 1 -- 172.21.15.60:0/1761304548 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b803d820 con 0x7f84bc152420 2024-09-12T02:28:07.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.482+0000 7f84b2ffd640 1 -- 172.21.15.60:0/1761304548 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5050 (secure 0 0 0) 0x7f84b803ce30 con 0x7f84bc152420 2024-09-12T02:28:07.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.482+0000 7f84b2ffd640 1 -- 172.21.15.60:0/1761304548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84bc152420 msgr2=0x7f84bc0ad290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:07.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.482+0000 7f84b2ffd640 1 --2- 172.21.15.60:0/1761304548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84bc152420 0x7f84bc0ad290 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f84bc0c4450 tx=0x7f84b8008030 comp rx=0 tx=0).stop 2024-09-12T02:28:07.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.482+0000 7f84b2ffd640 1 -- 172.21.15.60:0/1761304548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84bc152420 msgr2=0x7f84bc0ad290 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:28:07.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.482+0000 7f84b2ffd640 1 --2- 172.21.15.60:0/1761304548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84bc152420 0x7f84bc0ad290 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:07.484 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:28:07.485 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:28:07.485 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:28:07.485 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:28:07.485 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 42, 2024-09-12T02:28:07.485 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 232917, 2024-09-12T02:28:07.485 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:28:07.486 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:28:07.486 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:28:07.486 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:28:07.486 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:28:07.486 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 2, 2024-09-12T02:28:07.486 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:28:07.486 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:28:07.486 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:28:07.486 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:28:07.486 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:28:07.486 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:28:07.486 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:28:07.486 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:28:07.486 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:28:07.487 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:28:07.487 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:28:07.487 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:28:07.487 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:28:07.487 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:28:07.487 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:28:07.487 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:28:07.487 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:28:07.487 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:28:07.487 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:28:07.487 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:28:07.487 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:28:07.487 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:28:07.487 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:28:07.488 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:28:07.488 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:28:07.488 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:28:07.488 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:28:07.488 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:28:07.488 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:07.488 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:07.488 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:28:07.488 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:28:07.488 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:28:07.488 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:28:07.488 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:28:07.488 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:28:07.489 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:28:07.489 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:28:07.489 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:28:07.489 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:28:07.489 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:28:07.489 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:28:07.489 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:28:07.490 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:28:07.490 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:28:07.490 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:28:07.490 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:28:07.490 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:28:07.490 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:28:07.490 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:28:07.490 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:28:07.490 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:28:07.490 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:28:07.490 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:28:07.490 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:28:07.490 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:28:07.490 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:28:07.490 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:28:07.491 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:28:07.491 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:28:07.491 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:07.491 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:28:07.491 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:07.491 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:28:07.491 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:28:07.491 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:28:07.491 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:28:07.491 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:07.492 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:28:07.492 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:28:07.492 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:07.492 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:07.492 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:07.492 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:28:07.492 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:28:07.492 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:07.492 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:07.492 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:07.492 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:07.492 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:28:07.493 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:28:07.493 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:28:07.493 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:28:07.493 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:28:07.493 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:07.493 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:07.493 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:28:07.493 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:28:07.493 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:28:07.493 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:28:07.493 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:07.493 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:28:07.493 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:28:07.494 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:07.494 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:07.494 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:07.494 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:28:07.494 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:28:07.494 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:07.494 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:07.494 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:07.494 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:07.494 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:28:07.494 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:28:07.494 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:28:07.494 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:28:07.494 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:28:07.495 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:07.495 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:07.495 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:28:07.495 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:28:07.495 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:28:07.495 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:28:07.495 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:07.495 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:28:07.495 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:28:07.495 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:07.495 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:07.495 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:07.495 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:28:07.495 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:28:07.496 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:07.496 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:07.496 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:07.496 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:07.496 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:28:07.496 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:28:07.496 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:28:07.496 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:28:07.496 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:28:07.496 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:07.496 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:07.496 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:07.496 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:28:07.496 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:28:07.496 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:07.497 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:28:07.497 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:28:07.497 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:28:07.497 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:07.497 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:28:07.497 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:28:07.497 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:07.497 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:28:07.497 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:28:07.497 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:28:07.497 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:07.497 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:28:07.497 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:28:07.497 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:07.498 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:28:07.498 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:28:07.498 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-09-12T02:28:07.498 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:07.498 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:28:07.498 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:28:07.498 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:07.498 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:28:07.498 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:28:07.498 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-09-12T02:28:07.498 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:07.498 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:28:07.498 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:28:07.498 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:07.499 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:28:07.499 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:28:07.499 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:28:07.499 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:07.499 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:07.499 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:07.499 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:28:07.499 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:28:07.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.482+0000 7f84c4731640 1 -- 172.21.15.60:0/1761304548 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f84a006bd30 msgr2=0x7f84a006e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:07.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.482+0000 7f84c4731640 1 --2- 172.21.15.60:0/1761304548 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f84a006bd30 0x7f84a006e1f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f84b40012e0 tx=0x7f84b4009040 comp rx=0 tx=0).stop 2024-09-12T02:28:07.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.482+0000 7f84c4731640 1 -- 172.21.15.60:0/1761304548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84bc151780 msgr2=0x7f84bc1ed240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:07.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.482+0000 7f84c4731640 1 --2- 172.21.15.60:0/1761304548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84bc151780 0x7f84bc1ed240 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f84ac00c3e0 tx=0x7f84ac00c8a0 comp rx=0 tx=0).stop 2024-09-12T02:28:07.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.482+0000 7f84c2cce640 1 -- 172.21.15.60:0/1761304548 reap_dead start 2024-09-12T02:28:07.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.482+0000 7f84c4731640 1 -- 172.21.15.60:0/1761304548 shutdown_connections 2024-09-12T02:28:07.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.482+0000 7f84c4731640 1 --2- 172.21.15.60:0/1761304548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84bc151780 0x7f84bc1ed240 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:07.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.482+0000 7f84c4731640 1 -- 172.21.15.60:0/1761304548 >> 172.21.15.60:0/1761304548 conn(0x7f84bc0c6980 msgr2=0x7f84bc0c5c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:07.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.483+0000 7f84c4731640 1 -- 172.21.15.60:0/1761304548 shutdown_connections 2024-09-12T02:28:07.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.483+0000 7f84c4731640 1 -- 172.21.15.60:0/1761304548 wait complete. 2024-09-12T02:28:07.501 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:28:07.501 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-12T02:28:07.502 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-12T02:28:07.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.613+0000 7fbeca2f1640 1 Processor -- start 2024-09-12T02:28:07.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.614+0000 7fbeca2f1640 1 -- start start 2024-09-12T02:28:07.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.614+0000 7fbeca2f1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec406c650 0x7fbec40c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:07.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.614+0000 7fbeca2f1640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbec415a7c0 con 0x7fbec4150480 2024-09-12T02:28:07.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.614+0000 7fbeca2f1640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbec4159a00 con 0x7fbec40ca1c0 2024-09-12T02:28:07.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.614+0000 7fbeca2f1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbec406c240 con 0x7fbec406c650 2024-09-12T02:28:07.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.615+0000 7fbec3fff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fbec4150480 0x7fbec40c7a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49588/0 (socket says 172.21.15.60:49588) 2024-09-12T02:28:07.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.615+0000 7fbec3fff640 1 -- 172.21.15.60:0/2500617499 learned_addr learned my addr 172.21.15.60:0/2500617499 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:28:07.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.615+0000 7fbec37fe640 1 --2- 172.21.15.60:0/2500617499 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec406c650 0x7fbec40c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:07.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.615+0000 7fbec37fe640 1 -- 172.21.15.60:0/2500617499 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec406c650 msgr2=0x7fbec40c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:28:07.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.615+0000 7fbec37fe640 1 -- 172.21.15.60:0/2500617499 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec406c650 msgr2=0x7fbec40c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:28:07.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.615+0000 7fbec37fe640 1 --2- 172.21.15.60:0/2500617499 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec406c650 0x7fbec40c9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:28:07.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.615+0000 7fbec37fe640 1 --2- 172.21.15.60:0/2500617499 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec406c650 0x7fbec40c9c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:28:07.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.615+0000 7fbec2ffd640 1 -- 172.21.15.60:0/2500617499 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 351762549 0 0) 0x7fbec415a7c0 con 0x7fbec4150480 2024-09-12T02:28:07.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.615+0000 7fbec2ffd640 1 -- 172.21.15.60:0/2500617499 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbeac003520 con 0x7fbec4150480 2024-09-12T02:28:07.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.615+0000 7fbec2ffd640 1 -- 172.21.15.60:0/2500617499 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3943724082 0 0) 0x7fbec4159a00 con 0x7fbec40ca1c0 2024-09-12T02:28:07.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.615+0000 7fbec2ffd640 1 -- 172.21.15.60:0/2500617499 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbec415a7c0 con 0x7fbec40ca1c0 2024-09-12T02:28:07.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.615+0000 7fbec2ffd640 1 -- 172.21.15.60:0/2500617499 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1116924503 0 0) 0x7fbeac003520 con 0x7fbec4150480 2024-09-12T02:28:07.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.615+0000 7fbec2ffd640 1 -- 172.21.15.60:0/2500617499 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec406c650 msgr2=0x7fbec40c9c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:28:07.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.615+0000 7fbec2ffd640 1 --2- 172.21.15.60:0/2500617499 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec406c650 0x7fbec40c9c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:07.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.615+0000 7fbec2ffd640 1 -- 172.21.15.60:0/2500617499 >> v1:172.21.15.105:6789/0 conn(0x7fbec40ca1c0 legacy=0x7fbec4160bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:07.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.615+0000 7fbec2ffd640 1 -- 172.21.15.60:0/2500617499 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec4159ce0 con 0x7fbec4150480 2024-09-12T02:28:07.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.615+0000 7fbec2ffd640 1 -- 172.21.15.60:0/2500617499 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7fbeb4001670 con 0x7fbec4150480 2024-09-12T02:28:07.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.615+0000 7fbec2ffd640 1 -- 172.21.15.60:0/2500617499 >> v1:172.21.15.60:6789/0 conn(0x7fbec4150480 legacy=0x7fbec40c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:07.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.615+0000 7fbec2ffd640 1 --2- 172.21.15.60:0/2500617499 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbeac004bd0 0x7fbeac004fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:07.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.615+0000 7fbec2ffd640 1 --2- 172.21.15.60:0/2500617499 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec406c650 0x7fbeac0037a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:07.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.615+0000 7fbec2ffd640 1 --2- 172.21.15.60:0/2500617499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbeac003ce0 0x7fbeac004160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:07.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.615+0000 7fbec2ffd640 1 -- 172.21.15.60:0/2500617499 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbeac00bac0 con 0x7fbeac003ce0 2024-09-12T02:28:07.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.615+0000 7fbec2ffd640 1 -- 172.21.15.60:0/2500617499 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbeac00bc70 con 0x7fbeac004bd0 2024-09-12T02:28:07.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.615+0000 7fbec2ffd640 1 -- 172.21.15.60:0/2500617499 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbeac00be70 con 0x7fbec406c650 2024-09-12T02:28:07.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.616+0000 7fbec3fff640 1 --2- 172.21.15.60:0/2500617499 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbeac004bd0 0x7fbeac004fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:07.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.616+0000 7fbec888e640 1 --2- 172.21.15.60:0/2500617499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbeac003ce0 0x7fbeac004160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:07.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.616+0000 7fbec37fe640 1 --2- 172.21.15.60:0/2500617499 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec406c650 0x7fbeac0037a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:07.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.616+0000 7fbec888e640 1 -- 172.21.15.60:0/2500617499 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec406c650 msgr2=0x7fbeac0037a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:07.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.616+0000 7fbec888e640 1 --2- 172.21.15.60:0/2500617499 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec406c650 0x7fbeac0037a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:07.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.616+0000 7fbec888e640 1 -- 172.21.15.60:0/2500617499 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbeac004bd0 msgr2=0x7fbeac004fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:07.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.616+0000 7fbec888e640 1 --2- 172.21.15.60:0/2500617499 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbeac004bd0 0x7fbeac004fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:07.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.616+0000 7fbec888e640 1 -- 172.21.15.60:0/2500617499 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeac003520 con 0x7fbeac003ce0 2024-09-12T02:28:07.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.616+0000 7fbec3fff640 1 --2- 172.21.15.60:0/2500617499 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbeac004bd0 0x7fbeac004fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:28:07.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.617+0000 7fbec888e640 1 --2- 172.21.15.60:0/2500617499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbeac003ce0 0x7fbeac004160 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbebc001fd0 tx=0x7fbeac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb83c3c081781e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:07.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.617+0000 7fbec2ffd640 1 -- 172.21.15.60:0/2500617499 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbebc001bf0 con 0x7fbeac003ce0 2024-09-12T02:28:07.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.617+0000 7fbec2ffd640 1 -- 172.21.15.60:0/2500617499 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbebc003b70 con 0x7fbeac003ce0 2024-09-12T02:28:07.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.617+0000 7fbec2ffd640 1 -- 172.21.15.60:0/2500617499 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbebc0050d0 con 0x7fbeac003ce0 2024-09-12T02:28:07.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.617+0000 7fbeca2f1640 1 -- 172.21.15.60:0/2500617499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbeac003ce0 msgr2=0x7fbeac004160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:07.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.617+0000 7fbeca2f1640 1 --2- 172.21.15.60:0/2500617499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbeac003ce0 0x7fbeac004160 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbebc001fd0 tx=0x7fbeac005830 comp rx=0 tx=0).stop 2024-09-12T02:28:07.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.617+0000 7fbec888e640 1 -- 172.21.15.60:0/2500617499 reap_dead start 2024-09-12T02:28:07.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.617+0000 7fbeca2f1640 1 -- 172.21.15.60:0/2500617499 shutdown_connections 2024-09-12T02:28:07.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.617+0000 7fbeca2f1640 1 -- 172.21.15.60:0/2500617499 >> 172.21.15.60:0/2500617499 conn(0x7fbec4068030 msgr2=0x7fbec4073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:07.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.618+0000 7fbeca2f1640 1 -- 172.21.15.60:0/2500617499 shutdown_connections 2024-09-12T02:28:07.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.618+0000 7fbeca2f1640 1 -- 172.21.15.60:0/2500617499 wait complete. 2024-09-12T02:28:07.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.619+0000 7fbeca2f1640 1 Processor -- start 2024-09-12T02:28:07.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.619+0000 7fbeca2f1640 1 -- start start 2024-09-12T02:28:07.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.619+0000 7fbeca2f1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbeac003ce0 0x7fbec4155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:07.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.620+0000 7fbeca2f1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbec414fcf0 0x7fbec4152310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:07.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.620+0000 7fbeca2f1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbec41ef500 0x7fbec4152850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:07.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.620+0000 7fbeca2f1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbec40ca670 con 0x7fbec41ef500 2024-09-12T02:28:07.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.620+0000 7fbeca2f1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbec415a330 con 0x7fbec414fcf0 2024-09-12T02:28:07.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.620+0000 7fbeca2f1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbec406d270 con 0x7fbeac003ce0 2024-09-12T02:28:07.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.620+0000 7fbec888e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbec41ef500 0x7fbec4152850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:07.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.620+0000 7fbec888e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbec41ef500 0x7fbec4152850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39528/0 (socket says 172.21.15.60:39528) 2024-09-12T02:28:07.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.620+0000 7fbec888e640 1 -- 172.21.15.60:0/3140437054 learned_addr learned my addr 172.21.15.60:0/3140437054 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:28:07.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.620+0000 7fbec37fe640 1 --2- 172.21.15.60:0/3140437054 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbec414fcf0 0x7fbec4152310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:07.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.620+0000 7fbec3fff640 1 --2- 172.21.15.60:0/3140437054 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbeac003ce0 0x7fbec4155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:07.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.620+0000 7fbec3fff640 1 -- 172.21.15.60:0/3140437054 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbeac003ce0 msgr2=0x7fbec4155a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-12T02:28:07.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.620+0000 7fbec3fff640 1 -- 172.21.15.60:0/3140437054 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbeac003ce0 msgr2=0x7fbec4155a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:28:07.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.620+0000 7fbec3fff640 1 --2- 172.21.15.60:0/3140437054 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbeac003ce0 0x7fbec4155a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:28:07.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.620+0000 7fbec3fff640 1 --2- 172.21.15.60:0/3140437054 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbeac003ce0 0x7fbec4155a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:28:07.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.620+0000 7fbec888e640 1 -- 172.21.15.60:0/3140437054 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbeac003ce0 msgr2=0x7fbec4155a50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:28:07.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.620+0000 7fbec888e640 1 --2- 172.21.15.60:0/3140437054 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbeac003ce0 0x7fbec4155a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:07.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.620+0000 7fbec888e640 1 -- 172.21.15.60:0/3140437054 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbec414fcf0 msgr2=0x7fbec4152310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:07.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.620+0000 7fbec888e640 1 --2- 172.21.15.60:0/3140437054 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbec414fcf0 0x7fbec4152310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:07.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.620+0000 7fbec888e640 1 -- 172.21.15.60:0/3140437054 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec40cbe50 con 0x7fbec41ef500 2024-09-12T02:28:07.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.620+0000 7fbec888e640 1 --2- 172.21.15.60:0/3140437054 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbec41ef500 0x7fbec4152850 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbebc005040 tx=0x7fbebc001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:07.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.620+0000 7fbec0ff9640 1 -- 172.21.15.60:0/3140437054 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb4007cc0 con 0x7fbec41ef500 2024-09-12T02:28:07.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.620+0000 7fbec0ff9640 1 -- 172.21.15.60:0/3140437054 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbebc043070 con 0x7fbec41ef500 2024-09-12T02:28:07.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.621+0000 7fbeca2f1640 1 -- 172.21.15.60:0/3140437054 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbec41e0ac0 con 0x7fbec41ef500 2024-09-12T02:28:07.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.621+0000 7fbec0ff9640 1 -- 172.21.15.60:0/3140437054 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbebc001bf0 con 0x7fbec41ef500 2024-09-12T02:28:07.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.621+0000 7fbeca2f1640 1 -- 172.21.15.60:0/3140437054 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbec41e1040 con 0x7fbec41ef500 2024-09-12T02:28:07.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.622+0000 7fbeca2f1640 1 --2- 172.21.15.60:0/3140437054 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec41e1280 0x7fbec4151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:07.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.622+0000 7fbeca2f1640 1 -- 172.21.15.60:0/3140437054 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbec40c6c60 con 0x7fbec41e1280 2024-09-12T02:28:07.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.622+0000 7fbec3fff640 1 --2- 172.21.15.60:0/3140437054 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec41e1280 0x7fbec4151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:07.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.622+0000 7fbec3fff640 1 -- 172.21.15.60:0/3140437054 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec41e1280 msgr2=0x7fbec4151050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2024-09-12T02:28:07.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.622+0000 7fbec3fff640 1 -- 172.21.15.60:0/3140437054 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec41e1280 msgr2=0x7fbec4151050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:28:07.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.622+0000 7fbec3fff640 1 --2- 172.21.15.60:0/3140437054 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec41e1280 0x7fbec4151050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:28:07.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.622+0000 7fbec3fff640 1 --2- 172.21.15.60:0/3140437054 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec41e1280 0x7fbec4151050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:28:07.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.622+0000 7fbec0ff9640 1 -- 172.21.15.60:0/3140437054 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbebc03a040 con 0x7fbec41ef500 2024-09-12T02:28:07.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.623+0000 7fbec0ff9640 1 --2- 172.21.15.60:0/3140437054 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbeb006be60 0x7fbeb006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:07.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.623+0000 7fbec0ff9640 1 -- 172.21.15.60:0/3140437054 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fbebc0ab5c0 con 0x7fbec41ef500 2024-09-12T02:28:07.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.623+0000 7fbec37fe640 1 --2- 172.21.15.60:0/3140437054 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbeb006be60 0x7fbeb006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:07.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.623+0000 7fbec37fe640 1 --2- 172.21.15.60:0/3140437054 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbeb006be60 0x7fbeb006e320 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbec40cbc20 tx=0x7fbeb8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:07.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.823+0000 7fbec3fff640 1 --2- 172.21.15.60:0/3140437054 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec41e1280 0x7fbec4151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:07.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.823+0000 7fbec3fff640 1 -- 172.21.15.60:0/3140437054 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec41e1280 msgr2=0x7fbec4151050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-12T02:28:07.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.823+0000 7fbec3fff640 1 -- 172.21.15.60:0/3140437054 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec41e1280 msgr2=0x7fbec4151050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:28:07.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.823+0000 7fbec3fff640 1 --2- 172.21.15.60:0/3140437054 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec41e1280 0x7fbec4151050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:28:07.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:07.823+0000 7fbec3fff640 1 --2- 172.21.15.60:0/3140437054 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec41e1280 0x7fbec4151050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:28:08.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:08.224+0000 7fbec3fff640 1 --2- 172.21.15.60:0/3140437054 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec41e1280 0x7fbec4151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:08.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:08.224+0000 7fbec3fff640 1 -- 172.21.15.60:0/3140437054 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec41e1280 msgr2=0x7fbec4151050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-12T02:28:08.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:08.224+0000 7fbec3fff640 1 -- 172.21.15.60:0/3140437054 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec41e1280 msgr2=0x7fbec4151050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:28:08.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:08.224+0000 7fbec3fff640 1 --2- 172.21.15.60:0/3140437054 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec41e1280 0x7fbec4151050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:28:08.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:08.224+0000 7fbec3fff640 1 --2- 172.21.15.60:0/3140437054 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec41e1280 0x7fbec4151050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:28:09.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:09.025+0000 7fbec3fff640 1 --2- 172.21.15.60:0/3140437054 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec41e1280 0x7fbec4151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:09.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:09.025+0000 7fbec3fff640 1 -- 172.21.15.60:0/3140437054 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec41e1280 msgr2=0x7fbec4151050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-12T02:28:09.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:09.025+0000 7fbec3fff640 1 -- 172.21.15.60:0/3140437054 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec41e1280 msgr2=0x7fbec4151050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:28:09.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:09.025+0000 7fbec3fff640 1 --2- 172.21.15.60:0/3140437054 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec41e1280 0x7fbec4151050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:28:09.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:09.025+0000 7fbec3fff640 1 --2- 172.21.15.60:0/3140437054 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec41e1280 0x7fbec4151050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:28:10.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.627+0000 7fbec3fff640 1 --2- 172.21.15.60:0/3140437054 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec41e1280 0x7fbec4151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:10.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.627+0000 7fbec3fff640 1 -- 172.21.15.60:0/3140437054 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbec4159a00 con 0x7fbec41e1280 2024-09-12T02:28:10.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.627+0000 7fbec3fff640 1 --2- 172.21.15.60:0/3140437054 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec41e1280 0x7fbec4151050 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4004fd0 tx=0x7fbeb4007780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:10.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.628+0000 7fbec0ff9640 1 -- 172.21.15.60:0/3140437054 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb4019c70 con 0x7fbec41e1280 2024-09-12T02:28:10.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.628+0000 7fbec0ff9640 1 -- 172.21.15.60:0/3140437054 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fbeb4019c70 con 0x7fbec41e1280 2024-09-12T02:28:10.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.628+0000 7fbec0ff9640 1 -- 172.21.15.60:0/3140437054 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec41e1280 msgr2=0x7fbec4151050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:10.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.628+0000 7fbec0ff9640 1 --2- 172.21.15.60:0/3140437054 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec41e1280 0x7fbec4151050 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4004fd0 tx=0x7fbeb4007780 comp rx=0 tx=0).stop 2024-09-12T02:28:10.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.628+0000 7fbec0ff9640 1 -- 172.21.15.60:0/3140437054 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec41e1280 msgr2=0x7fbec4151050 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:28:10.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.628+0000 7fbec0ff9640 1 --2- 172.21.15.60:0/3140437054 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec41e1280 0x7fbec4151050 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:10.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.638+0000 7fbeca2f1640 1 --2- 172.21.15.60:0/3140437054 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec4151590 0x7fbec41e8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:10.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.638+0000 7fbeca2f1640 1 -- 172.21.15.60:0/3140437054 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbec40c9ef0 con 0x7fbec4151590 2024-09-12T02:28:10.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.638+0000 7fbec3fff640 1 --2- 172.21.15.60:0/3140437054 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec4151590 0x7fbec41e8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:10.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.638+0000 7fbec3fff640 1 -- 172.21.15.60:0/3140437054 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbec406c430 con 0x7fbec4151590 2024-09-12T02:28:10.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.638+0000 7fbec3fff640 1 --2- 172.21.15.60:0/3140437054 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec4151590 0x7fbec41e8e00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4004fd0 tx=0x7fbeb40019c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:10.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.639+0000 7fbec0ff9640 1 -- 172.21.15.60:0/3140437054 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb4019e20 con 0x7fbec4151590 2024-09-12T02:28:10.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.639+0000 7fbec0ff9640 1 -- 172.21.15.60:0/3140437054 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4548 (secure 0 0 0) 0x7fbeb4024760 con 0x7fbec4151590 2024-09-12T02:28:10.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.639+0000 7fbec0ff9640 1 -- 172.21.15.60:0/3140437054 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec4151590 msgr2=0x7fbec41e8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:10.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.639+0000 7fbec0ff9640 1 --2- 172.21.15.60:0/3140437054 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec4151590 0x7fbec41e8e00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4004fd0 tx=0x7fbeb40019c0 comp rx=0 tx=0).stop 2024-09-12T02:28:10.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.639+0000 7fbec0ff9640 1 -- 172.21.15.60:0/3140437054 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec4151590 msgr2=0x7fbec41e8e00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:28:10.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.639+0000 7fbec0ff9640 1 --2- 172.21.15.60:0/3140437054 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec4151590 0x7fbec41e8e00 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4004fd0 tx=0x7fbeb40019c0 comp rx=0 tx=0).stop 2024-09-12T02:28:10.640 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:28:10.640 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:28:10.640 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:28:10.640 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:28:10.640 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 42, 2024-09-12T02:28:10.641 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 10705, 2024-09-12T02:28:10.641 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:28:10.641 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:28:10.641 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:28:10.641 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:28:10.641 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:28:10.641 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 5, 2024-09-12T02:28:10.641 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:28:10.641 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:28:10.641 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:28:10.641 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:28:10.641 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:28:10.641 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:28:10.641 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:28:10.641 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:28:10.642 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:28:10.642 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:28:10.642 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:28:10.642 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:28:10.642 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:28:10.642 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:28:10.642 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:28:10.642 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:28:10.642 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:28:10.642 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:28:10.642 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:28:10.642 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:28:10.642 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:28:10.642 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:28:10.642 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:28:10.643 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:28:10.643 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:28:10.643 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:28:10.643 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:28:10.643 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:28:10.643 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:10.643 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:10.643 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:28:10.643 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:28:10.643 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:28:10.643 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:28:10.643 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:28:10.643 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:28:10.643 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:28:10.644 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:28:10.644 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:28:10.644 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:28:10.644 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:28:10.644 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:28:10.644 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:28:10.644 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:28:10.644 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:28:10.644 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:28:10.644 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:28:10.644 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:28:10.644 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:28:10.644 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:28:10.644 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:28:10.644 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:28:10.645 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:28:10.645 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:28:10.645 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:28:10.645 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:28:10.645 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:28:10.645 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:28:10.645 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:28:10.645 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:28:10.645 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:10.645 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:28:10.645 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:10.646 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:28:10.646 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:28:10.646 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:28:10.646 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:28:10.646 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:10.646 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:28:10.646 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:28:10.646 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:10.646 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:10.646 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:10.646 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:28:10.646 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:28:10.646 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:10.646 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:10.646 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:10.647 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:10.647 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:28:10.647 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:28:10.647 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:28:10.647 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:28:10.647 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:28:10.647 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:10.647 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:10.647 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:28:10.647 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:28:10.647 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:28:10.647 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:28:10.647 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:10.647 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:28:10.647 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:28:10.648 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:10.648 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:10.648 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:10.648 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:28:10.648 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:28:10.648 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:10.648 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:10.648 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:10.648 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:10.648 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:28:10.648 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:28:10.648 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:28:10.648 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:28:10.648 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:28:10.648 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:10.649 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:10.649 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:28:10.649 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:28:10.649 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:28:10.649 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:28:10.649 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:10.649 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:28:10.649 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:28:10.649 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:10.649 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:10.649 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:10.649 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:28:10.649 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:28:10.649 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:10.649 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:10.650 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:10.650 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:10.650 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:28:10.650 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:28:10.650 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:28:10.650 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:28:10.650 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:28:10.650 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:10.650 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:10.650 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:10.650 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:28:10.650 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:28:10.650 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:10.650 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:28:10.650 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:28:10.651 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:28:10.651 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:10.651 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:28:10.651 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:28:10.651 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:10.651 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:28:10.651 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:28:10.651 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:28:10.651 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:10.651 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:10.651 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:10.651 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:28:10.651 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:28:10.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.639+0000 7fbeca2f1640 1 -- 172.21.15.60:0/3140437054 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbeb006be60 msgr2=0x7fbeb006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:10.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.639+0000 7fbeca2f1640 1 --2- 172.21.15.60:0/3140437054 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbeb006be60 0x7fbeb006e320 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbec40cbc20 tx=0x7fbeb8008040 comp rx=0 tx=0).stop 2024-09-12T02:28:10.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.639+0000 7fbeca2f1640 1 -- 172.21.15.60:0/3140437054 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbec41ef500 msgr2=0x7fbec4152850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:10.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.639+0000 7fbeca2f1640 1 --2- 172.21.15.60:0/3140437054 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbec41ef500 0x7fbec4152850 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbebc005040 tx=0x7fbebc001650 comp rx=0 tx=0).stop 2024-09-12T02:28:10.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.639+0000 7fbec888e640 1 -- 172.21.15.60:0/3140437054 reap_dead start 2024-09-12T02:28:10.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.639+0000 7fbec888e640 1 -- 172.21.15.60:0/3140437054 reap_dead start 2024-09-12T02:28:10.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.639+0000 7fbeca2f1640 1 -- 172.21.15.60:0/3140437054 shutdown_connections 2024-09-12T02:28:10.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.639+0000 7fbeca2f1640 1 -- 172.21.15.60:0/3140437054 >> 172.21.15.60:0/3140437054 conn(0x7fbec4068030 msgr2=0x7fbec40c7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:10.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.639+0000 7fbeca2f1640 1 -- 172.21.15.60:0/3140437054 shutdown_connections 2024-09-12T02:28:10.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.640+0000 7fbeca2f1640 1 -- 172.21.15.60:0/3140437054 wait complete. 2024-09-12T02:28:10.653 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:28:10.654 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-12T02:28:10.654 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-12T02:28:10.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.772+0000 7ff33a0ba640 1 Processor -- start 2024-09-12T02:28:10.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.772+0000 7ff33a0ba640 1 -- start start 2024-09-12T02:28:10.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.773+0000 7ff33a0ba640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff3340c3560 0x7ff3340c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:10.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.773+0000 7ff33a0ba640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3340c7fb0 0x7ff334160bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:10.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.773+0000 7ff33a0ba640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff334153fc0 con 0x7ff334153be0 2024-09-12T02:28:10.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.773+0000 7ff33a0ba640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7ff334156db0 con 0x7ff3340c3560 2024-09-12T02:28:10.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.773+0000 7ff33a0ba640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff3340c8440 con 0x7ff3340c7fb0 2024-09-12T02:28:10.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.773+0000 7ff332ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff3340c3560 0x7ff3340c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:10.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.773+0000 7ff332ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff3340c3560 0x7ff3340c7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49666/0 (socket says 172.21.15.60:49666) 2024-09-12T02:28:10.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.773+0000 7ff332ffd640 1 -- 172.21.15.60:0/3959268767 learned_addr learned my addr 172.21.15.60:0/3959268767 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:28:10.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.773+0000 7ff333fff640 1 --2- 172.21.15.60:0/3959268767 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3340c7fb0 0x7ff334160bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:10.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.773+0000 7ff332ffd640 1 -- 172.21.15.60:0/3959268767 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3340c7fb0 msgr2=0x7ff334160bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:10.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.773+0000 7ff332ffd640 1 --2- 172.21.15.60:0/3959268767 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3340c7fb0 0x7ff334160bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:10.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.773+0000 7ff332ffd640 1 -- 172.21.15.60:0/3959268767 >> v1:172.21.15.105:6789/0 conn(0x7ff334153be0 legacy=0x7ff3340ac720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:10.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.773+0000 7ff332ffd640 1 -- 172.21.15.60:0/3959268767 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3340a8030 con 0x7ff3340c3560 2024-09-12T02:28:10.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.774+0000 7ff332ffd640 1 --2- 172.21.15.60:0/3959268767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3340c3560 0x7ff3340c7a70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff328009870 tx=0x7ff32802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7179fe923a8a4a7e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:10.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.774+0000 7ff3327fc640 1 -- 172.21.15.60:0/3959268767 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff328037070 con 0x7ff3340c3560 2024-09-12T02:28:10.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.774+0000 7ff3327fc640 1 -- 172.21.15.60:0/3959268767 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff328032440 con 0x7ff3340c3560 2024-09-12T02:28:10.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.774+0000 7ff3327fc640 1 -- 172.21.15.60:0/3959268767 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff328032810 con 0x7ff3340c3560 2024-09-12T02:28:10.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.775+0000 7ff33a0ba640 1 -- 172.21.15.60:0/3959268767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3340c3560 msgr2=0x7ff3340c7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:10.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.775+0000 7ff33a0ba640 1 --2- 172.21.15.60:0/3959268767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3340c3560 0x7ff3340c7a70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff328009870 tx=0x7ff32802a130 comp rx=0 tx=0).stop 2024-09-12T02:28:10.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.775+0000 7ff33a0ba640 1 -- 172.21.15.60:0/3959268767 shutdown_connections 2024-09-12T02:28:10.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.775+0000 7ff33a0ba640 1 --2- 172.21.15.60:0/3959268767 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3340c7fb0 0x7ff334160bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:10.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.775+0000 7ff33a0ba640 1 --2- 172.21.15.60:0/3959268767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3340c3560 0x7ff3340c7a70 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:10.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.775+0000 7ff33a0ba640 1 -- 172.21.15.60:0/3959268767 >> 172.21.15.60:0/3959268767 conn(0x7ff3340c5660 msgr2=0x7ff3340c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:10.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.775+0000 7ff33a0ba640 1 -- 172.21.15.60:0/3959268767 shutdown_connections 2024-09-12T02:28:10.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.775+0000 7ff33a0ba640 1 -- 172.21.15.60:0/3959268767 wait complete. 2024-09-12T02:28:10.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.777+0000 7ff33a0ba640 1 Processor -- start 2024-09-12T02:28:10.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.777+0000 7ff33a0ba640 1 -- start start 2024-09-12T02:28:10.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.778+0000 7ff33a0ba640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3340c3560 0x7ff3341dfb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:10.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.778+0000 7ff33a0ba640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3340c7fb0 0x7ff334154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:10.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.778+0000 7ff33a0ba640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff334153be0 0x7ff3341e1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:10.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.778+0000 7ff33a0ba640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff3340a83e0 con 0x7ff3340c7fb0 2024-09-12T02:28:10.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.778+0000 7ff33a0ba640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff334157240 con 0x7ff3340c3560 2024-09-12T02:28:10.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.778+0000 7ff33a0ba640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff3340ac370 con 0x7ff334153be0 2024-09-12T02:28:10.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.778+0000 7ff332ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3340c7fb0 0x7ff334154ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:10.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.778+0000 7ff332ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3340c7fb0 0x7ff334154ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49680/0 (socket says 172.21.15.60:49680) 2024-09-12T02:28:10.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.778+0000 7ff332ffd640 1 -- 172.21.15.60:0/1647747952 learned_addr learned my addr 172.21.15.60:0/1647747952 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:28:10.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.778+0000 7ff3337fe640 1 --2- 172.21.15.60:0/1647747952 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3340c3560 0x7ff3341dfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:10.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.778+0000 7ff333fff640 1 --2- 172.21.15.60:0/1647747952 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff334153be0 0x7ff3341e1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:10.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.778+0000 7ff332ffd640 1 -- 172.21.15.60:0/1647747952 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff334153be0 msgr2=0x7ff3341e1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:10.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.778+0000 7ff332ffd640 1 --2- 172.21.15.60:0/1647747952 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff334153be0 0x7ff3341e1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:10.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.778+0000 7ff332ffd640 1 -- 172.21.15.60:0/1647747952 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3340c3560 msgr2=0x7ff3341dfb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:10.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.778+0000 7ff332ffd640 1 --2- 172.21.15.60:0/1647747952 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3340c3560 0x7ff3341dfb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:10.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.778+0000 7ff332ffd640 1 -- 172.21.15.60:0/1647747952 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff334154240 con 0x7ff3340c7fb0 2024-09-12T02:28:10.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.779+0000 7ff332ffd640 1 --2- 172.21.15.60:0/1647747952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3340c7fb0 0x7ff334154ce0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff328000c00 tx=0x7ff3280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:10.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.779+0000 7ff31bfff640 1 -- 172.21.15.60:0/1647747952 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff328041020 con 0x7ff3340c7fb0 2024-09-12T02:28:10.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.779+0000 7ff31bfff640 1 -- 172.21.15.60:0/1647747952 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff328030640 con 0x7ff3340c7fb0 2024-09-12T02:28:10.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.779+0000 7ff33a0ba640 1 -- 172.21.15.60:0/1647747952 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3341eca00 con 0x7ff3340c7fb0 2024-09-12T02:28:10.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.779+0000 7ff31bfff640 1 -- 172.21.15.60:0/1647747952 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff328037040 con 0x7ff3340c7fb0 2024-09-12T02:28:10.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.779+0000 7ff33a0ba640 1 -- 172.21.15.60:0/1647747952 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3341e0090 con 0x7ff3340c7fb0 2024-09-12T02:28:10.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.780+0000 7ff31bfff640 1 -- 172.21.15.60:0/1647747952 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff328044020 con 0x7ff3340c7fb0 2024-09-12T02:28:10.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.780+0000 7ff33a0ba640 1 -- 172.21.15.60:0/1647747952 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3340aeeb0 con 0x7ff3340c7fb0 2024-09-12T02:28:10.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.781+0000 7ff31bfff640 1 --2- 172.21.15.60:0/1647747952 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff32006be60 0x7ff32006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:10.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.781+0000 7ff31bfff640 1 -- 172.21.15.60:0/1647747952 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7ff3280ab850 con 0x7ff3340c7fb0 2024-09-12T02:28:10.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.781+0000 7ff3337fe640 1 --2- 172.21.15.60:0/1647747952 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff32006be60 0x7ff32006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:10.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.782+0000 7ff3337fe640 1 --2- 172.21.15.60:0/1647747952 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff32006be60 0x7ff32006e320 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff3341e2760 tx=0x7ff324009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:10.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:10.786+0000 7ff31bfff640 1 -- 172.21.15.60:0/1647747952 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff3340aeeb0 con 0x7ff3340c7fb0 2024-09-12T02:28:11.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:11.145+0000 7ff33a0ba640 1 -- 172.21.15.60:0/1647747952 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7ff3340c63f0 con 0x7ff3340c7fb0 2024-09-12T02:28:11.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:11.146+0000 7ff31bfff640 1 -- 172.21.15.60:0/1647747952 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7ff32804b030 con 0x7ff3340c7fb0 2024-09-12T02:28:11.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:11.149+0000 7ff33a0ba640 1 -- 172.21.15.60:0/1647747952 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff32006be60 msgr2=0x7ff32006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:11.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:11.149+0000 7ff33a0ba640 1 --2- 172.21.15.60:0/1647747952 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff32006be60 0x7ff32006e320 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff3341e2760 tx=0x7ff324009040 comp rx=0 tx=0).stop 2024-09-12T02:28:11.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:11.149+0000 7ff33a0ba640 1 -- 172.21.15.60:0/1647747952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3340c7fb0 msgr2=0x7ff334154ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:11.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:11.149+0000 7ff33a0ba640 1 --2- 172.21.15.60:0/1647747952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3340c7fb0 0x7ff334154ce0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff328000c00 tx=0x7ff3280046c0 comp rx=0 tx=0).stop 2024-09-12T02:28:11.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:11.149+0000 7ff33a0ba640 1 -- 172.21.15.60:0/1647747952 shutdown_connections 2024-09-12T02:28:11.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:11.149+0000 7ff33a0ba640 1 --2- 172.21.15.60:0/1647747952 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff32006be60 0x7ff32006e320 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:11.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:11.149+0000 7ff33a0ba640 1 --2- 172.21.15.60:0/1647747952 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff334153be0 0x7ff3341e1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:11.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:11.149+0000 7ff33a0ba640 1 --2- 172.21.15.60:0/1647747952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3340c7fb0 0x7ff334154ce0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:11.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:11.149+0000 7ff33a0ba640 1 --2- 172.21.15.60:0/1647747952 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3340c3560 0x7ff3341dfb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:11.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:11.149+0000 7ff33a0ba640 1 -- 172.21.15.60:0/1647747952 >> 172.21.15.60:0/1647747952 conn(0x7ff3340c5660 msgr2=0x7ff3341522d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:11.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:11.149+0000 7ff33a0ba640 1 -- 172.21.15.60:0/1647747952 shutdown_connections 2024-09-12T02:28:11.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:11.149+0000 7ff33a0ba640 1 -- 172.21.15.60:0/1647747952 wait complete. 2024-09-12T02:28:11.161 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-12T02:28:21.162 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-12T02:28:21.162 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:28:21.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.272+0000 7fe89f274640 1 Processor -- start 2024-09-12T02:28:21.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.272+0000 7fe89f274640 1 -- start start 2024-09-12T02:28:21.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.273+0000 7fe89f274640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe8980ca170 0x7fe8980a92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:21.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.273+0000 7fe89f274640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8980c88f0 0x7fe8980c3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:21.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.273+0000 7fe89f274640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe898073920 con 0x7fe898158ea0 2024-09-12T02:28:21.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.273+0000 7fe89f274640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fe898073420 con 0x7fe8980ca170 2024-09-12T02:28:21.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.273+0000 7fe89f274640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe898072bd0 con 0x7fe8980c88f0 2024-09-12T02:28:21.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.273+0000 7fe89d010640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe8980ca170 0x7fe8980a92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:21.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.273+0000 7fe89c80f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8980c88f0 0x7fe8980c3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:21.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.273+0000 7fe89d010640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe8980ca170 0x7fe8980a92c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:54922/0 (socket says 172.21.15.60:54922) 2024-09-12T02:28:21.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.273+0000 7fe89d010640 1 -- 172.21.15.60:0/2835876707 learned_addr learned my addr 172.21.15.60:0/2835876707 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:28:21.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.273+0000 7fe89c80f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8980c88f0 0x7fe8980c3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:44284/0 (socket says 172.21.15.60:44284) 2024-09-12T02:28:21.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.274+0000 7fe89c80f640 1 -- 172.21.15.60:0/2835876707 >> v2:172.21.15.105:3300/0 conn(0x7fe8980ca170 msgr2=0x7fe8980a92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:21.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.274+0000 7fe89c80f640 1 --2- 172.21.15.60:0/2835876707 >> v2:172.21.15.105:3300/0 conn(0x7fe8980ca170 0x7fe8980a92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:21.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.274+0000 7fe89c80f640 1 -- 172.21.15.60:0/2835876707 >> v1:172.21.15.105:6789/0 conn(0x7fe898158ea0 legacy=0x7fe898159350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:21.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.274+0000 7fe89c80f640 1 -- 172.21.15.60:0/2835876707 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe898072eb0 con 0x7fe8980c88f0 2024-09-12T02:28:21.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.274+0000 7fe89d010640 1 --2- 172.21.15.60:0/2835876707 >> v2:172.21.15.105:3300/0 conn(0x7fe8980ca170 0x7fe8980a92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:28:21.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.274+0000 7fe89c80f640 1 --2- 172.21.15.60:0/2835876707 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8980c88f0 0x7fe8980c3be0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe8880097a0 tx=0x7fe88802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63fae4c049960e4c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:21.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.275+0000 7fe88ffff640 1 -- 172.21.15.60:0/2835876707 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe888037070 con 0x7fe8980c88f0 2024-09-12T02:28:21.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.275+0000 7fe88ffff640 1 -- 172.21.15.60:0/2835876707 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe88802ae50 con 0x7fe8980c88f0 2024-09-12T02:28:21.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.275+0000 7fe88ffff640 1 -- 172.21.15.60:0/2835876707 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe888032660 con 0x7fe8980c88f0 2024-09-12T02:28:21.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.275+0000 7fe89f274640 1 -- 172.21.15.60:0/2835876707 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8980c88f0 msgr2=0x7fe8980c3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:21.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.275+0000 7fe89f274640 1 --2- 172.21.15.60:0/2835876707 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8980c88f0 0x7fe8980c3be0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe8880097a0 tx=0x7fe88802a100 comp rx=0 tx=0).stop 2024-09-12T02:28:21.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.275+0000 7fe89f274640 1 -- 172.21.15.60:0/2835876707 shutdown_connections 2024-09-12T02:28:21.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.275+0000 7fe89f274640 1 --2- 172.21.15.60:0/2835876707 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8980c88f0 0x7fe8980c3be0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:21.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.275+0000 7fe89f274640 1 --2- 172.21.15.60:0/2835876707 >> v2:172.21.15.105:3300/0 conn(0x7fe8980ca170 0x7fe8980a92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:21.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.275+0000 7fe89f274640 1 -- 172.21.15.60:0/2835876707 >> 172.21.15.60:0/2835876707 conn(0x7fe898067b30 msgr2=0x7fe898067f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:21.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.275+0000 7fe89f274640 1 -- 172.21.15.60:0/2835876707 shutdown_connections 2024-09-12T02:28:21.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.275+0000 7fe89f274640 1 -- 172.21.15.60:0/2835876707 wait complete. 2024-09-12T02:28:21.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.276+0000 7fe89f274640 1 Processor -- start 2024-09-12T02:28:21.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.277+0000 7fe89f274640 1 -- start start 2024-09-12T02:28:21.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.277+0000 7fe89f274640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8980c88f0 0x7fe89814f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:21.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.277+0000 7fe89f274640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8980ca170 0x7fe8981eef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:21.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.277+0000 7fe89f274640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe898158ea0 0x7fe8981e9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:21.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.277+0000 7fe89f274640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe898070720 con 0x7fe898158ea0 2024-09-12T02:28:21.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.277+0000 7fe89f274640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe8980705a0 con 0x7fe8980c88f0 2024-09-12T02:28:21.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.277+0000 7fe89f274640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe8980c4120 con 0x7fe8980ca170 2024-09-12T02:28:21.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.277+0000 7fe89d811640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe898158ea0 0x7fe8981e9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:21.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.277+0000 7fe89d010640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8980c88f0 0x7fe89814f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:21.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.277+0000 7fe89c80f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8980ca170 0x7fe8981eef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:21.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.277+0000 7fe89d010640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8980c88f0 0x7fe89814f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:54938/0 (socket says 172.21.15.60:54938) 2024-09-12T02:28:21.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.277+0000 7fe89d811640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe898158ea0 0x7fe8981e9030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51286/0 (socket says 172.21.15.60:51286) 2024-09-12T02:28:21.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.277+0000 7fe89d010640 1 -- 172.21.15.60:0/782742567 learned_addr learned my addr 172.21.15.60:0/782742567 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:28:21.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.277+0000 7fe89c80f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8980ca170 0x7fe8981eef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:44296/0 (socket says 172.21.15.60:44296) 2024-09-12T02:28:21.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.278+0000 7fe89c80f640 1 -- 172.21.15.60:0/782742567 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8980c88f0 msgr2=0x7fe89814f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:21.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.278+0000 7fe89c80f640 1 --2- 172.21.15.60:0/782742567 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8980c88f0 0x7fe89814f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:21.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.278+0000 7fe89c80f640 1 -- 172.21.15.60:0/782742567 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe898158ea0 msgr2=0x7fe8981e9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:21.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.278+0000 7fe89c80f640 1 --2- 172.21.15.60:0/782742567 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe898158ea0 0x7fe8981e9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:21.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.278+0000 7fe89c80f640 1 -- 172.21.15.60:0/782742567 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe898150f60 con 0x7fe8980ca170 2024-09-12T02:28:21.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.278+0000 7fe89d010640 1 --2- 172.21.15.60:0/782742567 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8980c88f0 0x7fe89814f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:28:21.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.278+0000 7fe89d811640 1 --2- 172.21.15.60:0/782742567 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe898158ea0 0x7fe8981e9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:28:21.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.278+0000 7fe89c80f640 1 --2- 172.21.15.60:0/782742567 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8980ca170 0x7fe8981eef20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe888031000 tx=0x7fe8880046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:21.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.278+0000 7fe88dffb640 1 -- 172.21.15.60:0/782742567 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe888042070 con 0x7fe8980ca170 2024-09-12T02:28:21.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.278+0000 7fe88dffb640 1 -- 172.21.15.60:0/782742567 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe888032e20 con 0x7fe8980ca170 2024-09-12T02:28:21.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.278+0000 7fe88dffb640 1 -- 172.21.15.60:0/782742567 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe888037040 con 0x7fe8980ca170 2024-09-12T02:28:21.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.278+0000 7fe89f274640 1 -- 172.21.15.60:0/782742567 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe89814e3b0 con 0x7fe8980ca170 2024-09-12T02:28:21.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.279+0000 7fe89f274640 1 -- 172.21.15.60:0/782742567 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe89814e690 con 0x7fe8980ca170 2024-09-12T02:28:21.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.280+0000 7fe89f274640 1 -- 172.21.15.60:0/782742567 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8980500a0 con 0x7fe8980ca170 2024-09-12T02:28:21.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.280+0000 7fe88dffb640 1 -- 172.21.15.60:0/782742567 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe888045070 con 0x7fe8980ca170 2024-09-12T02:28:21.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.281+0000 7fe88dffb640 1 --2- 172.21.15.60:0/782742567 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe87c06be30 0x7fe87c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:21.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.281+0000 7fe88dffb640 1 -- 172.21.15.60:0/782742567 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fe8880abad0 con 0x7fe8980ca170 2024-09-12T02:28:21.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.281+0000 7fe89d010640 1 --2- 172.21.15.60:0/782742567 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe87c06be30 0x7fe87c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:21.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.281+0000 7fe89d010640 1 --2- 172.21.15.60:0/782742567 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe87c06be30 0x7fe87c06e2f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe8940112c0 tx=0x7fe894009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:21.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.287+0000 7fe88dffb640 1 -- 172.21.15.60:0/782742567 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe8980500a0 con 0x7fe8980ca170 2024-09-12T02:28:21.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.543+0000 7fe89f274640 1 -- 172.21.15.60:0/782742567 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe8980ca550 con 0x7fe8980ca170 2024-09-12T02:28:21.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.543+0000 7fe88dffb640 1 -- 172.21.15.60:0/782742567 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7fe888079b20 con 0x7fe8980ca170 2024-09-12T02:28:21.544 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":42,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:28:21.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.546+0000 7fe89f274640 1 -- 172.21.15.60:0/782742567 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe87c06be30 msgr2=0x7fe87c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:21.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.546+0000 7fe89f274640 1 --2- 172.21.15.60:0/782742567 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe87c06be30 0x7fe87c06e2f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe8940112c0 tx=0x7fe894009240 comp rx=0 tx=0).stop 2024-09-12T02:28:21.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.546+0000 7fe89f274640 1 -- 172.21.15.60:0/782742567 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8980ca170 msgr2=0x7fe8981eef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:21.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.546+0000 7fe89f274640 1 --2- 172.21.15.60:0/782742567 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8980ca170 0x7fe8981eef20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe888031000 tx=0x7fe8880046c0 comp rx=0 tx=0).stop 2024-09-12T02:28:21.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.547+0000 7fe89f274640 1 -- 172.21.15.60:0/782742567 shutdown_connections 2024-09-12T02:28:21.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.547+0000 7fe89f274640 1 --2- 172.21.15.60:0/782742567 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe87c06be30 0x7fe87c06e2f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:21.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.547+0000 7fe89f274640 1 --2- 172.21.15.60:0/782742567 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe898158ea0 0x7fe8981e9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:21.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.547+0000 7fe89f274640 1 --2- 172.21.15.60:0/782742567 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8980ca170 0x7fe8981eef20 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:21.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.547+0000 7fe89f274640 1 --2- 172.21.15.60:0/782742567 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8980c88f0 0x7fe89814f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:21.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.547+0000 7fe89f274640 1 -- 172.21.15.60:0/782742567 >> 172.21.15.60:0/782742567 conn(0x7fe898067b30 msgr2=0x7fe89815a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:21.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.547+0000 7fe89f274640 1 -- 172.21.15.60:0/782742567 shutdown_connections 2024-09-12T02:28:21.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.547+0000 7fe89f274640 1 -- 172.21.15.60:0/782742567 wait complete. 2024-09-12T02:28:21.559 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-12T02:28:21.559 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-12T02:28:21.559 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-12T02:28:21.559 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-12T02:28:21.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.675+0000 7fb33c378640 1 Processor -- start 2024-09-12T02:28:21.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.675+0000 7fb33c378640 1 -- start start 2024-09-12T02:28:21.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.676+0000 7fb33c378640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb3340afc60 0x7fb334153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:21.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.676+0000 7fb33c378640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb33406efa0 con 0x7fb334072ec0 2024-09-12T02:28:21.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.676+0000 7fb33c378640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb33406f280 con 0x7fb3340c4ac0 2024-09-12T02:28:21.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.676+0000 7fb33c378640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb33406f560 con 0x7fb3340afc60 2024-09-12T02:28:21.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.676+0000 7fb33a114640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb334072ec0 0x7fb334070040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34160/0 (socket says 172.21.15.60:34160) 2024-09-12T02:28:21.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.676+0000 7fb33a114640 1 -- 172.21.15.60:0/1383625872 learned_addr learned my addr 172.21.15.60:0/1383625872 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:28:21.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.676+0000 7fb33a915640 1 --2- 172.21.15.60:0/1383625872 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb3340afc60 0x7fb334153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:21.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.677+0000 7fb339112640 1 -- 172.21.15.60:0/1383625872 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3680748116 0 0) 0x7fb33406efa0 con 0x7fb334072ec0 2024-09-12T02:28:21.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.677+0000 7fb339112640 1 -- 172.21.15.60:0/1383625872 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb320003520 con 0x7fb334072ec0 2024-09-12T02:28:21.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.677+0000 7fb339112640 1 -- 172.21.15.60:0/1383625872 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2040781128 0 0) 0x7fb33406f280 con 0x7fb3340c4ac0 2024-09-12T02:28:21.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.677+0000 7fb339112640 1 -- 172.21.15.60:0/1383625872 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb33406efa0 con 0x7fb3340c4ac0 2024-09-12T02:28:21.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.677+0000 7fb33a915640 1 -- 172.21.15.60:0/1383625872 >> v1:172.21.15.105:6789/0 conn(0x7fb3340c4ac0 legacy=0x7fb334151380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:21.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.677+0000 7fb33a915640 1 -- 172.21.15.60:0/1383625872 >> v1:172.21.15.60:6789/0 conn(0x7fb334072ec0 legacy=0x7fb334070040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:21.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.677+0000 7fb33a915640 1 -- 172.21.15.60:0/1383625872 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb33406f840 con 0x7fb3340afc60 2024-09-12T02:28:21.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.678+0000 7fb33a915640 1 --2- 172.21.15.60:0/1383625872 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb3340afc60 0x7fb334153ff0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb32c009dc0 tx=0x7fb32c02a5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=caaedc33913d61c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:21.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.678+0000 7fb339112640 1 -- 172.21.15.60:0/1383625872 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32c007740 con 0x7fb3340afc60 2024-09-12T02:28:21.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.678+0000 7fb339112640 1 -- 172.21.15.60:0/1383625872 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb32c0078e0 con 0x7fb3340afc60 2024-09-12T02:28:21.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.678+0000 7fb339112640 1 -- 172.21.15.60:0/1383625872 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32c007cb0 con 0x7fb3340afc60 2024-09-12T02:28:21.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.679+0000 7fb33c378640 1 -- 172.21.15.60:0/1383625872 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb3340afc60 msgr2=0x7fb334153ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:21.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.679+0000 7fb33c378640 1 --2- 172.21.15.60:0/1383625872 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb3340afc60 0x7fb334153ff0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb32c009dc0 tx=0x7fb32c02a5b0 comp rx=0 tx=0).stop 2024-09-12T02:28:21.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.679+0000 7fb33c378640 1 -- 172.21.15.60:0/1383625872 shutdown_connections 2024-09-12T02:28:21.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.679+0000 7fb33c378640 1 --2- 172.21.15.60:0/1383625872 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb3340afc60 0x7fb334153ff0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:21.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.679+0000 7fb33c378640 1 -- 172.21.15.60:0/1383625872 >> 172.21.15.60:0/1383625872 conn(0x7fb3340c9d80 msgr2=0x7fb3340ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:21.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.679+0000 7fb33c378640 1 -- 172.21.15.60:0/1383625872 shutdown_connections 2024-09-12T02:28:21.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.679+0000 7fb33c378640 1 -- 172.21.15.60:0/1383625872 wait complete. 2024-09-12T02:28:21.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.680+0000 7fb33c378640 1 Processor -- start 2024-09-12T02:28:21.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.680+0000 7fb33c378640 1 -- start start 2024-09-12T02:28:21.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.681+0000 7fb33c378640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb334072ec0 0x7fb334156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:21.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.681+0000 7fb33c378640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3340afc60 0x7fb3340af1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:21.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.681+0000 7fb33c378640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3340c4ac0 0x7fb3340ac9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:21.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.681+0000 7fb33c378640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb334070750 con 0x7fb3340c4ac0 2024-09-12T02:28:21.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.681+0000 7fb33c378640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb3340c47f0 con 0x7fb3340afc60 2024-09-12T02:28:21.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.681+0000 7fb33c378640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb3340708d0 con 0x7fb334072ec0 2024-09-12T02:28:21.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.682+0000 7fb33a915640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3340c4ac0 0x7fb3340ac9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:21.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.682+0000 7fb33a114640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb334072ec0 0x7fb334156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:21.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.682+0000 7fb33a915640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3340c4ac0 0x7fb3340ac9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51298/0 (socket says 172.21.15.60:51298) 2024-09-12T02:28:21.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.682+0000 7fb33a915640 1 -- 172.21.15.60:0/593375235 learned_addr learned my addr 172.21.15.60:0/593375235 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:28:21.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.682+0000 7fb339913640 1 --2- 172.21.15.60:0/593375235 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3340afc60 0x7fb3340af1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:21.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.682+0000 7fb33a915640 1 -- 172.21.15.60:0/593375235 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb334072ec0 msgr2=0x7fb334156790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:21.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.682+0000 7fb33a915640 1 --2- 172.21.15.60:0/593375235 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb334072ec0 0x7fb334156790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:21.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.682+0000 7fb33a915640 1 -- 172.21.15.60:0/593375235 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3340afc60 msgr2=0x7fb3340af1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:21.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.682+0000 7fb33a915640 1 --2- 172.21.15.60:0/593375235 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3340afc60 0x7fb3340af1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:21.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.682+0000 7fb33a915640 1 -- 172.21.15.60:0/593375235 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb334156cd0 con 0x7fb3340c4ac0 2024-09-12T02:28:21.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.682+0000 7fb33a114640 1 --2- 172.21.15.60:0/593375235 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb334072ec0 0x7fb334156790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:28:21.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.682+0000 7fb33a915640 1 --2- 172.21.15.60:0/593375235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3340c4ac0 0x7fb3340ac9d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb32c009ee0 tx=0x7fb32c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:21.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.682+0000 7fb32affd640 1 -- 172.21.15.60:0/593375235 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32c040070 con 0x7fb3340c4ac0 2024-09-12T02:28:21.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.682+0000 7fb32affd640 1 -- 172.21.15.60:0/593375235 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb32c031bc0 con 0x7fb3340c4ac0 2024-09-12T02:28:21.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.682+0000 7fb33c378640 1 -- 172.21.15.60:0/593375235 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb33414a4a0 con 0x7fb3340c4ac0 2024-09-12T02:28:21.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.682+0000 7fb32affd640 1 -- 172.21.15.60:0/593375235 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32c009450 con 0x7fb3340c4ac0 2024-09-12T02:28:21.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.682+0000 7fb33c378640 1 -- 172.21.15.60:0/593375235 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb334156270 con 0x7fb3340c4ac0 2024-09-12T02:28:21.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.683+0000 7fb33c378640 1 --2- 172.21.15.60:0/593375235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb334157ad0 0x7fb334149750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:21.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.683+0000 7fb33c378640 1 -- 172.21.15.60:0/593375235 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb3341581b0 con 0x7fb334157ad0 2024-09-12T02:28:21.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.684+0000 7fb33a114640 1 --2- 172.21.15.60:0/593375235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb334157ad0 0x7fb334149750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:21.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.684+0000 7fb33a114640 1 -- 172.21.15.60:0/593375235 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb3340ca650 con 0x7fb334157ad0 2024-09-12T02:28:21.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.684+0000 7fb33a114640 1 --2- 172.21.15.60:0/593375235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb334157ad0 0x7fb334149750 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb3341522e0 tx=0x7fb33000ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:21.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.684+0000 7fb32affd640 1 -- 172.21.15.60:0/593375235 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb32c039040 con 0x7fb3340c4ac0 2024-09-12T02:28:21.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.685+0000 7fb32affd640 1 --2- 172.21.15.60:0/593375235 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb31806be60 0x7fb31806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:21.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.685+0000 7fb32affd640 1 -- 172.21.15.60:0/593375235 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb330005ac0 con 0x7fb334157ad0 2024-09-12T02:28:21.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.685+0000 7fb339913640 1 --2- 172.21.15.60:0/593375235 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb31806be60 0x7fb31806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:21.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.685+0000 7fb32affd640 1 -- 172.21.15.60:0/593375235 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fb32c0ac800 con 0x7fb3340c4ac0 2024-09-12T02:28:21.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.685+0000 7fb32affd640 1 -- 172.21.15.60:0/593375235 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fb330018070 con 0x7fb334157ad0 2024-09-12T02:28:21.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.685+0000 7fb32affd640 1 -- 172.21.15.60:0/593375235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb334157ad0 msgr2=0x7fb334149750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:21.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.685+0000 7fb32affd640 1 --2- 172.21.15.60:0/593375235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb334157ad0 0x7fb334149750 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb3341522e0 tx=0x7fb33000ff70 comp rx=0 tx=0).stop 2024-09-12T02:28:21.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.685+0000 7fb32affd640 1 -- 172.21.15.60:0/593375235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb334157ad0 msgr2=0x7fb334149750 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:28:21.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.685+0000 7fb32affd640 1 --2- 172.21.15.60:0/593375235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb334157ad0 0x7fb334149750 secure :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb3341522e0 tx=0x7fb33000ff70 comp rx=0 tx=0).stop 2024-09-12T02:28:21.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.685+0000 7fb339913640 1 --2- 172.21.15.60:0/593375235 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb31806be60 0x7fb31806e320 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb33414fa40 tx=0x7fb324009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:21.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.692+0000 7fb33c378640 1 --2- 172.21.15.60:0/593375235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb334149c90 0x7fb3341eca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:21.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.692+0000 7fb33c378640 1 -- 172.21.15.60:0/593375235 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb3340732a0 con 0x7fb334149c90 2024-09-12T02:28:21.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.692+0000 7fb33a114640 1 --2- 172.21.15.60:0/593375235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb334149c90 0x7fb3341eca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:21.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.692+0000 7fb33a114640 1 -- 172.21.15.60:0/593375235 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb33414a670 con 0x7fb334149c90 2024-09-12T02:28:21.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.692+0000 7fb33a114640 1 --2- 172.21.15.60:0/593375235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb334149c90 0x7fb3341eca30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb3341522e0 tx=0x7fb330001150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:21.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.693+0000 7fb32affd640 1 -- 172.21.15.60:0/593375235 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3300049f0 con 0x7fb334149c90 2024-09-12T02:28:21.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.693+0000 7fb32affd640 1 -- 172.21.15.60:0/593375235 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4886 (secure 0 0 0) 0x7fb3300049f0 con 0x7fb334149c90 2024-09-12T02:28:21.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.693+0000 7fb32affd640 1 -- 172.21.15.60:0/593375235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb334149c90 msgr2=0x7fb3341eca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:21.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.693+0000 7fb32affd640 1 --2- 172.21.15.60:0/593375235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb334149c90 0x7fb3341eca30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb3341522e0 tx=0x7fb330001150 comp rx=0 tx=0).stop 2024-09-12T02:28:21.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.693+0000 7fb32affd640 1 -- 172.21.15.60:0/593375235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb334149c90 msgr2=0x7fb3341eca30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:28:21.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.693+0000 7fb32affd640 1 --2- 172.21.15.60:0/593375235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb334149c90 0x7fb3341eca30 secure :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb3341522e0 tx=0x7fb330001150 comp rx=0 tx=0).stop 2024-09-12T02:28:21.694 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:28:21.694 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:28:21.694 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:28:21.695 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:28:21.695 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 42, 2024-09-12T02:28:21.695 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 141802, 2024-09-12T02:28:21.695 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:28:21.695 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:28:21.695 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:28:21.695 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:28:21.695 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:28:21.695 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 16, 2024-09-12T02:28:21.695 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:28:21.695 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:28:21.695 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:28:21.695 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:28:21.695 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:28:21.696 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:28:21.696 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:28:21.696 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:28:21.696 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:28:21.696 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:28:21.696 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:28:21.696 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:28:21.696 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:28:21.696 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:28:21.696 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:28:21.696 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:28:21.696 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:28:21.696 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:28:21.696 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:28:21.696 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:28:21.697 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:28:21.697 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:28:21.697 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:28:21.697 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:28:21.697 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:28:21.697 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:28:21.697 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:28:21.697 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:28:21.697 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:21.697 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:21.697 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:28:21.697 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:28:21.697 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:28:21.698 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:28:21.698 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:28:21.698 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:28:21.698 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:28:21.698 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:28:21.698 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:28:21.698 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:28:21.698 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:28:21.698 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:28:21.698 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:28:21.698 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:28:21.698 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:28:21.698 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:28:21.698 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:28:21.698 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:28:21.699 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:28:21.699 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:28:21.699 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:28:21.699 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:28:21.699 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:28:21.699 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:28:21.699 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:28:21.699 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:28:21.699 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:28:21.699 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:28:21.699 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:28:21.699 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:28:21.699 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:21.699 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:28:21.699 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:21.700 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:28:21.700 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:28:21.700 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:28:21.700 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:28:21.700 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:21.700 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:28:21.700 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:28:21.700 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:21.700 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:21.700 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:21.700 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:28:21.700 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:28:21.700 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:21.700 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:21.700 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:21.701 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:21.701 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:28:21.701 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:28:21.701 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:28:21.701 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:28:21.701 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:28:21.701 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:21.701 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:21.701 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:28:21.701 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:28:21.701 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:28:21.701 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:28:21.701 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:21.701 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:28:21.702 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:28:21.702 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:21.702 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:21.702 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:21.702 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:28:21.702 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:28:21.702 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:21.702 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:21.702 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:21.702 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:21.702 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:28:21.702 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:28:21.702 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:28:21.703 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:28:21.703 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:28:21.703 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:21.703 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:21.703 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:28:21.703 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:28:21.703 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:28:21.703 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:28:21.703 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:21.703 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:28:21.703 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:28:21.703 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:21.704 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:21.704 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:21.704 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:28:21.704 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:28:21.704 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:21.704 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:21.704 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:21.704 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:21.704 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:28:21.704 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:28:21.704 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:28:21.704 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:28:21.705 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:28:21.705 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:21.705 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:21.705 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:21.705 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:28:21.705 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:28:21.705 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:21.705 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:28:21.705 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:28:21.705 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:28:21.705 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:21.705 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:28:21.705 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:28:21.705 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:21.705 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:28:21.706 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:28:21.706 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:28:21.706 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:21.706 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:28:21.706 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:28:21.706 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:21.706 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:28:21.706 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:28:21.706 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:28:21.706 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:21.706 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:28:21.706 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:28:21.706 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:21.706 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:28:21.706 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:28:21.707 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:28:21.707 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:21.707 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:21.707 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:21.707 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:28:21.707 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:28:21.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.693+0000 7fb33c378640 1 -- 172.21.15.60:0/593375235 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb31806be60 msgr2=0x7fb31806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:21.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.693+0000 7fb33c378640 1 --2- 172.21.15.60:0/593375235 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb31806be60 0x7fb31806e320 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb33414fa40 tx=0x7fb324009040 comp rx=0 tx=0).stop 2024-09-12T02:28:21.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.693+0000 7fb33c378640 1 -- 172.21.15.60:0/593375235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3340c4ac0 msgr2=0x7fb3340ac9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:21.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.693+0000 7fb33c378640 1 --2- 172.21.15.60:0/593375235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3340c4ac0 0x7fb3340ac9d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb32c009ee0 tx=0x7fb32c004a40 comp rx=0 tx=0).stop 2024-09-12T02:28:21.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.693+0000 7fb33a915640 1 -- 172.21.15.60:0/593375235 reap_dead start 2024-09-12T02:28:21.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.693+0000 7fb33a915640 1 -- 172.21.15.60:0/593375235 reap_dead start 2024-09-12T02:28:21.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.693+0000 7fb33c378640 1 -- 172.21.15.60:0/593375235 shutdown_connections 2024-09-12T02:28:21.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.693+0000 7fb33c378640 1 -- 172.21.15.60:0/593375235 >> 172.21.15.60:0/593375235 conn(0x7fb3340c9d80 msgr2=0x7fb3341531a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:21.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.693+0000 7fb33c378640 1 -- 172.21.15.60:0/593375235 shutdown_connections 2024-09-12T02:28:21.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.693+0000 7fb33c378640 1 -- 172.21.15.60:0/593375235 wait complete. 2024-09-12T02:28:21.709 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:28:21.709 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-12T02:28:21.709 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-12T02:28:21.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.841+0000 7f693d6ae640 1 Processor -- start 2024-09-12T02:28:21.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.841+0000 7f693d6ae640 1 -- start start 2024-09-12T02:28:21.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.842+0000 7f693d6ae640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6938153be0 0x7f69380c3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:21.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.842+0000 7f693d6ae640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f69380ac720 0x7f69380c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:21.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.842+0000 7f693d6ae640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69380c7fb0 0x7f69381598a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:21.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.842+0000 7f693d6ae640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f6938156db0 con 0x7f6938153be0 2024-09-12T02:28:21.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.842+0000 7f693d6ae640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f6938153fc0 con 0x7f69380ac720 2024-09-12T02:28:21.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.842+0000 7f693d6ae640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f69380c8440 con 0x7f69380c7fb0 2024-09-12T02:28:21.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.842+0000 7f6936ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6938153be0 0x7f69380c3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:21.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.842+0000 7f6936ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6938153be0 0x7f69380c3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51314/0 (socket says 172.21.15.60:51314) 2024-09-12T02:28:21.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.842+0000 7f6936ffd640 1 -- 172.21.15.60:0/1303870398 learned_addr learned my addr 172.21.15.60:0/1303870398 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:28:21.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.842+0000 7f69367fc640 1 --2- 172.21.15.60:0/1303870398 >> v2:172.21.15.105:3300/0 conn(0x7f69380ac720 0x7f69380c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:21.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.842+0000 7f69377fe640 1 --2- 172.21.15.60:0/1303870398 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69380c7fb0 0x7f69381598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:21.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.842+0000 7f6936ffd640 1 -- 172.21.15.60:0/1303870398 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69380c7fb0 msgr2=0x7f69381598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:21.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.842+0000 7f6936ffd640 1 --2- 172.21.15.60:0/1303870398 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69380c7fb0 0x7f69381598a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:21.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.842+0000 7f6936ffd640 1 -- 172.21.15.60:0/1303870398 >> v2:172.21.15.105:3300/0 conn(0x7f69380ac720 msgr2=0x7f69380c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:21.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.842+0000 7f6936ffd640 1 --2- 172.21.15.60:0/1303870398 >> v2:172.21.15.105:3300/0 conn(0x7f69380ac720 0x7f69380c7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:21.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.842+0000 7f6936ffd640 1 -- 172.21.15.60:0/1303870398 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69380a8030 con 0x7f6938153be0 2024-09-12T02:28:21.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.843+0000 7f6936ffd640 1 --2- 172.21.15.60:0/1303870398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6938153be0 0x7f69380c3560 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f69380ac130 tx=0x7f692802a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc7f9f076b4830ec server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:21.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.843+0000 7f6935ffb640 1 -- 172.21.15.60:0/1303870398 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6928037070 con 0x7f6938153be0 2024-09-12T02:28:21.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.843+0000 7f6935ffb640 1 -- 172.21.15.60:0/1303870398 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f692802ae00 con 0x7f6938153be0 2024-09-12T02:28:21.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.844+0000 7f6935ffb640 1 -- 172.21.15.60:0/1303870398 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6928032660 con 0x7f6938153be0 2024-09-12T02:28:21.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.844+0000 7f693d6ae640 1 -- 172.21.15.60:0/1303870398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6938153be0 msgr2=0x7f69380c3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:21.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.844+0000 7f693d6ae640 1 --2- 172.21.15.60:0/1303870398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6938153be0 0x7f69380c3560 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f69380ac130 tx=0x7f692802a0b0 comp rx=0 tx=0).stop 2024-09-12T02:28:21.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.844+0000 7f693d6ae640 1 -- 172.21.15.60:0/1303870398 shutdown_connections 2024-09-12T02:28:21.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.844+0000 7f693d6ae640 1 --2- 172.21.15.60:0/1303870398 >> v2:172.21.15.105:3300/0 conn(0x7f69380ac720 0x7f69380c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:21.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.844+0000 7f693d6ae640 1 --2- 172.21.15.60:0/1303870398 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69380c7fb0 0x7f69381598a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:21.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.844+0000 7f693d6ae640 1 --2- 172.21.15.60:0/1303870398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6938153be0 0x7f69380c3560 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:21.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.844+0000 7f693d6ae640 1 -- 172.21.15.60:0/1303870398 >> 172.21.15.60:0/1303870398 conn(0x7f69380c5660 msgr2=0x7f69380c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:21.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.845+0000 7f693d6ae640 1 -- 172.21.15.60:0/1303870398 shutdown_connections 2024-09-12T02:28:21.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.845+0000 7f693d6ae640 1 -- 172.21.15.60:0/1303870398 wait complete. 2024-09-12T02:28:21.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.847+0000 7f693d6ae640 1 Processor -- start 2024-09-12T02:28:21.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.847+0000 7f693d6ae640 1 -- start start 2024-09-12T02:28:21.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.847+0000 7f693d6ae640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69380ac720 0x7f6938152f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:21.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.847+0000 7f693d6ae640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69380c7fb0 0x7f69381584c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:21.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.848+0000 7f693d6ae640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6938153be0 0x7f69380bf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:21.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.848+0000 7f693d6ae640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f69380a83e0 con 0x7f69380c7fb0 2024-09-12T02:28:21.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.848+0000 7f693d6ae640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6938157240 con 0x7f69380ac720 2024-09-12T02:28:21.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.848+0000 7f693d6ae640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f69380ac370 con 0x7f6938153be0 2024-09-12T02:28:21.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.848+0000 7f6936ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69380ac720 0x7f6938152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:21.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.848+0000 7f6936ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69380ac720 0x7f6938152f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:54960/0 (socket says 172.21.15.60:54960) 2024-09-12T02:28:21.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.848+0000 7f6936ffd640 1 -- 172.21.15.60:0/769845014 learned_addr learned my addr 172.21.15.60:0/769845014 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:28:21.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.848+0000 7f69367fc640 1 --2- 172.21.15.60:0/769845014 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69380c7fb0 0x7f69381584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:21.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.848+0000 7f69377fe640 1 --2- 172.21.15.60:0/769845014 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6938153be0 0x7f69380bf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:21.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.848+0000 7f6936ffd640 1 -- 172.21.15.60:0/769845014 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6938153be0 msgr2=0x7f69380bf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:21.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.848+0000 7f6936ffd640 1 --2- 172.21.15.60:0/769845014 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6938153be0 0x7f69380bf6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:21.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.848+0000 7f6936ffd640 1 -- 172.21.15.60:0/769845014 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69380c7fb0 msgr2=0x7f69381584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:21.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.848+0000 7f6936ffd640 1 --2- 172.21.15.60:0/769845014 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69380c7fb0 0x7f69381584c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:21.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.848+0000 7f6936ffd640 1 -- 172.21.15.60:0/769845014 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f693815a720 con 0x7f69380ac720 2024-09-12T02:28:21.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.849+0000 7f6936ffd640 1 --2- 172.21.15.60:0/769845014 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69380ac720 0x7f6938152f90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6928000c00 tx=0x7f69280046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:21.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.849+0000 7f691f7fe640 1 -- 172.21.15.60:0/769845014 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6928041030 con 0x7f69380ac720 2024-09-12T02:28:21.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.849+0000 7f691f7fe640 1 -- 172.21.15.60:0/769845014 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f692802ac00 con 0x7f69380ac720 2024-09-12T02:28:21.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.850+0000 7f691f7fe640 1 -- 172.21.15.60:0/769845014 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6928037040 con 0x7f69380ac720 2024-09-12T02:28:21.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.850+0000 7f693d6ae640 1 -- 172.21.15.60:0/769845014 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69380be130 con 0x7f69380ac720 2024-09-12T02:28:21.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.850+0000 7f693d6ae640 1 -- 172.21.15.60:0/769845014 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69380be6f0 con 0x7f69380ac720 2024-09-12T02:28:21.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.851+0000 7f693d6ae640 1 --2- 172.21.15.60:0/769845014 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69380bf1b0 0x7f6938157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:21.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.851+0000 7f693d6ae640 1 -- 172.21.15.60:0/769845014 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6938074390 con 0x7f69380bf1b0 2024-09-12T02:28:21.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.851+0000 7f69367fc640 1 --2- 172.21.15.60:0/769845014 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69380bf1b0 0x7f6938157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:21.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.851+0000 7f69367fc640 1 -- 172.21.15.60:0/769845014 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f69380abb20 con 0x7f69380bf1b0 2024-09-12T02:28:21.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.852+0000 7f69367fc640 1 --2- 172.21.15.60:0/769845014 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69380bf1b0 0x7f6938157490 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f69380c3440 tx=0x7f692c011d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:21.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.852+0000 7f691f7fe640 1 -- 172.21.15.60:0/769845014 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f692c019070 con 0x7f69380bf1b0 2024-09-12T02:28:21.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.852+0000 7f691f7fe640 1 -- 172.21.15.60:0/769845014 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6928044070 con 0x7f69380ac720 2024-09-12T02:28:21.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.852+0000 7f691f7fe640 1 --2- 172.21.15.60:0/769845014 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f692406bd30 0x7f692406e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:21.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.853+0000 7f691f7fe640 1 -- 172.21.15.60:0/769845014 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f69280ab430 con 0x7f69380ac720 2024-09-12T02:28:21.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.853+0000 7f69377fe640 1 --2- 172.21.15.60:0/769845014 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f692406bd30 0x7f692406e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:21.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.853+0000 7f691f7fe640 1 -- 172.21.15.60:0/769845014 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f692c004240 con 0x7f69380bf1b0 2024-09-12T02:28:21.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.853+0000 7f691f7fe640 1 -- 172.21.15.60:0/769845014 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69380bf1b0 msgr2=0x7f6938157490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:21.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.853+0000 7f691f7fe640 1 --2- 172.21.15.60:0/769845014 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69380bf1b0 0x7f6938157490 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f69380c3440 tx=0x7f692c011d60 comp rx=0 tx=0).stop 2024-09-12T02:28:21.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.853+0000 7f691f7fe640 1 -- 172.21.15.60:0/769845014 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69380bf1b0 msgr2=0x7f6938157490 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:28:21.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.853+0000 7f691f7fe640 1 --2- 172.21.15.60:0/769845014 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69380bf1b0 0x7f6938157490 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:21.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.853+0000 7f69377fe640 1 --2- 172.21.15.60:0/769845014 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f692406bd30 0x7f692406e1f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6938159af0 tx=0x7f693000b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:21.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.861+0000 7f693d6ae640 1 --2- 172.21.15.60:0/769845014 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6938158a00 0x7f69381579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:21.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.861+0000 7f693d6ae640 1 -- 172.21.15.60:0/769845014 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f69380c63f0 con 0x7f6938158a00 2024-09-12T02:28:21.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.861+0000 7f69367fc640 1 --2- 172.21.15.60:0/769845014 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6938158a00 0x7f69381579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:21.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.861+0000 7f69367fc640 1 -- 172.21.15.60:0/769845014 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f69380a99e0 con 0x7f6938158a00 2024-09-12T02:28:21.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.861+0000 7f69367fc640 1 --2- 172.21.15.60:0/769845014 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6938158a00 0x7f69381579d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f692c01b000 tx=0x7f692c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:21.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.862+0000 7f691f7fe640 1 -- 172.21.15.60:0/769845014 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f692c01e650 con 0x7f6938158a00 2024-09-12T02:28:21.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.862+0000 7f691f7fe640 1 -- 172.21.15.60:0/769845014 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5051 (secure 0 0 0) 0x7f692c0283a0 con 0x7f6938158a00 2024-09-12T02:28:21.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.862+0000 7f691f7fe640 1 -- 172.21.15.60:0/769845014 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6938158a00 msgr2=0x7f69381579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:21.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.862+0000 7f691f7fe640 1 --2- 172.21.15.60:0/769845014 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6938158a00 0x7f69381579d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f692c01b000 tx=0x7f692c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:28:21.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.862+0000 7f691f7fe640 1 -- 172.21.15.60:0/769845014 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6938158a00 msgr2=0x7f69381579d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:28:21.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.862+0000 7f691f7fe640 1 --2- 172.21.15.60:0/769845014 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6938158a00 0x7f69381579d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:21.863 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:28:21.863 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:28:21.863 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:28:21.863 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:28:21.863 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 42, 2024-09-12T02:28:21.863 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 247297, 2024-09-12T02:28:21.864 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:28:21.864 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:28:21.864 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:28:21.864 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:28:21.864 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:28:21.864 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 16, 2024-09-12T02:28:21.864 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:28:21.864 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:28:21.864 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:28:21.864 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:28:21.864 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:28:21.864 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:28:21.864 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:28:21.865 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:28:21.865 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:28:21.865 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:28:21.865 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:28:21.865 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:28:21.865 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:28:21.865 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:28:21.865 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:28:21.865 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:28:21.865 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:28:21.865 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:28:21.865 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:28:21.866 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:28:21.866 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:28:21.866 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:28:21.866 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:28:21.866 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:28:21.866 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:28:21.866 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:28:21.866 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:28:21.866 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:28:21.866 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:21.866 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:21.866 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:28:21.866 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:28:21.866 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:28:21.866 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:28:21.867 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:28:21.867 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:28:21.867 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:28:21.867 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:28:21.867 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:28:21.867 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:28:21.867 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:28:21.867 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:28:21.867 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:28:21.867 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:28:21.867 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:28:21.867 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:28:21.867 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:28:21.867 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:28:21.868 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:28:21.868 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:28:21.868 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:28:21.868 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:28:21.868 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:28:21.868 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:28:21.868 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:28:21.868 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:28:21.868 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:28:21.868 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:28:21.868 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:28:21.868 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:28:21.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:21.869 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:28:21.869 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:21.869 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:28:21.869 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:28:21.869 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:28:21.869 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:28:21.869 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:21.869 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:28:21.869 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:28:21.869 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:21.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:21.869 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:21.869 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:28:21.869 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:28:21.869 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:21.870 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:21.870 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:21.870 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:21.870 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:28:21.870 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:28:21.870 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:28:21.870 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:28:21.870 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:28:21.870 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:21.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:21.870 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:28:21.870 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:28:21.870 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:28:21.870 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:28:21.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:21.871 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:28:21.871 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:28:21.871 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:21.871 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:21.871 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:21.871 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:28:21.871 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:28:21.871 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:21.871 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:21.871 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:21.871 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:21.871 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:28:21.871 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:28:21.872 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:28:21.872 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:28:21.872 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:28:21.872 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:21.872 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:21.872 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:28:21.872 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:28:21.872 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:28:21.872 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:28:21.872 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:21.872 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:28:21.872 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:28:21.873 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:21.873 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:21.873 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:21.873 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:28:21.873 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:28:21.873 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:21.873 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:21.873 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:21.873 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:21.873 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:28:21.873 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:28:21.873 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:28:21.873 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:28:21.873 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:28:21.874 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:21.874 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:21.874 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:21.874 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:28:21.874 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:28:21.874 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:21.874 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:28:21.874 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:28:21.874 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:28:21.874 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:21.874 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:28:21.874 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:28:21.874 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:21.874 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:28:21.874 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:28:21.875 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:28:21.875 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:21.875 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:28:21.875 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:28:21.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:21.875 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:28:21.875 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:28:21.875 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-09-12T02:28:21.875 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:21.875 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:28:21.875 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:28:21.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:21.875 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:28:21.875 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:28:21.876 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-09-12T02:28:21.876 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:21.876 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:28:21.876 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:28:21.876 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:21.876 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:28:21.876 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:28:21.876 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:28:21.876 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:21.876 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:21.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:21.876 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:28:21.876 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:28:21.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.862+0000 7f693d6ae640 1 -- 172.21.15.60:0/769845014 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f692406bd30 msgr2=0x7f692406e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:21.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.862+0000 7f693d6ae640 1 --2- 172.21.15.60:0/769845014 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f692406bd30 0x7f692406e1f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6938159af0 tx=0x7f693000b040 comp rx=0 tx=0).stop 2024-09-12T02:28:21.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.862+0000 7f693d6ae640 1 -- 172.21.15.60:0/769845014 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69380ac720 msgr2=0x7f6938152f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:21.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.862+0000 7f693d6ae640 1 --2- 172.21.15.60:0/769845014 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69380ac720 0x7f6938152f90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6928000c00 tx=0x7f69280046c0 comp rx=0 tx=0).stop 2024-09-12T02:28:21.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.862+0000 7f69377fe640 1 -- 172.21.15.60:0/769845014 reap_dead start 2024-09-12T02:28:21.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.862+0000 7f69377fe640 1 -- 172.21.15.60:0/769845014 reap_dead start 2024-09-12T02:28:21.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.862+0000 7f693d6ae640 1 -- 172.21.15.60:0/769845014 shutdown_connections 2024-09-12T02:28:21.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.862+0000 7f693d6ae640 1 -- 172.21.15.60:0/769845014 >> 172.21.15.60:0/769845014 conn(0x7f69380c5660 msgr2=0x7f69381e2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:21.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.862+0000 7f693d6ae640 1 -- 172.21.15.60:0/769845014 shutdown_connections 2024-09-12T02:28:21.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.862+0000 7f693d6ae640 1 -- 172.21.15.60:0/769845014 wait complete. 2024-09-12T02:28:21.879 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:28:21.879 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-12T02:28:21.879 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-12T02:28:21.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.997+0000 7f5c34942640 1 Processor -- start 2024-09-12T02:28:21.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.997+0000 7f5c34942640 1 -- start start 2024-09-12T02:28:21.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.998+0000 7f5c34942640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c30150480 0x7f5c300c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:21.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.998+0000 7f5c34942640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f5c300ca390 0x7f5c300c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:21.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.998+0000 7f5c34942640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c3015a7c0 con 0x7f5c3006c650 2024-09-12T02:28:21.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.998+0000 7f5c34942640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f5c3006c240 con 0x7f5c300ca390 2024-09-12T02:28:21.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.998+0000 7f5c34942640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5c3015a330 con 0x7f5c30150480 2024-09-12T02:28:21.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.998+0000 7f5c2dd9b640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f5c3006c650 0x7f5c300c9c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34170/0 (socket says 172.21.15.60:34170) 2024-09-12T02:28:21.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.998+0000 7f5c2dd9b640 1 -- 172.21.15.60:0/3828056659 learned_addr learned my addr 172.21.15.60:0/3828056659 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:28:21.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.998+0000 7f5c2e59c640 1 --2- 172.21.15.60:0/3828056659 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c30150480 0x7f5c300c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:21.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.998+0000 7f5c2ed9d640 1 --2- 172.21.15.60:0/3828056659 >> v2:172.21.15.105:3300/0 conn(0x7f5c300ca390 0x7f5c300c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:22.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.999+0000 7f5c2d59a640 1 -- 172.21.15.60:0/3828056659 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 49712888 0 0) 0x7f5c3015a7c0 con 0x7f5c3006c650 2024-09-12T02:28:22.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.999+0000 7f5c2d59a640 1 -- 172.21.15.60:0/3828056659 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c18003520 con 0x7f5c3006c650 2024-09-12T02:28:22.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.999+0000 7f5c2e59c640 1 -- 172.21.15.60:0/3828056659 >> v2:172.21.15.105:3300/0 conn(0x7f5c300ca390 msgr2=0x7f5c300c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:22.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.999+0000 7f5c2e59c640 1 --2- 172.21.15.60:0/3828056659 >> v2:172.21.15.105:3300/0 conn(0x7f5c300ca390 0x7f5c300c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:22.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.999+0000 7f5c2e59c640 1 -- 172.21.15.60:0/3828056659 >> v1:172.21.15.60:6789/0 conn(0x7f5c3006c650 legacy=0x7f5c300c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:22.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.999+0000 7f5c2e59c640 1 -- 172.21.15.60:0/3828056659 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c30159a00 con 0x7f5c30150480 2024-09-12T02:28:22.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:21.999+0000 7f5c2ed9d640 1 --2- 172.21.15.60:0/3828056659 >> v2:172.21.15.105:3300/0 conn(0x7f5c300ca390 0x7f5c300c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:28:22.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.000+0000 7f5c2e59c640 1 --2- 172.21.15.60:0/3828056659 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c30150480 0x7f5c300c7a90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5c200097a0 tx=0x7f5c2002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=346b1805f440bccd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:22.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.000+0000 7f5c2d59a640 1 -- 172.21.15.60:0/3828056659 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c20037070 con 0x7f5c30150480 2024-09-12T02:28:22.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.000+0000 7f5c2d59a640 1 -- 172.21.15.60:0/3828056659 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c20032440 con 0x7f5c30150480 2024-09-12T02:28:22.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.000+0000 7f5c2d59a640 1 -- 172.21.15.60:0/3828056659 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c20032810 con 0x7f5c30150480 2024-09-12T02:28:22.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.000+0000 7f5c34942640 1 -- 172.21.15.60:0/3828056659 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c30150480 msgr2=0x7f5c300c7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:22.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.000+0000 7f5c34942640 1 --2- 172.21.15.60:0/3828056659 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c30150480 0x7f5c300c7a90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5c200097a0 tx=0x7f5c2002a180 comp rx=0 tx=0).stop 2024-09-12T02:28:22.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.001+0000 7f5c34942640 1 -- 172.21.15.60:0/3828056659 shutdown_connections 2024-09-12T02:28:22.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.001+0000 7f5c34942640 1 --2- 172.21.15.60:0/3828056659 >> v2:172.21.15.105:3300/0 conn(0x7f5c300ca390 0x7f5c300c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:22.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.001+0000 7f5c34942640 1 --2- 172.21.15.60:0/3828056659 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c30150480 0x7f5c300c7a90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:22.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.001+0000 7f5c34942640 1 -- 172.21.15.60:0/3828056659 >> 172.21.15.60:0/3828056659 conn(0x7f5c30068030 msgr2=0x7f5c30073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:22.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.001+0000 7f5c34942640 1 -- 172.21.15.60:0/3828056659 shutdown_connections 2024-09-12T02:28:22.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.001+0000 7f5c34942640 1 -- 172.21.15.60:0/3828056659 wait complete. 2024-09-12T02:28:22.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.002+0000 7f5c34942640 1 Processor -- start 2024-09-12T02:28:22.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.002+0000 7f5c34942640 1 -- start start 2024-09-12T02:28:22.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.003+0000 7f5c34942640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c3006c650 0x7f5c3014ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:22.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.003+0000 7f5c34942640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c300ca390 0x7f5c301e1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:22.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.003+0000 7f5c34942640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c30150480 0x7f5c301e21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:22.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.003+0000 7f5c34942640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5c3006d270 con 0x7f5c30150480 2024-09-12T02:28:22.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.003+0000 7f5c34942640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5c30159fc0 con 0x7f5c300ca390 2024-09-12T02:28:22.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.003+0000 7f5c34942640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5c30156270 con 0x7f5c3006c650 2024-09-12T02:28:22.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.003+0000 7f5c2e59c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c3006c650 0x7f5c3014ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:22.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.003+0000 7f5c2ed9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c30150480 0x7f5c301e21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:22.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.003+0000 7f5c2dd9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c300ca390 0x7f5c301e1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:22.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.003+0000 7f5c2e59c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c3006c650 0x7f5c3014ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:44350/0 (socket says 172.21.15.60:44350) 2024-09-12T02:28:22.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.003+0000 7f5c2e59c640 1 -- 172.21.15.60:0/4161225184 learned_addr learned my addr 172.21.15.60:0/4161225184 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:28:22.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.003+0000 7f5c2ed9d640 1 -- 172.21.15.60:0/4161225184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c3006c650 msgr2=0x7f5c3014ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:22.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.003+0000 7f5c2ed9d640 1 --2- 172.21.15.60:0/4161225184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c3006c650 0x7f5c3014ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:22.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.003+0000 7f5c2ed9d640 1 -- 172.21.15.60:0/4161225184 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c300ca390 msgr2=0x7f5c301e1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:22.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.003+0000 7f5c2ed9d640 1 --2- 172.21.15.60:0/4161225184 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c300ca390 0x7f5c301e1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:22.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.003+0000 7f5c2ed9d640 1 -- 172.21.15.60:0/4161225184 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c301dfce0 con 0x7f5c30150480 2024-09-12T02:28:22.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.004+0000 7f5c2ed9d640 1 --2- 172.21.15.60:0/4161225184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c30150480 0x7f5c301e21f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5c2800efc0 tx=0x7f5c2800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:22.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.004+0000 7f5c1effd640 1 -- 172.21.15.60:0/4161225184 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c28018020 con 0x7f5c30150480 2024-09-12T02:28:22.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.004+0000 7f5c1effd640 1 -- 172.21.15.60:0/4161225184 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c28014480 con 0x7f5c30150480 2024-09-12T02:28:22.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.004+0000 7f5c34942640 1 -- 172.21.15.60:0/4161225184 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c301ecb40 con 0x7f5c30150480 2024-09-12T02:28:22.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.004+0000 7f5c1effd640 1 -- 172.21.15.60:0/4161225184 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c28014870 con 0x7f5c30150480 2024-09-12T02:28:22.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.004+0000 7f5c34942640 1 -- 172.21.15.60:0/4161225184 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c301dfa00 con 0x7f5c30150480 2024-09-12T02:28:22.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.005+0000 7f5c34942640 1 --2- 172.21.15.60:0/4161225184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c300afb30 0x7f5c30152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:22.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.005+0000 7f5c34942640 1 -- 172.21.15.60:0/4161225184 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5c301ecd40 con 0x7f5c300afb30 2024-09-12T02:28:22.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.005+0000 7f5c2e59c640 1 --2- 172.21.15.60:0/4161225184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c300afb30 0x7f5c30152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:22.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.006+0000 7f5c2e59c640 1 -- 172.21.15.60:0/4161225184 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5c300b1050 con 0x7f5c300afb30 2024-09-12T02:28:22.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.006+0000 7f5c1effd640 1 -- 172.21.15.60:0/4161225184 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5c28005d10 con 0x7f5c30150480 2024-09-12T02:28:22.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.006+0000 7f5c2e59c640 1 --2- 172.21.15.60:0/4161225184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c300afb30 0x7f5c30152e00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5c200097a0 tx=0x7f5c200046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:22.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.006+0000 7f5c1effd640 1 --2- 172.21.15.60:0/4161225184 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f5c1006be30 0x7f5c1006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:22.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.006+0000 7f5c1effd640 1 -- 172.21.15.60:0/4161225184 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f5c2808bd50 con 0x7f5c30150480 2024-09-12T02:28:22.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.006+0000 7f5c2dd9b640 1 --2- 172.21.15.60:0/4161225184 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f5c1006be30 0x7f5c1006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:22.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.006+0000 7f5c1effd640 1 -- 172.21.15.60:0/4161225184 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c20044070 con 0x7f5c300afb30 2024-09-12T02:28:22.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.006+0000 7f5c1effd640 1 -- 172.21.15.60:0/4161225184 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5c200093c0 con 0x7f5c300afb30 2024-09-12T02:28:22.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.006+0000 7f5c1effd640 1 -- 172.21.15.60:0/4161225184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c300afb30 msgr2=0x7f5c30152e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:22.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.006+0000 7f5c1effd640 1 --2- 172.21.15.60:0/4161225184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c300afb30 0x7f5c30152e00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5c200097a0 tx=0x7f5c200046c0 comp rx=0 tx=0).stop 2024-09-12T02:28:22.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.007+0000 7f5c1effd640 1 -- 172.21.15.60:0/4161225184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c300afb30 msgr2=0x7f5c30152e00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:28:22.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.007+0000 7f5c1effd640 1 --2- 172.21.15.60:0/4161225184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c300afb30 0x7f5c30152e00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:22.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.007+0000 7f5c2dd9b640 1 --2- 172.21.15.60:0/4161225184 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f5c1006be30 0x7f5c1006e2f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5c300c5ed0 tx=0x7f5c24009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:22.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.013+0000 7f5c34942640 1 --2- 172.21.15.60:0/4161225184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c3014dc40 0x7f5c30153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:22.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.013+0000 7f5c34942640 1 -- 172.21.15.60:0/4161225184 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5c300c9c80 con 0x7f5c3014dc40 2024-09-12T02:28:22.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.013+0000 7f5c2e59c640 1 --2- 172.21.15.60:0/4161225184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c3014dc40 0x7f5c30153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:22.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.014+0000 7f5c2e59c640 1 -- 172.21.15.60:0/4161225184 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5c300cb4e0 con 0x7f5c3014dc40 2024-09-12T02:28:22.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.014+0000 7f5c2e59c640 1 --2- 172.21.15.60:0/4161225184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c3014dc40 0x7f5c30153340 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5c300c8760 tx=0x7f5c20008030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:22.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.014+0000 7f5c1effd640 1 -- 172.21.15.60:0/4161225184 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c20037040 con 0x7f5c3014dc40 2024-09-12T02:28:22.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.014+0000 7f5c1effd640 1 -- 172.21.15.60:0/4161225184 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4549 (secure 0 0 0) 0x7f5c20003820 con 0x7f5c3014dc40 2024-09-12T02:28:22.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.014+0000 7f5c1effd640 1 -- 172.21.15.60:0/4161225184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c3014dc40 msgr2=0x7f5c30153340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:22.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.014+0000 7f5c1effd640 1 --2- 172.21.15.60:0/4161225184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c3014dc40 0x7f5c30153340 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5c300c8760 tx=0x7f5c20008030 comp rx=0 tx=0).stop 2024-09-12T02:28:22.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.014+0000 7f5c1effd640 1 -- 172.21.15.60:0/4161225184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c3014dc40 msgr2=0x7f5c30153340 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:28:22.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.014+0000 7f5c1effd640 1 --2- 172.21.15.60:0/4161225184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c3014dc40 0x7f5c30153340 secure :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5c300c8760 tx=0x7f5c20008030 comp rx=0 tx=0).stop 2024-09-12T02:28:22.016 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:28:22.016 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:28:22.016 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:28:22.016 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:28:22.016 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 42, 2024-09-12T02:28:22.016 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 22080, 2024-09-12T02:28:22.016 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:28:22.016 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:28:22.016 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:28:22.016 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:28:22.016 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:28:22.016 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 16, 2024-09-12T02:28:22.017 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:28:22.017 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:28:22.017 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:28:22.017 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:28:22.017 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:28:22.017 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:28:22.017 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:28:22.017 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:28:22.017 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:28:22.017 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:28:22.017 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:28:22.017 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:28:22.017 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:28:22.017 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:28:22.018 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:28:22.018 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:28:22.018 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:28:22.018 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:28:22.018 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:28:22.018 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:28:22.018 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:28:22.018 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:28:22.018 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:28:22.018 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:28:22.018 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:28:22.018 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:28:22.018 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:28:22.019 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:28:22.019 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:22.019 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:22.019 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:28:22.019 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:28:22.019 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:28:22.019 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:28:22.019 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:28:22.019 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:28:22.019 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:28:22.019 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:28:22.019 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:28:22.019 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:28:22.020 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:28:22.020 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:28:22.020 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:28:22.020 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:28:22.020 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:28:22.020 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:28:22.020 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:28:22.020 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:28:22.020 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:28:22.020 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:28:22.020 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:28:22.020 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:28:22.020 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:28:22.020 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:28:22.020 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:28:22.021 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:28:22.021 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:28:22.021 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:28:22.021 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:28:22.021 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:28:22.021 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:22.021 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:28:22.021 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:22.021 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:28:22.021 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:28:22.021 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:28:22.021 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:28:22.021 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:22.022 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:28:22.022 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:28:22.022 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:22.022 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:22.022 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:22.022 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:28:22.022 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:28:22.022 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:22.022 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:22.022 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:22.022 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:22.022 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:28:22.022 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:28:22.022 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:28:22.022 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:28:22.022 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:28:22.023 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:22.023 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:22.023 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:28:22.023 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:28:22.023 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:28:22.023 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:28:22.023 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:22.023 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:28:22.023 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:28:22.023 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:22.023 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:22.023 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:22.023 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:28:22.023 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:28:22.023 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:22.024 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:22.024 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:22.024 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:22.024 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:28:22.024 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:28:22.024 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:28:22.024 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:28:22.024 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:28:22.024 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:22.024 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:22.024 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:28:22.024 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:28:22.024 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:28:22.025 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:28:22.025 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:22.025 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:28:22.025 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:28:22.025 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:22.025 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:22.025 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:22.025 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:28:22.025 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:28:22.025 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:22.025 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:22.025 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:22.025 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:22.025 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:28:22.026 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:28:22.026 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:28:22.026 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:28:22.026 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:28:22.026 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:22.026 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:22.026 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:22.026 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:28:22.026 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:28:22.026 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:22.026 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:28:22.026 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:28:22.026 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:28:22.026 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:22.026 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:28:22.027 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:28:22.027 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:22.027 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:28:22.027 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:28:22.027 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:28:22.027 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:22.027 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:22.027 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:22.027 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:28:22.027 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:28:22.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.015+0000 7f5c34942640 1 -- 172.21.15.60:0/4161225184 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f5c1006be30 msgr2=0x7f5c1006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:22.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.015+0000 7f5c34942640 1 --2- 172.21.15.60:0/4161225184 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f5c1006be30 0x7f5c1006e2f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5c300c5ed0 tx=0x7f5c24009040 comp rx=0 tx=0).stop 2024-09-12T02:28:22.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.015+0000 7f5c34942640 1 -- 172.21.15.60:0/4161225184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c30150480 msgr2=0x7f5c301e21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:22.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.015+0000 7f5c34942640 1 --2- 172.21.15.60:0/4161225184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c30150480 0x7f5c301e21f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5c2800efc0 tx=0x7f5c2800c490 comp rx=0 tx=0).stop 2024-09-12T02:28:22.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.015+0000 7f5c2ed9d640 1 -- 172.21.15.60:0/4161225184 reap_dead start 2024-09-12T02:28:22.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.015+0000 7f5c2ed9d640 1 -- 172.21.15.60:0/4161225184 reap_dead start 2024-09-12T02:28:22.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.015+0000 7f5c34942640 1 -- 172.21.15.60:0/4161225184 shutdown_connections 2024-09-12T02:28:22.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.015+0000 7f5c34942640 1 -- 172.21.15.60:0/4161225184 >> 172.21.15.60:0/4161225184 conn(0x7f5c30068030 msgr2=0x7f5c301550e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:22.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.015+0000 7f5c34942640 1 -- 172.21.15.60:0/4161225184 shutdown_connections 2024-09-12T02:28:22.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.015+0000 7f5c34942640 1 -- 172.21.15.60:0/4161225184 wait complete. 2024-09-12T02:28:22.029 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:28:22.030 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-09-12T02:28:22.030 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-12T02:28:22.030 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-09-12T02:28:22.030 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-12T02:28:22.030 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T02:28:22.030 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:28:22.042 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T02:28:22.042 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-12T02:28:22.042 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:28:22.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.195+0000 7f85431d6640 1 Processor -- start 2024-09-12T02:28:22.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.195+0000 7f85431d6640 1 -- start start 2024-09-12T02:28:22.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.196+0000 7f85431d6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f853c0c3560 0x7f853c0c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:22.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.196+0000 7f8540f72640 1 -- >> v1:172.21.15.60:6789/0 conn(0x7f853c153be0 legacy=0x7f853c0ac720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:28:22.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.196+0000 7f85431d6640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f853c0c8460 con 0x7f853c153be0 2024-09-12T02:28:22.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.196+0000 7f85431d6640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f853c153fc0 con 0x7f853c0c7fb0 2024-09-12T02:28:22.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.196+0000 7f85431d6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f853c156db0 con 0x7f853c0c3560 2024-09-12T02:28:22.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.196+0000 7f8541773640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f853c0c7fb0 0x7f853c160bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:60876/0 (socket says 172.21.15.60:60876) 2024-09-12T02:28:22.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.196+0000 7f8541773640 1 -- 172.21.15.60:0/2849063481 learned_addr learned my addr 172.21.15.60:0/2849063481 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:28:22.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.196+0000 7f853bfff640 1 --2- 172.21.15.60:0/2849063481 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f853c0c3560 0x7f853c0c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:22.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.196+0000 7f853b7fe640 1 -- 172.21.15.60:0/2849063481 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 986176989 0 0) 0x7f8534001490 con 0x7f853c0c7fb0 2024-09-12T02:28:22.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.196+0000 7f853b7fe640 1 -- 172.21.15.60:0/2849063481 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f852c003520 con 0x7f853c0c7fb0 2024-09-12T02:28:22.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.197+0000 7f853bfff640 1 -- 172.21.15.60:0/2849063481 >> v1:172.21.15.105:6789/0 conn(0x7f853c0c7fb0 legacy=0x7f853c160bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:22.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.197+0000 7f853bfff640 1 -- 172.21.15.60:0/2849063481 >> v1:172.21.15.60:6789/0 conn(0x7f853c153be0 legacy=0x7f853c0ac720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:28:22.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.197+0000 7f853bfff640 1 -- 172.21.15.60:0/2849063481 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f853c0a8030 con 0x7f853c0c3560 2024-09-12T02:28:22.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.197+0000 7f853bfff640 1 --2- 172.21.15.60:0/2849063481 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f853c0c3560 0x7f853c0c7a70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f85280097d0 tx=0x7f852802a0a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54b1ad7be723f751 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:22.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.198+0000 7f853b7fe640 1 -- 172.21.15.60:0/2849063481 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8528037070 con 0x7f853c0c3560 2024-09-12T02:28:22.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.198+0000 7f853b7fe640 1 -- 172.21.15.60:0/2849063481 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f852802adb0 con 0x7f853c0c3560 2024-09-12T02:28:22.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.198+0000 7f853b7fe640 1 -- 172.21.15.60:0/2849063481 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8528032640 con 0x7f853c0c3560 2024-09-12T02:28:22.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.198+0000 7f85431d6640 1 -- 172.21.15.60:0/2849063481 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f853c0c3560 msgr2=0x7f853c0c7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:22.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.198+0000 7f85431d6640 1 --2- 172.21.15.60:0/2849063481 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f853c0c3560 0x7f853c0c7a70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f85280097d0 tx=0x7f852802a0a0 comp rx=0 tx=0).stop 2024-09-12T02:28:22.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.198+0000 7f85431d6640 1 -- 172.21.15.60:0/2849063481 shutdown_connections 2024-09-12T02:28:22.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.198+0000 7f85431d6640 1 --2- 172.21.15.60:0/2849063481 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f853c0c3560 0x7f853c0c7a70 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:22.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.198+0000 7f85431d6640 1 -- 172.21.15.60:0/2849063481 >> 172.21.15.60:0/2849063481 conn(0x7f853c0c5660 msgr2=0x7f853c0c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:22.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.198+0000 7f85431d6640 1 -- 172.21.15.60:0/2849063481 shutdown_connections 2024-09-12T02:28:22.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.198+0000 7f85431d6640 1 -- 172.21.15.60:0/2849063481 wait complete. 2024-09-12T02:28:22.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.200+0000 7f85431d6640 1 Processor -- start 2024-09-12T02:28:22.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.200+0000 7f85431d6640 1 -- start start 2024-09-12T02:28:22.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.201+0000 7f85431d6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f853c0c3560 0x7f853c14bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:22.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.201+0000 7f85431d6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f853c0c7fb0 0x7f853c1ec630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:22.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.201+0000 7f85431d6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f853c153be0 0x7f853c159b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:22.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.201+0000 7f85431d6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f853c0a83e0 con 0x7f853c0c3560 2024-09-12T02:28:22.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.201+0000 7f85431d6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f853c157240 con 0x7f853c0c7fb0 2024-09-12T02:28:22.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.201+0000 7f85431d6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f853c0ac370 con 0x7f853c153be0 2024-09-12T02:28:22.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.201+0000 7f8540f72640 1 -- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f853c0c3560 msgr2=0x7f853c14bd90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:28:22.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.201+0000 7f8540f72640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f853c0c3560 0x7f853c14bd90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:28:22.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.201+0000 7f853bfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f853c0c7fb0 0x7f853c1ec630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:22.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.201+0000 7f853bfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f853c0c7fb0 0x7f853c1ec630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:55052/0 (socket says 172.21.15.60:55052) 2024-09-12T02:28:22.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.201+0000 7f853bfff640 1 -- 172.21.15.60:0/3205520149 learned_addr learned my addr 172.21.15.60:0/3205520149 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:28:22.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.201+0000 7f8541773640 1 --2- 172.21.15.60:0/3205520149 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f853c153be0 0x7f853c159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:22.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.201+0000 7f853bfff640 1 -- 172.21.15.60:0/3205520149 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f853c153be0 msgr2=0x7f853c159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:22.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.201+0000 7f853bfff640 1 --2- 172.21.15.60:0/3205520149 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f853c153be0 0x7f853c159b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:22.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.201+0000 7f853bfff640 1 -- 172.21.15.60:0/3205520149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f853c0c3560 msgr2=0x7f853c14bd90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:28:22.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.201+0000 7f853bfff640 1 --2- 172.21.15.60:0/3205520149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f853c0c3560 0x7f853c14bd90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:22.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.201+0000 7f853bfff640 1 -- 172.21.15.60:0/3205520149 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f853c1ec150 con 0x7f853c0c7fb0 2024-09-12T02:28:22.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.202+0000 7f853bfff640 1 --2- 172.21.15.60:0/3205520149 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f853c0c7fb0 0x7f853c1ec630 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f85280098f0 tx=0x7f85280046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:22.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.202+0000 7f85397fa640 1 -- 172.21.15.60:0/3205520149 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8528042020 con 0x7f853c0c7fb0 2024-09-12T02:28:22.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.202+0000 7f85397fa640 1 -- 172.21.15.60:0/3205520149 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8528038040 con 0x7f853c0c7fb0 2024-09-12T02:28:22.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.202+0000 7f85431d6640 1 -- 172.21.15.60:0/3205520149 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f853c158600 con 0x7f853c0c7fb0 2024-09-12T02:28:22.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.202+0000 7f85397fa640 1 -- 172.21.15.60:0/3205520149 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8528037070 con 0x7f853c0c7fb0 2024-09-12T02:28:22.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.202+0000 7f85431d6640 1 -- 172.21.15.60:0/3205520149 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f853c158320 con 0x7f853c0c7fb0 2024-09-12T02:28:22.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.203+0000 7f85431d6640 1 -- 172.21.15.60:0/3205520149 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f853c1ebf40 con 0x7f853c0c7fb0 2024-09-12T02:28:22.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.203+0000 7f85397fa640 1 -- 172.21.15.60:0/3205520149 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8528045020 con 0x7f853c0c7fb0 2024-09-12T02:28:22.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.204+0000 7f85397fa640 1 --2- 172.21.15.60:0/3205520149 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f852006bde0 0x7f852006e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:22.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.204+0000 7f8540f72640 1 --2- 172.21.15.60:0/3205520149 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f852006bde0 0x7f852006e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:22.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.204+0000 7f85397fa640 1 -- 172.21.15.60:0/3205520149 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f85280ab510 con 0x7f853c0c7fb0 2024-09-12T02:28:22.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.205+0000 7f8540f72640 1 --2- 172.21.15.60:0/3205520149 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f852006bde0 0x7f852006e2a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8530006fd0 tx=0x7f8530006d80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:22.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.209+0000 7f85397fa640 1 -- 172.21.15.60:0/3205520149 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f852804c070 con 0x7f853c0c7fb0 2024-09-12T02:28:22.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.503+0000 7f85431d6640 1 -- 172.21.15.60:0/3205520149 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f853c0a89a0 con 0x7f853c0c7fb0 2024-09-12T02:28:22.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.503+0000 7f85397fa640 1 -- 172.21.15.60:0/3205520149 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f8528079a80 con 0x7f853c0c7fb0 2024-09-12T02:28:22.504 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":42,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:28:22.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.505+0000 7f85431d6640 1 -- 172.21.15.60:0/3205520149 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f852006bde0 msgr2=0x7f852006e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:22.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.505+0000 7f85431d6640 1 --2- 172.21.15.60:0/3205520149 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f852006bde0 0x7f852006e2a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8530006fd0 tx=0x7f8530006d80 comp rx=0 tx=0).stop 2024-09-12T02:28:22.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.505+0000 7f85431d6640 1 -- 172.21.15.60:0/3205520149 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f853c0c7fb0 msgr2=0x7f853c1ec630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:22.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.505+0000 7f85431d6640 1 --2- 172.21.15.60:0/3205520149 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f853c0c7fb0 0x7f853c1ec630 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f85280098f0 tx=0x7f85280046c0 comp rx=0 tx=0).stop 2024-09-12T02:28:22.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.505+0000 7f85431d6640 1 -- 172.21.15.60:0/3205520149 shutdown_connections 2024-09-12T02:28:22.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.505+0000 7f85431d6640 1 --2- 172.21.15.60:0/3205520149 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f852006bde0 0x7f852006e2a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:22.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.505+0000 7f85431d6640 1 --2- 172.21.15.60:0/3205520149 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f853c153be0 0x7f853c159b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:22.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.505+0000 7f85431d6640 1 --2- 172.21.15.60:0/3205520149 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f853c0c7fb0 0x7f853c1ec630 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:22.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.505+0000 7f85431d6640 1 --2- 172.21.15.60:0/3205520149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f853c0c3560 0x7f853c14bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:22.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.505+0000 7f85431d6640 1 -- 172.21.15.60:0/3205520149 >> 172.21.15.60:0/3205520149 conn(0x7f853c0c5660 msgr2=0x7f853c0ac720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:22.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.505+0000 7f85431d6640 1 -- 172.21.15.60:0/3205520149 shutdown_connections 2024-09-12T02:28:22.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:22.505+0000 7f85431d6640 1 -- 172.21.15.60:0/3205520149 wait complete. 2024-09-12T02:28:25.519 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:28:25.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.632+0000 7f11a6a45640 1 Processor -- start 2024-09-12T02:28:25.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.632+0000 7f11a6a45640 1 -- start start 2024-09-12T02:28:25.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.633+0000 7f11a6a45640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f11a00c8b10 0x7f11a015a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:25.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.633+0000 7f11a6a45640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f11a0153be0 0x7f11a0156660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:25.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.633+0000 7f11a6a45640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11a00c7070 con 0x7f11a006cd80 2024-09-12T02:28:25.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.633+0000 7f11a6a45640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f11a006d210 con 0x7f11a0153be0 2024-09-12T02:28:25.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.633+0000 7f11a6a45640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f11a00c69b0 con 0x7f11a00c8b10 2024-09-12T02:28:25.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.633+0000 7f119f7fe640 1 -- >> v1:172.21.15.60:6789/0 conn(0x7f11a006cd80 legacy=0x7f11a01534d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:28:25.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.634+0000 7f11a4fe2640 1 -- >> v2:172.21.15.60:3300/0 conn(0x7f11a0153be0 msgr2=0x7f11a0156660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:28:25.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.634+0000 7f11a4fe2640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f11a0153be0 0x7f11a0156660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:28:25.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.634+0000 7f119ffff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f11a00c8b10 0x7f11a015a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:25.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.634+0000 7f119ffff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f11a00c8b10 0x7f11a015a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:55060/0 (socket says 172.21.15.60:55060) 2024-09-12T02:28:25.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.634+0000 7f119ffff640 1 -- 172.21.15.60:0/3988856540 learned_addr learned my addr 172.21.15.60:0/3988856540 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:28:25.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.634+0000 7f119ffff640 1 -- 172.21.15.60:0/3988856540 >> v2:172.21.15.60:3300/0 conn(0x7f11a0153be0 msgr2=0x7f11a0156660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:28:25.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.634+0000 7f119ffff640 1 --2- 172.21.15.60:0/3988856540 >> v2:172.21.15.60:3300/0 conn(0x7f11a0153be0 0x7f11a0156660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:25.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.634+0000 7f119ffff640 1 -- 172.21.15.60:0/3988856540 >> v1:172.21.15.60:6789/0 conn(0x7f11a006cd80 legacy=0x7f11a01534d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:28:25.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.634+0000 7f119ffff640 1 -- 172.21.15.60:0/3988856540 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11a00c6c90 con 0x7f11a00c8b10 2024-09-12T02:28:25.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.636+0000 7f119ffff640 1 --2- 172.21.15.60:0/3988856540 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11a00c8b10 0x7f11a015a4a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f11a00ae760 tx=0x7f119002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f14ce0cf9746f421 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:25.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.636+0000 7f119effd640 1 -- 172.21.15.60:0/3988856540 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1190037070 con 0x7f11a00c8b10 2024-09-12T02:28:25.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.636+0000 7f119effd640 1 -- 172.21.15.60:0/3988856540 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1190032440 con 0x7f11a00c8b10 2024-09-12T02:28:25.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.636+0000 7f119effd640 1 -- 172.21.15.60:0/3988856540 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1190032810 con 0x7f11a00c8b10 2024-09-12T02:28:25.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.637+0000 7f11a6a45640 1 -- 172.21.15.60:0/3988856540 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11a00c8b10 msgr2=0x7f11a015a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:25.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.637+0000 7f11a6a45640 1 --2- 172.21.15.60:0/3988856540 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11a00c8b10 0x7f11a015a4a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f11a00ae760 tx=0x7f119002a1c0 comp rx=0 tx=0).stop 2024-09-12T02:28:25.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.637+0000 7f11a6a45640 1 -- 172.21.15.60:0/3988856540 shutdown_connections 2024-09-12T02:28:25.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.637+0000 7f11a6a45640 1 --2- 172.21.15.60:0/3988856540 >> v2:172.21.15.60:3300/0 conn(0x7f11a0153be0 0x7f11a0156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:25.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.637+0000 7f11a6a45640 1 --2- 172.21.15.60:0/3988856540 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11a00c8b10 0x7f11a015a4a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:25.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.637+0000 7f11a6a45640 1 -- 172.21.15.60:0/3988856540 >> 172.21.15.60:0/3988856540 conn(0x7f11a00adb80 msgr2=0x7f11a00adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:25.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.637+0000 7f11a6a45640 1 -- 172.21.15.60:0/3988856540 shutdown_connections 2024-09-12T02:28:25.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.637+0000 7f11a6a45640 1 -- 172.21.15.60:0/3988856540 wait complete. 2024-09-12T02:28:25.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.639+0000 7f11a6a45640 1 Processor -- start 2024-09-12T02:28:25.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.639+0000 7f11a6a45640 1 -- start start 2024-09-12T02:28:25.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.640+0000 7f11a6a45640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11a00c8b10 0x7f11a015a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:25.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.640+0000 7f11a6a45640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11a0153be0 0x7f11a014ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:25.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.640+0000 7f11a6a45640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11a014b8b0 0x7f11a014b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:25.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.640+0000 7f119f7fe640 1 -- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11a0153be0 msgr2=0x7f11a014ad60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:28:25.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.640+0000 7f119f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11a0153be0 0x7f11a014ad60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:28:25.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.640+0000 7f11a6a45640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f11a00c9070 con 0x7f11a0153be0 2024-09-12T02:28:25.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.640+0000 7f11a6a45640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f11a00c8ef0 con 0x7f11a00c8b10 2024-09-12T02:28:25.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.641+0000 7f11a6a45640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f11a0156ba0 con 0x7f11a014b8b0 2024-09-12T02:28:25.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.641+0000 7f119ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11a00c8b10 0x7f11a015a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:25.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.641+0000 7f119ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11a00c8b10 0x7f11a015a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:55072/0 (socket says 172.21.15.60:55072) 2024-09-12T02:28:25.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.641+0000 7f119ffff640 1 -- 172.21.15.60:0/3832843645 learned_addr learned my addr 172.21.15.60:0/3832843645 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:28:25.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.641+0000 7f11a4fe2640 1 --2- 172.21.15.60:0/3832843645 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11a014b8b0 0x7f11a014b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:25.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.641+0000 7f11a4fe2640 1 -- 172.21.15.60:0/3832843645 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11a00c8b10 msgr2=0x7f11a015a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:25.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.641+0000 7f11a4fe2640 1 --2- 172.21.15.60:0/3832843645 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11a00c8b10 0x7f11a015a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:25.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.641+0000 7f11a4fe2640 1 -- 172.21.15.60:0/3832843645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11a0153be0 msgr2=0x7f11a014ad60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:28:25.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.641+0000 7f11a4fe2640 1 --2- 172.21.15.60:0/3832843645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11a0153be0 0x7f11a014ad60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:25.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.641+0000 7f11a4fe2640 1 -- 172.21.15.60:0/3832843645 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11a01500f0 con 0x7f11a014b8b0 2024-09-12T02:28:25.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.641+0000 7f11a4fe2640 1 --2- 172.21.15.60:0/3832843645 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11a014b8b0 0x7f11a014b2a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1198003c30 tx=0x7f1198009ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:25.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.641+0000 7f119cff9640 1 -- 172.21.15.60:0/3832843645 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f119800cd90 con 0x7f11a014b8b0 2024-09-12T02:28:25.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.641+0000 7f119cff9640 1 -- 172.21.15.60:0/3832843645 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1198010070 con 0x7f11a014b8b0 2024-09-12T02:28:25.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.642+0000 7f119cff9640 1 -- 172.21.15.60:0/3832843645 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11980156b0 con 0x7f11a014b8b0 2024-09-12T02:28:25.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.642+0000 7f11a6a45640 1 -- 172.21.15.60:0/3832843645 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11a01503d0 con 0x7f11a014b8b0 2024-09-12T02:28:25.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.642+0000 7f11a6a45640 1 -- 172.21.15.60:0/3832843645 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f11a014f2e0 con 0x7f11a014b8b0 2024-09-12T02:28:25.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.644+0000 7f119cff9640 1 -- 172.21.15.60:0/3832843645 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1198005070 con 0x7f11a014b8b0 2024-09-12T02:28:25.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.644+0000 7f11a6a45640 1 -- 172.21.15.60:0/3832843645 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11a00c9d90 con 0x7f11a014b8b0 2024-09-12T02:28:25.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.644+0000 7f119cff9640 1 --2- 172.21.15.60:0/3832843645 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f118c06bde0 0x7f118c06e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:25.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.645+0000 7f119cff9640 1 -- 172.21.15.60:0/3832843645 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f119808b600 con 0x7f11a014b8b0 2024-09-12T02:28:25.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.645+0000 7f119ffff640 1 --2- 172.21.15.60:0/3832843645 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f118c06bde0 0x7f118c06e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:25.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.646+0000 7f119ffff640 1 --2- 172.21.15.60:0/3832843645 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f118c06bde0 0x7f118c06e2a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f11a014f9a0 tx=0x7f119002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:25.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.650+0000 7f119cff9640 1 -- 172.21.15.60:0/3832843645 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1198059c00 con 0x7f11a014b8b0 2024-09-12T02:28:25.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.969+0000 7f11a6a45640 1 -- 172.21.15.60:0/3832843645 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f11a0156640 con 0x7f11a014b8b0 2024-09-12T02:28:25.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.970+0000 7f119cff9640 1 -- 172.21.15.60:0/3832843645 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f1198059500 con 0x7f11a014b8b0 2024-09-12T02:28:25.971 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":42,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:28:25.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.972+0000 7f11a6a45640 1 -- 172.21.15.60:0/3832843645 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f118c06bde0 msgr2=0x7f118c06e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:25.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.972+0000 7f11a6a45640 1 --2- 172.21.15.60:0/3832843645 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f118c06bde0 0x7f118c06e2a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f11a014f9a0 tx=0x7f119002e000 comp rx=0 tx=0).stop 2024-09-12T02:28:25.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.972+0000 7f11a6a45640 1 -- 172.21.15.60:0/3832843645 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11a014b8b0 msgr2=0x7f11a014b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:25.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.972+0000 7f11a6a45640 1 --2- 172.21.15.60:0/3832843645 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11a014b8b0 0x7f11a014b2a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1198003c30 tx=0x7f1198009ed0 comp rx=0 tx=0).stop 2024-09-12T02:28:25.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.972+0000 7f11a6a45640 1 -- 172.21.15.60:0/3832843645 shutdown_connections 2024-09-12T02:28:25.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.972+0000 7f11a6a45640 1 --2- 172.21.15.60:0/3832843645 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f118c06bde0 0x7f118c06e2a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:25.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.972+0000 7f11a6a45640 1 --2- 172.21.15.60:0/3832843645 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11a014b8b0 0x7f11a014b2a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:25.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.972+0000 7f11a6a45640 1 --2- 172.21.15.60:0/3832843645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11a0153be0 0x7f11a014ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:25.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.972+0000 7f11a6a45640 1 --2- 172.21.15.60:0/3832843645 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11a00c8b10 0x7f11a015a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:25.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.972+0000 7f11a6a45640 1 -- 172.21.15.60:0/3832843645 >> 172.21.15.60:0/3832843645 conn(0x7f11a00adb80 msgr2=0x7f11a00ca7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:25.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.972+0000 7f11a6a45640 1 -- 172.21.15.60:0/3832843645 shutdown_connections 2024-09-12T02:28:25.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:25.973+0000 7f11a6a45640 1 -- 172.21.15.60:0/3832843645 wait complete. 2024-09-12T02:28:27.478 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:28:27.481 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:28:28.986 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:28:29.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:29.107+0000 7fa0ecf03640 1 Processor -- start 2024-09-12T02:28:29.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:29.107+0000 7fa0ecf03640 1 -- start start 2024-09-12T02:28:29.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:29.108+0000 7fa0ecf03640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa0e8153be0 0x7fa0e815a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:29.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:29.108+0000 7fa0ecf03640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0e80c7070 con 0x7fa0e80c8b10 2024-09-12T02:28:29.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:29.108+0000 7fa0ecf03640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0e806d210 con 0x7fa0e806cd80 2024-09-12T02:28:29.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:29.108+0000 7fa0ecf03640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fa0e80c69b0 con 0x7fa0e8153be0 2024-09-12T02:28:29.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:29.108+0000 7fa0e659c640 1 -- >> v1:172.21.15.60:6789/0 conn(0x7fa0e80c8b10 legacy=0x7fa0e81534d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:28:29.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:29.108+0000 7fa0e6d9d640 1 -- >> v2:172.21.15.60:3300/0 conn(0x7fa0e8153be0 msgr2=0x7fa0e815a4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:28:29.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:29.108+0000 7fa0e6d9d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa0e8153be0 0x7fa0e815a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:28:29.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:29.108+0000 7fa0e5d9b640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fa0e806cd80 0x7fa0e8156660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:60880/0 (socket says 172.21.15.60:60880) 2024-09-12T02:28:29.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:29.108+0000 7fa0e5d9b640 1 -- 172.21.15.60:0/2795854402 learned_addr learned my addr 172.21.15.60:0/2795854402 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:28:29.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:29.309+0000 7fa0e6d9d640 1 -- 172.21.15.60:0/2795854402 >> v2:172.21.15.60:3300/0 conn(0x7fa0e8153be0 msgr2=0x7fa0e815a4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:28:29.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:29.309+0000 7fa0e659c640 1 -- 172.21.15.60:0/2795854402 >> v1:172.21.15.60:6789/0 conn(0x7fa0e80c8b10 legacy=0x7fa0e81534d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:28:29.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:29.309+0000 7fa0e6d9d640 1 --2- 172.21.15.60:0/2795854402 >> v2:172.21.15.60:3300/0 conn(0x7fa0e8153be0 0x7fa0e815a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:28:29.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:29.710+0000 7fa0e659c640 1 -- 172.21.15.60:0/2795854402 >> v1:172.21.15.60:6789/0 conn(0x7fa0e80c8b10 legacy=0x7fa0e81534d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:28:29.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:29.710+0000 7fa0e6d9d640 1 -- 172.21.15.60:0/2795854402 >> v2:172.21.15.60:3300/0 conn(0x7fa0e8153be0 msgr2=0x7fa0e815a4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:28:29.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:29.710+0000 7fa0e6d9d640 1 --2- 172.21.15.60:0/2795854402 >> v2:172.21.15.60:3300/0 conn(0x7fa0e8153be0 0x7fa0e815a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:28:30.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:30.511+0000 7fa0e6d9d640 1 -- 172.21.15.60:0/2795854402 >> v2:172.21.15.60:3300/0 conn(0x7fa0e8153be0 msgr2=0x7fa0e815a4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:28:30.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:30.511+0000 7fa0e659c640 1 -- 172.21.15.60:0/2795854402 >> v1:172.21.15.60:6789/0 conn(0x7fa0e80c8b10 legacy=0x7fa0e81534d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:28:30.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:30.511+0000 7fa0e6d9d640 1 --2- 172.21.15.60:0/2795854402 >> v2:172.21.15.60:3300/0 conn(0x7fa0e8153be0 0x7fa0e815a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:28:32.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:32.108+0000 7fa0d7fff640 1 -- 172.21.15.60:0/2795854402 >> v2:172.21.15.60:3300/0 conn(0x7fa0e8153be0 msgr2=0x7fa0e815a4a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:28:32.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:32.108+0000 7fa0d7fff640 1 --2- 172.21.15.60:0/2795854402 >> v2:172.21.15.60:3300/0 conn(0x7fa0e8153be0 0x7fa0e815a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:32.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:32.108+0000 7fa0d7fff640 1 -- 172.21.15.60:0/2795854402 >> v1:172.21.15.105:6789/0 conn(0x7fa0e806cd80 legacy=0x7fa0e8156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:32.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:32.108+0000 7fa0d7fff640 1 -- 172.21.15.60:0/2795854402 >> v1:172.21.15.60:6789/0 conn(0x7fa0e80c8b10 legacy=0x7fa0e81534d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:28:32.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:32.108+0000 7fa0d7fff640 1 --2- 172.21.15.60:0/2795854402 >> v2:172.21.15.105:3300/0 conn(0x7fa0c80036c0 0x7fa0c8005b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:32.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:32.108+0000 7fa0d7fff640 1 --2- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0c8006130 0x7fa0c80085f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:32.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:32.108+0000 7fa0d7fff640 1 -- 172.21.15.60:0/2795854402 --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fa0e80c69b0 con 0x7fa0c80036c0 2024-09-12T02:28:32.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:32.108+0000 7fa0d7fff640 1 -- 172.21.15.60:0/2795854402 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa0c8008d20 con 0x7fa0c8006130 2024-09-12T02:28:32.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:32.108+0000 7fa0e659c640 1 --2- 172.21.15.60:0/2795854402 >> v2:172.21.15.105:3300/0 conn(0x7fa0c80036c0 0x7fa0c8005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:32.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:32.108+0000 7fa0e5d9b640 1 --2- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0c8006130 0x7fa0c80085f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:32.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:32.108+0000 7fa0e659c640 1 -- 172.21.15.60:0/2795854402 >> v2:172.21.15.105:3300/0 conn(0x7fa0c80036c0 msgr2=0x7fa0c8005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:28:32.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:32.108+0000 7fa0e659c640 1 -- 172.21.15.60:0/2795854402 >> v2:172.21.15.105:3300/0 conn(0x7fa0c80036c0 msgr2=0x7fa0c8005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:28:32.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:32.108+0000 7fa0e659c640 1 --2- 172.21.15.60:0/2795854402 >> v2:172.21.15.105:3300/0 conn(0x7fa0c80036c0 0x7fa0c8005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:28:32.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:32.108+0000 7fa0e659c640 1 --2- 172.21.15.60:0/2795854402 >> v2:172.21.15.105:3300/0 conn(0x7fa0c80036c0 0x7fa0c8005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:28:32.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:32.108+0000 7fa0e5d9b640 1 -- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0c8006130 msgr2=0x7fa0c80085f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:28:32.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:32.108+0000 7fa0e5d9b640 1 -- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0c8006130 msgr2=0x7fa0c80085f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:28:32.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:32.108+0000 7fa0e5d9b640 1 --2- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0c8006130 0x7fa0c80085f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:28:32.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:32.108+0000 7fa0e5d9b640 1 --2- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0c8006130 0x7fa0c80085f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:28:32.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:32.309+0000 7fa0e5d9b640 1 --2- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0c8006130 0x7fa0c80085f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:32.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:32.309+0000 7fa0e659c640 1 --2- 172.21.15.60:0/2795854402 >> v2:172.21.15.105:3300/0 conn(0x7fa0c80036c0 0x7fa0c8005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:32.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:32.309+0000 7fa0e5d9b640 1 -- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0c8006130 msgr2=0x7fa0c80085f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:28:32.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:32.309+0000 7fa0e5d9b640 1 -- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0c8006130 msgr2=0x7fa0c80085f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:28:32.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:32.309+0000 7fa0e659c640 1 -- 172.21.15.60:0/2795854402 >> v2:172.21.15.105:3300/0 conn(0x7fa0c80036c0 msgr2=0x7fa0c8005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:28:32.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:32.309+0000 7fa0e659c640 1 -- 172.21.15.60:0/2795854402 >> v2:172.21.15.105:3300/0 conn(0x7fa0c80036c0 msgr2=0x7fa0c8005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:28:32.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:32.309+0000 7fa0e5d9b640 1 --2- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0c8006130 0x7fa0c80085f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:28:32.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:32.309+0000 7fa0e659c640 1 --2- 172.21.15.60:0/2795854402 >> v2:172.21.15.105:3300/0 conn(0x7fa0c80036c0 0x7fa0c8005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:28:32.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:32.309+0000 7fa0e659c640 1 --2- 172.21.15.60:0/2795854402 >> v2:172.21.15.105:3300/0 conn(0x7fa0c80036c0 0x7fa0c8005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:28:32.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:32.309+0000 7fa0e5d9b640 1 --2- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0c8006130 0x7fa0c80085f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:28:32.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:32.710+0000 7fa0e659c640 1 --2- 172.21.15.60:0/2795854402 >> v2:172.21.15.105:3300/0 conn(0x7fa0c80036c0 0x7fa0c8005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:32.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:32.710+0000 7fa0e5d9b640 1 --2- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0c8006130 0x7fa0c80085f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:32.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:32.710+0000 7fa0e659c640 1 -- 172.21.15.60:0/2795854402 >> v2:172.21.15.105:3300/0 conn(0x7fa0c80036c0 msgr2=0x7fa0c8005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:28:32.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:32.710+0000 7fa0e659c640 1 -- 172.21.15.60:0/2795854402 >> v2:172.21.15.105:3300/0 conn(0x7fa0c80036c0 msgr2=0x7fa0c8005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:28:32.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:32.710+0000 7fa0e659c640 1 --2- 172.21.15.60:0/2795854402 >> v2:172.21.15.105:3300/0 conn(0x7fa0c80036c0 0x7fa0c8005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:28:32.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:32.710+0000 7fa0e5d9b640 1 -- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0c8006130 msgr2=0x7fa0c80085f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:28:32.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:32.710+0000 7fa0e5d9b640 1 -- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0c8006130 msgr2=0x7fa0c80085f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:28:32.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:32.710+0000 7fa0e5d9b640 1 --2- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0c8006130 0x7fa0c80085f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:28:32.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:32.710+0000 7fa0e659c640 1 --2- 172.21.15.60:0/2795854402 >> v2:172.21.15.105:3300/0 conn(0x7fa0c80036c0 0x7fa0c8005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:28:32.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:32.710+0000 7fa0e5d9b640 1 --2- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0c8006130 0x7fa0c80085f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:28:33.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:33.511+0000 7fa0e659c640 1 --2- 172.21.15.60:0/2795854402 >> v2:172.21.15.105:3300/0 conn(0x7fa0c80036c0 0x7fa0c8005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:33.511+0000 7fa0e5d9b640 1 --2- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0c8006130 0x7fa0c80085f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:33.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:33.511+0000 7fa0e5d9b640 1 -- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0c8006130 msgr2=0x7fa0c80085f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:28:33.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:33.511+0000 7fa0e659c640 1 -- 172.21.15.60:0/2795854402 >> v2:172.21.15.105:3300/0 conn(0x7fa0c80036c0 msgr2=0x7fa0c8005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:28:33.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:33.511+0000 7fa0e5d9b640 1 -- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0c8006130 msgr2=0x7fa0c80085f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:28:33.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:33.511+0000 7fa0e659c640 1 -- 172.21.15.60:0/2795854402 >> v2:172.21.15.105:3300/0 conn(0x7fa0c80036c0 msgr2=0x7fa0c8005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:28:33.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:33.511+0000 7fa0e5d9b640 1 --2- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0c8006130 0x7fa0c80085f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:28:33.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:33.511+0000 7fa0e659c640 1 --2- 172.21.15.60:0/2795854402 >> v2:172.21.15.105:3300/0 conn(0x7fa0c80036c0 0x7fa0c8005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:28:33.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:33.511+0000 7fa0e5d9b640 1 --2- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0c8006130 0x7fa0c80085f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:28:33.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:33.511+0000 7fa0e659c640 1 --2- 172.21.15.60:0/2795854402 >> v2:172.21.15.105:3300/0 conn(0x7fa0c80036c0 0x7fa0c8005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:28:35.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:35.108+0000 7fa0d7fff640 1 -- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0c8006130 msgr2=0x7fa0c80085f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:28:35.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:35.108+0000 7fa0d7fff640 1 --2- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0c8006130 0x7fa0c80085f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:35.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:35.108+0000 7fa0d7fff640 1 -- 172.21.15.60:0/2795854402 >> v2:172.21.15.105:3300/0 conn(0x7fa0c80036c0 msgr2=0x7fa0c8005b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:28:35.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:35.108+0000 7fa0d7fff640 1 --2- 172.21.15.60:0/2795854402 >> v2:172.21.15.105:3300/0 conn(0x7fa0c80036c0 0x7fa0c8005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:35.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:35.108+0000 7fa0e6d9d640 1 -- 172.21.15.60:0/2795854402 reap_dead start 2024-09-12T02:28:35.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:35.108+0000 7fa0d7fff640 1 --2- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0c8007ce0 0x7fa0c8008120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:35.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:35.108+0000 7fa0d7fff640 1 --2- 172.21.15.60:0/2795854402 >> v2:172.21.15.60:3300/0 conn(0x7fa0c8008660 0x7fa0c800d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:35.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:35.108+0000 7fa0d7fff640 1 -- 172.21.15.60:0/2795854402 --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0e80c6c90 con 0x7fa0c8003b30 2024-09-12T02:28:35.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:35.108+0000 7fa0d7fff640 1 -- 172.21.15.60:0/2795854402 --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fa0e80c69b0 con 0x7fa0c8008660 2024-09-12T02:28:35.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:35.108+0000 7fa0d7fff640 1 -- 172.21.15.60:0/2795854402 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa0c8008d20 con 0x7fa0c8007ce0 2024-09-12T02:28:35.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:35.108+0000 7fa0e6d9d640 1 -- 172.21.15.60:0/2795854402 >> v2:172.21.15.60:3300/0 conn(0x7fa0c8008660 msgr2=0x7fa0c800d200 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:28:35.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:35.108+0000 7fa0e6d9d640 1 --2- 172.21.15.60:0/2795854402 >> v2:172.21.15.60:3300/0 conn(0x7fa0c8008660 0x7fa0c800d200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:28:35.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:35.108+0000 7fa0e5d9b640 1 --2- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0c8007ce0 0x7fa0c8008120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:35.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:35.108+0000 7fa0e5d9b640 1 -- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0c8007ce0 msgr2=0x7fa0c8008120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:28:35.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:35.108+0000 7fa0e5d9b640 1 -- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0c8007ce0 msgr2=0x7fa0c8008120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:28:35.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:35.108+0000 7fa0e5d9b640 1 --2- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0c8007ce0 0x7fa0c8008120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:28:35.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:35.108+0000 7fa0e5d9b640 1 --2- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0c8007ce0 0x7fa0c8008120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:28:35.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:35.309+0000 7fa0e6d9d640 1 -- 172.21.15.60:0/2795854402 >> v2:172.21.15.60:3300/0 conn(0x7fa0c8008660 msgr2=0x7fa0c800d200 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:28:35.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:35.309+0000 7fa0e6d9d640 1 --2- 172.21.15.60:0/2795854402 >> v2:172.21.15.60:3300/0 conn(0x7fa0c8008660 0x7fa0c800d200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:28:35.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:35.309+0000 7fa0e5d9b640 1 --2- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0c8007ce0 0x7fa0c8008120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:35.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:35.309+0000 7fa0e5d9b640 1 -- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0c8007ce0 msgr2=0x7fa0c8008120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:28:35.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:35.309+0000 7fa0e5d9b640 1 -- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0c8007ce0 msgr2=0x7fa0c8008120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:28:35.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:35.309+0000 7fa0e5d9b640 1 --2- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0c8007ce0 0x7fa0c8008120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:28:35.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:35.309+0000 7fa0e5d9b640 1 --2- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0c8007ce0 0x7fa0c8008120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:28:35.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:35.710+0000 7fa0e6d9d640 1 -- 172.21.15.60:0/2795854402 >> v2:172.21.15.60:3300/0 conn(0x7fa0c8008660 msgr2=0x7fa0c800d200 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:28:35.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:35.710+0000 7fa0e6d9d640 1 --2- 172.21.15.60:0/2795854402 >> v2:172.21.15.60:3300/0 conn(0x7fa0c8008660 0x7fa0c800d200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:28:35.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:35.710+0000 7fa0e5d9b640 1 --2- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0c8007ce0 0x7fa0c8008120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:35.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:35.710+0000 7fa0e5d9b640 1 -- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0c8007ce0 msgr2=0x7fa0c8008120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:28:35.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:35.710+0000 7fa0e5d9b640 1 -- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0c8007ce0 msgr2=0x7fa0c8008120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:28:35.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:35.710+0000 7fa0e5d9b640 1 --2- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0c8007ce0 0x7fa0c8008120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:28:35.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:35.710+0000 7fa0e5d9b640 1 --2- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0c8007ce0 0x7fa0c8008120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:28:36.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.237+0000 7fa0e559a640 1 -- 172.21.15.60:0/2795854402 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2741042796 0 0) 0x7fa0e80c6c90 con 0x7fa0c8003b30 2024-09-12T02:28:36.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.237+0000 7fa0e559a640 1 -- 172.21.15.60:0/2795854402 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0d0003520 con 0x7fa0c8003b30 2024-09-12T02:28:36.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.241+0000 7fa0e559a640 1 -- 172.21.15.60:0/2795854402 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3334804276 0 0) 0x7fa0d0003520 con 0x7fa0c8003b30 2024-09-12T02:28:36.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.241+0000 7fa0e559a640 1 -- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0c8007ce0 msgr2=0x7fa0c8008120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:28:36.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.241+0000 7fa0e559a640 1 --2- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0c8007ce0 0x7fa0c8008120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.241+0000 7fa0e559a640 1 -- 172.21.15.60:0/2795854402 >> v2:172.21.15.60:3300/0 conn(0x7fa0c8008660 msgr2=0x7fa0c800d200 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:28:36.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.241+0000 7fa0e559a640 1 --2- 172.21.15.60:0/2795854402 >> v2:172.21.15.60:3300/0 conn(0x7fa0c8008660 0x7fa0c800d200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.241+0000 7fa0e559a640 1 -- 172.21.15.60:0/2795854402 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0e80c7070 con 0x7fa0c8003b30 2024-09-12T02:28:36.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.241+0000 7fa0e559a640 1 -- 172.21.15.60:0/2795854402 <== mon.1 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7fa0d8003e30 con 0x7fa0c8003b30 2024-09-12T02:28:36.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.241+0000 7fa0e559a640 1 -- 172.21.15.60:0/2795854402 >> v1:172.21.15.105:6789/0 conn(0x7fa0c8003b30 legacy=0x7fa0c80065c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:36.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.242+0000 7fa0e559a640 1 --2- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0d00039b0 0x7fa0d0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.242+0000 7fa0e559a640 1 --2- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0c8007ce0 0x7fa0d0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.242+0000 7fa0e559a640 1 --2- 172.21.15.60:0/2795854402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0d0004d40 0x7fa0d00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.242+0000 7fa0e559a640 1 -- 172.21.15.60:0/2795854402 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e80c69b0 con 0x7fa0d0004d40 2024-09-12T02:28:36.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.242+0000 7fa0e559a640 1 -- 172.21.15.60:0/2795854402 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c8008d20 con 0x7fa0d00039b0 2024-09-12T02:28:36.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.242+0000 7fa0e559a640 1 -- 172.21.15.60:0/2795854402 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa0d000bc50 con 0x7fa0c8007ce0 2024-09-12T02:28:36.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.242+0000 7fa0e6d9d640 1 -- 172.21.15.60:0/2795854402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0d0004d40 msgr2=0x7fa0d00051c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:28:36.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.242+0000 7fa0e6d9d640 1 --2- 172.21.15.60:0/2795854402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0d0004d40 0x7fa0d00051c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:28:36.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.242+0000 7fa0e5d9b640 1 --2- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0c8007ce0 0x7fa0d0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.242+0000 7fa0e5d9b640 1 -- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0d00039b0 msgr2=0x7fa0d0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:36.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.242+0000 7fa0e5d9b640 1 --2- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0d00039b0 0x7fa0d0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.242+0000 7fa0e5d9b640 1 -- 172.21.15.60:0/2795854402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0d0004d40 msgr2=0x7fa0d00051c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:28:36.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.242+0000 7fa0e5d9b640 1 --2- 172.21.15.60:0/2795854402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0d0004d40 0x7fa0d00051c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.242+0000 7fa0e5d9b640 1 -- 172.21.15.60:0/2795854402 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0d0003520 con 0x7fa0c8007ce0 2024-09-12T02:28:36.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.243+0000 7fa0e5d9b640 1 --2- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0c8007ce0 0x7fa0d0004800 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc005fd0 tx=0x7fa0d0005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3b5457fb4fa631f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:36.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.244+0000 7fa0e559a640 1 -- 172.21.15.60:0/2795854402 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc032070 con 0x7fa0c8007ce0 2024-09-12T02:28:36.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.244+0000 7fa0e559a640 1 -- 172.21.15.60:0/2795854402 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0dc02c600 con 0x7fa0c8007ce0 2024-09-12T02:28:36.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.244+0000 7fa0e559a640 1 -- 172.21.15.60:0/2795854402 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc005c20 con 0x7fa0c8007ce0 2024-09-12T02:28:36.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.245+0000 7fa0ecf03640 1 -- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0c8007ce0 msgr2=0x7fa0d0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:36.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.245+0000 7fa0ecf03640 1 --2- 172.21.15.60:0/2795854402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0c8007ce0 0x7fa0d0004800 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc005fd0 tx=0x7fa0d0005830 comp rx=0 tx=0).stop 2024-09-12T02:28:36.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.245+0000 7fa0e6d9d640 1 -- 172.21.15.60:0/2795854402 reap_dead start 2024-09-12T02:28:36.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.245+0000 7fa0ecf03640 1 -- 172.21.15.60:0/2795854402 shutdown_connections 2024-09-12T02:28:36.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.245+0000 7fa0ecf03640 1 -- 172.21.15.60:0/2795854402 >> 172.21.15.60:0/2795854402 conn(0x7fa0e80adb80 msgr2=0x7fa0e80adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:36.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.245+0000 7fa0ecf03640 1 -- 172.21.15.60:0/2795854402 shutdown_connections 2024-09-12T02:28:36.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.245+0000 7fa0ecf03640 1 -- 172.21.15.60:0/2795854402 wait complete. 2024-09-12T02:28:36.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.246+0000 7fa0ecf03640 1 Processor -- start 2024-09-12T02:28:36.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.247+0000 7fa0ecf03640 1 -- start start 2024-09-12T02:28:36.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.247+0000 7fa0ecf03640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0c8007ce0 0x7fa0e81ecb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.247+0000 7fa0ecf03640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0e8158610 0x7fa0e814f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.247+0000 7fa0ecf03640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0e814dd60 0x7fa0e80b0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.247+0000 7fa0ecf03640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e80c9070 con 0x7fa0c8007ce0 2024-09-12T02:28:36.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.247+0000 7fa0ecf03640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e80c8ef0 con 0x7fa0e8158610 2024-09-12T02:28:36.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.247+0000 7fa0ecf03640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa0e815a4a0 con 0x7fa0e814dd60 2024-09-12T02:28:36.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.247+0000 7fa0e659c640 1 -- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0c8007ce0 msgr2=0x7fa0e81ecb40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:28:36.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.247+0000 7fa0e659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0c8007ce0 0x7fa0e81ecb40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:28:36.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.248+0000 7fa0e6d9d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0e814dd60 0x7fa0e80b0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.248+0000 7fa0e5d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0e8158610 0x7fa0e814f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.248+0000 7fa0e5d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0e8158610 0x7fa0e814f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:32916/0 (socket says 172.21.15.60:32916) 2024-09-12T02:28:36.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.248+0000 7fa0e6d9d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0e814dd60 0x7fa0e80b0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:50814/0 (socket says 172.21.15.60:50814) 2024-09-12T02:28:36.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.248+0000 7fa0e5d9b640 1 -- 172.21.15.60:0/1503195648 learned_addr learned my addr 172.21.15.60:0/1503195648 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:28:36.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.248+0000 7fa0e6d9d640 1 -- 172.21.15.60:0/1503195648 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0e8158610 msgr2=0x7fa0e814f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:36.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.248+0000 7fa0e6d9d640 1 --2- 172.21.15.60:0/1503195648 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0e8158610 0x7fa0e814f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.248+0000 7fa0e6d9d640 1 -- 172.21.15.60:0/1503195648 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0c8007ce0 msgr2=0x7fa0e81ecb40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:28:36.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.248+0000 7fa0e6d9d640 1 --2- 172.21.15.60:0/1503195648 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0c8007ce0 0x7fa0e81ecb40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.248+0000 7fa0e6d9d640 1 -- 172.21.15.60:0/1503195648 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0e81ec0a0 con 0x7fa0e814dd60 2024-09-12T02:28:36.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.248+0000 7fa0e5d9b640 1 --2- 172.21.15.60:0/1503195648 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0e8158610 0x7fa0e814f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:28:36.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.248+0000 7fa0e6d9d640 1 --2- 172.21.15.60:0/1503195648 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0e814dd60 0x7fa0e80b0420 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8153fc0 tx=0x7fa0e000bd60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:36.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.248+0000 7fa0d6ffd640 1 -- 172.21.15.60:0/1503195648 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e000cc10 con 0x7fa0e814dd60 2024-09-12T02:28:36.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.248+0000 7fa0d6ffd640 1 -- 172.21.15.60:0/1503195648 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0e0010030 con 0x7fa0e814dd60 2024-09-12T02:28:36.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.248+0000 7fa0ecf03640 1 -- 172.21.15.60:0/1503195648 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0e8158aa0 con 0x7fa0e814dd60 2024-09-12T02:28:36.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.249+0000 7fa0d6ffd640 1 -- 172.21.15.60:0/1503195648 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e0016430 con 0x7fa0e814dd60 2024-09-12T02:28:36.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.249+0000 7fa0ecf03640 1 -- 172.21.15.60:0/1503195648 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0e8158d80 con 0x7fa0e814dd60 2024-09-12T02:28:36.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.249+0000 7fa0ecf03640 1 -- 172.21.15.60:0/1503195648 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0e815a830 con 0x7fa0e814dd60 2024-09-12T02:28:36.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.250+0000 7fa0d6ffd640 1 -- 172.21.15.60:0/1503195648 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa0e00153e0 con 0x7fa0e814dd60 2024-09-12T02:28:36.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.250+0000 7fa0d6ffd640 1 --2- 172.21.15.60:0/1503195648 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa0c806d280 0x7fa0c806f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.250+0000 7fa0d6ffd640 1 -- 172.21.15.60:0/1503195648 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fa0e008ab40 con 0x7fa0e814dd60 2024-09-12T02:28:36.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.250+0000 7fa0e659c640 1 --2- 172.21.15.60:0/1503195648 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa0c806d280 0x7fa0c806f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.251+0000 7fa0e659c640 1 --2- 172.21.15.60:0/1503195648 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa0c806d280 0x7fa0c806f740 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8003980 tx=0x7fa0d80070a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:36.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.255+0000 7fa0d6ffd640 1 -- 172.21.15.60:0/1503195648 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa0e0058b90 con 0x7fa0e814dd60 2024-09-12T02:28:36.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.503+0000 7fa0ecf03640 1 -- 172.21.15.60:0/1503195648 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa0e8150b10 con 0x7fa0e814dd60 2024-09-12T02:28:36.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.503+0000 7fa0d6ffd640 1 -- 172.21.15.60:0/1503195648 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7fa0e005ce90 con 0x7fa0e814dd60 2024-09-12T02:28:36.504 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":44,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:28:36.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.505+0000 7fa0ecf03640 1 -- 172.21.15.60:0/1503195648 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa0c806d280 msgr2=0x7fa0c806f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:36.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.506+0000 7fa0ecf03640 1 --2- 172.21.15.60:0/1503195648 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa0c806d280 0x7fa0c806f740 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8003980 tx=0x7fa0d80070a0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.506+0000 7fa0ecf03640 1 -- 172.21.15.60:0/1503195648 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0e814dd60 msgr2=0x7fa0e80b0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:36.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.506+0000 7fa0ecf03640 1 --2- 172.21.15.60:0/1503195648 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0e814dd60 0x7fa0e80b0420 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8153fc0 tx=0x7fa0e000bd60 comp rx=0 tx=0).stop 2024-09-12T02:28:36.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.506+0000 7fa0ecf03640 1 -- 172.21.15.60:0/1503195648 shutdown_connections 2024-09-12T02:28:36.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.506+0000 7fa0ecf03640 1 --2- 172.21.15.60:0/1503195648 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa0c806d280 0x7fa0c806f740 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.506+0000 7fa0ecf03640 1 --2- 172.21.15.60:0/1503195648 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0e814dd60 0x7fa0e80b0420 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.506+0000 7fa0ecf03640 1 --2- 172.21.15.60:0/1503195648 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0e8158610 0x7fa0e814f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.506+0000 7fa0ecf03640 1 --2- 172.21.15.60:0/1503195648 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0c8007ce0 0x7fa0e81ecb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.506+0000 7fa0ecf03640 1 -- 172.21.15.60:0/1503195648 >> 172.21.15.60:0/1503195648 conn(0x7fa0e80adb80 msgr2=0x7fa0e81532a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:36.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.506+0000 7fa0ecf03640 1 -- 172.21.15.60:0/1503195648 shutdown_connections 2024-09-12T02:28:36.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.506+0000 7fa0ecf03640 1 -- 172.21.15.60:0/1503195648 wait complete. 2024-09-12T02:28:36.517 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-12T02:28:36.517 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-12T02:28:36.517 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-12T02:28:36.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.621+0000 7f4cc969b640 1 Processor -- start 2024-09-12T02:28:36.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.621+0000 7f4cc969b640 1 -- start start 2024-09-12T02:28:36.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.621+0000 7f4cc969b640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4cc41505f0 0x7f4cc4153910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.621+0000 7f4cc969b640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cc40c5940 con 0x7f4cc40c69c0 2024-09-12T02:28:36.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.621+0000 7f4cc969b640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cc40c5c00 con 0x7f4cc40c42b0 2024-09-12T02:28:36.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.621+0000 7f4cc969b640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f4cc40c7860 con 0x7f4cc41505f0 2024-09-12T02:28:36.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.621+0000 7f4cc27fc640 1 -- >> v1:172.21.15.60:6789/0 conn(0x7f4cc40c69c0 legacy=0x7f4cc40c2440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:28:36.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.622+0000 7f4cc2ffd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4cc41505f0 0x7f4cc4153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.622+0000 7f4cc2ffd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4cc41505f0 0x7f4cc4153910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:32924/0 (socket says 172.21.15.60:32924) 2024-09-12T02:28:36.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.622+0000 7f4cc2ffd640 1 -- 172.21.15.60:0/3476465994 learned_addr learned my addr 172.21.15.60:0/3476465994 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:28:36.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.622+0000 7f4cc2ffd640 1 -- 172.21.15.60:0/3476465994 >> v1:172.21.15.105:6789/0 conn(0x7f4cc40c42b0 legacy=0x7f4cc40c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:36.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.622+0000 7f4cc2ffd640 1 -- 172.21.15.60:0/3476465994 >> v1:172.21.15.60:6789/0 conn(0x7f4cc40c69c0 legacy=0x7f4cc40c2440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:28:36.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.622+0000 7f4cc2ffd640 1 -- 172.21.15.60:0/3476465994 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc40c5ee0 con 0x7f4cc41505f0 2024-09-12T02:28:36.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.623+0000 7f4cc2ffd640 1 --2- 172.21.15.60:0/3476465994 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cc41505f0 0x7f4cc4153910 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4009870 tx=0x7f4cb402a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2fc4e5c190aa04 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:36.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.623+0000 7f4cc1ffb640 1 -- 172.21.15.60:0/3476465994 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb4037070 con 0x7f4cc41505f0 2024-09-12T02:28:36.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.623+0000 7f4cc1ffb640 1 -- 172.21.15.60:0/3476465994 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cb4032440 con 0x7f4cc41505f0 2024-09-12T02:28:36.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.623+0000 7f4cc1ffb640 1 -- 172.21.15.60:0/3476465994 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb4032810 con 0x7f4cc41505f0 2024-09-12T02:28:36.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.623+0000 7f4cc969b640 1 -- 172.21.15.60:0/3476465994 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cc41505f0 msgr2=0x7f4cc4153910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:36.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.623+0000 7f4cc969b640 1 --2- 172.21.15.60:0/3476465994 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cc41505f0 0x7f4cc4153910 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4009870 tx=0x7f4cb402a210 comp rx=0 tx=0).stop 2024-09-12T02:28:36.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.623+0000 7f4cc969b640 1 -- 172.21.15.60:0/3476465994 shutdown_connections 2024-09-12T02:28:36.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.623+0000 7f4cc969b640 1 --2- 172.21.15.60:0/3476465994 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cc41505f0 0x7f4cc4153910 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.623+0000 7f4cc969b640 1 -- 172.21.15.60:0/3476465994 >> 172.21.15.60:0/3476465994 conn(0x7f4cc40c7a40 msgr2=0x7f4cc40c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:36.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.624+0000 7f4cc969b640 1 -- 172.21.15.60:0/3476465994 shutdown_connections 2024-09-12T02:28:36.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.624+0000 7f4cc969b640 1 -- 172.21.15.60:0/3476465994 wait complete. 2024-09-12T02:28:36.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.625+0000 7f4cc969b640 1 Processor -- start 2024-09-12T02:28:36.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.625+0000 7f4cc969b640 1 -- start start 2024-09-12T02:28:36.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.626+0000 7f4cc969b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cc40c42b0 0x7f4cc41edd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.626+0000 7f4cc969b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4cc41505f0 0x7f4cc41e1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.626+0000 7f4cc969b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4cc40abb50 0x7f4cc414ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.626+0000 7f4cc969b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc41509d0 con 0x7f4cc41505f0 2024-09-12T02:28:36.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.626+0000 7f4cc969b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc40c64a0 con 0x7f4cc40c42b0 2024-09-12T02:28:36.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.626+0000 7f4cc969b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4cc4150b50 con 0x7f4cc40abb50 2024-09-12T02:28:36.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.626+0000 7f4cc27fc640 1 -- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4cc41505f0 msgr2=0x7f4cc41e1010 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:28:36.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.626+0000 7f4cc27fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4cc41505f0 0x7f4cc41e1010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:28:36.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.626+0000 7f4cc2ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cc40c42b0 0x7f4cc41edd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.626+0000 7f4cc2ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cc40c42b0 0x7f4cc41edd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:32932/0 (socket says 172.21.15.60:32932) 2024-09-12T02:28:36.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.626+0000 7f4cc2ffd640 1 -- 172.21.15.60:0/2544312663 learned_addr learned my addr 172.21.15.60:0/2544312663 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:28:36.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.626+0000 7f4cc37fe640 1 --2- 172.21.15.60:0/2544312663 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4cc40abb50 0x7f4cc414ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.626+0000 7f4cc2ffd640 1 -- 172.21.15.60:0/2544312663 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4cc40abb50 msgr2=0x7f4cc414ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:36.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.626+0000 7f4cc2ffd640 1 --2- 172.21.15.60:0/2544312663 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4cc40abb50 0x7f4cc414ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.626+0000 7f4cc2ffd640 1 -- 172.21.15.60:0/2544312663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4cc41505f0 msgr2=0x7f4cc41e1010 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:28:36.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.626+0000 7f4cc2ffd640 1 --2- 172.21.15.60:0/2544312663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4cc41505f0 0x7f4cc41e1010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.626+0000 7f4cc2ffd640 1 -- 172.21.15.60:0/2544312663 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc40ac140 con 0x7f4cc40c42b0 2024-09-12T02:28:36.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.626+0000 7f4cc2ffd640 1 --2- 172.21.15.60:0/2544312663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cc40c42b0 0x7f4cc41edd50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4cb40097c0 tx=0x7f4cb40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:36.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.626+0000 7f4cbb7fe640 1 -- 172.21.15.60:0/2544312663 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb4041070 con 0x7f4cc40c42b0 2024-09-12T02:28:36.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.627+0000 7f4cbb7fe640 1 -- 172.21.15.60:0/2544312663 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cb403c930 con 0x7f4cc40c42b0 2024-09-12T02:28:36.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.627+0000 7f4cc969b640 1 -- 172.21.15.60:0/2544312663 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cc41ed550 con 0x7f4cc40c42b0 2024-09-12T02:28:36.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.627+0000 7f4cbb7fe640 1 -- 172.21.15.60:0/2544312663 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb4037040 con 0x7f4cc40c42b0 2024-09-12T02:28:36.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.627+0000 7f4cc969b640 1 -- 172.21.15.60:0/2544312663 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cc41e1550 con 0x7f4cc40c42b0 2024-09-12T02:28:36.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.627+0000 7f4cc969b640 1 --2- 172.21.15.60:0/2544312663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cc40c69c0 0x7f4cc4143cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.627+0000 7f4cc969b640 1 -- 172.21.15.60:0/2544312663 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc41ee290 con 0x7f4cc40c69c0 2024-09-12T02:28:36.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.628+0000 7f4cc27fc640 1 --2- 172.21.15.60:0/2544312663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cc40c69c0 0x7f4cc4143cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.628+0000 7f4cc27fc640 1 -- 172.21.15.60:0/2544312663 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4cc41ed340 con 0x7f4cc40c69c0 2024-09-12T02:28:36.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.628+0000 7f4cc27fc640 1 --2- 172.21.15.60:0/2544312663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cc40c69c0 0x7f4cc4143cb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4cc414d6f0 tx=0x7f4cac00b8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:36.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.628+0000 7f4cbb7fe640 1 -- 172.21.15.60:0/2544312663 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4cb4044070 con 0x7f4cc40c42b0 2024-09-12T02:28:36.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.629+0000 7f4cbb7fe640 1 --2- 172.21.15.60:0/2544312663 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4ca406bde0 0x7f4ca406e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.629+0000 7f4cbb7fe640 1 -- 172.21.15.60:0/2544312663 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f4cb40abce0 con 0x7f4cc40c42b0 2024-09-12T02:28:36.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.629+0000 7f4cc37fe640 1 --2- 172.21.15.60:0/2544312663 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4ca406bde0 0x7f4ca406e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.629+0000 7f4cbb7fe640 1 -- 172.21.15.60:0/2544312663 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cac003e10 con 0x7f4cc40c69c0 2024-09-12T02:28:36.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.629+0000 7f4cbb7fe640 1 -- 172.21.15.60:0/2544312663 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f4cac015070 con 0x7f4cc40c69c0 2024-09-12T02:28:36.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.629+0000 7f4cbb7fe640 1 -- 172.21.15.60:0/2544312663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cc40c69c0 msgr2=0x7f4cc4143cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:36.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.629+0000 7f4cbb7fe640 1 --2- 172.21.15.60:0/2544312663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cc40c69c0 0x7f4cc4143cb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4cc414d6f0 tx=0x7f4cac00b8c0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.629+0000 7f4cbb7fe640 1 -- 172.21.15.60:0/2544312663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cc40c69c0 msgr2=0x7f4cc4143cb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:28:36.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.629+0000 7f4cbb7fe640 1 --2- 172.21.15.60:0/2544312663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cc40c69c0 0x7f4cc4143cb0 secure :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4cc414d6f0 tx=0x7f4cac00b8c0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.629+0000 7f4cc37fe640 1 --2- 172.21.15.60:0/2544312663 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4ca406bde0 0x7f4ca406e2a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc0012e0 tx=0x7f4cbc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:36.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.635+0000 7f4cc969b640 1 --2- 172.21.15.60:0/2544312663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cc40ac310 0x7f4cc41441f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.635+0000 7f4cc969b640 1 -- 172.21.15.60:0/2544312663 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc4157440 con 0x7f4cc40ac310 2024-09-12T02:28:36.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.635+0000 7f4cc27fc640 1 --2- 172.21.15.60:0/2544312663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cc40ac310 0x7f4cc41441f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.636+0000 7f4cc27fc640 1 -- 172.21.15.60:0/2544312663 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4cc40c2c20 con 0x7f4cc40ac310 2024-09-12T02:28:36.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.636+0000 7f4cc27fc640 1 --2- 172.21.15.60:0/2544312663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cc40ac310 0x7f4cc41441f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4cc414d6f0 tx=0x7f4cac005a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:36.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.636+0000 7f4cbb7fe640 1 -- 172.21.15.60:0/2544312663 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cac005500 con 0x7f4cc40ac310 2024-09-12T02:28:36.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.636+0000 7f4cbb7fe640 1 -- 172.21.15.60:0/2544312663 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5041 (secure 0 0 0) 0x7f4cac005500 con 0x7f4cc40ac310 2024-09-12T02:28:36.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.636+0000 7f4cbb7fe640 1 -- 172.21.15.60:0/2544312663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cc40ac310 msgr2=0x7f4cc41441f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:36.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.636+0000 7f4cbb7fe640 1 --2- 172.21.15.60:0/2544312663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cc40ac310 0x7f4cc41441f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4cc414d6f0 tx=0x7f4cac005a20 comp rx=0 tx=0).stop 2024-09-12T02:28:36.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.636+0000 7f4cbb7fe640 1 -- 172.21.15.60:0/2544312663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cc40ac310 msgr2=0x7f4cc41441f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:28:36.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.636+0000 7f4cbb7fe640 1 --2- 172.21.15.60:0/2544312663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cc40ac310 0x7f4cc41441f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.638 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:28:36.638 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:28:36.638 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:28:36.638 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:28:36.638 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 44, 2024-09-12T02:28:36.638 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 262070, 2024-09-12T02:28:36.639 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:28:36.639 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:28:36.639 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:28:36.639 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:28:36.639 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-09-12T02:28:36.639 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:28:36.639 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:28:36.639 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:28:36.639 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:28:36.639 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:28:36.639 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:28:36.639 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:28:36.640 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:28:36.640 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:28:36.640 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:28:36.640 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:28:36.640 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:28:36.640 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:28:36.640 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:28:36.640 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:28:36.640 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:28:36.640 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:28:36.641 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:28:36.641 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:28:36.641 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:28:36.641 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:28:36.641 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:28:36.641 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:28:36.641 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:28:36.641 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:28:36.641 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:28:36.641 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:28:36.642 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:28:36.642 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:36.642 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:36.642 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:28:36.642 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:28:36.642 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:28:36.642 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:28:36.642 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:28:36.642 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:28:36.642 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:28:36.643 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:28:36.643 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:28:36.643 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:28:36.643 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:28:36.643 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:28:36.643 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:28:36.643 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:28:36.643 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:28:36.643 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:28:36.643 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:28:36.643 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:28:36.644 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:28:36.644 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:28:36.644 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:28:36.644 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:28:36.644 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:28:36.644 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:28:36.644 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:28:36.644 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:28:36.644 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:28:36.644 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:28:36.644 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:28:36.645 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:28:36.645 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:36.645 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:28:36.645 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:36.645 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:28:36.645 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:28:36.645 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:28:36.645 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:28:36.645 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:36.645 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:28:36.645 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:28:36.645 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:36.646 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:36.646 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:36.646 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:28:36.646 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:28:36.646 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:36.646 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:36.646 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:36.646 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:36.646 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:28:36.646 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:28:36.647 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:28:36.647 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:28:36.647 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:28:36.647 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:36.647 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:36.647 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:28:36.647 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:28:36.647 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:28:36.647 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:28:36.647 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:36.647 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:28:36.648 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:28:36.648 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:36.648 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:36.648 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:36.648 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:28:36.648 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:28:36.648 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:36.648 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:36.648 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:36.648 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:36.648 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:28:36.649 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:28:36.649 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:28:36.649 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:28:36.649 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:28:36.649 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:36.649 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:36.649 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:28:36.649 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:28:36.649 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:28:36.649 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:28:36.649 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:36.649 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:28:36.650 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:28:36.650 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:36.650 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:36.650 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:36.650 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:28:36.650 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:28:36.650 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:36.650 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:36.650 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:36.650 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:36.650 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:28:36.650 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:28:36.651 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:28:36.651 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:28:36.651 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:28:36.651 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:36.651 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:36.651 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:36.651 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:28:36.651 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:28:36.651 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:36.651 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:28:36.651 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:28:36.651 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:28:36.651 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:36.652 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:28:36.652 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:28:36.652 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:36.652 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:28:36.652 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:28:36.652 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:28:36.652 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:36.652 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:28:36.652 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:28:36.652 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:36.652 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:28:36.652 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:28:36.653 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-09-12T02:28:36.653 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:36.653 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:28:36.653 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:28:36.653 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:36.653 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:28:36.653 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:28:36.653 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 8 2024-09-12T02:28:36.653 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:36.653 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:28:36.653 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:28:36.653 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:36.654 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:28:36.654 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:28:36.654 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:28:36.654 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:36.654 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:36.654 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:36.654 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:28:36.654 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:28:36.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.637+0000 7f4cc969b640 1 -- 172.21.15.60:0/2544312663 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4ca406bde0 msgr2=0x7f4ca406e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:36.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.637+0000 7f4cc969b640 1 --2- 172.21.15.60:0/2544312663 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4ca406bde0 0x7f4ca406e2a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc0012e0 tx=0x7f4cbc009040 comp rx=0 tx=0).stop 2024-09-12T02:28:36.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.637+0000 7f4cc969b640 1 -- 172.21.15.60:0/2544312663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cc40c42b0 msgr2=0x7f4cc41edd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:36.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.637+0000 7f4cc37fe640 1 -- 172.21.15.60:0/2544312663 reap_dead start 2024-09-12T02:28:36.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.637+0000 7f4cc969b640 1 --2- 172.21.15.60:0/2544312663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cc40c42b0 0x7f4cc41edd50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4cb40097c0 tx=0x7f4cb40046c0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.637+0000 7f4cc969b640 1 -- 172.21.15.60:0/2544312663 shutdown_connections 2024-09-12T02:28:36.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.637+0000 7f4cc969b640 1 --2- 172.21.15.60:0/2544312663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cc40c42b0 0x7f4cc41edd50 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.637+0000 7f4cc969b640 1 -- 172.21.15.60:0/2544312663 >> 172.21.15.60:0/2544312663 conn(0x7f4cc40c7a40 msgr2=0x7f4cc40c4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:36.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.637+0000 7f4cc969b640 1 -- 172.21.15.60:0/2544312663 shutdown_connections 2024-09-12T02:28:36.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.637+0000 7f4cc969b640 1 -- 172.21.15.60:0/2544312663 wait complete. 2024-09-12T02:28:36.657 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-12T02:28:36.657 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-12T02:28:36.657 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-12T02:28:36.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.761+0000 7fb166152640 1 Processor -- start 2024-09-12T02:28:36.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.761+0000 7fb166152640 1 -- start start 2024-09-12T02:28:36.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.761+0000 7fb166152640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb16015a450 0x7fb1600c3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.761+0000 7fb166152640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb16015a830 con 0x7fb1600c84e0 2024-09-12T02:28:36.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.761+0000 7fb166152640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1600c7490 con 0x7fb1600c3fd0 2024-09-12T02:28:36.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.761+0000 7fb166152640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fb16006e240 con 0x7fb16015a450 2024-09-12T02:28:36.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.762+0000 7fb15ffff640 1 -- >> v1:172.21.15.60:6789/0 conn(0x7fb1600c84e0 legacy=0x7fb16006ede0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:28:36.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.762+0000 7fb15f7fe640 1 -- >> v2:172.21.15.60:3300/0 conn(0x7fb16015a450 msgr2=0x7fb1600c3a90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:28:36.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.762+0000 7fb15f7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb16015a450 0x7fb1600c3a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:28:36.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.762+0000 7fb15effd640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fb1600c3fd0 0x7fb16006e6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:47176/0 (socket says 172.21.15.60:47176) 2024-09-12T02:28:36.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.762+0000 7fb15effd640 1 -- 172.21.15.60:0/1598243573 learned_addr learned my addr 172.21.15.60:0/1598243573 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:28:36.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.762+0000 7fb15e7fc640 1 -- 172.21.15.60:0/1598243573 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4207602388 0 0) 0x7fb1600c7490 con 0x7fb1600c3fd0 2024-09-12T02:28:36.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.762+0000 7fb15e7fc640 1 -- 172.21.15.60:0/1598243573 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb148003520 con 0x7fb1600c3fd0 2024-09-12T02:28:36.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.762+0000 7fb15e7fc640 1 -- 172.21.15.60:0/1598243573 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 989585687 0 0) 0x7fb148003520 con 0x7fb1600c3fd0 2024-09-12T02:28:36.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.762+0000 7fb15e7fc640 1 -- 172.21.15.60:0/1598243573 >> v2:172.21.15.60:3300/0 conn(0x7fb16015a450 msgr2=0x7fb1600c3a90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:28:36.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.762+0000 7fb15e7fc640 1 --2- 172.21.15.60:0/1598243573 >> v2:172.21.15.60:3300/0 conn(0x7fb16015a450 0x7fb1600c3a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.762+0000 7fb15e7fc640 1 -- 172.21.15.60:0/1598243573 >> v1:172.21.15.60:6789/0 conn(0x7fb1600c84e0 legacy=0x7fb16006ede0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:28:36.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.762+0000 7fb15e7fc640 1 -- 172.21.15.60:0/1598243573 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1600c7770 con 0x7fb1600c3fd0 2024-09-12T02:28:36.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.762+0000 7fb15e7fc640 1 -- 172.21.15.60:0/1598243573 <== mon.1 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7fb154001670 con 0x7fb1600c3fd0 2024-09-12T02:28:36.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.762+0000 7fb15e7fc640 1 -- 172.21.15.60:0/1598243573 >> v1:172.21.15.105:6789/0 conn(0x7fb1600c3fd0 legacy=0x7fb16006e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:36.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.762+0000 7fb15e7fc640 1 --2- 172.21.15.60:0/1598243573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1480039b0 0x7fb148003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.762+0000 7fb15e7fc640 1 --2- 172.21.15.60:0/1598243573 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb148004800 0x7fb148004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.762+0000 7fb15e7fc640 1 --2- 172.21.15.60:0/1598243573 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1480052e0 0x7fb14800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.762+0000 7fb15e7fc640 1 -- 172.21.15.60:0/1598243573 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb16006e240 con 0x7fb148004800 2024-09-12T02:28:36.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.762+0000 7fb15e7fc640 1 -- 172.21.15.60:0/1598243573 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb14800c1e0 con 0x7fb1480039b0 2024-09-12T02:28:36.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.762+0000 7fb15e7fc640 1 -- 172.21.15.60:0/1598243573 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb14800c3e0 con 0x7fb1480052e0 2024-09-12T02:28:36.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.762+0000 7fb15effd640 1 -- 172.21.15.60:0/1598243573 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb148004800 msgr2=0x7fb148004c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:28:36.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.762+0000 7fb15effd640 1 --2- 172.21.15.60:0/1598243573 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb148004800 0x7fb148004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:28:36.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.763+0000 7fb15f7fe640 1 --2- 172.21.15.60:0/1598243573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1480039b0 0x7fb148003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.763+0000 7fb15ffff640 1 --2- 172.21.15.60:0/1598243573 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1480052e0 0x7fb14800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.763+0000 7fb15f7fe640 1 -- 172.21.15.60:0/1598243573 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1480052e0 msgr2=0x7fb14800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:28:36.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.763+0000 7fb15f7fe640 1 --2- 172.21.15.60:0/1598243573 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1480052e0 0x7fb14800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.763+0000 7fb15f7fe640 1 -- 172.21.15.60:0/1598243573 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb148004800 msgr2=0x7fb148004c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:28:36.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.763+0000 7fb15f7fe640 1 --2- 172.21.15.60:0/1598243573 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb148004800 0x7fb148004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.763+0000 7fb15f7fe640 1 -- 172.21.15.60:0/1598243573 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb148003520 con 0x7fb1480039b0 2024-09-12T02:28:36.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.763+0000 7fb15ffff640 1 -- 172.21.15.60:0/1598243573 reap_dead start 2024-09-12T02:28:36.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.764+0000 7fb15f7fe640 1 --2- 172.21.15.60:0/1598243573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1480039b0 0x7fb148003db0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb150003980 tx=0x7fb148005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=893f75cea5a31184 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:36.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.764+0000 7fb15e7fc640 1 -- 172.21.15.60:0/1598243573 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb150009500 con 0x7fb1480039b0 2024-09-12T02:28:36.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.764+0000 7fb15e7fc640 1 -- 172.21.15.60:0/1598243573 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb15002e070 con 0x7fb1480039b0 2024-09-12T02:28:36.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.764+0000 7fb15e7fc640 1 -- 172.21.15.60:0/1598243573 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb150003df0 con 0x7fb1480039b0 2024-09-12T02:28:36.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.764+0000 7fb166152640 1 -- 172.21.15.60:0/1598243573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1480039b0 msgr2=0x7fb148003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:36.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.764+0000 7fb166152640 1 --2- 172.21.15.60:0/1598243573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1480039b0 0x7fb148003db0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb150003980 tx=0x7fb148005830 comp rx=0 tx=0).stop 2024-09-12T02:28:36.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.764+0000 7fb166152640 1 -- 172.21.15.60:0/1598243573 shutdown_connections 2024-09-12T02:28:36.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.764+0000 7fb166152640 1 --2- 172.21.15.60:0/1598243573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1480039b0 0x7fb148003db0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.764+0000 7fb166152640 1 -- 172.21.15.60:0/1598243573 >> 172.21.15.60:0/1598243573 conn(0x7fb1600c5660 msgr2=0x7fb1600c5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:36.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.764+0000 7fb166152640 1 -- 172.21.15.60:0/1598243573 shutdown_connections 2024-09-12T02:28:36.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.764+0000 7fb166152640 1 -- 172.21.15.60:0/1598243573 wait complete. 2024-09-12T02:28:36.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.765+0000 7fb166152640 1 Processor -- start 2024-09-12T02:28:36.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.766+0000 7fb166152640 1 -- start start 2024-09-12T02:28:36.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.766+0000 7fb166152640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1480039b0 0x7fb1600733d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.766+0000 7fb166152640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1600aa420 0x7fb160150d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.766+0000 7fb166152640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1601512d0 0x7fb160071d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.766+0000 7fb166152640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb1600c70d0 con 0x7fb1480039b0 2024-09-12T02:28:36.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.766+0000 7fb166152640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb1600c7d30 con 0x7fb1601512d0 2024-09-12T02:28:36.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.766+0000 7fb166152640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb1600c7250 con 0x7fb1600aa420 2024-09-12T02:28:36.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.766+0000 7fb15f7fe640 1 -- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1480039b0 msgr2=0x7fb1600733d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:28:36.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.766+0000 7fb15f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1480039b0 0x7fb1600733d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:28:36.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.767+0000 7fb15effd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1600aa420 0x7fb160150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.767+0000 7fb15ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1601512d0 0x7fb160071d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.767+0000 7fb15ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1601512d0 0x7fb160071d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:32958/0 (socket says 172.21.15.60:32958) 2024-09-12T02:28:36.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.767+0000 7fb15ffff640 1 -- 172.21.15.60:0/2935079487 learned_addr learned my addr 172.21.15.60:0/2935079487 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:28:36.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.767+0000 7fb15ffff640 1 -- 172.21.15.60:0/2935079487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1600aa420 msgr2=0x7fb160150d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:36.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.767+0000 7fb15ffff640 1 --2- 172.21.15.60:0/2935079487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1600aa420 0x7fb160150d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.767+0000 7fb15ffff640 1 -- 172.21.15.60:0/2935079487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1480039b0 msgr2=0x7fb1600733d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:28:36.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.767+0000 7fb15ffff640 1 --2- 172.21.15.60:0/2935079487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1480039b0 0x7fb1600733d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.767+0000 7fb15ffff640 1 -- 172.21.15.60:0/2935079487 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1600a9c10 con 0x7fb1601512d0 2024-09-12T02:28:36.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.767+0000 7fb15ffff640 1 --2- 172.21.15.60:0/2935079487 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1601512d0 0x7fb160071d70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb15800ea10 tx=0x7fb15800eed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:36.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.767+0000 7fb147fff640 1 -- 172.21.15.60:0/2935079487 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15800ce10 con 0x7fb1601512d0 2024-09-12T02:28:36.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.767+0000 7fb147fff640 1 -- 172.21.15.60:0/2935079487 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb158017440 con 0x7fb1601512d0 2024-09-12T02:28:36.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.767+0000 7fb166152640 1 -- 172.21.15.60:0/2935079487 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1600a9ed0 con 0x7fb1601512d0 2024-09-12T02:28:36.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.767+0000 7fb147fff640 1 -- 172.21.15.60:0/2935079487 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb158017830 con 0x7fb1601512d0 2024-09-12T02:28:36.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.767+0000 7fb166152640 1 -- 172.21.15.60:0/2935079487 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1601ec3b0 con 0x7fb1601512d0 2024-09-12T02:28:36.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.768+0000 7fb166152640 1 --2- 172.21.15.60:0/2935079487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1601ec5b0 0x7fb1600722b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.768+0000 7fb166152640 1 -- 172.21.15.60:0/2935079487 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb1600727f0 con 0x7fb1601ec5b0 2024-09-12T02:28:36.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.768+0000 7fb15f7fe640 1 --2- 172.21.15.60:0/2935079487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1601ec5b0 0x7fb1600722b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.769+0000 7fb15f7fe640 1 -- 172.21.15.60:0/2935079487 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb16006c5c0 con 0x7fb1601ec5b0 2024-09-12T02:28:36.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.769+0000 7fb15f7fe640 1 --2- 172.21.15.60:0/2935079487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1601ec5b0 0x7fb1600722b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb1480057e0 tx=0x7fb150005a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:36.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.769+0000 7fb147fff640 1 -- 172.21.15.60:0/2935079487 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb1580179d0 con 0x7fb1601512d0 2024-09-12T02:28:36.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.769+0000 7fb147fff640 1 --2- 172.21.15.60:0/2935079487 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb14c06be10 0x7fb14c06e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.770+0000 7fb147fff640 1 -- 172.21.15.60:0/2935079487 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1500095c0 con 0x7fb1601ec5b0 2024-09-12T02:28:36.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.770+0000 7fb15effd640 1 --2- 172.21.15.60:0/2935079487 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb14c06be10 0x7fb14c06e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.770+0000 7fb147fff640 1 -- 172.21.15.60:0/2935079487 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fb15808bbc0 con 0x7fb1601512d0 2024-09-12T02:28:36.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.770+0000 7fb147fff640 1 -- 172.21.15.60:0/2935079487 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fb15002e050 con 0x7fb1601ec5b0 2024-09-12T02:28:36.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.770+0000 7fb147fff640 1 -- 172.21.15.60:0/2935079487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1601ec5b0 msgr2=0x7fb1600722b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:36.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.770+0000 7fb147fff640 1 --2- 172.21.15.60:0/2935079487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1601ec5b0 0x7fb1600722b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb1480057e0 tx=0x7fb150005a10 comp rx=0 tx=0).stop 2024-09-12T02:28:36.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.770+0000 7fb147fff640 1 -- 172.21.15.60:0/2935079487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1601ec5b0 msgr2=0x7fb1600722b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:28:36.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.770+0000 7fb147fff640 1 --2- 172.21.15.60:0/2935079487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1601ec5b0 0x7fb1600722b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.770+0000 7fb15effd640 1 --2- 172.21.15.60:0/2935079487 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb14c06be10 0x7fb14c06e2d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb1601e2970 tx=0x7fb154001ab0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:36.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.776+0000 7fb166152640 1 --2- 172.21.15.60:0/2935079487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1601ef530 0x7fb1601ef940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:36.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.776+0000 7fb166152640 1 -- 172.21.15.60:0/2935079487 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb1600c3660 con 0x7fb1601ef530 2024-09-12T02:28:36.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.776+0000 7fb15f7fe640 1 --2- 172.21.15.60:0/2935079487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1601ef530 0x7fb1601ef940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:36.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.776+0000 7fb15f7fe640 1 -- 172.21.15.60:0/2935079487 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb1600c6ba0 con 0x7fb1601ef530 2024-09-12T02:28:36.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.777+0000 7fb15f7fe640 1 --2- 172.21.15.60:0/2935079487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1601ef530 0x7fb1601ef940 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb1500090b0 tx=0x7fb1500090e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:36.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.777+0000 7fb147fff640 1 -- 172.21.15.60:0/2935079487 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb150044aa0 con 0x7fb1601ef530 2024-09-12T02:28:36.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.777+0000 7fb147fff640 1 -- 172.21.15.60:0/2935079487 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4871 (secure 0 0 0) 0x7fb150044c40 con 0x7fb1601ef530 2024-09-12T02:28:36.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.777+0000 7fb147fff640 1 -- 172.21.15.60:0/2935079487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1601ef530 msgr2=0x7fb1601ef940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:36.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.777+0000 7fb147fff640 1 --2- 172.21.15.60:0/2935079487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1601ef530 0x7fb1601ef940 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb1500090b0 tx=0x7fb1500090e0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.777+0000 7fb147fff640 1 -- 172.21.15.60:0/2935079487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1601ef530 msgr2=0x7fb1601ef940 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:28:36.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.777+0000 7fb147fff640 1 --2- 172.21.15.60:0/2935079487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1601ef530 0x7fb1601ef940 secure :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb1500090b0 tx=0x7fb1500090e0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.779 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:28:36.779 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:28:36.779 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:28:36.779 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:28:36.779 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 44, 2024-09-12T02:28:36.779 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 36843, 2024-09-12T02:28:36.779 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:28:36.779 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:28:36.779 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:28:36.780 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:28:36.780 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-09-12T02:28:36.780 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:28:36.780 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:28:36.780 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:28:36.780 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:28:36.780 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:28:36.780 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:28:36.780 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:28:36.780 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:28:36.780 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:28:36.780 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:28:36.781 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:28:36.781 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:28:36.781 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:28:36.781 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:28:36.781 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:28:36.781 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:28:36.781 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:28:36.781 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:28:36.781 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:28:36.781 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:28:36.781 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:28:36.781 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:28:36.782 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:28:36.782 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:28:36.782 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:28:36.782 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:28:36.782 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:28:36.782 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:28:36.782 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:36.782 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:36.782 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:28:36.782 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:28:36.782 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:28:36.782 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:28:36.782 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:28:36.783 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:28:36.783 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:28:36.783 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:28:36.783 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:28:36.783 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:28:36.783 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:28:36.783 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:28:36.783 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:28:36.783 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:28:36.783 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:28:36.783 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:28:36.783 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:28:36.783 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:28:36.784 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:28:36.784 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:28:36.784 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:28:36.784 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:28:36.784 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:28:36.784 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:28:36.784 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:28:36.784 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:28:36.784 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:28:36.784 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:28:36.784 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:28:36.784 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:28:36.784 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:36.785 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:28:36.785 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:36.785 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:28:36.785 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:28:36.785 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:28:36.785 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:28:36.785 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:36.785 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:28:36.785 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:28:36.785 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:36.785 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:36.785 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:36.785 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:28:36.786 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:28:36.786 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:36.786 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:36.786 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:36.786 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:36.786 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:28:36.786 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:28:36.786 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:28:36.786 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:28:36.786 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:28:36.786 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:36.786 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:36.786 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:28:36.787 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:28:36.787 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:28:36.787 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:28:36.787 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:36.787 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:28:36.787 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:28:36.787 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:36.787 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:36.787 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:36.787 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:28:36.787 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:28:36.787 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:36.787 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:36.787 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:36.788 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:36.788 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:28:36.788 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:28:36.788 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:28:36.788 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:28:36.788 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:28:36.788 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:36.788 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:36.788 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:28:36.788 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:28:36.788 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:28:36.788 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:28:36.788 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:36.788 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:28:36.789 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:28:36.789 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:36.789 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:36.789 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:36.789 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:28:36.789 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:28:36.789 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:28:36.789 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:36.789 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:36.789 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:36.789 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:28:36.789 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:28:36.790 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:28:36.790 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:28:36.790 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:28:36.790 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:36.790 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:36.790 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:36.790 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:28:36.790 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:28:36.790 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:36.790 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:28:36.790 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:28:36.790 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:28:36.790 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:36.790 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:28:36.790 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:28:36.790 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:36.791 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:28:36.791 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:28:36.791 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:28:36.791 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:36.791 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:28:36.791 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:28:36.791 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:36.791 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:28:36.791 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:28:36.791 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:28:36.791 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:36.791 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:28:36.792 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:28:36.792 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:28:36.792 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:28:36.792 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:28:36.792 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:28:36.792 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:28:36.792 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:28:36.792 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:28:36.792 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:28:36.792 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:28:36.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.778+0000 7fb166152640 1 -- 172.21.15.60:0/2935079487 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb14c06be10 msgr2=0x7fb14c06e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:36.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.778+0000 7fb166152640 1 --2- 172.21.15.60:0/2935079487 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb14c06be10 0x7fb14c06e2d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb1601e2970 tx=0x7fb154001ab0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.778+0000 7fb166152640 1 -- 172.21.15.60:0/2935079487 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1601512d0 msgr2=0x7fb160071d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:36.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.778+0000 7fb15ffff640 1 -- 172.21.15.60:0/2935079487 reap_dead start 2024-09-12T02:28:36.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.778+0000 7fb166152640 1 --2- 172.21.15.60:0/2935079487 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1601512d0 0x7fb160071d70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb15800ea10 tx=0x7fb15800eed0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.778+0000 7fb166152640 1 -- 172.21.15.60:0/2935079487 shutdown_connections 2024-09-12T02:28:36.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.778+0000 7fb166152640 1 --2- 172.21.15.60:0/2935079487 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1601512d0 0x7fb160071d70 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:36.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.778+0000 7fb166152640 1 -- 172.21.15.60:0/2935079487 >> 172.21.15.60:0/2935079487 conn(0x7fb1600c5660 msgr2=0x7fb16006bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:36.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.778+0000 7fb166152640 1 -- 172.21.15.60:0/2935079487 shutdown_connections 2024-09-12T02:28:36.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:36.778+0000 7fb166152640 1 -- 172.21.15.60:0/2935079487 wait complete. 2024-09-12T02:28:36.795 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-12T02:28:36.795 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-12T02:28:56.795 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-12T02:28:56.796 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-09-12T02:28:56.796 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T02:28:56.796 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T02:28:56.799 INFO:tasks.ceph.mon.a:Started 2024-09-12T02:28:56.799 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-12T02:28:56.799 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:28:56.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.930+0000 7fcdd8c77640 1 Processor -- start 2024-09-12T02:28:56.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.930+0000 7fcdd8c77640 1 -- start start 2024-09-12T02:28:56.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.931+0000 7fcdd8c77640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcdd40c8b10 0x7fcdd415a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:56.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.931+0000 7fcdd8c77640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fcdd406cd80 0x7fcdd41534d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:56.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.931+0000 7fcdd8c77640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdd40c7070 con 0x7fcdd4153a10 2024-09-12T02:28:56.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.931+0000 7fcdd8c77640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fcdd406d210 con 0x7fcdd40c8b10 2024-09-12T02:28:56.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.931+0000 7fcdd8c77640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fcdd40c69b0 con 0x7fcdd406cd80 2024-09-12T02:28:56.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.931+0000 7fcdd259c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcdd40c8b10 0x7fcdd415a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:56.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.931+0000 7fcdd259c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcdd40c8b10 0x7fcdd415a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55398/0 (socket says 172.21.15.60:55398) 2024-09-12T02:28:56.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.931+0000 7fcdd1d9b640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fcdd406cd80 0x7fcdd41534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:56.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.931+0000 7fcdd259c640 1 -- 172.21.15.60:0/3260367555 learned_addr learned my addr 172.21.15.60:0/3260367555 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:28:56.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.931+0000 7fcdd259c640 1 -- 172.21.15.60:0/3260367555 >> v2:172.21.15.60:3300/0 conn(0x7fcdd40c8b10 msgr2=0x7fcdd415a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:28:56.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.931+0000 7fcdd259c640 1 -- 172.21.15.60:0/3260367555 >> v2:172.21.15.60:3300/0 conn(0x7fcdd40c8b10 msgr2=0x7fcdd415a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:28:56.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.931+0000 7fcdd259c640 1 --2- 172.21.15.60:0/3260367555 >> v2:172.21.15.60:3300/0 conn(0x7fcdd40c8b10 0x7fcdd415a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:28:56.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.931+0000 7fcdd259c640 1 --2- 172.21.15.60:0/3260367555 >> v2:172.21.15.60:3300/0 conn(0x7fcdd40c8b10 0x7fcdd415a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:28:56.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.931+0000 7fcdd1d9b640 1 -- 172.21.15.60:0/3260367555 >> v2:172.21.15.60:3300/0 conn(0x7fcdd40c8b10 msgr2=0x7fcdd415a4a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:28:56.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.931+0000 7fcdd1d9b640 1 --2- 172.21.15.60:0/3260367555 >> v2:172.21.15.60:3300/0 conn(0x7fcdd40c8b10 0x7fcdd415a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:56.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.931+0000 7fcdd1d9b640 1 -- 172.21.15.60:0/3260367555 >> v1:172.21.15.60:6789/0 conn(0x7fcdd4153a10 legacy=0x7fcdd4156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:56.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.931+0000 7fcdd1d9b640 1 -- 172.21.15.60:0/3260367555 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdd40c6c90 con 0x7fcdd406cd80 2024-09-12T02:28:56.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.932+0000 7fcdd1d9b640 1 --2- 172.21.15.60:0/3260367555 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdd406cd80 0x7fcdd41534d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcdd406ec00 tx=0x7fcdc802a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4c7fe9f991dff3b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:56.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.933+0000 7fcdd159a640 1 -- 172.21.15.60:0/3260367555 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc8037070 con 0x7fcdd406cd80 2024-09-12T02:28:56.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.933+0000 7fcdd159a640 1 -- 172.21.15.60:0/3260367555 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdc8032440 con 0x7fcdd406cd80 2024-09-12T02:28:56.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.933+0000 7fcdd159a640 1 -- 172.21.15.60:0/3260367555 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc802ae60 con 0x7fcdd406cd80 2024-09-12T02:28:56.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.933+0000 7fcdd8c77640 1 -- 172.21.15.60:0/3260367555 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdd406cd80 msgr2=0x7fcdd41534d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:56.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.933+0000 7fcdd8c77640 1 --2- 172.21.15.60:0/3260367555 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdd406cd80 0x7fcdd41534d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcdd406ec00 tx=0x7fcdc802a110 comp rx=0 tx=0).stop 2024-09-12T02:28:56.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.934+0000 7fcdd8c77640 1 -- 172.21.15.60:0/3260367555 shutdown_connections 2024-09-12T02:28:56.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.934+0000 7fcdd8c77640 1 --2- 172.21.15.60:0/3260367555 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdd406cd80 0x7fcdd41534d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:56.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.934+0000 7fcdd8c77640 1 --2- 172.21.15.60:0/3260367555 >> v2:172.21.15.60:3300/0 conn(0x7fcdd40c8b10 0x7fcdd415a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:56.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.934+0000 7fcdd8c77640 1 -- 172.21.15.60:0/3260367555 >> 172.21.15.60:0/3260367555 conn(0x7fcdd40adb80 msgr2=0x7fcdd40adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:56.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.934+0000 7fcdd8c77640 1 -- 172.21.15.60:0/3260367555 shutdown_connections 2024-09-12T02:28:56.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.934+0000 7fcdd8c77640 1 -- 172.21.15.60:0/3260367555 wait complete. 2024-09-12T02:28:56.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.935+0000 7fcdd8c77640 1 Processor -- start 2024-09-12T02:28:56.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.935+0000 7fcdd8c77640 1 -- start start 2024-09-12T02:28:56.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.936+0000 7fcdd8c77640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdd40c8b10 0x7fcdd414b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:56.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.936+0000 7fcdd8c77640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdd4153a10 0x7fcdd41efd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:56.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.936+0000 7fcdd8c77640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcdd41e27e0 0x7fcdd414dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:56.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.936+0000 7fcdd8c77640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd4154020 con 0x7fcdd40c8b10 2024-09-12T02:28:56.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.936+0000 7fcdd8c77640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd4153ea0 con 0x7fcdd4153a10 2024-09-12T02:28:56.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.936+0000 7fcdd8c77640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcdd40c8ef0 con 0x7fcdd41e27e0 2024-09-12T02:28:56.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.936+0000 7fcdd259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdd40c8b10 0x7fcdd414b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:56.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.936+0000 7fcdd259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdd40c8b10 0x7fcdd414b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55404/0 (socket says 172.21.15.60:55404) 2024-09-12T02:28:56.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.936+0000 7fcdd259c640 1 -- 172.21.15.60:0/2917994497 learned_addr learned my addr 172.21.15.60:0/2917994497 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:28:56.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.936+0000 7fcdd2d9d640 1 --2- 172.21.15.60:0/2917994497 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcdd41e27e0 0x7fcdd414dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:56.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.936+0000 7fcdd259c640 1 -- 172.21.15.60:0/2917994497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdd40c8b10 msgr2=0x7fcdd414b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-12T02:28:56.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.936+0000 7fcdd259c640 1 -- 172.21.15.60:0/2917994497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdd40c8b10 msgr2=0x7fcdd414b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:28:56.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.936+0000 7fcdd259c640 1 --2- 172.21.15.60:0/2917994497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdd40c8b10 0x7fcdd414b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:28:56.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.936+0000 7fcdd1d9b640 1 --2- 172.21.15.60:0/2917994497 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdd4153a10 0x7fcdd41efd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:56.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.936+0000 7fcdd259c640 1 --2- 172.21.15.60:0/2917994497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdd40c8b10 0x7fcdd414b690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:28:56.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.936+0000 7fcdd2d9d640 1 -- 172.21.15.60:0/2917994497 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdd4153a10 msgr2=0x7fcdd41efd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:56.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.936+0000 7fcdd2d9d640 1 --2- 172.21.15.60:0/2917994497 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdd4153a10 0x7fcdd41efd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:56.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.936+0000 7fcdd2d9d640 1 -- 172.21.15.60:0/2917994497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdd40c8b10 msgr2=0x7fcdd414b690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:28:56.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.936+0000 7fcdd2d9d640 1 --2- 172.21.15.60:0/2917994497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdd40c8b10 0x7fcdd414b690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:56.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.936+0000 7fcdd2d9d640 1 -- 172.21.15.60:0/2917994497 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdd4150470 con 0x7fcdd41e27e0 2024-09-12T02:28:56.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.937+0000 7fcdd2d9d640 1 --2- 172.21.15.60:0/2917994497 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcdd41e27e0 0x7fcdd414dd90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc00c730 tx=0x7fcdcc00cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:56.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.937+0000 7fcdc2ffd640 1 -- 172.21.15.60:0/2917994497 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc003b70 con 0x7fcdd41e27e0 2024-09-12T02:28:56.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.937+0000 7fcdc2ffd640 1 -- 172.21.15.60:0/2917994497 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdcc003d10 con 0x7fcdd41e27e0 2024-09-12T02:28:56.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.937+0000 7fcdd8c77640 1 -- 172.21.15.60:0/2917994497 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdd4150750 con 0x7fcdd41e27e0 2024-09-12T02:28:56.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.937+0000 7fcdc2ffd640 1 -- 172.21.15.60:0/2917994497 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc005310 con 0x7fcdd41e27e0 2024-09-12T02:28:56.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.937+0000 7fcdd8c77640 1 -- 172.21.15.60:0/2917994497 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdd41e1df0 con 0x7fcdd41e27e0 2024-09-12T02:28:56.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.938+0000 7fcdd8c77640 1 -- 172.21.15.60:0/2917994497 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdd41534d0 con 0x7fcdd41e27e0 2024-09-12T02:28:56.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.939+0000 7fcdc2ffd640 1 -- 172.21.15.60:0/2917994497 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcdcc00a640 con 0x7fcdd41e27e0 2024-09-12T02:28:56.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.940+0000 7fcdc2ffd640 1 --2- 172.21.15.60:0/2917994497 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcdb406be60 0x7fcdb406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:56.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.940+0000 7fcdc2ffd640 1 -- 172.21.15.60:0/2917994497 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fcdcc08b070 con 0x7fcdd41e27e0 2024-09-12T02:28:56.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.940+0000 7fcdd259c640 1 --2- 172.21.15.60:0/2917994497 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcdb406be60 0x7fcdb406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:56.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.940+0000 7fcdd259c640 1 --2- 172.21.15.60:0/2917994497 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcdb406be60 0x7fcdb406e320 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcdc40091d0 tx=0x7fcdc4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:56.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:56.946+0000 7fcdc2ffd640 1 -- 172.21.15.60:0/2917994497 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcdcc059710 con 0x7fcdd41e27e0 2024-09-12T02:28:57.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:57.224+0000 7fcdd8c77640 1 -- 172.21.15.60:0/2917994497 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fcdd4150b10 con 0x7fcdd41e27e0 2024-09-12T02:28:57.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:57.224+0000 7fcdc2ffd640 1 -- 172.21.15.60:0/2917994497 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1559 (secure 0 0 0) 0x7fcdcc059010 con 0x7fcdd41e27e0 2024-09-12T02:28:57.225 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":44,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":20,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:28:57.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:57.227+0000 7fcdd8c77640 1 -- 172.21.15.60:0/2917994497 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcdb406be60 msgr2=0x7fcdb406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:57.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:57.227+0000 7fcdd8c77640 1 --2- 172.21.15.60:0/2917994497 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcdb406be60 0x7fcdb406e320 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcdc40091d0 tx=0x7fcdc4008040 comp rx=0 tx=0).stop 2024-09-12T02:28:57.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:57.227+0000 7fcdd8c77640 1 -- 172.21.15.60:0/2917994497 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcdd41e27e0 msgr2=0x7fcdd414dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:57.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:57.227+0000 7fcdd8c77640 1 --2- 172.21.15.60:0/2917994497 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcdd41e27e0 0x7fcdd414dd90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc00c730 tx=0x7fcdcc00cbf0 comp rx=0 tx=0).stop 2024-09-12T02:28:57.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:57.227+0000 7fcdd8c77640 1 -- 172.21.15.60:0/2917994497 shutdown_connections 2024-09-12T02:28:57.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:57.227+0000 7fcdd8c77640 1 --2- 172.21.15.60:0/2917994497 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcdb406be60 0x7fcdb406e320 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:57.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:57.227+0000 7fcdd8c77640 1 --2- 172.21.15.60:0/2917994497 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcdd41e27e0 0x7fcdd414dd90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:57.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:57.227+0000 7fcdd8c77640 1 --2- 172.21.15.60:0/2917994497 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdd4153a10 0x7fcdd41efd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:57.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:57.227+0000 7fcdd8c77640 1 --2- 172.21.15.60:0/2917994497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdd40c8b10 0x7fcdd414b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:57.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:57.227+0000 7fcdd8c77640 1 -- 172.21.15.60:0/2917994497 >> 172.21.15.60:0/2917994497 conn(0x7fcdd40adb80 msgr2=0x7fcdd4154c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:57.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:57.227+0000 7fcdd8c77640 1 -- 172.21.15.60:0/2917994497 shutdown_connections 2024-09-12T02:28:57.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:28:57.227+0000 7fcdd8c77640 1 -- 172.21.15.60:0/2917994497 wait complete. 2024-09-12T02:28:57.550 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:28:57.553 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:29:00.240 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:29:00.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:00.351+0000 7fe0c5ed7640 1 Processor -- start 2024-09-12T02:29:00.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:00.352+0000 7fe0c5ed7640 1 -- start start 2024-09-12T02:29:00.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:00.352+0000 7fe0c5ed7640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe0c006cd80 0x7fe0c0153be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:00.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:00.352+0000 7fe0c5ed7640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0c00c7070 con 0x7fe0c00c8b10 2024-09-12T02:29:00.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:00.352+0000 7fe0c5ed7640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0c006d210 con 0x7fe0c015a4a0 2024-09-12T02:29:00.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:00.352+0000 7fe0c5ed7640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fe0c00c69b0 con 0x7fe0c006cd80 2024-09-12T02:29:00.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:00.352+0000 7fe0bf7fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe0c00c8b10 0x7fe0c01534d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:38206/0 (socket says 172.21.15.60:38206) 2024-09-12T02:29:00.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:00.352+0000 7fe0bf7fe640 1 -- 172.21.15.60:0/2685656482 learned_addr learned my addr 172.21.15.60:0/2685656482 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:29:00.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:00.353+0000 7fe0beffd640 1 --2- 172.21.15.60:0/2685656482 >> v2:172.21.15.105:3300/0 conn(0x7fe0c006cd80 0x7fe0c0153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:00.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:00.353+0000 7fe0beffd640 1 -- 172.21.15.60:0/2685656482 >> v2:172.21.15.105:3300/0 conn(0x7fe0c006cd80 msgr2=0x7fe0c0153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:29:00.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:00.353+0000 7fe0beffd640 1 -- 172.21.15.60:0/2685656482 >> v2:172.21.15.105:3300/0 conn(0x7fe0c006cd80 msgr2=0x7fe0c0153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:29:00.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:00.353+0000 7fe0beffd640 1 --2- 172.21.15.60:0/2685656482 >> v2:172.21.15.105:3300/0 conn(0x7fe0c006cd80 0x7fe0c0153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:29:00.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:00.353+0000 7fe0beffd640 1 --2- 172.21.15.60:0/2685656482 >> v2:172.21.15.105:3300/0 conn(0x7fe0c006cd80 0x7fe0c0153be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:29:00.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:00.554+0000 7fe0beffd640 1 --2- 172.21.15.60:0/2685656482 >> v2:172.21.15.105:3300/0 conn(0x7fe0c006cd80 0x7fe0c0153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:00.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:00.554+0000 7fe0beffd640 1 -- 172.21.15.60:0/2685656482 >> v2:172.21.15.105:3300/0 conn(0x7fe0c006cd80 msgr2=0x7fe0c0153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:29:00.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:00.554+0000 7fe0beffd640 1 -- 172.21.15.60:0/2685656482 >> v2:172.21.15.105:3300/0 conn(0x7fe0c006cd80 msgr2=0x7fe0c0153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:29:00.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:00.554+0000 7fe0beffd640 1 --2- 172.21.15.60:0/2685656482 >> v2:172.21.15.105:3300/0 conn(0x7fe0c006cd80 0x7fe0c0153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:29:00.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:00.554+0000 7fe0beffd640 1 --2- 172.21.15.60:0/2685656482 >> v2:172.21.15.105:3300/0 conn(0x7fe0c006cd80 0x7fe0c0153be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:29:00.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:00.955+0000 7fe0beffd640 1 --2- 172.21.15.60:0/2685656482 >> v2:172.21.15.105:3300/0 conn(0x7fe0c006cd80 0x7fe0c0153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:00.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:00.955+0000 7fe0beffd640 1 -- 172.21.15.60:0/2685656482 >> v2:172.21.15.105:3300/0 conn(0x7fe0c006cd80 msgr2=0x7fe0c0153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:29:00.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:00.955+0000 7fe0beffd640 1 -- 172.21.15.60:0/2685656482 >> v2:172.21.15.105:3300/0 conn(0x7fe0c006cd80 msgr2=0x7fe0c0153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:29:00.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:00.955+0000 7fe0beffd640 1 --2- 172.21.15.60:0/2685656482 >> v2:172.21.15.105:3300/0 conn(0x7fe0c006cd80 0x7fe0c0153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:29:00.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:00.955+0000 7fe0beffd640 1 --2- 172.21.15.60:0/2685656482 >> v2:172.21.15.105:3300/0 conn(0x7fe0c006cd80 0x7fe0c0153be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:29:01.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:01.756+0000 7fe0beffd640 1 --2- 172.21.15.60:0/2685656482 >> v2:172.21.15.105:3300/0 conn(0x7fe0c006cd80 0x7fe0c0153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:01.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:01.756+0000 7fe0beffd640 1 -- 172.21.15.60:0/2685656482 >> v2:172.21.15.105:3300/0 conn(0x7fe0c006cd80 msgr2=0x7fe0c0153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:29:01.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:01.756+0000 7fe0beffd640 1 -- 172.21.15.60:0/2685656482 >> v2:172.21.15.105:3300/0 conn(0x7fe0c006cd80 msgr2=0x7fe0c0153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:29:01.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:01.756+0000 7fe0beffd640 1 --2- 172.21.15.60:0/2685656482 >> v2:172.21.15.105:3300/0 conn(0x7fe0c006cd80 0x7fe0c0153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:29:01.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:01.756+0000 7fe0beffd640 1 --2- 172.21.15.60:0/2685656482 >> v2:172.21.15.105:3300/0 conn(0x7fe0c006cd80 0x7fe0c0153be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:29:02.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.517+0000 7fe0be7fc640 1 -- 172.21.15.60:0/2685656482 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3689707439 0 0) 0x7fe0c006d210 con 0x7fe0c015a4a0 2024-09-12T02:29:02.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.517+0000 7fe0be7fc640 1 -- 172.21.15.60:0/2685656482 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0a8003520 con 0x7fe0c015a4a0 2024-09-12T02:29:02.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.518+0000 7fe0be7fc640 1 -- 172.21.15.60:0/2685656482 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3348855763 0 0) 0x7fe0a8003520 con 0x7fe0c015a4a0 2024-09-12T02:29:02.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.518+0000 7fe0be7fc640 1 -- 172.21.15.60:0/2685656482 >> v2:172.21.15.105:3300/0 conn(0x7fe0c006cd80 msgr2=0x7fe0c0153be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:29:02.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.518+0000 7fe0be7fc640 1 --2- 172.21.15.60:0/2685656482 >> v2:172.21.15.105:3300/0 conn(0x7fe0c006cd80 0x7fe0c0153be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:02.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.518+0000 7fe0be7fc640 1 -- 172.21.15.60:0/2685656482 >> v1:172.21.15.60:6789/0 conn(0x7fe0c00c8b10 legacy=0x7fe0c01534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:02.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.518+0000 7fe0be7fc640 1 -- 172.21.15.60:0/2685656482 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0c00c6c90 con 0x7fe0c015a4a0 2024-09-12T02:29:02.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.518+0000 7fe0be7fc640 1 -- 172.21.15.60:0/2685656482 <== mon.1 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7fe0b80019f0 con 0x7fe0c015a4a0 2024-09-12T02:29:02.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.518+0000 7fe0be7fc640 1 -- 172.21.15.60:0/2685656482 >> v1:172.21.15.105:6789/0 conn(0x7fe0c015a4a0 legacy=0x7fe0c0156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:02.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.518+0000 7fe0be7fc640 1 --2- 172.21.15.60:0/2685656482 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0a80039b0 0x7fe0a8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:02.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.518+0000 7fe0be7fc640 1 --2- 172.21.15.60:0/2685656482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0a8004800 0x7fe0a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:02.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.518+0000 7fe0be7fc640 1 --2- 172.21.15.60:0/2685656482 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0a80052e0 0x7fe0a800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:02.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.518+0000 7fe0be7fc640 1 -- 172.21.15.60:0/2685656482 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c00c69b0 con 0x7fe0a8004800 2024-09-12T02:29:02.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.518+0000 7fe0be7fc640 1 -- 172.21.15.60:0/2685656482 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a800c1b0 con 0x7fe0a80052e0 2024-09-12T02:29:02.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.518+0000 7fe0be7fc640 1 -- 172.21.15.60:0/2685656482 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe0a800c3b0 con 0x7fe0a80039b0 2024-09-12T02:29:02.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.518+0000 7fe0bf7fe640 1 --2- 172.21.15.60:0/2685656482 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0a80039b0 0x7fe0a8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:02.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.518+0000 7fe0bffff640 1 --2- 172.21.15.60:0/2685656482 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0a80052e0 0x7fe0a800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:02.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.518+0000 7fe0bf7fe640 1 -- 172.21.15.60:0/2685656482 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0a80052e0 msgr2=0x7fe0a800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:02.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.518+0000 7fe0bf7fe640 1 --2- 172.21.15.60:0/2685656482 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0a80052e0 0x7fe0a800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:02.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.518+0000 7fe0bf7fe640 1 -- 172.21.15.60:0/2685656482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0a8004800 msgr2=0x7fe0a8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:02.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.518+0000 7fe0bf7fe640 1 --2- 172.21.15.60:0/2685656482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0a8004800 0x7fe0a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:02.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.518+0000 7fe0bf7fe640 1 -- 172.21.15.60:0/2685656482 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0c00c6c90 con 0x7fe0a80039b0 2024-09-12T02:29:02.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.518+0000 7fe0bffff640 1 -- 172.21.15.60:0/2685656482 reap_dead start 2024-09-12T02:29:02.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.519+0000 7fe0bf7fe640 1 --2- 172.21.15.60:0/2685656482 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0a80039b0 0x7fe0a8003dd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0007fd0 tx=0x7fe0a8005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=318b562d1f60a620 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:02.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.519+0000 7fe0be7fc640 1 -- 172.21.15.60:0/2685656482 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b0001460 con 0x7fe0a80039b0 2024-09-12T02:29:02.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.520+0000 7fe0be7fc640 1 -- 172.21.15.60:0/2685656482 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0b002e070 con 0x7fe0a80039b0 2024-09-12T02:29:02.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.520+0000 7fe0be7fc640 1 -- 172.21.15.60:0/2685656482 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b002ad70 con 0x7fe0a80039b0 2024-09-12T02:29:02.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.520+0000 7fe0c5ed7640 1 -- 172.21.15.60:0/2685656482 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0a80039b0 msgr2=0x7fe0a8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:02.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.520+0000 7fe0c5ed7640 1 --2- 172.21.15.60:0/2685656482 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0a80039b0 0x7fe0a8003dd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0007fd0 tx=0x7fe0a8005830 comp rx=0 tx=0).stop 2024-09-12T02:29:02.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.520+0000 7fe0c5ed7640 1 -- 172.21.15.60:0/2685656482 shutdown_connections 2024-09-12T02:29:02.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.520+0000 7fe0c5ed7640 1 --2- 172.21.15.60:0/2685656482 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0a80039b0 0x7fe0a8003dd0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:02.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.520+0000 7fe0c5ed7640 1 -- 172.21.15.60:0/2685656482 >> 172.21.15.60:0/2685656482 conn(0x7fe0c00adb80 msgr2=0x7fe0c00adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:02.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.520+0000 7fe0c5ed7640 1 -- 172.21.15.60:0/2685656482 shutdown_connections 2024-09-12T02:29:02.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.521+0000 7fe0c5ed7640 1 -- 172.21.15.60:0/2685656482 wait complete. 2024-09-12T02:29:02.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.522+0000 7fe0c5ed7640 1 Processor -- start 2024-09-12T02:29:02.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.522+0000 7fe0c5ed7640 1 -- start start 2024-09-12T02:29:02.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.523+0000 7fe0c5ed7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0a80039b0 0x7fe0c014be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:02.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.523+0000 7fe0c5ed7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0c00b1730 0x7fe0c00ab9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:02.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.523+0000 7fe0c5ed7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0c00abf30 0x7fe0c01ef0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:02.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.523+0000 7fe0c5ed7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c00c9070 con 0x7fe0c00b1730 2024-09-12T02:29:02.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.523+0000 7fe0c5ed7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c00c8ef0 con 0x7fe0c00abf30 2024-09-12T02:29:02.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.523+0000 7fe0c5ed7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe0c01534d0 con 0x7fe0a80039b0 2024-09-12T02:29:02.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.523+0000 7fe0beffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0c00b1730 0x7fe0c00ab9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:02.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.523+0000 7fe0bf7fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0a80039b0 0x7fe0c014be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:02.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.523+0000 7fe0bf7fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0a80039b0 0x7fe0c014be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:49466/0 (socket says 172.21.15.60:49466) 2024-09-12T02:29:02.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.523+0000 7fe0bffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0c00abf30 0x7fe0c01ef0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:02.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.523+0000 7fe0beffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0c00b1730 0x7fe0c00ab9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59910/0 (socket says 172.21.15.60:59910) 2024-09-12T02:29:02.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.523+0000 7fe0bf7fe640 1 -- 172.21.15.60:0/2356975403 learned_addr learned my addr 172.21.15.60:0/2356975403 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:29:02.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.523+0000 7fe0bf7fe640 1 -- 172.21.15.60:0/2356975403 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0a80039b0 msgr2=0x7fe0c014be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-12T02:29:02.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.523+0000 7fe0bf7fe640 1 -- 172.21.15.60:0/2356975403 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0a80039b0 msgr2=0x7fe0c014be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:29:02.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.523+0000 7fe0bf7fe640 1 --2- 172.21.15.60:0/2356975403 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0a80039b0 0x7fe0c014be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:29:02.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.523+0000 7fe0bf7fe640 1 --2- 172.21.15.60:0/2356975403 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0a80039b0 0x7fe0c014be90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:29:02.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.524+0000 7fe0bffff640 1 -- 172.21.15.60:0/2356975403 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0a80039b0 msgr2=0x7fe0c014be90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:29:02.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.524+0000 7fe0bffff640 1 --2- 172.21.15.60:0/2356975403 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0a80039b0 0x7fe0c014be90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:02.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.524+0000 7fe0bffff640 1 -- 172.21.15.60:0/2356975403 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0c00b1730 msgr2=0x7fe0c00ab9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:02.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.524+0000 7fe0bffff640 1 --2- 172.21.15.60:0/2356975403 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0c00b1730 0x7fe0c00ab9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:02.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.524+0000 7fe0bffff640 1 -- 172.21.15.60:0/2356975403 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0c00ac3b0 con 0x7fe0c00abf30 2024-09-12T02:29:02.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.524+0000 7fe0beffd640 1 --2- 172.21.15.60:0/2356975403 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0c00b1730 0x7fe0c00ab9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:29:02.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.524+0000 7fe0bffff640 1 --2- 172.21.15.60:0/2356975403 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0c00abf30 0x7fe0c01ef0a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe0c00c6f70 tx=0x7fe0b800d520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:02.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.526+0000 7fe0a7fff640 1 -- 172.21.15.60:0/2356975403 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b8019070 con 0x7fe0c00abf30 2024-09-12T02:29:02.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.526+0000 7fe0a7fff640 1 -- 172.21.15.60:0/2356975403 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0b8006b50 con 0x7fe0c00abf30 2024-09-12T02:29:02.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.526+0000 7fe0c5ed7640 1 -- 172.21.15.60:0/2356975403 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0c00af1e0 con 0x7fe0c00abf30 2024-09-12T02:29:02.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.526+0000 7fe0a7fff640 1 -- 172.21.15.60:0/2356975403 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b800db80 con 0x7fe0c00abf30 2024-09-12T02:29:02.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.526+0000 7fe0c5ed7640 1 -- 172.21.15.60:0/2356975403 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0c00af7a0 con 0x7fe0c00abf30 2024-09-12T02:29:02.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.527+0000 7fe0c5ed7640 1 -- 172.21.15.60:0/2356975403 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0c004ffb0 con 0x7fe0c00abf30 2024-09-12T02:29:02.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.527+0000 7fe0a7fff640 1 -- 172.21.15.60:0/2356975403 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe0b8003970 con 0x7fe0c00abf30 2024-09-12T02:29:02.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.528+0000 7fe0a7fff640 1 --2- 172.21.15.60:0/2356975403 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe0ac06be30 0x7fe0ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:02.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.528+0000 7fe0a7fff640 1 -- 172.21.15.60:0/2356975403 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fe0b808a6f0 con 0x7fe0c00abf30 2024-09-12T02:29:02.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.528+0000 7fe0bf7fe640 1 --2- 172.21.15.60:0/2356975403 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe0ac06be30 0x7fe0ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:02.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.529+0000 7fe0bf7fe640 1 --2- 172.21.15.60:0/2356975403 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe0ac06be30 0x7fe0ac06e2f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe0b00016b0 tx=0x7fe0b0007000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:02.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.533+0000 7fe0a7fff640 1 -- 172.21.15.60:0/2356975403 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe0c004ffb0 con 0x7fe0c00abf30 2024-09-12T02:29:02.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.826+0000 7fe0c5ed7640 1 -- 172.21.15.60:0/2356975403 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe0c0153860 con 0x7fe0c00abf30 2024-09-12T02:29:02.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.827+0000 7fe0a7fff640 1 -- 172.21.15.60:0/2356975403 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7fe0b8058740 con 0x7fe0c00abf30 2024-09-12T02:29:02.827 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":48,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:29:02.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.829+0000 7fe0c5ed7640 1 -- 172.21.15.60:0/2356975403 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe0ac06be30 msgr2=0x7fe0ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:02.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.829+0000 7fe0c5ed7640 1 --2- 172.21.15.60:0/2356975403 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe0ac06be30 0x7fe0ac06e2f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe0b00016b0 tx=0x7fe0b0007000 comp rx=0 tx=0).stop 2024-09-12T02:29:02.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.829+0000 7fe0c5ed7640 1 -- 172.21.15.60:0/2356975403 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0c00abf30 msgr2=0x7fe0c01ef0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:02.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.829+0000 7fe0c5ed7640 1 --2- 172.21.15.60:0/2356975403 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0c00abf30 0x7fe0c01ef0a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe0c00c6f70 tx=0x7fe0b800d520 comp rx=0 tx=0).stop 2024-09-12T02:29:02.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.829+0000 7fe0c5ed7640 1 -- 172.21.15.60:0/2356975403 shutdown_connections 2024-09-12T02:29:02.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.829+0000 7fe0c5ed7640 1 --2- 172.21.15.60:0/2356975403 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe0ac06be30 0x7fe0ac06e2f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:02.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.829+0000 7fe0c5ed7640 1 --2- 172.21.15.60:0/2356975403 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0c00abf30 0x7fe0c01ef0a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:02.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.829+0000 7fe0c5ed7640 1 --2- 172.21.15.60:0/2356975403 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0c00b1730 0x7fe0c00ab9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:02.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.829+0000 7fe0c5ed7640 1 --2- 172.21.15.60:0/2356975403 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0a80039b0 0x7fe0c014be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:02.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.829+0000 7fe0c5ed7640 1 -- 172.21.15.60:0/2356975403 >> 172.21.15.60:0/2356975403 conn(0x7fe0c00adb80 msgr2=0x7fe0c00ca1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:02.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.829+0000 7fe0c5ed7640 1 -- 172.21.15.60:0/2356975403 shutdown_connections 2024-09-12T02:29:02.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:02.830+0000 7fe0c5ed7640 1 -- 172.21.15.60:0/2356975403 wait complete. 2024-09-12T02:29:05.845 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:29:05.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:05.972+0000 7f94dfe8d640 1 Processor -- start 2024-09-12T02:29:05.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:05.972+0000 7f94dfe8d640 1 -- start start 2024-09-12T02:29:05.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:05.973+0000 7f94dfe8d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94d8157620 0x7f94d8157a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:05.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:05.973+0000 7f94dfe8d640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94d8154030 con 0x7f94d80a80c0 2024-09-12T02:29:05.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:05.973+0000 7f94dfe8d640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94d81542f0 con 0x7f94d80aea30 2024-09-12T02:29:05.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:05.973+0000 7f94dfe8d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f94d80c41a0 con 0x7f94d8157620 2024-09-12T02:29:05.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:05.973+0000 7f94ddc29640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f94d80a80c0 0x7f94d80c3a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:38210/0 (socket says 172.21.15.60:38210) 2024-09-12T02:29:05.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:05.973+0000 7f94ddc29640 1 -- 172.21.15.60:0/2287623425 learned_addr learned my addr 172.21.15.60:0/2287623425 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:29:05.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:05.973+0000 7f94de42a640 1 --2- 172.21.15.60:0/2287623425 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94d8157620 0x7f94d8157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:05.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:05.974+0000 7f94de42a640 1 -- 172.21.15.60:0/2287623425 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94d8157620 msgr2=0x7f94d8157a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:29:05.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:05.974+0000 7f94de42a640 1 -- 172.21.15.60:0/2287623425 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94d8157620 msgr2=0x7f94d8157a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:29:05.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:05.974+0000 7f94de42a640 1 --2- 172.21.15.60:0/2287623425 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94d8157620 0x7f94d8157a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:29:05.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:05.974+0000 7f94de42a640 1 --2- 172.21.15.60:0/2287623425 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94d8157620 0x7f94d8157a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:29:06.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:06.175+0000 7f94de42a640 1 --2- 172.21.15.60:0/2287623425 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94d8157620 0x7f94d8157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:06.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:06.175+0000 7f94de42a640 1 -- 172.21.15.60:0/2287623425 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94d8157620 msgr2=0x7f94d8157a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:29:06.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:06.175+0000 7f94de42a640 1 -- 172.21.15.60:0/2287623425 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94d8157620 msgr2=0x7f94d8157a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:29:06.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:06.175+0000 7f94de42a640 1 --2- 172.21.15.60:0/2287623425 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94d8157620 0x7f94d8157a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:29:06.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:06.175+0000 7f94de42a640 1 --2- 172.21.15.60:0/2287623425 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94d8157620 0x7f94d8157a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:29:06.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:06.576+0000 7f94de42a640 1 --2- 172.21.15.60:0/2287623425 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94d8157620 0x7f94d8157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:06.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:06.576+0000 7f94de42a640 1 -- 172.21.15.60:0/2287623425 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94d8157620 msgr2=0x7f94d8157a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:29:06.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:06.576+0000 7f94de42a640 1 -- 172.21.15.60:0/2287623425 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94d8157620 msgr2=0x7f94d8157a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:29:06.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:06.576+0000 7f94de42a640 1 --2- 172.21.15.60:0/2287623425 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94d8157620 0x7f94d8157a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:29:06.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:06.576+0000 7f94de42a640 1 --2- 172.21.15.60:0/2287623425 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94d8157620 0x7f94d8157a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:29:07.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:07.377+0000 7f94de42a640 1 --2- 172.21.15.60:0/2287623425 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94d8157620 0x7f94d8157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:07.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:07.377+0000 7f94de42a640 1 -- 172.21.15.60:0/2287623425 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94d8157620 msgr2=0x7f94d8157a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:29:07.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:07.377+0000 7f94de42a640 1 -- 172.21.15.60:0/2287623425 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94d8157620 msgr2=0x7f94d8157a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:29:07.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:07.377+0000 7f94de42a640 1 --2- 172.21.15.60:0/2287623425 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94d8157620 0x7f94d8157a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:29:07.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:07.377+0000 7f94de42a640 1 --2- 172.21.15.60:0/2287623425 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94d8157620 0x7f94d8157a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:29:08.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.516+0000 7f94dcc27640 1 -- 172.21.15.60:0/2287623425 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3233912276 0 0) 0x7f94d81542f0 con 0x7f94d80aea30 2024-09-12T02:29:08.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.516+0000 7f94dcc27640 1 -- 172.21.15.60:0/2287623425 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94c4003520 con 0x7f94d80aea30 2024-09-12T02:29:08.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.516+0000 7f94dcc27640 1 -- 172.21.15.60:0/2287623425 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3762638766 0 0) 0x7f94c4003520 con 0x7f94d80aea30 2024-09-12T02:29:08.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.516+0000 7f94dcc27640 1 -- 172.21.15.60:0/2287623425 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94d8157620 msgr2=0x7f94d8157a70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:29:08.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.517+0000 7f94dcc27640 1 --2- 172.21.15.60:0/2287623425 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94d8157620 0x7f94d8157a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:08.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.517+0000 7f94dcc27640 1 -- 172.21.15.60:0/2287623425 >> v1:172.21.15.60:6789/0 conn(0x7f94d80a80c0 legacy=0x7f94d80c3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:08.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.517+0000 7f94dcc27640 1 -- 172.21.15.60:0/2287623425 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94d81545d0 con 0x7f94d80aea30 2024-09-12T02:29:08.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.517+0000 7f94dcc27640 1 -- 172.21.15.60:0/2287623425 <== mon.1 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7f94c8001670 con 0x7f94d80aea30 2024-09-12T02:29:08.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.517+0000 7f94dcc27640 1 -- 172.21.15.60:0/2287623425 >> v1:172.21.15.105:6789/0 conn(0x7f94d80aea30 legacy=0x7f94d8073dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:08.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.517+0000 7f94dcc27640 1 --2- 172.21.15.60:0/2287623425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94c40039b0 0x7f94c4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:08.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.517+0000 7f94dcc27640 1 --2- 172.21.15.60:0/2287623425 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94c4004800 0x7f94c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:08.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.517+0000 7f94dcc27640 1 --2- 172.21.15.60:0/2287623425 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94d8157620 0x7f94c400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:08.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.517+0000 7f94dcc27640 1 -- 172.21.15.60:0/2287623425 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f94d80c41a0 con 0x7f94c40039b0 2024-09-12T02:29:08.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.517+0000 7f94dcc27640 1 -- 172.21.15.60:0/2287623425 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f94c4005550 con 0x7f94c4004800 2024-09-12T02:29:08.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.517+0000 7f94dcc27640 1 -- 172.21.15.60:0/2287623425 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f94c400bf00 con 0x7f94d8157620 2024-09-12T02:29:08.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.517+0000 7f94dd428640 1 --2- 172.21.15.60:0/2287623425 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94c4004800 0x7f94c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:08.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.517+0000 7f94de42a640 1 --2- 172.21.15.60:0/2287623425 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94d8157620 0x7f94c400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:08.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.517+0000 7f94dd428640 1 -- 172.21.15.60:0/2287623425 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94d8157620 msgr2=0x7f94c400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:08.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.517+0000 7f94dd428640 1 --2- 172.21.15.60:0/2287623425 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94d8157620 0x7f94c400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:08.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.517+0000 7f94dd428640 1 -- 172.21.15.60:0/2287623425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94c40039b0 msgr2=0x7f94c4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:08.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.517+0000 7f94dd428640 1 --2- 172.21.15.60:0/2287623425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94c40039b0 0x7f94c4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:08.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.517+0000 7f94dd428640 1 -- 172.21.15.60:0/2287623425 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94c4003520 con 0x7f94c4004800 2024-09-12T02:29:08.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.518+0000 7f94dd428640 1 --2- 172.21.15.60:0/2287623425 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94c4004800 0x7f94c4004c80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f94c8007f30 tx=0x7f94c4005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34cfb4eb0d9f4666 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:08.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.519+0000 7f94dcc27640 1 -- 172.21.15.60:0/2287623425 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c8036070 con 0x7f94c4004800 2024-09-12T02:29:08.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.519+0000 7f94dcc27640 1 -- 172.21.15.60:0/2287623425 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94c8031620 con 0x7f94c4004800 2024-09-12T02:29:08.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.519+0000 7f94dcc27640 1 -- 172.21.15.60:0/2287623425 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c8007b50 con 0x7f94c4004800 2024-09-12T02:29:08.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.519+0000 7f94dfe8d640 1 -- 172.21.15.60:0/2287623425 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94c4004800 msgr2=0x7f94c4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:08.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.519+0000 7f94dfe8d640 1 --2- 172.21.15.60:0/2287623425 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94c4004800 0x7f94c4004c80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f94c8007f30 tx=0x7f94c4005830 comp rx=0 tx=0).stop 2024-09-12T02:29:08.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.520+0000 7f94de42a640 1 -- 172.21.15.60:0/2287623425 reap_dead start 2024-09-12T02:29:08.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.520+0000 7f94dfe8d640 1 -- 172.21.15.60:0/2287623425 shutdown_connections 2024-09-12T02:29:08.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.520+0000 7f94dfe8d640 1 -- 172.21.15.60:0/2287623425 >> 172.21.15.60:0/2287623425 conn(0x7f94d80c5680 msgr2=0x7f94d80c5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:08.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.520+0000 7f94dfe8d640 1 -- 172.21.15.60:0/2287623425 shutdown_connections 2024-09-12T02:29:08.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.520+0000 7f94dfe8d640 1 -- 172.21.15.60:0/2287623425 wait complete. 2024-09-12T02:29:08.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.521+0000 7f94dfe8d640 1 Processor -- start 2024-09-12T02:29:08.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.521+0000 7f94dfe8d640 1 -- start start 2024-09-12T02:29:08.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.522+0000 7f94dfe8d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94c4004800 0x7f94d80a9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:08.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.522+0000 7f94dfe8d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94d80739d0 0x7f94d81568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:08.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.522+0000 7f94dfe8d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94d81ec060 0x7f94d814ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:08.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.522+0000 7f94dfe8d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f94d80a84a0 con 0x7f94d80739d0 2024-09-12T02:29:08.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.522+0000 7f94dfe8d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f94d8154b90 con 0x7f94c4004800 2024-09-12T02:29:08.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.522+0000 7f94dfe8d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f94d80a8620 con 0x7f94d81ec060 2024-09-12T02:29:08.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.522+0000 7f94dd428640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94d80739d0 0x7f94d81568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:08.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.523+0000 7f94ddc29640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94c4004800 0x7f94d80a9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:08.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.523+0000 7f94dd428640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94d80739d0 0x7f94d81568d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59922/0 (socket says 172.21.15.60:59922) 2024-09-12T02:29:08.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.523+0000 7f94dd428640 1 -- 172.21.15.60:0/3284696333 learned_addr learned my addr 172.21.15.60:0/3284696333 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:29:08.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.523+0000 7f94de42a640 1 --2- 172.21.15.60:0/3284696333 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94d81ec060 0x7f94d814ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:08.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.523+0000 7f94de42a640 1 -- 172.21.15.60:0/3284696333 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94d81ec060 msgr2=0x7f94d814ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-12T02:29:08.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.523+0000 7f94de42a640 1 -- 172.21.15.60:0/3284696333 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94d81ec060 msgr2=0x7f94d814ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:29:08.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.523+0000 7f94de42a640 1 --2- 172.21.15.60:0/3284696333 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94d81ec060 0x7f94d814ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:29:08.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.523+0000 7f94de42a640 1 --2- 172.21.15.60:0/3284696333 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94d81ec060 0x7f94d814ae50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:29:08.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.523+0000 7f94dd428640 1 -- 172.21.15.60:0/3284696333 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94d81ec060 msgr2=0x7f94d814ae50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:29:08.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.523+0000 7f94dd428640 1 --2- 172.21.15.60:0/3284696333 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94d81ec060 0x7f94d814ae50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:08.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.523+0000 7f94dd428640 1 -- 172.21.15.60:0/3284696333 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94c4004800 msgr2=0x7f94d80a9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:08.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.523+0000 7f94dd428640 1 --2- 172.21.15.60:0/3284696333 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94c4004800 0x7f94d80a9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:08.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.523+0000 7f94dd428640 1 -- 172.21.15.60:0/3284696333 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94d8071bb0 con 0x7f94d80739d0 2024-09-12T02:29:08.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.523+0000 7f94dd428640 1 --2- 172.21.15.60:0/3284696333 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94d80739d0 0x7f94d81568d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f94c800c1d0 tx=0x7f94d81547a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:08.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.524+0000 7f94ce7fc640 1 -- 172.21.15.60:0/3284696333 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c8041020 con 0x7f94d80739d0 2024-09-12T02:29:08.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.524+0000 7f94dfe8d640 1 -- 172.21.15.60:0/3284696333 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94d80c2480 con 0x7f94d80739d0 2024-09-12T02:29:08.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.524+0000 7f94dfe8d640 1 -- 172.21.15.60:0/3284696333 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94d80c2a40 con 0x7f94d80739d0 2024-09-12T02:29:08.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.524+0000 7f94ce7fc640 1 -- 172.21.15.60:0/3284696333 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94c8037040 con 0x7f94d80739d0 2024-09-12T02:29:08.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.524+0000 7f94ce7fc640 1 -- 172.21.15.60:0/3284696333 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c8036070 con 0x7f94d80739d0 2024-09-12T02:29:08.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.525+0000 7f94dfe8d640 1 -- 172.21.15.60:0/3284696333 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94c0005290 con 0x7f94d80739d0 2024-09-12T02:29:08.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.526+0000 7f94ce7fc640 1 -- 172.21.15.60:0/3284696333 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f94c8044020 con 0x7f94d80739d0 2024-09-12T02:29:08.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.526+0000 7f94ce7fc640 1 --2- 172.21.15.60:0/3284696333 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f94bc06be60 0x7f94bc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:08.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.526+0000 7f94ce7fc640 1 -- 172.21.15.60:0/3284696333 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f94c80ab270 con 0x7f94d80739d0 2024-09-12T02:29:08.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.527+0000 7f94ddc29640 1 --2- 172.21.15.60:0/3284696333 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f94bc06be60 0x7f94bc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:08.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.527+0000 7f94ddc29640 1 --2- 172.21.15.60:0/3284696333 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f94bc06be60 0x7f94bc06e320 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f94d4005880 tx=0x7f94d4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:08.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.532+0000 7f94ce7fc640 1 -- 172.21.15.60:0/3284696333 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f94c804b070 con 0x7f94d80739d0 2024-09-12T02:29:08.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.828+0000 7f94dfe8d640 1 -- 172.21.15.60:0/3284696333 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f94c0005850 con 0x7f94d80739d0 2024-09-12T02:29:08.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.828+0000 7f94ce7fc640 1 -- 172.21.15.60:0/3284696333 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7f94c8079240 con 0x7f94d80739d0 2024-09-12T02:29:08.830 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":52,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:29:08.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.831+0000 7f94dfe8d640 1 -- 172.21.15.60:0/3284696333 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f94bc06be60 msgr2=0x7f94bc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:08.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.831+0000 7f94dfe8d640 1 --2- 172.21.15.60:0/3284696333 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f94bc06be60 0x7f94bc06e320 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f94d4005880 tx=0x7f94d4009040 comp rx=0 tx=0).stop 2024-09-12T02:29:08.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.831+0000 7f94dfe8d640 1 -- 172.21.15.60:0/3284696333 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94d80739d0 msgr2=0x7f94d81568d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:08.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.831+0000 7f94dfe8d640 1 --2- 172.21.15.60:0/3284696333 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94d80739d0 0x7f94d81568d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f94c800c1d0 tx=0x7f94d81547a0 comp rx=0 tx=0).stop 2024-09-12T02:29:08.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.831+0000 7f94dfe8d640 1 -- 172.21.15.60:0/3284696333 shutdown_connections 2024-09-12T02:29:08.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.831+0000 7f94dfe8d640 1 --2- 172.21.15.60:0/3284696333 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f94bc06be60 0x7f94bc06e320 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:08.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.831+0000 7f94dfe8d640 1 --2- 172.21.15.60:0/3284696333 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94d81ec060 0x7f94d814ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:08.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.831+0000 7f94dfe8d640 1 --2- 172.21.15.60:0/3284696333 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94d80739d0 0x7f94d81568d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:08.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.831+0000 7f94dfe8d640 1 --2- 172.21.15.60:0/3284696333 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94c4004800 0x7f94d80a9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:08.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.831+0000 7f94dfe8d640 1 -- 172.21.15.60:0/3284696333 >> 172.21.15.60:0/3284696333 conn(0x7f94d80c5680 msgr2=0x7f94d80c48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:08.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.831+0000 7f94dfe8d640 1 -- 172.21.15.60:0/3284696333 shutdown_connections 2024-09-12T02:29:08.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:08.831+0000 7f94dfe8d640 1 -- 172.21.15.60:0/3284696333 wait complete. 2024-09-12T02:29:11.845 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:29:11.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:11.956+0000 7f930d8a6640 1 Processor -- start 2024-09-12T02:29:11.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:11.956+0000 7f930d8a6640 1 -- start start 2024-09-12T02:29:11.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:11.956+0000 7f930d8a6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f93080c2d30 0x7f9308153730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:11.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:11.956+0000 7f930d8a6640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f93080c3210 0x7f9308160b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:11.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:11.957+0000 7f930d8a6640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9308068010 con 0x7f93080c5030 2024-09-12T02:29:11.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:11.957+0000 7f930d8a6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f9308067ae0 con 0x7f93080c2d30 2024-09-12T02:29:11.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:11.957+0000 7f930d8a6640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f9308074890 con 0x7f93080c3210 2024-09-12T02:29:11.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:11.957+0000 7f93067fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f93080c2d30 0x7f9308153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:11.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:11.957+0000 7f93067fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f93080c2d30 0x7f9308153730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51166/0 (socket says 172.21.15.60:51166) 2024-09-12T02:29:11.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:11.957+0000 7f93067fc640 1 -- 172.21.15.60:0/1910044328 learned_addr learned my addr 172.21.15.60:0/1910044328 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:29:11.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:11.957+0000 7f93077fe640 1 --2- 172.21.15.60:0/1910044328 >> v2:172.21.15.105:3300/0 conn(0x7f93080c3210 0x7f9308160b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:11.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:11.957+0000 7f93067fc640 1 -- 172.21.15.60:0/1910044328 >> v2:172.21.15.60:3300/0 conn(0x7f93080c2d30 msgr2=0x7f9308153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:29:11.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:11.957+0000 7f93067fc640 1 -- 172.21.15.60:0/1910044328 >> v2:172.21.15.60:3300/0 conn(0x7f93080c2d30 msgr2=0x7f9308153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:29:11.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:11.957+0000 7f93067fc640 1 --2- 172.21.15.60:0/1910044328 >> v2:172.21.15.60:3300/0 conn(0x7f93080c2d30 0x7f9308153730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:29:11.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:11.957+0000 7f93067fc640 1 --2- 172.21.15.60:0/1910044328 >> v2:172.21.15.60:3300/0 conn(0x7f93080c2d30 0x7f9308153730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:29:11.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:11.957+0000 7f93077fe640 1 -- 172.21.15.60:0/1910044328 >> v2:172.21.15.105:3300/0 conn(0x7f93080c3210 msgr2=0x7f9308160b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:29:11.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:11.957+0000 7f93077fe640 1 -- 172.21.15.60:0/1910044328 >> v2:172.21.15.105:3300/0 conn(0x7f93080c3210 msgr2=0x7f9308160b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:29:11.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:11.957+0000 7f93077fe640 1 --2- 172.21.15.60:0/1910044328 >> v2:172.21.15.105:3300/0 conn(0x7f93080c3210 0x7f9308160b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:29:11.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:11.957+0000 7f93077fe640 1 --2- 172.21.15.60:0/1910044328 >> v2:172.21.15.105:3300/0 conn(0x7f93080c3210 0x7f9308160b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:29:12.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:12.158+0000 7f93067fc640 1 --2- 172.21.15.60:0/1910044328 >> v2:172.21.15.60:3300/0 conn(0x7f93080c2d30 0x7f9308153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:12.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:12.158+0000 7f93077fe640 1 --2- 172.21.15.60:0/1910044328 >> v2:172.21.15.105:3300/0 conn(0x7f93080c3210 0x7f9308160b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:12.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:12.158+0000 7f93067fc640 1 -- 172.21.15.60:0/1910044328 >> v2:172.21.15.60:3300/0 conn(0x7f93080c2d30 msgr2=0x7f9308153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:29:12.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:12.158+0000 7f93067fc640 1 -- 172.21.15.60:0/1910044328 >> v2:172.21.15.60:3300/0 conn(0x7f93080c2d30 msgr2=0x7f9308153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:29:12.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:12.158+0000 7f93067fc640 1 --2- 172.21.15.60:0/1910044328 >> v2:172.21.15.60:3300/0 conn(0x7f93080c2d30 0x7f9308153730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:29:12.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:12.158+0000 7f93077fe640 1 -- 172.21.15.60:0/1910044328 >> v2:172.21.15.105:3300/0 conn(0x7f93080c3210 msgr2=0x7f9308160b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:29:12.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:12.158+0000 7f93077fe640 1 -- 172.21.15.60:0/1910044328 >> v2:172.21.15.105:3300/0 conn(0x7f93080c3210 msgr2=0x7f9308160b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:29:12.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:12.158+0000 7f93077fe640 1 --2- 172.21.15.60:0/1910044328 >> v2:172.21.15.105:3300/0 conn(0x7f93080c3210 0x7f9308160b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:29:12.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:12.158+0000 7f93077fe640 1 --2- 172.21.15.60:0/1910044328 >> v2:172.21.15.105:3300/0 conn(0x7f93080c3210 0x7f9308160b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:29:12.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:12.158+0000 7f93067fc640 1 --2- 172.21.15.60:0/1910044328 >> v2:172.21.15.60:3300/0 conn(0x7f93080c2d30 0x7f9308153730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:29:12.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:12.559+0000 7f93067fc640 1 --2- 172.21.15.60:0/1910044328 >> v2:172.21.15.60:3300/0 conn(0x7f93080c2d30 0x7f9308153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:12.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:12.559+0000 7f93077fe640 1 --2- 172.21.15.60:0/1910044328 >> v2:172.21.15.105:3300/0 conn(0x7f93080c3210 0x7f9308160b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:12.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:12.559+0000 7f93067fc640 1 -- 172.21.15.60:0/1910044328 >> v2:172.21.15.60:3300/0 conn(0x7f93080c2d30 msgr2=0x7f9308153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:29:12.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:12.559+0000 7f93067fc640 1 -- 172.21.15.60:0/1910044328 >> v2:172.21.15.60:3300/0 conn(0x7f93080c2d30 msgr2=0x7f9308153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:29:12.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:12.559+0000 7f93067fc640 1 --2- 172.21.15.60:0/1910044328 >> v2:172.21.15.60:3300/0 conn(0x7f93080c2d30 0x7f9308153730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:29:12.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:12.559+0000 7f93067fc640 1 --2- 172.21.15.60:0/1910044328 >> v2:172.21.15.60:3300/0 conn(0x7f93080c2d30 0x7f9308153730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:29:12.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:12.559+0000 7f93077fe640 1 -- 172.21.15.60:0/1910044328 >> v2:172.21.15.105:3300/0 conn(0x7f93080c3210 msgr2=0x7f9308160b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:29:12.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:12.559+0000 7f93077fe640 1 -- 172.21.15.60:0/1910044328 >> v2:172.21.15.105:3300/0 conn(0x7f93080c3210 msgr2=0x7f9308160b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:29:12.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:12.559+0000 7f93077fe640 1 --2- 172.21.15.60:0/1910044328 >> v2:172.21.15.105:3300/0 conn(0x7f93080c3210 0x7f9308160b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:29:12.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:12.559+0000 7f93077fe640 1 --2- 172.21.15.60:0/1910044328 >> v2:172.21.15.105:3300/0 conn(0x7f93080c3210 0x7f9308160b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:29:13.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:13.361+0000 7f93067fc640 1 --2- 172.21.15.60:0/1910044328 >> v2:172.21.15.60:3300/0 conn(0x7f93080c2d30 0x7f9308153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:13.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:13.361+0000 7f93077fe640 1 --2- 172.21.15.60:0/1910044328 >> v2:172.21.15.105:3300/0 conn(0x7f93080c3210 0x7f9308160b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:13.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:13.361+0000 7f93067fc640 1 -- 172.21.15.60:0/1910044328 >> v2:172.21.15.60:3300/0 conn(0x7f93080c2d30 msgr2=0x7f9308153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:29:13.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:13.361+0000 7f93067fc640 1 -- 172.21.15.60:0/1910044328 >> v2:172.21.15.60:3300/0 conn(0x7f93080c2d30 msgr2=0x7f9308153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:29:13.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:13.361+0000 7f93067fc640 1 --2- 172.21.15.60:0/1910044328 >> v2:172.21.15.60:3300/0 conn(0x7f93080c2d30 0x7f9308153730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:29:13.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:13.361+0000 7f93067fc640 1 --2- 172.21.15.60:0/1910044328 >> v2:172.21.15.60:3300/0 conn(0x7f93080c2d30 0x7f9308153730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:29:13.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:13.361+0000 7f93077fe640 1 -- 172.21.15.60:0/1910044328 >> v2:172.21.15.105:3300/0 conn(0x7f93080c3210 msgr2=0x7f9308160b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:29:13.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:13.361+0000 7f93077fe640 1 -- 172.21.15.60:0/1910044328 >> v2:172.21.15.105:3300/0 conn(0x7f93080c3210 msgr2=0x7f9308160b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:29:13.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:13.361+0000 7f93077fe640 1 --2- 172.21.15.60:0/1910044328 >> v2:172.21.15.105:3300/0 conn(0x7f93080c3210 0x7f9308160b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:29:13.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:13.361+0000 7f93077fe640 1 --2- 172.21.15.60:0/1910044328 >> v2:172.21.15.105:3300/0 conn(0x7f93080c3210 0x7f9308160b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:29:14.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.519+0000 7f9305ffb640 1 -- 172.21.15.60:0/1910044328 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1082647308 0 0) 0x7f9308068010 con 0x7f93080c5030 2024-09-12T02:29:14.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.519+0000 7f9305ffb640 1 -- 172.21.15.60:0/1910044328 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92f0003520 con 0x7f93080c5030 2024-09-12T02:29:14.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.519+0000 7f9305ffb640 1 -- 172.21.15.60:0/1910044328 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1284795349 0 0) 0x7f92f0003520 con 0x7f93080c5030 2024-09-12T02:29:14.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.519+0000 7f9305ffb640 1 -- 172.21.15.60:0/1910044328 >> v2:172.21.15.105:3300/0 conn(0x7f93080c3210 msgr2=0x7f9308160b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:29:14.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.519+0000 7f9305ffb640 1 --2- 172.21.15.60:0/1910044328 >> v2:172.21.15.105:3300/0 conn(0x7f93080c3210 0x7f9308160b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:14.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.519+0000 7f9305ffb640 1 -- 172.21.15.60:0/1910044328 >> v2:172.21.15.60:3300/0 conn(0x7f93080c2d30 msgr2=0x7f9308153730 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:29:14.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.519+0000 7f9305ffb640 1 --2- 172.21.15.60:0/1910044328 >> v2:172.21.15.60:3300/0 conn(0x7f93080c2d30 0x7f9308153730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:14.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.519+0000 7f9305ffb640 1 -- 172.21.15.60:0/1910044328 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9308067d30 con 0x7f93080c5030 2024-09-12T02:29:14.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.519+0000 7f9305ffb640 1 -- 172.21.15.60:0/1910044328 <== mon.1 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7f92f8001670 con 0x7f93080c5030 2024-09-12T02:29:14.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.519+0000 7f9305ffb640 1 -- 172.21.15.60:0/1910044328 >> v1:172.21.15.105:6789/0 conn(0x7f93080c5030 legacy=0x7f930806e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:14.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.519+0000 7f9305ffb640 1 --2- 172.21.15.60:0/1910044328 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92f0003a00 0x7f92f0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:14.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.519+0000 7f9305ffb640 1 --2- 172.21.15.60:0/1910044328 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f92f0004800 0x7f92f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:14.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.519+0000 7f9305ffb640 1 --2- 172.21.15.60:0/1910044328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92f0005210 0x7f92f000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:14.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.519+0000 7f9305ffb640 1 -- 172.21.15.60:0/1910044328 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9308067ae0 con 0x7f92f0005210 2024-09-12T02:29:14.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.519+0000 7f9305ffb640 1 -- 172.21.15.60:0/1910044328 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9308074890 con 0x7f92f0003a00 2024-09-12T02:29:14.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.519+0000 7f9305ffb640 1 -- 172.21.15.60:0/1910044328 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f92f000c1c0 con 0x7f92f0004800 2024-09-12T02:29:14.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.520+0000 7f9306ffd640 1 --2- 172.21.15.60:0/1910044328 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92f0003a00 0x7f92f0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:14.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.520+0000 7f93067fc640 1 --2- 172.21.15.60:0/1910044328 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f92f0004800 0x7f92f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:14.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.520+0000 7f9306ffd640 1 -- 172.21.15.60:0/1910044328 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f92f0004800 msgr2=0x7f92f0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:14.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.520+0000 7f9306ffd640 1 --2- 172.21.15.60:0/1910044328 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f92f0004800 0x7f92f0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:14.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.520+0000 7f9306ffd640 1 -- 172.21.15.60:0/1910044328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92f0005210 msgr2=0x7f92f000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:14.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.520+0000 7f9306ffd640 1 --2- 172.21.15.60:0/1910044328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92f0005210 0x7f92f000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:14.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.520+0000 7f9306ffd640 1 -- 172.21.15.60:0/1910044328 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92f0003520 con 0x7f92f0003a00 2024-09-12T02:29:14.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.520+0000 7f93077fe640 1 -- 172.21.15.60:0/1910044328 reap_dead start 2024-09-12T02:29:14.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.521+0000 7f9306ffd640 1 --2- 172.21.15.60:0/1910044328 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92f0003a00 0x7f92f0003e20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f92f8007f70 tx=0x7f92f0005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fec5569ea0623e6e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:14.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.521+0000 7f9305ffb640 1 -- 172.21.15.60:0/1910044328 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f8036070 con 0x7f92f0003a00 2024-09-12T02:29:14.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.521+0000 7f9305ffb640 1 -- 172.21.15.60:0/1910044328 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92f8031620 con 0x7f92f0003a00 2024-09-12T02:29:14.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.521+0000 7f9305ffb640 1 -- 172.21.15.60:0/1910044328 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f8007b90 con 0x7f92f0003a00 2024-09-12T02:29:14.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.522+0000 7f930d8a6640 1 -- 172.21.15.60:0/1910044328 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92f0003a00 msgr2=0x7f92f0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:14.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.522+0000 7f930d8a6640 1 --2- 172.21.15.60:0/1910044328 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92f0003a00 0x7f92f0003e20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f92f8007f70 tx=0x7f92f0005830 comp rx=0 tx=0).stop 2024-09-12T02:29:14.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.523+0000 7f930d8a6640 1 -- 172.21.15.60:0/1910044328 shutdown_connections 2024-09-12T02:29:14.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.523+0000 7f930d8a6640 1 --2- 172.21.15.60:0/1910044328 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92f0003a00 0x7f92f0003e20 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:14.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.523+0000 7f930d8a6640 1 -- 172.21.15.60:0/1910044328 >> 172.21.15.60:0/1910044328 conn(0x7f930806bbe0 msgr2=0x7f930806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:14.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.523+0000 7f930d8a6640 1 -- 172.21.15.60:0/1910044328 shutdown_connections 2024-09-12T02:29:14.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.523+0000 7f930d8a6640 1 -- 172.21.15.60:0/1910044328 wait complete. 2024-09-12T02:29:14.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.524+0000 7f930d8a6640 1 Processor -- start 2024-09-12T02:29:14.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.525+0000 7f930d8a6640 1 -- start start 2024-09-12T02:29:14.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.526+0000 7f930d8a6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92f0003a00 0x7f93081e1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:14.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.526+0000 7f930d8a6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93081ed170 0x7f93081ed5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:14.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.526+0000 7f930d8a6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93081edb30 0x7f9308073420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:14.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.526+0000 7f930d8a6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9308156a20 con 0x7f93081ed170 2024-09-12T02:29:14.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.526+0000 7f930d8a6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9308156740 con 0x7f92f0003a00 2024-09-12T02:29:14.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.526+0000 7f930d8a6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f93080c5410 con 0x7f93081edb30 2024-09-12T02:29:14.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.526+0000 7f9306ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92f0003a00 0x7f93081e1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:14.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.526+0000 7f9306ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92f0003a00 0x7f93081e1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:53200/0 (socket says 172.21.15.60:53200) 2024-09-12T02:29:14.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.526+0000 7f9306ffd640 1 -- 172.21.15.60:0/2811448031 learned_addr learned my addr 172.21.15.60:0/2811448031 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:29:14.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.526+0000 7f93067fc640 1 --2- 172.21.15.60:0/2811448031 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93081ed170 0x7f93081ed5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:14.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.526+0000 7f93077fe640 1 --2- 172.21.15.60:0/2811448031 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93081edb30 0x7f9308073420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:14.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.526+0000 7f93077fe640 1 -- 172.21.15.60:0/2811448031 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93081edb30 msgr2=0x7f9308073420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-12T02:29:14.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.526+0000 7f93077fe640 1 -- 172.21.15.60:0/2811448031 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93081edb30 msgr2=0x7f9308073420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:29:14.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.526+0000 7f93077fe640 1 --2- 172.21.15.60:0/2811448031 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93081edb30 0x7f9308073420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:29:14.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.526+0000 7f93077fe640 1 --2- 172.21.15.60:0/2811448031 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93081edb30 0x7f9308073420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:29:14.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.526+0000 7f9306ffd640 1 -- 172.21.15.60:0/2811448031 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93081edb30 msgr2=0x7f9308073420 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:29:14.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.526+0000 7f9306ffd640 1 --2- 172.21.15.60:0/2811448031 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93081edb30 0x7f9308073420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:14.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.526+0000 7f9306ffd640 1 -- 172.21.15.60:0/2811448031 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93081ed170 msgr2=0x7f93081ed5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:14.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.526+0000 7f9306ffd640 1 --2- 172.21.15.60:0/2811448031 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93081ed170 0x7f93081ed5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:14.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.526+0000 7f9306ffd640 1 -- 172.21.15.60:0/2811448031 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93081efb70 con 0x7f92f0003a00 2024-09-12T02:29:14.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.527+0000 7f9306ffd640 1 --2- 172.21.15.60:0/2811448031 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92f0003a00 0x7f93081e1ae0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f92f800c1d0 tx=0x7f9308067f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:14.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.527+0000 7f92effff640 1 -- 172.21.15.60:0/2811448031 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f8041020 con 0x7f92f0003a00 2024-09-12T02:29:14.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.527+0000 7f92effff640 1 -- 172.21.15.60:0/2811448031 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92f80319d0 con 0x7f92f0003a00 2024-09-12T02:29:14.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.527+0000 7f930d8a6640 1 -- 172.21.15.60:0/2811448031 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93081e2630 con 0x7f92f0003a00 2024-09-12T02:29:14.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.527+0000 7f92effff640 1 -- 172.21.15.60:0/2811448031 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f8036040 con 0x7f92f0003a00 2024-09-12T02:29:14.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.527+0000 7f930d8a6640 1 -- 172.21.15.60:0/2811448031 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9308157440 con 0x7f92f0003a00 2024-09-12T02:29:14.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.528+0000 7f930d8a6640 1 -- 172.21.15.60:0/2811448031 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9308156f40 con 0x7f92f0003a00 2024-09-12T02:29:14.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.528+0000 7f92effff640 1 -- 172.21.15.60:0/2811448031 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f92f8044020 con 0x7f92f0003a00 2024-09-12T02:29:14.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.529+0000 7f92effff640 1 --2- 172.21.15.60:0/2811448031 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f92f406be60 0x7f92f406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:14.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.529+0000 7f92effff640 1 -- 172.21.15.60:0/2811448031 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f92f80ab790 con 0x7f92f0003a00 2024-09-12T02:29:14.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.529+0000 7f93067fc640 1 --2- 172.21.15.60:0/2811448031 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f92f406be60 0x7f92f406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:14.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.530+0000 7f93067fc640 1 --2- 172.21.15.60:0/2811448031 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f92f406be60 0x7f92f406e320 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f93081f00f0 tx=0x7f92fc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:14.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.534+0000 7f92effff640 1 -- 172.21.15.60:0/2811448031 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f92f804b030 con 0x7f92f0003a00 2024-09-12T02:29:14.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.792+0000 7f930d8a6640 1 -- 172.21.15.60:0/2811448031 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f930806ed90 con 0x7f92f0003a00 2024-09-12T02:29:14.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.793+0000 7f92effff640 1 -- 172.21.15.60:0/2811448031 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7f92f8079860 con 0x7f92f0003a00 2024-09-12T02:29:14.795 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":56,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:29:14.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.795+0000 7f930d8a6640 1 -- 172.21.15.60:0/2811448031 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f92f406be60 msgr2=0x7f92f406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:14.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.795+0000 7f930d8a6640 1 --2- 172.21.15.60:0/2811448031 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f92f406be60 0x7f92f406e320 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f93081f00f0 tx=0x7f92fc008040 comp rx=0 tx=0).stop 2024-09-12T02:29:14.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.795+0000 7f930d8a6640 1 -- 172.21.15.60:0/2811448031 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92f0003a00 msgr2=0x7f93081e1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:14.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.795+0000 7f930d8a6640 1 --2- 172.21.15.60:0/2811448031 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92f0003a00 0x7f93081e1ae0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f92f800c1d0 tx=0x7f9308067f00 comp rx=0 tx=0).stop 2024-09-12T02:29:14.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.796+0000 7f930d8a6640 1 -- 172.21.15.60:0/2811448031 shutdown_connections 2024-09-12T02:29:14.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.796+0000 7f930d8a6640 1 --2- 172.21.15.60:0/2811448031 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f92f406be60 0x7f92f406e320 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:14.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.796+0000 7f930d8a6640 1 --2- 172.21.15.60:0/2811448031 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93081edb30 0x7f9308073420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:14.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.796+0000 7f930d8a6640 1 --2- 172.21.15.60:0/2811448031 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93081ed170 0x7f93081ed5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:14.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.796+0000 7f930d8a6640 1 --2- 172.21.15.60:0/2811448031 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92f0003a00 0x7f93081e1ae0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:14.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.796+0000 7f930d8a6640 1 -- 172.21.15.60:0/2811448031 >> 172.21.15.60:0/2811448031 conn(0x7f930806bbe0 msgr2=0x7f93080c2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:14.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.796+0000 7f930d8a6640 1 -- 172.21.15.60:0/2811448031 shutdown_connections 2024-09-12T02:29:14.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:14.796+0000 7f930d8a6640 1 -- 172.21.15.60:0/2811448031 wait complete. 2024-09-12T02:29:17.811 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:29:17.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:17.920+0000 7fe0a9918640 1 Processor -- start 2024-09-12T02:29:17.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:17.920+0000 7fe0a9918640 1 -- start start 2024-09-12T02:29:17.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:17.921+0000 7fe0a9918640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe0a4153910 0x7fe0a40c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:17.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:17.921+0000 7fe0a9918640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0a4153d60 con 0x7fe0a40c69c0 2024-09-12T02:29:17.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:17.921+0000 7fe0a9918640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0a40c5940 con 0x7fe0a41505f0 2024-09-12T02:29:17.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:17.921+0000 7fe0a9918640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fe0a40c7860 con 0x7fe0a4153910 2024-09-12T02:29:17.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:17.921+0000 7fe0a37fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe0a4153910 0x7fe0a40c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:17.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:17.921+0000 7fe0a27fc640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe0a40c69c0 0x7fe0a40c42b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:39566/0 (socket says 172.21.15.60:39566) 2024-09-12T02:29:17.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:17.921+0000 7fe0a27fc640 1 -- 172.21.15.60:0/3612946175 learned_addr learned my addr 172.21.15.60:0/3612946175 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:29:17.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:17.921+0000 7fe0a37fe640 1 -- 172.21.15.60:0/3612946175 >> v2:172.21.15.60:3300/0 conn(0x7fe0a4153910 msgr2=0x7fe0a40c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:29:17.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:17.921+0000 7fe0a37fe640 1 -- 172.21.15.60:0/3612946175 >> v2:172.21.15.60:3300/0 conn(0x7fe0a4153910 msgr2=0x7fe0a40c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:29:17.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:17.921+0000 7fe0a37fe640 1 --2- 172.21.15.60:0/3612946175 >> v2:172.21.15.60:3300/0 conn(0x7fe0a4153910 0x7fe0a40c49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:29:17.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:17.921+0000 7fe0a37fe640 1 --2- 172.21.15.60:0/3612946175 >> v2:172.21.15.60:3300/0 conn(0x7fe0a4153910 0x7fe0a40c49c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:29:18.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:18.122+0000 7fe0a37fe640 1 --2- 172.21.15.60:0/3612946175 >> v2:172.21.15.60:3300/0 conn(0x7fe0a4153910 0x7fe0a40c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:18.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:18.122+0000 7fe0a37fe640 1 -- 172.21.15.60:0/3612946175 >> v2:172.21.15.60:3300/0 conn(0x7fe0a4153910 msgr2=0x7fe0a40c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:29:18.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:18.122+0000 7fe0a37fe640 1 -- 172.21.15.60:0/3612946175 >> v2:172.21.15.60:3300/0 conn(0x7fe0a4153910 msgr2=0x7fe0a40c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:29:18.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:18.122+0000 7fe0a37fe640 1 --2- 172.21.15.60:0/3612946175 >> v2:172.21.15.60:3300/0 conn(0x7fe0a4153910 0x7fe0a40c49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:29:18.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:18.122+0000 7fe0a37fe640 1 --2- 172.21.15.60:0/3612946175 >> v2:172.21.15.60:3300/0 conn(0x7fe0a4153910 0x7fe0a40c49c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:29:18.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:18.523+0000 7fe0a37fe640 1 --2- 172.21.15.60:0/3612946175 >> v2:172.21.15.60:3300/0 conn(0x7fe0a4153910 0x7fe0a40c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:18.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:18.523+0000 7fe0a37fe640 1 -- 172.21.15.60:0/3612946175 >> v2:172.21.15.60:3300/0 conn(0x7fe0a4153910 msgr2=0x7fe0a40c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:29:18.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:18.523+0000 7fe0a37fe640 1 -- 172.21.15.60:0/3612946175 >> v2:172.21.15.60:3300/0 conn(0x7fe0a4153910 msgr2=0x7fe0a40c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:29:18.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:18.523+0000 7fe0a37fe640 1 --2- 172.21.15.60:0/3612946175 >> v2:172.21.15.60:3300/0 conn(0x7fe0a4153910 0x7fe0a40c49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:29:18.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:18.523+0000 7fe0a37fe640 1 --2- 172.21.15.60:0/3612946175 >> v2:172.21.15.60:3300/0 conn(0x7fe0a4153910 0x7fe0a40c49c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:29:19.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:19.324+0000 7fe0a37fe640 1 --2- 172.21.15.60:0/3612946175 >> v2:172.21.15.60:3300/0 conn(0x7fe0a4153910 0x7fe0a40c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:19.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:19.324+0000 7fe0a37fe640 1 -- 172.21.15.60:0/3612946175 >> v2:172.21.15.60:3300/0 conn(0x7fe0a4153910 msgr2=0x7fe0a40c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:29:19.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:19.324+0000 7fe0a37fe640 1 -- 172.21.15.60:0/3612946175 >> v2:172.21.15.60:3300/0 conn(0x7fe0a4153910 msgr2=0x7fe0a40c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:29:19.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:19.324+0000 7fe0a37fe640 1 --2- 172.21.15.60:0/3612946175 >> v2:172.21.15.60:3300/0 conn(0x7fe0a4153910 0x7fe0a40c49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:29:19.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:19.324+0000 7fe0a37fe640 1 --2- 172.21.15.60:0/3612946175 >> v2:172.21.15.60:3300/0 conn(0x7fe0a4153910 0x7fe0a40c49c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:29:20.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.525+0000 7fe0a1ffb640 1 -- 172.21.15.60:0/3612946175 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2802775256 0 0) 0x7fe0a40c5940 con 0x7fe0a41505f0 2024-09-12T02:29:20.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.525+0000 7fe0a1ffb640 1 -- 172.21.15.60:0/3612946175 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe08c003520 con 0x7fe0a41505f0 2024-09-12T02:29:20.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.526+0000 7fe0a1ffb640 1 -- 172.21.15.60:0/3612946175 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3304941184 0 0) 0x7fe08c003520 con 0x7fe0a41505f0 2024-09-12T02:29:20.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.526+0000 7fe0a1ffb640 1 -- 172.21.15.60:0/3612946175 >> v2:172.21.15.60:3300/0 conn(0x7fe0a4153910 msgr2=0x7fe0a40c49c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:29:20.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.526+0000 7fe0a1ffb640 1 --2- 172.21.15.60:0/3612946175 >> v2:172.21.15.60:3300/0 conn(0x7fe0a4153910 0x7fe0a40c49c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:20.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.526+0000 7fe0a1ffb640 1 -- 172.21.15.60:0/3612946175 >> v1:172.21.15.60:6789/0 conn(0x7fe0a40c69c0 legacy=0x7fe0a40c42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:20.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.526+0000 7fe0a1ffb640 1 -- 172.21.15.60:0/3612946175 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0a40c5c00 con 0x7fe0a41505f0 2024-09-12T02:29:20.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.526+0000 7fe0a1ffb640 1 -- 172.21.15.60:0/3612946175 <== mon.1 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7fe094001670 con 0x7fe0a41505f0 2024-09-12T02:29:20.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.526+0000 7fe0a1ffb640 1 -- 172.21.15.60:0/3612946175 >> v1:172.21.15.105:6789/0 conn(0x7fe0a41505f0 legacy=0x7fe0a40c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:20.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.526+0000 7fe0a1ffb640 1 --2- 172.21.15.60:0/3612946175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe08c003a00 0x7fe08c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:20.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.526+0000 7fe0a1ffb640 1 --2- 172.21.15.60:0/3612946175 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe08c004800 0x7fe08c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:20.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.526+0000 7fe0a1ffb640 1 --2- 172.21.15.60:0/3612946175 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe08c0052e0 0x7fe08c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:20.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.526+0000 7fe0a1ffb640 1 -- 172.21.15.60:0/3612946175 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe08c00c1d0 con 0x7fe08c003a00 2024-09-12T02:29:20.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.526+0000 7fe0a1ffb640 1 -- 172.21.15.60:0/3612946175 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe08c00c380 con 0x7fe08c0052e0 2024-09-12T02:29:20.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.526+0000 7fe0a1ffb640 1 -- 172.21.15.60:0/3612946175 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe08c00c580 con 0x7fe08c004800 2024-09-12T02:29:20.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.526+0000 7fe0a37fe640 1 --2- 172.21.15.60:0/3612946175 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe08c0052e0 0x7fe08c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:20.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.526+0000 7fe0a27fc640 1 --2- 172.21.15.60:0/3612946175 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe08c004800 0x7fe08c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:20.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.526+0000 7fe0a37fe640 1 -- 172.21.15.60:0/3612946175 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe08c004800 msgr2=0x7fe08c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:20.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.526+0000 7fe0a37fe640 1 --2- 172.21.15.60:0/3612946175 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe08c004800 0x7fe08c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:20.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.526+0000 7fe0a37fe640 1 -- 172.21.15.60:0/3612946175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe08c003a00 msgr2=0x7fe08c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:20.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.526+0000 7fe0a37fe640 1 --2- 172.21.15.60:0/3612946175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe08c003a00 0x7fe08c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:20.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.526+0000 7fe0a37fe640 1 -- 172.21.15.60:0/3612946175 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe08c003520 con 0x7fe08c0052e0 2024-09-12T02:29:20.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.527+0000 7fe0a37fe640 1 -- 172.21.15.60:0/3612946175 reap_dead start 2024-09-12T02:29:20.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.527+0000 7fe0a37fe640 1 --2- 172.21.15.60:0/3612946175 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe08c0052e0 0x7fe08c00b9c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe09c004360 tx=0x7fe08c005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=910ccfb4fc0009a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:20.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.528+0000 7fe0a1ffb640 1 -- 172.21.15.60:0/3612946175 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe09c031070 con 0x7fe08c0052e0 2024-09-12T02:29:20.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.528+0000 7fe0a1ffb640 1 -- 172.21.15.60:0/3612946175 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe09c02ba80 con 0x7fe08c0052e0 2024-09-12T02:29:20.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.528+0000 7fe0a1ffb640 1 -- 172.21.15.60:0/3612946175 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe09c004040 con 0x7fe08c0052e0 2024-09-12T02:29:20.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.528+0000 7fe0a9918640 1 -- 172.21.15.60:0/3612946175 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe08c0052e0 msgr2=0x7fe08c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:20.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.528+0000 7fe0a9918640 1 --2- 172.21.15.60:0/3612946175 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe08c0052e0 0x7fe08c00b9c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe09c004360 tx=0x7fe08c005830 comp rx=0 tx=0).stop 2024-09-12T02:29:20.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.529+0000 7fe0a9918640 1 -- 172.21.15.60:0/3612946175 shutdown_connections 2024-09-12T02:29:20.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.529+0000 7fe0a9918640 1 --2- 172.21.15.60:0/3612946175 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe08c0052e0 0x7fe08c00b9c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:20.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.529+0000 7fe0a9918640 1 -- 172.21.15.60:0/3612946175 >> 172.21.15.60:0/3612946175 conn(0x7fe0a40c7a40 msgr2=0x7fe0a40c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:20.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.529+0000 7fe0a9918640 1 -- 172.21.15.60:0/3612946175 shutdown_connections 2024-09-12T02:29:20.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.529+0000 7fe0a9918640 1 -- 172.21.15.60:0/3612946175 wait complete. 2024-09-12T02:29:20.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.530+0000 7fe0a9918640 1 Processor -- start 2024-09-12T02:29:20.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.531+0000 7fe0a9918640 1 -- start start 2024-09-12T02:29:20.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.531+0000 7fe0a9918640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe08c0052e0 0x7fe0a41485a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:20.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.532+0000 7fe0a9918640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0a4146440 0x7fe0a41e09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:20.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.532+0000 7fe0a9918640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0a4150d00 0x7fe0a4152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:20.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.532+0000 7fe0a9918640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a40c64a0 con 0x7fe0a4150d00 2024-09-12T02:29:20.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.532+0000 7fe0a9918640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a40c61c0 con 0x7fe0a4146440 2024-09-12T02:29:20.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.532+0000 7fe0a9918640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe0a41509d0 con 0x7fe08c0052e0 2024-09-12T02:29:20.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.532+0000 7fe0a27fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0a4146440 0x7fe0a41e09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:20.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.532+0000 7fe0a2ffd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe08c0052e0 0x7fe0a41485a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:20.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.532+0000 7fe0a2ffd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe08c0052e0 0x7fe0a41485a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:36242/0 (socket says 172.21.15.60:36242) 2024-09-12T02:29:20.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.532+0000 7fe0a37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0a4150d00 0x7fe0a4152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:20.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.532+0000 7fe0a2ffd640 1 -- 172.21.15.60:0/2791960826 learned_addr learned my addr 172.21.15.60:0/2791960826 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:29:20.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.532+0000 7fe0a27fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0a4146440 0x7fe0a41e09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:49354/0 (socket says 172.21.15.60:49354) 2024-09-12T02:29:20.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.532+0000 7fe0a2ffd640 1 -- 172.21.15.60:0/2791960826 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe08c0052e0 msgr2=0x7fe0a41485a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-12T02:29:20.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.532+0000 7fe0a2ffd640 1 -- 172.21.15.60:0/2791960826 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe08c0052e0 msgr2=0x7fe0a41485a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:29:20.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.532+0000 7fe0a2ffd640 1 --2- 172.21.15.60:0/2791960826 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe08c0052e0 0x7fe0a41485a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:29:20.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.532+0000 7fe0a2ffd640 1 --2- 172.21.15.60:0/2791960826 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe08c0052e0 0x7fe0a41485a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:29:20.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.532+0000 7fe0a27fc640 1 -- 172.21.15.60:0/2791960826 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe08c0052e0 msgr2=0x7fe0a41485a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:29:20.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.532+0000 7fe0a27fc640 1 --2- 172.21.15.60:0/2791960826 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe08c0052e0 0x7fe0a41485a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:20.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.532+0000 7fe0a27fc640 1 -- 172.21.15.60:0/2791960826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0a4150d00 msgr2=0x7fe0a4152430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:20.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.532+0000 7fe0a27fc640 1 --2- 172.21.15.60:0/2791960826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0a4150d00 0x7fe0a4152430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:20.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.532+0000 7fe0a27fc640 1 -- 172.21.15.60:0/2791960826 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0a40ada30 con 0x7fe0a4146440 2024-09-12T02:29:20.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.532+0000 7fe0a37fe640 1 --2- 172.21.15.60:0/2791960826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0a4150d00 0x7fe0a4152430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:29:20.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.533+0000 7fe0a27fc640 1 --2- 172.21.15.60:0/2791960826 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0a4146440 0x7fe0a41e09b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe098007fd0 tx=0x7fe098001a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:20.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.533+0000 7fe08bfff640 1 -- 172.21.15.60:0/2791960826 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe098007740 con 0x7fe0a4146440 2024-09-12T02:29:20.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.533+0000 7fe08bfff640 1 -- 172.21.15.60:0/2791960826 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe098018070 con 0x7fe0a4146440 2024-09-12T02:29:20.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.533+0000 7fe0a9918640 1 -- 172.21.15.60:0/2791960826 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0a40ad750 con 0x7fe0a4146440 2024-09-12T02:29:20.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.533+0000 7fe08bfff640 1 -- 172.21.15.60:0/2791960826 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe09800f9f0 con 0x7fe0a4146440 2024-09-12T02:29:20.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.533+0000 7fe0a9918640 1 -- 172.21.15.60:0/2791960826 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0a41edd70 con 0x7fe0a4146440 2024-09-12T02:29:20.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.534+0000 7fe0a9918640 1 -- 172.21.15.60:0/2791960826 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0a40c2130 con 0x7fe0a4146440 2024-09-12T02:29:20.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.534+0000 7fe08bfff640 1 -- 172.21.15.60:0/2791960826 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe09800fb90 con 0x7fe0a4146440 2024-09-12T02:29:20.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.535+0000 7fe08bfff640 1 --2- 172.21.15.60:0/2791960826 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe09006be30 0x7fe09006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:20.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.535+0000 7fe08bfff640 1 -- 172.21.15.60:0/2791960826 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fe09808ad70 con 0x7fe0a4146440 2024-09-12T02:29:20.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.535+0000 7fe0a2ffd640 1 --2- 172.21.15.60:0/2791960826 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe09006be30 0x7fe09006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:20.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.536+0000 7fe0a2ffd640 1 --2- 172.21.15.60:0/2791960826 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe09006be30 0x7fe09006e2f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe094001eb0 tx=0x7fe094009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:20.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.541+0000 7fe08bfff640 1 -- 172.21.15.60:0/2791960826 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe098059410 con 0x7fe0a4146440 2024-09-12T02:29:20.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.796+0000 7fe0a9918640 1 -- 172.21.15.60:0/2791960826 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe0a40c5940 con 0x7fe0a4146440 2024-09-12T02:29:20.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.797+0000 7fe08bfff640 1 -- 172.21.15.60:0/2791960826 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7fe098058d10 con 0x7fe0a4146440 2024-09-12T02:29:20.798 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":60,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:29:20.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.799+0000 7fe0a9918640 1 -- 172.21.15.60:0/2791960826 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe09006be30 msgr2=0x7fe09006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:20.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.799+0000 7fe0a9918640 1 --2- 172.21.15.60:0/2791960826 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe09006be30 0x7fe09006e2f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe094001eb0 tx=0x7fe094009040 comp rx=0 tx=0).stop 2024-09-12T02:29:20.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.799+0000 7fe0a9918640 1 -- 172.21.15.60:0/2791960826 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0a4146440 msgr2=0x7fe0a41e09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:20.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.799+0000 7fe0a9918640 1 --2- 172.21.15.60:0/2791960826 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0a4146440 0x7fe0a41e09b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe098007fd0 tx=0x7fe098001a60 comp rx=0 tx=0).stop 2024-09-12T02:29:20.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.799+0000 7fe0a9918640 1 -- 172.21.15.60:0/2791960826 shutdown_connections 2024-09-12T02:29:20.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.799+0000 7fe0a9918640 1 --2- 172.21.15.60:0/2791960826 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe09006be30 0x7fe09006e2f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:20.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.799+0000 7fe0a9918640 1 --2- 172.21.15.60:0/2791960826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0a4150d00 0x7fe0a4152430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:20.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.799+0000 7fe0a9918640 1 --2- 172.21.15.60:0/2791960826 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0a4146440 0x7fe0a41e09b0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:20.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.799+0000 7fe0a9918640 1 --2- 172.21.15.60:0/2791960826 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe08c0052e0 0x7fe0a41485a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:20.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.799+0000 7fe0a9918640 1 -- 172.21.15.60:0/2791960826 >> 172.21.15.60:0/2791960826 conn(0x7fe0a40c7a40 msgr2=0x7fe0a40c3580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:20.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.799+0000 7fe0a9918640 1 -- 172.21.15.60:0/2791960826 shutdown_connections 2024-09-12T02:29:20.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:20.799+0000 7fe0a9918640 1 -- 172.21.15.60:0/2791960826 wait complete. 2024-09-12T02:29:23.812 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:29:23.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.923+0000 7fad297ff640 1 Processor -- start 2024-09-12T02:29:23.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.923+0000 7fad297ff640 1 -- start start 2024-09-12T02:29:23.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.924+0000 7fad297ff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad240c8b60 0x7fad240cb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:23.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.924+0000 7fad297ff640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad241561f0 con 0x7fad2406c890 2024-09-12T02:29:23.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.924+0000 7fad297ff640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad241564d0 con 0x7fad240cb5c0 2024-09-12T02:29:23.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.924+0000 7fad297ff640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fad24156e00 con 0x7fad240c8b60 2024-09-12T02:29:23.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.924+0000 7fad227fc640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fad2406c890 0x7fad241596b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:39068/0 (socket says 172.21.15.60:39068) 2024-09-12T02:29:23.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.924+0000 7fad227fc640 1 -- 172.21.15.60:0/1303685541 learned_addr learned my addr 172.21.15.60:0/1303685541 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:29:23.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.924+0000 7fad22ffd640 1 --2- 172.21.15.60:0/1303685541 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad240c8b60 0x7fad240cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:23.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.924+0000 7fad21ffb640 1 -- 172.21.15.60:0/1303685541 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1596450284 0 0) 0x7fad241561f0 con 0x7fad2406c890 2024-09-12T02:29:23.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.924+0000 7fad21ffb640 1 -- 172.21.15.60:0/1303685541 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad0c003520 con 0x7fad2406c890 2024-09-12T02:29:23.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.924+0000 7fad21ffb640 1 -- 172.21.15.60:0/1303685541 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2634000074 0 0) 0x7fad241564d0 con 0x7fad240cb5c0 2024-09-12T02:29:23.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.924+0000 7fad21ffb640 1 -- 172.21.15.60:0/1303685541 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad241561f0 con 0x7fad240cb5c0 2024-09-12T02:29:23.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.925+0000 7fad22ffd640 1 -- 172.21.15.60:0/1303685541 >> v1:172.21.15.105:6789/0 conn(0x7fad240cb5c0 legacy=0x7fad24159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:23.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.925+0000 7fad22ffd640 1 -- 172.21.15.60:0/1303685541 >> v1:172.21.15.60:6789/0 conn(0x7fad2406c890 legacy=0x7fad241596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:23.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.925+0000 7fad22ffd640 1 -- 172.21.15.60:0/1303685541 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad241567b0 con 0x7fad240c8b60 2024-09-12T02:29:23.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.925+0000 7fad22ffd640 1 --2- 172.21.15.60:0/1303685541 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad240c8b60 0x7fad240cb080 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fad140097d0 tx=0x7fad1402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83277b2d9d7435ba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:23.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.926+0000 7fad21ffb640 1 -- 172.21.15.60:0/1303685541 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad14037070 con 0x7fad240c8b60 2024-09-12T02:29:23.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.926+0000 7fad21ffb640 1 -- 172.21.15.60:0/1303685541 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad1402ae50 con 0x7fad240c8b60 2024-09-12T02:29:23.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.926+0000 7fad21ffb640 1 -- 172.21.15.60:0/1303685541 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad14032660 con 0x7fad240c8b60 2024-09-12T02:29:23.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.926+0000 7fad297ff640 1 -- 172.21.15.60:0/1303685541 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad240c8b60 msgr2=0x7fad240cb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:23.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.926+0000 7fad297ff640 1 --2- 172.21.15.60:0/1303685541 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad240c8b60 0x7fad240cb080 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fad140097d0 tx=0x7fad1402a100 comp rx=0 tx=0).stop 2024-09-12T02:29:23.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.926+0000 7fad297ff640 1 -- 172.21.15.60:0/1303685541 shutdown_connections 2024-09-12T02:29:23.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.926+0000 7fad297ff640 1 --2- 172.21.15.60:0/1303685541 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad240c8b60 0x7fad240cb080 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:23.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.926+0000 7fad297ff640 1 -- 172.21.15.60:0/1303685541 >> 172.21.15.60:0/1303685541 conn(0x7fad240adca0 msgr2=0x7fad240ae0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:23.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.926+0000 7fad297ff640 1 -- 172.21.15.60:0/1303685541 shutdown_connections 2024-09-12T02:29:23.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.926+0000 7fad297ff640 1 -- 172.21.15.60:0/1303685541 wait complete. 2024-09-12T02:29:23.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.928+0000 7fad297ff640 1 Processor -- start 2024-09-12T02:29:23.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.928+0000 7fad297ff640 1 -- start start 2024-09-12T02:29:23.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.928+0000 7fad297ff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad2406c890 0x7fad24155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:23.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.928+0000 7fad297ff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad240c8b60 0x7fad240c4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:23.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.928+0000 7fad297ff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad240cb5c0 0x7fad241eee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:23.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.928+0000 7fad297ff640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fad2406d090 con 0x7fad2406c890 2024-09-12T02:29:23.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.928+0000 7fad297ff640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fad2406cf10 con 0x7fad240cb5c0 2024-09-12T02:29:23.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.928+0000 7fad297ff640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fad240c8f40 con 0x7fad240c8b60 2024-09-12T02:29:23.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.928+0000 7fad22ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad2406c890 0x7fad24155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:23.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.928+0000 7fad22ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad2406c890 0x7fad24155110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33632/0 (socket says 172.21.15.60:33632) 2024-09-12T02:29:23.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.928+0000 7fad22ffd640 1 -- 172.21.15.60:0/3585946987 learned_addr learned my addr 172.21.15.60:0/3585946987 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:29:23.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.928+0000 7fad227fc640 1 --2- 172.21.15.60:0/3585946987 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad240c8b60 0x7fad240c4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:23.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.928+0000 7fad237fe640 1 --2- 172.21.15.60:0/3585946987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad240cb5c0 0x7fad241eee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:23.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.929+0000 7fad22ffd640 1 -- 172.21.15.60:0/3585946987 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad240c8b60 msgr2=0x7fad240c4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:23.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.929+0000 7fad22ffd640 1 --2- 172.21.15.60:0/3585946987 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad240c8b60 0x7fad240c4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:23.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.929+0000 7fad22ffd640 1 -- 172.21.15.60:0/3585946987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad240cb5c0 msgr2=0x7fad241eee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:23.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.929+0000 7fad22ffd640 1 --2- 172.21.15.60:0/3585946987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad240cb5c0 0x7fad241eee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:23.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.929+0000 7fad22ffd640 1 -- 172.21.15.60:0/3585946987 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad240c3d20 con 0x7fad2406c890 2024-09-12T02:29:23.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.929+0000 7fad22ffd640 1 --2- 172.21.15.60:0/3585946987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad2406c890 0x7fad24155110 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fad14035040 tx=0x7fad140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:23.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.929+0000 7fad0b7fe640 1 -- 172.21.15.60:0/3585946987 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad14041070 con 0x7fad2406c890 2024-09-12T02:29:23.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.929+0000 7fad0b7fe640 1 -- 172.21.15.60:0/3585946987 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad1403c460 con 0x7fad2406c890 2024-09-12T02:29:23.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.929+0000 7fad297ff640 1 -- 172.21.15.60:0/3585946987 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad240c57e0 con 0x7fad2406c890 2024-09-12T02:29:23.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.929+0000 7fad0b7fe640 1 -- 172.21.15.60:0/3585946987 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad14037040 con 0x7fad2406c890 2024-09-12T02:29:23.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.929+0000 7fad297ff640 1 -- 172.21.15.60:0/3585946987 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad240c42a0 con 0x7fad2406c890 2024-09-12T02:29:23.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.930+0000 7fad297ff640 1 -- 172.21.15.60:0/3585946987 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad2406d770 con 0x7fad2406c890 2024-09-12T02:29:23.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.931+0000 7fad0b7fe640 1 -- 172.21.15.60:0/3585946987 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fad14044070 con 0x7fad2406c890 2024-09-12T02:29:23.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.931+0000 7fad0b7fe640 1 --2- 172.21.15.60:0/3585946987 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fad1006be30 0x7fad1006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:23.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.932+0000 7fad0b7fe640 1 -- 172.21.15.60:0/3585946987 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fad140ab720 con 0x7fad2406c890 2024-09-12T02:29:23.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.932+0000 7fad227fc640 1 --2- 172.21.15.60:0/3585946987 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fad1006be30 0x7fad1006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:23.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.932+0000 7fad227fc640 1 --2- 172.21.15.60:0/3585946987 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fad1006be30 0x7fad1006e2f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fad24155920 tx=0x7fad18007d70 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:23.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:23.937+0000 7fad0b7fe640 1 -- 172.21.15.60:0/3585946987 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fad140796e0 con 0x7fad2406c890 2024-09-12T02:29:24.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.216+0000 7fad297ff640 1 -- 172.21.15.60:0/3585946987 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fad240ae290 con 0x7fad2406c890 2024-09-12T02:29:24.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.217+0000 7fad0b7fe640 1 -- 172.21.15.60:0/3585946987 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7fad1407d9e0 con 0x7fad2406c890 2024-09-12T02:29:24.218 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":64,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:29:24.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.219+0000 7fad297ff640 1 -- 172.21.15.60:0/3585946987 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fad1006be30 msgr2=0x7fad1006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:24.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.219+0000 7fad297ff640 1 --2- 172.21.15.60:0/3585946987 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fad1006be30 0x7fad1006e2f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fad24155920 tx=0x7fad18007d70 comp rx=0 tx=0).stop 2024-09-12T02:29:24.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.219+0000 7fad297ff640 1 -- 172.21.15.60:0/3585946987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad2406c890 msgr2=0x7fad24155110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:24.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.219+0000 7fad297ff640 1 --2- 172.21.15.60:0/3585946987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad2406c890 0x7fad24155110 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fad14035040 tx=0x7fad140046c0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.219+0000 7fad297ff640 1 -- 172.21.15.60:0/3585946987 shutdown_connections 2024-09-12T02:29:24.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.219+0000 7fad297ff640 1 --2- 172.21.15.60:0/3585946987 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fad1006be30 0x7fad1006e2f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.219+0000 7fad297ff640 1 --2- 172.21.15.60:0/3585946987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad240cb5c0 0x7fad241eee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.219+0000 7fad297ff640 1 --2- 172.21.15.60:0/3585946987 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad240c8b60 0x7fad240c4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.219+0000 7fad297ff640 1 --2- 172.21.15.60:0/3585946987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad2406c890 0x7fad24155110 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.219+0000 7fad297ff640 1 -- 172.21.15.60:0/3585946987 >> 172.21.15.60:0/3585946987 conn(0x7fad240adca0 msgr2=0x7fad24067950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:24.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.219+0000 7fad297ff640 1 -- 172.21.15.60:0/3585946987 shutdown_connections 2024-09-12T02:29:24.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.219+0000 7fad297ff640 1 -- 172.21.15.60:0/3585946987 wait complete. 2024-09-12T02:29:24.231 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-12T02:29:24.231 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-12T02:29:24.231 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-12T02:29:24.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.344+0000 7effc42ba640 1 Processor -- start 2024-09-12T02:29:24.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.344+0000 7effc42ba640 1 -- start start 2024-09-12T02:29:24.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.345+0000 7effc42ba640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7effbc0bda70 0x7effbc153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:24.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.345+0000 7effc42ba640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7effbc0c5090 0x7effbc0c5500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:24.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.345+0000 7effc42ba640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effbc0c8290 con 0x7effbc150aa0 2024-09-12T02:29:24.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.345+0000 7effc42ba640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7effbc074100 con 0x7effbc0c5090 2024-09-12T02:29:24.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.345+0000 7effc42ba640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7effbc0c8570 con 0x7effbc0bda70 2024-09-12T02:29:24.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.345+0000 7effc2056640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7effbc150aa0 0x7effbc0bf3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:39084/0 (socket says 172.21.15.60:39084) 2024-09-12T02:29:24.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.345+0000 7effc2056640 1 -- 172.21.15.60:0/4231104321 learned_addr learned my addr 172.21.15.60:0/4231104321 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:29:24.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.345+0000 7effc1855640 1 --2- 172.21.15.60:0/4231104321 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7effbc0bda70 0x7effbc153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:24.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.345+0000 7effc2857640 1 --2- 172.21.15.60:0/4231104321 >> v2:172.21.15.105:3300/0 conn(0x7effbc0c5090 0x7effbc0c5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:24.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.345+0000 7effc1054640 1 -- 172.21.15.60:0/4231104321 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1596929754 0 0) 0x7effbc0c8290 con 0x7effbc150aa0 2024-09-12T02:29:24.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.345+0000 7effc1054640 1 -- 172.21.15.60:0/4231104321 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effa8003520 con 0x7effbc150aa0 2024-09-12T02:29:24.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.345+0000 7effc1855640 1 -- 172.21.15.60:0/4231104321 >> v2:172.21.15.105:3300/0 conn(0x7effbc0c5090 msgr2=0x7effbc0c5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:24.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.345+0000 7effc1855640 1 --2- 172.21.15.60:0/4231104321 >> v2:172.21.15.105:3300/0 conn(0x7effbc0c5090 0x7effbc0c5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.345+0000 7effc1855640 1 -- 172.21.15.60:0/4231104321 >> v1:172.21.15.60:6789/0 conn(0x7effbc150aa0 legacy=0x7effbc0bf3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:24.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.345+0000 7effc1855640 1 -- 172.21.15.60:0/4231104321 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effbc074350 con 0x7effbc0bda70 2024-09-12T02:29:24.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.346+0000 7effc2857640 1 --2- 172.21.15.60:0/4231104321 >> v2:172.21.15.105:3300/0 conn(0x7effbc0c5090 0x7effbc0c5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:29:24.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.346+0000 7effc1855640 1 --2- 172.21.15.60:0/4231104321 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7effbc0bda70 0x7effbc153ce0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7effac0097a0 tx=0x7effac02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29653a474415db48 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:24.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.347+0000 7effc1054640 1 -- 172.21.15.60:0/4231104321 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effac037070 con 0x7effbc0bda70 2024-09-12T02:29:24.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.347+0000 7effc1054640 1 -- 172.21.15.60:0/4231104321 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effac02ae50 con 0x7effbc0bda70 2024-09-12T02:29:24.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.347+0000 7effc1054640 1 -- 172.21.15.60:0/4231104321 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effac032660 con 0x7effbc0bda70 2024-09-12T02:29:24.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.347+0000 7effc42ba640 1 -- 172.21.15.60:0/4231104321 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7effbc0bda70 msgr2=0x7effbc153ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:24.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.347+0000 7effc42ba640 1 --2- 172.21.15.60:0/4231104321 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7effbc0bda70 0x7effbc153ce0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7effac0097a0 tx=0x7effac02a100 comp rx=0 tx=0).stop 2024-09-12T02:29:24.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.347+0000 7effc42ba640 1 -- 172.21.15.60:0/4231104321 shutdown_connections 2024-09-12T02:29:24.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.347+0000 7effc42ba640 1 --2- 172.21.15.60:0/4231104321 >> v2:172.21.15.105:3300/0 conn(0x7effbc0c5090 0x7effbc0c5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.347+0000 7effc42ba640 1 --2- 172.21.15.60:0/4231104321 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7effbc0bda70 0x7effbc153ce0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.347+0000 7effc42ba640 1 -- 172.21.15.60:0/4231104321 >> 172.21.15.60:0/4231104321 conn(0x7effbc0c8a50 msgr2=0x7effbc0c8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:24.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.347+0000 7effc42ba640 1 -- 172.21.15.60:0/4231104321 shutdown_connections 2024-09-12T02:29:24.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.347+0000 7effc42ba640 1 -- 172.21.15.60:0/4231104321 wait complete. 2024-09-12T02:29:24.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.348+0000 7effc42ba640 1 Processor -- start 2024-09-12T02:29:24.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.348+0000 7effc42ba640 1 -- start start 2024-09-12T02:29:24.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.349+0000 7effc42ba640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7effbc0bda70 0x7effbc0acb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:24.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.349+0000 7effc42ba640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7effbc0c5090 0x7effbc0c23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:24.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.349+0000 7effc42ba640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effbc150aa0 0x7effbc0c2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:24.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.349+0000 7effc42ba640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7effbc0bfac0 con 0x7effbc150aa0 2024-09-12T02:29:24.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.349+0000 7effc42ba640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7effbc150e80 con 0x7effbc0bda70 2024-09-12T02:29:24.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.349+0000 7effc42ba640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7effbc0bfc40 con 0x7effbc0c5090 2024-09-12T02:29:24.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.349+0000 7effc2857640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effbc150aa0 0x7effbc0c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:24.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.349+0000 7effc2857640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effbc150aa0 0x7effbc0c2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33634/0 (socket says 172.21.15.60:33634) 2024-09-12T02:29:24.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.349+0000 7effc2857640 1 -- 172.21.15.60:0/3051069693 learned_addr learned my addr 172.21.15.60:0/3051069693 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:29:24.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.349+0000 7effc1855640 1 --2- 172.21.15.60:0/3051069693 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7effbc0c5090 0x7effbc0c23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:24.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.349+0000 7effc2056640 1 --2- 172.21.15.60:0/3051069693 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7effbc0bda70 0x7effbc0acb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:24.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.350+0000 7effc2857640 1 -- 172.21.15.60:0/3051069693 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7effbc0c5090 msgr2=0x7effbc0c23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:24.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.350+0000 7effc2857640 1 --2- 172.21.15.60:0/3051069693 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7effbc0c5090 0x7effbc0c23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.350+0000 7effc2857640 1 -- 172.21.15.60:0/3051069693 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7effbc0bda70 msgr2=0x7effbc0acb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:24.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.350+0000 7effc2857640 1 --2- 172.21.15.60:0/3051069693 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7effbc0bda70 0x7effbc0acb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.350+0000 7effc2857640 1 -- 172.21.15.60:0/3051069693 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effbc15fda0 con 0x7effbc150aa0 2024-09-12T02:29:24.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.350+0000 7effc2857640 1 --2- 172.21.15.60:0/3051069693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effbc150aa0 0x7effbc0c2900 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7effb400efc0 tx=0x7effb4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:24.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.350+0000 7effb2ffd640 1 -- 172.21.15.60:0/3051069693 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb4018030 con 0x7effbc150aa0 2024-09-12T02:29:24.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.350+0000 7effb2ffd640 1 -- 172.21.15.60:0/3051069693 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effb400cde0 con 0x7effbc150aa0 2024-09-12T02:29:24.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.350+0000 7effc42ba640 1 -- 172.21.15.60:0/3051069693 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effbc160ae0 con 0x7effbc150aa0 2024-09-12T02:29:24.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.350+0000 7effb2ffd640 1 -- 172.21.15.60:0/3051069693 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb4003bb0 con 0x7effbc150aa0 2024-09-12T02:29:24.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.350+0000 7effc42ba640 1 -- 172.21.15.60:0/3051069693 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effbc160040 con 0x7effbc150aa0 2024-09-12T02:29:24.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.351+0000 7effc42ba640 1 --2- 172.21.15.60:0/3051069693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effbc0a84c0 0x7effbc0a8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:24.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.351+0000 7effc42ba640 1 -- 172.21.15.60:0/3051069693 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7effbc069a00 con 0x7effbc0a84c0 2024-09-12T02:29:24.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.351+0000 7effc2056640 1 --2- 172.21.15.60:0/3051069693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effbc0a84c0 0x7effbc0a8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:24.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.352+0000 7effc2056640 1 -- 172.21.15.60:0/3051069693 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7effbc153ce0 con 0x7effbc0a84c0 2024-09-12T02:29:24.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.352+0000 7effb2ffd640 1 -- 172.21.15.60:0/3051069693 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7effb4005d10 con 0x7effbc150aa0 2024-09-12T02:29:24.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.352+0000 7effc2056640 1 --2- 172.21.15.60:0/3051069693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effbc0a84c0 0x7effbc0a8c20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7effb8000f60 tx=0x7effb800f9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:24.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.352+0000 7effb2ffd640 1 --2- 172.21.15.60:0/3051069693 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7effa006be60 0x7effa006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:24.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.352+0000 7effb2ffd640 1 -- 172.21.15.60:0/3051069693 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7effb408bb10 con 0x7effbc150aa0 2024-09-12T02:29:24.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.352+0000 7effc1855640 1 --2- 172.21.15.60:0/3051069693 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7effa006be60 0x7effa006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:24.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.353+0000 7effb2ffd640 1 -- 172.21.15.60:0/3051069693 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb8005ac0 con 0x7effbc0a84c0 2024-09-12T02:29:24.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.353+0000 7effb2ffd640 1 -- 172.21.15.60:0/3051069693 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7effb8018070 con 0x7effbc0a84c0 2024-09-12T02:29:24.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.353+0000 7effb2ffd640 1 -- 172.21.15.60:0/3051069693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effbc0a84c0 msgr2=0x7effbc0a8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:24.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.353+0000 7effb2ffd640 1 --2- 172.21.15.60:0/3051069693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effbc0a84c0 0x7effbc0a8c20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7effb8000f60 tx=0x7effb800f9d0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.353+0000 7effb2ffd640 1 -- 172.21.15.60:0/3051069693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effbc0a84c0 msgr2=0x7effbc0a8c20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:29:24.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.353+0000 7effb2ffd640 1 --2- 172.21.15.60:0/3051069693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effbc0a84c0 0x7effbc0a8c20 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.353+0000 7effc1855640 1 --2- 172.21.15.60:0/3051069693 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7effa006be60 0x7effa006e320 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7effac034000 tx=0x7effac02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:24.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.360+0000 7effc42ba640 1 --2- 172.21.15.60:0/3051069693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effbc1500e0 0x7effbc0a9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:24.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.360+0000 7effc42ba640 1 -- 172.21.15.60:0/3051069693 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7effbc0c7f40 con 0x7effbc1500e0 2024-09-12T02:29:24.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.360+0000 7effc2056640 1 --2- 172.21.15.60:0/3051069693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effbc1500e0 0x7effbc0a9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:24.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.360+0000 7effc2056640 1 -- 172.21.15.60:0/3051069693 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7effbc0c4bc0 con 0x7effbc1500e0 2024-09-12T02:29:24.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.360+0000 7effc2056640 1 --2- 172.21.15.60:0/3051069693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effbc1500e0 0x7effbc0a9160 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7effb8000f60 tx=0x7effb80010a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:24.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.360+0000 7effb2ffd640 1 -- 172.21.15.60:0/3051069693 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb801dc50 con 0x7effbc1500e0 2024-09-12T02:29:24.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.361+0000 7effb2ffd640 1 -- 172.21.15.60:0/3051069693 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4717 (secure 0 0 0) 0x7effb801dc50 con 0x7effbc1500e0 2024-09-12T02:29:24.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.361+0000 7effb2ffd640 1 -- 172.21.15.60:0/3051069693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effbc1500e0 msgr2=0x7effbc0a9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:24.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.361+0000 7effb2ffd640 1 --2- 172.21.15.60:0/3051069693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effbc1500e0 0x7effbc0a9160 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7effb8000f60 tx=0x7effb80010a0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.361+0000 7effb2ffd640 1 -- 172.21.15.60:0/3051069693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effbc1500e0 msgr2=0x7effbc0a9160 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:29:24.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.361+0000 7effb2ffd640 1 --2- 172.21.15.60:0/3051069693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effbc1500e0 0x7effbc0a9160 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.362 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:29:24.362 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:29:24.362 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:29:24.362 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:29:24.362 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 64, 2024-09-12T02:29:24.362 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 27464, 2024-09-12T02:29:24.363 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:29:24.363 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:29:24.363 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:29:24.363 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:29:24.363 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:24.363 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 2, 2024-09-12T02:29:24.363 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:29:24.363 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:29:24.363 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:29:24.363 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:29:24.363 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:29:24.363 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:29:24.364 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:29:24.364 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:29:24.364 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:29:24.364 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:29:24.364 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:29:24.364 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:29:24.364 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:29:24.364 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:29:24.364 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:24.364 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:29:24.364 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:29:24.364 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:29:24.364 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:29:24.364 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:29:24.365 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:29:24.365 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:29:24.365 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:29:24.365 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:29:24.365 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:29:24.365 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:29:24.365 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:29:24.365 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:29:24.365 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:24.365 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:24.365 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:29:24.365 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:29:24.366 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:29:24.366 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:29:24.366 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:29:24.366 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:29:24.366 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:29:24.366 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:29:24.366 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:29:24.366 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:29:24.366 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:29:24.366 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:29:24.366 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:29:24.366 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:29:24.367 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:29:24.367 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:29:24.367 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:29:24.367 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:29:24.367 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:29:24.367 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:29:24.367 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:29:24.367 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:29:24.367 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:29:24.367 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:29:24.367 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:29:24.367 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:29:24.367 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:29:24.368 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:29:24.368 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:24.368 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:29:24.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:24.368 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:29:24.368 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:24.368 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:29:24.368 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:29:24.368 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:29:24.368 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:29:24.368 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:24.368 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:29:24.369 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:29:24.369 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:24.369 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:24.369 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:24.369 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:29:24.369 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:29:24.369 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:24.369 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:24.369 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:24.369 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:24.369 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:29:24.369 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:29:24.369 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:29:24.370 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:29:24.370 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:29:24.370 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:24.370 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:24.370 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:29:24.370 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:29:24.370 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:29:24.370 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:29:24.370 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:24.370 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:29:24.370 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:29:24.370 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:24.370 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:24.370 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:24.371 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:29:24.371 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:29:24.371 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:24.371 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:24.371 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:24.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:24.371 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:29:24.371 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:29:24.371 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:29:24.371 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:29:24.371 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:29:24.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:24.371 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:24.372 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:29:24.372 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:29:24.372 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:29:24.372 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:29:24.372 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:24.372 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:29:24.372 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:29:24.372 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:24.372 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:24.372 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:24.372 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:29:24.372 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:29:24.372 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:24.373 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:24.373 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:24.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:24.373 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:29:24.373 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:29:24.373 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:29:24.373 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:29:24.373 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:29:24.373 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:24.373 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:24.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:24.373 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:29:24.373 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:29:24.373 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:24.374 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:29:24.374 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:29:24.374 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:29:24.374 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:24.374 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:24.374 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:29:24.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:24.374 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:29:24.374 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:29:24.374 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:29:24.374 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:24.374 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:24.374 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:29:24.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:24.375 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:29:24.375 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:29:24.375 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:29:24.375 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:24.375 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:24.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:24.375 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:29:24.375 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:29:24.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.361+0000 7effc42ba640 1 -- 172.21.15.60:0/3051069693 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7effa006be60 msgr2=0x7effa006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:24.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.361+0000 7effc42ba640 1 --2- 172.21.15.60:0/3051069693 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7effa006be60 0x7effa006e320 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7effac034000 tx=0x7effac02e000 comp rx=0 tx=0).stop 2024-09-12T02:29:24.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.361+0000 7effc42ba640 1 -- 172.21.15.60:0/3051069693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effbc150aa0 msgr2=0x7effbc0c2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:24.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.361+0000 7effc42ba640 1 --2- 172.21.15.60:0/3051069693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effbc150aa0 0x7effbc0c2900 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7effb400efc0 tx=0x7effb4009f90 comp rx=0 tx=0).stop 2024-09-12T02:29:24.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.361+0000 7effc2857640 1 -- 172.21.15.60:0/3051069693 reap_dead start 2024-09-12T02:29:24.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.361+0000 7effc42ba640 1 -- 172.21.15.60:0/3051069693 shutdown_connections 2024-09-12T02:29:24.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.361+0000 7effc42ba640 1 --2- 172.21.15.60:0/3051069693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effbc150aa0 0x7effbc0c2900 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.361+0000 7effc42ba640 1 -- 172.21.15.60:0/3051069693 >> 172.21.15.60:0/3051069693 conn(0x7effbc0c8a50 msgr2=0x7effbc151940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:24.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.361+0000 7effc42ba640 1 -- 172.21.15.60:0/3051069693 shutdown_connections 2024-09-12T02:29:24.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.361+0000 7effc42ba640 1 -- 172.21.15.60:0/3051069693 wait complete. 2024-09-12T02:29:24.378 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:29:24.378 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-12T02:29:24.378 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-12T02:29:24.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.497+0000 7f9c1b6a6640 1 Processor -- start 2024-09-12T02:29:24.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.497+0000 7f9c1b6a6640 1 -- start start 2024-09-12T02:29:24.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.498+0000 7f9c1b6a6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c1406c650 0x7f9c140c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:24.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.498+0000 7f9c1b6a6640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9c140ca1c0 0x7f9c14160bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:24.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.498+0000 7f9c1b6a6640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c1415a7c0 con 0x7f9c14150480 2024-09-12T02:29:24.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.498+0000 7f9c1b6a6640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f9c1406c240 con 0x7f9c140ca1c0 2024-09-12T02:29:24.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.498+0000 7f9c1b6a6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9c1415a330 con 0x7f9c1406c650 2024-09-12T02:29:24.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.498+0000 7f9c19442640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f9c14150480 0x7f9c140c7a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:39098/0 (socket says 172.21.15.60:39098) 2024-09-12T02:29:24.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.498+0000 7f9c19442640 1 -- 172.21.15.60:0/1248817317 learned_addr learned my addr 172.21.15.60:0/1248817317 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:29:24.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.498+0000 7f9c19c43640 1 --2- 172.21.15.60:0/1248817317 >> v2:172.21.15.105:3300/0 conn(0x7f9c140ca1c0 0x7f9c14160bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:24.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.498+0000 7f9c18c41640 1 --2- 172.21.15.60:0/1248817317 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c1406c650 0x7f9c140c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:24.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.498+0000 7f9c0bfff640 1 -- 172.21.15.60:0/1248817317 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 767410547 0 0) 0x7f9c1415a7c0 con 0x7f9c14150480 2024-09-12T02:29:24.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.498+0000 7f9c0bfff640 1 -- 172.21.15.60:0/1248817317 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c00003520 con 0x7f9c14150480 2024-09-12T02:29:24.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.498+0000 7f9c19c43640 1 -- 172.21.15.60:0/1248817317 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c1406c650 msgr2=0x7f9c140c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:24.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.498+0000 7f9c19c43640 1 --2- 172.21.15.60:0/1248817317 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c1406c650 0x7f9c140c9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.498+0000 7f9c19c43640 1 -- 172.21.15.60:0/1248817317 >> v1:172.21.15.60:6789/0 conn(0x7f9c14150480 legacy=0x7f9c140c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:24.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.498+0000 7f9c19c43640 1 -- 172.21.15.60:0/1248817317 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c14159a00 con 0x7f9c140ca1c0 2024-09-12T02:29:24.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.498+0000 7f9c18c41640 1 --2- 172.21.15.60:0/1248817317 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c1406c650 0x7f9c140c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:29:24.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.499+0000 7f9c19c43640 1 --2- 172.21.15.60:0/1248817317 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c140ca1c0 0x7f9c14160bf0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c009d90 tx=0x7f9c0c02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a404d42161f4e9f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:24.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.499+0000 7f9c0bfff640 1 -- 172.21.15.60:0/1248817317 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c007740 con 0x7f9c140ca1c0 2024-09-12T02:29:24.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.499+0000 7f9c0bfff640 1 -- 172.21.15.60:0/1248817317 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c0c0078e0 con 0x7f9c140ca1c0 2024-09-12T02:29:24.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.499+0000 7f9c0bfff640 1 -- 172.21.15.60:0/1248817317 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c007cb0 con 0x7f9c140ca1c0 2024-09-12T02:29:24.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.500+0000 7f9c1b6a6640 1 -- 172.21.15.60:0/1248817317 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c140ca1c0 msgr2=0x7f9c14160bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:24.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.500+0000 7f9c1b6a6640 1 --2- 172.21.15.60:0/1248817317 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c140ca1c0 0x7f9c14160bf0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c009d90 tx=0x7f9c0c02a660 comp rx=0 tx=0).stop 2024-09-12T02:29:24.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.500+0000 7f9c1b6a6640 1 -- 172.21.15.60:0/1248817317 shutdown_connections 2024-09-12T02:29:24.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.500+0000 7f9c1b6a6640 1 --2- 172.21.15.60:0/1248817317 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c140ca1c0 0x7f9c14160bf0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.500+0000 7f9c1b6a6640 1 --2- 172.21.15.60:0/1248817317 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c1406c650 0x7f9c140c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.500+0000 7f9c1b6a6640 1 -- 172.21.15.60:0/1248817317 >> 172.21.15.60:0/1248817317 conn(0x7f9c14068030 msgr2=0x7f9c14073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:24.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.500+0000 7f9c1b6a6640 1 -- 172.21.15.60:0/1248817317 shutdown_connections 2024-09-12T02:29:24.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.500+0000 7f9c1b6a6640 1 -- 172.21.15.60:0/1248817317 wait complete. 2024-09-12T02:29:24.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.501+0000 7f9c1b6a6640 1 Processor -- start 2024-09-12T02:29:24.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.501+0000 7f9c1b6a6640 1 -- start start 2024-09-12T02:29:24.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.502+0000 7f9c1b6a6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c1406c650 0x7f9c141537a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:24.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.502+0000 7f9c1b6a6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c140ca1c0 0x7f9c141dfae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:24.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.502+0000 7f9c1b6a6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c14150480 0x7f9c141ec8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:24.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.502+0000 7f9c1b6a6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9c140ca670 con 0x7f9c14150480 2024-09-12T02:29:24.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.502+0000 7f9c1b6a6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9c14159fc0 con 0x7f9c1406c650 2024-09-12T02:29:24.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.502+0000 7f9c1b6a6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9c1406d270 con 0x7f9c140ca1c0 2024-09-12T02:29:24.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.502+0000 7f9c19c43640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c14150480 0x7f9c141ec8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:24.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.502+0000 7f9c18c41640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c140ca1c0 0x7f9c141dfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:24.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.502+0000 7f9c19442640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c1406c650 0x7f9c141537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:24.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.502+0000 7f9c19c43640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c14150480 0x7f9c141ec8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33654/0 (socket says 172.21.15.60:33654) 2024-09-12T02:29:24.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.502+0000 7f9c19c43640 1 -- 172.21.15.60:0/3523784470 learned_addr learned my addr 172.21.15.60:0/3523784470 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:29:24.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.503+0000 7f9c19c43640 1 -- 172.21.15.60:0/3523784470 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c140ca1c0 msgr2=0x7f9c141dfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:24.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.503+0000 7f9c19c43640 1 --2- 172.21.15.60:0/3523784470 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c140ca1c0 0x7f9c141dfae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.503+0000 7f9c19c43640 1 -- 172.21.15.60:0/3523784470 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c1406c650 msgr2=0x7f9c141537a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:24.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.503+0000 7f9c19c43640 1 --2- 172.21.15.60:0/3523784470 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c1406c650 0x7f9c141537a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.503+0000 7f9c19c43640 1 -- 172.21.15.60:0/3523784470 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c141e0020 con 0x7f9c14150480 2024-09-12T02:29:24.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.503+0000 7f9c19442640 1 --2- 172.21.15.60:0/3523784470 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c1406c650 0x7f9c141537a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:29:24.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.503+0000 7f9c19c43640 1 --2- 172.21.15.60:0/3523784470 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c14150480 0x7f9c141ec8a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c02ac50 tx=0x7f9c0c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:24.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.503+0000 7f9c09ffb640 1 -- 172.21.15.60:0/3523784470 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c040070 con 0x7f9c14150480 2024-09-12T02:29:24.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.503+0000 7f9c09ffb640 1 -- 172.21.15.60:0/3523784470 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c0c031bc0 con 0x7f9c14150480 2024-09-12T02:29:24.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.503+0000 7f9c1b6a6640 1 -- 172.21.15.60:0/3523784470 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c141ecde0 con 0x7f9c14150480 2024-09-12T02:29:24.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.503+0000 7f9c09ffb640 1 -- 172.21.15.60:0/3523784470 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c009450 con 0x7f9c14150480 2024-09-12T02:29:24.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.503+0000 7f9c1b6a6640 1 -- 172.21.15.60:0/3523784470 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c141f0110 con 0x7f9c14150480 2024-09-12T02:29:24.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.504+0000 7f9c1b6a6640 1 --2- 172.21.15.60:0/3523784470 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c141532c0 0x7f9c140c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:24.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.504+0000 7f9c1b6a6640 1 -- 172.21.15.60:0/3523784470 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9c140b0c40 con 0x7f9c141532c0 2024-09-12T02:29:24.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.504+0000 7f9c19442640 1 --2- 172.21.15.60:0/3523784470 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c141532c0 0x7f9c140c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:24.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.505+0000 7f9c19442640 1 -- 172.21.15.60:0/3523784470 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9c141ec3f0 con 0x7f9c141532c0 2024-09-12T02:29:24.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.505+0000 7f9c19442640 1 --2- 172.21.15.60:0/3523784470 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c141532c0 0x7f9c140c8a00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9c10000f60 tx=0x7f9c1000ff00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:24.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.505+0000 7f9c09ffb640 1 -- 172.21.15.60:0/3523784470 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9c0c039040 con 0x7f9c14150480 2024-09-12T02:29:24.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.505+0000 7f9c09ffb640 1 --2- 172.21.15.60:0/3523784470 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9bf806be30 0x7f9bf806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:24.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.505+0000 7f9c09ffb640 1 -- 172.21.15.60:0/3523784470 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f9c0c0ac8b0 con 0x7f9c14150480 2024-09-12T02:29:24.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.505+0000 7f9c18c41640 1 --2- 172.21.15.60:0/3523784470 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9bf806be30 0x7f9bf806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:24.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.506+0000 7f9c09ffb640 1 -- 172.21.15.60:0/3523784470 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c10005ac0 con 0x7f9c141532c0 2024-09-12T02:29:24.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.506+0000 7f9c09ffb640 1 -- 172.21.15.60:0/3523784470 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f9c10018070 con 0x7f9c141532c0 2024-09-12T02:29:24.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.506+0000 7f9c09ffb640 1 -- 172.21.15.60:0/3523784470 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c141532c0 msgr2=0x7f9c140c8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:24.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.506+0000 7f9c09ffb640 1 --2- 172.21.15.60:0/3523784470 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c141532c0 0x7f9c140c8a00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9c10000f60 tx=0x7f9c1000ff00 comp rx=0 tx=0).stop 2024-09-12T02:29:24.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.506+0000 7f9c09ffb640 1 -- 172.21.15.60:0/3523784470 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c141532c0 msgr2=0x7f9c140c8a00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:29:24.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.506+0000 7f9c09ffb640 1 --2- 172.21.15.60:0/3523784470 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c141532c0 0x7f9c140c8a00 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.506+0000 7f9c18c41640 1 --2- 172.21.15.60:0/3523784470 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9bf806be30 0x7f9bf806e2f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9c04009560 tx=0x7f9c04009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:24.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.513+0000 7f9c1b6a6640 1 --2- 172.21.15.60:0/3523784470 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c141ebeb0 0x7f9c141e92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:24.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.513+0000 7f9c1b6a6640 1 -- 172.21.15.60:0/3523784470 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9c141ec5c0 con 0x7f9c141ebeb0 2024-09-12T02:29:24.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.513+0000 7f9c19442640 1 --2- 172.21.15.60:0/3523784470 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c141ebeb0 0x7f9c141e92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:24.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.514+0000 7f9c19442640 1 -- 172.21.15.60:0/3523784470 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9c14156270 con 0x7f9c141ebeb0 2024-09-12T02:29:24.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.514+0000 7f9c19442640 1 --2- 172.21.15.60:0/3523784470 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c141ebeb0 0x7f9c141e92d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9c10000f60 tx=0x7f9c100010a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:24.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.514+0000 7f9c09ffb640 1 -- 172.21.15.60:0/3523784470 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1000db30 con 0x7f9c141ebeb0 2024-09-12T02:29:24.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.514+0000 7f9c09ffb640 1 -- 172.21.15.60:0/3523784470 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5050 (secure 0 0 0) 0x7f9c1000db30 con 0x7f9c141ebeb0 2024-09-12T02:29:24.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.514+0000 7f9c09ffb640 1 -- 172.21.15.60:0/3523784470 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c141ebeb0 msgr2=0x7f9c141e92d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:24.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.514+0000 7f9c09ffb640 1 --2- 172.21.15.60:0/3523784470 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c141ebeb0 0x7f9c141e92d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9c10000f60 tx=0x7f9c100010a0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.514+0000 7f9c09ffb640 1 -- 172.21.15.60:0/3523784470 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c141ebeb0 msgr2=0x7f9c141e92d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:29:24.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.514+0000 7f9c09ffb640 1 --2- 172.21.15.60:0/3523784470 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c141ebeb0 0x7f9c141e92d0 secure :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9c10000f60 tx=0x7f9c100010a0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.516 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:29:24.516 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:29:24.516 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:29:24.516 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:29:24.516 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 64, 2024-09-12T02:29:24.516 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 309948, 2024-09-12T02:29:24.516 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:29:24.516 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:29:24.516 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:29:24.516 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:29:24.517 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:24.517 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 2, 2024-09-12T02:29:24.517 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:29:24.517 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:29:24.517 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:29:24.517 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:29:24.517 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:29:24.517 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:29:24.517 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:29:24.518 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:29:24.518 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:29:24.518 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:29:24.518 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:29:24.518 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:29:24.518 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:29:24.518 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:29:24.518 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:24.518 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:29:24.518 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:29:24.518 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:29:24.518 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:29:24.518 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:29:24.519 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:29:24.519 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:29:24.519 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:29:24.519 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:29:24.519 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:29:24.519 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:29:24.519 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:29:24.519 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:29:24.519 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:24.519 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:24.519 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:29:24.519 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:29:24.519 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:29:24.520 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:29:24.520 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:29:24.520 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:29:24.520 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:29:24.520 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:29:24.520 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:29:24.520 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:29:24.520 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:29:24.520 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:29:24.520 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:29:24.520 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:29:24.520 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:29:24.520 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:29:24.521 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:29:24.521 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:29:24.521 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:29:24.521 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:29:24.521 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:29:24.521 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:29:24.521 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:29:24.521 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:29:24.521 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:29:24.521 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:29:24.521 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:29:24.521 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:29:24.521 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:24.521 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:29:24.522 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:24.522 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:29:24.522 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:24.522 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:29:24.522 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:29:24.522 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:29:24.522 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:29:24.522 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:24.522 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:29:24.522 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:29:24.522 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:24.522 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:24.522 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:24.522 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:29:24.523 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:29:24.523 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:24.523 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:24.523 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:24.523 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:24.523 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:29:24.523 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:29:24.523 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:29:24.523 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:29:24.523 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:29:24.523 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:24.523 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:24.523 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:29:24.524 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:29:24.524 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:29:24.524 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:29:24.524 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:24.524 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:29:24.524 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:29:24.524 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:24.524 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:24.524 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:24.524 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:29:24.524 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:29:24.524 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:24.524 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:24.524 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:24.525 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:24.525 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:29:24.525 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:29:24.525 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:29:24.525 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:29:24.525 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:29:24.525 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:24.525 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:24.525 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:29:24.525 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:29:24.526 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:29:24.526 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:29:24.526 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:24.526 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:29:24.526 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:29:24.526 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:24.526 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:24.526 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:24.526 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:29:24.526 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:29:24.526 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:24.526 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:24.527 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:24.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:24.527 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:29:24.527 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:29:24.527 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:29:24.527 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:29:24.527 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:29:24.527 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:24.527 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:24.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:24.528 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:29:24.528 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:29:24.528 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:24.528 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:29:24.528 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:29:24.528 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:29:24.528 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:24.528 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:24.528 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:29:24.528 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:24.528 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:29:24.528 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:29:24.528 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:29:24.528 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:24.529 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:24.529 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:29:24.529 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:24.529 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:29:24.529 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:29:24.529 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-09-12T02:29:24.529 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:24.529 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:24.529 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:29:24.529 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:24.529 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:29:24.529 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:29:24.529 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-09-12T02:29:24.530 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:24.530 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:24.530 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:29:24.530 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:24.530 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:29:24.530 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:29:24.530 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:29:24.530 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:24.530 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:24.530 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:24.530 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:29:24.530 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:29:24.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.515+0000 7f9c1b6a6640 1 -- 172.21.15.60:0/3523784470 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9bf806be30 msgr2=0x7f9bf806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:24.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.515+0000 7f9c1b6a6640 1 --2- 172.21.15.60:0/3523784470 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9bf806be30 0x7f9bf806e2f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9c04009560 tx=0x7f9c04009190 comp rx=0 tx=0).stop 2024-09-12T02:29:24.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.515+0000 7f9c1b6a6640 1 -- 172.21.15.60:0/3523784470 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c14150480 msgr2=0x7f9c141ec8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:24.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.515+0000 7f9c1b6a6640 1 --2- 172.21.15.60:0/3523784470 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c14150480 0x7f9c141ec8a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c02ac50 tx=0x7f9c0c004a40 comp rx=0 tx=0).stop 2024-09-12T02:29:24.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.515+0000 7f9c19c43640 1 -- 172.21.15.60:0/3523784470 reap_dead start 2024-09-12T02:29:24.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.515+0000 7f9c19c43640 1 -- 172.21.15.60:0/3523784470 reap_dead start 2024-09-12T02:29:24.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.515+0000 7f9c1b6a6640 1 -- 172.21.15.60:0/3523784470 shutdown_connections 2024-09-12T02:29:24.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.515+0000 7f9c1b6a6640 1 -- 172.21.15.60:0/3523784470 >> 172.21.15.60:0/3523784470 conn(0x7f9c14068030 msgr2=0x7f9c140acee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:24.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.515+0000 7f9c1b6a6640 1 -- 172.21.15.60:0/3523784470 shutdown_connections 2024-09-12T02:29:24.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.515+0000 7f9c1b6a6640 1 -- 172.21.15.60:0/3523784470 wait complete. 2024-09-12T02:29:24.533 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:29:24.533 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-12T02:29:24.533 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-12T02:29:24.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.639+0000 7f8f2790a640 1 Processor -- start 2024-09-12T02:29:24.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.639+0000 7f8f2790a640 1 -- start start 2024-09-12T02:29:24.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.640+0000 7f8f2790a640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8f20073ae0 0x7f8f20153380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:24.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.640+0000 7f8f2790a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8f200733d0 0x7f8f201538c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:24.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.640+0000 7f8f2790a640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f2006dd50 con 0x7f8f2006d850 2024-09-12T02:29:24.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.640+0000 7f8f2790a640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f8f2006e030 con 0x7f8f200733d0 2024-09-12T02:29:24.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.640+0000 7f8f2790a640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f8f2006e310 con 0x7f8f20073ae0 2024-09-12T02:29:24.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.640+0000 7f8f24ea5640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8f200733d0 0x7f8f201538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:24.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.640+0000 7f8f24ea5640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8f200733d0 0x7f8f201538c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33668/0 (socket says 172.21.15.60:33668) 2024-09-12T02:29:24.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.640+0000 7f8f24ea5640 1 -- 172.21.15.60:0/2450542782 learned_addr learned my addr 172.21.15.60:0/2450542782 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:29:24.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.640+0000 7f8f256a6640 1 --2- 172.21.15.60:0/2450542782 >> v2:172.21.15.105:3300/0 conn(0x7f8f20073ae0 0x7f8f20153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:24.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.641+0000 7f8f24ea5640 1 -- 172.21.15.60:0/2450542782 >> v2:172.21.15.105:3300/0 conn(0x7f8f20073ae0 msgr2=0x7f8f20153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:24.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.641+0000 7f8f24ea5640 1 --2- 172.21.15.60:0/2450542782 >> v2:172.21.15.105:3300/0 conn(0x7f8f20073ae0 0x7f8f20153380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.641+0000 7f8f24ea5640 1 -- 172.21.15.60:0/2450542782 >> v1:172.21.15.105:6789/0 conn(0x7f8f2006d850 legacy=0x7f8f20156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:24.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.641+0000 7f8f17fff640 1 -- 172.21.15.60:0/2450542782 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1380172330 0 0) 0x7f8f2006dd50 con 0x7f8f2006d850 2024-09-12T02:29:24.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.641+0000 7f8f24ea5640 1 -- 172.21.15.60:0/2450542782 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f2006e5f0 con 0x7f8f200733d0 2024-09-12T02:29:24.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.642+0000 7f8f24ea5640 1 --2- 172.21.15.60:0/2450542782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f200733d0 0x7f8f201538c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8f20076720 tx=0x7f8f1002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb3c5f58a4413a0a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:24.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.642+0000 7f8f17fff640 1 -- 172.21.15.60:0/2450542782 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f10037070 con 0x7f8f200733d0 2024-09-12T02:29:24.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.642+0000 7f8f17fff640 1 -- 172.21.15.60:0/2450542782 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f10032440 con 0x7f8f200733d0 2024-09-12T02:29:24.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.642+0000 7f8f17fff640 1 -- 172.21.15.60:0/2450542782 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f10032810 con 0x7f8f200733d0 2024-09-12T02:29:24.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.642+0000 7f8f2790a640 1 -- 172.21.15.60:0/2450542782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f200733d0 msgr2=0x7f8f201538c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:24.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.642+0000 7f8f2790a640 1 --2- 172.21.15.60:0/2450542782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f200733d0 0x7f8f201538c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8f20076720 tx=0x7f8f1002a270 comp rx=0 tx=0).stop 2024-09-12T02:29:24.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.642+0000 7f8f2790a640 1 -- 172.21.15.60:0/2450542782 shutdown_connections 2024-09-12T02:29:24.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.642+0000 7f8f2790a640 1 --2- 172.21.15.60:0/2450542782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f200733d0 0x7f8f201538c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.642+0000 7f8f2790a640 1 --2- 172.21.15.60:0/2450542782 >> v2:172.21.15.105:3300/0 conn(0x7f8f20073ae0 0x7f8f20153380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.642+0000 7f8f2790a640 1 -- 172.21.15.60:0/2450542782 >> 172.21.15.60:0/2450542782 conn(0x7f8f200c9d80 msgr2=0x7f8f200ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:24.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.643+0000 7f8f2790a640 1 -- 172.21.15.60:0/2450542782 shutdown_connections 2024-09-12T02:29:24.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.643+0000 7f8f2790a640 1 -- 172.21.15.60:0/2450542782 wait complete. 2024-09-12T02:29:24.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.644+0000 7f8f2790a640 1 Processor -- start 2024-09-12T02:29:24.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.644+0000 7f8f2790a640 1 -- start start 2024-09-12T02:29:24.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.644+0000 7f8f2790a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f2006d850 0x7f8f201efa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:24.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.644+0000 7f8f2790a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f200733d0 0x7f8f2014f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:24.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.644+0000 7f8f2790a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f20073ae0 0x7f8f200c9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:24.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.645+0000 7f8f2790a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8f2006edd0 con 0x7f8f200733d0 2024-09-12T02:29:24.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.645+0000 7f8f2790a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8f2006ec50 con 0x7f8f2006d850 2024-09-12T02:29:24.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.645+0000 7f8f2790a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8f20073ec0 con 0x7f8f20073ae0 2024-09-12T02:29:24.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.645+0000 7f8f24ea5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f200733d0 0x7f8f2014f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:24.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.645+0000 7f8f256a6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f2006d850 0x7f8f201efa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:24.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.645+0000 7f8f256a6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f2006d850 0x7f8f201efa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:49452/0 (socket says 172.21.15.60:49452) 2024-09-12T02:29:24.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.645+0000 7f8f24ea5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f200733d0 0x7f8f2014f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33678/0 (socket says 172.21.15.60:33678) 2024-09-12T02:29:24.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.645+0000 7f8f256a6640 1 -- 172.21.15.60:0/25218421 learned_addr learned my addr 172.21.15.60:0/25218421 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:29:24.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.645+0000 7f8f25ea7640 1 --2- 172.21.15.60:0/25218421 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f20073ae0 0x7f8f200c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:24.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.645+0000 7f8f256a6640 1 -- 172.21.15.60:0/25218421 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f20073ae0 msgr2=0x7f8f200c9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:24.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.645+0000 7f8f256a6640 1 --2- 172.21.15.60:0/25218421 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f20073ae0 0x7f8f200c9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.645+0000 7f8f256a6640 1 -- 172.21.15.60:0/25218421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f200733d0 msgr2=0x7f8f2014f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:24.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.645+0000 7f8f256a6640 1 --2- 172.21.15.60:0/25218421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f200733d0 0x7f8f2014f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.645+0000 7f8f256a6640 1 -- 172.21.15.60:0/25218421 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f200c55e0 con 0x7f8f2006d850 2024-09-12T02:29:24.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.645+0000 7f8f24ea5640 1 --2- 172.21.15.60:0/25218421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f200733d0 0x7f8f2014f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:29:24.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.645+0000 7f8f256a6640 1 --2- 172.21.15.60:0/25218421 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f2006d850 0x7f8f201efa30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c00e870 tx=0x7f8f1c00ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:24.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.645+0000 7f8f15ffb640 1 -- 172.21.15.60:0/25218421 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c017070 con 0x7f8f2006d850 2024-09-12T02:29:24.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.645+0000 7f8f15ffb640 1 -- 172.21.15.60:0/25218421 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f1c00c940 con 0x7f8f2006d850 2024-09-12T02:29:24.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.645+0000 7f8f15ffb640 1 -- 172.21.15.60:0/25218421 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c00cd30 con 0x7f8f2006d850 2024-09-12T02:29:24.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.646+0000 7f8f2790a640 1 -- 172.21.15.60:0/25218421 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f2014da30 con 0x7f8f2006d850 2024-09-12T02:29:24.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.646+0000 7f8f2790a640 1 -- 172.21.15.60:0/25218421 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f201ebe20 con 0x7f8f2006d850 2024-09-12T02:29:24.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.647+0000 7f8f2790a640 1 --2- 172.21.15.60:0/25218421 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f2014dc50 0x7f8f201ec340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:24.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.647+0000 7f8f2790a640 1 -- 172.21.15.60:0/25218421 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8f20072c50 con 0x7f8f2014dc50 2024-09-12T02:29:24.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.647+0000 7f8f24ea5640 1 --2- 172.21.15.60:0/25218421 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f2014dc50 0x7f8f201ec340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:24.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.647+0000 7f8f24ea5640 1 -- 172.21.15.60:0/25218421 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8f2014c6b0 con 0x7f8f2014dc50 2024-09-12T02:29:24.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.647+0000 7f8f24ea5640 1 --2- 172.21.15.60:0/25218421 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f2014dc50 0x7f8f201ec340 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8f200b0110 tx=0x7f8f100046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:24.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.648+0000 7f8f15ffb640 1 -- 172.21.15.60:0/25218421 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f10043070 con 0x7f8f2014dc50 2024-09-12T02:29:24.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.648+0000 7f8f15ffb640 1 -- 172.21.15.60:0/25218421 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8f1c01a070 con 0x7f8f2006d850 2024-09-12T02:29:24.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.648+0000 7f8f15ffb640 1 --2- 172.21.15.60:0/25218421 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8f0406bd30 0x7f8f0406e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:24.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.648+0000 7f8f15ffb640 1 -- 172.21.15.60:0/25218421 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f8f1c08b010 con 0x7f8f2006d850 2024-09-12T02:29:24.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.648+0000 7f8f25ea7640 1 --2- 172.21.15.60:0/25218421 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8f0406bd30 0x7f8f0406e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:24.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.648+0000 7f8f15ffb640 1 -- 172.21.15.60:0/25218421 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f8f10032440 con 0x7f8f2014dc50 2024-09-12T02:29:24.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.648+0000 7f8f15ffb640 1 -- 172.21.15.60:0/25218421 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f2014dc50 msgr2=0x7f8f201ec340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:24.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.648+0000 7f8f15ffb640 1 --2- 172.21.15.60:0/25218421 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f2014dc50 0x7f8f201ec340 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8f200b0110 tx=0x7f8f100046c0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.648+0000 7f8f15ffb640 1 -- 172.21.15.60:0/25218421 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f2014dc50 msgr2=0x7f8f201ec340 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:29:24.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.648+0000 7f8f15ffb640 1 --2- 172.21.15.60:0/25218421 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f2014dc50 0x7f8f201ec340 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8f200b0110 tx=0x7f8f100046c0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.649+0000 7f8f25ea7640 1 --2- 172.21.15.60:0/25218421 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8f0406bd30 0x7f8f0406e1f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8f201eba70 tx=0x7f8f18009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:24.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.655+0000 7f8f2790a640 1 --2- 172.21.15.60:0/25218421 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f201558a0 0x7f8f201e8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:24.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.655+0000 7f8f2790a640 1 -- 172.21.15.60:0/25218421 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8f2014c3d0 con 0x7f8f201558a0 2024-09-12T02:29:24.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.655+0000 7f8f24ea5640 1 --2- 172.21.15.60:0/25218421 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f201558a0 0x7f8f201e8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:24.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.655+0000 7f8f24ea5640 1 -- 172.21.15.60:0/25218421 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8f2014c0f0 con 0x7f8f201558a0 2024-09-12T02:29:24.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.655+0000 7f8f24ea5640 1 --2- 172.21.15.60:0/25218421 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f201558a0 0x7f8f201e8e50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8f20142730 tx=0x7f8f10009240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:24.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.656+0000 7f8f15ffb640 1 -- 172.21.15.60:0/25218421 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f10037040 con 0x7f8f201558a0 2024-09-12T02:29:24.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.656+0000 7f8f15ffb640 1 -- 172.21.15.60:0/25218421 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4882 (secure 0 0 0) 0x7f8f1003d930 con 0x7f8f201558a0 2024-09-12T02:29:24.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.656+0000 7f8f15ffb640 1 -- 172.21.15.60:0/25218421 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f201558a0 msgr2=0x7f8f201e8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:24.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.656+0000 7f8f15ffb640 1 --2- 172.21.15.60:0/25218421 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f201558a0 0x7f8f201e8e50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8f20142730 tx=0x7f8f10009240 comp rx=0 tx=0).stop 2024-09-12T02:29:24.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.656+0000 7f8f15ffb640 1 -- 172.21.15.60:0/25218421 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f201558a0 msgr2=0x7f8f201e8e50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:29:24.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.656+0000 7f8f15ffb640 1 --2- 172.21.15.60:0/25218421 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f201558a0 0x7f8f201e8e50 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8f20142730 tx=0x7f8f10009240 comp rx=0 tx=0).stop 2024-09-12T02:29:24.657 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:29:24.657 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:29:24.657 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:29:24.657 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:29:24.658 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 64, 2024-09-12T02:29:24.658 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 84722, 2024-09-12T02:29:24.658 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:29:24.658 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:29:24.658 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:29:24.658 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:29:24.658 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:24.658 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 2, 2024-09-12T02:29:24.658 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:29:24.658 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:29:24.658 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:29:24.658 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:29:24.658 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:29:24.659 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:29:24.659 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:29:24.659 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:29:24.659 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:29:24.659 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:29:24.659 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:29:24.659 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:29:24.659 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:29:24.659 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:29:24.659 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:24.659 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:29:24.659 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:29:24.659 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:29:24.660 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:29:24.660 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:29:24.660 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:29:24.660 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:29:24.660 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:29:24.660 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:29:24.660 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:29:24.660 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:29:24.660 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:29:24.660 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:29:24.660 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:24.660 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:24.660 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:29:24.661 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:29:24.661 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:29:24.661 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:29:24.661 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:29:24.661 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:29:24.661 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:29:24.661 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:29:24.661 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:29:24.661 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:29:24.661 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:29:24.661 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:29:24.661 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:29:24.661 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:29:24.662 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:29:24.662 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:29:24.662 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:29:24.662 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:29:24.662 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:29:24.662 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:29:24.662 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:29:24.662 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:29:24.662 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:29:24.662 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:29:24.662 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:29:24.662 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:29:24.663 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:29:24.663 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:29:24.663 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:24.663 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:29:24.663 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:24.663 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:29:24.663 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:24.663 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:29:24.663 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:29:24.663 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:29:24.663 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:29:24.663 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:24.663 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:29:24.664 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:29:24.664 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:24.664 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:24.664 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:24.664 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:29:24.664 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:29:24.664 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:24.664 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:24.664 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:24.664 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:24.664 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:29:24.664 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:29:24.665 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:29:24.665 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:29:24.665 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:29:24.665 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:24.665 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:24.665 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:29:24.665 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:29:24.665 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:29:24.665 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:29:24.665 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:24.665 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:29:24.665 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:29:24.666 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:24.666 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:24.666 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:24.666 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:29:24.666 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:29:24.666 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:24.666 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:24.666 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:24.666 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:24.666 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:29:24.666 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:29:24.666 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:29:24.666 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:29:24.667 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:29:24.667 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:24.667 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:24.667 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:29:24.667 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:29:24.667 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:29:24.667 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:29:24.667 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:24.667 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:29:24.667 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:29:24.667 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:24.667 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:24.667 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:24.668 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:29:24.668 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:29:24.668 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:24.668 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:24.668 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:24.668 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:24.668 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:29:24.668 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:29:24.668 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:29:24.668 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:29:24.668 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:29:24.668 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:24.668 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:24.669 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:24.669 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:29:24.669 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:29:24.669 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:24.669 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:29:24.669 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:29:24.669 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:29:24.669 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:24.669 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:24.669 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:29:24.669 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:24.669 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:29:24.669 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:29:24.669 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:29:24.670 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:24.670 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:24.670 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:29:24.670 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:24.670 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:29:24.670 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:29:24.670 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:29:24.670 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:24.670 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:24.670 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:29:24.670 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:24.670 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:29:24.670 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:29:24.670 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:29:24.671 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:24.671 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:24.671 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:24.671 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:29:24.671 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:29:24.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.656+0000 7f8f2790a640 1 -- 172.21.15.60:0/25218421 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8f0406bd30 msgr2=0x7f8f0406e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:24.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.656+0000 7f8f2790a640 1 --2- 172.21.15.60:0/25218421 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8f0406bd30 0x7f8f0406e1f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8f201eba70 tx=0x7f8f18009040 comp rx=0 tx=0).stop 2024-09-12T02:29:24.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.656+0000 7f8f2790a640 1 -- 172.21.15.60:0/25218421 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f2006d850 msgr2=0x7f8f201efa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:24.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.656+0000 7f8f2790a640 1 --2- 172.21.15.60:0/25218421 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f2006d850 0x7f8f201efa30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c00e870 tx=0x7f8f1c00ed30 comp rx=0 tx=0).stop 2024-09-12T02:29:24.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.656+0000 7f8f25ea7640 1 -- 172.21.15.60:0/25218421 reap_dead start 2024-09-12T02:29:24.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.656+0000 7f8f25ea7640 1 -- 172.21.15.60:0/25218421 reap_dead start 2024-09-12T02:29:24.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.656+0000 7f8f2790a640 1 -- 172.21.15.60:0/25218421 shutdown_connections 2024-09-12T02:29:24.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.656+0000 7f8f2790a640 1 -- 172.21.15.60:0/25218421 >> 172.21.15.60:0/25218421 conn(0x7f8f200c9d80 msgr2=0x7f8f20153360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:24.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.656+0000 7f8f2790a640 1 -- 172.21.15.60:0/25218421 shutdown_connections 2024-09-12T02:29:24.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.656+0000 7f8f2790a640 1 -- 172.21.15.60:0/25218421 wait complete. 2024-09-12T02:29:24.673 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:29:24.673 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-12T02:29:24.673 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-12T02:29:24.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.788+0000 7f69ee911640 1 Processor -- start 2024-09-12T02:29:24.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.788+0000 7f69ee911640 1 -- start start 2024-09-12T02:29:24.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.789+0000 7f69ee911640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f69e8150480 0x7f69e80c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:24.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.789+0000 7f69ee911640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f69e806c650 0x7f69e80c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:24.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.789+0000 7f69ee911640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69e815a7c0 con 0x7f69e80c9c80 2024-09-12T02:29:24.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.789+0000 7f69ee911640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f69e806c240 con 0x7f69e8150480 2024-09-12T02:29:24.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.789+0000 7f69ee911640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f69e815a330 con 0x7f69e806c650 2024-09-12T02:29:24.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.789+0000 7f69e7fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f69e8150480 0x7f69e80c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:24.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.789+0000 7f69eceae640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f69e80c9c80 0x7f69e80ca0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:39106/0 (socket says 172.21.15.60:39106) 2024-09-12T02:29:24.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.789+0000 7f69eceae640 1 -- 172.21.15.60:0/439015264 learned_addr learned my addr 172.21.15.60:0/439015264 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:29:24.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.789+0000 7f69e77fe640 1 --2- 172.21.15.60:0/439015264 >> v2:172.21.15.105:3300/0 conn(0x7f69e806c650 0x7f69e80c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:24.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.789+0000 7f69e7fff640 1 -- 172.21.15.60:0/439015264 >> v2:172.21.15.105:3300/0 conn(0x7f69e806c650 msgr2=0x7f69e80c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:24.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.789+0000 7f69e7fff640 1 --2- 172.21.15.60:0/439015264 >> v2:172.21.15.105:3300/0 conn(0x7f69e806c650 0x7f69e80c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.789+0000 7f69e7fff640 1 -- 172.21.15.60:0/439015264 >> v1:172.21.15.60:6789/0 conn(0x7f69e80c9c80 legacy=0x7f69e80ca0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:24.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.789+0000 7f69e6ffd640 1 -- 172.21.15.60:0/439015264 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3258066126 0 0) 0x7f69e815a7c0 con 0x7f69e80c9c80 2024-09-12T02:29:24.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.789+0000 7f69e7fff640 1 -- 172.21.15.60:0/439015264 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69e8159a00 con 0x7f69e8150480 2024-09-12T02:29:24.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.790+0000 7f69e7fff640 1 --2- 172.21.15.60:0/439015264 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69e8150480 0x7f69e80c7a90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f69e80c6110 tx=0x7f69d802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4ecb79c0e654194 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:24.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.790+0000 7f69e6ffd640 1 -- 172.21.15.60:0/439015264 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d8037070 con 0x7f69e8150480 2024-09-12T02:29:24.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.790+0000 7f69e6ffd640 1 -- 172.21.15.60:0/439015264 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69d8032440 con 0x7f69e8150480 2024-09-12T02:29:24.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.790+0000 7f69e6ffd640 1 -- 172.21.15.60:0/439015264 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d8032810 con 0x7f69e8150480 2024-09-12T02:29:24.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.791+0000 7f69ee911640 1 -- 172.21.15.60:0/439015264 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69e8150480 msgr2=0x7f69e80c7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:24.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.791+0000 7f69ee911640 1 --2- 172.21.15.60:0/439015264 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69e8150480 0x7f69e80c7a90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f69e80c6110 tx=0x7f69d802a1a0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.791+0000 7f69ee911640 1 -- 172.21.15.60:0/439015264 shutdown_connections 2024-09-12T02:29:24.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.791+0000 7f69ee911640 1 --2- 172.21.15.60:0/439015264 >> v2:172.21.15.105:3300/0 conn(0x7f69e806c650 0x7f69e80c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.791+0000 7f69ee911640 1 --2- 172.21.15.60:0/439015264 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69e8150480 0x7f69e80c7a90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.791+0000 7f69ee911640 1 -- 172.21.15.60:0/439015264 >> 172.21.15.60:0/439015264 conn(0x7f69e8068030 msgr2=0x7f69e8073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:24.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.791+0000 7f69ee911640 1 -- 172.21.15.60:0/439015264 shutdown_connections 2024-09-12T02:29:24.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.791+0000 7f69ee911640 1 -- 172.21.15.60:0/439015264 wait complete. 2024-09-12T02:29:24.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.792+0000 7f69ee911640 1 Processor -- start 2024-09-12T02:29:24.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.793+0000 7f69ee911640 1 -- start start 2024-09-12T02:29:24.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.793+0000 7f69ee911640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69e806c650 0x7f69e8157430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:24.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.793+0000 7f69ee911640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69e80c9c80 0x7f69e814f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:24.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.793+0000 7f69ee911640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69e8150480 0x7f69e8146760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:24.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.793+0000 7f69ee911640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f69e806d270 con 0x7f69e806c650 2024-09-12T02:29:24.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.793+0000 7f69ee911640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f69e8159fc0 con 0x7f69e80c9c80 2024-09-12T02:29:24.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.793+0000 7f69ee911640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f69e8156270 con 0x7f69e8150480 2024-09-12T02:29:24.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.793+0000 7f69e7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69e806c650 0x7f69e8157430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:24.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.793+0000 7f69e7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69e806c650 0x7f69e8157430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33704/0 (socket says 172.21.15.60:33704) 2024-09-12T02:29:24.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.794+0000 7f69e7fff640 1 -- 172.21.15.60:0/2631163459 learned_addr learned my addr 172.21.15.60:0/2631163459 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:29:24.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.794+0000 7f69e77fe640 1 --2- 172.21.15.60:0/2631163459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69e80c9c80 0x7f69e814f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:24.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.794+0000 7f69eceae640 1 --2- 172.21.15.60:0/2631163459 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69e8150480 0x7f69e8146760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:24.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.794+0000 7f69e7fff640 1 -- 172.21.15.60:0/2631163459 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69e8150480 msgr2=0x7f69e8146760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:24.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.794+0000 7f69e7fff640 1 --2- 172.21.15.60:0/2631163459 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69e8150480 0x7f69e8146760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.794+0000 7f69e7fff640 1 -- 172.21.15.60:0/2631163459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69e80c9c80 msgr2=0x7f69e814f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:24.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.794+0000 7f69e7fff640 1 --2- 172.21.15.60:0/2631163459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69e80c9c80 0x7f69e814f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:24.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.794+0000 7f69e7fff640 1 -- 172.21.15.60:0/2631163459 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69e8157a10 con 0x7f69e806c650 2024-09-12T02:29:24.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.794+0000 7f69e7fff640 1 --2- 172.21.15.60:0/2631163459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69e806c650 0x7f69e8157430 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f69d8009890 tx=0x7f69d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:24.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.794+0000 7f69e4ff9640 1 -- 172.21.15.60:0/2631163459 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d8037040 con 0x7f69e806c650 2024-09-12T02:29:24.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.794+0000 7f69e4ff9640 1 -- 172.21.15.60:0/2631163459 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69d8042070 con 0x7f69e806c650 2024-09-12T02:29:24.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.794+0000 7f69ee911640 1 -- 172.21.15.60:0/2631163459 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69e81ecf60 con 0x7f69e806c650 2024-09-12T02:29:24.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.794+0000 7f69e4ff9640 1 -- 172.21.15.60:0/2631163459 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d8030960 con 0x7f69e806c650 2024-09-12T02:29:24.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.794+0000 7f69ee911640 1 -- 172.21.15.60:0/2631163459 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69e81ed520 con 0x7f69e806c650 2024-09-12T02:29:24.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.795+0000 7f69ee911640 1 -- 172.21.15.60:0/2631163459 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69e80ca0f0 con 0x7f69e806c650 2024-09-12T02:29:24.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.796+0000 7f69e4ff9640 1 -- 172.21.15.60:0/2631163459 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f69d8030b00 con 0x7f69e806c650 2024-09-12T02:29:24.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.797+0000 7f69e4ff9640 1 --2- 172.21.15.60:0/2631163459 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f69d406be60 0x7f69d406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:24.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.797+0000 7f69e4ff9640 1 -- 172.21.15.60:0/2631163459 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f69d80ab970 con 0x7f69e806c650 2024-09-12T02:29:24.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.797+0000 7f69e77fe640 1 --2- 172.21.15.60:0/2631163459 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f69d406be60 0x7f69d406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:24.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.797+0000 7f69e77fe640 1 --2- 172.21.15.60:0/2631163459 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f69d406be60 0x7f69d406e320 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f69e814dde0 tx=0x7f69dc009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:24.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:24.802+0000 7f69e4ff9640 1 -- 172.21.15.60:0/2631163459 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f69d80799c0 con 0x7f69e806c650 2024-09-12T02:29:25.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:25.070+0000 7f69ee911640 1 -- 172.21.15.60:0/2631163459 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f69e80ad3b0 con 0x7f69e806c650 2024-09-12T02:29:25.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:25.071+0000 7f69e4ff9640 1 -- 172.21.15.60:0/2631163459 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f69d807dcc0 con 0x7f69e806c650 2024-09-12T02:29:25.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:25.074+0000 7f69ee911640 1 -- 172.21.15.60:0/2631163459 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f69d406be60 msgr2=0x7f69d406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:25.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:25.074+0000 7f69ee911640 1 --2- 172.21.15.60:0/2631163459 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f69d406be60 0x7f69d406e320 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f69e814dde0 tx=0x7f69dc009190 comp rx=0 tx=0).stop 2024-09-12T02:29:25.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:25.074+0000 7f69ee911640 1 -- 172.21.15.60:0/2631163459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69e806c650 msgr2=0x7f69e8157430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:25.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:25.074+0000 7f69ee911640 1 --2- 172.21.15.60:0/2631163459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69e806c650 0x7f69e8157430 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f69d8009890 tx=0x7f69d80046c0 comp rx=0 tx=0).stop 2024-09-12T02:29:25.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:25.074+0000 7f69ee911640 1 -- 172.21.15.60:0/2631163459 shutdown_connections 2024-09-12T02:29:25.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:25.074+0000 7f69ee911640 1 --2- 172.21.15.60:0/2631163459 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f69d406be60 0x7f69d406e320 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:25.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:25.074+0000 7f69ee911640 1 --2- 172.21.15.60:0/2631163459 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69e8150480 0x7f69e8146760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:25.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:25.074+0000 7f69ee911640 1 --2- 172.21.15.60:0/2631163459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69e80c9c80 0x7f69e814f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:25.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:25.074+0000 7f69ee911640 1 --2- 172.21.15.60:0/2631163459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69e806c650 0x7f69e8157430 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:25.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:25.074+0000 7f69ee911640 1 -- 172.21.15.60:0/2631163459 >> 172.21.15.60:0/2631163459 conn(0x7f69e8068030 msgr2=0x7f69e8155610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:25.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:25.074+0000 7f69ee911640 1 -- 172.21.15.60:0/2631163459 shutdown_connections 2024-09-12T02:29:25.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:25.074+0000 7f69ee911640 1 -- 172.21.15.60:0/2631163459 wait complete. 2024-09-12T02:29:25.088 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-12T02:29:27.682 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:29:27.685 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:29:35.089 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-12T02:29:35.089 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:29:35.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.207+0000 7f7112d59640 1 Processor -- start 2024-09-12T02:29:35.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.207+0000 7f7112d59640 1 -- start start 2024-09-12T02:29:35.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.208+0000 7f7112d59640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f710c06cd80 0x7f710c153be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:35.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.208+0000 7f7112d59640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f710c15a4a0 0x7f710c156660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:35.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.208+0000 7f7112d59640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f710c0c7070 con 0x7f710c0c8b10 2024-09-12T02:29:35.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.208+0000 7f7112d59640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f710c06d210 con 0x7f710c15a4a0 2024-09-12T02:29:35.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.208+0000 7f7112d59640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f710c0c69b0 con 0x7f710c06cd80 2024-09-12T02:29:35.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.209+0000 7f71112f6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f710c15a4a0 0x7f710c156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:35.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.209+0000 7f710bfff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f710c06cd80 0x7f710c153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:35.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.209+0000 7f7110af5640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f710c0c8b10 0x7f710c1534d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:41202/0 (socket says 172.21.15.60:41202) 2024-09-12T02:29:35.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.209+0000 7f7110af5640 1 -- 172.21.15.60:0/3506341020 learned_addr learned my addr 172.21.15.60:0/3506341020 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:29:35.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.209+0000 7f71112f6640 1 -- 172.21.15.60:0/3506341020 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f710c06cd80 msgr2=0x7f710c153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:35.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.209+0000 7f71112f6640 1 --2- 172.21.15.60:0/3506341020 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f710c06cd80 0x7f710c153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.209+0000 7f71112f6640 1 -- 172.21.15.60:0/3506341020 >> v1:172.21.15.105:6789/0 conn(0x7f710c0c8b10 legacy=0x7f710c1534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:35.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.209+0000 7f710b7fe640 1 -- 172.21.15.60:0/3506341020 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1450827476 0 0) 0x7f710c0c7070 con 0x7f710c0c8b10 2024-09-12T02:29:35.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.209+0000 7f71112f6640 1 -- 172.21.15.60:0/3506341020 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f710c0c6c90 con 0x7f710c15a4a0 2024-09-12T02:29:35.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.210+0000 7f71112f6640 1 --2- 172.21.15.60:0/3506341020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f710c15a4a0 0x7f710c156660 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7104009d90 tx=0x7f710402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d779fe633673e0c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:35.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.210+0000 7f710b7fe640 1 -- 172.21.15.60:0/3506341020 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7104031600 con 0x7f710c15a4a0 2024-09-12T02:29:35.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.210+0000 7f710b7fe640 1 -- 172.21.15.60:0/3506341020 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71040317a0 con 0x7f710c15a4a0 2024-09-12T02:29:35.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.210+0000 7f710b7fe640 1 -- 172.21.15.60:0/3506341020 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7104031b70 con 0x7f710c15a4a0 2024-09-12T02:29:35.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.210+0000 7f7112d59640 1 -- 172.21.15.60:0/3506341020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f710c15a4a0 msgr2=0x7f710c156660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:35.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.210+0000 7f7112d59640 1 --2- 172.21.15.60:0/3506341020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f710c15a4a0 0x7f710c156660 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7104009d90 tx=0x7f710402a5d0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.211+0000 7f7112d59640 1 -- 172.21.15.60:0/3506341020 shutdown_connections 2024-09-12T02:29:35.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.211+0000 7f7112d59640 1 --2- 172.21.15.60:0/3506341020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f710c15a4a0 0x7f710c156660 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.211+0000 7f7112d59640 1 --2- 172.21.15.60:0/3506341020 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f710c06cd80 0x7f710c153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.211+0000 7f7112d59640 1 -- 172.21.15.60:0/3506341020 >> 172.21.15.60:0/3506341020 conn(0x7f710c0adb80 msgr2=0x7f710c0adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:35.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.211+0000 7f7112d59640 1 -- 172.21.15.60:0/3506341020 shutdown_connections 2024-09-12T02:29:35.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.211+0000 7f7112d59640 1 -- 172.21.15.60:0/3506341020 wait complete. 2024-09-12T02:29:35.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.212+0000 7f7112d59640 1 Processor -- start 2024-09-12T02:29:35.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.212+0000 7f7112d59640 1 -- start start 2024-09-12T02:29:35.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.213+0000 7f7112d59640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f710c0c8b10 0x7f710c14ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:35.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.213+0000 7f7112d59640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f710c15a4a0 0x7f710c1ef6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:35.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.213+0000 7f7112d59640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f710c14c940 0x7f710c142470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:35.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.213+0000 7f7112d59640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f710c0c9070 con 0x7f710c0c8b10 2024-09-12T02:29:35.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.213+0000 7f7112d59640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f710c0c8ef0 con 0x7f710c14c940 2024-09-12T02:29:35.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.213+0000 7f7112d59640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f710c156ba0 con 0x7f710c15a4a0 2024-09-12T02:29:35.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.213+0000 7f7110af5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f710c0c8b10 0x7f710c14ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:35.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.213+0000 7f7110af5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f710c0c8b10 0x7f710c14ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52076/0 (socket says 172.21.15.60:52076) 2024-09-12T02:29:35.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.213+0000 7f7110af5640 1 -- 172.21.15.60:0/113980470 learned_addr learned my addr 172.21.15.60:0/113980470 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:29:35.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.213+0000 7f71112f6640 1 --2- 172.21.15.60:0/113980470 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f710c14c940 0x7f710c142470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:35.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.213+0000 7f710bfff640 1 --2- 172.21.15.60:0/113980470 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f710c15a4a0 0x7f710c1ef6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:35.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.213+0000 7f7110af5640 1 -- 172.21.15.60:0/113980470 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f710c15a4a0 msgr2=0x7f710c1ef6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:35.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.213+0000 7f7110af5640 1 --2- 172.21.15.60:0/113980470 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f710c15a4a0 0x7f710c1ef6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.213+0000 7f7110af5640 1 -- 172.21.15.60:0/113980470 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f710c14c940 msgr2=0x7f710c142470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:35.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.213+0000 7f7110af5640 1 --2- 172.21.15.60:0/113980470 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f710c14c940 0x7f710c142470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.213+0000 7f7110af5640 1 -- 172.21.15.60:0/113980470 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f710c1555f0 con 0x7f710c0c8b10 2024-09-12T02:29:35.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.214+0000 7f7110af5640 1 --2- 172.21.15.60:0/113980470 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f710c0c8b10 0x7f710c14ce90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f710000c4d0 tx=0x7f710000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:35.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.214+0000 7f71097fa640 1 -- 172.21.15.60:0/113980470 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7100018070 con 0x7f710c0c8b10 2024-09-12T02:29:35.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.214+0000 7f71097fa640 1 -- 172.21.15.60:0/113980470 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7100007500 con 0x7f710c0c8b10 2024-09-12T02:29:35.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.214+0000 7f7112d59640 1 -- 172.21.15.60:0/113980470 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f710c1eff80 con 0x7f710c0c8b10 2024-09-12T02:29:35.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.214+0000 7f71097fa640 1 -- 172.21.15.60:0/113980470 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7100004a20 con 0x7f710c0c8b10 2024-09-12T02:29:35.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.214+0000 7f7112d59640 1 -- 172.21.15.60:0/113980470 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f710c14fcb0 con 0x7f710c0c8b10 2024-09-12T02:29:35.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.215+0000 7f7112d59640 1 -- 172.21.15.60:0/113980470 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f710c15aa90 con 0x7f710c0c8b10 2024-09-12T02:29:35.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.216+0000 7f71097fa640 1 -- 172.21.15.60:0/113980470 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f710001b070 con 0x7f710c0c8b10 2024-09-12T02:29:35.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.216+0000 7f71097fa640 1 --2- 172.21.15.60:0/113980470 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f70f006be60 0x7f70f006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:35.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.216+0000 7f71097fa640 1 -- 172.21.15.60:0/113980470 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f710008a4b0 con 0x7f710c0c8b10 2024-09-12T02:29:35.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.216+0000 7f710bfff640 1 --2- 172.21.15.60:0/113980470 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f70f006be60 0x7f70f006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:35.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.217+0000 7f710bfff640 1 --2- 172.21.15.60:0/113980470 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f70f006be60 0x7f70f006e320 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f710c14c8f0 tx=0x7f70f8009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:35.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.222+0000 7f71097fa640 1 -- 172.21.15.60:0/113980470 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f710c15aa90 con 0x7f710c0c8b10 2024-09-12T02:29:35.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.493+0000 7f7112d59640 1 -- 172.21.15.60:0/113980470 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f710c150b10 con 0x7f710c0c8b10 2024-09-12T02:29:35.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.494+0000 7f71097fa640 1 -- 172.21.15.60:0/113980470 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f7100058500 con 0x7f710c0c8b10 2024-09-12T02:29:35.494 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":64,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:29:35.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.496+0000 7f7112d59640 1 -- 172.21.15.60:0/113980470 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f70f006be60 msgr2=0x7f70f006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:35.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.496+0000 7f7112d59640 1 --2- 172.21.15.60:0/113980470 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f70f006be60 0x7f70f006e320 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f710c14c8f0 tx=0x7f70f8009190 comp rx=0 tx=0).stop 2024-09-12T02:29:35.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.496+0000 7f7112d59640 1 -- 172.21.15.60:0/113980470 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f710c0c8b10 msgr2=0x7f710c14ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:35.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.496+0000 7f7112d59640 1 --2- 172.21.15.60:0/113980470 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f710c0c8b10 0x7f710c14ce90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f710000c4d0 tx=0x7f710000c990 comp rx=0 tx=0).stop 2024-09-12T02:29:35.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.496+0000 7f7112d59640 1 -- 172.21.15.60:0/113980470 shutdown_connections 2024-09-12T02:29:35.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.496+0000 7f7112d59640 1 --2- 172.21.15.60:0/113980470 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f70f006be60 0x7f70f006e320 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.496+0000 7f7112d59640 1 --2- 172.21.15.60:0/113980470 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f710c14c940 0x7f710c142470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.496+0000 7f7112d59640 1 --2- 172.21.15.60:0/113980470 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f710c15a4a0 0x7f710c1ef6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.496+0000 7f7112d59640 1 --2- 172.21.15.60:0/113980470 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f710c0c8b10 0x7f710c14ce90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.496+0000 7f7112d59640 1 -- 172.21.15.60:0/113980470 >> 172.21.15.60:0/113980470 conn(0x7f710c0adb80 msgr2=0x7f710c0aba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:35.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.497+0000 7f7112d59640 1 -- 172.21.15.60:0/113980470 shutdown_connections 2024-09-12T02:29:35.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.497+0000 7f7112d59640 1 -- 172.21.15.60:0/113980470 wait complete. 2024-09-12T02:29:35.509 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-12T02:29:35.509 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-12T02:29:35.509 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-12T02:29:35.509 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-12T02:29:35.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.629+0000 7ff5a478d640 1 Processor -- start 2024-09-12T02:29:35.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.629+0000 7ff5a478d640 1 -- start start 2024-09-12T02:29:35.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.631+0000 7ff5a478d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff59c074230 0x7ff59c0c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:35.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.631+0000 7ff5a478d640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff59c0c43c0 0x7ff59c159e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:35.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.631+0000 7ff5a478d640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff59c0c47f0 con 0x7ff59c0c59f0 2024-09-12T02:29:35.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.631+0000 7ff5a478d640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff59c0bed90 con 0x7ff59c0c43c0 2024-09-12T02:29:35.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.631+0000 7ff5a478d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff59c0c3820 con 0x7ff59c074230 2024-09-12T02:29:35.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.631+0000 7ff5a1d28640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff59c0c59f0 0x7ff59c0c3cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50954/0 (socket says 172.21.15.60:50954) 2024-09-12T02:29:35.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.631+0000 7ff5a1d28640 1 -- 172.21.15.60:0/3755199716 learned_addr learned my addr 172.21.15.60:0/3755199716 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:29:35.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.631+0000 7ff5a2d2a640 1 --2- 172.21.15.60:0/3755199716 >> v2:172.21.15.105:3300/0 conn(0x7ff59c0c43c0 0x7ff59c159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:35.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.631+0000 7ff5a2529640 1 --2- 172.21.15.60:0/3755199716 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff59c074230 0x7ff59c0c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:35.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.631+0000 7ff5a1527640 1 -- 172.21.15.60:0/3755199716 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 684979024 0 0) 0x7ff58c001110 con 0x7ff59c0c59f0 2024-09-12T02:29:35.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.631+0000 7ff5a1527640 1 -- 172.21.15.60:0/3755199716 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff588003520 con 0x7ff59c0c59f0 2024-09-12T02:29:35.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.631+0000 7ff5a2d2a640 1 -- 172.21.15.60:0/3755199716 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff59c074230 msgr2=0x7ff59c0c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:35.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.631+0000 7ff5a2d2a640 1 --2- 172.21.15.60:0/3755199716 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff59c074230 0x7ff59c0c54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.631+0000 7ff5a2d2a640 1 -- 172.21.15.60:0/3755199716 >> v1:172.21.15.60:6789/0 conn(0x7ff59c0c59f0 legacy=0x7ff59c0c3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:35.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.631+0000 7ff5a2d2a640 1 -- 172.21.15.60:0/3755199716 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff59c0c34f0 con 0x7ff59c0c43c0 2024-09-12T02:29:35.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.631+0000 7ff5a2529640 1 --2- 172.21.15.60:0/3755199716 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff59c074230 0x7ff59c0c54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:29:35.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.632+0000 7ff5a2d2a640 1 --2- 172.21.15.60:0/3755199716 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff59c0c43c0 0x7ff59c159e00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff594009d90 tx=0x7ff59402a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3998415d8f767be7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:35.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.633+0000 7ff5a1527640 1 -- 172.21.15.60:0/3755199716 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff594031600 con 0x7ff59c0c43c0 2024-09-12T02:29:35.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.633+0000 7ff5a1527640 1 -- 172.21.15.60:0/3755199716 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5940317a0 con 0x7ff59c0c43c0 2024-09-12T02:29:35.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.633+0000 7ff5a1527640 1 -- 172.21.15.60:0/3755199716 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff594031b70 con 0x7ff59c0c43c0 2024-09-12T02:29:35.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.633+0000 7ff5a478d640 1 -- 172.21.15.60:0/3755199716 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff59c0c43c0 msgr2=0x7ff59c159e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:35.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.633+0000 7ff5a478d640 1 --2- 172.21.15.60:0/3755199716 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff59c0c43c0 0x7ff59c159e00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff594009d90 tx=0x7ff59402a5d0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.633+0000 7ff5a478d640 1 -- 172.21.15.60:0/3755199716 shutdown_connections 2024-09-12T02:29:35.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.633+0000 7ff5a478d640 1 --2- 172.21.15.60:0/3755199716 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff59c0c43c0 0x7ff59c159e00 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.633+0000 7ff5a478d640 1 --2- 172.21.15.60:0/3755199716 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff59c074230 0x7ff59c0c54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.633+0000 7ff5a478d640 1 -- 172.21.15.60:0/3755199716 >> 172.21.15.60:0/3755199716 conn(0x7ff59c0c8a50 msgr2=0x7ff59c0c8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:35.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.633+0000 7ff5a478d640 1 -- 172.21.15.60:0/3755199716 shutdown_connections 2024-09-12T02:29:35.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.633+0000 7ff5a478d640 1 -- 172.21.15.60:0/3755199716 wait complete. 2024-09-12T02:29:35.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.635+0000 7ff5a478d640 1 Processor -- start 2024-09-12T02:29:35.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.635+0000 7ff5a478d640 1 -- start start 2024-09-12T02:29:35.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.636+0000 7ff5a478d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff59c074230 0x7ff59c0c1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:35.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.636+0000 7ff5a478d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff59c0c43c0 0x7ff59c1524e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:35.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.636+0000 7ff5a478d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff59c0c59f0 0x7ff59c06df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:35.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.636+0000 7ff5a478d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff59c0bf5a0 con 0x7ff59c074230 2024-09-12T02:29:35.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.636+0000 7ff5a478d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff59c0bf2c0 con 0x7ff59c0c59f0 2024-09-12T02:29:35.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.636+0000 7ff5a478d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff59c074610 con 0x7ff59c0c43c0 2024-09-12T02:29:35.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.636+0000 7ff5a2529640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff59c074230 0x7ff59c0c1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:35.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.636+0000 7ff5a2529640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff59c074230 0x7ff59c0c1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52086/0 (socket says 172.21.15.60:52086) 2024-09-12T02:29:35.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.636+0000 7ff5a1d28640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff59c0c43c0 0x7ff59c1524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:35.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.636+0000 7ff5a2529640 1 -- 172.21.15.60:0/628044442 learned_addr learned my addr 172.21.15.60:0/628044442 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:29:35.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.636+0000 7ff5a2d2a640 1 --2- 172.21.15.60:0/628044442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff59c0c59f0 0x7ff59c06df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:35.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.636+0000 7ff5a1d28640 1 -- 172.21.15.60:0/628044442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff59c0c59f0 msgr2=0x7ff59c06df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:35.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.636+0000 7ff5a1d28640 1 --2- 172.21.15.60:0/628044442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff59c0c59f0 0x7ff59c06df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.636+0000 7ff5a1d28640 1 -- 172.21.15.60:0/628044442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff59c074230 msgr2=0x7ff59c0c1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:35.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.636+0000 7ff5a1d28640 1 --2- 172.21.15.60:0/628044442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff59c074230 0x7ff59c0c1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.636+0000 7ff5a1d28640 1 -- 172.21.15.60:0/628044442 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff59c0add60 con 0x7ff59c0c43c0 2024-09-12T02:29:35.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.636+0000 7ff5a2529640 1 --2- 172.21.15.60:0/628044442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff59c074230 0x7ff59c0c1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:29:35.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.637+0000 7ff5a1d28640 1 --2- 172.21.15.60:0/628044442 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff59c0c43c0 0x7ff59c1524e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff58c00c390 tx=0x7ff58c00c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:35.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.637+0000 7ff592ffd640 1 -- 172.21.15.60:0/628044442 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58c017070 con 0x7ff59c0c43c0 2024-09-12T02:29:35.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.637+0000 7ff592ffd640 1 -- 172.21.15.60:0/628044442 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff58c005ce0 con 0x7ff59c0c43c0 2024-09-12T02:29:35.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.637+0000 7ff5a478d640 1 -- 172.21.15.60:0/628044442 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff59c1ebe60 con 0x7ff59c0c43c0 2024-09-12T02:29:35.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.637+0000 7ff592ffd640 1 -- 172.21.15.60:0/628044442 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58c0072f0 con 0x7ff59c0c43c0 2024-09-12T02:29:35.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.637+0000 7ff5a478d640 1 -- 172.21.15.60:0/628044442 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff59c1ec420 con 0x7ff59c0c43c0 2024-09-12T02:29:35.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.638+0000 7ff5a478d640 1 --2- 172.21.15.60:0/628044442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff59c150fa0 0x7ff59c152a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:35.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.638+0000 7ff5a2529640 1 --2- 172.21.15.60:0/628044442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff59c150fa0 0x7ff59c152a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:35.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.638+0000 7ff5a478d640 1 -- 172.21.15.60:0/628044442 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff59c069a00 con 0x7ff59c150fa0 2024-09-12T02:29:35.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.638+0000 7ff5a2529640 1 -- 172.21.15.60:0/628044442 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff59c0ae040 con 0x7ff59c150fa0 2024-09-12T02:29:35.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.638+0000 7ff5a2529640 1 --2- 172.21.15.60:0/628044442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff59c150fa0 0x7ff59c152a20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff598009ed0 tx=0x7ff59800f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:35.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.639+0000 7ff592ffd640 1 -- 172.21.15.60:0/628044442 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff59800fe50 con 0x7ff59c150fa0 2024-09-12T02:29:35.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.639+0000 7ff592ffd640 1 -- 172.21.15.60:0/628044442 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff598014650 con 0x7ff59c150fa0 2024-09-12T02:29:35.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.639+0000 7ff592ffd640 1 -- 172.21.15.60:0/628044442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff59c150fa0 msgr2=0x7ff59c152a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:35.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.639+0000 7ff592ffd640 1 --2- 172.21.15.60:0/628044442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff59c150fa0 0x7ff59c152a20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff598009ed0 tx=0x7ff59800f610 comp rx=0 tx=0).stop 2024-09-12T02:29:35.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.639+0000 7ff592ffd640 1 -- 172.21.15.60:0/628044442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff59c150fa0 msgr2=0x7ff59c152a20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:29:35.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.639+0000 7ff592ffd640 1 --2- 172.21.15.60:0/628044442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff59c150fa0 0x7ff59c152a20 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.639+0000 7ff592ffd640 1 -- 172.21.15.60:0/628044442 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff58c01a070 con 0x7ff59c0c43c0 2024-09-12T02:29:35.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.639+0000 7ff592ffd640 1 --2- 172.21.15.60:0/628044442 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff58006b8a0 0x7ff58006dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:35.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.640+0000 7ff592ffd640 1 -- 172.21.15.60:0/628044442 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7ff58c08a4c0 con 0x7ff59c0c43c0 2024-09-12T02:29:35.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.640+0000 7ff5a2529640 1 --2- 172.21.15.60:0/628044442 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff58006b8a0 0x7ff58006dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:35.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.640+0000 7ff5a2529640 1 --2- 172.21.15.60:0/628044442 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff58006b8a0 0x7ff58006dd60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff59800fbb0 tx=0x7ff598008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:35.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.646+0000 7ff5a478d640 1 --2- 172.21.15.60:0/628044442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff59c0c2050 0x7ff59c0ac630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:35.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.646+0000 7ff5a478d640 1 -- 172.21.15.60:0/628044442 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff59c0c54b0 con 0x7ff59c0c2050 2024-09-12T02:29:35.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.646+0000 7ff5a2d2a640 1 --2- 172.21.15.60:0/628044442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff59c0c2050 0x7ff59c0ac630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:35.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.646+0000 7ff5a2d2a640 1 -- 172.21.15.60:0/628044442 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff59c0c7fb0 con 0x7ff59c0c2050 2024-09-12T02:29:35.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.646+0000 7ff5a2d2a640 1 --2- 172.21.15.60:0/628044442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff59c0c2050 0x7ff59c0ac630 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff59c070660 tx=0x7ff594004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:35.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.647+0000 7ff592ffd640 1 -- 172.21.15.60:0/628044442 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff594009450 con 0x7ff59c0c2050 2024-09-12T02:29:35.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.647+0000 7ff592ffd640 1 -- 172.21.15.60:0/628044442 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4718 (secure 0 0 0) 0x7ff594009a30 con 0x7ff59c0c2050 2024-09-12T02:29:35.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.647+0000 7ff592ffd640 1 -- 172.21.15.60:0/628044442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff59c0c2050 msgr2=0x7ff59c0ac630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:35.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.647+0000 7ff592ffd640 1 --2- 172.21.15.60:0/628044442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff59c0c2050 0x7ff59c0ac630 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff59c070660 tx=0x7ff594004a40 comp rx=0 tx=0).stop 2024-09-12T02:29:35.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.647+0000 7ff592ffd640 1 -- 172.21.15.60:0/628044442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff59c0c2050 msgr2=0x7ff59c0ac630 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:29:35.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.647+0000 7ff592ffd640 1 --2- 172.21.15.60:0/628044442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff59c0c2050 0x7ff59c0ac630 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.649 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:29:35.649 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:29:35.649 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:29:35.649 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:29:35.649 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 64, 2024-09-12T02:29:35.649 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 38751, 2024-09-12T02:29:35.650 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:29:35.650 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:29:35.650 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:29:35.650 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:29:35.650 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:35.650 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 13, 2024-09-12T02:29:35.650 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:29:35.650 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:29:35.650 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:29:35.650 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:29:35.650 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:29:35.650 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:29:35.650 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:29:35.651 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:29:35.651 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:29:35.651 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:29:35.651 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:29:35.651 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:29:35.651 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:29:35.651 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:29:35.651 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:35.651 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:29:35.651 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:29:35.651 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:29:35.651 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:29:35.651 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:29:35.651 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:29:35.652 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:29:35.652 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:29:35.652 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:29:35.652 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:29:35.652 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:29:35.652 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:29:35.652 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:29:35.652 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:35.652 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:35.652 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:29:35.652 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:29:35.652 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:29:35.652 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:29:35.653 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:29:35.653 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:29:35.653 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:29:35.653 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:29:35.653 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:29:35.653 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:29:35.653 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:29:35.653 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:29:35.653 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:29:35.653 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:29:35.653 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:29:35.653 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:29:35.653 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:29:35.654 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:29:35.654 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:29:35.654 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:29:35.654 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:29:35.654 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:29:35.654 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:29:35.654 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:29:35.654 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:29:35.654 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:29:35.654 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:29:35.654 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:29:35.654 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:35.654 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:29:35.655 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:35.655 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:29:35.655 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:35.655 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:29:35.655 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:29:35.655 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:29:35.655 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:29:35.655 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:35.655 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:29:35.655 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:29:35.655 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:35.655 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:35.655 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:35.655 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:29:35.656 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:29:35.656 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:35.656 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:35.656 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:35.656 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:35.656 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:29:35.656 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:29:35.656 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:29:35.656 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:29:35.656 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:29:35.656 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:35.656 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:35.656 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:29:35.657 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:29:35.657 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:29:35.657 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:29:35.657 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:35.657 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:29:35.657 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:29:35.657 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:35.657 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:35.657 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:35.657 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:29:35.657 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:29:35.657 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:35.657 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:35.658 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:35.658 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:35.658 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:29:35.658 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:29:35.658 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:29:35.658 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:29:35.658 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:29:35.658 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:35.658 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:35.658 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:29:35.658 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:29:35.658 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:29:35.658 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:29:35.658 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:35.659 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:29:35.659 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:29:35.659 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:35.659 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:35.659 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:35.659 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:29:35.659 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:29:35.659 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:35.659 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:35.659 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:35.659 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:35.659 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:29:35.659 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:29:35.660 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:29:35.660 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:29:35.660 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:29:35.660 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:35.660 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:35.660 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:35.660 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:29:35.660 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:29:35.660 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:35.660 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:29:35.660 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:29:35.660 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:29:35.660 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:35.660 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:35.661 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:29:35.661 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:35.661 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:29:35.661 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:29:35.661 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:29:35.661 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:35.661 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:35.661 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:29:35.661 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:35.661 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:29:35.661 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:29:35.661 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:29:35.661 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:35.662 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:35.662 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:35.662 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:29:35.662 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:29:35.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.647+0000 7ff5a478d640 1 -- 172.21.15.60:0/628044442 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff58006b8a0 msgr2=0x7ff58006dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:35.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.647+0000 7ff5a478d640 1 --2- 172.21.15.60:0/628044442 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff58006b8a0 0x7ff58006dd60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff59800fbb0 tx=0x7ff598008030 comp rx=0 tx=0).stop 2024-09-12T02:29:35.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.647+0000 7ff5a478d640 1 -- 172.21.15.60:0/628044442 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff59c0c43c0 msgr2=0x7ff59c1524e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:35.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.647+0000 7ff5a478d640 1 --2- 172.21.15.60:0/628044442 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff59c0c43c0 0x7ff59c1524e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff58c00c390 tx=0x7ff58c00c790 comp rx=0 tx=0).stop 2024-09-12T02:29:35.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.647+0000 7ff5a2d2a640 1 -- 172.21.15.60:0/628044442 reap_dead start 2024-09-12T02:29:35.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.647+0000 7ff5a478d640 1 -- 172.21.15.60:0/628044442 shutdown_connections 2024-09-12T02:29:35.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.647+0000 7ff5a478d640 1 --2- 172.21.15.60:0/628044442 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff59c0c43c0 0x7ff59c1524e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.647+0000 7ff5a478d640 1 -- 172.21.15.60:0/628044442 >> 172.21.15.60:0/628044442 conn(0x7ff59c0c8a50 msgr2=0x7ff59c156100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:35.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.647+0000 7ff5a478d640 1 -- 172.21.15.60:0/628044442 shutdown_connections 2024-09-12T02:29:35.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.647+0000 7ff5a478d640 1 -- 172.21.15.60:0/628044442 wait complete. 2024-09-12T02:29:35.664 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:29:35.664 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-12T02:29:35.664 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-12T02:29:35.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.775+0000 7f95708ae640 1 Processor -- start 2024-09-12T02:29:35.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.775+0000 7f95708ae640 1 -- start start 2024-09-12T02:29:35.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.776+0000 7f95708ae640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f956c06c610 0x7f956c0cb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:35.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.776+0000 7f95708ae640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f956c06ce90 0x7f956c0ca630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:35.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.776+0000 7f95708ae640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f956c158370 con 0x7f956c0cb050 2024-09-12T02:29:35.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.776+0000 7f95708ae640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f956c15aab0 con 0x7f956c06c610 2024-09-12T02:29:35.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.776+0000 7f95708ae640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f956c15ad90 con 0x7f956c06ce90 2024-09-12T02:29:35.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.776+0000 7f956a59c640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f956c0cb050 0x7f956c0c9f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50958/0 (socket says 172.21.15.60:50958) 2024-09-12T02:29:35.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.776+0000 7f956a59c640 1 -- 172.21.15.60:0/2144264092 learned_addr learned my addr 172.21.15.60:0/2144264092 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:29:35.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.776+0000 7f956ad9d640 1 --2- 172.21.15.60:0/2144264092 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f956c06ce90 0x7f956c0ca630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:35.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.776+0000 7f9569d9b640 1 --2- 172.21.15.60:0/2144264092 >> v2:172.21.15.105:3300/0 conn(0x7f956c06c610 0x7f956c0cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:35.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.777+0000 7f956959a640 1 -- 172.21.15.60:0/2144264092 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1662230113 0 0) 0x7f956c158370 con 0x7f956c0cb050 2024-09-12T02:29:35.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.777+0000 7f9569d9b640 1 -- 172.21.15.60:0/2144264092 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f956c06ce90 msgr2=0x7f956c0ca630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:35.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.777+0000 7f9569d9b640 1 --2- 172.21.15.60:0/2144264092 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f956c06ce90 0x7f956c0ca630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.777+0000 7f9569d9b640 1 -- 172.21.15.60:0/2144264092 >> v1:172.21.15.60:6789/0 conn(0x7f956c0cb050 legacy=0x7f956c0c9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:35.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.777+0000 7f9569d9b640 1 -- 172.21.15.60:0/2144264092 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f956c15b070 con 0x7f956c06c610 2024-09-12T02:29:35.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.778+0000 7f9569d9b640 1 --2- 172.21.15.60:0/2144264092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f956c06c610 0x7f956c0cb430 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f95600097a0 tx=0x7f956002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1729613edee60fd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:35.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.778+0000 7f956959a640 1 -- 172.21.15.60:0/2144264092 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9560037070 con 0x7f956c06c610 2024-09-12T02:29:35.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.778+0000 7f956959a640 1 -- 172.21.15.60:0/2144264092 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f956002ae50 con 0x7f956c06c610 2024-09-12T02:29:35.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.778+0000 7f956959a640 1 -- 172.21.15.60:0/2144264092 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9560032660 con 0x7f956c06c610 2024-09-12T02:29:35.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.779+0000 7f95708ae640 1 -- 172.21.15.60:0/2144264092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f956c06c610 msgr2=0x7f956c0cb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:35.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.779+0000 7f95708ae640 1 --2- 172.21.15.60:0/2144264092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f956c06c610 0x7f956c0cb430 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f95600097a0 tx=0x7f956002a100 comp rx=0 tx=0).stop 2024-09-12T02:29:35.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.779+0000 7f95708ae640 1 -- 172.21.15.60:0/2144264092 shutdown_connections 2024-09-12T02:29:35.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.779+0000 7f95708ae640 1 --2- 172.21.15.60:0/2144264092 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f956c06ce90 0x7f956c0ca630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.779+0000 7f95708ae640 1 --2- 172.21.15.60:0/2144264092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f956c06c610 0x7f956c0cb430 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.779+0000 7f95708ae640 1 -- 172.21.15.60:0/2144264092 >> 172.21.15.60:0/2144264092 conn(0x7f956c068030 msgr2=0x7f956c073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:35.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.779+0000 7f95708ae640 1 -- 172.21.15.60:0/2144264092 shutdown_connections 2024-09-12T02:29:35.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.779+0000 7f95708ae640 1 -- 172.21.15.60:0/2144264092 wait complete. 2024-09-12T02:29:35.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.780+0000 7f95708ae640 1 Processor -- start 2024-09-12T02:29:35.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.780+0000 7f95708ae640 1 -- start start 2024-09-12T02:29:35.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.781+0000 7f95708ae640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f956c06c610 0x7f956c1f4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:35.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.781+0000 7f95708ae640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f956c06ce90 0x7f956c1f45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:35.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.781+0000 7f95708ae640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f956c0cb050 0x7f956c1519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:35.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.781+0000 7f95708ae640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f956c0cab70 con 0x7f956c0cb050 2024-09-12T02:29:35.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.781+0000 7f95708ae640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f956c15b630 con 0x7f956c06ce90 2024-09-12T02:29:35.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.781+0000 7f95708ae640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f956c15a6d0 con 0x7f956c06c610 2024-09-12T02:29:35.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.781+0000 7f956ad9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f956c0cb050 0x7f956c1519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:35.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.781+0000 7f9569d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f956c06ce90 0x7f956c1f45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:35.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.781+0000 7f956ad9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f956c0cb050 0x7f956c1519b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52118/0 (socket says 172.21.15.60:52118) 2024-09-12T02:29:35.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.781+0000 7f956a59c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f956c06c610 0x7f956c1f4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:35.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.781+0000 7f956ad9d640 1 -- 172.21.15.60:0/1755918173 learned_addr learned my addr 172.21.15.60:0/1755918173 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:29:35.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.782+0000 7f9569d9b640 1 -- 172.21.15.60:0/1755918173 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f956c06c610 msgr2=0x7f956c1f4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:35.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.782+0000 7f9569d9b640 1 --2- 172.21.15.60:0/1755918173 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f956c06c610 0x7f956c1f4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.782+0000 7f9569d9b640 1 -- 172.21.15.60:0/1755918173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f956c0cb050 msgr2=0x7f956c1519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:35.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.782+0000 7f9569d9b640 1 --2- 172.21.15.60:0/1755918173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f956c0cb050 0x7f956c1519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.782+0000 7f9569d9b640 1 -- 172.21.15.60:0/1755918173 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f956c1f4af0 con 0x7f956c06ce90 2024-09-12T02:29:35.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.782+0000 7f956ad9d640 1 --2- 172.21.15.60:0/1755918173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f956c0cb050 0x7f956c1519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:29:35.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.782+0000 7f9569d9b640 1 --2- 172.21.15.60:0/1755918173 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f956c06ce90 0x7f956c1f45b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f956c0c98f0 tx=0x7f95600046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:35.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.782+0000 7f955affd640 1 -- 172.21.15.60:0/1755918173 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9560037040 con 0x7f956c06ce90 2024-09-12T02:29:35.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.782+0000 7f955affd640 1 -- 172.21.15.60:0/1755918173 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9560004030 con 0x7f956c06ce90 2024-09-12T02:29:35.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.782+0000 7f95708ae640 1 -- 172.21.15.60:0/1755918173 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f956c1e63a0 con 0x7f956c06ce90 2024-09-12T02:29:35.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.782+0000 7f955affd640 1 -- 172.21.15.60:0/1755918173 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9560004420 con 0x7f956c06ce90 2024-09-12T02:29:35.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.782+0000 7f95708ae640 1 -- 172.21.15.60:0/1755918173 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f956c15d7b0 con 0x7f956c06ce90 2024-09-12T02:29:35.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.783+0000 7f95708ae640 1 --2- 172.21.15.60:0/1755918173 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f956c15bac0 0x7f956c151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:35.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.783+0000 7f95708ae640 1 -- 172.21.15.60:0/1755918173 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f956c15d310 con 0x7f956c15bac0 2024-09-12T02:29:35.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.783+0000 7f956a59c640 1 --2- 172.21.15.60:0/1755918173 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f956c15bac0 0x7f956c151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:35.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.784+0000 7f956a59c640 1 -- 172.21.15.60:0/1755918173 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f956c0ae880 con 0x7f956c15bac0 2024-09-12T02:29:35.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.784+0000 7f956a59c640 1 --2- 172.21.15.60:0/1755918173 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f956c15bac0 0x7f956c151ef0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f955c000f60 tx=0x7f955c0018d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:35.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.784+0000 7f955affd640 1 -- 172.21.15.60:0/1755918173 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9560003610 con 0x7f956c06ce90 2024-09-12T02:29:35.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.784+0000 7f955affd640 1 --2- 172.21.15.60:0/1755918173 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f954c06be30 0x7f954c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:35.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.785+0000 7f955affd640 1 -- 172.21.15.60:0/1755918173 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f95600abca0 con 0x7f956c06ce90 2024-09-12T02:29:35.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.785+0000 7f956ad9d640 1 --2- 172.21.15.60:0/1755918173 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f954c06be30 0x7f954c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:35.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.785+0000 7f955affd640 1 -- 172.21.15.60:0/1755918173 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f955c011580 con 0x7f956c15bac0 2024-09-12T02:29:35.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.785+0000 7f955affd640 1 -- 172.21.15.60:0/1755918173 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f955c018070 con 0x7f956c15bac0 2024-09-12T02:29:35.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.785+0000 7f955affd640 1 -- 172.21.15.60:0/1755918173 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f956c15bac0 msgr2=0x7f956c151ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:35.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.785+0000 7f955affd640 1 --2- 172.21.15.60:0/1755918173 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f956c15bac0 0x7f956c151ef0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f955c000f60 tx=0x7f955c0018d0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.785+0000 7f955affd640 1 -- 172.21.15.60:0/1755918173 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f956c15bac0 msgr2=0x7f956c151ef0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:29:35.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.785+0000 7f955affd640 1 --2- 172.21.15.60:0/1755918173 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f956c15bac0 0x7f956c151ef0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.785+0000 7f956ad9d640 1 --2- 172.21.15.60:0/1755918173 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f954c06be30 0x7f954c06e2f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f956400e740 tx=0x7f956400b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:35.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.793+0000 7f95708ae640 1 --2- 172.21.15.60:0/1755918173 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f956c15df90 0x7f956c15e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:35.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.793+0000 7f95708ae640 1 -- 172.21.15.60:0/1755918173 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f956c0cb430 con 0x7f956c15df90 2024-09-12T02:29:35.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.793+0000 7f956a59c640 1 --2- 172.21.15.60:0/1755918173 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f956c15df90 0x7f956c15e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:35.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.794+0000 7f956a59c640 1 -- 172.21.15.60:0/1755918173 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f956c06c3f0 con 0x7f956c15df90 2024-09-12T02:29:35.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.794+0000 7f956a59c640 1 --2- 172.21.15.60:0/1755918173 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f956c15df90 0x7f956c15e370 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f955c000f60 tx=0x7f955c001080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:35.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.794+0000 7f955affd640 1 -- 172.21.15.60:0/1755918173 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f955c011e30 con 0x7f956c15df90 2024-09-12T02:29:35.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.794+0000 7f955affd640 1 -- 172.21.15.60:0/1755918173 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5051 (secure 0 0 0) 0x7f955c011e30 con 0x7f956c15df90 2024-09-12T02:29:35.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.794+0000 7f955affd640 1 -- 172.21.15.60:0/1755918173 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f956c15df90 msgr2=0x7f956c15e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:35.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.794+0000 7f955affd640 1 --2- 172.21.15.60:0/1755918173 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f956c15df90 0x7f956c15e370 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f955c000f60 tx=0x7f955c001080 comp rx=0 tx=0).stop 2024-09-12T02:29:35.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.794+0000 7f955affd640 1 -- 172.21.15.60:0/1755918173 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f956c15df90 msgr2=0x7f956c15e370 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:29:35.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.794+0000 7f955affd640 1 --2- 172.21.15.60:0/1755918173 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f956c15df90 0x7f956c15e370 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.795 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:29:35.796 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:29:35.796 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:29:35.796 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:29:35.796 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 64, 2024-09-12T02:29:35.796 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 321228, 2024-09-12T02:29:35.796 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:29:35.796 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:29:35.796 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:29:35.796 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:29:35.796 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:35.796 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 13, 2024-09-12T02:29:35.796 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:29:35.796 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:29:35.797 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:29:35.797 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:29:35.797 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:29:35.797 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:29:35.797 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:29:35.797 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:29:35.797 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:29:35.797 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:29:35.797 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:29:35.797 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:29:35.797 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:29:35.797 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:29:35.797 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:35.798 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:29:35.798 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:29:35.798 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:29:35.798 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:29:35.798 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:29:35.798 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:29:35.798 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:29:35.798 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:29:35.798 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:29:35.798 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:29:35.798 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:29:35.798 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:29:35.798 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:29:35.798 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:35.799 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:35.799 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:29:35.799 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:29:35.799 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:29:35.799 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:29:35.799 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:29:35.799 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:29:35.799 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:29:35.799 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:29:35.799 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:29:35.799 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:29:35.799 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:29:35.799 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:29:35.800 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:29:35.800 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:29:35.800 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:29:35.800 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:29:35.800 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:29:35.800 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:29:35.800 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:29:35.800 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:29:35.800 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:29:35.800 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:29:35.800 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:29:35.800 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:29:35.800 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:29:35.800 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:29:35.801 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:29:35.801 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:29:35.801 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:35.801 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:29:35.801 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:35.801 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:29:35.801 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:35.801 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:29:35.801 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:29:35.801 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:29:35.801 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:29:35.801 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:35.801 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:29:35.801 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:29:35.802 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:35.802 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:35.802 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:35.802 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:29:35.802 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:29:35.802 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:35.802 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:35.802 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:35.802 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:35.802 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:29:35.802 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:29:35.802 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:29:35.802 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:29:35.802 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:29:35.803 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:35.803 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:35.803 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:29:35.803 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:29:35.803 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:29:35.803 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:29:35.803 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:35.803 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:29:35.803 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:29:35.803 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:35.804 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:35.804 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:35.804 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:29:35.804 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:29:35.804 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:35.804 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:35.804 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:35.804 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:35.804 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:29:35.804 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:29:35.804 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:29:35.804 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:29:35.805 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:29:35.805 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:35.805 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:35.805 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:29:35.805 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:29:35.805 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:29:35.805 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:29:35.805 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:35.805 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:29:35.805 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:29:35.805 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:35.805 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:35.805 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:35.806 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:29:35.806 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:29:35.806 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:35.806 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:35.806 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:35.806 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:35.806 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:29:35.806 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:29:35.806 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:29:35.806 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:29:35.806 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:29:35.806 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:35.806 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:35.807 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:35.807 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:29:35.807 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:29:35.807 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:35.807 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:29:35.807 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:29:35.807 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:29:35.807 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:35.807 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:35.807 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:29:35.807 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:35.807 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:29:35.807 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:29:35.807 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:29:35.808 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:35.808 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:35.808 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:29:35.808 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:35.808 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:29:35.808 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:29:35.808 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-09-12T02:29:35.808 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:35.808 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:35.808 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:29:35.808 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:35.808 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:29:35.808 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:29:35.808 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 8 2024-09-12T02:29:35.809 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:35.809 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:35.809 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:29:35.809 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:35.809 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:29:35.809 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:29:35.809 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:29:35.809 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:35.809 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:35.809 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:35.809 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:29:35.809 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:29:35.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.795+0000 7f95708ae640 1 -- 172.21.15.60:0/1755918173 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f954c06be30 msgr2=0x7f954c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:35.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.795+0000 7f95708ae640 1 --2- 172.21.15.60:0/1755918173 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f954c06be30 0x7f954c06e2f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f956400e740 tx=0x7f956400b040 comp rx=0 tx=0).stop 2024-09-12T02:29:35.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.795+0000 7f95708ae640 1 -- 172.21.15.60:0/1755918173 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f956c06ce90 msgr2=0x7f956c1f45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:35.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.795+0000 7f95708ae640 1 --2- 172.21.15.60:0/1755918173 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f956c06ce90 0x7f956c1f45b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f956c0c98f0 tx=0x7f95600046c0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.795+0000 7f956ad9d640 1 -- 172.21.15.60:0/1755918173 reap_dead start 2024-09-12T02:29:35.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.795+0000 7f956ad9d640 1 -- 172.21.15.60:0/1755918173 reap_dead start 2024-09-12T02:29:35.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.795+0000 7f95708ae640 1 -- 172.21.15.60:0/1755918173 shutdown_connections 2024-09-12T02:29:35.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.795+0000 7f95708ae640 1 -- 172.21.15.60:0/1755918173 >> 172.21.15.60:0/1755918173 conn(0x7f956c068030 msgr2=0x7f956c1573c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:35.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.795+0000 7f95708ae640 1 -- 172.21.15.60:0/1755918173 shutdown_connections 2024-09-12T02:29:35.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.795+0000 7f95708ae640 1 -- 172.21.15.60:0/1755918173 wait complete. 2024-09-12T02:29:35.812 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:29:35.812 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-12T02:29:35.812 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-12T02:29:35.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.925+0000 7f268b398640 1 Processor -- start 2024-09-12T02:29:35.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.925+0000 7f268b398640 1 -- start start 2024-09-12T02:29:35.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.927+0000 7f268b398640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2684073ae0 0x7f2684153380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:35.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.927+0000 7f268b398640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f26840733d0 0x7f26841538c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:35.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.927+0000 7f268b398640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f268406dd50 con 0x7f268406d850 2024-09-12T02:29:35.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.927+0000 7f268b398640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f268406e030 con 0x7f26840733d0 2024-09-12T02:29:35.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.927+0000 7f268b398640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f268406e310 con 0x7f2684073ae0 2024-09-12T02:29:35.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.927+0000 7f2688933640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f26840733d0 0x7f26841538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:35.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.927+0000 7f2689935640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f268406d850 0x7f2684156840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50968/0 (socket says 172.21.15.60:50968) 2024-09-12T02:29:35.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.927+0000 7f2689935640 1 -- 172.21.15.60:0/2081559441 learned_addr learned my addr 172.21.15.60:0/2081559441 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:29:35.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.927+0000 7f2688933640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f26840733d0 0x7f26841538c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52130/0 (socket says 172.21.15.60:52130) 2024-09-12T02:29:35.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.927+0000 7f2689134640 1 --2- 172.21.15.60:0/2081559441 >> v2:172.21.15.105:3300/0 conn(0x7f2684073ae0 0x7f2684153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:35.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.927+0000 7f2688933640 1 -- 172.21.15.60:0/2081559441 >> v2:172.21.15.105:3300/0 conn(0x7f2684073ae0 msgr2=0x7f2684153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:35.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.927+0000 7f2688933640 1 --2- 172.21.15.60:0/2081559441 >> v2:172.21.15.105:3300/0 conn(0x7f2684073ae0 0x7f2684153380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.927+0000 7f2688933640 1 -- 172.21.15.60:0/2081559441 >> v1:172.21.15.60:6789/0 conn(0x7f268406d850 legacy=0x7f2684156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:35.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.927+0000 7f2688933640 1 -- 172.21.15.60:0/2081559441 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f268406e5f0 con 0x7f26840733d0 2024-09-12T02:29:35.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.928+0000 7f2688933640 1 --2- 172.21.15.60:0/2081559441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26840733d0 0x7f26841538c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2684076720 tx=0x7f267402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b6f1e5dcaab4c27 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:35.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.928+0000 7f267bfff640 1 -- 172.21.15.60:0/2081559441 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2674037070 con 0x7f26840733d0 2024-09-12T02:29:35.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.928+0000 7f267bfff640 1 -- 172.21.15.60:0/2081559441 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2674032440 con 0x7f26840733d0 2024-09-12T02:29:35.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.928+0000 7f267bfff640 1 -- 172.21.15.60:0/2081559441 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2674032810 con 0x7f26840733d0 2024-09-12T02:29:35.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.929+0000 7f268b398640 1 -- 172.21.15.60:0/2081559441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26840733d0 msgr2=0x7f26841538c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:35.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.929+0000 7f268b398640 1 --2- 172.21.15.60:0/2081559441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26840733d0 0x7f26841538c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2684076720 tx=0x7f267402a1a0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.929+0000 7f268b398640 1 -- 172.21.15.60:0/2081559441 shutdown_connections 2024-09-12T02:29:35.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.929+0000 7f268b398640 1 --2- 172.21.15.60:0/2081559441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26840733d0 0x7f26841538c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.929+0000 7f268b398640 1 --2- 172.21.15.60:0/2081559441 >> v2:172.21.15.105:3300/0 conn(0x7f2684073ae0 0x7f2684153380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.929+0000 7f268b398640 1 -- 172.21.15.60:0/2081559441 >> 172.21.15.60:0/2081559441 conn(0x7f26840c9d80 msgr2=0x7f26840ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:35.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.929+0000 7f268b398640 1 -- 172.21.15.60:0/2081559441 shutdown_connections 2024-09-12T02:29:35.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.929+0000 7f268b398640 1 -- 172.21.15.60:0/2081559441 wait complete. 2024-09-12T02:29:35.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.930+0000 7f268b398640 1 Processor -- start 2024-09-12T02:29:35.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.930+0000 7f268b398640 1 -- start start 2024-09-12T02:29:35.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.931+0000 7f268b398640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f268406d850 0x7f2684146580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:35.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.931+0000 7f268b398640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26840733d0 0x7f26840c9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:35.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.931+0000 7f268b398640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2684073ae0 0x7f2684148500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:35.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.931+0000 7f268b398640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f268406edd0 con 0x7f2684073ae0 2024-09-12T02:29:35.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.931+0000 7f268b398640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f268406ec50 con 0x7f268406d850 2024-09-12T02:29:35.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.931+0000 7f268b398640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2684073ec0 con 0x7f26840733d0 2024-09-12T02:29:35.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.931+0000 7f2689935640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2684073ae0 0x7f2684148500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:35.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.931+0000 7f2689134640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f268406d850 0x7f2684146580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:35.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.931+0000 7f2689935640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2684073ae0 0x7f2684148500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52146/0 (socket says 172.21.15.60:52146) 2024-09-12T02:29:35.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.931+0000 7f2688933640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26840733d0 0x7f26840c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:35.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.931+0000 7f2689935640 1 -- 172.21.15.60:0/1135729030 learned_addr learned my addr 172.21.15.60:0/1135729030 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:29:35.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.932+0000 7f2689134640 1 -- 172.21.15.60:0/1135729030 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26840733d0 msgr2=0x7f26840c9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:35.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.932+0000 7f2689134640 1 --2- 172.21.15.60:0/1135729030 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26840733d0 0x7f26840c9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.932+0000 7f2689134640 1 -- 172.21.15.60:0/1135729030 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2684073ae0 msgr2=0x7f2684148500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:35.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.932+0000 7f2689134640 1 --2- 172.21.15.60:0/1135729030 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2684073ae0 0x7f2684148500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.932+0000 7f2689134640 1 -- 172.21.15.60:0/1135729030 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f268414d930 con 0x7f268406d850 2024-09-12T02:29:35.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.932+0000 7f2689935640 1 --2- 172.21.15.60:0/1135729030 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2684073ae0 0x7f2684148500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:29:35.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.932+0000 7f2688933640 1 --2- 172.21.15.60:0/1135729030 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26840733d0 0x7f26840c9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:29:35.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.932+0000 7f2689134640 1 --2- 172.21.15.60:0/1135729030 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f268406d850 0x7f2684146580 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f268000e870 tx=0x7f268000ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:35.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.932+0000 7f2679ffb640 1 -- 172.21.15.60:0/1135729030 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2680017070 con 0x7f268406d850 2024-09-12T02:29:35.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.932+0000 7f2679ffb640 1 -- 172.21.15.60:0/1135729030 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f268000ee60 con 0x7f268406d850 2024-09-12T02:29:35.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.932+0000 7f268b398640 1 -- 172.21.15.60:0/1135729030 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f268414dc10 con 0x7f268406d850 2024-09-12T02:29:35.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.932+0000 7f2679ffb640 1 -- 172.21.15.60:0/1135729030 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f268000cb60 con 0x7f268406d850 2024-09-12T02:29:35.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.932+0000 7f268b398640 1 -- 172.21.15.60:0/1135729030 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2684148a40 con 0x7f268406d850 2024-09-12T02:29:35.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.933+0000 7f268b398640 1 --2- 172.21.15.60:0/1135729030 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26840c7b80 0x7f26841454e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:35.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.933+0000 7f268b398640 1 -- 172.21.15.60:0/1135729030 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2684072c50 con 0x7f26840c7b80 2024-09-12T02:29:35.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.933+0000 7f2688933640 1 --2- 172.21.15.60:0/1135729030 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26840c7b80 0x7f26841454e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:35.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.934+0000 7f2688933640 1 -- 172.21.15.60:0/1135729030 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f26840c92f0 con 0x7f26840c7b80 2024-09-12T02:29:35.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.934+0000 7f2679ffb640 1 -- 172.21.15.60:0/1135729030 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f268001a070 con 0x7f268406d850 2024-09-12T02:29:35.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.934+0000 7f2688933640 1 --2- 172.21.15.60:0/1135729030 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26840c7b80 0x7f26841454e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f26840b0110 tx=0x7f26740046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:35.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.934+0000 7f2679ffb640 1 --2- 172.21.15.60:0/1135729030 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f266806be30 0x7f266806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:35.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.935+0000 7f2679ffb640 1 -- 172.21.15.60:0/1135729030 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f268008b320 con 0x7f268406d850 2024-09-12T02:29:35.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.935+0000 7f2689935640 1 --2- 172.21.15.60:0/1135729030 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f266806be30 0x7f266806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:35.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.935+0000 7f2679ffb640 1 -- 172.21.15.60:0/1135729030 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2674043070 con 0x7f26840c7b80 2024-09-12T02:29:35.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.935+0000 7f2679ffb640 1 -- 172.21.15.60:0/1135729030 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f2674032440 con 0x7f26840c7b80 2024-09-12T02:29:35.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.935+0000 7f2679ffb640 1 -- 172.21.15.60:0/1135729030 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26840c7b80 msgr2=0x7f26841454e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:35.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.935+0000 7f2679ffb640 1 --2- 172.21.15.60:0/1135729030 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26840c7b80 0x7f26841454e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f26840b0110 tx=0x7f26740046c0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.935+0000 7f2679ffb640 1 -- 172.21.15.60:0/1135729030 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26840c7b80 msgr2=0x7f26841454e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:29:35.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.935+0000 7f2679ffb640 1 --2- 172.21.15.60:0/1135729030 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26840c7b80 0x7f26841454e0 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f26840b0110 tx=0x7f26740046c0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.935+0000 7f2689935640 1 --2- 172.21.15.60:0/1135729030 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f266806be30 0x7f266806e2f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f267c005c00 tx=0x7f267c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:35.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.942+0000 7f268b398640 1 --2- 172.21.15.60:0/1135729030 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26840c7f60 0x7f2684145a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:35.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.942+0000 7f268b398640 1 -- 172.21.15.60:0/1135729030 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f268414c900 con 0x7f26840c7f60 2024-09-12T02:29:35.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.942+0000 7f2688933640 1 --2- 172.21.15.60:0/1135729030 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26840c7f60 0x7f2684145a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:35.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.943+0000 7f2688933640 1 -- 172.21.15.60:0/1135729030 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2684148d90 con 0x7f26840c7f60 2024-09-12T02:29:35.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.943+0000 7f2688933640 1 --2- 172.21.15.60:0/1135729030 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26840c7f60 0x7f2684145a20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2674000c00 tx=0x7f2674008030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:35.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.944+0000 7f2679ffb640 1 -- 172.21.15.60:0/1135729030 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2674037040 con 0x7f26840c7f60 2024-09-12T02:29:35.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.944+0000 7f2679ffb640 1 -- 172.21.15.60:0/1135729030 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4883 (secure 0 0 0) 0x7f2674003820 con 0x7f26840c7f60 2024-09-12T02:29:35.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.944+0000 7f2679ffb640 1 -- 172.21.15.60:0/1135729030 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26840c7f60 msgr2=0x7f2684145a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:35.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.944+0000 7f2679ffb640 1 --2- 172.21.15.60:0/1135729030 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26840c7f60 0x7f2684145a20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2674000c00 tx=0x7f2674008030 comp rx=0 tx=0).stop 2024-09-12T02:29:35.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.944+0000 7f2679ffb640 1 -- 172.21.15.60:0/1135729030 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26840c7f60 msgr2=0x7f2684145a20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:29:35.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.944+0000 7f2679ffb640 1 --2- 172.21.15.60:0/1135729030 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26840c7f60 0x7f2684145a20 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:35.946 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:29:35.946 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:29:35.946 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:29:35.946 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:29:35.946 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 64, 2024-09-12T02:29:35.946 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 96010, 2024-09-12T02:29:35.947 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:29:35.947 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:29:35.947 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:29:35.947 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:29:35.947 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:35.947 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 13, 2024-09-12T02:29:35.947 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:29:35.947 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:29:35.947 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:29:35.947 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:29:35.948 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:29:35.948 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:29:35.948 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:29:35.948 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:29:35.948 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:29:35.948 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:29:35.948 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:29:35.948 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:29:35.948 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:29:35.948 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:29:35.948 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:35.948 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:29:35.949 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:29:35.949 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:29:35.949 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:29:35.949 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:29:35.949 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:29:35.949 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:29:35.949 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:29:35.949 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:29:35.949 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:29:35.950 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:29:35.950 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:29:35.950 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:29:35.950 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:35.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:35.950 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:29:35.950 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:29:35.950 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:29:35.950 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:29:35.950 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:29:35.950 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:29:35.950 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:29:35.951 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:29:35.951 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:29:35.951 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:29:35.951 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:29:35.951 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:29:35.951 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:29:35.951 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:29:35.951 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:29:35.951 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:29:35.951 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:29:35.951 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:29:35.951 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:29:35.952 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:29:35.952 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:29:35.952 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:29:35.952 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:29:35.952 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:29:35.952 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:29:35.952 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:29:35.952 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:29:35.952 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:29:35.953 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:35.953 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:29:35.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:35.953 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:29:35.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:35.953 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:29:35.953 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:29:35.953 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:29:35.953 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:29:35.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:35.953 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:29:35.954 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:29:35.954 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:35.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:35.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:35.954 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:29:35.954 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:29:35.954 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:35.954 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:35.954 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:35.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:35.955 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:29:35.955 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:29:35.955 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:29:35.955 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:29:35.955 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:29:35.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:35.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:35.955 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:29:35.956 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:29:35.956 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:29:35.956 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:29:35.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:35.956 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:29:35.956 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:29:35.956 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:35.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:35.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:35.956 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:29:35.957 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:29:35.957 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:35.957 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:35.957 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:35.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:35.957 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:29:35.957 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:29:35.957 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:29:35.957 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:29:35.957 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:29:35.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:35.957 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:35.958 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:29:35.958 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:29:35.958 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:29:35.958 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:29:35.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:35.958 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:29:35.958 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:29:35.958 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:35.958 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:35.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:35.958 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:29:35.958 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:29:35.958 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:35.959 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:35.959 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:35.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:35.959 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:29:35.959 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:29:35.959 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:29:35.959 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:29:35.959 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:29:35.959 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:35.960 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:35.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:35.960 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:29:35.960 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:29:35.960 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:35.960 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:29:35.960 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:29:35.960 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:29:35.960 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:35.960 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:35.961 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:29:35.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:35.961 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:29:35.961 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:29:35.961 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:29:35.961 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:35.961 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:35.961 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:29:35.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:35.961 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:29:35.961 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:29:35.961 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:29:35.962 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:35.962 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:35.962 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:29:35.962 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:35.962 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:29:35.962 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:29:35.962 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:29:35.962 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:35.962 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:35.962 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:35.962 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:29:35.962 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:29:35.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.945+0000 7f266f7fe640 1 -- 172.21.15.60:0/1135729030 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f266806be30 msgr2=0x7f266806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:35.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.945+0000 7f266f7fe640 1 --2- 172.21.15.60:0/1135729030 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f266806be30 0x7f266806e2f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f267c005c00 tx=0x7f267c009040 comp rx=0 tx=0).stop 2024-09-12T02:29:35.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.945+0000 7f266f7fe640 1 -- 172.21.15.60:0/1135729030 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f268406d850 msgr2=0x7f2684146580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:35.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.945+0000 7f266f7fe640 1 --2- 172.21.15.60:0/1135729030 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f268406d850 0x7f2684146580 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f268000e870 tx=0x7f268000ed30 comp rx=0 tx=0).stop 2024-09-12T02:29:35.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.945+0000 7f2689935640 1 -- 172.21.15.60:0/1135729030 reap_dead start 2024-09-12T02:29:35.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.945+0000 7f2689935640 1 -- 172.21.15.60:0/1135729030 reap_dead start 2024-09-12T02:29:35.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.945+0000 7f266f7fe640 1 -- 172.21.15.60:0/1135729030 shutdown_connections 2024-09-12T02:29:35.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.945+0000 7f266f7fe640 1 -- 172.21.15.60:0/1135729030 >> 172.21.15.60:0/1135729030 conn(0x7f26840c9d80 msgr2=0x7f2684153360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:35.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.945+0000 7f266f7fe640 1 -- 172.21.15.60:0/1135729030 shutdown_connections 2024-09-12T02:29:35.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:35.945+0000 7f266f7fe640 1 -- 172.21.15.60:0/1135729030 wait complete. 2024-09-12T02:29:35.965 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:29:35.965 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-09-12T02:29:35.965 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-12T02:29:35.965 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-09-12T02:29:35.965 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-09-12T02:29:35.965 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T02:29:35.966 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:29:35.977 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T02:29:35.977 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-12T02:29:35.977 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:29:36.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.094+0000 7f2a28fbd640 1 Processor -- start 2024-09-12T02:29:36.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.094+0000 7f2a28fbd640 1 -- start start 2024-09-12T02:29:36.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.095+0000 7f2a28fbd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2a240a7f30 0x7f2a24156d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:36.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.095+0000 7f2a28fbd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a240c3d40 0x7f2a240c4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:36.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.095+0000 7f2a28fbd640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a24157270 con 0x7f2a240ae340 2024-09-12T02:29:36.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.095+0000 7f2a28fbd640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f2a240c38b0 con 0x7f2a240a7f30 2024-09-12T02:29:36.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.095+0000 7f2a28fbd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2a240c3560 con 0x7f2a240c3d40 2024-09-12T02:29:36.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.096+0000 7f2a22d9d640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a240c3d40 msgr2=0x7f2a240c4140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:29:36.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.096+0000 7f2a22d9d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a240c3d40 0x7f2a240c4140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:29:36.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.096+0000 7f2a2259c640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2a240a7f30 0x7f2a24156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:36.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.096+0000 7f2a21d9b640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f2a240ae340 0x7f2a240ae770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:41212/0 (socket says 172.21.15.60:41212) 2024-09-12T02:29:36.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.096+0000 7f2a21d9b640 1 -- 172.21.15.60:0/1843957541 learned_addr learned my addr 172.21.15.60:0/1843957541 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:29:36.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.096+0000 7f2a2159a640 1 -- 172.21.15.60:0/1843957541 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1485750948 0 0) 0x7f2a18001110 con 0x7f2a240ae340 2024-09-12T02:29:36.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.096+0000 7f2a2159a640 1 -- 172.21.15.60:0/1843957541 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a0c003520 con 0x7f2a240ae340 2024-09-12T02:29:36.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.096+0000 7f2a2259c640 1 -- 172.21.15.60:0/1843957541 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a240c3d40 msgr2=0x7f2a240c4140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:29:36.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.096+0000 7f2a2259c640 1 --2- 172.21.15.60:0/1843957541 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a240c3d40 0x7f2a240c4140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:36.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.096+0000 7f2a2259c640 1 -- 172.21.15.60:0/1843957541 >> v1:172.21.15.105:6789/0 conn(0x7f2a240ae340 legacy=0x7f2a240ae770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:36.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.096+0000 7f2a2259c640 1 -- 172.21.15.60:0/1843957541 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a240c7df0 con 0x7f2a240a7f30 2024-09-12T02:29:36.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.097+0000 7f2a2259c640 1 --2- 172.21.15.60:0/1843957541 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a240a7f30 0x7f2a24156d30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2a140097a0 tx=0x7f2a1402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ad94a5c13de4870 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:36.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.097+0000 7f2a2159a640 1 -- 172.21.15.60:0/1843957541 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a14037070 con 0x7f2a240a7f30 2024-09-12T02:29:36.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.097+0000 7f2a2159a640 1 -- 172.21.15.60:0/1843957541 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a14032440 con 0x7f2a240a7f30 2024-09-12T02:29:36.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.097+0000 7f2a2159a640 1 -- 172.21.15.60:0/1843957541 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a14032810 con 0x7f2a240a7f30 2024-09-12T02:29:36.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.098+0000 7f2a28fbd640 1 -- 172.21.15.60:0/1843957541 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a240a7f30 msgr2=0x7f2a24156d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:36.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.098+0000 7f2a28fbd640 1 --2- 172.21.15.60:0/1843957541 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a240a7f30 0x7f2a24156d30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2a140097a0 tx=0x7f2a1402a1a0 comp rx=0 tx=0).stop 2024-09-12T02:29:36.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.098+0000 7f2a28fbd640 1 -- 172.21.15.60:0/1843957541 shutdown_connections 2024-09-12T02:29:36.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.098+0000 7f2a28fbd640 1 --2- 172.21.15.60:0/1843957541 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a240c3d40 0x7f2a240c4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:36.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.098+0000 7f2a28fbd640 1 --2- 172.21.15.60:0/1843957541 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a240a7f30 0x7f2a24156d30 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:36.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.098+0000 7f2a28fbd640 1 -- 172.21.15.60:0/1843957541 >> 172.21.15.60:0/1843957541 conn(0x7f2a240c5660 msgr2=0x7f2a240c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:36.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.098+0000 7f2a28fbd640 1 -- 172.21.15.60:0/1843957541 shutdown_connections 2024-09-12T02:29:36.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.098+0000 7f2a28fbd640 1 -- 172.21.15.60:0/1843957541 wait complete. 2024-09-12T02:29:36.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.099+0000 7f2a28fbd640 1 Processor -- start 2024-09-12T02:29:36.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.099+0000 7f2a28fbd640 1 -- start start 2024-09-12T02:29:36.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.100+0000 7f2a28fbd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a240a7f30 0x7f2a241f02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:36.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.100+0000 7f2a28fbd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a240ae340 0x7f2a24153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:36.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.100+0000 7f2a28fbd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a240c3d40 0x7f2a24157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:36.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.100+0000 7f2a28fbd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2a240704c0 con 0x7f2a240a7f30 2024-09-12T02:29:36.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.100+0000 7f2a28fbd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2a240c83b0 con 0x7f2a240ae340 2024-09-12T02:29:36.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.100+0000 7f2a28fbd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2a240c7a70 con 0x7f2a240c3d40 2024-09-12T02:29:36.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.100+0000 7f2a2259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a240a7f30 0x7f2a241f02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:36.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.100+0000 7f2a22d9d640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a240c3d40 msgr2=0x7f2a24157e10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:29:36.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.100+0000 7f2a22d9d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a240c3d40 0x7f2a24157e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:29:36.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.100+0000 7f2a21d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a240ae340 0x7f2a24153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:36.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.100+0000 7f2a2259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a240a7f30 0x7f2a241f02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52170/0 (socket says 172.21.15.60:52170) 2024-09-12T02:29:36.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.100+0000 7f2a2259c640 1 -- 172.21.15.60:0/746538888 learned_addr learned my addr 172.21.15.60:0/746538888 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:29:36.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.101+0000 7f2a21d9b640 1 -- 172.21.15.60:0/746538888 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a240c3d40 msgr2=0x7f2a24157e10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:29:36.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.101+0000 7f2a21d9b640 1 --2- 172.21.15.60:0/746538888 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a240c3d40 0x7f2a24157e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:36.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.101+0000 7f2a21d9b640 1 -- 172.21.15.60:0/746538888 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a240a7f30 msgr2=0x7f2a241f02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:36.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.101+0000 7f2a21d9b640 1 --2- 172.21.15.60:0/746538888 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a240a7f30 0x7f2a241f02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:36.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.101+0000 7f2a21d9b640 1 -- 172.21.15.60:0/746538888 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a241f07f0 con 0x7f2a240ae340 2024-09-12T02:29:36.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.101+0000 7f2a21d9b640 1 --2- 172.21.15.60:0/746538888 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a240ae340 0x7f2a24153f20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2a18000f60 tx=0x7f2a1800cb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:36.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.101+0000 7f2a12ffd640 1 -- 172.21.15.60:0/746538888 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a18017070 con 0x7f2a240ae340 2024-09-12T02:29:36.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.101+0000 7f2a12ffd640 1 -- 172.21.15.60:0/746538888 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a18005870 con 0x7f2a240ae340 2024-09-12T02:29:36.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.101+0000 7f2a12ffd640 1 -- 172.21.15.60:0/746538888 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a18005ca0 con 0x7f2a240ae340 2024-09-12T02:29:36.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.101+0000 7f2a28fbd640 1 -- 172.21.15.60:0/746538888 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a24159900 con 0x7f2a240ae340 2024-09-12T02:29:36.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.101+0000 7f2a28fbd640 1 -- 172.21.15.60:0/746538888 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a24157610 con 0x7f2a240ae340 2024-09-12T02:29:36.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.102+0000 7f2a28fbd640 1 -- 172.21.15.60:0/746538888 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a240a9490 con 0x7f2a240ae340 2024-09-12T02:29:36.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.103+0000 7f2a12ffd640 1 -- 172.21.15.60:0/746538888 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2a1801a070 con 0x7f2a240ae340 2024-09-12T02:29:36.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.103+0000 7f2a12ffd640 1 --2- 172.21.15.60:0/746538888 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2a0406bde0 0x7f2a0406e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:36.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.104+0000 7f2a12ffd640 1 -- 172.21.15.60:0/746538888 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f2a1808a2a0 con 0x7f2a240ae340 2024-09-12T02:29:36.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.104+0000 7f2a2259c640 1 --2- 172.21.15.60:0/746538888 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2a0406bde0 0x7f2a0406e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:36.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.104+0000 7f2a2259c640 1 --2- 172.21.15.60:0/746538888 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2a0406bde0 0x7f2a0406e2a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2a14000c00 tx=0x7f2a1402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:36.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.108+0000 7f2a12ffd640 1 -- 172.21.15.60:0/746538888 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2a24157270 con 0x7f2a240ae340 2024-09-12T02:29:36.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.411+0000 7f2a28fbd640 1 -- 172.21.15.60:0/746538888 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f2a240ad240 con 0x7f2a240ae340 2024-09-12T02:29:36.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.412+0000 7f2a12ffd640 1 -- 172.21.15.60:0/746538888 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f2a180582d0 con 0x7f2a240ae340 2024-09-12T02:29:36.413 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":64,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:29:36.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.414+0000 7f2a28fbd640 1 -- 172.21.15.60:0/746538888 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2a0406bde0 msgr2=0x7f2a0406e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:36.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.414+0000 7f2a28fbd640 1 --2- 172.21.15.60:0/746538888 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2a0406bde0 0x7f2a0406e2a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2a14000c00 tx=0x7f2a1402e000 comp rx=0 tx=0).stop 2024-09-12T02:29:36.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.414+0000 7f2a28fbd640 1 -- 172.21.15.60:0/746538888 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a240ae340 msgr2=0x7f2a24153f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:36.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.414+0000 7f2a28fbd640 1 --2- 172.21.15.60:0/746538888 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a240ae340 0x7f2a24153f20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2a18000f60 tx=0x7f2a1800cb90 comp rx=0 tx=0).stop 2024-09-12T02:29:36.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.414+0000 7f2a28fbd640 1 -- 172.21.15.60:0/746538888 shutdown_connections 2024-09-12T02:29:36.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.414+0000 7f2a28fbd640 1 --2- 172.21.15.60:0/746538888 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2a0406bde0 0x7f2a0406e2a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:36.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.414+0000 7f2a28fbd640 1 --2- 172.21.15.60:0/746538888 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a240c3d40 0x7f2a24157e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:36.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.414+0000 7f2a28fbd640 1 --2- 172.21.15.60:0/746538888 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a240ae340 0x7f2a24153f20 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:36.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.414+0000 7f2a28fbd640 1 --2- 172.21.15.60:0/746538888 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a240a7f30 0x7f2a241f02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:36.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.414+0000 7f2a28fbd640 1 -- 172.21.15.60:0/746538888 >> 172.21.15.60:0/746538888 conn(0x7f2a240c5660 msgr2=0x7f2a24071f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:36.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.414+0000 7f2a28fbd640 1 -- 172.21.15.60:0/746538888 shutdown_connections 2024-09-12T02:29:36.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:36.414+0000 7f2a28fbd640 1 -- 172.21.15.60:0/746538888 wait complete. 2024-09-12T02:29:39.427 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:29:39.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.540+0000 7f3ef63f1640 1 Processor -- start 2024-09-12T02:29:39.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.540+0000 7f3ef63f1640 1 -- start start 2024-09-12T02:29:39.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.541+0000 7f3ef63f1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ef0153be0 0x7f3ef015a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:39.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.541+0000 7f3ef63f1640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ef00c7070 con 0x7f3ef006cd80 2024-09-12T02:29:39.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.541+0000 7f3ef63f1640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ef006d210 con 0x7f3ef00c8b10 2024-09-12T02:29:39.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.541+0000 7f3ef63f1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3ef00c69b0 con 0x7f3ef0153be0 2024-09-12T02:29:39.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.541+0000 7f3ef498e640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ef0153be0 msgr2=0x7f3ef015a4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:29:39.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.541+0000 7f3ef498e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ef0153be0 0x7f3ef015a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:29:39.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.541+0000 7f3eef7fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f3ef006cd80 0x7f3ef0156660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:58976/0 (socket says 172.21.15.60:58976) 2024-09-12T02:29:39.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.541+0000 7f3eef7fe640 1 -- 172.21.15.60:0/2939740449 learned_addr learned my addr 172.21.15.60:0/2939740449 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:29:39.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.541+0000 7f3eeeffd640 1 -- 172.21.15.60:0/2939740449 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1778075660 0 0) 0x7f3ef00c7070 con 0x7f3ef006cd80 2024-09-12T02:29:39.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.541+0000 7f3eeeffd640 1 -- 172.21.15.60:0/2939740449 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ed8003520 con 0x7f3ef006cd80 2024-09-12T02:29:39.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.542+0000 7f3eeeffd640 1 -- 172.21.15.60:0/2939740449 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3495963556 0 0) 0x7f3ed8003520 con 0x7f3ef006cd80 2024-09-12T02:29:39.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.542+0000 7f3eeeffd640 1 -- 172.21.15.60:0/2939740449 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ef0153be0 msgr2=0x7f3ef015a4a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:29:39.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.542+0000 7f3eeeffd640 1 --2- 172.21.15.60:0/2939740449 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ef0153be0 0x7f3ef015a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:39.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.542+0000 7f3eeeffd640 1 -- 172.21.15.60:0/2939740449 >> v1:172.21.15.105:6789/0 conn(0x7f3ef00c8b10 legacy=0x7f3ef01534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:39.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.542+0000 7f3eeeffd640 1 -- 172.21.15.60:0/2939740449 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ef00c6c90 con 0x7f3ef006cd80 2024-09-12T02:29:39.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.542+0000 7f3eeeffd640 1 -- 172.21.15.60:0/2939740449 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7f3ee4001670 con 0x7f3ef006cd80 2024-09-12T02:29:39.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.542+0000 7f3eeeffd640 1 -- 172.21.15.60:0/2939740449 >> v1:172.21.15.60:6789/0 conn(0x7f3ef006cd80 legacy=0x7f3ef0156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:39.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.542+0000 7f3eeeffd640 1 --2- 172.21.15.60:0/2939740449 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ef0153be0 0x7f3ed8003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:39.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.542+0000 7f3eeeffd640 1 --2- 172.21.15.60:0/2939740449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ed8004110 0x7f3ed8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:39.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.542+0000 7f3eeeffd640 1 --2- 172.21.15.60:0/2939740449 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ed8004e60 0x7f3ed800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:39.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.542+0000 7f3eeeffd640 1 -- 172.21.15.60:0/2939740449 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef00c69b0 con 0x7f3ed8004110 2024-09-12T02:29:39.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.542+0000 7f3eeeffd640 1 -- 172.21.15.60:0/2939740449 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed8005680 con 0x7f3ed8004e60 2024-09-12T02:29:39.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.542+0000 7f3eeeffd640 1 -- 172.21.15.60:0/2939740449 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3ed800bf00 con 0x7f3ef0153be0 2024-09-12T02:29:39.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.542+0000 7f3eeffff640 1 -- 172.21.15.60:0/2939740449 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ef0153be0 msgr2=0x7f3ed8003a00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:29:39.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.542+0000 7f3eef7fe640 1 --2- 172.21.15.60:0/2939740449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ed8004110 0x7f3ed8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:39.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.542+0000 7f3eeffff640 1 --2- 172.21.15.60:0/2939740449 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ef0153be0 0x7f3ed8003a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:29:39.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.542+0000 7f3ef498e640 1 --2- 172.21.15.60:0/2939740449 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ed8004e60 0x7f3ed800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:39.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.542+0000 7f3eef7fe640 1 -- 172.21.15.60:0/2939740449 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ef0153be0 msgr2=0x7f3ed8003a00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:29:39.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.542+0000 7f3eef7fe640 1 --2- 172.21.15.60:0/2939740449 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ef0153be0 0x7f3ed8003a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:39.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.542+0000 7f3eef7fe640 1 -- 172.21.15.60:0/2939740449 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ed8004e60 msgr2=0x7f3ed800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:39.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.542+0000 7f3eef7fe640 1 --2- 172.21.15.60:0/2939740449 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ed8004e60 0x7f3ed800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:39.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.542+0000 7f3eef7fe640 1 -- 172.21.15.60:0/2939740449 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ed8003520 con 0x7f3ed8004110 2024-09-12T02:29:39.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.543+0000 7f3eef7fe640 1 --2- 172.21.15.60:0/2939740449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ed8004110 0x7f3ed8004800 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3ee400c190 tx=0x7f3ed8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5815073038fd7cb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:39.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.543+0000 7f3eeeffd640 1 -- 172.21.15.60:0/2939740449 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee4007ce0 con 0x7f3ed8004110 2024-09-12T02:29:39.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.543+0000 7f3eeeffd640 1 -- 172.21.15.60:0/2939740449 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ee4005af0 con 0x7f3ed8004110 2024-09-12T02:29:39.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.543+0000 7f3eeeffd640 1 -- 172.21.15.60:0/2939740449 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee4007070 con 0x7f3ed8004110 2024-09-12T02:29:39.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.544+0000 7f3ef63f1640 1 -- 172.21.15.60:0/2939740449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ed8004110 msgr2=0x7f3ed8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:39.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.544+0000 7f3ef63f1640 1 --2- 172.21.15.60:0/2939740449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ed8004110 0x7f3ed8004800 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3ee400c190 tx=0x7f3ed8005830 comp rx=0 tx=0).stop 2024-09-12T02:29:39.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.545+0000 7f3ef498e640 1 -- 172.21.15.60:0/2939740449 reap_dead start 2024-09-12T02:29:39.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.545+0000 7f3ef63f1640 1 -- 172.21.15.60:0/2939740449 shutdown_connections 2024-09-12T02:29:39.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.545+0000 7f3ef63f1640 1 -- 172.21.15.60:0/2939740449 >> 172.21.15.60:0/2939740449 conn(0x7f3ef00adb80 msgr2=0x7f3ef00adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:39.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.545+0000 7f3ef63f1640 1 -- 172.21.15.60:0/2939740449 shutdown_connections 2024-09-12T02:29:39.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.545+0000 7f3ef63f1640 1 -- 172.21.15.60:0/2939740449 wait complete. 2024-09-12T02:29:39.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.547+0000 7f3ef63f1640 1 Processor -- start 2024-09-12T02:29:39.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.547+0000 7f3ef63f1640 1 -- start start 2024-09-12T02:29:39.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.548+0000 7f3ef63f1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ed8004110 0x7f3ef014fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:39.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.548+0000 7f3ef63f1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ef0150aa0 0x7f3ef00afeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:39.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.548+0000 7f3ef63f1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ef01503c0 0x7f3ef00b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:39.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.548+0000 7f3ef63f1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef00c9070 con 0x7f3ef01503c0 2024-09-12T02:29:39.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.548+0000 7f3ef63f1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef00c8ef0 con 0x7f3ed8004110 2024-09-12T02:29:39.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.548+0000 7f3ef63f1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3ef015a4a0 con 0x7f3ef0150aa0 2024-09-12T02:29:39.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.548+0000 7f3eef7fe640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ef0150aa0 msgr2=0x7f3ef00afeb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:29:39.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.548+0000 7f3eef7fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ef0150aa0 0x7f3ef00afeb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:29:39.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.548+0000 7f3eeffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ed8004110 0x7f3ef014fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:39.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.549+0000 7f3eeffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ed8004110 0x7f3ef014fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:39630/0 (socket says 172.21.15.60:39630) 2024-09-12T02:29:39.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.549+0000 7f3eeffff640 1 -- 172.21.15.60:0/1771154545 learned_addr learned my addr 172.21.15.60:0/1771154545 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:29:39.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.549+0000 7f3ef498e640 1 --2- 172.21.15.60:0/1771154545 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ef01503c0 0x7f3ef00b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:39.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.549+0000 7f3eeffff640 1 -- 172.21.15.60:0/1771154545 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ef0150aa0 msgr2=0x7f3ef00afeb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:29:39.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.549+0000 7f3eeffff640 1 --2- 172.21.15.60:0/1771154545 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ef0150aa0 0x7f3ef00afeb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:39.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.549+0000 7f3eeffff640 1 -- 172.21.15.60:0/1771154545 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ef01503c0 msgr2=0x7f3ef00b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:39.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.549+0000 7f3eeffff640 1 --2- 172.21.15.60:0/1771154545 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ef01503c0 0x7f3ef00b03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:39.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.549+0000 7f3eeffff640 1 -- 172.21.15.60:0/1771154545 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ef01f4160 con 0x7f3ed8004110 2024-09-12T02:29:39.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.549+0000 7f3ef498e640 1 --2- 172.21.15.60:0/1771154545 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ef01503c0 0x7f3ef00b03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:29:39.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.549+0000 7f3eeffff640 1 --2- 172.21.15.60:0/1771154545 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ed8004110 0x7f3ef014fa10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3ee000c4d0 tx=0x7f3ee000c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:39.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.549+0000 7f3eecff9640 1 -- 172.21.15.60:0/1771154545 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee0017070 con 0x7f3ed8004110 2024-09-12T02:29:39.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.550+0000 7f3eecff9640 1 -- 172.21.15.60:0/1771154545 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ee0007480 con 0x7f3ed8004110 2024-09-12T02:29:39.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.550+0000 7f3eecff9640 1 -- 172.21.15.60:0/1771154545 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee0005a00 con 0x7f3ed8004110 2024-09-12T02:29:39.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.550+0000 7f3ef63f1640 1 -- 172.21.15.60:0/1771154545 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ef01f4440 con 0x7f3ed8004110 2024-09-12T02:29:39.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.550+0000 7f3ef63f1640 1 -- 172.21.15.60:0/1771154545 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ef0158fd0 con 0x7f3ed8004110 2024-09-12T02:29:39.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.551+0000 7f3ef63f1640 1 -- 172.21.15.60:0/1771154545 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ef01592e0 con 0x7f3ed8004110 2024-09-12T02:29:39.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.552+0000 7f3eecff9640 1 -- 172.21.15.60:0/1771154545 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3ee001a070 con 0x7f3ed8004110 2024-09-12T02:29:39.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.552+0000 7f3eecff9640 1 --2- 172.21.15.60:0/1771154545 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3edc06bde0 0x7f3edc06e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:39.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.552+0000 7f3eecff9640 1 -- 172.21.15.60:0/1771154545 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f3ee008a330 con 0x7f3ed8004110 2024-09-12T02:29:39.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.552+0000 7f3eef7fe640 1 --2- 172.21.15.60:0/1771154545 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3edc06bde0 0x7f3edc06e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:39.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.553+0000 7f3eef7fe640 1 --2- 172.21.15.60:0/1771154545 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3edc06bde0 0x7f3edc06e2a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3ee4032000 tx=0x7f3ee4009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:39.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.557+0000 7f3eecff9640 1 -- 172.21.15.60:0/1771154545 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3ee0058380 con 0x7f3ed8004110 2024-09-12T02:29:39.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.817+0000 7f3ef63f1640 1 -- 172.21.15.60:0/1771154545 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3ef015a7d0 con 0x7f3ed8004110 2024-09-12T02:29:39.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.817+0000 7f3eecff9640 1 -- 172.21.15.60:0/1771154545 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f3ee005c680 con 0x7f3ed8004110 2024-09-12T02:29:39.818 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":64,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:29:39.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.819+0000 7f3ef63f1640 1 -- 172.21.15.60:0/1771154545 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3edc06bde0 msgr2=0x7f3edc06e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:39.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.819+0000 7f3ef63f1640 1 --2- 172.21.15.60:0/1771154545 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3edc06bde0 0x7f3edc06e2a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3ee4032000 tx=0x7f3ee4009030 comp rx=0 tx=0).stop 2024-09-12T02:29:39.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.819+0000 7f3ef63f1640 1 -- 172.21.15.60:0/1771154545 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ed8004110 msgr2=0x7f3ef014fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:39.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.819+0000 7f3ef63f1640 1 --2- 172.21.15.60:0/1771154545 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ed8004110 0x7f3ef014fa10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3ee000c4d0 tx=0x7f3ee000c990 comp rx=0 tx=0).stop 2024-09-12T02:29:39.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.819+0000 7f3ef63f1640 1 -- 172.21.15.60:0/1771154545 shutdown_connections 2024-09-12T02:29:39.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.819+0000 7f3ef63f1640 1 --2- 172.21.15.60:0/1771154545 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3edc06bde0 0x7f3edc06e2a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:39.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.819+0000 7f3ef63f1640 1 --2- 172.21.15.60:0/1771154545 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ef01503c0 0x7f3ef00b03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:39.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.819+0000 7f3ef63f1640 1 --2- 172.21.15.60:0/1771154545 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ef0150aa0 0x7f3ef00afeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:39.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.819+0000 7f3ef63f1640 1 --2- 172.21.15.60:0/1771154545 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ed8004110 0x7f3ef014fa10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:39.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.819+0000 7f3ef63f1640 1 -- 172.21.15.60:0/1771154545 >> 172.21.15.60:0/1771154545 conn(0x7f3ef00adb80 msgr2=0x7f3ef00cbe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:39.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.819+0000 7f3ef63f1640 1 -- 172.21.15.60:0/1771154545 shutdown_connections 2024-09-12T02:29:39.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:39.819+0000 7f3ef63f1640 1 -- 172.21.15.60:0/1771154545 wait complete. 2024-09-12T02:29:42.831 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:29:42.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.940+0000 7fe3c3bd8640 1 Processor -- start 2024-09-12T02:29:42.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.941+0000 7fe3c3bd8640 1 -- start start 2024-09-12T02:29:42.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.941+0000 7fe3c3bd8640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe3bc0c8b10 0x7fe3bc15a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:42.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.941+0000 7fe3c3bd8640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe3bc153be0 0x7fe3bc156660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:42.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.941+0000 7fe3c3bd8640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3bc0c7070 con 0x7fe3bc06cd80 2024-09-12T02:29:42.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.941+0000 7fe3c3bd8640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fe3bc06d210 con 0x7fe3bc153be0 2024-09-12T02:29:42.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.941+0000 7fe3c3bd8640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fe3bc0c69b0 con 0x7fe3bc0c8b10 2024-09-12T02:29:42.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.942+0000 7fe3c2175640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe3bc153be0 0x7fe3bc156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:42.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.942+0000 7fe3c2175640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe3bc153be0 0x7fe3bc156660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40048/0 (socket says 172.21.15.60:40048) 2024-09-12T02:29:42.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.942+0000 7fe3c2175640 1 -- 172.21.15.60:0/457511092 learned_addr learned my addr 172.21.15.60:0/457511092 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:29:42.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.942+0000 7fe3c1974640 1 --2- 172.21.15.60:0/457511092 >> v2:172.21.15.105:3300/0 conn(0x7fe3bc0c8b10 0x7fe3bc15a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:42.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.942+0000 7fe3c2175640 1 -- 172.21.15.60:0/457511092 >> v2:172.21.15.105:3300/0 conn(0x7fe3bc0c8b10 msgr2=0x7fe3bc15a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:42.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.942+0000 7fe3c2175640 1 --2- 172.21.15.60:0/457511092 >> v2:172.21.15.105:3300/0 conn(0x7fe3bc0c8b10 0x7fe3bc15a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.942+0000 7fe3c2175640 1 -- 172.21.15.60:0/457511092 >> v1:172.21.15.105:6789/0 conn(0x7fe3bc06cd80 legacy=0x7fe3bc1534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:42.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.942+0000 7fe3c2175640 1 -- 172.21.15.60:0/457511092 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3bc0c6c90 con 0x7fe3bc153be0 2024-09-12T02:29:42.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.943+0000 7fe3c2175640 1 --2- 172.21.15.60:0/457511092 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3bc153be0 0x7fe3bc156660 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc0ae760 tx=0x7fe3b402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2be5bb503f42c573 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:42.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.943+0000 7fe3c0972640 1 -- 172.21.15.60:0/457511092 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b4036070 con 0x7fe3bc153be0 2024-09-12T02:29:42.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.943+0000 7fe3c0972640 1 -- 172.21.15.60:0/457511092 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3b4031600 con 0x7fe3bc153be0 2024-09-12T02:29:42.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.943+0000 7fe3c0972640 1 -- 172.21.15.60:0/457511092 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b40319d0 con 0x7fe3bc153be0 2024-09-12T02:29:42.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.944+0000 7fe3c3bd8640 1 -- 172.21.15.60:0/457511092 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3bc153be0 msgr2=0x7fe3bc156660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:42.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.944+0000 7fe3c3bd8640 1 --2- 172.21.15.60:0/457511092 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3bc153be0 0x7fe3bc156660 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc0ae760 tx=0x7fe3b402a6a0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.944+0000 7fe3c3bd8640 1 -- 172.21.15.60:0/457511092 shutdown_connections 2024-09-12T02:29:42.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.944+0000 7fe3c3bd8640 1 --2- 172.21.15.60:0/457511092 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3bc153be0 0x7fe3bc156660 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.944+0000 7fe3c3bd8640 1 --2- 172.21.15.60:0/457511092 >> v2:172.21.15.105:3300/0 conn(0x7fe3bc0c8b10 0x7fe3bc15a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.944+0000 7fe3c3bd8640 1 -- 172.21.15.60:0/457511092 >> 172.21.15.60:0/457511092 conn(0x7fe3bc0adb80 msgr2=0x7fe3bc0adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:42.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.944+0000 7fe3c3bd8640 1 -- 172.21.15.60:0/457511092 shutdown_connections 2024-09-12T02:29:42.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.944+0000 7fe3c3bd8640 1 -- 172.21.15.60:0/457511092 wait complete. 2024-09-12T02:29:42.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.945+0000 7fe3c3bd8640 1 Processor -- start 2024-09-12T02:29:42.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.945+0000 7fe3c3bd8640 1 -- start start 2024-09-12T02:29:42.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.946+0000 7fe3c3bd8640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3bc0c8b10 0x7fe3bc1ecab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:42.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.946+0000 7fe3c3bd8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3bc153be0 0x7fe3bc152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:42.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.946+0000 7fe3c3bd8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3bc159340 0x7fe3bc14eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:42.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.946+0000 7fe3c3bd8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe3bc0c9070 con 0x7fe3bc153be0 2024-09-12T02:29:42.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.946+0000 7fe3c3bd8640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe3bc0c8ef0 con 0x7fe3bc159340 2024-09-12T02:29:42.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.946+0000 7fe3c3bd8640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe3bc156ba0 con 0x7fe3bc0c8b10 2024-09-12T02:29:42.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.946+0000 7fe3c1974640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3bc0c8b10 msgr2=0x7fe3bc1ecab0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:29:42.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.946+0000 7fe3c1974640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3bc0c8b10 0x7fe3bc1ecab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:29:42.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.946+0000 7fe3c1173640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3bc153be0 0x7fe3bc152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:42.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.946+0000 7fe3c1173640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3bc153be0 0x7fe3bc152750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40054/0 (socket says 172.21.15.60:40054) 2024-09-12T02:29:42.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.946+0000 7fe3c1173640 1 -- 172.21.15.60:0/1742995489 learned_addr learned my addr 172.21.15.60:0/1742995489 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:29:42.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.946+0000 7fe3c2175640 1 --2- 172.21.15.60:0/1742995489 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3bc159340 0x7fe3bc14eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:42.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.947+0000 7fe3c1173640 1 -- 172.21.15.60:0/1742995489 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3bc0c8b10 msgr2=0x7fe3bc1ecab0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:29:42.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.947+0000 7fe3c1173640 1 --2- 172.21.15.60:0/1742995489 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3bc0c8b10 0x7fe3bc1ecab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.947+0000 7fe3c1173640 1 -- 172.21.15.60:0/1742995489 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3bc159340 msgr2=0x7fe3bc14eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:42.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.947+0000 7fe3c1173640 1 --2- 172.21.15.60:0/1742995489 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3bc159340 0x7fe3bc14eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.947+0000 7fe3c1173640 1 -- 172.21.15.60:0/1742995489 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3bc1ec010 con 0x7fe3bc153be0 2024-09-12T02:29:42.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.947+0000 7fe3c2175640 1 --2- 172.21.15.60:0/1742995489 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3bc159340 0x7fe3bc14eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:29:42.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.947+0000 7fe3c1173640 1 --2- 172.21.15.60:0/1742995489 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3bc153be0 0x7fe3bc152750 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe3b000c400 tx=0x7fe3b000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:42.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.947+0000 7fe3ae7fc640 1 -- 172.21.15.60:0/1742995489 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b00052d0 con 0x7fe3bc153be0 2024-09-12T02:29:42.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.947+0000 7fe3ae7fc640 1 -- 172.21.15.60:0/1742995489 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3b0005490 con 0x7fe3bc153be0 2024-09-12T02:29:42.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.947+0000 7fe3c3bd8640 1 -- 172.21.15.60:0/1742995489 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3bc159850 con 0x7fe3bc153be0 2024-09-12T02:29:42.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.947+0000 7fe3ae7fc640 1 -- 172.21.15.60:0/1742995489 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b0007260 con 0x7fe3bc153be0 2024-09-12T02:29:42.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.947+0000 7fe3c3bd8640 1 -- 172.21.15.60:0/1742995489 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3bc0cc7e0 con 0x7fe3bc153be0 2024-09-12T02:29:42.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.948+0000 7fe3c3bd8640 1 -- 172.21.15.60:0/1742995489 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3bc156660 con 0x7fe3bc153be0 2024-09-12T02:29:42.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.949+0000 7fe3ae7fc640 1 -- 172.21.15.60:0/1742995489 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe3b0007400 con 0x7fe3bc153be0 2024-09-12T02:29:42.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.949+0000 7fe3ae7fc640 1 --2- 172.21.15.60:0/1742995489 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe3a006be10 0x7fe3a006e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:42.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.949+0000 7fe3ae7fc640 1 -- 172.21.15.60:0/1742995489 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fe3b008a600 con 0x7fe3bc153be0 2024-09-12T02:29:42.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.949+0000 7fe3c1974640 1 --2- 172.21.15.60:0/1742995489 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe3a006be10 0x7fe3a006e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:42.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.950+0000 7fe3c1974640 1 --2- 172.21.15.60:0/1742995489 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe3a006be10 0x7fe3a006e2d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe3b80094a0 tx=0x7fe3b8009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:42.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:42.954+0000 7fe3ae7fc640 1 -- 172.21.15.60:0/1742995489 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe3b0058650 con 0x7fe3bc153be0 2024-09-12T02:29:43.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:43.221+0000 7fe3c3bd8640 1 -- 172.21.15.60:0/1742995489 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe3bc1ec6d0 con 0x7fe3bc153be0 2024-09-12T02:29:43.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:43.221+0000 7fe3ae7fc640 1 -- 172.21.15.60:0/1742995489 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7fe3b005c950 con 0x7fe3bc153be0 2024-09-12T02:29:43.222 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":64,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:29:43.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:43.224+0000 7fe3c3bd8640 1 -- 172.21.15.60:0/1742995489 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe3a006be10 msgr2=0x7fe3a006e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:43.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:43.224+0000 7fe3c3bd8640 1 --2- 172.21.15.60:0/1742995489 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe3a006be10 0x7fe3a006e2d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe3b80094a0 tx=0x7fe3b8009190 comp rx=0 tx=0).stop 2024-09-12T02:29:43.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:43.224+0000 7fe3c3bd8640 1 -- 172.21.15.60:0/1742995489 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3bc153be0 msgr2=0x7fe3bc152750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:43.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:43.224+0000 7fe3c3bd8640 1 --2- 172.21.15.60:0/1742995489 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3bc153be0 0x7fe3bc152750 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe3b000c400 tx=0x7fe3b000c8c0 comp rx=0 tx=0).stop 2024-09-12T02:29:43.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:43.224+0000 7fe3c3bd8640 1 -- 172.21.15.60:0/1742995489 shutdown_connections 2024-09-12T02:29:43.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:43.224+0000 7fe3c3bd8640 1 --2- 172.21.15.60:0/1742995489 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe3a006be10 0x7fe3a006e2d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:43.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:43.224+0000 7fe3c3bd8640 1 --2- 172.21.15.60:0/1742995489 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3bc159340 0x7fe3bc14eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:43.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:43.224+0000 7fe3c3bd8640 1 --2- 172.21.15.60:0/1742995489 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3bc153be0 0x7fe3bc152750 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:43.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:43.224+0000 7fe3c3bd8640 1 --2- 172.21.15.60:0/1742995489 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3bc0c8b10 0x7fe3bc1ecab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:43.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:43.224+0000 7fe3c3bd8640 1 -- 172.21.15.60:0/1742995489 >> 172.21.15.60:0/1742995489 conn(0x7fe3bc0adb80 msgr2=0x7fe3bc1e19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:43.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:43.224+0000 7fe3c3bd8640 1 -- 172.21.15.60:0/1742995489 shutdown_connections 2024-09-12T02:29:43.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:43.224+0000 7fe3c3bd8640 1 -- 172.21.15.60:0/1742995489 wait complete. 2024-09-12T02:29:46.237 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:29:46.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:46.350+0000 7fef0377f640 1 Processor -- start 2024-09-12T02:29:46.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:46.350+0000 7fef0377f640 1 -- start start 2024-09-12T02:29:46.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:46.351+0000 7fef0377f640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7feefc06cd80 0x7feefc153be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:46.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:46.351+0000 7fef0377f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7feefc15a4a0 0x7feefc156660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:46.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:46.351+0000 7fef0377f640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feefc0c7070 con 0x7feefc0c8b10 2024-09-12T02:29:46.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:46.351+0000 7fef0377f640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7feefc06d210 con 0x7feefc15a4a0 2024-09-12T02:29:46.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:46.351+0000 7fef0377f640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7feefc0c69b0 con 0x7feefc06cd80 2024-09-12T02:29:46.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:46.351+0000 7fef01d1c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7feefc15a4a0 0x7feefc156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:46.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:46.351+0000 7fef01d1c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7feefc15a4a0 0x7feefc156660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40062/0 (socket says 172.21.15.60:40062) 2024-09-12T02:29:46.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:46.351+0000 7fef01d1c640 1 -- 172.21.15.60:0/112476020 learned_addr learned my addr 172.21.15.60:0/112476020 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:29:46.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:46.351+0000 7fef00d1a640 1 --2- 172.21.15.60:0/112476020 >> v2:172.21.15.105:3300/0 conn(0x7feefc06cd80 0x7feefc153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:46.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:46.351+0000 7fef01d1c640 1 -- 172.21.15.60:0/112476020 >> v2:172.21.15.60:3300/0 conn(0x7feefc15a4a0 msgr2=0x7feefc156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:29:46.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:46.351+0000 7fef01d1c640 1 -- 172.21.15.60:0/112476020 >> v2:172.21.15.60:3300/0 conn(0x7feefc15a4a0 msgr2=0x7feefc156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:29:46.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:46.351+0000 7fef01d1c640 1 --2- 172.21.15.60:0/112476020 >> v2:172.21.15.60:3300/0 conn(0x7feefc15a4a0 0x7feefc156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:29:46.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:46.352+0000 7fef00d1a640 1 -- 172.21.15.60:0/112476020 >> v2:172.21.15.105:3300/0 conn(0x7feefc06cd80 msgr2=0x7feefc153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:29:46.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:46.352+0000 7fef01d1c640 1 --2- 172.21.15.60:0/112476020 >> v2:172.21.15.60:3300/0 conn(0x7feefc15a4a0 0x7feefc156660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:29:46.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:46.352+0000 7fef00d1a640 1 -- 172.21.15.60:0/112476020 >> v2:172.21.15.105:3300/0 conn(0x7feefc06cd80 msgr2=0x7feefc153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:29:46.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:46.352+0000 7fef00d1a640 1 --2- 172.21.15.60:0/112476020 >> v2:172.21.15.105:3300/0 conn(0x7feefc06cd80 0x7feefc153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:29:46.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:46.352+0000 7fef00d1a640 1 --2- 172.21.15.60:0/112476020 >> v2:172.21.15.105:3300/0 conn(0x7feefc06cd80 0x7feefc153be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:29:46.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:46.553+0000 7fef01d1c640 1 --2- 172.21.15.60:0/112476020 >> v2:172.21.15.60:3300/0 conn(0x7feefc15a4a0 0x7feefc156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:46.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:46.553+0000 7fef01d1c640 1 -- 172.21.15.60:0/112476020 >> v2:172.21.15.60:3300/0 conn(0x7feefc15a4a0 msgr2=0x7feefc156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:29:46.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:46.553+0000 7fef01d1c640 1 -- 172.21.15.60:0/112476020 >> v2:172.21.15.60:3300/0 conn(0x7feefc15a4a0 msgr2=0x7feefc156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:29:46.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:46.553+0000 7fef01d1c640 1 --2- 172.21.15.60:0/112476020 >> v2:172.21.15.60:3300/0 conn(0x7feefc15a4a0 0x7feefc156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:29:46.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:46.553+0000 7fef01d1c640 1 --2- 172.21.15.60:0/112476020 >> v2:172.21.15.60:3300/0 conn(0x7feefc15a4a0 0x7feefc156660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:29:46.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:46.553+0000 7fef00d1a640 1 --2- 172.21.15.60:0/112476020 >> v2:172.21.15.105:3300/0 conn(0x7feefc06cd80 0x7feefc153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:46.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:46.553+0000 7fef00d1a640 1 -- 172.21.15.60:0/112476020 >> v2:172.21.15.105:3300/0 conn(0x7feefc06cd80 msgr2=0x7feefc153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:29:46.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:46.553+0000 7fef00d1a640 1 -- 172.21.15.60:0/112476020 >> v2:172.21.15.105:3300/0 conn(0x7feefc06cd80 msgr2=0x7feefc153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:29:46.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:46.553+0000 7fef00d1a640 1 --2- 172.21.15.60:0/112476020 >> v2:172.21.15.105:3300/0 conn(0x7feefc06cd80 0x7feefc153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:29:46.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:46.553+0000 7fef00d1a640 1 --2- 172.21.15.60:0/112476020 >> v2:172.21.15.105:3300/0 conn(0x7feefc06cd80 0x7feefc153be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:29:46.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:46.954+0000 7fef01d1c640 1 --2- 172.21.15.60:0/112476020 >> v2:172.21.15.60:3300/0 conn(0x7feefc15a4a0 0x7feefc156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:46.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:46.954+0000 7fef00d1a640 1 --2- 172.21.15.60:0/112476020 >> v2:172.21.15.105:3300/0 conn(0x7feefc06cd80 0x7feefc153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:46.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:46.954+0000 7fef01d1c640 1 -- 172.21.15.60:0/112476020 >> v2:172.21.15.60:3300/0 conn(0x7feefc15a4a0 msgr2=0x7feefc156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:29:46.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:46.954+0000 7fef01d1c640 1 -- 172.21.15.60:0/112476020 >> v2:172.21.15.60:3300/0 conn(0x7feefc15a4a0 msgr2=0x7feefc156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:29:46.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:46.954+0000 7fef01d1c640 1 --2- 172.21.15.60:0/112476020 >> v2:172.21.15.60:3300/0 conn(0x7feefc15a4a0 0x7feefc156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:29:46.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:46.954+0000 7fef01d1c640 1 --2- 172.21.15.60:0/112476020 >> v2:172.21.15.60:3300/0 conn(0x7feefc15a4a0 0x7feefc156660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:29:46.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:46.954+0000 7fef00d1a640 1 -- 172.21.15.60:0/112476020 >> v2:172.21.15.105:3300/0 conn(0x7feefc06cd80 msgr2=0x7feefc153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:29:46.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:46.954+0000 7fef00d1a640 1 -- 172.21.15.60:0/112476020 >> v2:172.21.15.105:3300/0 conn(0x7feefc06cd80 msgr2=0x7feefc153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:29:46.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:46.954+0000 7fef00d1a640 1 --2- 172.21.15.60:0/112476020 >> v2:172.21.15.105:3300/0 conn(0x7feefc06cd80 0x7feefc153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:29:46.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:46.954+0000 7fef00d1a640 1 --2- 172.21.15.60:0/112476020 >> v2:172.21.15.105:3300/0 conn(0x7feefc06cd80 0x7feefc153be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:29:47.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:47.755+0000 7fef01d1c640 1 --2- 172.21.15.60:0/112476020 >> v2:172.21.15.60:3300/0 conn(0x7feefc15a4a0 0x7feefc156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:47.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:47.755+0000 7fef00d1a640 1 --2- 172.21.15.60:0/112476020 >> v2:172.21.15.105:3300/0 conn(0x7feefc06cd80 0x7feefc153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:47.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:47.755+0000 7fef01d1c640 1 -- 172.21.15.60:0/112476020 >> v2:172.21.15.60:3300/0 conn(0x7feefc15a4a0 msgr2=0x7feefc156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:29:47.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:47.755+0000 7fef01d1c640 1 -- 172.21.15.60:0/112476020 >> v2:172.21.15.60:3300/0 conn(0x7feefc15a4a0 msgr2=0x7feefc156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:29:47.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:47.755+0000 7fef01d1c640 1 --2- 172.21.15.60:0/112476020 >> v2:172.21.15.60:3300/0 conn(0x7feefc15a4a0 0x7feefc156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:29:47.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:47.755+0000 7fef01d1c640 1 --2- 172.21.15.60:0/112476020 >> v2:172.21.15.60:3300/0 conn(0x7feefc15a4a0 0x7feefc156660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:29:47.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:47.755+0000 7fef00d1a640 1 -- 172.21.15.60:0/112476020 >> v2:172.21.15.105:3300/0 conn(0x7feefc06cd80 msgr2=0x7feefc153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:29:47.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:47.755+0000 7fef00d1a640 1 -- 172.21.15.60:0/112476020 >> v2:172.21.15.105:3300/0 conn(0x7feefc06cd80 msgr2=0x7feefc153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:29:47.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:47.755+0000 7fef00d1a640 1 --2- 172.21.15.60:0/112476020 >> v2:172.21.15.105:3300/0 conn(0x7feefc06cd80 0x7feefc153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:29:47.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:47.755+0000 7fef00d1a640 1 --2- 172.21.15.60:0/112476020 >> v2:172.21.15.105:3300/0 conn(0x7feefc06cd80 0x7feefc153be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:29:49.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:49.351+0000 7feef2ffd640 1 -- 172.21.15.60:0/112476020 >> v2:172.21.15.105:3300/0 conn(0x7feefc06cd80 msgr2=0x7feefc153be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:29:49.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:49.351+0000 7feef2ffd640 1 --2- 172.21.15.60:0/112476020 >> v2:172.21.15.105:3300/0 conn(0x7feefc06cd80 0x7feefc153be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:49.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:49.351+0000 7feef2ffd640 1 -- 172.21.15.60:0/112476020 >> v2:172.21.15.60:3300/0 conn(0x7feefc15a4a0 msgr2=0x7feefc156660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:29:49.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:49.351+0000 7feef2ffd640 1 --2- 172.21.15.60:0/112476020 >> v2:172.21.15.60:3300/0 conn(0x7feefc15a4a0 0x7feefc156660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:49.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:49.351+0000 7feef2ffd640 1 -- 172.21.15.60:0/112476020 >> v1:172.21.15.105:6789/0 conn(0x7feefc0c8b10 legacy=0x7feefc1534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:49.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:49.351+0000 7feef2ffd640 1 --2- 172.21.15.60:0/112476020 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feee00036b0 0x7feee0005ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:49.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:49.351+0000 7feef2ffd640 1 -- 172.21.15.60:0/112476020 --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feefc0c6c90 con 0x7feee0006170 2024-09-12T02:29:49.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:49.351+0000 7feef2ffd640 1 -- 172.21.15.60:0/112476020 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7feefc06d210 con 0x7feee00036b0 2024-09-12T02:29:49.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:49.352+0000 7fef0151b640 1 -- 172.21.15.60:0/112476020 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feee00036b0 msgr2=0x7feee0005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:29:49.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:49.352+0000 7fef0151b640 1 --2- 172.21.15.60:0/112476020 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feee00036b0 0x7feee0005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:29:49.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:49.553+0000 7fef0151b640 1 -- 172.21.15.60:0/112476020 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feee00036b0 msgr2=0x7feee0005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:29:49.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:49.553+0000 7fef0151b640 1 --2- 172.21.15.60:0/112476020 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feee00036b0 0x7feee0005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:29:49.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:49.954+0000 7fef0151b640 1 -- 172.21.15.60:0/112476020 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feee00036b0 msgr2=0x7feee0005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:29:49.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:49.954+0000 7fef0151b640 1 --2- 172.21.15.60:0/112476020 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feee00036b0 0x7feee0005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:29:50.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.411+0000 7feef3fff640 1 -- 172.21.15.60:0/112476020 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3433684948 0 0) 0x7feefc0c6c90 con 0x7feee0006170 2024-09-12T02:29:50.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.411+0000 7feef3fff640 1 -- 172.21.15.60:0/112476020 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feee8003520 con 0x7feee0006170 2024-09-12T02:29:50.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.413+0000 7feef3fff640 1 -- 172.21.15.60:0/112476020 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2813024675 0 0) 0x7feee8003520 con 0x7feee0006170 2024-09-12T02:29:50.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.413+0000 7feef3fff640 1 -- 172.21.15.60:0/112476020 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feee00036b0 msgr2=0x7feee0005ae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:29:50.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.413+0000 7feef3fff640 1 --2- 172.21.15.60:0/112476020 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feee00036b0 0x7feee0005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.413+0000 7feef3fff640 1 -- 172.21.15.60:0/112476020 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee000afb0 con 0x7feee0006170 2024-09-12T02:29:50.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.413+0000 7feef3fff640 1 -- 172.21.15.60:0/112476020 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7feeec00d580 con 0x7feee0006170 2024-09-12T02:29:50.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.413+0000 7feef3fff640 1 -- 172.21.15.60:0/112476020 >> v1:172.21.15.60:6789/0 conn(0x7feee0006170 legacy=0x7feee0008610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:50.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.413+0000 7fef01d1c640 1 -- 172.21.15.60:0/112476020 reap_dead start 2024-09-12T02:29:50.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.413+0000 7feef3fff640 1 --2- 172.21.15.60:0/112476020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feee80039b0 0x7feee8003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:50.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.413+0000 7feef3fff640 1 --2- 172.21.15.60:0/112476020 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feee8004800 0x7feee8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:50.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.413+0000 7feef3fff640 1 --2- 172.21.15.60:0/112476020 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feee80052e0 0x7feee800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:50.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.413+0000 7feef3fff640 1 -- 172.21.15.60:0/112476020 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7feefc06d210 con 0x7feee80039b0 2024-09-12T02:29:50.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.413+0000 7feef3fff640 1 -- 172.21.15.60:0/112476020 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7feee800c230 con 0x7feee8004800 2024-09-12T02:29:50.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.413+0000 7feef3fff640 1 -- 172.21.15.60:0/112476020 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7feee800c430 con 0x7feee80052e0 2024-09-12T02:29:50.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.413+0000 7fef01d1c640 1 -- 172.21.15.60:0/112476020 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feee80052e0 msgr2=0x7feee800b9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:29:50.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.413+0000 7fef01d1c640 1 --2- 172.21.15.60:0/112476020 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feee80052e0 0x7feee800b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:29:50.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.413+0000 7fef00d1a640 1 --2- 172.21.15.60:0/112476020 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feee8004800 0x7feee8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:50.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.414+0000 7fef00d1a640 1 -- 172.21.15.60:0/112476020 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feee80052e0 msgr2=0x7feee800b9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:29:50.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.414+0000 7fef00d1a640 1 --2- 172.21.15.60:0/112476020 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feee80052e0 0x7feee800b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.414+0000 7fef00d1a640 1 -- 172.21.15.60:0/112476020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feee80039b0 msgr2=0x7feee8003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:50.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.414+0000 7fef00d1a640 1 --2- 172.21.15.60:0/112476020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feee80039b0 0x7feee8003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.414+0000 7fef00d1a640 1 -- 172.21.15.60:0/112476020 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee8003520 con 0x7feee8004800 2024-09-12T02:29:50.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.415+0000 7fef00d1a640 1 --2- 172.21.15.60:0/112476020 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feee8004800 0x7feee8004c80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7feeec006fd0 tx=0x7feee8005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b450db0cff79bee8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:50.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.415+0000 7feef3fff640 1 -- 172.21.15.60:0/112476020 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec039070 con 0x7feee8004800 2024-09-12T02:29:50.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.415+0000 7feef3fff640 1 -- 172.21.15.60:0/112476020 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeec034410 con 0x7feee8004800 2024-09-12T02:29:50.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.415+0000 7feef3fff640 1 -- 172.21.15.60:0/112476020 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec00ddf0 con 0x7feee8004800 2024-09-12T02:29:50.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.416+0000 7fef0377f640 1 -- 172.21.15.60:0/112476020 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feee8004800 msgr2=0x7feee8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:50.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.416+0000 7fef0377f640 1 --2- 172.21.15.60:0/112476020 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feee8004800 0x7feee8004c80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7feeec006fd0 tx=0x7feee8005830 comp rx=0 tx=0).stop 2024-09-12T02:29:50.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.416+0000 7fef0377f640 1 -- 172.21.15.60:0/112476020 shutdown_connections 2024-09-12T02:29:50.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.416+0000 7fef0377f640 1 --2- 172.21.15.60:0/112476020 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feee80052e0 0x7feee800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.416+0000 7fef0377f640 1 --2- 172.21.15.60:0/112476020 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feee8004800 0x7feee8004c80 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.416+0000 7fef0377f640 1 --2- 172.21.15.60:0/112476020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feee80039b0 0x7feee8003db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.416+0000 7fef0377f640 1 -- 172.21.15.60:0/112476020 >> 172.21.15.60:0/112476020 conn(0x7feefc0adb80 msgr2=0x7feefc0adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:50.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.416+0000 7fef0377f640 1 -- 172.21.15.60:0/112476020 shutdown_connections 2024-09-12T02:29:50.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.416+0000 7fef0377f640 1 -- 172.21.15.60:0/112476020 wait complete. 2024-09-12T02:29:50.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.419+0000 7fef0377f640 1 Processor -- start 2024-09-12T02:29:50.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.419+0000 7fef0377f640 1 -- start start 2024-09-12T02:29:50.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.420+0000 7fef0377f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feee80039b0 0x7feefc0b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:50.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.420+0000 7fef0377f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feee8004800 0x7feefc14f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:50.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.420+0000 7fef0377f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feee80052e0 0x7feefc14dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:50.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.420+0000 7fef0377f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7feefc0c9070 con 0x7feee80039b0 2024-09-12T02:29:50.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.420+0000 7fef0377f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7feefc0c8ef0 con 0x7feee8004800 2024-09-12T02:29:50.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.420+0000 7fef0377f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7feefc1534d0 con 0x7feee80052e0 2024-09-12T02:29:50.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.420+0000 7fef01d1c640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feee80052e0 msgr2=0x7feefc14dd50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:29:50.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.420+0000 7fef01d1c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feee80052e0 0x7feefc14dd50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:29:50.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.420+0000 7fef0151b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feee80039b0 0x7feefc0b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:50.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.420+0000 7fef0151b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feee80039b0 0x7feefc0b1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54934/0 (socket says 172.21.15.60:54934) 2024-09-12T02:29:50.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.420+0000 7fef0151b640 1 -- 172.21.15.60:0/3860495006 learned_addr learned my addr 172.21.15.60:0/3860495006 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:29:50.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.420+0000 7fef00d1a640 1 --2- 172.21.15.60:0/3860495006 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feee8004800 0x7feefc14f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:50.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.421+0000 7fef00d1a640 1 -- 172.21.15.60:0/3860495006 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feee80052e0 msgr2=0x7feefc14dd50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:29:50.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.421+0000 7fef00d1a640 1 --2- 172.21.15.60:0/3860495006 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feee80052e0 0x7feefc14dd50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.421+0000 7fef00d1a640 1 -- 172.21.15.60:0/3860495006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feee80039b0 msgr2=0x7feefc0b1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:50.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.421+0000 7fef00d1a640 1 --2- 172.21.15.60:0/3860495006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feee80039b0 0x7feefc0b1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.421+0000 7fef00d1a640 1 -- 172.21.15.60:0/3860495006 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feefc1501e0 con 0x7feee8004800 2024-09-12T02:29:50.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.421+0000 7fef0151b640 1 --2- 172.21.15.60:0/3860495006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feee80039b0 0x7feefc0b1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:29:50.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.421+0000 7fef00d1a640 1 --2- 172.21.15.60:0/3860495006 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feee8004800 0x7feefc14f660 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7feeec033000 tx=0x7feeec0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:50.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.422+0000 7feef1ffb640 1 -- 172.21.15.60:0/3860495006 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec043070 con 0x7feee8004800 2024-09-12T02:29:50.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.422+0000 7feef1ffb640 1 -- 172.21.15.60:0/3860495006 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeec00d380 con 0x7feee8004800 2024-09-12T02:29:50.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.422+0000 7feef1ffb640 1 -- 172.21.15.60:0/3860495006 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec039040 con 0x7feee8004800 2024-09-12T02:29:50.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.422+0000 7fef0377f640 1 -- 172.21.15.60:0/3860495006 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feefc1504c0 con 0x7feee8004800 2024-09-12T02:29:50.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.422+0000 7fef0377f640 1 -- 172.21.15.60:0/3860495006 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feefc14fba0 con 0x7feee8004800 2024-09-12T02:29:50.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.424+0000 7fef0377f640 1 -- 172.21.15.60:0/3860495006 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feefc15aa90 con 0x7feee8004800 2024-09-12T02:29:50.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.424+0000 7feef1ffb640 1 -- 172.21.15.60:0/3860495006 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feeec046070 con 0x7feee8004800 2024-09-12T02:29:50.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.424+0000 7feef1ffb640 1 --2- 172.21.15.60:0/3860495006 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7feee006c670 0x7feee006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:50.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.424+0000 7feef1ffb640 1 -- 172.21.15.60:0/3860495006 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7feeec0ac350 con 0x7feee8004800 2024-09-12T02:29:50.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.424+0000 7fef0151b640 1 --2- 172.21.15.60:0/3860495006 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7feee006c670 0x7feee006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:50.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.425+0000 7fef0151b640 1 --2- 172.21.15.60:0/3860495006 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7feee006c670 0x7feee006eb30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7feef8007fd0 tx=0x7feef8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:50.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.429+0000 7feef1ffb640 1 -- 172.21.15.60:0/3860495006 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7feefc15aa90 con 0x7feee8004800 2024-09-12T02:29:50.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.677+0000 7fef0377f640 1 -- 172.21.15.60:0/3860495006 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7feefc0c69b0 con 0x7feee8004800 2024-09-12T02:29:50.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.678+0000 7feef1ffb640 1 -- 172.21.15.60:0/3860495006 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7feeec07a300 con 0x7feee8004800 2024-09-12T02:29:50.678 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":68,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:29:50.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.680+0000 7fef0377f640 1 -- 172.21.15.60:0/3860495006 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7feee006c670 msgr2=0x7feee006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:50.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.680+0000 7fef0377f640 1 --2- 172.21.15.60:0/3860495006 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7feee006c670 0x7feee006eb30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7feef8007fd0 tx=0x7feef8009040 comp rx=0 tx=0).stop 2024-09-12T02:29:50.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.680+0000 7fef0377f640 1 -- 172.21.15.60:0/3860495006 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feee8004800 msgr2=0x7feefc14f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:50.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.680+0000 7fef0377f640 1 --2- 172.21.15.60:0/3860495006 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feee8004800 0x7feefc14f660 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7feeec033000 tx=0x7feeec0046c0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.680+0000 7fef0377f640 1 -- 172.21.15.60:0/3860495006 shutdown_connections 2024-09-12T02:29:50.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.680+0000 7fef0377f640 1 --2- 172.21.15.60:0/3860495006 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7feee006c670 0x7feee006eb30 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.680+0000 7fef0377f640 1 --2- 172.21.15.60:0/3860495006 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feee80052e0 0x7feefc14dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.680+0000 7fef0377f640 1 --2- 172.21.15.60:0/3860495006 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feee8004800 0x7feefc14f660 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.680+0000 7fef0377f640 1 --2- 172.21.15.60:0/3860495006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feee80039b0 0x7feefc0b1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.680+0000 7fef0377f640 1 -- 172.21.15.60:0/3860495006 >> 172.21.15.60:0/3860495006 conn(0x7feefc0adb80 msgr2=0x7feefc1549a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:50.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.680+0000 7fef0377f640 1 -- 172.21.15.60:0/3860495006 shutdown_connections 2024-09-12T02:29:50.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.680+0000 7fef0377f640 1 -- 172.21.15.60:0/3860495006 wait complete. 2024-09-12T02:29:50.691 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-12T02:29:50.691 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-09-12T02:29:50.691 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-12T02:29:50.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.794+0000 7f3d8ee1e640 1 Processor -- start 2024-09-12T02:29:50.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.794+0000 7f3d8ee1e640 1 -- start start 2024-09-12T02:29:50.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.795+0000 7f3d8ee1e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3d881505f0 0x7f3d88153910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:50.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.795+0000 7f3d8ee1e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3d880c42b0 0x7f3d880c4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:50.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.795+0000 7f3d8ee1e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d880c5940 con 0x7f3d880c69c0 2024-09-12T02:29:50.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.795+0000 7f3d8ee1e640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f3d880c7860 con 0x7f3d881505f0 2024-09-12T02:29:50.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.795+0000 7f3d8ee1e640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f3d880c5c00 con 0x7f3d880c42b0 2024-09-12T02:29:50.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.795+0000 7f3d8cbba640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3d881505f0 0x7f3d88153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:50.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.795+0000 7f3d87fff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f3d880c69c0 0x7f3d880c2440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46852/0 (socket says 172.21.15.60:46852) 2024-09-12T02:29:50.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.795+0000 7f3d87fff640 1 -- 172.21.15.60:0/633826768 learned_addr learned my addr 172.21.15.60:0/633826768 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:29:50.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.795+0000 7f3d8d3bb640 1 --2- 172.21.15.60:0/633826768 >> v2:172.21.15.105:3300/0 conn(0x7f3d880c42b0 0x7f3d880c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:50.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.795+0000 7f3d8cbba640 1 -- 172.21.15.60:0/633826768 >> v2:172.21.15.105:3300/0 conn(0x7f3d880c42b0 msgr2=0x7f3d880c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:29:50.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.795+0000 7f3d8cbba640 1 --2- 172.21.15.60:0/633826768 >> v2:172.21.15.105:3300/0 conn(0x7f3d880c42b0 0x7f3d880c4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.795+0000 7f3d8cbba640 1 -- 172.21.15.60:0/633826768 >> v1:172.21.15.60:6789/0 conn(0x7f3d880c69c0 legacy=0x7f3d880c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:50.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.795+0000 7f3d877fe640 1 -- 172.21.15.60:0/633826768 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1476135569 0 0) 0x7f3d880c5940 con 0x7f3d880c69c0 2024-09-12T02:29:50.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.795+0000 7f3d8cbba640 1 -- 172.21.15.60:0/633826768 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d880c5ee0 con 0x7f3d881505f0 2024-09-12T02:29:50.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.796+0000 7f3d8cbba640 1 --2- 172.21.15.60:0/633826768 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d881505f0 0x7f3d88153910 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3d880ab190 tx=0x7f3d7c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8024adc04f85c87c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:50.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.796+0000 7f3d877fe640 1 -- 172.21.15.60:0/633826768 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c037070 con 0x7f3d881505f0 2024-09-12T02:29:50.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.796+0000 7f3d877fe640 1 -- 172.21.15.60:0/633826768 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d7c032440 con 0x7f3d881505f0 2024-09-12T02:29:50.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.796+0000 7f3d877fe640 1 -- 172.21.15.60:0/633826768 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c02ae60 con 0x7f3d881505f0 2024-09-12T02:29:50.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.797+0000 7f3d8ee1e640 1 -- 172.21.15.60:0/633826768 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d881505f0 msgr2=0x7f3d88153910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:50.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.797+0000 7f3d8ee1e640 1 --2- 172.21.15.60:0/633826768 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d881505f0 0x7f3d88153910 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3d880ab190 tx=0x7f3d7c02a110 comp rx=0 tx=0).stop 2024-09-12T02:29:50.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.797+0000 7f3d8ee1e640 1 -- 172.21.15.60:0/633826768 shutdown_connections 2024-09-12T02:29:50.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.797+0000 7f3d8ee1e640 1 --2- 172.21.15.60:0/633826768 >> v2:172.21.15.105:3300/0 conn(0x7f3d880c42b0 0x7f3d880c4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.797+0000 7f3d8ee1e640 1 --2- 172.21.15.60:0/633826768 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d881505f0 0x7f3d88153910 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.797+0000 7f3d8ee1e640 1 -- 172.21.15.60:0/633826768 >> 172.21.15.60:0/633826768 conn(0x7f3d880c7a40 msgr2=0x7f3d880c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:50.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.797+0000 7f3d8ee1e640 1 -- 172.21.15.60:0/633826768 shutdown_connections 2024-09-12T02:29:50.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.797+0000 7f3d8ee1e640 1 -- 172.21.15.60:0/633826768 wait complete. 2024-09-12T02:29:50.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.798+0000 7f3d8ee1e640 1 Processor -- start 2024-09-12T02:29:50.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.798+0000 7f3d8ee1e640 1 -- start start 2024-09-12T02:29:50.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.799+0000 7f3d8ee1e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d880c42b0 0x7f3d88148780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:50.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.799+0000 7f3d8ee1e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d881505f0 0x7f3d881ecf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:50.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.799+0000 7f3d8ee1e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d880abb50 0x7f3d880abfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:50.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.799+0000 7f3d8ee1e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3d881509d0 con 0x7f3d880abb50 2024-09-12T02:29:50.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.799+0000 7f3d8ee1e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3d880c64a0 con 0x7f3d881505f0 2024-09-12T02:29:50.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.799+0000 7f3d8ee1e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3d88150b50 con 0x7f3d880c42b0 2024-09-12T02:29:50.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.799+0000 7f3d8cbba640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d880c42b0 msgr2=0x7f3d88148780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:29:50.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.799+0000 7f3d8cbba640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d880c42b0 0x7f3d88148780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:29:50.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.799+0000 7f3d8d3bb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d880abb50 0x7f3d880abfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:50.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.799+0000 7f3d8d3bb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d880abb50 0x7f3d880abfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54950/0 (socket says 172.21.15.60:54950) 2024-09-12T02:29:50.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.799+0000 7f3d8d3bb640 1 -- 172.21.15.60:0/918279877 learned_addr learned my addr 172.21.15.60:0/918279877 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:29:50.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.799+0000 7f3d87fff640 1 --2- 172.21.15.60:0/918279877 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d881505f0 0x7f3d881ecf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:50.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.799+0000 7f3d8d3bb640 1 -- 172.21.15.60:0/918279877 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d880c42b0 msgr2=0x7f3d88148780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:29:50.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.799+0000 7f3d8d3bb640 1 --2- 172.21.15.60:0/918279877 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d880c42b0 0x7f3d88148780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.799+0000 7f3d8d3bb640 1 -- 172.21.15.60:0/918279877 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d881505f0 msgr2=0x7f3d881ecf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:50.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.799+0000 7f3d8d3bb640 1 --2- 172.21.15.60:0/918279877 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d881505f0 0x7f3d881ecf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.799+0000 7f3d8d3bb640 1 -- 172.21.15.60:0/918279877 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d88148cc0 con 0x7f3d880abb50 2024-09-12T02:29:50.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.799+0000 7f3d8d3bb640 1 --2- 172.21.15.60:0/918279877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d880abb50 0x7f3d880abfe0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3d80009dd0 tx=0x7f3d8000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:50.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.800+0000 7f3d857fa640 1 -- 172.21.15.60:0/918279877 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d80018020 con 0x7f3d880abb50 2024-09-12T02:29:50.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.800+0000 7f3d857fa640 1 -- 172.21.15.60:0/918279877 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d80014480 con 0x7f3d880abb50 2024-09-12T02:29:50.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.800+0000 7f3d8ee1e640 1 -- 172.21.15.60:0/918279877 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d8814b730 con 0x7f3d880abb50 2024-09-12T02:29:50.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.800+0000 7f3d857fa640 1 -- 172.21.15.60:0/918279877 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d80014870 con 0x7f3d880abb50 2024-09-12T02:29:50.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.800+0000 7f3d8ee1e640 1 -- 172.21.15.60:0/918279877 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d88147950 con 0x7f3d880abb50 2024-09-12T02:29:50.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.801+0000 7f3d8ee1e640 1 --2- 172.21.15.60:0/918279877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d880c69c0 0x7f3d88145b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:50.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.801+0000 7f3d8ee1e640 1 -- 172.21.15.60:0/918279877 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8814e1c0 con 0x7f3d880c69c0 2024-09-12T02:29:50.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.801+0000 7f3d8cbba640 1 --2- 172.21.15.60:0/918279877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d880c69c0 0x7f3d88145b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:50.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.801+0000 7f3d8cbba640 1 -- 172.21.15.60:0/918279877 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3d88153910 con 0x7f3d880c69c0 2024-09-12T02:29:50.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.801+0000 7f3d8cbba640 1 --2- 172.21.15.60:0/918279877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d880c69c0 0x7f3d88145b40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3d880c5580 tx=0x7f3d7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:50.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.801+0000 7f3d857fa640 1 -- 172.21.15.60:0/918279877 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c037040 con 0x7f3d880c69c0 2024-09-12T02:29:50.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.801+0000 7f3d857fa640 1 -- 172.21.15.60:0/918279877 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3d80005d10 con 0x7f3d880abb50 2024-09-12T02:29:50.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.802+0000 7f3d857fa640 1 --2- 172.21.15.60:0/918279877 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3d6c06bd60 0x7f3d6c06e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:50.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.802+0000 7f3d857fa640 1 -- 172.21.15.60:0/918279877 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f3d8008beb0 con 0x7f3d880abb50 2024-09-12T02:29:50.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.802+0000 7f3d87fff640 1 --2- 172.21.15.60:0/918279877 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3d6c06bd60 0x7f3d6c06e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:50.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.802+0000 7f3d857fa640 1 -- 172.21.15.60:0/918279877 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f3d7c004220 con 0x7f3d880c69c0 2024-09-12T02:29:50.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.802+0000 7f3d857fa640 1 -- 172.21.15.60:0/918279877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d880c69c0 msgr2=0x7f3d88145b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:50.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.802+0000 7f3d857fa640 1 --2- 172.21.15.60:0/918279877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d880c69c0 0x7f3d88145b40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3d880c5580 tx=0x7f3d7c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.802+0000 7f3d857fa640 1 -- 172.21.15.60:0/918279877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d880c69c0 msgr2=0x7f3d88145b40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:29:50.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.802+0000 7f3d857fa640 1 --2- 172.21.15.60:0/918279877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d880c69c0 0x7f3d88145b40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.802+0000 7f3d87fff640 1 --2- 172.21.15.60:0/918279877 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3d6c06bd60 0x7f3d6c06e220 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3d88148f20 tx=0x7f3d74007d50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:50.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.809+0000 7f3d8ee1e640 1 --2- 172.21.15.60:0/918279877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d88146080 0x7f3d8814a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:50.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.809+0000 7f3d8ee1e640 1 -- 172.21.15.60:0/918279877 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3d88147b20 con 0x7f3d88146080 2024-09-12T02:29:50.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.809+0000 7f3d8cbba640 1 --2- 172.21.15.60:0/918279877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d88146080 0x7f3d8814a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:50.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.809+0000 7f3d8cbba640 1 -- 172.21.15.60:0/918279877 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3d8806e660 con 0x7f3d88146080 2024-09-12T02:29:50.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.809+0000 7f3d8cbba640 1 --2- 172.21.15.60:0/918279877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d88146080 0x7f3d8814a680 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c000c00 tx=0x7f3d7c009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:50.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.809+0000 7f3d857fa640 1 -- 172.21.15.60:0/918279877 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c003810 con 0x7f3d88146080 2024-09-12T02:29:50.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.809+0000 7f3d857fa640 1 -- 172.21.15.60:0/918279877 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4873 (secure 0 0 0) 0x7f3d7c003810 con 0x7f3d88146080 2024-09-12T02:29:50.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.809+0000 7f3d857fa640 1 -- 172.21.15.60:0/918279877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d88146080 msgr2=0x7f3d8814a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:50.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.809+0000 7f3d857fa640 1 --2- 172.21.15.60:0/918279877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d88146080 0x7f3d8814a680 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c000c00 tx=0x7f3d7c009190 comp rx=0 tx=0).stop 2024-09-12T02:29:50.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.809+0000 7f3d857fa640 1 -- 172.21.15.60:0/918279877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d88146080 msgr2=0x7f3d8814a680 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:29:50.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.809+0000 7f3d857fa640 1 --2- 172.21.15.60:0/918279877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d88146080 0x7f3d8814a680 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.812 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:29:50.812 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:29:50.812 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:29:50.812 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:29:50.812 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 68, 2024-09-12T02:29:50.812 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 53913, 2024-09-12T02:29:50.812 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:29:50.813 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:29:50.813 INFO:teuthology.orchestra.run.smithi060.stdout: 1 2024-09-12T02:29:50.813 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:50.813 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-09-12T02:29:50.813 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:29:50.813 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:29:50.813 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:29:50.813 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:29:50.813 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:29:50.813 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:29:50.813 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:29:50.813 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:29:50.814 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:29:50.814 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:29:50.814 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:29:50.814 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:29:50.814 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:29:50.814 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:29:50.814 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:50.814 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:29:50.814 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:29:50.814 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:29:50.814 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:29:50.814 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:29:50.815 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:29:50.815 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:29:50.815 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:29:50.815 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:29:50.815 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:29:50.815 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:29:50.815 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:29:50.815 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:29:50.815 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:50.815 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:50.815 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:29:50.815 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:29:50.816 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:29:50.816 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:29:50.816 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:29:50.816 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:29:50.816 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:29:50.816 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:29:50.816 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:29:50.816 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:29:50.816 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:29:50.816 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:29:50.816 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:29:50.816 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:29:50.817 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:29:50.817 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:29:50.817 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:29:50.817 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:29:50.817 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:29:50.817 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:29:50.817 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:29:50.817 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:29:50.817 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:29:50.817 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:29:50.818 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:29:50.818 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:29:50.818 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:29:50.818 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:29:50.818 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:50.818 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:29:50.818 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:50.818 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:29:50.818 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:50.818 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:29:50.818 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:29:50.818 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:29:50.819 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:29:50.819 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:50.819 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:29:50.819 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:29:50.819 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:50.819 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:50.819 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:50.819 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:29:50.819 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:29:50.819 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:50.819 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:50.819 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:50.820 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:50.820 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:29:50.820 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:29:50.820 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:29:50.820 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:29:50.820 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:29:50.820 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:50.820 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:50.820 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:29:50.820 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:29:50.820 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:29:50.821 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:29:50.821 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:50.821 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:29:50.821 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:29:50.821 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:50.821 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:50.821 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:50.821 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:29:50.821 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:29:50.821 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:50.821 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:50.822 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:50.822 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:50.822 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:29:50.822 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:29:50.822 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:29:50.822 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:29:50.823 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:29:50.823 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:50.823 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:50.823 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:29:50.823 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:29:50.823 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:29:50.823 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:29:50.823 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:50.823 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:29:50.823 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:29:50.824 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:50.824 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:50.824 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:50.824 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:29:50.824 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:29:50.824 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:50.824 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:50.824 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:50.824 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:50.824 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:29:50.824 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:29:50.824 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:29:50.825 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:29:50.825 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:29:50.825 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:50.825 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:50.825 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:50.825 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:29:50.825 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:29:50.826 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:50.826 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:29:50.826 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:29:50.826 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:29:50.826 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:50.826 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:50.826 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:29:50.826 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:50.826 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:29:50.826 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:29:50.826 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:29:50.827 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:50.827 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:50.827 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:29:50.827 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:50.827 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:29:50.827 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:29:50.827 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:29:50.827 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:50.827 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:50.828 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:29:50.828 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:50.828 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:29:50.828 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:29:50.828 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:29:50.828 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:50.828 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:50.828 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:50.828 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:29:50.828 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:29:50.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.810+0000 7f3d8ee1e640 1 -- 172.21.15.60:0/918279877 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3d6c06bd60 msgr2=0x7f3d6c06e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:50.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.810+0000 7f3d8ee1e640 1 --2- 172.21.15.60:0/918279877 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3d6c06bd60 0x7f3d6c06e220 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3d88148f20 tx=0x7f3d74007d50 comp rx=0 tx=0).stop 2024-09-12T02:29:50.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.810+0000 7f3d8ee1e640 1 -- 172.21.15.60:0/918279877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d880abb50 msgr2=0x7f3d880abfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:50.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.810+0000 7f3d8ee1e640 1 --2- 172.21.15.60:0/918279877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d880abb50 0x7f3d880abfe0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3d80009dd0 tx=0x7f3d8000c490 comp rx=0 tx=0).stop 2024-09-12T02:29:50.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.810+0000 7f3d8d3bb640 1 -- 172.21.15.60:0/918279877 reap_dead start 2024-09-12T02:29:50.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.810+0000 7f3d8d3bb640 1 -- 172.21.15.60:0/918279877 reap_dead start 2024-09-12T02:29:50.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.810+0000 7f3d8ee1e640 1 -- 172.21.15.60:0/918279877 shutdown_connections 2024-09-12T02:29:50.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.810+0000 7f3d8ee1e640 1 -- 172.21.15.60:0/918279877 >> 172.21.15.60:0/918279877 conn(0x7f3d880c7a40 msgr2=0x7f3d8814dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:50.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.810+0000 7f3d8ee1e640 1 -- 172.21.15.60:0/918279877 shutdown_connections 2024-09-12T02:29:50.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.810+0000 7f3d8ee1e640 1 -- 172.21.15.60:0/918279877 wait complete. 2024-09-12T02:29:50.832 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-12T02:29:50.832 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-12T02:29:50.832 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-12T02:29:50.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.935+0000 7f2142942640 1 Processor -- start 2024-09-12T02:29:50.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.935+0000 7f2142942640 1 -- start start 2024-09-12T02:29:50.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.935+0000 7f2142942640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f213c151840 0x7f213c0ace00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:50.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.935+0000 7f2142942640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f213c0ad340 0x7f213c0c32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:50.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.935+0000 7f2142942640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f213c154330 con 0x7f213c0c3830 2024-09-12T02:29:50.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.936+0000 7f2142942640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f213c1550f0 con 0x7f213c151840 2024-09-12T02:29:50.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.936+0000 7f2142942640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f213c154610 con 0x7f213c0ad340 2024-09-12T02:29:50.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.936+0000 7f213bfff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f213c151840 0x7f213c0ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:50.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.936+0000 7f2140edf640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f213c0c3830 0x7f213c0c44d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46866/0 (socket says 172.21.15.60:46866) 2024-09-12T02:29:50.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.936+0000 7f213b7fe640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f213c0ad340 msgr2=0x7f213c0c32f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:29:50.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.936+0000 7f2140edf640 1 -- 172.21.15.60:0/3581300981 learned_addr learned my addr 172.21.15.60:0/3581300981 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:29:50.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.936+0000 7f213bfff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f213c151840 0x7f213c0ace00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54972/0 (socket says 172.21.15.60:54972) 2024-09-12T02:29:50.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.936+0000 7f213b7fe640 1 --2- 172.21.15.60:0/3581300981 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f213c0ad340 0x7f213c0c32f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:29:50.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.936+0000 7f213bfff640 1 -- 172.21.15.60:0/3581300981 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f213c0ad340 msgr2=0x7f213c0c32f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:29:50.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.936+0000 7f213bfff640 1 --2- 172.21.15.60:0/3581300981 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f213c0ad340 0x7f213c0c32f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.936+0000 7f213bfff640 1 -- 172.21.15.60:0/3581300981 >> v1:172.21.15.60:6789/0 conn(0x7f213c0c3830 legacy=0x7f213c0c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:50.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.936+0000 7f213bfff640 1 -- 172.21.15.60:0/3581300981 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f213c1548f0 con 0x7f213c151840 2024-09-12T02:29:50.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.936+0000 7f213affd640 1 -- 172.21.15.60:0/3581300981 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4151105140 0 0) 0x7f213c154330 con 0x7f213c0c3830 2024-09-12T02:29:50.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.937+0000 7f213bfff640 1 --2- 172.21.15.60:0/3581300981 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f213c151840 0x7f213c0ace00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f212c0097a0 tx=0x7f212c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9ee1d8e37f794aa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:50.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.937+0000 7f213affd640 1 -- 172.21.15.60:0/3581300981 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f212c037070 con 0x7f213c151840 2024-09-12T02:29:50.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.937+0000 7f213affd640 1 -- 172.21.15.60:0/3581300981 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f212c032440 con 0x7f213c151840 2024-09-12T02:29:50.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.937+0000 7f213affd640 1 -- 172.21.15.60:0/3581300981 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f212c032810 con 0x7f213c151840 2024-09-12T02:29:50.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.937+0000 7f2142942640 1 -- 172.21.15.60:0/3581300981 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f213c151840 msgr2=0x7f213c0ace00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:50.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.937+0000 7f2142942640 1 --2- 172.21.15.60:0/3581300981 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f213c151840 0x7f213c0ace00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f212c0097a0 tx=0x7f212c02a1a0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.937+0000 7f2142942640 1 -- 172.21.15.60:0/3581300981 shutdown_connections 2024-09-12T02:29:50.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.937+0000 7f2142942640 1 --2- 172.21.15.60:0/3581300981 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f213c0ad340 0x7f213c0c32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.937+0000 7f2142942640 1 --2- 172.21.15.60:0/3581300981 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f213c151840 0x7f213c0ace00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.937+0000 7f2142942640 1 -- 172.21.15.60:0/3581300981 >> 172.21.15.60:0/3581300981 conn(0x7f213c0c7a40 msgr2=0x7f213c0c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:50.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.937+0000 7f2142942640 1 -- 172.21.15.60:0/3581300981 shutdown_connections 2024-09-12T02:29:50.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.937+0000 7f2142942640 1 -- 172.21.15.60:0/3581300981 wait complete. 2024-09-12T02:29:50.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.939+0000 7f2142942640 1 Processor -- start 2024-09-12T02:29:50.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.939+0000 7f2142942640 1 -- start start 2024-09-12T02:29:50.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.939+0000 7f2142942640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f213c0ad340 0x7f213c1ebf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:50.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.939+0000 7f2142942640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f213c0c3830 0x7f213c0aaf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:50.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.939+0000 7f2142942640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f213c151840 0x7f213c1df830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:50.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.939+0000 7f2142942640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f213c06e030 con 0x7f213c151840 2024-09-12T02:29:50.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.939+0000 7f2142942640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f213c06dda0 con 0x7f213c0c3830 2024-09-12T02:29:50.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.939+0000 7f2142942640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f213c06e1b0 con 0x7f213c0ad340 2024-09-12T02:29:50.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.940+0000 7f2140edf640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f213c151840 0x7f213c1df830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:50.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.940+0000 7f213bfff640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f213c0ad340 msgr2=0x7f213c1ebf60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:29:50.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.940+0000 7f2140edf640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f213c151840 0x7f213c1df830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54984/0 (socket says 172.21.15.60:54984) 2024-09-12T02:29:50.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.940+0000 7f2140edf640 1 -- 172.21.15.60:0/1560627128 learned_addr learned my addr 172.21.15.60:0/1560627128 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:29:50.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.940+0000 7f213bfff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f213c0ad340 0x7f213c1ebf60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:29:50.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.940+0000 7f213b7fe640 1 --2- 172.21.15.60:0/1560627128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f213c0c3830 0x7f213c0aaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:50.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.940+0000 7f2140edf640 1 -- 172.21.15.60:0/1560627128 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f213c0ad340 msgr2=0x7f213c1ebf60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:29:50.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.940+0000 7f2140edf640 1 --2- 172.21.15.60:0/1560627128 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f213c0ad340 0x7f213c1ebf60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.940+0000 7f2140edf640 1 -- 172.21.15.60:0/1560627128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f213c0c3830 msgr2=0x7f213c0aaf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:50.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.940+0000 7f2140edf640 1 --2- 172.21.15.60:0/1560627128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f213c0c3830 0x7f213c0aaf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.940+0000 7f2140edf640 1 -- 172.21.15.60:0/1560627128 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f213c1de790 con 0x7f213c151840 2024-09-12T02:29:50.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.940+0000 7f213b7fe640 1 --2- 172.21.15.60:0/1560627128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f213c0c3830 0x7f213c0aaf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:29:50.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.940+0000 7f2140edf640 1 --2- 172.21.15.60:0/1560627128 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f213c151840 0x7f213c1df830 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f213400c7d0 tx=0x7f213400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:50.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.940+0000 7f2138ff9640 1 -- 172.21.15.60:0/1560627128 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2134018070 con 0x7f213c151840 2024-09-12T02:29:50.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.940+0000 7f2138ff9640 1 -- 172.21.15.60:0/1560627128 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f213400a640 con 0x7f213c151840 2024-09-12T02:29:50.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.940+0000 7f2142942640 1 -- 172.21.15.60:0/1560627128 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f213c1dea70 con 0x7f213c151840 2024-09-12T02:29:50.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.940+0000 7f2138ff9640 1 -- 172.21.15.60:0/1560627128 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f213400aa70 con 0x7f213c151840 2024-09-12T02:29:50.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.940+0000 7f2142942640 1 -- 172.21.15.60:0/1560627128 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f213c1df030 con 0x7f213c151840 2024-09-12T02:29:50.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.941+0000 7f2142942640 1 --2- 172.21.15.60:0/1560627128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f213c150030 0x7f213c150410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:50.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.941+0000 7f2142942640 1 -- 172.21.15.60:0/1560627128 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f213c0699d0 con 0x7f213c150030 2024-09-12T02:29:50.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.941+0000 7f213bfff640 1 --2- 172.21.15.60:0/1560627128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f213c150030 0x7f213c150410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:50.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.942+0000 7f2138ff9640 1 -- 172.21.15.60:0/1560627128 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f213401b070 con 0x7f213c151840 2024-09-12T02:29:50.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.942+0000 7f213bfff640 1 -- 172.21.15.60:0/1560627128 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f213c151c20 con 0x7f213c150030 2024-09-12T02:29:50.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.942+0000 7f213bfff640 1 --2- 172.21.15.60:0/1560627128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f213c150030 0x7f213c150410 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f213c068bd0 tx=0x7f212c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:50.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.942+0000 7f2138ff9640 1 --2- 172.21.15.60:0/1560627128 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f212806bde0 0x7f212806e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:50.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.942+0000 7f2138ff9640 1 -- 172.21.15.60:0/1560627128 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f213408a760 con 0x7f213c151840 2024-09-12T02:29:50.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.942+0000 7f213b7fe640 1 --2- 172.21.15.60:0/1560627128 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f212806bde0 0x7f212806e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:50.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.943+0000 7f2138ff9640 1 -- 172.21.15.60:0/1560627128 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f212c042070 con 0x7f213c150030 2024-09-12T02:29:50.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.943+0000 7f2138ff9640 1 -- 172.21.15.60:0/1560627128 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f212c032e00 con 0x7f213c150030 2024-09-12T02:29:50.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.943+0000 7f2138ff9640 1 -- 172.21.15.60:0/1560627128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f213c150030 msgr2=0x7f213c150410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:50.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.943+0000 7f2138ff9640 1 --2- 172.21.15.60:0/1560627128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f213c150030 0x7f213c150410 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f213c068bd0 tx=0x7f212c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.943+0000 7f2138ff9640 1 -- 172.21.15.60:0/1560627128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f213c150030 msgr2=0x7f213c150410 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:29:50.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.943+0000 7f2138ff9640 1 --2- 172.21.15.60:0/1560627128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f213c150030 0x7f213c150410 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.943+0000 7f213b7fe640 1 --2- 172.21.15.60:0/1560627128 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f212806bde0 0x7f212806e2a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f213c155fe0 tx=0x7f2130008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:50.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.949+0000 7f2142942640 1 --2- 172.21.15.60:0/1560627128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f213c0a9c00 0x7f213c0a9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:50.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.949+0000 7f2142942640 1 -- 172.21.15.60:0/1560627128 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f213c0c1ab0 con 0x7f213c0a9c00 2024-09-12T02:29:50.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.949+0000 7f213bfff640 1 --2- 172.21.15.60:0/1560627128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f213c0a9c00 0x7f213c0a9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:50.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.950+0000 7f213bfff640 1 -- 172.21.15.60:0/1560627128 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f213c0a84a0 con 0x7f213c0a9c00 2024-09-12T02:29:50.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.950+0000 7f213bfff640 1 --2- 172.21.15.60:0/1560627128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f213c0a9c00 0x7f213c0a9fe0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f212c000c00 tx=0x7f212c009190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:50.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.950+0000 7f2138ff9640 1 -- 172.21.15.60:0/1560627128 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f212c037040 con 0x7f213c0a9c00 2024-09-12T02:29:50.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.950+0000 7f2138ff9640 1 -- 172.21.15.60:0/1560627128 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5039 (secure 0 0 0) 0x7f212c051420 con 0x7f213c0a9c00 2024-09-12T02:29:50.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.950+0000 7f2138ff9640 1 -- 172.21.15.60:0/1560627128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f213c0a9c00 msgr2=0x7f213c0a9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:50.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.950+0000 7f2138ff9640 1 --2- 172.21.15.60:0/1560627128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f213c0a9c00 0x7f213c0a9fe0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f212c000c00 tx=0x7f212c009190 comp rx=0 tx=0).stop 2024-09-12T02:29:50.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.950+0000 7f2138ff9640 1 -- 172.21.15.60:0/1560627128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f213c0a9c00 msgr2=0x7f213c0a9fe0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:29:50.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.950+0000 7f2138ff9640 1 --2- 172.21.15.60:0/1560627128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f213c0a9c00 0x7f213c0a9fe0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.952 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:29:50.952 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:29:50.952 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:29:50.952 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:29:50.952 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 68, 2024-09-12T02:29:50.952 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 336385, 2024-09-12T02:29:50.952 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:29:50.952 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:29:50.953 INFO:teuthology.orchestra.run.smithi060.stdout: 1 2024-09-12T02:29:50.953 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:50.953 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-09-12T02:29:50.953 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:29:50.953 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:29:50.953 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:29:50.953 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:29:50.953 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:29:50.953 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:29:50.953 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:29:50.953 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:29:50.953 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:29:50.953 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:29:50.953 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:29:50.954 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:29:50.954 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:29:50.954 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:29:50.954 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:50.954 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:29:50.954 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:29:50.954 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:29:50.954 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:29:50.954 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:29:50.954 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:29:50.954 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:29:50.954 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:29:50.954 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:29:50.954 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:29:50.955 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:29:50.955 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:29:50.955 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:29:50.955 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:50.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:50.955 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:29:50.955 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:29:50.955 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:29:50.955 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:29:50.955 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:29:50.955 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:29:50.955 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:29:50.955 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:29:50.955 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:29:50.956 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:29:50.956 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:29:50.956 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:29:50.956 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:29:50.956 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:29:50.956 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:29:50.956 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:29:50.956 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:29:50.956 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:29:50.956 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:29:50.956 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:29:50.956 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:29:50.957 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:29:50.957 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:29:50.957 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:29:50.957 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:29:50.957 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:29:50.957 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:29:50.957 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:29:50.957 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:50.957 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:29:50.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:50.957 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:29:50.957 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:50.957 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:29:50.958 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:29:50.958 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:29:50.958 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:29:50.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:50.958 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:29:50.958 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:29:50.958 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:50.958 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:50.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:50.958 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:29:50.958 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:29:50.958 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:50.958 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:50.959 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:50.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:50.959 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:29:50.959 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:29:50.959 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:29:50.959 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:29:50.959 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:29:50.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:50.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:50.959 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:29:50.959 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:29:50.959 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:29:50.959 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:29:50.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:50.960 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:29:50.960 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:29:50.960 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:50.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:50.960 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:50.960 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:29:50.960 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:29:50.960 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:50.960 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:50.960 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:50.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:50.960 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:29:50.960 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:29:50.961 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:29:50.961 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:29:50.961 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:29:50.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:50.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:50.961 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:29:50.961 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:29:50.961 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:29:50.961 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:29:50.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:50.961 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:29:50.961 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:29:50.961 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:50.962 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:50.962 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:50.962 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:29:50.962 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:29:50.962 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:29:50.962 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:50.962 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:50.962 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:50.962 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:29:50.962 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:29:50.962 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:29:50.962 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:29:50.962 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:29:50.962 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:50.963 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:50.963 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:50.963 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:29:50.963 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:29:50.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:50.963 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:29:50.963 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:29:50.963 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:29:50.963 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:50.963 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:50.963 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:29:50.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:50.963 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:29:50.964 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:29:50.964 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:29:50.964 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:50.964 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:50.964 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:29:50.964 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:50.964 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:29:50.964 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:29:50.964 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-09-12T02:29:50.964 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:50.964 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:50.964 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:29:50.965 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:50.965 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:29:50.965 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:29:50.965 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-09-12T02:29:50.965 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:50.965 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:29:50.965 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:29:50.965 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:29:50.965 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:29:50.965 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:29:50.965 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:29:50.965 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:29:50.965 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:29:50.965 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:29:50.966 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:29:50.966 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:29:50.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.950+0000 7f2142942640 1 -- 172.21.15.60:0/1560627128 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f212806bde0 msgr2=0x7f212806e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:50.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.950+0000 7f2142942640 1 --2- 172.21.15.60:0/1560627128 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f212806bde0 0x7f212806e2a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f213c155fe0 tx=0x7f2130008040 comp rx=0 tx=0).stop 2024-09-12T02:29:50.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.951+0000 7f2142942640 1 -- 172.21.15.60:0/1560627128 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f213c151840 msgr2=0x7f213c1df830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:50.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.951+0000 7f2142942640 1 --2- 172.21.15.60:0/1560627128 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f213c151840 0x7f213c1df830 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f213400c7d0 tx=0x7f213400cc90 comp rx=0 tx=0).stop 2024-09-12T02:29:50.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.951+0000 7f2140edf640 1 -- 172.21.15.60:0/1560627128 reap_dead start 2024-09-12T02:29:50.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.951+0000 7f2142942640 1 -- 172.21.15.60:0/1560627128 shutdown_connections 2024-09-12T02:29:50.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.951+0000 7f2142942640 1 --2- 172.21.15.60:0/1560627128 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f213c151840 0x7f213c1df830 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:50.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.951+0000 7f2142942640 1 -- 172.21.15.60:0/1560627128 >> 172.21.15.60:0/1560627128 conn(0x7f213c0c7a40 msgr2=0x7f213c1568c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:50.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.951+0000 7f2142942640 1 -- 172.21.15.60:0/1560627128 shutdown_connections 2024-09-12T02:29:50.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:29:50.951+0000 7f2142942640 1 -- 172.21.15.60:0/1560627128 wait complete. 2024-09-12T02:29:50.968 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-12T02:29:50.968 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-12T02:29:58.030 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:29:58.032 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:30:10.968 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-09-12T02:30:10.969 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-09-12T02:30:10.969 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T02:30:10.969 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T02:30:10.973 INFO:tasks.ceph.mon.c:Started 2024-09-12T02:30:10.973 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-12T02:30:10.973 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:30:11.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.099+0000 7f0c4d581640 1 Processor -- start 2024-09-12T02:30:11.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.100+0000 7f0c4d581640 1 -- start start 2024-09-12T02:30:11.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.100+0000 7f0c4d581640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0c481505f0 0x7f0c48153910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:11.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.100+0000 7f0c4d581640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0c480c69c0 0x7f0c480c2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:11.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.100+0000 7f0c4d581640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c480c5940 con 0x7f0c480c2980 2024-09-12T02:30:11.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.100+0000 7f0c4d581640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f0c480c7860 con 0x7f0c480c69c0 2024-09-12T02:30:11.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.100+0000 7f0c4d581640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f0c480c5c00 con 0x7f0c481505f0 2024-09-12T02:30:11.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.101+0000 7f0c467fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0c480c69c0 0x7f0c480c2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:11.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.101+0000 7f0c467fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0c480c69c0 0x7f0c480c2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47182/0 (socket says 172.21.15.60:47182) 2024-09-12T02:30:11.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.101+0000 7f0c467fc640 1 -- 172.21.15.60:0/3862842053 learned_addr learned my addr 172.21.15.60:0/3862842053 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:30:11.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.101+0000 7f0c477fe640 1 --1- 172.21.15.60:0/3862842053 >> v1:172.21.15.60:6789/0 conn(0x7f0c480c2980 0x7f0c480c42b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:59958/0 (socket says 172.21.15.60:59958) 2024-09-12T02:30:11.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.101+0000 7f0c46ffd640 1 --2- 172.21.15.60:0/3862842053 >> v2:172.21.15.105:3300/0 conn(0x7f0c481505f0 0x7f0c48153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:11.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.101+0000 7f0c467fc640 1 -- 172.21.15.60:0/3862842053 >> v2:172.21.15.105:3300/0 conn(0x7f0c481505f0 msgr2=0x7f0c48153910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:11.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.101+0000 7f0c467fc640 1 --2- 172.21.15.60:0/3862842053 >> v2:172.21.15.105:3300/0 conn(0x7f0c481505f0 0x7f0c48153910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:11.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.101+0000 7f0c467fc640 1 -- 172.21.15.60:0/3862842053 >> v1:172.21.15.60:6789/0 conn(0x7f0c480c2980 legacy=0x7f0c480c42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:11.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.101+0000 7f0c45ffb640 1 -- 172.21.15.60:0/3862842053 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2014157500 0 0) 0x7f0c480c5940 con 0x7f0c480c2980 2024-09-12T02:30:11.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.101+0000 7f0c467fc640 1 -- 172.21.15.60:0/3862842053 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c480c5ee0 con 0x7f0c480c69c0 2024-09-12T02:30:11.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.102+0000 7f0c467fc640 1 --2- 172.21.15.60:0/3862842053 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c480c69c0 0x7f0c480c2440 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0c480702a0 tx=0x7f0c3c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b235b1367d36e13e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:11.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.102+0000 7f0c45ffb640 1 -- 172.21.15.60:0/3862842053 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c037070 con 0x7f0c480c69c0 2024-09-12T02:30:11.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.102+0000 7f0c45ffb640 1 -- 172.21.15.60:0/3862842053 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c3c032440 con 0x7f0c480c69c0 2024-09-12T02:30:11.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.102+0000 7f0c45ffb640 1 -- 172.21.15.60:0/3862842053 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c032810 con 0x7f0c480c69c0 2024-09-12T02:30:11.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.103+0000 7f0c4d581640 1 -- 172.21.15.60:0/3862842053 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c480c69c0 msgr2=0x7f0c480c2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:11.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.103+0000 7f0c4d581640 1 --2- 172.21.15.60:0/3862842053 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c480c69c0 0x7f0c480c2440 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0c480702a0 tx=0x7f0c3c02a1e0 comp rx=0 tx=0).stop 2024-09-12T02:30:11.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.103+0000 7f0c4d581640 1 -- 172.21.15.60:0/3862842053 shutdown_connections 2024-09-12T02:30:11.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.103+0000 7f0c4d581640 1 --2- 172.21.15.60:0/3862842053 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c480c69c0 0x7f0c480c2440 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:11.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.103+0000 7f0c4d581640 1 --2- 172.21.15.60:0/3862842053 >> v2:172.21.15.105:3300/0 conn(0x7f0c481505f0 0x7f0c48153910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:11.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.103+0000 7f0c4d581640 1 -- 172.21.15.60:0/3862842053 >> 172.21.15.60:0/3862842053 conn(0x7f0c480c7a40 msgr2=0x7f0c480c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:11.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.103+0000 7f0c4d581640 1 -- 172.21.15.60:0/3862842053 shutdown_connections 2024-09-12T02:30:11.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.103+0000 7f0c4d581640 1 -- 172.21.15.60:0/3862842053 wait complete. 2024-09-12T02:30:11.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.104+0000 7f0c4d581640 1 Processor -- start 2024-09-12T02:30:11.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.104+0000 7f0c4d581640 1 -- start start 2024-09-12T02:30:11.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.105+0000 7f0c4d581640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c480c2980 0x7f0c481ecf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:11.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.105+0000 7f0c4d581640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c481505f0 0x7f0c480a8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:11.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.105+0000 7f0c4d581640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c48154c90 0x7f0c48156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:11.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.105+0000 7f0c4d581640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0c481509d0 con 0x7f0c481505f0 2024-09-12T02:30:11.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.105+0000 7f0c4d581640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0c480c64a0 con 0x7f0c48154c90 2024-09-12T02:30:11.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.105+0000 7f0c4d581640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0c48150b50 con 0x7f0c480c2980 2024-09-12T02:30:11.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.105+0000 7f0c467fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c481505f0 0x7f0c480a8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:11.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.105+0000 7f0c467fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c481505f0 0x7f0c480a8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47188/0 (socket says 172.21.15.60:47188) 2024-09-12T02:30:11.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.105+0000 7f0c467fc640 1 -- 172.21.15.60:0/3819885183 learned_addr learned my addr 172.21.15.60:0/3819885183 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:30:11.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.105+0000 7f0c477fe640 1 --2- 172.21.15.60:0/3819885183 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c48154c90 0x7f0c48156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:11.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.105+0000 7f0c46ffd640 1 --2- 172.21.15.60:0/3819885183 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c480c2980 0x7f0c481ecf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:11.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.105+0000 7f0c46ffd640 1 -- 172.21.15.60:0/3819885183 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c480c2980 msgr2=0x7f0c481ecf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-12T02:30:11.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.105+0000 7f0c46ffd640 1 -- 172.21.15.60:0/3819885183 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c480c2980 msgr2=0x7f0c481ecf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:30:11.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.105+0000 7f0c46ffd640 1 --2- 172.21.15.60:0/3819885183 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c480c2980 0x7f0c481ecf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:30:11.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.105+0000 7f0c46ffd640 1 --2- 172.21.15.60:0/3819885183 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c480c2980 0x7f0c481ecf70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:30:11.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.106+0000 7f0c467fc640 1 -- 172.21.15.60:0/3819885183 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c480c2980 msgr2=0x7f0c481ecf70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:30:11.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.106+0000 7f0c467fc640 1 --2- 172.21.15.60:0/3819885183 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c480c2980 0x7f0c481ecf70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:11.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.106+0000 7f0c467fc640 1 -- 172.21.15.60:0/3819885183 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c48154c90 msgr2=0x7f0c48156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:11.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.106+0000 7f0c467fc640 1 --2- 172.21.15.60:0/3819885183 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c48154c90 0x7f0c48156c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:11.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.106+0000 7f0c467fc640 1 -- 172.21.15.60:0/3819885183 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c481564a0 con 0x7f0c481505f0 2024-09-12T02:30:11.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.106+0000 7f0c477fe640 1 --2- 172.21.15.60:0/3819885183 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c48154c90 0x7f0c48156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:30:11.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.106+0000 7f0c467fc640 1 --2- 172.21.15.60:0/3819885183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c481505f0 0x7f0c480a8cb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c02a220 tx=0x7f0c3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:11.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.106+0000 7f0c2f7fe640 1 -- 172.21.15.60:0/3819885183 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c037040 con 0x7f0c481505f0 2024-09-12T02:30:11.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.106+0000 7f0c2f7fe640 1 -- 172.21.15.60:0/3819885183 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c3c042070 con 0x7f0c481505f0 2024-09-12T02:30:11.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.106+0000 7f0c4d581640 1 -- 172.21.15.60:0/3819885183 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c48152890 con 0x7f0c481505f0 2024-09-12T02:30:11.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.106+0000 7f0c2f7fe640 1 -- 172.21.15.60:0/3819885183 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c030880 con 0x7f0c481505f0 2024-09-12T02:30:11.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.106+0000 7f0c4d581640 1 -- 172.21.15.60:0/3819885183 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c480a91f0 con 0x7f0c481505f0 2024-09-12T02:30:11.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.107+0000 7f0c4d581640 1 -- 172.21.15.60:0/3819885183 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c480c2440 con 0x7f0c481505f0 2024-09-12T02:30:11.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.108+0000 7f0c2f7fe640 1 -- 172.21.15.60:0/3819885183 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0c3c030a20 con 0x7f0c481505f0 2024-09-12T02:30:11.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.108+0000 7f0c2f7fe640 1 --2- 172.21.15.60:0/3819885183 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0c3406be60 0x7f0c3406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:11.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.108+0000 7f0c2f7fe640 1 -- 172.21.15.60:0/3819885183 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f0c3c0ab930 con 0x7f0c481505f0 2024-09-12T02:30:11.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.109+0000 7f0c46ffd640 1 --2- 172.21.15.60:0/3819885183 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0c3406be60 0x7f0c3406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:11.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.109+0000 7f0c46ffd640 1 --2- 172.21.15.60:0/3819885183 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0c3406be60 0x7f0c3406e320 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0c48156220 tx=0x7f0c38008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:11.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.113+0000 7f0c2f7fe640 1 -- 172.21.15.60:0/3819885183 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0c3c079fd0 con 0x7f0c481505f0 2024-09-12T02:30:11.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.402+0000 7f0c4d581640 1 -- 172.21.15.60:0/3819885183 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f0c480aa970 con 0x7f0c481505f0 2024-09-12T02:30:11.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.402+0000 7f0c2f7fe640 1 -- 172.21.15.60:0/3819885183 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1559 (secure 0 0 0) 0x7f0c3c0798d0 con 0x7f0c481505f0 2024-09-12T02:30:11.403 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":68,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:30:11.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.405+0000 7f0c4d581640 1 -- 172.21.15.60:0/3819885183 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0c3406be60 msgr2=0x7f0c3406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:11.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.405+0000 7f0c4d581640 1 --2- 172.21.15.60:0/3819885183 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0c3406be60 0x7f0c3406e320 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0c48156220 tx=0x7f0c38008040 comp rx=0 tx=0).stop 2024-09-12T02:30:11.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.405+0000 7f0c4d581640 1 -- 172.21.15.60:0/3819885183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c481505f0 msgr2=0x7f0c480a8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:11.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.405+0000 7f0c4d581640 1 --2- 172.21.15.60:0/3819885183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c481505f0 0x7f0c480a8cb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c02a220 tx=0x7f0c3c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:30:11.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.405+0000 7f0c4d581640 1 -- 172.21.15.60:0/3819885183 shutdown_connections 2024-09-12T02:30:11.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.405+0000 7f0c4d581640 1 --2- 172.21.15.60:0/3819885183 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0c3406be60 0x7f0c3406e320 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:11.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.405+0000 7f0c4d581640 1 --2- 172.21.15.60:0/3819885183 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c48154c90 0x7f0c48156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:11.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.405+0000 7f0c4d581640 1 --2- 172.21.15.60:0/3819885183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c481505f0 0x7f0c480a8cb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:11.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.405+0000 7f0c4d581640 1 --2- 172.21.15.60:0/3819885183 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c480c2980 0x7f0c481ecf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:11.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.405+0000 7f0c4d581640 1 -- 172.21.15.60:0/3819885183 >> 172.21.15.60:0/3819885183 conn(0x7f0c480c7a40 msgr2=0x7f0c4814f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:11.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.405+0000 7f0c4d581640 1 -- 172.21.15.60:0/3819885183 shutdown_connections 2024-09-12T02:30:11.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:11.405+0000 7f0c4d581640 1 -- 172.21.15.60:0/3819885183 wait complete. 2024-09-12T02:30:14.418 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:30:14.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.533+0000 7f0e0955f640 1 Processor -- start 2024-09-12T02:30:14.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.533+0000 7f0e0955f640 1 -- start start 2024-09-12T02:30:14.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.534+0000 7f0e0955f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0e0406cd80 0x7f0e04153be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:14.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.534+0000 7f0e0955f640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e040c7070 con 0x7f0e040c8b10 2024-09-12T02:30:14.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.534+0000 7f0e0955f640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e0406d210 con 0x7f0e0415a4a0 2024-09-12T02:30:14.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.534+0000 7f0e0955f640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f0e040c69b0 con 0x7f0e0406cd80 2024-09-12T02:30:14.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.534+0000 7f0e02ffd640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f0e040c8b10 0x7f0e041534d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:59974/0 (socket says 172.21.15.60:59974) 2024-09-12T02:30:14.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.534+0000 7f0e027fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0e0406cd80 0x7f0e04153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:14.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.534+0000 7f0e02ffd640 1 -- 172.21.15.60:0/1114312499 learned_addr learned my addr 172.21.15.60:0/1114312499 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:30:14.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.535+0000 7f0e027fc640 1 -- 172.21.15.60:0/1114312499 >> v1:172.21.15.105:6789/0 conn(0x7f0e0415a4a0 legacy=0x7f0e04156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:14.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.535+0000 7f0e027fc640 1 -- 172.21.15.60:0/1114312499 >> v1:172.21.15.60:6789/0 conn(0x7f0e040c8b10 legacy=0x7f0e041534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:14.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.535+0000 7f0e01ffb640 1 -- 172.21.15.60:0/1114312499 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1011087581 0 0) 0x7f0e0406d210 con 0x7f0e0415a4a0 2024-09-12T02:30:14.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.535+0000 7f0e027fc640 1 -- 172.21.15.60:0/1114312499 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e040c6c90 con 0x7f0e0406cd80 2024-09-12T02:30:14.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.536+0000 7f0e027fc640 1 --2- 172.21.15.60:0/1114312499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e0406cd80 0x7f0e04153be0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0df80097a0 tx=0x7f0df802a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac8105d5e34aefff server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:14.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.536+0000 7f0e01ffb640 1 -- 172.21.15.60:0/1114312499 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df8037070 con 0x7f0e0406cd80 2024-09-12T02:30:14.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.536+0000 7f0e01ffb640 1 -- 172.21.15.60:0/1114312499 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0df802ad30 con 0x7f0e0406cd80 2024-09-12T02:30:14.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.536+0000 7f0e01ffb640 1 -- 172.21.15.60:0/1114312499 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df8032660 con 0x7f0e0406cd80 2024-09-12T02:30:14.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.536+0000 7f0e0955f640 1 -- 172.21.15.60:0/1114312499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e0406cd80 msgr2=0x7f0e04153be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:14.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.536+0000 7f0e0955f640 1 --2- 172.21.15.60:0/1114312499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e0406cd80 0x7f0e04153be0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0df80097a0 tx=0x7f0df802a0a0 comp rx=0 tx=0).stop 2024-09-12T02:30:14.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.536+0000 7f0e0955f640 1 -- 172.21.15.60:0/1114312499 shutdown_connections 2024-09-12T02:30:14.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.536+0000 7f0e0955f640 1 --2- 172.21.15.60:0/1114312499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e0406cd80 0x7f0e04153be0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:14.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.536+0000 7f0e0955f640 1 -- 172.21.15.60:0/1114312499 >> 172.21.15.60:0/1114312499 conn(0x7f0e040adb80 msgr2=0x7f0e040adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:14.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.536+0000 7f0e0955f640 1 -- 172.21.15.60:0/1114312499 shutdown_connections 2024-09-12T02:30:14.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.536+0000 7f0e0955f640 1 -- 172.21.15.60:0/1114312499 wait complete. 2024-09-12T02:30:14.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.538+0000 7f0e0955f640 1 Processor -- start 2024-09-12T02:30:14.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.538+0000 7f0e0955f640 1 -- start start 2024-09-12T02:30:14.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.539+0000 7f0e0955f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e040c8b10 0x7f0e041599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:14.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.539+0000 7f0e0955f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e0415a4a0 0x7f0e041eefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:14.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.539+0000 7f0e0955f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e04150120 0x7f0e041df9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:14.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.539+0000 7f0e0955f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0e040c9070 con 0x7f0e040c8b10 2024-09-12T02:30:14.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.539+0000 7f0e0955f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0e040c8ef0 con 0x7f0e0415a4a0 2024-09-12T02:30:14.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.539+0000 7f0e0955f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0e04156d70 con 0x7f0e04150120 2024-09-12T02:30:14.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.539+0000 7f0e02ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e040c8b10 0x7f0e041599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:14.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.539+0000 7f0e02ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e040c8b10 0x7f0e041599e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47206/0 (socket says 172.21.15.60:47206) 2024-09-12T02:30:14.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.539+0000 7f0e02ffd640 1 -- 172.21.15.60:0/2838193839 learned_addr learned my addr 172.21.15.60:0/2838193839 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:30:14.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.539+0000 7f0e027fc640 1 --2- 172.21.15.60:0/2838193839 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e0415a4a0 0x7f0e041eefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:14.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.539+0000 7f0e037fe640 1 --2- 172.21.15.60:0/2838193839 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e04150120 0x7f0e041df9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:14.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.539+0000 7f0e037fe640 1 -- 172.21.15.60:0/2838193839 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e04150120 msgr2=0x7f0e041df9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-12T02:30:14.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.539+0000 7f0e037fe640 1 -- 172.21.15.60:0/2838193839 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e04150120 msgr2=0x7f0e041df9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:30:14.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.539+0000 7f0e037fe640 1 --2- 172.21.15.60:0/2838193839 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e04150120 0x7f0e041df9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:30:14.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.539+0000 7f0e037fe640 1 --2- 172.21.15.60:0/2838193839 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e04150120 0x7f0e041df9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:30:14.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.539+0000 7f0e02ffd640 1 -- 172.21.15.60:0/2838193839 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e04150120 msgr2=0x7f0e041df9b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:30:14.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.539+0000 7f0e02ffd640 1 --2- 172.21.15.60:0/2838193839 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e04150120 0x7f0e041df9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:14.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.539+0000 7f0e02ffd640 1 -- 172.21.15.60:0/2838193839 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e0415a4a0 msgr2=0x7f0e041eefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:14.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.539+0000 7f0e02ffd640 1 --2- 172.21.15.60:0/2838193839 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e0415a4a0 0x7f0e041eefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:14.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.539+0000 7f0e02ffd640 1 -- 172.21.15.60:0/2838193839 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e0414dc30 con 0x7f0e040c8b10 2024-09-12T02:30:14.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.539+0000 7f0e02ffd640 1 --2- 172.21.15.60:0/2838193839 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e040c8b10 0x7f0e041599e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0df400c780 tx=0x7f0df400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:14.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.539+0000 7f0deb7fe640 1 -- 172.21.15.60:0/2838193839 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df4018070 con 0x7f0e040c8b10 2024-09-12T02:30:14.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.539+0000 7f0deb7fe640 1 -- 172.21.15.60:0/2838193839 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0df40072f0 con 0x7f0e040c8b10 2024-09-12T02:30:14.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.539+0000 7f0deb7fe640 1 -- 172.21.15.60:0/2838193839 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df40047e0 con 0x7f0e040c8b10 2024-09-12T02:30:14.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.540+0000 7f0e0955f640 1 -- 172.21.15.60:0/2838193839 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e0414df10 con 0x7f0e040c8b10 2024-09-12T02:30:14.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.540+0000 7f0e0955f640 1 -- 172.21.15.60:0/2838193839 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e0414f920 con 0x7f0e040c8b10 2024-09-12T02:30:14.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.541+0000 7f0e0955f640 1 -- 172.21.15.60:0/2838193839 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e040c7750 con 0x7f0e040c8b10 2024-09-12T02:30:14.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.541+0000 7f0deb7fe640 1 -- 172.21.15.60:0/2838193839 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0df401b070 con 0x7f0e040c8b10 2024-09-12T02:30:14.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.542+0000 7f0deb7fe640 1 --2- 172.21.15.60:0/2838193839 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0df006be30 0x7f0df006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:14.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.542+0000 7f0e027fc640 1 --2- 172.21.15.60:0/2838193839 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0df006be30 0x7f0df006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:14.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.542+0000 7f0deb7fe640 1 -- 172.21.15.60:0/2838193839 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f0df408a4a0 con 0x7f0e040c8b10 2024-09-12T02:30:14.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.542+0000 7f0e027fc640 1 --2- 172.21.15.60:0/2838193839 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0df006be30 0x7f0df006e2f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0df8034000 tx=0x7f0df802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:14.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.547+0000 7f0deb7fe640 1 -- 172.21.15.60:0/2838193839 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0e040c7750 con 0x7f0e040c8b10 2024-09-12T02:30:14.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.828+0000 7f0e0955f640 1 -- 172.21.15.60:0/2838193839 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f0e041570d0 con 0x7f0e040c8b10 2024-09-12T02:30:14.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.828+0000 7f0deb7fe640 1 -- 172.21.15.60:0/2838193839 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1559 (secure 0 0 0) 0x7f0df40584f0 con 0x7f0e040c8b10 2024-09-12T02:30:14.829 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":68,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:30:14.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.831+0000 7f0e0955f640 1 -- 172.21.15.60:0/2838193839 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0df006be30 msgr2=0x7f0df006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:14.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.831+0000 7f0e0955f640 1 --2- 172.21.15.60:0/2838193839 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0df006be30 0x7f0df006e2f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0df8034000 tx=0x7f0df802e000 comp rx=0 tx=0).stop 2024-09-12T02:30:14.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.831+0000 7f0e0955f640 1 -- 172.21.15.60:0/2838193839 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e040c8b10 msgr2=0x7f0e041599e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:14.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.831+0000 7f0e0955f640 1 --2- 172.21.15.60:0/2838193839 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e040c8b10 0x7f0e041599e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0df400c780 tx=0x7f0df400cc40 comp rx=0 tx=0).stop 2024-09-12T02:30:14.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.831+0000 7f0e0955f640 1 -- 172.21.15.60:0/2838193839 shutdown_connections 2024-09-12T02:30:14.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.831+0000 7f0e0955f640 1 --2- 172.21.15.60:0/2838193839 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0df006be30 0x7f0df006e2f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:14.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.831+0000 7f0e0955f640 1 --2- 172.21.15.60:0/2838193839 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e04150120 0x7f0e041df9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:14.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.831+0000 7f0e0955f640 1 --2- 172.21.15.60:0/2838193839 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e0415a4a0 0x7f0e041eefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:14.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.831+0000 7f0e0955f640 1 --2- 172.21.15.60:0/2838193839 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e040c8b10 0x7f0e041599e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:14.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.831+0000 7f0e0955f640 1 -- 172.21.15.60:0/2838193839 >> 172.21.15.60:0/2838193839 conn(0x7f0e040adb80 msgr2=0x7f0e04155440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:14.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.831+0000 7f0e0955f640 1 -- 172.21.15.60:0/2838193839 shutdown_connections 2024-09-12T02:30:14.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:14.831+0000 7f0e0955f640 1 -- 172.21.15.60:0/2838193839 wait complete. 2024-09-12T02:30:17.843 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:30:17.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.958+0000 7f94fc4e6640 1 Processor -- start 2024-09-12T02:30:17.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.958+0000 7f94fc4e6640 1 -- start start 2024-09-12T02:30:17.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.959+0000 7f94fc4e6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94f406cd80 0x7f94f4153be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:17.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.959+0000 7f94fc4e6640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94f40c7070 con 0x7f94f415a4a0 2024-09-12T02:30:17.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.959+0000 7f94fc4e6640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94f406d210 con 0x7f94f40c8b10 2024-09-12T02:30:17.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.959+0000 7f94fc4e6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f94f40c69b0 con 0x7f94f406cd80 2024-09-12T02:30:17.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.959+0000 7f94faa83640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f94f415a4a0 0x7f94f4156660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:59990/0 (socket says 172.21.15.60:59990) 2024-09-12T02:30:17.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.959+0000 7f94faa83640 1 -- 172.21.15.60:0/2859213381 learned_addr learned my addr 172.21.15.60:0/2859213381 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:30:17.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.960+0000 7f94f9a81640 1 --2- 172.21.15.60:0/2859213381 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94f406cd80 0x7f94f4153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:17.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.960+0000 7f94f9a81640 1 -- 172.21.15.60:0/2859213381 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94f406cd80 msgr2=0x7f94f4153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:30:17.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.960+0000 7f94f9a81640 1 -- 172.21.15.60:0/2859213381 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94f406cd80 msgr2=0x7f94f4153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:30:17.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.960+0000 7f94f9a81640 1 --2- 172.21.15.60:0/2859213381 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94f406cd80 0x7f94f4153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:30:17.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.960+0000 7f94f9a81640 1 --2- 172.21.15.60:0/2859213381 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94f406cd80 0x7f94f4153be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:30:17.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.960+0000 7f94f9280640 1 -- 172.21.15.60:0/2859213381 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1941021958 0 0) 0x7f94f40c7070 con 0x7f94f415a4a0 2024-09-12T02:30:17.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.960+0000 7f94f9280640 1 -- 172.21.15.60:0/2859213381 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94e0003520 con 0x7f94f415a4a0 2024-09-12T02:30:17.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.960+0000 7f94f9280640 1 -- 172.21.15.60:0/2859213381 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1182142070 0 0) 0x7f94f406d210 con 0x7f94f40c8b10 2024-09-12T02:30:17.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.960+0000 7f94f9280640 1 -- 172.21.15.60:0/2859213381 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94f40c7070 con 0x7f94f40c8b10 2024-09-12T02:30:17.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.960+0000 7f94f9280640 1 -- 172.21.15.60:0/2859213381 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2114560620 0 0) 0x7f94e0003520 con 0x7f94f415a4a0 2024-09-12T02:30:17.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.960+0000 7f94f9280640 1 -- 172.21.15.60:0/2859213381 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94f406cd80 msgr2=0x7f94f4153be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:30:17.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.960+0000 7f94f9280640 1 --2- 172.21.15.60:0/2859213381 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94f406cd80 0x7f94f4153be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:17.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.960+0000 7f94f9280640 1 -- 172.21.15.60:0/2859213381 >> v1:172.21.15.105:6789/0 conn(0x7f94f40c8b10 legacy=0x7f94f41534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:17.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.960+0000 7f94f9280640 1 -- 172.21.15.60:0/2859213381 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94f40c6c90 con 0x7f94f415a4a0 2024-09-12T02:30:17.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.960+0000 7f94f9280640 1 -- 172.21.15.60:0/2859213381 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7f94ec0019f0 con 0x7f94f415a4a0 2024-09-12T02:30:17.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.960+0000 7f94f9280640 1 -- 172.21.15.60:0/2859213381 >> v1:172.21.15.60:6789/0 conn(0x7f94f415a4a0 legacy=0x7f94f4156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:17.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.960+0000 7f94f9280640 1 --2- 172.21.15.60:0/2859213381 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94e0004c00 0x7f94e0004fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:17.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.960+0000 7f94f9280640 1 --2- 172.21.15.60:0/2859213381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94e00037a0 0x7f94e0003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:17.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.960+0000 7f94f9280640 1 --2- 172.21.15.60:0/2859213381 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94e0004160 0x7f94e000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:17.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.960+0000 7f94f9280640 1 -- 172.21.15.60:0/2859213381 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f94f40c69b0 con 0x7f94e00037a0 2024-09-12T02:30:17.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.960+0000 7f94f9280640 1 -- 172.21.15.60:0/2859213381 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f94e000bfb0 con 0x7f94e0004160 2024-09-12T02:30:17.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.960+0000 7f94f9280640 1 -- 172.21.15.60:0/2859213381 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f94e000c180 con 0x7f94e0004c00 2024-09-12T02:30:17.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.960+0000 7f94f9a81640 1 --2- 172.21.15.60:0/2859213381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94e00037a0 0x7f94e0003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:17.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.960+0000 7f94faa83640 1 --2- 172.21.15.60:0/2859213381 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94e0004160 0x7f94e000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:17.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.960+0000 7f94fa282640 1 --2- 172.21.15.60:0/2859213381 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94e0004c00 0x7f94e0004fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:17.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.961+0000 7f94f9a81640 1 -- 172.21.15.60:0/2859213381 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94e0004c00 msgr2=0x7f94e0004fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:17.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.961+0000 7f94f9a81640 1 --2- 172.21.15.60:0/2859213381 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94e0004c00 0x7f94e0004fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:17.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.961+0000 7f94f9a81640 1 -- 172.21.15.60:0/2859213381 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94e0004160 msgr2=0x7f94e000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:17.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.961+0000 7f94f9a81640 1 --2- 172.21.15.60:0/2859213381 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94e0004160 0x7f94e000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:17.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.961+0000 7f94f9a81640 1 -- 172.21.15.60:0/2859213381 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94e0003520 con 0x7f94e00037a0 2024-09-12T02:30:17.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.961+0000 7f94faa83640 1 --2- 172.21.15.60:0/2859213381 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94e0004160 0x7f94e000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:30:17.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.962+0000 7f94f9a81640 1 --2- 172.21.15.60:0/2859213381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94e00037a0 0x7f94e0003c20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f94e4006fd0 tx=0x7f94e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83ada9576ddccac2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:17.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.962+0000 7f94f9280640 1 -- 172.21.15.60:0/2859213381 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e4030070 con 0x7f94e00037a0 2024-09-12T02:30:17.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.962+0000 7f94f9280640 1 -- 172.21.15.60:0/2859213381 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94e402ad70 con 0x7f94e00037a0 2024-09-12T02:30:17.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.962+0000 7f94f9280640 1 -- 172.21.15.60:0/2859213381 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e400b5e0 con 0x7f94e00037a0 2024-09-12T02:30:17.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.962+0000 7f94fc4e6640 1 -- 172.21.15.60:0/2859213381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94e00037a0 msgr2=0x7f94e0003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:17.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.962+0000 7f94fc4e6640 1 --2- 172.21.15.60:0/2859213381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94e00037a0 0x7f94e0003c20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f94e4006fd0 tx=0x7f94e0005830 comp rx=0 tx=0).stop 2024-09-12T02:30:17.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.962+0000 7f94faa83640 1 -- 172.21.15.60:0/2859213381 reap_dead start 2024-09-12T02:30:17.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.962+0000 7f94fc4e6640 1 -- 172.21.15.60:0/2859213381 shutdown_connections 2024-09-12T02:30:17.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.962+0000 7f94fc4e6640 1 -- 172.21.15.60:0/2859213381 >> 172.21.15.60:0/2859213381 conn(0x7f94f40adb80 msgr2=0x7f94f40adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:17.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.963+0000 7f94fc4e6640 1 -- 172.21.15.60:0/2859213381 shutdown_connections 2024-09-12T02:30:17.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.963+0000 7f94fc4e6640 1 -- 172.21.15.60:0/2859213381 wait complete. 2024-09-12T02:30:17.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.964+0000 7f94fc4e6640 1 Processor -- start 2024-09-12T02:30:17.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.964+0000 7f94fc4e6640 1 -- start start 2024-09-12T02:30:17.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.965+0000 7f94fc4e6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94e00037a0 0x7f94f4154d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:17.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.965+0000 7f94fc4e6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94f41556b0 0x7f94f4150190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:17.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.965+0000 7f94fc4e6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94f41506d0 0x7f94f41eee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:17.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.965+0000 7f94fc4e6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f94f40c9070 con 0x7f94f41556b0 2024-09-12T02:30:17.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.965+0000 7f94fc4e6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f94f40c8ef0 con 0x7f94f41506d0 2024-09-12T02:30:17.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.965+0000 7f94fc4e6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f94f4153be0 con 0x7f94e00037a0 2024-09-12T02:30:17.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.965+0000 7f94f9a81640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94f41556b0 0x7f94f4150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:17.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.965+0000 7f94fa282640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94e00037a0 0x7f94f4154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:17.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.965+0000 7f94f9a81640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94f41556b0 0x7f94f4150190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47228/0 (socket says 172.21.15.60:47228) 2024-09-12T02:30:17.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.965+0000 7f94f9a81640 1 -- 172.21.15.60:0/3087882600 learned_addr learned my addr 172.21.15.60:0/3087882600 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:30:17.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.965+0000 7f94fa282640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94e00037a0 0x7f94f4154d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:50142/0 (socket says 172.21.15.60:50142) 2024-09-12T02:30:17.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.965+0000 7f94faa83640 1 --2- 172.21.15.60:0/3087882600 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94f41506d0 0x7f94f41eee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:17.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.965+0000 7f94fa282640 1 -- 172.21.15.60:0/3087882600 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94e00037a0 msgr2=0x7f94f4154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-12T02:30:17.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.965+0000 7f94fa282640 1 -- 172.21.15.60:0/3087882600 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94e00037a0 msgr2=0x7f94f4154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:30:17.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.965+0000 7f94fa282640 1 --2- 172.21.15.60:0/3087882600 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94e00037a0 0x7f94f4154d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:30:17.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.965+0000 7f94fa282640 1 --2- 172.21.15.60:0/3087882600 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94e00037a0 0x7f94f4154d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:30:17.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.965+0000 7f94f9a81640 1 -- 172.21.15.60:0/3087882600 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94e00037a0 msgr2=0x7f94f4154d10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:30:17.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.965+0000 7f94f9a81640 1 --2- 172.21.15.60:0/3087882600 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94e00037a0 0x7f94f4154d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:17.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.965+0000 7f94f9a81640 1 -- 172.21.15.60:0/3087882600 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94f41506d0 msgr2=0x7f94f41eee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:17.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.965+0000 7f94f9a81640 1 --2- 172.21.15.60:0/3087882600 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94f41506d0 0x7f94f41eee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:17.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.965+0000 7f94f9a81640 1 -- 172.21.15.60:0/3087882600 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94f40aec70 con 0x7f94f41556b0 2024-09-12T02:30:17.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.965+0000 7f94f9a81640 1 --2- 172.21.15.60:0/3087882600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94f41556b0 0x7f94f4150190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f94e4036040 tx=0x7f94e4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:17.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.966+0000 7f94eaffd640 1 -- 172.21.15.60:0/3087882600 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e4043020 con 0x7f94f41556b0 2024-09-12T02:30:17.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.966+0000 7f94eaffd640 1 -- 172.21.15.60:0/3087882600 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94e403f680 con 0x7f94f41556b0 2024-09-12T02:30:17.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.966+0000 7f94fc4e6640 1 -- 172.21.15.60:0/3087882600 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94f414f860 con 0x7f94f41556b0 2024-09-12T02:30:17.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.966+0000 7f94eaffd640 1 -- 172.21.15.60:0/3087882600 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e400b5e0 con 0x7f94f41556b0 2024-09-12T02:30:17.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.966+0000 7f94fc4e6640 1 -- 172.21.15.60:0/3087882600 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94f40b1d00 con 0x7f94f41556b0 2024-09-12T02:30:17.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.967+0000 7f94fc4e6640 1 -- 172.21.15.60:0/3087882600 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94f414d220 con 0x7f94f41556b0 2024-09-12T02:30:17.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.967+0000 7f94eaffd640 1 -- 172.21.15.60:0/3087882600 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f94e4046020 con 0x7f94f41556b0 2024-09-12T02:30:17.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.968+0000 7f94eaffd640 1 --2- 172.21.15.60:0/3087882600 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f94d806be60 0x7f94d806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:17.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.968+0000 7f94eaffd640 1 -- 172.21.15.60:0/3087882600 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f94e40aba30 con 0x7f94f41556b0 2024-09-12T02:30:17.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.968+0000 7f94fa282640 1 --2- 172.21.15.60:0/3087882600 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f94d806be60 0x7f94d806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:17.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.968+0000 7f94fa282640 1 --2- 172.21.15.60:0/3087882600 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f94d806be60 0x7f94d806e320 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f94f4151500 tx=0x7f94f0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:17.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:17.973+0000 7f94eaffd640 1 -- 172.21.15.60:0/3087882600 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f94e404d030 con 0x7f94f41556b0 2024-09-12T02:30:18.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.238+0000 7f94fc4e6640 1 -- 172.21.15.60:0/3087882600 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f94f40c9d90 con 0x7f94f41556b0 2024-09-12T02:30:18.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.238+0000 7f94eaffd640 1 -- 172.21.15.60:0/3087882600 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7f94f40aec70 con 0x7f94f41556b0 2024-09-12T02:30:18.239 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":70,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:30:18.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.241+0000 7f94fc4e6640 1 -- 172.21.15.60:0/3087882600 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f94d806be60 msgr2=0x7f94d806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:18.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.241+0000 7f94fc4e6640 1 --2- 172.21.15.60:0/3087882600 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f94d806be60 0x7f94d806e320 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f94f4151500 tx=0x7f94f0009040 comp rx=0 tx=0).stop 2024-09-12T02:30:18.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.241+0000 7f94fc4e6640 1 -- 172.21.15.60:0/3087882600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94f41556b0 msgr2=0x7f94f4150190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:18.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.241+0000 7f94fc4e6640 1 --2- 172.21.15.60:0/3087882600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94f41556b0 0x7f94f4150190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f94e4036040 tx=0x7f94e4004730 comp rx=0 tx=0).stop 2024-09-12T02:30:18.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.241+0000 7f94fc4e6640 1 -- 172.21.15.60:0/3087882600 shutdown_connections 2024-09-12T02:30:18.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.241+0000 7f94fc4e6640 1 --2- 172.21.15.60:0/3087882600 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f94d806be60 0x7f94d806e320 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:18.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.241+0000 7f94fc4e6640 1 --2- 172.21.15.60:0/3087882600 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94f41506d0 0x7f94f41eee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:18.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.241+0000 7f94fc4e6640 1 --2- 172.21.15.60:0/3087882600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94f41556b0 0x7f94f4150190 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:18.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.241+0000 7f94fc4e6640 1 --2- 172.21.15.60:0/3087882600 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94e00037a0 0x7f94f4154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:18.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.241+0000 7f94fc4e6640 1 -- 172.21.15.60:0/3087882600 >> 172.21.15.60:0/3087882600 conn(0x7f94f40adb80 msgr2=0x7f94f41532a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:18.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.241+0000 7f94fc4e6640 1 -- 172.21.15.60:0/3087882600 shutdown_connections 2024-09-12T02:30:18.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.241+0000 7f94fc4e6640 1 -- 172.21.15.60:0/3087882600 wait complete. 2024-09-12T02:30:18.253 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-12T02:30:18.253 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-12T02:30:18.253 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-12T02:30:18.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.365+0000 7f4129082640 1 Processor -- start 2024-09-12T02:30:18.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.365+0000 7f4129082640 1 -- start start 2024-09-12T02:30:18.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.366+0000 7f4129082640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4124150480 0x7f41240c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:18.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.366+0000 7f4129082640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f412415a7c0 con 0x7f412406c650 2024-09-12T02:30:18.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.366+0000 7f4129082640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4124159a00 con 0x7f41240ca390 2024-09-12T02:30:18.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.366+0000 7f4129082640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f412406c240 con 0x7f4124150480 2024-09-12T02:30:18.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.366+0000 7f412259c640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f412406c650 0x7f41240c9c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60006/0 (socket says 172.21.15.60:60006) 2024-09-12T02:30:18.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.366+0000 7f412259c640 1 -- 172.21.15.60:0/1907258385 learned_addr learned my addr 172.21.15.60:0/1907258385 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:30:18.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.366+0000 7f4122d9d640 1 --2- 172.21.15.60:0/1907258385 >> v2:172.21.15.105:3300/0 conn(0x7f4124150480 0x7f41240c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:18.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.367+0000 7f4121d9b640 1 -- 172.21.15.60:0/1907258385 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1306906777 0 0) 0x7f412415a7c0 con 0x7f412406c650 2024-09-12T02:30:18.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.367+0000 7f4121d9b640 1 -- 172.21.15.60:0/1907258385 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f410c003520 con 0x7f412406c650 2024-09-12T02:30:18.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.367+0000 7f4121d9b640 1 -- 172.21.15.60:0/1907258385 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1197954786 0 0) 0x7f4124159a00 con 0x7f41240ca390 2024-09-12T02:30:18.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.367+0000 7f4121d9b640 1 -- 172.21.15.60:0/1907258385 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f412415a7c0 con 0x7f41240ca390 2024-09-12T02:30:18.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.367+0000 7f4122d9d640 1 -- 172.21.15.60:0/1907258385 >> v1:172.21.15.105:6789/0 conn(0x7f41240ca390 legacy=0x7f4124160bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:18.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.367+0000 7f4122d9d640 1 -- 172.21.15.60:0/1907258385 >> v1:172.21.15.60:6789/0 conn(0x7f412406c650 legacy=0x7f41240c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:18.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.367+0000 7f4122d9d640 1 -- 172.21.15.60:0/1907258385 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4124159ce0 con 0x7f4124150480 2024-09-12T02:30:18.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.368+0000 7f4122d9d640 1 --2- 172.21.15.60:0/1907258385 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4124150480 0x7f41240c7a90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f41140097a0 tx=0x7f411402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77baf8edc96f81db server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:18.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.368+0000 7f4121d9b640 1 -- 172.21.15.60:0/1907258385 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4114037070 con 0x7f4124150480 2024-09-12T02:30:18.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.368+0000 7f4121d9b640 1 -- 172.21.15.60:0/1907258385 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4114032440 con 0x7f4124150480 2024-09-12T02:30:18.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.368+0000 7f4121d9b640 1 -- 172.21.15.60:0/1907258385 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41140327f0 con 0x7f4124150480 2024-09-12T02:30:18.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.368+0000 7f4129082640 1 -- 172.21.15.60:0/1907258385 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4124150480 msgr2=0x7f41240c7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:18.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.368+0000 7f4129082640 1 --2- 172.21.15.60:0/1907258385 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4124150480 0x7f41240c7a90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f41140097a0 tx=0x7f411402a230 comp rx=0 tx=0).stop 2024-09-12T02:30:18.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.369+0000 7f4129082640 1 -- 172.21.15.60:0/1907258385 shutdown_connections 2024-09-12T02:30:18.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.369+0000 7f4129082640 1 --2- 172.21.15.60:0/1907258385 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4124150480 0x7f41240c7a90 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:18.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.369+0000 7f4129082640 1 -- 172.21.15.60:0/1907258385 >> 172.21.15.60:0/1907258385 conn(0x7f4124068030 msgr2=0x7f4124073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:18.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.369+0000 7f4129082640 1 -- 172.21.15.60:0/1907258385 shutdown_connections 2024-09-12T02:30:18.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.369+0000 7f4129082640 1 -- 172.21.15.60:0/1907258385 wait complete. 2024-09-12T02:30:18.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.370+0000 7f4129082640 1 Processor -- start 2024-09-12T02:30:18.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.370+0000 7f4129082640 1 -- start start 2024-09-12T02:30:18.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.371+0000 7f4129082640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f412406c650 0x7f41240afda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:18.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.371+0000 7f4129082640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41240ca390 0x7f41241521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:18.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.371+0000 7f4129082640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4124150480 0x7f412414e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:18.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.371+0000 7f4129082640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f412406d270 con 0x7f412406c650 2024-09-12T02:30:18.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.371+0000 7f4129082640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f412415a330 con 0x7f41240ca390 2024-09-12T02:30:18.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.371+0000 7f4129082640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4124156270 con 0x7f4124150480 2024-09-12T02:30:18.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.371+0000 7f4122d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f412406c650 0x7f41240afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:18.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.371+0000 7f412259c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41240ca390 0x7f41241521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:18.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.371+0000 7f4122d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f412406c650 0x7f41240afda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47230/0 (socket says 172.21.15.60:47230) 2024-09-12T02:30:18.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.371+0000 7f4122d9d640 1 -- 172.21.15.60:0/371565999 learned_addr learned my addr 172.21.15.60:0/371565999 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:30:18.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.371+0000 7f412359e640 1 --2- 172.21.15.60:0/371565999 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4124150480 0x7f412414e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:18.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.371+0000 7f412359e640 1 -- 172.21.15.60:0/371565999 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4124150480 msgr2=0x7f412414e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-12T02:30:18.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.371+0000 7f412359e640 1 -- 172.21.15.60:0/371565999 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4124150480 msgr2=0x7f412414e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:30:18.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.371+0000 7f412359e640 1 --2- 172.21.15.60:0/371565999 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4124150480 0x7f412414e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:30:18.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.371+0000 7f412359e640 1 --2- 172.21.15.60:0/371565999 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4124150480 0x7f412414e720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:30:18.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.371+0000 7f4122d9d640 1 -- 172.21.15.60:0/371565999 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4124150480 msgr2=0x7f412414e720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:30:18.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.371+0000 7f4122d9d640 1 --2- 172.21.15.60:0/371565999 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4124150480 0x7f412414e720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:18.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.371+0000 7f4122d9d640 1 -- 172.21.15.60:0/371565999 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41240ca390 msgr2=0x7f41241521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:18.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.371+0000 7f4122d9d640 1 --2- 172.21.15.60:0/371565999 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41240ca390 0x7f41241521c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:18.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.372+0000 7f4122d9d640 1 -- 172.21.15.60:0/371565999 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f412414fbc0 con 0x7f412406c650 2024-09-12T02:30:18.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.372+0000 7f412259c640 1 --2- 172.21.15.60:0/371565999 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41240ca390 0x7f41241521c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:30:18.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.372+0000 7f4122d9d640 1 --2- 172.21.15.60:0/371565999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f412406c650 0x7f41240afda0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f411402a270 tx=0x7f41140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:18.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.372+0000 7f410b7fe640 1 -- 172.21.15.60:0/371565999 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4114041030 con 0x7f412406c650 2024-09-12T02:30:18.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.372+0000 7f410b7fe640 1 -- 172.21.15.60:0/371565999 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f411403d4e0 con 0x7f412406c650 2024-09-12T02:30:18.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.372+0000 7f410b7fe640 1 -- 172.21.15.60:0/371565999 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4114037040 con 0x7f412406c650 2024-09-12T02:30:18.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.372+0000 7f4129082640 1 -- 172.21.15.60:0/371565999 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f412414f450 con 0x7f412406c650 2024-09-12T02:30:18.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.372+0000 7f4129082640 1 -- 172.21.15.60:0/371565999 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41240b02e0 con 0x7f412406c650 2024-09-12T02:30:18.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.373+0000 7f4129082640 1 --2- 172.21.15.60:0/371565999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4124152700 0x7f412414ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:18.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.373+0000 7f4129082640 1 -- 172.21.15.60:0/371565999 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f412414f1a0 con 0x7f4124152700 2024-09-12T02:30:18.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.373+0000 7f412259c640 1 --2- 172.21.15.60:0/371565999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4124152700 0x7f412414ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:18.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.374+0000 7f412259c640 1 -- 172.21.15.60:0/371565999 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f41240c9c80 con 0x7f4124152700 2024-09-12T02:30:18.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.374+0000 7f412259c640 1 --2- 172.21.15.60:0/371565999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4124152700 0x7f412414ec60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4124150050 tx=0x7f4118001cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:18.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.374+0000 7f410b7fe640 1 -- 172.21.15.60:0/371565999 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f411800f9b0 con 0x7f4124152700 2024-09-12T02:30:18.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.374+0000 7f410b7fe640 1 -- 172.21.15.60:0/371565999 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4114044070 con 0x7f412406c650 2024-09-12T02:30:18.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.375+0000 7f410b7fe640 1 --2- 172.21.15.60:0/371565999 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f411006bd30 0x7f411006e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:18.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.375+0000 7f410b7fe640 1 -- 172.21.15.60:0/371565999 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f41140ab8c0 con 0x7f412406c650 2024-09-12T02:30:18.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.375+0000 7f412359e640 1 --2- 172.21.15.60:0/371565999 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f411006bd30 0x7f411006e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:18.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.375+0000 7f410b7fe640 1 -- 172.21.15.60:0/371565999 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f411800fb50 con 0x7f4124152700 2024-09-12T02:30:18.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.375+0000 7f410b7fe640 1 -- 172.21.15.60:0/371565999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4124152700 msgr2=0x7f412414ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:18.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.375+0000 7f410b7fe640 1 --2- 172.21.15.60:0/371565999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4124152700 0x7f412414ec60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4124150050 tx=0x7f4118001cc0 comp rx=0 tx=0).stop 2024-09-12T02:30:18.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.375+0000 7f410b7fe640 1 -- 172.21.15.60:0/371565999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4124152700 msgr2=0x7f412414ec60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:30:18.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.375+0000 7f410b7fe640 1 --2- 172.21.15.60:0/371565999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4124152700 0x7f412414ec60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:18.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.375+0000 7f412359e640 1 --2- 172.21.15.60:0/371565999 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f411006bd30 0x7f411006e1f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f41241ebdf0 tx=0x7f411c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:18.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.384+0000 7f4129082640 1 --2- 172.21.15.60:0/371565999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f412414f620 0x7f41241ef4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:18.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.384+0000 7f4129082640 1 -- 172.21.15.60:0/371565999 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f412406c430 con 0x7f412414f620 2024-09-12T02:30:18.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.384+0000 7f412259c640 1 --2- 172.21.15.60:0/371565999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f412414f620 0x7f41241ef4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:18.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.385+0000 7f412259c640 1 -- 172.21.15.60:0/371565999 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f41240cc4e0 con 0x7f412414f620 2024-09-12T02:30:18.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.385+0000 7f412259c640 1 --2- 172.21.15.60:0/371565999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f412414f620 0x7f41241ef4d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4118006fd0 tx=0x7f4118001150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:18.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.385+0000 7f410b7fe640 1 -- 172.21.15.60:0/371565999 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4118006030 con 0x7f412414f620 2024-09-12T02:30:18.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.385+0000 7f410b7fe640 1 -- 172.21.15.60:0/371565999 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4884 (secure 0 0 0) 0x7f4118006030 con 0x7f412414f620 2024-09-12T02:30:18.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.385+0000 7f410b7fe640 1 -- 172.21.15.60:0/371565999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f412414f620 msgr2=0x7f41241ef4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:18.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.385+0000 7f410b7fe640 1 --2- 172.21.15.60:0/371565999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f412414f620 0x7f41241ef4d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4118006fd0 tx=0x7f4118001150 comp rx=0 tx=0).stop 2024-09-12T02:30:18.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.385+0000 7f410b7fe640 1 -- 172.21.15.60:0/371565999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f412414f620 msgr2=0x7f41241ef4d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:30:18.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.385+0000 7f410b7fe640 1 --2- 172.21.15.60:0/371565999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f412414f620 0x7f41241ef4d0 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4118006fd0 tx=0x7f4118001150 comp rx=0 tx=0).stop 2024-09-12T02:30:18.386 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:30:18.387 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:30:18.387 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:30:18.387 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:30:18.387 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 70, 2024-09-12T02:30:18.387 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 81489, 2024-09-12T02:30:18.387 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:30:18.387 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:30:18.387 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:30:18.387 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:30:18.387 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:30:18.387 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 1, 2024-09-12T02:30:18.387 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:30:18.388 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:30:18.388 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:30:18.388 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:30:18.388 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:30:18.388 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:30:18.388 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:30:18.388 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:30:18.388 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:30:18.388 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:30:18.388 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:30:18.388 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:30:18.388 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:30:18.388 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:30:18.389 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:30:18.389 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:30:18.389 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:30:18.389 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:30:18.389 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:30:18.389 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:30:18.389 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:30:18.389 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:30:18.389 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:30:18.389 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:30:18.389 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:30:18.390 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:30:18.390 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:30:18.390 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:30:18.390 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:18.390 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:18.390 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:30:18.390 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:30:18.390 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:30:18.390 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:30:18.390 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:30:18.390 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:30:18.391 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:30:18.391 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:30:18.391 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:30:18.391 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:30:18.391 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:30:18.391 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:30:18.391 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:30:18.391 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:30:18.391 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:30:18.391 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:30:18.391 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:30:18.391 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:30:18.391 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:30:18.391 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:30:18.392 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:30:18.392 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:30:18.392 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:30:18.392 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:30:18.392 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:30:18.392 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:30:18.392 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:30:18.392 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:30:18.392 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:30:18.392 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:30:18.392 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:18.392 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:30:18.392 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:18.393 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:30:18.393 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:30:18.393 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:30:18.393 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:30:18.393 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:18.393 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:30:18.393 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:30:18.393 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:18.393 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:18.393 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:18.393 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:30:18.393 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:30:18.393 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:18.394 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:18.394 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:18.394 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:18.394 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:30:18.394 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:30:18.394 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:30:18.394 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:30:18.394 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:30:18.394 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:18.394 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:18.394 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:30:18.394 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:30:18.394 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:30:18.395 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:30:18.395 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:18.395 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:30:18.395 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:30:18.395 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:18.395 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:18.395 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:18.395 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:30:18.395 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:30:18.395 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:18.395 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:18.395 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:18.395 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:18.396 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:30:18.396 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:30:18.396 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:30:18.396 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:30:18.396 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:30:18.396 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:18.396 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:18.396 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:30:18.396 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:30:18.396 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:30:18.396 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:30:18.396 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:18.396 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:30:18.397 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:30:18.397 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:18.397 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:18.397 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:18.397 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:30:18.397 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:30:18.397 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:18.397 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:18.397 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:18.397 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:18.397 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:30:18.397 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:30:18.397 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:30:18.398 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:30:18.398 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:30:18.398 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:18.398 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:18.398 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:18.398 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:30:18.398 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:30:18.398 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:18.398 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:30:18.398 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:30:18.398 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:30:18.398 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:18.399 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:30:18.399 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:30:18.399 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:18.399 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:30:18.399 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:30:18.399 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:30:18.399 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:18.399 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:30:18.399 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:30:18.399 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:18.399 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:30:18.399 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:30:18.399 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:30:18.399 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:18.400 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:30:18.400 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:30:18.400 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:18.400 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:30:18.400 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:30:18.400 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:30:18.400 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:18.400 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:18.400 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:18.400 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:30:18.400 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:30:18.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.386+0000 7f4129082640 1 -- 172.21.15.60:0/371565999 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f411006bd30 msgr2=0x7f411006e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:18.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.386+0000 7f4129082640 1 --2- 172.21.15.60:0/371565999 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f411006bd30 0x7f411006e1f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f41241ebdf0 tx=0x7f411c009040 comp rx=0 tx=0).stop 2024-09-12T02:30:18.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.386+0000 7f4129082640 1 -- 172.21.15.60:0/371565999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f412406c650 msgr2=0x7f41240afda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:18.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.386+0000 7f4129082640 1 --2- 172.21.15.60:0/371565999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f412406c650 0x7f41240afda0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f411402a270 tx=0x7f41140046c0 comp rx=0 tx=0).stop 2024-09-12T02:30:18.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.386+0000 7f412359e640 1 -- 172.21.15.60:0/371565999 reap_dead start 2024-09-12T02:30:18.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.386+0000 7f412359e640 1 -- 172.21.15.60:0/371565999 reap_dead start 2024-09-12T02:30:18.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.386+0000 7f4129082640 1 -- 172.21.15.60:0/371565999 shutdown_connections 2024-09-12T02:30:18.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.386+0000 7f4129082640 1 -- 172.21.15.60:0/371565999 >> 172.21.15.60:0/371565999 conn(0x7f4124068030 msgr2=0x7f41240c8790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:18.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.386+0000 7f4129082640 1 -- 172.21.15.60:0/371565999 shutdown_connections 2024-09-12T02:30:18.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.386+0000 7f4129082640 1 -- 172.21.15.60:0/371565999 wait complete. 2024-09-12T02:30:18.402 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:30:18.402 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-12T02:30:18.403 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-12T02:30:18.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.526+0000 7fbe095b7640 1 Processor -- start 2024-09-12T02:30:18.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.526+0000 7fbe095b7640 1 -- start start 2024-09-12T02:30:18.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.527+0000 7fbe095b7640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbe04151680 0x7fbe0406e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:18.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.527+0000 7fbe095b7640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe0406f060 con 0x7fbe0406e920 2024-09-12T02:30:18.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.527+0000 7fbe095b7640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe0406f340 con 0x7fbe04154210 2024-09-12T02:30:18.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.527+0000 7fbe095b7640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fbe0406fc70 con 0x7fbe04151680 2024-09-12T02:30:18.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.527+0000 7fbe02ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbe04151680 0x7fbe0406e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:18.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.527+0000 7fbdfbfff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fbe0406e920 0x7fbe040ad7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60012/0 (socket says 172.21.15.60:60012) 2024-09-12T02:30:18.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.527+0000 7fbdfbfff640 1 -- 172.21.15.60:0/496152977 learned_addr learned my addr 172.21.15.60:0/496152977 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:30:18.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.527+0000 7fbe02ffd640 1 --2- 172.21.15.60:0/496152977 >> v2:172.21.15.60:3300/0 conn(0x7fbe04151680 0x7fbe0406e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47256/0 (socket says 172.21.15.60:47256) 2024-09-12T02:30:18.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.527+0000 7fbe02ffd640 1 -- 172.21.15.60:0/496152977 >> v1:172.21.15.105:6789/0 conn(0x7fbe04154210 legacy=0x7fbe04154660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:18.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.527+0000 7fbe02ffd640 1 -- 172.21.15.60:0/496152977 >> v1:172.21.15.60:6789/0 conn(0x7fbe0406e920 legacy=0x7fbe040ad7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:18.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.527+0000 7fbe027fc640 1 -- 172.21.15.60:0/496152977 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4003940638 0 0) 0x7fbe0406f060 con 0x7fbe0406e920 2024-09-12T02:30:18.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.527+0000 7fbe02ffd640 1 -- 172.21.15.60:0/496152977 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe0406f620 con 0x7fbe04151680 2024-09-12T02:30:18.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.528+0000 7fbe02ffd640 1 --2- 172.21.15.60:0/496152977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe04151680 0x7fbe0406e260 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbdf40097a0 tx=0x7fbdf402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d10977f8c5247fe3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:18.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.528+0000 7fbe027fc640 1 -- 172.21.15.60:0/496152977 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf4037070 con 0x7fbe04151680 2024-09-12T02:30:18.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.528+0000 7fbe027fc640 1 -- 172.21.15.60:0/496152977 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdf4032440 con 0x7fbe04151680 2024-09-12T02:30:18.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.528+0000 7fbe027fc640 1 -- 172.21.15.60:0/496152977 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf4032810 con 0x7fbe04151680 2024-09-12T02:30:18.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.529+0000 7fbe095b7640 1 -- 172.21.15.60:0/496152977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe04151680 msgr2=0x7fbe0406e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:18.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.529+0000 7fbe095b7640 1 --2- 172.21.15.60:0/496152977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe04151680 0x7fbe0406e260 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbdf40097a0 tx=0x7fbdf402a1a0 comp rx=0 tx=0).stop 2024-09-12T02:30:18.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.529+0000 7fbe095b7640 1 -- 172.21.15.60:0/496152977 shutdown_connections 2024-09-12T02:30:18.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.529+0000 7fbe095b7640 1 --2- 172.21.15.60:0/496152977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe04151680 0x7fbe0406e260 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:18.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.529+0000 7fbe095b7640 1 -- 172.21.15.60:0/496152977 >> 172.21.15.60:0/496152977 conn(0x7fbe040c8410 msgr2=0x7fbe040c87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:18.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.529+0000 7fbe095b7640 1 -- 172.21.15.60:0/496152977 shutdown_connections 2024-09-12T02:30:18.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.529+0000 7fbe095b7640 1 -- 172.21.15.60:0/496152977 wait complete. 2024-09-12T02:30:18.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.530+0000 7fbe095b7640 1 Processor -- start 2024-09-12T02:30:18.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.530+0000 7fbe095b7640 1 -- start start 2024-09-12T02:30:18.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.531+0000 7fbe095b7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe0406e920 0x7fbe040c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:18.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.531+0000 7fbe095b7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe04151680 0x7fbe041ea010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:18.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.531+0000 7fbe095b7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe04154210 0x7fbe041ea550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:18.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.531+0000 7fbe095b7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbe040ae060 con 0x7fbe0406e920 2024-09-12T02:30:18.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.531+0000 7fbe095b7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbe040adee0 con 0x7fbe04154210 2024-09-12T02:30:18.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.531+0000 7fbe095b7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbe04151a60 con 0x7fbe04151680 2024-09-12T02:30:18.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.531+0000 7fbe02ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe0406e920 0x7fbe040c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:18.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.531+0000 7fbe02ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe0406e920 0x7fbe040c78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47270/0 (socket says 172.21.15.60:47270) 2024-09-12T02:30:18.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.531+0000 7fbe02ffd640 1 -- 172.21.15.60:0/1048093758 learned_addr learned my addr 172.21.15.60:0/1048093758 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:30:18.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.531+0000 7fbdfbfff640 1 --2- 172.21.15.60:0/1048093758 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe04151680 0x7fbe041ea010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:18.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.531+0000 7fbe037fe640 1 --2- 172.21.15.60:0/1048093758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe04154210 0x7fbe041ea550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:18.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.531+0000 7fbdfbfff640 1 -- 172.21.15.60:0/1048093758 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe04151680 msgr2=0x7fbe041ea010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-12T02:30:18.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.531+0000 7fbdfbfff640 1 -- 172.21.15.60:0/1048093758 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe04151680 msgr2=0x7fbe041ea010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:30:18.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.531+0000 7fbdfbfff640 1 --2- 172.21.15.60:0/1048093758 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe04151680 0x7fbe041ea010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:30:18.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.532+0000 7fbdfbfff640 1 --2- 172.21.15.60:0/1048093758 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe04151680 0x7fbe041ea010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:30:18.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.532+0000 7fbe02ffd640 1 -- 172.21.15.60:0/1048093758 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe04151680 msgr2=0x7fbe041ea010 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:30:18.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.532+0000 7fbe02ffd640 1 --2- 172.21.15.60:0/1048093758 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe04151680 0x7fbe041ea010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:18.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.532+0000 7fbe02ffd640 1 -- 172.21.15.60:0/1048093758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe04154210 msgr2=0x7fbe041ea550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:18.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.532+0000 7fbe02ffd640 1 --2- 172.21.15.60:0/1048093758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe04154210 0x7fbe041ea550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:18.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.532+0000 7fbe02ffd640 1 -- 172.21.15.60:0/1048093758 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe04153d10 con 0x7fbe0406e920 2024-09-12T02:30:18.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.532+0000 7fbe02ffd640 1 --2- 172.21.15.60:0/1048093758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe0406e920 0x7fbe040c78b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbdf40098c0 tx=0x7fbdf40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:18.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.532+0000 7fbdfb7fe640 1 -- 172.21.15.60:0/1048093758 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf4037040 con 0x7fbe0406e920 2024-09-12T02:30:18.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.532+0000 7fbdfb7fe640 1 -- 172.21.15.60:0/1048093758 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdf4042070 con 0x7fbe0406e920 2024-09-12T02:30:18.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.532+0000 7fbe095b7640 1 -- 172.21.15.60:0/1048093758 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe041edb20 con 0x7fbe0406e920 2024-09-12T02:30:18.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.532+0000 7fbdfb7fe640 1 -- 172.21.15.60:0/1048093758 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf4030a70 con 0x7fbe0406e920 2024-09-12T02:30:18.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.532+0000 7fbe095b7640 1 -- 172.21.15.60:0/1048093758 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe04152fe0 con 0x7fbe0406e920 2024-09-12T02:30:18.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.533+0000 7fbe095b7640 1 --2- 172.21.15.60:0/1048093758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe04071a00 0x7fbe04147390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:18.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.533+0000 7fbe095b7640 1 -- 172.21.15.60:0/1048093758 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbe041ed9a0 con 0x7fbe04071a00 2024-09-12T02:30:18.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.533+0000 7fbdfbfff640 1 --2- 172.21.15.60:0/1048093758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe04071a00 0x7fbe04147390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:18.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.534+0000 7fbdfbfff640 1 -- 172.21.15.60:0/1048093758 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbe0406e260 con 0x7fbe04071a00 2024-09-12T02:30:18.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.534+0000 7fbdfbfff640 1 --2- 172.21.15.60:0/1048093758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe04071a00 0x7fbe04147390 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbe0414d7f0 tx=0x7fbdec0016e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:18.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.534+0000 7fbdfb7fe640 1 -- 172.21.15.60:0/1048093758 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbdf4030c10 con 0x7fbe0406e920 2024-09-12T02:30:18.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.534+0000 7fbdfb7fe640 1 --2- 172.21.15.60:0/1048093758 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbde406be30 0x7fbde406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:18.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.534+0000 7fbdfb7fe640 1 -- 172.21.15.60:0/1048093758 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fbdf40abbd0 con 0x7fbe0406e920 2024-09-12T02:30:18.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.534+0000 7fbe037fe640 1 --2- 172.21.15.60:0/1048093758 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbde406be30 0x7fbde406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:18.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.535+0000 7fbdfb7fe640 1 -- 172.21.15.60:0/1048093758 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdec019070 con 0x7fbe04071a00 2024-09-12T02:30:18.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.535+0000 7fbdfb7fe640 1 -- 172.21.15.60:0/1048093758 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fbdec010510 con 0x7fbe04071a00 2024-09-12T02:30:18.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.535+0000 7fbdfb7fe640 1 -- 172.21.15.60:0/1048093758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe04071a00 msgr2=0x7fbe04147390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:18.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.535+0000 7fbdfb7fe640 1 --2- 172.21.15.60:0/1048093758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe04071a00 0x7fbe04147390 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbe0414d7f0 tx=0x7fbdec0016e0 comp rx=0 tx=0).stop 2024-09-12T02:30:18.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.535+0000 7fbdfb7fe640 1 -- 172.21.15.60:0/1048093758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe04071a00 msgr2=0x7fbe04147390 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:30:18.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.535+0000 7fbdfb7fe640 1 --2- 172.21.15.60:0/1048093758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe04071a00 0x7fbe04147390 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:18.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.535+0000 7fbe037fe640 1 --2- 172.21.15.60:0/1048093758 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbde406be30 0x7fbde406e2f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc0012e0 tx=0x7fbdfc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:18.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.541+0000 7fbe095b7640 1 --2- 172.21.15.60:0/1048093758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe041478d0 0x7fbe04147cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:18.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.541+0000 7fbe095b7640 1 -- 172.21.15.60:0/1048093758 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0414ed60 con 0x7fbe041478d0 2024-09-12T02:30:18.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.541+0000 7fbdfbfff640 1 --2- 172.21.15.60:0/1048093758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe041478d0 0x7fbe04147cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:18.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.541+0000 7fbdfbfff640 1 -- 172.21.15.60:0/1048093758 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbe0414e840 con 0x7fbe041478d0 2024-09-12T02:30:18.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.542+0000 7fbdfbfff640 1 --2- 172.21.15.60:0/1048093758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe041478d0 0x7fbe04147cb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbe040c2680 tx=0x7fbdec000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:18.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.542+0000 7fbdfb7fe640 1 -- 172.21.15.60:0/1048093758 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdec019040 con 0x7fbe041478d0 2024-09-12T02:30:18.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.542+0000 7fbdfb7fe640 1 -- 172.21.15.60:0/1048093758 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5050 (secure 0 0 0) 0x7fbdec010980 con 0x7fbe041478d0 2024-09-12T02:30:18.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.542+0000 7fbdfb7fe640 1 -- 172.21.15.60:0/1048093758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe041478d0 msgr2=0x7fbe04147cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:18.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.542+0000 7fbdfb7fe640 1 --2- 172.21.15.60:0/1048093758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe041478d0 0x7fbe04147cb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbe040c2680 tx=0x7fbdec000ed0 comp rx=0 tx=0).stop 2024-09-12T02:30:18.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.542+0000 7fbdfb7fe640 1 -- 172.21.15.60:0/1048093758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe041478d0 msgr2=0x7fbe04147cb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:30:18.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.542+0000 7fbdfb7fe640 1 --2- 172.21.15.60:0/1048093758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe041478d0 0x7fbe04147cb0 secure :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbe040c2680 tx=0x7fbdec000ed0 comp rx=0 tx=0).stop 2024-09-12T02:30:18.543 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:30:18.543 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:30:18.544 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:30:18.544 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:30:18.544 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 70, 2024-09-12T02:30:18.544 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 363976, 2024-09-12T02:30:18.544 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:30:18.544 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:30:18.544 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:30:18.544 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:30:18.544 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:30:18.544 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 1, 2024-09-12T02:30:18.544 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:30:18.544 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:30:18.545 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:30:18.545 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:30:18.545 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:30:18.545 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:30:18.545 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:30:18.545 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:30:18.545 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:30:18.545 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:30:18.545 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:30:18.545 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:30:18.545 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:30:18.545 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:30:18.545 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:30:18.546 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:30:18.546 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:30:18.546 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:30:18.546 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:30:18.546 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:30:18.546 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:30:18.546 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:30:18.546 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:30:18.546 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:30:18.546 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:30:18.547 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:30:18.547 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:30:18.547 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:30:18.547 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:18.547 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:18.547 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:30:18.547 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:30:18.547 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:30:18.547 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:30:18.547 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:30:18.547 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:30:18.547 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:30:18.547 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:30:18.547 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:30:18.548 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:30:18.548 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:30:18.548 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:30:18.548 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:30:18.548 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:30:18.548 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:30:18.548 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:30:18.548 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:30:18.548 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:30:18.548 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:30:18.548 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:30:18.548 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:30:18.548 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:30:18.549 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:30:18.549 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:30:18.549 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:30:18.549 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:30:18.549 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:30:18.549 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:30:18.549 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:30:18.549 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:30:18.549 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:18.549 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:30:18.549 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:18.549 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:30:18.549 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:30:18.549 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:30:18.550 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:30:18.550 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:18.550 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:30:18.550 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:30:18.550 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:18.550 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:18.550 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:18.550 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:30:18.550 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:30:18.550 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:18.551 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:18.551 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:18.551 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:18.551 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:30:18.551 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:30:18.551 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:30:18.551 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:30:18.551 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:30:18.551 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:18.551 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:18.551 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:30:18.551 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:30:18.552 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:30:18.552 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:30:18.552 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:18.552 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:30:18.552 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:30:18.552 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:18.552 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:18.552 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:18.552 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:30:18.552 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:30:18.552 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:18.552 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:18.552 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:18.553 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:18.553 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:30:18.553 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:30:18.553 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:30:18.553 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:30:18.553 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:30:18.553 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:18.553 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:18.553 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:30:18.553 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:30:18.553 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:30:18.553 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:30:18.553 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:18.553 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:30:18.554 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:30:18.554 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:18.554 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:18.554 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:18.554 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:30:18.554 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:30:18.554 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:18.554 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:18.554 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:18.554 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:18.554 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:30:18.554 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:30:18.554 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:30:18.554 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:30:18.555 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:30:18.555 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:18.555 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:18.555 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:18.555 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:30:18.555 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:30:18.555 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:18.555 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:30:18.555 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:30:18.555 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:30:18.555 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:18.555 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:30:18.555 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:30:18.556 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:18.556 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:30:18.556 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:30:18.556 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:30:18.556 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:18.556 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:30:18.556 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:30:18.556 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:18.556 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:30:18.556 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:30:18.556 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-09-12T02:30:18.556 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:18.556 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:30:18.557 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:30:18.557 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:18.557 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:30:18.557 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:30:18.557 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-09-12T02:30:18.557 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:18.557 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:30:18.557 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:30:18.557 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:18.557 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:30:18.557 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:30:18.557 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:30:18.557 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:18.557 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:18.558 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:18.558 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:30:18.558 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:30:18.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.542+0000 7fbe095b7640 1 -- 172.21.15.60:0/1048093758 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbde406be30 msgr2=0x7fbde406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:18.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.542+0000 7fbe095b7640 1 --2- 172.21.15.60:0/1048093758 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbde406be30 0x7fbde406e2f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc0012e0 tx=0x7fbdfc009040 comp rx=0 tx=0).stop 2024-09-12T02:30:18.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.542+0000 7fbe095b7640 1 -- 172.21.15.60:0/1048093758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe0406e920 msgr2=0x7fbe040c78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:18.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.542+0000 7fbe095b7640 1 --2- 172.21.15.60:0/1048093758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe0406e920 0x7fbe040c78b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbdf40098c0 tx=0x7fbdf40046c0 comp rx=0 tx=0).stop 2024-09-12T02:30:18.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.542+0000 7fbe037fe640 1 -- 172.21.15.60:0/1048093758 reap_dead start 2024-09-12T02:30:18.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.543+0000 7fbe037fe640 1 -- 172.21.15.60:0/1048093758 reap_dead start 2024-09-12T02:30:18.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.543+0000 7fbe095b7640 1 -- 172.21.15.60:0/1048093758 shutdown_connections 2024-09-12T02:30:18.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.543+0000 7fbe095b7640 1 -- 172.21.15.60:0/1048093758 >> 172.21.15.60:0/1048093758 conn(0x7fbe040c8410 msgr2=0x7fbe0414f970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:18.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.543+0000 7fbe095b7640 1 -- 172.21.15.60:0/1048093758 shutdown_connections 2024-09-12T02:30:18.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.543+0000 7fbe095b7640 1 -- 172.21.15.60:0/1048093758 wait complete. 2024-09-12T02:30:18.560 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:30:18.560 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-12T02:30:18.560 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-12T02:30:18.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.673+0000 7f913b442640 1 Processor -- start 2024-09-12T02:30:18.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.674+0000 7f913b442640 1 -- start start 2024-09-12T02:30:18.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.675+0000 7f913b442640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9134073ae0 0x7f9134153380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:18.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.675+0000 7f913b442640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f913406dd50 con 0x7f9134156f50 2024-09-12T02:30:18.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.675+0000 7f913b442640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f913406e030 con 0x7f91340733d0 2024-09-12T02:30:18.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.675+0000 7f913b442640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f913406e310 con 0x7f9134073ae0 2024-09-12T02:30:18.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.675+0000 7f91399df640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f9134156f50 0x7f9134160b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60022/0 (socket says 172.21.15.60:60022) 2024-09-12T02:30:18.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.675+0000 7f91399df640 1 -- 172.21.15.60:0/2459681204 learned_addr learned my addr 172.21.15.60:0/2459681204 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:30:18.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.675+0000 7f91391de640 1 --2- 172.21.15.60:0/2459681204 >> v2:172.21.15.105:3300/0 conn(0x7f9134073ae0 0x7f9134153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:18.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.675+0000 7f912bfff640 1 -- 172.21.15.60:0/2459681204 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4186355094 0 0) 0x7f913406dd50 con 0x7f9134156f50 2024-09-12T02:30:18.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.675+0000 7f912bfff640 1 -- 172.21.15.60:0/2459681204 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9120003520 con 0x7f9134156f50 2024-09-12T02:30:18.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.675+0000 7f912bfff640 1 -- 172.21.15.60:0/2459681204 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1078814759 0 0) 0x7f913406e030 con 0x7f91340733d0 2024-09-12T02:30:18.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.676+0000 7f912bfff640 1 -- 172.21.15.60:0/2459681204 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f913406dd50 con 0x7f91340733d0 2024-09-12T02:30:18.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.676+0000 7f91391de640 1 -- 172.21.15.60:0/2459681204 >> v1:172.21.15.105:6789/0 conn(0x7f91340733d0 legacy=0x7f9134156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:18.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.676+0000 7f91391de640 1 -- 172.21.15.60:0/2459681204 >> v1:172.21.15.60:6789/0 conn(0x7f9134156f50 legacy=0x7f9134160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:18.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.676+0000 7f91391de640 1 -- 172.21.15.60:0/2459681204 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f913406e5f0 con 0x7f9134073ae0 2024-09-12T02:30:18.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.677+0000 7f91391de640 1 --2- 172.21.15.60:0/2459681204 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9134073ae0 0x7f9134153380 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f91300097a0 tx=0x7f913002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3c81ba3fe0042b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:18.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.677+0000 7f912bfff640 1 -- 172.21.15.60:0/2459681204 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9130037070 con 0x7f9134073ae0 2024-09-12T02:30:18.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.677+0000 7f912bfff640 1 -- 172.21.15.60:0/2459681204 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9130032440 con 0x7f9134073ae0 2024-09-12T02:30:18.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.677+0000 7f912bfff640 1 -- 172.21.15.60:0/2459681204 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9130032810 con 0x7f9134073ae0 2024-09-12T02:30:18.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.678+0000 7f913b442640 1 -- 172.21.15.60:0/2459681204 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9134073ae0 msgr2=0x7f9134153380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:18.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.678+0000 7f913b442640 1 --2- 172.21.15.60:0/2459681204 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9134073ae0 0x7f9134153380 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f91300097a0 tx=0x7f913002a230 comp rx=0 tx=0).stop 2024-09-12T02:30:18.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.678+0000 7f913b442640 1 -- 172.21.15.60:0/2459681204 shutdown_connections 2024-09-12T02:30:18.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.678+0000 7f913b442640 1 --2- 172.21.15.60:0/2459681204 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9134073ae0 0x7f9134153380 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:18.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.678+0000 7f913b442640 1 -- 172.21.15.60:0/2459681204 >> 172.21.15.60:0/2459681204 conn(0x7f91340c9d80 msgr2=0x7f91340ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:18.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.678+0000 7f913b442640 1 -- 172.21.15.60:0/2459681204 shutdown_connections 2024-09-12T02:30:18.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.678+0000 7f913b442640 1 -- 172.21.15.60:0/2459681204 wait complete. 2024-09-12T02:30:18.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.680+0000 7f913b442640 1 Processor -- start 2024-09-12T02:30:18.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.680+0000 7f913b442640 1 -- start start 2024-09-12T02:30:18.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.680+0000 7f913b442640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91340733d0 0x7f91340c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:18.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.680+0000 7f913b442640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9134073ae0 0x7f913414f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:18.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.680+0000 7f913b442640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9134156f50 0x7f91341eed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:18.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.680+0000 7f913b442640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f913406edd0 con 0x7f91340733d0 2024-09-12T02:30:18.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.680+0000 7f913b442640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f913406ec50 con 0x7f9134073ae0 2024-09-12T02:30:18.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.680+0000 7f913b442640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9134073ec0 con 0x7f9134156f50 2024-09-12T02:30:18.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.681+0000 7f91391de640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91340733d0 0x7f91340c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:18.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.681+0000 7f91391de640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91340733d0 0x7f91340c85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47280/0 (socket says 172.21.15.60:47280) 2024-09-12T02:30:18.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.681+0000 7f91391de640 1 -- 172.21.15.60:0/234674062 learned_addr learned my addr 172.21.15.60:0/234674062 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:30:18.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.681+0000 7f91399df640 1 --2- 172.21.15.60:0/234674062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9134156f50 0x7f91341eed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:18.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.681+0000 7f91389dd640 1 --2- 172.21.15.60:0/234674062 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9134073ae0 0x7f913414f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:18.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.681+0000 7f91399df640 1 -- 172.21.15.60:0/234674062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9134156f50 msgr2=0x7f91341eed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-12T02:30:18.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.681+0000 7f91399df640 1 -- 172.21.15.60:0/234674062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9134156f50 msgr2=0x7f91341eed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:30:18.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.681+0000 7f91399df640 1 --2- 172.21.15.60:0/234674062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9134156f50 0x7f91341eed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:30:18.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.681+0000 7f91399df640 1 --2- 172.21.15.60:0/234674062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9134156f50 0x7f91341eed50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:30:18.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.681+0000 7f91391de640 1 -- 172.21.15.60:0/234674062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9134156f50 msgr2=0x7f91341eed50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:30:18.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.681+0000 7f91391de640 1 --2- 172.21.15.60:0/234674062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9134156f50 0x7f91341eed50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:18.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.681+0000 7f91391de640 1 -- 172.21.15.60:0/234674062 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9134073ae0 msgr2=0x7f913414f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:18.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.681+0000 7f91391de640 1 --2- 172.21.15.60:0/234674062 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9134073ae0 0x7f913414f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:18.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.681+0000 7f91391de640 1 -- 172.21.15.60:0/234674062 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91340c8f80 con 0x7f91340733d0 2024-09-12T02:30:18.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.681+0000 7f91389dd640 1 --2- 172.21.15.60:0/234674062 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9134073ae0 0x7f913414f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:30:18.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.681+0000 7f91391de640 1 --2- 172.21.15.60:0/234674062 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91340733d0 0x7f91340c85d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9130000c00 tx=0x7f91300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:18.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.682+0000 7f9129ffb640 1 -- 172.21.15.60:0/234674062 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9130041020 con 0x7f91340733d0 2024-09-12T02:30:18.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.682+0000 7f9129ffb640 1 -- 172.21.15.60:0/234674062 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f913003d6e0 con 0x7f91340733d0 2024-09-12T02:30:18.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.682+0000 7f913b442640 1 -- 172.21.15.60:0/234674062 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9134155ce0 con 0x7f91340733d0 2024-09-12T02:30:18.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.682+0000 7f9129ffb640 1 -- 172.21.15.60:0/234674062 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9130037040 con 0x7f91340733d0 2024-09-12T02:30:18.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.682+0000 7f913b442640 1 -- 172.21.15.60:0/234674062 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91340c7dd0 con 0x7f91340733d0 2024-09-12T02:30:18.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.683+0000 7f913b442640 1 --2- 172.21.15.60:0/234674062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91340c8010 0x7f9134147d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:18.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.683+0000 7f913b442640 1 -- 172.21.15.60:0/234674062 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f913406d850 con 0x7f91340c8010 2024-09-12T02:30:18.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.683+0000 7f91389dd640 1 --2- 172.21.15.60:0/234674062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91340c8010 0x7f9134147d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:18.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.683+0000 7f91389dd640 1 -- 172.21.15.60:0/234674062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91340c8010 msgr2=0x7f9134147d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2024-09-12T02:30:18.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.683+0000 7f91389dd640 1 -- 172.21.15.60:0/234674062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91340c8010 msgr2=0x7f9134147d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:30:18.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.683+0000 7f91389dd640 1 --2- 172.21.15.60:0/234674062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91340c8010 0x7f9134147d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:30:18.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.683+0000 7f91389dd640 1 --2- 172.21.15.60:0/234674062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91340c8010 0x7f9134147d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:30:18.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.684+0000 7f9129ffb640 1 -- 172.21.15.60:0/234674062 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9130044020 con 0x7f91340733d0 2024-09-12T02:30:18.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.684+0000 7f9129ffb640 1 --2- 172.21.15.60:0/234674062 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f911806be60 0x7f911806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:18.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.684+0000 7f9129ffb640 1 -- 172.21.15.60:0/234674062 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f91300ab890 con 0x7f91340733d0 2024-09-12T02:30:18.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.684+0000 7f91399df640 1 --2- 172.21.15.60:0/234674062 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f911806be60 0x7f911806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:18.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.685+0000 7f91399df640 1 --2- 172.21.15.60:0/234674062 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f911806be60 0x7f911806e320 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f912c0012e0 tx=0x7f912c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:18.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.884+0000 7f91389dd640 1 --2- 172.21.15.60:0/234674062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91340c8010 0x7f9134147d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:18.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.884+0000 7f91389dd640 1 -- 172.21.15.60:0/234674062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91340c8010 msgr2=0x7f9134147d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-12T02:30:18.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.884+0000 7f91389dd640 1 -- 172.21.15.60:0/234674062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91340c8010 msgr2=0x7f9134147d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:30:18.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.884+0000 7f91389dd640 1 --2- 172.21.15.60:0/234674062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91340c8010 0x7f9134147d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:30:18.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:18.884+0000 7f91389dd640 1 --2- 172.21.15.60:0/234674062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91340c8010 0x7f9134147d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:30:19.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:19.285+0000 7f91389dd640 1 --2- 172.21.15.60:0/234674062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91340c8010 0x7f9134147d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:19.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:19.285+0000 7f91389dd640 1 -- 172.21.15.60:0/234674062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91340c8010 msgr2=0x7f9134147d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-12T02:30:19.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:19.285+0000 7f91389dd640 1 -- 172.21.15.60:0/234674062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91340c8010 msgr2=0x7f9134147d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:30:19.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:19.285+0000 7f91389dd640 1 --2- 172.21.15.60:0/234674062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91340c8010 0x7f9134147d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:30:19.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:19.285+0000 7f91389dd640 1 --2- 172.21.15.60:0/234674062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91340c8010 0x7f9134147d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:30:20.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:20.086+0000 7f91389dd640 1 --2- 172.21.15.60:0/234674062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91340c8010 0x7f9134147d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:20.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:20.086+0000 7f91389dd640 1 -- 172.21.15.60:0/234674062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91340c8010 msgr2=0x7f9134147d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-12T02:30:20.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:20.086+0000 7f91389dd640 1 -- 172.21.15.60:0/234674062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91340c8010 msgr2=0x7f9134147d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:30:20.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:20.086+0000 7f91389dd640 1 --2- 172.21.15.60:0/234674062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91340c8010 0x7f9134147d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:30:20.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:20.086+0000 7f91389dd640 1 --2- 172.21.15.60:0/234674062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91340c8010 0x7f9134147d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:30:21.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.688+0000 7f91389dd640 1 --2- 172.21.15.60:0/234674062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91340c8010 0x7f9134147d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:21.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.688+0000 7f91389dd640 1 -- 172.21.15.60:0/234674062 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9134070940 con 0x7f91340c8010 2024-09-12T02:30:21.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.688+0000 7f91389dd640 1 --2- 172.21.15.60:0/234674062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91340c8010 0x7f9134147d10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f913414a830 tx=0x7f9124013700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:21.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.689+0000 7f9129ffb640 1 -- 172.21.15.60:0/234674062 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9124015d80 con 0x7f91340c8010 2024-09-12T02:30:21.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.689+0000 7f9129ffb640 1 -- 172.21.15.60:0/234674062 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f912401a030 con 0x7f91340c8010 2024-09-12T02:30:21.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.689+0000 7f9129ffb640 1 -- 172.21.15.60:0/234674062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91340c8010 msgr2=0x7f9134147d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:21.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.689+0000 7f9129ffb640 1 --2- 172.21.15.60:0/234674062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91340c8010 0x7f9134147d10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f913414a830 tx=0x7f9124013700 comp rx=0 tx=0).stop 2024-09-12T02:30:21.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.689+0000 7f9129ffb640 1 -- 172.21.15.60:0/234674062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91340c8010 msgr2=0x7f9134147d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:30:21.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.689+0000 7f9129ffb640 1 --2- 172.21.15.60:0/234674062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91340c8010 0x7f9134147d10 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:21.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.696+0000 7f913b442640 1 --2- 172.21.15.60:0/234674062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9134148250 0x7f9134158890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:21.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.696+0000 7f913b442640 1 -- 172.21.15.60:0/234674062 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9134148630 con 0x7f9134148250 2024-09-12T02:30:21.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.696+0000 7f91389dd640 1 --2- 172.21.15.60:0/234674062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9134148250 0x7f9134158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:21.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.696+0000 7f91389dd640 1 -- 172.21.15.60:0/234674062 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f913414f730 con 0x7f9134148250 2024-09-12T02:30:21.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.697+0000 7f91389dd640 1 --2- 172.21.15.60:0/234674062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9134148250 0x7f9134158890 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9124007fd0 tx=0x7f9124000ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:21.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.697+0000 7f9129ffb640 1 -- 172.21.15.60:0/234674062 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912401f420 con 0x7f9134148250 2024-09-12T02:30:21.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.697+0000 7f9129ffb640 1 -- 172.21.15.60:0/234674062 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4548 (secure 0 0 0) 0x7f9124016420 con 0x7f9134148250 2024-09-12T02:30:21.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.697+0000 7f9129ffb640 1 -- 172.21.15.60:0/234674062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9134148250 msgr2=0x7f9134158890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:21.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.697+0000 7f9129ffb640 1 --2- 172.21.15.60:0/234674062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9134148250 0x7f9134158890 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9124007fd0 tx=0x7f9124000ed0 comp rx=0 tx=0).stop 2024-09-12T02:30:21.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.697+0000 7f9129ffb640 1 -- 172.21.15.60:0/234674062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9134148250 msgr2=0x7f9134158890 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:30:21.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.697+0000 7f9129ffb640 1 --2- 172.21.15.60:0/234674062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9134148250 0x7f9134158890 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:21.698 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:30:21.698 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:30:21.699 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:30:21.699 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:30:21.699 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 70, 2024-09-12T02:30:21.699 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 10637, 2024-09-12T02:30:21.699 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:30:21.699 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:30:21.699 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:30:21.699 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:30:21.699 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:30:21.699 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 4, 2024-09-12T02:30:21.699 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:30:21.699 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:30:21.699 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:30:21.699 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:30:21.700 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:30:21.700 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:30:21.700 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:30:21.700 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:30:21.700 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:30:21.700 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:30:21.700 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:30:21.700 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:30:21.700 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:30:21.700 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:30:21.700 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:30:21.700 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:30:21.700 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:30:21.701 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:30:21.701 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:30:21.701 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:30:21.701 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:30:21.701 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:30:21.701 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:30:21.701 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:30:21.701 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:30:21.701 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:30:21.701 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:30:21.701 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:30:21.701 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:21.701 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:21.702 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:30:21.702 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:30:21.702 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:30:21.702 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:30:21.702 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:30:21.702 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:30:21.702 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:30:21.702 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:30:21.702 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:30:21.702 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:30:21.702 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:30:21.702 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:30:21.702 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:30:21.703 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:30:21.703 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:30:21.703 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:30:21.703 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:30:21.703 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:30:21.703 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:30:21.703 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:30:21.703 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:30:21.703 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:30:21.703 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:30:21.703 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:30:21.703 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:30:21.703 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:30:21.704 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:30:21.704 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:30:21.704 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:30:21.704 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:30:21.704 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:21.704 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:30:21.704 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:21.704 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:30:21.704 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:30:21.704 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:30:21.704 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:30:21.704 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:21.704 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:30:21.705 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:30:21.705 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:21.705 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:21.705 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:21.705 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:30:21.705 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:30:21.705 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:21.705 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:21.705 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:21.705 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:21.705 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:30:21.705 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:30:21.705 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:30:21.705 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:30:21.706 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:30:21.706 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:21.706 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:21.706 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:30:21.706 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:30:21.706 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:30:21.706 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:30:21.706 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:21.706 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:30:21.706 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:30:21.706 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:21.706 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:21.706 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:21.707 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:30:21.707 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:30:21.707 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:21.707 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:21.707 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:21.707 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:21.707 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:30:21.707 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:30:21.707 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:30:21.707 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:30:21.707 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:30:21.707 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:21.707 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:21.707 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:30:21.708 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:30:21.708 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:30:21.708 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:30:21.708 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:21.708 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:30:21.708 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:30:21.708 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:21.708 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:21.708 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:21.708 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:30:21.708 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:30:21.708 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:21.708 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:21.709 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:21.709 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:21.709 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:30:21.709 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:30:21.709 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:30:21.709 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:30:21.709 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:30:21.709 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:21.709 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:21.709 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:21.709 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:30:21.709 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:30:21.709 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:21.710 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:30:21.710 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:30:21.710 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:30:21.710 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:21.710 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:30:21.710 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:30:21.710 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:21.710 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:30:21.710 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:30:21.710 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:30:21.710 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:21.710 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:21.710 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:21.711 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:30:21.711 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:30:21.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.698+0000 7f913b442640 1 -- 172.21.15.60:0/234674062 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f911806be60 msgr2=0x7f911806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:21.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.698+0000 7f913b442640 1 --2- 172.21.15.60:0/234674062 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f911806be60 0x7f911806e320 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f912c0012e0 tx=0x7f912c009040 comp rx=0 tx=0).stop 2024-09-12T02:30:21.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.698+0000 7f913b442640 1 -- 172.21.15.60:0/234674062 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91340733d0 msgr2=0x7f91340c85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:21.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.698+0000 7f913b442640 1 --2- 172.21.15.60:0/234674062 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91340733d0 0x7f91340c85d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9130000c00 tx=0x7f91300046c0 comp rx=0 tx=0).stop 2024-09-12T02:30:21.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.698+0000 7f91399df640 1 -- 172.21.15.60:0/234674062 reap_dead start 2024-09-12T02:30:21.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.698+0000 7f91399df640 1 -- 172.21.15.60:0/234674062 reap_dead start 2024-09-12T02:30:21.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.698+0000 7f913b442640 1 -- 172.21.15.60:0/234674062 shutdown_connections 2024-09-12T02:30:21.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.698+0000 7f913b442640 1 -- 172.21.15.60:0/234674062 >> 172.21.15.60:0/234674062 conn(0x7f91340c9d80 msgr2=0x7f91340c4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:21.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.698+0000 7f913b442640 1 -- 172.21.15.60:0/234674062 shutdown_connections 2024-09-12T02:30:21.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.698+0000 7f913b442640 1 -- 172.21.15.60:0/234674062 wait complete. 2024-09-12T02:30:21.713 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:30:21.713 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-12T02:30:21.713 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-12T02:30:21.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.824+0000 7f39bc4b7640 1 Processor -- start 2024-09-12T02:30:21.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.824+0000 7f39bc4b7640 1 -- start start 2024-09-12T02:30:21.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.825+0000 7f39bc4b7640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f39b414e720 0x7f39b40aa160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:21.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.825+0000 7f39bc4b7640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39b4158610 con 0x7f39b40aa6a0 2024-09-12T02:30:21.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.825+0000 7f39bc4b7640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39b40a7f70 con 0x7f39b40aaac0 2024-09-12T02:30:21.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.825+0000 7f39bc4b7640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f39b40a9cd0 con 0x7f39b414e720 2024-09-12T02:30:21.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.825+0000 7f39ba253640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f39b414e720 0x7f39b40aa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:21.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.825+0000 7f39b9a52640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f39b40aa6a0 0x7f39b406e3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55584/0 (socket says 172.21.15.60:55584) 2024-09-12T02:30:21.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.825+0000 7f39ba253640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f39b414e720 0x7f39b40aa160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43642/0 (socket says 172.21.15.60:43642) 2024-09-12T02:30:21.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.825+0000 7f39b9a52640 1 -- 172.21.15.60:0/1496700097 learned_addr learned my addr 172.21.15.60:0/1496700097 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:30:21.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.826+0000 7f39ba253640 1 -- 172.21.15.60:0/1496700097 >> v1:172.21.15.105:6789/0 conn(0x7f39b40aaac0 legacy=0x7f39b406eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:21.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.826+0000 7f39ba253640 1 -- 172.21.15.60:0/1496700097 >> v1:172.21.15.60:6789/0 conn(0x7f39b40aa6a0 legacy=0x7f39b406e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:21.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.826+0000 7f39ba253640 1 -- 172.21.15.60:0/1496700097 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39b40a8250 con 0x7f39b414e720 2024-09-12T02:30:21.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.827+0000 7f39ba253640 1 --2- 172.21.15.60:0/1496700097 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39b414e720 0x7f39b40aa160 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f39b00097a0 tx=0x7f39b002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f10b5376f8ffcec9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:21.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.827+0000 7f39b9251640 1 -- 172.21.15.60:0/1496700097 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b0037070 con 0x7f39b414e720 2024-09-12T02:30:21.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.827+0000 7f39b9251640 1 -- 172.21.15.60:0/1496700097 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39b0032440 con 0x7f39b414e720 2024-09-12T02:30:21.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.827+0000 7f39b9251640 1 -- 172.21.15.60:0/1496700097 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b0032810 con 0x7f39b414e720 2024-09-12T02:30:21.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.828+0000 7f39bc4b7640 1 -- 172.21.15.60:0/1496700097 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39b414e720 msgr2=0x7f39b40aa160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:21.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.828+0000 7f39bc4b7640 1 --2- 172.21.15.60:0/1496700097 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39b414e720 0x7f39b40aa160 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f39b00097a0 tx=0x7f39b002a1a0 comp rx=0 tx=0).stop 2024-09-12T02:30:21.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.828+0000 7f39bc4b7640 1 -- 172.21.15.60:0/1496700097 shutdown_connections 2024-09-12T02:30:21.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.828+0000 7f39bc4b7640 1 --2- 172.21.15.60:0/1496700097 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39b414e720 0x7f39b40aa160 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:21.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.828+0000 7f39bc4b7640 1 -- 172.21.15.60:0/1496700097 >> 172.21.15.60:0/1496700097 conn(0x7f39b40c8430 msgr2=0x7f39b40c8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:21.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.828+0000 7f39bc4b7640 1 -- 172.21.15.60:0/1496700097 shutdown_connections 2024-09-12T02:30:21.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.828+0000 7f39bc4b7640 1 -- 172.21.15.60:0/1496700097 wait complete. 2024-09-12T02:30:21.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.829+0000 7f39bc4b7640 1 Processor -- start 2024-09-12T02:30:21.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.829+0000 7f39bc4b7640 1 -- start start 2024-09-12T02:30:21.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.830+0000 7f39bc4b7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39b40aa6a0 0x7f39b41ed1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:21.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.830+0000 7f39bc4b7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39b40aaac0 0x7f39b414c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:21.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.830+0000 7f39bc4b7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39b414e720 0x7f39b41efb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:21.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.830+0000 7f39bc4b7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f39b4067fe0 con 0x7f39b40aaac0 2024-09-12T02:30:21.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.830+0000 7f39bc4b7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f39b4067e60 con 0x7f39b414e720 2024-09-12T02:30:21.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.830+0000 7f39bc4b7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f39b41581e0 con 0x7f39b40aa6a0 2024-09-12T02:30:21.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.830+0000 7f39b9a52640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39b40aaac0 0x7f39b414c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:21.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.830+0000 7f39b9a52640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39b40aaac0 0x7f39b414c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43650/0 (socket says 172.21.15.60:43650) 2024-09-12T02:30:21.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.830+0000 7f39b9a52640 1 -- 172.21.15.60:0/3771424779 learned_addr learned my addr 172.21.15.60:0/3771424779 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:30:21.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.830+0000 7f39ba253640 1 --2- 172.21.15.60:0/3771424779 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39b40aa6a0 0x7f39b41ed1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:21.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.830+0000 7f39baa54640 1 --2- 172.21.15.60:0/3771424779 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39b414e720 0x7f39b41efb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:21.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.830+0000 7f39b9a52640 1 -- 172.21.15.60:0/3771424779 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39b40aa6a0 msgr2=0x7f39b41ed1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:21.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.830+0000 7f39b9a52640 1 --2- 172.21.15.60:0/3771424779 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39b40aa6a0 0x7f39b41ed1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:21.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.830+0000 7f39b9a52640 1 -- 172.21.15.60:0/3771424779 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39b414e720 msgr2=0x7f39b41efb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:21.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.830+0000 7f39b9a52640 1 --2- 172.21.15.60:0/3771424779 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39b414e720 0x7f39b41efb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:21.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.830+0000 7f39b9a52640 1 -- 172.21.15.60:0/3771424779 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39b40ad280 con 0x7f39b40aaac0 2024-09-12T02:30:21.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.830+0000 7f39b9a52640 1 --2- 172.21.15.60:0/3771424779 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39b40aaac0 0x7f39b414c6f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f39a400c4a0 tx=0x7f39a400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:21.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.830+0000 7f39aaffd640 1 -- 172.21.15.60:0/3771424779 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a4017070 con 0x7f39b40aaac0 2024-09-12T02:30:21.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.830+0000 7f39aaffd640 1 -- 172.21.15.60:0/3771424779 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39a4005ce0 con 0x7f39b40aaac0 2024-09-12T02:30:21.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.830+0000 7f39aaffd640 1 -- 172.21.15.60:0/3771424779 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a4007270 con 0x7f39b40aaac0 2024-09-12T02:30:21.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.830+0000 7f39bc4b7640 1 -- 172.21.15.60:0/3771424779 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39b40ad560 con 0x7f39b40aaac0 2024-09-12T02:30:21.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.831+0000 7f39bc4b7640 1 -- 172.21.15.60:0/3771424779 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39b41ec9c0 con 0x7f39b40aaac0 2024-09-12T02:30:21.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.832+0000 7f39bc4b7640 1 -- 172.21.15.60:0/3771424779 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39b414e040 con 0x7f39b40aaac0 2024-09-12T02:30:21.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.832+0000 7f39aaffd640 1 -- 172.21.15.60:0/3771424779 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f39a401a070 con 0x7f39b40aaac0 2024-09-12T02:30:21.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.833+0000 7f39aaffd640 1 --2- 172.21.15.60:0/3771424779 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f399806be30 0x7f399806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:21.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.833+0000 7f39aaffd640 1 -- 172.21.15.60:0/3771424779 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f39a408a3d0 con 0x7f39b40aaac0 2024-09-12T02:30:21.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.833+0000 7f39ba253640 1 --2- 172.21.15.60:0/3771424779 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f399806be30 0x7f399806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:21.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.834+0000 7f39ba253640 1 --2- 172.21.15.60:0/3771424779 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f399806be30 0x7f399806e2f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f39b0034000 tx=0x7f39b002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:21.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:21.838+0000 7f39aaffd640 1 -- 172.21.15.60:0/3771424779 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f39a4058420 con 0x7f39b40aaac0 2024-09-12T02:30:22.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:22.117+0000 7f39bc4b7640 1 -- 172.21.15.60:0/3771424779 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f39b40c5cc0 con 0x7f39b40aaac0 2024-09-12T02:30:22.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:22.118+0000 7f39aaffd640 1 -- 172.21.15.60:0/3771424779 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f39a405c720 con 0x7f39b40aaac0 2024-09-12T02:30:22.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:22.121+0000 7f39bc4b7640 1 -- 172.21.15.60:0/3771424779 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f399806be30 msgr2=0x7f399806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:22.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:22.121+0000 7f39bc4b7640 1 --2- 172.21.15.60:0/3771424779 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f399806be30 0x7f399806e2f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f39b0034000 tx=0x7f39b002e000 comp rx=0 tx=0).stop 2024-09-12T02:30:22.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:22.121+0000 7f39bc4b7640 1 -- 172.21.15.60:0/3771424779 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39b40aaac0 msgr2=0x7f39b414c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:22.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:22.121+0000 7f39bc4b7640 1 --2- 172.21.15.60:0/3771424779 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39b40aaac0 0x7f39b414c6f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f39a400c4a0 tx=0x7f39a400c960 comp rx=0 tx=0).stop 2024-09-12T02:30:22.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:22.121+0000 7f39bc4b7640 1 -- 172.21.15.60:0/3771424779 shutdown_connections 2024-09-12T02:30:22.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:22.121+0000 7f39bc4b7640 1 --2- 172.21.15.60:0/3771424779 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f399806be30 0x7f399806e2f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:22.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:22.121+0000 7f39bc4b7640 1 --2- 172.21.15.60:0/3771424779 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39b414e720 0x7f39b41efb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:22.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:22.121+0000 7f39bc4b7640 1 --2- 172.21.15.60:0/3771424779 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39b40aaac0 0x7f39b414c6f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:22.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:22.121+0000 7f39bc4b7640 1 --2- 172.21.15.60:0/3771424779 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39b40aa6a0 0x7f39b41ed1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:22.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:22.121+0000 7f39bc4b7640 1 -- 172.21.15.60:0/3771424779 >> 172.21.15.60:0/3771424779 conn(0x7f39b40c8430 msgr2=0x7f39b414cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:22.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:22.122+0000 7f39bc4b7640 1 -- 172.21.15.60:0/3771424779 shutdown_connections 2024-09-12T02:30:22.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:22.122+0000 7f39bc4b7640 1 -- 172.21.15.60:0/3771424779 wait complete. 2024-09-12T02:30:22.133 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-12T02:30:28.088 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:30:28.090 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:30:32.135 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-12T02:30:32.135 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:30:32.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.240+0000 7f95d004c640 1 Processor -- start 2024-09-12T02:30:32.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.240+0000 7f95d004c640 1 -- start start 2024-09-12T02:30:32.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.241+0000 7f95d004c640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f95c80c8b10 0x7f95c815a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:32.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.241+0000 7f95d004c640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95c80c7070 con 0x7f95c8153be0 2024-09-12T02:30:32.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.241+0000 7f95d004c640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95c806d210 con 0x7f95c806cd80 2024-09-12T02:30:32.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.241+0000 7f95d004c640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f95c80c69b0 con 0x7f95c80c8b10 2024-09-12T02:30:32.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.241+0000 7f95ce5e9640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f95c8153be0 0x7f95c8156660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:57204/0 (socket says 172.21.15.60:57204) 2024-09-12T02:30:32.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.241+0000 7f95ce5e9640 1 -- 172.21.15.60:0/2073218381 learned_addr learned my addr 172.21.15.60:0/2073218381 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:30:32.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.241+0000 7f95cdde8640 1 --2- 172.21.15.60:0/2073218381 >> v2:172.21.15.105:3300/0 conn(0x7f95c80c8b10 0x7f95c815a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:32.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.241+0000 7f95ccde6640 1 -- 172.21.15.60:0/2073218381 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2855704135 0 0) 0x7f95c80c7070 con 0x7f95c8153be0 2024-09-12T02:30:32.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.241+0000 7f95ccde6640 1 -- 172.21.15.60:0/2073218381 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95b4003520 con 0x7f95c8153be0 2024-09-12T02:30:32.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.241+0000 7f95ccde6640 1 -- 172.21.15.60:0/2073218381 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2822722140 0 0) 0x7f95c806d210 con 0x7f95c806cd80 2024-09-12T02:30:32.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.241+0000 7f95ccde6640 1 -- 172.21.15.60:0/2073218381 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95c80c7070 con 0x7f95c806cd80 2024-09-12T02:30:32.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.242+0000 7f95cdde8640 1 -- 172.21.15.60:0/2073218381 >> v1:172.21.15.105:6789/0 conn(0x7f95c806cd80 legacy=0x7f95c81534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:32.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.242+0000 7f95cdde8640 1 -- 172.21.15.60:0/2073218381 >> v1:172.21.15.60:6789/0 conn(0x7f95c8153be0 legacy=0x7f95c8156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:32.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.242+0000 7f95cdde8640 1 -- 172.21.15.60:0/2073218381 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95c80c6c90 con 0x7f95c80c8b10 2024-09-12T02:30:32.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.242+0000 7f95cdde8640 1 --2- 172.21.15.60:0/2073218381 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95c80c8b10 0x7f95c815a4a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f95c40097a0 tx=0x7f95c402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8caefac2351060c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:32.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.243+0000 7f95ccde6640 1 -- 172.21.15.60:0/2073218381 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c4037070 con 0x7f95c80c8b10 2024-09-12T02:30:32.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.243+0000 7f95ccde6640 1 -- 172.21.15.60:0/2073218381 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95c4032440 con 0x7f95c80c8b10 2024-09-12T02:30:32.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.243+0000 7f95ccde6640 1 -- 172.21.15.60:0/2073218381 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c4032810 con 0x7f95c80c8b10 2024-09-12T02:30:32.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.243+0000 7f95d004c640 1 -- 172.21.15.60:0/2073218381 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95c80c8b10 msgr2=0x7f95c815a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:32.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.243+0000 7f95d004c640 1 --2- 172.21.15.60:0/2073218381 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95c80c8b10 0x7f95c815a4a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f95c40097a0 tx=0x7f95c402a1a0 comp rx=0 tx=0).stop 2024-09-12T02:30:32.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.243+0000 7f95d004c640 1 -- 172.21.15.60:0/2073218381 shutdown_connections 2024-09-12T02:30:32.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.243+0000 7f95d004c640 1 --2- 172.21.15.60:0/2073218381 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95c80c8b10 0x7f95c815a4a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:32.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.243+0000 7f95d004c640 1 -- 172.21.15.60:0/2073218381 >> 172.21.15.60:0/2073218381 conn(0x7f95c80adb80 msgr2=0x7f95c80adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:32.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.243+0000 7f95d004c640 1 -- 172.21.15.60:0/2073218381 shutdown_connections 2024-09-12T02:30:32.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.243+0000 7f95d004c640 1 -- 172.21.15.60:0/2073218381 wait complete. 2024-09-12T02:30:32.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.244+0000 7f95d004c640 1 Processor -- start 2024-09-12T02:30:32.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.245+0000 7f95d004c640 1 -- start start 2024-09-12T02:30:32.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.245+0000 7f95d004c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95c80c8b10 0x7f95c8145990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:32.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.245+0000 7f95d004c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95c8153be0 0x7f95c814b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:32.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.245+0000 7f95d004c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f95c80c6050 0x7f95c815a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:32.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.245+0000 7f95d004c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f95c80c9070 con 0x7f95c80c8b10 2024-09-12T02:30:32.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.245+0000 7f95d004c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f95c80c8ef0 con 0x7f95c8153be0 2024-09-12T02:30:32.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.245+0000 7f95d004c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f95c8156d70 con 0x7f95c80c6050 2024-09-12T02:30:32.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.245+0000 7f95cdde8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95c80c8b10 0x7f95c8145990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:32.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.245+0000 7f95cdde8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95c80c8b10 0x7f95c8145990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54538/0 (socket says 172.21.15.60:54538) 2024-09-12T02:30:32.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.245+0000 7f95cdde8640 1 -- 172.21.15.60:0/2860374411 learned_addr learned my addr 172.21.15.60:0/2860374411 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:30:32.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.245+0000 7f95cd5e7640 1 --2- 172.21.15.60:0/2860374411 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95c8153be0 0x7f95c814b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:32.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.246+0000 7f95ce5e9640 1 --2- 172.21.15.60:0/2860374411 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f95c80c6050 0x7f95c815a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:32.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.246+0000 7f95cdde8640 1 -- 172.21.15.60:0/2860374411 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f95c80c6050 msgr2=0x7f95c815a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:32.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.246+0000 7f95cdde8640 1 --2- 172.21.15.60:0/2860374411 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f95c80c6050 0x7f95c815a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:32.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.246+0000 7f95cdde8640 1 -- 172.21.15.60:0/2860374411 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95c8153be0 msgr2=0x7f95c814b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:32.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.246+0000 7f95cdde8640 1 --2- 172.21.15.60:0/2860374411 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95c8153be0 0x7f95c814b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:32.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.246+0000 7f95cdde8640 1 -- 172.21.15.60:0/2860374411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95c81ef430 con 0x7f95c80c8b10 2024-09-12T02:30:32.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.246+0000 7f95cdde8640 1 --2- 172.21.15.60:0/2860374411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95c80c8b10 0x7f95c8145990 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f95c4035040 tx=0x7f95c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:32.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.246+0000 7f95be7fc640 1 -- 172.21.15.60:0/2860374411 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c4041030 con 0x7f95c80c8b10 2024-09-12T02:30:32.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.246+0000 7f95be7fc640 1 -- 172.21.15.60:0/2860374411 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95c403d4e0 con 0x7f95c80c8b10 2024-09-12T02:30:32.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.246+0000 7f95d004c640 1 -- 172.21.15.60:0/2860374411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95c8145ed0 con 0x7f95c80c8b10 2024-09-12T02:30:32.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.246+0000 7f95be7fc640 1 -- 172.21.15.60:0/2860374411 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c4037040 con 0x7f95c80c8b10 2024-09-12T02:30:32.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.246+0000 7f95d004c640 1 -- 172.21.15.60:0/2860374411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95c81e2450 con 0x7f95c80c8b10 2024-09-12T02:30:32.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.248+0000 7f95d004c640 1 -- 172.21.15.60:0/2860374411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95c81570d0 con 0x7f95c80c8b10 2024-09-12T02:30:32.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.248+0000 7f95be7fc640 1 -- 172.21.15.60:0/2860374411 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f95c4044070 con 0x7f95c80c8b10 2024-09-12T02:30:32.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.249+0000 7f95be7fc640 1 --2- 172.21.15.60:0/2860374411 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f95ac06be30 0x7f95ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:32.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.249+0000 7f95be7fc640 1 -- 172.21.15.60:0/2860374411 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f95c40ab770 con 0x7f95c80c8b10 2024-09-12T02:30:32.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.249+0000 7f95cd5e7640 1 --2- 172.21.15.60:0/2860374411 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f95ac06be30 0x7f95ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:32.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.249+0000 7f95cd5e7640 1 --2- 172.21.15.60:0/2860374411 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f95ac06be30 0x7f95ac06e2f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f95b8007fd0 tx=0x7f95b8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:32.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.253+0000 7f95be7fc640 1 -- 172.21.15.60:0/2860374411 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f95c8145ed0 con 0x7f95c80c8b10 2024-09-12T02:30:32.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.575+0000 7f95d004c640 1 -- 172.21.15.60:0/2860374411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f95c80c9d90 con 0x7f95c80c8b10 2024-09-12T02:30:32.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.576+0000 7f95be7fc640 1 -- 172.21.15.60:0/2860374411 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f95c4079740 con 0x7f95c80c8b10 2024-09-12T02:30:32.577 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":70,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:30:32.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.578+0000 7f95d004c640 1 -- 172.21.15.60:0/2860374411 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f95ac06be30 msgr2=0x7f95ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:32.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.578+0000 7f95d004c640 1 --2- 172.21.15.60:0/2860374411 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f95ac06be30 0x7f95ac06e2f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f95b8007fd0 tx=0x7f95b8009040 comp rx=0 tx=0).stop 2024-09-12T02:30:32.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.578+0000 7f95d004c640 1 -- 172.21.15.60:0/2860374411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95c80c8b10 msgr2=0x7f95c8145990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:32.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.578+0000 7f95d004c640 1 --2- 172.21.15.60:0/2860374411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95c80c8b10 0x7f95c8145990 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f95c4035040 tx=0x7f95c40046c0 comp rx=0 tx=0).stop 2024-09-12T02:30:32.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.578+0000 7f95d004c640 1 -- 172.21.15.60:0/2860374411 shutdown_connections 2024-09-12T02:30:32.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.578+0000 7f95d004c640 1 --2- 172.21.15.60:0/2860374411 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f95ac06be30 0x7f95ac06e2f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:32.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.578+0000 7f95d004c640 1 --2- 172.21.15.60:0/2860374411 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f95c80c6050 0x7f95c815a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:32.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.578+0000 7f95d004c640 1 --2- 172.21.15.60:0/2860374411 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95c8153be0 0x7f95c814b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:32.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.578+0000 7f95d004c640 1 --2- 172.21.15.60:0/2860374411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95c80c8b10 0x7f95c8145990 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:32.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.578+0000 7f95d004c640 1 -- 172.21.15.60:0/2860374411 >> 172.21.15.60:0/2860374411 conn(0x7f95c80adb80 msgr2=0x7f95c814c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:32.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.578+0000 7f95d004c640 1 -- 172.21.15.60:0/2860374411 shutdown_connections 2024-09-12T02:30:32.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.578+0000 7f95d004c640 1 -- 172.21.15.60:0/2860374411 wait complete. 2024-09-12T02:30:32.590 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-12T02:30:32.590 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-12T02:30:32.590 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-12T02:30:32.590 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-12T02:30:32.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.705+0000 7fb920b31640 1 Processor -- start 2024-09-12T02:30:32.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.705+0000 7fb920b31640 1 -- start start 2024-09-12T02:30:32.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.706+0000 7fb920b31640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb91c153910 0x7fb91c0c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:32.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.706+0000 7fb920b31640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb91c0c5940 con 0x7fb91c0c69c0 2024-09-12T02:30:32.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.706+0000 7fb920b31640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb91c0c5c00 con 0x7fb91c1505f0 2024-09-12T02:30:32.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.706+0000 7fb920b31640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb91c0c7860 con 0x7fb91c153910 2024-09-12T02:30:32.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.706+0000 7fb919d9b640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb91c0c69c0 0x7fb91c0c42b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:57208/0 (socket says 172.21.15.60:57208) 2024-09-12T02:30:32.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.706+0000 7fb919d9b640 1 -- 172.21.15.60:0/901043310 learned_addr learned my addr 172.21.15.60:0/901043310 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:30:32.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.706+0000 7fb91ad9d640 1 --2- 172.21.15.60:0/901043310 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb91c153910 0x7fb91c0c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:32.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.707+0000 7fb91959a640 1 -- 172.21.15.60:0/901043310 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3460384975 0 0) 0x7fb91c0c5940 con 0x7fb91c0c69c0 2024-09-12T02:30:32.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.707+0000 7fb91959a640 1 -- 172.21.15.60:0/901043310 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb904003520 con 0x7fb91c0c69c0 2024-09-12T02:30:32.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.707+0000 7fb91959a640 1 -- 172.21.15.60:0/901043310 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 756869487 0 0) 0x7fb91c0c5c00 con 0x7fb91c1505f0 2024-09-12T02:30:32.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.707+0000 7fb91959a640 1 -- 172.21.15.60:0/901043310 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb91c0c5940 con 0x7fb91c1505f0 2024-09-12T02:30:32.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.707+0000 7fb91ad9d640 1 -- 172.21.15.60:0/901043310 >> v1:172.21.15.105:6789/0 conn(0x7fb91c1505f0 legacy=0x7fb91c0c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:32.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.707+0000 7fb91ad9d640 1 -- 172.21.15.60:0/901043310 >> v1:172.21.15.60:6789/0 conn(0x7fb91c0c69c0 legacy=0x7fb91c0c42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:32.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.707+0000 7fb91ad9d640 1 -- 172.21.15.60:0/901043310 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb91c0c5ee0 con 0x7fb91c153910 2024-09-12T02:30:32.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.708+0000 7fb91ad9d640 1 --2- 172.21.15.60:0/901043310 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb91c153910 0x7fb91c0c49c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb914009dc0 tx=0x7fb91402a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=849b5423d0f6d053 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:32.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.708+0000 7fb91959a640 1 -- 172.21.15.60:0/901043310 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91402ae60 con 0x7fb91c153910 2024-09-12T02:30:32.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.708+0000 7fb91959a640 1 -- 172.21.15.60:0/901043310 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb914007740 con 0x7fb91c153910 2024-09-12T02:30:32.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.708+0000 7fb91959a640 1 -- 172.21.15.60:0/901043310 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb914007b10 con 0x7fb91c153910 2024-09-12T02:30:32.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.708+0000 7fb920b31640 1 -- 172.21.15.60:0/901043310 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb91c153910 msgr2=0x7fb91c0c49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:32.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.708+0000 7fb920b31640 1 --2- 172.21.15.60:0/901043310 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb91c153910 0x7fb91c0c49c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb914009dc0 tx=0x7fb91402a640 comp rx=0 tx=0).stop 2024-09-12T02:30:32.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.709+0000 7fb920b31640 1 -- 172.21.15.60:0/901043310 shutdown_connections 2024-09-12T02:30:32.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.709+0000 7fb920b31640 1 --2- 172.21.15.60:0/901043310 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb91c153910 0x7fb91c0c49c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:32.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.709+0000 7fb920b31640 1 -- 172.21.15.60:0/901043310 >> 172.21.15.60:0/901043310 conn(0x7fb91c0c7a40 msgr2=0x7fb91c0c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:32.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.709+0000 7fb920b31640 1 -- 172.21.15.60:0/901043310 shutdown_connections 2024-09-12T02:30:32.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.709+0000 7fb920b31640 1 -- 172.21.15.60:0/901043310 wait complete. 2024-09-12T02:30:32.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.710+0000 7fb920b31640 1 Processor -- start 2024-09-12T02:30:32.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.710+0000 7fb920b31640 1 -- start start 2024-09-12T02:30:32.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.711+0000 7fb920b31640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb91c1505f0 0x7fb91c0a7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:32.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.711+0000 7fb920b31640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb91c153910 0x7fb91c145780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:32.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.711+0000 7fb920b31640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb91c0a7fb0 0x7fb91c145cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:32.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.711+0000 7fb920b31640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb91c153d30 con 0x7fb91c1505f0 2024-09-12T02:30:32.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.711+0000 7fb920b31640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb91c0c64a0 con 0x7fb91c153910 2024-09-12T02:30:32.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.711+0000 7fb920b31640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb91c1509d0 con 0x7fb91c0a7fb0 2024-09-12T02:30:32.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.711+0000 7fb91a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb91c1505f0 0x7fb91c0a7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:32.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.712+0000 7fb91a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb91c1505f0 0x7fb91c0a7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54540/0 (socket says 172.21.15.60:54540) 2024-09-12T02:30:32.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.712+0000 7fb91a59c640 1 -- 172.21.15.60:0/2641725662 learned_addr learned my addr 172.21.15.60:0/2641725662 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:30:32.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.712+0000 7fb919d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb91c153910 0x7fb91c145780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:32.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.712+0000 7fb91ad9d640 1 --2- 172.21.15.60:0/2641725662 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb91c0a7fb0 0x7fb91c145cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:32.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.712+0000 7fb91a59c640 1 -- 172.21.15.60:0/2641725662 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb91c0a7fb0 msgr2=0x7fb91c145cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:32.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.712+0000 7fb91a59c640 1 --2- 172.21.15.60:0/2641725662 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb91c0a7fb0 0x7fb91c145cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:32.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.712+0000 7fb91a59c640 1 -- 172.21.15.60:0/2641725662 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb91c153910 msgr2=0x7fb91c145780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:32.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.712+0000 7fb91a59c640 1 --2- 172.21.15.60:0/2641725662 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb91c153910 0x7fb91c145780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:32.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.712+0000 7fb91a59c640 1 -- 172.21.15.60:0/2641725662 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb91c148ad0 con 0x7fb91c1505f0 2024-09-12T02:30:32.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.712+0000 7fb91a59c640 1 --2- 172.21.15.60:0/2641725662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb91c1505f0 0x7fb91c0a7a70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb90c00c4c0 tx=0x7fb90c00c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:32.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.712+0000 7fb90affd640 1 -- 172.21.15.60:0/2641725662 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90c0052d0 con 0x7fb91c1505f0 2024-09-12T02:30:32.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.712+0000 7fb90affd640 1 -- 172.21.15.60:0/2641725662 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb90c005470 con 0x7fb91c1505f0 2024-09-12T02:30:32.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.712+0000 7fb920b31640 1 -- 172.21.15.60:0/2641725662 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb91c1ea6b0 con 0x7fb91c1505f0 2024-09-12T02:30:32.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.712+0000 7fb90affd640 1 -- 172.21.15.60:0/2641725662 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90c012870 con 0x7fb91c1505f0 2024-09-12T02:30:32.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.712+0000 7fb920b31640 1 -- 172.21.15.60:0/2641725662 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb91c0a7540 con 0x7fb91c1505f0 2024-09-12T02:30:32.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.713+0000 7fb920b31640 1 --2- 172.21.15.60:0/2641725662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb91c0c69c0 0x7fb91c147380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:32.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.713+0000 7fb920b31640 1 -- 172.21.15.60:0/2641725662 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb91c148880 con 0x7fb91c0c69c0 2024-09-12T02:30:32.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.713+0000 7fb919d9b640 1 --2- 172.21.15.60:0/2641725662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb91c0c69c0 0x7fb91c147380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:32.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.714+0000 7fb919d9b640 1 -- 172.21.15.60:0/2641725662 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb91c0c2440 con 0x7fb91c0c69c0 2024-09-12T02:30:32.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.714+0000 7fb919d9b640 1 --2- 172.21.15.60:0/2641725662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb91c0c69c0 0x7fb91c147380 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb91c152e60 tx=0x7fb9100019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:32.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.714+0000 7fb90affd640 1 -- 172.21.15.60:0/2641725662 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb90c012a10 con 0x7fb91c1505f0 2024-09-12T02:30:32.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.714+0000 7fb90affd640 1 --2- 172.21.15.60:0/2641725662 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb8fc06be60 0x7fb8fc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:32.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.715+0000 7fb90affd640 1 -- 172.21.15.60:0/2641725662 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fb90c08acb0 con 0x7fb91c1505f0 2024-09-12T02:30:32.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.715+0000 7fb91ad9d640 1 --2- 172.21.15.60:0/2641725662 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb8fc06be60 0x7fb8fc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:32.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.715+0000 7fb90affd640 1 -- 172.21.15.60:0/2641725662 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb910017020 con 0x7fb91c0c69c0 2024-09-12T02:30:32.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.715+0000 7fb90affd640 1 -- 172.21.15.60:0/2641725662 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fb910013600 con 0x7fb91c0c69c0 2024-09-12T02:30:32.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.715+0000 7fb90affd640 1 -- 172.21.15.60:0/2641725662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb91c0c69c0 msgr2=0x7fb91c147380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:32.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.715+0000 7fb90affd640 1 --2- 172.21.15.60:0/2641725662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb91c0c69c0 0x7fb91c147380 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb91c152e60 tx=0x7fb9100019b0 comp rx=0 tx=0).stop 2024-09-12T02:30:32.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.715+0000 7fb90affd640 1 -- 172.21.15.60:0/2641725662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb91c0c69c0 msgr2=0x7fb91c147380 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:30:32.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.715+0000 7fb90affd640 1 --2- 172.21.15.60:0/2641725662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb91c0c69c0 0x7fb91c147380 secure :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb91c152e60 tx=0x7fb9100019b0 comp rx=0 tx=0).stop 2024-09-12T02:30:32.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.715+0000 7fb91ad9d640 1 --2- 172.21.15.60:0/2641725662 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb8fc06be60 0x7fb8fc06e320 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb914034000 tx=0x7fb91402f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:32.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.725+0000 7fb920b31640 1 --2- 172.21.15.60:0/2641725662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb91c146340 0x7fb91c1478c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:32.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.725+0000 7fb920b31640 1 -- 172.21.15.60:0/2641725662 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb91c0a6c30 con 0x7fb91c146340 2024-09-12T02:30:32.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.725+0000 7fb919d9b640 1 --2- 172.21.15.60:0/2641725662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb91c146340 0x7fb91c1478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:32.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.725+0000 7fb919d9b640 1 -- 172.21.15.60:0/2641725662 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb91c06e6d0 con 0x7fb91c146340 2024-09-12T02:30:32.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.725+0000 7fb919d9b640 1 --2- 172.21.15.60:0/2641725662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb91c146340 0x7fb91c1478c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb91c0c2b60 tx=0x7fb910001150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:32.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.725+0000 7fb90affd640 1 -- 172.21.15.60:0/2641725662 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb910017050 con 0x7fb91c146340 2024-09-12T02:30:32.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.726+0000 7fb90affd640 1 -- 172.21.15.60:0/2641725662 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4885 (secure 0 0 0) 0x7fb910006240 con 0x7fb91c146340 2024-09-12T02:30:32.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.726+0000 7fb90affd640 1 -- 172.21.15.60:0/2641725662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb91c146340 msgr2=0x7fb91c1478c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:32.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.726+0000 7fb90affd640 1 --2- 172.21.15.60:0/2641725662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb91c146340 0x7fb91c1478c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb91c0c2b60 tx=0x7fb910001150 comp rx=0 tx=0).stop 2024-09-12T02:30:32.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.726+0000 7fb90affd640 1 -- 172.21.15.60:0/2641725662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb91c146340 msgr2=0x7fb91c1478c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:30:32.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.726+0000 7fb90affd640 1 --2- 172.21.15.60:0/2641725662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb91c146340 0x7fb91c1478c0 secure :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb91c0c2b60 tx=0x7fb910001150 comp rx=0 tx=0).stop 2024-09-12T02:30:32.728 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:30:32.728 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:30:32.728 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:30:32.728 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:30:32.728 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 70, 2024-09-12T02:30:32.728 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 95829, 2024-09-12T02:30:32.729 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:30:32.729 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:30:32.729 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:30:32.729 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:30:32.729 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:30:32.729 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 15, 2024-09-12T02:30:32.729 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:30:32.729 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:30:32.729 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:30:32.729 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:30:32.729 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:30:32.729 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:30:32.729 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:30:32.730 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:30:32.730 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:30:32.730 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:30:32.730 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:30:32.730 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:30:32.730 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:30:32.730 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:30:32.730 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:30:32.730 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:30:32.730 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:30:32.730 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:30:32.730 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:30:32.730 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:30:32.731 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:30:32.731 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:30:32.731 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:30:32.731 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:30:32.731 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:30:32.731 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:30:32.731 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:30:32.731 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:30:32.731 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:32.731 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:32.731 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:30:32.731 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:30:32.731 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:30:32.731 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:30:32.732 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:30:32.732 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:30:32.732 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:30:32.732 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:30:32.732 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:30:32.732 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:30:32.732 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:30:32.732 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:30:32.732 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:30:32.732 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:30:32.732 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:30:32.733 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:30:32.733 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:30:32.733 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:30:32.733 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:30:32.733 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:30:32.733 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:30:32.733 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:30:32.733 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:30:32.733 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:30:32.733 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:30:32.733 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:30:32.733 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:30:32.733 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:30:32.734 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:30:32.734 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:30:32.734 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:32.734 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:30:32.734 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:32.734 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:30:32.734 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:30:32.734 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:30:32.734 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:30:32.734 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:32.734 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:30:32.735 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:30:32.735 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:32.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:32.735 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:32.735 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:30:32.735 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:30:32.735 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:32.735 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:32.735 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:32.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:32.735 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:30:32.735 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:30:32.736 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:30:32.736 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:30:32.736 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:30:32.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:32.736 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:32.736 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:30:32.736 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:30:32.736 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:30:32.736 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:30:32.736 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:32.736 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:30:32.736 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:30:32.737 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:32.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:32.737 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:32.737 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:30:32.737 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:30:32.737 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:32.737 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:32.737 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:32.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:32.737 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:30:32.737 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:30:32.737 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:30:32.738 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:30:32.738 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:30:32.738 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:32.738 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:32.738 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:30:32.738 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:30:32.738 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:30:32.738 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:30:32.738 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:32.738 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:30:32.738 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:30:32.738 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:32.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:32.739 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:32.739 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:30:32.739 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:30:32.739 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:32.739 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:32.739 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:32.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:32.740 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:30:32.740 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:30:32.740 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:30:32.740 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:30:32.740 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:30:32.740 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:32.740 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:32.740 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:32.740 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:30:32.740 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:30:32.740 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:32.740 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:30:32.741 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:30:32.741 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:30:32.741 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:32.741 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:30:32.741 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:30:32.741 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:32.741 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:30:32.741 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:30:32.741 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:30:32.741 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:32.741 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:30:32.741 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:30:32.741 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:32.742 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:30:32.742 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:30:32.742 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:30:32.742 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:32.742 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:30:32.742 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:30:32.742 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:32.742 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:30:32.742 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:30:32.742 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:30:32.742 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:32.742 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:32.742 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:32.743 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:30:32.743 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:30:32.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.726+0000 7fb920b31640 1 -- 172.21.15.60:0/2641725662 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb8fc06be60 msgr2=0x7fb8fc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:32.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.726+0000 7fb920b31640 1 --2- 172.21.15.60:0/2641725662 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb8fc06be60 0x7fb8fc06e320 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb914034000 tx=0x7fb91402f000 comp rx=0 tx=0).stop 2024-09-12T02:30:32.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.726+0000 7fb920b31640 1 -- 172.21.15.60:0/2641725662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb91c1505f0 msgr2=0x7fb91c0a7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:32.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.726+0000 7fb920b31640 1 --2- 172.21.15.60:0/2641725662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb91c1505f0 0x7fb91c0a7a70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb90c00c4c0 tx=0x7fb90c00c980 comp rx=0 tx=0).stop 2024-09-12T02:30:32.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.726+0000 7fb91ad9d640 1 -- 172.21.15.60:0/2641725662 reap_dead start 2024-09-12T02:30:32.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.726+0000 7fb91ad9d640 1 -- 172.21.15.60:0/2641725662 reap_dead start 2024-09-12T02:30:32.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.726+0000 7fb920b31640 1 -- 172.21.15.60:0/2641725662 shutdown_connections 2024-09-12T02:30:32.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.726+0000 7fb920b31640 1 -- 172.21.15.60:0/2641725662 >> 172.21.15.60:0/2641725662 conn(0x7fb91c0c7a40 msgr2=0x7fb91c0c3590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:32.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.726+0000 7fb920b31640 1 -- 172.21.15.60:0/2641725662 shutdown_connections 2024-09-12T02:30:32.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.726+0000 7fb920b31640 1 -- 172.21.15.60:0/2641725662 wait complete. 2024-09-12T02:30:32.745 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:30:32.745 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-12T02:30:32.745 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-12T02:30:32.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.869+0000 7fddb16d0640 1 Processor -- start 2024-09-12T02:30:32.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.869+0000 7fddb16d0640 1 -- start start 2024-09-12T02:30:32.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.870+0000 7fddb16d0640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fddac154ac0 0x7fddac0708a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:32.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.870+0000 7fddb16d0640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddac154ff0 con 0x7fddac151780 2024-09-12T02:30:32.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.870+0000 7fddb16d0640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddac06f5f0 con 0x7fddac0703b0 2024-09-12T02:30:32.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.870+0000 7fddb16d0640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fddac06f8d0 con 0x7fddac154ac0 2024-09-12T02:30:32.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.870+0000 7fddaa7fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fddac154ac0 0x7fddac0708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:32.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.870+0000 7fddaaffd640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fddac151780 0x7fddac155560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:57222/0 (socket says 172.21.15.60:57222) 2024-09-12T02:30:32.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.870+0000 7fddaa7fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fddac154ac0 0x7fddac0708a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54568/0 (socket says 172.21.15.60:54568) 2024-09-12T02:30:32.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.870+0000 7fddaaffd640 1 -- 172.21.15.60:0/387030937 learned_addr learned my addr 172.21.15.60:0/387030937 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:30:32.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.870+0000 7fddaa7fc640 1 -- 172.21.15.60:0/387030937 >> v1:172.21.15.105:6789/0 conn(0x7fddac0703b0 legacy=0x7fddac15e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:32.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.870+0000 7fdda9ffb640 1 -- 172.21.15.60:0/387030937 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 272357329 0 0) 0x7fddac06f5f0 con 0x7fddac0703b0 2024-09-12T02:30:32.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.871+0000 7fddaa7fc640 1 -- 172.21.15.60:0/387030937 >> v1:172.21.15.60:6789/0 conn(0x7fddac151780 legacy=0x7fddac155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:32.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.871+0000 7fddaa7fc640 1 -- 172.21.15.60:0/387030937 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddac06fbb0 con 0x7fddac154ac0 2024-09-12T02:30:32.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.871+0000 7fddaa7fc640 1 --2- 172.21.15.60:0/387030937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddac154ac0 0x7fddac0708a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdda00097a0 tx=0x7fdda002a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69ef725626bac3c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:32.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.872+0000 7fdda9ffb640 1 -- 172.21.15.60:0/387030937 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda0037070 con 0x7fddac154ac0 2024-09-12T02:30:32.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.872+0000 7fdda9ffb640 1 -- 172.21.15.60:0/387030937 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdda002ac90 con 0x7fddac154ac0 2024-09-12T02:30:32.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.872+0000 7fdda9ffb640 1 -- 172.21.15.60:0/387030937 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda0032660 con 0x7fddac154ac0 2024-09-12T02:30:32.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.872+0000 7fddb16d0640 1 -- 172.21.15.60:0/387030937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddac154ac0 msgr2=0x7fddac0708a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:32.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.872+0000 7fddb16d0640 1 --2- 172.21.15.60:0/387030937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddac154ac0 0x7fddac0708a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdda00097a0 tx=0x7fdda002a000 comp rx=0 tx=0).stop 2024-09-12T02:30:32.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.872+0000 7fddb16d0640 1 -- 172.21.15.60:0/387030937 shutdown_connections 2024-09-12T02:30:32.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.872+0000 7fddb16d0640 1 --2- 172.21.15.60:0/387030937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddac154ac0 0x7fddac0708a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:32.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.872+0000 7fddb16d0640 1 -- 172.21.15.60:0/387030937 >> 172.21.15.60:0/387030937 conn(0x7fddac0c6980 msgr2=0x7fddac0c6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:32.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.872+0000 7fddb16d0640 1 -- 172.21.15.60:0/387030937 shutdown_connections 2024-09-12T02:30:32.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.872+0000 7fddb16d0640 1 -- 172.21.15.60:0/387030937 wait complete. 2024-09-12T02:30:32.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.874+0000 7fddb16d0640 1 Processor -- start 2024-09-12T02:30:32.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.874+0000 7fddb16d0640 1 -- start start 2024-09-12T02:30:32.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.874+0000 7fddb16d0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddac0703b0 0x7fddac14cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:32.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.874+0000 7fddb16d0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddac151780 0x7fddac14ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:32.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.874+0000 7fddb16d0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fddac154ac0 0x7fddac0c3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:32.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.874+0000 7fddb16d0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fddac155c70 con 0x7fddac151780 2024-09-12T02:30:32.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.874+0000 7fddb16d0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fddac073f30 con 0x7fddac0703b0 2024-09-12T02:30:32.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.874+0000 7fddb16d0640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fddac153dc0 con 0x7fddac154ac0 2024-09-12T02:30:32.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.875+0000 7fddaa7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddac151780 0x7fddac14ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:32.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.875+0000 7fddaa7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddac151780 0x7fddac14ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54570/0 (socket says 172.21.15.60:54570) 2024-09-12T02:30:32.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.875+0000 7fddaa7fc640 1 -- 172.21.15.60:0/3306420578 learned_addr learned my addr 172.21.15.60:0/3306420578 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:30:32.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.875+0000 7fddaaffd640 1 --2- 172.21.15.60:0/3306420578 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddac0703b0 0x7fddac14cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:32.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.875+0000 7fddab7fe640 1 --2- 172.21.15.60:0/3306420578 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fddac154ac0 0x7fddac0c3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:32.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.875+0000 7fddaa7fc640 1 -- 172.21.15.60:0/3306420578 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fddac154ac0 msgr2=0x7fddac0c3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:32.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.875+0000 7fddaa7fc640 1 --2- 172.21.15.60:0/3306420578 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fddac154ac0 0x7fddac0c3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:32.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.875+0000 7fddaa7fc640 1 -- 172.21.15.60:0/3306420578 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddac0703b0 msgr2=0x7fddac14cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:32.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.875+0000 7fddaa7fc640 1 --2- 172.21.15.60:0/3306420578 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddac0703b0 0x7fddac14cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:32.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.875+0000 7fddaa7fc640 1 -- 172.21.15.60:0/3306420578 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddac14d460 con 0x7fddac151780 2024-09-12T02:30:32.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.875+0000 7fddaa7fc640 1 --2- 172.21.15.60:0/3306420578 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddac151780 0x7fddac14ed50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdda0035040 tx=0x7fdda00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:32.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.875+0000 7fdd937fe640 1 -- 172.21.15.60:0/3306420578 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda0037040 con 0x7fddac151780 2024-09-12T02:30:32.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.875+0000 7fdd937fe640 1 -- 172.21.15.60:0/3306420578 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdda0004230 con 0x7fddac151780 2024-09-12T02:30:32.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.875+0000 7fddb16d0640 1 -- 172.21.15.60:0/3306420578 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddac14b950 con 0x7fddac151780 2024-09-12T02:30:32.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.875+0000 7fdd937fe640 1 -- 172.21.15.60:0/3306420578 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda0003610 con 0x7fddac151780 2024-09-12T02:30:32.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.875+0000 7fddb16d0640 1 -- 172.21.15.60:0/3306420578 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddac14bf10 con 0x7fddac151780 2024-09-12T02:30:32.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.876+0000 7fddb16d0640 1 --2- 172.21.15.60:0/3306420578 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddac0c9a80 0x7fddac14c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:32.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.876+0000 7fddb16d0640 1 -- 172.21.15.60:0/3306420578 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fddac155df0 con 0x7fddac0c9a80 2024-09-12T02:30:32.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.876+0000 7fddaaffd640 1 --2- 172.21.15.60:0/3306420578 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddac0c9a80 0x7fddac14c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:32.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.877+0000 7fddaaffd640 1 -- 172.21.15.60:0/3306420578 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fddac0af630 con 0x7fddac0c9a80 2024-09-12T02:30:32.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.877+0000 7fddaaffd640 1 --2- 172.21.15.60:0/3306420578 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddac0c9a80 0x7fddac14c430 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c007840 tx=0x7fdd9c001a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:32.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.877+0000 7fdd937fe640 1 -- 172.21.15.60:0/3306420578 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c00f820 con 0x7fddac0c9a80 2024-09-12T02:30:32.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.877+0000 7fdd937fe640 1 -- 172.21.15.60:0/3306420578 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdda002ab10 con 0x7fddac151780 2024-09-12T02:30:32.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.878+0000 7fdd937fe640 1 --2- 172.21.15.60:0/3306420578 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fdd9806bd30 0x7fdd9806e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:32.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.878+0000 7fddab7fe640 1 --2- 172.21.15.60:0/3306420578 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fdd9806bd30 0x7fdd9806e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:32.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.878+0000 7fdd937fe640 1 -- 172.21.15.60:0/3306420578 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fdda00abf80 con 0x7fddac151780 2024-09-12T02:30:32.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.878+0000 7fdd937fe640 1 -- 172.21.15.60:0/3306420578 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fdd9c018070 con 0x7fddac0c9a80 2024-09-12T02:30:32.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.878+0000 7fdd937fe640 1 -- 172.21.15.60:0/3306420578 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddac0c9a80 msgr2=0x7fddac14c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:32.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.878+0000 7fdd937fe640 1 --2- 172.21.15.60:0/3306420578 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddac0c9a80 0x7fddac14c430 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c007840 tx=0x7fdd9c001a90 comp rx=0 tx=0).stop 2024-09-12T02:30:32.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.878+0000 7fdd937fe640 1 -- 172.21.15.60:0/3306420578 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddac0c9a80 msgr2=0x7fddac14c430 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:30:32.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.878+0000 7fdd937fe640 1 --2- 172.21.15.60:0/3306420578 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddac0c9a80 0x7fddac14c430 secure :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c007840 tx=0x7fdd9c001a90 comp rx=0 tx=0).stop 2024-09-12T02:30:32.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.879+0000 7fddab7fe640 1 --2- 172.21.15.60:0/3306420578 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fdd9806bd30 0x7fdd9806e1f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fddac155ff0 tx=0x7fdda4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:32.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.885+0000 7fddb16d0640 1 --2- 172.21.15.60:0/3306420578 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddac1ef280 0x7fddac1ef690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:32.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.885+0000 7fddb16d0640 1 -- 172.21.15.60:0/3306420578 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fddac14c150 con 0x7fddac1ef280 2024-09-12T02:30:32.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.885+0000 7fddaaffd640 1 --2- 172.21.15.60:0/3306420578 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddac1ef280 0x7fddac1ef690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:32.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.885+0000 7fddaaffd640 1 -- 172.21.15.60:0/3306420578 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fddac073ca0 con 0x7fddac1ef280 2024-09-12T02:30:32.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.885+0000 7fddaaffd640 1 --2- 172.21.15.60:0/3306420578 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddac1ef280 0x7fddac1ef690 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c007840 tx=0x7fdd9c007f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:32.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.886+0000 7fdd937fe640 1 -- 172.21.15.60:0/3306420578 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c01ee60 con 0x7fddac1ef280 2024-09-12T02:30:32.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.886+0000 7fdd937fe640 1 -- 172.21.15.60:0/3306420578 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5051 (secure 0 0 0) 0x7fdd9c013600 con 0x7fddac1ef280 2024-09-12T02:30:32.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.886+0000 7fdd937fe640 1 -- 172.21.15.60:0/3306420578 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddac1ef280 msgr2=0x7fddac1ef690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:32.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.886+0000 7fdd937fe640 1 --2- 172.21.15.60:0/3306420578 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddac1ef280 0x7fddac1ef690 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c007840 tx=0x7fdd9c007f90 comp rx=0 tx=0).stop 2024-09-12T02:30:32.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.886+0000 7fdd937fe640 1 -- 172.21.15.60:0/3306420578 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddac1ef280 msgr2=0x7fddac1ef690 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:30:32.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.886+0000 7fdd937fe640 1 --2- 172.21.15.60:0/3306420578 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddac1ef280 0x7fddac1ef690 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:32.891 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:30:32.891 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:30:32.891 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:30:32.891 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:30:32.891 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 70, 2024-09-12T02:30:32.891 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 378320, 2024-09-12T02:30:32.891 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:30:32.891 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:30:32.891 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:30:32.892 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:30:32.892 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:30:32.892 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 16, 2024-09-12T02:30:32.892 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:30:32.892 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:30:32.892 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:30:32.892 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:30:32.892 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:30:32.892 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:30:32.892 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:30:32.892 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:30:32.892 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:30:32.892 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:30:32.893 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:30:32.893 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:30:32.893 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:30:32.893 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:30:32.893 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:30:32.894 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:30:32.894 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:30:32.894 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:30:32.894 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:30:32.894 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:30:32.895 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:30:32.895 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:30:32.895 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:30:32.895 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:30:32.895 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:30:32.896 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:30:32.896 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:30:32.896 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:30:32.896 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:32.896 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:32.896 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:30:32.897 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:30:32.897 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:30:32.897 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:30:32.897 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:30:32.898 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:30:32.898 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:30:32.898 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:30:32.898 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:30:32.899 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:30:32.899 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:30:32.899 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:30:32.899 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:30:32.899 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:30:32.900 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:30:32.900 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:30:32.900 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:30:32.900 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:30:32.900 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:30:32.901 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:30:32.901 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:30:32.901 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:30:32.901 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:30:32.901 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:30:32.901 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:30:32.902 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:30:32.902 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:30:32.902 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:30:32.902 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:30:32.902 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:30:32.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:32.903 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:30:32.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:32.903 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:30:32.904 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:30:32.904 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:30:32.904 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:30:32.904 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:32.904 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:30:32.905 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:30:32.905 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:32.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:32.906 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:32.906 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:30:32.906 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:30:32.906 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:32.906 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:32.906 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:32.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:32.907 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:30:32.907 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:30:32.907 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:30:32.907 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:30:32.908 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:30:32.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:32.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:32.908 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:30:32.909 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:30:32.909 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:30:32.909 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:30:32.909 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:32.909 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:30:32.910 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:30:32.910 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:32.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:32.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:32.910 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:30:32.910 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:30:32.911 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:32.911 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:32.911 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:32.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:32.911 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:30:32.912 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:30:32.912 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:30:32.912 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:30:32.912 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:30:32.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:32.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:32.913 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:30:32.913 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:30:32.913 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:30:32.914 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:30:32.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:32.914 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:30:32.914 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:30:32.914 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:32.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:32.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:32.915 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:30:32.915 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:30:32.915 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:32.916 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:32.916 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:32.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:32.916 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:30:32.916 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:30:32.916 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:30:32.917 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:30:32.917 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:30:32.917 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:32.917 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:32.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:32.918 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:30:32.918 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:30:32.918 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:32.918 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:30:32.918 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:30:32.918 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:30:32.919 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:32.919 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:30:32.919 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:30:32.919 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:32.919 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:30:32.920 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:30:32.920 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:30:32.920 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:32.920 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:30:32.920 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:30:32.921 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:32.921 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:30:32.921 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:30:32.921 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-09-12T02:30:32.921 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:32.922 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:30:32.922 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:30:32.922 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:32.922 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:30:32.922 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:30:32.923 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-09-12T02:30:32.923 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:32.923 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:30:32.923 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:30:32.923 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:32.923 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:30:32.924 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:30:32.924 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:30:32.924 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:32.924 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:32.924 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:32.924 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:30:32.924 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:30:32.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.886+0000 7fddb16d0640 1 -- 172.21.15.60:0/3306420578 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fdd9806bd30 msgr2=0x7fdd9806e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:32.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.886+0000 7fddb16d0640 1 --2- 172.21.15.60:0/3306420578 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fdd9806bd30 0x7fdd9806e1f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fddac155ff0 tx=0x7fdda4009040 comp rx=0 tx=0).stop 2024-09-12T02:30:32.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.886+0000 7fddb16d0640 1 -- 172.21.15.60:0/3306420578 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddac151780 msgr2=0x7fddac14ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:32.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.886+0000 7fddb16d0640 1 --2- 172.21.15.60:0/3306420578 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddac151780 0x7fddac14ed50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdda0035040 tx=0x7fdda00046c0 comp rx=0 tx=0).stop 2024-09-12T02:30:32.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.886+0000 7fddab7fe640 1 -- 172.21.15.60:0/3306420578 reap_dead start 2024-09-12T02:30:32.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.886+0000 7fddab7fe640 1 -- 172.21.15.60:0/3306420578 reap_dead start 2024-09-12T02:30:32.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.886+0000 7fddb16d0640 1 -- 172.21.15.60:0/3306420578 shutdown_connections 2024-09-12T02:30:32.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.886+0000 7fddb16d0640 1 -- 172.21.15.60:0/3306420578 >> 172.21.15.60:0/3306420578 conn(0x7fddac0c6980 msgr2=0x7fddac156890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:32.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.886+0000 7fddb16d0640 1 -- 172.21.15.60:0/3306420578 shutdown_connections 2024-09-12T02:30:32.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:32.886+0000 7fddb16d0640 1 -- 172.21.15.60:0/3306420578 wait complete. 2024-09-12T02:30:32.927 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:30:32.927 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-12T02:30:32.928 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-12T02:30:33.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.038+0000 7faa28ea5640 1 Processor -- start 2024-09-12T02:30:33.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.038+0000 7faa28ea5640 1 -- start start 2024-09-12T02:30:33.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.039+0000 7faa28ea5640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa240709d0 0x7faa24161c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:33.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.039+0000 7faa28ea5640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa240c4320 con 0x7faa240c5830 2024-09-12T02:30:33.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.039+0000 7faa28ea5640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa24156f20 con 0x7faa24153d60 2024-09-12T02:30:33.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.039+0000 7faa28ea5640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7faa240c4c90 con 0x7faa240709d0 2024-09-12T02:30:33.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.039+0000 7faa21d9b640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7faa240c5830 0x7faa240702c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:57234/0 (socket says 172.21.15.60:57234) 2024-09-12T02:30:33.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.039+0000 7faa21d9b640 1 -- 172.21.15.60:0/197334885 learned_addr learned my addr 172.21.15.60:0/197334885 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:30:33.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.039+0000 7faa22d9d640 1 --2- 172.21.15.60:0/197334885 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa240709d0 0x7faa24161c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:33.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.039+0000 7faa2159a640 1 -- 172.21.15.60:0/197334885 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2062576025 0 0) 0x7faa18001110 con 0x7faa240c5830 2024-09-12T02:30:33.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.040+0000 7faa2159a640 1 -- 172.21.15.60:0/197334885 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa0c003520 con 0x7faa240c5830 2024-09-12T02:30:33.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.040+0000 7faa2159a640 1 -- 172.21.15.60:0/197334885 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3530750512 0 0) 0x7faa24156f20 con 0x7faa24153d60 2024-09-12T02:30:33.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.040+0000 7faa2159a640 1 -- 172.21.15.60:0/197334885 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa18001110 con 0x7faa24153d60 2024-09-12T02:30:33.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.040+0000 7faa22d9d640 1 -- 172.21.15.60:0/197334885 >> v1:172.21.15.105:6789/0 conn(0x7faa24153d60 legacy=0x7faa240c5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:33.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.040+0000 7faa22d9d640 1 -- 172.21.15.60:0/197334885 >> v1:172.21.15.60:6789/0 conn(0x7faa240c5830 legacy=0x7faa240702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:33.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.040+0000 7faa22d9d640 1 -- 172.21.15.60:0/197334885 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa24157200 con 0x7faa240709d0 2024-09-12T02:30:33.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.041+0000 7faa22d9d640 1 --2- 172.21.15.60:0/197334885 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa240709d0 0x7faa24161c90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7faa1c009dc0 tx=0x7faa1c02a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d295df29909e767 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:33.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.041+0000 7faa2159a640 1 -- 172.21.15.60:0/197334885 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1c007740 con 0x7faa240709d0 2024-09-12T02:30:33.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.041+0000 7faa2159a640 1 -- 172.21.15.60:0/197334885 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa1c0078e0 con 0x7faa240709d0 2024-09-12T02:30:33.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.041+0000 7faa2159a640 1 -- 172.21.15.60:0/197334885 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1c007cb0 con 0x7faa240709d0 2024-09-12T02:30:33.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.041+0000 7faa28ea5640 1 -- 172.21.15.60:0/197334885 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa240709d0 msgr2=0x7faa24161c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:33.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.042+0000 7faa28ea5640 1 --2- 172.21.15.60:0/197334885 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa240709d0 0x7faa24161c90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7faa1c009dc0 tx=0x7faa1c02a6d0 comp rx=0 tx=0).stop 2024-09-12T02:30:33.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.042+0000 7faa28ea5640 1 -- 172.21.15.60:0/197334885 shutdown_connections 2024-09-12T02:30:33.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.042+0000 7faa28ea5640 1 --2- 172.21.15.60:0/197334885 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa240709d0 0x7faa24161c90 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:33.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.042+0000 7faa28ea5640 1 -- 172.21.15.60:0/197334885 >> 172.21.15.60:0/197334885 conn(0x7faa240c6980 msgr2=0x7faa240c6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:33.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.042+0000 7faa28ea5640 1 -- 172.21.15.60:0/197334885 shutdown_connections 2024-09-12T02:30:33.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.042+0000 7faa28ea5640 1 -- 172.21.15.60:0/197334885 wait complete. 2024-09-12T02:30:33.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.043+0000 7faa28ea5640 1 Processor -- start 2024-09-12T02:30:33.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.043+0000 7faa28ea5640 1 -- start start 2024-09-12T02:30:33.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.044+0000 7faa28ea5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa240709d0 0x7faa241ec5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:33.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.044+0000 7faa28ea5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa240c5830 0x7faa240bf110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:33.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.044+0000 7faa28ea5640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa24153d60 0x7faa2415a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:33.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.044+0000 7faa28ea5640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7faa24073e20 con 0x7faa240709d0 2024-09-12T02:30:33.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.044+0000 7faa28ea5640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7faa24073ca0 con 0x7faa240c5830 2024-09-12T02:30:33.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.044+0000 7faa28ea5640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7faa240c7690 con 0x7faa24153d60 2024-09-12T02:30:33.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.044+0000 7faa2259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa240709d0 0x7faa241ec5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:33.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.044+0000 7faa21d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa240c5830 0x7faa240bf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:33.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.044+0000 7faa2259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa240709d0 0x7faa241ec5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54576/0 (socket says 172.21.15.60:54576) 2024-09-12T02:30:33.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.044+0000 7faa2259c640 1 -- 172.21.15.60:0/708443453 learned_addr learned my addr 172.21.15.60:0/708443453 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:30:33.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.044+0000 7faa22d9d640 1 --2- 172.21.15.60:0/708443453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa24153d60 0x7faa2415a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:33.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.044+0000 7faa2259c640 1 -- 172.21.15.60:0/708443453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa24153d60 msgr2=0x7faa2415a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:33.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.044+0000 7faa2259c640 1 --2- 172.21.15.60:0/708443453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa24153d60 0x7faa2415a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:33.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.044+0000 7faa2259c640 1 -- 172.21.15.60:0/708443453 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa240c5830 msgr2=0x7faa240bf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:33.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.044+0000 7faa2259c640 1 --2- 172.21.15.60:0/708443453 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa240c5830 0x7faa240bf110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:33.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.044+0000 7faa2259c640 1 -- 172.21.15.60:0/708443453 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa241ecb00 con 0x7faa240709d0 2024-09-12T02:30:33.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.044+0000 7faa21d9b640 1 --2- 172.21.15.60:0/708443453 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa240c5830 0x7faa240bf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:30:33.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.045+0000 7faa2259c640 1 --2- 172.21.15.60:0/708443453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa240709d0 0x7faa241ec5c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7faa1400c460 tx=0x7faa1400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:33.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.045+0000 7faa12ffd640 1 -- 172.21.15.60:0/708443453 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa140052d0 con 0x7faa240709d0 2024-09-12T02:30:33.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.045+0000 7faa12ffd640 1 -- 172.21.15.60:0/708443453 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa14005490 con 0x7faa240709d0 2024-09-12T02:30:33.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.045+0000 7faa28ea5640 1 -- 172.21.15.60:0/708443453 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa24158860 con 0x7faa240709d0 2024-09-12T02:30:33.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.045+0000 7faa12ffd640 1 -- 172.21.15.60:0/708443453 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa14012870 con 0x7faa240709d0 2024-09-12T02:30:33.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.045+0000 7faa28ea5640 1 -- 172.21.15.60:0/708443453 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa241598e0 con 0x7faa240709d0 2024-09-12T02:30:33.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.046+0000 7faa28ea5640 1 --2- 172.21.15.60:0/708443453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa240c0470 0x7faa2415a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:33.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.046+0000 7faa28ea5640 1 -- 172.21.15.60:0/708443453 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7faa240c5c70 con 0x7faa240c0470 2024-09-12T02:30:33.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.046+0000 7faa21d9b640 1 --2- 172.21.15.60:0/708443453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa240c0470 0x7faa2415a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:33.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.046+0000 7faa21d9b640 1 -- 172.21.15.60:0/708443453 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faa2406ed10 con 0x7faa240c0470 2024-09-12T02:30:33.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.046+0000 7faa21d9b640 1 --2- 172.21.15.60:0/708443453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa240c0470 0x7faa2415a620 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7faa240c9d00 tx=0x7faa18007840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:33.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.047+0000 7faa12ffd640 1 -- 172.21.15.60:0/708443453 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa18017020 con 0x7faa240c0470 2024-09-12T02:30:33.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.047+0000 7faa12ffd640 1 -- 172.21.15.60:0/708443453 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faa14012a10 con 0x7faa240709d0 2024-09-12T02:30:33.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.047+0000 7faa12ffd640 1 --2- 172.21.15.60:0/708443453 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7faa0406bd60 0x7faa0406e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:33.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.048+0000 7faa12ffd640 1 -- 172.21.15.60:0/708443453 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7faa1408abe0 con 0x7faa240709d0 2024-09-12T02:30:33.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.048+0000 7faa22d9d640 1 --2- 172.21.15.60:0/708443453 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7faa0406bd60 0x7faa0406e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:33.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.048+0000 7faa12ffd640 1 -- 172.21.15.60:0/708443453 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7faa1800fb90 con 0x7faa240c0470 2024-09-12T02:30:33.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.048+0000 7faa12ffd640 1 -- 172.21.15.60:0/708443453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa240c0470 msgr2=0x7faa2415a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:33.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.048+0000 7faa12ffd640 1 --2- 172.21.15.60:0/708443453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa240c0470 0x7faa2415a620 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7faa240c9d00 tx=0x7faa18007840 comp rx=0 tx=0).stop 2024-09-12T02:30:33.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.048+0000 7faa12ffd640 1 -- 172.21.15.60:0/708443453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa240c0470 msgr2=0x7faa2415a620 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:30:33.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.048+0000 7faa12ffd640 1 --2- 172.21.15.60:0/708443453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa240c0470 0x7faa2415a620 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7faa240c9d00 tx=0x7faa18007840 comp rx=0 tx=0).stop 2024-09-12T02:30:33.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.048+0000 7faa22d9d640 1 --2- 172.21.15.60:0/708443453 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7faa0406bd60 0x7faa0406e220 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7faa1c034000 tx=0x7faa1c02f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:33.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.054+0000 7faa28ea5640 1 --2- 172.21.15.60:0/708443453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa24159b20 0x7faa2414c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:33.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.054+0000 7faa28ea5640 1 -- 172.21.15.60:0/708443453 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7faa240c6370 con 0x7faa24159b20 2024-09-12T02:30:33.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.054+0000 7faa21d9b640 1 --2- 172.21.15.60:0/708443453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa24159b20 0x7faa2414c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:33.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.055+0000 7faa21d9b640 1 -- 172.21.15.60:0/708443453 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7faa24158d80 con 0x7faa24159b20 2024-09-12T02:30:33.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.055+0000 7faa21d9b640 1 --2- 172.21.15.60:0/708443453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa24159b20 0x7faa2414c6c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7faa240c6340 tx=0x7faa18001320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:33.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.055+0000 7faa12ffd640 1 -- 172.21.15.60:0/708443453 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa18006110 con 0x7faa24159b20 2024-09-12T02:30:33.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.055+0000 7faa12ffd640 1 -- 172.21.15.60:0/708443453 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4549 (secure 0 0 0) 0x7faa18006110 con 0x7faa24159b20 2024-09-12T02:30:33.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.055+0000 7faa12ffd640 1 -- 172.21.15.60:0/708443453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa24159b20 msgr2=0x7faa2414c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:33.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.055+0000 7faa12ffd640 1 --2- 172.21.15.60:0/708443453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa24159b20 0x7faa2414c6c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7faa240c6340 tx=0x7faa18001320 comp rx=0 tx=0).stop 2024-09-12T02:30:33.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.055+0000 7faa12ffd640 1 -- 172.21.15.60:0/708443453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa24159b20 msgr2=0x7faa2414c6c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:30:33.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.055+0000 7faa12ffd640 1 --2- 172.21.15.60:0/708443453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa24159b20 0x7faa2414c6c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:33.057 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:30:33.057 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:30:33.057 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:30:33.057 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:30:33.057 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 70, 2024-09-12T02:30:33.057 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 21996, 2024-09-12T02:30:33.057 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:30:33.057 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:30:33.057 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:30:33.058 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:30:33.058 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:30:33.058 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 16, 2024-09-12T02:30:33.058 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:30:33.058 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:30:33.058 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:30:33.058 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:30:33.058 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:30:33.058 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:30:33.058 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:30:33.058 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:30:33.058 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:30:33.058 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:30:33.058 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:30:33.059 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:30:33.059 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:30:33.059 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:30:33.059 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:30:33.059 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:30:33.059 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:30:33.059 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:30:33.059 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:30:33.059 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:30:33.059 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:30:33.059 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:30:33.059 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:30:33.059 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:30:33.060 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:30:33.060 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:30:33.060 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:30:33.060 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:30:33.060 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:33.060 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:33.060 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:30:33.060 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:30:33.060 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:30:33.060 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:30:33.060 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:30:33.060 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:30:33.060 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:30:33.060 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:30:33.061 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:30:33.061 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:30:33.061 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:30:33.061 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:30:33.061 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:30:33.061 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:30:33.061 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:30:33.061 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:30:33.061 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:30:33.061 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:30:33.061 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:30:33.061 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:30:33.061 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:30:33.062 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:30:33.062 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:30:33.062 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:30:33.062 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:30:33.062 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:30:33.062 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:30:33.062 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:30:33.062 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:30:33.062 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:30:33.062 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:33.062 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:30:33.062 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:33.063 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:30:33.063 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:30:33.063 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:30:33.063 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:30:33.063 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:33.063 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:30:33.063 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:30:33.063 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:33.063 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:33.063 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:33.063 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:30:33.063 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:30:33.063 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:33.063 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:33.064 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:33.064 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:33.064 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:30:33.064 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:30:33.064 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:30:33.064 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:30:33.064 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:30:33.064 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:33.064 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:33.064 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:30:33.064 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:30:33.064 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:30:33.064 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:30:33.065 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:33.065 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:30:33.065 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:30:33.065 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:33.065 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:33.065 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:33.065 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:30:33.065 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:30:33.065 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:33.065 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:33.065 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:33.065 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:33.065 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:30:33.065 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:30:33.066 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:30:33.066 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:30:33.066 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:30:33.066 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:33.066 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:33.066 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:30:33.066 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:30:33.066 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:30:33.066 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:30:33.066 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:33.066 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:30:33.066 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:30:33.066 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:33.067 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:33.067 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:33.067 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:30:33.067 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:30:33.067 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:33.067 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:33.067 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:33.067 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:33.067 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:30:33.067 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:30:33.067 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:30:33.067 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:30:33.067 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:30:33.068 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:33.068 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:33.068 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:33.068 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:30:33.068 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:30:33.068 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:33.068 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:30:33.068 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:30:33.068 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:30:33.068 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:33.068 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:30:33.068 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:30:33.068 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:33.069 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:30:33.069 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:30:33.069 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:30:33.069 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:33.069 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:33.069 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:33.069 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:30:33.069 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:30:33.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.056+0000 7faa28ea5640 1 -- 172.21.15.60:0/708443453 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7faa0406bd60 msgr2=0x7faa0406e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:33.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.056+0000 7faa28ea5640 1 --2- 172.21.15.60:0/708443453 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7faa0406bd60 0x7faa0406e220 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7faa1c034000 tx=0x7faa1c02f000 comp rx=0 tx=0).stop 2024-09-12T02:30:33.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.056+0000 7faa28ea5640 1 -- 172.21.15.60:0/708443453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa240709d0 msgr2=0x7faa241ec5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:33.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.056+0000 7faa28ea5640 1 --2- 172.21.15.60:0/708443453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa240709d0 0x7faa241ec5c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7faa1400c460 tx=0x7faa1400c920 comp rx=0 tx=0).stop 2024-09-12T02:30:33.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.056+0000 7faa22d9d640 1 -- 172.21.15.60:0/708443453 reap_dead start 2024-09-12T02:30:33.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.056+0000 7faa22d9d640 1 -- 172.21.15.60:0/708443453 reap_dead start 2024-09-12T02:30:33.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.056+0000 7faa28ea5640 1 -- 172.21.15.60:0/708443453 shutdown_connections 2024-09-12T02:30:33.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.056+0000 7faa28ea5640 1 -- 172.21.15.60:0/708443453 >> 172.21.15.60:0/708443453 conn(0x7faa240c6980 msgr2=0x7faa24151580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:33.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.056+0000 7faa28ea5640 1 -- 172.21.15.60:0/708443453 shutdown_connections 2024-09-12T02:30:33.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.056+0000 7faa28ea5640 1 -- 172.21.15.60:0/708443453 wait complete. 2024-09-12T02:30:33.071 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:30:33.072 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-09-12T02:30:33.072 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-12T02:30:33.072 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-09-12T02:30:33.072 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-09-12T02:30:33.072 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T02:30:33.072 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:30:33.083 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T02:30:33.083 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-12T02:30:33.083 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:30:33.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.194+0000 7fd91d20a640 1 Processor -- start 2024-09-12T02:30:33.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.194+0000 7fd91d20a640 1 -- start start 2024-09-12T02:30:33.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.195+0000 7fd91d20a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9181507b0 0x7fd91806f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:33.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.195+0000 7fd91d20a640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd918150b90 con 0x7fd9180745c0 2024-09-12T02:30:33.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.195+0000 7fd91d20a640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9180c4b20 con 0x7fd9180c4690 2024-09-12T02:30:33.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.195+0000 7fd91d20a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd9181539a0 con 0x7fd9181507b0 2024-09-12T02:30:33.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.195+0000 7fd916d9d640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9181507b0 msgr2=0x7fd91806f480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:30:33.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.195+0000 7fd916d9d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9181507b0 0x7fd91806f480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:30:33.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.195+0000 7fd91759e640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fd9180745c0 0x7fd91815d8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:57244/0 (socket says 172.21.15.60:57244) 2024-09-12T02:30:33.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.195+0000 7fd91759e640 1 -- 172.21.15.60:0/2639433116 learned_addr learned my addr 172.21.15.60:0/2639433116 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:30:33.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.195+0000 7fd915d9b640 1 -- 172.21.15.60:0/2639433116 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4087748534 0 0) 0x7fd918150b90 con 0x7fd9180745c0 2024-09-12T02:30:33.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.195+0000 7fd915d9b640 1 -- 172.21.15.60:0/2639433116 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd900003520 con 0x7fd9180745c0 2024-09-12T02:30:33.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.195+0000 7fd915d9b640 1 -- 172.21.15.60:0/2639433116 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4075057953 0 0) 0x7fd9180c4b20 con 0x7fd9180c4690 2024-09-12T02:30:33.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.195+0000 7fd915d9b640 1 -- 172.21.15.60:0/2639433116 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd918150b90 con 0x7fd9180c4690 2024-09-12T02:30:33.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.196+0000 7fd915d9b640 1 -- 172.21.15.60:0/2639433116 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 120285028 0 0) 0x7fd900003520 con 0x7fd9180745c0 2024-09-12T02:30:33.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.196+0000 7fd915d9b640 1 -- 172.21.15.60:0/2639433116 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9181507b0 msgr2=0x7fd91806f480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:30:33.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.196+0000 7fd915d9b640 1 --2- 172.21.15.60:0/2639433116 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9181507b0 0x7fd91806f480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:33.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.196+0000 7fd915d9b640 1 -- 172.21.15.60:0/2639433116 >> v1:172.21.15.105:6789/0 conn(0x7fd9180c4690 legacy=0x7fd9180c2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:33.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.196+0000 7fd915d9b640 1 -- 172.21.15.60:0/2639433116 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd918153070 con 0x7fd9180745c0 2024-09-12T02:30:33.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.196+0000 7fd915d9b640 1 -- 172.21.15.60:0/2639433116 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7fd910001a10 con 0x7fd9180745c0 2024-09-12T02:30:33.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.196+0000 7fd915d9b640 1 -- 172.21.15.60:0/2639433116 >> v1:172.21.15.60:6789/0 conn(0x7fd9180745c0 legacy=0x7fd91815d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:33.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.196+0000 7fd915d9b640 1 --2- 172.21.15.60:0/2639433116 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd900003b70 0x7fd900003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:33.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.196+0000 7fd915d9b640 1 --2- 172.21.15.60:0/2639433116 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd900004800 0x7fd900004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:33.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.196+0000 7fd915d9b640 1 --2- 172.21.15.60:0/2639433116 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9181507b0 0x7fd90000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:33.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.196+0000 7fd915d9b640 1 -- 172.21.15.60:0/2639433116 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd9181539a0 con 0x7fd900003b70 2024-09-12T02:30:33.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.196+0000 7fd915d9b640 1 -- 172.21.15.60:0/2639433116 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd900005540 con 0x7fd900004800 2024-09-12T02:30:33.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.196+0000 7fd915d9b640 1 -- 172.21.15.60:0/2639433116 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd90000bf00 con 0x7fd9181507b0 2024-09-12T02:30:33.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.196+0000 7fd91759e640 1 -- 172.21.15.60:0/2639433116 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9181507b0 msgr2=0x7fd90000b9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:30:33.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.196+0000 7fd916d9d640 1 --2- 172.21.15.60:0/2639433116 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd900003b70 0x7fd900003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:33.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.196+0000 7fd91759e640 1 --2- 172.21.15.60:0/2639433116 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9181507b0 0x7fd90000b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:30:33.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.196+0000 7fd91659c640 1 --2- 172.21.15.60:0/2639433116 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd900004800 0x7fd900004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:33.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.196+0000 7fd916d9d640 1 -- 172.21.15.60:0/2639433116 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9181507b0 msgr2=0x7fd90000b9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:30:33.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.196+0000 7fd916d9d640 1 --2- 172.21.15.60:0/2639433116 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9181507b0 0x7fd90000b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:33.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.196+0000 7fd916d9d640 1 -- 172.21.15.60:0/2639433116 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd900004800 msgr2=0x7fd900004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:33.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.196+0000 7fd916d9d640 1 --2- 172.21.15.60:0/2639433116 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd900004800 0x7fd900004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:33.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.196+0000 7fd916d9d640 1 -- 172.21.15.60:0/2639433116 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd900003520 con 0x7fd900003b70 2024-09-12T02:30:33.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.197+0000 7fd916d9d640 1 --2- 172.21.15.60:0/2639433116 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd900003b70 0x7fd900003f70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd908009900 tx=0x7fd900005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b0439ddb8d71a9a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:33.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.197+0000 7fd915d9b640 1 -- 172.21.15.60:0/2639433116 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd908009500 con 0x7fd900003b70 2024-09-12T02:30:33.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.197+0000 7fd915d9b640 1 -- 172.21.15.60:0/2639433116 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd90802e070 con 0x7fd900003b70 2024-09-12T02:30:33.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.197+0000 7fd915d9b640 1 -- 172.21.15.60:0/2639433116 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd908003df0 con 0x7fd900003b70 2024-09-12T02:30:33.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.198+0000 7fd91d20a640 1 -- 172.21.15.60:0/2639433116 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd900003b70 msgr2=0x7fd900003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:33.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.198+0000 7fd91d20a640 1 --2- 172.21.15.60:0/2639433116 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd900003b70 0x7fd900003f70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd908009900 tx=0x7fd900005830 comp rx=0 tx=0).stop 2024-09-12T02:30:33.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.198+0000 7fd91759e640 1 -- 172.21.15.60:0/2639433116 reap_dead start 2024-09-12T02:30:33.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.198+0000 7fd91d20a640 1 -- 172.21.15.60:0/2639433116 shutdown_connections 2024-09-12T02:30:33.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.198+0000 7fd91d20a640 1 -- 172.21.15.60:0/2639433116 >> 172.21.15.60:0/2639433116 conn(0x7fd9180c4ea0 msgr2=0x7fd9180c52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:33.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.198+0000 7fd91d20a640 1 -- 172.21.15.60:0/2639433116 shutdown_connections 2024-09-12T02:30:33.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.198+0000 7fd91d20a640 1 -- 172.21.15.60:0/2639433116 wait complete. 2024-09-12T02:30:33.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.199+0000 7fd91d20a640 1 Processor -- start 2024-09-12T02:30:33.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.200+0000 7fd91d20a640 1 -- start start 2024-09-12T02:30:33.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.200+0000 7fd91d20a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd900003b70 0x7fd9180c71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:33.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.200+0000 7fd91d20a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd918155b60 0x7fd918073040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:33.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.200+0000 7fd91d20a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd918073580 0x7fd9181ef6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:33.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.200+0000 7fd91d20a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd918153e10 con 0x7fd918155b60 2024-09-12T02:30:33.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.200+0000 7fd91d20a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd918153630 con 0x7fd900003b70 2024-09-12T02:30:33.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.200+0000 7fd91d20a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd9180c2620 con 0x7fd918073580 2024-09-12T02:30:33.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.200+0000 7fd91759e640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd918073580 msgr2=0x7fd9181ef6d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:30:33.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.200+0000 7fd91759e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd918073580 0x7fd9181ef6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:30:33.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.200+0000 7fd91659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd918155b60 0x7fd918073040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:33.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.200+0000 7fd916d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd900003b70 0x7fd9180c71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:33.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.200+0000 7fd916d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd900003b70 0x7fd9180c71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:39452/0 (socket says 172.21.15.60:39452) 2024-09-12T02:30:33.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.200+0000 7fd91659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd918155b60 0x7fd918073040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54598/0 (socket says 172.21.15.60:54598) 2024-09-12T02:30:33.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.200+0000 7fd916d9d640 1 -- 172.21.15.60:0/3780869474 learned_addr learned my addr 172.21.15.60:0/3780869474 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:30:33.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.201+0000 7fd91659c640 1 -- 172.21.15.60:0/3780869474 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd918073580 msgr2=0x7fd9181ef6d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:30:33.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.201+0000 7fd91659c640 1 --2- 172.21.15.60:0/3780869474 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd918073580 0x7fd9181ef6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:33.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.201+0000 7fd91659c640 1 -- 172.21.15.60:0/3780869474 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd900003b70 msgr2=0x7fd9180c71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:33.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.201+0000 7fd91659c640 1 --2- 172.21.15.60:0/3780869474 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd900003b70 0x7fd9180c71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:33.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.201+0000 7fd91659c640 1 -- 172.21.15.60:0/3780869474 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd918073e30 con 0x7fd918155b60 2024-09-12T02:30:33.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.201+0000 7fd916d9d640 1 --2- 172.21.15.60:0/3780869474 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd900003b70 0x7fd9180c71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:30:33.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.201+0000 7fd91659c640 1 --2- 172.21.15.60:0/3780869474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd918155b60 0x7fd918073040 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd918074500 tx=0x7fd90c00fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:33.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.201+0000 7fd8ff7fe640 1 -- 172.21.15.60:0/3780869474 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd90c0050d0 con 0x7fd918155b60 2024-09-12T02:30:33.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.201+0000 7fd8ff7fe640 1 -- 172.21.15.60:0/3780869474 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd90c018070 con 0x7fd918155b60 2024-09-12T02:30:33.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.201+0000 7fd8ff7fe640 1 -- 172.21.15.60:0/3780869474 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd90c0054b0 con 0x7fd918155b60 2024-09-12T02:30:33.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.201+0000 7fd91d20a640 1 -- 172.21.15.60:0/3780869474 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9181542c0 con 0x7fd918155b60 2024-09-12T02:30:33.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.201+0000 7fd91d20a640 1 -- 172.21.15.60:0/3780869474 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9181547a0 con 0x7fd918155b60 2024-09-12T02:30:33.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.202+0000 7fd91d20a640 1 -- 172.21.15.60:0/3780869474 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9180c2da0 con 0x7fd918155b60 2024-09-12T02:30:33.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.203+0000 7fd8ff7fe640 1 -- 172.21.15.60:0/3780869474 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd90c00d6a0 con 0x7fd918155b60 2024-09-12T02:30:33.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.203+0000 7fd8ff7fe640 1 --2- 172.21.15.60:0/3780869474 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd90406bde0 0x7fd90406e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:33.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.203+0000 7fd8ff7fe640 1 -- 172.21.15.60:0/3780869474 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fd90c08af30 con 0x7fd918155b60 2024-09-12T02:30:33.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.204+0000 7fd916d9d640 1 --2- 172.21.15.60:0/3780869474 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd90406bde0 0x7fd90406e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:33.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.204+0000 7fd916d9d640 1 --2- 172.21.15.60:0/3780869474 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd90406bde0 0x7fd90406e2a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd908009900 tx=0x7fd908005000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:33.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.210+0000 7fd8ff7fe640 1 -- 172.21.15.60:0/3780869474 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd90c0595d0 con 0x7fd918155b60 2024-09-12T02:30:33.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.476+0000 7fd91d20a640 1 -- 172.21.15.60:0/3780869474 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd9180c4470 con 0x7fd918155b60 2024-09-12T02:30:33.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.477+0000 7fd8ff7fe640 1 -- 172.21.15.60:0/3780869474 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7fd90c058ed0 con 0x7fd918155b60 2024-09-12T02:30:33.477 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":70,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:30:33.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.479+0000 7fd91d20a640 1 -- 172.21.15.60:0/3780869474 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd90406bde0 msgr2=0x7fd90406e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:33.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.479+0000 7fd91d20a640 1 --2- 172.21.15.60:0/3780869474 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd90406bde0 0x7fd90406e2a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd908009900 tx=0x7fd908005000 comp rx=0 tx=0).stop 2024-09-12T02:30:33.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.479+0000 7fd91d20a640 1 -- 172.21.15.60:0/3780869474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd918155b60 msgr2=0x7fd918073040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:33.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.479+0000 7fd91d20a640 1 --2- 172.21.15.60:0/3780869474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd918155b60 0x7fd918073040 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd918074500 tx=0x7fd90c00fc80 comp rx=0 tx=0).stop 2024-09-12T02:30:33.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.480+0000 7fd91d20a640 1 -- 172.21.15.60:0/3780869474 shutdown_connections 2024-09-12T02:30:33.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.480+0000 7fd91d20a640 1 --2- 172.21.15.60:0/3780869474 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd90406bde0 0x7fd90406e2a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:33.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.480+0000 7fd91d20a640 1 --2- 172.21.15.60:0/3780869474 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd918073580 0x7fd9181ef6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:33.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.480+0000 7fd91d20a640 1 --2- 172.21.15.60:0/3780869474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd918155b60 0x7fd918073040 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:33.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.480+0000 7fd91d20a640 1 --2- 172.21.15.60:0/3780869474 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd900003b70 0x7fd9180c71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:33.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.480+0000 7fd91d20a640 1 -- 172.21.15.60:0/3780869474 >> 172.21.15.60:0/3780869474 conn(0x7fd9180c4ea0 msgr2=0x7fd9180ac770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:33.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.480+0000 7fd91d20a640 1 -- 172.21.15.60:0/3780869474 shutdown_connections 2024-09-12T02:30:33.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:33.480+0000 7fd91d20a640 1 -- 172.21.15.60:0/3780869474 wait complete. 2024-09-12T02:30:36.492 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:30:36.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.613+0000 7f88cd1d6640 1 Processor -- start 2024-09-12T02:30:36.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.613+0000 7f88cd1d6640 1 -- start start 2024-09-12T02:30:36.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.614+0000 7f88cd1d6640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f88c806cd80 0x7f88c8153be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:36.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.614+0000 7f88cd1d6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f88c815a4a0 0x7f88c8156660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:36.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.614+0000 7f88cd1d6640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88c80c7070 con 0x7f88c80c8b10 2024-09-12T02:30:36.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.614+0000 7f88cd1d6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f88c806d210 con 0x7f88c815a4a0 2024-09-12T02:30:36.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.614+0000 7f88cd1d6640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f88c80c69b0 con 0x7f88c806cd80 2024-09-12T02:30:36.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.614+0000 7f88c759e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f88c815a4a0 0x7f88c8156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:36.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.614+0000 7f88c6d9d640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f88c80c8b10 0x7f88c81534d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:57256/0 (socket says 172.21.15.60:57256) 2024-09-12T02:30:36.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.614+0000 7f88c759e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f88c815a4a0 0x7f88c8156660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54604/0 (socket says 172.21.15.60:54604) 2024-09-12T02:30:36.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.614+0000 7f88c6d9d640 1 -- 172.21.15.60:0/50422266 learned_addr learned my addr 172.21.15.60:0/50422266 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:30:36.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.615+0000 7f88c759e640 1 -- 172.21.15.60:0/50422266 >> v2:172.21.15.105:3300/0 conn(0x7f88c806cd80 msgr2=0x7f88c8153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:36.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.615+0000 7f88c759e640 1 --2- 172.21.15.60:0/50422266 >> v2:172.21.15.105:3300/0 conn(0x7f88c806cd80 0x7f88c8153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:36.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.615+0000 7f88c759e640 1 -- 172.21.15.60:0/50422266 >> v1:172.21.15.60:6789/0 conn(0x7f88c80c8b10 legacy=0x7f88c81534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:36.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.615+0000 7f88c759e640 1 -- 172.21.15.60:0/50422266 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88c80c6c90 con 0x7f88c815a4a0 2024-09-12T02:30:36.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.615+0000 7f88c759e640 1 --2- 172.21.15.60:0/50422266 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88c815a4a0 0x7f88c8156660 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f88c806ec00 tx=0x7f88c002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14497dd4f8a2b508 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:36.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.616+0000 7f88c5d9b640 1 -- 172.21.15.60:0/50422266 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c0007740 con 0x7f88c815a4a0 2024-09-12T02:30:36.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.616+0000 7f88c5d9b640 1 -- 172.21.15.60:0/50422266 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88c00078e0 con 0x7f88c815a4a0 2024-09-12T02:30:36.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.616+0000 7f88c5d9b640 1 -- 172.21.15.60:0/50422266 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c0007cb0 con 0x7f88c815a4a0 2024-09-12T02:30:36.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.616+0000 7f88cd1d6640 1 -- 172.21.15.60:0/50422266 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88c815a4a0 msgr2=0x7f88c8156660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:36.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.616+0000 7f88cd1d6640 1 --2- 172.21.15.60:0/50422266 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88c815a4a0 0x7f88c8156660 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f88c806ec00 tx=0x7f88c002a5f0 comp rx=0 tx=0).stop 2024-09-12T02:30:36.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.616+0000 7f88cd1d6640 1 -- 172.21.15.60:0/50422266 shutdown_connections 2024-09-12T02:30:36.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.616+0000 7f88cd1d6640 1 --2- 172.21.15.60:0/50422266 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88c815a4a0 0x7f88c8156660 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:36.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.616+0000 7f88cd1d6640 1 --2- 172.21.15.60:0/50422266 >> v2:172.21.15.105:3300/0 conn(0x7f88c806cd80 0x7f88c8153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:36.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.616+0000 7f88cd1d6640 1 -- 172.21.15.60:0/50422266 >> 172.21.15.60:0/50422266 conn(0x7f88c80adb80 msgr2=0x7f88c80adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:36.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.616+0000 7f88cd1d6640 1 -- 172.21.15.60:0/50422266 shutdown_connections 2024-09-12T02:30:36.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.617+0000 7f88cd1d6640 1 -- 172.21.15.60:0/50422266 wait complete. 2024-09-12T02:30:36.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.618+0000 7f88cd1d6640 1 Processor -- start 2024-09-12T02:30:36.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.618+0000 7f88cd1d6640 1 -- start start 2024-09-12T02:30:36.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.619+0000 7f88cd1d6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88c80c8b10 0x7f88c80accb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:36.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.619+0000 7f88cd1d6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88c815a4a0 0x7f88c81502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:36.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.619+0000 7f88cd1d6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88c8145d10 0x7f88c8146190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:36.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.619+0000 7f88cd1d6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f88c80c9070 con 0x7f88c8145d10 2024-09-12T02:30:36.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.619+0000 7f88cd1d6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f88c80c8ef0 con 0x7f88c80c8b10 2024-09-12T02:30:36.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.619+0000 7f88cd1d6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f88c8156ba0 con 0x7f88c815a4a0 2024-09-12T02:30:36.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.619+0000 7f88c659c640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88c815a4a0 msgr2=0x7f88c81502e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:30:36.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.619+0000 7f88c659c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88c815a4a0 0x7f88c81502e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:30:36.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.619+0000 7f88c759e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88c8145d10 0x7f88c8146190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:36.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.619+0000 7f88c759e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88c8145d10 0x7f88c8146190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54610/0 (socket says 172.21.15.60:54610) 2024-09-12T02:30:36.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.619+0000 7f88c759e640 1 -- 172.21.15.60:0/76285116 learned_addr learned my addr 172.21.15.60:0/76285116 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:30:36.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.619+0000 7f88c6d9d640 1 --2- 172.21.15.60:0/76285116 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88c80c8b10 0x7f88c80accb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:36.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.619+0000 7f88c759e640 1 -- 172.21.15.60:0/76285116 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88c815a4a0 msgr2=0x7f88c81502e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:30:36.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.619+0000 7f88c759e640 1 --2- 172.21.15.60:0/76285116 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88c815a4a0 0x7f88c81502e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:36.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.619+0000 7f88c759e640 1 -- 172.21.15.60:0/76285116 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88c80c8b10 msgr2=0x7f88c80accb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:36.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.619+0000 7f88c759e640 1 --2- 172.21.15.60:0/76285116 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88c80c8b10 0x7f88c80accb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:36.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.619+0000 7f88c759e640 1 -- 172.21.15.60:0/76285116 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88c8158800 con 0x7f88c8145d10 2024-09-12T02:30:36.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.619+0000 7f88c759e640 1 --2- 172.21.15.60:0/76285116 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88c8145d10 0x7f88c8146190 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f88c002abe0 tx=0x7f88c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:36.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.620+0000 7f88af7fe640 1 -- 172.21.15.60:0/76285116 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c003f070 con 0x7f88c8145d10 2024-09-12T02:30:36.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.620+0000 7f88af7fe640 1 -- 172.21.15.60:0/76285116 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88c0031c40 con 0x7f88c8145d10 2024-09-12T02:30:36.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.620+0000 7f88af7fe640 1 -- 172.21.15.60:0/76285116 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c0044460 con 0x7f88c8145d10 2024-09-12T02:30:36.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.620+0000 7f88cd1d6640 1 -- 172.21.15.60:0/76285116 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88c8159610 con 0x7f88c8145d10 2024-09-12T02:30:36.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.620+0000 7f88cd1d6640 1 -- 172.21.15.60:0/76285116 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88c8158d60 con 0x7f88c8145d10 2024-09-12T02:30:36.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.621+0000 7f88cd1d6640 1 -- 172.21.15.60:0/76285116 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88c80c61e0 con 0x7f88c8145d10 2024-09-12T02:30:36.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.621+0000 7f88af7fe640 1 -- 172.21.15.60:0/76285116 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f88c003b410 con 0x7f88c8145d10 2024-09-12T02:30:36.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.622+0000 7f88af7fe640 1 --2- 172.21.15.60:0/76285116 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f88b406be30 0x7f88b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:36.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.622+0000 7f88af7fe640 1 -- 172.21.15.60:0/76285116 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f88c00ac920 con 0x7f88c8145d10 2024-09-12T02:30:36.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.622+0000 7f88c6d9d640 1 --2- 172.21.15.60:0/76285116 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f88b406be30 0x7f88b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:36.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.623+0000 7f88c6d9d640 1 --2- 172.21.15.60:0/76285116 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f88b406be30 0x7f88b406e2f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f88b8007fd0 tx=0x7f88b8007e80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:36.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.626+0000 7f88af7fe640 1 -- 172.21.15.60:0/76285116 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f88c80c61e0 con 0x7f88c8145d10 2024-09-12T02:30:36.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.904+0000 7f88cd1d6640 1 -- 172.21.15.60:0/76285116 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f88c8156660 con 0x7f88c8145d10 2024-09-12T02:30:36.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.905+0000 7f88af7fe640 1 -- 172.21.15.60:0/76285116 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f88c8158800 con 0x7f88c8145d10 2024-09-12T02:30:36.906 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":70,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:30:36.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.907+0000 7f88cd1d6640 1 -- 172.21.15.60:0/76285116 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f88b406be30 msgr2=0x7f88b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:36.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.907+0000 7f88cd1d6640 1 --2- 172.21.15.60:0/76285116 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f88b406be30 0x7f88b406e2f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f88b8007fd0 tx=0x7f88b8007e80 comp rx=0 tx=0).stop 2024-09-12T02:30:36.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.907+0000 7f88cd1d6640 1 -- 172.21.15.60:0/76285116 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88c8145d10 msgr2=0x7f88c8146190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:36.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.908+0000 7f88cd1d6640 1 --2- 172.21.15.60:0/76285116 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88c8145d10 0x7f88c8146190 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f88c002abe0 tx=0x7f88c0004a40 comp rx=0 tx=0).stop 2024-09-12T02:30:36.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.908+0000 7f88cd1d6640 1 -- 172.21.15.60:0/76285116 shutdown_connections 2024-09-12T02:30:36.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.908+0000 7f88cd1d6640 1 --2- 172.21.15.60:0/76285116 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f88b406be30 0x7f88b406e2f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:36.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.908+0000 7f88cd1d6640 1 --2- 172.21.15.60:0/76285116 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88c8145d10 0x7f88c8146190 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:36.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.908+0000 7f88cd1d6640 1 --2- 172.21.15.60:0/76285116 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88c815a4a0 0x7f88c81502e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:36.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.908+0000 7f88cd1d6640 1 --2- 172.21.15.60:0/76285116 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88c80c8b10 0x7f88c80accb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:36.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.908+0000 7f88cd1d6640 1 -- 172.21.15.60:0/76285116 >> 172.21.15.60:0/76285116 conn(0x7f88c80adb80 msgr2=0x7f88c80ca710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:36.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.908+0000 7f88cd1d6640 1 -- 172.21.15.60:0/76285116 shutdown_connections 2024-09-12T02:30:36.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:36.908+0000 7f88cd1d6640 1 -- 172.21.15.60:0/76285116 wait complete. 2024-09-12T02:30:39.920 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:30:40.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.037+0000 7fc2b1247640 1 Processor -- start 2024-09-12T02:30:40.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.037+0000 7fc2b1247640 1 -- start start 2024-09-12T02:30:40.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.038+0000 7fc2b1247640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2ac1505f0 0x7fc2ac153910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:40.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.038+0000 7fc2b1247640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc2ac0c69c0 0x7fc2ac0c2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:40.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.038+0000 7fc2b1247640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2ac0c5940 con 0x7fc2ac0c2980 2024-09-12T02:30:40.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.038+0000 7fc2b1247640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc2ac0c7860 con 0x7fc2ac0c69c0 2024-09-12T02:30:40.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.038+0000 7fc2b1247640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc2ac0c5c00 con 0x7fc2ac1505f0 2024-09-12T02:30:40.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.039+0000 7fc2aad9d640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2ac1505f0 msgr2=0x7fc2ac153910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:30:40.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.039+0000 7fc2aad9d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2ac1505f0 0x7fc2ac153910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:30:40.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.039+0000 7fc2ab59e640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fc2ac0c2980 0x7fc2ac0c42b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:43248/0 (socket says 172.21.15.60:43248) 2024-09-12T02:30:40.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.039+0000 7fc2ab59e640 1 -- 172.21.15.60:0/1290743709 learned_addr learned my addr 172.21.15.60:0/1290743709 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:30:40.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.039+0000 7fc2aa59c640 1 --2- 172.21.15.60:0/1290743709 >> v2:172.21.15.105:3300/0 conn(0x7fc2ac0c69c0 0x7fc2ac0c2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:40.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.039+0000 7fc2aa59c640 1 -- 172.21.15.60:0/1290743709 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2ac1505f0 msgr2=0x7fc2ac153910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:30:40.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.039+0000 7fc2aa59c640 1 --2- 172.21.15.60:0/1290743709 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2ac1505f0 0x7fc2ac153910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:40.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.039+0000 7fc2aa59c640 1 -- 172.21.15.60:0/1290743709 >> v1:172.21.15.105:6789/0 conn(0x7fc2ac0c2980 legacy=0x7fc2ac0c42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:40.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.039+0000 7fc2aa59c640 1 -- 172.21.15.60:0/1290743709 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2ac0c5ee0 con 0x7fc2ac0c69c0 2024-09-12T02:30:40.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.040+0000 7fc2aa59c640 1 --2- 172.21.15.60:0/1290743709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2ac0c69c0 0x7fc2ac0c2440 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc2a00097a0 tx=0x7fc2a002a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35dea0c07ea1093 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:40.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.040+0000 7fc2a9d9b640 1 -- 172.21.15.60:0/1290743709 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a0037070 con 0x7fc2ac0c69c0 2024-09-12T02:30:40.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.040+0000 7fc2a9d9b640 1 -- 172.21.15.60:0/1290743709 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2a0032440 con 0x7fc2ac0c69c0 2024-09-12T02:30:40.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.040+0000 7fc2a9d9b640 1 -- 172.21.15.60:0/1290743709 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a002ae60 con 0x7fc2ac0c69c0 2024-09-12T02:30:40.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.041+0000 7fc2b1247640 1 -- 172.21.15.60:0/1290743709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2ac0c69c0 msgr2=0x7fc2ac0c2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:40.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.041+0000 7fc2b1247640 1 --2- 172.21.15.60:0/1290743709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2ac0c69c0 0x7fc2ac0c2440 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc2a00097a0 tx=0x7fc2a002a110 comp rx=0 tx=0).stop 2024-09-12T02:30:40.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.041+0000 7fc2b1247640 1 -- 172.21.15.60:0/1290743709 shutdown_connections 2024-09-12T02:30:40.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.041+0000 7fc2b1247640 1 --2- 172.21.15.60:0/1290743709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2ac0c69c0 0x7fc2ac0c2440 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:40.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.041+0000 7fc2b1247640 1 --2- 172.21.15.60:0/1290743709 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2ac1505f0 0x7fc2ac153910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:40.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.041+0000 7fc2b1247640 1 -- 172.21.15.60:0/1290743709 >> 172.21.15.60:0/1290743709 conn(0x7fc2ac0c7a40 msgr2=0x7fc2ac0c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:40.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.041+0000 7fc2b1247640 1 -- 172.21.15.60:0/1290743709 shutdown_connections 2024-09-12T02:30:40.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.041+0000 7fc2b1247640 1 -- 172.21.15.60:0/1290743709 wait complete. 2024-09-12T02:30:40.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.043+0000 7fc2b1247640 1 Processor -- start 2024-09-12T02:30:40.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.043+0000 7fc2b1247640 1 -- start start 2024-09-12T02:30:40.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.044+0000 7fc2b1247640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2ac0c2980 0x7fc2ac0acf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:40.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.044+0000 7fc2b1247640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2ac1505f0 0x7fc2ac145c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:40.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.044+0000 7fc2b1247640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2ac146180 0x7fc2ac1e9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:40.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.044+0000 7fc2b1247640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc2ac1509d0 con 0x7fc2ac146180 2024-09-12T02:30:40.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.044+0000 7fc2b1247640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc2ac0c64a0 con 0x7fc2ac1505f0 2024-09-12T02:30:40.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.044+0000 7fc2b1247640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc2ac150b50 con 0x7fc2ac0c2980 2024-09-12T02:30:40.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.044+0000 7fc2aad9d640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2ac0c2980 msgr2=0x7fc2ac0acf40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:30:40.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.044+0000 7fc2aad9d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2ac0c2980 0x7fc2ac0acf40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:30:40.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.044+0000 7fc2ab59e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2ac146180 0x7fc2ac1e9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:40.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.044+0000 7fc2aa59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2ac1505f0 0x7fc2ac145c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:40.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.044+0000 7fc2aa59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2ac1505f0 0x7fc2ac145c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:48034/0 (socket says 172.21.15.60:48034) 2024-09-12T02:30:40.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.044+0000 7fc2ab59e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2ac146180 0x7fc2ac1e9d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56290/0 (socket says 172.21.15.60:56290) 2024-09-12T02:30:40.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.044+0000 7fc2aa59c640 1 -- 172.21.15.60:0/1141779906 learned_addr learned my addr 172.21.15.60:0/1141779906 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:30:40.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.045+0000 7fc2ab59e640 1 -- 172.21.15.60:0/1141779906 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2ac0c2980 msgr2=0x7fc2ac0acf40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:30:40.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.045+0000 7fc2ab59e640 1 --2- 172.21.15.60:0/1141779906 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2ac0c2980 0x7fc2ac0acf40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:40.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.045+0000 7fc2ab59e640 1 -- 172.21.15.60:0/1141779906 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2ac1505f0 msgr2=0x7fc2ac145c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:40.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.045+0000 7fc2ab59e640 1 --2- 172.21.15.60:0/1141779906 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2ac1505f0 0x7fc2ac145c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:40.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.045+0000 7fc2ab59e640 1 -- 172.21.15.60:0/1141779906 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2ac14dea0 con 0x7fc2ac146180 2024-09-12T02:30:40.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.045+0000 7fc2aa59c640 1 --2- 172.21.15.60:0/1141779906 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2ac1505f0 0x7fc2ac145c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:30:40.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.045+0000 7fc2ab59e640 1 --2- 172.21.15.60:0/1141779906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2ac146180 0x7fc2ac1e9d70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc2a400caa0 tx=0x7fc2a400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:40.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.045+0000 7fc2937fe640 1 -- 172.21.15.60:0/1141779906 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a4017070 con 0x7fc2ac146180 2024-09-12T02:30:40.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.045+0000 7fc2937fe640 1 -- 172.21.15.60:0/1141779906 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2a400ab40 con 0x7fc2ac146180 2024-09-12T02:30:40.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.045+0000 7fc2b1247640 1 -- 172.21.15.60:0/1141779906 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2ac146600 con 0x7fc2ac146180 2024-09-12T02:30:40.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.045+0000 7fc2937fe640 1 -- 172.21.15.60:0/1141779906 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a4012400 con 0x7fc2ac146180 2024-09-12T02:30:40.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.045+0000 7fc2b1247640 1 -- 172.21.15.60:0/1141779906 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2ac151180 con 0x7fc2ac146180 2024-09-12T02:30:40.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.047+0000 7fc2b1247640 1 -- 172.21.15.60:0/1141779906 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2ac1513c0 con 0x7fc2ac146180 2024-09-12T02:30:40.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.047+0000 7fc2937fe640 1 -- 172.21.15.60:0/1141779906 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc2a401a070 con 0x7fc2ac146180 2024-09-12T02:30:40.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.048+0000 7fc2937fe640 1 --2- 172.21.15.60:0/1141779906 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc29806be10 0x7fc29806e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:40.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.048+0000 7fc2937fe640 1 -- 172.21.15.60:0/1141779906 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fc2a408ac00 con 0x7fc2ac146180 2024-09-12T02:30:40.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.048+0000 7fc2aad9d640 1 --2- 172.21.15.60:0/1141779906 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc29806be10 0x7fc29806e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:40.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.048+0000 7fc2aad9d640 1 --2- 172.21.15.60:0/1141779906 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc29806be10 0x7fc29806e2d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc29c006fd0 tx=0x7fc29c006d80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:40.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.053+0000 7fc2937fe640 1 -- 172.21.15.60:0/1141779906 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc2ac1513c0 con 0x7fc2ac146180 2024-09-12T02:30:40.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.327+0000 7fc2b1247640 1 -- 172.21.15.60:0/1141779906 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc2ac0c2440 con 0x7fc2ac146180 2024-09-12T02:30:40.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.327+0000 7fc2937fe640 1 -- 172.21.15.60:0/1141779906 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7fc2a408a070 con 0x7fc2ac146180 2024-09-12T02:30:40.328 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":70,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:30:40.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.329+0000 7fc2b1247640 1 -- 172.21.15.60:0/1141779906 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc29806be10 msgr2=0x7fc29806e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:40.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.329+0000 7fc2b1247640 1 --2- 172.21.15.60:0/1141779906 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc29806be10 0x7fc29806e2d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc29c006fd0 tx=0x7fc29c006d80 comp rx=0 tx=0).stop 2024-09-12T02:30:40.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.329+0000 7fc2b1247640 1 -- 172.21.15.60:0/1141779906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2ac146180 msgr2=0x7fc2ac1e9d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:40.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.329+0000 7fc2b1247640 1 --2- 172.21.15.60:0/1141779906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2ac146180 0x7fc2ac1e9d70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc2a400caa0 tx=0x7fc2a400cf60 comp rx=0 tx=0).stop 2024-09-12T02:30:40.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.330+0000 7fc2b1247640 1 -- 172.21.15.60:0/1141779906 shutdown_connections 2024-09-12T02:30:40.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.330+0000 7fc2b1247640 1 --2- 172.21.15.60:0/1141779906 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc29806be10 0x7fc29806e2d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:40.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.330+0000 7fc2b1247640 1 --2- 172.21.15.60:0/1141779906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2ac146180 0x7fc2ac1e9d70 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:40.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.330+0000 7fc2b1247640 1 --2- 172.21.15.60:0/1141779906 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2ac1505f0 0x7fc2ac145c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:40.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.330+0000 7fc2b1247640 1 --2- 172.21.15.60:0/1141779906 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2ac0c2980 0x7fc2ac0acf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:40.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.330+0000 7fc2b1247640 1 -- 172.21.15.60:0/1141779906 >> 172.21.15.60:0/1141779906 conn(0x7fc2ac0c7a40 msgr2=0x7fc2ac156590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:40.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.330+0000 7fc2b1247640 1 -- 172.21.15.60:0/1141779906 shutdown_connections 2024-09-12T02:30:40.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:40.330+0000 7fc2b1247640 1 -- 172.21.15.60:0/1141779906 wait complete. 2024-09-12T02:30:43.342 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:30:43.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:43.456+0000 7f8f783fd640 1 Processor -- start 2024-09-12T02:30:43.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:43.456+0000 7f8f783fd640 1 -- start start 2024-09-12T02:30:43.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:43.458+0000 7f8f783fd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8f70150b70 0x7f8f700ac1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:43.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:43.458+0000 7f8f783fd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f700ac6e0 0x7f8f700c3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:43.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:43.458+0000 7f8f783fd640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f70153d70 con 0x7f8f70067d20 2024-09-12T02:30:43.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:43.458+0000 7f8f783fd640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f8f700a82c0 con 0x7f8f70150b70 2024-09-12T02:30:43.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:43.458+0000 7f8f783fd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8f701542f0 con 0x7f8f700ac6e0 2024-09-12T02:30:43.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:43.458+0000 7f8f7699a640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f700ac6e0 msgr2=0x7f8f700c3a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:30:43.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:43.458+0000 7f8f7699a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f700ac6e0 0x7f8f700c3a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:30:43.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:43.458+0000 7f8f75998640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f8f70067d20 0x7f8f700c3350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:33966/0 (socket says 172.21.15.60:33966) 2024-09-12T02:30:43.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:43.458+0000 7f8f75998640 1 -- 172.21.15.60:0/3100408236 learned_addr learned my addr 172.21.15.60:0/3100408236 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:30:43.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:43.458+0000 7f8f76199640 1 --2- 172.21.15.60:0/3100408236 >> v2:172.21.15.105:3300/0 conn(0x7f8f70150b70 0x7f8f700ac1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:43.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:43.458+0000 7f8f76199640 1 -- 172.21.15.60:0/3100408236 >> v2:172.21.15.105:3300/0 conn(0x7f8f70150b70 msgr2=0x7f8f700ac1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:30:43.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:43.458+0000 7f8f76199640 1 -- 172.21.15.60:0/3100408236 >> v2:172.21.15.105:3300/0 conn(0x7f8f70150b70 msgr2=0x7f8f700ac1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:30:43.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:43.458+0000 7f8f76199640 1 --2- 172.21.15.60:0/3100408236 >> v2:172.21.15.105:3300/0 conn(0x7f8f70150b70 0x7f8f700ac1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:30:43.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:43.458+0000 7f8f76199640 1 --2- 172.21.15.60:0/3100408236 >> v2:172.21.15.105:3300/0 conn(0x7f8f70150b70 0x7f8f700ac1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:30:43.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:43.659+0000 7f8f7699a640 1 -- 172.21.15.60:0/3100408236 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f700ac6e0 msgr2=0x7f8f700c3a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:30:43.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:43.659+0000 7f8f7699a640 1 --2- 172.21.15.60:0/3100408236 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f700ac6e0 0x7f8f700c3a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:30:43.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:43.659+0000 7f8f76199640 1 --2- 172.21.15.60:0/3100408236 >> v2:172.21.15.105:3300/0 conn(0x7f8f70150b70 0x7f8f700ac1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:43.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:43.659+0000 7f8f76199640 1 -- 172.21.15.60:0/3100408236 >> v2:172.21.15.105:3300/0 conn(0x7f8f70150b70 msgr2=0x7f8f700ac1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:30:43.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:43.659+0000 7f8f76199640 1 -- 172.21.15.60:0/3100408236 >> v2:172.21.15.105:3300/0 conn(0x7f8f70150b70 msgr2=0x7f8f700ac1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:30:43.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:43.659+0000 7f8f76199640 1 --2- 172.21.15.60:0/3100408236 >> v2:172.21.15.105:3300/0 conn(0x7f8f70150b70 0x7f8f700ac1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:30:43.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:43.659+0000 7f8f76199640 1 --2- 172.21.15.60:0/3100408236 >> v2:172.21.15.105:3300/0 conn(0x7f8f70150b70 0x7f8f700ac1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:30:44.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:44.060+0000 7f8f7699a640 1 -- 172.21.15.60:0/3100408236 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f700ac6e0 msgr2=0x7f8f700c3a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:30:44.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:44.060+0000 7f8f7699a640 1 --2- 172.21.15.60:0/3100408236 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f700ac6e0 0x7f8f700c3a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:30:44.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:44.060+0000 7f8f76199640 1 --2- 172.21.15.60:0/3100408236 >> v2:172.21.15.105:3300/0 conn(0x7f8f70150b70 0x7f8f700ac1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:44.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:44.060+0000 7f8f76199640 1 -- 172.21.15.60:0/3100408236 >> v2:172.21.15.105:3300/0 conn(0x7f8f70150b70 msgr2=0x7f8f700ac1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:30:44.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:44.060+0000 7f8f76199640 1 -- 172.21.15.60:0/3100408236 >> v2:172.21.15.105:3300/0 conn(0x7f8f70150b70 msgr2=0x7f8f700ac1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:30:44.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:44.060+0000 7f8f76199640 1 --2- 172.21.15.60:0/3100408236 >> v2:172.21.15.105:3300/0 conn(0x7f8f70150b70 0x7f8f700ac1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:30:44.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:44.060+0000 7f8f76199640 1 --2- 172.21.15.60:0/3100408236 >> v2:172.21.15.105:3300/0 conn(0x7f8f70150b70 0x7f8f700ac1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:30:44.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:44.861+0000 7f8f7699a640 1 -- 172.21.15.60:0/3100408236 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f700ac6e0 msgr2=0x7f8f700c3a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:30:44.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:44.861+0000 7f8f7699a640 1 --2- 172.21.15.60:0/3100408236 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f700ac6e0 0x7f8f700c3a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:30:44.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:44.861+0000 7f8f76199640 1 --2- 172.21.15.60:0/3100408236 >> v2:172.21.15.105:3300/0 conn(0x7f8f70150b70 0x7f8f700ac1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:44.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:44.861+0000 7f8f76199640 1 -- 172.21.15.60:0/3100408236 >> v2:172.21.15.105:3300/0 conn(0x7f8f70150b70 msgr2=0x7f8f700ac1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:30:44.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:44.861+0000 7f8f76199640 1 -- 172.21.15.60:0/3100408236 >> v2:172.21.15.105:3300/0 conn(0x7f8f70150b70 msgr2=0x7f8f700ac1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:30:44.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:44.861+0000 7f8f76199640 1 --2- 172.21.15.60:0/3100408236 >> v2:172.21.15.105:3300/0 conn(0x7f8f70150b70 0x7f8f700ac1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:30:44.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:44.861+0000 7f8f76199640 1 --2- 172.21.15.60:0/3100408236 >> v2:172.21.15.105:3300/0 conn(0x7f8f70150b70 0x7f8f700ac1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:30:46.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:46.458+0000 7f8f67fff640 1 -- 172.21.15.60:0/3100408236 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f700ac6e0 msgr2=0x7f8f700c3a60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:30:46.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:46.458+0000 7f8f67fff640 1 --2- 172.21.15.60:0/3100408236 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f700ac6e0 0x7f8f700c3a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:46.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:46.458+0000 7f8f67fff640 1 -- 172.21.15.60:0/3100408236 >> v2:172.21.15.105:3300/0 conn(0x7f8f70150b70 msgr2=0x7f8f700ac1a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:30:46.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:46.458+0000 7f8f67fff640 1 --2- 172.21.15.60:0/3100408236 >> v2:172.21.15.105:3300/0 conn(0x7f8f70150b70 0x7f8f700ac1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:46.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:46.458+0000 7f8f67fff640 1 -- 172.21.15.60:0/3100408236 >> v1:172.21.15.60:6789/0 conn(0x7f8f70067d20 legacy=0x7f8f700c3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:46.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:46.458+0000 7f8f67fff640 1 --2- 172.21.15.60:0/3100408236 >> v2:172.21.15.60:3300/0 conn(0x7f8f54007410 0x7f8f540098d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:46.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:46.458+0000 7f8f67fff640 1 -- 172.21.15.60:0/3100408236 --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f70154010 con 0x7f8f540036c0 2024-09-12T02:30:46.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:46.458+0000 7f8f67fff640 1 -- 172.21.15.60:0/3100408236 --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f8f700a82c0 con 0x7f8f54007410 2024-09-12T02:30:46.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:46.458+0000 7f8f75998640 1 --2- 172.21.15.60:0/3100408236 >> v2:172.21.15.60:3300/0 conn(0x7f8f54007410 0x7f8f540098d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:46.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:46.458+0000 7f8f75998640 1 -- 172.21.15.60:0/3100408236 >> v2:172.21.15.60:3300/0 conn(0x7f8f54007410 msgr2=0x7f8f540098d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:30:46.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:46.458+0000 7f8f75998640 1 -- 172.21.15.60:0/3100408236 >> v2:172.21.15.60:3300/0 conn(0x7f8f54007410 msgr2=0x7f8f540098d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:30:46.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:46.458+0000 7f8f75998640 1 --2- 172.21.15.60:0/3100408236 >> v2:172.21.15.60:3300/0 conn(0x7f8f54007410 0x7f8f540098d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:30:46.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:46.458+0000 7f8f75998640 1 --2- 172.21.15.60:0/3100408236 >> v2:172.21.15.60:3300/0 conn(0x7f8f54007410 0x7f8f540098d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:30:46.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:46.659+0000 7f8f75998640 1 --2- 172.21.15.60:0/3100408236 >> v2:172.21.15.60:3300/0 conn(0x7f8f54007410 0x7f8f540098d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:46.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:46.659+0000 7f8f75998640 1 -- 172.21.15.60:0/3100408236 >> v2:172.21.15.60:3300/0 conn(0x7f8f54007410 msgr2=0x7f8f540098d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:30:46.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:46.659+0000 7f8f75998640 1 -- 172.21.15.60:0/3100408236 >> v2:172.21.15.60:3300/0 conn(0x7f8f54007410 msgr2=0x7f8f540098d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:30:46.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:46.659+0000 7f8f75998640 1 --2- 172.21.15.60:0/3100408236 >> v2:172.21.15.60:3300/0 conn(0x7f8f54007410 0x7f8f540098d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:30:46.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:46.659+0000 7f8f75998640 1 --2- 172.21.15.60:0/3100408236 >> v2:172.21.15.60:3300/0 conn(0x7f8f54007410 0x7f8f540098d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:30:47.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.060+0000 7f8f75998640 1 --2- 172.21.15.60:0/3100408236 >> v2:172.21.15.60:3300/0 conn(0x7f8f54007410 0x7f8f540098d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:47.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.060+0000 7f8f75998640 1 -- 172.21.15.60:0/3100408236 >> v2:172.21.15.60:3300/0 conn(0x7f8f54007410 msgr2=0x7f8f540098d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:30:47.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.060+0000 7f8f75998640 1 -- 172.21.15.60:0/3100408236 >> v2:172.21.15.60:3300/0 conn(0x7f8f54007410 msgr2=0x7f8f540098d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:30:47.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.060+0000 7f8f75998640 1 --2- 172.21.15.60:0/3100408236 >> v2:172.21.15.60:3300/0 conn(0x7f8f54007410 0x7f8f540098d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:30:47.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.060+0000 7f8f75998640 1 --2- 172.21.15.60:0/3100408236 >> v2:172.21.15.60:3300/0 conn(0x7f8f54007410 0x7f8f540098d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:30:47.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.479+0000 7f8f75197640 1 -- 172.21.15.60:0/3100408236 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1036869416 0 0) 0x7f8f70154010 con 0x7f8f540036c0 2024-09-12T02:30:47.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.480+0000 7f8f75197640 1 -- 172.21.15.60:0/3100408236 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f5c003520 con 0x7f8f540036c0 2024-09-12T02:30:47.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.480+0000 7f8f75197640 1 -- 172.21.15.60:0/3100408236 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 126938029 0 0) 0x7f8f5c003520 con 0x7f8f540036c0 2024-09-12T02:30:47.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.480+0000 7f8f75197640 1 -- 172.21.15.60:0/3100408236 >> v2:172.21.15.60:3300/0 conn(0x7f8f54007410 msgr2=0x7f8f540098d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:30:47.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.480+0000 7f8f75197640 1 --2- 172.21.15.60:0/3100408236 >> v2:172.21.15.60:3300/0 conn(0x7f8f54007410 0x7f8f540098d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:47.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.480+0000 7f8f75197640 1 -- 172.21.15.60:0/3100408236 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f5400b0a0 con 0x7f8f540036c0 2024-09-12T02:30:47.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.480+0000 7f8f75197640 1 -- 172.21.15.60:0/3100408236 <== mon.1 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7f8f6c00d580 con 0x7f8f540036c0 2024-09-12T02:30:47.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.480+0000 7f8f75197640 1 -- 172.21.15.60:0/3100408236 >> v1:172.21.15.105:6789/0 conn(0x7f8f540036c0 legacy=0x7f8f54005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:47.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.480+0000 7f8f75197640 1 --2- 172.21.15.60:0/3100408236 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f5c0039b0 0x7f8f5c003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:47.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.480+0000 7f8f7699a640 1 -- 172.21.15.60:0/3100408236 reap_dead start 2024-09-12T02:30:47.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.480+0000 7f8f75197640 1 --2- 172.21.15.60:0/3100408236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f5c004800 0x7f8f5c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:47.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.480+0000 7f8f75197640 1 --2- 172.21.15.60:0/3100408236 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f700ac6e0 0x7f8f5c005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:47.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.480+0000 7f8f75197640 1 -- 172.21.15.60:0/3100408236 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8f700a82c0 con 0x7f8f5c004800 2024-09-12T02:30:47.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.480+0000 7f8f75197640 1 -- 172.21.15.60:0/3100408236 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8f5c00bb80 con 0x7f8f5c0039b0 2024-09-12T02:30:47.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.480+0000 7f8f75197640 1 -- 172.21.15.60:0/3100408236 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8f5c00bd80 con 0x7f8f700ac6e0 2024-09-12T02:30:47.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.480+0000 7f8f7699a640 1 -- 172.21.15.60:0/3100408236 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f700ac6e0 msgr2=0x7f8f5c005270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:30:47.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.480+0000 7f8f76199640 1 --2- 172.21.15.60:0/3100408236 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f5c0039b0 0x7f8f5c003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:47.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.480+0000 7f8f7699a640 1 --2- 172.21.15.60:0/3100408236 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f700ac6e0 0x7f8f5c005270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:30:47.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.481+0000 7f8f76199640 1 -- 172.21.15.60:0/3100408236 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f700ac6e0 msgr2=0x7f8f5c005270 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:30:47.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.481+0000 7f8f76199640 1 --2- 172.21.15.60:0/3100408236 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f700ac6e0 0x7f8f5c005270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:47.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.481+0000 7f8f76199640 1 -- 172.21.15.60:0/3100408236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f5c004800 msgr2=0x7f8f5c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:30:47.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.481+0000 7f8f76199640 1 --2- 172.21.15.60:0/3100408236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f5c004800 0x7f8f5c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:47.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.481+0000 7f8f76199640 1 -- 172.21.15.60:0/3100408236 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f5c003520 con 0x7f8f5c0039b0 2024-09-12T02:30:47.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.482+0000 7f8f76199640 1 --2- 172.21.15.60:0/3100408236 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f5c0039b0 0x7f8f5c003db0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c013410 tx=0x7f8f5c005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40c946f4397ea795 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:47.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.482+0000 7f8f75197640 1 -- 172.21.15.60:0/3100408236 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c039070 con 0x7f8f5c0039b0 2024-09-12T02:30:47.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.482+0000 7f8f75197640 1 -- 172.21.15.60:0/3100408236 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f6c034410 con 0x7f8f5c0039b0 2024-09-12T02:30:47.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.482+0000 7f8f75197640 1 -- 172.21.15.60:0/3100408236 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c00dd50 con 0x7f8f5c0039b0 2024-09-12T02:30:47.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.483+0000 7f8f783fd640 1 -- 172.21.15.60:0/3100408236 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f5c0039b0 msgr2=0x7f8f5c003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:47.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.483+0000 7f8f783fd640 1 --2- 172.21.15.60:0/3100408236 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f5c0039b0 0x7f8f5c003db0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c013410 tx=0x7f8f5c005830 comp rx=0 tx=0).stop 2024-09-12T02:30:47.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.483+0000 7f8f783fd640 1 -- 172.21.15.60:0/3100408236 shutdown_connections 2024-09-12T02:30:47.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.483+0000 7f8f783fd640 1 --2- 172.21.15.60:0/3100408236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f5c004800 0x7f8f5c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:47.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.483+0000 7f8f783fd640 1 --2- 172.21.15.60:0/3100408236 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f700ac6e0 0x7f8f5c005270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:47.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.483+0000 7f8f783fd640 1 --2- 172.21.15.60:0/3100408236 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f5c0039b0 0x7f8f5c003db0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:47.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.483+0000 7f8f783fd640 1 -- 172.21.15.60:0/3100408236 >> 172.21.15.60:0/3100408236 conn(0x7f8f700c8430 msgr2=0x7f8f700c8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:47.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.483+0000 7f8f783fd640 1 -- 172.21.15.60:0/3100408236 shutdown_connections 2024-09-12T02:30:47.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.483+0000 7f8f783fd640 1 -- 172.21.15.60:0/3100408236 wait complete. 2024-09-12T02:30:47.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.485+0000 7f8f783fd640 1 Processor -- start 2024-09-12T02:30:47.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.485+0000 7f8f783fd640 1 -- start start 2024-09-12T02:30:47.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.486+0000 7f8f783fd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f5c0039b0 0x7f8f700c06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:47.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.486+0000 7f8f783fd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f5c004800 0x7f8f700bf750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:47.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.486+0000 7f8f783fd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f700ac6e0 0x7f8f70071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:47.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.486+0000 7f8f783fd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8f700c2e30 con 0x7f8f5c004800 2024-09-12T02:30:47.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.486+0000 7f8f783fd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8f700ab8f0 con 0x7f8f5c0039b0 2024-09-12T02:30:47.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.486+0000 7f8f783fd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8f70150f50 con 0x7f8f700ac6e0 2024-09-12T02:30:47.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.486+0000 7f8f7699a640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f700ac6e0 msgr2=0x7f8f70071bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:30:47.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.486+0000 7f8f7699a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f700ac6e0 0x7f8f70071bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:30:47.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.486+0000 7f8f76199640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f5c0039b0 0x7f8f700c06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:47.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.486+0000 7f8f75998640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f5c004800 0x7f8f700bf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:47.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.486+0000 7f8f76199640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f5c0039b0 0x7f8f700c06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:48088/0 (socket says 172.21.15.60:48088) 2024-09-12T02:30:47.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.486+0000 7f8f76199640 1 -- 172.21.15.60:0/3265120274 learned_addr learned my addr 172.21.15.60:0/3265120274 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:30:47.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.487+0000 7f8f75998640 1 -- 172.21.15.60:0/3265120274 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f700ac6e0 msgr2=0x7f8f70071bd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:30:47.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.487+0000 7f8f75998640 1 --2- 172.21.15.60:0/3265120274 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f700ac6e0 0x7f8f70071bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:47.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.487+0000 7f8f75998640 1 -- 172.21.15.60:0/3265120274 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f5c0039b0 msgr2=0x7f8f700c06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:47.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.487+0000 7f8f75998640 1 --2- 172.21.15.60:0/3265120274 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f5c0039b0 0x7f8f700c06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:47.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.487+0000 7f8f75998640 1 -- 172.21.15.60:0/3265120274 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f700c16c0 con 0x7f8f5c004800 2024-09-12T02:30:47.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.487+0000 7f8f76199640 1 --2- 172.21.15.60:0/3265120274 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f5c0039b0 0x7f8f700c06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:30:47.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.487+0000 7f8f75998640 1 --2- 172.21.15.60:0/3265120274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f5c004800 0x7f8f700bf750 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8f60000c00 tx=0x7f8f60001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:47.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.488+0000 7f8f66ffd640 1 -- 172.21.15.60:0/3265120274 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f600049f0 con 0x7f8f5c004800 2024-09-12T02:30:47.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.488+0000 7f8f66ffd640 1 -- 172.21.15.60:0/3265120274 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f60004b90 con 0x7f8f5c004800 2024-09-12T02:30:47.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.488+0000 7f8f66ffd640 1 -- 172.21.15.60:0/3265120274 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f60004d60 con 0x7f8f5c004800 2024-09-12T02:30:47.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.488+0000 7f8f783fd640 1 -- 172.21.15.60:0/3265120274 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f700c1420 con 0x7f8f5c004800 2024-09-12T02:30:47.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.488+0000 7f8f783fd640 1 -- 172.21.15.60:0/3265120274 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f700c2690 con 0x7f8f5c004800 2024-09-12T02:30:47.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.489+0000 7f8f783fd640 1 -- 172.21.15.60:0/3265120274 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f700abc50 con 0x7f8f5c004800 2024-09-12T02:30:47.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.490+0000 7f8f66ffd640 1 -- 172.21.15.60:0/3265120274 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8f6001e020 con 0x7f8f5c004800 2024-09-12T02:30:47.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.490+0000 7f8f66ffd640 1 --2- 172.21.15.60:0/3265120274 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8f5406cac0 0x7f8f5406ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:47.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.491+0000 7f8f66ffd640 1 -- 172.21.15.60:0/3265120274 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f8f6008adf0 con 0x7f8f5c004800 2024-09-12T02:30:47.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.491+0000 7f8f76199640 1 --2- 172.21.15.60:0/3265120274 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8f5406cac0 0x7f8f5406ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:47.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.491+0000 7f8f76199640 1 --2- 172.21.15.60:0/3265120274 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8f5406cac0 0x7f8f5406ef80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c037040 tx=0x7f8f6c02f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:47.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.496+0000 7f8f66ffd640 1 -- 172.21.15.60:0/3265120274 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8f60058db0 con 0x7f8f5c004800 2024-09-12T02:30:47.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.804+0000 7f8f783fd640 1 -- 172.21.15.60:0/3265120274 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f8f70067b00 con 0x7f8f5c004800 2024-09-12T02:30:47.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.804+0000 7f8f66ffd640 1 -- 172.21.15.60:0/3265120274 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7f8f6005d0b0 con 0x7f8f5c004800 2024-09-12T02:30:47.805 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":74,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:30:47.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.807+0000 7f8f783fd640 1 -- 172.21.15.60:0/3265120274 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8f5406cac0 msgr2=0x7f8f5406ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:47.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.807+0000 7f8f783fd640 1 --2- 172.21.15.60:0/3265120274 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8f5406cac0 0x7f8f5406ef80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c037040 tx=0x7f8f6c02f000 comp rx=0 tx=0).stop 2024-09-12T02:30:47.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.807+0000 7f8f783fd640 1 -- 172.21.15.60:0/3265120274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f5c004800 msgr2=0x7f8f700bf750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:47.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.807+0000 7f8f783fd640 1 --2- 172.21.15.60:0/3265120274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f5c004800 0x7f8f700bf750 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8f60000c00 tx=0x7f8f60001630 comp rx=0 tx=0).stop 2024-09-12T02:30:47.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.807+0000 7f8f783fd640 1 -- 172.21.15.60:0/3265120274 shutdown_connections 2024-09-12T02:30:47.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.807+0000 7f8f783fd640 1 --2- 172.21.15.60:0/3265120274 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8f5406cac0 0x7f8f5406ef80 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:47.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.807+0000 7f8f783fd640 1 --2- 172.21.15.60:0/3265120274 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f700ac6e0 0x7f8f70071bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:47.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.807+0000 7f8f783fd640 1 --2- 172.21.15.60:0/3265120274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f5c004800 0x7f8f700bf750 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:47.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.807+0000 7f8f783fd640 1 --2- 172.21.15.60:0/3265120274 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f5c0039b0 0x7f8f700c06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:47.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.807+0000 7f8f783fd640 1 -- 172.21.15.60:0/3265120274 >> 172.21.15.60:0/3265120274 conn(0x7f8f700c8430 msgr2=0x7f8f7006bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:47.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.807+0000 7f8f783fd640 1 -- 172.21.15.60:0/3265120274 shutdown_connections 2024-09-12T02:30:47.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.807+0000 7f8f783fd640 1 -- 172.21.15.60:0/3265120274 wait complete. 2024-09-12T02:30:47.821 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-12T02:30:47.821 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-09-12T02:30:47.821 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-12T02:30:47.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.945+0000 7f50df5d6640 1 Processor -- start 2024-09-12T02:30:47.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.946+0000 7f50df5d6640 1 -- start start 2024-09-12T02:30:47.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.946+0000 7f50df5d6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50d80c4fe0 0x7f50d806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:47.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.946+0000 7f50df5d6640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f50d80c53c0 0x7f50d8159a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:47.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.946+0000 7f50df5d6640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50d8067c30 con 0x7f50d80adbc0 2024-09-12T02:30:47.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.947+0000 7f50df5d6640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f50d806e640 con 0x7f50d80c53c0 2024-09-12T02:30:47.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.947+0000 7f50df5d6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f50d806f140 con 0x7f50d80c4fe0 2024-09-12T02:30:47.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.947+0000 7f50dd372640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50d80c4fe0 msgr2=0x7f50d806f5d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:30:47.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.947+0000 7f50dd372640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50d80c4fe0 0x7f50d806f5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:30:47.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.947+0000 7f50ddb73640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f50d80adbc0 0x7f50d81559c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:33980/0 (socket says 172.21.15.60:33980) 2024-09-12T02:30:47.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.947+0000 7f50ddb73640 1 -- 172.21.15.60:0/666629082 learned_addr learned my addr 172.21.15.60:0/666629082 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:30:47.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.947+0000 7f50dcb71640 1 --2- 172.21.15.60:0/666629082 >> v2:172.21.15.105:3300/0 conn(0x7f50d80c53c0 0x7f50d8159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:47.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.947+0000 7f50cffff640 1 -- 172.21.15.60:0/666629082 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2919195359 0 0) 0x7f50d8067c30 con 0x7f50d80adbc0 2024-09-12T02:30:47.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.947+0000 7f50cffff640 1 -- 172.21.15.60:0/666629082 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50c4003520 con 0x7f50d80adbc0 2024-09-12T02:30:47.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.947+0000 7f50dcb71640 1 -- 172.21.15.60:0/666629082 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50d80c4fe0 msgr2=0x7f50d806f5d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:30:47.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.947+0000 7f50dcb71640 1 --2- 172.21.15.60:0/666629082 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50d80c4fe0 0x7f50d806f5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:47.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.947+0000 7f50dcb71640 1 -- 172.21.15.60:0/666629082 >> v1:172.21.15.60:6789/0 conn(0x7f50d80adbc0 legacy=0x7f50d81559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:47.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.947+0000 7f50dcb71640 1 -- 172.21.15.60:0/666629082 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50d8067f10 con 0x7f50d80c53c0 2024-09-12T02:30:47.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.948+0000 7f50dcb71640 1 --2- 172.21.15.60:0/666629082 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50d80c53c0 0x7f50d8159a40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f50c80097a0 tx=0x7f50c802a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=921000e5e91855da server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:47.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.948+0000 7f50cffff640 1 -- 172.21.15.60:0/666629082 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c8037070 con 0x7f50d80c53c0 2024-09-12T02:30:47.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.948+0000 7f50cffff640 1 -- 172.21.15.60:0/666629082 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50c802add0 con 0x7f50d80c53c0 2024-09-12T02:30:47.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.948+0000 7f50cffff640 1 -- 172.21.15.60:0/666629082 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c8037070 con 0x7f50d80c53c0 2024-09-12T02:30:47.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.949+0000 7f50df5d6640 1 -- 172.21.15.60:0/666629082 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50d80c53c0 msgr2=0x7f50d8159a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:47.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.949+0000 7f50df5d6640 1 --2- 172.21.15.60:0/666629082 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50d80c53c0 0x7f50d8159a40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f50c80097a0 tx=0x7f50c802a080 comp rx=0 tx=0).stop 2024-09-12T02:30:47.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.949+0000 7f50df5d6640 1 -- 172.21.15.60:0/666629082 shutdown_connections 2024-09-12T02:30:47.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.949+0000 7f50df5d6640 1 --2- 172.21.15.60:0/666629082 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50d80c53c0 0x7f50d8159a40 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:47.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.949+0000 7f50df5d6640 1 --2- 172.21.15.60:0/666629082 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50d80c4fe0 0x7f50d806f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:47.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.949+0000 7f50df5d6640 1 -- 172.21.15.60:0/666629082 >> 172.21.15.60:0/666629082 conn(0x7f50d80c8410 msgr2=0x7f50d80c87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:47.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.949+0000 7f50df5d6640 1 -- 172.21.15.60:0/666629082 shutdown_connections 2024-09-12T02:30:47.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.949+0000 7f50df5d6640 1 -- 172.21.15.60:0/666629082 wait complete. 2024-09-12T02:30:47.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.950+0000 7f50df5d6640 1 Processor -- start 2024-09-12T02:30:47.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.950+0000 7f50df5d6640 1 -- start start 2024-09-12T02:30:47.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.951+0000 7f50df5d6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50d80adbc0 0x7f50d8158870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:47.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.951+0000 7f50df5d6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50d80c4fe0 0x7f50d81ec130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:47.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.951+0000 7f50df5d6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50d80c53c0 0x7f50d81ef570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:47.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.951+0000 7f50df5d6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f50d806e3e0 con 0x7f50d80adbc0 2024-09-12T02:30:47.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.951+0000 7f50df5d6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f50d806e260 con 0x7f50d80c53c0 2024-09-12T02:30:47.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.951+0000 7f50df5d6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f50d8159f80 con 0x7f50d80c4fe0 2024-09-12T02:30:47.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.951+0000 7f50dcb71640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50d80c4fe0 msgr2=0x7f50d81ec130 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:30:47.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.951+0000 7f50dcb71640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50d80c4fe0 0x7f50d81ec130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:30:47.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.951+0000 7f50dd372640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50d80adbc0 0x7f50d8158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:47.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.951+0000 7f50dd372640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50d80adbc0 0x7f50d8158870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56340/0 (socket says 172.21.15.60:56340) 2024-09-12T02:30:47.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.951+0000 7f50dd372640 1 -- 172.21.15.60:0/586393142 learned_addr learned my addr 172.21.15.60:0/586393142 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:30:47.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.952+0000 7f50ddb73640 1 --2- 172.21.15.60:0/586393142 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50d80c53c0 0x7f50d81ef570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:47.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.952+0000 7f50dd372640 1 -- 172.21.15.60:0/586393142 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50d80c4fe0 msgr2=0x7f50d81ec130 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:30:47.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.952+0000 7f50dd372640 1 --2- 172.21.15.60:0/586393142 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50d80c4fe0 0x7f50d81ec130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:47.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.952+0000 7f50dd372640 1 -- 172.21.15.60:0/586393142 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50d80c53c0 msgr2=0x7f50d81ef570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:47.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.952+0000 7f50dd372640 1 --2- 172.21.15.60:0/586393142 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50d80c53c0 0x7f50d81ef570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:47.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.952+0000 7f50dd372640 1 -- 172.21.15.60:0/586393142 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50d8074770 con 0x7f50d80adbc0 2024-09-12T02:30:47.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.952+0000 7f50dd372640 1 --2- 172.21.15.60:0/586393142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50d80adbc0 0x7f50d8158870 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f50d400b550 tx=0x7f50d400ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:47.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.952+0000 7f50cdffb640 1 -- 172.21.15.60:0/586393142 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d4013020 con 0x7f50d80adbc0 2024-09-12T02:30:47.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.952+0000 7f50cdffb640 1 -- 172.21.15.60:0/586393142 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50d4003de0 con 0x7f50d80adbc0 2024-09-12T02:30:47.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.952+0000 7f50df5d6640 1 -- 172.21.15.60:0/586393142 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50d80741b0 con 0x7f50d80adbc0 2024-09-12T02:30:47.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.952+0000 7f50cdffb640 1 -- 172.21.15.60:0/586393142 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d40052b0 con 0x7f50d80adbc0 2024-09-12T02:30:47.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.952+0000 7f50df5d6640 1 -- 172.21.15.60:0/586393142 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50d81eed70 con 0x7f50d80adbc0 2024-09-12T02:30:47.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.953+0000 7f50df5d6640 1 --2- 172.21.15.60:0/586393142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50d80c7260 0x7f50d80c7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:47.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.953+0000 7f50df5d6640 1 -- 172.21.15.60:0/586393142 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f50d81ec670 con 0x7f50d80c7260 2024-09-12T02:30:47.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.953+0000 7f50dcb71640 1 --2- 172.21.15.60:0/586393142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50d80c7260 0x7f50d80c7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:47.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.954+0000 7f50dcb71640 1 -- 172.21.15.60:0/586393142 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f50d81ef3c0 con 0x7f50d80c7260 2024-09-12T02:30:47.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.954+0000 7f50dcb71640 1 --2- 172.21.15.60:0/586393142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50d80c7260 0x7f50d80c7640 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f50d80c5c60 tx=0x7f50c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:47.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.954+0000 7f50cdffb640 1 -- 172.21.15.60:0/586393142 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f50d4016020 con 0x7f50d80adbc0 2024-09-12T02:30:47.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.955+0000 7f50cdffb640 1 --2- 172.21.15.60:0/586393142 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f50bc06bde0 0x7f50bc06e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:47.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.955+0000 7f50ddb73640 1 --2- 172.21.15.60:0/586393142 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f50bc06bde0 0x7f50bc06e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:47.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.955+0000 7f50cdffb640 1 -- 172.21.15.60:0/586393142 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f50d408aea0 con 0x7f50d80adbc0 2024-09-12T02:30:47.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.955+0000 7f50cdffb640 1 -- 172.21.15.60:0/586393142 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c8042030 con 0x7f50d80c7260 2024-09-12T02:30:47.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.955+0000 7f50cdffb640 1 -- 172.21.15.60:0/586393142 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f50c8003610 con 0x7f50d80c7260 2024-09-12T02:30:47.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.955+0000 7f50cdffb640 1 -- 172.21.15.60:0/586393142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50d80c7260 msgr2=0x7f50d80c7640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:47.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.955+0000 7f50cdffb640 1 --2- 172.21.15.60:0/586393142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50d80c7260 0x7f50d80c7640 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f50d80c5c60 tx=0x7f50c80046c0 comp rx=0 tx=0).stop 2024-09-12T02:30:47.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.955+0000 7f50cdffb640 1 -- 172.21.15.60:0/586393142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50d80c7260 msgr2=0x7f50d80c7640 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:30:47.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.955+0000 7f50cdffb640 1 --2- 172.21.15.60:0/586393142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50d80c7260 0x7f50d80c7640 secure :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f50d80c5c60 tx=0x7f50c80046c0 comp rx=0 tx=0).stop 2024-09-12T02:30:47.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.955+0000 7f50ddb73640 1 --2- 172.21.15.60:0/586393142 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f50bc06bde0 0x7f50bc06e2a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f50d81ef090 tx=0x7f50d0001970 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:47.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.961+0000 7f50df5d6640 1 --2- 172.21.15.60:0/586393142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50d81590e0 0x7f50d81594c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:47.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.961+0000 7f50df5d6640 1 -- 172.21.15.60:0/586393142 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f50d8073bf0 con 0x7f50d81590e0 2024-09-12T02:30:47.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.961+0000 7f50dcb71640 1 --2- 172.21.15.60:0/586393142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50d81590e0 0x7f50d81594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:47.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.962+0000 7f50dcb71640 1 -- 172.21.15.60:0/586393142 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f50d80c8990 con 0x7f50d81590e0 2024-09-12T02:30:47.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.962+0000 7f50dcb71640 1 --2- 172.21.15.60:0/586393142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50d81590e0 0x7f50d81594c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f50c80097a0 tx=0x7f50c8009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:47.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.962+0000 7f50cdffb640 1 -- 172.21.15.60:0/586393142 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c8042040 con 0x7f50d81590e0 2024-09-12T02:30:47.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.962+0000 7f50cdffb640 1 -- 172.21.15.60:0/586393142 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4874 (secure 0 0 0) 0x7f50c803d470 con 0x7f50d81590e0 2024-09-12T02:30:47.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.962+0000 7f50cdffb640 1 -- 172.21.15.60:0/586393142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50d81590e0 msgr2=0x7f50d81594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:47.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.962+0000 7f50cdffb640 1 --2- 172.21.15.60:0/586393142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50d81590e0 0x7f50d81594c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f50c80097a0 tx=0x7f50c8009190 comp rx=0 tx=0).stop 2024-09-12T02:30:47.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.962+0000 7f50cdffb640 1 -- 172.21.15.60:0/586393142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50d81590e0 msgr2=0x7f50d81594c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:30:47.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.962+0000 7f50cdffb640 1 --2- 172.21.15.60:0/586393142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50d81590e0 0x7f50d81594c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:47.964 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:30:47.964 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:30:47.964 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:30:47.964 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:30:47.964 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 74, 2024-09-12T02:30:47.964 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 111065, 2024-09-12T02:30:47.964 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:30:47.964 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:30:47.964 INFO:teuthology.orchestra.run.smithi060.stdout: 1 2024-09-12T02:30:47.964 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:30:47.965 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-09-12T02:30:47.965 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:30:47.965 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:30:47.965 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:30:47.965 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:30:47.965 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:30:47.965 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:30:47.965 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:30:47.965 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:30:47.965 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:30:47.965 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:30:47.965 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:30:47.965 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:30:47.965 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:30:47.966 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:30:47.966 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:30:47.966 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:30:47.966 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:30:47.966 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:30:47.966 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:30:47.966 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:30:47.966 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:30:47.966 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:30:47.966 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:30:47.966 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:30:47.966 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:30:47.966 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:30:47.966 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:30:47.967 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:30:47.967 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:47.967 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:47.967 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:30:47.967 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:30:47.967 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:30:47.967 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:30:47.967 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:30:47.967 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:30:47.967 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:30:47.967 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:30:47.967 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:30:47.967 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:30:47.967 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:30:47.968 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:30:47.968 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:30:47.968 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:30:47.968 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:30:47.968 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:30:47.968 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:30:47.968 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:30:47.968 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:30:47.968 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:30:47.968 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:30:47.968 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:30:47.968 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:30:47.968 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:30:47.968 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:30:47.969 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:30:47.969 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:30:47.969 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:30:47.969 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:30:47.969 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:30:47.969 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:47.969 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:30:47.969 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:47.969 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:30:47.969 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:30:47.969 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:30:47.969 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:30:47.969 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:47.969 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:30:47.970 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:30:47.970 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:47.970 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:47.970 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:47.970 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:30:47.970 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:30:47.970 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:47.970 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:47.970 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:47.970 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:47.970 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:30:47.970 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:30:47.970 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:30:47.970 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:30:47.971 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:30:47.971 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:47.971 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:47.971 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:30:47.971 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:30:47.971 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:30:47.971 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:30:47.971 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:47.971 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:30:47.971 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:30:47.971 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:47.971 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:47.971 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:47.971 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:30:47.972 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:30:47.972 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:47.972 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:47.972 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:47.972 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:47.972 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:30:47.972 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:30:47.972 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:30:47.972 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:30:47.972 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:30:47.972 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:47.972 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:47.972 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:30:47.972 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:30:47.973 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:30:47.973 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:30:47.973 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:47.973 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:30:47.973 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:30:47.973 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:47.973 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:47.973 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:47.973 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:30:47.973 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:30:47.973 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:47.973 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:47.973 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:47.973 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:47.974 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:30:47.974 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:30:47.974 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:30:47.974 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:30:47.974 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:30:47.974 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:47.974 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:47.974 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:47.974 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:30:47.974 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:30:47.974 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:47.974 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:30:47.974 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:30:47.975 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:30:47.975 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:47.975 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:30:47.975 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:30:47.975 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:47.975 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:30:47.975 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:30:47.975 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:30:47.975 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:47.975 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:30:47.975 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:30:47.975 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:47.975 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:30:47.975 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:30:47.975 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:30:47.976 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:47.976 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:30:47.976 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:30:47.976 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:47.976 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:30:47.976 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:30:47.976 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:30:47.976 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:47.976 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:47.976 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:47.976 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:30:47.976 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:30:47.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.963+0000 7f50df5d6640 1 -- 172.21.15.60:0/586393142 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f50bc06bde0 msgr2=0x7f50bc06e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:47.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.963+0000 7f50df5d6640 1 --2- 172.21.15.60:0/586393142 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f50bc06bde0 0x7f50bc06e2a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f50d81ef090 tx=0x7f50d0001970 comp rx=0 tx=0).stop 2024-09-12T02:30:47.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.963+0000 7f50df5d6640 1 -- 172.21.15.60:0/586393142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50d80adbc0 msgr2=0x7f50d8158870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:47.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.963+0000 7f50df5d6640 1 --2- 172.21.15.60:0/586393142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50d80adbc0 0x7f50d8158870 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f50d400b550 tx=0x7f50d400ba10 comp rx=0 tx=0).stop 2024-09-12T02:30:47.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.963+0000 7f50ddb73640 1 -- 172.21.15.60:0/586393142 reap_dead start 2024-09-12T02:30:47.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.963+0000 7f50ddb73640 1 -- 172.21.15.60:0/586393142 reap_dead start 2024-09-12T02:30:47.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.963+0000 7f50df5d6640 1 -- 172.21.15.60:0/586393142 shutdown_connections 2024-09-12T02:30:47.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.963+0000 7f50df5d6640 1 -- 172.21.15.60:0/586393142 >> 172.21.15.60:0/586393142 conn(0x7f50d80c8410 msgr2=0x7f50d81548d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:47.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.963+0000 7f50df5d6640 1 -- 172.21.15.60:0/586393142 shutdown_connections 2024-09-12T02:30:47.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:47.963+0000 7f50df5d6640 1 -- 172.21.15.60:0/586393142 wait complete. 2024-09-12T02:30:47.979 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-12T02:30:47.979 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-12T02:30:47.979 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-12T02:30:48.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.093+0000 7f77e17a6640 1 Processor -- start 2024-09-12T02:30:48.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.093+0000 7f77e17a6640 1 -- start start 2024-09-12T02:30:48.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.094+0000 7f77e17a6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f77dc0c5030 0x7f77dc06e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:48.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.094+0000 7f77e17a6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77dc06e580 0x7f77dc153730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:48.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.094+0000 7f77e17a6640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77dc068010 con 0x7f77dc0c2d30 2024-09-12T02:30:48.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.094+0000 7f77e17a6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f77dc067ae0 con 0x7f77dc0c5030 2024-09-12T02:30:48.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.094+0000 7f77e17a6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f77dc074890 con 0x7f77dc06e580 2024-09-12T02:30:48.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.094+0000 7f77da7fc640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77dc06e580 msgr2=0x7f77dc153730 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:30:48.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.094+0000 7f77daffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f77dc0c5030 0x7f77dc06e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:48.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.094+0000 7f77da7fc640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77dc06e580 0x7f77dc153730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:30:48.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.094+0000 7f77daffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f77dc0c5030 0x7f77dc06e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56380/0 (socket says 172.21.15.60:56380) 2024-09-12T02:30:48.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.095+0000 7f77daffd640 1 -- 172.21.15.60:0/815980076 learned_addr learned my addr 172.21.15.60:0/815980076 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:30:48.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.095+0000 7f77daffd640 1 -- 172.21.15.60:0/815980076 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77dc06e580 msgr2=0x7f77dc153730 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:30:48.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.095+0000 7f77daffd640 1 --2- 172.21.15.60:0/815980076 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77dc06e580 0x7f77dc153730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:48.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.095+0000 7f77daffd640 1 -- 172.21.15.60:0/815980076 >> v1:172.21.15.105:6789/0 conn(0x7f77dc0c2d30 legacy=0x7f77dc159850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:48.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.095+0000 7f77d9ffb640 1 -- 172.21.15.60:0/815980076 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3666324515 0 0) 0x7f77dc068010 con 0x7f77dc0c2d30 2024-09-12T02:30:48.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.095+0000 7f77daffd640 1 -- 172.21.15.60:0/815980076 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77dc067d30 con 0x7f77dc0c5030 2024-09-12T02:30:48.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.096+0000 7f77daffd640 1 --2- 172.21.15.60:0/815980076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77dc0c5030 0x7f77dc06e040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f77cc009870 tx=0x7f77cc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5281c2bfc02be6bb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:48.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.096+0000 7f77d9ffb640 1 -- 172.21.15.60:0/815980076 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77cc037070 con 0x7f77dc0c5030 2024-09-12T02:30:48.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.096+0000 7f77d9ffb640 1 -- 172.21.15.60:0/815980076 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77cc032440 con 0x7f77dc0c5030 2024-09-12T02:30:48.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.096+0000 7f77d9ffb640 1 -- 172.21.15.60:0/815980076 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77cc032810 con 0x7f77dc0c5030 2024-09-12T02:30:48.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.097+0000 7f77e17a6640 1 -- 172.21.15.60:0/815980076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77dc0c5030 msgr2=0x7f77dc06e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:48.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.097+0000 7f77e17a6640 1 --2- 172.21.15.60:0/815980076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77dc0c5030 0x7f77dc06e040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f77cc009870 tx=0x7f77cc02a1e0 comp rx=0 tx=0).stop 2024-09-12T02:30:48.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.097+0000 7f77e17a6640 1 -- 172.21.15.60:0/815980076 shutdown_connections 2024-09-12T02:30:48.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.097+0000 7f77e17a6640 1 --2- 172.21.15.60:0/815980076 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77dc06e580 0x7f77dc153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:48.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.097+0000 7f77e17a6640 1 --2- 172.21.15.60:0/815980076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77dc0c5030 0x7f77dc06e040 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:48.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.097+0000 7f77e17a6640 1 -- 172.21.15.60:0/815980076 >> 172.21.15.60:0/815980076 conn(0x7f77dc06bbe0 msgr2=0x7f77dc06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:48.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.097+0000 7f77e17a6640 1 -- 172.21.15.60:0/815980076 shutdown_connections 2024-09-12T02:30:48.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.097+0000 7f77e17a6640 1 -- 172.21.15.60:0/815980076 wait complete. 2024-09-12T02:30:48.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.098+0000 7f77e17a6640 1 Processor -- start 2024-09-12T02:30:48.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.098+0000 7f77e17a6640 1 -- start start 2024-09-12T02:30:48.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.099+0000 7f77e17a6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77dc06e580 0x7f77dc0726e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:48.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.099+0000 7f77e17a6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77dc0c2d30 0x7f77dc1ec850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:48.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.099+0000 7f77e17a6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77dc0c5030 0x7f77dc0c2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:48.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.099+0000 7f77e17a6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f77dc156a20 con 0x7f77dc0c5030 2024-09-12T02:30:48.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.099+0000 7f77e17a6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f77dc156740 con 0x7f77dc0c2d30 2024-09-12T02:30:48.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.099+0000 7f77e17a6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f77dc0c5410 con 0x7f77dc06e580 2024-09-12T02:30:48.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.099+0000 7f77daffd640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77dc06e580 msgr2=0x7f77dc0726e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:30:48.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.099+0000 7f77daffd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77dc06e580 0x7f77dc0726e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:30:48.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.099+0000 7f77db7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77dc0c5030 0x7f77dc0c2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:48.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.099+0000 7f77db7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77dc0c5030 0x7f77dc0c2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56392/0 (socket says 172.21.15.60:56392) 2024-09-12T02:30:48.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.099+0000 7f77db7fe640 1 -- 172.21.15.60:0/1448809459 learned_addr learned my addr 172.21.15.60:0/1448809459 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:30:48.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.099+0000 7f77da7fc640 1 --2- 172.21.15.60:0/1448809459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77dc0c2d30 0x7f77dc1ec850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:48.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.099+0000 7f77db7fe640 1 -- 172.21.15.60:0/1448809459 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77dc06e580 msgr2=0x7f77dc0726e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:30:48.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.099+0000 7f77db7fe640 1 --2- 172.21.15.60:0/1448809459 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77dc06e580 0x7f77dc0726e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:48.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.099+0000 7f77db7fe640 1 -- 172.21.15.60:0/1448809459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77dc0c2d30 msgr2=0x7f77dc1ec850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:48.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.099+0000 7f77db7fe640 1 --2- 172.21.15.60:0/1448809459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77dc0c2d30 0x7f77dc1ec850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:48.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.099+0000 7f77db7fe640 1 -- 172.21.15.60:0/1448809459 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77dc1f0080 con 0x7f77dc0c5030 2024-09-12T02:30:48.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.100+0000 7f77db7fe640 1 --2- 172.21.15.60:0/1448809459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77dc0c5030 0x7f77dc0c2470 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f77d400c760 tx=0x7f77d400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:48.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.100+0000 7f77c37fe640 1 -- 172.21.15.60:0/1448809459 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d4003da0 con 0x7f77dc0c5030 2024-09-12T02:30:48.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.100+0000 7f77c37fe640 1 -- 172.21.15.60:0/1448809459 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77d4005070 con 0x7f77dc0c5030 2024-09-12T02:30:48.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.100+0000 7f77e17a6640 1 -- 172.21.15.60:0/1448809459 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77dc1ec050 con 0x7f77dc0c5030 2024-09-12T02:30:48.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.100+0000 7f77c37fe640 1 -- 172.21.15.60:0/1448809459 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d4005460 con 0x7f77dc0c5030 2024-09-12T02:30:48.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.100+0000 7f77e17a6640 1 -- 172.21.15.60:0/1448809459 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77dc1e1cf0 con 0x7f77dc0c5030 2024-09-12T02:30:48.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.101+0000 7f77e17a6640 1 --2- 172.21.15.60:0/1448809459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77dc14feb0 0x7f77dc14c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:48.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.101+0000 7f77e17a6640 1 -- 172.21.15.60:0/1448809459 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f77dc1ebeb0 con 0x7f77dc14feb0 2024-09-12T02:30:48.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.101+0000 7f77daffd640 1 --2- 172.21.15.60:0/1448809459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77dc14feb0 0x7f77dc14c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:48.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.101+0000 7f77daffd640 1 -- 172.21.15.60:0/1448809459 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f77dc1efe30 con 0x7f77dc14feb0 2024-09-12T02:30:48.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.102+0000 7f77daffd640 1 --2- 172.21.15.60:0/1448809459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77dc14feb0 0x7f77dc14c5b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f77dc0c5e40 tx=0x7f77cc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:48.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.102+0000 7f77c37fe640 1 -- 172.21.15.60:0/1448809459 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f77d4005600 con 0x7f77dc0c5030 2024-09-12T02:30:48.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.102+0000 7f77c37fe640 1 --2- 172.21.15.60:0/1448809459 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f77c806bde0 0x7f77c806e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:48.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.102+0000 7f77da7fc640 1 --2- 172.21.15.60:0/1448809459 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f77c806bde0 0x7f77c806e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:48.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.102+0000 7f77c37fe640 1 -- 172.21.15.60:0/1448809459 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f77d408af20 con 0x7f77dc0c5030 2024-09-12T02:30:48.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.103+0000 7f77c37fe640 1 -- 172.21.15.60:0/1448809459 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77cc042070 con 0x7f77dc14feb0 2024-09-12T02:30:48.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.103+0000 7f77c37fe640 1 -- 172.21.15.60:0/1448809459 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f77cc032e00 con 0x7f77dc14feb0 2024-09-12T02:30:48.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.103+0000 7f77c37fe640 1 -- 172.21.15.60:0/1448809459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77dc14feb0 msgr2=0x7f77dc14c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:48.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.103+0000 7f77c37fe640 1 --2- 172.21.15.60:0/1448809459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77dc14feb0 0x7f77dc14c5b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f77dc0c5e40 tx=0x7f77cc0046c0 comp rx=0 tx=0).stop 2024-09-12T02:30:48.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.103+0000 7f77c37fe640 1 -- 172.21.15.60:0/1448809459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77dc14feb0 msgr2=0x7f77dc14c5b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:30:48.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.103+0000 7f77c37fe640 1 --2- 172.21.15.60:0/1448809459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77dc14feb0 0x7f77dc14c5b0 secure :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f77dc0c5e40 tx=0x7f77cc0046c0 comp rx=0 tx=0).stop 2024-09-12T02:30:48.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.103+0000 7f77da7fc640 1 --2- 172.21.15.60:0/1448809459 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f77c806bde0 0x7f77c806e2a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f77d0006b20 tx=0x7f77d0006ab0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:48.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.110+0000 7f77e17a6640 1 --2- 172.21.15.60:0/1448809459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77dc071e50 0x7f77dc14caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:48.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.110+0000 7f77e17a6640 1 -- 172.21.15.60:0/1448809459 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f77dc0c3210 con 0x7f77dc071e50 2024-09-12T02:30:48.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.110+0000 7f77daffd640 1 --2- 172.21.15.60:0/1448809459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77dc071e50 0x7f77dc14caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:48.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.110+0000 7f77daffd640 1 -- 172.21.15.60:0/1448809459 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f77dc074510 con 0x7f77dc071e50 2024-09-12T02:30:48.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.111+0000 7f77daffd640 1 --2- 172.21.15.60:0/1448809459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77dc071e50 0x7f77dc14caf0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f77cc000c00 tx=0x7f77cc009240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:48.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.111+0000 7f77c37fe640 1 -- 172.21.15.60:0/1448809459 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77cc037040 con 0x7f77dc071e50 2024-09-12T02:30:48.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.111+0000 7f77c37fe640 1 -- 172.21.15.60:0/1448809459 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5039 (secure 0 0 0) 0x7f77cc003e20 con 0x7f77dc071e50 2024-09-12T02:30:48.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.111+0000 7f77c37fe640 1 -- 172.21.15.60:0/1448809459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77dc071e50 msgr2=0x7f77dc14caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:48.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.111+0000 7f77c37fe640 1 --2- 172.21.15.60:0/1448809459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77dc071e50 0x7f77dc14caf0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f77cc000c00 tx=0x7f77cc009240 comp rx=0 tx=0).stop 2024-09-12T02:30:48.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.111+0000 7f77c37fe640 1 -- 172.21.15.60:0/1448809459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77dc071e50 msgr2=0x7f77dc14caf0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:30:48.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.111+0000 7f77c37fe640 1 --2- 172.21.15.60:0/1448809459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77dc071e50 0x7f77dc14caf0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:48.112 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:30:48.113 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:30:48.113 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:30:48.113 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:30:48.113 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 74, 2024-09-12T02:30:48.113 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 393546, 2024-09-12T02:30:48.113 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:30:48.113 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:30:48.113 INFO:teuthology.orchestra.run.smithi060.stdout: 1 2024-09-12T02:30:48.113 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:30:48.113 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-09-12T02:30:48.113 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:30:48.113 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:30:48.113 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:30:48.113 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:30:48.114 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:30:48.114 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:30:48.114 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:30:48.114 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:30:48.114 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:30:48.114 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:30:48.114 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:30:48.114 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:30:48.114 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:30:48.114 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:30:48.114 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:30:48.114 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:30:48.114 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:30:48.115 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:30:48.115 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:30:48.115 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:30:48.115 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:30:48.115 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:30:48.115 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:30:48.115 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:30:48.115 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:30:48.115 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:30:48.115 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:30:48.115 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:30:48.115 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:48.115 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:48.115 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:30:48.116 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:30:48.116 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:30:48.116 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:30:48.116 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:30:48.116 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:30:48.116 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:30:48.116 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:30:48.116 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:30:48.116 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:30:48.116 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:30:48.116 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:30:48.116 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:30:48.116 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:30:48.116 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:30:48.117 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:30:48.117 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:30:48.117 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:30:48.117 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:30:48.117 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:30:48.117 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:30:48.117 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:30:48.117 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:30:48.117 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:30:48.117 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:30:48.117 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:30:48.117 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:30:48.117 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:30:48.118 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:30:48.118 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:30:48.118 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:48.118 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:30:48.118 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:48.118 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:30:48.118 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:30:48.118 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:30:48.118 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:30:48.118 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:48.118 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:30:48.118 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:30:48.118 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:48.119 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:48.119 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:48.119 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:30:48.119 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:30:48.119 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:48.119 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:48.119 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:48.119 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:48.119 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:30:48.119 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:30:48.119 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:30:48.119 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:30:48.119 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:30:48.120 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:48.120 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:48.120 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:30:48.120 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:30:48.120 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:30:48.120 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:30:48.120 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:48.120 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:30:48.120 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:30:48.120 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:48.120 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:48.120 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:48.120 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:30:48.121 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:30:48.121 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:48.121 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:48.121 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:48.121 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:48.121 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:30:48.121 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:30:48.121 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:30:48.121 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:30:48.121 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:30:48.121 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:48.121 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:48.121 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:30:48.122 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:30:48.122 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:30:48.122 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:30:48.122 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:48.122 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:30:48.122 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:30:48.122 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:48.122 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:48.122 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:48.122 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:30:48.122 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:30:48.122 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:30:48.122 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:48.122 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:48.123 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:48.123 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:30:48.123 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:30:48.123 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:30:48.123 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:30:48.123 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:30:48.123 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:48.123 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:48.123 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:48.123 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:30:48.123 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:30:48.123 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:48.123 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:30:48.123 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:30:48.124 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:30:48.124 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:48.124 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:30:48.124 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:30:48.124 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:48.124 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:30:48.124 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:30:48.124 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:30:48.124 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:48.124 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:30:48.124 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:30:48.124 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:48.125 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:30:48.125 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:30:48.125 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-09-12T02:30:48.125 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:48.125 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:30:48.125 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:30:48.125 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:48.125 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:30:48.125 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:30:48.125 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-09-12T02:30:48.125 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:48.125 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:30:48.125 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:30:48.126 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:30:48.126 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:30:48.126 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:30:48.126 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:30:48.126 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:30:48.126 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:30:48.126 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:30:48.126 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:30:48.126 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:30:48.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.111+0000 7f77e17a6640 1 -- 172.21.15.60:0/1448809459 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f77c806bde0 msgr2=0x7f77c806e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:48.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.111+0000 7f77e17a6640 1 --2- 172.21.15.60:0/1448809459 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f77c806bde0 0x7f77c806e2a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f77d0006b20 tx=0x7f77d0006ab0 comp rx=0 tx=0).stop 2024-09-12T02:30:48.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.111+0000 7f77e17a6640 1 -- 172.21.15.60:0/1448809459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77dc0c5030 msgr2=0x7f77dc0c2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:48.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.111+0000 7f77e17a6640 1 --2- 172.21.15.60:0/1448809459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77dc0c5030 0x7f77dc0c2470 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f77d400c760 tx=0x7f77d400cc20 comp rx=0 tx=0).stop 2024-09-12T02:30:48.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.111+0000 7f77db7fe640 1 -- 172.21.15.60:0/1448809459 reap_dead start 2024-09-12T02:30:48.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.111+0000 7f77db7fe640 1 -- 172.21.15.60:0/1448809459 reap_dead start 2024-09-12T02:30:48.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.111+0000 7f77e17a6640 1 -- 172.21.15.60:0/1448809459 shutdown_connections 2024-09-12T02:30:48.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.111+0000 7f77e17a6640 1 -- 172.21.15.60:0/1448809459 >> 172.21.15.60:0/1448809459 conn(0x7f77dc06bbe0 msgr2=0x7f77dc06bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:48.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.112+0000 7f77e17a6640 1 -- 172.21.15.60:0/1448809459 shutdown_connections 2024-09-12T02:30:48.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:30:48.112+0000 7f77e17a6640 1 -- 172.21.15.60:0/1448809459 wait complete. 2024-09-12T02:30:48.128 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-12T02:30:48.129 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-12T02:30:58.361 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:30:58.364 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:31:08.129 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-09-12T02:31:08.129 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-09-12T02:31:08.129 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T02:31:08.130 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T02:31:08.132 INFO:tasks.ceph.mon.c:Started 2024-09-12T02:31:08.132 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-12T02:31:08.133 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:31:08.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.255+0000 7fa8cdb3b640 1 Processor -- start 2024-09-12T02:31:08.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.255+0000 7fa8cdb3b640 1 -- start start 2024-09-12T02:31:08.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.256+0000 7fa8cdb3b640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa8c80aeb10 0x7fa8c8156c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:08.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.256+0000 7fa8cdb3b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa8c80c7a90 0x7fa8c80c7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:08.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.256+0000 7fa8cdb3b640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8c80a7cc0 con 0x7fa8c80c3cf0 2024-09-12T02:31:08.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.256+0000 7fa8cdb3b640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fa8c80c3580 con 0x7fa8c80c7a90 2024-09-12T02:31:08.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.256+0000 7fa8cdb3b640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fa8c80c3860 con 0x7fa8c80aeb10 2024-09-12T02:31:08.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.256+0000 7fa8c6ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa8c80c7a90 0x7fa8c80c7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:08.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.256+0000 7fa8c6ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa8c80c7a90 0x7fa8c80c7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51088/0 (socket says 172.21.15.60:51088) 2024-09-12T02:31:08.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.256+0000 7fa8c6ffd640 1 -- 172.21.15.60:0/2242467136 learned_addr learned my addr 172.21.15.60:0/2242467136 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:31:08.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.256+0000 7fa8c77fe640 1 --2- 172.21.15.60:0/2242467136 >> v2:172.21.15.105:3300/0 conn(0x7fa8c80aeb10 0x7fa8c8156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:08.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.256+0000 7fa8c6ffd640 1 -- 172.21.15.60:0/2242467136 >> v2:172.21.15.105:3300/0 conn(0x7fa8c80aeb10 msgr2=0x7fa8c8156c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:08.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.256+0000 7fa8c6ffd640 1 --2- 172.21.15.60:0/2242467136 >> v2:172.21.15.105:3300/0 conn(0x7fa8c80aeb10 0x7fa8c8156c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:08.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.256+0000 7fa8c6ffd640 1 -- 172.21.15.60:0/2242467136 >> v1:172.21.15.105:6789/0 conn(0x7fa8c80c3cf0 legacy=0x7fa8c80c4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:08.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.256+0000 7fa8c6ffd640 1 -- 172.21.15.60:0/2242467136 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8c8157160 con 0x7fa8c80c7a90 2024-09-12T02:31:08.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.256+0000 7fa8c67fc640 1 -- 172.21.15.60:0/2242467136 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 222593207 0 0) 0x7fa8c80a7cc0 con 0x7fa8c80c3cf0 2024-09-12T02:31:08.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.257+0000 7fa8c6ffd640 1 --2- 172.21.15.60:0/2242467136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8c80c7a90 0x7fa8c80c7ef0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa8c80a7e90 tx=0x7fa8bc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff271c46c4ca5962 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:08.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.257+0000 7fa8c67fc640 1 -- 172.21.15.60:0/2242467136 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc037070 con 0x7fa8c80c7a90 2024-09-12T02:31:08.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.257+0000 7fa8c67fc640 1 -- 172.21.15.60:0/2242467136 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8bc032440 con 0x7fa8c80c7a90 2024-09-12T02:31:08.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.257+0000 7fa8c67fc640 1 -- 172.21.15.60:0/2242467136 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc032810 con 0x7fa8c80c7a90 2024-09-12T02:31:08.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.258+0000 7fa8cdb3b640 1 -- 172.21.15.60:0/2242467136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8c80c7a90 msgr2=0x7fa8c80c7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:08.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.258+0000 7fa8cdb3b640 1 --2- 172.21.15.60:0/2242467136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8c80c7a90 0x7fa8c80c7ef0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa8c80a7e90 tx=0x7fa8bc02a140 comp rx=0 tx=0).stop 2024-09-12T02:31:08.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.258+0000 7fa8cdb3b640 1 -- 172.21.15.60:0/2242467136 shutdown_connections 2024-09-12T02:31:08.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.258+0000 7fa8cdb3b640 1 --2- 172.21.15.60:0/2242467136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8c80c7a90 0x7fa8c80c7ef0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:08.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.258+0000 7fa8cdb3b640 1 --2- 172.21.15.60:0/2242467136 >> v2:172.21.15.105:3300/0 conn(0x7fa8c80aeb10 0x7fa8c8156c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:08.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.258+0000 7fa8cdb3b640 1 -- 172.21.15.60:0/2242467136 >> 172.21.15.60:0/2242467136 conn(0x7fa8c80c5680 msgr2=0x7fa8c80c5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:08.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.258+0000 7fa8cdb3b640 1 -- 172.21.15.60:0/2242467136 shutdown_connections 2024-09-12T02:31:08.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.258+0000 7fa8cdb3b640 1 -- 172.21.15.60:0/2242467136 wait complete. 2024-09-12T02:31:08.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.260+0000 7fa8cdb3b640 1 Processor -- start 2024-09-12T02:31:08.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.260+0000 7fa8cdb3b640 1 -- start start 2024-09-12T02:31:08.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.261+0000 7fa8cdb3b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8c80aeb10 0x7fa8c81e06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:08.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.261+0000 7fa8cdb3b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8c80c3cf0 0x7fa8c814fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:08.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.261+0000 7fa8cdb3b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8c80c7a90 0x7fa8c8150350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:08.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.261+0000 7fa8cdb3b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c80a8520 con 0x7fa8c80c3cf0 2024-09-12T02:31:08.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.261+0000 7fa8cdb3b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c80a8240 con 0x7fa8c80aeb10 2024-09-12T02:31:08.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.261+0000 7fa8cdb3b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa8c80c5240 con 0x7fa8c80c7a90 2024-09-12T02:31:08.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.261+0000 7fa8c6ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8c80c3cf0 0x7fa8c814fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:08.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.261+0000 7fa8c6ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8c80c3cf0 0x7fa8c814fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51092/0 (socket says 172.21.15.60:51092) 2024-09-12T02:31:08.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.261+0000 7fa8c6ffd640 1 -- 172.21.15.60:0/2802312632 learned_addr learned my addr 172.21.15.60:0/2802312632 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:31:08.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.261+0000 7fa8c77fe640 1 --2- 172.21.15.60:0/2802312632 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8c80aeb10 0x7fa8c81e06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:08.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.261+0000 7fa8c7fff640 1 --2- 172.21.15.60:0/2802312632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8c80c7a90 0x7fa8c8150350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:08.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.261+0000 7fa8c7fff640 1 -- 172.21.15.60:0/2802312632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8c80c7a90 msgr2=0x7fa8c8150350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-12T02:31:08.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.261+0000 7fa8c7fff640 1 -- 172.21.15.60:0/2802312632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8c80c7a90 msgr2=0x7fa8c8150350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:31:08.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.261+0000 7fa8c7fff640 1 --2- 172.21.15.60:0/2802312632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8c80c7a90 0x7fa8c8150350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:31:08.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.261+0000 7fa8c7fff640 1 --2- 172.21.15.60:0/2802312632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8c80c7a90 0x7fa8c8150350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:31:08.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.261+0000 7fa8c6ffd640 1 -- 172.21.15.60:0/2802312632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8c80c7a90 msgr2=0x7fa8c8150350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:31:08.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.261+0000 7fa8c6ffd640 1 --2- 172.21.15.60:0/2802312632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8c80c7a90 0x7fa8c8150350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:08.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.261+0000 7fa8c6ffd640 1 -- 172.21.15.60:0/2802312632 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8c80aeb10 msgr2=0x7fa8c81e06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:08.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.261+0000 7fa8c6ffd640 1 --2- 172.21.15.60:0/2802312632 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8c80aeb10 0x7fa8c81e06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:08.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.261+0000 7fa8c6ffd640 1 -- 172.21.15.60:0/2802312632 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8c81e1dd0 con 0x7fa8c80c3cf0 2024-09-12T02:31:08.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.262+0000 7fa8c6ffd640 1 --2- 172.21.15.60:0/2802312632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8c80c3cf0 0x7fa8c814fe10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc02a180 tx=0x7fa8bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:08.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.262+0000 7fa8affff640 1 -- 172.21.15.60:0/2802312632 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc037040 con 0x7fa8c80c3cf0 2024-09-12T02:31:08.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.262+0000 7fa8affff640 1 -- 172.21.15.60:0/2802312632 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8bc042070 con 0x7fa8c80c3cf0 2024-09-12T02:31:08.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.262+0000 7fa8affff640 1 -- 172.21.15.60:0/2802312632 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc030880 con 0x7fa8c80c3cf0 2024-09-12T02:31:08.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.262+0000 7fa8cdb3b640 1 -- 172.21.15.60:0/2802312632 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8c814dbd0 con 0x7fa8c80c3cf0 2024-09-12T02:31:08.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.262+0000 7fa8cdb3b640 1 -- 172.21.15.60:0/2802312632 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8c81558c0 con 0x7fa8c80c3cf0 2024-09-12T02:31:08.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.263+0000 7fa8cdb3b640 1 -- 172.21.15.60:0/2802312632 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8c8156c20 con 0x7fa8c80c3cf0 2024-09-12T02:31:08.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.263+0000 7fa8affff640 1 -- 172.21.15.60:0/2802312632 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa8bc030a20 con 0x7fa8c80c3cf0 2024-09-12T02:31:08.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.264+0000 7fa8affff640 1 --2- 172.21.15.60:0/2802312632 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa8b406be60 0x7fa8b406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:08.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.264+0000 7fa8affff640 1 -- 172.21.15.60:0/2802312632 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fa8bc0aba00 con 0x7fa8c80c3cf0 2024-09-12T02:31:08.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.264+0000 7fa8c77fe640 1 --2- 172.21.15.60:0/2802312632 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa8b406be60 0x7fa8b406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:08.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.264+0000 7fa8c77fe640 1 --2- 172.21.15.60:0/2802312632 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa8b406be60 0x7fa8b406e320 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8009b40 tx=0x7fa8b8009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:08.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.270+0000 7fa8affff640 1 -- 172.21.15.60:0/2802312632 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa8bc07a010 con 0x7fa8c80c3cf0 2024-09-12T02:31:08.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.547+0000 7fa8cdb3b640 1 -- 172.21.15.60:0/2802312632 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa8c80704b0 con 0x7fa8c80c3cf0 2024-09-12T02:31:08.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.547+0000 7fa8affff640 1 -- 172.21.15.60:0/2802312632 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1559 (secure 0 0 0) 0x7fa8bc079910 con 0x7fa8c80c3cf0 2024-09-12T02:31:08.548 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":74,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:31:08.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.549+0000 7fa8cdb3b640 1 -- 172.21.15.60:0/2802312632 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa8b406be60 msgr2=0x7fa8b406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:08.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.549+0000 7fa8cdb3b640 1 --2- 172.21.15.60:0/2802312632 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa8b406be60 0x7fa8b406e320 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8009b40 tx=0x7fa8b8009190 comp rx=0 tx=0).stop 2024-09-12T02:31:08.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.549+0000 7fa8cdb3b640 1 -- 172.21.15.60:0/2802312632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8c80c3cf0 msgr2=0x7fa8c814fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:08.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.549+0000 7fa8cdb3b640 1 --2- 172.21.15.60:0/2802312632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8c80c3cf0 0x7fa8c814fe10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc02a180 tx=0x7fa8bc0046c0 comp rx=0 tx=0).stop 2024-09-12T02:31:08.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.549+0000 7fa8cdb3b640 1 -- 172.21.15.60:0/2802312632 shutdown_connections 2024-09-12T02:31:08.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.549+0000 7fa8cdb3b640 1 --2- 172.21.15.60:0/2802312632 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa8b406be60 0x7fa8b406e320 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:08.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.549+0000 7fa8cdb3b640 1 --2- 172.21.15.60:0/2802312632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8c80c7a90 0x7fa8c8150350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:08.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.549+0000 7fa8cdb3b640 1 --2- 172.21.15.60:0/2802312632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8c80c3cf0 0x7fa8c814fe10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:08.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.549+0000 7fa8cdb3b640 1 --2- 172.21.15.60:0/2802312632 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8c80aeb10 0x7fa8c81e06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:08.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.549+0000 7fa8cdb3b640 1 -- 172.21.15.60:0/2802312632 >> 172.21.15.60:0/2802312632 conn(0x7fa8c80c5680 msgr2=0x7fa8c80c4140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:08.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.549+0000 7fa8cdb3b640 1 -- 172.21.15.60:0/2802312632 shutdown_connections 2024-09-12T02:31:08.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:08.549+0000 7fa8cdb3b640 1 -- 172.21.15.60:0/2802312632 wait complete. 2024-09-12T02:31:11.565 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:31:11.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.690+0000 7f461e2a6640 1 Processor -- start 2024-09-12T02:31:11.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.690+0000 7f461e2a6640 1 -- start start 2024-09-12T02:31:11.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.691+0000 7f461e2a6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4618153be0 0x7f46180c3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:11.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.691+0000 7f461e2a6640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f46180ac720 0x7f46180c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:11.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.691+0000 7f461e2a6640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4618153fc0 con 0x7f46180c7fb0 2024-09-12T02:31:11.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.691+0000 7f461e2a6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f4618156db0 con 0x7f4618153be0 2024-09-12T02:31:11.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.691+0000 7f461e2a6640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f46180c8420 con 0x7f46180ac720 2024-09-12T02:31:11.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.691+0000 7f4617fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4618153be0 0x7f46180c3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:11.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.691+0000 7f4617fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4618153be0 0x7f46180c3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53876/0 (socket says 172.21.15.60:53876) 2024-09-12T02:31:11.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.691+0000 7f4617fff640 1 -- 172.21.15.60:0/170306413 learned_addr learned my addr 172.21.15.60:0/170306413 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:31:11.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.691+0000 7f46177fe640 1 --2- 172.21.15.60:0/170306413 >> v2:172.21.15.105:3300/0 conn(0x7f46180ac720 0x7f46180c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:11.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.692+0000 7f4617fff640 1 -- 172.21.15.60:0/170306413 >> v2:172.21.15.105:3300/0 conn(0x7f46180ac720 msgr2=0x7f46180c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:11.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.692+0000 7f4617fff640 1 --2- 172.21.15.60:0/170306413 >> v2:172.21.15.105:3300/0 conn(0x7f46180ac720 0x7f46180c7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:11.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.692+0000 7f4617fff640 1 -- 172.21.15.60:0/170306413 >> v1:172.21.15.105:6789/0 conn(0x7f46180c7fb0 legacy=0x7f46181598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:11.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.692+0000 7f4617fff640 1 -- 172.21.15.60:0/170306413 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46180a8030 con 0x7f4618153be0 2024-09-12T02:31:11.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.692+0000 7f46177fe640 1 --2- 172.21.15.60:0/170306413 >> v2:172.21.15.105:3300/0 conn(0x7f46180ac720 0x7f46180c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:31:11.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.693+0000 7f4617fff640 1 --2- 172.21.15.60:0/170306413 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4618153be0 0x7f46180c3560 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f46180ac130 tx=0x7f460802a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53a5f5479a7dd991 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:11.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.693+0000 7f4616ffd640 1 -- 172.21.15.60:0/170306413 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4608037070 con 0x7f4618153be0 2024-09-12T02:31:11.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.693+0000 7f4616ffd640 1 -- 172.21.15.60:0/170306413 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4608032440 con 0x7f4618153be0 2024-09-12T02:31:11.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.693+0000 7f4616ffd640 1 -- 172.21.15.60:0/170306413 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4608032810 con 0x7f4618153be0 2024-09-12T02:31:11.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.693+0000 7f461e2a6640 1 -- 172.21.15.60:0/170306413 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4618153be0 msgr2=0x7f46180c3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:11.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.693+0000 7f461e2a6640 1 --2- 172.21.15.60:0/170306413 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4618153be0 0x7f46180c3560 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f46180ac130 tx=0x7f460802a150 comp rx=0 tx=0).stop 2024-09-12T02:31:11.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.693+0000 7f461e2a6640 1 -- 172.21.15.60:0/170306413 shutdown_connections 2024-09-12T02:31:11.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.693+0000 7f461e2a6640 1 --2- 172.21.15.60:0/170306413 >> v2:172.21.15.105:3300/0 conn(0x7f46180ac720 0x7f46180c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:11.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.693+0000 7f461e2a6640 1 --2- 172.21.15.60:0/170306413 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4618153be0 0x7f46180c3560 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:11.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.693+0000 7f461e2a6640 1 -- 172.21.15.60:0/170306413 >> 172.21.15.60:0/170306413 conn(0x7f46180c5660 msgr2=0x7f46180c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:11.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.693+0000 7f461e2a6640 1 -- 172.21.15.60:0/170306413 shutdown_connections 2024-09-12T02:31:11.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.693+0000 7f461e2a6640 1 -- 172.21.15.60:0/170306413 wait complete. 2024-09-12T02:31:11.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.695+0000 7f461e2a6640 1 Processor -- start 2024-09-12T02:31:11.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.695+0000 7f461e2a6640 1 -- start start 2024-09-12T02:31:11.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.696+0000 7f461e2a6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46180ac720 0x7f46181e1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:11.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.696+0000 7f461e2a6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46180c7fb0 0x7f4618152b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:11.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.696+0000 7f461e2a6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4618153be0 0x7f46181530d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:11.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.696+0000 7f461e2a6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f46180a83e0 con 0x7f46180ac720 2024-09-12T02:31:11.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.696+0000 7f461e2a6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4618157240 con 0x7f46180c7fb0 2024-09-12T02:31:11.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.696+0000 7f461e2a6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f46180ac370 con 0x7f4618153be0 2024-09-12T02:31:11.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.696+0000 7f4617fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46180ac720 0x7f46181e1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:11.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.696+0000 7f4617fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46180ac720 0x7f46181e1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53882/0 (socket says 172.21.15.60:53882) 2024-09-12T02:31:11.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.696+0000 7f4617fff640 1 -- 172.21.15.60:0/3196037399 learned_addr learned my addr 172.21.15.60:0/3196037399 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:31:11.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.696+0000 7f46177fe640 1 --2- 172.21.15.60:0/3196037399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46180c7fb0 0x7f4618152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:11.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.696+0000 7f461c843640 1 --2- 172.21.15.60:0/3196037399 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4618153be0 0x7f46181530d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:11.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.696+0000 7f461c843640 1 -- 172.21.15.60:0/3196037399 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4618153be0 msgr2=0x7f46181530d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-12T02:31:11.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.696+0000 7f461c843640 1 -- 172.21.15.60:0/3196037399 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4618153be0 msgr2=0x7f46181530d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:31:11.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.696+0000 7f461c843640 1 --2- 172.21.15.60:0/3196037399 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4618153be0 0x7f46181530d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:31:11.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.696+0000 7f461c843640 1 --2- 172.21.15.60:0/3196037399 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4618153be0 0x7f46181530d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:31:11.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.696+0000 7f4617fff640 1 -- 172.21.15.60:0/3196037399 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4618153be0 msgr2=0x7f46181530d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:31:11.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.696+0000 7f4617fff640 1 --2- 172.21.15.60:0/3196037399 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4618153be0 0x7f46181530d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:11.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.696+0000 7f4617fff640 1 -- 172.21.15.60:0/3196037399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46180c7fb0 msgr2=0x7f4618152b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:11.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.696+0000 7f4617fff640 1 --2- 172.21.15.60:0/3196037399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46180c7fb0 0x7f4618152b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:11.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.696+0000 7f4617fff640 1 -- 172.21.15.60:0/3196037399 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4618157490 con 0x7f46180ac720 2024-09-12T02:31:11.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.696+0000 7f46177fe640 1 --2- 172.21.15.60:0/3196037399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46180c7fb0 0x7f4618152b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:31:11.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.697+0000 7f4617fff640 1 --2- 172.21.15.60:0/3196037399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46180ac720 0x7f46181e1cf0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f460802a190 tx=0x7f46080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:11.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.697+0000 7f4614ff9640 1 -- 172.21.15.60:0/3196037399 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4608037040 con 0x7f46180ac720 2024-09-12T02:31:11.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.697+0000 7f4614ff9640 1 -- 172.21.15.60:0/3196037399 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4608042070 con 0x7f46180ac720 2024-09-12T02:31:11.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.697+0000 7f461e2a6640 1 -- 172.21.15.60:0/3196037399 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4618157770 con 0x7f46180ac720 2024-09-12T02:31:11.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.697+0000 7f4614ff9640 1 -- 172.21.15.60:0/3196037399 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4608030880 con 0x7f46180ac720 2024-09-12T02:31:11.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.697+0000 7f461e2a6640 1 -- 172.21.15.60:0/3196037399 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4618157d30 con 0x7f46180ac720 2024-09-12T02:31:11.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.698+0000 7f461e2a6640 1 -- 172.21.15.60:0/3196037399 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46180c63f0 con 0x7f46180ac720 2024-09-12T02:31:11.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.699+0000 7f4614ff9640 1 -- 172.21.15.60:0/3196037399 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4608030a20 con 0x7f46180ac720 2024-09-12T02:31:11.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.699+0000 7f4614ff9640 1 --2- 172.21.15.60:0/3196037399 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f460406be30 0x7f460406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:11.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.699+0000 7f4614ff9640 1 -- 172.21.15.60:0/3196037399 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f46080ab900 con 0x7f46180ac720 2024-09-12T02:31:11.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.699+0000 7f46177fe640 1 --2- 172.21.15.60:0/3196037399 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f460406be30 0x7f460406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:11.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.700+0000 7f46177fe640 1 --2- 172.21.15.60:0/3196037399 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f460406be30 0x7f460406e2f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f46181e2520 tx=0x7f460c009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:11.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.704+0000 7f4614ff9640 1 -- 172.21.15.60:0/3196037399 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4608079fa0 con 0x7f46180ac720 2024-09-12T02:31:11.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.980+0000 7f461e2a6640 1 -- 172.21.15.60:0/3196037399 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f46180c5ea0 con 0x7f46180ac720 2024-09-12T02:31:11.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.981+0000 7f4614ff9640 1 -- 172.21.15.60:0/3196037399 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1559 (secure 0 0 0) 0x7f46080798a0 con 0x7f46180ac720 2024-09-12T02:31:11.982 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":74,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:31:11.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.983+0000 7f461e2a6640 1 -- 172.21.15.60:0/3196037399 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f460406be30 msgr2=0x7f460406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:11.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.983+0000 7f461e2a6640 1 --2- 172.21.15.60:0/3196037399 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f460406be30 0x7f460406e2f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f46181e2520 tx=0x7f460c009190 comp rx=0 tx=0).stop 2024-09-12T02:31:11.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.983+0000 7f461e2a6640 1 -- 172.21.15.60:0/3196037399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46180ac720 msgr2=0x7f46181e1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:11.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.983+0000 7f461e2a6640 1 --2- 172.21.15.60:0/3196037399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46180ac720 0x7f46181e1cf0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f460802a190 tx=0x7f46080046c0 comp rx=0 tx=0).stop 2024-09-12T02:31:11.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.983+0000 7f461e2a6640 1 -- 172.21.15.60:0/3196037399 shutdown_connections 2024-09-12T02:31:11.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.983+0000 7f461e2a6640 1 --2- 172.21.15.60:0/3196037399 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f460406be30 0x7f460406e2f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:11.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.983+0000 7f461e2a6640 1 --2- 172.21.15.60:0/3196037399 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4618153be0 0x7f46181530d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:11.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.983+0000 7f461e2a6640 1 --2- 172.21.15.60:0/3196037399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46180c7fb0 0x7f4618152b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:11.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.983+0000 7f461e2a6640 1 --2- 172.21.15.60:0/3196037399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46180ac720 0x7f46181e1cf0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:11.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.983+0000 7f461e2a6640 1 -- 172.21.15.60:0/3196037399 >> 172.21.15.60:0/3196037399 conn(0x7f46180c5660 msgr2=0x7f46180c77f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:11.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.983+0000 7f461e2a6640 1 -- 172.21.15.60:0/3196037399 shutdown_connections 2024-09-12T02:31:11.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:11.983+0000 7f461e2a6640 1 -- 172.21.15.60:0/3196037399 wait complete. 2024-09-12T02:31:14.997 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:31:15.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.114+0000 7f05ba6af640 1 Processor -- start 2024-09-12T02:31:15.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.114+0000 7f05ba6af640 1 -- start start 2024-09-12T02:31:15.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.114+0000 7f05ba6af640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f05b40ad6a0 0x7f05b4159c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:15.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.114+0000 7f05ba6af640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05b4153fd0 0x7f05b415a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:15.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.114+0000 7f05ba6af640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05b40c2f60 con 0x7f05b40c5130 2024-09-12T02:31:15.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.114+0000 7f05ba6af640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f05b40c1f80 con 0x7f05b40ad6a0 2024-09-12T02:31:15.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.114+0000 7f05ba6af640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f05b40c3240 con 0x7f05b4153fd0 2024-09-12T02:31:15.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.115+0000 7f05b3fff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f05b40c5130 0x7f05b41538c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:59912/0 (socket says 172.21.15.60:59912) 2024-09-12T02:31:15.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.115+0000 7f05b3fff640 1 -- 172.21.15.60:0/450925098 learned_addr learned my addr 172.21.15.60:0/450925098 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:31:15.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.115+0000 7f05abfff640 1 --2- 172.21.15.60:0/450925098 >> v2:172.21.15.105:3300/0 conn(0x7f05b40ad6a0 0x7f05b4159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:15.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.115+0000 7f05b8c4c640 1 --2- 172.21.15.60:0/450925098 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05b4153fd0 0x7f05b415a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:15.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.115+0000 7f05b8c4c640 1 -- 172.21.15.60:0/450925098 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05b4153fd0 msgr2=0x7f05b415a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:31:15.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.115+0000 7f05b8c4c640 1 -- 172.21.15.60:0/450925098 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05b4153fd0 msgr2=0x7f05b415a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:31:15.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.115+0000 7f05b8c4c640 1 --2- 172.21.15.60:0/450925098 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05b4153fd0 0x7f05b415a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:31:15.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.115+0000 7f05b8c4c640 1 --2- 172.21.15.60:0/450925098 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05b4153fd0 0x7f05b415a1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:31:15.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.115+0000 7f05b37fe640 1 -- 172.21.15.60:0/450925098 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2238691250 0 0) 0x7f05b40c2f60 con 0x7f05b40c5130 2024-09-12T02:31:15.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.115+0000 7f05b37fe640 1 -- 172.21.15.60:0/450925098 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05a0003520 con 0x7f05b40c5130 2024-09-12T02:31:15.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.115+0000 7f05abfff640 1 -- 172.21.15.60:0/450925098 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05b4153fd0 msgr2=0x7f05b415a1a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:31:15.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.115+0000 7f05abfff640 1 --2- 172.21.15.60:0/450925098 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05b4153fd0 0x7f05b415a1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.115+0000 7f05abfff640 1 -- 172.21.15.60:0/450925098 >> v1:172.21.15.60:6789/0 conn(0x7f05b40c5130 legacy=0x7f05b41538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:15.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.115+0000 7f05abfff640 1 -- 172.21.15.60:0/450925098 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05b40c1c10 con 0x7f05b40ad6a0 2024-09-12T02:31:15.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.116+0000 7f05abfff640 1 --2- 172.21.15.60:0/450925098 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05b40ad6a0 0x7f05b4159c60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f059c0097a0 tx=0x7f059c02a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6daad33f1d7c05f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:15.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.116+0000 7f05b37fe640 1 -- 172.21.15.60:0/450925098 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059c037070 con 0x7f05b40ad6a0 2024-09-12T02:31:15.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.116+0000 7f05b37fe640 1 -- 172.21.15.60:0/450925098 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f059c02adb0 con 0x7f05b40ad6a0 2024-09-12T02:31:15.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.116+0000 7f05b37fe640 1 -- 172.21.15.60:0/450925098 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059c032640 con 0x7f05b40ad6a0 2024-09-12T02:31:15.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.117+0000 7f05ba6af640 1 -- 172.21.15.60:0/450925098 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05b40ad6a0 msgr2=0x7f05b4159c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:15.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.117+0000 7f05ba6af640 1 --2- 172.21.15.60:0/450925098 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05b40ad6a0 0x7f05b4159c60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f059c0097a0 tx=0x7f059c02a060 comp rx=0 tx=0).stop 2024-09-12T02:31:15.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.117+0000 7f05ba6af640 1 -- 172.21.15.60:0/450925098 shutdown_connections 2024-09-12T02:31:15.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.117+0000 7f05ba6af640 1 --2- 172.21.15.60:0/450925098 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05b4153fd0 0x7f05b415a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.117+0000 7f05ba6af640 1 --2- 172.21.15.60:0/450925098 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05b40ad6a0 0x7f05b4159c60 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.117+0000 7f05ba6af640 1 -- 172.21.15.60:0/450925098 >> 172.21.15.60:0/450925098 conn(0x7f05b40c8430 msgr2=0x7f05b40c8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:15.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.117+0000 7f05ba6af640 1 -- 172.21.15.60:0/450925098 shutdown_connections 2024-09-12T02:31:15.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.117+0000 7f05ba6af640 1 -- 172.21.15.60:0/450925098 wait complete. 2024-09-12T02:31:15.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.118+0000 7f05ba6af640 1 Processor -- start 2024-09-12T02:31:15.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.118+0000 7f05ba6af640 1 -- start start 2024-09-12T02:31:15.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.119+0000 7f05ba6af640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05b40ad6a0 0x7f05b40a99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:15.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.119+0000 7f05ba6af640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05b40c5130 0x7f05b41ebc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:15.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.119+0000 7f05ba6af640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05b4153fd0 0x7f05b41ec170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:15.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.119+0000 7f05ba6af640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f05b40c5690 con 0x7f05b4153fd0 2024-09-12T02:31:15.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.119+0000 7f05ba6af640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f05b40c5510 con 0x7f05b40c5130 2024-09-12T02:31:15.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.119+0000 7f05ba6af640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f05b415a6e0 con 0x7f05b40ad6a0 2024-09-12T02:31:15.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.119+0000 7f05b8c4c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05b4153fd0 0x7f05b41ec170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:15.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.119+0000 7f05b8c4c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05b4153fd0 0x7f05b41ec170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53884/0 (socket says 172.21.15.60:53884) 2024-09-12T02:31:15.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.120+0000 7f05b8c4c640 1 -- 172.21.15.60:0/1392553792 learned_addr learned my addr 172.21.15.60:0/1392553792 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:31:15.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.120+0000 7f05b3fff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05b40ad6a0 0x7f05b40a99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:15.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.120+0000 7f05abfff640 1 --2- 172.21.15.60:0/1392553792 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05b40c5130 0x7f05b41ebc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:15.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.120+0000 7f05b3fff640 1 -- 172.21.15.60:0/1392553792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05b40ad6a0 msgr2=0x7f05b40a99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-12T02:31:15.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.120+0000 7f05b3fff640 1 -- 172.21.15.60:0/1392553792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05b40ad6a0 msgr2=0x7f05b40a99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:31:15.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.120+0000 7f05b3fff640 1 --2- 172.21.15.60:0/1392553792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05b40ad6a0 0x7f05b40a99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:31:15.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.120+0000 7f05b3fff640 1 --2- 172.21.15.60:0/1392553792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05b40ad6a0 0x7f05b40a99e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:31:15.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.120+0000 7f05b8c4c640 1 -- 172.21.15.60:0/1392553792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05b40ad6a0 msgr2=0x7f05b40a99e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:31:15.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.120+0000 7f05b8c4c640 1 --2- 172.21.15.60:0/1392553792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05b40ad6a0 0x7f05b40a99e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.120+0000 7f05b8c4c640 1 -- 172.21.15.60:0/1392553792 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05b40c5130 msgr2=0x7f05b41ebc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:15.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.120+0000 7f05b8c4c640 1 --2- 172.21.15.60:0/1392553792 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05b40c5130 0x7f05b41ebc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.120+0000 7f05b8c4c640 1 -- 172.21.15.60:0/1392553792 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05b41ec6b0 con 0x7f05b4153fd0 2024-09-12T02:31:15.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.120+0000 7f05b8c4c640 1 --2- 172.21.15.60:0/1392553792 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05b4153fd0 0x7f05b41ec170 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f05ac007e30 tx=0x7f05ac00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:15.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.120+0000 7f05b17fa640 1 -- 172.21.15.60:0/1392553792 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ac014420 con 0x7f05b4153fd0 2024-09-12T02:31:15.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.120+0000 7f05b17fa640 1 -- 172.21.15.60:0/1392553792 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05ac019070 con 0x7f05b4153fd0 2024-09-12T02:31:15.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.120+0000 7f05ba6af640 1 -- 172.21.15.60:0/1392553792 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05b40746b0 con 0x7f05b4153fd0 2024-09-12T02:31:15.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.120+0000 7f05b17fa640 1 -- 172.21.15.60:0/1392553792 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ac014820 con 0x7f05b4153fd0 2024-09-12T02:31:15.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.120+0000 7f05ba6af640 1 -- 172.21.15.60:0/1392553792 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05b4156db0 con 0x7f05b4153fd0 2024-09-12T02:31:15.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.122+0000 7f05ba6af640 1 -- 172.21.15.60:0/1392553792 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05b4067950 con 0x7f05b4153fd0 2024-09-12T02:31:15.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.122+0000 7f05b17fa640 1 -- 172.21.15.60:0/1392553792 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f05ac0149c0 con 0x7f05b4153fd0 2024-09-12T02:31:15.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.123+0000 7f05b17fa640 1 --2- 172.21.15.60:0/1392553792 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f059406be30 0x7f059406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:15.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.123+0000 7f05b17fa640 1 -- 172.21.15.60:0/1392553792 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f05ac08b960 con 0x7f05b4153fd0 2024-09-12T02:31:15.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.123+0000 7f05b3fff640 1 --2- 172.21.15.60:0/1392553792 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f059406be30 0x7f059406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:15.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.123+0000 7f05b3fff640 1 --2- 172.21.15.60:0/1392553792 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f059406be30 0x7f059406e2f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f05a4005880 tx=0x7f05a4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:15.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.127+0000 7f05b17fa640 1 -- 172.21.15.60:0/1392553792 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f05b41ec6b0 con 0x7f05b4153fd0 2024-09-12T02:31:15.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.450+0000 7f05ba6af640 1 -- 172.21.15.60:0/1392553792 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f05b40c89d0 con 0x7f05b4153fd0 2024-09-12T02:31:15.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.450+0000 7f05b17fa640 1 -- 172.21.15.60:0/1392553792 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7f05ac05a000 con 0x7f05b4153fd0 2024-09-12T02:31:15.451 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":76,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:31:15.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.453+0000 7f05ba6af640 1 -- 172.21.15.60:0/1392553792 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f059406be30 msgr2=0x7f059406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:15.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.453+0000 7f05ba6af640 1 --2- 172.21.15.60:0/1392553792 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f059406be30 0x7f059406e2f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f05a4005880 tx=0x7f05a4009040 comp rx=0 tx=0).stop 2024-09-12T02:31:15.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.453+0000 7f05ba6af640 1 -- 172.21.15.60:0/1392553792 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05b4153fd0 msgr2=0x7f05b41ec170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:15.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.453+0000 7f05ba6af640 1 --2- 172.21.15.60:0/1392553792 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05b4153fd0 0x7f05b41ec170 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f05ac007e30 tx=0x7f05ac00e4b0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.453+0000 7f05ba6af640 1 -- 172.21.15.60:0/1392553792 shutdown_connections 2024-09-12T02:31:15.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.453+0000 7f05ba6af640 1 --2- 172.21.15.60:0/1392553792 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f059406be30 0x7f059406e2f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.453+0000 7f05ba6af640 1 --2- 172.21.15.60:0/1392553792 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05b4153fd0 0x7f05b41ec170 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.453+0000 7f05ba6af640 1 --2- 172.21.15.60:0/1392553792 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05b40c5130 0x7f05b41ebc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.453+0000 7f05ba6af640 1 --2- 172.21.15.60:0/1392553792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05b40ad6a0 0x7f05b40a99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.453+0000 7f05ba6af640 1 -- 172.21.15.60:0/1392553792 >> 172.21.15.60:0/1392553792 conn(0x7f05b40c8430 msgr2=0x7f05b4157fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:15.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.453+0000 7f05ba6af640 1 -- 172.21.15.60:0/1392553792 shutdown_connections 2024-09-12T02:31:15.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.453+0000 7f05ba6af640 1 -- 172.21.15.60:0/1392553792 wait complete. 2024-09-12T02:31:15.465 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-12T02:31:15.465 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-12T02:31:15.465 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-12T02:31:15.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.574+0000 7fb65c20a640 1 Processor -- start 2024-09-12T02:31:15.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.575+0000 7fb65c20a640 1 -- start start 2024-09-12T02:31:15.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.576+0000 7fb65c20a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb654150480 0x7fb6540c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:15.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.576+0000 7fb65c20a640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb65406c650 0x7fb6540c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:15.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.576+0000 7fb65c20a640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb65415a7c0 con 0x7fb6540c9c80 2024-09-12T02:31:15.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.576+0000 7fb65c20a640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fb65406c240 con 0x7fb65406c650 2024-09-12T02:31:15.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.576+0000 7fb65c20a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb65415a330 con 0x7fb654150480 2024-09-12T02:31:15.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.576+0000 7fb65a7a7640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb6540c9c80 0x7fb6540ca130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:59924/0 (socket says 172.21.15.60:59924) 2024-09-12T02:31:15.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.576+0000 7fb65a7a7640 1 -- 172.21.15.60:0/746839721 learned_addr learned my addr 172.21.15.60:0/746839721 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:31:15.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.576+0000 7fb659fa6640 1 --2- 172.21.15.60:0/746839721 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb654150480 0x7fb6540c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:15.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.576+0000 7fb6597a5640 1 --2- 172.21.15.60:0/746839721 >> v2:172.21.15.105:3300/0 conn(0x7fb65406c650 0x7fb6540c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:15.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.576+0000 7fb658fa4640 1 -- 172.21.15.60:0/746839721 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 956927228 0 0) 0x7fb65415a7c0 con 0x7fb6540c9c80 2024-09-12T02:31:15.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.576+0000 7fb658fa4640 1 -- 172.21.15.60:0/746839721 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb640003520 con 0x7fb6540c9c80 2024-09-12T02:31:15.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.576+0000 7fb659fa6640 1 -- 172.21.15.60:0/746839721 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb654150480 msgr2=0x7fb6540c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:31:15.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.576+0000 7fb659fa6640 1 -- 172.21.15.60:0/746839721 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb654150480 msgr2=0x7fb6540c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:31:15.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.576+0000 7fb659fa6640 1 --2- 172.21.15.60:0/746839721 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb654150480 0x7fb6540c7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:31:15.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.576+0000 7fb659fa6640 1 --2- 172.21.15.60:0/746839721 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb654150480 0x7fb6540c7a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:31:15.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.576+0000 7fb658fa4640 1 -- 172.21.15.60:0/746839721 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4097962060 0 0) 0x7fb640003520 con 0x7fb6540c9c80 2024-09-12T02:31:15.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.576+0000 7fb6597a5640 1 -- 172.21.15.60:0/746839721 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb654150480 msgr2=0x7fb6540c7a90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:31:15.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.576+0000 7fb6597a5640 1 --2- 172.21.15.60:0/746839721 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb654150480 0x7fb6540c7a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.576+0000 7fb6597a5640 1 -- 172.21.15.60:0/746839721 >> v1:172.21.15.60:6789/0 conn(0x7fb6540c9c80 legacy=0x7fb6540ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:15.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.576+0000 7fb6597a5640 1 -- 172.21.15.60:0/746839721 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb654159a00 con 0x7fb65406c650 2024-09-12T02:31:15.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.577+0000 7fb6597a5640 1 --2- 172.21.15.60:0/746839721 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb65406c650 0x7fb6540c7fd0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb6440097a0 tx=0x7fb64402a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e808b20985c88ab server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:15.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.578+0000 7fb658fa4640 1 -- 172.21.15.60:0/746839721 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb644037070 con 0x7fb65406c650 2024-09-12T02:31:15.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.578+0000 7fb658fa4640 1 -- 172.21.15.60:0/746839721 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb64402aba0 con 0x7fb65406c650 2024-09-12T02:31:15.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.578+0000 7fb658fa4640 1 -- 172.21.15.60:0/746839721 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb64c0019f0 con 0x7fb65406c650 2024-09-12T02:31:15.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.578+0000 7fb65c20a640 1 -- 172.21.15.60:0/746839721 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb65406c650 msgr2=0x7fb6540c7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:15.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.578+0000 7fb65c20a640 1 --2- 172.21.15.60:0/746839721 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb65406c650 0x7fb6540c7fd0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb6440097a0 tx=0x7fb64402a110 comp rx=0 tx=0).stop 2024-09-12T02:31:15.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.578+0000 7fb65c20a640 1 -- 172.21.15.60:0/746839721 shutdown_connections 2024-09-12T02:31:15.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.578+0000 7fb65c20a640 1 --2- 172.21.15.60:0/746839721 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb65406c650 0x7fb6540c7fd0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.578+0000 7fb65c20a640 1 --2- 172.21.15.60:0/746839721 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb654150480 0x7fb6540c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.578+0000 7fb65c20a640 1 -- 172.21.15.60:0/746839721 >> 172.21.15.60:0/746839721 conn(0x7fb654068030 msgr2=0x7fb654073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:15.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.578+0000 7fb65c20a640 1 -- 172.21.15.60:0/746839721 shutdown_connections 2024-09-12T02:31:15.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.578+0000 7fb65c20a640 1 -- 172.21.15.60:0/746839721 wait complete. 2024-09-12T02:31:15.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.580+0000 7fb65c20a640 1 Processor -- start 2024-09-12T02:31:15.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.580+0000 7fb65c20a640 1 -- start start 2024-09-12T02:31:15.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.580+0000 7fb65c20a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb65406c650 0x7fb6540b0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:15.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.580+0000 7fb65c20a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6540c9c80 0x7fb6541ec320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:15.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.580+0000 7fb65c20a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb654150480 0x7fb6541ec860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:15.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.580+0000 7fb65c20a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb65406d270 con 0x7fb6540c9c80 2024-09-12T02:31:15.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.580+0000 7fb65c20a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb654159fc0 con 0x7fb654150480 2024-09-12T02:31:15.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.580+0000 7fb65c20a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb654156270 con 0x7fb65406c650 2024-09-12T02:31:15.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.581+0000 7fb6597a5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6540c9c80 0x7fb6541ec320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:15.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.581+0000 7fb659fa6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb65406c650 0x7fb6540b0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:15.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.581+0000 7fb6597a5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6540c9c80 0x7fb6541ec320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53888/0 (socket says 172.21.15.60:53888) 2024-09-12T02:31:15.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.581+0000 7fb65a7a7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb654150480 0x7fb6541ec860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:15.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.581+0000 7fb6597a5640 1 -- 172.21.15.60:0/3131461744 learned_addr learned my addr 172.21.15.60:0/3131461744 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:31:15.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.581+0000 7fb659fa6640 1 -- 172.21.15.60:0/3131461744 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb65406c650 msgr2=0x7fb6540b0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-12T02:31:15.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.581+0000 7fb659fa6640 1 -- 172.21.15.60:0/3131461744 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb65406c650 msgr2=0x7fb6540b0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:31:15.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.581+0000 7fb659fa6640 1 --2- 172.21.15.60:0/3131461744 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb65406c650 0x7fb6540b0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:31:15.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.581+0000 7fb659fa6640 1 --2- 172.21.15.60:0/3131461744 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb65406c650 0x7fb6540b0470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:31:15.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.581+0000 7fb6597a5640 1 -- 172.21.15.60:0/3131461744 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb65406c650 msgr2=0x7fb6540b0470 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:31:15.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.581+0000 7fb6597a5640 1 --2- 172.21.15.60:0/3131461744 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb65406c650 0x7fb6540b0470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.581+0000 7fb6597a5640 1 -- 172.21.15.60:0/3131461744 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb654150480 msgr2=0x7fb6541ec860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:15.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.581+0000 7fb6597a5640 1 --2- 172.21.15.60:0/3131461744 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb654150480 0x7fb6541ec860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.581+0000 7fb6597a5640 1 -- 172.21.15.60:0/3131461744 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6541efff0 con 0x7fb6540c9c80 2024-09-12T02:31:15.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.581+0000 7fb6597a5640 1 --2- 172.21.15.60:0/3131461744 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6540c9c80 0x7fb6541ec320 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb6440098c0 tx=0x7fb6440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:15.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.581+0000 7fb64a7fc640 1 -- 172.21.15.60:0/3131461744 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb644041020 con 0x7fb6540c9c80 2024-09-12T02:31:15.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.581+0000 7fb64a7fc640 1 -- 172.21.15.60:0/3131461744 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb64403d620 con 0x7fb6540c9c80 2024-09-12T02:31:15.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.581+0000 7fb65c20a640 1 -- 172.21.15.60:0/3131461744 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6541f0290 con 0x7fb6540c9c80 2024-09-12T02:31:15.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.581+0000 7fb64a7fc640 1 -- 172.21.15.60:0/3131461744 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb644037040 con 0x7fb6540c9c80 2024-09-12T02:31:15.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.582+0000 7fb65c20a640 1 -- 172.21.15.60:0/3131461744 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6541e2070 con 0x7fb6540c9c80 2024-09-12T02:31:15.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.582+0000 7fb65c20a640 1 --2- 172.21.15.60:0/3131461744 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6541ecda0 0x7fb65414f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:15.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.582+0000 7fb65c20a640 1 -- 172.21.15.60:0/3131461744 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb6541e1bf0 con 0x7fb6541ecda0 2024-09-12T02:31:15.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.583+0000 7fb659fa6640 1 --2- 172.21.15.60:0/3131461744 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6541ecda0 0x7fb65414f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:15.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.583+0000 7fb659fa6640 1 -- 172.21.15.60:0/3131461744 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb6541539e0 con 0x7fb6541ecda0 2024-09-12T02:31:15.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.583+0000 7fb659fa6640 1 --2- 172.21.15.60:0/3131461744 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6541ecda0 0x7fb65414f200 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb650006fd0 tx=0x7fb65000f930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:15.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.583+0000 7fb64a7fc640 1 -- 172.21.15.60:0/3131461744 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb650019020 con 0x7fb6541ecda0 2024-09-12T02:31:15.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.583+0000 7fb64a7fc640 1 -- 172.21.15.60:0/3131461744 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb644044020 con 0x7fb6540c9c80 2024-09-12T02:31:15.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.584+0000 7fb64a7fc640 1 --2- 172.21.15.60:0/3131461744 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb63806bd30 0x7fb63806e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:15.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.584+0000 7fb64a7fc640 1 -- 172.21.15.60:0/3131461744 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fb6440ab700 con 0x7fb6540c9c80 2024-09-12T02:31:15.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.584+0000 7fb65a7a7640 1 --2- 172.21.15.60:0/3131461744 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb63806bd30 0x7fb63806e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:15.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.584+0000 7fb64a7fc640 1 -- 172.21.15.60:0/3131461744 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fb650014870 con 0x7fb6541ecda0 2024-09-12T02:31:15.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.584+0000 7fb64a7fc640 1 -- 172.21.15.60:0/3131461744 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6541ecda0 msgr2=0x7fb65414f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:15.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.584+0000 7fb64a7fc640 1 --2- 172.21.15.60:0/3131461744 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6541ecda0 0x7fb65414f200 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb650006fd0 tx=0x7fb65000f930 comp rx=0 tx=0).stop 2024-09-12T02:31:15.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.584+0000 7fb64a7fc640 1 -- 172.21.15.60:0/3131461744 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6541ecda0 msgr2=0x7fb65414f200 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:31:15.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.584+0000 7fb64a7fc640 1 --2- 172.21.15.60:0/3131461744 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6541ecda0 0x7fb65414f200 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.585+0000 7fb65a7a7640 1 --2- 172.21.15.60:0/3131461744 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb63806bd30 0x7fb63806e1f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb64c002230 tx=0x7fb64c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:15.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.591+0000 7fb65c20a640 1 --2- 172.21.15.60:0/3131461744 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb65414f740 0x7fb65414fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:15.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.591+0000 7fb65c20a640 1 -- 172.21.15.60:0/3131461744 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb6540ca130 con 0x7fb65414f740 2024-09-12T02:31:15.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.591+0000 7fb659fa6640 1 --2- 172.21.15.60:0/3131461744 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb65414f740 0x7fb65414fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:15.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.592+0000 7fb659fa6640 1 -- 172.21.15.60:0/3131461744 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb6541f0460 con 0x7fb65414f740 2024-09-12T02:31:15.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.592+0000 7fb659fa6640 1 --2- 172.21.15.60:0/3131461744 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb65414f740 0x7fb65414fb50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb650006fd0 tx=0x7fb6500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:15.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.592+0000 7fb64a7fc640 1 -- 172.21.15.60:0/3131461744 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb65001e8f0 con 0x7fb65414f740 2024-09-12T02:31:15.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.592+0000 7fb64a7fc640 1 -- 172.21.15.60:0/3131461744 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4885 (secure 0 0 0) 0x7fb65002a430 con 0x7fb65414f740 2024-09-12T02:31:15.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.592+0000 7fb64a7fc640 1 -- 172.21.15.60:0/3131461744 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb65414f740 msgr2=0x7fb65414fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:15.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.592+0000 7fb64a7fc640 1 --2- 172.21.15.60:0/3131461744 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb65414f740 0x7fb65414fb50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb650006fd0 tx=0x7fb6500046c0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.593+0000 7fb64a7fc640 1 -- 172.21.15.60:0/3131461744 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb65414f740 msgr2=0x7fb65414fb50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:31:15.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.593+0000 7fb64a7fc640 1 --2- 172.21.15.60:0/3131461744 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb65414f740 0x7fb65414fb50 secure :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb650006fd0 tx=0x7fb6500046c0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.594 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:31:15.594 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:31:15.594 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:31:15.594 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:31:15.594 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 76, 2024-09-12T02:31:15.594 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 138696, 2024-09-12T02:31:15.594 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:31:15.595 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:31:15.595 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:31:15.595 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:31:15.595 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:31:15.595 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 1, 2024-09-12T02:31:15.595 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:31:15.595 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:31:15.595 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:31:15.595 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:31:15.595 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:31:15.595 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:31:15.595 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:31:15.595 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:31:15.595 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:31:15.596 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:31:15.596 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:31:15.596 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:31:15.596 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:31:15.596 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:31:15.596 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:31:15.596 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:31:15.596 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:31:15.596 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:31:15.596 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:31:15.596 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:31:15.596 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:31:15.596 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:31:15.596 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:31:15.597 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:31:15.597 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:31:15.597 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:31:15.597 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:31:15.597 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:31:15.597 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:15.597 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:15.597 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:31:15.597 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:31:15.597 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:31:15.597 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:31:15.597 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:31:15.597 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:31:15.598 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:31:15.598 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:31:15.598 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:31:15.598 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:31:15.598 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:31:15.598 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:31:15.598 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:31:15.598 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:31:15.599 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:31:15.599 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:31:15.599 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:31:15.599 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:31:15.599 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:31:15.599 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:31:15.599 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:31:15.599 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:31:15.599 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:31:15.599 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:31:15.600 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:31:15.600 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:31:15.600 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:31:15.600 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:31:15.600 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:31:15.600 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:31:15.600 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:15.600 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:31:15.600 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:15.600 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:31:15.600 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:31:15.600 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:31:15.600 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:31:15.600 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:15.601 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:31:15.601 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:31:15.601 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:15.601 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:15.601 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:15.601 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:31:15.601 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:31:15.601 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:15.601 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:15.601 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:15.601 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:15.601 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:31:15.601 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:31:15.601 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:31:15.602 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:31:15.602 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:31:15.602 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:15.602 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:15.602 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:31:15.602 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:31:15.602 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:31:15.602 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:31:15.602 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:15.602 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:31:15.602 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:31:15.602 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:15.602 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:15.603 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:15.603 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:31:15.603 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:31:15.603 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:15.603 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:15.603 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:15.603 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:15.603 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:31:15.603 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:31:15.603 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:31:15.603 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:31:15.603 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:31:15.603 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:15.603 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:15.604 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:31:15.604 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:31:15.604 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:31:15.604 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:31:15.604 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:15.604 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:31:15.604 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:31:15.604 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:15.604 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:15.604 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:15.604 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:31:15.604 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:31:15.604 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:15.605 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:15.605 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:15.605 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:15.605 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:31:15.605 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:31:15.605 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:31:15.605 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:31:15.605 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:31:15.605 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:15.605 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:15.605 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:15.605 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:31:15.605 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:31:15.605 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:15.606 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:31:15.606 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:31:15.606 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:31:15.606 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:15.606 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:31:15.606 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:31:15.606 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:15.606 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:31:15.606 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:31:15.606 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:31:15.606 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:15.606 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:31:15.606 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:31:15.606 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:15.607 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:31:15.607 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:31:15.607 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:31:15.607 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:15.607 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:31:15.607 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:31:15.607 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:15.607 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:31:15.607 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:31:15.607 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:31:15.607 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:15.607 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:15.607 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:15.607 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:31:15.607 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:31:15.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.593+0000 7fb65c20a640 1 -- 172.21.15.60:0/3131461744 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb63806bd30 msgr2=0x7fb63806e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:15.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.593+0000 7fb65c20a640 1 --2- 172.21.15.60:0/3131461744 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb63806bd30 0x7fb63806e1f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb64c002230 tx=0x7fb64c009040 comp rx=0 tx=0).stop 2024-09-12T02:31:15.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.593+0000 7fb65c20a640 1 -- 172.21.15.60:0/3131461744 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6540c9c80 msgr2=0x7fb6541ec320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:15.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.593+0000 7fb65c20a640 1 --2- 172.21.15.60:0/3131461744 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6540c9c80 0x7fb6541ec320 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb6440098c0 tx=0x7fb6440046c0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.593+0000 7fb65a7a7640 1 -- 172.21.15.60:0/3131461744 reap_dead start 2024-09-12T02:31:15.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.593+0000 7fb65a7a7640 1 -- 172.21.15.60:0/3131461744 reap_dead start 2024-09-12T02:31:15.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.593+0000 7fb65c20a640 1 -- 172.21.15.60:0/3131461744 shutdown_connections 2024-09-12T02:31:15.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.593+0000 7fb65c20a640 1 -- 172.21.15.60:0/3131461744 >> 172.21.15.60:0/3131461744 conn(0x7fb654068030 msgr2=0x7fb6540ac290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:15.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.593+0000 7fb65c20a640 1 -- 172.21.15.60:0/3131461744 shutdown_connections 2024-09-12T02:31:15.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.593+0000 7fb65c20a640 1 -- 172.21.15.60:0/3131461744 wait complete. 2024-09-12T02:31:15.610 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:31:15.610 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-12T02:31:15.610 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-12T02:31:15.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.737+0000 7f3ab7053640 1 Processor -- start 2024-09-12T02:31:15.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.737+0000 7f3ab7053640 1 -- start start 2024-09-12T02:31:15.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.738+0000 7f3ab7053640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3ab00c7a70 0x7f3ab00744a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:15.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.738+0000 7f3ab7053640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3ab0158300 0x7f3ab00c8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:15.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.738+0000 7f3ab7053640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ab0154e00 con 0x7f3ab00c7e50 2024-09-12T02:31:15.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.738+0000 7f3ab7053640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f3ab00c4ba0 con 0x7f3ab00c7a70 2024-09-12T02:31:15.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.738+0000 7f3ab7053640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f3ab00c50e0 con 0x7f3ab0158300 2024-09-12T02:31:15.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.738+0000 7f3ab4def640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3ab00c7a70 0x7f3ab00744a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:15.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.738+0000 7f3ab4def640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3ab00c7a70 0x7f3ab00744a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53926/0 (socket says 172.21.15.60:53926) 2024-09-12T02:31:15.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.738+0000 7f3ab4def640 1 -- 172.21.15.60:0/1741705447 learned_addr learned my addr 172.21.15.60:0/1741705447 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:31:15.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.738+0000 7f3ab55f0640 1 --2- 172.21.15.60:0/1741705447 >> v2:172.21.15.105:3300/0 conn(0x7f3ab0158300 0x7f3ab00c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:15.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.739+0000 7f3ab4def640 1 -- 172.21.15.60:0/1741705447 >> v2:172.21.15.105:3300/0 conn(0x7f3ab0158300 msgr2=0x7f3ab00c8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:15.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.739+0000 7f3ab4def640 1 --2- 172.21.15.60:0/1741705447 >> v2:172.21.15.105:3300/0 conn(0x7f3ab0158300 0x7f3ab00c8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.739+0000 7f3ab4def640 1 -- 172.21.15.60:0/1741705447 >> v1:172.21.15.105:6789/0 conn(0x7f3ab00c7e50 legacy=0x7f3ab0157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:15.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.739+0000 7f3ab4def640 1 -- 172.21.15.60:0/1741705447 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ab01576d0 con 0x7f3ab00c7a70 2024-09-12T02:31:15.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.740+0000 7f3ab4def640 1 --2- 172.21.15.60:0/1741705447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ab00c7a70 0x7f3ab00744a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3ab0073bc0 tx=0x7f3aa402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cfba09b03ee19f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:15.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.740+0000 7f3aaf7fe640 1 -- 172.21.15.60:0/1741705447 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4037070 con 0x7f3ab00c7a70 2024-09-12T02:31:15.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.740+0000 7f3aaf7fe640 1 -- 172.21.15.60:0/1741705447 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3aa4032440 con 0x7f3ab00c7a70 2024-09-12T02:31:15.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.740+0000 7f3aaf7fe640 1 -- 172.21.15.60:0/1741705447 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4032810 con 0x7f3ab00c7a70 2024-09-12T02:31:15.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.740+0000 7f3ab7053640 1 -- 172.21.15.60:0/1741705447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ab00c7a70 msgr2=0x7f3ab00744a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:15.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.740+0000 7f3ab7053640 1 --2- 172.21.15.60:0/1741705447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ab00c7a70 0x7f3ab00744a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3ab0073bc0 tx=0x7f3aa402a270 comp rx=0 tx=0).stop 2024-09-12T02:31:15.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.741+0000 7f3ab7053640 1 -- 172.21.15.60:0/1741705447 shutdown_connections 2024-09-12T02:31:15.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.741+0000 7f3ab7053640 1 --2- 172.21.15.60:0/1741705447 >> v2:172.21.15.105:3300/0 conn(0x7f3ab0158300 0x7f3ab00c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.741+0000 7f3ab7053640 1 --2- 172.21.15.60:0/1741705447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ab00c7a70 0x7f3ab00744a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.741+0000 7f3ab7053640 1 -- 172.21.15.60:0/1741705447 >> 172.21.15.60:0/1741705447 conn(0x7f3ab00c5660 msgr2=0x7f3ab00c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:15.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.741+0000 7f3ab7053640 1 -- 172.21.15.60:0/1741705447 shutdown_connections 2024-09-12T02:31:15.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.741+0000 7f3ab7053640 1 -- 172.21.15.60:0/1741705447 wait complete. 2024-09-12T02:31:15.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.742+0000 7f3ab7053640 1 Processor -- start 2024-09-12T02:31:15.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.742+0000 7f3ab7053640 1 -- start start 2024-09-12T02:31:15.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.743+0000 7f3ab7053640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ab00c7a70 0x7f3ab01f0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:15.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.743+0000 7f3ab7053640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ab00c7e50 0x7f3ab00c2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:15.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.743+0000 7f3ab7053640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ab0158300 0x7f3ab00a8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:15.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.743+0000 7f3ab7053640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab0071bb0 con 0x7f3ab00c7a70 2024-09-12T02:31:15.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.743+0000 7f3ab7053640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab00c53c0 con 0x7f3ab00c7e50 2024-09-12T02:31:15.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.743+0000 7f3ab7053640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3ab0071d30 con 0x7f3ab0158300 2024-09-12T02:31:15.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.743+0000 7f3ab4def640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ab00c7a70 0x7f3ab01f0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:15.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.743+0000 7f3ab4def640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ab00c7a70 0x7f3ab01f0140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53932/0 (socket says 172.21.15.60:53932) 2024-09-12T02:31:15.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.743+0000 7f3ab4def640 1 -- 172.21.15.60:0/1505847736 learned_addr learned my addr 172.21.15.60:0/1505847736 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:31:15.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.743+0000 7f3aaffff640 1 --2- 172.21.15.60:0/1505847736 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ab00c7e50 0x7f3ab00c2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:15.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.743+0000 7f3ab55f0640 1 --2- 172.21.15.60:0/1505847736 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ab0158300 0x7f3ab00a8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:15.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.743+0000 7f3ab55f0640 1 -- 172.21.15.60:0/1505847736 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ab0158300 msgr2=0x7f3ab00a8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-12T02:31:15.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.743+0000 7f3ab55f0640 1 -- 172.21.15.60:0/1505847736 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ab0158300 msgr2=0x7f3ab00a8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:31:15.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.743+0000 7f3ab55f0640 1 --2- 172.21.15.60:0/1505847736 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ab0158300 0x7f3ab00a8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:31:15.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.743+0000 7f3ab55f0640 1 --2- 172.21.15.60:0/1505847736 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ab0158300 0x7f3ab00a8d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:31:15.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.743+0000 7f3ab4def640 1 -- 172.21.15.60:0/1505847736 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ab0158300 msgr2=0x7f3ab00a8d40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:31:15.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.743+0000 7f3ab4def640 1 --2- 172.21.15.60:0/1505847736 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ab0158300 0x7f3ab00a8d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.743+0000 7f3ab4def640 1 -- 172.21.15.60:0/1505847736 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ab00c7e50 msgr2=0x7f3ab00c2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:15.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.743+0000 7f3ab4def640 1 --2- 172.21.15.60:0/1505847736 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ab00c7e50 0x7f3ab00c2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.743+0000 7f3ab4def640 1 -- 172.21.15.60:0/1505847736 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ab00a9950 con 0x7f3ab00c7a70 2024-09-12T02:31:15.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.743+0000 7f3ab4def640 1 --2- 172.21.15.60:0/1505847736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ab00c7a70 0x7f3ab01f0140 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3aa402a2b0 tx=0x7f3aa40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:15.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.744+0000 7f3aad7fa640 1 -- 172.21.15.60:0/1505847736 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4037040 con 0x7f3ab00c7a70 2024-09-12T02:31:15.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.744+0000 7f3aad7fa640 1 -- 172.21.15.60:0/1505847736 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3aa4042070 con 0x7f3ab00c7a70 2024-09-12T02:31:15.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.744+0000 7f3ab7053640 1 -- 172.21.15.60:0/1505847736 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ab00a9c30 con 0x7f3ab00c7a70 2024-09-12T02:31:15.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.744+0000 7f3aad7fa640 1 -- 172.21.15.60:0/1505847736 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4030880 con 0x7f3ab00c7a70 2024-09-12T02:31:15.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.744+0000 7f3ab7053640 1 -- 172.21.15.60:0/1505847736 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ab00c2740 con 0x7f3ab00c7a70 2024-09-12T02:31:15.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.745+0000 7f3ab7053640 1 --2- 172.21.15.60:0/1505847736 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ab01ec1c0 0x7f3ab00a9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:15.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.745+0000 7f3ab7053640 1 -- 172.21.15.60:0/1505847736 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab01f0680 con 0x7f3ab01ec1c0 2024-09-12T02:31:15.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.745+0000 7f3aaffff640 1 --2- 172.21.15.60:0/1505847736 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ab01ec1c0 0x7f3ab00a9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:15.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.745+0000 7f3aaffff640 1 -- 172.21.15.60:0/1505847736 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3ab00a8670 con 0x7f3ab01ec1c0 2024-09-12T02:31:15.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.745+0000 7f3aad7fa640 1 -- 172.21.15.60:0/1505847736 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3aa4030a20 con 0x7f3ab00c7a70 2024-09-12T02:31:15.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.746+0000 7f3aaffff640 1 --2- 172.21.15.60:0/1505847736 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ab01ec1c0 0x7f3ab00a9280 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c00f540 tx=0x7f3a9c00fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:15.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.746+0000 7f3aad7fa640 1 --2- 172.21.15.60:0/1505847736 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3a9406be30 0x7f3a9406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:15.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.746+0000 7f3aad7fa640 1 -- 172.21.15.60:0/1505847736 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f3aa40ab9a0 con 0x7f3ab00c7a70 2024-09-12T02:31:15.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.746+0000 7f3ab55f0640 1 --2- 172.21.15.60:0/1505847736 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3a9406be30 0x7f3a9406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:15.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.746+0000 7f3aad7fa640 1 -- 172.21.15.60:0/1505847736 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a9c019070 con 0x7f3ab01ec1c0 2024-09-12T02:31:15.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.746+0000 7f3aad7fa640 1 -- 172.21.15.60:0/1505847736 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f3a9c005320 con 0x7f3ab01ec1c0 2024-09-12T02:31:15.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.746+0000 7f3aad7fa640 1 -- 172.21.15.60:0/1505847736 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ab01ec1c0 msgr2=0x7f3ab00a9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:15.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.746+0000 7f3aad7fa640 1 --2- 172.21.15.60:0/1505847736 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ab01ec1c0 0x7f3ab00a9280 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c00f540 tx=0x7f3a9c00fa00 comp rx=0 tx=0).stop 2024-09-12T02:31:15.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.746+0000 7f3aad7fa640 1 -- 172.21.15.60:0/1505847736 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ab01ec1c0 msgr2=0x7f3ab00a9280 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:31:15.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.746+0000 7f3aad7fa640 1 --2- 172.21.15.60:0/1505847736 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ab01ec1c0 0x7f3ab00a9280 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.747+0000 7f3ab55f0640 1 --2- 172.21.15.60:0/1505847736 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3a9406be30 0x7f3a9406e2f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3ab014d940 tx=0x7f3aa800b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:15.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.753+0000 7f3ab7053640 1 --2- 172.21.15.60:0/1505847736 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ab00ad150 0x7f3ab00ad530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:15.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.753+0000 7f3ab7053640 1 -- 172.21.15.60:0/1505847736 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab0151bc0 con 0x7f3ab00ad150 2024-09-12T02:31:15.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.753+0000 7f3aaffff640 1 --2- 172.21.15.60:0/1505847736 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ab00ad150 0x7f3ab00ad530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:15.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.754+0000 7f3aaffff640 1 -- 172.21.15.60:0/1505847736 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3ab0072ef0 con 0x7f3ab00ad150 2024-09-12T02:31:15.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.754+0000 7f3aaffff640 1 --2- 172.21.15.60:0/1505847736 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ab00ad150 0x7f3ab00ad530 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3ab0152230 tx=0x7f3a9c000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:15.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.754+0000 7f3aad7fa640 1 -- 172.21.15.60:0/1505847736 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a9c019030 con 0x7f3ab00ad150 2024-09-12T02:31:15.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.754+0000 7f3aad7fa640 1 -- 172.21.15.60:0/1505847736 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5050 (secure 0 0 0) 0x7f3a9c006bf0 con 0x7f3ab00ad150 2024-09-12T02:31:15.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.754+0000 7f3aad7fa640 1 -- 172.21.15.60:0/1505847736 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ab00ad150 msgr2=0x7f3ab00ad530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:15.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.754+0000 7f3aad7fa640 1 --2- 172.21.15.60:0/1505847736 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ab00ad150 0x7f3ab00ad530 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3ab0152230 tx=0x7f3a9c000ed0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.754+0000 7f3aad7fa640 1 -- 172.21.15.60:0/1505847736 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ab00ad150 msgr2=0x7f3ab00ad530 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:31:15.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.754+0000 7f3aad7fa640 1 --2- 172.21.15.60:0/1505847736 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ab00ad150 0x7f3ab00ad530 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.756 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:31:15.757 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:31:15.757 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:31:15.757 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:31:15.757 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 76, 2024-09-12T02:31:15.757 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 421188, 2024-09-12T02:31:15.757 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:31:15.757 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:31:15.757 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:31:15.757 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:31:15.757 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:31:15.757 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 1, 2024-09-12T02:31:15.757 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:31:15.757 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:31:15.757 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:31:15.757 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:31:15.758 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:31:15.758 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:31:15.758 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:31:15.758 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:31:15.758 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:31:15.758 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:31:15.758 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:31:15.758 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:31:15.758 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:31:15.758 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:31:15.759 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:31:15.759 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:31:15.759 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:31:15.759 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:31:15.759 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:31:15.759 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:31:15.759 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:31:15.759 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:31:15.759 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:31:15.759 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:31:15.759 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:31:15.759 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:31:15.759 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:31:15.759 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:31:15.760 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:15.760 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:15.760 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:31:15.760 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:31:15.760 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:31:15.760 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:31:15.760 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:31:15.760 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:31:15.760 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:31:15.760 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:31:15.760 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:31:15.760 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:31:15.760 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:31:15.760 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:31:15.760 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:31:15.761 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:31:15.761 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:31:15.761 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:31:15.761 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:31:15.761 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:31:15.761 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:31:15.761 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:31:15.761 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:31:15.761 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:31:15.761 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:31:15.761 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:31:15.761 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:31:15.762 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:31:15.762 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:31:15.762 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:31:15.762 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:31:15.762 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:31:15.762 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:15.762 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:31:15.762 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:15.762 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:31:15.762 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:31:15.762 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:31:15.763 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:31:15.763 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:15.763 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:31:15.763 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:31:15.763 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:15.763 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:15.763 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:15.763 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:31:15.763 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:31:15.763 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:15.763 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:15.764 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:15.764 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:15.764 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:31:15.764 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:31:15.764 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:31:15.764 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:31:15.764 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:31:15.764 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:15.764 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:15.764 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:31:15.764 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:31:15.764 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:31:15.764 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:31:15.765 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:15.765 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:31:15.765 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:31:15.765 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:15.765 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:15.765 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:15.765 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:31:15.765 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:31:15.765 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:15.765 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:15.765 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:15.765 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:15.765 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:31:15.766 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:31:15.766 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:31:15.766 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:31:15.766 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:31:15.766 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:15.766 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:15.766 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:31:15.766 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:31:15.766 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:31:15.766 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:31:15.766 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:15.766 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:31:15.766 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:31:15.767 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:15.767 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:15.767 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:15.767 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:31:15.767 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:31:15.767 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:15.767 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:15.767 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:15.768 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:15.768 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:31:15.768 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:31:15.768 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:31:15.769 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:31:15.769 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:31:15.769 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:15.769 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:15.769 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:15.769 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:31:15.769 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:31:15.769 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:15.769 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:31:15.769 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:31:15.769 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:31:15.769 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:15.770 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:31:15.770 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:31:15.770 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:15.770 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:31:15.770 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:31:15.770 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:31:15.770 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:15.770 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:31:15.770 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:31:15.770 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:15.770 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:31:15.770 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:31:15.770 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-09-12T02:31:15.771 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:15.771 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:31:15.771 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:31:15.771 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:15.771 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:31:15.771 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:31:15.771 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-09-12T02:31:15.771 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:15.771 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:31:15.771 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:31:15.771 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:15.771 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:31:15.771 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:31:15.772 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:31:15.772 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:15.772 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:15.772 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:15.772 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:31:15.772 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:31:15.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.755+0000 7f3ab7053640 1 -- 172.21.15.60:0/1505847736 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3a9406be30 msgr2=0x7f3a9406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:15.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.755+0000 7f3ab7053640 1 --2- 172.21.15.60:0/1505847736 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3a9406be30 0x7f3a9406e2f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3ab014d940 tx=0x7f3aa800b040 comp rx=0 tx=0).stop 2024-09-12T02:31:15.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.755+0000 7f3ab7053640 1 -- 172.21.15.60:0/1505847736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ab00c7a70 msgr2=0x7f3ab01f0140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:15.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.755+0000 7f3ab7053640 1 --2- 172.21.15.60:0/1505847736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ab00c7a70 0x7f3ab01f0140 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3aa402a2b0 tx=0x7f3aa40046c0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.755+0000 7f3ab55f0640 1 -- 172.21.15.60:0/1505847736 reap_dead start 2024-09-12T02:31:15.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.755+0000 7f3ab55f0640 1 -- 172.21.15.60:0/1505847736 reap_dead start 2024-09-12T02:31:15.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.755+0000 7f3ab7053640 1 -- 172.21.15.60:0/1505847736 shutdown_connections 2024-09-12T02:31:15.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.755+0000 7f3ab7053640 1 -- 172.21.15.60:0/1505847736 >> 172.21.15.60:0/1505847736 conn(0x7f3ab00c5660 msgr2=0x7f3ab00c5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:15.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.755+0000 7f3ab7053640 1 -- 172.21.15.60:0/1505847736 shutdown_connections 2024-09-12T02:31:15.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.755+0000 7f3ab7053640 1 -- 172.21.15.60:0/1505847736 wait complete. 2024-09-12T02:31:15.777 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:31:15.777 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-12T02:31:15.777 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-12T02:31:15.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.892+0000 7fa37ebfd640 1 Processor -- start 2024-09-12T02:31:15.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.892+0000 7fa37ebfd640 1 -- start start 2024-09-12T02:31:15.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.893+0000 7fa37ebfd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa378153be0 0x7fa3780c3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:15.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.893+0000 7fa37ebfd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3780c8180 0x7fa378160bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:15.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.893+0000 7fa37ebfd640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa378153fc0 con 0x7fa3780ac720 2024-09-12T02:31:15.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.893+0000 7fa37ebfd640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fa378156db0 con 0x7fa378153be0 2024-09-12T02:31:15.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.893+0000 7fa37ebfd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa3780a8030 con 0x7fa3780c8180 2024-09-12T02:31:15.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.893+0000 7fa37c999640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa378153be0 0x7fa3780c3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:15.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.893+0000 7fa37d19a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3780c8180 0x7fa378160bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:15.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.893+0000 7fa37c999640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa378153be0 0x7fa3780c3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:39354/0 (socket says 172.21.15.60:39354) 2024-09-12T02:31:15.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.893+0000 7fa377fff640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fa3780ac720 0x7fa3780c7a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:45726/0 (socket says 172.21.15.60:45726) 2024-09-12T02:31:15.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.893+0000 7fa37c999640 1 -- 172.21.15.60:0/444037443 learned_addr learned my addr 172.21.15.60:0/444037443 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:31:15.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.894+0000 7fa37d19a640 1 -- 172.21.15.60:0/444037443 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3780c8180 msgr2=0x7fa378160bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:31:15.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.894+0000 7fa37d19a640 1 -- 172.21.15.60:0/444037443 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3780c8180 msgr2=0x7fa378160bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:31:15.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.894+0000 7fa37d19a640 1 --2- 172.21.15.60:0/444037443 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3780c8180 0x7fa378160bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:31:15.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.894+0000 7fa37d19a640 1 --2- 172.21.15.60:0/444037443 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3780c8180 0x7fa378160bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:31:15.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.894+0000 7fa37c999640 1 -- 172.21.15.60:0/444037443 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3780c8180 msgr2=0x7fa378160bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:31:15.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.894+0000 7fa37c999640 1 --2- 172.21.15.60:0/444037443 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3780c8180 0x7fa378160bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.894+0000 7fa37c999640 1 -- 172.21.15.60:0/444037443 >> v1:172.21.15.105:6789/0 conn(0x7fa3780ac720 legacy=0x7fa3780c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:15.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.894+0000 7fa37c999640 1 -- 172.21.15.60:0/444037443 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3780c86d0 con 0x7fa378153be0 2024-09-12T02:31:15.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.894+0000 7fa3777fe640 1 -- 172.21.15.60:0/444037443 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 914312586 0 0) 0x7fa364001110 con 0x7fa3780ac720 2024-09-12T02:31:15.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.895+0000 7fa37c999640 1 --2- 172.21.15.60:0/444037443 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa378153be0 0x7fa3780c3560 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa36c009870 tx=0x7fa36c02a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d915d107ea48f37a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:15.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.895+0000 7fa3777fe640 1 -- 172.21.15.60:0/444037443 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36c037070 con 0x7fa378153be0 2024-09-12T02:31:15.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.895+0000 7fa3777fe640 1 -- 172.21.15.60:0/444037443 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa36c032440 con 0x7fa378153be0 2024-09-12T02:31:15.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.895+0000 7fa3777fe640 1 -- 172.21.15.60:0/444037443 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36c032810 con 0x7fa378153be0 2024-09-12T02:31:15.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.896+0000 7fa37ebfd640 1 -- 172.21.15.60:0/444037443 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa378153be0 msgr2=0x7fa3780c3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:15.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.896+0000 7fa37ebfd640 1 --2- 172.21.15.60:0/444037443 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa378153be0 0x7fa3780c3560 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa36c009870 tx=0x7fa36c02a130 comp rx=0 tx=0).stop 2024-09-12T02:31:15.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.896+0000 7fa37ebfd640 1 -- 172.21.15.60:0/444037443 shutdown_connections 2024-09-12T02:31:15.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.896+0000 7fa37ebfd640 1 --2- 172.21.15.60:0/444037443 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3780c8180 0x7fa378160bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.896+0000 7fa37ebfd640 1 --2- 172.21.15.60:0/444037443 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa378153be0 0x7fa3780c3560 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.896+0000 7fa37ebfd640 1 -- 172.21.15.60:0/444037443 >> 172.21.15.60:0/444037443 conn(0x7fa3780c5660 msgr2=0x7fa3780c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:15.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.896+0000 7fa37ebfd640 1 -- 172.21.15.60:0/444037443 shutdown_connections 2024-09-12T02:31:15.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.896+0000 7fa37ebfd640 1 -- 172.21.15.60:0/444037443 wait complete. 2024-09-12T02:31:15.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.897+0000 7fa37ebfd640 1 Processor -- start 2024-09-12T02:31:15.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.897+0000 7fa37ebfd640 1 -- start start 2024-09-12T02:31:15.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.898+0000 7fa37ebfd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3780ac720 0x7fa3781e1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:15.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.898+0000 7fa37ebfd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3780c8180 0x7fa3781523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:15.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.898+0000 7fa37ebfd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa378153be0 0x7fa378152930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:15.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.898+0000 7fa37ebfd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa3780ac370 con 0x7fa3780c8180 2024-09-12T02:31:15.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.898+0000 7fa37ebfd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa3780a83e0 con 0x7fa3780ac720 2024-09-12T02:31:15.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.898+0000 7fa37ebfd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa3780ac4f0 con 0x7fa378153be0 2024-09-12T02:31:15.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.898+0000 7fa377fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3780c8180 0x7fa3781523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:15.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.898+0000 7fa377fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3780c8180 0x7fa3781523f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53938/0 (socket says 172.21.15.60:53938) 2024-09-12T02:31:15.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.898+0000 7fa377fff640 1 -- 172.21.15.60:0/2752872867 learned_addr learned my addr 172.21.15.60:0/2752872867 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:31:15.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.898+0000 7fa37c999640 1 --2- 172.21.15.60:0/2752872867 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3780ac720 0x7fa3781e1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:15.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.898+0000 7fa37d19a640 1 --2- 172.21.15.60:0/2752872867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa378153be0 0x7fa378152930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:15.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.898+0000 7fa37d19a640 1 -- 172.21.15.60:0/2752872867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa378153be0 msgr2=0x7fa378152930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-12T02:31:15.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.898+0000 7fa37d19a640 1 -- 172.21.15.60:0/2752872867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa378153be0 msgr2=0x7fa378152930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:31:15.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.899+0000 7fa37d19a640 1 --2- 172.21.15.60:0/2752872867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa378153be0 0x7fa378152930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:31:15.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.899+0000 7fa37d19a640 1 --2- 172.21.15.60:0/2752872867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa378153be0 0x7fa378152930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:31:15.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.899+0000 7fa377fff640 1 -- 172.21.15.60:0/2752872867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa378153be0 msgr2=0x7fa378152930 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:31:15.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.899+0000 7fa377fff640 1 --2- 172.21.15.60:0/2752872867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa378153be0 0x7fa378152930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.899+0000 7fa377fff640 1 -- 172.21.15.60:0/2752872867 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3780ac720 msgr2=0x7fa3781e1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:15.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.899+0000 7fa377fff640 1 --2- 172.21.15.60:0/2752872867 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3780ac720 0x7fa3781e1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:15.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.899+0000 7fa377fff640 1 -- 172.21.15.60:0/2752872867 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa378153500 con 0x7fa3780c8180 2024-09-12T02:31:15.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.899+0000 7fa37c999640 1 --2- 172.21.15.60:0/2752872867 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3780ac720 0x7fa3781e1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:31:15.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.899+0000 7fa377fff640 1 --2- 172.21.15.60:0/2752872867 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3780c8180 0x7fa3781523f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa36400c780 tx=0x7fa36400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:15.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.899+0000 7fa3757fa640 1 -- 172.21.15.60:0/2752872867 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa364018070 con 0x7fa3780c8180 2024-09-12T02:31:15.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.899+0000 7fa3757fa640 1 -- 172.21.15.60:0/2752872867 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3640072d0 con 0x7fa3780c8180 2024-09-12T02:31:15.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.899+0000 7fa3757fa640 1 -- 172.21.15.60:0/2752872867 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3640047e0 con 0x7fa3780c8180 2024-09-12T02:31:15.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.899+0000 7fa37ebfd640 1 -- 172.21.15.60:0/2752872867 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa378153220 con 0x7fa3780c8180 2024-09-12T02:31:15.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.899+0000 7fa37ebfd640 1 -- 172.21.15.60:0/2752872867 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa378158820 con 0x7fa3780c8180 2024-09-12T02:31:15.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.900+0000 7fa37ebfd640 1 --2- 172.21.15.60:0/2752872867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3780c2980 0x7fa378158d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:15.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.900+0000 7fa37ebfd640 1 -- 172.21.15.60:0/2752872867 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa378152fd0 con 0x7fa3780c2980 2024-09-12T02:31:15.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.900+0000 7fa37c999640 1 --2- 172.21.15.60:0/2752872867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3780c2980 0x7fa378158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:15.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.901+0000 7fa37c999640 1 -- 172.21.15.60:0/2752872867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3780c2980 msgr2=0x7fa378158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2024-09-12T02:31:15.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.901+0000 7fa37c999640 1 -- 172.21.15.60:0/2752872867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3780c2980 msgr2=0x7fa378158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:31:15.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.901+0000 7fa37c999640 1 --2- 172.21.15.60:0/2752872867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3780c2980 0x7fa378158d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:31:15.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.901+0000 7fa37c999640 1 --2- 172.21.15.60:0/2752872867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3780c2980 0x7fa378158d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:31:15.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.901+0000 7fa3757fa640 1 -- 172.21.15.60:0/2752872867 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa36401b070 con 0x7fa3780c8180 2024-09-12T02:31:15.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.902+0000 7fa3757fa640 1 --2- 172.21.15.60:0/2752872867 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa35c06be60 0x7fa35c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:15.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.902+0000 7fa37d19a640 1 --2- 172.21.15.60:0/2752872867 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa35c06be60 0x7fa35c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:15.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.902+0000 7fa3757fa640 1 -- 172.21.15.60:0/2752872867 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fa36408a3f0 con 0x7fa3780c8180 2024-09-12T02:31:15.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:15.902+0000 7fa37d19a640 1 --2- 172.21.15.60:0/2752872867 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa35c06be60 0x7fa35c06e320 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa3781df980 tx=0x7fa37000b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:16.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:16.102+0000 7fa37c999640 1 --2- 172.21.15.60:0/2752872867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3780c2980 0x7fa378158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:16.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:16.102+0000 7fa37c999640 1 -- 172.21.15.60:0/2752872867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3780c2980 msgr2=0x7fa378158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-12T02:31:16.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:16.102+0000 7fa37c999640 1 -- 172.21.15.60:0/2752872867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3780c2980 msgr2=0x7fa378158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:31:16.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:16.102+0000 7fa37c999640 1 --2- 172.21.15.60:0/2752872867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3780c2980 0x7fa378158d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:31:16.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:16.102+0000 7fa37c999640 1 --2- 172.21.15.60:0/2752872867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3780c2980 0x7fa378158d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:31:16.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:16.503+0000 7fa37c999640 1 --2- 172.21.15.60:0/2752872867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3780c2980 0x7fa378158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:16.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:16.503+0000 7fa37c999640 1 -- 172.21.15.60:0/2752872867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3780c2980 msgr2=0x7fa378158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-12T02:31:16.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:16.503+0000 7fa37c999640 1 -- 172.21.15.60:0/2752872867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3780c2980 msgr2=0x7fa378158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:31:16.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:16.503+0000 7fa37c999640 1 --2- 172.21.15.60:0/2752872867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3780c2980 0x7fa378158d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:31:16.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:16.503+0000 7fa37c999640 1 --2- 172.21.15.60:0/2752872867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3780c2980 0x7fa378158d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:31:17.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:17.304+0000 7fa37c999640 1 --2- 172.21.15.60:0/2752872867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3780c2980 0x7fa378158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:17.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:17.304+0000 7fa37c999640 1 -- 172.21.15.60:0/2752872867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3780c2980 msgr2=0x7fa378158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-12T02:31:17.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:17.304+0000 7fa37c999640 1 -- 172.21.15.60:0/2752872867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3780c2980 msgr2=0x7fa378158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:31:17.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:17.304+0000 7fa37c999640 1 --2- 172.21.15.60:0/2752872867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3780c2980 0x7fa378158d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:31:17.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:17.304+0000 7fa37c999640 1 --2- 172.21.15.60:0/2752872867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3780c2980 0x7fa378158d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:31:18.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:18.906+0000 7fa37c999640 1 --2- 172.21.15.60:0/2752872867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3780c2980 0x7fa378158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:18.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:18.906+0000 7fa37c999640 1 -- 172.21.15.60:0/2752872867 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa3780c63f0 con 0x7fa3780c2980 2024-09-12T02:31:18.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:18.906+0000 7fa37c999640 1 --2- 172.21.15.60:0/2752872867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3780c2980 0x7fa378158d40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa3780ac130 tx=0x7fa36c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:18.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:18.907+0000 7fa3757fa640 1 -- 172.21.15.60:0/2752872867 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36c037040 con 0x7fa3780c2980 2024-09-12T02:31:18.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:18.907+0000 7fa3757fa640 1 -- 172.21.15.60:0/2752872867 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fa36c009490 con 0x7fa3780c2980 2024-09-12T02:31:18.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:18.907+0000 7fa3757fa640 1 -- 172.21.15.60:0/2752872867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3780c2980 msgr2=0x7fa378158d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:18.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:18.907+0000 7fa3757fa640 1 --2- 172.21.15.60:0/2752872867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3780c2980 0x7fa378158d40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa3780ac130 tx=0x7fa36c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:31:18.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:18.907+0000 7fa3757fa640 1 -- 172.21.15.60:0/2752872867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3780c2980 msgr2=0x7fa378158d40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:31:18.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:18.907+0000 7fa3757fa640 1 --2- 172.21.15.60:0/2752872867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3780c2980 0x7fa378158d40 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:18.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:18.917+0000 7fa37ebfd640 1 --2- 172.21.15.60:0/2752872867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa378159280 0x7fa3781ef2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:18.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:18.917+0000 7fa37ebfd640 1 -- 172.21.15.60:0/2752872867 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa3780aa360 con 0x7fa378159280 2024-09-12T02:31:18.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:18.918+0000 7fa37c999640 1 --2- 172.21.15.60:0/2752872867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa378159280 0x7fa3781ef2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:18.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:18.918+0000 7fa37c999640 1 -- 172.21.15.60:0/2752872867 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa3780c4bb0 con 0x7fa378159280 2024-09-12T02:31:18.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:18.918+0000 7fa37c999640 1 --2- 172.21.15.60:0/2752872867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa378159280 0x7fa3781ef2d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa36c000c00 tx=0x7fa36c009240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:18.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:18.919+0000 7fa3757fa640 1 -- 172.21.15.60:0/2752872867 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36c04b040 con 0x7fa378159280 2024-09-12T02:31:18.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:18.919+0000 7fa3757fa640 1 -- 172.21.15.60:0/2752872867 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4548 (secure 0 0 0) 0x7fa36c047ce0 con 0x7fa378159280 2024-09-12T02:31:18.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:18.919+0000 7fa3757fa640 1 -- 172.21.15.60:0/2752872867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa378159280 msgr2=0x7fa3781ef2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:18.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:18.919+0000 7fa3757fa640 1 --2- 172.21.15.60:0/2752872867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa378159280 0x7fa3781ef2d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa36c000c00 tx=0x7fa36c009240 comp rx=0 tx=0).stop 2024-09-12T02:31:18.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:18.919+0000 7fa3757fa640 1 -- 172.21.15.60:0/2752872867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa378159280 msgr2=0x7fa3781ef2d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:31:18.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:18.919+0000 7fa3757fa640 1 --2- 172.21.15.60:0/2752872867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa378159280 0x7fa3781ef2d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:18.920 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:31:18.920 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:31:18.920 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:31:18.920 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:31:18.920 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 76, 2024-09-12T02:31:18.921 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 10702, 2024-09-12T02:31:18.921 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:31:18.921 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:31:18.921 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:31:18.921 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:31:18.921 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:31:18.921 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 5, 2024-09-12T02:31:18.921 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:31:18.921 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:31:18.921 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:31:18.921 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:31:18.921 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:31:18.921 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:31:18.922 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:31:18.922 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:31:18.922 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:31:18.922 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:31:18.922 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:31:18.922 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:31:18.922 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:31:18.922 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:31:18.922 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:31:18.922 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:31:18.922 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:31:18.922 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:31:18.922 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:31:18.922 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:31:18.923 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:31:18.923 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:31:18.923 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:31:18.923 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:31:18.923 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:31:18.923 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:31:18.923 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:31:18.923 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:31:18.923 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:18.923 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:18.923 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:31:18.923 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:31:18.923 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:31:18.923 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:31:18.924 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:31:18.924 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:31:18.924 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:31:18.924 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:31:18.924 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:31:18.924 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:31:18.924 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:31:18.924 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:31:18.924 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:31:18.924 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:31:18.924 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:31:18.924 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:31:18.924 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:31:18.924 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:31:18.925 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:31:18.925 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:31:18.925 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:31:18.925 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:31:18.925 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:31:18.925 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:31:18.925 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:31:18.925 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:31:18.925 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:31:18.925 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:31:18.925 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:31:18.925 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:31:18.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:18.925 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:31:18.926 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:18.926 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:31:18.926 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:31:18.926 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:31:18.926 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:31:18.926 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:18.926 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:31:18.926 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:31:18.926 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:18.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:18.926 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:18.926 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:31:18.926 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:31:18.926 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:18.927 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:18.927 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:18.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:18.927 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:31:18.927 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:31:18.927 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:31:18.927 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:31:18.927 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:31:18.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:18.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:18.927 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:31:18.927 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:31:18.927 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:31:18.927 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:31:18.928 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:18.928 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:31:18.928 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:31:18.928 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:18.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:18.928 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:18.928 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:31:18.928 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:31:18.928 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:18.928 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:18.928 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:18.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:18.928 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:31:18.929 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:31:18.929 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:31:18.929 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:31:18.929 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:31:18.929 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:18.929 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:18.929 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:31:18.929 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:31:18.929 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:31:18.929 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:31:18.929 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:18.929 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:31:18.929 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:31:18.929 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:18.930 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:18.930 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:18.930 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:31:18.930 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:31:18.930 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:18.930 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:18.930 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:18.930 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:18.930 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:31:18.930 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:31:18.930 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:31:18.930 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:31:18.930 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:31:18.930 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:18.931 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:18.931 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:18.931 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:31:18.931 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:31:18.931 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:18.931 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:31:18.931 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:31:18.931 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:31:18.931 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:18.931 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:31:18.931 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:31:18.931 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:18.931 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:31:18.931 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:31:18.932 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:31:18.932 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:18.932 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:18.932 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:18.932 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:31:18.932 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:31:18.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:18.919+0000 7fa37ebfd640 1 -- 172.21.15.60:0/2752872867 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa35c06be60 msgr2=0x7fa35c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:18.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:18.919+0000 7fa37ebfd640 1 --2- 172.21.15.60:0/2752872867 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa35c06be60 0x7fa35c06e320 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa3781df980 tx=0x7fa37000b040 comp rx=0 tx=0).stop 2024-09-12T02:31:18.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:18.919+0000 7fa37ebfd640 1 -- 172.21.15.60:0/2752872867 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3780c8180 msgr2=0x7fa3781523f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:18.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:18.919+0000 7fa37ebfd640 1 --2- 172.21.15.60:0/2752872867 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3780c8180 0x7fa3781523f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa36400c780 tx=0x7fa36400cc40 comp rx=0 tx=0).stop 2024-09-12T02:31:18.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:18.919+0000 7fa37d19a640 1 -- 172.21.15.60:0/2752872867 reap_dead start 2024-09-12T02:31:18.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:18.919+0000 7fa37d19a640 1 -- 172.21.15.60:0/2752872867 reap_dead start 2024-09-12T02:31:18.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:18.920+0000 7fa37ebfd640 1 -- 172.21.15.60:0/2752872867 shutdown_connections 2024-09-12T02:31:18.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:18.920+0000 7fa37ebfd640 1 -- 172.21.15.60:0/2752872867 >> 172.21.15.60:0/2752872867 conn(0x7fa3780c5660 msgr2=0x7fa3780a8750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:18.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:18.920+0000 7fa37ebfd640 1 -- 172.21.15.60:0/2752872867 shutdown_connections 2024-09-12T02:31:18.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:18.920+0000 7fa37ebfd640 1 -- 172.21.15.60:0/2752872867 wait complete. 2024-09-12T02:31:18.934 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:31:18.934 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-12T02:31:18.935 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-12T02:31:19.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.039+0000 7f4309253640 1 Processor -- start 2024-09-12T02:31:19.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.039+0000 7f4309253640 1 -- start start 2024-09-12T02:31:19.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.040+0000 7f4309253640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f43040c69c0 0x7f4304153910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:19.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.040+0000 7f4309253640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43040c5940 con 0x7f43040c42b0 2024-09-12T02:31:19.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.040+0000 7f4309253640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43040c5c00 con 0x7f43041505f0 2024-09-12T02:31:19.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.040+0000 7f4309253640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f43040c7860 con 0x7f43040c69c0 2024-09-12T02:31:19.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.040+0000 7f430359e640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f43040c42b0 0x7f43040c4700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:59932/0 (socket says 172.21.15.60:59932) 2024-09-12T02:31:19.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.040+0000 7f430359e640 1 -- 172.21.15.60:0/884042925 learned_addr learned my addr 172.21.15.60:0/884042925 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:31:19.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.040+0000 7f430259c640 1 --2- 172.21.15.60:0/884042925 >> v2:172.21.15.105:3300/0 conn(0x7f43040c69c0 0x7f4304153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:19.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.040+0000 7f4301d9b640 1 -- 172.21.15.60:0/884042925 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 444846586 0 0) 0x7f43040c5940 con 0x7f43040c42b0 2024-09-12T02:31:19.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.040+0000 7f4301d9b640 1 -- 172.21.15.60:0/884042925 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42ec003520 con 0x7f43040c42b0 2024-09-12T02:31:19.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.040+0000 7f4301d9b640 1 -- 172.21.15.60:0/884042925 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2540934210 0 0) 0x7f43040c5c00 con 0x7f43041505f0 2024-09-12T02:31:19.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.040+0000 7f4301d9b640 1 -- 172.21.15.60:0/884042925 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43040c5940 con 0x7f43041505f0 2024-09-12T02:31:19.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.040+0000 7f430259c640 1 -- 172.21.15.60:0/884042925 >> v1:172.21.15.105:6789/0 conn(0x7f43041505f0 legacy=0x7f43040c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:19.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.040+0000 7f430259c640 1 -- 172.21.15.60:0/884042925 >> v1:172.21.15.60:6789/0 conn(0x7f43040c42b0 legacy=0x7f43040c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:19.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.040+0000 7f430259c640 1 -- 172.21.15.60:0/884042925 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43040c5ee0 con 0x7f43040c69c0 2024-09-12T02:31:19.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.041+0000 7f430259c640 1 --2- 172.21.15.60:0/884042925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43040c69c0 0x7f4304153910 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f42f80097a0 tx=0x7f42f802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=558b3ae37962ce9b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:19.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.041+0000 7f4301d9b640 1 -- 172.21.15.60:0/884042925 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f8037070 con 0x7f43040c69c0 2024-09-12T02:31:19.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.041+0000 7f4301d9b640 1 -- 172.21.15.60:0/884042925 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42f8032440 con 0x7f43040c69c0 2024-09-12T02:31:19.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.041+0000 7f4301d9b640 1 -- 172.21.15.60:0/884042925 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f8032810 con 0x7f43040c69c0 2024-09-12T02:31:19.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.042+0000 7f4309253640 1 -- 172.21.15.60:0/884042925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43040c69c0 msgr2=0x7f4304153910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:19.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.042+0000 7f4309253640 1 --2- 172.21.15.60:0/884042925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43040c69c0 0x7f4304153910 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f42f80097a0 tx=0x7f42f802a1a0 comp rx=0 tx=0).stop 2024-09-12T02:31:19.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.042+0000 7f4309253640 1 -- 172.21.15.60:0/884042925 shutdown_connections 2024-09-12T02:31:19.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.042+0000 7f4309253640 1 --2- 172.21.15.60:0/884042925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43040c69c0 0x7f4304153910 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:19.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.042+0000 7f4309253640 1 -- 172.21.15.60:0/884042925 >> 172.21.15.60:0/884042925 conn(0x7f43040c7a40 msgr2=0x7f43040c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:19.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.042+0000 7f4309253640 1 -- 172.21.15.60:0/884042925 shutdown_connections 2024-09-12T02:31:19.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.042+0000 7f4309253640 1 -- 172.21.15.60:0/884042925 wait complete. 2024-09-12T02:31:19.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.044+0000 7f4309253640 1 Processor -- start 2024-09-12T02:31:19.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.044+0000 7f4309253640 1 -- start start 2024-09-12T02:31:19.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.044+0000 7f4309253640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f43040c42b0 0x7f430414a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:19.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.044+0000 7f4309253640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43041505f0 0x7f43041464d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:19.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.044+0000 7f4309253640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43040abb50 0x7f430414bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:19.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.044+0000 7f4309253640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f43041509d0 con 0x7f43040abb50 2024-09-12T02:31:19.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.044+0000 7f4309253640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f43040c64a0 con 0x7f43041505f0 2024-09-12T02:31:19.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.044+0000 7f4309253640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4304150b50 con 0x7f43040c42b0 2024-09-12T02:31:19.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.045+0000 7f4302d9d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f43040c42b0 0x7f430414a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:19.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.045+0000 7f430259c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43041505f0 0x7f43041464d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:19.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.045+0000 7f430359e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43040abb50 0x7f430414bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:19.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.045+0000 7f430259c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43041505f0 0x7f43041464d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:39376/0 (socket says 172.21.15.60:39376) 2024-09-12T02:31:19.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.045+0000 7f430259c640 1 -- 172.21.15.60:0/3436811545 learned_addr learned my addr 172.21.15.60:0/3436811545 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:31:19.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.045+0000 7f4302d9d640 1 --2- 172.21.15.60:0/3436811545 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f43040c42b0 0x7f430414a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:48900/0 (socket says 172.21.15.60:48900) 2024-09-12T02:31:19.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.045+0000 7f430359e640 1 -- 172.21.15.60:0/3436811545 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f43040c42b0 msgr2=0x7f430414a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:19.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.045+0000 7f430359e640 1 --2- 172.21.15.60:0/3436811545 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f43040c42b0 0x7f430414a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:19.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.045+0000 7f430359e640 1 -- 172.21.15.60:0/3436811545 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43041505f0 msgr2=0x7f43041464d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:19.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.045+0000 7f430359e640 1 --2- 172.21.15.60:0/3436811545 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43041505f0 0x7f43041464d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:19.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.045+0000 7f430359e640 1 -- 172.21.15.60:0/3436811545 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43040c39c0 con 0x7f43040abb50 2024-09-12T02:31:19.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.045+0000 7f430259c640 1 --2- 172.21.15.60:0/3436811545 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43041505f0 0x7f43041464d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:31:19.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.045+0000 7f430359e640 1 --2- 172.21.15.60:0/3436811545 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43040abb50 0x7f430414bc00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f42fc00ca70 tx=0x7f42fc00cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:19.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.045+0000 7f42eb7fe640 1 -- 172.21.15.60:0/3436811545 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42fc017070 con 0x7f43040abb50 2024-09-12T02:31:19.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.045+0000 7f42eb7fe640 1 -- 172.21.15.60:0/3436811545 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42fc00abd0 con 0x7f43040abb50 2024-09-12T02:31:19.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.045+0000 7f4309253640 1 -- 172.21.15.60:0/3436811545 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43040ad6d0 con 0x7f43040abb50 2024-09-12T02:31:19.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.046+0000 7f42eb7fe640 1 -- 172.21.15.60:0/3436811545 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42fc012400 con 0x7f43040abb50 2024-09-12T02:31:19.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.046+0000 7f4309253640 1 -- 172.21.15.60:0/3436811545 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f430414c140 con 0x7f43040abb50 2024-09-12T02:31:19.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.047+0000 7f4309253640 1 -- 172.21.15.60:0/3436811545 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f430414de10 con 0x7f43040abb50 2024-09-12T02:31:19.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.047+0000 7f42eb7fe640 1 -- 172.21.15.60:0/3436811545 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f42fc01a070 con 0x7f43040abb50 2024-09-12T02:31:19.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.048+0000 7f42eb7fe640 1 --2- 172.21.15.60:0/3436811545 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f42f006be30 0x7f42f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:19.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.048+0000 7f4302d9d640 1 --2- 172.21.15.60:0/3436811545 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f42f006be30 0x7f42f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:19.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.048+0000 7f42eb7fe640 1 -- 172.21.15.60:0/3436811545 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f42fc08af00 con 0x7f43040abb50 2024-09-12T02:31:19.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.048+0000 7f4302d9d640 1 --2- 172.21.15.60:0/3436811545 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f42f006be30 0x7f42f006e2f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f42f40011e0 tx=0x7f42f4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:19.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.053+0000 7f42eb7fe640 1 -- 172.21.15.60:0/3436811545 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f430414de10 con 0x7f43040abb50 2024-09-12T02:31:19.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.358+0000 7f4309253640 1 -- 172.21.15.60:0/3436811545 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f43040c2c20 con 0x7f43040abb50 2024-09-12T02:31:19.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.359+0000 7f42eb7fe640 1 -- 172.21.15.60:0/3436811545 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f42fc058ec0 con 0x7f43040abb50 2024-09-12T02:31:19.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.362+0000 7f4309253640 1 -- 172.21.15.60:0/3436811545 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f42f006be30 msgr2=0x7f42f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:19.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.362+0000 7f4309253640 1 --2- 172.21.15.60:0/3436811545 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f42f006be30 0x7f42f006e2f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f42f40011e0 tx=0x7f42f4009040 comp rx=0 tx=0).stop 2024-09-12T02:31:19.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.362+0000 7f4309253640 1 -- 172.21.15.60:0/3436811545 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43040abb50 msgr2=0x7f430414bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:19.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.362+0000 7f4309253640 1 --2- 172.21.15.60:0/3436811545 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43040abb50 0x7f430414bc00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f42fc00ca70 tx=0x7f42fc00cf30 comp rx=0 tx=0).stop 2024-09-12T02:31:19.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.362+0000 7f4309253640 1 -- 172.21.15.60:0/3436811545 shutdown_connections 2024-09-12T02:31:19.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.362+0000 7f4309253640 1 --2- 172.21.15.60:0/3436811545 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f42f006be30 0x7f42f006e2f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:19.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.362+0000 7f4309253640 1 --2- 172.21.15.60:0/3436811545 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43040abb50 0x7f430414bc00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:19.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.362+0000 7f4309253640 1 --2- 172.21.15.60:0/3436811545 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43041505f0 0x7f43041464d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:19.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.362+0000 7f4309253640 1 --2- 172.21.15.60:0/3436811545 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f43040c42b0 0x7f430414a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:19.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.362+0000 7f4309253640 1 -- 172.21.15.60:0/3436811545 >> 172.21.15.60:0/3436811545 conn(0x7f43040c7a40 msgr2=0x7f43040c46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:19.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.362+0000 7f4309253640 1 -- 172.21.15.60:0/3436811545 shutdown_connections 2024-09-12T02:31:19.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:19.362+0000 7f4309253640 1 -- 172.21.15.60:0/3436811545 wait complete. 2024-09-12T02:31:19.377 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-12T02:31:28.418 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:31:28.421 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:31:29.378 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-12T02:31:29.379 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:31:29.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.489+0000 7f658c4ba640 1 Processor -- start 2024-09-12T02:31:29.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.490+0000 7f658c4ba640 1 -- start start 2024-09-12T02:31:29.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.491+0000 7f658c4ba640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f65841500a0 0x7f65840c3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:29.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.491+0000 7f658c4ba640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65840c3e00 0x7f658406dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:29.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.491+0000 7f658c4ba640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65840ad5c0 con 0x7f658406e650 2024-09-12T02:31:29.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.491+0000 7f658c4ba640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f658406ef50 con 0x7f65841500a0 2024-09-12T02:31:29.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.491+0000 7f658c4ba640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f65840ad860 con 0x7f65840c3e00 2024-09-12T02:31:29.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.491+0000 7f658a256640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f65841500a0 0x7f65840c3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:29.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.491+0000 7f6589a55640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f658406e650 0x7f6584150930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49814/0 (socket says 172.21.15.60:49814) 2024-09-12T02:31:29.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.491+0000 7f6589a55640 1 -- 172.21.15.60:0/2603486140 learned_addr learned my addr 172.21.15.60:0/2603486140 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:31:29.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.491+0000 7f658aa57640 1 --2- 172.21.15.60:0/2603486140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65840c3e00 0x7f658406dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:29.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.491+0000 7f658a256640 1 -- 172.21.15.60:0/2603486140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65840c3e00 msgr2=0x7f658406dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:29.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.491+0000 7f658a256640 1 --2- 172.21.15.60:0/2603486140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65840c3e00 0x7f658406dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:29.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.491+0000 7f658a256640 1 -- 172.21.15.60:0/2603486140 >> v1:172.21.15.60:6789/0 conn(0x7f658406e650 legacy=0x7f6584150930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:29.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.491+0000 7f658a256640 1 -- 172.21.15.60:0/2603486140 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f658406ec70 con 0x7f65841500a0 2024-09-12T02:31:29.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.492+0000 7f658a256640 1 --2- 172.21.15.60:0/2603486140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65841500a0 0x7f65840c3000 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f658000ba40 tx=0x7f658002c590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e05cf318eb4786db server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:29.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.492+0000 7f6589254640 1 -- 172.21.15.60:0/2603486140 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f658003a070 con 0x7f65841500a0 2024-09-12T02:31:29.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.492+0000 7f6589254640 1 -- 172.21.15.60:0/2603486140 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6580032480 con 0x7f65841500a0 2024-09-12T02:31:29.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.492+0000 7f6589254640 1 -- 172.21.15.60:0/2603486140 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6580032850 con 0x7f65841500a0 2024-09-12T02:31:29.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.493+0000 7f658c4ba640 1 -- 172.21.15.60:0/2603486140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65841500a0 msgr2=0x7f65840c3000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:29.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.493+0000 7f658c4ba640 1 --2- 172.21.15.60:0/2603486140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65841500a0 0x7f65840c3000 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f658000ba40 tx=0x7f658002c590 comp rx=0 tx=0).stop 2024-09-12T02:31:29.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.493+0000 7f658c4ba640 1 -- 172.21.15.60:0/2603486140 shutdown_connections 2024-09-12T02:31:29.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.493+0000 7f658c4ba640 1 --2- 172.21.15.60:0/2603486140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65840c3e00 0x7f658406dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:29.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.493+0000 7f658c4ba640 1 --2- 172.21.15.60:0/2603486140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65841500a0 0x7f65840c3000 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:29.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.493+0000 7f658c4ba640 1 -- 172.21.15.60:0/2603486140 >> 172.21.15.60:0/2603486140 conn(0x7f65840c7a40 msgr2=0x7f65840c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:29.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.493+0000 7f658c4ba640 1 -- 172.21.15.60:0/2603486140 shutdown_connections 2024-09-12T02:31:29.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.493+0000 7f658c4ba640 1 -- 172.21.15.60:0/2603486140 wait complete. 2024-09-12T02:31:29.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.494+0000 7f658c4ba640 1 Processor -- start 2024-09-12T02:31:29.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.494+0000 7f658c4ba640 1 -- start start 2024-09-12T02:31:29.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.495+0000 7f658c4ba640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f658406e650 0x7f65840a91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:29.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.495+0000 7f658c4ba640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65840c3e00 0x7f65840a8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:29.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.495+0000 7f658c4ba640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65841500a0 0x7f6584148b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:29.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.495+0000 7f658c4ba640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f65840adb10 con 0x7f65840c3e00 2024-09-12T02:31:29.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.495+0000 7f658c4ba640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f65840c3540 con 0x7f658406e650 2024-09-12T02:31:29.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.495+0000 7f658c4ba640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6584150480 con 0x7f65841500a0 2024-09-12T02:31:29.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.495+0000 7f6589a55640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65840c3e00 0x7f65840a8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:29.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.495+0000 7f6589a55640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65840c3e00 0x7f65840a8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50674/0 (socket says 172.21.15.60:50674) 2024-09-12T02:31:29.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.495+0000 7f6589a55640 1 -- 172.21.15.60:0/715852598 learned_addr learned my addr 172.21.15.60:0/715852598 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:31:29.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.495+0000 7f658a256640 1 --2- 172.21.15.60:0/715852598 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f658406e650 0x7f65840a91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:29.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.495+0000 7f658aa57640 1 --2- 172.21.15.60:0/715852598 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65841500a0 0x7f6584148b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:29.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.495+0000 7f6589a55640 1 -- 172.21.15.60:0/715852598 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65841500a0 msgr2=0x7f6584148b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:29.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.495+0000 7f6589a55640 1 --2- 172.21.15.60:0/715852598 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65841500a0 0x7f6584148b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:29.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.495+0000 7f6589a55640 1 -- 172.21.15.60:0/715852598 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f658406e650 msgr2=0x7f65840a91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:29.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.495+0000 7f6589a55640 1 --2- 172.21.15.60:0/715852598 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f658406e650 0x7f65840a91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:29.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.495+0000 7f6589a55640 1 -- 172.21.15.60:0/715852598 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65840a9f00 con 0x7f65840c3e00 2024-09-12T02:31:29.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.495+0000 7f6589a55640 1 --2- 172.21.15.60:0/715852598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65840c3e00 0x7f65840a8180 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f657400c3c0 tx=0x7f657400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:29.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.496+0000 7f657affd640 1 -- 172.21.15.60:0/715852598 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6574017070 con 0x7f65840c3e00 2024-09-12T02:31:29.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.496+0000 7f657affd640 1 -- 172.21.15.60:0/715852598 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6574005ce0 con 0x7f65840c3e00 2024-09-12T02:31:29.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.496+0000 7f657affd640 1 -- 172.21.15.60:0/715852598 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65740072f0 con 0x7f65840c3e00 2024-09-12T02:31:29.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.496+0000 7f658c4ba640 1 -- 172.21.15.60:0/715852598 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65841e8790 con 0x7f65840c3e00 2024-09-12T02:31:29.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.496+0000 7f658c4ba640 1 -- 172.21.15.60:0/715852598 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65840a9700 con 0x7f65840c3e00 2024-09-12T02:31:29.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.497+0000 7f658c4ba640 1 -- 172.21.15.60:0/715852598 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65841e8ad0 con 0x7f65840c3e00 2024-09-12T02:31:29.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.497+0000 7f657affd640 1 -- 172.21.15.60:0/715852598 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f657401a070 con 0x7f65840c3e00 2024-09-12T02:31:29.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.498+0000 7f657affd640 1 --2- 172.21.15.60:0/715852598 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f656806be30 0x7f656806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:29.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.498+0000 7f657affd640 1 -- 172.21.15.60:0/715852598 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f657408a4c0 con 0x7f65840c3e00 2024-09-12T02:31:29.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.498+0000 7f658a256640 1 --2- 172.21.15.60:0/715852598 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f656806be30 0x7f656806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:29.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.499+0000 7f658a256640 1 --2- 172.21.15.60:0/715852598 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f656806be30 0x7f656806e2f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6580037000 tx=0x7f6580030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:29.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.503+0000 7f657affd640 1 -- 172.21.15.60:0/715852598 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6574058470 con 0x7f65840c3e00 2024-09-12T02:31:29.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.803+0000 7f658c4ba640 1 -- 172.21.15.60:0/715852598 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f65840c2770 con 0x7f65840c3e00 2024-09-12T02:31:29.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.804+0000 7f657affd640 1 -- 172.21.15.60:0/715852598 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f657405c770 con 0x7f65840c3e00 2024-09-12T02:31:29.805 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":76,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:31:29.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.806+0000 7f658c4ba640 1 -- 172.21.15.60:0/715852598 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f656806be30 msgr2=0x7f656806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:29.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.806+0000 7f658c4ba640 1 --2- 172.21.15.60:0/715852598 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f656806be30 0x7f656806e2f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6580037000 tx=0x7f6580030000 comp rx=0 tx=0).stop 2024-09-12T02:31:29.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.806+0000 7f658c4ba640 1 -- 172.21.15.60:0/715852598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65840c3e00 msgr2=0x7f65840a8180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:29.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.806+0000 7f658c4ba640 1 --2- 172.21.15.60:0/715852598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65840c3e00 0x7f65840a8180 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f657400c3c0 tx=0x7f657400c880 comp rx=0 tx=0).stop 2024-09-12T02:31:29.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.806+0000 7f658c4ba640 1 -- 172.21.15.60:0/715852598 shutdown_connections 2024-09-12T02:31:29.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.806+0000 7f658c4ba640 1 --2- 172.21.15.60:0/715852598 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f656806be30 0x7f656806e2f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:29.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.806+0000 7f658c4ba640 1 --2- 172.21.15.60:0/715852598 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65841500a0 0x7f6584148b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:29.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.806+0000 7f658c4ba640 1 --2- 172.21.15.60:0/715852598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65840c3e00 0x7f65840a8180 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:29.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.806+0000 7f658c4ba640 1 --2- 172.21.15.60:0/715852598 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f658406e650 0x7f65840a91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:29.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.806+0000 7f658c4ba640 1 -- 172.21.15.60:0/715852598 >> 172.21.15.60:0/715852598 conn(0x7f65840c7a40 msgr2=0x7f65840c43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:29.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.806+0000 7f658c4ba640 1 -- 172.21.15.60:0/715852598 shutdown_connections 2024-09-12T02:31:29.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.806+0000 7f658c4ba640 1 -- 172.21.15.60:0/715852598 wait complete. 2024-09-12T02:31:29.818 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-12T02:31:29.818 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-12T02:31:29.818 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-12T02:31:29.818 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-12T02:31:29.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.924+0000 7f11bed8d640 1 Processor -- start 2024-09-12T02:31:29.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.924+0000 7f11bed8d640 1 -- start start 2024-09-12T02:31:29.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.925+0000 7f11bed8d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11b8150480 0x7f11b80c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:29.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.925+0000 7f11bed8d640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11b815a7c0 con 0x7f11b806c650 2024-09-12T02:31:29.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.925+0000 7f11bed8d640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11b8159a00 con 0x7f11b80ca390 2024-09-12T02:31:29.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.925+0000 7f11bed8d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f11b806c240 con 0x7f11b8150480 2024-09-12T02:31:29.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.925+0000 7f11b7fff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f11b806c650 0x7f11b80c9c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49818/0 (socket says 172.21.15.60:49818) 2024-09-12T02:31:29.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.925+0000 7f11b7fff640 1 -- 172.21.15.60:0/2998119393 learned_addr learned my addr 172.21.15.60:0/2998119393 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:31:29.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.925+0000 7f11bcb29640 1 --2- 172.21.15.60:0/2998119393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11b8150480 0x7f11b80c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:29.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.925+0000 7f11bcb29640 1 -- 172.21.15.60:0/2998119393 >> v1:172.21.15.105:6789/0 conn(0x7f11b80ca390 legacy=0x7f11b8160bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:29.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.925+0000 7f11bcb29640 1 -- 172.21.15.60:0/2998119393 >> v1:172.21.15.60:6789/0 conn(0x7f11b806c650 legacy=0x7f11b80c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:29.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.925+0000 7f11b77fe640 1 -- 172.21.15.60:0/2998119393 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1054488901 0 0) 0x7f11b8159a00 con 0x7f11b80ca390 2024-09-12T02:31:29.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.926+0000 7f11bcb29640 1 -- 172.21.15.60:0/2998119393 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11b8159ce0 con 0x7f11b8150480 2024-09-12T02:31:29.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.926+0000 7f11bcb29640 1 --2- 172.21.15.60:0/2998119393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11b8150480 0x7f11b80c7a90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f11ac0097d0 tx=0x7f11ac02a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b222a1c836cedfb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:29.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.929+0000 7f11b77fe640 1 -- 172.21.15.60:0/2998119393 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ac037070 con 0x7f11b8150480 2024-09-12T02:31:29.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.929+0000 7f11b77fe640 1 -- 172.21.15.60:0/2998119393 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11ac032440 con 0x7f11b8150480 2024-09-12T02:31:29.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.929+0000 7f11b77fe640 1 -- 172.21.15.60:0/2998119393 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ac032810 con 0x7f11b8150480 2024-09-12T02:31:29.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.930+0000 7f11bed8d640 1 -- 172.21.15.60:0/2998119393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11b8150480 msgr2=0x7f11b80c7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:29.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.930+0000 7f11bed8d640 1 --2- 172.21.15.60:0/2998119393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11b8150480 0x7f11b80c7a90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f11ac0097d0 tx=0x7f11ac02a200 comp rx=0 tx=0).stop 2024-09-12T02:31:29.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.930+0000 7f11bed8d640 1 -- 172.21.15.60:0/2998119393 shutdown_connections 2024-09-12T02:31:29.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.930+0000 7f11bed8d640 1 --2- 172.21.15.60:0/2998119393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11b8150480 0x7f11b80c7a90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:29.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.930+0000 7f11bed8d640 1 -- 172.21.15.60:0/2998119393 >> 172.21.15.60:0/2998119393 conn(0x7f11b8068030 msgr2=0x7f11b8073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:29.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.930+0000 7f11bed8d640 1 -- 172.21.15.60:0/2998119393 shutdown_connections 2024-09-12T02:31:29.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.930+0000 7f11bed8d640 1 -- 172.21.15.60:0/2998119393 wait complete. 2024-09-12T02:31:29.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.931+0000 7f11bed8d640 1 Processor -- start 2024-09-12T02:31:29.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.931+0000 7f11bed8d640 1 -- start start 2024-09-12T02:31:29.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.932+0000 7f11bed8d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11b806c650 0x7f11b81ebfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:29.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.932+0000 7f11bed8d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11b80ca390 0x7f11b81e3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:29.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.932+0000 7f11bed8d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11b8150480 0x7f11b81508d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:29.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.932+0000 7f11bed8d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f11b806d270 con 0x7f11b806c650 2024-09-12T02:31:29.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.932+0000 7f11bed8d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f11b815a330 con 0x7f11b80ca390 2024-09-12T02:31:29.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.932+0000 7f11bed8d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f11b8156270 con 0x7f11b8150480 2024-09-12T02:31:29.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.932+0000 7f11bcb29640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11b806c650 0x7f11b81ebfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:29.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.932+0000 7f11bcb29640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11b806c650 0x7f11b81ebfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50680/0 (socket says 172.21.15.60:50680) 2024-09-12T02:31:29.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.932+0000 7f11bcb29640 1 -- 172.21.15.60:0/3674535685 learned_addr learned my addr 172.21.15.60:0/3674535685 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:31:29.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.932+0000 7f11b7fff640 1 --2- 172.21.15.60:0/3674535685 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11b80ca390 0x7f11b81e3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:29.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.932+0000 7f11bd32a640 1 --2- 172.21.15.60:0/3674535685 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11b8150480 0x7f11b81508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:29.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.933+0000 7f11bcb29640 1 -- 172.21.15.60:0/3674535685 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11b8150480 msgr2=0x7f11b81508d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:29.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.933+0000 7f11bcb29640 1 --2- 172.21.15.60:0/3674535685 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11b8150480 0x7f11b81508d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:29.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.933+0000 7f11bcb29640 1 -- 172.21.15.60:0/3674535685 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11b80ca390 msgr2=0x7f11b81e3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:29.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.933+0000 7f11bcb29640 1 --2- 172.21.15.60:0/3674535685 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11b80ca390 0x7f11b81e3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:29.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.933+0000 7f11bcb29640 1 -- 172.21.15.60:0/3674535685 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11b81e2290 con 0x7f11b806c650 2024-09-12T02:31:29.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.933+0000 7f11bcb29640 1 --2- 172.21.15.60:0/3674535685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11b806c650 0x7f11b81ebfe0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f11ac0097d0 tx=0x7f11ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:29.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.933+0000 7f11b57fa640 1 -- 172.21.15.60:0/3674535685 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ac037040 con 0x7f11b806c650 2024-09-12T02:31:29.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.933+0000 7f11b57fa640 1 -- 172.21.15.60:0/3674535685 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11ac042070 con 0x7f11b806c650 2024-09-12T02:31:29.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.933+0000 7f11b57fa640 1 -- 172.21.15.60:0/3674535685 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ac030bd0 con 0x7f11b806c650 2024-09-12T02:31:29.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.933+0000 7f11bed8d640 1 -- 172.21.15.60:0/3674535685 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11b81f0100 con 0x7f11b806c650 2024-09-12T02:31:29.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.933+0000 7f11bed8d640 1 -- 172.21.15.60:0/3674535685 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11b81e39b0 con 0x7f11b806c650 2024-09-12T02:31:29.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.934+0000 7f11bed8d640 1 --2- 172.21.15.60:0/3674535685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11b8150e10 0x7f11b80afb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:29.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.934+0000 7f11bed8d640 1 -- 172.21.15.60:0/3674535685 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f11b8159a00 con 0x7f11b8150e10 2024-09-12T02:31:29.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.934+0000 7f11b7fff640 1 --2- 172.21.15.60:0/3674535685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11b8150e10 0x7f11b80afb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:29.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.935+0000 7f11b7fff640 1 -- 172.21.15.60:0/3674535685 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f11b806c430 con 0x7f11b8150e10 2024-09-12T02:31:29.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.935+0000 7f11b57fa640 1 -- 172.21.15.60:0/3674535685 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f11ac047460 con 0x7f11b806c650 2024-09-12T02:31:29.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.935+0000 7f11b7fff640 1 --2- 172.21.15.60:0/3674535685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11b8150e10 0x7f11b80afb30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f11b8150030 tx=0x7f11a4001880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:29.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.935+0000 7f11b57fa640 1 --2- 172.21.15.60:0/3674535685 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f119c06be30 0x7f119c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:29.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.936+0000 7f11bd32a640 1 --2- 172.21.15.60:0/3674535685 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f119c06be30 0x7f119c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:29.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.936+0000 7f11b57fa640 1 -- 172.21.15.60:0/3674535685 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f11ac0abc60 con 0x7f11b806c650 2024-09-12T02:31:29.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.936+0000 7f11b57fa640 1 -- 172.21.15.60:0/3674535685 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a4011580 con 0x7f11b8150e10 2024-09-12T02:31:29.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.936+0000 7f11b57fa640 1 -- 172.21.15.60:0/3674535685 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f11a4011720 con 0x7f11b8150e10 2024-09-12T02:31:29.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.936+0000 7f11b57fa640 1 -- 172.21.15.60:0/3674535685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11b8150e10 msgr2=0x7f11b80afb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:29.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.936+0000 7f11b57fa640 1 --2- 172.21.15.60:0/3674535685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11b8150e10 0x7f11b80afb30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f11b8150030 tx=0x7f11a4001880 comp rx=0 tx=0).stop 2024-09-12T02:31:29.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.936+0000 7f11b57fa640 1 -- 172.21.15.60:0/3674535685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11b8150e10 msgr2=0x7f11b80afb30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:31:29.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.936+0000 7f11b57fa640 1 --2- 172.21.15.60:0/3674535685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11b8150e10 0x7f11b80afb30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:29.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.936+0000 7f11bd32a640 1 --2- 172.21.15.60:0/3674535685 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f119c06be30 0x7f119c06e2f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f11b00012e0 tx=0x7f11b0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:29.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.943+0000 7f11bed8d640 1 --2- 172.21.15.60:0/3674535685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11b8151270 0x7f11b80b0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:29.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.943+0000 7f11bed8d640 1 -- 172.21.15.60:0/3674535685 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f11b80cbfc0 con 0x7f11b8151270 2024-09-12T02:31:29.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.943+0000 7f11b7fff640 1 --2- 172.21.15.60:0/3674535685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11b8151270 0x7f11b80b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:29.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.943+0000 7f11b7fff640 1 -- 172.21.15.60:0/3674535685 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f11b80754c0 con 0x7f11b8151270 2024-09-12T02:31:29.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.944+0000 7f11b7fff640 1 --2- 172.21.15.60:0/3674535685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11b8151270 0x7f11b80b0070 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f11b8156aa0 tx=0x7f11a4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:29.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.944+0000 7f11b57fa640 1 -- 172.21.15.60:0/3674535685 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a4011de0 con 0x7f11b8151270 2024-09-12T02:31:29.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.944+0000 7f11b57fa640 1 -- 172.21.15.60:0/3674535685 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4886 (secure 0 0 0) 0x7f11a4011de0 con 0x7f11b8151270 2024-09-12T02:31:29.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.944+0000 7f11b57fa640 1 -- 172.21.15.60:0/3674535685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11b8151270 msgr2=0x7f11b80b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:29.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.944+0000 7f11b57fa640 1 --2- 172.21.15.60:0/3674535685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11b8151270 0x7f11b80b0070 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f11b8156aa0 tx=0x7f11a4000ed0 comp rx=0 tx=0).stop 2024-09-12T02:31:29.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.944+0000 7f11b57fa640 1 -- 172.21.15.60:0/3674535685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11b8151270 msgr2=0x7f11b80b0070 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:31:29.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.944+0000 7f11b57fa640 1 --2- 172.21.15.60:0/3674535685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11b8151270 0x7f11b80b0070 secure :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f11b8156aa0 tx=0x7f11a4000ed0 comp rx=0 tx=0).stop 2024-09-12T02:31:29.945 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:31:29.946 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:31:29.946 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:31:29.946 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:31:29.946 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 76, 2024-09-12T02:31:29.946 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 153048, 2024-09-12T02:31:29.946 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:31:29.946 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:31:29.946 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:31:29.946 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:31:29.946 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:31:29.946 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 16, 2024-09-12T02:31:29.946 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:31:29.946 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:31:29.947 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:31:29.947 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:31:29.947 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:31:29.947 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:31:29.947 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:31:29.947 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:31:29.947 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:31:29.947 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:31:29.947 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:31:29.947 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:31:29.947 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:31:29.947 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:31:29.947 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:31:29.947 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:31:29.948 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:31:29.948 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:31:29.948 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:31:29.948 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:31:29.948 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:31:29.948 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:31:29.948 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:31:29.948 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:31:29.948 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:31:29.948 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:31:29.948 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:31:29.948 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:31:29.948 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:29.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:29.949 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:31:29.949 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:31:29.949 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:31:29.949 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:31:29.949 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:31:29.949 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:31:29.949 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:31:29.949 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:31:29.949 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:31:29.949 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:31:29.949 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:31:29.949 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:31:29.950 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:31:29.950 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:31:29.950 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:31:29.950 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:31:29.950 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:31:29.950 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:31:29.950 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:31:29.950 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:31:29.950 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:31:29.950 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:31:29.950 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:31:29.950 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:31:29.950 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:31:29.951 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:31:29.951 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:31:29.951 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:31:29.951 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:31:29.951 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:31:29.951 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:29.951 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:31:29.951 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:29.951 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:31:29.951 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:31:29.951 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:31:29.951 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:31:29.951 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:29.952 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:31:29.952 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:31:29.952 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:29.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:29.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:29.952 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:31:29.952 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:31:29.952 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:29.952 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:29.952 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:29.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:29.952 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:31:29.953 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:31:29.953 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:31:29.953 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:31:29.953 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:31:29.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:29.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:29.953 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:31:29.953 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:31:29.953 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:31:29.953 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:31:29.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:29.953 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:31:29.953 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:31:29.954 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:29.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:29.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:29.954 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:31:29.954 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:31:29.954 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:29.954 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:29.954 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:29.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:29.954 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:31:29.955 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:31:29.955 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:31:29.955 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:31:29.955 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:31:29.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:29.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:29.955 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:31:29.955 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:31:29.955 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:31:29.955 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:31:29.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:29.955 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:31:29.955 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:31:29.956 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:29.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:29.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:29.956 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:31:29.956 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:31:29.956 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:29.956 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:29.956 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:29.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:29.956 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:31:29.956 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:31:29.956 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:31:29.957 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:31:29.957 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:31:29.957 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:29.957 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:29.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:29.957 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:31:29.957 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:31:29.957 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:29.957 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:31:29.957 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:31:29.957 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:31:29.957 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:29.957 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:31:29.958 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:31:29.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:29.958 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:31:29.958 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:31:29.958 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:31:29.958 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:29.958 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:31:29.958 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:31:29.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:29.958 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:31:29.958 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:31:29.958 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:31:29.958 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:29.959 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:31:29.959 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:31:29.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:29.959 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:31:29.959 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:31:29.959 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:31:29.959 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:29.959 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:29.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:29.959 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:31:29.959 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:31:29.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.944+0000 7f11bed8d640 1 -- 172.21.15.60:0/3674535685 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f119c06be30 msgr2=0x7f119c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:29.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.944+0000 7f11bed8d640 1 --2- 172.21.15.60:0/3674535685 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f119c06be30 0x7f119c06e2f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f11b00012e0 tx=0x7f11b0009040 comp rx=0 tx=0).stop 2024-09-12T02:31:29.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.944+0000 7f11bed8d640 1 -- 172.21.15.60:0/3674535685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11b806c650 msgr2=0x7f11b81ebfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:29.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.944+0000 7f11bed8d640 1 --2- 172.21.15.60:0/3674535685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11b806c650 0x7f11b81ebfe0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f11ac0097d0 tx=0x7f11ac0046c0 comp rx=0 tx=0).stop 2024-09-12T02:31:29.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.944+0000 7f11bd32a640 1 -- 172.21.15.60:0/3674535685 reap_dead start 2024-09-12T02:31:29.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.944+0000 7f11bd32a640 1 -- 172.21.15.60:0/3674535685 reap_dead start 2024-09-12T02:31:29.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.945+0000 7f11bed8d640 1 -- 172.21.15.60:0/3674535685 shutdown_connections 2024-09-12T02:31:29.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.945+0000 7f11bed8d640 1 -- 172.21.15.60:0/3674535685 >> 172.21.15.60:0/3674535685 conn(0x7f11b8068030 msgr2=0x7f11b80c7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:29.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.945+0000 7f11bed8d640 1 -- 172.21.15.60:0/3674535685 shutdown_connections 2024-09-12T02:31:29.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:29.945+0000 7f11bed8d640 1 -- 172.21.15.60:0/3674535685 wait complete. 2024-09-12T02:31:29.962 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:31:29.962 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-12T02:31:29.962 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-12T02:31:30.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.074+0000 7f123fd2a640 1 Processor -- start 2024-09-12T02:31:30.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.074+0000 7f123fd2a640 1 -- start start 2024-09-12T02:31:30.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.075+0000 7f123fd2a640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f12380addf0 0x7f12380acb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:30.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.075+0000 7f123fd2a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12380c59d0 0x7f1238157c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:30.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.075+0000 7f123fd2a640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12380c3e60 con 0x7f12380c55f0 2024-09-12T02:31:30.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.075+0000 7f123fd2a640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f12380c8580 con 0x7f12380addf0 2024-09-12T02:31:30.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.075+0000 7f123fd2a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f12380c4120 con 0x7f12380c59d0 2024-09-12T02:31:30.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.075+0000 7f123d2c5640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f12380addf0 0x7f12380acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:30.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.075+0000 7f123dac6640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f12380c55f0 0x7f12380ac470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:60194/0 (socket says 172.21.15.60:60194) 2024-09-12T02:31:30.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.075+0000 7f123e2c7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12380c59d0 0x7f1238157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:30.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.075+0000 7f123dac6640 1 -- 172.21.15.60:0/3752359780 learned_addr learned my addr 172.21.15.60:0/3752359780 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:31:30.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.076+0000 7f123e2c7640 1 -- 172.21.15.60:0/3752359780 >> v2:172.21.15.105:3300/0 conn(0x7f12380addf0 msgr2=0x7f12380acb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:30.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.076+0000 7f123e2c7640 1 --2- 172.21.15.60:0/3752359780 >> v2:172.21.15.105:3300/0 conn(0x7f12380addf0 0x7f12380acb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:30.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.076+0000 7f123e2c7640 1 -- 172.21.15.60:0/3752359780 >> v1:172.21.15.105:6789/0 conn(0x7f12380c55f0 legacy=0x7f12380ac470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:30.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.076+0000 7f123e2c7640 1 -- 172.21.15.60:0/3752359780 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12380c4400 con 0x7f12380c59d0 2024-09-12T02:31:30.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.076+0000 7f123cac4640 1 -- 172.21.15.60:0/3752359780 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3866834250 0 0) 0x7f12380c3e60 con 0x7f12380c55f0 2024-09-12T02:31:30.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.076+0000 7f123d2c5640 1 --2- 172.21.15.60:0/3752359780 >> v2:172.21.15.105:3300/0 conn(0x7f12380addf0 0x7f12380acb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:31:30.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.076+0000 7f123e2c7640 1 --2- 172.21.15.60:0/3752359780 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12380c59d0 0x7f1238157c90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1230009d90 tx=0x7f123002a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24dd28f353e2d85a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:30.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.077+0000 7f123cac4640 1 -- 172.21.15.60:0/3752359780 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1230031600 con 0x7f12380c59d0 2024-09-12T02:31:30.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.077+0000 7f123cac4640 1 -- 172.21.15.60:0/3752359780 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12300317a0 con 0x7f12380c59d0 2024-09-12T02:31:30.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.077+0000 7f123cac4640 1 -- 172.21.15.60:0/3752359780 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1230031b70 con 0x7f12380c59d0 2024-09-12T02:31:30.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.077+0000 7f123fd2a640 1 -- 172.21.15.60:0/3752359780 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12380c59d0 msgr2=0x7f1238157c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:30.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.077+0000 7f123fd2a640 1 --2- 172.21.15.60:0/3752359780 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12380c59d0 0x7f1238157c90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1230009d90 tx=0x7f123002a5d0 comp rx=0 tx=0).stop 2024-09-12T02:31:30.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.077+0000 7f123fd2a640 1 -- 172.21.15.60:0/3752359780 shutdown_connections 2024-09-12T02:31:30.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.077+0000 7f123fd2a640 1 --2- 172.21.15.60:0/3752359780 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12380c59d0 0x7f1238157c90 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:30.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.077+0000 7f123fd2a640 1 --2- 172.21.15.60:0/3752359780 >> v2:172.21.15.105:3300/0 conn(0x7f12380addf0 0x7f12380acb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:30.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.077+0000 7f123fd2a640 1 -- 172.21.15.60:0/3752359780 >> 172.21.15.60:0/3752359780 conn(0x7f12380c8a50 msgr2=0x7f12380c8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:30.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.077+0000 7f123fd2a640 1 -- 172.21.15.60:0/3752359780 shutdown_connections 2024-09-12T02:31:30.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.077+0000 7f123fd2a640 1 -- 172.21.15.60:0/3752359780 wait complete. 2024-09-12T02:31:30.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.079+0000 7f123fd2a640 1 Processor -- start 2024-09-12T02:31:30.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.079+0000 7f123fd2a640 1 -- start start 2024-09-12T02:31:30.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.079+0000 7f123fd2a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12380addf0 0x7f12380a77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:30.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.079+0000 7f123fd2a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12380c55f0 0x7f12380c15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:30.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.079+0000 7f123fd2a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12380c59d0 0x7f12381ef190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:30.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.080+0000 7f123fd2a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f12380c35d0 con 0x7f12380c59d0 2024-09-12T02:31:30.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.080+0000 7f123fd2a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f12380c3450 con 0x7f12380c55f0 2024-09-12T02:31:30.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.080+0000 7f123fd2a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f12380abb00 con 0x7f12380addf0 2024-09-12T02:31:30.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.080+0000 7f123dac6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12380addf0 0x7f12380a77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:30.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.080+0000 7f123dac6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12380addf0 0x7f12380a77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:32976/0 (socket says 172.21.15.60:32976) 2024-09-12T02:31:30.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.080+0000 7f123dac6640 1 -- 172.21.15.60:0/2249217151 learned_addr learned my addr 172.21.15.60:0/2249217151 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:31:30.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.080+0000 7f123d2c5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12380c55f0 0x7f12380c15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:30.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.080+0000 7f123e2c7640 1 --2- 172.21.15.60:0/2249217151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12380c59d0 0x7f12381ef190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:30.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.080+0000 7f123dac6640 1 -- 172.21.15.60:0/2249217151 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12380c55f0 msgr2=0x7f12380c15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:30.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.080+0000 7f123dac6640 1 --2- 172.21.15.60:0/2249217151 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12380c55f0 0x7f12380c15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:30.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.080+0000 7f123dac6640 1 -- 172.21.15.60:0/2249217151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12380c59d0 msgr2=0x7f12381ef190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:30.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.080+0000 7f123dac6640 1 --2- 172.21.15.60:0/2249217151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12380c59d0 0x7f12381ef190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:30.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.080+0000 7f123dac6640 1 -- 172.21.15.60:0/2249217151 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12380a70a0 con 0x7f12380addf0 2024-09-12T02:31:30.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.080+0000 7f123d2c5640 1 --2- 172.21.15.60:0/2249217151 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12380c55f0 0x7f12380c15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:31:30.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.080+0000 7f123dac6640 1 --2- 172.21.15.60:0/2249217151 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12380addf0 0x7f12380a77c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f123400c4d0 tx=0x7f123400c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:30.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.080+0000 7f122e7fc640 1 -- 172.21.15.60:0/2249217151 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1234018070 con 0x7f12380addf0 2024-09-12T02:31:30.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.080+0000 7f122e7fc640 1 -- 172.21.15.60:0/2249217151 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12340074e0 con 0x7f12380addf0 2024-09-12T02:31:30.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.080+0000 7f123fd2a640 1 -- 172.21.15.60:0/2249217151 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12381efb80 con 0x7f12380addf0 2024-09-12T02:31:30.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.081+0000 7f122e7fc640 1 -- 172.21.15.60:0/2249217151 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1234004a20 con 0x7f12380addf0 2024-09-12T02:31:30.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.081+0000 7f123fd2a640 1 -- 172.21.15.60:0/2249217151 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f12380c1b20 con 0x7f12380addf0 2024-09-12T02:31:30.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.081+0000 7f123fd2a640 1 --2- 172.21.15.60:0/2249217151 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12380c2ca0 0x7f12380aa530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:30.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.081+0000 7f123fd2a640 1 -- 172.21.15.60:0/2249217151 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1238070520 con 0x7f12380c2ca0 2024-09-12T02:31:30.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.082+0000 7f123d2c5640 1 --2- 172.21.15.60:0/2249217151 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12380c2ca0 0x7f12380aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:30.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.082+0000 7f123d2c5640 1 -- 172.21.15.60:0/2249217151 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1238158860 con 0x7f12380c2ca0 2024-09-12T02:31:30.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.082+0000 7f123d2c5640 1 --2- 172.21.15.60:0/2249217151 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12380c2ca0 0x7f12380aa530 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f12380ad380 tx=0x7f122800f610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:30.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.082+0000 7f122e7fc640 1 -- 172.21.15.60:0/2249217151 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1234004bc0 con 0x7f12380addf0 2024-09-12T02:31:30.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.083+0000 7f122e7fc640 1 --2- 172.21.15.60:0/2249217151 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f121c06be30 0x7f121c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:30.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.083+0000 7f122e7fc640 1 -- 172.21.15.60:0/2249217151 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f123408a370 con 0x7f12380addf0 2024-09-12T02:31:30.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.083+0000 7f123e2c7640 1 --2- 172.21.15.60:0/2249217151 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f121c06be30 0x7f121c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:30.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.083+0000 7f122e7fc640 1 -- 172.21.15.60:0/2249217151 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1228014440 con 0x7f12380c2ca0 2024-09-12T02:31:30.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.083+0000 7f122e7fc640 1 -- 172.21.15.60:0/2249217151 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f12280145e0 con 0x7f12380c2ca0 2024-09-12T02:31:30.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.083+0000 7f122e7fc640 1 -- 172.21.15.60:0/2249217151 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12380c2ca0 msgr2=0x7f12380aa530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:30.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.083+0000 7f122e7fc640 1 --2- 172.21.15.60:0/2249217151 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12380c2ca0 0x7f12380aa530 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f12380ad380 tx=0x7f122800f610 comp rx=0 tx=0).stop 2024-09-12T02:31:30.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.083+0000 7f122e7fc640 1 -- 172.21.15.60:0/2249217151 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12380c2ca0 msgr2=0x7f12380aa530 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:31:30.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.083+0000 7f122e7fc640 1 --2- 172.21.15.60:0/2249217151 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12380c2ca0 0x7f12380aa530 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:30.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.083+0000 7f123e2c7640 1 --2- 172.21.15.60:0/2249217151 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f121c06be30 0x7f121c06e2f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1230034000 tx=0x7f123002f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:30.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.090+0000 7f123fd2a640 1 --2- 172.21.15.60:0/2249217151 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12381ef6d0 0x7f12380aaa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:30.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.090+0000 7f123fd2a640 1 -- 172.21.15.60:0/2249217151 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1238069a00 con 0x7f12381ef6d0 2024-09-12T02:31:30.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.091+0000 7f123d2c5640 1 --2- 172.21.15.60:0/2249217151 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12381ef6d0 0x7f12380aaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:30.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.091+0000 7f123d2c5640 1 -- 172.21.15.60:0/2249217151 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f12380ac470 con 0x7f12381ef6d0 2024-09-12T02:31:30.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.091+0000 7f123d2c5640 1 --2- 172.21.15.60:0/2249217151 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12381ef6d0 0x7f12380aaa70 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f12381e97f0 tx=0x7f12280046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:30.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.091+0000 7f122e7fc640 1 -- 172.21.15.60:0/2249217151 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1228004220 con 0x7f12381ef6d0 2024-09-12T02:31:30.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.092+0000 7f122e7fc640 1 -- 172.21.15.60:0/2249217151 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5051 (secure 0 0 0) 0x7f1228004220 con 0x7f12381ef6d0 2024-09-12T02:31:30.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.092+0000 7f122e7fc640 1 -- 172.21.15.60:0/2249217151 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12381ef6d0 msgr2=0x7f12380aaa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:30.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.092+0000 7f122e7fc640 1 --2- 172.21.15.60:0/2249217151 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12381ef6d0 0x7f12380aaa70 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f12381e97f0 tx=0x7f12280046c0 comp rx=0 tx=0).stop 2024-09-12T02:31:30.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.092+0000 7f122e7fc640 1 -- 172.21.15.60:0/2249217151 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12381ef6d0 msgr2=0x7f12380aaa70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:31:30.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.092+0000 7f122e7fc640 1 --2- 172.21.15.60:0/2249217151 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12381ef6d0 0x7f12380aaa70 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:30.093 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:31:30.093 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:31:30.093 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:31:30.093 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:31:30.093 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 76, 2024-09-12T02:31:30.094 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 435526, 2024-09-12T02:31:30.094 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:31:30.094 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:31:30.094 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:31:30.094 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:31:30.094 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:31:30.094 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 16, 2024-09-12T02:31:30.094 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:31:30.094 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:31:30.094 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:31:30.095 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:31:30.095 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:31:30.095 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:31:30.095 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:31:30.095 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:31:30.095 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:31:30.095 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:31:30.095 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:31:30.095 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:31:30.095 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:31:30.095 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:31:30.095 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:31:30.095 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:31:30.095 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:31:30.096 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:31:30.096 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:31:30.096 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:31:30.096 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:31:30.096 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:31:30.096 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:31:30.096 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:31:30.096 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:31:30.096 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:31:30.096 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:31:30.097 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:31:30.097 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:30.097 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:30.097 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:31:30.097 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:31:30.097 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:31:30.097 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:31:30.097 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:31:30.097 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:31:30.097 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:31:30.097 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:31:30.097 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:31:30.098 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:31:30.098 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:31:30.098 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:31:30.098 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:31:30.098 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:31:30.098 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:31:30.098 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:31:30.098 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:31:30.098 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:31:30.098 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:31:30.098 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:31:30.098 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:31:30.098 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:31:30.099 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:31:30.099 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:31:30.099 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:31:30.099 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:31:30.099 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:31:30.099 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:31:30.099 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:31:30.099 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:31:30.099 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:30.099 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:31:30.099 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:30.099 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:31:30.099 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:31:30.099 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:31:30.100 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:31:30.100 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:30.100 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:31:30.100 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:31:30.100 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:30.100 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:30.100 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:30.100 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:31:30.100 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:31:30.100 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:30.100 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:30.100 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:30.100 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:30.101 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:31:30.101 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:31:30.101 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:31:30.101 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:31:30.101 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:31:30.101 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:30.101 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:30.101 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:31:30.101 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:31:30.101 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:31:30.101 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:31:30.101 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:30.101 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:31:30.102 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:31:30.102 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:30.102 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:30.102 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:30.102 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:31:30.102 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:31:30.102 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:30.102 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:30.102 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:30.102 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:30.102 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:31:30.102 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:31:30.102 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:31:30.103 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:31:30.103 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:31:30.103 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:30.103 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:30.103 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:31:30.103 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:31:30.103 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:31:30.103 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:31:30.103 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:30.103 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:31:30.103 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:31:30.103 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:30.103 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:30.104 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:30.104 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:31:30.104 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:31:30.104 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:30.104 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:30.104 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:30.104 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:30.104 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:31:30.104 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:31:30.104 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:31:30.104 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:31:30.104 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:31:30.104 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:30.104 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:30.105 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:30.105 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:31:30.105 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:31:30.105 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:30.105 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:31:30.105 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:31:30.105 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:31:30.105 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:30.105 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:31:30.105 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:31:30.105 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:30.105 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:31:30.105 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:31:30.105 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:31:30.106 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:30.106 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:31:30.106 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:31:30.106 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:30.106 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:31:30.106 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:31:30.106 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-09-12T02:31:30.106 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:30.106 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:31:30.106 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:31:30.106 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:30.106 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:31:30.106 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:31:30.107 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-09-12T02:31:30.107 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:30.107 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:31:30.107 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:31:30.107 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:30.107 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:31:30.107 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:31:30.107 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:31:30.107 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:30.107 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:30.107 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:30.107 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:31:30.107 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:31:30.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.092+0000 7f123fd2a640 1 -- 172.21.15.60:0/2249217151 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f121c06be30 msgr2=0x7f121c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:30.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.092+0000 7f123fd2a640 1 --2- 172.21.15.60:0/2249217151 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f121c06be30 0x7f121c06e2f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1230034000 tx=0x7f123002f000 comp rx=0 tx=0).stop 2024-09-12T02:31:30.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.092+0000 7f123fd2a640 1 -- 172.21.15.60:0/2249217151 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12380addf0 msgr2=0x7f12380a77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:30.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.092+0000 7f123fd2a640 1 --2- 172.21.15.60:0/2249217151 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12380addf0 0x7f12380a77c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f123400c4d0 tx=0x7f123400c990 comp rx=0 tx=0).stop 2024-09-12T02:31:30.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.092+0000 7f123e2c7640 1 -- 172.21.15.60:0/2249217151 reap_dead start 2024-09-12T02:31:30.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.092+0000 7f123e2c7640 1 -- 172.21.15.60:0/2249217151 reap_dead start 2024-09-12T02:31:30.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.092+0000 7f123fd2a640 1 -- 172.21.15.60:0/2249217151 shutdown_connections 2024-09-12T02:31:30.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.092+0000 7f123fd2a640 1 -- 172.21.15.60:0/2249217151 >> 172.21.15.60:0/2249217151 conn(0x7f12380c8a50 msgr2=0x7f1238158150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:30.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.092+0000 7f123fd2a640 1 -- 172.21.15.60:0/2249217151 shutdown_connections 2024-09-12T02:31:30.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.092+0000 7f123fd2a640 1 -- 172.21.15.60:0/2249217151 wait complete. 2024-09-12T02:31:30.110 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:31:30.110 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-12T02:31:30.110 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-12T02:31:30.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.223+0000 7f5bc8427640 1 Processor -- start 2024-09-12T02:31:30.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.223+0000 7f5bc8427640 1 -- start start 2024-09-12T02:31:30.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.224+0000 7f5bc8427640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5bc0150480 0x7f5bc00c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:30.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.224+0000 7f5bc8427640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5bc006c650 0x7f5bc00c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:30.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.224+0000 7f5bc8427640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bc015a7c0 con 0x7f5bc00c9c80 2024-09-12T02:31:30.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.224+0000 7f5bc8427640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f5bc006c240 con 0x7f5bc0150480 2024-09-12T02:31:30.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.224+0000 7f5bc8427640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5bc015a330 con 0x7f5bc006c650 2024-09-12T02:31:30.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.224+0000 7f5bc61c3640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5bc0150480 0x7f5bc00c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:30.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.224+0000 7f5bc61c3640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5bc0150480 0x7f5bc00c7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50726/0 (socket says 172.21.15.60:50726) 2024-09-12T02:31:30.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.224+0000 7f5bc69c4640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f5bc00c9c80 0x7f5bc00ca130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:60206/0 (socket says 172.21.15.60:60206) 2024-09-12T02:31:30.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.224+0000 7f5bc59c2640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5bc006c650 0x7f5bc00c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:30.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.224+0000 7f5bc61c3640 1 -- 172.21.15.60:0/694583926 learned_addr learned my addr 172.21.15.60:0/694583926 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:31:30.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.225+0000 7f5bc61c3640 1 -- 172.21.15.60:0/694583926 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5bc006c650 msgr2=0x7f5bc00c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:30.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.225+0000 7f5bc61c3640 1 --2- 172.21.15.60:0/694583926 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5bc006c650 0x7f5bc00c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:30.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.225+0000 7f5bc61c3640 1 -- 172.21.15.60:0/694583926 >> v1:172.21.15.105:6789/0 conn(0x7f5bc00c9c80 legacy=0x7f5bc00ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:30.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.225+0000 7f5bc51c1640 1 -- 172.21.15.60:0/694583926 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2374933884 0 0) 0x7f5bc015a7c0 con 0x7f5bc00c9c80 2024-09-12T02:31:30.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.225+0000 7f5bc61c3640 1 -- 172.21.15.60:0/694583926 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bc0159a00 con 0x7f5bc0150480 2024-09-12T02:31:30.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.225+0000 7f5bc61c3640 1 --2- 172.21.15.60:0/694583926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bc0150480 0x7f5bc00c7a90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc009870 tx=0x7f5bbc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef6bf4e8738b8c6e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:30.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.226+0000 7f5bc51c1640 1 -- 172.21.15.60:0/694583926 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc037070 con 0x7f5bc0150480 2024-09-12T02:31:30.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.226+0000 7f5bc51c1640 1 -- 172.21.15.60:0/694583926 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bbc032440 con 0x7f5bc0150480 2024-09-12T02:31:30.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.226+0000 7f5bc51c1640 1 -- 172.21.15.60:0/694583926 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc032810 con 0x7f5bc0150480 2024-09-12T02:31:30.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.226+0000 7f5bc8427640 1 -- 172.21.15.60:0/694583926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bc0150480 msgr2=0x7f5bc00c7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:30.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.226+0000 7f5bc8427640 1 --2- 172.21.15.60:0/694583926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bc0150480 0x7f5bc00c7a90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc009870 tx=0x7f5bbc02a270 comp rx=0 tx=0).stop 2024-09-12T02:31:30.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.226+0000 7f5bc8427640 1 -- 172.21.15.60:0/694583926 shutdown_connections 2024-09-12T02:31:30.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.226+0000 7f5bc8427640 1 --2- 172.21.15.60:0/694583926 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5bc006c650 0x7f5bc00c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:30.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.226+0000 7f5bc8427640 1 --2- 172.21.15.60:0/694583926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bc0150480 0x7f5bc00c7a90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:30.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.226+0000 7f5bc8427640 1 -- 172.21.15.60:0/694583926 >> 172.21.15.60:0/694583926 conn(0x7f5bc0068030 msgr2=0x7f5bc0073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:30.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.227+0000 7f5bc8427640 1 -- 172.21.15.60:0/694583926 shutdown_connections 2024-09-12T02:31:30.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.227+0000 7f5bc8427640 1 -- 172.21.15.60:0/694583926 wait complete. 2024-09-12T02:31:30.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.228+0000 7f5bc8427640 1 Processor -- start 2024-09-12T02:31:30.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.228+0000 7f5bc8427640 1 -- start start 2024-09-12T02:31:30.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.228+0000 7f5bc8427640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5bc006c650 0x7f5bc0152580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:30.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.228+0000 7f5bc8427640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bc00c9c80 0x7f5bc01e3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:30.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.228+0000 7f5bc8427640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5bc0150480 0x7f5bc01ed2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:30.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.228+0000 7f5bc8427640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5bc006d270 con 0x7f5bc00c9c80 2024-09-12T02:31:30.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.228+0000 7f5bc8427640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5bc0159fc0 con 0x7f5bc006c650 2024-09-12T02:31:30.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.228+0000 7f5bc8427640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5bc0156270 con 0x7f5bc0150480 2024-09-12T02:31:30.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.229+0000 7f5bc59c2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bc00c9c80 0x7f5bc01e3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:30.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.229+0000 7f5bc61c3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5bc006c650 0x7f5bc0152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:30.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.229+0000 7f5bc69c4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5bc0150480 0x7f5bc01ed2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:30.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.229+0000 7f5bc59c2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bc00c9c80 0x7f5bc01e3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50738/0 (socket says 172.21.15.60:50738) 2024-09-12T02:31:30.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.229+0000 7f5bc61c3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5bc006c650 0x7f5bc0152580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:50844/0 (socket says 172.21.15.60:50844) 2024-09-12T02:31:30.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.229+0000 7f5bc59c2640 1 -- 172.21.15.60:0/3368964635 learned_addr learned my addr 172.21.15.60:0/3368964635 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:31:30.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.229+0000 7f5bc69c4640 1 --2- 172.21.15.60:0/3368964635 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5bc0150480 0x7f5bc01ed2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:32996/0 (socket says 172.21.15.60:32996) 2024-09-12T02:31:30.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.229+0000 7f5bc59c2640 1 -- 172.21.15.60:0/3368964635 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5bc0150480 msgr2=0x7f5bc01ed2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:30.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.229+0000 7f5bc59c2640 1 --2- 172.21.15.60:0/3368964635 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5bc0150480 0x7f5bc01ed2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:30.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.229+0000 7f5bc59c2640 1 -- 172.21.15.60:0/3368964635 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5bc006c650 msgr2=0x7f5bc0152580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:30.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.229+0000 7f5bc59c2640 1 --2- 172.21.15.60:0/3368964635 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5bc006c650 0x7f5bc0152580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:30.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.229+0000 7f5bc59c2640 1 -- 172.21.15.60:0/3368964635 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bc01efd60 con 0x7f5bc00c9c80 2024-09-12T02:31:30.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.229+0000 7f5bc69c4640 1 --2- 172.21.15.60:0/3368964635 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5bc0150480 0x7f5bc01ed2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:31:30.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.229+0000 7f5bc59c2640 1 --2- 172.21.15.60:0/3368964635 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bc00c9c80 0x7f5bc01e3320 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5bb000e8a0 tx=0x7f5bb000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:30.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.229+0000 7f5bb6ffd640 1 -- 172.21.15.60:0/3368964635 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb0017070 con 0x7f5bc00c9c80 2024-09-12T02:31:30.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.229+0000 7f5bb6ffd640 1 -- 172.21.15.60:0/3368964635 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bb000c940 con 0x7f5bc00c9c80 2024-09-12T02:31:30.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.229+0000 7f5bb6ffd640 1 -- 172.21.15.60:0/3368964635 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb000cd30 con 0x7f5bc00c9c80 2024-09-12T02:31:30.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.229+0000 7f5bc8427640 1 -- 172.21.15.60:0/3368964635 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bc01f0000 con 0x7f5bc00c9c80 2024-09-12T02:31:30.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.229+0000 7f5bc8427640 1 -- 172.21.15.60:0/3368964635 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bc01e3860 con 0x7f5bc00c9c80 2024-09-12T02:31:30.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.230+0000 7f5bc8427640 1 --2- 172.21.15.60:0/3368964635 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5bc01ed7f0 0x7f5bc01edbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:30.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.230+0000 7f5bc8427640 1 -- 172.21.15.60:0/3368964635 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5bc00cccf0 con 0x7f5bc01ed7f0 2024-09-12T02:31:30.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.230+0000 7f5bc61c3640 1 --2- 172.21.15.60:0/3368964635 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5bc01ed7f0 0x7f5bc01edbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:30.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.231+0000 7f5bc61c3640 1 -- 172.21.15.60:0/3368964635 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5bc00ca130 con 0x7f5bc01ed7f0 2024-09-12T02:31:30.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.231+0000 7f5bc61c3640 1 --2- 172.21.15.60:0/3368964635 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5bc01ed7f0 0x7f5bc01edbd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5bc00c62d0 tx=0x7f5bbc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:30.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.231+0000 7f5bb6ffd640 1 -- 172.21.15.60:0/3368964635 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc037040 con 0x7f5bc01ed7f0 2024-09-12T02:31:30.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.231+0000 7f5bb6ffd640 1 -- 172.21.15.60:0/3368964635 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5bb001a070 con 0x7f5bc00c9c80 2024-09-12T02:31:30.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.232+0000 7f5bb6ffd640 1 --2- 172.21.15.60:0/3368964635 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f5ba406bd30 0x7f5ba406e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:30.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.232+0000 7f5bc69c4640 1 --2- 172.21.15.60:0/3368964635 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f5ba406bd30 0x7f5ba406e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:30.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.232+0000 7f5bb6ffd640 1 -- 172.21.15.60:0/3368964635 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f5bb008af30 con 0x7f5bc00c9c80 2024-09-12T02:31:30.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.232+0000 7f5bb6ffd640 1 -- 172.21.15.60:0/3368964635 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5bbc03c640 con 0x7f5bc01ed7f0 2024-09-12T02:31:30.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.232+0000 7f5bb6ffd640 1 -- 172.21.15.60:0/3368964635 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5bc01ed7f0 msgr2=0x7f5bc01edbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:30.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.232+0000 7f5bb6ffd640 1 --2- 172.21.15.60:0/3368964635 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5bc01ed7f0 0x7f5bc01edbd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5bc00c62d0 tx=0x7f5bbc0046c0 comp rx=0 tx=0).stop 2024-09-12T02:31:30.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.232+0000 7f5bb6ffd640 1 -- 172.21.15.60:0/3368964635 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5bc01ed7f0 msgr2=0x7f5bc01edbd0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:31:30.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.232+0000 7f5bb6ffd640 1 --2- 172.21.15.60:0/3368964635 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5bc01ed7f0 0x7f5bc01edbd0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:30.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.232+0000 7f5bc69c4640 1 --2- 172.21.15.60:0/3368964635 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f5ba406bd30 0x7f5ba406e1f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5bb8007f30 tx=0x7f5bb8007e80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:30.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.238+0000 7f5bc8427640 1 --2- 172.21.15.60:0/3368964635 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5bc0152dd0 0x7f5bc01531b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:30.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.238+0000 7f5bc8427640 1 -- 172.21.15.60:0/3368964635 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5bc00c9340 con 0x7f5bc0152dd0 2024-09-12T02:31:30.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.239+0000 7f5bc61c3640 1 --2- 172.21.15.60:0/3368964635 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5bc0152dd0 0x7f5bc01531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:30.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.239+0000 7f5bc61c3640 1 -- 172.21.15.60:0/3368964635 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5bc0151130 con 0x7f5bc0152dd0 2024-09-12T02:31:30.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.239+0000 7f5bc61c3640 1 --2- 172.21.15.60:0/3368964635 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5bc0152dd0 0x7f5bc01531b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc02a2b0 tx=0x7f5bbc008030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:30.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.239+0000 7f5bb6ffd640 1 -- 172.21.15.60:0/3368964635 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc047b60 con 0x7f5bc0152dd0 2024-09-12T02:31:30.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.240+0000 7f5bb6ffd640 1 -- 172.21.15.60:0/3368964635 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4549 (secure 0 0 0) 0x7f5bbc047b60 con 0x7f5bc0152dd0 2024-09-12T02:31:30.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.240+0000 7f5bb6ffd640 1 -- 172.21.15.60:0/3368964635 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5bc0152dd0 msgr2=0x7f5bc01531b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:30.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.240+0000 7f5bb6ffd640 1 --2- 172.21.15.60:0/3368964635 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5bc0152dd0 0x7f5bc01531b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc02a2b0 tx=0x7f5bbc008030 comp rx=0 tx=0).stop 2024-09-12T02:31:30.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.240+0000 7f5bb6ffd640 1 -- 172.21.15.60:0/3368964635 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5bc0152dd0 msgr2=0x7f5bc01531b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:31:30.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.240+0000 7f5bb6ffd640 1 --2- 172.21.15.60:0/3368964635 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5bc0152dd0 0x7f5bc01531b0 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc02a2b0 tx=0x7f5bbc008030 comp rx=0 tx=0).stop 2024-09-12T02:31:30.241 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:31:30.241 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:31:30.241 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:31:30.241 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:31:30.241 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 76, 2024-09-12T02:31:30.241 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 22023, 2024-09-12T02:31:30.242 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:31:30.242 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:31:30.242 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:31:30.242 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:31:30.242 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:31:30.242 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 16, 2024-09-12T02:31:30.242 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:31:30.242 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:31:30.242 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:31:30.242 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:31:30.242 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:31:30.242 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:31:30.242 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:31:30.242 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:31:30.243 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:31:30.243 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:31:30.243 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:31:30.243 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:31:30.243 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:31:30.243 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:31:30.243 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:31:30.243 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:31:30.243 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:31:30.243 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:31:30.243 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:31:30.243 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:31:30.243 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:31:30.244 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:31:30.244 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:31:30.244 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:31:30.244 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:31:30.244 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:31:30.244 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:31:30.244 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:31:30.244 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:30.244 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:30.244 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:31:30.244 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:31:30.244 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:31:30.244 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:31:30.244 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:31:30.245 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:31:30.245 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:31:30.245 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:31:30.245 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:31:30.245 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:31:30.245 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:31:30.245 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:31:30.245 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:31:30.245 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:31:30.245 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:31:30.245 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:31:30.245 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:31:30.245 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:31:30.246 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:31:30.246 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:31:30.246 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:31:30.246 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:31:30.246 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:31:30.246 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:31:30.246 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:31:30.246 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:31:30.246 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:31:30.246 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:31:30.246 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:31:30.247 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:31:30.247 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:30.247 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:31:30.247 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:30.247 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:31:30.247 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:31:30.247 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:31:30.247 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:31:30.247 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:30.247 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:31:30.247 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:31:30.247 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:30.248 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:30.248 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:30.248 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:31:30.248 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:31:30.248 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:30.248 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:30.248 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:30.248 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:30.248 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:31:30.248 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:31:30.248 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:31:30.248 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:31:30.248 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:31:30.249 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:30.249 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:30.249 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:31:30.249 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:31:30.249 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:31:30.249 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:31:30.249 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:30.249 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:31:30.249 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:31:30.249 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:30.249 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:30.249 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:30.249 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:31:30.250 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:31:30.250 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:30.250 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:30.250 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:30.250 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:30.250 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:31:30.250 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:31:30.250 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:31:30.250 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:31:30.250 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:31:30.250 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:30.250 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:30.250 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:31:30.251 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:31:30.251 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:31:30.251 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:31:30.251 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:30.251 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:31:30.251 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:31:30.251 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:30.251 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:30.251 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:30.251 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:31:30.251 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:31:30.251 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:30.251 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:30.252 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:30.252 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:30.252 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:31:30.252 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:31:30.252 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:31:30.252 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:31:30.252 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:31:30.252 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:30.252 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:30.252 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:30.253 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:31:30.253 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:31:30.253 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:30.253 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:31:30.253 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:31:30.253 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:31:30.253 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:30.253 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:31:30.253 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:31:30.253 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:30.253 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:31:30.253 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:31:30.253 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:31:30.254 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:30.254 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:30.254 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:30.254 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:31:30.254 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:31:30.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.240+0000 7f5bc8427640 1 -- 172.21.15.60:0/3368964635 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f5ba406bd30 msgr2=0x7f5ba406e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:30.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.240+0000 7f5bc8427640 1 --2- 172.21.15.60:0/3368964635 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f5ba406bd30 0x7f5ba406e1f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5bb8007f30 tx=0x7f5bb8007e80 comp rx=0 tx=0).stop 2024-09-12T02:31:30.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.240+0000 7f5bc8427640 1 -- 172.21.15.60:0/3368964635 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bc00c9c80 msgr2=0x7f5bc01e3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:30.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.240+0000 7f5bc8427640 1 --2- 172.21.15.60:0/3368964635 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bc00c9c80 0x7f5bc01e3320 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5bb000e8a0 tx=0x7f5bb000ed60 comp rx=0 tx=0).stop 2024-09-12T02:31:30.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.240+0000 7f5bc69c4640 1 -- 172.21.15.60:0/3368964635 reap_dead start 2024-09-12T02:31:30.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.240+0000 7f5bc69c4640 1 -- 172.21.15.60:0/3368964635 reap_dead start 2024-09-12T02:31:30.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.240+0000 7f5bc8427640 1 -- 172.21.15.60:0/3368964635 shutdown_connections 2024-09-12T02:31:30.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.240+0000 7f5bc8427640 1 -- 172.21.15.60:0/3368964635 >> 172.21.15.60:0/3368964635 conn(0x7f5bc0068030 msgr2=0x7f5bc00c8790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:30.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.240+0000 7f5bc8427640 1 -- 172.21.15.60:0/3368964635 shutdown_connections 2024-09-12T02:31:30.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.240+0000 7f5bc8427640 1 -- 172.21.15.60:0/3368964635 wait complete. 2024-09-12T02:31:30.256 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:31:30.256 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-09-12T02:31:30.257 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-12T02:31:30.257 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-09-12T02:31:30.257 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-09-12T02:31:30.257 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T02:31:30.257 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:31:30.267 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T02:31:30.267 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-12T02:31:30.267 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:31:30.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.374+0000 7f9656733640 1 Processor -- start 2024-09-12T02:31:30.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.374+0000 7f9656733640 1 -- start start 2024-09-12T02:31:30.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.375+0000 7f9656733640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f965006cd80 0x7f9650153be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:30.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.375+0000 7f9656733640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f965015a4a0 0x7f9650156660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:30.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.375+0000 7f9656733640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96500c7070 con 0x7f96500c8b10 2024-09-12T02:31:30.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.375+0000 7f9656733640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f965006d210 con 0x7f965015a4a0 2024-09-12T02:31:30.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.375+0000 7f9656733640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f96500c69b0 con 0x7f965006cd80 2024-09-12T02:31:30.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.375+0000 7f964f7fe640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f965006cd80 msgr2=0x7f9650153be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:31:30.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.375+0000 7f964f7fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f965006cd80 0x7f9650153be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:31:30.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.375+0000 7f9654cd0640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f965015a4a0 0x7f9650156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:30.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.375+0000 7f9654cd0640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f965015a4a0 0x7f9650156660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50744/0 (socket says 172.21.15.60:50744) 2024-09-12T02:31:30.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.375+0000 7f964ffff640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f96500c8b10 0x7f96501534d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:60212/0 (socket says 172.21.15.60:60212) 2024-09-12T02:31:30.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.375+0000 7f9654cd0640 1 -- 172.21.15.60:0/1841735102 learned_addr learned my addr 172.21.15.60:0/1841735102 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:31:30.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.375+0000 7f9654cd0640 1 -- 172.21.15.60:0/1841735102 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f965006cd80 msgr2=0x7f9650153be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:31:30.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.375+0000 7f9654cd0640 1 --2- 172.21.15.60:0/1841735102 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f965006cd80 0x7f9650153be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:30.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.375+0000 7f9654cd0640 1 -- 172.21.15.60:0/1841735102 >> v1:172.21.15.105:6789/0 conn(0x7f96500c8b10 legacy=0x7f96501534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:30.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.375+0000 7f9654cd0640 1 -- 172.21.15.60:0/1841735102 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96500c6c90 con 0x7f965015a4a0 2024-09-12T02:31:30.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.375+0000 7f964effd640 1 -- 172.21.15.60:0/1841735102 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3393477885 0 0) 0x7f96500c7070 con 0x7f96500c8b10 2024-09-12T02:31:30.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.376+0000 7f9654cd0640 1 --2- 172.21.15.60:0/1841735102 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f965015a4a0 0x7f9650156660 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9648009e50 tx=0x7f964802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa95aabb85a51fdf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:30.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.377+0000 7f964effd640 1 -- 172.21.15.60:0/1841735102 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9648036070 con 0x7f965015a4a0 2024-09-12T02:31:30.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.377+0000 7f964effd640 1 -- 172.21.15.60:0/1841735102 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9648031600 con 0x7f965015a4a0 2024-09-12T02:31:30.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.377+0000 7f964effd640 1 -- 172.21.15.60:0/1841735102 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96480319d0 con 0x7f965015a4a0 2024-09-12T02:31:30.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.377+0000 7f9656733640 1 -- 172.21.15.60:0/1841735102 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f965015a4a0 msgr2=0x7f9650156660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:30.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.377+0000 7f9656733640 1 --2- 172.21.15.60:0/1841735102 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f965015a4a0 0x7f9650156660 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9648009e50 tx=0x7f964802a6a0 comp rx=0 tx=0).stop 2024-09-12T02:31:30.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.377+0000 7f9656733640 1 -- 172.21.15.60:0/1841735102 shutdown_connections 2024-09-12T02:31:30.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.377+0000 7f9656733640 1 --2- 172.21.15.60:0/1841735102 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f965015a4a0 0x7f9650156660 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:30.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.377+0000 7f9656733640 1 --2- 172.21.15.60:0/1841735102 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f965006cd80 0x7f9650153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:30.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.377+0000 7f9656733640 1 -- 172.21.15.60:0/1841735102 >> 172.21.15.60:0/1841735102 conn(0x7f96500adb80 msgr2=0x7f96500adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:30.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.377+0000 7f9656733640 1 -- 172.21.15.60:0/1841735102 shutdown_connections 2024-09-12T02:31:30.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.377+0000 7f9656733640 1 -- 172.21.15.60:0/1841735102 wait complete. 2024-09-12T02:31:30.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.378+0000 7f9656733640 1 Processor -- start 2024-09-12T02:31:30.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.379+0000 7f9656733640 1 -- start start 2024-09-12T02:31:30.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.379+0000 7f9656733640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96500c8b10 0x7f96500b1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:30.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.379+0000 7f9656733640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f965015a4a0 0x7f96500aca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:30.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.379+0000 7f9656733640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96501ebc80 0x7f96501ec130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:30.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.379+0000 7f9656733640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f96500c9070 con 0x7f965015a4a0 2024-09-12T02:31:30.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.379+0000 7f9656733640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f96500c8ef0 con 0x7f96501ebc80 2024-09-12T02:31:30.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.379+0000 7f9656733640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9650156ba0 con 0x7f96500c8b10 2024-09-12T02:31:30.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.380+0000 7f964ffff640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96500c8b10 msgr2=0x7f96500b1500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:31:30.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.380+0000 7f964ffff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96500c8b10 0x7f96500b1500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:31:30.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.380+0000 7f964f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f965015a4a0 0x7f96500aca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:30.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.380+0000 7f964f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f965015a4a0 0x7f96500aca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50756/0 (socket says 172.21.15.60:50756) 2024-09-12T02:31:30.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.380+0000 7f964f7fe640 1 -- 172.21.15.60:0/4032537108 learned_addr learned my addr 172.21.15.60:0/4032537108 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:31:30.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.380+0000 7f9654cd0640 1 --2- 172.21.15.60:0/4032537108 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96501ebc80 0x7f96501ec130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:30.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.380+0000 7f964f7fe640 1 -- 172.21.15.60:0/4032537108 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96500c8b10 msgr2=0x7f96500b1500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:31:30.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.380+0000 7f964f7fe640 1 --2- 172.21.15.60:0/4032537108 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96500c8b10 0x7f96500b1500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:30.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.380+0000 7f964f7fe640 1 -- 172.21.15.60:0/4032537108 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96501ebc80 msgr2=0x7f96501ec130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:30.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.380+0000 7f964f7fe640 1 --2- 172.21.15.60:0/4032537108 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96501ebc80 0x7f96501ec130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:30.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.380+0000 7f964f7fe640 1 -- 172.21.15.60:0/4032537108 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96501507b0 con 0x7f965015a4a0 2024-09-12T02:31:30.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.380+0000 7f964f7fe640 1 --2- 172.21.15.60:0/4032537108 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f965015a4a0 0x7f96500aca50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f964400b500 tx=0x7f964400b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:30.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.380+0000 7f964cff9640 1 -- 172.21.15.60:0/4032537108 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9644003dc0 con 0x7f965015a4a0 2024-09-12T02:31:30.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.380+0000 7f964cff9640 1 -- 172.21.15.60:0/4032537108 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9644015070 con 0x7f965015a4a0 2024-09-12T02:31:30.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.380+0000 7f9656733640 1 -- 172.21.15.60:0/4032537108 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96500b1fc0 con 0x7f965015a4a0 2024-09-12T02:31:30.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.380+0000 7f964cff9640 1 -- 172.21.15.60:0/4032537108 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96440052b0 con 0x7f965015a4a0 2024-09-12T02:31:30.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.380+0000 7f9656733640 1 -- 172.21.15.60:0/4032537108 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96500acf90 con 0x7f965015a4a0 2024-09-12T02:31:30.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.382+0000 7f9656733640 1 -- 172.21.15.60:0/4032537108 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96500cc1d0 con 0x7f965015a4a0 2024-09-12T02:31:30.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.382+0000 7f964cff9640 1 -- 172.21.15.60:0/4032537108 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9644005450 con 0x7f965015a4a0 2024-09-12T02:31:30.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.382+0000 7f964cff9640 1 --2- 172.21.15.60:0/4032537108 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f963c06bde0 0x7f963c06e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:30.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.383+0000 7f964cff9640 1 -- 172.21.15.60:0/4032537108 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f964408af10 con 0x7f965015a4a0 2024-09-12T02:31:30.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.383+0000 7f964ffff640 1 --2- 172.21.15.60:0/4032537108 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f963c06bde0 0x7f963c06e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:30.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.383+0000 7f964ffff640 1 --2- 172.21.15.60:0/4032537108 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f963c06bde0 0x7f963c06e2a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f96500ac1e0 tx=0x7f9640007a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:30.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.388+0000 7f964cff9640 1 -- 172.21.15.60:0/4032537108 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f96500cc1d0 con 0x7f965015a4a0 2024-09-12T02:31:30.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.668+0000 7f9656733640 1 -- 172.21.15.60:0/4032537108 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9650157030 con 0x7f965015a4a0 2024-09-12T02:31:30.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.669+0000 7f964cff9640 1 -- 172.21.15.60:0/4032537108 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f96440595b0 con 0x7f965015a4a0 2024-09-12T02:31:30.670 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":76,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:31:30.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.671+0000 7f9656733640 1 -- 172.21.15.60:0/4032537108 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f963c06bde0 msgr2=0x7f963c06e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:30.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.671+0000 7f9656733640 1 --2- 172.21.15.60:0/4032537108 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f963c06bde0 0x7f963c06e2a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f96500ac1e0 tx=0x7f9640007a00 comp rx=0 tx=0).stop 2024-09-12T02:31:30.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.671+0000 7f9656733640 1 -- 172.21.15.60:0/4032537108 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f965015a4a0 msgr2=0x7f96500aca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:30.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.671+0000 7f9656733640 1 --2- 172.21.15.60:0/4032537108 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f965015a4a0 0x7f96500aca50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f964400b500 tx=0x7f964400b9c0 comp rx=0 tx=0).stop 2024-09-12T02:31:30.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.671+0000 7f9656733640 1 -- 172.21.15.60:0/4032537108 shutdown_connections 2024-09-12T02:31:30.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.671+0000 7f9656733640 1 --2- 172.21.15.60:0/4032537108 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f963c06bde0 0x7f963c06e2a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:30.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.671+0000 7f9656733640 1 --2- 172.21.15.60:0/4032537108 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96501ebc80 0x7f96501ec130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:30.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.671+0000 7f9656733640 1 --2- 172.21.15.60:0/4032537108 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f965015a4a0 0x7f96500aca50 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:30.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.671+0000 7f9656733640 1 --2- 172.21.15.60:0/4032537108 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96500c8b10 0x7f96500b1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:30.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.671+0000 7f9656733640 1 -- 172.21.15.60:0/4032537108 >> 172.21.15.60:0/4032537108 conn(0x7f96500adb80 msgr2=0x7f96500adf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:30.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.672+0000 7f9656733640 1 -- 172.21.15.60:0/4032537108 shutdown_connections 2024-09-12T02:31:30.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:30.672+0000 7f9656733640 1 -- 172.21.15.60:0/4032537108 wait complete. 2024-09-12T02:31:33.684 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:31:33.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.795+0000 7f59fb85c640 1 Processor -- start 2024-09-12T02:31:33.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.795+0000 7f59fb85c640 1 -- start start 2024-09-12T02:31:33.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.796+0000 7f59fb85c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f59f40c8b10 0x7f59f415a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:33.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.796+0000 7f59fb85c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59f4153be0 0x7f59f4156660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:33.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.796+0000 7f59fb85c640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59f40c7070 con 0x7f59f406cd80 2024-09-12T02:31:33.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.796+0000 7f59fb85c640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f59f406d210 con 0x7f59f40c8b10 2024-09-12T02:31:33.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.796+0000 7f59fb85c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f59f40c69b0 con 0x7f59f4153be0 2024-09-12T02:31:33.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.796+0000 7f59f9df9640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59f4153be0 msgr2=0x7f59f4156660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:31:33.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.796+0000 7f59f9df9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59f4153be0 0x7f59f4156660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:31:33.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.796+0000 7f59f95f8640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f59f40c8b10 0x7f59f415a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:33.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.796+0000 7f59f95f8640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f59f40c8b10 0x7f59f415a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50764/0 (socket says 172.21.15.60:50764) 2024-09-12T02:31:33.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.796+0000 7f59f95f8640 1 -- 172.21.15.60:0/3168240969 learned_addr learned my addr 172.21.15.60:0/3168240969 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:31:33.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.796+0000 7f59f8df7640 1 --1- 172.21.15.60:0/3168240969 >> v1:172.21.15.105:6789/0 conn(0x7f59f406cd80 0x7f59f41534d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:60218/0 (socket says 172.21.15.60:60218) 2024-09-12T02:31:33.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.796+0000 7f59f95f8640 1 -- 172.21.15.60:0/3168240969 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59f4153be0 msgr2=0x7f59f4156660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:31:33.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.796+0000 7f59f95f8640 1 --2- 172.21.15.60:0/3168240969 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59f4153be0 0x7f59f4156660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:33.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.796+0000 7f59f95f8640 1 -- 172.21.15.60:0/3168240969 >> v1:172.21.15.105:6789/0 conn(0x7f59f406cd80 legacy=0x7f59f41534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:33.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.796+0000 7f59f95f8640 1 -- 172.21.15.60:0/3168240969 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59f40c6c90 con 0x7f59f40c8b10 2024-09-12T02:31:33.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.797+0000 7f59f95f8640 1 --2- 172.21.15.60:0/3168240969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59f40c8b10 0x7f59f415a4a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f59f0009870 tx=0x7f59f002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=692b44e68ac59240 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:33.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.797+0000 7f59ebfff640 1 -- 172.21.15.60:0/3168240969 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f0037070 con 0x7f59f40c8b10 2024-09-12T02:31:33.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.797+0000 7f59ebfff640 1 -- 172.21.15.60:0/3168240969 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59f0032440 con 0x7f59f40c8b10 2024-09-12T02:31:33.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.797+0000 7f59ebfff640 1 -- 172.21.15.60:0/3168240969 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f0032810 con 0x7f59f40c8b10 2024-09-12T02:31:33.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.798+0000 7f59fb85c640 1 -- 172.21.15.60:0/3168240969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59f40c8b10 msgr2=0x7f59f415a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:33.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.798+0000 7f59fb85c640 1 --2- 172.21.15.60:0/3168240969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59f40c8b10 0x7f59f415a4a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f59f0009870 tx=0x7f59f002a1e0 comp rx=0 tx=0).stop 2024-09-12T02:31:33.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.798+0000 7f59fb85c640 1 -- 172.21.15.60:0/3168240969 shutdown_connections 2024-09-12T02:31:33.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.798+0000 7f59fb85c640 1 --2- 172.21.15.60:0/3168240969 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59f4153be0 0x7f59f4156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:33.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.798+0000 7f59fb85c640 1 --2- 172.21.15.60:0/3168240969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59f40c8b10 0x7f59f415a4a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:33.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.798+0000 7f59fb85c640 1 -- 172.21.15.60:0/3168240969 >> 172.21.15.60:0/3168240969 conn(0x7f59f40adb80 msgr2=0x7f59f40adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:33.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.798+0000 7f59fb85c640 1 -- 172.21.15.60:0/3168240969 shutdown_connections 2024-09-12T02:31:33.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.798+0000 7f59fb85c640 1 -- 172.21.15.60:0/3168240969 wait complete. 2024-09-12T02:31:33.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.799+0000 7f59fb85c640 1 Processor -- start 2024-09-12T02:31:33.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.800+0000 7f59fb85c640 1 -- start start 2024-09-12T02:31:33.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.801+0000 7f59fb85c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59f40c8b10 0x7f59f414e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:33.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.801+0000 7f59fb85c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59f4153be0 0x7f59f414f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:33.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.801+0000 7f59fb85c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59f4142ab0 0x7f59f414b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:33.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.801+0000 7f59fb85c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f59f40c9070 con 0x7f59f4142ab0 2024-09-12T02:31:33.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.801+0000 7f59fb85c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f59f40c8ef0 con 0x7f59f40c8b10 2024-09-12T02:31:33.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.801+0000 7f59fb85c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f59f4156ba0 con 0x7f59f4153be0 2024-09-12T02:31:33.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.801+0000 7f59f8df7640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59f4153be0 msgr2=0x7f59f414f6a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:31:33.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.801+0000 7f59f8df7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59f4153be0 0x7f59f414f6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:31:33.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.801+0000 7f59f9df9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59f4142ab0 0x7f59f414b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:33.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.801+0000 7f59f95f8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59f40c8b10 0x7f59f414e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:33.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.801+0000 7f59f9df9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59f4142ab0 0x7f59f414b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50766/0 (socket says 172.21.15.60:50766) 2024-09-12T02:31:33.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.801+0000 7f59f9df9640 1 -- 172.21.15.60:0/954877735 learned_addr learned my addr 172.21.15.60:0/954877735 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:31:33.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.801+0000 7f59f9df9640 1 -- 172.21.15.60:0/954877735 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59f4153be0 msgr2=0x7f59f414f6a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:31:33.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.801+0000 7f59f9df9640 1 --2- 172.21.15.60:0/954877735 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59f4153be0 0x7f59f414f6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:33.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.801+0000 7f59f9df9640 1 -- 172.21.15.60:0/954877735 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59f40c8b10 msgr2=0x7f59f414e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:33.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.801+0000 7f59f9df9640 1 --2- 172.21.15.60:0/954877735 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59f40c8b10 0x7f59f414e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:33.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.801+0000 7f59f9df9640 1 -- 172.21.15.60:0/954877735 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59f41ec950 con 0x7f59f4142ab0 2024-09-12T02:31:33.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.801+0000 7f59f95f8640 1 --2- 172.21.15.60:0/954877735 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59f40c8b10 0x7f59f414e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:31:33.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.801+0000 7f59f9df9640 1 --2- 172.21.15.60:0/954877735 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59f4142ab0 0x7f59f414b360 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f59ec00b990 tx=0x7f59ec00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:33.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.801+0000 7f59e9ffb640 1 -- 172.21.15.60:0/954877735 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ec00ca60 con 0x7f59f4142ab0 2024-09-12T02:31:33.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.802+0000 7f59e9ffb640 1 -- 172.21.15.60:0/954877735 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59ec010070 con 0x7f59f4142ab0 2024-09-12T02:31:33.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.802+0000 7f59fb85c640 1 -- 172.21.15.60:0/954877735 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59f41ecc30 con 0x7f59f4142ab0 2024-09-12T02:31:33.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.802+0000 7f59e9ffb640 1 -- 172.21.15.60:0/954877735 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ec015470 con 0x7f59f4142ab0 2024-09-12T02:31:33.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.802+0000 7f59fb85c640 1 -- 172.21.15.60:0/954877735 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59f414de80 con 0x7f59f4142ab0 2024-09-12T02:31:33.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.803+0000 7f59fb85c640 1 -- 172.21.15.60:0/954877735 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59f4157030 con 0x7f59f4142ab0 2024-09-12T02:31:33.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.803+0000 7f59e9ffb640 1 -- 172.21.15.60:0/954877735 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f59ec015610 con 0x7f59f4142ab0 2024-09-12T02:31:33.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.804+0000 7f59e9ffb640 1 --2- 172.21.15.60:0/954877735 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f59d806be10 0x7f59d806e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:33.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.804+0000 7f59e9ffb640 1 -- 172.21.15.60:0/954877735 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f59ec08b170 con 0x7f59f4142ab0 2024-09-12T02:31:33.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.804+0000 7f59f95f8640 1 --2- 172.21.15.60:0/954877735 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f59d806be10 0x7f59d806e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:33.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.805+0000 7f59f95f8640 1 --2- 172.21.15.60:0/954877735 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f59d806be10 0x7f59d806e2d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f59f0034000 tx=0x7f59f002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:33.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:33.810+0000 7f59e9ffb640 1 -- 172.21.15.60:0/954877735 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f59ec059810 con 0x7f59f4142ab0 2024-09-12T02:31:34.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:34.092+0000 7f59fb85c640 1 -- 172.21.15.60:0/954877735 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f59f40c9d90 con 0x7f59f4142ab0 2024-09-12T02:31:34.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:34.093+0000 7f59e9ffb640 1 -- 172.21.15.60:0/954877735 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f59ec059110 con 0x7f59f4142ab0 2024-09-12T02:31:34.094 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":76,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:31:34.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:34.095+0000 7f59fb85c640 1 -- 172.21.15.60:0/954877735 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f59d806be10 msgr2=0x7f59d806e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:34.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:34.095+0000 7f59fb85c640 1 --2- 172.21.15.60:0/954877735 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f59d806be10 0x7f59d806e2d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f59f0034000 tx=0x7f59f002e000 comp rx=0 tx=0).stop 2024-09-12T02:31:34.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:34.095+0000 7f59fb85c640 1 -- 172.21.15.60:0/954877735 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59f4142ab0 msgr2=0x7f59f414b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:34.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:34.095+0000 7f59fb85c640 1 --2- 172.21.15.60:0/954877735 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59f4142ab0 0x7f59f414b360 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f59ec00b990 tx=0x7f59ec00be50 comp rx=0 tx=0).stop 2024-09-12T02:31:34.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:34.095+0000 7f59fb85c640 1 -- 172.21.15.60:0/954877735 shutdown_connections 2024-09-12T02:31:34.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:34.095+0000 7f59fb85c640 1 --2- 172.21.15.60:0/954877735 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f59d806be10 0x7f59d806e2d0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:34.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:34.095+0000 7f59fb85c640 1 --2- 172.21.15.60:0/954877735 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59f4142ab0 0x7f59f414b360 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:34.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:34.095+0000 7f59fb85c640 1 --2- 172.21.15.60:0/954877735 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59f4153be0 0x7f59f414f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:34.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:34.095+0000 7f59fb85c640 1 --2- 172.21.15.60:0/954877735 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59f40c8b10 0x7f59f414e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:34.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:34.095+0000 7f59fb85c640 1 -- 172.21.15.60:0/954877735 >> 172.21.15.60:0/954877735 conn(0x7f59f40adb80 msgr2=0x7f59f41510f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:34.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:34.095+0000 7f59fb85c640 1 -- 172.21.15.60:0/954877735 shutdown_connections 2024-09-12T02:31:34.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:34.095+0000 7f59fb85c640 1 -- 172.21.15.60:0/954877735 wait complete. 2024-09-12T02:31:37.109 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:31:37.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.225+0000 7febda674640 1 Processor -- start 2024-09-12T02:31:37.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.225+0000 7febda674640 1 -- start start 2024-09-12T02:31:37.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.226+0000 7febda674640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7febd4153dd0 0x7febd4156db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:37.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.226+0000 7febda674640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7febd40c9c60 0x7febd406c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:37.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.226+0000 7febda674640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febd40c66e0 con 0x7febd4067bc0 2024-09-12T02:31:37.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.226+0000 7febda674640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7febd406d360 con 0x7febd4153dd0 2024-09-12T02:31:37.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.226+0000 7febda674640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7febd40c6980 con 0x7febd40c9c60 2024-09-12T02:31:37.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.226+0000 7febd37fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7febd4153dd0 0x7febd4156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:37.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.226+0000 7febd37fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7febd4153dd0 0x7febd4156db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50778/0 (socket says 172.21.15.60:50778) 2024-09-12T02:31:37.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.226+0000 7febd37fe640 1 -- 172.21.15.60:0/3310988518 learned_addr learned my addr 172.21.15.60:0/3310988518 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:31:37.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.226+0000 7febd8c11640 1 --2- 172.21.15.60:0/3310988518 >> v2:172.21.15.105:3300/0 conn(0x7febd40c9c60 0x7febd406c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:37.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.226+0000 7febd37fe640 1 -- 172.21.15.60:0/3310988518 >> v2:172.21.15.105:3300/0 conn(0x7febd40c9c60 msgr2=0x7febd406c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:37.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.226+0000 7febd37fe640 1 --2- 172.21.15.60:0/3310988518 >> v2:172.21.15.105:3300/0 conn(0x7febd40c9c60 0x7febd406c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:37.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.226+0000 7febd37fe640 1 -- 172.21.15.60:0/3310988518 >> v1:172.21.15.105:6789/0 conn(0x7febd4067bc0 legacy=0x7febd41536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:37.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.226+0000 7febd37fe640 1 -- 172.21.15.60:0/3310988518 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febd40c6c60 con 0x7febd4153dd0 2024-09-12T02:31:37.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.227+0000 7febd37fe640 1 --2- 172.21.15.60:0/3310988518 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7febd4153dd0 0x7febd4156db0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7febd40aead0 tx=0x7febc802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d57265593cf769c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:37.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.228+0000 7febd2ffd640 1 -- 172.21.15.60:0/3310988518 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc8037070 con 0x7febd4153dd0 2024-09-12T02:31:37.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.228+0000 7febd2ffd640 1 -- 172.21.15.60:0/3310988518 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febc8032440 con 0x7febd4153dd0 2024-09-12T02:31:37.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.228+0000 7febd2ffd640 1 -- 172.21.15.60:0/3310988518 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc8032810 con 0x7febd4153dd0 2024-09-12T02:31:37.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.228+0000 7febda674640 1 -- 172.21.15.60:0/3310988518 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7febd4153dd0 msgr2=0x7febd4156db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:37.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.228+0000 7febda674640 1 --2- 172.21.15.60:0/3310988518 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7febd4153dd0 0x7febd4156db0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7febd40aead0 tx=0x7febc802a1e0 comp rx=0 tx=0).stop 2024-09-12T02:31:37.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.228+0000 7febda674640 1 -- 172.21.15.60:0/3310988518 shutdown_connections 2024-09-12T02:31:37.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.228+0000 7febda674640 1 --2- 172.21.15.60:0/3310988518 >> v2:172.21.15.105:3300/0 conn(0x7febd40c9c60 0x7febd406c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:37.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.228+0000 7febda674640 1 --2- 172.21.15.60:0/3310988518 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7febd4153dd0 0x7febd4156db0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:37.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.228+0000 7febda674640 1 -- 172.21.15.60:0/3310988518 >> 172.21.15.60:0/3310988518 conn(0x7febd40c87e0 msgr2=0x7febd40c8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:37.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.228+0000 7febda674640 1 -- 172.21.15.60:0/3310988518 shutdown_connections 2024-09-12T02:31:37.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.228+0000 7febda674640 1 -- 172.21.15.60:0/3310988518 wait complete. 2024-09-12T02:31:37.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.229+0000 7febda674640 1 Processor -- start 2024-09-12T02:31:37.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.230+0000 7febda674640 1 -- start start 2024-09-12T02:31:37.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.230+0000 7febda674640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7febd4067bc0 0x7febd4145620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:37.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.230+0000 7febda674640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7febd40c9c60 0x7febd4150040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:37.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.230+0000 7febda674640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7febd4153dd0 0x7febd4150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:37.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.230+0000 7febda674640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7febd4068120 con 0x7febd4067bc0 2024-09-12T02:31:37.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.230+0000 7febd8c11640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7febd4153dd0 msgr2=0x7febd4150580 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:31:37.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.230+0000 7febd8c11640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7febd4153dd0 0x7febd4150580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:31:37.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.230+0000 7febda674640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7febd4067fa0 con 0x7febd40c9c60 2024-09-12T02:31:37.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.230+0000 7febd3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7febd4067bc0 0x7febd4145620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:37.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.230+0000 7febda674640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7febd406c7e0 con 0x7febd4153dd0 2024-09-12T02:31:37.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.231+0000 7febd3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7febd4067bc0 0x7febd4145620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50784/0 (socket says 172.21.15.60:50784) 2024-09-12T02:31:37.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.231+0000 7febd3fff640 1 -- 172.21.15.60:0/3566174935 learned_addr learned my addr 172.21.15.60:0/3566174935 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:31:37.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.231+0000 7febd37fe640 1 --2- 172.21.15.60:0/3566174935 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7febd40c9c60 0x7febd4150040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:37.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.231+0000 7febd3fff640 1 -- 172.21.15.60:0/3566174935 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7febd4153dd0 msgr2=0x7febd4150580 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:31:37.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.231+0000 7febd3fff640 1 --2- 172.21.15.60:0/3566174935 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7febd4153dd0 0x7febd4150580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:37.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.231+0000 7febd3fff640 1 -- 172.21.15.60:0/3566174935 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7febd40c9c60 msgr2=0x7febd4150040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:37.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.231+0000 7febd3fff640 1 --2- 172.21.15.60:0/3566174935 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7febd40c9c60 0x7febd4150040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:37.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.231+0000 7febd3fff640 1 -- 172.21.15.60:0/3566174935 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febd41efc10 con 0x7febd4067bc0 2024-09-12T02:31:37.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.231+0000 7febd3fff640 1 --2- 172.21.15.60:0/3566174935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7febd4067bc0 0x7febd4145620 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7febc400c500 tx=0x7febc400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:37.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.231+0000 7febd0ff9640 1 -- 172.21.15.60:0/3566174935 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc40052d0 con 0x7febd4067bc0 2024-09-12T02:31:37.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.231+0000 7febd0ff9640 1 -- 172.21.15.60:0/3566174935 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febc4005470 con 0x7febd4067bc0 2024-09-12T02:31:37.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.231+0000 7febda674640 1 -- 172.21.15.60:0/3566174935 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febd41eee50 con 0x7febd4067bc0 2024-09-12T02:31:37.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.231+0000 7febd0ff9640 1 -- 172.21.15.60:0/3566174935 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc4012850 con 0x7febd4067bc0 2024-09-12T02:31:37.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.231+0000 7febda674640 1 -- 172.21.15.60:0/3566174935 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febd41ef410 con 0x7febd4067bc0 2024-09-12T02:31:37.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.232+0000 7febda674640 1 -- 172.21.15.60:0/3566174935 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febd406c2a0 con 0x7febd4067bc0 2024-09-12T02:31:37.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.233+0000 7febd0ff9640 1 -- 172.21.15.60:0/3566174935 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7febc40129f0 con 0x7febd4067bc0 2024-09-12T02:31:37.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.234+0000 7febd0ff9640 1 --2- 172.21.15.60:0/3566174935 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7febc006be10 0x7febc006e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:37.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.234+0000 7febd0ff9640 1 -- 172.21.15.60:0/3566174935 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7febc408ad50 con 0x7febd4067bc0 2024-09-12T02:31:37.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.234+0000 7febd37fe640 1 --2- 172.21.15.60:0/3566174935 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7febc006be10 0x7febc006e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:37.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.235+0000 7febd37fe640 1 --2- 172.21.15.60:0/3566174935 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7febc006be10 0x7febc006e2d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7febc8034000 tx=0x7febc802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:37.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.238+0000 7febd0ff9640 1 -- 172.21.15.60:0/3566174935 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7febc408e030 con 0x7febd4067bc0 2024-09-12T02:31:37.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.560+0000 7febda674640 1 -- 172.21.15.60:0/3566174935 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7febd4153840 con 0x7febd4067bc0 2024-09-12T02:31:37.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.560+0000 7febd0ff9640 1 -- 172.21.15.60:0/3566174935 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7febc405f020 con 0x7febd4067bc0 2024-09-12T02:31:37.561 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":76,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:31:37.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.562+0000 7febda674640 1 -- 172.21.15.60:0/3566174935 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7febc006be10 msgr2=0x7febc006e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:37.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.562+0000 7febda674640 1 --2- 172.21.15.60:0/3566174935 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7febc006be10 0x7febc006e2d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7febc8034000 tx=0x7febc802e000 comp rx=0 tx=0).stop 2024-09-12T02:31:37.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.562+0000 7febda674640 1 -- 172.21.15.60:0/3566174935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7febd4067bc0 msgr2=0x7febd4145620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:37.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.562+0000 7febda674640 1 --2- 172.21.15.60:0/3566174935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7febd4067bc0 0x7febd4145620 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7febc400c500 tx=0x7febc400c9c0 comp rx=0 tx=0).stop 2024-09-12T02:31:37.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.562+0000 7febda674640 1 -- 172.21.15.60:0/3566174935 shutdown_connections 2024-09-12T02:31:37.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.562+0000 7febda674640 1 --2- 172.21.15.60:0/3566174935 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7febc006be10 0x7febc006e2d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:37.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.562+0000 7febda674640 1 --2- 172.21.15.60:0/3566174935 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7febd4153dd0 0x7febd4150580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:37.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.562+0000 7febda674640 1 --2- 172.21.15.60:0/3566174935 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7febd40c9c60 0x7febd4150040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:37.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.562+0000 7febda674640 1 --2- 172.21.15.60:0/3566174935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7febd4067bc0 0x7febd4145620 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:37.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.562+0000 7febda674640 1 -- 172.21.15.60:0/3566174935 >> 172.21.15.60:0/3566174935 conn(0x7febd40c87e0 msgr2=0x7febd41552f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:37.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.562+0000 7febda674640 1 -- 172.21.15.60:0/3566174935 shutdown_connections 2024-09-12T02:31:37.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:37.562+0000 7febda674640 1 -- 172.21.15.60:0/3566174935 wait complete. 2024-09-12T02:31:40.580 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:31:40.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:40.692+0000 7fcf1b0f1640 1 Processor -- start 2024-09-12T02:31:40.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:40.692+0000 7fcf1b0f1640 1 -- start start 2024-09-12T02:31:40.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:40.693+0000 7fcf1b0f1640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fcf140ad6a0 0x7fcf14159c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:40.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:40.693+0000 7fcf1b0f1640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf140c2f60 con 0x7fcf14153fd0 2024-09-12T02:31:40.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:40.693+0000 7fcf1b0f1640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf140c3240 con 0x7fcf140c5130 2024-09-12T02:31:40.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:40.693+0000 7fcf1b0f1640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fcf140c1f80 con 0x7fcf140ad6a0 2024-09-12T02:31:40.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:40.693+0000 7fcf1968e640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fcf14153fd0 0x7fcf1415a1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:54628/0 (socket says 172.21.15.60:54628) 2024-09-12T02:31:40.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:40.693+0000 7fcf1968e640 1 -- 172.21.15.60:0/3017354363 learned_addr learned my addr 172.21.15.60:0/3017354363 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:31:40.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:40.693+0000 7fcf13fff640 1 --2- 172.21.15.60:0/3017354363 >> v2:172.21.15.105:3300/0 conn(0x7fcf140ad6a0 0x7fcf14159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:40.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:40.693+0000 7fcf13fff640 1 -- 172.21.15.60:0/3017354363 >> v2:172.21.15.105:3300/0 conn(0x7fcf140ad6a0 msgr2=0x7fcf14159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:31:40.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:40.693+0000 7fcf13fff640 1 -- 172.21.15.60:0/3017354363 >> v2:172.21.15.105:3300/0 conn(0x7fcf140ad6a0 msgr2=0x7fcf14159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:31:40.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:40.693+0000 7fcf13fff640 1 --2- 172.21.15.60:0/3017354363 >> v2:172.21.15.105:3300/0 conn(0x7fcf140ad6a0 0x7fcf14159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:31:40.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:40.693+0000 7fcf13fff640 1 --2- 172.21.15.60:0/3017354363 >> v2:172.21.15.105:3300/0 conn(0x7fcf140ad6a0 0x7fcf14159c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:31:40.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:40.894+0000 7fcf13fff640 1 --2- 172.21.15.60:0/3017354363 >> v2:172.21.15.105:3300/0 conn(0x7fcf140ad6a0 0x7fcf14159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:40.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:40.894+0000 7fcf13fff640 1 -- 172.21.15.60:0/3017354363 >> v2:172.21.15.105:3300/0 conn(0x7fcf140ad6a0 msgr2=0x7fcf14159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:31:40.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:40.894+0000 7fcf13fff640 1 -- 172.21.15.60:0/3017354363 >> v2:172.21.15.105:3300/0 conn(0x7fcf140ad6a0 msgr2=0x7fcf14159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:31:40.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:40.894+0000 7fcf13fff640 1 --2- 172.21.15.60:0/3017354363 >> v2:172.21.15.105:3300/0 conn(0x7fcf140ad6a0 0x7fcf14159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:31:40.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:40.894+0000 7fcf13fff640 1 --2- 172.21.15.60:0/3017354363 >> v2:172.21.15.105:3300/0 conn(0x7fcf140ad6a0 0x7fcf14159c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:31:41.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:41.295+0000 7fcf13fff640 1 --2- 172.21.15.60:0/3017354363 >> v2:172.21.15.105:3300/0 conn(0x7fcf140ad6a0 0x7fcf14159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:41.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:41.295+0000 7fcf13fff640 1 -- 172.21.15.60:0/3017354363 >> v2:172.21.15.105:3300/0 conn(0x7fcf140ad6a0 msgr2=0x7fcf14159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:31:41.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:41.295+0000 7fcf13fff640 1 -- 172.21.15.60:0/3017354363 >> v2:172.21.15.105:3300/0 conn(0x7fcf140ad6a0 msgr2=0x7fcf14159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:31:41.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:41.295+0000 7fcf13fff640 1 --2- 172.21.15.60:0/3017354363 >> v2:172.21.15.105:3300/0 conn(0x7fcf140ad6a0 0x7fcf14159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:31:41.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:41.295+0000 7fcf13fff640 1 --2- 172.21.15.60:0/3017354363 >> v2:172.21.15.105:3300/0 conn(0x7fcf140ad6a0 0x7fcf14159c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:31:42.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:42.096+0000 7fcf13fff640 1 --2- 172.21.15.60:0/3017354363 >> v2:172.21.15.105:3300/0 conn(0x7fcf140ad6a0 0x7fcf14159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:42.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:42.096+0000 7fcf13fff640 1 -- 172.21.15.60:0/3017354363 >> v2:172.21.15.105:3300/0 conn(0x7fcf140ad6a0 msgr2=0x7fcf14159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:31:42.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:42.096+0000 7fcf13fff640 1 -- 172.21.15.60:0/3017354363 >> v2:172.21.15.105:3300/0 conn(0x7fcf140ad6a0 msgr2=0x7fcf14159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:31:42.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:42.096+0000 7fcf13fff640 1 --2- 172.21.15.60:0/3017354363 >> v2:172.21.15.105:3300/0 conn(0x7fcf140ad6a0 0x7fcf14159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:31:42.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:42.096+0000 7fcf13fff640 1 --2- 172.21.15.60:0/3017354363 >> v2:172.21.15.105:3300/0 conn(0x7fcf140ad6a0 0x7fcf14159c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:31:43.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:43.693+0000 7fcf127fc640 1 -- 172.21.15.60:0/3017354363 >> v2:172.21.15.105:3300/0 conn(0x7fcf140ad6a0 msgr2=0x7fcf14159c60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:31:43.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:43.693+0000 7fcf127fc640 1 --2- 172.21.15.60:0/3017354363 >> v2:172.21.15.105:3300/0 conn(0x7fcf140ad6a0 0x7fcf14159c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:43.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:43.693+0000 7fcf127fc640 1 -- 172.21.15.60:0/3017354363 >> v1:172.21.15.105:6789/0 conn(0x7fcf140c5130 legacy=0x7fcf141538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:43.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:43.693+0000 7fcf127fc640 1 -- 172.21.15.60:0/3017354363 >> v1:172.21.15.60:6789/0 conn(0x7fcf14153fd0 legacy=0x7fcf1415a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:43.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:43.693+0000 7fcf127fc640 1 --2- 172.21.15.60:0/3017354363 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcef8003710 0x7fcef8005b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:43.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:43.693+0000 7fcf127fc640 1 --2- 172.21.15.60:0/3017354363 >> v2:172.21.15.60:3300/0 conn(0x7fcef8006290 0x7fcef8008730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:43.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:43.693+0000 7fcf127fc640 1 -- 172.21.15.60:0/3017354363 --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fcf140c1f80 con 0x7fcef8006290 2024-09-12T02:31:43.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:43.693+0000 7fcf127fc640 1 -- 172.21.15.60:0/3017354363 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcef8008dd0 con 0x7fcef8003710 2024-09-12T02:31:43.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:43.693+0000 7fcf18e8d640 1 -- 172.21.15.60:0/3017354363 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcef8003710 msgr2=0x7fcef8005b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:31:43.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:43.693+0000 7fcf18e8d640 1 --2- 172.21.15.60:0/3017354363 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcef8003710 0x7fcef8005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:31:43.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:43.693+0000 7fcf13fff640 1 --2- 172.21.15.60:0/3017354363 >> v2:172.21.15.60:3300/0 conn(0x7fcef8006290 0x7fcef8008730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:43.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:43.693+0000 7fcf13fff640 1 -- 172.21.15.60:0/3017354363 >> v2:172.21.15.60:3300/0 conn(0x7fcef8006290 msgr2=0x7fcef8008730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:31:43.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:43.693+0000 7fcf13fff640 1 -- 172.21.15.60:0/3017354363 >> v2:172.21.15.60:3300/0 conn(0x7fcef8006290 msgr2=0x7fcef8008730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:31:43.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:43.693+0000 7fcf13fff640 1 --2- 172.21.15.60:0/3017354363 >> v2:172.21.15.60:3300/0 conn(0x7fcef8006290 0x7fcef8008730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:31:43.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:43.693+0000 7fcf13fff640 1 --2- 172.21.15.60:0/3017354363 >> v2:172.21.15.60:3300/0 conn(0x7fcef8006290 0x7fcef8008730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:31:43.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:43.894+0000 7fcf18e8d640 1 -- 172.21.15.60:0/3017354363 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcef8003710 msgr2=0x7fcef8005b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:31:43.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:43.894+0000 7fcf18e8d640 1 --2- 172.21.15.60:0/3017354363 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcef8003710 0x7fcef8005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:31:43.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:43.894+0000 7fcf13fff640 1 --2- 172.21.15.60:0/3017354363 >> v2:172.21.15.60:3300/0 conn(0x7fcef8006290 0x7fcef8008730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:43.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:43.894+0000 7fcf13fff640 1 -- 172.21.15.60:0/3017354363 >> v2:172.21.15.60:3300/0 conn(0x7fcef8006290 msgr2=0x7fcef8008730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:31:43.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:43.894+0000 7fcf13fff640 1 -- 172.21.15.60:0/3017354363 >> v2:172.21.15.60:3300/0 conn(0x7fcef8006290 msgr2=0x7fcef8008730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:31:43.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:43.894+0000 7fcf13fff640 1 --2- 172.21.15.60:0/3017354363 >> v2:172.21.15.60:3300/0 conn(0x7fcef8006290 0x7fcef8008730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:31:43.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:43.894+0000 7fcf13fff640 1 --2- 172.21.15.60:0/3017354363 >> v2:172.21.15.60:3300/0 conn(0x7fcef8006290 0x7fcef8008730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:31:44.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:44.295+0000 7fcf18e8d640 1 -- 172.21.15.60:0/3017354363 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcef8003710 msgr2=0x7fcef8005b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:31:44.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:44.295+0000 7fcf18e8d640 1 --2- 172.21.15.60:0/3017354363 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcef8003710 0x7fcef8005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:31:44.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:44.295+0000 7fcf13fff640 1 --2- 172.21.15.60:0/3017354363 >> v2:172.21.15.60:3300/0 conn(0x7fcef8006290 0x7fcef8008730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:44.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:44.295+0000 7fcf13fff640 1 -- 172.21.15.60:0/3017354363 >> v2:172.21.15.60:3300/0 conn(0x7fcef8006290 msgr2=0x7fcef8008730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:31:44.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:44.295+0000 7fcf13fff640 1 -- 172.21.15.60:0/3017354363 >> v2:172.21.15.60:3300/0 conn(0x7fcef8006290 msgr2=0x7fcef8008730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:31:44.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:44.295+0000 7fcf13fff640 1 --2- 172.21.15.60:0/3017354363 >> v2:172.21.15.60:3300/0 conn(0x7fcef8006290 0x7fcef8008730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:31:44.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:44.295+0000 7fcf13fff640 1 --2- 172.21.15.60:0/3017354363 >> v2:172.21.15.60:3300/0 conn(0x7fcef8006290 0x7fcef8008730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:31:45.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.096+0000 7fcf18e8d640 1 -- 172.21.15.60:0/3017354363 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcef8003710 msgr2=0x7fcef8005b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:31:45.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.096+0000 7fcf13fff640 1 --2- 172.21.15.60:0/3017354363 >> v2:172.21.15.60:3300/0 conn(0x7fcef8006290 0x7fcef8008730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:45.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.096+0000 7fcf18e8d640 1 --2- 172.21.15.60:0/3017354363 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcef8003710 0x7fcef8005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:31:45.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.096+0000 7fcf13fff640 1 -- 172.21.15.60:0/3017354363 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcef8003710 msgr2=0x7fcef8005b60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:31:45.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.096+0000 7fcf13fff640 1 --2- 172.21.15.60:0/3017354363 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcef8003710 0x7fcef8005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.096+0000 7fcf13fff640 1 -- 172.21.15.60:0/3017354363 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf140c1c10 con 0x7fcef8006290 2024-09-12T02:31:45.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.097+0000 7fcf13fff640 1 --2- 172.21.15.60:0/3017354363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcef8006290 0x7fcef8008730 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcf00006fd0 tx=0x7fcf0002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a103aa1feb1ffdf4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:45.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.097+0000 7fcf137fe640 1 -- 172.21.15.60:0/3017354363 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf00032070 con 0x7fcef8006290 2024-09-12T02:31:45.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.097+0000 7fcf137fe640 1 -- 172.21.15.60:0/3017354363 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf00030070 con 0x7fcef8006290 2024-09-12T02:31:45.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.097+0000 7fcf137fe640 1 -- 172.21.15.60:0/3017354363 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf0002ca50 con 0x7fcef8006290 2024-09-12T02:31:45.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.098+0000 7fcf1b0f1640 1 -- 172.21.15.60:0/3017354363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcef8006290 msgr2=0x7fcef8008730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:45.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.098+0000 7fcf1b0f1640 1 --2- 172.21.15.60:0/3017354363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcef8006290 0x7fcef8008730 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcf00006fd0 tx=0x7fcf0002bf50 comp rx=0 tx=0).stop 2024-09-12T02:31:45.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.098+0000 7fcf1968e640 1 -- 172.21.15.60:0/3017354363 reap_dead start 2024-09-12T02:31:45.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.098+0000 7fcf1b0f1640 1 -- 172.21.15.60:0/3017354363 shutdown_connections 2024-09-12T02:31:45.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.098+0000 7fcf1b0f1640 1 --2- 172.21.15.60:0/3017354363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcef8006290 0x7fcef8008730 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.098+0000 7fcf1b0f1640 1 -- 172.21.15.60:0/3017354363 >> 172.21.15.60:0/3017354363 conn(0x7fcf140c8430 msgr2=0x7fcf140c8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:45.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.098+0000 7fcf1b0f1640 1 -- 172.21.15.60:0/3017354363 shutdown_connections 2024-09-12T02:31:45.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.098+0000 7fcf1b0f1640 1 -- 172.21.15.60:0/3017354363 wait complete. 2024-09-12T02:31:45.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.100+0000 7fcf1b0f1640 1 Processor -- start 2024-09-12T02:31:45.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.100+0000 7fcf1b0f1640 1 -- start start 2024-09-12T02:31:45.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.100+0000 7fcf1b0f1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcef8006290 0x7fcf1414e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:45.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.100+0000 7fcf1b0f1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcf141effa0 0x7fcf140ac1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:45.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.100+0000 7fcf1b0f1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf14154460 0x7fcf141548e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:45.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.101+0000 7fcf1b0f1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcf140c4250 con 0x7fcf14154460 2024-09-12T02:31:45.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.101+0000 7fcf1b0f1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcf140c40d0 con 0x7fcf141effa0 2024-09-12T02:31:45.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.101+0000 7fcf1b0f1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcf140c5510 con 0x7fcef8006290 2024-09-12T02:31:45.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.101+0000 7fcf1968e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf14154460 0x7fcf141548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:45.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.101+0000 7fcf18e8d640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcef8006290 msgr2=0x7fcf1414e7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:31:45.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.101+0000 7fcf18e8d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcef8006290 0x7fcf1414e7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:31:45.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.101+0000 7fcf1968e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf14154460 0x7fcf141548e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58292/0 (socket says 172.21.15.60:58292) 2024-09-12T02:31:45.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.101+0000 7fcf1968e640 1 -- 172.21.15.60:0/2162360836 learned_addr learned my addr 172.21.15.60:0/2162360836 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:31:45.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.101+0000 7fcf13fff640 1 --2- 172.21.15.60:0/2162360836 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcf141effa0 0x7fcf140ac1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:45.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.101+0000 7fcf1968e640 1 -- 172.21.15.60:0/2162360836 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcef8006290 msgr2=0x7fcf1414e7b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:31:45.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.101+0000 7fcf1968e640 1 --2- 172.21.15.60:0/2162360836 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcef8006290 0x7fcf1414e7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.101+0000 7fcf1968e640 1 -- 172.21.15.60:0/2162360836 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcf141effa0 msgr2=0x7fcf140ac1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:45.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.101+0000 7fcf1968e640 1 --2- 172.21.15.60:0/2162360836 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcf141effa0 0x7fcf140ac1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.101+0000 7fcf1968e640 1 -- 172.21.15.60:0/2162360836 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf14074030 con 0x7fcf14154460 2024-09-12T02:31:45.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.101+0000 7fcf1968e640 1 --2- 172.21.15.60:0/2162360836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf14154460 0x7fcf141548e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcf140c2ad0 tx=0x7fcf0c00ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:45.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.101+0000 7fcf117fa640 1 -- 172.21.15.60:0/2162360836 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c017070 con 0x7fcf14154460 2024-09-12T02:31:45.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.101+0000 7fcf117fa640 1 -- 172.21.15.60:0/2162360836 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf0c00aae0 con 0x7fcf14154460 2024-09-12T02:31:45.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.101+0000 7fcf1b0f1640 1 -- 172.21.15.60:0/2162360836 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf141ef4c0 con 0x7fcf14154460 2024-09-12T02:31:45.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.101+0000 7fcf117fa640 1 -- 172.21.15.60:0/2162360836 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c00ae90 con 0x7fcf14154460 2024-09-12T02:31:45.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.102+0000 7fcf1b0f1640 1 -- 172.21.15.60:0/2162360836 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf141efa80 con 0x7fcf14154460 2024-09-12T02:31:45.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.103+0000 7fcf1b0f1640 1 -- 172.21.15.60:0/2162360836 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf14067950 con 0x7fcf14154460 2024-09-12T02:31:45.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.103+0000 7fcf117fa640 1 -- 172.21.15.60:0/2162360836 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcf0c01a070 con 0x7fcf14154460 2024-09-12T02:31:45.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.104+0000 7fcf117fa640 1 --2- 172.21.15.60:0/2162360836 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcef806ce40 0x7fcef806f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:45.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.104+0000 7fcf117fa640 1 -- 172.21.15.60:0/2162360836 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fcf0c08aad0 con 0x7fcf14154460 2024-09-12T02:31:45.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.104+0000 7fcf18e8d640 1 --2- 172.21.15.60:0/2162360836 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcef806ce40 0x7fcef806f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:45.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.104+0000 7fcf18e8d640 1 --2- 172.21.15.60:0/2162360836 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcef806ce40 0x7fcef806f300 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fcf080011d0 tx=0x7fcf08007950 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:45.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.111+0000 7fcf117fa640 1 -- 172.21.15.60:0/2162360836 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcf0c058b20 con 0x7fcf14154460 2024-09-12T02:31:45.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.445+0000 7fcf1b0f1640 1 -- 172.21.15.60:0/2162360836 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fcf140a7ab0 con 0x7fcf14154460 2024-09-12T02:31:45.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.446+0000 7fcf117fa640 1 -- 172.21.15.60:0/2162360836 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7fcf0c05ce20 con 0x7fcf14154460 2024-09-12T02:31:45.447 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":80,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:31:45.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.448+0000 7fcf1b0f1640 1 -- 172.21.15.60:0/2162360836 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcef806ce40 msgr2=0x7fcef806f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:45.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.448+0000 7fcf1b0f1640 1 --2- 172.21.15.60:0/2162360836 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcef806ce40 0x7fcef806f300 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fcf080011d0 tx=0x7fcf08007950 comp rx=0 tx=0).stop 2024-09-12T02:31:45.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.448+0000 7fcf1b0f1640 1 -- 172.21.15.60:0/2162360836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf14154460 msgr2=0x7fcf141548e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:45.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.448+0000 7fcf1b0f1640 1 --2- 172.21.15.60:0/2162360836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf14154460 0x7fcf141548e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcf140c2ad0 tx=0x7fcf0c00ce40 comp rx=0 tx=0).stop 2024-09-12T02:31:45.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.448+0000 7fcf1b0f1640 1 -- 172.21.15.60:0/2162360836 shutdown_connections 2024-09-12T02:31:45.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.448+0000 7fcf1b0f1640 1 --2- 172.21.15.60:0/2162360836 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcef806ce40 0x7fcef806f300 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.448+0000 7fcf1b0f1640 1 --2- 172.21.15.60:0/2162360836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf14154460 0x7fcf141548e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.448+0000 7fcf1b0f1640 1 --2- 172.21.15.60:0/2162360836 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcf141effa0 0x7fcf140ac1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.448+0000 7fcf1b0f1640 1 --2- 172.21.15.60:0/2162360836 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcef8006290 0x7fcf1414e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.448+0000 7fcf1b0f1640 1 -- 172.21.15.60:0/2162360836 >> 172.21.15.60:0/2162360836 conn(0x7fcf140c8430 msgr2=0x7fcf14157700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:45.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.448+0000 7fcf1b0f1640 1 -- 172.21.15.60:0/2162360836 shutdown_connections 2024-09-12T02:31:45.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.448+0000 7fcf1b0f1640 1 -- 172.21.15.60:0/2162360836 wait complete. 2024-09-12T02:31:45.460 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-12T02:31:45.460 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-09-12T02:31:45.460 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-12T02:31:45.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.566+0000 7fcfba4af640 1 Processor -- start 2024-09-12T02:31:45.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.566+0000 7fcfba4af640 1 -- start start 2024-09-12T02:31:45.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.568+0000 7fcfba4af640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcfb4150480 0x7fcfb40c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:45.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.568+0000 7fcfba4af640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfb406c650 0x7fcfb40c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:45.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.568+0000 7fcfba4af640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fcfb40c9c80 0x7fcfb40ca130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:45.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.568+0000 7fcfba4af640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fcfb406c240 con 0x7fcfb4150480 2024-09-12T02:31:45.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.568+0000 7fcfba4af640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fcfb415a330 con 0x7fcfb40c9c80 2024-09-12T02:31:45.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.568+0000 7fcfba4af640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcfb415a7c0 con 0x7fcfb406c650 2024-09-12T02:31:45.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.568+0000 7fcfb3fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcfb4150480 0x7fcfb40c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:45.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.568+0000 7fcfb37fe640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfb406c650 msgr2=0x7fcfb40c7fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:31:45.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.568+0000 7fcfb3fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcfb4150480 0x7fcfb40c7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58306/0 (socket says 172.21.15.60:58306) 2024-09-12T02:31:45.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.568+0000 7fcfb37fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfb406c650 0x7fcfb40c7fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:31:45.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.568+0000 7fcfb3fff640 1 -- 172.21.15.60:0/81173840 learned_addr learned my addr 172.21.15.60:0/81173840 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:31:45.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.568+0000 7fcfb8a4c640 1 --2- 172.21.15.60:0/81173840 >> v2:172.21.15.105:3300/0 conn(0x7fcfb40c9c80 0x7fcfb40ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:45.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.568+0000 7fcfb3fff640 1 -- 172.21.15.60:0/81173840 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfb406c650 msgr2=0x7fcfb40c7fd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:31:45.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.568+0000 7fcfb3fff640 1 --2- 172.21.15.60:0/81173840 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfb406c650 0x7fcfb40c7fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.568+0000 7fcfb3fff640 1 -- 172.21.15.60:0/81173840 >> v2:172.21.15.105:3300/0 conn(0x7fcfb40c9c80 msgr2=0x7fcfb40ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:45.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.568+0000 7fcfb3fff640 1 --2- 172.21.15.60:0/81173840 >> v2:172.21.15.105:3300/0 conn(0x7fcfb40c9c80 0x7fcfb40ca130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.568+0000 7fcfb3fff640 1 -- 172.21.15.60:0/81173840 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfb4159a00 con 0x7fcfb4150480 2024-09-12T02:31:45.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.569+0000 7fcfb3fff640 1 --2- 172.21.15.60:0/81173840 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfb4150480 0x7fcfb40c7a90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcfb40c62d0 tx=0x7fcfa402a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=620e18b98ebdcc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:45.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.569+0000 7fcfb2ffd640 1 -- 172.21.15.60:0/81173840 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa4037070 con 0x7fcfb4150480 2024-09-12T02:31:45.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.569+0000 7fcfb2ffd640 1 -- 172.21.15.60:0/81173840 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfa4032440 con 0x7fcfb4150480 2024-09-12T02:31:45.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.569+0000 7fcfb2ffd640 1 -- 172.21.15.60:0/81173840 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa4032810 con 0x7fcfb4150480 2024-09-12T02:31:45.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.570+0000 7fcfba4af640 1 -- 172.21.15.60:0/81173840 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfb4150480 msgr2=0x7fcfb40c7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:45.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.570+0000 7fcfba4af640 1 --2- 172.21.15.60:0/81173840 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfb4150480 0x7fcfb40c7a90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcfb40c62d0 tx=0x7fcfa402a200 comp rx=0 tx=0).stop 2024-09-12T02:31:45.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.570+0000 7fcfba4af640 1 -- 172.21.15.60:0/81173840 shutdown_connections 2024-09-12T02:31:45.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.570+0000 7fcfba4af640 1 --2- 172.21.15.60:0/81173840 >> v2:172.21.15.105:3300/0 conn(0x7fcfb40c9c80 0x7fcfb40ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.570+0000 7fcfba4af640 1 --2- 172.21.15.60:0/81173840 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfb406c650 0x7fcfb40c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.570+0000 7fcfba4af640 1 --2- 172.21.15.60:0/81173840 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfb4150480 0x7fcfb40c7a90 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.570+0000 7fcfba4af640 1 -- 172.21.15.60:0/81173840 >> 172.21.15.60:0/81173840 conn(0x7fcfb4068030 msgr2=0x7fcfb4073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:45.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.570+0000 7fcfba4af640 1 -- 172.21.15.60:0/81173840 shutdown_connections 2024-09-12T02:31:45.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.570+0000 7fcfba4af640 1 -- 172.21.15.60:0/81173840 wait complete. 2024-09-12T02:31:45.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.571+0000 7fcfba4af640 1 Processor -- start 2024-09-12T02:31:45.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.571+0000 7fcfba4af640 1 -- start start 2024-09-12T02:31:45.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.572+0000 7fcfba4af640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfb406c650 0x7fcfb41e21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:45.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.572+0000 7fcfba4af640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfb40c9c80 0x7fcfb41ef4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:45.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.572+0000 7fcfba4af640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfb4150480 0x7fcfb4155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:45.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.572+0000 7fcfba4af640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb40ca670 con 0x7fcfb406c650 2024-09-12T02:31:45.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.572+0000 7fcfba4af640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb4159fc0 con 0x7fcfb40c9c80 2024-09-12T02:31:45.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.572+0000 7fcfba4af640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcfb406d270 con 0x7fcfb4150480 2024-09-12T02:31:45.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.572+0000 7fcfb8a4c640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfb4150480 msgr2=0x7fcfb4155260 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:31:45.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.572+0000 7fcfb3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfb406c650 0x7fcfb41e21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:45.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.572+0000 7fcfb8a4c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfb4150480 0x7fcfb4155260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:31:45.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.572+0000 7fcfb3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfb406c650 0x7fcfb41e21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58318/0 (socket says 172.21.15.60:58318) 2024-09-12T02:31:45.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.572+0000 7fcfb3fff640 1 -- 172.21.15.60:0/1608425461 learned_addr learned my addr 172.21.15.60:0/1608425461 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:31:45.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.572+0000 7fcfb37fe640 1 --2- 172.21.15.60:0/1608425461 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfb40c9c80 0x7fcfb41ef4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:45.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.572+0000 7fcfb3fff640 1 -- 172.21.15.60:0/1608425461 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfb4150480 msgr2=0x7fcfb4155260 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:31:45.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.572+0000 7fcfb3fff640 1 --2- 172.21.15.60:0/1608425461 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfb4150480 0x7fcfb4155260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.572+0000 7fcfb3fff640 1 -- 172.21.15.60:0/1608425461 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfb40c9c80 msgr2=0x7fcfb41ef4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:45.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.572+0000 7fcfb3fff640 1 --2- 172.21.15.60:0/1608425461 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfb40c9c80 0x7fcfb41ef4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.572+0000 7fcfb3fff640 1 -- 172.21.15.60:0/1608425461 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfb4155e80 con 0x7fcfb406c650 2024-09-12T02:31:45.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.573+0000 7fcfb3fff640 1 --2- 172.21.15.60:0/1608425461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfb406c650 0x7fcfb41e21f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4000c00 tx=0x7fcfa40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:45.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.573+0000 7fcfb0ff9640 1 -- 172.21.15.60:0/1608425461 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa4041020 con 0x7fcfb406c650 2024-09-12T02:31:45.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.573+0000 7fcfb0ff9640 1 -- 172.21.15.60:0/1608425461 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfa4030640 con 0x7fcfb406c650 2024-09-12T02:31:45.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.573+0000 7fcfba4af640 1 -- 172.21.15.60:0/1608425461 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfb41e2730 con 0x7fcfb406c650 2024-09-12T02:31:45.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.573+0000 7fcfb0ff9640 1 -- 172.21.15.60:0/1608425461 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa4037040 con 0x7fcfb406c650 2024-09-12T02:31:45.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.573+0000 7fcfba4af640 1 -- 172.21.15.60:0/1608425461 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfb41efa20 con 0x7fcfb406c650 2024-09-12T02:31:45.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.574+0000 7fcfba4af640 1 --2- 172.21.15.60:0/1608425461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfb41e1c50 0x7fcfb4151350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:45.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.574+0000 7fcfba4af640 1 -- 172.21.15.60:0/1608425461 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb40ca130 con 0x7fcfb41e1c50 2024-09-12T02:31:45.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.574+0000 7fcfb37fe640 1 --2- 172.21.15.60:0/1608425461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfb41e1c50 0x7fcfb4151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:45.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.574+0000 7fcfb37fe640 1 -- 172.21.15.60:0/1608425461 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcfb40b1210 con 0x7fcfb41e1c50 2024-09-12T02:31:45.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.574+0000 7fcfb37fe640 1 --2- 172.21.15.60:0/1608425461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfb41e1c50 0x7fcfb4151350 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4156ac0 tx=0x7fcfa8009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:45.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.575+0000 7fcfb0ff9640 1 -- 172.21.15.60:0/1608425461 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa8016070 con 0x7fcfb41e1c50 2024-09-12T02:31:45.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.575+0000 7fcfb0ff9640 1 -- 172.21.15.60:0/1608425461 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fcfa8012600 con 0x7fcfb41e1c50 2024-09-12T02:31:45.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.575+0000 7fcfb0ff9640 1 -- 172.21.15.60:0/1608425461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfb41e1c50 msgr2=0x7fcfb4151350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:45.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.575+0000 7fcfb0ff9640 1 --2- 172.21.15.60:0/1608425461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfb41e1c50 0x7fcfb4151350 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4156ac0 tx=0x7fcfa8009b00 comp rx=0 tx=0).stop 2024-09-12T02:31:45.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.575+0000 7fcfb0ff9640 1 -- 172.21.15.60:0/1608425461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfb41e1c50 msgr2=0x7fcfb4151350 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:31:45.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.575+0000 7fcfb0ff9640 1 --2- 172.21.15.60:0/1608425461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfb41e1c50 0x7fcfb4151350 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.575+0000 7fcfb0ff9640 1 -- 172.21.15.60:0/1608425461 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcfa4044020 con 0x7fcfb406c650 2024-09-12T02:31:45.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.575+0000 7fcfb0ff9640 1 --2- 172.21.15.60:0/1608425461 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcfa006b8a0 0x7fcfa006dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:45.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.576+0000 7fcfb0ff9640 1 -- 172.21.15.60:0/1608425461 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fcfa40ab880 con 0x7fcfb406c650 2024-09-12T02:31:45.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.576+0000 7fcfb37fe640 1 --2- 172.21.15.60:0/1608425461 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcfa006b8a0 0x7fcfa006dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:45.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.576+0000 7fcfb37fe640 1 --2- 172.21.15.60:0/1608425461 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcfa006b8a0 0x7fcfa006dd60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8018000 tx=0x7fcfa8008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:45.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.581+0000 7fcfba4af640 1 --2- 172.21.15.60:0/1608425461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfb41557a0 0x7fcfb414f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:45.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.581+0000 7fcfba4af640 1 -- 172.21.15.60:0/1608425461 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb406c430 con 0x7fcfb41557a0 2024-09-12T02:31:45.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.582+0000 7fcfb8a4c640 1 --2- 172.21.15.60:0/1608425461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfb41557a0 0x7fcfb414f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:45.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.582+0000 7fcfb8a4c640 1 -- 172.21.15.60:0/1608425461 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fcfb41e1950 con 0x7fcfb41557a0 2024-09-12T02:31:45.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.582+0000 7fcfb8a4c640 1 --2- 172.21.15.60:0/1608425461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfb41557a0 0x7fcfb414f450 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fcfac00ef40 tx=0x7fcfac00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:45.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.582+0000 7fcfb0ff9640 1 -- 172.21.15.60:0/1608425461 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfac018030 con 0x7fcfb41557a0 2024-09-12T02:31:45.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.582+0000 7fcfb0ff9640 1 -- 172.21.15.60:0/1608425461 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4874 (secure 0 0 0) 0x7fcfac00cd20 con 0x7fcfb41557a0 2024-09-12T02:31:45.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.582+0000 7fcfb0ff9640 1 -- 172.21.15.60:0/1608425461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfb41557a0 msgr2=0x7fcfb414f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:45.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.582+0000 7fcfb0ff9640 1 --2- 172.21.15.60:0/1608425461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfb41557a0 0x7fcfb414f450 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fcfac00ef40 tx=0x7fcfac00c490 comp rx=0 tx=0).stop 2024-09-12T02:31:45.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.582+0000 7fcfb0ff9640 1 -- 172.21.15.60:0/1608425461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfb41557a0 msgr2=0x7fcfb414f450 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:31:45.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.582+0000 7fcfb0ff9640 1 --2- 172.21.15.60:0/1608425461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfb41557a0 0x7fcfb414f450 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.584 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:31:45.584 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:31:45.584 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:31:45.584 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:31:45.584 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 80, 2024-09-12T02:31:45.584 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 168686, 2024-09-12T02:31:45.585 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:31:45.585 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:31:45.585 INFO:teuthology.orchestra.run.smithi060.stdout: 1 2024-09-12T02:31:45.585 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:31:45.585 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-09-12T02:31:45.585 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:31:45.585 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:31:45.585 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:31:45.585 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:31:45.585 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:31:45.585 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:31:45.585 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:31:45.585 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:31:45.586 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:31:45.586 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:31:45.586 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:31:45.586 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:31:45.586 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:31:45.586 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:31:45.586 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:31:45.586 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:31:45.586 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:31:45.586 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:31:45.586 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:31:45.586 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:31:45.586 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:31:45.587 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:31:45.587 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:31:45.587 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:31:45.587 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:31:45.587 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:31:45.587 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:31:45.587 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:31:45.587 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:45.587 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:45.587 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:31:45.587 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:31:45.587 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:31:45.587 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:31:45.587 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:31:45.588 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:31:45.588 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:31:45.588 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:31:45.588 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:31:45.588 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:31:45.588 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:31:45.588 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:31:45.588 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:31:45.588 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:31:45.588 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:31:45.588 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:31:45.588 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:31:45.588 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:31:45.589 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:31:45.589 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:31:45.589 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:31:45.589 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:31:45.589 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:31:45.589 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:31:45.589 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:31:45.589 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:31:45.589 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:31:45.589 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:31:45.589 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:31:45.589 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:31:45.589 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:45.590 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:31:45.590 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:45.590 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:31:45.590 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:31:45.590 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:31:45.590 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:31:45.590 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:45.590 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:31:45.590 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:31:45.590 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:45.590 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:45.590 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:45.590 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:31:45.590 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:31:45.591 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:45.591 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:45.591 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:45.591 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:45.591 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:31:45.591 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:31:45.591 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:31:45.591 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:31:45.591 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:31:45.591 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:45.591 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:45.591 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:31:45.591 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:31:45.591 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:31:45.592 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:31:45.592 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:45.592 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:31:45.592 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:31:45.592 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:45.592 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:45.592 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:45.592 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:31:45.592 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:31:45.592 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:45.592 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:45.592 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:45.592 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:45.593 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:31:45.593 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:31:45.593 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:31:45.593 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:31:45.593 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:31:45.593 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:45.593 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:45.593 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:31:45.593 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:31:45.593 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:31:45.593 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:31:45.593 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:45.593 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:31:45.593 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:31:45.594 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:45.594 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:45.594 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:45.594 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:31:45.594 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:31:45.594 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:45.594 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:45.594 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:45.594 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:45.594 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:31:45.594 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:31:45.594 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:31:45.594 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:31:45.594 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:31:45.595 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:45.595 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:45.595 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:45.595 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:31:45.595 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:31:45.595 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:45.595 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:31:45.595 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:31:45.595 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:31:45.595 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:45.595 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:31:45.595 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:31:45.596 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:45.596 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:31:45.596 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:31:45.596 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:31:45.596 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:45.596 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:31:45.596 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:31:45.596 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:45.596 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:31:45.596 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:31:45.596 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:31:45.596 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:45.596 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:31:45.597 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:31:45.597 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:45.597 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:31:45.597 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:31:45.597 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:31:45.597 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:45.597 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:45.597 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:45.597 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:31:45.597 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:31:45.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.583+0000 7fcfba4af640 1 -- 172.21.15.60:0/1608425461 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcfa006b8a0 msgr2=0x7fcfa006dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:45.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.583+0000 7fcfba4af640 1 --2- 172.21.15.60:0/1608425461 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcfa006b8a0 0x7fcfa006dd60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8018000 tx=0x7fcfa8008030 comp rx=0 tx=0).stop 2024-09-12T02:31:45.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.583+0000 7fcfba4af640 1 -- 172.21.15.60:0/1608425461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfb406c650 msgr2=0x7fcfb41e21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:45.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.583+0000 7fcfb8a4c640 1 -- 172.21.15.60:0/1608425461 reap_dead start 2024-09-12T02:31:45.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.583+0000 7fcfba4af640 1 --2- 172.21.15.60:0/1608425461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfb406c650 0x7fcfb41e21f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4000c00 tx=0x7fcfa40046c0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.583+0000 7fcfba4af640 1 -- 172.21.15.60:0/1608425461 shutdown_connections 2024-09-12T02:31:45.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.583+0000 7fcfba4af640 1 --2- 172.21.15.60:0/1608425461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfb406c650 0x7fcfb41e21f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.583+0000 7fcfba4af640 1 -- 172.21.15.60:0/1608425461 >> 172.21.15.60:0/1608425461 conn(0x7fcfb4068030 msgr2=0x7fcfb40acfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:45.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.583+0000 7fcfba4af640 1 -- 172.21.15.60:0/1608425461 shutdown_connections 2024-09-12T02:31:45.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.583+0000 7fcfba4af640 1 -- 172.21.15.60:0/1608425461 wait complete. 2024-09-12T02:31:45.600 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-12T02:31:45.600 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-12T02:31:45.600 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-12T02:31:45.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.715+0000 7f8c82191640 1 Processor -- start 2024-09-12T02:31:45.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.715+0000 7f8c82191640 1 -- start start 2024-09-12T02:31:45.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.716+0000 7f8c82191640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8c7c06c650 0x7f8c7c0c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:45.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.716+0000 7f8c82191640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c7c0ca1c0 0x7f8c7c160bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:45.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.716+0000 7f8c82191640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c7c15a7c0 con 0x7f8c7c150480 2024-09-12T02:31:45.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.716+0000 7f8c82191640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f8c7c06c240 con 0x7f8c7c06c650 2024-09-12T02:31:45.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.716+0000 7f8c82191640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8c7c15a330 con 0x7f8c7c0ca1c0 2024-09-12T02:31:45.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.716+0000 7f8c7bfff640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c7c0ca1c0 msgr2=0x7f8c7c160bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:31:45.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.717+0000 7f8c7b7fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f8c7c150480 0x7f8c7c0c7a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:54644/0 (socket says 172.21.15.60:54644) 2024-09-12T02:31:45.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.717+0000 7f8c7bfff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c7c0ca1c0 0x7f8c7c160bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:31:45.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.717+0000 7f8c7b7fe640 1 -- 172.21.15.60:0/1078813199 learned_addr learned my addr 172.21.15.60:0/1078813199 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:31:45.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.717+0000 7f8c7affd640 1 --2- 172.21.15.60:0/1078813199 >> v2:172.21.15.105:3300/0 conn(0x7f8c7c06c650 0x7f8c7c0c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:45.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.717+0000 7f8c7a7fc640 1 -- 172.21.15.60:0/1078813199 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2525291254 0 0) 0x7f8c7c15a7c0 con 0x7f8c7c150480 2024-09-12T02:31:45.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.717+0000 7f8c7a7fc640 1 -- 172.21.15.60:0/1078813199 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c64003520 con 0x7f8c7c150480 2024-09-12T02:31:45.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.717+0000 7f8c7a7fc640 1 -- 172.21.15.60:0/1078813199 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 403403262 0 0) 0x7f8c64003520 con 0x7f8c7c150480 2024-09-12T02:31:45.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.717+0000 7f8c7a7fc640 1 -- 172.21.15.60:0/1078813199 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c7c0ca1c0 msgr2=0x7f8c7c160bf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:31:45.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.717+0000 7f8c7a7fc640 1 --2- 172.21.15.60:0/1078813199 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c7c0ca1c0 0x7f8c7c160bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.717+0000 7f8c7a7fc640 1 -- 172.21.15.60:0/1078813199 >> v2:172.21.15.105:3300/0 conn(0x7f8c7c06c650 msgr2=0x7f8c7c0c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:45.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.717+0000 7f8c7a7fc640 1 --2- 172.21.15.60:0/1078813199 >> v2:172.21.15.105:3300/0 conn(0x7f8c7c06c650 0x7f8c7c0c9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.717+0000 7f8c7a7fc640 1 -- 172.21.15.60:0/1078813199 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c7c159a00 con 0x7f8c7c150480 2024-09-12T02:31:45.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.717+0000 7f8c7a7fc640 1 -- 172.21.15.60:0/1078813199 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7f8c6c001670 con 0x7f8c7c150480 2024-09-12T02:31:45.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.717+0000 7f8c7affd640 1 --2- 172.21.15.60:0/1078813199 >> v2:172.21.15.105:3300/0 conn(0x7f8c7c06c650 0x7f8c7c0c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:31:45.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.717+0000 7f8c7a7fc640 1 -- 172.21.15.60:0/1078813199 >> v1:172.21.15.60:6789/0 conn(0x7f8c7c150480 legacy=0x7f8c7c0c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:45.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.717+0000 7f8c7a7fc640 1 --2- 172.21.15.60:0/1078813199 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c7c0ca1c0 0x7f8c640039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:45.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.717+0000 7f8c7a7fc640 1 --2- 172.21.15.60:0/1078813199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c64003f50 0x7f8c64004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:45.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.717+0000 7f8c7a7fc640 1 --2- 172.21.15.60:0/1078813199 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c64004d40 0x7f8c640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:45.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.717+0000 7f8c7a7fc640 1 -- 172.21.15.60:0/1078813199 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8c7c15a330 con 0x7f8c64003f50 2024-09-12T02:31:45.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.717+0000 7f8c7a7fc640 1 -- 172.21.15.60:0/1078813199 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6400ba70 con 0x7f8c64004d40 2024-09-12T02:31:45.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.717+0000 7f8c7a7fc640 1 -- 172.21.15.60:0/1078813199 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8c6400bc40 con 0x7f8c7c0ca1c0 2024-09-12T02:31:45.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.717+0000 7f8c7b7fe640 1 -- 172.21.15.60:0/1078813199 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c7c0ca1c0 msgr2=0x7f8c640039d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:31:45.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.717+0000 7f8c7b7fe640 1 --2- 172.21.15.60:0/1078813199 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c7c0ca1c0 0x7f8c640039d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:31:45.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.717+0000 7f8c7affd640 1 --2- 172.21.15.60:0/1078813199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c64003f50 0x7f8c64004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:45.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.717+0000 7f8c7bfff640 1 --2- 172.21.15.60:0/1078813199 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c64004d40 0x7f8c640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:45.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.718+0000 7f8c7affd640 1 -- 172.21.15.60:0/1078813199 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c7c0ca1c0 msgr2=0x7f8c640039d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:31:45.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.718+0000 7f8c7affd640 1 --2- 172.21.15.60:0/1078813199 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c7c0ca1c0 0x7f8c640039d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.718+0000 7f8c7affd640 1 -- 172.21.15.60:0/1078813199 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c64004d40 msgr2=0x7f8c640051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:31:45.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.718+0000 7f8c7affd640 1 --2- 172.21.15.60:0/1078813199 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c64004d40 0x7f8c640051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.718+0000 7f8c7affd640 1 -- 172.21.15.60:0/1078813199 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c64003520 con 0x7f8c64003f50 2024-09-12T02:31:45.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.719+0000 7f8c7affd640 1 --2- 172.21.15.60:0/1078813199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c64003f50 0x7f8c64004800 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8c70009c90 tx=0x7f8c64005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cef8a47b1029936 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:45.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.719+0000 7f8c7a7fc640 1 -- 172.21.15.60:0/1078813199 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c70036070 con 0x7f8c64003f50 2024-09-12T02:31:45.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.719+0000 7f8c7a7fc640 1 -- 172.21.15.60:0/1078813199 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c70031400 con 0x7f8c64003f50 2024-09-12T02:31:45.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.719+0000 7f8c7a7fc640 1 -- 172.21.15.60:0/1078813199 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c70009860 con 0x7f8c64003f50 2024-09-12T02:31:45.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.719+0000 7f8c82191640 1 -- 172.21.15.60:0/1078813199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c64003f50 msgr2=0x7f8c64004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:45.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.719+0000 7f8c82191640 1 --2- 172.21.15.60:0/1078813199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c64003f50 0x7f8c64004800 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8c70009c90 tx=0x7f8c64005830 comp rx=0 tx=0).stop 2024-09-12T02:31:45.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.719+0000 7f8c7bfff640 1 -- 172.21.15.60:0/1078813199 reap_dead start 2024-09-12T02:31:45.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.719+0000 7f8c82191640 1 -- 172.21.15.60:0/1078813199 shutdown_connections 2024-09-12T02:31:45.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.719+0000 7f8c82191640 1 -- 172.21.15.60:0/1078813199 >> 172.21.15.60:0/1078813199 conn(0x7f8c7c068030 msgr2=0x7f8c7c073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:45.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.719+0000 7f8c82191640 1 -- 172.21.15.60:0/1078813199 shutdown_connections 2024-09-12T02:31:45.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.719+0000 7f8c82191640 1 -- 172.21.15.60:0/1078813199 wait complete. 2024-09-12T02:31:45.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.721+0000 7f8c82191640 1 Processor -- start 2024-09-12T02:31:45.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.721+0000 7f8c82191640 1 -- start start 2024-09-12T02:31:45.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.722+0000 7f8c82191640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c64003f50 0x7f8c7c153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:45.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.722+0000 7f8c82191640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c7c0af060 0x7f8c7c1e04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:45.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.722+0000 7f8c82191640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c7c1ef600 0x7f8c7c0af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:45.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.722+0000 7f8c82191640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8c7c0ca630 con 0x7f8c7c1ef600 2024-09-12T02:31:45.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.722+0000 7f8c82191640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8c7c159fc0 con 0x7f8c64003f50 2024-09-12T02:31:45.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.722+0000 7f8c82191640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8c7c06d270 con 0x7f8c7c0af060 2024-09-12T02:31:45.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.722+0000 7f8c7affd640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c7c0af060 msgr2=0x7f8c7c1e04f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:31:45.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.722+0000 7f8c7affd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c7c0af060 0x7f8c7c1e04f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:31:45.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.722+0000 7f8c7bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c7c1ef600 0x7f8c7c0af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:45.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.722+0000 7f8c7bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c7c1ef600 0x7f8c7c0af8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58340/0 (socket says 172.21.15.60:58340) 2024-09-12T02:31:45.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.722+0000 7f8c7bfff640 1 -- 172.21.15.60:0/39087639 learned_addr learned my addr 172.21.15.60:0/39087639 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:31:45.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.722+0000 7f8c7b7fe640 1 --2- 172.21.15.60:0/39087639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c64003f50 0x7f8c7c153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:45.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.722+0000 7f8c7bfff640 1 -- 172.21.15.60:0/39087639 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c7c0af060 msgr2=0x7f8c7c1e04f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:31:45.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.722+0000 7f8c7bfff640 1 --2- 172.21.15.60:0/39087639 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c7c0af060 0x7f8c7c1e04f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.722+0000 7f8c7bfff640 1 -- 172.21.15.60:0/39087639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c64003f50 msgr2=0x7f8c7c153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:45.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.722+0000 7f8c7bfff640 1 --2- 172.21.15.60:0/39087639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c64003f50 0x7f8c7c153880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.722+0000 7f8c7bfff640 1 -- 172.21.15.60:0/39087639 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c7c1e26f0 con 0x7f8c7c1ef600 2024-09-12T02:31:45.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.722+0000 7f8c7b7fe640 1 --2- 172.21.15.60:0/39087639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c64003f50 0x7f8c7c153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:31:45.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.722+0000 7f8c7bfff640 1 --2- 172.21.15.60:0/39087639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c7c1ef600 0x7f8c7c0af8e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c08e210 tx=0x7f8c7400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:45.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.722+0000 7f8c63fff640 1 -- 172.21.15.60:0/39087639 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7400cca0 con 0x7f8c7c1ef600 2024-09-12T02:31:45.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.723+0000 7f8c63fff640 1 -- 172.21.15.60:0/39087639 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c7400ce60 con 0x7f8c7c1ef600 2024-09-12T02:31:45.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.723+0000 7f8c82191640 1 -- 172.21.15.60:0/39087639 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c7c1535a0 con 0x7f8c7c1ef600 2024-09-12T02:31:45.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.723+0000 7f8c63fff640 1 -- 172.21.15.60:0/39087639 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c74017680 con 0x7f8c7c1ef600 2024-09-12T02:31:45.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.723+0000 7f8c82191640 1 -- 172.21.15.60:0/39087639 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c7c159270 con 0x7f8c7c1ef600 2024-09-12T02:31:45.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.724+0000 7f8c82191640 1 --2- 172.21.15.60:0/39087639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c7c1efab0 0x7f8c7c0afe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:45.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.724+0000 7f8c82191640 1 -- 172.21.15.60:0/39087639 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8c7c0b0c40 con 0x7f8c7c1efab0 2024-09-12T02:31:45.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.724+0000 7f8c7b7fe640 1 --2- 172.21.15.60:0/39087639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c7c1efab0 0x7f8c7c0afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:45.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.724+0000 7f8c63fff640 1 -- 172.21.15.60:0/39087639 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8c740203e0 con 0x7f8c7c1ef600 2024-09-12T02:31:45.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.724+0000 7f8c7b7fe640 1 -- 172.21.15.60:0/39087639 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8c7c156270 con 0x7f8c7c1efab0 2024-09-12T02:31:45.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.724+0000 7f8c7b7fe640 1 --2- 172.21.15.60:0/39087639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c7c1efab0 0x7f8c7c0afe20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c1590a0 tx=0x7f8c6c00f5a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:45.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.725+0000 7f8c63fff640 1 --2- 172.21.15.60:0/39087639 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8c6806bde0 0x7f8c6806e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:45.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.725+0000 7f8c63fff640 1 -- 172.21.15.60:0/39087639 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f8c7408bc10 con 0x7f8c7c1ef600 2024-09-12T02:31:45.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.725+0000 7f8c7affd640 1 --2- 172.21.15.60:0/39087639 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8c6806bde0 0x7f8c6806e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:45.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.725+0000 7f8c63fff640 1 -- 172.21.15.60:0/39087639 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c004e40 con 0x7f8c7c1efab0 2024-09-12T02:31:45.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.725+0000 7f8c63fff640 1 -- 172.21.15.60:0/39087639 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f8c6c018070 con 0x7f8c7c1efab0 2024-09-12T02:31:45.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.725+0000 7f8c63fff640 1 -- 172.21.15.60:0/39087639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c7c1efab0 msgr2=0x7f8c7c0afe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:45.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.725+0000 7f8c63fff640 1 --2- 172.21.15.60:0/39087639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c7c1efab0 0x7f8c7c0afe20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c1590a0 tx=0x7f8c6c00f5a0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.725+0000 7f8c63fff640 1 -- 172.21.15.60:0/39087639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c7c1efab0 msgr2=0x7f8c7c0afe20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:31:45.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.725+0000 7f8c63fff640 1 --2- 172.21.15.60:0/39087639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c7c1efab0 0x7f8c7c0afe20 secure :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c1590a0 tx=0x7f8c6c00f5a0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.725+0000 7f8c7affd640 1 --2- 172.21.15.60:0/39087639 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8c6806bde0 0x7f8c6806e2a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8c70033000 tx=0x7f8c70008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:45.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.732+0000 7f8c82191640 1 --2- 172.21.15.60:0/39087639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c7c1ebdc0 0x7f8c7c1ec1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:45.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.732+0000 7f8c82191640 1 -- 172.21.15.60:0/39087639 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8c7c06c430 con 0x7f8c7c1ebdc0 2024-09-12T02:31:45.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.732+0000 7f8c7b7fe640 1 --2- 172.21.15.60:0/39087639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c7c1ebdc0 0x7f8c7c1ec1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:45.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.732+0000 7f8c7b7fe640 1 -- 172.21.15.60:0/39087639 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8c7c073590 con 0x7f8c7c1ebdc0 2024-09-12T02:31:45.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.732+0000 7f8c7b7fe640 1 --2- 172.21.15.60:0/39087639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c7c1ebdc0 0x7f8c7c1ec1a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c1590a0 tx=0x7f8c6c001a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:45.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.733+0000 7f8c63fff640 1 -- 172.21.15.60:0/39087639 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c013940 con 0x7f8c7c1ebdc0 2024-09-12T02:31:45.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.733+0000 7f8c63fff640 1 -- 172.21.15.60:0/39087639 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5039 (secure 0 0 0) 0x7f8c6c013940 con 0x7f8c7c1ebdc0 2024-09-12T02:31:45.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.733+0000 7f8c63fff640 1 -- 172.21.15.60:0/39087639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c7c1ebdc0 msgr2=0x7f8c7c1ec1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:45.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.733+0000 7f8c63fff640 1 --2- 172.21.15.60:0/39087639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c7c1ebdc0 0x7f8c7c1ec1a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c1590a0 tx=0x7f8c6c001a70 comp rx=0 tx=0).stop 2024-09-12T02:31:45.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.733+0000 7f8c63fff640 1 -- 172.21.15.60:0/39087639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c7c1ebdc0 msgr2=0x7f8c7c1ec1a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:31:45.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.733+0000 7f8c63fff640 1 --2- 172.21.15.60:0/39087639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c7c1ebdc0 0x7f8c7c1ec1a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:45.735 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:31:45.735 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:31:45.735 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:31:45.735 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:31:45.735 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 80, 2024-09-12T02:31:45.735 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 451166, 2024-09-12T02:31:45.735 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:31:45.735 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:31:45.735 INFO:teuthology.orchestra.run.smithi060.stdout: 1 2024-09-12T02:31:45.735 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:31:45.735 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-09-12T02:31:45.736 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:31:45.736 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:31:45.736 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:31:45.736 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:31:45.736 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:31:45.736 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:31:45.736 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:31:45.736 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:31:45.736 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:31:45.736 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:31:45.736 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:31:45.737 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:31:45.737 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:31:45.737 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:31:45.737 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:31:45.737 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:31:45.737 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:31:45.737 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:31:45.737 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:31:45.737 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:31:45.737 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:31:45.737 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:31:45.737 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:31:45.738 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:31:45.738 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:31:45.738 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:31:45.738 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:31:45.738 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:31:45.738 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:45.738 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:45.738 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:31:45.738 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:31:45.738 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:31:45.738 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:31:45.738 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:31:45.738 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:31:45.738 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:31:45.739 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:31:45.739 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:31:45.739 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:31:45.739 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:31:45.739 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:31:45.739 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:31:45.739 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:31:45.739 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:31:45.739 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:31:45.739 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:31:45.740 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:31:45.740 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:31:45.740 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:31:45.740 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:31:45.740 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:31:45.740 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:31:45.740 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:31:45.740 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:31:45.740 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:31:45.741 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:31:45.741 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:31:45.741 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:31:45.741 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:31:45.741 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:45.741 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:31:45.741 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:45.741 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:31:45.741 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:31:45.741 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:31:45.741 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:31:45.741 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:45.742 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:31:45.742 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:31:45.742 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:45.742 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:45.742 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:45.742 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:31:45.742 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:31:45.742 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:45.742 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:45.742 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:45.742 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:45.742 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:31:45.742 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:31:45.742 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:31:45.743 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:31:45.743 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:31:45.743 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:45.743 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:45.743 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:31:45.743 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:31:45.743 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:31:45.743 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:31:45.743 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:45.743 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:31:45.743 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:31:45.743 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:45.743 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:45.744 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:45.744 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:31:45.744 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:31:45.744 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:45.744 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:45.744 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:45.744 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:45.744 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:31:45.744 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:31:45.744 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:31:45.744 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:31:45.744 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:31:45.744 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:45.745 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:45.745 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:31:45.745 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:31:45.745 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:31:45.745 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:31:45.745 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:45.745 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:31:45.745 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:31:45.745 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:45.745 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:45.745 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:45.745 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:31:45.745 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:31:45.746 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:31:45.746 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:45.746 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:45.746 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:45.746 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:31:45.746 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:31:45.746 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:31:45.746 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:31:45.747 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:31:45.747 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:45.747 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:45.747 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:45.747 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:31:45.747 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:31:45.747 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:45.747 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:31:45.747 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:31:45.747 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:31:45.747 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:45.747 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:31:45.747 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:31:45.747 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:45.748 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:31:45.748 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:31:45.748 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:31:45.748 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:45.748 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:31:45.748 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:31:45.748 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:45.748 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:31:45.748 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:31:45.748 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-09-12T02:31:45.748 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:45.748 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:31:45.748 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:31:45.749 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:45.749 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:31:45.749 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:31:45.749 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-09-12T02:31:45.749 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:45.749 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:31:45.749 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:31:45.749 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:31:45.750 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:31:45.750 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:31:45.750 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:31:45.750 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:31:45.750 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:31:45.750 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:31:45.750 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:31:45.750 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:31:45.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.733+0000 7f8c82191640 1 -- 172.21.15.60:0/39087639 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8c6806bde0 msgr2=0x7f8c6806e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:45.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.733+0000 7f8c82191640 1 --2- 172.21.15.60:0/39087639 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8c6806bde0 0x7f8c6806e2a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8c70033000 tx=0x7f8c70008030 comp rx=0 tx=0).stop 2024-09-12T02:31:45.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.733+0000 7f8c82191640 1 -- 172.21.15.60:0/39087639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c7c1ef600 msgr2=0x7f8c7c0af8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:45.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.733+0000 7f8c82191640 1 --2- 172.21.15.60:0/39087639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c7c1ef600 0x7f8c7c0af8e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c08e210 tx=0x7f8c7400ee30 comp rx=0 tx=0).stop 2024-09-12T02:31:45.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.733+0000 7f8c7bfff640 1 -- 172.21.15.60:0/39087639 reap_dead start 2024-09-12T02:31:45.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.733+0000 7f8c7bfff640 1 -- 172.21.15.60:0/39087639 reap_dead start 2024-09-12T02:31:45.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.733+0000 7f8c82191640 1 -- 172.21.15.60:0/39087639 shutdown_connections 2024-09-12T02:31:45.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.733+0000 7f8c82191640 1 -- 172.21.15.60:0/39087639 >> 172.21.15.60:0/39087639 conn(0x7f8c7c068030 msgr2=0x7f8c7c0ca8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:45.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.733+0000 7f8c82191640 1 -- 172.21.15.60:0/39087639 shutdown_connections 2024-09-12T02:31:45.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:31:45.733+0000 7f8c82191640 1 -- 172.21.15.60:0/39087639 wait complete. 2024-09-12T02:31:45.753 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-12T02:31:45.753 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-12T02:31:58.477 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:31:58.480 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:32:05.754 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-09-12T02:32:05.754 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-09-12T02:32:05.754 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T02:32:05.755 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T02:32:05.757 INFO:tasks.ceph.mon.c:Started 2024-09-12T02:32:05.757 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-12T02:32:05.757 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:32:05.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.878+0000 7eff16add640 1 Processor -- start 2024-09-12T02:32:05.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.878+0000 7eff16add640 1 -- start start 2024-09-12T02:32:05.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.879+0000 7eff16add640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7eff100c7ef0 0x7eff100c4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.879+0000 7eff16add640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff100a7cc0 con 0x7eff100c7a90 2024-09-12T02:32:05.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.879+0000 7eff16add640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff100a7f60 con 0x7eff100aeb10 2024-09-12T02:32:05.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.879+0000 7eff16add640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7eff100c3580 con 0x7eff100c7ef0 2024-09-12T02:32:05.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.879+0000 7eff1507a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7eff100c7ef0 0x7eff100c4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.879+0000 7eff0ffff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7eff100c7a90 0x7eff100c3cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50054/0 (socket says 172.21.15.60:50054) 2024-09-12T02:32:05.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.879+0000 7eff0ffff640 1 -- 172.21.15.60:0/1622606138 learned_addr learned my addr 172.21.15.60:0/1622606138 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:32:05.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.879+0000 7eff1507a640 1 -- 172.21.15.60:0/1622606138 >> v1:172.21.15.105:6789/0 conn(0x7eff100aeb10 legacy=0x7eff10156c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.879+0000 7eff1507a640 1 -- 172.21.15.60:0/1622606138 >> v1:172.21.15.60:6789/0 conn(0x7eff100c7a90 legacy=0x7eff100c3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.879+0000 7eff0f7fe640 1 -- 172.21.15.60:0/1622606138 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 997728565 0 0) 0x7eff100a7f60 con 0x7eff100aeb10 2024-09-12T02:32:05.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.879+0000 7eff1507a640 1 -- 172.21.15.60:0/1622606138 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff100a8240 con 0x7eff100c7ef0 2024-09-12T02:32:05.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.880+0000 7eff1507a640 1 --2- 172.21.15.60:0/1622606138 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff100c7ef0 0x7eff100c4400 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7eff08009d90 tx=0x7eff0802a4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6414f44ba713f5e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:05.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.880+0000 7eff0f7fe640 1 -- 172.21.15.60:0/1622606138 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff08007740 con 0x7eff100c7ef0 2024-09-12T02:32:05.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.880+0000 7eff0f7fe640 1 -- 172.21.15.60:0/1622606138 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff080078e0 con 0x7eff100c7ef0 2024-09-12T02:32:05.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.881+0000 7eff0f7fe640 1 -- 172.21.15.60:0/1622606138 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff08007cb0 con 0x7eff100c7ef0 2024-09-12T02:32:05.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.881+0000 7eff16add640 1 -- 172.21.15.60:0/1622606138 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff100c7ef0 msgr2=0x7eff100c4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.881+0000 7eff16add640 1 --2- 172.21.15.60:0/1622606138 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff100c7ef0 0x7eff100c4400 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7eff08009d90 tx=0x7eff0802a4d0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.881+0000 7eff16add640 1 -- 172.21.15.60:0/1622606138 shutdown_connections 2024-09-12T02:32:05.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.881+0000 7eff16add640 1 --2- 172.21.15.60:0/1622606138 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff100c7ef0 0x7eff100c4400 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.881+0000 7eff16add640 1 -- 172.21.15.60:0/1622606138 >> 172.21.15.60:0/1622606138 conn(0x7eff100c5680 msgr2=0x7eff100c5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:05.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.881+0000 7eff16add640 1 -- 172.21.15.60:0/1622606138 shutdown_connections 2024-09-12T02:32:05.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.881+0000 7eff16add640 1 -- 172.21.15.60:0/1622606138 wait complete. 2024-09-12T02:32:05.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.883+0000 7eff16add640 1 Processor -- start 2024-09-12T02:32:05.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.883+0000 7eff16add640 1 -- start start 2024-09-12T02:32:05.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.884+0000 7eff16add640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff100aeb10 0x7eff10155b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.884+0000 7eff16add640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff100c7a90 0x7eff10154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.884+0000 7eff16add640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff100c7ef0 0x7eff10154ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.884+0000 7eff16add640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7eff100c4940 con 0x7eff100aeb10 2024-09-12T02:32:05.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.884+0000 7eff16add640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7eff100c3860 con 0x7eff100c7ef0 2024-09-12T02:32:05.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.884+0000 7eff16add640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7eff100c5240 con 0x7eff100c7a90 2024-09-12T02:32:05.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.884+0000 7eff0ffff640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff100c7a90 msgr2=0x7eff10154580 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:32:05.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.884+0000 7eff0ffff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff100c7a90 0x7eff10154580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:32:05.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.884+0000 7eff14879640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff100aeb10 0x7eff10155b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.884+0000 7eff14879640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff100aeb10 0x7eff10155b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34194/0 (socket says 172.21.15.60:34194) 2024-09-12T02:32:05.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.884+0000 7eff14879640 1 -- 172.21.15.60:0/759534033 learned_addr learned my addr 172.21.15.60:0/759534033 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:32:05.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.884+0000 7eff1507a640 1 --2- 172.21.15.60:0/759534033 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff100c7ef0 0x7eff10154ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.884+0000 7eff14879640 1 -- 172.21.15.60:0/759534033 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff100c7a90 msgr2=0x7eff10154580 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:32:05.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.884+0000 7eff14879640 1 --2- 172.21.15.60:0/759534033 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff100c7a90 0x7eff10154580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.884+0000 7eff14879640 1 -- 172.21.15.60:0/759534033 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff100c7ef0 msgr2=0x7eff10154ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:05.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.884+0000 7eff14879640 1 --2- 172.21.15.60:0/759534033 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff100c7ef0 0x7eff10154ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:05.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.884+0000 7eff14879640 1 -- 172.21.15.60:0/759534033 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff101554a0 con 0x7eff100aeb10 2024-09-12T02:32:05.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.884+0000 7eff14879640 1 --2- 172.21.15.60:0/759534033 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff100aeb10 0x7eff10155b90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7eff0400c430 tx=0x7eff0400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:05.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.884+0000 7eff0d7fa640 1 -- 172.21.15.60:0/759534033 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff04017070 con 0x7eff100aeb10 2024-09-12T02:32:05.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.884+0000 7eff0d7fa640 1 -- 172.21.15.60:0/759534033 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff040052d0 con 0x7eff100aeb10 2024-09-12T02:32:05.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.884+0000 7eff16add640 1 -- 172.21.15.60:0/759534033 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff101551c0 con 0x7eff100aeb10 2024-09-12T02:32:05.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.884+0000 7eff0d7fa640 1 -- 172.21.15.60:0/759534033 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff040037f0 con 0x7eff100aeb10 2024-09-12T02:32:05.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.885+0000 7eff16add640 1 -- 172.21.15.60:0/759534033 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff101e2590 con 0x7eff100aeb10 2024-09-12T02:32:05.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.886+0000 7eff16add640 1 -- 172.21.15.60:0/759534033 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff10156c20 con 0x7eff100aeb10 2024-09-12T02:32:05.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.886+0000 7eff0d7fa640 1 -- 172.21.15.60:0/759534033 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7eff0401a070 con 0x7eff100aeb10 2024-09-12T02:32:05.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.887+0000 7eff0d7fa640 1 --2- 172.21.15.60:0/759534033 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7efef406bde0 0x7efef406e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:05.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.887+0000 7eff0d7fa640 1 -- 172.21.15.60:0/759534033 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7eff0408a3e0 con 0x7eff100aeb10 2024-09-12T02:32:05.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.887+0000 7eff0ffff640 1 --2- 172.21.15.60:0/759534033 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7efef406bde0 0x7efef406e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:05.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.887+0000 7eff0ffff640 1 --2- 172.21.15.60:0/759534033 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7efef406bde0 0x7efef406e2a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7efefc007fd0 tx=0x7efefc007b40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:05.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:05.892+0000 7eff0d7fa640 1 -- 172.21.15.60:0/759534033 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7eff04058430 con 0x7eff100aeb10 2024-09-12T02:32:06.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:06.236+0000 7eff16add640 1 -- 172.21.15.60:0/759534033 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7eff100704b0 con 0x7eff100aeb10 2024-09-12T02:32:06.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:06.236+0000 7eff0d7fa640 1 -- 172.21.15.60:0/759534033 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1559 (secure 0 0 0) 0x7eff0405c730 con 0x7eff100aeb10 2024-09-12T02:32:06.237 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":80,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:32:06.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:06.238+0000 7eff16add640 1 -- 172.21.15.60:0/759534033 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7efef406bde0 msgr2=0x7efef406e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:06.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:06.238+0000 7eff16add640 1 --2- 172.21.15.60:0/759534033 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7efef406bde0 0x7efef406e2a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7efefc007fd0 tx=0x7efefc007b40 comp rx=0 tx=0).stop 2024-09-12T02:32:06.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:06.238+0000 7eff16add640 1 -- 172.21.15.60:0/759534033 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff100aeb10 msgr2=0x7eff10155b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:06.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:06.238+0000 7eff16add640 1 --2- 172.21.15.60:0/759534033 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff100aeb10 0x7eff10155b90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7eff0400c430 tx=0x7eff0400c8f0 comp rx=0 tx=0).stop 2024-09-12T02:32:06.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:06.238+0000 7eff16add640 1 -- 172.21.15.60:0/759534033 shutdown_connections 2024-09-12T02:32:06.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:06.238+0000 7eff16add640 1 --2- 172.21.15.60:0/759534033 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7efef406bde0 0x7efef406e2a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:06.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:06.238+0000 7eff16add640 1 --2- 172.21.15.60:0/759534033 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff100c7ef0 0x7eff10154ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:06.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:06.238+0000 7eff16add640 1 --2- 172.21.15.60:0/759534033 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff100c7a90 0x7eff10154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:06.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:06.238+0000 7eff16add640 1 --2- 172.21.15.60:0/759534033 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff100aeb10 0x7eff10155b90 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:06.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:06.238+0000 7eff16add640 1 -- 172.21.15.60:0/759534033 >> 172.21.15.60:0/759534033 conn(0x7eff100c5680 msgr2=0x7eff100a93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:06.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:06.238+0000 7eff16add640 1 -- 172.21.15.60:0/759534033 shutdown_connections 2024-09-12T02:32:06.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:06.238+0000 7eff16add640 1 -- 172.21.15.60:0/759534033 wait complete. 2024-09-12T02:32:09.255 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:32:09.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.364+0000 7f6ff2959640 1 Processor -- start 2024-09-12T02:32:09.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.364+0000 7f6ff2959640 1 -- start start 2024-09-12T02:32:09.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.365+0000 7f6ff2959640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6fec153be0 0x7f6fec15a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:09.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.365+0000 7f6ff2959640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fec0c7070 con 0x7f6fec0c8b10 2024-09-12T02:32:09.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.365+0000 7f6ff2959640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fec06d210 con 0x7f6fec06cd80 2024-09-12T02:32:09.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.365+0000 7f6ff2959640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6fec0c69b0 con 0x7f6fec153be0 2024-09-12T02:32:09.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.365+0000 7f6febfff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f6fec0c8b10 0x7f6fec1534d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50064/0 (socket says 172.21.15.60:50064) 2024-09-12T02:32:09.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.365+0000 7f6febfff640 1 -- 172.21.15.60:0/1355156987 learned_addr learned my addr 172.21.15.60:0/1355156987 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:32:09.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.365+0000 7f6ff0ef6640 1 --2- 172.21.15.60:0/1355156987 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6fec153be0 0x7f6fec15a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:09.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.365+0000 7f6ff0ef6640 1 -- 172.21.15.60:0/1355156987 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6fec153be0 msgr2=0x7f6fec15a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:32:09.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.365+0000 7f6ff0ef6640 1 -- 172.21.15.60:0/1355156987 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6fec153be0 msgr2=0x7f6fec15a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:32:09.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.365+0000 7f6ff0ef6640 1 --2- 172.21.15.60:0/1355156987 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6fec153be0 0x7f6fec15a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:32:09.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.366+0000 7f6ff0ef6640 1 --2- 172.21.15.60:0/1355156987 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6fec153be0 0x7f6fec15a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:32:09.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.366+0000 7f6feaffd640 1 -- 172.21.15.60:0/1355156987 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2028598545 0 0) 0x7f6fec0c7070 con 0x7f6fec0c8b10 2024-09-12T02:32:09.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.366+0000 7f6feaffd640 1 -- 172.21.15.60:0/1355156987 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fd4003520 con 0x7f6fec0c8b10 2024-09-12T02:32:09.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.366+0000 7f6feaffd640 1 -- 172.21.15.60:0/1355156987 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 212566871 0 0) 0x7f6fec06d210 con 0x7f6fec06cd80 2024-09-12T02:32:09.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.366+0000 7f6feaffd640 1 -- 172.21.15.60:0/1355156987 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fec0c7070 con 0x7f6fec06cd80 2024-09-12T02:32:09.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.366+0000 7f6feaffd640 1 -- 172.21.15.60:0/1355156987 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 918623131 0 0) 0x7f6fd4003520 con 0x7f6fec0c8b10 2024-09-12T02:32:09.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.366+0000 7f6feaffd640 1 -- 172.21.15.60:0/1355156987 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6fec153be0 msgr2=0x7f6fec15a4a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:32:09.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.366+0000 7f6feaffd640 1 --2- 172.21.15.60:0/1355156987 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6fec153be0 0x7f6fec15a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:09.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.366+0000 7f6feaffd640 1 -- 172.21.15.60:0/1355156987 >> v1:172.21.15.105:6789/0 conn(0x7f6fec06cd80 legacy=0x7f6fec156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:09.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.366+0000 7f6feaffd640 1 -- 172.21.15.60:0/1355156987 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fec0c6c90 con 0x7f6fec0c8b10 2024-09-12T02:32:09.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.366+0000 7f6feaffd640 1 -- 172.21.15.60:0/1355156987 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7f6fdc001670 con 0x7f6fec0c8b10 2024-09-12T02:32:09.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.366+0000 7f6feaffd640 1 -- 172.21.15.60:0/1355156987 >> v1:172.21.15.60:6789/0 conn(0x7f6fec0c8b10 legacy=0x7f6fec1534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:09.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.366+0000 7f6feaffd640 1 --2- 172.21.15.60:0/1355156987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fd4004c00 0x7f6fd4004fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:09.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.366+0000 7f6feaffd640 1 --2- 172.21.15.60:0/1355156987 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6fec153be0 0x7f6fd40037a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:09.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.366+0000 7f6feaffd640 1 --2- 172.21.15.60:0/1355156987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fd4003ce0 0x7f6fd4004160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:09.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.366+0000 7f6feaffd640 1 -- 172.21.15.60:0/1355156987 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6fec0c69b0 con 0x7f6fd4003ce0 2024-09-12T02:32:09.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.366+0000 7f6feaffd640 1 -- 172.21.15.60:0/1355156987 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd400bb50 con 0x7f6fd4004c00 2024-09-12T02:32:09.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.366+0000 7f6feaffd640 1 -- 172.21.15.60:0/1355156987 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6fd400bd50 con 0x7f6fec153be0 2024-09-12T02:32:09.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.366+0000 7f6ff0ef6640 1 --2- 172.21.15.60:0/1355156987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fd4003ce0 0x7f6fd4004160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:09.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.366+0000 7f6febfff640 1 --2- 172.21.15.60:0/1355156987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fd4004c00 0x7f6fd4004fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:09.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.366+0000 7f6feb7fe640 1 --2- 172.21.15.60:0/1355156987 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6fec153be0 0x7f6fd40037a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:09.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.366+0000 7f6ff0ef6640 1 -- 172.21.15.60:0/1355156987 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6fec153be0 msgr2=0x7f6fd40037a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:09.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.366+0000 7f6ff0ef6640 1 --2- 172.21.15.60:0/1355156987 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6fec153be0 0x7f6fd40037a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:09.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.367+0000 7f6ff0ef6640 1 -- 172.21.15.60:0/1355156987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fd4004c00 msgr2=0x7f6fd4004fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:09.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.367+0000 7f6ff0ef6640 1 --2- 172.21.15.60:0/1355156987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fd4004c00 0x7f6fd4004fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:09.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.367+0000 7f6ff0ef6640 1 -- 172.21.15.60:0/1355156987 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fd4003520 con 0x7f6fd4003ce0 2024-09-12T02:32:09.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.367+0000 7f6febfff640 1 --2- 172.21.15.60:0/1355156987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fd4004c00 0x7f6fd4004fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:32:09.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.367+0000 7f6ff0ef6640 1 --2- 172.21.15.60:0/1355156987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fd4003ce0 0x7f6fd4004160 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4009fd0 tx=0x7f6fd4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a817df7ece5b51f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:09.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.368+0000 7f6feaffd640 1 -- 172.21.15.60:0/1355156987 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe4033070 con 0x7f6fd4003ce0 2024-09-12T02:32:09.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.368+0000 7f6feaffd640 1 -- 172.21.15.60:0/1355156987 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fe402f650 con 0x7f6fd4003ce0 2024-09-12T02:32:09.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.368+0000 7f6feaffd640 1 -- 172.21.15.60:0/1355156987 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe4009bd0 con 0x7f6fd4003ce0 2024-09-12T02:32:09.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.368+0000 7f6ff2959640 1 -- 172.21.15.60:0/1355156987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fd4003ce0 msgr2=0x7f6fd4004160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:09.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.368+0000 7f6ff2959640 1 --2- 172.21.15.60:0/1355156987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fd4003ce0 0x7f6fd4004160 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4009fd0 tx=0x7f6fd4005830 comp rx=0 tx=0).stop 2024-09-12T02:32:09.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.368+0000 7f6ff0ef6640 1 -- 172.21.15.60:0/1355156987 reap_dead start 2024-09-12T02:32:09.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.368+0000 7f6ff2959640 1 -- 172.21.15.60:0/1355156987 shutdown_connections 2024-09-12T02:32:09.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.368+0000 7f6ff2959640 1 -- 172.21.15.60:0/1355156987 >> 172.21.15.60:0/1355156987 conn(0x7f6fec0adb80 msgr2=0x7f6fec0adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:09.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.368+0000 7f6ff2959640 1 -- 172.21.15.60:0/1355156987 shutdown_connections 2024-09-12T02:32:09.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.368+0000 7f6ff2959640 1 -- 172.21.15.60:0/1355156987 wait complete. 2024-09-12T02:32:09.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.370+0000 7f6ff2959640 1 Processor -- start 2024-09-12T02:32:09.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.370+0000 7f6ff2959640 1 -- start start 2024-09-12T02:32:09.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.370+0000 7f6ff2959640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6fd4003ce0 0x7f6fec14f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:09.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.370+0000 7f6ff2959640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fec0b19b0 0x7f6fec0afc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:09.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.371+0000 7f6ff2959640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fec0b0360 0x7f6fec1eecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:09.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.371+0000 7f6ff2959640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6fec0c9070 con 0x7f6fec0b0360 2024-09-12T02:32:09.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.371+0000 7f6ff2959640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6fec0c8ef0 con 0x7f6fec0b19b0 2024-09-12T02:32:09.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.371+0000 7f6ff2959640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6fec15a4a0 con 0x7f6fd4003ce0 2024-09-12T02:32:09.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.371+0000 7f6ff0ef6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fec0b0360 0x7f6fec1eecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:09.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.371+0000 7f6febfff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6fd4003ce0 0x7f6fec14f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:09.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.371+0000 7f6ff0ef6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fec0b0360 0x7f6fec1eecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34222/0 (socket says 172.21.15.60:34222) 2024-09-12T02:32:09.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.371+0000 7f6ff0ef6640 1 -- 172.21.15.60:0/2595257501 learned_addr learned my addr 172.21.15.60:0/2595257501 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:32:09.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.371+0000 7f6feb7fe640 1 --2- 172.21.15.60:0/2595257501 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fec0b19b0 0x7f6fec0afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:09.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.371+0000 7f6febfff640 1 -- 172.21.15.60:0/2595257501 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6fd4003ce0 msgr2=0x7f6fec14f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-12T02:32:09.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.371+0000 7f6febfff640 1 -- 172.21.15.60:0/2595257501 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6fd4003ce0 msgr2=0x7f6fec14f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:32:09.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.371+0000 7f6febfff640 1 --2- 172.21.15.60:0/2595257501 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6fd4003ce0 0x7f6fec14f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:32:09.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.371+0000 7f6febfff640 1 --2- 172.21.15.60:0/2595257501 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6fd4003ce0 0x7f6fec14f350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:32:09.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.371+0000 7f6ff0ef6640 1 -- 172.21.15.60:0/2595257501 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6fd4003ce0 msgr2=0x7f6fec14f350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:32:09.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.371+0000 7f6ff0ef6640 1 --2- 172.21.15.60:0/2595257501 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6fd4003ce0 0x7f6fec14f350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:09.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.371+0000 7f6ff0ef6640 1 -- 172.21.15.60:0/2595257501 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fec0b19b0 msgr2=0x7f6fec0afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:09.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.371+0000 7f6ff0ef6640 1 --2- 172.21.15.60:0/2595257501 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fec0b19b0 0x7f6fec0afc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:09.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.371+0000 7f6ff0ef6640 1 -- 172.21.15.60:0/2595257501 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fec0c5df0 con 0x7f6fec0b0360 2024-09-12T02:32:09.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.371+0000 7f6feb7fe640 1 --2- 172.21.15.60:0/2595257501 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fec0b19b0 0x7f6fec0afc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:32:09.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.371+0000 7f6ff0ef6640 1 --2- 172.21.15.60:0/2595257501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fec0b0360 0x7f6fec1eecf0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4007420 tx=0x7f6fe4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:09.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.371+0000 7f6fe8ff9640 1 -- 172.21.15.60:0/2595257501 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe4033040 con 0x7f6fec0b0360 2024-09-12T02:32:09.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.371+0000 7f6fe8ff9640 1 -- 172.21.15.60:0/2595257501 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fe402fe40 con 0x7f6fec0b0360 2024-09-12T02:32:09.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.371+0000 7f6ff2959640 1 -- 172.21.15.60:0/2595257501 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fec0b0140 con 0x7f6fec0b0360 2024-09-12T02:32:09.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.371+0000 7f6fe8ff9640 1 -- 172.21.15.60:0/2595257501 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc007ce0 con 0x7f6fec0b0360 2024-09-12T02:32:09.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.372+0000 7f6ff2959640 1 -- 172.21.15.60:0/2595257501 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fec0c6090 con 0x7f6fec0b0360 2024-09-12T02:32:09.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.373+0000 7f6ff2959640 1 -- 172.21.15.60:0/2595257501 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fec15a830 con 0x7f6fec0b0360 2024-09-12T02:32:09.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.373+0000 7f6fe8ff9640 1 -- 172.21.15.60:0/2595257501 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6fe4036070 con 0x7f6fec0b0360 2024-09-12T02:32:09.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.374+0000 7f6fe8ff9640 1 --2- 172.21.15.60:0/2595257501 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f6fd806be30 0x7f6fd806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:09.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.374+0000 7f6fe8ff9640 1 -- 172.21.15.60:0/2595257501 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f6fe40ab6f0 con 0x7f6fec0b0360 2024-09-12T02:32:09.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.374+0000 7f6febfff640 1 --2- 172.21.15.60:0/2595257501 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f6fd806be30 0x7f6fd806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:09.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.374+0000 7f6febfff640 1 --2- 172.21.15.60:0/2595257501 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f6fd806be30 0x7f6fd806e2f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc000ff0 tx=0x7f6fdc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:09.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.379+0000 7f6fe8ff9640 1 -- 172.21.15.60:0/2595257501 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6fe4079d90 con 0x7f6fec0b0360 2024-09-12T02:32:09.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.692+0000 7f6ff2959640 1 -- 172.21.15.60:0/2595257501 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6fec0aee20 con 0x7f6fec0b0360 2024-09-12T02:32:09.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.692+0000 7f6fe8ff9640 1 -- 172.21.15.60:0/2595257501 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1559 (secure 0 0 0) 0x7f6fe4079690 con 0x7f6fec0b0360 2024-09-12T02:32:09.693 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":80,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:32:09.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.694+0000 7f6ff2959640 1 -- 172.21.15.60:0/2595257501 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f6fd806be30 msgr2=0x7f6fd806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:09.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.694+0000 7f6ff2959640 1 --2- 172.21.15.60:0/2595257501 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f6fd806be30 0x7f6fd806e2f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc000ff0 tx=0x7f6fdc009040 comp rx=0 tx=0).stop 2024-09-12T02:32:09.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.694+0000 7f6ff2959640 1 -- 172.21.15.60:0/2595257501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fec0b0360 msgr2=0x7f6fec1eecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:09.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.694+0000 7f6ff2959640 1 --2- 172.21.15.60:0/2595257501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fec0b0360 0x7f6fec1eecf0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4007420 tx=0x7f6fe4004ab0 comp rx=0 tx=0).stop 2024-09-12T02:32:09.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.695+0000 7f6ff2959640 1 -- 172.21.15.60:0/2595257501 shutdown_connections 2024-09-12T02:32:09.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.695+0000 7f6ff2959640 1 --2- 172.21.15.60:0/2595257501 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f6fd806be30 0x7f6fd806e2f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:09.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.695+0000 7f6ff2959640 1 --2- 172.21.15.60:0/2595257501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fec0b0360 0x7f6fec1eecf0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:09.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.695+0000 7f6ff2959640 1 --2- 172.21.15.60:0/2595257501 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fec0b19b0 0x7f6fec0afc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:09.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.695+0000 7f6ff2959640 1 --2- 172.21.15.60:0/2595257501 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6fd4003ce0 0x7f6fec14f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:09.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.695+0000 7f6ff2959640 1 -- 172.21.15.60:0/2595257501 >> 172.21.15.60:0/2595257501 conn(0x7f6fec0adb80 msgr2=0x7f6fec0aca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:09.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.695+0000 7f6ff2959640 1 -- 172.21.15.60:0/2595257501 shutdown_connections 2024-09-12T02:32:09.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:09.695+0000 7f6ff2959640 1 -- 172.21.15.60:0/2595257501 wait complete. 2024-09-12T02:32:12.706 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:32:12.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.827+0000 7fb9a1f6d640 1 Processor -- start 2024-09-12T02:32:12.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.827+0000 7fb9a1f6d640 1 -- start start 2024-09-12T02:32:12.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.828+0000 7fb9a1f6d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb99c153be0 0x7fb99c15a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:12.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.828+0000 7fb9a1f6d640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb99c0c7070 con 0x7fb99c0c8b10 2024-09-12T02:32:12.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.828+0000 7fb9a1f6d640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb99c06d210 con 0x7fb99c06cd80 2024-09-12T02:32:12.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.828+0000 7fb9a1f6d640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fb99c0c69b0 con 0x7fb99c153be0 2024-09-12T02:32:12.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.828+0000 7fb99bfff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb99c153be0 0x7fb99c15a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:12.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.828+0000 7fb99b7fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb99c0c8b10 0x7fb99c1534d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55968/0 (socket says 172.21.15.60:55968) 2024-09-12T02:32:12.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.828+0000 7fb99b7fe640 1 -- 172.21.15.60:0/4149504357 learned_addr learned my addr 172.21.15.60:0/4149504357 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:32:12.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.828+0000 7fb99bfff640 1 -- 172.21.15.60:0/4149504357 >> v1:172.21.15.105:6789/0 conn(0x7fb99c06cd80 legacy=0x7fb99c156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:12.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.828+0000 7fb99bfff640 1 -- 172.21.15.60:0/4149504357 >> v1:172.21.15.60:6789/0 conn(0x7fb99c0c8b10 legacy=0x7fb99c1534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:12.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.828+0000 7fb99a7fc640 1 -- 172.21.15.60:0/4149504357 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4136206939 0 0) 0x7fb99c06d210 con 0x7fb99c06cd80 2024-09-12T02:32:12.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.828+0000 7fb99bfff640 1 -- 172.21.15.60:0/4149504357 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb99c0c6c90 con 0x7fb99c153be0 2024-09-12T02:32:12.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.829+0000 7fb99bfff640 1 --2- 172.21.15.60:0/4149504357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb99c153be0 0x7fb99c15a4a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb994009d90 tx=0x7fb99402a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1582cb4825d4f287 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:12.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.829+0000 7fb99a7fc640 1 -- 172.21.15.60:0/4149504357 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb994007740 con 0x7fb99c153be0 2024-09-12T02:32:12.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.829+0000 7fb99a7fc640 1 -- 172.21.15.60:0/4149504357 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9940078e0 con 0x7fb99c153be0 2024-09-12T02:32:12.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.829+0000 7fb99a7fc640 1 -- 172.21.15.60:0/4149504357 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb994007cb0 con 0x7fb99c153be0 2024-09-12T02:32:12.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.830+0000 7fb9a1f6d640 1 -- 172.21.15.60:0/4149504357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb99c153be0 msgr2=0x7fb99c15a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:12.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.830+0000 7fb9a1f6d640 1 --2- 172.21.15.60:0/4149504357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb99c153be0 0x7fb99c15a4a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb994009d90 tx=0x7fb99402a560 comp rx=0 tx=0).stop 2024-09-12T02:32:12.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.830+0000 7fb9a1f6d640 1 -- 172.21.15.60:0/4149504357 shutdown_connections 2024-09-12T02:32:12.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.830+0000 7fb9a1f6d640 1 --2- 172.21.15.60:0/4149504357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb99c153be0 0x7fb99c15a4a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:12.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.830+0000 7fb9a1f6d640 1 -- 172.21.15.60:0/4149504357 >> 172.21.15.60:0/4149504357 conn(0x7fb99c0adb80 msgr2=0x7fb99c0adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:12.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.830+0000 7fb9a1f6d640 1 -- 172.21.15.60:0/4149504357 shutdown_connections 2024-09-12T02:32:12.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.830+0000 7fb9a1f6d640 1 -- 172.21.15.60:0/4149504357 wait complete. 2024-09-12T02:32:12.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.831+0000 7fb9a1f6d640 1 Processor -- start 2024-09-12T02:32:12.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.831+0000 7fb9a1f6d640 1 -- start start 2024-09-12T02:32:12.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.832+0000 7fb9a1f6d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb99c0c8b10 0x7fb99c158790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:12.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.832+0000 7fb9a1f6d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb99c153be0 0x7fb99c0b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:12.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.832+0000 7fb9a1f6d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb99c15a6a0 0x7fb99c1ec190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:12.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.832+0000 7fb9a1f6d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb99c0c9070 con 0x7fb99c153be0 2024-09-12T02:32:12.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.832+0000 7fb9a1f6d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb99c0c8ef0 con 0x7fb99c0c8b10 2024-09-12T02:32:12.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.832+0000 7fb9a1f6d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb99c156d70 con 0x7fb99c15a6a0 2024-09-12T02:32:12.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.832+0000 7fb99affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb99c153be0 0x7fb99c0b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:12.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.832+0000 7fb99bfff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb99c15a6a0 0x7fb99c1ec190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:12.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.832+0000 7fb99affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb99c153be0 0x7fb99c0b02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46644/0 (socket says 172.21.15.60:46644) 2024-09-12T02:32:12.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.832+0000 7fb99affd640 1 -- 172.21.15.60:0/1284749041 learned_addr learned my addr 172.21.15.60:0/1284749041 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:32:12.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.832+0000 7fb99b7fe640 1 --2- 172.21.15.60:0/1284749041 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb99c0c8b10 0x7fb99c158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:12.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.832+0000 7fb99bfff640 1 -- 172.21.15.60:0/1284749041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb99c15a6a0 msgr2=0x7fb99c1ec190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-12T02:32:12.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.832+0000 7fb99bfff640 1 -- 172.21.15.60:0/1284749041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb99c15a6a0 msgr2=0x7fb99c1ec190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:32:12.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.832+0000 7fb99bfff640 1 --2- 172.21.15.60:0/1284749041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb99c15a6a0 0x7fb99c1ec190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:32:12.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.832+0000 7fb99bfff640 1 --2- 172.21.15.60:0/1284749041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb99c15a6a0 0x7fb99c1ec190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:32:12.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.833+0000 7fb99affd640 1 -- 172.21.15.60:0/1284749041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb99c15a6a0 msgr2=0x7fb99c1ec190 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:32:12.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.833+0000 7fb99affd640 1 --2- 172.21.15.60:0/1284749041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb99c15a6a0 0x7fb99c1ec190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:12.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.833+0000 7fb99affd640 1 -- 172.21.15.60:0/1284749041 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb99c0c8b10 msgr2=0x7fb99c158790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:12.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.833+0000 7fb99affd640 1 --2- 172.21.15.60:0/1284749041 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb99c0c8b10 0x7fb99c158790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:12.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.833+0000 7fb99affd640 1 -- 172.21.15.60:0/1284749041 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb99c159c30 con 0x7fb99c153be0 2024-09-12T02:32:12.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.833+0000 7fb99b7fe640 1 --2- 172.21.15.60:0/1284749041 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb99c0c8b10 0x7fb99c158790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:32:12.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.833+0000 7fb99affd640 1 --2- 172.21.15.60:0/1284749041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb99c153be0 0x7fb99c0b02b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb99000c4b0 tx=0x7fb99000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:12.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.833+0000 7fb983fff640 1 -- 172.21.15.60:0/1284749041 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb990017070 con 0x7fb99c153be0 2024-09-12T02:32:12.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.833+0000 7fb983fff640 1 -- 172.21.15.60:0/1284749041 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb990005480 con 0x7fb99c153be0 2024-09-12T02:32:12.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.833+0000 7fb983fff640 1 -- 172.21.15.60:0/1284749041 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb990003830 con 0x7fb99c153be0 2024-09-12T02:32:12.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.833+0000 7fb9a1f6d640 1 -- 172.21.15.60:0/1284749041 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb99c159f10 con 0x7fb99c153be0 2024-09-12T02:32:12.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.833+0000 7fb9a1f6d640 1 -- 172.21.15.60:0/1284749041 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb99c1eb990 con 0x7fb99c153be0 2024-09-12T02:32:12.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.834+0000 7fb9a1f6d640 1 -- 172.21.15.60:0/1284749041 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb99c0c9d90 con 0x7fb99c153be0 2024-09-12T02:32:12.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.835+0000 7fb983fff640 1 -- 172.21.15.60:0/1284749041 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb99001a070 con 0x7fb99c153be0 2024-09-12T02:32:12.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.836+0000 7fb983fff640 1 --2- 172.21.15.60:0/1284749041 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb98806be30 0x7fb98806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:12.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.836+0000 7fb983fff640 1 -- 172.21.15.60:0/1284749041 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fb99008a540 con 0x7fb99c153be0 2024-09-12T02:32:12.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.836+0000 7fb99b7fe640 1 --2- 172.21.15.60:0/1284749041 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb98806be30 0x7fb98806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:12.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.836+0000 7fb99b7fe640 1 --2- 172.21.15.60:0/1284749041 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb98806be30 0x7fb98806e2f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb99c0b2350 tx=0x7fb98c000bc0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:12.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:12.840+0000 7fb983fff640 1 -- 172.21.15.60:0/1284749041 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb990058500 con 0x7fb99c153be0 2024-09-12T02:32:13.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.135+0000 7fb9a1f6d640 1 -- 172.21.15.60:0/1284749041 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb99c153830 con 0x7fb99c153be0 2024-09-12T02:32:13.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.136+0000 7fb983fff640 1 -- 172.21.15.60:0/1284749041 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7fb99005c800 con 0x7fb99c153be0 2024-09-12T02:32:13.137 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":82,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:32:13.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.139+0000 7fb9a1f6d640 1 -- 172.21.15.60:0/1284749041 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb98806be30 msgr2=0x7fb98806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:13.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.139+0000 7fb9a1f6d640 1 --2- 172.21.15.60:0/1284749041 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb98806be30 0x7fb98806e2f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb99c0b2350 tx=0x7fb98c000bc0 comp rx=0 tx=0).stop 2024-09-12T02:32:13.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.139+0000 7fb9a1f6d640 1 -- 172.21.15.60:0/1284749041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb99c153be0 msgr2=0x7fb99c0b02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:13.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.139+0000 7fb9a1f6d640 1 --2- 172.21.15.60:0/1284749041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb99c153be0 0x7fb99c0b02b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb99000c4b0 tx=0x7fb99000c970 comp rx=0 tx=0).stop 2024-09-12T02:32:13.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.139+0000 7fb9a1f6d640 1 -- 172.21.15.60:0/1284749041 shutdown_connections 2024-09-12T02:32:13.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.139+0000 7fb9a1f6d640 1 --2- 172.21.15.60:0/1284749041 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb98806be30 0x7fb98806e2f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:13.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.139+0000 7fb9a1f6d640 1 --2- 172.21.15.60:0/1284749041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb99c15a6a0 0x7fb99c1ec190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:13.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.139+0000 7fb9a1f6d640 1 --2- 172.21.15.60:0/1284749041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb99c153be0 0x7fb99c0b02b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:13.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.139+0000 7fb9a1f6d640 1 --2- 172.21.15.60:0/1284749041 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb99c0c8b10 0x7fb99c158790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:13.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.139+0000 7fb9a1f6d640 1 -- 172.21.15.60:0/1284749041 >> 172.21.15.60:0/1284749041 conn(0x7fb99c0adb80 msgr2=0x7fb99c0cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:13.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.139+0000 7fb9a1f6d640 1 -- 172.21.15.60:0/1284749041 shutdown_connections 2024-09-12T02:32:13.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.139+0000 7fb9a1f6d640 1 -- 172.21.15.60:0/1284749041 wait complete. 2024-09-12T02:32:13.153 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-12T02:32:13.153 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-12T02:32:13.153 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-12T02:32:13.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.264+0000 7f921556d640 1 Processor -- start 2024-09-12T02:32:13.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.264+0000 7f921556d640 1 -- start start 2024-09-12T02:32:13.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.265+0000 7f921556d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f92100c3560 0x7f92100c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:13.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.265+0000 7f921556d640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f92100c7fb0 0x7f9210160bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:13.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.265+0000 7f921556d640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92100c8460 con 0x7f9210153be0 2024-09-12T02:32:13.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.265+0000 7f921556d640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f9210156db0 con 0x7f92100c7fb0 2024-09-12T02:32:13.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.265+0000 7f921556d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9210153fc0 con 0x7f92100c3560 2024-09-12T02:32:13.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.265+0000 7f920effd640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f9210153be0 0x7f92100ac720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55984/0 (socket says 172.21.15.60:55984) 2024-09-12T02:32:13.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.265+0000 7f920effd640 1 -- 172.21.15.60:0/2193299343 learned_addr learned my addr 172.21.15.60:0/2193299343 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:32:13.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.265+0000 7f920e7fc640 1 --2- 172.21.15.60:0/2193299343 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f92100c3560 0x7f92100c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:13.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.265+0000 7f920f7fe640 1 --2- 172.21.15.60:0/2193299343 >> v2:172.21.15.105:3300/0 conn(0x7f92100c7fb0 0x7f9210160bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:13.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.265+0000 7f920e7fc640 1 -- 172.21.15.60:0/2193299343 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f92100c3560 msgr2=0x7f92100c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:32:13.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.265+0000 7f920e7fc640 1 -- 172.21.15.60:0/2193299343 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f92100c3560 msgr2=0x7f92100c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:32:13.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.265+0000 7f920e7fc640 1 --2- 172.21.15.60:0/2193299343 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f92100c3560 0x7f92100c7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:32:13.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.265+0000 7f920e7fc640 1 --2- 172.21.15.60:0/2193299343 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f92100c3560 0x7f92100c7a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:32:13.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.265+0000 7f920dffb640 1 -- 172.21.15.60:0/2193299343 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1239445914 0 0) 0x7f92100c8460 con 0x7f9210153be0 2024-09-12T02:32:13.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.265+0000 7f920dffb640 1 -- 172.21.15.60:0/2193299343 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91f8003520 con 0x7f9210153be0 2024-09-12T02:32:13.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.266+0000 7f920f7fe640 1 -- 172.21.15.60:0/2193299343 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f92100c3560 msgr2=0x7f92100c7a70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:32:13.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.266+0000 7f920f7fe640 1 --2- 172.21.15.60:0/2193299343 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f92100c3560 0x7f92100c7a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:13.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.266+0000 7f920f7fe640 1 -- 172.21.15.60:0/2193299343 >> v1:172.21.15.60:6789/0 conn(0x7f9210153be0 legacy=0x7f92100ac720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:13.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.266+0000 7f920f7fe640 1 -- 172.21.15.60:0/2193299343 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92100a8030 con 0x7f92100c7fb0 2024-09-12T02:32:13.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.266+0000 7f920f7fe640 1 --2- 172.21.15.60:0/2193299343 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92100c7fb0 0x7f9210160bd0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9208009d90 tx=0x7f920802a530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cabdcb18b9cd9f08 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:13.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.266+0000 7f920dffb640 1 -- 172.21.15.60:0/2193299343 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9208007740 con 0x7f92100c7fb0 2024-09-12T02:32:13.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.267+0000 7f920dffb640 1 -- 172.21.15.60:0/2193299343 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92080078e0 con 0x7f92100c7fb0 2024-09-12T02:32:13.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.267+0000 7f920dffb640 1 -- 172.21.15.60:0/2193299343 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9208007c90 con 0x7f92100c7fb0 2024-09-12T02:32:13.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.267+0000 7f921556d640 1 -- 172.21.15.60:0/2193299343 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92100c7fb0 msgr2=0x7f9210160bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:13.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.267+0000 7f921556d640 1 --2- 172.21.15.60:0/2193299343 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92100c7fb0 0x7f9210160bd0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9208009d90 tx=0x7f920802a530 comp rx=0 tx=0).stop 2024-09-12T02:32:13.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.267+0000 7f921556d640 1 -- 172.21.15.60:0/2193299343 shutdown_connections 2024-09-12T02:32:13.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.267+0000 7f921556d640 1 --2- 172.21.15.60:0/2193299343 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92100c7fb0 0x7f9210160bd0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:13.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.267+0000 7f921556d640 1 --2- 172.21.15.60:0/2193299343 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f92100c3560 0x7f92100c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:13.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.267+0000 7f921556d640 1 -- 172.21.15.60:0/2193299343 >> 172.21.15.60:0/2193299343 conn(0x7f92100c5660 msgr2=0x7f92100c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:13.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.267+0000 7f921556d640 1 -- 172.21.15.60:0/2193299343 shutdown_connections 2024-09-12T02:32:13.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.267+0000 7f921556d640 1 -- 172.21.15.60:0/2193299343 wait complete. 2024-09-12T02:32:13.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.269+0000 7f921556d640 1 Processor -- start 2024-09-12T02:32:13.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.269+0000 7f921556d640 1 -- start start 2024-09-12T02:32:13.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.270+0000 7f921556d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92100c3560 0x7f92101554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:13.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.270+0000 7f921556d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92100c7fb0 0x7f92101ebe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:13.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.270+0000 7f921556d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9210153be0 0x7f92101ec3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:13.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.270+0000 7f921556d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f92100a83e0 con 0x7f92100c7fb0 2024-09-12T02:32:13.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.270+0000 7f921556d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9210157240 con 0x7f92100c3560 2024-09-12T02:32:13.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.270+0000 7f921556d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f92100ac370 con 0x7f9210153be0 2024-09-12T02:32:13.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.270+0000 7f920e7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92100c7fb0 0x7f92101ebe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:13.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.270+0000 7f920e7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92100c7fb0 0x7f92101ebe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46658/0 (socket says 172.21.15.60:46658) 2024-09-12T02:32:13.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.270+0000 7f920e7fc640 1 -- 172.21.15.60:0/866702631 learned_addr learned my addr 172.21.15.60:0/866702631 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:32:13.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.270+0000 7f920effd640 1 --2- 172.21.15.60:0/866702631 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92100c3560 0x7f92101554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:13.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.270+0000 7f920f7fe640 1 --2- 172.21.15.60:0/866702631 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9210153be0 0x7f92101ec3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:13.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.270+0000 7f920f7fe640 1 -- 172.21.15.60:0/866702631 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9210153be0 msgr2=0x7f92101ec3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-12T02:32:13.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.270+0000 7f920f7fe640 1 -- 172.21.15.60:0/866702631 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9210153be0 msgr2=0x7f92101ec3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:32:13.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.270+0000 7f920f7fe640 1 --2- 172.21.15.60:0/866702631 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9210153be0 0x7f92101ec3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:32:13.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.270+0000 7f920f7fe640 1 --2- 172.21.15.60:0/866702631 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9210153be0 0x7f92101ec3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:32:13.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.270+0000 7f920effd640 1 -- 172.21.15.60:0/866702631 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9210153be0 msgr2=0x7f92101ec3d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:32:13.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.270+0000 7f920effd640 1 --2- 172.21.15.60:0/866702631 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9210153be0 0x7f92101ec3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:13.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.270+0000 7f920effd640 1 -- 172.21.15.60:0/866702631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92100c7fb0 msgr2=0x7f92101ebe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:13.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.270+0000 7f920effd640 1 --2- 172.21.15.60:0/866702631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92100c7fb0 0x7f92101ebe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:13.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.270+0000 7f920effd640 1 -- 172.21.15.60:0/866702631 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92100bfdc0 con 0x7f92100c3560 2024-09-12T02:32:13.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.271+0000 7f920e7fc640 1 --2- 172.21.15.60:0/866702631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92100c7fb0 0x7f92101ebe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:32:13.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.271+0000 7f920effd640 1 --2- 172.21.15.60:0/866702631 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92100c3560 0x7f92101554d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f920000c390 tx=0x7f9200001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:13.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.271+0000 7f91f77fe640 1 -- 172.21.15.60:0/866702631 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9200017070 con 0x7f92100c3560 2024-09-12T02:32:13.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.271+0000 7f91f77fe640 1 -- 172.21.15.60:0/866702631 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9200005ce0 con 0x7f92100c3560 2024-09-12T02:32:13.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.271+0000 7f921556d640 1 -- 172.21.15.60:0/866702631 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92101e0700 con 0x7f92100c3560 2024-09-12T02:32:13.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.271+0000 7f91f77fe640 1 -- 172.21.15.60:0/866702631 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92000072f0 con 0x7f92100c3560 2024-09-12T02:32:13.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.271+0000 7f921556d640 1 -- 172.21.15.60:0/866702631 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92101efa60 con 0x7f92100c3560 2024-09-12T02:32:13.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.272+0000 7f921556d640 1 --2- 172.21.15.60:0/866702631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9210153370 0x7f92101efc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:13.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.272+0000 7f921556d640 1 -- 172.21.15.60:0/866702631 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f92100c63f0 con 0x7f9210153370 2024-09-12T02:32:13.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.272+0000 7f920e7fc640 1 --2- 172.21.15.60:0/866702631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9210153370 0x7f92101efc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:13.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.272+0000 7f920e7fc640 1 -- 172.21.15.60:0/866702631 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9210070560 con 0x7f9210153370 2024-09-12T02:32:13.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.272+0000 7f920e7fc640 1 --2- 172.21.15.60:0/866702631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9210153370 0x7f92101efc60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f92100c3530 tx=0x7f920400e5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:13.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.273+0000 7f91f77fe640 1 -- 172.21.15.60:0/866702631 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9204018070 con 0x7f9210153370 2024-09-12T02:32:13.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.273+0000 7f91f77fe640 1 -- 172.21.15.60:0/866702631 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f920001a070 con 0x7f92100c3560 2024-09-12T02:32:13.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.273+0000 7f91f77fe640 1 --2- 172.21.15.60:0/866702631 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f91fc06bd60 0x7f91fc06e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:13.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.273+0000 7f91f77fe640 1 -- 172.21.15.60:0/866702631 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f920008a330 con 0x7f92100c3560 2024-09-12T02:32:13.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.273+0000 7f920f7fe640 1 --2- 172.21.15.60:0/866702631 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f91fc06bd60 0x7f91fc06e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:13.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.273+0000 7f91f77fe640 1 -- 172.21.15.60:0/866702631 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f9204010e40 con 0x7f9210153370 2024-09-12T02:32:13.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.273+0000 7f91f77fe640 1 -- 172.21.15.60:0/866702631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9210153370 msgr2=0x7f92101efc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:13.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.273+0000 7f91f77fe640 1 --2- 172.21.15.60:0/866702631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9210153370 0x7f92101efc60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f92100c3530 tx=0x7f920400e5a0 comp rx=0 tx=0).stop 2024-09-12T02:32:13.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.274+0000 7f91f77fe640 1 -- 172.21.15.60:0/866702631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9210153370 msgr2=0x7f92101efc60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:32:13.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.274+0000 7f91f77fe640 1 --2- 172.21.15.60:0/866702631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9210153370 0x7f92101efc60 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:13.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.274+0000 7f920f7fe640 1 --2- 172.21.15.60:0/866702631 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f91fc06bd60 0x7f91fc06e220 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9208034000 tx=0x7f920802f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:13.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.280+0000 7f921556d640 1 --2- 172.21.15.60:0/866702631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92100bde20 0x7f92100be230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:13.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.280+0000 7f921556d640 1 -- 172.21.15.60:0/866702631 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f92100acf40 con 0x7f92100bde20 2024-09-12T02:32:13.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.280+0000 7f920e7fc640 1 --2- 172.21.15.60:0/866702631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92100bde20 0x7f92100be230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:13.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.280+0000 7f920e7fc640 1 -- 172.21.15.60:0/866702631 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9210073b80 con 0x7f92100bde20 2024-09-12T02:32:13.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.280+0000 7f920e7fc640 1 --2- 172.21.15.60:0/866702631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92100bde20 0x7f92100be230 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9210075de0 tx=0x7f92040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:13.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.281+0000 7f91f77fe640 1 -- 172.21.15.60:0/866702631 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f920402b020 con 0x7f92100bde20 2024-09-12T02:32:13.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.281+0000 7f91f77fe640 1 -- 172.21.15.60:0/866702631 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4885 (secure 0 0 0) 0x7f9204014b10 con 0x7f92100bde20 2024-09-12T02:32:13.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.281+0000 7f91f77fe640 1 -- 172.21.15.60:0/866702631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92100bde20 msgr2=0x7f92100be230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:13.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.281+0000 7f91f77fe640 1 --2- 172.21.15.60:0/866702631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92100bde20 0x7f92100be230 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9210075de0 tx=0x7f92040046c0 comp rx=0 tx=0).stop 2024-09-12T02:32:13.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.281+0000 7f91f77fe640 1 -- 172.21.15.60:0/866702631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92100bde20 msgr2=0x7f92100be230 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:32:13.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.281+0000 7f91f77fe640 1 --2- 172.21.15.60:0/866702631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92100bde20 0x7f92100be230 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:13.284 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:32:13.284 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:32:13.284 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:32:13.284 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:32:13.284 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 82, 2024-09-12T02:32:13.284 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 196385, 2024-09-12T02:32:13.284 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:32:13.284 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:32:13.284 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:32:13.284 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:32:13.285 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:32:13.285 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 1, 2024-09-12T02:32:13.285 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:32:13.285 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:32:13.285 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:32:13.285 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:32:13.285 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:32:13.285 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:32:13.285 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:32:13.285 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:32:13.285 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:32:13.285 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:32:13.286 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:32:13.286 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:32:13.286 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:32:13.286 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:32:13.286 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:32:13.286 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:32:13.286 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:32:13.287 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:32:13.287 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:32:13.287 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:32:13.287 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:32:13.287 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:32:13.287 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:32:13.287 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:32:13.287 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:32:13.288 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:32:13.288 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:32:13.288 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:32:13.288 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:13.288 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:13.288 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:32:13.288 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:32:13.288 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:32:13.288 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:32:13.288 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:32:13.288 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:32:13.288 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:32:13.288 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:32:13.289 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:32:13.289 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:32:13.289 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:32:13.289 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:32:13.289 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:32:13.289 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:32:13.289 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:32:13.289 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:32:13.289 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:32:13.289 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:32:13.289 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:32:13.289 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:32:13.289 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:32:13.290 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:32:13.290 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:32:13.290 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:32:13.290 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:32:13.290 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:32:13.290 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:32:13.290 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:32:13.290 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:32:13.290 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:32:13.290 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:13.290 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:32:13.290 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:13.290 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:32:13.291 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:32:13.291 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:32:13.291 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:32:13.291 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:13.291 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:32:13.291 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:32:13.291 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:13.291 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:13.291 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:13.291 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:32:13.291 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:32:13.291 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:13.291 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:13.292 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:13.292 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:13.292 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:32:13.292 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:32:13.292 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:32:13.292 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:32:13.292 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:32:13.292 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:13.292 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:13.292 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:32:13.292 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:32:13.292 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:32:13.293 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:32:13.293 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:13.293 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:32:13.293 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:32:13.293 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:13.293 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:13.293 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:13.293 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:32:13.293 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:32:13.293 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:13.293 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:13.294 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:13.294 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:13.294 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:32:13.294 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:32:13.294 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:32:13.294 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:32:13.294 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:32:13.294 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:13.294 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:13.294 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:32:13.294 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:32:13.294 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:32:13.294 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:32:13.294 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:13.295 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:32:13.295 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:32:13.295 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:13.295 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:13.295 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:13.295 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:32:13.295 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:32:13.295 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:13.295 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:13.295 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:13.295 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:13.295 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:32:13.295 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:32:13.295 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:32:13.295 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:32:13.296 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:32:13.296 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:13.296 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:13.296 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:13.296 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:32:13.296 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:32:13.296 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:13.296 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:32:13.296 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:32:13.296 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:32:13.296 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:13.296 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:32:13.297 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:32:13.297 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:13.297 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:32:13.297 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:32:13.297 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:32:13.297 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:13.297 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:32:13.297 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:32:13.297 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:13.297 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:32:13.297 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:32:13.297 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:32:13.297 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:13.298 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:32:13.298 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:32:13.298 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:13.298 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:32:13.298 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:32:13.298 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:32:13.298 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:13.298 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:13.298 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:13.298 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:32:13.298 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:32:13.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.281+0000 7f921556d640 1 -- 172.21.15.60:0/866702631 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f91fc06bd60 msgr2=0x7f91fc06e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:13.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.281+0000 7f921556d640 1 --2- 172.21.15.60:0/866702631 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f91fc06bd60 0x7f91fc06e220 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9208034000 tx=0x7f920802f000 comp rx=0 tx=0).stop 2024-09-12T02:32:13.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.281+0000 7f921556d640 1 -- 172.21.15.60:0/866702631 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92100c3560 msgr2=0x7f92101554d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:13.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.281+0000 7f921556d640 1 --2- 172.21.15.60:0/866702631 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92100c3560 0x7f92101554d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f920000c390 tx=0x7f9200001e70 comp rx=0 tx=0).stop 2024-09-12T02:32:13.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.281+0000 7f920f7fe640 1 -- 172.21.15.60:0/866702631 reap_dead start 2024-09-12T02:32:13.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.281+0000 7f920f7fe640 1 -- 172.21.15.60:0/866702631 reap_dead start 2024-09-12T02:32:13.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.281+0000 7f921556d640 1 -- 172.21.15.60:0/866702631 shutdown_connections 2024-09-12T02:32:13.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.281+0000 7f921556d640 1 -- 172.21.15.60:0/866702631 >> 172.21.15.60:0/866702631 conn(0x7f92100c5660 msgr2=0x7f92100c77f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:13.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.281+0000 7f921556d640 1 -- 172.21.15.60:0/866702631 shutdown_connections 2024-09-12T02:32:13.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.281+0000 7f921556d640 1 -- 172.21.15.60:0/866702631 wait complete. 2024-09-12T02:32:13.301 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:32:13.301 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-12T02:32:13.301 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-12T02:32:13.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.420+0000 7f1aa20ac640 1 Processor -- start 2024-09-12T02:32:13.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.420+0000 7f1aa20ac640 1 -- start start 2024-09-12T02:32:13.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.421+0000 7f1aa20ac640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a9c0ca390 0x7f1a9c161c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:13.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.421+0000 7f1aa20ac640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a9c15a7c0 con 0x7f1a9c150480 2024-09-12T02:32:13.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.421+0000 7f1aa20ac640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a9c159a00 con 0x7f1a9c06c650 2024-09-12T02:32:13.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.421+0000 7f1aa20ac640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1a9c06c240 con 0x7f1a9c0ca390 2024-09-12T02:32:13.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.421+0000 7f1a9b7fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f1a9c150480 0x7f1a9c0c7a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:56000/0 (socket says 172.21.15.60:56000) 2024-09-12T02:32:13.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.421+0000 7f1a9b7fe640 1 -- 172.21.15.60:0/936410976 learned_addr learned my addr 172.21.15.60:0/936410976 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:32:13.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.422+0000 7f1a9bfff640 1 --2- 172.21.15.60:0/936410976 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a9c0ca390 0x7f1a9c161c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:13.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.422+0000 7f1a9bfff640 1 -- 172.21.15.60:0/936410976 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a9c0ca390 msgr2=0x7f1a9c161c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:32:13.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.422+0000 7f1a9bfff640 1 -- 172.21.15.60:0/936410976 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a9c0ca390 msgr2=0x7f1a9c161c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:32:13.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.422+0000 7f1a9a7fc640 1 -- 172.21.15.60:0/936410976 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2118187991 0 0) 0x7f1a9c15a7c0 con 0x7f1a9c150480 2024-09-12T02:32:13.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.422+0000 7f1a9bfff640 1 --2- 172.21.15.60:0/936410976 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a9c0ca390 0x7f1a9c161c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:32:13.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.422+0000 7f1a9a7fc640 1 -- 172.21.15.60:0/936410976 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a84003520 con 0x7f1a9c150480 2024-09-12T02:32:13.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.422+0000 7f1a9bfff640 1 --2- 172.21.15.60:0/936410976 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a9c0ca390 0x7f1a9c161c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:32:13.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.422+0000 7f1a9a7fc640 1 -- 172.21.15.60:0/936410976 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3700764291 0 0) 0x7f1a9c159a00 con 0x7f1a9c06c650 2024-09-12T02:32:13.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.422+0000 7f1a9a7fc640 1 -- 172.21.15.60:0/936410976 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a9c15a7c0 con 0x7f1a9c06c650 2024-09-12T02:32:13.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.422+0000 7f1a9a7fc640 1 -- 172.21.15.60:0/936410976 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1260474537 0 0) 0x7f1a9c15a7c0 con 0x7f1a9c06c650 2024-09-12T02:32:13.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.422+0000 7f1a9a7fc640 1 -- 172.21.15.60:0/936410976 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a9c0ca390 msgr2=0x7f1a9c161c00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:32:13.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.422+0000 7f1a9a7fc640 1 --2- 172.21.15.60:0/936410976 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a9c0ca390 0x7f1a9c161c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:13.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.422+0000 7f1a9a7fc640 1 -- 172.21.15.60:0/936410976 >> v1:172.21.15.60:6789/0 conn(0x7f1a9c150480 legacy=0x7f1a9c0c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:13.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.422+0000 7f1a9a7fc640 1 -- 172.21.15.60:0/936410976 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a9c159ce0 con 0x7f1a9c06c650 2024-09-12T02:32:13.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.422+0000 7f1a9a7fc640 1 -- 172.21.15.60:0/936410976 <== mon.1 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7f1a90001670 con 0x7f1a9c06c650 2024-09-12T02:32:13.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.422+0000 7f1a9a7fc640 1 -- 172.21.15.60:0/936410976 >> v1:172.21.15.105:6789/0 conn(0x7f1a9c06c650 legacy=0x7f1a9c0c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:13.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.422+0000 7f1a9a7fc640 1 --2- 172.21.15.60:0/936410976 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a84003b70 0x7f1a84003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:13.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.422+0000 7f1a9a7fc640 1 --2- 172.21.15.60:0/936410976 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a84004800 0x7f1a84004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:13.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.422+0000 7f1a9a7fc640 1 --2- 172.21.15.60:0/936410976 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a9c0ca390 0x7f1a840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:13.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.422+0000 7f1a9a7fc640 1 -- 172.21.15.60:0/936410976 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1a8400ba70 con 0x7f1a84004800 2024-09-12T02:32:13.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.422+0000 7f1a9a7fc640 1 -- 172.21.15.60:0/936410976 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1a8400bbf0 con 0x7f1a84003b70 2024-09-12T02:32:13.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.422+0000 7f1a9a7fc640 1 -- 172.21.15.60:0/936410976 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1a8400bdf0 con 0x7f1a9c0ca390 2024-09-12T02:32:13.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.422+0000 7f1a9affd640 1 --2- 172.21.15.60:0/936410976 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a84004800 0x7f1a84004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:13.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.422+0000 7f1a9b7fe640 1 --2- 172.21.15.60:0/936410976 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a84003b70 0x7f1a84003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:13.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.422+0000 7f1a9bfff640 1 --2- 172.21.15.60:0/936410976 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a9c0ca390 0x7f1a840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:13.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.423+0000 7f1a9affd640 1 -- 172.21.15.60:0/936410976 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a9c0ca390 msgr2=0x7f1a840051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:13.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.423+0000 7f1a9affd640 1 --2- 172.21.15.60:0/936410976 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a9c0ca390 0x7f1a840051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:13.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.423+0000 7f1a9affd640 1 -- 172.21.15.60:0/936410976 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a84003b70 msgr2=0x7f1a84003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:13.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.423+0000 7f1a9affd640 1 --2- 172.21.15.60:0/936410976 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a84003b70 0x7f1a84003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:13.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.423+0000 7f1a9affd640 1 -- 172.21.15.60:0/936410976 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a9c15a7c0 con 0x7f1a84004800 2024-09-12T02:32:13.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.423+0000 7f1a9affd640 1 --2- 172.21.15.60:0/936410976 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a84004800 0x7f1a84004c80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1a90001eb0 tx=0x7f1a84005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7191e5847cddeae server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:13.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.424+0000 7f1a9a7fc640 1 -- 172.21.15.60:0/936410976 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a90007b70 con 0x7f1a84004800 2024-09-12T02:32:13.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.424+0000 7f1a9a7fc640 1 -- 172.21.15.60:0/936410976 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a90031600 con 0x7f1a84004800 2024-09-12T02:32:13.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.424+0000 7f1a9a7fc640 1 -- 172.21.15.60:0/936410976 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a900319f0 con 0x7f1a84004800 2024-09-12T02:32:13.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.424+0000 7f1aa20ac640 1 -- 172.21.15.60:0/936410976 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a84004800 msgr2=0x7f1a84004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:13.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.424+0000 7f1aa20ac640 1 --2- 172.21.15.60:0/936410976 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a84004800 0x7f1a84004c80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1a90001eb0 tx=0x7f1a84005830 comp rx=0 tx=0).stop 2024-09-12T02:32:13.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.424+0000 7f1a9bfff640 1 -- 172.21.15.60:0/936410976 reap_dead start 2024-09-12T02:32:13.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.424+0000 7f1aa20ac640 1 -- 172.21.15.60:0/936410976 shutdown_connections 2024-09-12T02:32:13.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.424+0000 7f1aa20ac640 1 -- 172.21.15.60:0/936410976 >> 172.21.15.60:0/936410976 conn(0x7f1a9c068030 msgr2=0x7f1a9c073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:13.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.424+0000 7f1aa20ac640 1 -- 172.21.15.60:0/936410976 shutdown_connections 2024-09-12T02:32:13.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.424+0000 7f1aa20ac640 1 -- 172.21.15.60:0/936410976 wait complete. 2024-09-12T02:32:13.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.426+0000 7f1aa20ac640 1 Processor -- start 2024-09-12T02:32:13.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.426+0000 7f1aa20ac640 1 -- start start 2024-09-12T02:32:13.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.427+0000 7f1aa20ac640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a9c14e670 0x7f1a9c14d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:13.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.427+0000 7f1aa20ac640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a9c1df8d0 0x7f1a9c14db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:13.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.427+0000 7f1aa20ac640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a9c1e0890 0x7f1a9c1e0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:13.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.427+0000 7f1aa20ac640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1a9c06d270 con 0x7f1a9c1df8d0 2024-09-12T02:32:13.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.427+0000 7f1aa20ac640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1a9c15a330 con 0x7f1a9c14e670 2024-09-12T02:32:13.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.427+0000 7f1aa20ac640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1a9c0c81a0 con 0x7f1a9c1e0890 2024-09-12T02:32:13.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.427+0000 7f1a9affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a9c1df8d0 0x7f1a9c14db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:13.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.427+0000 7f1a9b7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a9c14e670 0x7f1a9c14d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:13.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.427+0000 7f1a9affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a9c1df8d0 0x7f1a9c14db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46684/0 (socket says 172.21.15.60:46684) 2024-09-12T02:32:13.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.427+0000 7f1a9bfff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a9c1e0890 0x7f1a9c1e0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:13.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.427+0000 7f1a9affd640 1 -- 172.21.15.60:0/3685586355 learned_addr learned my addr 172.21.15.60:0/3685586355 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:32:13.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.427+0000 7f1a9bfff640 1 -- 172.21.15.60:0/3685586355 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a9c1e0890 msgr2=0x7f1a9c1e0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-12T02:32:13.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.427+0000 7f1a9bfff640 1 -- 172.21.15.60:0/3685586355 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a9c1e0890 msgr2=0x7f1a9c1e0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:32:13.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.427+0000 7f1a9bfff640 1 --2- 172.21.15.60:0/3685586355 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a9c1e0890 0x7f1a9c1e0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:32:13.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.427+0000 7f1a9bfff640 1 --2- 172.21.15.60:0/3685586355 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a9c1e0890 0x7f1a9c1e0d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:32:13.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.427+0000 7f1a9b7fe640 1 -- 172.21.15.60:0/3685586355 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a9c1e0890 msgr2=0x7f1a9c1e0d10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:32:13.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.427+0000 7f1a9b7fe640 1 --2- 172.21.15.60:0/3685586355 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a9c1e0890 0x7f1a9c1e0d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:13.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.427+0000 7f1a9b7fe640 1 -- 172.21.15.60:0/3685586355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a9c1df8d0 msgr2=0x7f1a9c14db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:13.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.427+0000 7f1a9b7fe640 1 --2- 172.21.15.60:0/3685586355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a9c1df8d0 0x7f1a9c14db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:13.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.427+0000 7f1a9b7fe640 1 -- 172.21.15.60:0/3685586355 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a9c0ad360 con 0x7f1a9c14e670 2024-09-12T02:32:13.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.427+0000 7f1a9affd640 1 --2- 172.21.15.60:0/3685586355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a9c1df8d0 0x7f1a9c14db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:32:13.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.428+0000 7f1a9b7fe640 1 --2- 172.21.15.60:0/3685586355 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a9c14e670 0x7f1a9c14d610 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c004f10 tx=0x7f1a8c007430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:13.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.428+0000 7f1a83fff640 1 -- 172.21.15.60:0/3685586355 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c01a070 con 0x7f1a9c14e670 2024-09-12T02:32:13.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.428+0000 7f1a83fff640 1 -- 172.21.15.60:0/3685586355 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a8c00f750 con 0x7f1a9c14e670 2024-09-12T02:32:13.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.428+0000 7f1a83fff640 1 -- 172.21.15.60:0/3685586355 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c00fb40 con 0x7f1a9c14e670 2024-09-12T02:32:13.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.428+0000 7f1aa20ac640 1 -- 172.21.15.60:0/3685586355 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a9c1ef500 con 0x7f1a9c14e670 2024-09-12T02:32:13.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.428+0000 7f1aa20ac640 1 -- 172.21.15.60:0/3685586355 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a9c1efac0 con 0x7f1a9c14e670 2024-09-12T02:32:13.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.429+0000 7f1aa20ac640 1 --2- 172.21.15.60:0/3685586355 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a9c1efcc0 0x7f1a9c0afb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:13.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.429+0000 7f1aa20ac640 1 -- 172.21.15.60:0/3685586355 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1a9c1e06e0 con 0x7f1a9c1efcc0 2024-09-12T02:32:13.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.429+0000 7f1a9affd640 1 --2- 172.21.15.60:0/3685586355 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a9c1efcc0 0x7f1a9c0afb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:13.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.429+0000 7f1a9affd640 1 -- 172.21.15.60:0/3685586355 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1a9c159a00 con 0x7f1a9c1efcc0 2024-09-12T02:32:13.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.429+0000 7f1a83fff640 1 -- 172.21.15.60:0/3685586355 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1a8c01d070 con 0x7f1a9c14e670 2024-09-12T02:32:13.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.429+0000 7f1a9affd640 1 --2- 172.21.15.60:0/3685586355 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a9c1efcc0 0x7f1a9c0afb30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1a90001400 tx=0x7f1a90001940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:13.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.430+0000 7f1a83fff640 1 --2- 172.21.15.60:0/3685586355 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1a8806be30 0x7f1a8806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:13.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.430+0000 7f1a9bfff640 1 --2- 172.21.15.60:0/3685586355 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1a8806be30 0x7f1a8806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:13.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.430+0000 7f1a83fff640 1 -- 172.21.15.60:0/3685586355 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f1a8c08a940 con 0x7f1a9c14e670 2024-09-12T02:32:13.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.430+0000 7f1a83fff640 1 -- 172.21.15.60:0/3685586355 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a90005270 con 0x7f1a9c1efcc0 2024-09-12T02:32:13.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.430+0000 7f1a83fff640 1 -- 172.21.15.60:0/3685586355 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f1a90005410 con 0x7f1a9c1efcc0 2024-09-12T02:32:13.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.430+0000 7f1a83fff640 1 -- 172.21.15.60:0/3685586355 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a9c1efcc0 msgr2=0x7f1a9c0afb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:13.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.430+0000 7f1a83fff640 1 --2- 172.21.15.60:0/3685586355 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a9c1efcc0 0x7f1a9c0afb30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1a90001400 tx=0x7f1a90001940 comp rx=0 tx=0).stop 2024-09-12T02:32:13.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.430+0000 7f1a83fff640 1 -- 172.21.15.60:0/3685586355 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a9c1efcc0 msgr2=0x7f1a9c0afb30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:32:13.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.430+0000 7f1a83fff640 1 --2- 172.21.15.60:0/3685586355 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a9c1efcc0 0x7f1a9c0afb30 secure :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1a90001400 tx=0x7f1a90001940 comp rx=0 tx=0).stop 2024-09-12T02:32:13.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.431+0000 7f1a9bfff640 1 --2- 172.21.15.60:0/3685586355 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1a8806be30 0x7f1a8806e2f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c0c6110 tx=0x7f1a94009770 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:13.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.438+0000 7f1aa20ac640 1 --2- 172.21.15.60:0/3685586355 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a9c1e1250 0x7f1a9c0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:13.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.438+0000 7f1aa20ac640 1 -- 172.21.15.60:0/3685586355 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1a9c0cc530 con 0x7f1a9c1e1250 2024-09-12T02:32:13.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.438+0000 7f1a9affd640 1 --2- 172.21.15.60:0/3685586355 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a9c1e1250 0x7f1a9c0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:13.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.438+0000 7f1a9affd640 1 -- 172.21.15.60:0/3685586355 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1a9c06c430 con 0x7f1a9c1e1250 2024-09-12T02:32:13.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.438+0000 7f1a9affd640 1 --2- 172.21.15.60:0/3685586355 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a9c1e1250 0x7f1a9c0b0070 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1a90001eb0 tx=0x7f1a90030000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:13.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.438+0000 7f1a83fff640 1 -- 172.21.15.60:0/3685586355 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9004a040 con 0x7f1a9c1e1250 2024-09-12T02:32:13.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.439+0000 7f1a83fff640 1 -- 172.21.15.60:0/3685586355 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5050 (secure 0 0 0) 0x7f1a90003a00 con 0x7f1a9c1e1250 2024-09-12T02:32:13.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.439+0000 7f1a83fff640 1 -- 172.21.15.60:0/3685586355 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a9c1e1250 msgr2=0x7f1a9c0b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:13.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.439+0000 7f1a83fff640 1 --2- 172.21.15.60:0/3685586355 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a9c1e1250 0x7f1a9c0b0070 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1a90001eb0 tx=0x7f1a90030000 comp rx=0 tx=0).stop 2024-09-12T02:32:13.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.439+0000 7f1a83fff640 1 -- 172.21.15.60:0/3685586355 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a9c1e1250 msgr2=0x7f1a9c0b0070 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:32:13.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.439+0000 7f1a83fff640 1 --2- 172.21.15.60:0/3685586355 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a9c1e1250 0x7f1a9c0b0070 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:13.440 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:32:13.440 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:32:13.440 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:32:13.441 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:32:13.441 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 82, 2024-09-12T02:32:13.441 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 478873, 2024-09-12T02:32:13.441 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:32:13.441 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:32:13.441 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:32:13.441 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:32:13.441 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:32:13.441 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 2, 2024-09-12T02:32:13.441 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:32:13.441 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:32:13.441 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:32:13.441 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:32:13.442 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:32:13.442 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:32:13.442 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:32:13.442 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:32:13.442 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:32:13.442 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:32:13.442 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:32:13.442 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:32:13.442 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:32:13.442 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:32:13.442 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:32:13.442 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:32:13.442 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:32:13.443 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:32:13.443 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:32:13.443 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:32:13.443 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:32:13.443 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:32:13.443 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:32:13.443 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:32:13.443 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:32:13.443 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:32:13.443 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:32:13.443 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:32:13.443 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:13.443 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:13.443 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:32:13.444 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:32:13.444 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:32:13.444 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:32:13.444 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:32:13.444 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:32:13.444 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:32:13.444 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:32:13.444 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:32:13.444 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:32:13.444 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:32:13.444 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:32:13.444 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:32:13.444 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:32:13.445 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:32:13.445 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:32:13.445 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:32:13.445 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:32:13.445 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:32:13.445 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:32:13.445 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:32:13.445 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:32:13.445 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:32:13.445 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:32:13.445 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:32:13.445 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:32:13.445 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:32:13.446 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:32:13.446 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:32:13.446 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:32:13.446 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:13.446 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:32:13.446 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:13.446 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:32:13.446 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:32:13.446 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:32:13.446 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:32:13.446 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:13.446 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:32:13.446 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:32:13.446 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:13.446 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:13.447 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:13.447 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:32:13.447 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:32:13.447 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:13.447 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:13.447 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:13.447 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:13.447 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:32:13.447 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:32:13.447 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:32:13.447 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:32:13.447 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:32:13.447 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:13.447 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:13.448 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:32:13.448 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:32:13.448 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:32:13.448 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:32:13.448 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:13.448 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:32:13.448 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:32:13.448 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:13.448 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:13.448 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:13.448 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:32:13.448 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:32:13.448 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:13.449 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:13.449 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:13.449 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:13.449 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:32:13.449 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:32:13.449 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:32:13.449 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:32:13.449 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:32:13.449 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:13.449 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:13.449 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:32:13.449 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:32:13.449 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:32:13.450 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:32:13.450 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:13.450 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:32:13.450 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:32:13.450 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:13.450 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:13.450 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:13.450 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:32:13.450 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:32:13.450 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:13.450 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:13.451 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:13.451 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:13.451 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:32:13.451 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:32:13.451 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:32:13.451 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:32:13.451 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:32:13.451 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:13.451 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:13.451 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:13.451 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:32:13.451 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:32:13.451 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:13.451 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:32:13.452 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:32:13.452 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:32:13.452 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:13.452 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:32:13.452 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:32:13.452 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:13.452 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:32:13.452 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:32:13.452 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:32:13.452 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:13.453 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:32:13.453 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:32:13.453 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:13.453 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:32:13.453 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:32:13.453 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-09-12T02:32:13.453 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:13.453 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:32:13.453 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:32:13.453 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:13.453 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:32:13.453 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:32:13.454 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 8 2024-09-12T02:32:13.454 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:13.454 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:32:13.454 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:32:13.454 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:13.454 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:32:13.454 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:32:13.454 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:32:13.454 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:13.454 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:13.454 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:13.454 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:32:13.454 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:32:13.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.439+0000 7f1aa20ac640 1 -- 172.21.15.60:0/3685586355 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1a8806be30 msgr2=0x7f1a8806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:13.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.439+0000 7f1aa20ac640 1 --2- 172.21.15.60:0/3685586355 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1a8806be30 0x7f1a8806e2f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c0c6110 tx=0x7f1a94009770 comp rx=0 tx=0).stop 2024-09-12T02:32:13.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.439+0000 7f1aa20ac640 1 -- 172.21.15.60:0/3685586355 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a9c14e670 msgr2=0x7f1a9c14d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:13.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.439+0000 7f1aa20ac640 1 --2- 172.21.15.60:0/3685586355 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a9c14e670 0x7f1a9c14d610 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c004f10 tx=0x7f1a8c007430 comp rx=0 tx=0).stop 2024-09-12T02:32:13.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.439+0000 7f1a9bfff640 1 -- 172.21.15.60:0/3685586355 reap_dead start 2024-09-12T02:32:13.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.439+0000 7f1aa20ac640 1 -- 172.21.15.60:0/3685586355 shutdown_connections 2024-09-12T02:32:13.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.439+0000 7f1aa20ac640 1 --2- 172.21.15.60:0/3685586355 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a9c14e670 0x7f1a9c14d610 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:13.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.439+0000 7f1aa20ac640 1 -- 172.21.15.60:0/3685586355 >> 172.21.15.60:0/3685586355 conn(0x7f1a9c068030 msgr2=0x7f1a9c073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:13.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.439+0000 7f1aa20ac640 1 -- 172.21.15.60:0/3685586355 shutdown_connections 2024-09-12T02:32:13.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.439+0000 7f1aa20ac640 1 -- 172.21.15.60:0/3685586355 wait complete. 2024-09-12T02:32:13.457 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:32:13.457 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-12T02:32:13.458 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-12T02:32:13.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.568+0000 7fe05e44c640 1 Processor -- start 2024-09-12T02:32:13.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.568+0000 7fe05e44c640 1 -- start start 2024-09-12T02:32:13.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.569+0000 7fe05e44c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe058150480 0x7fe0580c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:13.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.569+0000 7fe05e44c640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe05806c650 0x7fe0580c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:13.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.569+0000 7fe05e44c640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe05815a7c0 con 0x7fe0580c9c80 2024-09-12T02:32:13.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.569+0000 7fe05e44c640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fe05806c240 con 0x7fe05806c650 2024-09-12T02:32:13.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.569+0000 7fe05e44c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe05815a330 con 0x7fe058150480 2024-09-12T02:32:13.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.569+0000 7fe05c9e9640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe0580c9c80 0x7fe0580ca130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:56006/0 (socket says 172.21.15.60:56006) 2024-09-12T02:32:13.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.569+0000 7fe05c9e9640 1 -- 172.21.15.60:0/3511375107 learned_addr learned my addr 172.21.15.60:0/3511375107 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:32:13.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.569+0000 7fe057fff640 1 --2- 172.21.15.60:0/3511375107 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe058150480 0x7fe0580c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:13.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.569+0000 7fe0577fe640 1 --2- 172.21.15.60:0/3511375107 >> v2:172.21.15.105:3300/0 conn(0x7fe05806c650 0x7fe0580c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:13.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.570+0000 7fe057fff640 1 -- 172.21.15.60:0/3511375107 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe058150480 msgr2=0x7fe0580c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:32:13.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.570+0000 7fe057fff640 1 -- 172.21.15.60:0/3511375107 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe058150480 msgr2=0x7fe0580c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:32:13.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.570+0000 7fe057fff640 1 --2- 172.21.15.60:0/3511375107 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe058150480 0x7fe0580c7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:32:13.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.570+0000 7fe057fff640 1 --2- 172.21.15.60:0/3511375107 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe058150480 0x7fe0580c7a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:32:13.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.570+0000 7fe056ffd640 1 -- 172.21.15.60:0/3511375107 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 824246623 0 0) 0x7fe05815a7c0 con 0x7fe0580c9c80 2024-09-12T02:32:13.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.570+0000 7fe056ffd640 1 -- 172.21.15.60:0/3511375107 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe040003520 con 0x7fe0580c9c80 2024-09-12T02:32:13.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.570+0000 7fe0577fe640 1 -- 172.21.15.60:0/3511375107 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe058150480 msgr2=0x7fe0580c7a90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:32:13.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.570+0000 7fe0577fe640 1 --2- 172.21.15.60:0/3511375107 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe058150480 0x7fe0580c7a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:13.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.570+0000 7fe0577fe640 1 -- 172.21.15.60:0/3511375107 >> v1:172.21.15.60:6789/0 conn(0x7fe0580c9c80 legacy=0x7fe0580ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:13.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.570+0000 7fe0577fe640 1 -- 172.21.15.60:0/3511375107 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe058159a00 con 0x7fe05806c650 2024-09-12T02:32:13.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.571+0000 7fe0577fe640 1 --2- 172.21.15.60:0/3511375107 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe05806c650 0x7fe0580c7fd0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe04c0097a0 tx=0x7fe04c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b70ee6ee8a7d9567 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:13.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.571+0000 7fe056ffd640 1 -- 172.21.15.60:0/3511375107 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe04c037070 con 0x7fe05806c650 2024-09-12T02:32:13.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.571+0000 7fe056ffd640 1 -- 172.21.15.60:0/3511375107 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe04c032440 con 0x7fe05806c650 2024-09-12T02:32:13.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.571+0000 7fe056ffd640 1 -- 172.21.15.60:0/3511375107 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe04c0327f0 con 0x7fe05806c650 2024-09-12T02:32:13.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.571+0000 7fe05e44c640 1 -- 172.21.15.60:0/3511375107 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe05806c650 msgr2=0x7fe0580c7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:13.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.571+0000 7fe05e44c640 1 --2- 172.21.15.60:0/3511375107 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe05806c650 0x7fe0580c7fd0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe04c0097a0 tx=0x7fe04c02a180 comp rx=0 tx=0).stop 2024-09-12T02:32:13.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.571+0000 7fe05e44c640 1 -- 172.21.15.60:0/3511375107 shutdown_connections 2024-09-12T02:32:13.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.571+0000 7fe05e44c640 1 --2- 172.21.15.60:0/3511375107 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe05806c650 0x7fe0580c7fd0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:13.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.571+0000 7fe05e44c640 1 --2- 172.21.15.60:0/3511375107 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe058150480 0x7fe0580c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:13.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.571+0000 7fe05e44c640 1 -- 172.21.15.60:0/3511375107 >> 172.21.15.60:0/3511375107 conn(0x7fe058068030 msgr2=0x7fe058073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:13.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.571+0000 7fe05e44c640 1 -- 172.21.15.60:0/3511375107 shutdown_connections 2024-09-12T02:32:13.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.572+0000 7fe05e44c640 1 -- 172.21.15.60:0/3511375107 wait complete. 2024-09-12T02:32:13.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.573+0000 7fe05e44c640 1 Processor -- start 2024-09-12T02:32:13.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.573+0000 7fe05e44c640 1 -- start start 2024-09-12T02:32:13.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.574+0000 7fe05e44c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe05806c650 0x7fe05814ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:13.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.574+0000 7fe05e44c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0580c9c80 0x7fe058149820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:13.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.574+0000 7fe05e44c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe058150480 0x7fe058149d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:13.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.574+0000 7fe05e44c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe05806d270 con 0x7fe0580c9c80 2024-09-12T02:32:13.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.574+0000 7fe05e44c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe058159fc0 con 0x7fe058150480 2024-09-12T02:32:13.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.574+0000 7fe05e44c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe058156270 con 0x7fe05806c650 2024-09-12T02:32:13.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.574+0000 7fe057fff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe05806c650 0x7fe05814ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:13.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.574+0000 7fe0577fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0580c9c80 0x7fe058149820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:13.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.574+0000 7fe057fff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe05806c650 0x7fe05814ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:41924/0 (socket says 172.21.15.60:41924) 2024-09-12T02:32:13.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.574+0000 7fe057fff640 1 -- 172.21.15.60:0/3877363995 learned_addr learned my addr 172.21.15.60:0/3877363995 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:32:13.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.574+0000 7fe05c9e9640 1 --2- 172.21.15.60:0/3877363995 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe058150480 0x7fe058149d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:13.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.574+0000 7fe057fff640 1 -- 172.21.15.60:0/3877363995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe05806c650 msgr2=0x7fe05814ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-12T02:32:13.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.574+0000 7fe057fff640 1 -- 172.21.15.60:0/3877363995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe05806c650 msgr2=0x7fe05814ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:32:13.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.574+0000 7fe057fff640 1 --2- 172.21.15.60:0/3877363995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe05806c650 0x7fe05814ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:32:13.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.574+0000 7fe057fff640 1 --2- 172.21.15.60:0/3877363995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe05806c650 0x7fe05814ba30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:32:13.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.574+0000 7fe0577fe640 1 -- 172.21.15.60:0/3877363995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe05806c650 msgr2=0x7fe05814ba30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:32:13.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.574+0000 7fe0577fe640 1 --2- 172.21.15.60:0/3877363995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe05806c650 0x7fe05814ba30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:13.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.574+0000 7fe0577fe640 1 -- 172.21.15.60:0/3877363995 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe058150480 msgr2=0x7fe058149d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:13.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.574+0000 7fe0577fe640 1 --2- 172.21.15.60:0/3877363995 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe058150480 0x7fe058149d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:13.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.574+0000 7fe0577fe640 1 -- 172.21.15.60:0/3877363995 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe058157810 con 0x7fe0580c9c80 2024-09-12T02:32:13.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.574+0000 7fe0577fe640 1 --2- 172.21.15.60:0/3877363995 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0580c9c80 0x7fe058149820 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe04c031000 tx=0x7fe04c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:13.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.575+0000 7fe054ff9640 1 -- 172.21.15.60:0/3877363995 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe04c041020 con 0x7fe0580c9c80 2024-09-12T02:32:13.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.575+0000 7fe054ff9640 1 -- 172.21.15.60:0/3877363995 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe04c030640 con 0x7fe0580c9c80 2024-09-12T02:32:13.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.575+0000 7fe05e44c640 1 -- 172.21.15.60:0/3877363995 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0580b03d0 con 0x7fe0580c9c80 2024-09-12T02:32:13.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.575+0000 7fe054ff9640 1 -- 172.21.15.60:0/3877363995 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe04c037040 con 0x7fe0580c9c80 2024-09-12T02:32:13.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.575+0000 7fe05e44c640 1 -- 172.21.15.60:0/3877363995 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0580cb510 con 0x7fe0580c9c80 2024-09-12T02:32:13.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.575+0000 7fe05e44c640 1 --2- 172.21.15.60:0/3877363995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0580aee50 0x7fe0580af230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:13.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.575+0000 7fe05e44c640 1 -- 172.21.15.60:0/3877363995 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe05814a2a0 con 0x7fe0580aee50 2024-09-12T02:32:13.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.576+0000 7fe057fff640 1 --2- 172.21.15.60:0/3877363995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0580aee50 0x7fe0580af230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:13.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.576+0000 7fe057fff640 1 -- 172.21.15.60:0/3877363995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0580aee50 msgr2=0x7fe0580af230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2024-09-12T02:32:13.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.576+0000 7fe057fff640 1 -- 172.21.15.60:0/3877363995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0580aee50 msgr2=0x7fe0580af230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:32:13.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.576+0000 7fe057fff640 1 --2- 172.21.15.60:0/3877363995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0580aee50 0x7fe0580af230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:32:13.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.576+0000 7fe057fff640 1 --2- 172.21.15.60:0/3877363995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0580aee50 0x7fe0580af230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:32:13.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.576+0000 7fe054ff9640 1 -- 172.21.15.60:0/3877363995 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe04c044020 con 0x7fe0580c9c80 2024-09-12T02:32:13.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.577+0000 7fe054ff9640 1 --2- 172.21.15.60:0/3877363995 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe04406be30 0x7fe04406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:13.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.577+0000 7fe054ff9640 1 -- 172.21.15.60:0/3877363995 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fe04c0ab890 con 0x7fe0580c9c80 2024-09-12T02:32:13.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.577+0000 7fe05c9e9640 1 --2- 172.21.15.60:0/3877363995 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe04406be30 0x7fe04406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:13.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.577+0000 7fe05c9e9640 1 --2- 172.21.15.60:0/3877363995 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe04406be30 0x7fe04406e2f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe050001560 tx=0x7fe050001970 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:13.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.777+0000 7fe057fff640 1 --2- 172.21.15.60:0/3877363995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0580aee50 0x7fe0580af230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:13.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.777+0000 7fe057fff640 1 -- 172.21.15.60:0/3877363995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0580aee50 msgr2=0x7fe0580af230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-12T02:32:13.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.777+0000 7fe057fff640 1 -- 172.21.15.60:0/3877363995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0580aee50 msgr2=0x7fe0580af230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:32:13.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.777+0000 7fe057fff640 1 --2- 172.21.15.60:0/3877363995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0580aee50 0x7fe0580af230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:32:13.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:13.777+0000 7fe057fff640 1 --2- 172.21.15.60:0/3877363995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0580aee50 0x7fe0580af230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:32:14.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:14.178+0000 7fe057fff640 1 --2- 172.21.15.60:0/3877363995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0580aee50 0x7fe0580af230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:14.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:14.178+0000 7fe057fff640 1 -- 172.21.15.60:0/3877363995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0580aee50 msgr2=0x7fe0580af230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-12T02:32:14.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:14.178+0000 7fe057fff640 1 -- 172.21.15.60:0/3877363995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0580aee50 msgr2=0x7fe0580af230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:32:14.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:14.178+0000 7fe057fff640 1 --2- 172.21.15.60:0/3877363995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0580aee50 0x7fe0580af230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:32:14.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:14.178+0000 7fe057fff640 1 --2- 172.21.15.60:0/3877363995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0580aee50 0x7fe0580af230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:32:14.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:14.979+0000 7fe057fff640 1 --2- 172.21.15.60:0/3877363995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0580aee50 0x7fe0580af230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:14.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:14.979+0000 7fe057fff640 1 -- 172.21.15.60:0/3877363995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0580aee50 msgr2=0x7fe0580af230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-12T02:32:14.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:14.979+0000 7fe057fff640 1 -- 172.21.15.60:0/3877363995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0580aee50 msgr2=0x7fe0580af230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:32:14.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:14.979+0000 7fe057fff640 1 --2- 172.21.15.60:0/3877363995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0580aee50 0x7fe0580af230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:32:14.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:14.979+0000 7fe057fff640 1 --2- 172.21.15.60:0/3877363995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0580aee50 0x7fe0580af230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:32:16.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.581+0000 7fe057fff640 1 --2- 172.21.15.60:0/3877363995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0580aee50 0x7fe0580af230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:16.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.581+0000 7fe057fff640 1 -- 172.21.15.60:0/3877363995 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe05814fae0 con 0x7fe0580aee50 2024-09-12T02:32:16.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.581+0000 7fe057fff640 1 --2- 172.21.15.60:0/3877363995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0580aee50 0x7fe0580af230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe048006e80 tx=0x7fe048017e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:16.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.582+0000 7fe054ff9640 1 -- 172.21.15.60:0/3877363995 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe048013990 con 0x7fe0580aee50 2024-09-12T02:32:16.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.582+0000 7fe054ff9640 1 -- 172.21.15.60:0/3877363995 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fe048013990 con 0x7fe0580aee50 2024-09-12T02:32:16.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.582+0000 7fe054ff9640 1 -- 172.21.15.60:0/3877363995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0580aee50 msgr2=0x7fe0580af230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:16.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.582+0000 7fe054ff9640 1 --2- 172.21.15.60:0/3877363995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0580aee50 0x7fe0580af230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe048006e80 tx=0x7fe048017e10 comp rx=0 tx=0).stop 2024-09-12T02:32:16.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.582+0000 7fe054ff9640 1 -- 172.21.15.60:0/3877363995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0580aee50 msgr2=0x7fe0580af230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:32:16.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.582+0000 7fe054ff9640 1 --2- 172.21.15.60:0/3877363995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0580aee50 0x7fe0580af230 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:16.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.589+0000 7fe05e44c640 1 --2- 172.21.15.60:0/3877363995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0580af770 0x7fe0581ef0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:16.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.589+0000 7fe05e44c640 1 -- 172.21.15.60:0/3877363995 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe0580b0250 con 0x7fe0580af770 2024-09-12T02:32:16.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.589+0000 7fe057fff640 1 --2- 172.21.15.60:0/3877363995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0580af770 0x7fe0581ef0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:16.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.589+0000 7fe057fff640 1 -- 172.21.15.60:0/3877363995 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe0580afb50 con 0x7fe0580af770 2024-09-12T02:32:16.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.589+0000 7fe057fff640 1 --2- 172.21.15.60:0/3877363995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0580af770 0x7fe0581ef0a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe0480153d0 tx=0x7fe0480046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:16.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.589+0000 7fe054ff9640 1 -- 172.21.15.60:0/3877363995 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe048018450 con 0x7fe0580af770 2024-09-12T02:32:16.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.590+0000 7fe054ff9640 1 -- 172.21.15.60:0/3877363995 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4548 (secure 0 0 0) 0x7fe048018450 con 0x7fe0580af770 2024-09-12T02:32:16.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.590+0000 7fe054ff9640 1 -- 172.21.15.60:0/3877363995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0580af770 msgr2=0x7fe0581ef0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:16.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.590+0000 7fe054ff9640 1 --2- 172.21.15.60:0/3877363995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0580af770 0x7fe0581ef0a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe0480153d0 tx=0x7fe0480046c0 comp rx=0 tx=0).stop 2024-09-12T02:32:16.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.590+0000 7fe054ff9640 1 -- 172.21.15.60:0/3877363995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0580af770 msgr2=0x7fe0581ef0a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:32:16.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.590+0000 7fe054ff9640 1 --2- 172.21.15.60:0/3877363995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0580af770 0x7fe0581ef0a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:16.591 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:32:16.591 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:32:16.591 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:32:16.591 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:32:16.591 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 82, 2024-09-12T02:32:16.591 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 10344, 2024-09-12T02:32:16.591 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:32:16.592 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:32:16.592 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:32:16.592 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:32:16.592 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:32:16.592 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 5, 2024-09-12T02:32:16.592 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:32:16.592 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:32:16.592 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:32:16.592 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:32:16.592 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:32:16.592 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:32:16.592 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:32:16.592 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:32:16.593 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:32:16.593 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:32:16.593 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:32:16.593 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:32:16.593 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:32:16.593 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:32:16.593 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:32:16.593 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:32:16.593 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:32:16.593 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:32:16.593 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:32:16.593 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:32:16.593 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:32:16.594 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:32:16.594 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:32:16.594 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:32:16.594 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:32:16.594 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:32:16.594 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:32:16.594 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:32:16.594 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:16.594 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:16.594 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:32:16.595 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:32:16.595 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:32:16.595 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:32:16.595 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:32:16.595 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:32:16.595 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:32:16.595 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:32:16.595 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:32:16.595 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:32:16.595 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:32:16.595 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:32:16.595 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:32:16.596 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:32:16.596 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:32:16.596 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:32:16.596 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:32:16.596 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:32:16.596 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:32:16.596 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:32:16.596 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:32:16.596 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:32:16.596 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:32:16.596 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:32:16.596 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:32:16.596 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:32:16.596 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:32:16.597 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:32:16.597 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:32:16.597 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:32:16.597 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:16.597 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:32:16.597 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:16.597 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:32:16.597 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:32:16.597 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:32:16.597 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:32:16.598 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:16.598 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:32:16.598 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:32:16.598 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:16.598 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:16.598 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:16.598 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:32:16.598 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:32:16.598 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:16.598 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:16.598 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:16.598 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:16.598 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:32:16.599 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:32:16.599 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:32:16.599 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:32:16.599 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:32:16.599 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:16.599 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:16.599 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:32:16.599 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:32:16.599 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:32:16.599 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:32:16.599 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:16.599 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:32:16.599 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:32:16.599 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:16.600 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:16.600 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:16.600 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:32:16.600 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:32:16.600 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:16.600 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:16.600 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:16.600 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:16.600 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:32:16.600 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:32:16.600 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:32:16.600 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:32:16.600 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:32:16.601 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:16.601 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:16.601 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:32:16.601 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:32:16.601 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:32:16.601 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:32:16.601 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:16.601 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:32:16.601 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:32:16.601 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:16.601 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:16.601 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:16.601 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:32:16.601 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:32:16.602 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:16.602 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:16.602 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:16.602 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:16.602 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:32:16.602 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:32:16.602 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:32:16.602 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:32:16.602 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:32:16.602 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:16.602 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:16.602 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:16.602 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:32:16.603 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:32:16.603 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:16.603 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:32:16.603 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:32:16.603 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:32:16.603 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:16.603 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:32:16.603 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:32:16.603 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:16.603 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:32:16.603 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:32:16.603 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:32:16.604 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:16.604 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:16.604 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:16.604 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:32:16.604 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:32:16.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.590+0000 7fe05e44c640 1 -- 172.21.15.60:0/3877363995 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe04406be30 msgr2=0x7fe04406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:16.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.590+0000 7fe05e44c640 1 --2- 172.21.15.60:0/3877363995 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe04406be30 0x7fe04406e2f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe050001560 tx=0x7fe050001970 comp rx=0 tx=0).stop 2024-09-12T02:32:16.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.590+0000 7fe05e44c640 1 -- 172.21.15.60:0/3877363995 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0580c9c80 msgr2=0x7fe058149820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:16.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.590+0000 7fe05e44c640 1 --2- 172.21.15.60:0/3877363995 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0580c9c80 0x7fe058149820 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe04c031000 tx=0x7fe04c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:32:16.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.590+0000 7fe05c9e9640 1 -- 172.21.15.60:0/3877363995 reap_dead start 2024-09-12T02:32:16.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.590+0000 7fe05c9e9640 1 -- 172.21.15.60:0/3877363995 reap_dead start 2024-09-12T02:32:16.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.590+0000 7fe05e44c640 1 -- 172.21.15.60:0/3877363995 shutdown_connections 2024-09-12T02:32:16.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.590+0000 7fe05e44c640 1 -- 172.21.15.60:0/3877363995 >> 172.21.15.60:0/3877363995 conn(0x7fe058068030 msgr2=0x7fe0580cbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:16.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.590+0000 7fe05e44c640 1 -- 172.21.15.60:0/3877363995 shutdown_connections 2024-09-12T02:32:16.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.590+0000 7fe05e44c640 1 -- 172.21.15.60:0/3877363995 wait complete. 2024-09-12T02:32:16.606 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:32:16.607 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-12T02:32:16.607 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-12T02:32:16.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.718+0000 7f80ac85e640 1 Processor -- start 2024-09-12T02:32:16.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.718+0000 7f80ac85e640 1 -- start start 2024-09-12T02:32:16.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.719+0000 7f80ac85e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80a8150480 0x7f80a80c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:16.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.719+0000 7f80ac85e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f80a806c650 0x7f80a80c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:16.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.719+0000 7f80ac85e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f80a80c9c80 0x7f80a80ca130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:16.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.719+0000 7f80ac85e640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f80a806c240 con 0x7f80a80c9c80 2024-09-12T02:32:16.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.719+0000 7f80ac85e640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f80a815a330 con 0x7f80a806c650 2024-09-12T02:32:16.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.719+0000 7f80ac85e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f80a815a7c0 con 0x7f80a8150480 2024-09-12T02:32:16.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.719+0000 7f80a6d9d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f80a80c9c80 0x7f80a80ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:16.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.719+0000 7f80a659c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80a8150480 0x7f80a80c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:16.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.719+0000 7f80a6d9d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f80a80c9c80 0x7f80a80ca130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46702/0 (socket says 172.21.15.60:46702) 2024-09-12T02:32:16.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.719+0000 7f80a6d9d640 1 -- 172.21.15.60:0/469693535 learned_addr learned my addr 172.21.15.60:0/469693535 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:32:16.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.719+0000 7f80a5d9b640 1 --2- 172.21.15.60:0/469693535 >> v2:172.21.15.105:3300/0 conn(0x7f80a806c650 0x7f80a80c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:16.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.720+0000 7f80a6d9d640 1 -- 172.21.15.60:0/469693535 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80a8150480 msgr2=0x7f80a80c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:16.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.720+0000 7f80a6d9d640 1 --2- 172.21.15.60:0/469693535 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80a8150480 0x7f80a80c7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:16.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.720+0000 7f80a6d9d640 1 -- 172.21.15.60:0/469693535 >> v2:172.21.15.105:3300/0 conn(0x7f80a806c650 msgr2=0x7f80a80c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:16.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.720+0000 7f80a6d9d640 1 --2- 172.21.15.60:0/469693535 >> v2:172.21.15.105:3300/0 conn(0x7f80a806c650 0x7f80a80c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:16.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.720+0000 7f80a6d9d640 1 -- 172.21.15.60:0/469693535 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80a8159a00 con 0x7f80a80c9c80 2024-09-12T02:32:16.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.720+0000 7f80a6d9d640 1 --2- 172.21.15.60:0/469693535 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80a80c9c80 0x7f80a80ca130 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f80a80cc830 tx=0x7f80a002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd0e7e6510e49e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:16.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.721+0000 7f80a559a640 1 -- 172.21.15.60:0/469693535 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a0036070 con 0x7f80a80c9c80 2024-09-12T02:32:16.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.721+0000 7f80a559a640 1 -- 172.21.15.60:0/469693535 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80a0031600 con 0x7f80a80c9c80 2024-09-12T02:32:16.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.721+0000 7f80a559a640 1 -- 172.21.15.60:0/469693535 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a00319d0 con 0x7f80a80c9c80 2024-09-12T02:32:16.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.721+0000 7f80ac85e640 1 -- 172.21.15.60:0/469693535 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80a80c9c80 msgr2=0x7f80a80ca130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:16.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.721+0000 7f80ac85e640 1 --2- 172.21.15.60:0/469693535 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80a80c9c80 0x7f80a80ca130 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f80a80cc830 tx=0x7f80a002a6a0 comp rx=0 tx=0).stop 2024-09-12T02:32:16.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.721+0000 7f80ac85e640 1 -- 172.21.15.60:0/469693535 shutdown_connections 2024-09-12T02:32:16.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.721+0000 7f80ac85e640 1 --2- 172.21.15.60:0/469693535 >> v2:172.21.15.105:3300/0 conn(0x7f80a806c650 0x7f80a80c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:16.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.721+0000 7f80ac85e640 1 --2- 172.21.15.60:0/469693535 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80a80c9c80 0x7f80a80ca130 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:16.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.721+0000 7f80ac85e640 1 --2- 172.21.15.60:0/469693535 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80a8150480 0x7f80a80c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:16.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.721+0000 7f80ac85e640 1 -- 172.21.15.60:0/469693535 >> 172.21.15.60:0/469693535 conn(0x7f80a8068030 msgr2=0x7f80a8073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:16.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.721+0000 7f80ac85e640 1 -- 172.21.15.60:0/469693535 shutdown_connections 2024-09-12T02:32:16.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.721+0000 7f80ac85e640 1 -- 172.21.15.60:0/469693535 wait complete. 2024-09-12T02:32:16.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.723+0000 7f80ac85e640 1 Processor -- start 2024-09-12T02:32:16.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.723+0000 7f80ac85e640 1 -- start start 2024-09-12T02:32:16.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.724+0000 7f80ac85e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80a806c650 0x7f80a80b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:16.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.724+0000 7f80ac85e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80a80c9c80 0x7f80a814d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:16.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.724+0000 7f80ac85e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80a8150480 0x7f80a814d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:16.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.724+0000 7f80ac85e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f80a80ca670 con 0x7f80a806c650 2024-09-12T02:32:16.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.724+0000 7f80ac85e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f80a8159fc0 con 0x7f80a8150480 2024-09-12T02:32:16.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.724+0000 7f80ac85e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f80a806d270 con 0x7f80a80c9c80 2024-09-12T02:32:16.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.724+0000 7f80a659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80a806c650 0x7f80a80b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:16.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.724+0000 7f80a659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80a806c650 0x7f80a80b0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46712/0 (socket says 172.21.15.60:46712) 2024-09-12T02:32:16.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.724+0000 7f80a5d9b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80a80c9c80 0x7f80a814d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:16.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.724+0000 7f80a659c640 1 -- 172.21.15.60:0/1245074834 learned_addr learned my addr 172.21.15.60:0/1245074834 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:32:16.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.724+0000 7f80a6d9d640 1 --2- 172.21.15.60:0/1245074834 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80a8150480 0x7f80a814d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:16.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.724+0000 7f80a659c640 1 -- 172.21.15.60:0/1245074834 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80a80c9c80 msgr2=0x7f80a814d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:16.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.724+0000 7f80a659c640 1 --2- 172.21.15.60:0/1245074834 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80a80c9c80 0x7f80a814d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:16.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.724+0000 7f80a659c640 1 -- 172.21.15.60:0/1245074834 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80a8150480 msgr2=0x7f80a814d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:16.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.724+0000 7f80a659c640 1 --2- 172.21.15.60:0/1245074834 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80a8150480 0x7f80a814d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:16.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.724+0000 7f80a659c640 1 -- 172.21.15.60:0/1245074834 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80a81ef7c0 con 0x7f80a806c650 2024-09-12T02:32:16.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.725+0000 7f80a659c640 1 --2- 172.21.15.60:0/1245074834 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80a806c650 0x7f80a80b0c50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f809800e9b0 tx=0x7f809800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:16.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.725+0000 7f8096ffd640 1 -- 172.21.15.60:0/1245074834 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8098017070 con 0x7f80a806c650 2024-09-12T02:32:16.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.725+0000 7f8096ffd640 1 -- 172.21.15.60:0/1245074834 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f809800c9a0 con 0x7f80a806c650 2024-09-12T02:32:16.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.725+0000 7f80ac85e640 1 -- 172.21.15.60:0/1245074834 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80a81efaa0 con 0x7f80a806c650 2024-09-12T02:32:16.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.725+0000 7f8096ffd640 1 -- 172.21.15.60:0/1245074834 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f809800cd90 con 0x7f80a806c650 2024-09-12T02:32:16.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.725+0000 7f80ac85e640 1 -- 172.21.15.60:0/1245074834 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80a81f0060 con 0x7f80a806c650 2024-09-12T02:32:16.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.726+0000 7f80ac85e640 1 -- 172.21.15.60:0/1245074834 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80a8156270 con 0x7f80a806c650 2024-09-12T02:32:16.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.726+0000 7f8096ffd640 1 -- 172.21.15.60:0/1245074834 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f809801a070 con 0x7f80a806c650 2024-09-12T02:32:16.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.727+0000 7f8096ffd640 1 --2- 172.21.15.60:0/1245074834 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f808806be30 0x7f808806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:16.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.727+0000 7f8096ffd640 1 -- 172.21.15.60:0/1245074834 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f809808b530 con 0x7f80a806c650 2024-09-12T02:32:16.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.727+0000 7f80a5d9b640 1 --2- 172.21.15.60:0/1245074834 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f808806be30 0x7f808806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:16.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.728+0000 7f80a5d9b640 1 --2- 172.21.15.60:0/1245074834 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f808806be30 0x7f808806e2f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f80a8155390 tx=0x7f809c009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:16.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:16.732+0000 7f8096ffd640 1 -- 172.21.15.60:0/1245074834 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8098059500 con 0x7f80a806c650 2024-09-12T02:32:17.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:17.023+0000 7f80ac85e640 1 -- 172.21.15.60:0/1245074834 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f80a8153d40 con 0x7f80a806c650 2024-09-12T02:32:17.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:17.024+0000 7f8096ffd640 1 -- 172.21.15.60:0/1245074834 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f809805d800 con 0x7f80a806c650 2024-09-12T02:32:17.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:17.026+0000 7f80ac85e640 1 -- 172.21.15.60:0/1245074834 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f808806be30 msgr2=0x7f808806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:17.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:17.026+0000 7f80ac85e640 1 --2- 172.21.15.60:0/1245074834 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f808806be30 0x7f808806e2f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f80a8155390 tx=0x7f809c009190 comp rx=0 tx=0).stop 2024-09-12T02:32:17.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:17.026+0000 7f80ac85e640 1 -- 172.21.15.60:0/1245074834 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80a806c650 msgr2=0x7f80a80b0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:17.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:17.026+0000 7f80ac85e640 1 --2- 172.21.15.60:0/1245074834 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80a806c650 0x7f80a80b0c50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f809800e9b0 tx=0x7f809800ee70 comp rx=0 tx=0).stop 2024-09-12T02:32:17.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:17.026+0000 7f80ac85e640 1 -- 172.21.15.60:0/1245074834 shutdown_connections 2024-09-12T02:32:17.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:17.026+0000 7f80ac85e640 1 --2- 172.21.15.60:0/1245074834 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f808806be30 0x7f808806e2f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:17.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:17.026+0000 7f80ac85e640 1 --2- 172.21.15.60:0/1245074834 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80a8150480 0x7f80a814d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:17.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:17.026+0000 7f80ac85e640 1 --2- 172.21.15.60:0/1245074834 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80a80c9c80 0x7f80a814d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:17.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:17.026+0000 7f80ac85e640 1 --2- 172.21.15.60:0/1245074834 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80a806c650 0x7f80a80b0c50 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:17.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:17.026+0000 7f80ac85e640 1 -- 172.21.15.60:0/1245074834 >> 172.21.15.60:0/1245074834 conn(0x7f80a8068030 msgr2=0x7f80a80c8790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:17.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:17.027+0000 7f80ac85e640 1 -- 172.21.15.60:0/1245074834 shutdown_connections 2024-09-12T02:32:17.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:17.027+0000 7f80ac85e640 1 -- 172.21.15.60:0/1245074834 wait complete. 2024-09-12T02:32:17.041 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-12T02:32:27.042 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-12T02:32:27.043 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:32:27.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.162+0000 7f5dcceba640 1 Processor -- start 2024-09-12T02:32:27.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.162+0000 7f5dcceba640 1 -- start start 2024-09-12T02:32:27.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.163+0000 7f5dcceba640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5dc8153be0 0x7f5dc815a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:27.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.163+0000 7f5dcceba640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dc80c7070 con 0x7f5dc806cd80 2024-09-12T02:32:27.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.163+0000 7f5dcceba640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dc806d210 con 0x7f5dc80c8b10 2024-09-12T02:32:27.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.163+0000 7f5dcceba640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f5dc80c69b0 con 0x7f5dc8153be0 2024-09-12T02:32:27.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.163+0000 7f5dc5d9b640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f5dc806cd80 0x7f5dc8156660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45656/0 (socket says 172.21.15.60:45656) 2024-09-12T02:32:27.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.163+0000 7f5dc5d9b640 1 -- 172.21.15.60:0/2577164312 learned_addr learned my addr 172.21.15.60:0/2577164312 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:32:27.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.163+0000 7f5dc6d9d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5dc8153be0 0x7f5dc815a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:27.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.164+0000 7f5dc559a640 1 -- 172.21.15.60:0/2577164312 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1307004171 0 0) 0x7f5dc80c7070 con 0x7f5dc806cd80 2024-09-12T02:32:27.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.164+0000 7f5dc559a640 1 -- 172.21.15.60:0/2577164312 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5db0003520 con 0x7f5dc806cd80 2024-09-12T02:32:27.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.164+0000 7f5dc559a640 1 -- 172.21.15.60:0/2577164312 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1973445505 0 0) 0x7f5dc806d210 con 0x7f5dc80c8b10 2024-09-12T02:32:27.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.164+0000 7f5dc6d9d640 1 -- 172.21.15.60:0/2577164312 >> v1:172.21.15.105:6789/0 conn(0x7f5dc80c8b10 legacy=0x7f5dc81534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:27.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.164+0000 7f5dc6d9d640 1 -- 172.21.15.60:0/2577164312 >> v1:172.21.15.60:6789/0 conn(0x7f5dc806cd80 legacy=0x7f5dc8156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:27.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.164+0000 7f5dc6d9d640 1 -- 172.21.15.60:0/2577164312 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dc80c6c90 con 0x7f5dc8153be0 2024-09-12T02:32:27.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.165+0000 7f5dc6d9d640 1 --2- 172.21.15.60:0/2577164312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5dc8153be0 0x7f5dc815a4a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0009d90 tx=0x7f5dc002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=598ce8a2fdc80a92 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:27.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.165+0000 7f5dc559a640 1 -- 172.21.15.60:0/2577164312 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc0007740 con 0x7f5dc8153be0 2024-09-12T02:32:27.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.165+0000 7f5dc559a640 1 -- 172.21.15.60:0/2577164312 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dc00078e0 con 0x7f5dc8153be0 2024-09-12T02:32:27.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.165+0000 7f5dc559a640 1 -- 172.21.15.60:0/2577164312 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc0007cb0 con 0x7f5dc8153be0 2024-09-12T02:32:27.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.165+0000 7f5dcceba640 1 -- 172.21.15.60:0/2577164312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5dc8153be0 msgr2=0x7f5dc815a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:27.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.165+0000 7f5dcceba640 1 --2- 172.21.15.60:0/2577164312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5dc8153be0 0x7f5dc815a4a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0009d90 tx=0x7f5dc002a660 comp rx=0 tx=0).stop 2024-09-12T02:32:27.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.166+0000 7f5dcceba640 1 -- 172.21.15.60:0/2577164312 shutdown_connections 2024-09-12T02:32:27.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.166+0000 7f5dcceba640 1 --2- 172.21.15.60:0/2577164312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5dc8153be0 0x7f5dc815a4a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:27.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.166+0000 7f5dcceba640 1 -- 172.21.15.60:0/2577164312 >> 172.21.15.60:0/2577164312 conn(0x7f5dc80adb80 msgr2=0x7f5dc80adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:27.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.166+0000 7f5dcceba640 1 -- 172.21.15.60:0/2577164312 shutdown_connections 2024-09-12T02:32:27.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.166+0000 7f5dcceba640 1 -- 172.21.15.60:0/2577164312 wait complete. 2024-09-12T02:32:27.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.167+0000 7f5dcceba640 1 Processor -- start 2024-09-12T02:32:27.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.167+0000 7f5dcceba640 1 -- start start 2024-09-12T02:32:27.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.168+0000 7f5dcceba640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5dc80c8b10 0x7f5dc80b1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:27.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.168+0000 7f5dcceba640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5dc8153be0 0x7f5dc81ebc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:27.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.168+0000 7f5dcceba640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5dc81ec160 0x7f5dc80afeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:27.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.168+0000 7f5dcceba640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc80c9070 con 0x7f5dc80c8b10 2024-09-12T02:32:27.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.168+0000 7f5dcceba640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc80c8ef0 con 0x7f5dc81ec160 2024-09-12T02:32:27.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.168+0000 7f5dcceba640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5dc8156d70 con 0x7f5dc8153be0 2024-09-12T02:32:27.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.168+0000 7f5dc659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5dc80c8b10 0x7f5dc80b1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:27.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.168+0000 7f5dc659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5dc80c8b10 0x7f5dc80b1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58870/0 (socket says 172.21.15.60:58870) 2024-09-12T02:32:27.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.168+0000 7f5dc659c640 1 -- 172.21.15.60:0/2113599170 learned_addr learned my addr 172.21.15.60:0/2113599170 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:32:27.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.168+0000 7f5dc5d9b640 1 --2- 172.21.15.60:0/2113599170 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5dc8153be0 0x7f5dc81ebc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:27.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.168+0000 7f5dc6d9d640 1 --2- 172.21.15.60:0/2113599170 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5dc81ec160 0x7f5dc80afeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:27.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.168+0000 7f5dc659c640 1 -- 172.21.15.60:0/2113599170 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5dc8153be0 msgr2=0x7f5dc81ebc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:27.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.168+0000 7f5dc659c640 1 --2- 172.21.15.60:0/2113599170 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5dc8153be0 0x7f5dc81ebc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:27.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.168+0000 7f5dc659c640 1 -- 172.21.15.60:0/2113599170 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5dc81ec160 msgr2=0x7f5dc80afeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:27.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.168+0000 7f5dc659c640 1 --2- 172.21.15.60:0/2113599170 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5dc81ec160 0x7f5dc80afeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:27.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.168+0000 7f5dc659c640 1 -- 172.21.15.60:0/2113599170 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dc81598e0 con 0x7f5dc80c8b10 2024-09-12T02:32:27.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.169+0000 7f5dc659c640 1 --2- 172.21.15.60:0/2113599170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5dc80c8b10 0x7f5dc80b1e40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5db800c4b0 tx=0x7f5db800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:27.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.169+0000 7f5db6ffd640 1 -- 172.21.15.60:0/2113599170 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db8017070 con 0x7f5dc80c8b10 2024-09-12T02:32:27.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.169+0000 7f5db6ffd640 1 -- 172.21.15.60:0/2113599170 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5db8005480 con 0x7f5dc80c8b10 2024-09-12T02:32:27.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.169+0000 7f5dcceba640 1 -- 172.21.15.60:0/2113599170 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dc815a9a0 con 0x7f5dc80c8b10 2024-09-12T02:32:27.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.169+0000 7f5db6ffd640 1 -- 172.21.15.60:0/2113599170 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db8003830 con 0x7f5dc80c8b10 2024-09-12T02:32:27.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.169+0000 7f5dcceba640 1 -- 172.21.15.60:0/2113599170 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dc80cb7f0 con 0x7f5dc80c8b10 2024-09-12T02:32:27.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.170+0000 7f5dcceba640 1 -- 172.21.15.60:0/2113599170 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dc81ec660 con 0x7f5dc80c8b10 2024-09-12T02:32:27.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.171+0000 7f5db6ffd640 1 -- 172.21.15.60:0/2113599170 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5db801a070 con 0x7f5dc80c8b10 2024-09-12T02:32:27.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.171+0000 7f5db6ffd640 1 --2- 172.21.15.60:0/2113599170 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f5da806be60 0x7f5da806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:27.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.171+0000 7f5db6ffd640 1 -- 172.21.15.60:0/2113599170 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f5db808a4f0 con 0x7f5dc80c8b10 2024-09-12T02:32:27.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.171+0000 7f5dc5d9b640 1 --2- 172.21.15.60:0/2113599170 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f5da806be60 0x7f5da806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:27.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.172+0000 7f5dc5d9b640 1 --2- 172.21.15.60:0/2113599170 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f5da806be60 0x7f5da806e320 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5dc81e9780 tx=0x7f5dbc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:27.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.176+0000 7f5db6ffd640 1 -- 172.21.15.60:0/2113599170 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5db80584b0 con 0x7f5dc80c8b10 2024-09-12T02:32:27.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.454+0000 7f5dcceba640 1 -- 172.21.15.60:0/2113599170 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f5dc81570d0 con 0x7f5dc80c8b10 2024-09-12T02:32:27.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.454+0000 7f5db6ffd640 1 -- 172.21.15.60:0/2113599170 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f5db805c7b0 con 0x7f5dc80c8b10 2024-09-12T02:32:27.455 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":82,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:32:27.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.456+0000 7f5dcceba640 1 -- 172.21.15.60:0/2113599170 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f5da806be60 msgr2=0x7f5da806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:27.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.456+0000 7f5dcceba640 1 --2- 172.21.15.60:0/2113599170 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f5da806be60 0x7f5da806e320 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5dc81e9780 tx=0x7f5dbc009040 comp rx=0 tx=0).stop 2024-09-12T02:32:27.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.456+0000 7f5dcceba640 1 -- 172.21.15.60:0/2113599170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5dc80c8b10 msgr2=0x7f5dc80b1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:27.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.456+0000 7f5dcceba640 1 --2- 172.21.15.60:0/2113599170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5dc80c8b10 0x7f5dc80b1e40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5db800c4b0 tx=0x7f5db800c970 comp rx=0 tx=0).stop 2024-09-12T02:32:27.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.456+0000 7f5dcceba640 1 -- 172.21.15.60:0/2113599170 shutdown_connections 2024-09-12T02:32:27.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.456+0000 7f5dcceba640 1 --2- 172.21.15.60:0/2113599170 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f5da806be60 0x7f5da806e320 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:27.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.456+0000 7f5dcceba640 1 --2- 172.21.15.60:0/2113599170 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5dc81ec160 0x7f5dc80afeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:27.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.456+0000 7f5dcceba640 1 --2- 172.21.15.60:0/2113599170 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5dc8153be0 0x7f5dc81ebc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:27.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.456+0000 7f5dcceba640 1 --2- 172.21.15.60:0/2113599170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5dc80c8b10 0x7f5dc80b1e40 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:27.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.456+0000 7f5dcceba640 1 -- 172.21.15.60:0/2113599170 >> 172.21.15.60:0/2113599170 conn(0x7f5dc80adb80 msgr2=0x7f5dc814faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:27.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.457+0000 7f5dcceba640 1 -- 172.21.15.60:0/2113599170 shutdown_connections 2024-09-12T02:32:27.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.457+0000 7f5dcceba640 1 -- 172.21.15.60:0/2113599170 wait complete. 2024-09-12T02:32:27.469 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-12T02:32:27.469 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-12T02:32:27.469 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-12T02:32:27.469 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-12T02:32:27.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.579+0000 7f1cb3952640 1 Processor -- start 2024-09-12T02:32:27.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.579+0000 7f1cb3952640 1 -- start start 2024-09-12T02:32:27.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.580+0000 7f1cb3952640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1cac06c650 0x7f1cac0c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:27.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.580+0000 7f1cb3952640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cac15a7c0 con 0x7f1cac150480 2024-09-12T02:32:27.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.580+0000 7f1cb3952640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cac159a00 con 0x7f1cac0ca1c0 2024-09-12T02:32:27.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.580+0000 7f1cb3952640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f1cac06c240 con 0x7f1cac06c650 2024-09-12T02:32:27.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.580+0000 7f1cb0eed640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1cac06c650 0x7f1cac0c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:27.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.580+0000 7f1cb16ee640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f1cac150480 0x7f1cac0c7a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45666/0 (socket says 172.21.15.60:45666) 2024-09-12T02:32:27.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.580+0000 7f1cb16ee640 1 -- 172.21.15.60:0/817715022 learned_addr learned my addr 172.21.15.60:0/817715022 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:32:27.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.580+0000 7f1cb0eed640 1 -- 172.21.15.60:0/817715022 >> v1:172.21.15.105:6789/0 conn(0x7f1cac0ca1c0 legacy=0x7f1cac160bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:27.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.580+0000 7f1cb0eed640 1 -- 172.21.15.60:0/817715022 >> v1:172.21.15.60:6789/0 conn(0x7f1cac150480 legacy=0x7f1cac0c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:27.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.580+0000 7f1cb0eed640 1 -- 172.21.15.60:0/817715022 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cac159ce0 con 0x7f1cac06c650 2024-09-12T02:32:27.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.580+0000 7f1ca3fff640 1 -- 172.21.15.60:0/817715022 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1520628877 0 0) 0x7f1cac15a7c0 con 0x7f1cac150480 2024-09-12T02:32:27.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.581+0000 7f1cb0eed640 1 --2- 172.21.15.60:0/817715022 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cac06c650 0x7f1cac0c9c80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c0097a0 tx=0x7f1c9c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8576e7816cd88461 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:27.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.581+0000 7f1ca3fff640 1 -- 172.21.15.60:0/817715022 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c037070 con 0x7f1cac06c650 2024-09-12T02:32:27.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.581+0000 7f1ca3fff640 1 -- 172.21.15.60:0/817715022 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c9c032440 con 0x7f1cac06c650 2024-09-12T02:32:27.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.581+0000 7f1ca3fff640 1 -- 172.21.15.60:0/817715022 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c032810 con 0x7f1cac06c650 2024-09-12T02:32:27.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.582+0000 7f1cb3952640 1 -- 172.21.15.60:0/817715022 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cac06c650 msgr2=0x7f1cac0c9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:27.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.582+0000 7f1cb3952640 1 --2- 172.21.15.60:0/817715022 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cac06c650 0x7f1cac0c9c80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c0097a0 tx=0x7f1c9c02a230 comp rx=0 tx=0).stop 2024-09-12T02:32:27.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.582+0000 7f1cb3952640 1 -- 172.21.15.60:0/817715022 shutdown_connections 2024-09-12T02:32:27.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.582+0000 7f1cb3952640 1 --2- 172.21.15.60:0/817715022 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cac06c650 0x7f1cac0c9c80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:27.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.582+0000 7f1cb3952640 1 -- 172.21.15.60:0/817715022 >> 172.21.15.60:0/817715022 conn(0x7f1cac068030 msgr2=0x7f1cac073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:27.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.582+0000 7f1cb3952640 1 -- 172.21.15.60:0/817715022 shutdown_connections 2024-09-12T02:32:27.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.582+0000 7f1cb3952640 1 -- 172.21.15.60:0/817715022 wait complete. 2024-09-12T02:32:27.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.583+0000 7f1cb3952640 1 Processor -- start 2024-09-12T02:32:27.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.583+0000 7f1cb3952640 1 -- start start 2024-09-12T02:32:27.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.584+0000 7f1cb3952640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1cac06c650 0x7f1cac157be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:27.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.584+0000 7f1cb3952640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cac0ca1c0 0x7f1cac0acc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:27.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.584+0000 7f1cb3952640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1cac150480 0x7f1cac158450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:27.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.584+0000 7f1cb3952640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1cac06d270 con 0x7f1cac0ca1c0 2024-09-12T02:32:27.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.584+0000 7f1cb3952640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1cac15a330 con 0x7f1cac150480 2024-09-12T02:32:27.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.584+0000 7f1cb3952640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1cac0ca5f0 con 0x7f1cac06c650 2024-09-12T02:32:27.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.584+0000 7f1cb0eed640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cac0ca1c0 0x7f1cac0acc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:27.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.584+0000 7f1cb0eed640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cac0ca1c0 0x7f1cac0acc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58884/0 (socket says 172.21.15.60:58884) 2024-09-12T02:32:27.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.584+0000 7f1cb0eed640 1 -- 172.21.15.60:0/179431230 learned_addr learned my addr 172.21.15.60:0/179431230 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:32:27.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.584+0000 7f1cb1eef640 1 --2- 172.21.15.60:0/179431230 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1cac150480 0x7f1cac158450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:27.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.584+0000 7f1cb16ee640 1 --2- 172.21.15.60:0/179431230 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1cac06c650 0x7f1cac157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:27.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.585+0000 7f1cb0eed640 1 -- 172.21.15.60:0/179431230 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1cac06c650 msgr2=0x7f1cac157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:27.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.585+0000 7f1cb0eed640 1 --2- 172.21.15.60:0/179431230 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1cac06c650 0x7f1cac157be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:27.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.585+0000 7f1cb0eed640 1 -- 172.21.15.60:0/179431230 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1cac150480 msgr2=0x7f1cac158450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:27.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.585+0000 7f1cb0eed640 1 --2- 172.21.15.60:0/179431230 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1cac150480 0x7f1cac158450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:27.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.585+0000 7f1cb0eed640 1 -- 172.21.15.60:0/179431230 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cac1e2490 con 0x7f1cac0ca1c0 2024-09-12T02:32:27.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.585+0000 7f1cb0eed640 1 --2- 172.21.15.60:0/179431230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cac0ca1c0 0x7f1cac0acc70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c0098c0 tx=0x7f1c9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:27.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.585+0000 7f1ca1ffb640 1 -- 172.21.15.60:0/179431230 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c037040 con 0x7f1cac0ca1c0 2024-09-12T02:32:27.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.585+0000 7f1ca1ffb640 1 -- 172.21.15.60:0/179431230 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c9c042070 con 0x7f1cac0ca1c0 2024-09-12T02:32:27.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.585+0000 7f1cb3952640 1 -- 172.21.15.60:0/179431230 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cac1eff40 con 0x7f1cac0ca1c0 2024-09-12T02:32:27.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.585+0000 7f1ca1ffb640 1 -- 172.21.15.60:0/179431230 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c030a70 con 0x7f1cac0ca1c0 2024-09-12T02:32:27.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.586+0000 7f1cb3952640 1 -- 172.21.15.60:0/179431230 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cac0ad1b0 con 0x7f1cac0ca1c0 2024-09-12T02:32:27.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.587+0000 7f1cb3952640 1 --2- 172.21.15.60:0/179431230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cac1ebe20 0x7f1cac1e1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:27.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.587+0000 7f1cb3952640 1 -- 172.21.15.60:0/179431230 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1cac1efda0 con 0x7f1cac1ebe20 2024-09-12T02:32:27.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.587+0000 7f1cb16ee640 1 --2- 172.21.15.60:0/179431230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cac1ebe20 0x7f1cac1e1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:27.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.588+0000 7f1cb16ee640 1 -- 172.21.15.60:0/179431230 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1cac1e2240 con 0x7f1cac1ebe20 2024-09-12T02:32:27.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.588+0000 7f1ca1ffb640 1 -- 172.21.15.60:0/179431230 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1c9c030c10 con 0x7f1cac0ca1c0 2024-09-12T02:32:27.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.588+0000 7f1cb16ee640 1 --2- 172.21.15.60:0/179431230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cac1ebe20 0x7f1cac1e1540 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1cac14fe50 tx=0x7f1ca8001990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:27.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.588+0000 7f1ca1ffb640 1 --2- 172.21.15.60:0/179431230 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1c9006be30 0x7f1c9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:27.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.588+0000 7f1ca1ffb640 1 -- 172.21.15.60:0/179431230 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f1c9c0abac0 con 0x7f1cac0ca1c0 2024-09-12T02:32:27.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.588+0000 7f1cb1eef640 1 --2- 172.21.15.60:0/179431230 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1c9006be30 0x7f1c9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:27.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.588+0000 7f1ca1ffb640 1 -- 172.21.15.60:0/179431230 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca800f5e0 con 0x7f1cac1ebe20 2024-09-12T02:32:27.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.589+0000 7f1ca1ffb640 1 -- 172.21.15.60:0/179431230 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f1ca8018070 con 0x7f1cac1ebe20 2024-09-12T02:32:27.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.589+0000 7f1ca1ffb640 1 -- 172.21.15.60:0/179431230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cac1ebe20 msgr2=0x7f1cac1e1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:27.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.589+0000 7f1ca1ffb640 1 --2- 172.21.15.60:0/179431230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cac1ebe20 0x7f1cac1e1540 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1cac14fe50 tx=0x7f1ca8001990 comp rx=0 tx=0).stop 2024-09-12T02:32:27.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.589+0000 7f1ca1ffb640 1 -- 172.21.15.60:0/179431230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cac1ebe20 msgr2=0x7f1cac1e1540 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:32:27.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.589+0000 7f1ca1ffb640 1 --2- 172.21.15.60:0/179431230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cac1ebe20 0x7f1cac1e1540 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:27.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.589+0000 7f1cb1eef640 1 --2- 172.21.15.60:0/179431230 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1c9006be30 0x7f1c9006e2f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1cac0ad4d0 tx=0x7f1ca4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:27.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.597+0000 7f1cb3952640 1 --2- 172.21.15.60:0/179431230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cac158990 0x7f1cac1e1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:27.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.597+0000 7f1cb3952640 1 -- 172.21.15.60:0/179431230 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1cac156270 con 0x7f1cac158990 2024-09-12T02:32:27.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.597+0000 7f1cb16ee640 1 --2- 172.21.15.60:0/179431230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cac158990 0x7f1cac1e1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:27.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.598+0000 7f1cb16ee640 1 -- 172.21.15.60:0/179431230 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1cac06c430 con 0x7f1cac158990 2024-09-12T02:32:27.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.598+0000 7f1cb16ee640 1 --2- 172.21.15.60:0/179431230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cac158990 0x7f1cac1e1a80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1cac14fe50 tx=0x7f1ca8001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:27.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.598+0000 7f1ca1ffb640 1 -- 172.21.15.60:0/179431230 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca8027410 con 0x7f1cac158990 2024-09-12T02:32:27.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.599+0000 7f1ca1ffb640 1 -- 172.21.15.60:0/179431230 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4886 (secure 0 0 0) 0x7f1ca8027410 con 0x7f1cac158990 2024-09-12T02:32:27.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.599+0000 7f1ca1ffb640 1 -- 172.21.15.60:0/179431230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cac158990 msgr2=0x7f1cac1e1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:27.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.599+0000 7f1ca1ffb640 1 --2- 172.21.15.60:0/179431230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cac158990 0x7f1cac1e1a80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1cac14fe50 tx=0x7f1ca8001080 comp rx=0 tx=0).stop 2024-09-12T02:32:27.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.599+0000 7f1ca1ffb640 1 -- 172.21.15.60:0/179431230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cac158990 msgr2=0x7f1cac1e1a80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:32:27.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.599+0000 7f1ca1ffb640 1 --2- 172.21.15.60:0/179431230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cac158990 0x7f1cac1e1a80 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:27.600 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:32:27.600 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:32:27.600 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:32:27.600 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:32:27.600 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 82, 2024-09-12T02:32:27.600 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 210701, 2024-09-12T02:32:27.601 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:32:27.601 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:32:27.601 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:32:27.601 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:32:27.601 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:32:27.601 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 16, 2024-09-12T02:32:27.601 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:32:27.601 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:32:27.601 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:32:27.601 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:32:27.601 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:32:27.601 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:32:27.602 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:32:27.602 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:32:27.602 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:32:27.602 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:32:27.602 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:32:27.602 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:32:27.602 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:32:27.602 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:32:27.602 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:32:27.602 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:32:27.602 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:32:27.602 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:32:27.602 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:32:27.603 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:32:27.603 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:32:27.603 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:32:27.603 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:32:27.603 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:32:27.603 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:32:27.603 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:32:27.603 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:32:27.603 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:32:27.603 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:27.603 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:27.603 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:32:27.603 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:32:27.604 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:32:27.604 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:32:27.604 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:32:27.604 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:32:27.604 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:32:27.604 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:32:27.604 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:32:27.604 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:32:27.604 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:32:27.604 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:32:27.604 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:32:27.604 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:32:27.605 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:32:27.605 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:32:27.605 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:32:27.605 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:32:27.605 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:32:27.605 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:32:27.605 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:32:27.605 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:32:27.605 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:32:27.605 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:32:27.605 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:32:27.605 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:32:27.605 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:32:27.606 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:32:27.606 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:32:27.606 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:32:27.606 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:27.606 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:32:27.606 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:27.606 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:32:27.606 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:32:27.606 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:32:27.606 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:32:27.606 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:27.606 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:32:27.606 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:32:27.607 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:27.607 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:27.607 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:27.607 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:32:27.607 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:32:27.607 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:27.607 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:27.607 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:27.607 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:27.607 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:32:27.607 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:32:27.607 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:32:27.607 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:32:27.607 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:32:27.608 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:27.608 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:27.608 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:32:27.608 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:32:27.608 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:32:27.608 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:32:27.608 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:27.608 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:32:27.608 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:32:27.608 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:27.608 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:27.608 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:27.608 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:32:27.609 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:32:27.609 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:27.609 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:27.609 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:27.609 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:27.609 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:32:27.609 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:32:27.609 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:32:27.609 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:32:27.609 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:32:27.609 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:27.609 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:27.609 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:32:27.610 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:32:27.610 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:32:27.610 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:32:27.610 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:27.610 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:32:27.610 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:32:27.610 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:27.610 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:27.610 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:27.610 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:32:27.610 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:32:27.610 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:27.610 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:27.610 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:27.610 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:27.611 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:32:27.611 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:32:27.611 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:32:27.611 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:32:27.611 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:32:27.611 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:27.611 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:27.611 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:27.611 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:32:27.611 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:32:27.611 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:27.611 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:32:27.611 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:32:27.612 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:32:27.612 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:27.612 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:32:27.612 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:32:27.612 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:27.612 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:32:27.612 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:32:27.612 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:32:27.612 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:27.612 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:32:27.612 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:32:27.612 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:27.612 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:32:27.612 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:32:27.612 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:32:27.613 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:27.613 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:32:27.613 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:32:27.613 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:27.613 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:32:27.613 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:32:27.613 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:32:27.613 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:27.613 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:27.613 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:27.613 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:32:27.613 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:32:27.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.599+0000 7f1cb3952640 1 -- 172.21.15.60:0/179431230 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1c9006be30 msgr2=0x7f1c9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:27.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.599+0000 7f1cb3952640 1 --2- 172.21.15.60:0/179431230 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1c9006be30 0x7f1c9006e2f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1cac0ad4d0 tx=0x7f1ca4009040 comp rx=0 tx=0).stop 2024-09-12T02:32:27.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.599+0000 7f1cb3952640 1 -- 172.21.15.60:0/179431230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cac0ca1c0 msgr2=0x7f1cac0acc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:27.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.599+0000 7f1cb3952640 1 --2- 172.21.15.60:0/179431230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cac0ca1c0 0x7f1cac0acc70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c0098c0 tx=0x7f1c9c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:32:27.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.599+0000 7f1cb1eef640 1 -- 172.21.15.60:0/179431230 reap_dead start 2024-09-12T02:32:27.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.599+0000 7f1cb1eef640 1 -- 172.21.15.60:0/179431230 reap_dead start 2024-09-12T02:32:27.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.599+0000 7f1cb3952640 1 -- 172.21.15.60:0/179431230 shutdown_connections 2024-09-12T02:32:27.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.599+0000 7f1cb3952640 1 -- 172.21.15.60:0/179431230 >> 172.21.15.60:0/179431230 conn(0x7f1cac068030 msgr2=0x7f1cac0c7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:27.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.599+0000 7f1cb3952640 1 -- 172.21.15.60:0/179431230 shutdown_connections 2024-09-12T02:32:27.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.599+0000 7f1cb3952640 1 -- 172.21.15.60:0/179431230 wait complete. 2024-09-12T02:32:27.616 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:32:27.616 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-12T02:32:27.616 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-12T02:32:27.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.725+0000 7ff6d6c4c640 1 Processor -- start 2024-09-12T02:32:27.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.725+0000 7ff6d6c4c640 1 -- start start 2024-09-12T02:32:27.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.726+0000 7ff6d6c4c640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff6d0153fd0 0x7ff6d015a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:27.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.726+0000 7ff6d6c4c640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6d00c2f60 con 0x7ff6d00ad6a0 2024-09-12T02:32:27.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.726+0000 7ff6d6c4c640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6d00c3240 con 0x7ff6d00c5130 2024-09-12T02:32:27.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.726+0000 7ff6d6c4c640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff6d00c1f80 con 0x7ff6d0153fd0 2024-09-12T02:32:27.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.727+0000 7ff6cffff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff6d00ad6a0 0x7ff6d0159c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45674/0 (socket says 172.21.15.60:45674) 2024-09-12T02:32:27.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.727+0000 7ff6cffff640 1 -- 172.21.15.60:0/1649061137 learned_addr learned my addr 172.21.15.60:0/1649061137 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:32:27.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.727+0000 7ff6d51e9640 1 --2- 172.21.15.60:0/1649061137 >> v2:172.21.15.105:3300/0 conn(0x7ff6d0153fd0 0x7ff6d015a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:27.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.727+0000 7ff6cf7fe640 1 -- 172.21.15.60:0/1649061137 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 433781481 0 0) 0x7ff6d00c2f60 con 0x7ff6d00ad6a0 2024-09-12T02:32:27.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.727+0000 7ff6cf7fe640 1 -- 172.21.15.60:0/1649061137 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6c0003520 con 0x7ff6d00ad6a0 2024-09-12T02:32:27.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.727+0000 7ff6cf7fe640 1 -- 172.21.15.60:0/1649061137 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3838509167 0 0) 0x7ff6d00c3240 con 0x7ff6d00c5130 2024-09-12T02:32:27.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.727+0000 7ff6cf7fe640 1 -- 172.21.15.60:0/1649061137 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6d00c2f60 con 0x7ff6d00c5130 2024-09-12T02:32:27.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.727+0000 7ff6d51e9640 1 -- 172.21.15.60:0/1649061137 >> v1:172.21.15.105:6789/0 conn(0x7ff6d00c5130 legacy=0x7ff6d01538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:27.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.727+0000 7ff6d51e9640 1 -- 172.21.15.60:0/1649061137 >> v1:172.21.15.60:6789/0 conn(0x7ff6d00ad6a0 legacy=0x7ff6d0159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:27.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.727+0000 7ff6d51e9640 1 -- 172.21.15.60:0/1649061137 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6d00c1c10 con 0x7ff6d0153fd0 2024-09-12T02:32:27.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.728+0000 7ff6d51e9640 1 --2- 172.21.15.60:0/1649061137 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6d0153fd0 0x7ff6d015a370 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8009d90 tx=0x7ff6c802a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aecdc3b5d2a688f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:27.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.728+0000 7ff6cf7fe640 1 -- 172.21.15.60:0/1649061137 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c8031600 con 0x7ff6d0153fd0 2024-09-12T02:32:27.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.728+0000 7ff6cf7fe640 1 -- 172.21.15.60:0/1649061137 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6c80317a0 con 0x7ff6d0153fd0 2024-09-12T02:32:27.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.728+0000 7ff6cf7fe640 1 -- 172.21.15.60:0/1649061137 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c8031b70 con 0x7ff6d0153fd0 2024-09-12T02:32:27.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.729+0000 7ff6d6c4c640 1 -- 172.21.15.60:0/1649061137 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6d0153fd0 msgr2=0x7ff6d015a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:27.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.729+0000 7ff6d6c4c640 1 --2- 172.21.15.60:0/1649061137 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6d0153fd0 0x7ff6d015a370 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8009d90 tx=0x7ff6c802a5d0 comp rx=0 tx=0).stop 2024-09-12T02:32:27.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.729+0000 7ff6d6c4c640 1 -- 172.21.15.60:0/1649061137 shutdown_connections 2024-09-12T02:32:27.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.729+0000 7ff6d6c4c640 1 --2- 172.21.15.60:0/1649061137 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6d0153fd0 0x7ff6d015a370 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:27.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.729+0000 7ff6d6c4c640 1 -- 172.21.15.60:0/1649061137 >> 172.21.15.60:0/1649061137 conn(0x7ff6d00c8430 msgr2=0x7ff6d00c8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:27.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.729+0000 7ff6d6c4c640 1 -- 172.21.15.60:0/1649061137 shutdown_connections 2024-09-12T02:32:27.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.729+0000 7ff6d6c4c640 1 -- 172.21.15.60:0/1649061137 wait complete. 2024-09-12T02:32:27.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.730+0000 7ff6d6c4c640 1 Processor -- start 2024-09-12T02:32:27.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.730+0000 7ff6d6c4c640 1 -- start start 2024-09-12T02:32:27.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.731+0000 7ff6d6c4c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6d00ad6a0 0x7ff6d00c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:27.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.731+0000 7ff6d6c4c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6d00c5130 0x7ff6d01e8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:27.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.731+0000 7ff6d6c4c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6d0153fd0 0x7ff6d00c77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:27.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.731+0000 7ff6d6c4c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d00c4250 con 0x7ff6d00c5130 2024-09-12T02:32:27.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.731+0000 7ff6d6c4c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d00c40d0 con 0x7ff6d0153fd0 2024-09-12T02:32:27.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.731+0000 7ff6d6c4c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff6d00c5510 con 0x7ff6d00ad6a0 2024-09-12T02:32:27.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.731+0000 7ff6cffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6d00c5130 0x7ff6d01e8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:27.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.731+0000 7ff6d49e8640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6d00ad6a0 0x7ff6d00c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:27.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.731+0000 7ff6cffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6d00c5130 0x7ff6d01e8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58922/0 (socket says 172.21.15.60:58922) 2024-09-12T02:32:27.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.731+0000 7ff6cffff640 1 -- 172.21.15.60:0/2615047192 learned_addr learned my addr 172.21.15.60:0/2615047192 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:32:27.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.731+0000 7ff6d51e9640 1 --2- 172.21.15.60:0/2615047192 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6d0153fd0 0x7ff6d00c77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:27.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.731+0000 7ff6d49e8640 1 -- 172.21.15.60:0/2615047192 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6d0153fd0 msgr2=0x7ff6d00c77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:27.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.731+0000 7ff6d49e8640 1 --2- 172.21.15.60:0/2615047192 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6d0153fd0 0x7ff6d00c77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:27.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.731+0000 7ff6d49e8640 1 -- 172.21.15.60:0/2615047192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6d00c5130 msgr2=0x7ff6d01e8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:27.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.731+0000 7ff6d49e8640 1 --2- 172.21.15.60:0/2615047192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6d00c5130 0x7ff6d01e8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:27.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.731+0000 7ff6d49e8640 1 -- 172.21.15.60:0/2615047192 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6d014e5d0 con 0x7ff6d00ad6a0 2024-09-12T02:32:27.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.731+0000 7ff6cffff640 1 --2- 172.21.15.60:0/2615047192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6d00c5130 0x7ff6d01e8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:32:27.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.732+0000 7ff6d49e8640 1 --2- 172.21.15.60:0/2615047192 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6d00ad6a0 0x7ff6d00c6c40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff6c400c3c0 tx=0x7ff6c4001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:27.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.732+0000 7ff6cd7fa640 1 -- 172.21.15.60:0/2615047192 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c4017070 con 0x7ff6d00ad6a0 2024-09-12T02:32:27.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.732+0000 7ff6cd7fa640 1 -- 172.21.15.60:0/2615047192 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6c40052d0 con 0x7ff6d00ad6a0 2024-09-12T02:32:27.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.732+0000 7ff6d6c4c640 1 -- 172.21.15.60:0/2615047192 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6d01ed0b0 con 0x7ff6d00ad6a0 2024-09-12T02:32:27.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.732+0000 7ff6cd7fa640 1 -- 172.21.15.60:0/2615047192 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c4003830 con 0x7ff6d00ad6a0 2024-09-12T02:32:27.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.732+0000 7ff6d6c4c640 1 -- 172.21.15.60:0/2615047192 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6d01ee500 con 0x7ff6d00ad6a0 2024-09-12T02:32:27.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.733+0000 7ff6d6c4c640 1 --2- 172.21.15.60:0/2615047192 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6d01e94e0 0x7ff6d01ed870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:27.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.733+0000 7ff6d6c4c640 1 -- 172.21.15.60:0/2615047192 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d0067950 con 0x7ff6d01e94e0 2024-09-12T02:32:27.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.733+0000 7ff6cffff640 1 --2- 172.21.15.60:0/2615047192 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6d01e94e0 0x7ff6d01ed870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:27.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.733+0000 7ff6cffff640 1 -- 172.21.15.60:0/2615047192 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff6d014e010 con 0x7ff6d01e94e0 2024-09-12T02:32:27.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.734+0000 7ff6cffff640 1 --2- 172.21.15.60:0/2615047192 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6d01e94e0 0x7ff6d01ed870 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc000f60 tx=0x7ff6bc00ff70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:27.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.734+0000 7ff6cd7fa640 1 -- 172.21.15.60:0/2615047192 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff6c401a070 con 0x7ff6d00ad6a0 2024-09-12T02:32:27.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.734+0000 7ff6cd7fa640 1 --2- 172.21.15.60:0/2615047192 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff6b406be60 0x7ff6b406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:27.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.734+0000 7ff6d51e9640 1 --2- 172.21.15.60:0/2615047192 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff6b406be60 0x7ff6b406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:27.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.734+0000 7ff6cd7fa640 1 -- 172.21.15.60:0/2615047192 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7ff6c408a3f0 con 0x7ff6d00ad6a0 2024-09-12T02:32:27.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.734+0000 7ff6cd7fa640 1 -- 172.21.15.60:0/2615047192 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc005ac0 con 0x7ff6d01e94e0 2024-09-12T02:32:27.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.734+0000 7ff6cd7fa640 1 -- 172.21.15.60:0/2615047192 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff6bc018070 con 0x7ff6d01e94e0 2024-09-12T02:32:27.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.734+0000 7ff6cd7fa640 1 -- 172.21.15.60:0/2615047192 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6d01e94e0 msgr2=0x7ff6d01ed870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:27.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.734+0000 7ff6cd7fa640 1 --2- 172.21.15.60:0/2615047192 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6d01e94e0 0x7ff6d01ed870 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc000f60 tx=0x7ff6bc00ff70 comp rx=0 tx=0).stop 2024-09-12T02:32:27.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.734+0000 7ff6cd7fa640 1 -- 172.21.15.60:0/2615047192 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6d01e94e0 msgr2=0x7ff6d01ed870 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:32:27.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.734+0000 7ff6cd7fa640 1 --2- 172.21.15.60:0/2615047192 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6d01e94e0 0x7ff6d01ed870 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:27.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.735+0000 7ff6d51e9640 1 --2- 172.21.15.60:0/2615047192 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff6b406be60 0x7ff6b406e320 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8034000 tx=0x7ff6c802f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:27.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.741+0000 7ff6d6c4c640 1 --2- 172.21.15.60:0/2615047192 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6d014db10 0x7ff6d01ed280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:27.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.741+0000 7ff6d6c4c640 1 -- 172.21.15.60:0/2615047192 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d015a530 con 0x7ff6d014db10 2024-09-12T02:32:27.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.742+0000 7ff6cffff640 1 --2- 172.21.15.60:0/2615047192 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6d014db10 0x7ff6d01ed280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:27.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.742+0000 7ff6cffff640 1 -- 172.21.15.60:0/2615047192 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff6d0157a90 con 0x7ff6d014db10 2024-09-12T02:32:27.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.742+0000 7ff6cffff640 1 --2- 172.21.15.60:0/2615047192 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6d014db10 0x7ff6d01ed280 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc000f60 tx=0x7ff6bc001150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:27.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.742+0000 7ff6cd7fa640 1 -- 172.21.15.60:0/2615047192 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc005030 con 0x7ff6d014db10 2024-09-12T02:32:27.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.743+0000 7ff6cd7fa640 1 -- 172.21.15.60:0/2615047192 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5051 (secure 0 0 0) 0x7ff6bc005030 con 0x7ff6d014db10 2024-09-12T02:32:27.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.743+0000 7ff6cd7fa640 1 -- 172.21.15.60:0/2615047192 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6d014db10 msgr2=0x7ff6d01ed280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:27.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.743+0000 7ff6cd7fa640 1 --2- 172.21.15.60:0/2615047192 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6d014db10 0x7ff6d01ed280 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc000f60 tx=0x7ff6bc001150 comp rx=0 tx=0).stop 2024-09-12T02:32:27.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.743+0000 7ff6cd7fa640 1 -- 172.21.15.60:0/2615047192 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6d014db10 msgr2=0x7ff6d01ed280 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:32:27.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.743+0000 7ff6cd7fa640 1 --2- 172.21.15.60:0/2615047192 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6d014db10 0x7ff6d01ed280 secure :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc000f60 tx=0x7ff6bc001150 comp rx=0 tx=0).stop 2024-09-12T02:32:27.751 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:32:27.751 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:32:27.751 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:32:27.751 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:32:27.751 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 82, 2024-09-12T02:32:27.751 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 493177, 2024-09-12T02:32:27.751 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:32:27.751 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:32:27.751 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:32:27.752 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:32:27.752 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:32:27.752 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 16, 2024-09-12T02:32:27.752 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:32:27.752 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:32:27.752 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:32:27.752 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:32:27.752 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:32:27.752 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:32:27.752 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:32:27.752 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:32:27.753 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:32:27.753 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:32:27.753 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:32:27.753 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:32:27.753 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:32:27.753 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:32:27.753 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:32:27.753 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:32:27.753 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:32:27.753 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:32:27.753 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:32:27.753 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:32:27.753 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:32:27.754 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:32:27.754 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:32:27.754 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:32:27.754 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:32:27.754 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:32:27.754 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:32:27.754 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:32:27.754 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:27.754 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:27.754 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:32:27.754 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:32:27.754 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:32:27.754 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:32:27.755 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:32:27.755 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:32:27.755 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:32:27.755 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:32:27.755 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:32:27.755 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:32:27.755 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:32:27.755 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:32:27.755 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:32:27.755 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:32:27.755 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:32:27.755 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:32:27.755 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:32:27.756 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:32:27.756 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:32:27.756 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:32:27.756 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:32:27.756 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:32:27.756 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:32:27.756 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:32:27.756 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:32:27.756 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:32:27.756 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:32:27.756 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:32:27.756 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:32:27.757 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:32:27.757 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:27.757 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:32:27.757 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:27.757 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:32:27.757 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:32:27.757 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:32:27.757 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:32:27.757 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:27.757 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:32:27.757 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:32:27.757 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:27.757 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:27.758 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:27.758 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:32:27.758 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:32:27.758 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:27.758 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:27.758 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:27.758 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:27.758 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:32:27.758 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:32:27.758 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:32:27.758 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:32:27.758 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:32:27.758 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:27.759 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:27.759 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:32:27.759 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:32:27.759 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:32:27.759 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:32:27.759 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:27.759 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:32:27.759 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:32:27.759 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:27.759 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:27.759 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:27.760 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:32:27.760 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:32:27.760 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:27.760 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:27.760 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:27.760 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:27.760 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:32:27.760 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:32:27.760 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:32:27.761 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:32:27.761 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:32:27.761 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:27.761 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:27.761 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:32:27.761 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:32:27.761 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:32:27.761 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:32:27.761 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:27.761 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:32:27.761 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:32:27.761 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:27.761 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:27.762 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:27.762 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:32:27.762 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:32:27.762 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:27.762 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:27.762 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:27.762 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:27.762 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:32:27.762 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:32:27.762 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:32:27.763 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:32:27.763 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:32:27.763 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:27.763 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:27.763 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:27.763 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:32:27.763 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:32:27.763 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:27.763 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:32:27.763 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:32:27.763 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:32:27.763 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:27.763 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:32:27.763 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:32:27.763 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:27.764 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:32:27.764 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:32:27.764 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:32:27.764 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:27.764 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:32:27.764 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:32:27.764 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:27.765 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:32:27.765 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:32:27.765 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-09-12T02:32:27.765 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:27.765 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:32:27.765 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:32:27.765 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:27.765 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:32:27.765 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:32:27.765 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-09-12T02:32:27.765 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:27.766 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:32:27.766 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:32:27.766 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:27.766 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:32:27.766 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:32:27.766 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:32:27.766 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:27.766 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:27.766 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:27.766 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:32:27.766 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:32:27.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.743+0000 7ff6d6c4c640 1 -- 172.21.15.60:0/2615047192 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff6b406be60 msgr2=0x7ff6b406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:27.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.743+0000 7ff6d6c4c640 1 --2- 172.21.15.60:0/2615047192 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff6b406be60 0x7ff6b406e320 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8034000 tx=0x7ff6c802f000 comp rx=0 tx=0).stop 2024-09-12T02:32:27.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.743+0000 7ff6d6c4c640 1 -- 172.21.15.60:0/2615047192 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6d00ad6a0 msgr2=0x7ff6d00c6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:27.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.743+0000 7ff6d6c4c640 1 --2- 172.21.15.60:0/2615047192 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6d00ad6a0 0x7ff6d00c6c40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff6c400c3c0 tx=0x7ff6c4001e70 comp rx=0 tx=0).stop 2024-09-12T02:32:27.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.743+0000 7ff6d51e9640 1 -- 172.21.15.60:0/2615047192 reap_dead start 2024-09-12T02:32:27.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.743+0000 7ff6d51e9640 1 -- 172.21.15.60:0/2615047192 reap_dead start 2024-09-12T02:32:27.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.743+0000 7ff6d6c4c640 1 -- 172.21.15.60:0/2615047192 shutdown_connections 2024-09-12T02:32:27.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.743+0000 7ff6d6c4c640 1 -- 172.21.15.60:0/2615047192 >> 172.21.15.60:0/2615047192 conn(0x7ff6d00c8430 msgr2=0x7ff6d0158ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:27.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.743+0000 7ff6d6c4c640 1 -- 172.21.15.60:0/2615047192 shutdown_connections 2024-09-12T02:32:27.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.743+0000 7ff6d6c4c640 1 -- 172.21.15.60:0/2615047192 wait complete. 2024-09-12T02:32:27.769 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:32:27.769 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-12T02:32:27.769 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-12T02:32:27.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.880+0000 7f92f2cd0640 1 Processor -- start 2024-09-12T02:32:27.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.880+0000 7f92f2cd0640 1 -- start start 2024-09-12T02:32:27.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.881+0000 7f92f2cd0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f92ec150480 0x7f92ec0c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:27.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.881+0000 7f92f2cd0640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f92ec06c650 0x7f92ec0c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:27.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.881+0000 7f92f2cd0640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92ec15a7c0 con 0x7f92ec0c9c80 2024-09-12T02:32:27.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.881+0000 7f92f2cd0640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f92ec06c240 con 0x7f92ec06c650 2024-09-12T02:32:27.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.881+0000 7f92f2cd0640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f92ec15a330 con 0x7f92ec150480 2024-09-12T02:32:27.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.881+0000 7f92ebfff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f92ec06c650 0x7f92ec0c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:27.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.881+0000 7f92f126d640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f92ec0c9c80 0x7f92ec0ca130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45682/0 (socket says 172.21.15.60:45682) 2024-09-12T02:32:27.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.881+0000 7f92f126d640 1 -- 172.21.15.60:0/1261177914 learned_addr learned my addr 172.21.15.60:0/1261177914 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:32:27.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.881+0000 7f92f0a6c640 1 --2- 172.21.15.60:0/1261177914 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f92ec150480 0x7f92ec0c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:27.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.881+0000 7f92ebfff640 1 -- 172.21.15.60:0/1261177914 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f92ec150480 msgr2=0x7f92ec0c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:27.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.881+0000 7f92ebfff640 1 --2- 172.21.15.60:0/1261177914 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f92ec150480 0x7f92ec0c7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:27.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.881+0000 7f92ebfff640 1 -- 172.21.15.60:0/1261177914 >> v1:172.21.15.60:6789/0 conn(0x7f92ec0c9c80 legacy=0x7f92ec0ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:27.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.881+0000 7f92ebfff640 1 -- 172.21.15.60:0/1261177914 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92ec159a00 con 0x7f92ec06c650 2024-09-12T02:32:27.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.881+0000 7f92eb7fe640 1 -- 172.21.15.60:0/1261177914 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1833879853 0 0) 0x7f92ec15a7c0 con 0x7f92ec0c9c80 2024-09-12T02:32:27.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.882+0000 7f92ebfff640 1 --2- 172.21.15.60:0/1261177914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92ec06c650 0x7f92ec0c7fd0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f92d80097a0 tx=0x7f92d802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e02102f9ae35970 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:27.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.883+0000 7f92eb7fe640 1 -- 172.21.15.60:0/1261177914 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d8037070 con 0x7f92ec06c650 2024-09-12T02:32:27.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.883+0000 7f92eb7fe640 1 -- 172.21.15.60:0/1261177914 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92d8032440 con 0x7f92ec06c650 2024-09-12T02:32:27.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.883+0000 7f92eb7fe640 1 -- 172.21.15.60:0/1261177914 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d8032810 con 0x7f92ec06c650 2024-09-12T02:32:27.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.883+0000 7f92f2cd0640 1 -- 172.21.15.60:0/1261177914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92ec06c650 msgr2=0x7f92ec0c7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:27.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.883+0000 7f92f2cd0640 1 --2- 172.21.15.60:0/1261177914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92ec06c650 0x7f92ec0c7fd0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f92d80097a0 tx=0x7f92d802a180 comp rx=0 tx=0).stop 2024-09-12T02:32:27.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.883+0000 7f92f2cd0640 1 -- 172.21.15.60:0/1261177914 shutdown_connections 2024-09-12T02:32:27.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.883+0000 7f92f2cd0640 1 --2- 172.21.15.60:0/1261177914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92ec06c650 0x7f92ec0c7fd0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:27.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.883+0000 7f92f2cd0640 1 --2- 172.21.15.60:0/1261177914 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f92ec150480 0x7f92ec0c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:27.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.883+0000 7f92f2cd0640 1 -- 172.21.15.60:0/1261177914 >> 172.21.15.60:0/1261177914 conn(0x7f92ec068030 msgr2=0x7f92ec073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:27.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.883+0000 7f92f2cd0640 1 -- 172.21.15.60:0/1261177914 shutdown_connections 2024-09-12T02:32:27.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.883+0000 7f92f2cd0640 1 -- 172.21.15.60:0/1261177914 wait complete. 2024-09-12T02:32:27.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.885+0000 7f92f2cd0640 1 Processor -- start 2024-09-12T02:32:27.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.885+0000 7f92f2cd0640 1 -- start start 2024-09-12T02:32:27.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.886+0000 7f92f2cd0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f92ec06c650 0x7f92ec1e1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:27.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.886+0000 7f92f2cd0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92ec0c9c80 0x7f92ec1efe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:27.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.886+0000 7f92f2cd0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92ec150480 0x7f92ec1f03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:27.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.886+0000 7f92f2cd0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f92ec06d270 con 0x7f92ec0c9c80 2024-09-12T02:32:27.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.886+0000 7f92f2cd0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f92ec159fc0 con 0x7f92ec150480 2024-09-12T02:32:27.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.886+0000 7f92f2cd0640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f92ec156270 con 0x7f92ec06c650 2024-09-12T02:32:27.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.886+0000 7f92ebfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92ec0c9c80 0x7f92ec1efe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:27.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.886+0000 7f92ebfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92ec0c9c80 0x7f92ec1efe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58934/0 (socket says 172.21.15.60:58934) 2024-09-12T02:32:27.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.886+0000 7f92f0a6c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f92ec06c650 0x7f92ec1e1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:27.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.886+0000 7f92ebfff640 1 -- 172.21.15.60:0/590994590 learned_addr learned my addr 172.21.15.60:0/590994590 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:32:27.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.886+0000 7f92f126d640 1 --2- 172.21.15.60:0/590994590 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92ec150480 0x7f92ec1f03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:27.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.886+0000 7f92ebfff640 1 -- 172.21.15.60:0/590994590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f92ec06c650 msgr2=0x7f92ec1e1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:27.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.886+0000 7f92ebfff640 1 --2- 172.21.15.60:0/590994590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f92ec06c650 0x7f92ec1e1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:27.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.886+0000 7f92ebfff640 1 -- 172.21.15.60:0/590994590 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92ec150480 msgr2=0x7f92ec1f03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:27.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.886+0000 7f92ebfff640 1 --2- 172.21.15.60:0/590994590 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92ec150480 0x7f92ec1f03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:27.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.886+0000 7f92ebfff640 1 -- 172.21.15.60:0/590994590 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92ec153e90 con 0x7f92ec0c9c80 2024-09-12T02:32:27.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.886+0000 7f92ebfff640 1 --2- 172.21.15.60:0/590994590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92ec0c9c80 0x7f92ec1efe90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f92d8000c00 tx=0x7f92d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:27.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.887+0000 7f92e97fa640 1 -- 172.21.15.60:0/590994590 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d8037040 con 0x7f92ec0c9c80 2024-09-12T02:32:27.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.887+0000 7f92e97fa640 1 -- 172.21.15.60:0/590994590 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92d8042070 con 0x7f92ec0c9c80 2024-09-12T02:32:27.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.887+0000 7f92f2cd0640 1 -- 172.21.15.60:0/590994590 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92ec1535f0 con 0x7f92ec0c9c80 2024-09-12T02:32:27.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.887+0000 7f92e97fa640 1 -- 172.21.15.60:0/590994590 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d8030940 con 0x7f92ec0c9c80 2024-09-12T02:32:27.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.887+0000 7f92f2cd0640 1 -- 172.21.15.60:0/590994590 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92ec153bb0 con 0x7f92ec0c9c80 2024-09-12T02:32:27.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.888+0000 7f92f2cd0640 1 --2- 172.21.15.60:0/590994590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f92ec152ab0 0x7f92ec14f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:27.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.888+0000 7f92f2cd0640 1 -- 172.21.15.60:0/590994590 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f92ec1554c0 con 0x7f92ec152ab0 2024-09-12T02:32:27.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.888+0000 7f92f0a6c640 1 --2- 172.21.15.60:0/590994590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f92ec152ab0 0x7f92ec14f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:27.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.888+0000 7f92f0a6c640 1 -- 172.21.15.60:0/590994590 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f92ec04ffb0 con 0x7f92ec152ab0 2024-09-12T02:32:27.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.888+0000 7f92f0a6c640 1 --2- 172.21.15.60:0/590994590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f92ec152ab0 0x7f92ec14f1e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f92e0011890 tx=0x7f92e0011d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:27.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.888+0000 7f92e97fa640 1 -- 172.21.15.60:0/590994590 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f92d8030ae0 con 0x7f92ec0c9c80 2024-09-12T02:32:27.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.889+0000 7f92e97fa640 1 --2- 172.21.15.60:0/590994590 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f92d006be30 0x7f92d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:27.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.889+0000 7f92e97fa640 1 -- 172.21.15.60:0/590994590 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f92d80ab970 con 0x7f92ec0c9c80 2024-09-12T02:32:27.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.889+0000 7f92f126d640 1 --2- 172.21.15.60:0/590994590 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f92d006be30 0x7f92d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:27.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.889+0000 7f92e97fa640 1 -- 172.21.15.60:0/590994590 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e0019070 con 0x7f92ec152ab0 2024-09-12T02:32:27.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.889+0000 7f92e97fa640 1 -- 172.21.15.60:0/590994590 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f92e0004240 con 0x7f92ec152ab0 2024-09-12T02:32:27.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.889+0000 7f92e97fa640 1 -- 172.21.15.60:0/590994590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f92ec152ab0 msgr2=0x7f92ec14f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:27.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.889+0000 7f92e97fa640 1 --2- 172.21.15.60:0/590994590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f92ec152ab0 0x7f92ec14f1e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f92e0011890 tx=0x7f92e0011d50 comp rx=0 tx=0).stop 2024-09-12T02:32:27.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.889+0000 7f92e97fa640 1 -- 172.21.15.60:0/590994590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f92ec152ab0 msgr2=0x7f92ec14f1e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:32:27.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.889+0000 7f92e97fa640 1 --2- 172.21.15.60:0/590994590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f92ec152ab0 0x7f92ec14f1e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:27.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.890+0000 7f92f126d640 1 --2- 172.21.15.60:0/590994590 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f92d006be30 0x7f92d006e2f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f92e40012e0 tx=0x7f92e4004d40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:27.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.896+0000 7f92f2cd0640 1 --2- 172.21.15.60:0/590994590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f92ec1e2070 0x7f92ec14f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:27.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.896+0000 7f92f2cd0640 1 -- 172.21.15.60:0/590994590 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f92ec14fc60 con 0x7f92ec1e2070 2024-09-12T02:32:27.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.896+0000 7f92f0a6c640 1 --2- 172.21.15.60:0/590994590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f92ec1e2070 0x7f92ec14f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:27.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.897+0000 7f92f0a6c640 1 -- 172.21.15.60:0/590994590 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f92ec0ca130 con 0x7f92ec1e2070 2024-09-12T02:32:27.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.897+0000 7f92f0a6c640 1 --2- 172.21.15.60:0/590994590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f92ec1e2070 0x7f92ec14f720 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f92e0011890 tx=0x7f92e00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:27.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.897+0000 7f92e97fa640 1 -- 172.21.15.60:0/590994590 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e0019040 con 0x7f92ec1e2070 2024-09-12T02:32:27.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.897+0000 7f92e97fa640 1 -- 172.21.15.60:0/590994590 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4549 (secure 0 0 0) 0x7f92e0003da0 con 0x7f92ec1e2070 2024-09-12T02:32:27.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.897+0000 7f92e97fa640 1 -- 172.21.15.60:0/590994590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f92ec1e2070 msgr2=0x7f92ec14f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:27.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.897+0000 7f92e97fa640 1 --2- 172.21.15.60:0/590994590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f92ec1e2070 0x7f92ec14f720 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f92e0011890 tx=0x7f92e00046c0 comp rx=0 tx=0).stop 2024-09-12T02:32:27.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.897+0000 7f92e97fa640 1 -- 172.21.15.60:0/590994590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f92ec1e2070 msgr2=0x7f92ec14f720 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:32:27.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.897+0000 7f92e97fa640 1 --2- 172.21.15.60:0/590994590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f92ec1e2070 0x7f92ec14f720 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:27.899 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:32:27.899 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:32:27.899 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:32:27.899 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:32:27.899 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 82, 2024-09-12T02:32:27.899 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 21652, 2024-09-12T02:32:27.899 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:32:27.899 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:32:27.899 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:32:27.899 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:32:27.900 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:32:27.900 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 16, 2024-09-12T02:32:27.900 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:32:27.900 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:32:27.900 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:32:27.900 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:32:27.900 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:32:27.900 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:32:27.900 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:32:27.900 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:32:27.900 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:32:27.900 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:32:27.900 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:32:27.901 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:32:27.901 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:32:27.901 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:32:27.901 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:32:27.901 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:32:27.901 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:32:27.901 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:32:27.901 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:32:27.901 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:32:27.902 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:32:27.902 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:32:27.902 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:32:27.902 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:32:27.902 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:32:27.902 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:32:27.902 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:32:27.902 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:32:27.902 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:27.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:27.902 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:32:27.902 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:32:27.902 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:32:27.903 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:32:27.903 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:32:27.903 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:32:27.903 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:32:27.903 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:32:27.903 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:32:27.903 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:32:27.903 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:32:27.903 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:32:27.903 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:32:27.903 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:32:27.903 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:32:27.903 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:32:27.904 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:32:27.904 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:32:27.904 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:32:27.904 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:32:27.904 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:32:27.904 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:32:27.904 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:32:27.904 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:32:27.904 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:32:27.904 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:32:27.904 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:32:27.905 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:32:27.905 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:32:27.906 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:32:27.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:27.906 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:32:27.906 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:27.906 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:32:27.906 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:32:27.906 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:32:27.907 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:32:27.907 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:27.907 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:32:27.907 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:32:27.907 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:27.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:27.907 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:27.907 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:32:27.907 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:32:27.907 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:27.907 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:27.907 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:27.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:27.908 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:32:27.908 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:32:27.908 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:32:27.908 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:32:27.908 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:32:27.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:27.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:27.908 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:32:27.908 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:32:27.908 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:32:27.908 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:32:27.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:27.909 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:32:27.909 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:32:27.909 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:27.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:27.909 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:27.909 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:32:27.909 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:32:27.909 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:27.909 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:27.909 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:27.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:27.909 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:32:27.909 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:32:27.910 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:32:27.910 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:32:27.910 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:32:27.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:27.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:27.910 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:32:27.910 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:32:27.910 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:32:27.910 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:32:27.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:27.910 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:32:27.910 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:32:27.910 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:27.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:27.911 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:27.911 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:32:27.911 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:32:27.911 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:27.911 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:27.911 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:27.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:27.911 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:32:27.911 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:32:27.911 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:32:27.911 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:32:27.911 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:32:27.912 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:27.912 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:27.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:27.912 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:32:27.912 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:32:27.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:27.912 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:32:27.912 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:32:27.912 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:32:27.912 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:27.912 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:32:27.912 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:32:27.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:27.913 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:32:27.913 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:32:27.913 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:32:27.913 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:27.913 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:27.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:27.913 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:32:27.913 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:32:27.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.898+0000 7f92f2cd0640 1 -- 172.21.15.60:0/590994590 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f92d006be30 msgr2=0x7f92d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:27.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.898+0000 7f92f2cd0640 1 --2- 172.21.15.60:0/590994590 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f92d006be30 0x7f92d006e2f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f92e40012e0 tx=0x7f92e4004d40 comp rx=0 tx=0).stop 2024-09-12T02:32:27.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.898+0000 7f92f2cd0640 1 -- 172.21.15.60:0/590994590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92ec0c9c80 msgr2=0x7f92ec1efe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:27.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.898+0000 7f92f2cd0640 1 --2- 172.21.15.60:0/590994590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92ec0c9c80 0x7f92ec1efe90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f92d8000c00 tx=0x7f92d80046c0 comp rx=0 tx=0).stop 2024-09-12T02:32:27.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.898+0000 7f92f126d640 1 -- 172.21.15.60:0/590994590 reap_dead start 2024-09-12T02:32:27.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.898+0000 7f92f126d640 1 -- 172.21.15.60:0/590994590 reap_dead start 2024-09-12T02:32:27.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.898+0000 7f92f2cd0640 1 -- 172.21.15.60:0/590994590 shutdown_connections 2024-09-12T02:32:27.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.898+0000 7f92f2cd0640 1 -- 172.21.15.60:0/590994590 >> 172.21.15.60:0/590994590 conn(0x7f92ec068030 msgr2=0x7f92ec0c8790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:27.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.898+0000 7f92f2cd0640 1 -- 172.21.15.60:0/590994590 shutdown_connections 2024-09-12T02:32:27.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:27.898+0000 7f92f2cd0640 1 -- 172.21.15.60:0/590994590 wait complete. 2024-09-12T02:32:27.915 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:32:27.916 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-09-12T02:32:27.916 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-12T02:32:27.916 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-09-12T02:32:27.916 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-12T02:32:27.916 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T02:32:27.917 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:32:27.928 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T02:32:27.929 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-12T02:32:27.929 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:32:28.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.082+0000 7f0136a8d640 1 Processor -- start 2024-09-12T02:32:28.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.083+0000 7f0136a8d640 1 -- start start 2024-09-12T02:32:28.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.083+0000 7f0136a8d640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f01300a8090 0x7f01300c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:28.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.083+0000 7f0136a8d640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0130153470 con 0x7f01300aea70 2024-09-12T02:32:28.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.083+0000 7f0136a8d640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0130153750 con 0x7f01300ade30 2024-09-12T02:32:28.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.083+0000 7f0136a8d640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f0130150d00 con 0x7f01300a8090 2024-09-12T02:32:28.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.083+0000 7f012ffff640 1 -- >> v1:172.21.15.60:6789/0 conn(0x7f01300aea70 legacy=0x7f01300c38d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:32:28.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.084+0000 7f013502a640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f01300a8090 0x7f01300c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:28.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.084+0000 7f0134829640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f01300ade30 0x7f01300c7a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:51658/0 (socket says 172.21.15.60:51658) 2024-09-12T02:32:28.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.084+0000 7f0134829640 1 -- 172.21.15.60:0/3487578483 learned_addr learned my addr 172.21.15.60:0/3487578483 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:32:28.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.084+0000 7f013502a640 1 -- 172.21.15.60:0/3487578483 >> v1:172.21.15.105:6789/0 conn(0x7f01300ade30 legacy=0x7f01300c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:28.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.084+0000 7f013502a640 1 -- 172.21.15.60:0/3487578483 >> v1:172.21.15.60:6789/0 conn(0x7f01300aea70 legacy=0x7f01300c38d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:32:28.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.084+0000 7f012f7fe640 1 -- 172.21.15.60:0/3487578483 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2473991688 0 0) 0x7f0130153750 con 0x7f01300ade30 2024-09-12T02:32:28.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.084+0000 7f013502a640 1 -- 172.21.15.60:0/3487578483 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0130153a30 con 0x7f01300a8090 2024-09-12T02:32:28.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.085+0000 7f013502a640 1 --2- 172.21.15.60:0/3487578483 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01300a8090 0x7f01300c3fe0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0130150e80 tx=0x7f012802a570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d7d22954ee048ae server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:28.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.085+0000 7f012f7fe640 1 -- 172.21.15.60:0/3487578483 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0128007740 con 0x7f01300a8090 2024-09-12T02:32:28.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.085+0000 7f012f7fe640 1 -- 172.21.15.60:0/3487578483 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01280078e0 con 0x7f01300a8090 2024-09-12T02:32:28.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.085+0000 7f012f7fe640 1 -- 172.21.15.60:0/3487578483 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0128007cb0 con 0x7f01300a8090 2024-09-12T02:32:28.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.085+0000 7f0136a8d640 1 -- 172.21.15.60:0/3487578483 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01300a8090 msgr2=0x7f01300c3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:28.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.085+0000 7f0136a8d640 1 --2- 172.21.15.60:0/3487578483 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01300a8090 0x7f01300c3fe0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0130150e80 tx=0x7f012802a570 comp rx=0 tx=0).stop 2024-09-12T02:32:28.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.086+0000 7f0136a8d640 1 -- 172.21.15.60:0/3487578483 shutdown_connections 2024-09-12T02:32:28.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.086+0000 7f0136a8d640 1 --2- 172.21.15.60:0/3487578483 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01300a8090 0x7f01300c3fe0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.086+0000 7f0136a8d640 1 -- 172.21.15.60:0/3487578483 >> 172.21.15.60:0/3487578483 conn(0x7f01300c5660 msgr2=0x7f01300c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:28.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.086+0000 7f0136a8d640 1 -- 172.21.15.60:0/3487578483 shutdown_connections 2024-09-12T02:32:28.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.086+0000 7f0136a8d640 1 -- 172.21.15.60:0/3487578483 wait complete. 2024-09-12T02:32:28.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.087+0000 7f0136a8d640 1 Processor -- start 2024-09-12T02:32:28.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.087+0000 7f0136a8d640 1 -- start start 2024-09-12T02:32:28.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.088+0000 7f0136a8d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f01300a8090 0x7f0130156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:28.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.088+0000 7f0136a8d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01300ade30 0x7f01301ea160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:28.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.088+0000 7f0136a8d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01300aea70 0x7f01300734f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:28.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.088+0000 7f0136a8d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f01300c8180 con 0x7f01300ade30 2024-09-12T02:32:28.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.088+0000 7f0136a8d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f01300c4520 con 0x7f01300aea70 2024-09-12T02:32:28.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.088+0000 7f0136a8d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f01300c8300 con 0x7f01300a8090 2024-09-12T02:32:28.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.088+0000 7f012ffff640 1 -- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01300ade30 msgr2=0x7f01301ea160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:32:28.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.088+0000 7f012ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01300ade30 0x7f01301ea160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:32:28.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.088+0000 7f0134829640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f01300a8090 0x7f0130156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:28.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.088+0000 7f013502a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01300aea70 0x7f01300734f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:28.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.088+0000 7f0134829640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f01300a8090 0x7f0130156f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:45722/0 (socket says 172.21.15.60:45722) 2024-09-12T02:32:28.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.088+0000 7f0134829640 1 -- 172.21.15.60:0/4281224230 learned_addr learned my addr 172.21.15.60:0/4281224230 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:32:28.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.088+0000 7f013502a640 1 -- 172.21.15.60:0/4281224230 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f01300a8090 msgr2=0x7f0130156f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:28.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.088+0000 7f013502a640 1 --2- 172.21.15.60:0/4281224230 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f01300a8090 0x7f0130156f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.088+0000 7f013502a640 1 -- 172.21.15.60:0/4281224230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01300ade30 msgr2=0x7f01301ea160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:32:28.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.088+0000 7f013502a640 1 --2- 172.21.15.60:0/4281224230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01300ade30 0x7f01301ea160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.088+0000 7f013502a640 1 -- 172.21.15.60:0/4281224230 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0130151a50 con 0x7f01300aea70 2024-09-12T02:32:28.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.088+0000 7f0134829640 1 --2- 172.21.15.60:0/4281224230 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f01300a8090 0x7f0130156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:32:28.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.088+0000 7f013502a640 1 --2- 172.21.15.60:0/4281224230 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01300aea70 0x7f01300734f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0128031000 tx=0x7f0128004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:28.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.089+0000 7f012d7fa640 1 -- 172.21.15.60:0/4281224230 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0128040070 con 0x7f01300aea70 2024-09-12T02:32:28.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.089+0000 7f012d7fa640 1 -- 172.21.15.60:0/4281224230 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0128031c90 con 0x7f01300aea70 2024-09-12T02:32:28.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.089+0000 7f0136a8d640 1 -- 172.21.15.60:0/4281224230 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01301ea6a0 con 0x7f01300aea70 2024-09-12T02:32:28.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.089+0000 7f012d7fa640 1 -- 172.21.15.60:0/4281224230 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0128045680 con 0x7f01300aea70 2024-09-12T02:32:28.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.089+0000 7f0136a8d640 1 -- 172.21.15.60:0/4281224230 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f013006c790 con 0x7f01300aea70 2024-09-12T02:32:28.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.090+0000 7f0136a8d640 1 -- 172.21.15.60:0/4281224230 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0130153040 con 0x7f01300aea70 2024-09-12T02:32:28.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.090+0000 7f012d7fa640 1 -- 172.21.15.60:0/4281224230 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0128039040 con 0x7f01300aea70 2024-09-12T02:32:28.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.091+0000 7f012d7fa640 1 --2- 172.21.15.60:0/4281224230 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f011406be10 0x7f011406e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:28.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.091+0000 7f012d7fa640 1 -- 172.21.15.60:0/4281224230 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f01280ac800 con 0x7f01300aea70 2024-09-12T02:32:28.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.091+0000 7f0134829640 1 --2- 172.21.15.60:0/4281224230 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f011406be10 0x7f011406e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:28.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.091+0000 7f0134829640 1 --2- 172.21.15.60:0/4281224230 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f011406be10 0x7f011406e2d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0124000f60 tx=0x7f0124007e10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:28.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.096+0000 7f012d7fa640 1 -- 172.21.15.60:0/4281224230 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f01301ea6a0 con 0x7f01300aea70 2024-09-12T02:32:28.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.418+0000 7f0136a8d640 1 -- 172.21.15.60:0/4281224230 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f01300c7f30 con 0x7f01300aea70 2024-09-12T02:32:28.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.418+0000 7f012d7fa640 1 -- 172.21.15.60:0/4281224230 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f012804a060 con 0x7f01300aea70 2024-09-12T02:32:28.419 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":82,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:32:28.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.420+0000 7f0136a8d640 1 -- 172.21.15.60:0/4281224230 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f011406be10 msgr2=0x7f011406e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:28.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.420+0000 7f0136a8d640 1 --2- 172.21.15.60:0/4281224230 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f011406be10 0x7f011406e2d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0124000f60 tx=0x7f0124007e10 comp rx=0 tx=0).stop 2024-09-12T02:32:28.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.420+0000 7f0136a8d640 1 -- 172.21.15.60:0/4281224230 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01300aea70 msgr2=0x7f01300734f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:28.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.420+0000 7f0136a8d640 1 --2- 172.21.15.60:0/4281224230 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01300aea70 0x7f01300734f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0128031000 tx=0x7f0128004a40 comp rx=0 tx=0).stop 2024-09-12T02:32:28.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.421+0000 7f0136a8d640 1 -- 172.21.15.60:0/4281224230 shutdown_connections 2024-09-12T02:32:28.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.421+0000 7f0136a8d640 1 --2- 172.21.15.60:0/4281224230 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f011406be10 0x7f011406e2d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.421+0000 7f0136a8d640 1 --2- 172.21.15.60:0/4281224230 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01300aea70 0x7f01300734f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.421+0000 7f0136a8d640 1 --2- 172.21.15.60:0/4281224230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01300ade30 0x7f01301ea160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.421+0000 7f0136a8d640 1 --2- 172.21.15.60:0/4281224230 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f01300a8090 0x7f0130156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:28.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.421+0000 7f0136a8d640 1 -- 172.21.15.60:0/4281224230 >> 172.21.15.60:0/4281224230 conn(0x7f01300c5660 msgr2=0x7f01300c4800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:28.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.421+0000 7f0136a8d640 1 -- 172.21.15.60:0/4281224230 shutdown_connections 2024-09-12T02:32:28.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:28.421+0000 7f0136a8d640 1 -- 172.21.15.60:0/4281224230 wait complete. 2024-09-12T02:32:29.447 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:32:29.450 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:32:31.436 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:32:31.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.550+0000 7f04ddb78640 1 Processor -- start 2024-09-12T02:32:31.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.550+0000 7f04ddb78640 1 -- start start 2024-09-12T02:32:31.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.551+0000 7f04ddb78640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f04d806cd80 0x7f04d8153be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:31.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.551+0000 7f04ddb78640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f04d815a4a0 0x7f04d8156660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:31.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.551+0000 7f04ddb78640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04d80c7070 con 0x7f04d80c8b10 2024-09-12T02:32:31.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.551+0000 7f04ddb78640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f04d806d210 con 0x7f04d815a4a0 2024-09-12T02:32:31.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.551+0000 7f04ddb78640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f04d80c69b0 con 0x7f04d806cd80 2024-09-12T02:32:31.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.551+0000 7f04d7fff640 1 -- >> v2:172.21.15.60:3300/0 conn(0x7f04d815a4a0 msgr2=0x7f04d8156660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:32:31.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.551+0000 7f04d77fe640 1 -- >> v1:172.21.15.60:6789/0 conn(0x7f04d80c8b10 legacy=0x7f04d81534d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:32:31.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.551+0000 7f04d7fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f04d815a4a0 0x7f04d8156660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:32:31.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.551+0000 7f04d6ffd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f04d806cd80 0x7f04d8153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:31.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.551+0000 7f04d6ffd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f04d806cd80 0x7f04d8153be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:56862/0 (socket says 172.21.15.60:56862) 2024-09-12T02:32:31.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.551+0000 7f04d6ffd640 1 -- 172.21.15.60:0/3234568748 learned_addr learned my addr 172.21.15.60:0/3234568748 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:32:31.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.551+0000 7f04d6ffd640 1 -- 172.21.15.60:0/3234568748 >> v2:172.21.15.60:3300/0 conn(0x7f04d815a4a0 msgr2=0x7f04d8156660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:32:31.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.551+0000 7f04d6ffd640 1 --2- 172.21.15.60:0/3234568748 >> v2:172.21.15.60:3300/0 conn(0x7f04d815a4a0 0x7f04d8156660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:31.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.551+0000 7f04d6ffd640 1 -- 172.21.15.60:0/3234568748 >> v1:172.21.15.60:6789/0 conn(0x7f04d80c8b10 legacy=0x7f04d81534d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:32:31.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.551+0000 7f04d6ffd640 1 -- 172.21.15.60:0/3234568748 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04d80c6c90 con 0x7f04d806cd80 2024-09-12T02:32:31.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.552+0000 7f04d6ffd640 1 --2- 172.21.15.60:0/3234568748 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04d806cd80 0x7f04d8153be0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f04d806ec00 tx=0x7f04cc02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b57134116060c8dd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:31.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.552+0000 7f04d67fc640 1 -- 172.21.15.60:0/3234568748 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04cc037070 con 0x7f04d806cd80 2024-09-12T02:32:31.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.552+0000 7f04d67fc640 1 -- 172.21.15.60:0/3234568748 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04cc032440 con 0x7f04d806cd80 2024-09-12T02:32:31.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.552+0000 7f04d67fc640 1 -- 172.21.15.60:0/3234568748 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04cc032810 con 0x7f04d806cd80 2024-09-12T02:32:31.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.553+0000 7f04ddb78640 1 -- 172.21.15.60:0/3234568748 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04d806cd80 msgr2=0x7f04d8153be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:31.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.553+0000 7f04ddb78640 1 --2- 172.21.15.60:0/3234568748 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04d806cd80 0x7f04d8153be0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f04d806ec00 tx=0x7f04cc02a1c0 comp rx=0 tx=0).stop 2024-09-12T02:32:31.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.553+0000 7f04ddb78640 1 -- 172.21.15.60:0/3234568748 shutdown_connections 2024-09-12T02:32:31.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.553+0000 7f04ddb78640 1 --2- 172.21.15.60:0/3234568748 >> v2:172.21.15.60:3300/0 conn(0x7f04d815a4a0 0x7f04d8156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:31.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.553+0000 7f04ddb78640 1 --2- 172.21.15.60:0/3234568748 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04d806cd80 0x7f04d8153be0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:31.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.553+0000 7f04ddb78640 1 -- 172.21.15.60:0/3234568748 >> 172.21.15.60:0/3234568748 conn(0x7f04d80adb80 msgr2=0x7f04d80adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:31.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.553+0000 7f04ddb78640 1 -- 172.21.15.60:0/3234568748 shutdown_connections 2024-09-12T02:32:31.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.553+0000 7f04ddb78640 1 -- 172.21.15.60:0/3234568748 wait complete. 2024-09-12T02:32:31.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.554+0000 7f04ddb78640 1 Processor -- start 2024-09-12T02:32:31.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.554+0000 7f04ddb78640 1 -- start start 2024-09-12T02:32:31.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.555+0000 7f04ddb78640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04d80c8b10 0x7f04d81e0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:31.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.555+0000 7f04ddb78640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04d815a4a0 0x7f04d814a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:31.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.555+0000 7f04ddb78640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f04d8150740 0x7f04d806be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:31.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.555+0000 7f04ddb78640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f04d80c9070 con 0x7f04d815a4a0 2024-09-12T02:32:31.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.555+0000 7f04ddb78640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f04d80c8ef0 con 0x7f04d80c8b10 2024-09-12T02:32:31.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.555+0000 7f04ddb78640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f04d8156ba0 con 0x7f04d8150740 2024-09-12T02:32:31.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.555+0000 7f04d6ffd640 1 -- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04d815a4a0 msgr2=0x7f04d814a450 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:32:31.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.555+0000 7f04d6ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04d815a4a0 0x7f04d814a450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:32:31.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.555+0000 7f04d77fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04d80c8b10 0x7f04d81e0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:31.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.555+0000 7f04d77fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04d80c8b10 0x7f04d81e0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:56870/0 (socket says 172.21.15.60:56870) 2024-09-12T02:32:31.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.555+0000 7f04d77fe640 1 -- 172.21.15.60:0/2039427988 learned_addr learned my addr 172.21.15.60:0/2039427988 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:32:31.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.555+0000 7f04d7fff640 1 --2- 172.21.15.60:0/2039427988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f04d8150740 0x7f04d806be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:31.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.556+0000 7f04d7fff640 1 -- 172.21.15.60:0/2039427988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04d80c8b10 msgr2=0x7f04d81e0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:31.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.556+0000 7f04d7fff640 1 --2- 172.21.15.60:0/2039427988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04d80c8b10 0x7f04d81e0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:31.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.556+0000 7f04d7fff640 1 -- 172.21.15.60:0/2039427988 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04d815a4a0 msgr2=0x7f04d814a450 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:32:31.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.556+0000 7f04d7fff640 1 --2- 172.21.15.60:0/2039427988 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04d815a4a0 0x7f04d814a450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:31.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.556+0000 7f04d7fff640 1 -- 172.21.15.60:0/2039427988 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04d8157740 con 0x7f04d8150740 2024-09-12T02:32:31.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.556+0000 7f04d77fe640 1 --2- 172.21.15.60:0/2039427988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04d80c8b10 0x7f04d81e0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:32:31.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.556+0000 7f04d7fff640 1 --2- 172.21.15.60:0/2039427988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f04d8150740 0x7f04d806be50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f04d000be00 tx=0x7f04d000bef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:31.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.556+0000 7f04bffff640 1 -- 172.21.15.60:0/2039427988 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d0016430 con 0x7f04d8150740 2024-09-12T02:32:31.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.556+0000 7f04bffff640 1 -- 172.21.15.60:0/2039427988 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04d0010030 con 0x7f04d8150740 2024-09-12T02:32:31.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.556+0000 7f04bffff640 1 -- 172.21.15.60:0/2039427988 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d0016830 con 0x7f04d8150740 2024-09-12T02:32:31.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.556+0000 7f04ddb78640 1 -- 172.21.15.60:0/2039427988 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04d81ed0a0 con 0x7f04d8150740 2024-09-12T02:32:31.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.556+0000 7f04ddb78640 1 -- 172.21.15.60:0/2039427988 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f04d81593f0 con 0x7f04d8150740 2024-09-12T02:32:31.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.557+0000 7f04ddb78640 1 -- 172.21.15.60:0/2039427988 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04d8157c20 con 0x7f04d8150740 2024-09-12T02:32:31.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.558+0000 7f04bffff640 1 -- 172.21.15.60:0/2039427988 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f04d00153e0 con 0x7f04d8150740 2024-09-12T02:32:31.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.558+0000 7f04bffff640 1 --2- 172.21.15.60:0/2039427988 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f04c406be10 0x7f04c406e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:31.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.558+0000 7f04d77fe640 1 --2- 172.21.15.60:0/2039427988 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f04c406be10 0x7f04c406e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:31.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.558+0000 7f04bffff640 1 -- 172.21.15.60:0/2039427988 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f04d008b3c0 con 0x7f04d8150740 2024-09-12T02:32:31.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.559+0000 7f04d77fe640 1 --2- 172.21.15.60:0/2039427988 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f04c406be10 0x7f04c406e2d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f04d8158f40 tx=0x7f04c8009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:31.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.564+0000 7f04bffff640 1 -- 172.21.15.60:0/2039427988 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f04d8157c20 con 0x7f04d8150740 2024-09-12T02:32:31.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.850+0000 7f04ddb78640 1 -- 172.21.15.60:0/2039427988 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f04d81542c0 con 0x7f04d8150740 2024-09-12T02:32:31.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.851+0000 7f04bffff640 1 -- 172.21.15.60:0/2039427988 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f04d0059410 con 0x7f04d8150740 2024-09-12T02:32:31.851 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":82,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:32:31.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.853+0000 7f04ddb78640 1 -- 172.21.15.60:0/2039427988 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f04c406be10 msgr2=0x7f04c406e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:31.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.853+0000 7f04ddb78640 1 --2- 172.21.15.60:0/2039427988 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f04c406be10 0x7f04c406e2d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f04d8158f40 tx=0x7f04c8009190 comp rx=0 tx=0).stop 2024-09-12T02:32:31.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.853+0000 7f04ddb78640 1 -- 172.21.15.60:0/2039427988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f04d8150740 msgr2=0x7f04d806be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:31.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.853+0000 7f04ddb78640 1 --2- 172.21.15.60:0/2039427988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f04d8150740 0x7f04d806be50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f04d000be00 tx=0x7f04d000bef0 comp rx=0 tx=0).stop 2024-09-12T02:32:31.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.853+0000 7f04ddb78640 1 -- 172.21.15.60:0/2039427988 shutdown_connections 2024-09-12T02:32:31.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.853+0000 7f04ddb78640 1 --2- 172.21.15.60:0/2039427988 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f04c406be10 0x7f04c406e2d0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:31.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.853+0000 7f04ddb78640 1 --2- 172.21.15.60:0/2039427988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f04d8150740 0x7f04d806be50 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:31.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.853+0000 7f04ddb78640 1 --2- 172.21.15.60:0/2039427988 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04d815a4a0 0x7f04d814a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:31.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.853+0000 7f04ddb78640 1 --2- 172.21.15.60:0/2039427988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04d80c8b10 0x7f04d81e0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:31.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.853+0000 7f04ddb78640 1 -- 172.21.15.60:0/2039427988 >> 172.21.15.60:0/2039427988 conn(0x7f04d80adb80 msgr2=0x7f04d81527b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:31.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.853+0000 7f04ddb78640 1 -- 172.21.15.60:0/2039427988 shutdown_connections 2024-09-12T02:32:31.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:31.853+0000 7f04ddb78640 1 -- 172.21.15.60:0/2039427988 wait complete. 2024-09-12T02:32:34.866 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:32:34.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:34.974+0000 7f3a0420e640 1 Processor -- start 2024-09-12T02:32:34.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:34.974+0000 7f3a0420e640 1 -- start start 2024-09-12T02:32:34.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:34.975+0000 7f3a0420e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f39fc073f80 0x7f39fc071350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:34.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:34.975+0000 7f3a0420e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39fc06e200 con 0x7f39fc074570 2024-09-12T02:32:34.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:34.975+0000 7f3a0420e640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39fc154bc0 con 0x7f39fc0ad9d0 2024-09-12T02:32:34.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:34.975+0000 7f3a0420e640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f39fc154ea0 con 0x7f39fc073f80 2024-09-12T02:32:34.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:34.975+0000 7f3a017a9640 1 -- >> v1:172.21.15.60:6789/0 conn(0x7f39fc074570 legacy=0x7f39fc073870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:32:34.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:34.975+0000 7f3a027ab640 1 -- >> v2:172.21.15.60:3300/0 conn(0x7f39fc073f80 msgr2=0x7f39fc071350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:32:34.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:34.975+0000 7f3a027ab640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f39fc073f80 0x7f39fc071350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:32:34.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:34.975+0000 7f3a01faa640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f39fc0ad9d0 0x7f39fc1513c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:59356/0 (socket says 172.21.15.60:59356) 2024-09-12T02:32:34.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:34.975+0000 7f3a01faa640 1 -- 172.21.15.60:0/3413289016 learned_addr learned my addr 172.21.15.60:0/3413289016 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:32:35.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:35.176+0000 7f3a017a9640 1 -- 172.21.15.60:0/3413289016 >> v1:172.21.15.60:6789/0 conn(0x7f39fc074570 legacy=0x7f39fc073870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:32:35.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:35.176+0000 7f3a027ab640 1 -- 172.21.15.60:0/3413289016 >> v2:172.21.15.60:3300/0 conn(0x7f39fc073f80 msgr2=0x7f39fc071350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:32:35.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:35.176+0000 7f3a027ab640 1 --2- 172.21.15.60:0/3413289016 >> v2:172.21.15.60:3300/0 conn(0x7f39fc073f80 0x7f39fc071350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:32:35.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:35.576+0000 7f3a027ab640 1 -- 172.21.15.60:0/3413289016 >> v2:172.21.15.60:3300/0 conn(0x7f39fc073f80 msgr2=0x7f39fc071350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:32:35.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:35.576+0000 7f3a017a9640 1 -- 172.21.15.60:0/3413289016 >> v1:172.21.15.60:6789/0 conn(0x7f39fc074570 legacy=0x7f39fc073870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:32:35.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:35.576+0000 7f3a027ab640 1 --2- 172.21.15.60:0/3413289016 >> v2:172.21.15.60:3300/0 conn(0x7f39fc073f80 0x7f39fc071350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:32:36.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:36.377+0000 7f3a027ab640 1 -- 172.21.15.60:0/3413289016 >> v2:172.21.15.60:3300/0 conn(0x7f39fc073f80 msgr2=0x7f39fc071350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:32:36.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:36.377+0000 7f3a017a9640 1 -- 172.21.15.60:0/3413289016 >> v1:172.21.15.60:6789/0 conn(0x7f39fc074570 legacy=0x7f39fc073870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:32:36.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:36.377+0000 7f3a027ab640 1 --2- 172.21.15.60:0/3413289016 >> v2:172.21.15.60:3300/0 conn(0x7f39fc073f80 0x7f39fc071350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:32:37.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:37.974+0000 7f39f37fe640 1 -- 172.21.15.60:0/3413289016 >> v2:172.21.15.60:3300/0 conn(0x7f39fc073f80 msgr2=0x7f39fc071350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:32:37.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:37.974+0000 7f39f37fe640 1 --2- 172.21.15.60:0/3413289016 >> v2:172.21.15.60:3300/0 conn(0x7f39fc073f80 0x7f39fc071350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:37.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:37.974+0000 7f39f37fe640 1 -- 172.21.15.60:0/3413289016 >> v1:172.21.15.105:6789/0 conn(0x7f39fc0ad9d0 legacy=0x7f39fc1513c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:37.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:37.974+0000 7f39f37fe640 1 -- 172.21.15.60:0/3413289016 >> v1:172.21.15.60:6789/0 conn(0x7f39fc074570 legacy=0x7f39fc073870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:32:37.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:37.974+0000 7f39f37fe640 1 --2- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39e00036c0 0x7f39e0005af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:37.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:37.974+0000 7f39f37fe640 1 --2- 172.21.15.60:0/3413289016 >> v2:172.21.15.105:3300/0 conn(0x7f39e0006180 0x7f39e0008640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:37.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:37.974+0000 7f39f37fe640 1 -- 172.21.15.60:0/3413289016 --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f39fc154ea0 con 0x7f39e0006180 2024-09-12T02:32:37.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:37.974+0000 7f39f37fe640 1 -- 172.21.15.60:0/3413289016 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f39e0008cf0 con 0x7f39e00036c0 2024-09-12T02:32:37.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:37.974+0000 7f3a01faa640 1 --2- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39e00036c0 0x7f39e0005af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:37.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:37.974+0000 7f3a017a9640 1 --2- 172.21.15.60:0/3413289016 >> v2:172.21.15.105:3300/0 conn(0x7f39e0006180 0x7f39e0008640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:37.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:37.974+0000 7f3a01faa640 1 -- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39e00036c0 msgr2=0x7f39e0005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:32:37.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:37.974+0000 7f3a01faa640 1 -- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39e00036c0 msgr2=0x7f39e0005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:32:37.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:37.974+0000 7f3a01faa640 1 --2- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39e00036c0 0x7f39e0005af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:32:37.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:37.974+0000 7f3a01faa640 1 --2- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39e00036c0 0x7f39e0005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:32:37.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:37.975+0000 7f3a017a9640 1 -- 172.21.15.60:0/3413289016 >> v2:172.21.15.105:3300/0 conn(0x7f39e0006180 msgr2=0x7f39e0008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:32:37.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:37.975+0000 7f3a017a9640 1 -- 172.21.15.60:0/3413289016 >> v2:172.21.15.105:3300/0 conn(0x7f39e0006180 msgr2=0x7f39e0008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:32:37.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:37.975+0000 7f3a017a9640 1 --2- 172.21.15.60:0/3413289016 >> v2:172.21.15.105:3300/0 conn(0x7f39e0006180 0x7f39e0008640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:32:37.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:37.975+0000 7f3a017a9640 1 --2- 172.21.15.60:0/3413289016 >> v2:172.21.15.105:3300/0 conn(0x7f39e0006180 0x7f39e0008640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:32:38.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:38.175+0000 7f3a01faa640 1 --2- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39e00036c0 0x7f39e0005af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:38.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:38.175+0000 7f3a01faa640 1 -- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39e00036c0 msgr2=0x7f39e0005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:32:38.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:38.175+0000 7f3a01faa640 1 -- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39e00036c0 msgr2=0x7f39e0005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:32:38.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:38.175+0000 7f3a01faa640 1 --2- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39e00036c0 0x7f39e0005af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:32:38.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:38.175+0000 7f3a01faa640 1 --2- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39e00036c0 0x7f39e0005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:32:38.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:38.176+0000 7f3a017a9640 1 --2- 172.21.15.60:0/3413289016 >> v2:172.21.15.105:3300/0 conn(0x7f39e0006180 0x7f39e0008640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:38.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:38.176+0000 7f3a017a9640 1 -- 172.21.15.60:0/3413289016 >> v2:172.21.15.105:3300/0 conn(0x7f39e0006180 msgr2=0x7f39e0008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:32:38.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:38.176+0000 7f3a017a9640 1 -- 172.21.15.60:0/3413289016 >> v2:172.21.15.105:3300/0 conn(0x7f39e0006180 msgr2=0x7f39e0008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:32:38.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:38.176+0000 7f3a017a9640 1 --2- 172.21.15.60:0/3413289016 >> v2:172.21.15.105:3300/0 conn(0x7f39e0006180 0x7f39e0008640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:32:38.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:38.176+0000 7f3a017a9640 1 --2- 172.21.15.60:0/3413289016 >> v2:172.21.15.105:3300/0 conn(0x7f39e0006180 0x7f39e0008640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:32:38.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:38.576+0000 7f3a01faa640 1 --2- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39e00036c0 0x7f39e0005af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:38.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:38.576+0000 7f3a01faa640 1 -- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39e00036c0 msgr2=0x7f39e0005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:32:38.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:38.576+0000 7f3a01faa640 1 -- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39e00036c0 msgr2=0x7f39e0005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:32:38.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:38.576+0000 7f3a01faa640 1 --2- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39e00036c0 0x7f39e0005af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:32:38.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:38.576+0000 7f3a01faa640 1 --2- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39e00036c0 0x7f39e0005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:32:38.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:38.577+0000 7f3a017a9640 1 --2- 172.21.15.60:0/3413289016 >> v2:172.21.15.105:3300/0 conn(0x7f39e0006180 0x7f39e0008640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:38.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:38.577+0000 7f3a017a9640 1 -- 172.21.15.60:0/3413289016 >> v2:172.21.15.105:3300/0 conn(0x7f39e0006180 msgr2=0x7f39e0008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:32:38.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:38.577+0000 7f3a017a9640 1 -- 172.21.15.60:0/3413289016 >> v2:172.21.15.105:3300/0 conn(0x7f39e0006180 msgr2=0x7f39e0008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:32:38.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:38.577+0000 7f3a017a9640 1 --2- 172.21.15.60:0/3413289016 >> v2:172.21.15.105:3300/0 conn(0x7f39e0006180 0x7f39e0008640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:32:38.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:38.577+0000 7f3a017a9640 1 --2- 172.21.15.60:0/3413289016 >> v2:172.21.15.105:3300/0 conn(0x7f39e0006180 0x7f39e0008640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:32:39.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:39.377+0000 7f3a01faa640 1 --2- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39e00036c0 0x7f39e0005af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:39.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:39.377+0000 7f3a01faa640 1 -- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39e00036c0 msgr2=0x7f39e0005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:32:39.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:39.377+0000 7f3a01faa640 1 -- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39e00036c0 msgr2=0x7f39e0005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:32:39.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:39.377+0000 7f3a01faa640 1 --2- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39e00036c0 0x7f39e0005af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:32:39.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:39.377+0000 7f3a01faa640 1 --2- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39e00036c0 0x7f39e0005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:32:39.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:39.378+0000 7f3a017a9640 1 --2- 172.21.15.60:0/3413289016 >> v2:172.21.15.105:3300/0 conn(0x7f39e0006180 0x7f39e0008640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:39.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:39.378+0000 7f3a017a9640 1 -- 172.21.15.60:0/3413289016 >> v2:172.21.15.105:3300/0 conn(0x7f39e0006180 msgr2=0x7f39e0008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:32:39.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:39.378+0000 7f3a017a9640 1 -- 172.21.15.60:0/3413289016 >> v2:172.21.15.105:3300/0 conn(0x7f39e0006180 msgr2=0x7f39e0008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:32:39.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:39.378+0000 7f3a017a9640 1 --2- 172.21.15.60:0/3413289016 >> v2:172.21.15.105:3300/0 conn(0x7f39e0006180 0x7f39e0008640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:32:39.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:39.378+0000 7f3a017a9640 1 --2- 172.21.15.60:0/3413289016 >> v2:172.21.15.105:3300/0 conn(0x7f39e0006180 0x7f39e0008640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:32:40.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:40.974+0000 7f39f37fe640 1 -- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39e00036c0 msgr2=0x7f39e0005af0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:32:40.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:40.974+0000 7f39f37fe640 1 --2- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39e00036c0 0x7f39e0005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:40.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:40.974+0000 7f39f37fe640 1 -- 172.21.15.60:0/3413289016 >> v2:172.21.15.105:3300/0 conn(0x7f39e0006180 msgr2=0x7f39e0008640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:32:40.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:40.974+0000 7f39f37fe640 1 --2- 172.21.15.60:0/3413289016 >> v2:172.21.15.105:3300/0 conn(0x7f39e0006180 0x7f39e0008640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:40.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:40.974+0000 7f3a027ab640 1 -- 172.21.15.60:0/3413289016 reap_dead start 2024-09-12T02:32:40.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:40.974+0000 7f39f37fe640 1 --2- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39e000c190 0x7f39e000e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:40.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:40.974+0000 7f39f37fe640 1 -- 172.21.15.60:0/3413289016 --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39fc073070 con 0x7f39e0007d50 2024-09-12T02:32:40.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:40.974+0000 7f39f37fe640 1 -- 172.21.15.60:0/3413289016 --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39fc06e200 con 0x7f39e0003ae0 2024-09-12T02:32:40.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:40.974+0000 7f39f37fe640 1 -- 172.21.15.60:0/3413289016 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f39fc154ea0 con 0x7f39e000c190 2024-09-12T02:32:40.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:40.974+0000 7f3a017a9640 1 -- 172.21.15.60:0/3413289016 >> v1:172.21.15.60:6789/0 conn(0x7f39e0007d50 legacy=0x7f39e0008150 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:32:40.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:40.975+0000 7f3a027ab640 1 --2- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39e000c190 0x7f39e000e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:40.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:40.975+0000 7f3a027ab640 1 -- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39e000c190 msgr2=0x7f39e000e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:32:40.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:40.975+0000 7f3a027ab640 1 -- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39e000c190 msgr2=0x7f39e000e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:32:40.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:40.975+0000 7f3a027ab640 1 --2- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39e000c190 0x7f39e000e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:32:40.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:40.975+0000 7f3a027ab640 1 --2- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39e000c190 0x7f39e000e580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:32:41.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:41.176+0000 7f3a017a9640 1 -- 172.21.15.60:0/3413289016 >> v1:172.21.15.60:6789/0 conn(0x7f39e0007d50 legacy=0x7f39e0008150 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:32:41.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:41.176+0000 7f3a027ab640 1 --2- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39e000c190 0x7f39e000e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:41.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:41.176+0000 7f3a027ab640 1 -- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39e000c190 msgr2=0x7f39e000e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:32:41.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:41.176+0000 7f3a027ab640 1 -- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39e000c190 msgr2=0x7f39e000e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:32:41.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:41.176+0000 7f3a027ab640 1 --2- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39e000c190 0x7f39e000e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:32:41.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:41.176+0000 7f3a027ab640 1 --2- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39e000c190 0x7f39e000e580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:32:41.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:41.577+0000 7f3a017a9640 1 -- 172.21.15.60:0/3413289016 >> v1:172.21.15.60:6789/0 conn(0x7f39e0007d50 legacy=0x7f39e0008150 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:32:41.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:41.577+0000 7f3a027ab640 1 --2- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39e000c190 0x7f39e000e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:41.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:41.577+0000 7f3a027ab640 1 -- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39e000c190 msgr2=0x7f39e000e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:32:41.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:41.577+0000 7f3a027ab640 1 -- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39e000c190 msgr2=0x7f39e000e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:32:41.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:41.577+0000 7f3a027ab640 1 --2- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39e000c190 0x7f39e000e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:32:41.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:41.577+0000 7f3a027ab640 1 --2- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39e000c190 0x7f39e000e580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:32:42.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.304+0000 7f3a00fa8640 1 -- 172.21.15.60:0/3413289016 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2521287599 0 0) 0x7f39fc06e200 con 0x7f39e0003ae0 2024-09-12T02:32:42.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.304+0000 7f3a00fa8640 1 -- 172.21.15.60:0/3413289016 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f39e8003520 con 0x7f39e0003ae0 2024-09-12T02:32:42.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.309+0000 7f3a00fa8640 1 -- 172.21.15.60:0/3413289016 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1561607069 0 0) 0x7f39e8003520 con 0x7f39e0003ae0 2024-09-12T02:32:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.309+0000 7f3a00fa8640 1 -- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39e000c190 msgr2=0x7f39e000e580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:32:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.309+0000 7f3a00fa8640 1 --2- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39e000c190 0x7f39e000e580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.309+0000 7f3a00fa8640 1 -- 172.21.15.60:0/3413289016 >> v1:172.21.15.60:6789/0 conn(0x7f39e0007d50 legacy=0x7f39e0008150 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:32:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.309+0000 7f3a00fa8640 1 -- 172.21.15.60:0/3413289016 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39e0010c40 con 0x7f39e0003ae0 2024-09-12T02:32:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.309+0000 7f3a00fa8640 1 -- 172.21.15.60:0/3413289016 <== mon.1 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7f39f8001d80 con 0x7f39e0003ae0 2024-09-12T02:32:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.309+0000 7f3a00fa8640 1 -- 172.21.15.60:0/3413289016 >> v1:172.21.15.105:6789/0 conn(0x7f39e0003ae0 legacy=0x7f39e0006630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.309+0000 7f3a00fa8640 1 --2- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39e80039b0 0x7f39e8003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.309+0000 7f3a00fa8640 1 --2- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39e000c190 0x7f39e8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.309+0000 7f3a00fa8640 1 --2- 172.21.15.60:0/3413289016 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39e8004d40 0x7f39e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.309+0000 7f3a00fa8640 1 -- 172.21.15.60:0/3413289016 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f39fc154ea0 con 0x7f39e8004d40 2024-09-12T02:32:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.309+0000 7f3a00fa8640 1 -- 172.21.15.60:0/3413289016 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f39e800bb80 con 0x7f39e80039b0 2024-09-12T02:32:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.309+0000 7f3a00fa8640 1 -- 172.21.15.60:0/3413289016 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f39e800bd80 con 0x7f39e000c190 2024-09-12T02:32:42.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.309+0000 7f3a027ab640 1 -- 172.21.15.60:0/3413289016 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39e8004d40 msgr2=0x7f39e80051c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:32:42.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.309+0000 7f3a027ab640 1 --2- 172.21.15.60:0/3413289016 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39e8004d40 0x7f39e80051c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:32:42.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.309+0000 7f3a01faa640 1 --2- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39e80039b0 0x7f39e8003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:42.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.309+0000 7f3a017a9640 1 --2- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39e000c190 0x7f39e8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:42.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.310+0000 7f3a01faa640 1 -- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39e000c190 msgr2=0x7f39e8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:32:42.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.310+0000 7f3a01faa640 1 --2- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39e000c190 0x7f39e8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.310+0000 7f3a01faa640 1 -- 172.21.15.60:0/3413289016 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39e8004d40 msgr2=0x7f39e80051c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:32:42.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.310+0000 7f3a01faa640 1 --2- 172.21.15.60:0/3413289016 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39e8004d40 0x7f39e80051c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.310+0000 7f3a01faa640 1 -- 172.21.15.60:0/3413289016 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39e8003520 con 0x7f39e80039b0 2024-09-12T02:32:42.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.311+0000 7f3a01faa640 1 --2- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39e80039b0 0x7f39e8003db0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f39f8001330 tx=0x7f39e8005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bd2625b3326a5bc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:42.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.311+0000 7f3a00fa8640 1 -- 172.21.15.60:0/3413289016 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f8007300 con 0x7f39e80039b0 2024-09-12T02:32:42.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.311+0000 7f3a00fa8640 1 -- 172.21.15.60:0/3413289016 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39f8038070 con 0x7f39e80039b0 2024-09-12T02:32:42.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.311+0000 7f3a00fa8640 1 -- 172.21.15.60:0/3413289016 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f8033630 con 0x7f39e80039b0 2024-09-12T02:32:42.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.312+0000 7f3a0420e640 1 -- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39e80039b0 msgr2=0x7f39e8003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:42.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.312+0000 7f3a0420e640 1 --2- 172.21.15.60:0/3413289016 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39e80039b0 0x7f39e8003db0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f39f8001330 tx=0x7f39e8005830 comp rx=0 tx=0).stop 2024-09-12T02:32:42.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.312+0000 7f3a027ab640 1 -- 172.21.15.60:0/3413289016 reap_dead start 2024-09-12T02:32:42.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.312+0000 7f3a0420e640 1 -- 172.21.15.60:0/3413289016 shutdown_connections 2024-09-12T02:32:42.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.312+0000 7f3a0420e640 1 -- 172.21.15.60:0/3413289016 >> 172.21.15.60:0/3413289016 conn(0x7f39fc0c4ea0 msgr2=0x7f39fc0c52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:42.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.312+0000 7f3a0420e640 1 -- 172.21.15.60:0/3413289016 shutdown_connections 2024-09-12T02:32:42.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.312+0000 7f3a0420e640 1 -- 172.21.15.60:0/3413289016 wait complete. 2024-09-12T02:32:42.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.313+0000 7f3a0420e640 1 Processor -- start 2024-09-12T02:32:42.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.314+0000 7f3a0420e640 1 -- start start 2024-09-12T02:32:42.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.314+0000 7f3a0420e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39e80039b0 0x7f39fc0c1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:42.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.314+0000 7f3a0420e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39fc06f890 0x7f39fc0acc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:42.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.314+0000 7f3a0420e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39fc0ad1c0 0x7f39fc145650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:42.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.314+0000 7f3a0420e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f39fc0addb0 con 0x7f39e80039b0 2024-09-12T02:32:42.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.314+0000 7f3a0420e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f39fc072d00 con 0x7f39fc06f890 2024-09-12T02:32:42.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.314+0000 7f3a0420e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f39fc0adf30 con 0x7f39fc0ad1c0 2024-09-12T02:32:42.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.314+0000 7f3a01faa640 1 -- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39e80039b0 msgr2=0x7f39fc0c1a40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:32:42.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.314+0000 7f3a01faa640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39e80039b0 0x7f39fc0c1a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:32:42.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.315+0000 7f3a027ab640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39fc0ad1c0 0x7f39fc145650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:42.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.315+0000 7f3a017a9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39fc06f890 0x7f39fc0acc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:42.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.315+0000 7f3a027ab640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39fc0ad1c0 0x7f39fc145650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:48718/0 (socket says 172.21.15.60:48718) 2024-09-12T02:32:42.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.315+0000 7f3a027ab640 1 -- 172.21.15.60:0/2937305329 learned_addr learned my addr 172.21.15.60:0/2937305329 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:32:42.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.315+0000 7f3a027ab640 1 -- 172.21.15.60:0/2937305329 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39fc06f890 msgr2=0x7f39fc0acc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:42.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.315+0000 7f3a027ab640 1 --2- 172.21.15.60:0/2937305329 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39fc06f890 0x7f39fc0acc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.315+0000 7f3a027ab640 1 -- 172.21.15.60:0/2937305329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39e80039b0 msgr2=0x7f39fc0c1a40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:32:42.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.315+0000 7f3a027ab640 1 --2- 172.21.15.60:0/2937305329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39e80039b0 0x7f39fc0c1a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.315+0000 7f3a027ab640 1 -- 172.21.15.60:0/2937305329 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39fc155a00 con 0x7f39fc0ad1c0 2024-09-12T02:32:42.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.315+0000 7f3a027ab640 1 --2- 172.21.15.60:0/2937305329 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39fc0ad1c0 0x7f39fc145650 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f39fc06e170 tx=0x7f39f400ad30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:42.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.315+0000 7f39f27fc640 1 -- 172.21.15.60:0/2937305329 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f4003d90 con 0x7f39fc0ad1c0 2024-09-12T02:32:42.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.315+0000 7f39f27fc640 1 -- 172.21.15.60:0/2937305329 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39f40099c0 con 0x7f39fc0ad1c0 2024-09-12T02:32:42.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.315+0000 7f3a0420e640 1 -- 172.21.15.60:0/2937305329 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39fc155540 con 0x7f39fc0ad1c0 2024-09-12T02:32:42.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.315+0000 7f39f27fc640 1 -- 172.21.15.60:0/2937305329 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f4009db0 con 0x7f39fc0ad1c0 2024-09-12T02:32:42.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.316+0000 7f3a0420e640 1 -- 172.21.15.60:0/2937305329 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f39fc0c1f80 con 0x7f39fc0ad1c0 2024-09-12T02:32:42.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.317+0000 7f3a0420e640 1 -- 172.21.15.60:0/2937305329 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39fc157e30 con 0x7f39fc0ad1c0 2024-09-12T02:32:42.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.317+0000 7f39f27fc640 1 -- 172.21.15.60:0/2937305329 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f39f400d0d0 con 0x7f39fc0ad1c0 2024-09-12T02:32:42.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.318+0000 7f39f27fc640 1 --2- 172.21.15.60:0/2937305329 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f39e006cf20 0x7f39e006f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:42.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.318+0000 7f39f27fc640 1 -- 172.21.15.60:0/2937305329 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f39f408ad60 con 0x7f39fc0ad1c0 2024-09-12T02:32:42.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.318+0000 7f3a01faa640 1 --2- 172.21.15.60:0/2937305329 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f39e006cf20 0x7f39e006f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:42.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.318+0000 7f3a01faa640 1 --2- 172.21.15.60:0/2937305329 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f39e006cf20 0x7f39e006f3e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f39f8037000 tx=0x7f39f8030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:42.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.322+0000 7f39f27fc640 1 -- 172.21.15.60:0/2937305329 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f39f4059360 con 0x7f39fc0ad1c0 2024-09-12T02:32:42.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.570+0000 7f3a0420e640 1 -- 172.21.15.60:0/2937305329 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f39fc071350 con 0x7f39fc0ad1c0 2024-09-12T02:32:42.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.571+0000 7f39f27fc640 1 -- 172.21.15.60:0/2937305329 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7f39f4058c60 con 0x7f39fc0ad1c0 2024-09-12T02:32:42.573 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":84,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:32:42.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.573+0000 7f3a0420e640 1 -- 172.21.15.60:0/2937305329 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f39e006cf20 msgr2=0x7f39e006f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:42.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.573+0000 7f3a0420e640 1 --2- 172.21.15.60:0/2937305329 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f39e006cf20 0x7f39e006f3e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f39f8037000 tx=0x7f39f8030000 comp rx=0 tx=0).stop 2024-09-12T02:32:42.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.573+0000 7f3a0420e640 1 -- 172.21.15.60:0/2937305329 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39fc0ad1c0 msgr2=0x7f39fc145650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:42.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.573+0000 7f3a0420e640 1 --2- 172.21.15.60:0/2937305329 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39fc0ad1c0 0x7f39fc145650 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f39fc06e170 tx=0x7f39f400ad30 comp rx=0 tx=0).stop 2024-09-12T02:32:42.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.573+0000 7f3a0420e640 1 -- 172.21.15.60:0/2937305329 shutdown_connections 2024-09-12T02:32:42.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.573+0000 7f3a0420e640 1 --2- 172.21.15.60:0/2937305329 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f39e006cf20 0x7f39e006f3e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.573+0000 7f3a0420e640 1 --2- 172.21.15.60:0/2937305329 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39fc0ad1c0 0x7f39fc145650 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.573+0000 7f3a0420e640 1 --2- 172.21.15.60:0/2937305329 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39fc06f890 0x7f39fc0acc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.573+0000 7f3a0420e640 1 --2- 172.21.15.60:0/2937305329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39e80039b0 0x7f39fc0c1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.573+0000 7f3a0420e640 1 -- 172.21.15.60:0/2937305329 >> 172.21.15.60:0/2937305329 conn(0x7f39fc0c4ea0 msgr2=0x7f39fc0c6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:42.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.573+0000 7f3a0420e640 1 -- 172.21.15.60:0/2937305329 shutdown_connections 2024-09-12T02:32:42.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.574+0000 7f3a0420e640 1 -- 172.21.15.60:0/2937305329 wait complete. 2024-09-12T02:32:42.585 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-12T02:32:42.586 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-12T02:32:42.586 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-12T02:32:42.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.687+0000 7feee1f6d640 1 Processor -- start 2024-09-12T02:32:42.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.687+0000 7feee1f6d640 1 -- start start 2024-09-12T02:32:42.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.688+0000 7feee1f6d640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7feedc0afdd0 0x7feedc0c5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:42.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.688+0000 7feee1f6d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7feedc0af870 0x7feedc0c4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:42.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.688+0000 7feee1f6d640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feedc0c54e0 con 0x7feedc153af0 2024-09-12T02:32:42.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.688+0000 7feee1f6d640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7feedc0c74a0 con 0x7feedc0af870 2024-09-12T02:32:42.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.688+0000 7feee1f6d640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7feedc0c7740 con 0x7feedc0afdd0 2024-09-12T02:32:42.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.688+0000 7feedbfff640 1 -- >> v2:172.21.15.60:3300/0 conn(0x7feedc0af870 msgr2=0x7feedc0c4780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:32:42.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.688+0000 7feedb7fe640 1 -- >> v1:172.21.15.60:6789/0 conn(0x7feedc153af0 legacy=0x7feedc1563a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:32:42.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.688+0000 7feedbfff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7feedc0af870 0x7feedc0c4780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:32:42.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.688+0000 7feedaffd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7feedc0afdd0 0x7feedc0c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:42.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.688+0000 7feedaffd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7feedc0afdd0 0x7feedc0c5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:47026/0 (socket says 172.21.15.60:47026) 2024-09-12T02:32:42.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.688+0000 7feedaffd640 1 -- 172.21.15.60:0/733422097 learned_addr learned my addr 172.21.15.60:0/733422097 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:32:42.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.689+0000 7feedaffd640 1 -- 172.21.15.60:0/733422097 >> v2:172.21.15.60:3300/0 conn(0x7feedc0af870 msgr2=0x7feedc0c4780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:32:42.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.689+0000 7feedaffd640 1 --2- 172.21.15.60:0/733422097 >> v2:172.21.15.60:3300/0 conn(0x7feedc0af870 0x7feedc0c4780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.689+0000 7feedaffd640 1 -- 172.21.15.60:0/733422097 >> v1:172.21.15.60:6789/0 conn(0x7feedc153af0 legacy=0x7feedc1563a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:32:42.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.689+0000 7feedaffd640 1 -- 172.21.15.60:0/733422097 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feedc15a3c0 con 0x7feedc0afdd0 2024-09-12T02:32:42.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.690+0000 7feedaffd640 1 --2- 172.21.15.60:0/733422097 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feedc0afdd0 0x7feedc0c5900 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7feedc0c9d30 tx=0x7feed002a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32be25edf8607825 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:42.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.690+0000 7feeda7fc640 1 -- 172.21.15.60:0/733422097 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed0037070 con 0x7feedc0afdd0 2024-09-12T02:32:42.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.690+0000 7feeda7fc640 1 -- 172.21.15.60:0/733422097 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feed002ae40 con 0x7feedc0afdd0 2024-09-12T02:32:42.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.690+0000 7feeda7fc640 1 -- 172.21.15.60:0/733422097 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed0032660 con 0x7feedc0afdd0 2024-09-12T02:32:42.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.690+0000 7feee1f6d640 1 -- 172.21.15.60:0/733422097 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feedc0afdd0 msgr2=0x7feedc0c5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:42.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.690+0000 7feee1f6d640 1 --2- 172.21.15.60:0/733422097 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feedc0afdd0 0x7feedc0c5900 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7feedc0c9d30 tx=0x7feed002a130 comp rx=0 tx=0).stop 2024-09-12T02:32:42.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.690+0000 7feee1f6d640 1 -- 172.21.15.60:0/733422097 shutdown_connections 2024-09-12T02:32:42.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.690+0000 7feee1f6d640 1 --2- 172.21.15.60:0/733422097 >> v2:172.21.15.60:3300/0 conn(0x7feedc0af870 0x7feedc0c4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.690+0000 7feee1f6d640 1 --2- 172.21.15.60:0/733422097 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feedc0afdd0 0x7feedc0c5900 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.690+0000 7feee1f6d640 1 -- 172.21.15.60:0/733422097 >> 172.21.15.60:0/733422097 conn(0x7feedc0c6880 msgr2=0x7feedc0c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:42.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.690+0000 7feee1f6d640 1 -- 172.21.15.60:0/733422097 shutdown_connections 2024-09-12T02:32:42.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.690+0000 7feee1f6d640 1 -- 172.21.15.60:0/733422097 wait complete. 2024-09-12T02:32:42.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.691+0000 7feee1f6d640 1 Processor -- start 2024-09-12T02:32:42.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.692+0000 7feee1f6d640 1 -- start start 2024-09-12T02:32:42.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.692+0000 7feee1f6d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feedc0af870 0x7feedc14af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:42.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.692+0000 7feee1f6d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feedc0afdd0 0x7feedc1e15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:42.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.692+0000 7feee1f6d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feedc153af0 0x7feedc1e1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:42.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.692+0000 7feee1f6d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7feedc154050 con 0x7feedc0afdd0 2024-09-12T02:32:42.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.692+0000 7feee1f6d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7feedc153ed0 con 0x7feedc0af870 2024-09-12T02:32:42.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.692+0000 7feee1f6d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7feedc0c4cc0 con 0x7feedc153af0 2024-09-12T02:32:42.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.692+0000 7feedaffd640 1 -- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feedc0afdd0 msgr2=0x7feedc1e15a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:32:42.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.692+0000 7feedaffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feedc0afdd0 0x7feedc1e15a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:32:42.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.693+0000 7feedbfff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feedc153af0 0x7feedc1e1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:42.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.693+0000 7feedb7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feedc0af870 0x7feedc14af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:42.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.693+0000 7feedbfff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feedc153af0 0x7feedc1e1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:48726/0 (socket says 172.21.15.60:48726) 2024-09-12T02:32:42.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.693+0000 7feedbfff640 1 -- 172.21.15.60:0/2904662109 learned_addr learned my addr 172.21.15.60:0/2904662109 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:32:42.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.693+0000 7feedbfff640 1 -- 172.21.15.60:0/2904662109 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feedc0af870 msgr2=0x7feedc14af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:42.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.693+0000 7feedbfff640 1 --2- 172.21.15.60:0/2904662109 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feedc0af870 0x7feedc14af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.693+0000 7feedbfff640 1 -- 172.21.15.60:0/2904662109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feedc0afdd0 msgr2=0x7feedc1e15a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:32:42.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.693+0000 7feedbfff640 1 --2- 172.21.15.60:0/2904662109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feedc0afdd0 0x7feedc1e15a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.693+0000 7feedbfff640 1 -- 172.21.15.60:0/2904662109 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feedc1dfc90 con 0x7feedc153af0 2024-09-12T02:32:42.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.693+0000 7feedbfff640 1 --2- 172.21.15.60:0/2904662109 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feedc153af0 0x7feedc1e1ae0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7feed400be60 tx=0x7feed4009f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:42.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.693+0000 7feec3fff640 1 -- 172.21.15.60:0/2904662109 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed4016430 con 0x7feedc153af0 2024-09-12T02:32:42.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.693+0000 7feec3fff640 1 -- 172.21.15.60:0/2904662109 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feed4010030 con 0x7feedc153af0 2024-09-12T02:32:42.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.693+0000 7feee1f6d640 1 -- 172.21.15.60:0/2904662109 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feedc147fc0 con 0x7feedc153af0 2024-09-12T02:32:42.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.693+0000 7feec3fff640 1 -- 172.21.15.60:0/2904662109 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed4016850 con 0x7feedc153af0 2024-09-12T02:32:42.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.694+0000 7feee1f6d640 1 -- 172.21.15.60:0/2904662109 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7feedc1ecc40 con 0x7feedc153af0 2024-09-12T02:32:42.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.694+0000 7feee1f6d640 1 --2- 172.21.15.60:0/2904662109 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feedc1ece40 0x7feedc14b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:42.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.694+0000 7feee1f6d640 1 -- 172.21.15.60:0/2904662109 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7feedc146210 con 0x7feedc1ece40 2024-09-12T02:32:42.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.694+0000 7feedb7fe640 1 --2- 172.21.15.60:0/2904662109 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feedc1ece40 0x7feedc14b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:42.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.695+0000 7feedb7fe640 1 -- 172.21.15.60:0/2904662109 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feedc0c5130 con 0x7feedc1ece40 2024-09-12T02:32:42.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.695+0000 7feedb7fe640 1 --2- 172.21.15.60:0/2904662109 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feedc1ece40 0x7feedc14b470 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7feecc009610 tx=0x7feecc009ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:42.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.695+0000 7feec3fff640 1 -- 172.21.15.60:0/2904662109 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feed40153e0 con 0x7feedc153af0 2024-09-12T02:32:42.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.695+0000 7feec3fff640 1 --2- 172.21.15.60:0/2904662109 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7feec806bde0 0x7feec806e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:42.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.696+0000 7feec3fff640 1 -- 172.21.15.60:0/2904662109 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7feed408b580 con 0x7feedc153af0 2024-09-12T02:32:42.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.696+0000 7feedaffd640 1 --2- 172.21.15.60:0/2904662109 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7feec806bde0 0x7feec806e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:42.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.696+0000 7feec3fff640 1 -- 172.21.15.60:0/2904662109 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feecc016070 con 0x7feedc1ece40 2024-09-12T02:32:42.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.696+0000 7feec3fff640 1 -- 172.21.15.60:0/2904662109 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7feecc012600 con 0x7feedc1ece40 2024-09-12T02:32:42.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.696+0000 7feec3fff640 1 -- 172.21.15.60:0/2904662109 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feedc1ece40 msgr2=0x7feedc14b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:42.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.696+0000 7feec3fff640 1 --2- 172.21.15.60:0/2904662109 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feedc1ece40 0x7feedc14b470 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7feecc009610 tx=0x7feecc009ad0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.696+0000 7feec3fff640 1 -- 172.21.15.60:0/2904662109 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feedc1ece40 msgr2=0x7feedc14b470 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:32:42.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.696+0000 7feec3fff640 1 --2- 172.21.15.60:0/2904662109 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feedc1ece40 0x7feedc14b470 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.696+0000 7feedaffd640 1 --2- 172.21.15.60:0/2904662109 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7feec806bde0 0x7feec806e2a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7feed0034000 tx=0x7feed002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:42.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.702+0000 7feee1f6d640 1 --2- 172.21.15.60:0/2904662109 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feedc1ef730 0x7feedc1efb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:42.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.702+0000 7feee1f6d640 1 -- 172.21.15.60:0/2904662109 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7feedc0c9030 con 0x7feedc1ef730 2024-09-12T02:32:42.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.702+0000 7feedb7fe640 1 --2- 172.21.15.60:0/2904662109 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feedc1ef730 0x7feedc1efb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:42.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.703+0000 7feedb7fe640 1 -- 172.21.15.60:0/2904662109 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7feedc0c8830 con 0x7feedc1ef730 2024-09-12T02:32:42.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.703+0000 7feedb7fe640 1 --2- 172.21.15.60:0/2904662109 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feedc1ef730 0x7feedc1efb10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7feecc009610 tx=0x7feecc005970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:42.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.703+0000 7feec3fff640 1 -- 172.21.15.60:0/2904662109 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feecc016040 con 0x7feedc1ef730 2024-09-12T02:32:42.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.703+0000 7feec3fff640 1 -- 172.21.15.60:0/2904662109 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5041 (secure 0 0 0) 0x7feecc01d0d0 con 0x7feedc1ef730 2024-09-12T02:32:42.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.703+0000 7feec3fff640 1 -- 172.21.15.60:0/2904662109 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feedc1ef730 msgr2=0x7feedc1efb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:42.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.703+0000 7feec3fff640 1 --2- 172.21.15.60:0/2904662109 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feedc1ef730 0x7feedc1efb10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7feecc009610 tx=0x7feecc005970 comp rx=0 tx=0).stop 2024-09-12T02:32:42.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.703+0000 7feec3fff640 1 -- 172.21.15.60:0/2904662109 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feedc1ef730 msgr2=0x7feedc1efb10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:32:42.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.703+0000 7feec3fff640 1 --2- 172.21.15.60:0/2904662109 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feedc1ef730 0x7feedc1efb10 secure :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7feecc009610 tx=0x7feecc005970 comp rx=0 tx=0).stop 2024-09-12T02:32:42.705 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:32:42.706 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:32:42.706 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:32:42.706 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:32:42.706 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 84, 2024-09-12T02:32:42.706 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 508138, 2024-09-12T02:32:42.706 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:32:42.706 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:32:42.706 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:32:42.706 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:32:42.706 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-09-12T02:32:42.706 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:32:42.706 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:32:42.706 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:32:42.707 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:32:42.707 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:32:42.707 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:32:42.707 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:32:42.707 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:32:42.707 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:32:42.707 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:32:42.707 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:32:42.707 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:32:42.707 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:32:42.707 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:32:42.707 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:32:42.707 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:32:42.708 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:32:42.708 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:32:42.708 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:32:42.708 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:32:42.708 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:32:42.708 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:32:42.708 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:32:42.708 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:32:42.708 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:32:42.708 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:32:42.708 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:32:42.708 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:32:42.708 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:42.709 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:42.709 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:32:42.709 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:32:42.709 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:32:42.709 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:32:42.709 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:32:42.709 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:32:42.709 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:32:42.709 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:32:42.709 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:32:42.709 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:32:42.709 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:32:42.709 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:32:42.710 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:32:42.710 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:32:42.710 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:32:42.710 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:32:42.710 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:32:42.710 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:32:42.710 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:32:42.710 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:32:42.710 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:32:42.710 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:32:42.710 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:32:42.710 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:32:42.710 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:32:42.710 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:32:42.711 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:32:42.711 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:32:42.711 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:32:42.711 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:32:42.711 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:42.711 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:32:42.711 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:42.711 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:32:42.711 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:32:42.711 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:32:42.711 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:32:42.711 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:42.711 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:32:42.712 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:32:42.712 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:42.712 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:42.712 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:42.712 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:32:42.712 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:32:42.712 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:42.712 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:42.712 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:42.712 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:42.712 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:32:42.712 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:32:42.712 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:32:42.713 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:32:42.713 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:32:42.713 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:42.713 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:42.713 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:32:42.713 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:32:42.713 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:32:42.713 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:32:42.713 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:42.713 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:32:42.713 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:32:42.713 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:42.713 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:42.713 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:42.714 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:32:42.714 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:32:42.714 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:42.714 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:42.714 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:42.714 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:42.714 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:32:42.714 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:32:42.714 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:32:42.714 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:32:42.714 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:32:42.714 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:42.714 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:42.715 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:32:42.715 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:32:42.715 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:32:42.715 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:32:42.715 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:42.715 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:32:42.715 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:32:42.715 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:42.715 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:42.715 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:42.715 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:32:42.715 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:32:42.715 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:42.716 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:42.716 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:42.716 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:42.716 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:32:42.716 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:32:42.716 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:32:42.716 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:32:42.716 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:32:42.716 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:42.716 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:42.716 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:42.716 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:32:42.716 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:32:42.717 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:42.717 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:32:42.717 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:32:42.717 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:32:42.720 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:42.720 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:32:42.720 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:32:42.720 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:42.720 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:32:42.721 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:32:42.721 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:32:42.721 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:42.721 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:32:42.721 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:32:42.721 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:42.721 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:32:42.721 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:32:42.721 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-09-12T02:32:42.721 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:42.721 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:32:42.721 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:32:42.721 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:42.722 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:32:42.722 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:32:42.722 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-09-12T02:32:42.722 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:42.722 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:32:42.722 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:32:42.722 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:42.722 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:32:42.722 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:32:42.722 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:32:42.722 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:42.722 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:42.722 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:42.723 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:32:42.723 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:32:42.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.703+0000 7feee1f6d640 1 -- 172.21.15.60:0/2904662109 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7feec806bde0 msgr2=0x7feec806e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:42.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.704+0000 7feee1f6d640 1 --2- 172.21.15.60:0/2904662109 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7feec806bde0 0x7feec806e2a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7feed0034000 tx=0x7feed002e000 comp rx=0 tx=0).stop 2024-09-12T02:32:42.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.704+0000 7feee1f6d640 1 -- 172.21.15.60:0/2904662109 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feedc153af0 msgr2=0x7feedc1e1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:42.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.704+0000 7feee1f6d640 1 --2- 172.21.15.60:0/2904662109 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feedc153af0 0x7feedc1e1ae0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7feed400be60 tx=0x7feed4009f30 comp rx=0 tx=0).stop 2024-09-12T02:32:42.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.704+0000 7feedbfff640 1 -- 172.21.15.60:0/2904662109 reap_dead start 2024-09-12T02:32:42.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.704+0000 7feedbfff640 1 -- 172.21.15.60:0/2904662109 reap_dead start 2024-09-12T02:32:42.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.704+0000 7feee1f6d640 1 -- 172.21.15.60:0/2904662109 shutdown_connections 2024-09-12T02:32:42.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.704+0000 7feee1f6d640 1 -- 172.21.15.60:0/2904662109 >> 172.21.15.60:0/2904662109 conn(0x7feedc0c6880 msgr2=0x7feedc157500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:42.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.704+0000 7feee1f6d640 1 -- 172.21.15.60:0/2904662109 shutdown_connections 2024-09-12T02:32:42.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.704+0000 7feee1f6d640 1 -- 172.21.15.60:0/2904662109 wait complete. 2024-09-12T02:32:42.725 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-12T02:32:42.726 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-12T02:32:42.726 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-12T02:32:42.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.827+0000 7f49a2c65640 1 Processor -- start 2024-09-12T02:32:42.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.827+0000 7f49a2c65640 1 -- start start 2024-09-12T02:32:42.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.828+0000 7f49a2c65640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f499c153de0 0x7f499c0ca640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:42.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.828+0000 7f49a2c65640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f499c0cab80 con 0x7f499c06bbe0 2024-09-12T02:32:42.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.828+0000 7f49a2c65640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f499c0c6b20 con 0x7f499c1598c0 2024-09-12T02:32:42.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.828+0000 7f49a2c65640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f499c0c9480 con 0x7f499c153de0 2024-09-12T02:32:42.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.828+0000 7f499bfff640 1 -- >> v1:172.21.15.60:6789/0 conn(0x7f499c06bbe0 legacy=0x7f499c06c020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:32:42.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.829+0000 7f49a1202640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f499c1598c0 0x7f499c159d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:44596/0 (socket says 172.21.15.60:44596) 2024-09-12T02:32:42.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.829+0000 7f49a1202640 1 -- 172.21.15.60:0/2645793946 learned_addr learned my addr 172.21.15.60:0/2645793946 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:32:42.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.829+0000 7f49a0a01640 1 --2- 172.21.15.60:0/2645793946 >> v2:172.21.15.105:3300/0 conn(0x7f499c153de0 0x7f499c0ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:42.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.829+0000 7f499b7fe640 1 -- 172.21.15.60:0/2645793946 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1939894320 0 0) 0x7f499c0c6b20 con 0x7f499c1598c0 2024-09-12T02:32:42.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.829+0000 7f499b7fe640 1 -- 172.21.15.60:0/2645793946 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4984003520 con 0x7f499c1598c0 2024-09-12T02:32:42.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.829+0000 7f49a0a01640 1 -- 172.21.15.60:0/2645793946 >> v1:172.21.15.105:6789/0 conn(0x7f499c1598c0 legacy=0x7f499c159d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:42.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.829+0000 7f49a0a01640 1 -- 172.21.15.60:0/2645793946 >> v1:172.21.15.60:6789/0 conn(0x7f499c06bbe0 legacy=0x7f499c06c020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:32:42.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.829+0000 7f49a0a01640 1 -- 172.21.15.60:0/2645793946 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f499c0c6e00 con 0x7f499c153de0 2024-09-12T02:32:42.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.830+0000 7f49a0a01640 1 --2- 172.21.15.60:0/2645793946 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f499c153de0 0x7f499c0ca640 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4994009d90 tx=0x7f499402a6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3c624a89c0c3bec server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:42.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.830+0000 7f499b7fe640 1 -- 172.21.15.60:0/2645793946 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4994007740 con 0x7f499c153de0 2024-09-12T02:32:42.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.830+0000 7f499b7fe640 1 -- 172.21.15.60:0/2645793946 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49940078e0 con 0x7f499c153de0 2024-09-12T02:32:42.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.830+0000 7f499b7fe640 1 -- 172.21.15.60:0/2645793946 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4994007cb0 con 0x7f499c153de0 2024-09-12T02:32:42.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.831+0000 7f49a2c65640 1 -- 172.21.15.60:0/2645793946 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f499c153de0 msgr2=0x7f499c0ca640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:42.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.831+0000 7f49a2c65640 1 --2- 172.21.15.60:0/2645793946 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f499c153de0 0x7f499c0ca640 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4994009d90 tx=0x7f499402a6a0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.831+0000 7f49a2c65640 1 -- 172.21.15.60:0/2645793946 shutdown_connections 2024-09-12T02:32:42.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.831+0000 7f49a2c65640 1 --2- 172.21.15.60:0/2645793946 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f499c153de0 0x7f499c0ca640 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.831+0000 7f49a2c65640 1 -- 172.21.15.60:0/2645793946 >> 172.21.15.60:0/2645793946 conn(0x7f499c0c8800 msgr2=0x7f499c0c8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:42.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.831+0000 7f49a2c65640 1 -- 172.21.15.60:0/2645793946 shutdown_connections 2024-09-12T02:32:42.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.831+0000 7f49a2c65640 1 -- 172.21.15.60:0/2645793946 wait complete. 2024-09-12T02:32:42.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.832+0000 7f49a2c65640 1 Processor -- start 2024-09-12T02:32:42.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.832+0000 7f49a2c65640 1 -- start start 2024-09-12T02:32:42.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.833+0000 7f49a2c65640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f499c06bbe0 0x7f499c1dff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:42.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.833+0000 7f49a2c65640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f499c153de0 0x7f499c157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:42.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.833+0000 7f49a2c65640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f499c1598c0 0x7f499c14c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:42.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.833+0000 7f49a2c65640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f499c0cbab0 con 0x7f499c153de0 2024-09-12T02:32:42.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.833+0000 7f49a2c65640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f499c0cb620 con 0x7f499c06bbe0 2024-09-12T02:32:42.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.833+0000 7f49a2c65640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f499c15a460 con 0x7f499c1598c0 2024-09-12T02:32:42.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.833+0000 7f499bfff640 1 -- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f499c153de0 msgr2=0x7f499c157790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:32:42.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.833+0000 7f499bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f499c153de0 0x7f499c157790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:32:42.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.833+0000 7f49a1202640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f499c1598c0 0x7f499c14c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:42.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.833+0000 7f49a0a01640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f499c06bbe0 0x7f499c1dff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:42.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.833+0000 7f49a1202640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f499c1598c0 0x7f499c14c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:48742/0 (socket says 172.21.15.60:48742) 2024-09-12T02:32:42.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.833+0000 7f49a1202640 1 -- 172.21.15.60:0/2017159722 learned_addr learned my addr 172.21.15.60:0/2017159722 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:32:42.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.833+0000 7f49a1202640 1 -- 172.21.15.60:0/2017159722 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f499c06bbe0 msgr2=0x7f499c1dff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:42.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.833+0000 7f49a1202640 1 --2- 172.21.15.60:0/2017159722 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f499c06bbe0 0x7f499c1dff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.833+0000 7f49a1202640 1 -- 172.21.15.60:0/2017159722 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f499c153de0 msgr2=0x7f499c157790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:32:42.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.833+0000 7f49a1202640 1 --2- 172.21.15.60:0/2017159722 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f499c153de0 0x7f499c157790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.833+0000 7f49a1202640 1 -- 172.21.15.60:0/2017159722 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f499c157cd0 con 0x7f499c1598c0 2024-09-12T02:32:42.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.834+0000 7f49a1202640 1 --2- 172.21.15.60:0/2017159722 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f499c1598c0 0x7f499c14c770 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f498c00c3c0 tx=0x7f498c00c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:42.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.834+0000 7f49997fa640 1 -- 172.21.15.60:0/2017159722 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f498c017070 con 0x7f499c1598c0 2024-09-12T02:32:42.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.834+0000 7f49997fa640 1 -- 172.21.15.60:0/2017159722 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f498c005ce0 con 0x7f499c1598c0 2024-09-12T02:32:42.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.834+0000 7f49997fa640 1 -- 172.21.15.60:0/2017159722 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f498c007310 con 0x7f499c1598c0 2024-09-12T02:32:42.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.834+0000 7f49a2c65640 1 -- 172.21.15.60:0/2017159722 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f499c14e6f0 con 0x7f499c1598c0 2024-09-12T02:32:42.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.834+0000 7f49a2c65640 1 -- 172.21.15.60:0/2017159722 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f499c1e1a40 con 0x7f499c1598c0 2024-09-12T02:32:42.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.835+0000 7f49a2c65640 1 --2- 172.21.15.60:0/2017159722 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f499c1484b0 0x7f499c1e1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:42.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.835+0000 7f49a2c65640 1 -- 172.21.15.60:0/2017159722 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f499c1dfc70 con 0x7f499c1484b0 2024-09-12T02:32:42.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.835+0000 7f49a0a01640 1 --2- 172.21.15.60:0/2017159722 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f499c1484b0 0x7f499c1e1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:42.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.835+0000 7f49a0a01640 1 -- 172.21.15.60:0/2017159722 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f499c1f03c0 con 0x7f499c1484b0 2024-09-12T02:32:42.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.835+0000 7f49997fa640 1 -- 172.21.15.60:0/2017159722 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f498c01a070 con 0x7f499c1598c0 2024-09-12T02:32:42.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.835+0000 7f49a0a01640 1 --2- 172.21.15.60:0/2017159722 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f499c1484b0 0x7f499c1e1c10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f499c0c8760 tx=0x7f4994004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:42.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.836+0000 7f49997fa640 1 --2- 172.21.15.60:0/2017159722 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f498806bde0 0x7f498806e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:42.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.836+0000 7f49997fa640 1 -- 172.21.15.60:0/2017159722 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f498c08a3f0 con 0x7f499c1598c0 2024-09-12T02:32:42.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.836+0000 7f499bfff640 1 --2- 172.21.15.60:0/2017159722 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f498806bde0 0x7f498806e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:42.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.836+0000 7f49997fa640 1 -- 172.21.15.60:0/2017159722 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499404a070 con 0x7f499c1484b0 2024-09-12T02:32:42.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.836+0000 7f49997fa640 1 -- 172.21.15.60:0/2017159722 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f4994007e80 con 0x7f499c1484b0 2024-09-12T02:32:42.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.836+0000 7f49997fa640 1 -- 172.21.15.60:0/2017159722 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f499c1484b0 msgr2=0x7f499c1e1c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:42.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.836+0000 7f49997fa640 1 --2- 172.21.15.60:0/2017159722 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f499c1484b0 0x7f499c1e1c10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f499c0c8760 tx=0x7f4994004a40 comp rx=0 tx=0).stop 2024-09-12T02:32:42.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.836+0000 7f49997fa640 1 -- 172.21.15.60:0/2017159722 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f499c1484b0 msgr2=0x7f499c1e1c10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:32:42.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.836+0000 7f49997fa640 1 --2- 172.21.15.60:0/2017159722 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f499c1484b0 0x7f499c1e1c10 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:42.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.836+0000 7f499bfff640 1 --2- 172.21.15.60:0/2017159722 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f498806bde0 0x7f498806e2a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4990006fd0 tx=0x7f4990006d80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:42.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.842+0000 7f49a2c65640 1 --2- 172.21.15.60:0/2017159722 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f499c1e22e0 0x7f499c1ef480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:42.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.842+0000 7f49a2c65640 1 -- 172.21.15.60:0/2017159722 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f499c151520 con 0x7f499c1e22e0 2024-09-12T02:32:42.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.843+0000 7f49a0a01640 1 --2- 172.21.15.60:0/2017159722 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f499c1e22e0 0x7f499c1ef480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:42.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.843+0000 7f49a0a01640 1 -- 172.21.15.60:0/2017159722 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f499c0c8180 con 0x7f499c1e22e0 2024-09-12T02:32:42.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.843+0000 7f49a0a01640 1 --2- 172.21.15.60:0/2017159722 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f499c1e22e0 0x7f499c1ef480 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f499c1e2180 tx=0x7f4994030000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:42.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.843+0000 7f49997fa640 1 -- 172.21.15.60:0/2017159722 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4994051070 con 0x7f499c1e22e0 2024-09-12T02:32:42.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.844+0000 7f49997fa640 1 -- 172.21.15.60:0/2017159722 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4704 (secure 0 0 0) 0x7f499404b040 con 0x7f499c1e22e0 2024-09-12T02:32:42.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.844+0000 7f49997fa640 1 -- 172.21.15.60:0/2017159722 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f499c1e22e0 msgr2=0x7f499c1ef480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:42.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.844+0000 7f49997fa640 1 --2- 172.21.15.60:0/2017159722 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f499c1e22e0 0x7f499c1ef480 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f499c1e2180 tx=0x7f4994030000 comp rx=0 tx=0).stop 2024-09-12T02:32:42.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.844+0000 7f49997fa640 1 -- 172.21.15.60:0/2017159722 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f499c1e22e0 msgr2=0x7f499c1ef480 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:32:42.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.844+0000 7f49997fa640 1 --2- 172.21.15.60:0/2017159722 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f499c1e22e0 0x7f499c1ef480 secure :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f499c1e2180 tx=0x7f4994030000 comp rx=0 tx=0).stop 2024-09-12T02:32:42.846 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:32:42.846 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:32:42.846 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:32:42.846 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:32:42.847 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 84, 2024-09-12T02:32:42.847 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 36599, 2024-09-12T02:32:42.847 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:32:42.847 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:32:42.847 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:32:42.847 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:32:42.847 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-09-12T02:32:42.847 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:32:42.847 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:32:42.847 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:32:42.847 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:32:42.847 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:32:42.847 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:32:42.847 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:32:42.848 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:32:42.848 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:32:42.848 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:32:42.848 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:32:42.848 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:32:42.848 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:32:42.848 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:32:42.848 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:32:42.848 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:32:42.848 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:32:42.848 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:32:42.848 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:32:42.848 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:32:42.849 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:32:42.849 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:32:42.849 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:32:42.849 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:32:42.849 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:32:42.849 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:32:42.849 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:32:42.849 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:32:42.849 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:42.849 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:42.849 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:32:42.849 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:32:42.849 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:32:42.850 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:32:42.850 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:32:42.850 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:32:42.850 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:32:42.850 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:32:42.850 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:32:42.850 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:32:42.850 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:32:42.850 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:32:42.850 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:32:42.850 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:32:42.850 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:32:42.850 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:32:42.850 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:32:42.851 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:32:42.851 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:32:42.851 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:32:42.851 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:32:42.851 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:32:42.851 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:32:42.851 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:32:42.851 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:32:42.851 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:32:42.851 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:32:42.851 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:32:42.851 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:32:42.851 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:32:42.851 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:42.852 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:32:42.852 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:42.852 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:32:42.852 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:32:42.852 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:32:42.852 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:32:42.852 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:42.852 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:32:42.852 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:32:42.852 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:42.852 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:42.852 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:42.852 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:32:42.853 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:32:42.853 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:42.853 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:42.853 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:42.853 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:42.853 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:32:42.853 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:32:42.853 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:32:42.853 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:32:42.853 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:32:42.853 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:42.853 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:42.853 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:32:42.853 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:32:42.854 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:32:42.854 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:32:42.854 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:42.854 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:32:42.854 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:32:42.854 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:42.854 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:42.854 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:42.854 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:32:42.854 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:32:42.854 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:42.854 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:42.854 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:42.855 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:42.855 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:32:42.855 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:32:42.855 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:32:42.855 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:32:42.855 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:32:42.855 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:42.855 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:42.855 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:32:42.855 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:32:42.855 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:32:42.855 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:32:42.855 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:42.856 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:32:42.856 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:32:42.856 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:42.856 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:42.856 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:42.856 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:32:42.856 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:32:42.856 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:32:42.856 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:42.856 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:42.856 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:42.856 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:32:42.856 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:32:42.856 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:32:42.857 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:32:42.857 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:32:42.857 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:42.857 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:42.857 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:42.857 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:32:42.857 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:32:42.857 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:42.857 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:32:42.857 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:32:42.857 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:32:42.857 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:42.857 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:32:42.858 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:32:42.858 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:42.858 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:32:42.858 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:32:42.858 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:32:42.858 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:42.858 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:32:42.858 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:32:42.858 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:32:42.858 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:32:42.858 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:32:42.858 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:32:42.858 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:32:42.859 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:32:42.859 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:32:42.859 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:32:42.859 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:32:42.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.844+0000 7f49a2c65640 1 -- 172.21.15.60:0/2017159722 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f498806bde0 msgr2=0x7f498806e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:42.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.844+0000 7f49a2c65640 1 --2- 172.21.15.60:0/2017159722 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f498806bde0 0x7f498806e2a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4990006fd0 tx=0x7f4990006d80 comp rx=0 tx=0).stop 2024-09-12T02:32:42.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.844+0000 7f49a2c65640 1 -- 172.21.15.60:0/2017159722 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f499c1598c0 msgr2=0x7f499c14c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:42.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.844+0000 7f49a2c65640 1 --2- 172.21.15.60:0/2017159722 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f499c1598c0 0x7f499c14c770 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f498c00c3c0 tx=0x7f498c00c880 comp rx=0 tx=0).stop 2024-09-12T02:32:42.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.844+0000 7f49a1202640 1 -- 172.21.15.60:0/2017159722 reap_dead start 2024-09-12T02:32:42.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.844+0000 7f49a1202640 1 -- 172.21.15.60:0/2017159722 reap_dead start 2024-09-12T02:32:42.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.844+0000 7f49a2c65640 1 -- 172.21.15.60:0/2017159722 shutdown_connections 2024-09-12T02:32:42.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.844+0000 7f49a2c65640 1 -- 172.21.15.60:0/2017159722 >> 172.21.15.60:0/2017159722 conn(0x7f499c0c8800 msgr2=0x7f499c0ab980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:42.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.844+0000 7f49a2c65640 1 -- 172.21.15.60:0/2017159722 shutdown_connections 2024-09-12T02:32:42.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:32:42.844+0000 7f49a2c65640 1 -- 172.21.15.60:0/2017159722 wait complete. 2024-09-12T02:32:42.861 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-12T02:32:42.861 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-12T02:32:45.246 INFO:tasks.workunit.client.1.smithi105.stdout:fs setup took 453 secs 2024-09-12T02:32:46.748 INFO:tasks.workunit.client.1.smithi105.stdout:Syncing()...1 sec 2024-09-12T02:32:46.749 INFO:tasks.workunit.client.1.smithi105.stdout:Starting Actual Benchmark At: Thu Sep 12 02:32:46 2024 2024-09-12T02:32:46.749 INFO:tasks.workunit.client.1.smithi105.stdout: 2024-09-12T02:32:59.605 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:32:59.608 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:33:02.862 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-12T02:33:02.862 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-09-12T02:33:02.863 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T02:33:02.863 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T02:33:02.865 INFO:tasks.ceph.mon.a:Started 2024-09-12T02:33:02.866 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-12T02:33:02.866 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:33:03.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.024+0000 7f07bc477640 1 Processor -- start 2024-09-12T02:33:03.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.024+0000 7f07bc477640 1 -- start start 2024-09-12T02:33:03.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.025+0000 7f07bc477640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f07b4074250 0x7f07b40becd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:03.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.025+0000 7f07bc477640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07b40c7ff0 con 0x7f07b40c34f0 2024-09-12T02:33:03.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.025+0000 7f07bc477640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07b40c7230 con 0x7f07b40a8170 2024-09-12T02:33:03.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.025+0000 7f07bc477640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f07b40c7b60 con 0x7f07b4074250 2024-09-12T02:33:03.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.025+0000 7f07ba213640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f07b4074250 0x7f07b40becd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:03.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.025+0000 7f07baa14640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f07b40c34f0 0x7f07b40c3900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:37538/0 (socket says 172.21.15.60:37538) 2024-09-12T02:33:03.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.025+0000 7f07baa14640 1 -- 172.21.15.60:0/3218907270 learned_addr learned my addr 172.21.15.60:0/3218907270 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:33:03.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.025+0000 7f07ba213640 1 -- 172.21.15.60:0/3218907270 >> v2:172.21.15.60:3300/0 conn(0x7f07b4074250 msgr2=0x7f07b40becd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:33:03.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.025+0000 7f07ba213640 1 -- 172.21.15.60:0/3218907270 >> v2:172.21.15.60:3300/0 conn(0x7f07b4074250 msgr2=0x7f07b40becd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:33:03.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.025+0000 7f07ba213640 1 --2- 172.21.15.60:0/3218907270 >> v2:172.21.15.60:3300/0 conn(0x7f07b4074250 0x7f07b40becd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:33:03.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.025+0000 7f07ba213640 1 --2- 172.21.15.60:0/3218907270 >> v2:172.21.15.60:3300/0 conn(0x7f07b4074250 0x7f07b40becd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:33:03.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.026+0000 7f07b9211640 1 -- 172.21.15.60:0/3218907270 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2953004220 0 0) 0x7f07b40c7230 con 0x7f07b40a8170 2024-09-12T02:33:03.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.026+0000 7f07b9211640 1 -- 172.21.15.60:0/3218907270 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07a0003520 con 0x7f07b40a8170 2024-09-12T02:33:03.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.026+0000 7f07b9211640 1 -- 172.21.15.60:0/3218907270 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1152712120 0 0) 0x7f07a0003520 con 0x7f07b40a8170 2024-09-12T02:33:03.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.026+0000 7f07b9211640 1 -- 172.21.15.60:0/3218907270 >> v2:172.21.15.60:3300/0 conn(0x7f07b4074250 msgr2=0x7f07b40becd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:33:03.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.026+0000 7f07b9211640 1 --2- 172.21.15.60:0/3218907270 >> v2:172.21.15.60:3300/0 conn(0x7f07b4074250 0x7f07b40becd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:03.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.026+0000 7f07b9211640 1 -- 172.21.15.60:0/3218907270 >> v1:172.21.15.60:6789/0 conn(0x7f07b40c34f0 legacy=0x7f07b40c3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:03.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.026+0000 7f07b9211640 1 -- 172.21.15.60:0/3218907270 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07b40c7510 con 0x7f07b40a8170 2024-09-12T02:33:03.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.026+0000 7f07b9211640 1 -- 172.21.15.60:0/3218907270 <== mon.1 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7f07a4001670 con 0x7f07b40a8170 2024-09-12T02:33:03.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.026+0000 7f07b9211640 1 -- 172.21.15.60:0/3218907270 >> v1:172.21.15.105:6789/0 conn(0x7f07b40a8170 legacy=0x7f07b406cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:03.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.026+0000 7f07b9211640 1 --2- 172.21.15.60:0/3218907270 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07a00039d0 0x7f07a0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:03.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.026+0000 7f07b9211640 1 --2- 172.21.15.60:0/3218907270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07a0004800 0x7f07a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:03.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.026+0000 7f07b9211640 1 --2- 172.21.15.60:0/3218907270 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07a00053c0 0x7f07a000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:03.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.026+0000 7f07b9211640 1 -- 172.21.15.60:0/3218907270 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f07b40c7b60 con 0x7f07a0004800 2024-09-12T02:33:03.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.026+0000 7f07b9211640 1 -- 172.21.15.60:0/3218907270 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f07a000c230 con 0x7f07a00039d0 2024-09-12T02:33:03.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.026+0000 7f07b9211640 1 -- 172.21.15.60:0/3218907270 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f07a000c430 con 0x7f07a00053c0 2024-09-12T02:33:03.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.027+0000 7f07ba213640 1 --2- 172.21.15.60:0/3218907270 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07a00039d0 0x7f07a0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:03.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.027+0000 7f07b9a12640 1 --2- 172.21.15.60:0/3218907270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07a0004800 0x7f07a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:03.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.027+0000 7f07baa14640 1 --2- 172.21.15.60:0/3218907270 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07a00053c0 0x7f07a000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:03.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.027+0000 7f07b9a12640 1 -- 172.21.15.60:0/3218907270 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07a00053c0 msgr2=0x7f07a000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:03.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.027+0000 7f07b9a12640 1 --2- 172.21.15.60:0/3218907270 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07a00053c0 0x7f07a000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:03.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.027+0000 7f07b9a12640 1 -- 172.21.15.60:0/3218907270 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07a00039d0 msgr2=0x7f07a0003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:03.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.027+0000 7f07b9a12640 1 --2- 172.21.15.60:0/3218907270 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07a00039d0 0x7f07a0003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:03.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.027+0000 7f07b9a12640 1 -- 172.21.15.60:0/3218907270 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07b40c7510 con 0x7f07a0004800 2024-09-12T02:33:03.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.027+0000 7f07baa14640 1 --2- 172.21.15.60:0/3218907270 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07a00053c0 0x7f07a000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:33:03.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.027+0000 7f07baa14640 1 -- 172.21.15.60:0/3218907270 reap_dead start 2024-09-12T02:33:03.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.028+0000 7f07b9a12640 1 --2- 172.21.15.60:0/3218907270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07a0004800 0x7f07a0004c80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f07a400c1e0 tx=0x7f07a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=407e6c16d5dc0ac1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:03.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.029+0000 7f07b9211640 1 -- 172.21.15.60:0/3218907270 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a4007d00 con 0x7f07a0004800 2024-09-12T02:33:03.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.029+0000 7f07b9211640 1 -- 172.21.15.60:0/3218907270 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07a402f070 con 0x7f07a0004800 2024-09-12T02:33:03.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.029+0000 7f07b9211640 1 -- 172.21.15.60:0/3218907270 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a4007d00 con 0x7f07a0004800 2024-09-12T02:33:03.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.030+0000 7f07bc477640 1 -- 172.21.15.60:0/3218907270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07a0004800 msgr2=0x7f07a0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:03.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.030+0000 7f07bc477640 1 --2- 172.21.15.60:0/3218907270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07a0004800 0x7f07a0004c80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f07a400c1e0 tx=0x7f07a0005830 comp rx=0 tx=0).stop 2024-09-12T02:33:03.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.030+0000 7f07bc477640 1 -- 172.21.15.60:0/3218907270 shutdown_connections 2024-09-12T02:33:03.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.030+0000 7f07bc477640 1 --2- 172.21.15.60:0/3218907270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07a0004800 0x7f07a0004c80 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:03.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.030+0000 7f07bc477640 1 -- 172.21.15.60:0/3218907270 >> 172.21.15.60:0/3218907270 conn(0x7f07b40c55f0 msgr2=0x7f07b40c59d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:03.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.030+0000 7f07bc477640 1 -- 172.21.15.60:0/3218907270 shutdown_connections 2024-09-12T02:33:03.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.030+0000 7f07bc477640 1 -- 172.21.15.60:0/3218907270 wait complete. 2024-09-12T02:33:03.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.032+0000 7f07bc477640 1 Processor -- start 2024-09-12T02:33:03.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.032+0000 7f07bc477640 1 -- start start 2024-09-12T02:33:03.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.033+0000 7f07bc477640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07a0004800 0x7f07b40ac440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:03.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.033+0000 7f07bc477640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07b41e63c0 0x7f07b406c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:03.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.033+0000 7f07bc477640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07b41e08b0 0x7f07b41e0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:03.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.033+0000 7f07bc477640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f07b4074630 con 0x7f07b41e63c0 2024-09-12T02:33:03.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.033+0000 7f07bc477640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f07b40c6c10 con 0x7f07b41e08b0 2024-09-12T02:33:03.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.033+0000 7f07bc477640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f07b40747b0 con 0x7f07a0004800 2024-09-12T02:33:03.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.033+0000 7f07ba213640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07a0004800 0x7f07b40ac440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:03.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.033+0000 7f07baa14640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07b41e08b0 0x7f07b41e0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:03.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.033+0000 7f07ba213640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07a0004800 0x7f07b40ac440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:54424/0 (socket says 172.21.15.60:54424) 2024-09-12T02:33:03.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.034+0000 7f07ba213640 1 -- 172.21.15.60:0/3286090187 learned_addr learned my addr 172.21.15.60:0/3286090187 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:33:03.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.034+0000 7f07b9a12640 1 --2- 172.21.15.60:0/3286090187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07b41e63c0 0x7f07b406c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:03.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.034+0000 7f07ba213640 1 -- 172.21.15.60:0/3286090187 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07b41e08b0 msgr2=0x7f07b41e0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:03.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.034+0000 7f07ba213640 1 --2- 172.21.15.60:0/3286090187 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07b41e08b0 0x7f07b41e0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:03.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.034+0000 7f07ba213640 1 -- 172.21.15.60:0/3286090187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07b41e63c0 msgr2=0x7f07b406c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:03.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.034+0000 7f07ba213640 1 --2- 172.21.15.60:0/3286090187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07b41e63c0 0x7f07b406c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:03.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.034+0000 7f07ba213640 1 -- 172.21.15.60:0/3286090187 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07b41efdd0 con 0x7f07a0004800 2024-09-12T02:33:03.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.034+0000 7f07baa14640 1 --2- 172.21.15.60:0/3286090187 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07b41e08b0 0x7f07b41e0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:33:03.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.034+0000 7f07ba213640 1 --2- 172.21.15.60:0/3286090187 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07a0004800 0x7f07b40ac440 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f07b0010920 tx=0x7f07b0010de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:03.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.035+0000 7f07aaffd640 1 -- 172.21.15.60:0/3286090187 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b001a020 con 0x7f07a0004800 2024-09-12T02:33:03.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.035+0000 7f07bc477640 1 -- 172.21.15.60:0/3286090187 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07b41f00b0 con 0x7f07a0004800 2024-09-12T02:33:03.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.035+0000 7f07bc477640 1 -- 172.21.15.60:0/3286090187 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f07b406cd30 con 0x7f07a0004800 2024-09-12T02:33:03.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.035+0000 7f07aaffd640 1 -- 172.21.15.60:0/3286090187 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07b000ea80 con 0x7f07a0004800 2024-09-12T02:33:03.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.035+0000 7f07aaffd640 1 -- 172.21.15.60:0/3286090187 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b000ee30 con 0x7f07a0004800 2024-09-12T02:33:03.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.036+0000 7f07bc477640 1 -- 172.21.15.60:0/3286090187 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07b40becd0 con 0x7f07a0004800 2024-09-12T02:33:03.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.037+0000 7f07aaffd640 1 -- 172.21.15.60:0/3286090187 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f07b001d020 con 0x7f07a0004800 2024-09-12T02:33:03.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.037+0000 7f07aaffd640 1 --2- 172.21.15.60:0/3286090187 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f079806be60 0x7f079806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:03.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.037+0000 7f07aaffd640 1 -- 172.21.15.60:0/3286090187 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f07b008ba60 con 0x7f07a0004800 2024-09-12T02:33:03.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.038+0000 7f07b9a12640 1 --2- 172.21.15.60:0/3286090187 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f079806be60 0x7f079806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:03.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.038+0000 7f07b9a12640 1 --2- 172.21.15.60:0/3286090187 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f079806be60 0x7f079806e320 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f07a4033000 tx=0x7f07a402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:03.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.045+0000 7f07aaffd640 1 -- 172.21.15.60:0/3286090187 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f07b0024020 con 0x7f07a0004800 2024-09-12T02:33:03.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.457+0000 7f07bc477640 1 -- 172.21.15.60:0/3286090187 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f07b40acb40 con 0x7f07a0004800 2024-09-12T02:33:03.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.458+0000 7f07aaffd640 1 -- 172.21.15.60:0/3286090187 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1559 (secure 0 0 0) 0x7f07b005a080 con 0x7f07a0004800 2024-09-12T02:33:03.458 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":84,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:33:03.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.461+0000 7f07bc477640 1 -- 172.21.15.60:0/3286090187 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f079806be60 msgr2=0x7f079806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:03.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.461+0000 7f07bc477640 1 --2- 172.21.15.60:0/3286090187 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f079806be60 0x7f079806e320 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f07a4033000 tx=0x7f07a402e000 comp rx=0 tx=0).stop 2024-09-12T02:33:03.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.461+0000 7f07bc477640 1 -- 172.21.15.60:0/3286090187 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07a0004800 msgr2=0x7f07b40ac440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:03.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.461+0000 7f07bc477640 1 --2- 172.21.15.60:0/3286090187 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07a0004800 0x7f07b40ac440 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f07b0010920 tx=0x7f07b0010de0 comp rx=0 tx=0).stop 2024-09-12T02:33:03.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.461+0000 7f07bc477640 1 -- 172.21.15.60:0/3286090187 shutdown_connections 2024-09-12T02:33:03.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.461+0000 7f07bc477640 1 --2- 172.21.15.60:0/3286090187 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f079806be60 0x7f079806e320 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:03.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.461+0000 7f07bc477640 1 --2- 172.21.15.60:0/3286090187 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07b41e08b0 0x7f07b41e0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:03.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.461+0000 7f07bc477640 1 --2- 172.21.15.60:0/3286090187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07b41e63c0 0x7f07b406c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:03.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.461+0000 7f07bc477640 1 --2- 172.21.15.60:0/3286090187 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07a0004800 0x7f07b40ac440 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:03.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.461+0000 7f07bc477640 1 -- 172.21.15.60:0/3286090187 >> 172.21.15.60:0/3286090187 conn(0x7f07b40c55f0 msgr2=0x7f07b4073150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:03.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.461+0000 7f07bc477640 1 -- 172.21.15.60:0/3286090187 shutdown_connections 2024-09-12T02:33:03.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:03.461+0000 7f07bc477640 1 -- 172.21.15.60:0/3286090187 wait complete. 2024-09-12T02:33:06.477 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:33:06.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:06.713+0000 7f64565e4640 1 Processor -- start 2024-09-12T02:33:06.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:06.713+0000 7f64565e4640 1 -- start start 2024-09-12T02:33:06.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:06.714+0000 7f64565e4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6450158300 0x7f645015f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:06.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:06.714+0000 7f64565e4640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6450154e00 con 0x7f64500744a0 2024-09-12T02:33:06.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:06.714+0000 7f64565e4640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64500c50e0 con 0x7f64500c7a70 2024-09-12T02:33:06.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:06.714+0000 7f64565e4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f64500c4ba0 con 0x7f6450158300 2024-09-12T02:33:06.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:06.715+0000 7f644f7fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f64500744a0 0x7f6450157bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:37554/0 (socket says 172.21.15.60:37554) 2024-09-12T02:33:06.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:06.715+0000 7f644f7fe640 1 -- 172.21.15.60:0/3578422689 learned_addr learned my addr 172.21.15.60:0/3578422689 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:33:06.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:06.715+0000 7f6454b81640 1 --2- 172.21.15.60:0/3578422689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6450158300 0x7f645015f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:06.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:06.715+0000 7f6454b81640 1 -- 172.21.15.60:0/3578422689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6450158300 msgr2=0x7f645015f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:33:06.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:06.715+0000 7f6454b81640 1 -- 172.21.15.60:0/3578422689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6450158300 msgr2=0x7f645015f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:33:06.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:06.715+0000 7f6454b81640 1 --2- 172.21.15.60:0/3578422689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6450158300 0x7f645015f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:33:06.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:06.715+0000 7f6454b81640 1 --2- 172.21.15.60:0/3578422689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6450158300 0x7f645015f9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:33:06.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:06.916+0000 7f6454b81640 1 --2- 172.21.15.60:0/3578422689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6450158300 0x7f645015f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:06.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:06.916+0000 7f6454b81640 1 -- 172.21.15.60:0/3578422689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6450158300 msgr2=0x7f645015f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:33:06.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:06.916+0000 7f6454b81640 1 -- 172.21.15.60:0/3578422689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6450158300 msgr2=0x7f645015f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:33:06.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:06.916+0000 7f6454b81640 1 --2- 172.21.15.60:0/3578422689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6450158300 0x7f645015f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:33:06.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:06.916+0000 7f6454b81640 1 --2- 172.21.15.60:0/3578422689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6450158300 0x7f645015f9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:33:07.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:07.317+0000 7f6454b81640 1 --2- 172.21.15.60:0/3578422689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6450158300 0x7f645015f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:07.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:07.317+0000 7f6454b81640 1 -- 172.21.15.60:0/3578422689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6450158300 msgr2=0x7f645015f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:33:07.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:07.317+0000 7f6454b81640 1 -- 172.21.15.60:0/3578422689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6450158300 msgr2=0x7f645015f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:33:07.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:07.317+0000 7f6454b81640 1 --2- 172.21.15.60:0/3578422689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6450158300 0x7f645015f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:33:07.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:07.317+0000 7f6454b81640 1 --2- 172.21.15.60:0/3578422689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6450158300 0x7f645015f9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:33:08.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.118+0000 7f6454b81640 1 --2- 172.21.15.60:0/3578422689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6450158300 0x7f645015f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:08.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.118+0000 7f6454b81640 1 -- 172.21.15.60:0/3578422689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6450158300 msgr2=0x7f645015f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:33:08.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.118+0000 7f6454b81640 1 -- 172.21.15.60:0/3578422689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6450158300 msgr2=0x7f645015f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:33:08.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.118+0000 7f6454b81640 1 --2- 172.21.15.60:0/3578422689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6450158300 0x7f645015f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:33:08.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.118+0000 7f6454b81640 1 --2- 172.21.15.60:0/3578422689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6450158300 0x7f645015f9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:33:08.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.623+0000 7f644effd640 1 -- 172.21.15.60:0/3578422689 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2657516204 0 0) 0x7f64500c50e0 con 0x7f64500c7a70 2024-09-12T02:33:08.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.623+0000 7f644effd640 1 -- 172.21.15.60:0/3578422689 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6438003520 con 0x7f64500c7a70 2024-09-12T02:33:08.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.624+0000 7f644effd640 1 -- 172.21.15.60:0/3578422689 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3538073385 0 0) 0x7f6438003520 con 0x7f64500c7a70 2024-09-12T02:33:08.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.624+0000 7f644effd640 1 -- 172.21.15.60:0/3578422689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6450158300 msgr2=0x7f645015f9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:33:08.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.624+0000 7f644effd640 1 --2- 172.21.15.60:0/3578422689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6450158300 0x7f645015f9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:08.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.624+0000 7f644effd640 1 -- 172.21.15.60:0/3578422689 >> v1:172.21.15.60:6789/0 conn(0x7f64500744a0 legacy=0x7f6450157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:08.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.624+0000 7f644effd640 1 -- 172.21.15.60:0/3578422689 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64501576d0 con 0x7f64500c7a70 2024-09-12T02:33:08.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.624+0000 7f644effd640 1 -- 172.21.15.60:0/3578422689 <== mon.1 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7f6440001670 con 0x7f64500c7a70 2024-09-12T02:33:08.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.624+0000 7f644effd640 1 -- 172.21.15.60:0/3578422689 >> v1:172.21.15.105:6789/0 conn(0x7f64500c7a70 legacy=0x7f64500c7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:08.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.624+0000 7f644effd640 1 --2- 172.21.15.60:0/3578422689 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64380039b0 0x7f6438003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:08.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.624+0000 7f644effd640 1 --2- 172.21.15.60:0/3578422689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6438004800 0x7f6438004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:08.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.624+0000 7f644effd640 1 --2- 172.21.15.60:0/3578422689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6450158300 0x7f6438005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:08.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.624+0000 7f644effd640 1 -- 172.21.15.60:0/3578422689 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f643800bb50 con 0x7f6438004800 2024-09-12T02:33:08.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.624+0000 7f644effd640 1 -- 172.21.15.60:0/3578422689 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f643800bcd0 con 0x7f64380039b0 2024-09-12T02:33:08.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.624+0000 7f644effd640 1 -- 172.21.15.60:0/3578422689 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f643800bea0 con 0x7f6450158300 2024-09-12T02:33:08.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.625+0000 7f644ffff640 1 --2- 172.21.15.60:0/3578422689 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64380039b0 0x7f6438003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:08.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.626+0000 7f644ffff640 1 -- 172.21.15.60:0/3578422689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6450158300 msgr2=0x7f6438005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:08.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.626+0000 7f644ffff640 1 --2- 172.21.15.60:0/3578422689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6450158300 0x7f6438005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:08.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.626+0000 7f644ffff640 1 -- 172.21.15.60:0/3578422689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6438004800 msgr2=0x7f6438004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:08.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.626+0000 7f644ffff640 1 --2- 172.21.15.60:0/3578422689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6438004800 0x7f6438004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:08.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.626+0000 7f644ffff640 1 -- 172.21.15.60:0/3578422689 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6438003520 con 0x7f64380039b0 2024-09-12T02:33:08.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.628+0000 7f644ffff640 1 --2- 172.21.15.60:0/3578422689 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64380039b0 0x7f6438003dd0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6440007f30 tx=0x7f6438005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7f9ff521bee944 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:08.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.629+0000 7f644effd640 1 -- 172.21.15.60:0/3578422689 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6440036070 con 0x7f64380039b0 2024-09-12T02:33:08.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.629+0000 7f644effd640 1 -- 172.21.15.60:0/3578422689 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6440031620 con 0x7f64380039b0 2024-09-12T02:33:08.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.629+0000 7f644effd640 1 -- 172.21.15.60:0/3578422689 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6440007b50 con 0x7f64380039b0 2024-09-12T02:33:08.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.630+0000 7f64565e4640 1 -- 172.21.15.60:0/3578422689 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64380039b0 msgr2=0x7f6438003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:08.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.630+0000 7f64565e4640 1 --2- 172.21.15.60:0/3578422689 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64380039b0 0x7f6438003dd0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6440007f30 tx=0x7f6438005830 comp rx=0 tx=0).stop 2024-09-12T02:33:08.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.630+0000 7f6454b81640 1 -- 172.21.15.60:0/3578422689 reap_dead start 2024-09-12T02:33:08.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.630+0000 7f64565e4640 1 -- 172.21.15.60:0/3578422689 shutdown_connections 2024-09-12T02:33:08.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.630+0000 7f64565e4640 1 -- 172.21.15.60:0/3578422689 >> 172.21.15.60:0/3578422689 conn(0x7f64500c5660 msgr2=0x7f64500c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:08.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.630+0000 7f64565e4640 1 -- 172.21.15.60:0/3578422689 shutdown_connections 2024-09-12T02:33:08.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.630+0000 7f64565e4640 1 -- 172.21.15.60:0/3578422689 wait complete. 2024-09-12T02:33:08.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.632+0000 7f64565e4640 1 Processor -- start 2024-09-12T02:33:08.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.632+0000 7f64565e4640 1 -- start start 2024-09-12T02:33:08.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.633+0000 7f64565e4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f64380039b0 0x7f6450149c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:08.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.634+0000 7f64565e4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64501dd6a0 0x7f64501472b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:08.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.634+0000 7f64565e4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64500aa050 0x7f64501477f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:08.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.634+0000 7f64565e4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6450071bb0 con 0x7f64501dd6a0 2024-09-12T02:33:08.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.634+0000 7f64565e4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f64500c53c0 con 0x7f64500aa050 2024-09-12T02:33:08.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.634+0000 7f64565e4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6450071d30 con 0x7f64380039b0 2024-09-12T02:33:08.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.634+0000 7f644f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64501dd6a0 0x7f64501472b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:08.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.634+0000 7f644f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64501dd6a0 0x7f64501472b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37116/0 (socket says 172.21.15.60:37116) 2024-09-12T02:33:08.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.634+0000 7f644f7fe640 1 -- 172.21.15.60:0/3971644092 learned_addr learned my addr 172.21.15.60:0/3971644092 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:33:08.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.634+0000 7f644ffff640 1 --2- 172.21.15.60:0/3971644092 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f64380039b0 0x7f6450149c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:08.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.634+0000 7f6454b81640 1 --2- 172.21.15.60:0/3971644092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64500aa050 0x7f64501477f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:08.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.634+0000 7f644ffff640 1 -- 172.21.15.60:0/3971644092 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f64380039b0 msgr2=0x7f6450149c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-12T02:33:08.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.634+0000 7f644ffff640 1 -- 172.21.15.60:0/3971644092 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f64380039b0 msgr2=0x7f6450149c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:33:08.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.634+0000 7f644ffff640 1 --2- 172.21.15.60:0/3971644092 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f64380039b0 0x7f6450149c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:33:08.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.634+0000 7f644ffff640 1 --2- 172.21.15.60:0/3971644092 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f64380039b0 0x7f6450149c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:33:08.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.634+0000 7f644f7fe640 1 -- 172.21.15.60:0/3971644092 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f64380039b0 msgr2=0x7f6450149c80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:33:08.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.634+0000 7f644f7fe640 1 --2- 172.21.15.60:0/3971644092 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f64380039b0 0x7f6450149c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:08.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.634+0000 7f644f7fe640 1 -- 172.21.15.60:0/3971644092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64500aa050 msgr2=0x7f64501477f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:08.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.634+0000 7f644f7fe640 1 --2- 172.21.15.60:0/3971644092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64500aa050 0x7f64501477f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:08.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.634+0000 7f644f7fe640 1 -- 172.21.15.60:0/3971644092 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64500a9140 con 0x7f64501dd6a0 2024-09-12T02:33:08.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.635+0000 7f644f7fe640 1 --2- 172.21.15.60:0/3971644092 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64501dd6a0 0x7f64501472b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f644400c500 tx=0x7f644400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:08.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.635+0000 7f644cff9640 1 -- 172.21.15.60:0/3971644092 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6444018070 con 0x7f64501dd6a0 2024-09-12T02:33:08.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.636+0000 7f64565e4640 1 -- 172.21.15.60:0/3971644092 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6450148270 con 0x7f64501dd6a0 2024-09-12T02:33:08.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.636+0000 7f64565e4640 1 -- 172.21.15.60:0/3971644092 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64500a96c0 con 0x7f64501dd6a0 2024-09-12T02:33:08.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.636+0000 7f644cff9640 1 -- 172.21.15.60:0/3971644092 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6444005ce0 con 0x7f64501dd6a0 2024-09-12T02:33:08.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.636+0000 7f644cff9640 1 -- 172.21.15.60:0/3971644092 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64440072d0 con 0x7f64501dd6a0 2024-09-12T02:33:08.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.637+0000 7f64565e4640 1 -- 172.21.15.60:0/3971644092 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6430005290 con 0x7f64501dd6a0 2024-09-12T02:33:08.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.638+0000 7f644cff9640 1 -- 172.21.15.60:0/3971644092 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f644401b070 con 0x7f64501dd6a0 2024-09-12T02:33:08.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.638+0000 7f644cff9640 1 --2- 172.21.15.60:0/3971644092 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f643c06be60 0x7f643c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:08.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.638+0000 7f644cff9640 1 -- 172.21.15.60:0/3971644092 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f644408a460 con 0x7f64501dd6a0 2024-09-12T02:33:08.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.639+0000 7f644ffff640 1 --2- 172.21.15.60:0/3971644092 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f643c06be60 0x7f643c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:08.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.639+0000 7f644ffff640 1 --2- 172.21.15.60:0/3971644092 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f643c06be60 0x7f643c06e320 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6440007f30 tx=0x7f6440009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:08.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:08.648+0000 7f644cff9640 1 -- 172.21.15.60:0/3971644092 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f64440584b0 con 0x7f64501dd6a0 2024-09-12T02:33:09.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:09.078+0000 7f64565e4640 1 -- 172.21.15.60:0/3971644092 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6430005850 con 0x7f64501dd6a0 2024-09-12T02:33:09.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:09.078+0000 7f644cff9640 1 -- 172.21.15.60:0/3971644092 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7f644405c7b0 con 0x7f64501dd6a0 2024-09-12T02:33:09.079 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":88,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:33:09.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:09.081+0000 7f64565e4640 1 -- 172.21.15.60:0/3971644092 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f643c06be60 msgr2=0x7f643c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:09.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:09.081+0000 7f64565e4640 1 --2- 172.21.15.60:0/3971644092 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f643c06be60 0x7f643c06e320 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6440007f30 tx=0x7f6440009030 comp rx=0 tx=0).stop 2024-09-12T02:33:09.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:09.081+0000 7f64565e4640 1 -- 172.21.15.60:0/3971644092 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64501dd6a0 msgr2=0x7f64501472b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:09.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:09.081+0000 7f64565e4640 1 --2- 172.21.15.60:0/3971644092 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64501dd6a0 0x7f64501472b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f644400c500 tx=0x7f644400c9c0 comp rx=0 tx=0).stop 2024-09-12T02:33:09.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:09.081+0000 7f64565e4640 1 -- 172.21.15.60:0/3971644092 shutdown_connections 2024-09-12T02:33:09.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:09.081+0000 7f64565e4640 1 --2- 172.21.15.60:0/3971644092 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f643c06be60 0x7f643c06e320 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:09.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:09.081+0000 7f64565e4640 1 --2- 172.21.15.60:0/3971644092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64500aa050 0x7f64501477f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:09.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:09.081+0000 7f64565e4640 1 --2- 172.21.15.60:0/3971644092 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64501dd6a0 0x7f64501472b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:09.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:09.081+0000 7f64565e4640 1 --2- 172.21.15.60:0/3971644092 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f64380039b0 0x7f6450149c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:09.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:09.081+0000 7f64565e4640 1 -- 172.21.15.60:0/3971644092 >> 172.21.15.60:0/3971644092 conn(0x7f64500c5660 msgr2=0x7f6450152d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:09.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:09.081+0000 7f64565e4640 1 -- 172.21.15.60:0/3971644092 shutdown_connections 2024-09-12T02:33:09.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:09.081+0000 7f64565e4640 1 -- 172.21.15.60:0/3971644092 wait complete. 2024-09-12T02:33:12.098 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:33:12.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:12.536+0000 7fe6991c4640 1 Processor -- start 2024-09-12T02:33:12.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:12.536+0000 7fe6991c4640 1 -- start start 2024-09-12T02:33:12.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:12.537+0000 7fe6991c4640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe6940af5c0 0x7fe694155430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:12.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:12.537+0000 7fe6991c4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe6940afc20 0x7fe694070f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:12.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:12.538+0000 7fe6991c4640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe694070480 con 0x7fe694071460 2024-09-12T02:33:12.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:12.538+0000 7fe6991c4640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fe694158470 con 0x7fe6940afc20 2024-09-12T02:33:12.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:12.538+0000 7fe6991c4640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fe694070a90 con 0x7fe6940af5c0 2024-09-12T02:33:12.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:12.538+0000 7fe69359e640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe694071460 0x7fe6941574d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:56690/0 (socket says 172.21.15.60:56690) 2024-09-12T02:33:12.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:12.538+0000 7fe69359e640 1 -- 172.21.15.60:0/1192869070 learned_addr learned my addr 172.21.15.60:0/1192869070 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:33:12.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:12.538+0000 7fe692d9d640 1 --2- 172.21.15.60:0/1192869070 >> v2:172.21.15.105:3300/0 conn(0x7fe6940af5c0 0x7fe694155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:12.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:12.539+0000 7fe69259c640 1 --2- 172.21.15.60:0/1192869070 >> v2:172.21.15.60:3300/0 conn(0x7fe6940afc20 0x7fe694070f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:12.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:12.539+0000 7fe69259c640 1 -- 172.21.15.60:0/1192869070 >> v2:172.21.15.60:3300/0 conn(0x7fe6940afc20 msgr2=0x7fe694070f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:33:12.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:12.539+0000 7fe69259c640 1 -- 172.21.15.60:0/1192869070 >> v2:172.21.15.60:3300/0 conn(0x7fe6940afc20 msgr2=0x7fe694070f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:33:12.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:12.539+0000 7fe69259c640 1 --2- 172.21.15.60:0/1192869070 >> v2:172.21.15.60:3300/0 conn(0x7fe6940afc20 0x7fe694070f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:33:12.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:12.539+0000 7fe69259c640 1 --2- 172.21.15.60:0/1192869070 >> v2:172.21.15.60:3300/0 conn(0x7fe6940afc20 0x7fe694070f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:33:12.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:12.539+0000 7fe692d9d640 1 -- 172.21.15.60:0/1192869070 >> v2:172.21.15.105:3300/0 conn(0x7fe6940af5c0 msgr2=0x7fe694155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:33:12.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:12.539+0000 7fe692d9d640 1 -- 172.21.15.60:0/1192869070 >> v2:172.21.15.105:3300/0 conn(0x7fe6940af5c0 msgr2=0x7fe694155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:33:12.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:12.539+0000 7fe692d9d640 1 --2- 172.21.15.60:0/1192869070 >> v2:172.21.15.105:3300/0 conn(0x7fe6940af5c0 0x7fe694155430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:33:12.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:12.539+0000 7fe692d9d640 1 --2- 172.21.15.60:0/1192869070 >> v2:172.21.15.105:3300/0 conn(0x7fe6940af5c0 0x7fe694155430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:33:12.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:12.740+0000 7fe69259c640 1 --2- 172.21.15.60:0/1192869070 >> v2:172.21.15.60:3300/0 conn(0x7fe6940afc20 0x7fe694070f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:12.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:12.740+0000 7fe69259c640 1 -- 172.21.15.60:0/1192869070 >> v2:172.21.15.60:3300/0 conn(0x7fe6940afc20 msgr2=0x7fe694070f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:33:12.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:12.740+0000 7fe69259c640 1 -- 172.21.15.60:0/1192869070 >> v2:172.21.15.60:3300/0 conn(0x7fe6940afc20 msgr2=0x7fe694070f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:33:12.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:12.740+0000 7fe69259c640 1 --2- 172.21.15.60:0/1192869070 >> v2:172.21.15.60:3300/0 conn(0x7fe6940afc20 0x7fe694070f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:33:12.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:12.740+0000 7fe692d9d640 1 --2- 172.21.15.60:0/1192869070 >> v2:172.21.15.105:3300/0 conn(0x7fe6940af5c0 0x7fe694155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:12.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:12.740+0000 7fe69259c640 1 --2- 172.21.15.60:0/1192869070 >> v2:172.21.15.60:3300/0 conn(0x7fe6940afc20 0x7fe694070f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:33:12.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:12.740+0000 7fe692d9d640 1 -- 172.21.15.60:0/1192869070 >> v2:172.21.15.105:3300/0 conn(0x7fe6940af5c0 msgr2=0x7fe694155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:33:12.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:12.740+0000 7fe692d9d640 1 -- 172.21.15.60:0/1192869070 >> v2:172.21.15.105:3300/0 conn(0x7fe6940af5c0 msgr2=0x7fe694155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:33:12.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:12.740+0000 7fe692d9d640 1 --2- 172.21.15.60:0/1192869070 >> v2:172.21.15.105:3300/0 conn(0x7fe6940af5c0 0x7fe694155430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:33:12.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:12.740+0000 7fe692d9d640 1 --2- 172.21.15.60:0/1192869070 >> v2:172.21.15.105:3300/0 conn(0x7fe6940af5c0 0x7fe694155430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:33:13.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:13.141+0000 7fe69259c640 1 --2- 172.21.15.60:0/1192869070 >> v2:172.21.15.60:3300/0 conn(0x7fe6940afc20 0x7fe694070f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:13.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:13.141+0000 7fe692d9d640 1 --2- 172.21.15.60:0/1192869070 >> v2:172.21.15.105:3300/0 conn(0x7fe6940af5c0 0x7fe694155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:13.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:13.141+0000 7fe69259c640 1 -- 172.21.15.60:0/1192869070 >> v2:172.21.15.60:3300/0 conn(0x7fe6940afc20 msgr2=0x7fe694070f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:33:13.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:13.141+0000 7fe69259c640 1 -- 172.21.15.60:0/1192869070 >> v2:172.21.15.60:3300/0 conn(0x7fe6940afc20 msgr2=0x7fe694070f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:33:13.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:13.141+0000 7fe69259c640 1 --2- 172.21.15.60:0/1192869070 >> v2:172.21.15.60:3300/0 conn(0x7fe6940afc20 0x7fe694070f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:33:13.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:13.141+0000 7fe692d9d640 1 -- 172.21.15.60:0/1192869070 >> v2:172.21.15.105:3300/0 conn(0x7fe6940af5c0 msgr2=0x7fe694155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:33:13.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:13.141+0000 7fe692d9d640 1 -- 172.21.15.60:0/1192869070 >> v2:172.21.15.105:3300/0 conn(0x7fe6940af5c0 msgr2=0x7fe694155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:33:13.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:13.141+0000 7fe692d9d640 1 --2- 172.21.15.60:0/1192869070 >> v2:172.21.15.105:3300/0 conn(0x7fe6940af5c0 0x7fe694155430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:33:13.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:13.141+0000 7fe692d9d640 1 --2- 172.21.15.60:0/1192869070 >> v2:172.21.15.105:3300/0 conn(0x7fe6940af5c0 0x7fe694155430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:33:13.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:13.141+0000 7fe69259c640 1 --2- 172.21.15.60:0/1192869070 >> v2:172.21.15.60:3300/0 conn(0x7fe6940afc20 0x7fe694070f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:33:13.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:13.942+0000 7fe69259c640 1 --2- 172.21.15.60:0/1192869070 >> v2:172.21.15.60:3300/0 conn(0x7fe6940afc20 0x7fe694070f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:13.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:13.942+0000 7fe692d9d640 1 --2- 172.21.15.60:0/1192869070 >> v2:172.21.15.105:3300/0 conn(0x7fe6940af5c0 0x7fe694155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:13.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:13.942+0000 7fe69259c640 1 -- 172.21.15.60:0/1192869070 >> v2:172.21.15.60:3300/0 conn(0x7fe6940afc20 msgr2=0x7fe694070f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:33:13.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:13.942+0000 7fe69259c640 1 -- 172.21.15.60:0/1192869070 >> v2:172.21.15.60:3300/0 conn(0x7fe6940afc20 msgr2=0x7fe694070f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:33:13.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:13.942+0000 7fe69259c640 1 --2- 172.21.15.60:0/1192869070 >> v2:172.21.15.60:3300/0 conn(0x7fe6940afc20 0x7fe694070f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:33:13.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:13.942+0000 7fe69259c640 1 --2- 172.21.15.60:0/1192869070 >> v2:172.21.15.60:3300/0 conn(0x7fe6940afc20 0x7fe694070f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:33:13.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:13.942+0000 7fe692d9d640 1 -- 172.21.15.60:0/1192869070 >> v2:172.21.15.105:3300/0 conn(0x7fe6940af5c0 msgr2=0x7fe694155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:33:13.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:13.942+0000 7fe692d9d640 1 -- 172.21.15.60:0/1192869070 >> v2:172.21.15.105:3300/0 conn(0x7fe6940af5c0 msgr2=0x7fe694155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:33:13.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:13.942+0000 7fe692d9d640 1 --2- 172.21.15.60:0/1192869070 >> v2:172.21.15.105:3300/0 conn(0x7fe6940af5c0 0x7fe694155430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:33:13.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:13.942+0000 7fe692d9d640 1 --2- 172.21.15.60:0/1192869070 >> v2:172.21.15.105:3300/0 conn(0x7fe6940af5c0 0x7fe694155430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:33:14.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.627+0000 7fe691d9b640 1 -- 172.21.15.60:0/1192869070 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1242008799 0 0) 0x7fe694070480 con 0x7fe694071460 2024-09-12T02:33:14.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.627+0000 7fe691d9b640 1 -- 172.21.15.60:0/1192869070 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe680003520 con 0x7fe694071460 2024-09-12T02:33:14.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.632+0000 7fe691d9b640 1 -- 172.21.15.60:0/1192869070 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1622887914 0 0) 0x7fe680003520 con 0x7fe694071460 2024-09-12T02:33:14.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.632+0000 7fe691d9b640 1 -- 172.21.15.60:0/1192869070 >> v2:172.21.15.105:3300/0 conn(0x7fe6940af5c0 msgr2=0x7fe694155430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:33:14.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.632+0000 7fe691d9b640 1 --2- 172.21.15.60:0/1192869070 >> v2:172.21.15.105:3300/0 conn(0x7fe6940af5c0 0x7fe694155430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:14.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.632+0000 7fe691d9b640 1 -- 172.21.15.60:0/1192869070 >> v2:172.21.15.60:3300/0 conn(0x7fe6940afc20 msgr2=0x7fe694070f20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:33:14.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.632+0000 7fe691d9b640 1 --2- 172.21.15.60:0/1192869070 >> v2:172.21.15.60:3300/0 conn(0x7fe6940afc20 0x7fe694070f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:14.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.632+0000 7fe691d9b640 1 -- 172.21.15.60:0/1192869070 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe694158190 con 0x7fe694071460 2024-09-12T02:33:14.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.632+0000 7fe691d9b640 1 -- 172.21.15.60:0/1192869070 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7fe67c001670 con 0x7fe694071460 2024-09-12T02:33:14.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.632+0000 7fe691d9b640 1 -- 172.21.15.60:0/1192869070 >> v1:172.21.15.60:6789/0 conn(0x7fe694071460 legacy=0x7fe6941574d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:14.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.632+0000 7fe691d9b640 1 --2- 172.21.15.60:0/1192869070 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6800039b0 0x7fe680003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:14.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.632+0000 7fe691d9b640 1 --2- 172.21.15.60:0/1192869070 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe680004800 0x7fe680004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:14.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.632+0000 7fe691d9b640 1 --2- 172.21.15.60:0/1192869070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6800051c0 0x7fe68000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:14.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.632+0000 7fe691d9b640 1 -- 172.21.15.60:0/1192869070 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe694158470 con 0x7fe6800051c0 2024-09-12T02:33:14.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.632+0000 7fe691d9b640 1 -- 172.21.15.60:0/1192869070 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe694070a90 con 0x7fe6800039b0 2024-09-12T02:33:14.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.632+0000 7fe691d9b640 1 -- 172.21.15.60:0/1192869070 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe68000c170 con 0x7fe680004800 2024-09-12T02:33:14.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.632+0000 7fe692d9d640 1 --2- 172.21.15.60:0/1192869070 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6800039b0 0x7fe680003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:14.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.632+0000 7fe69259c640 1 --2- 172.21.15.60:0/1192869070 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe680004800 0x7fe680004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:14.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.633+0000 7fe692d9d640 1 -- 172.21.15.60:0/1192869070 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe680004800 msgr2=0x7fe680004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:14.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.633+0000 7fe692d9d640 1 --2- 172.21.15.60:0/1192869070 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe680004800 0x7fe680004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:14.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.633+0000 7fe692d9d640 1 -- 172.21.15.60:0/1192869070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6800051c0 msgr2=0x7fe68000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:14.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.633+0000 7fe692d9d640 1 --2- 172.21.15.60:0/1192869070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6800051c0 0x7fe68000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:14.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.633+0000 7fe692d9d640 1 -- 172.21.15.60:0/1192869070 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe694158190 con 0x7fe6800039b0 2024-09-12T02:33:14.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.633+0000 7fe69359e640 1 -- 172.21.15.60:0/1192869070 reap_dead start 2024-09-12T02:33:14.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.633+0000 7fe69259c640 1 --2- 172.21.15.60:0/1192869070 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe680004800 0x7fe680004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:33:14.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.634+0000 7fe692d9d640 1 --2- 172.21.15.60:0/1192869070 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6800039b0 0x7fe680003dd0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe68c011b90 tx=0x7fe680005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abd75e13e1682b3d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:14.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.635+0000 7fe691d9b640 1 -- 172.21.15.60:0/1192869070 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe68c031070 con 0x7fe6800039b0 2024-09-12T02:33:14.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.635+0000 7fe691d9b640 1 -- 172.21.15.60:0/1192869070 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe68c02b790 con 0x7fe6800039b0 2024-09-12T02:33:14.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.635+0000 7fe691d9b640 1 -- 172.21.15.60:0/1192869070 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe68c011790 con 0x7fe6800039b0 2024-09-12T02:33:14.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.636+0000 7fe6991c4640 1 -- 172.21.15.60:0/1192869070 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6800039b0 msgr2=0x7fe680003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:14.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.636+0000 7fe6991c4640 1 --2- 172.21.15.60:0/1192869070 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6800039b0 0x7fe680003dd0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe68c011b90 tx=0x7fe680005830 comp rx=0 tx=0).stop 2024-09-12T02:33:14.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.636+0000 7fe6991c4640 1 -- 172.21.15.60:0/1192869070 shutdown_connections 2024-09-12T02:33:14.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.636+0000 7fe6991c4640 1 --2- 172.21.15.60:0/1192869070 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6800039b0 0x7fe680003dd0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:14.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.636+0000 7fe6991c4640 1 -- 172.21.15.60:0/1192869070 >> 172.21.15.60:0/1192869070 conn(0x7fe6940c6880 msgr2=0x7fe6940c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:14.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.636+0000 7fe6991c4640 1 -- 172.21.15.60:0/1192869070 shutdown_connections 2024-09-12T02:33:14.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.636+0000 7fe6991c4640 1 -- 172.21.15.60:0/1192869070 wait complete. 2024-09-12T02:33:14.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.638+0000 7fe6991c4640 1 Processor -- start 2024-09-12T02:33:14.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.639+0000 7fe6991c4640 1 -- start start 2024-09-12T02:33:14.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.639+0000 7fe6991c4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6800039b0 0x7fe6941ed3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:14.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.639+0000 7fe6991c4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6941de5a0 0x7fe6940add50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:14.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.640+0000 7fe6991c4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6941ddad0 0x7fe6940ae290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:14.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.640+0000 7fe6991c4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe694073ca0 con 0x7fe6941ddad0 2024-09-12T02:33:14.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.640+0000 7fe6991c4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe6940c7690 con 0x7fe6800039b0 2024-09-12T02:33:14.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.640+0000 7fe6991c4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe694073e20 con 0x7fe6941de5a0 2024-09-12T02:33:14.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.640+0000 7fe69359e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6941ddad0 0x7fe6940ae290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:14.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.640+0000 7fe69359e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6941ddad0 0x7fe6940ae290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39646/0 (socket says 172.21.15.60:39646) 2024-09-12T02:33:14.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.640+0000 7fe69359e640 1 -- 172.21.15.60:0/3140971873 learned_addr learned my addr 172.21.15.60:0/3140971873 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:33:14.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.640+0000 7fe69259c640 1 --2- 172.21.15.60:0/3140971873 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6941de5a0 0x7fe6940add50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:14.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.640+0000 7fe69259c640 1 -- 172.21.15.60:0/3140971873 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6941de5a0 msgr2=0x7fe6940add50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-12T02:33:14.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.640+0000 7fe69259c640 1 -- 172.21.15.60:0/3140971873 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6941de5a0 msgr2=0x7fe6940add50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:33:14.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.640+0000 7fe69259c640 1 --2- 172.21.15.60:0/3140971873 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6941de5a0 0x7fe6940add50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:33:14.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.640+0000 7fe69359e640 1 -- 172.21.15.60:0/3140971873 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6941de5a0 msgr2=0x7fe6940add50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:14.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.641+0000 7fe69259c640 1 --2- 172.21.15.60:0/3140971873 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6941de5a0 0x7fe6940add50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:33:14.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.641+0000 7fe69359e640 1 --2- 172.21.15.60:0/3140971873 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6941de5a0 0x7fe6940add50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:14.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.641+0000 7fe69359e640 1 -- 172.21.15.60:0/3140971873 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6800039b0 msgr2=0x7fe6941ed3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:14.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.641+0000 7fe69359e640 1 --2- 172.21.15.60:0/3140971873 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6800039b0 0x7fe6941ed3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:14.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.641+0000 7fe69359e640 1 -- 172.21.15.60:0/3140971873 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6941e03b0 con 0x7fe6941ddad0 2024-09-12T02:33:14.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.641+0000 7fe69359e640 1 --2- 172.21.15.60:0/3140971873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6941ddad0 0x7fe6940ae290 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe6940af9a0 tx=0x7fe67c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:14.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.642+0000 7fe68b7fe640 1 -- 172.21.15.60:0/3140971873 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe67c004bf0 con 0x7fe6941ddad0 2024-09-12T02:33:14.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.642+0000 7fe68b7fe640 1 -- 172.21.15.60:0/3140971873 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe67c004db0 con 0x7fe6941ddad0 2024-09-12T02:33:14.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.642+0000 7fe68b7fe640 1 -- 172.21.15.60:0/3140971873 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe67c0073b0 con 0x7fe6941ddad0 2024-09-12T02:33:14.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.642+0000 7fe6991c4640 1 -- 172.21.15.60:0/3140971873 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6941ede50 con 0x7fe6941ddad0 2024-09-12T02:33:14.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.642+0000 7fe6991c4640 1 -- 172.21.15.60:0/3140971873 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6941e00d0 con 0x7fe6941ddad0 2024-09-12T02:33:14.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.644+0000 7fe6991c4640 1 -- 172.21.15.60:0/3140971873 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe694155430 con 0x7fe6941ddad0 2024-09-12T02:33:14.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.645+0000 7fe68b7fe640 1 -- 172.21.15.60:0/3140971873 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe67c01d3f0 con 0x7fe6941ddad0 2024-09-12T02:33:14.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.646+0000 7fe68b7fe640 1 --2- 172.21.15.60:0/3140971873 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe67406bf00 0x7fe67406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:14.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.646+0000 7fe692d9d640 1 --2- 172.21.15.60:0/3140971873 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe67406bf00 0x7fe67406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:14.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.647+0000 7fe68b7fe640 1 -- 172.21.15.60:0/3140971873 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fe67c08acd0 con 0x7fe6941ddad0 2024-09-12T02:33:14.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.647+0000 7fe692d9d640 1 --2- 172.21.15.60:0/3140971873 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe67406bf00 0x7fe67406e3c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe68c036000 tx=0x7fe68c02d000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:14.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:14.654+0000 7fe68b7fe640 1 -- 172.21.15.60:0/3140971873 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe67c090020 con 0x7fe6941ddad0 2024-09-12T02:33:15.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:15.074+0000 7fe6991c4640 1 -- 172.21.15.60:0/3140971873 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe6940696f0 con 0x7fe6941ddad0 2024-09-12T02:33:15.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:15.074+0000 7fe68b7fe640 1 -- 172.21.15.60:0/3140971873 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7fe67c058d00 con 0x7fe6941ddad0 2024-09-12T02:33:15.075 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":92,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:33:15.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:15.078+0000 7fe6991c4640 1 -- 172.21.15.60:0/3140971873 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe67406bf00 msgr2=0x7fe67406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:15.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:15.078+0000 7fe6991c4640 1 --2- 172.21.15.60:0/3140971873 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe67406bf00 0x7fe67406e3c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe68c036000 tx=0x7fe68c02d000 comp rx=0 tx=0).stop 2024-09-12T02:33:15.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:15.078+0000 7fe6991c4640 1 -- 172.21.15.60:0/3140971873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6941ddad0 msgr2=0x7fe6940ae290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:15.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:15.078+0000 7fe6991c4640 1 --2- 172.21.15.60:0/3140971873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6941ddad0 0x7fe6940ae290 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe6940af9a0 tx=0x7fe67c00c8e0 comp rx=0 tx=0).stop 2024-09-12T02:33:15.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:15.078+0000 7fe6991c4640 1 -- 172.21.15.60:0/3140971873 shutdown_connections 2024-09-12T02:33:15.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:15.078+0000 7fe6991c4640 1 --2- 172.21.15.60:0/3140971873 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe67406bf00 0x7fe67406e3c0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:15.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:15.078+0000 7fe6991c4640 1 --2- 172.21.15.60:0/3140971873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6941ddad0 0x7fe6940ae290 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:15.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:15.078+0000 7fe6991c4640 1 --2- 172.21.15.60:0/3140971873 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6941de5a0 0x7fe6940add50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:15.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:15.078+0000 7fe6991c4640 1 --2- 172.21.15.60:0/3140971873 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6800039b0 0x7fe6941ed3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:15.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:15.078+0000 7fe6991c4640 1 -- 172.21.15.60:0/3140971873 >> 172.21.15.60:0/3140971873 conn(0x7fe6940c6880 msgr2=0x7fe694156620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:15.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:15.079+0000 7fe6991c4640 1 -- 172.21.15.60:0/3140971873 shutdown_connections 2024-09-12T02:33:15.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:15.079+0000 7fe6991c4640 1 -- 172.21.15.60:0/3140971873 wait complete. 2024-09-12T02:33:18.096 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:33:18.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:18.257+0000 7fc1f0b0b640 1 Processor -- start 2024-09-12T02:33:18.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:18.257+0000 7fc1f0b0b640 1 -- start start 2024-09-12T02:33:18.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:18.259+0000 7fc1f0b0b640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc1ec15e450 0x7fc1ec15afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:18.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:18.259+0000 7fc1f0b0b640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1ec0c2400 con 0x7fc1ec157e60 2024-09-12T02:33:18.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:18.259+0000 7fc1f0b0b640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1ec0c26e0 con 0x7fc1ec0c5e30 2024-09-12T02:33:18.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:18.259+0000 7fc1f0b0b640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc1ec0c6310 con 0x7fc1ec15e450 2024-09-12T02:33:18.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:18.259+0000 7fc1eb7fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fc1ec157e60 0x7fc1ec0c7da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:56700/0 (socket says 172.21.15.60:56700) 2024-09-12T02:33:18.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:18.259+0000 7fc1eb7fe640 1 -- 172.21.15.60:0/2297282763 learned_addr learned my addr 172.21.15.60:0/2297282763 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:33:18.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:18.259+0000 7fc1ebfff640 1 --2- 172.21.15.60:0/2297282763 >> v2:172.21.15.105:3300/0 conn(0x7fc1ec15e450 0x7fc1ec15afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:18.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:18.260+0000 7fc1ebfff640 1 -- 172.21.15.60:0/2297282763 >> v2:172.21.15.105:3300/0 conn(0x7fc1ec15e450 msgr2=0x7fc1ec15afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:33:18.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:18.260+0000 7fc1ebfff640 1 -- 172.21.15.60:0/2297282763 >> v2:172.21.15.105:3300/0 conn(0x7fc1ec15e450 msgr2=0x7fc1ec15afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:33:18.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:18.260+0000 7fc1ebfff640 1 --2- 172.21.15.60:0/2297282763 >> v2:172.21.15.105:3300/0 conn(0x7fc1ec15e450 0x7fc1ec15afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:33:18.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:18.260+0000 7fc1ebfff640 1 --2- 172.21.15.60:0/2297282763 >> v2:172.21.15.105:3300/0 conn(0x7fc1ec15e450 0x7fc1ec15afb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:33:18.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:18.461+0000 7fc1ebfff640 1 --2- 172.21.15.60:0/2297282763 >> v2:172.21.15.105:3300/0 conn(0x7fc1ec15e450 0x7fc1ec15afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:18.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:18.461+0000 7fc1ebfff640 1 -- 172.21.15.60:0/2297282763 >> v2:172.21.15.105:3300/0 conn(0x7fc1ec15e450 msgr2=0x7fc1ec15afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:33:18.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:18.461+0000 7fc1ebfff640 1 -- 172.21.15.60:0/2297282763 >> v2:172.21.15.105:3300/0 conn(0x7fc1ec15e450 msgr2=0x7fc1ec15afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:33:18.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:18.461+0000 7fc1ebfff640 1 --2- 172.21.15.60:0/2297282763 >> v2:172.21.15.105:3300/0 conn(0x7fc1ec15e450 0x7fc1ec15afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:33:18.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:18.461+0000 7fc1ebfff640 1 --2- 172.21.15.60:0/2297282763 >> v2:172.21.15.105:3300/0 conn(0x7fc1ec15e450 0x7fc1ec15afb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:33:18.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:18.862+0000 7fc1ebfff640 1 --2- 172.21.15.60:0/2297282763 >> v2:172.21.15.105:3300/0 conn(0x7fc1ec15e450 0x7fc1ec15afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:18.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:18.862+0000 7fc1ebfff640 1 -- 172.21.15.60:0/2297282763 >> v2:172.21.15.105:3300/0 conn(0x7fc1ec15e450 msgr2=0x7fc1ec15afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:33:18.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:18.862+0000 7fc1ebfff640 1 -- 172.21.15.60:0/2297282763 >> v2:172.21.15.105:3300/0 conn(0x7fc1ec15e450 msgr2=0x7fc1ec15afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:33:18.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:18.862+0000 7fc1ebfff640 1 --2- 172.21.15.60:0/2297282763 >> v2:172.21.15.105:3300/0 conn(0x7fc1ec15e450 0x7fc1ec15afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:33:18.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:18.862+0000 7fc1ebfff640 1 --2- 172.21.15.60:0/2297282763 >> v2:172.21.15.105:3300/0 conn(0x7fc1ec15e450 0x7fc1ec15afb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:33:19.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:19.663+0000 7fc1ebfff640 1 --2- 172.21.15.60:0/2297282763 >> v2:172.21.15.105:3300/0 conn(0x7fc1ec15e450 0x7fc1ec15afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:19.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:19.664+0000 7fc1ebfff640 1 -- 172.21.15.60:0/2297282763 >> v2:172.21.15.105:3300/0 conn(0x7fc1ec15e450 msgr2=0x7fc1ec15afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:33:19.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:19.664+0000 7fc1ebfff640 1 -- 172.21.15.60:0/2297282763 >> v2:172.21.15.105:3300/0 conn(0x7fc1ec15e450 msgr2=0x7fc1ec15afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:33:19.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:19.664+0000 7fc1ebfff640 1 --2- 172.21.15.60:0/2297282763 >> v2:172.21.15.105:3300/0 conn(0x7fc1ec15e450 0x7fc1ec15afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:33:19.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:19.664+0000 7fc1ebfff640 1 --2- 172.21.15.60:0/2297282763 >> v2:172.21.15.105:3300/0 conn(0x7fc1ec15e450 0x7fc1ec15afb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:33:20.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.632+0000 7fc1ea7fc640 1 -- 172.21.15.60:0/2297282763 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 681983477 0 0) 0x7fc1ec0c26e0 con 0x7fc1ec0c5e30 2024-09-12T02:33:20.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.632+0000 7fc1ea7fc640 1 -- 172.21.15.60:0/2297282763 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1d4003520 con 0x7fc1ec0c5e30 2024-09-12T02:33:20.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.632+0000 7fc1ea7fc640 1 -- 172.21.15.60:0/2297282763 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 736103814 0 0) 0x7fc1d4003520 con 0x7fc1ec0c5e30 2024-09-12T02:33:20.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.632+0000 7fc1ea7fc640 1 -- 172.21.15.60:0/2297282763 >> v2:172.21.15.105:3300/0 conn(0x7fc1ec15e450 msgr2=0x7fc1ec15afb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:33:20.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.632+0000 7fc1ea7fc640 1 --2- 172.21.15.60:0/2297282763 >> v2:172.21.15.105:3300/0 conn(0x7fc1ec15e450 0x7fc1ec15afb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:20.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.632+0000 7fc1ea7fc640 1 -- 172.21.15.60:0/2297282763 >> v1:172.21.15.60:6789/0 conn(0x7fc1ec157e60 legacy=0x7fc1ec0c7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:20.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.632+0000 7fc1ea7fc640 1 -- 172.21.15.60:0/2297282763 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1ec0c29c0 con 0x7fc1ec0c5e30 2024-09-12T02:33:20.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.632+0000 7fc1ea7fc640 1 -- 172.21.15.60:0/2297282763 <== mon.1 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7fc1e0001670 con 0x7fc1ec0c5e30 2024-09-12T02:33:20.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.632+0000 7fc1ea7fc640 1 -- 172.21.15.60:0/2297282763 >> v1:172.21.15.105:6789/0 conn(0x7fc1ec0c5e30 legacy=0x7fc1ec15a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:20.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.632+0000 7fc1ea7fc640 1 --2- 172.21.15.60:0/2297282763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1d4003a00 0x7fc1d4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:20.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.632+0000 7fc1ea7fc640 1 --2- 172.21.15.60:0/2297282763 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1d4004800 0x7fc1d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:20.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.632+0000 7fc1ea7fc640 1 --2- 172.21.15.60:0/2297282763 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1d40053c0 0x7fc1d400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:20.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.632+0000 7fc1ea7fc640 1 -- 172.21.15.60:0/2297282763 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d400c270 con 0x7fc1d4003a00 2024-09-12T02:33:20.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.632+0000 7fc1ea7fc640 1 -- 172.21.15.60:0/2297282763 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d400c420 con 0x7fc1d4004800 2024-09-12T02:33:20.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.632+0000 7fc1ea7fc640 1 -- 172.21.15.60:0/2297282763 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc1d400c620 con 0x7fc1d40053c0 2024-09-12T02:33:20.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.633+0000 7fc1ebfff640 1 --2- 172.21.15.60:0/2297282763 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1d40053c0 0x7fc1d400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:20.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.633+0000 7fc1eaffd640 1 --2- 172.21.15.60:0/2297282763 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1d4004800 0x7fc1d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:20.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.634+0000 7fc1ebfff640 1 -- 172.21.15.60:0/2297282763 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1d4004800 msgr2=0x7fc1d4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:20.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.634+0000 7fc1ebfff640 1 --2- 172.21.15.60:0/2297282763 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1d4004800 0x7fc1d4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:20.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.634+0000 7fc1ebfff640 1 -- 172.21.15.60:0/2297282763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1d4003a00 msgr2=0x7fc1d4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:20.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.634+0000 7fc1ebfff640 1 --2- 172.21.15.60:0/2297282763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1d4003a00 0x7fc1d4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:20.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.634+0000 7fc1ebfff640 1 -- 172.21.15.60:0/2297282763 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1d4003520 con 0x7fc1d40053c0 2024-09-12T02:33:20.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.635+0000 7fc1ebfff640 1 -- 172.21.15.60:0/2297282763 reap_dead start 2024-09-12T02:33:20.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.636+0000 7fc1ebfff640 1 --2- 172.21.15.60:0/2297282763 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1d40053c0 0x7fc1d400b9c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4004440 tx=0x7fc1d4005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac037a098076e0e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:20.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.636+0000 7fc1ea7fc640 1 -- 172.21.15.60:0/2297282763 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e4031070 con 0x7fc1d40053c0 2024-09-12T02:33:20.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.636+0000 7fc1ea7fc640 1 -- 172.21.15.60:0/2297282763 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1e402bb10 con 0x7fc1d40053c0 2024-09-12T02:33:20.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.636+0000 7fc1ea7fc640 1 -- 172.21.15.60:0/2297282763 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e4004040 con 0x7fc1d40053c0 2024-09-12T02:33:20.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.637+0000 7fc1f0b0b640 1 -- 172.21.15.60:0/2297282763 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1d40053c0 msgr2=0x7fc1d400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:20.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.637+0000 7fc1f0b0b640 1 --2- 172.21.15.60:0/2297282763 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1d40053c0 0x7fc1d400b9c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4004440 tx=0x7fc1d4005830 comp rx=0 tx=0).stop 2024-09-12T02:33:20.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.638+0000 7fc1f0b0b640 1 -- 172.21.15.60:0/2297282763 shutdown_connections 2024-09-12T02:33:20.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.638+0000 7fc1f0b0b640 1 --2- 172.21.15.60:0/2297282763 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1d40053c0 0x7fc1d400b9c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:20.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.638+0000 7fc1f0b0b640 1 -- 172.21.15.60:0/2297282763 >> 172.21.15.60:0/2297282763 conn(0x7fc1ec06c030 msgr2=0x7fc1ec06c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:20.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.638+0000 7fc1f0b0b640 1 -- 172.21.15.60:0/2297282763 shutdown_connections 2024-09-12T02:33:20.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.638+0000 7fc1f0b0b640 1 -- 172.21.15.60:0/2297282763 wait complete. 2024-09-12T02:33:20.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.640+0000 7fc1f0b0b640 1 Processor -- start 2024-09-12T02:33:20.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.640+0000 7fc1f0b0b640 1 -- start start 2024-09-12T02:33:20.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.641+0000 7fc1f0b0b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1d40053c0 0x7fc1ec0a9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:20.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.641+0000 7fc1f0b0b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1ec0aa700 0x7fc1ec0aab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:20.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.641+0000 7fc1f0b0b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1ec0ab840 0x7fc1ec0abcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:20.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.641+0000 7fc1f0b0b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc1ec0c7da0 con 0x7fc1ec0ab840 2024-09-12T02:33:20.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.641+0000 7fc1f0b0b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc1ec0c2ca0 con 0x7fc1ec0aa700 2024-09-12T02:33:20.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.641+0000 7fc1f0b0b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc1ec0c7f20 con 0x7fc1d40053c0 2024-09-12T02:33:20.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.642+0000 7fc1eaffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1ec0aa700 0x7fc1ec0aab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:20.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.642+0000 7fc1eb7fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1d40053c0 0x7fc1ec0a9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:20.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.642+0000 7fc1ebfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1ec0ab840 0x7fc1ec0abcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:20.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.642+0000 7fc1eb7fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1d40053c0 0x7fc1ec0a9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:49754/0 (socket says 172.21.15.60:49754) 2024-09-12T02:33:20.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.642+0000 7fc1eb7fe640 1 -- 172.21.15.60:0/3862250451 learned_addr learned my addr 172.21.15.60:0/3862250451 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:33:20.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.642+0000 7fc1eb7fe640 1 -- 172.21.15.60:0/3862250451 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1d40053c0 msgr2=0x7fc1ec0a9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-12T02:33:20.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.642+0000 7fc1eb7fe640 1 -- 172.21.15.60:0/3862250451 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1d40053c0 msgr2=0x7fc1ec0a9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:33:20.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.642+0000 7fc1eb7fe640 1 --2- 172.21.15.60:0/3862250451 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1d40053c0 0x7fc1ec0a9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:33:20.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.642+0000 7fc1eb7fe640 1 --2- 172.21.15.60:0/3862250451 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1d40053c0 0x7fc1ec0a9cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:33:20.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.642+0000 7fc1ebfff640 1 -- 172.21.15.60:0/3862250451 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1d40053c0 msgr2=0x7fc1ec0a9cd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:33:20.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.642+0000 7fc1ebfff640 1 --2- 172.21.15.60:0/3862250451 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1d40053c0 0x7fc1ec0a9cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:20.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.642+0000 7fc1ebfff640 1 -- 172.21.15.60:0/3862250451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1ec0aa700 msgr2=0x7fc1ec0aab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:20.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.642+0000 7fc1ebfff640 1 --2- 172.21.15.60:0/3862250451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1ec0aa700 0x7fc1ec0aab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:20.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.642+0000 7fc1ebfff640 1 -- 172.21.15.60:0/3862250451 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1ec15a240 con 0x7fc1ec0ab840 2024-09-12T02:33:20.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.642+0000 7fc1ebfff640 1 --2- 172.21.15.60:0/3862250451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1ec0ab840 0x7fc1ec0abcc0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec0c3880 tx=0x7fc1e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:20.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.643+0000 7fc1d3fff640 1 -- 172.21.15.60:0/3862250451 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e403e440 con 0x7fc1ec0ab840 2024-09-12T02:33:20.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.643+0000 7fc1d3fff640 1 -- 172.21.15.60:0/3862250451 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1e403e600 con 0x7fc1ec0ab840 2024-09-12T02:33:20.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.643+0000 7fc1d3fff640 1 -- 172.21.15.60:0/3862250451 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e403e7f0 con 0x7fc1ec0ab840 2024-09-12T02:33:20.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.643+0000 7fc1f0b0b640 1 -- 172.21.15.60:0/3862250451 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1ec0ac500 con 0x7fc1ec0ab840 2024-09-12T02:33:20.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.643+0000 7fc1f0b0b640 1 -- 172.21.15.60:0/3862250451 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1ec0acac0 con 0x7fc1ec0ab840 2024-09-12T02:33:20.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.644+0000 7fc1f0b0b640 1 -- 172.21.15.60:0/3862250451 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1ec0c82b0 con 0x7fc1ec0ab840 2024-09-12T02:33:20.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.645+0000 7fc1d3fff640 1 -- 172.21.15.60:0/3862250451 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc1e4047020 con 0x7fc1ec0ab840 2024-09-12T02:33:20.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.645+0000 7fc1d3fff640 1 --2- 172.21.15.60:0/3862250451 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc1d806be30 0x7fc1d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:20.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.646+0000 7fc1eb7fe640 1 --2- 172.21.15.60:0/3862250451 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc1d806be30 0x7fc1d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:20.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.646+0000 7fc1d3fff640 1 -- 172.21.15.60:0/3862250451 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fc1e40abcb0 con 0x7fc1ec0ab840 2024-09-12T02:33:20.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.646+0000 7fc1eb7fe640 1 --2- 172.21.15.60:0/3862250451 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc1d806be30 0x7fc1d806e2f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec06e370 tx=0x7fc1dc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:20.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:20.653+0000 7fc1d3fff640 1 -- 172.21.15.60:0/3862250451 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc1e404e020 con 0x7fc1ec0ab840 2024-09-12T02:33:21.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:21.088+0000 7fc1f0b0b640 1 -- 172.21.15.60:0/3862250451 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc1ec06ea80 con 0x7fc1ec0ab840 2024-09-12T02:33:21.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:21.088+0000 7fc1d3fff640 1 -- 172.21.15.60:0/3862250451 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7fc1e407a350 con 0x7fc1ec0ab840 2024-09-12T02:33:21.089 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":96,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:33:21.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:21.092+0000 7fc1f0b0b640 1 -- 172.21.15.60:0/3862250451 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc1d806be30 msgr2=0x7fc1d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:21.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:21.092+0000 7fc1f0b0b640 1 --2- 172.21.15.60:0/3862250451 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc1d806be30 0x7fc1d806e2f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec06e370 tx=0x7fc1dc009040 comp rx=0 tx=0).stop 2024-09-12T02:33:21.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:21.092+0000 7fc1f0b0b640 1 -- 172.21.15.60:0/3862250451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1ec0ab840 msgr2=0x7fc1ec0abcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:21.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:21.092+0000 7fc1f0b0b640 1 --2- 172.21.15.60:0/3862250451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1ec0ab840 0x7fc1ec0abcc0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec0c3880 tx=0x7fc1e4004a40 comp rx=0 tx=0).stop 2024-09-12T02:33:21.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:21.092+0000 7fc1f0b0b640 1 -- 172.21.15.60:0/3862250451 shutdown_connections 2024-09-12T02:33:21.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:21.092+0000 7fc1f0b0b640 1 --2- 172.21.15.60:0/3862250451 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc1d806be30 0x7fc1d806e2f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:21.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:21.092+0000 7fc1f0b0b640 1 --2- 172.21.15.60:0/3862250451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1ec0ab840 0x7fc1ec0abcc0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:21.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:21.092+0000 7fc1f0b0b640 1 --2- 172.21.15.60:0/3862250451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1ec0aa700 0x7fc1ec0aab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:21.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:21.092+0000 7fc1f0b0b640 1 --2- 172.21.15.60:0/3862250451 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1d40053c0 0x7fc1ec0a9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:21.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:21.092+0000 7fc1f0b0b640 1 -- 172.21.15.60:0/3862250451 >> 172.21.15.60:0/3862250451 conn(0x7fc1ec06c030 msgr2=0x7fc1ec154640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:21.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:21.092+0000 7fc1f0b0b640 1 -- 172.21.15.60:0/3862250451 shutdown_connections 2024-09-12T02:33:21.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:21.092+0000 7fc1f0b0b640 1 -- 172.21.15.60:0/3862250451 wait complete. 2024-09-12T02:33:24.109 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:33:24.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:24.453+0000 7f28a5d9f640 1 Processor -- start 2024-09-12T02:33:24.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:24.453+0000 7f28a5d9f640 1 -- start start 2024-09-12T02:33:24.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:24.454+0000 7f28a5d9f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f28a00c8b10 0x7f28a015a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:24.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:24.454+0000 7f28a5d9f640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f28a006cd80 0x7f28a01534d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:24.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:24.454+0000 7f28a5d9f640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28a00c7070 con 0x7f28a0153a10 2024-09-12T02:33:24.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:24.454+0000 7f28a5d9f640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f28a006d210 con 0x7f28a00c8b10 2024-09-12T02:33:24.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:24.454+0000 7f28a5d9f640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f28a00c69b0 con 0x7f28a006cd80 2024-09-12T02:33:24.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:24.454+0000 7f289f7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f28a00c8b10 0x7f28a015a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:24.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:24.454+0000 7f289f7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f28a00c8b10 0x7f28a015a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51534/0 (socket says 172.21.15.60:51534) 2024-09-12T02:33:24.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:24.454+0000 7f289f7fe640 1 -- 172.21.15.60:0/1017792103 learned_addr learned my addr 172.21.15.60:0/1017792103 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:33:24.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:24.454+0000 7f289effd640 1 --2- 172.21.15.60:0/1017792103 >> v2:172.21.15.105:3300/0 conn(0x7f28a006cd80 0x7f28a01534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:24.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:24.454+0000 7f289f7fe640 1 -- 172.21.15.60:0/1017792103 >> v2:172.21.15.60:3300/0 conn(0x7f28a00c8b10 msgr2=0x7f28a015a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:33:24.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:24.454+0000 7f289f7fe640 1 -- 172.21.15.60:0/1017792103 >> v2:172.21.15.60:3300/0 conn(0x7f28a00c8b10 msgr2=0x7f28a015a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:33:24.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:24.454+0000 7f289f7fe640 1 --2- 172.21.15.60:0/1017792103 >> v2:172.21.15.60:3300/0 conn(0x7f28a00c8b10 0x7f28a015a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:33:24.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:24.454+0000 7f289f7fe640 1 --2- 172.21.15.60:0/1017792103 >> v2:172.21.15.60:3300/0 conn(0x7f28a00c8b10 0x7f28a015a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:33:24.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:24.454+0000 7f289effd640 1 -- 172.21.15.60:0/1017792103 >> v2:172.21.15.105:3300/0 conn(0x7f28a006cd80 msgr2=0x7f28a01534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:33:24.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:24.454+0000 7f289effd640 1 -- 172.21.15.60:0/1017792103 >> v2:172.21.15.105:3300/0 conn(0x7f28a006cd80 msgr2=0x7f28a01534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:33:24.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:24.454+0000 7f289effd640 1 --2- 172.21.15.60:0/1017792103 >> v2:172.21.15.105:3300/0 conn(0x7f28a006cd80 0x7f28a01534d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:33:24.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:24.454+0000 7f289effd640 1 --2- 172.21.15.60:0/1017792103 >> v2:172.21.15.105:3300/0 conn(0x7f28a006cd80 0x7f28a01534d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:33:24.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:24.655+0000 7f289f7fe640 1 --2- 172.21.15.60:0/1017792103 >> v2:172.21.15.60:3300/0 conn(0x7f28a00c8b10 0x7f28a015a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:24.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:24.655+0000 7f289f7fe640 1 -- 172.21.15.60:0/1017792103 >> v2:172.21.15.60:3300/0 conn(0x7f28a00c8b10 msgr2=0x7f28a015a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:33:24.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:24.655+0000 7f289f7fe640 1 -- 172.21.15.60:0/1017792103 >> v2:172.21.15.60:3300/0 conn(0x7f28a00c8b10 msgr2=0x7f28a015a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:33:24.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:24.655+0000 7f289f7fe640 1 --2- 172.21.15.60:0/1017792103 >> v2:172.21.15.60:3300/0 conn(0x7f28a00c8b10 0x7f28a015a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:33:24.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:24.655+0000 7f289f7fe640 1 --2- 172.21.15.60:0/1017792103 >> v2:172.21.15.60:3300/0 conn(0x7f28a00c8b10 0x7f28a015a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:33:24.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:24.655+0000 7f289effd640 1 --2- 172.21.15.60:0/1017792103 >> v2:172.21.15.105:3300/0 conn(0x7f28a006cd80 0x7f28a01534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:24.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:24.656+0000 7f289effd640 1 -- 172.21.15.60:0/1017792103 >> v2:172.21.15.105:3300/0 conn(0x7f28a006cd80 msgr2=0x7f28a01534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:33:24.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:24.656+0000 7f289effd640 1 -- 172.21.15.60:0/1017792103 >> v2:172.21.15.105:3300/0 conn(0x7f28a006cd80 msgr2=0x7f28a01534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:33:24.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:24.656+0000 7f289effd640 1 --2- 172.21.15.60:0/1017792103 >> v2:172.21.15.105:3300/0 conn(0x7f28a006cd80 0x7f28a01534d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:33:24.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:24.656+0000 7f289effd640 1 --2- 172.21.15.60:0/1017792103 >> v2:172.21.15.105:3300/0 conn(0x7f28a006cd80 0x7f28a01534d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:33:25.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:25.056+0000 7f289f7fe640 1 --2- 172.21.15.60:0/1017792103 >> v2:172.21.15.60:3300/0 conn(0x7f28a00c8b10 0x7f28a015a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:25.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:25.056+0000 7f289f7fe640 1 -- 172.21.15.60:0/1017792103 >> v2:172.21.15.60:3300/0 conn(0x7f28a00c8b10 msgr2=0x7f28a015a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:33:25.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:25.056+0000 7f289f7fe640 1 -- 172.21.15.60:0/1017792103 >> v2:172.21.15.60:3300/0 conn(0x7f28a00c8b10 msgr2=0x7f28a015a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:33:25.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:25.056+0000 7f289f7fe640 1 --2- 172.21.15.60:0/1017792103 >> v2:172.21.15.60:3300/0 conn(0x7f28a00c8b10 0x7f28a015a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:33:25.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:25.056+0000 7f289f7fe640 1 --2- 172.21.15.60:0/1017792103 >> v2:172.21.15.60:3300/0 conn(0x7f28a00c8b10 0x7f28a015a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:33:25.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:25.057+0000 7f289effd640 1 --2- 172.21.15.60:0/1017792103 >> v2:172.21.15.105:3300/0 conn(0x7f28a006cd80 0x7f28a01534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:25.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:25.058+0000 7f289effd640 1 -- 172.21.15.60:0/1017792103 >> v2:172.21.15.105:3300/0 conn(0x7f28a006cd80 msgr2=0x7f28a01534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:33:25.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:25.058+0000 7f289effd640 1 -- 172.21.15.60:0/1017792103 >> v2:172.21.15.105:3300/0 conn(0x7f28a006cd80 msgr2=0x7f28a01534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:33:25.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:25.058+0000 7f289effd640 1 --2- 172.21.15.60:0/1017792103 >> v2:172.21.15.105:3300/0 conn(0x7f28a006cd80 0x7f28a01534d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:33:25.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:25.058+0000 7f289effd640 1 --2- 172.21.15.60:0/1017792103 >> v2:172.21.15.105:3300/0 conn(0x7f28a006cd80 0x7f28a01534d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:33:25.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:25.857+0000 7f289f7fe640 1 --2- 172.21.15.60:0/1017792103 >> v2:172.21.15.60:3300/0 conn(0x7f28a00c8b10 0x7f28a015a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:25.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:25.857+0000 7f289f7fe640 1 -- 172.21.15.60:0/1017792103 >> v2:172.21.15.60:3300/0 conn(0x7f28a00c8b10 msgr2=0x7f28a015a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:33:25.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:25.857+0000 7f289f7fe640 1 -- 172.21.15.60:0/1017792103 >> v2:172.21.15.60:3300/0 conn(0x7f28a00c8b10 msgr2=0x7f28a015a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:33:25.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:25.857+0000 7f289f7fe640 1 --2- 172.21.15.60:0/1017792103 >> v2:172.21.15.60:3300/0 conn(0x7f28a00c8b10 0x7f28a015a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:33:25.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:25.857+0000 7f289f7fe640 1 --2- 172.21.15.60:0/1017792103 >> v2:172.21.15.60:3300/0 conn(0x7f28a00c8b10 0x7f28a015a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:33:25.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:25.859+0000 7f289effd640 1 --2- 172.21.15.60:0/1017792103 >> v2:172.21.15.105:3300/0 conn(0x7f28a006cd80 0x7f28a01534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:25.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:25.859+0000 7f289effd640 1 -- 172.21.15.60:0/1017792103 >> v2:172.21.15.105:3300/0 conn(0x7f28a006cd80 msgr2=0x7f28a01534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:33:25.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:25.859+0000 7f289effd640 1 -- 172.21.15.60:0/1017792103 >> v2:172.21.15.105:3300/0 conn(0x7f28a006cd80 msgr2=0x7f28a01534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:33:25.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:25.859+0000 7f289effd640 1 --2- 172.21.15.60:0/1017792103 >> v2:172.21.15.105:3300/0 conn(0x7f28a006cd80 0x7f28a01534d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:33:25.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:25.859+0000 7f289effd640 1 --2- 172.21.15.60:0/1017792103 >> v2:172.21.15.105:3300/0 conn(0x7f28a006cd80 0x7f28a01534d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:33:26.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.640+0000 7f289e7fc640 1 -- 172.21.15.60:0/1017792103 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2115448892 0 0) 0x7f28a00c7070 con 0x7f28a0153a10 2024-09-12T02:33:26.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.641+0000 7f289e7fc640 1 -- 172.21.15.60:0/1017792103 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2888003520 con 0x7f28a0153a10 2024-09-12T02:33:26.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.646+0000 7f289e7fc640 1 -- 172.21.15.60:0/1017792103 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2959873368 0 0) 0x7f2888003520 con 0x7f28a0153a10 2024-09-12T02:33:26.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.646+0000 7f289e7fc640 1 -- 172.21.15.60:0/1017792103 >> v2:172.21.15.105:3300/0 conn(0x7f28a006cd80 msgr2=0x7f28a01534d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:33:26.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.646+0000 7f289e7fc640 1 --2- 172.21.15.60:0/1017792103 >> v2:172.21.15.105:3300/0 conn(0x7f28a006cd80 0x7f28a01534d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:26.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.646+0000 7f289e7fc640 1 -- 172.21.15.60:0/1017792103 >> v2:172.21.15.60:3300/0 conn(0x7f28a00c8b10 msgr2=0x7f28a015a4a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:33:26.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.646+0000 7f289e7fc640 1 --2- 172.21.15.60:0/1017792103 >> v2:172.21.15.60:3300/0 conn(0x7f28a00c8b10 0x7f28a015a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:26.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.646+0000 7f289e7fc640 1 -- 172.21.15.60:0/1017792103 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28a00c6c90 con 0x7f28a0153a10 2024-09-12T02:33:26.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.646+0000 7f289e7fc640 1 -- 172.21.15.60:0/1017792103 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7f28980019f0 con 0x7f28a0153a10 2024-09-12T02:33:26.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.646+0000 7f289e7fc640 1 -- 172.21.15.60:0/1017792103 >> v1:172.21.15.60:6789/0 conn(0x7f28a0153a10 legacy=0x7f28a0156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:26.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.646+0000 7f289e7fc640 1 --2- 172.21.15.60:0/1017792103 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28880039b0 0x7f2888003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:26.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.646+0000 7f289e7fc640 1 --2- 172.21.15.60:0/1017792103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2888004800 0x7f2888004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:26.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.646+0000 7f289e7fc640 1 --2- 172.21.15.60:0/1017792103 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28880051c0 0x7f288800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:26.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.646+0000 7f289e7fc640 1 -- 172.21.15.60:0/1017792103 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f28a006d210 con 0x7f2888004800 2024-09-12T02:33:26.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.646+0000 7f289e7fc640 1 -- 172.21.15.60:0/1017792103 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f28a00c69b0 con 0x7f28880039b0 2024-09-12T02:33:26.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.646+0000 7f289e7fc640 1 -- 172.21.15.60:0/1017792103 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f288800c170 con 0x7f28880051c0 2024-09-12T02:33:26.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.646+0000 7f289effd640 1 --2- 172.21.15.60:0/1017792103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2888004800 0x7f2888004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:26.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.646+0000 7f289f7fe640 1 --2- 172.21.15.60:0/1017792103 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28880039b0 0x7f2888003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:26.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.647+0000 7f289effd640 1 -- 172.21.15.60:0/1017792103 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28880051c0 msgr2=0x7f288800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:26.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.647+0000 7f289effd640 1 --2- 172.21.15.60:0/1017792103 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28880051c0 0x7f288800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:26.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.647+0000 7f289effd640 1 -- 172.21.15.60:0/1017792103 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28880039b0 msgr2=0x7f2888003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:26.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.647+0000 7f289effd640 1 --2- 172.21.15.60:0/1017792103 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28880039b0 0x7f2888003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:26.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.647+0000 7f289effd640 1 -- 172.21.15.60:0/1017792103 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28a00c6c90 con 0x7f2888004800 2024-09-12T02:33:26.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.647+0000 7f289ffff640 1 -- 172.21.15.60:0/1017792103 reap_dead start 2024-09-12T02:33:26.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.648+0000 7f289effd640 1 --2- 172.21.15.60:0/1017792103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2888004800 0x7f2888004c80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2894011b90 tx=0x7f2888005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a952a2ee3b591b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:26.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.648+0000 7f289e7fc640 1 -- 172.21.15.60:0/1017792103 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2894031070 con 0x7f2888004800 2024-09-12T02:33:26.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.648+0000 7f289e7fc640 1 -- 172.21.15.60:0/1017792103 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f289402b790 con 0x7f2888004800 2024-09-12T02:33:26.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.648+0000 7f289e7fc640 1 -- 172.21.15.60:0/1017792103 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2894011790 con 0x7f2888004800 2024-09-12T02:33:26.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.649+0000 7f28a5d9f640 1 -- 172.21.15.60:0/1017792103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2888004800 msgr2=0x7f2888004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:26.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.649+0000 7f28a5d9f640 1 --2- 172.21.15.60:0/1017792103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2888004800 0x7f2888004c80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2894011b90 tx=0x7f2888005830 comp rx=0 tx=0).stop 2024-09-12T02:33:26.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.649+0000 7f28a5d9f640 1 -- 172.21.15.60:0/1017792103 shutdown_connections 2024-09-12T02:33:26.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.649+0000 7f28a5d9f640 1 --2- 172.21.15.60:0/1017792103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2888004800 0x7f2888004c80 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:26.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.649+0000 7f28a5d9f640 1 -- 172.21.15.60:0/1017792103 >> 172.21.15.60:0/1017792103 conn(0x7f28a00adb80 msgr2=0x7f28a00adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:26.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.649+0000 7f28a5d9f640 1 -- 172.21.15.60:0/1017792103 shutdown_connections 2024-09-12T02:33:26.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.649+0000 7f28a5d9f640 1 -- 172.21.15.60:0/1017792103 wait complete. 2024-09-12T02:33:26.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.651+0000 7f28a5d9f640 1 Processor -- start 2024-09-12T02:33:26.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.651+0000 7f28a5d9f640 1 -- start start 2024-09-12T02:33:26.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.652+0000 7f28a5d9f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2888004800 0x7f28a0072ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:26.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.652+0000 7f28a5d9f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28a01595e0 0x7f28a01e73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:26.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.652+0000 7f28a5d9f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a0159c80 0x7f28a01e7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:26.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.652+0000 7f289f7fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2888004800 0x7f28a0072ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:26.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.652+0000 7f289f7fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2888004800 0x7f28a0072ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:49784/0 (socket says 172.21.15.60:49784) 2024-09-12T02:33:26.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.652+0000 7f289effd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28a01595e0 0x7f28a01e73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:26.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.652+0000 7f289ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a0159c80 0x7f28a01e7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:26.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.652+0000 7f289ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a0159c80 0x7f28a01e7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51576/0 (socket says 172.21.15.60:51576) 2024-09-12T02:33:26.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.652+0000 7f289f7fe640 1 -- 172.21.15.60:0/2966197861 learned_addr learned my addr 172.21.15.60:0/2966197861 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:33:26.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.652+0000 7f28a5d9f640 1 -- 172.21.15.60:0/2966197861 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f28a0154020 con 0x7f28a0159c80 2024-09-12T02:33:26.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.652+0000 7f28a5d9f640 1 -- 172.21.15.60:0/2966197861 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f28a0153ea0 con 0x7f28a01595e0 2024-09-12T02:33:26.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.652+0000 7f28a5d9f640 1 -- 172.21.15.60:0/2966197861 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f28a00c8ef0 con 0x7f2888004800 2024-09-12T02:33:26.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.653+0000 7f289ffff640 1 -- 172.21.15.60:0/2966197861 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2888004800 msgr2=0x7f28a0072ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:26.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.653+0000 7f289ffff640 1 --2- 172.21.15.60:0/2966197861 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2888004800 0x7f28a0072ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:26.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.653+0000 7f289ffff640 1 -- 172.21.15.60:0/2966197861 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28a01595e0 msgr2=0x7f28a01e73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:26.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.653+0000 7f289ffff640 1 --2- 172.21.15.60:0/2966197861 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28a01595e0 0x7f28a01e73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:26.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.653+0000 7f289ffff640 1 -- 172.21.15.60:0/2966197861 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28a00b1d00 con 0x7f28a0159c80 2024-09-12T02:33:26.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.653+0000 7f289ffff640 1 --2- 172.21.15.60:0/2966197861 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a0159c80 0x7f28a01e7900 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f28a0156370 tx=0x7f289800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:26.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.653+0000 7f289effd640 1 --2- 172.21.15.60:0/2966197861 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28a01595e0 0x7f28a01e73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:33:26.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.654+0000 7f2887fff640 1 -- 172.21.15.60:0/2966197861 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2898017070 con 0x7f28a0159c80 2024-09-12T02:33:26.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.654+0000 7f2887fff640 1 -- 172.21.15.60:0/2966197861 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f289800a5b0 con 0x7f28a0159c80 2024-09-12T02:33:26.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.654+0000 7f2887fff640 1 -- 172.21.15.60:0/2966197861 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289800cea0 con 0x7f28a0159c80 2024-09-12T02:33:26.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.654+0000 7f28a5d9f640 1 -- 172.21.15.60:0/2966197861 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28a01e7fe0 con 0x7f28a0159c80 2024-09-12T02:33:26.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.654+0000 7f28a5d9f640 1 -- 172.21.15.60:0/2966197861 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28a01e82c0 con 0x7f28a0159c80 2024-09-12T02:33:26.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.655+0000 7f28a5d9f640 1 -- 172.21.15.60:0/2966197861 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28a01534d0 con 0x7f28a0159c80 2024-09-12T02:33:26.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.656+0000 7f2887fff640 1 -- 172.21.15.60:0/2966197861 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f289801a070 con 0x7f28a0159c80 2024-09-12T02:33:26.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.656+0000 7f2887fff640 1 --2- 172.21.15.60:0/2966197861 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f288c06beb0 0x7f288c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:26.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.656+0000 7f2887fff640 1 -- 172.21.15.60:0/2966197861 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f289808a430 con 0x7f28a0159c80 2024-09-12T02:33:26.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.657+0000 7f289f7fe640 1 --2- 172.21.15.60:0/2966197861 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f288c06beb0 0x7f288c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:26.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.657+0000 7f289f7fe640 1 --2- 172.21.15.60:0/2966197861 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f288c06beb0 0x7f288c06e370 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f28a00726f0 tx=0x7f2890008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:26.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:26.664+0000 7f2887fff640 1 -- 172.21.15.60:0/2966197861 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2898058560 con 0x7f28a0159c80 2024-09-12T02:33:27.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:27.083+0000 7f28a5d9f640 1 -- 172.21.15.60:0/2966197861 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f28a00c9d90 con 0x7f28a0159c80 2024-09-12T02:33:27.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:27.084+0000 7f2887fff640 1 -- 172.21.15.60:0/2966197861 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1559 (secure 0 0 0) 0x7f289805c860 con 0x7f28a0159c80 2024-09-12T02:33:27.085 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":100,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:33:27.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:27.086+0000 7f28a5d9f640 1 -- 172.21.15.60:0/2966197861 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f288c06beb0 msgr2=0x7f288c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:27.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:27.086+0000 7f28a5d9f640 1 --2- 172.21.15.60:0/2966197861 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f288c06beb0 0x7f288c06e370 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f28a00726f0 tx=0x7f2890008040 comp rx=0 tx=0).stop 2024-09-12T02:33:27.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:27.086+0000 7f28a5d9f640 1 -- 172.21.15.60:0/2966197861 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a0159c80 msgr2=0x7f28a01e7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:27.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:27.086+0000 7f28a5d9f640 1 --2- 172.21.15.60:0/2966197861 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a0159c80 0x7f28a01e7900 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f28a0156370 tx=0x7f289800cc50 comp rx=0 tx=0).stop 2024-09-12T02:33:27.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:27.087+0000 7f28a5d9f640 1 -- 172.21.15.60:0/2966197861 shutdown_connections 2024-09-12T02:33:27.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:27.087+0000 7f28a5d9f640 1 --2- 172.21.15.60:0/2966197861 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f288c06beb0 0x7f288c06e370 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:27.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:27.087+0000 7f28a5d9f640 1 --2- 172.21.15.60:0/2966197861 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a0159c80 0x7f28a01e7900 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:27.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:27.087+0000 7f28a5d9f640 1 --2- 172.21.15.60:0/2966197861 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28a01595e0 0x7f28a01e73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:27.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:27.087+0000 7f28a5d9f640 1 --2- 172.21.15.60:0/2966197861 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2888004800 0x7f28a0072ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:27.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:27.087+0000 7f28a5d9f640 1 -- 172.21.15.60:0/2966197861 >> 172.21.15.60:0/2966197861 conn(0x7f28a00adb80 msgr2=0x7f28a00cbe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:27.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:27.087+0000 7f28a5d9f640 1 -- 172.21.15.60:0/2966197861 shutdown_connections 2024-09-12T02:33:27.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:27.087+0000 7f28a5d9f640 1 -- 172.21.15.60:0/2966197861 wait complete. 2024-09-12T02:33:29.972 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:33:29.975 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:33:30.104 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:33:30.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.256+0000 7f12311d6640 1 Processor -- start 2024-09-12T02:33:30.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.256+0000 7f12311d6640 1 -- start start 2024-09-12T02:33:30.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.257+0000 7f12311d6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f122c154690 0x7f122c067950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:30.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.258+0000 7f12311d6640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f122c154a70 con 0x7f122c15a5c0 2024-09-12T02:33:30.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.258+0000 7f12311d6640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f122c15aac0 con 0x7f122c0cb950 2024-09-12T02:33:30.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.258+0000 7f12311d6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f122c15ada0 con 0x7f122c154690 2024-09-12T02:33:30.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.258+0000 7f122b59e640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f122c15a5c0 0x7f122c0ca6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:39162/0 (socket says 172.21.15.60:39162) 2024-09-12T02:33:30.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.258+0000 7f122b59e640 1 -- 172.21.15.60:0/2768061510 learned_addr learned my addr 172.21.15.60:0/2768061510 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:33:30.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.258+0000 7f122ad9d640 1 --2- 172.21.15.60:0/2768061510 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f122c154690 0x7f122c067950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:30.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.258+0000 7f1229d9b640 1 -- 172.21.15.60:0/2768061510 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2141534637 0 0) 0x7f122c154a70 con 0x7f122c15a5c0 2024-09-12T02:33:30.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.258+0000 7f1229d9b640 1 -- 172.21.15.60:0/2768061510 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1214003520 con 0x7f122c15a5c0 2024-09-12T02:33:30.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.258+0000 7f1229d9b640 1 -- 172.21.15.60:0/2768061510 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2598070081 0 0) 0x7f122c15aac0 con 0x7f122c0cb950 2024-09-12T02:33:30.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.258+0000 7f1229d9b640 1 -- 172.21.15.60:0/2768061510 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f122c154a70 con 0x7f122c0cb950 2024-09-12T02:33:30.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.258+0000 7f122ad9d640 1 -- 172.21.15.60:0/2768061510 >> v1:172.21.15.105:6789/0 conn(0x7f122c0cb950 legacy=0x7f122c0c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:30.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.259+0000 7f122ad9d640 1 -- 172.21.15.60:0/2768061510 >> v1:172.21.15.60:6789/0 conn(0x7f122c15a5c0 legacy=0x7f122c0ca6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:30.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.259+0000 7f122ad9d640 1 -- 172.21.15.60:0/2768061510 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f122c15b080 con 0x7f122c154690 2024-09-12T02:33:30.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.260+0000 7f122ad9d640 1 --2- 172.21.15.60:0/2768061510 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f122c154690 0x7f122c067950 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1224009dc0 tx=0x7f122402a5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ce5ef4123e723bc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:30.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.260+0000 7f1229d9b640 1 -- 172.21.15.60:0/2768061510 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1224007740 con 0x7f122c154690 2024-09-12T02:33:30.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.260+0000 7f1229d9b640 1 -- 172.21.15.60:0/2768061510 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12240078e0 con 0x7f122c154690 2024-09-12T02:33:30.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.260+0000 7f1229d9b640 1 -- 172.21.15.60:0/2768061510 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1224007cb0 con 0x7f122c154690 2024-09-12T02:33:30.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.261+0000 7f12311d6640 1 -- 172.21.15.60:0/2768061510 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f122c154690 msgr2=0x7f122c067950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:30.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.261+0000 7f12311d6640 1 --2- 172.21.15.60:0/2768061510 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f122c154690 0x7f122c067950 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1224009dc0 tx=0x7f122402a5b0 comp rx=0 tx=0).stop 2024-09-12T02:33:30.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.261+0000 7f12311d6640 1 -- 172.21.15.60:0/2768061510 shutdown_connections 2024-09-12T02:33:30.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.261+0000 7f12311d6640 1 --2- 172.21.15.60:0/2768061510 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f122c154690 0x7f122c067950 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:30.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.261+0000 7f12311d6640 1 -- 172.21.15.60:0/2768061510 >> 172.21.15.60:0/2768061510 conn(0x7f122c0c87f0 msgr2=0x7f122c0c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:30.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.261+0000 7f12311d6640 1 -- 172.21.15.60:0/2768061510 shutdown_connections 2024-09-12T02:33:30.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.261+0000 7f12311d6640 1 -- 172.21.15.60:0/2768061510 wait complete. 2024-09-12T02:33:30.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.264+0000 7f12311d6640 1 Processor -- start 2024-09-12T02:33:30.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.264+0000 7f12311d6640 1 -- start start 2024-09-12T02:33:30.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.265+0000 7f12311d6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f122c0cb950 0x7f122c1f0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:30.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.265+0000 7f12311d6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f122c154690 0x7f122c0ac6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:30.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.265+0000 7f12311d6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f122c15a5c0 0x7f122c14e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:30.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.265+0000 7f12311d6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f122c068010 con 0x7f122c0cb950 2024-09-12T02:33:30.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.265+0000 7f12311d6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f122c067e90 con 0x7f122c15a5c0 2024-09-12T02:33:30.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.265+0000 7f12311d6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f122c068190 con 0x7f122c154690 2024-09-12T02:33:30.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.265+0000 7f122ad9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f122c0cb950 0x7f122c1f0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:30.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.265+0000 7f122ad9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f122c0cb950 0x7f122c1f0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39850/0 (socket says 172.21.15.60:39850) 2024-09-12T02:33:30.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.265+0000 7f122ad9d640 1 -- 172.21.15.60:0/1734225429 learned_addr learned my addr 172.21.15.60:0/1734225429 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:33:30.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.265+0000 7f122b59e640 1 --2- 172.21.15.60:0/1734225429 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f122c15a5c0 0x7f122c14e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:30.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.265+0000 7f122a59c640 1 --2- 172.21.15.60:0/1734225429 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f122c154690 0x7f122c0ac6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:30.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.266+0000 7f122ad9d640 1 -- 172.21.15.60:0/1734225429 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f122c154690 msgr2=0x7f122c0ac6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:30.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.266+0000 7f122ad9d640 1 --2- 172.21.15.60:0/1734225429 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f122c154690 0x7f122c0ac6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:30.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.266+0000 7f122ad9d640 1 -- 172.21.15.60:0/1734225429 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f122c15a5c0 msgr2=0x7f122c14e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:30.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.266+0000 7f122ad9d640 1 --2- 172.21.15.60:0/1734225429 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f122c15a5c0 0x7f122c14e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:30.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.266+0000 7f122ad9d640 1 -- 172.21.15.60:0/1734225429 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f122c14dce0 con 0x7f122c0cb950 2024-09-12T02:33:30.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.266+0000 7f122b59e640 1 --2- 172.21.15.60:0/1734225429 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f122c15a5c0 0x7f122c14e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:30.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.266+0000 7f122ad9d640 1 --2- 172.21.15.60:0/1734225429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f122c0cb950 0x7f122c1f0b70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1224000f80 tx=0x7f1224004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:30.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.266+0000 7f12137fe640 1 -- 172.21.15.60:0/1734225429 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1224040070 con 0x7f122c0cb950 2024-09-12T02:33:30.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.266+0000 7f12137fe640 1 -- 172.21.15.60:0/1734225429 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1224031bc0 con 0x7f122c0cb950 2024-09-12T02:33:30.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.266+0000 7f12137fe640 1 -- 172.21.15.60:0/1734225429 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1224009450 con 0x7f122c0cb950 2024-09-12T02:33:30.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.266+0000 7f12311d6640 1 -- 172.21.15.60:0/1734225429 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f122c151750 con 0x7f122c0cb950 2024-09-12T02:33:30.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.266+0000 7f12311d6640 1 -- 172.21.15.60:0/1734225429 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f122c14e650 con 0x7f122c0cb950 2024-09-12T02:33:30.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.268+0000 7f12311d6640 1 -- 172.21.15.60:0/1734225429 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f122c15a200 con 0x7f122c0cb950 2024-09-12T02:33:30.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.268+0000 7f12137fe640 1 -- 172.21.15.60:0/1734225429 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1224039040 con 0x7f122c0cb950 2024-09-12T02:33:30.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.269+0000 7f12137fe640 1 --2- 172.21.15.60:0/1734225429 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f121806be30 0x7f121806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:30.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.269+0000 7f12137fe640 1 -- 172.21.15.60:0/1734225429 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f12240ac970 con 0x7f122c0cb950 2024-09-12T02:33:30.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.269+0000 7f122a59c640 1 --2- 172.21.15.60:0/1734225429 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f121806be30 0x7f121806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:30.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.270+0000 7f122a59c640 1 --2- 172.21.15.60:0/1734225429 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f121806be30 0x7f121806e2f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f122c1f4620 tx=0x7f121c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:30.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.275+0000 7f12137fe640 1 -- 172.21.15.60:0/1734225429 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f122c15a200 con 0x7f122c0cb950 2024-09-12T02:33:30.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.696+0000 7f12311d6640 1 -- 172.21.15.60:0/1734225429 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f122c157fe0 con 0x7f122c0cb950 2024-09-12T02:33:30.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.696+0000 7f12137fe640 1 -- 172.21.15.60:0/1734225429 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f122c157fe0 con 0x7f122c0cb950 2024-09-12T02:33:30.697 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":104,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:33:30.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.699+0000 7f12311d6640 1 -- 172.21.15.60:0/1734225429 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f121806be30 msgr2=0x7f121806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:30.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.699+0000 7f12311d6640 1 --2- 172.21.15.60:0/1734225429 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f121806be30 0x7f121806e2f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f122c1f4620 tx=0x7f121c009040 comp rx=0 tx=0).stop 2024-09-12T02:33:30.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.699+0000 7f12311d6640 1 -- 172.21.15.60:0/1734225429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f122c0cb950 msgr2=0x7f122c1f0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:30.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.699+0000 7f12311d6640 1 --2- 172.21.15.60:0/1734225429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f122c0cb950 0x7f122c1f0b70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1224000f80 tx=0x7f1224004a40 comp rx=0 tx=0).stop 2024-09-12T02:33:30.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.699+0000 7f12311d6640 1 -- 172.21.15.60:0/1734225429 shutdown_connections 2024-09-12T02:33:30.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.699+0000 7f12311d6640 1 --2- 172.21.15.60:0/1734225429 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f121806be30 0x7f121806e2f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:30.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.699+0000 7f12311d6640 1 --2- 172.21.15.60:0/1734225429 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f122c15a5c0 0x7f122c14e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:30.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.699+0000 7f12311d6640 1 --2- 172.21.15.60:0/1734225429 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f122c154690 0x7f122c0ac6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:30.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.699+0000 7f12311d6640 1 --2- 172.21.15.60:0/1734225429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f122c0cb950 0x7f122c1f0b70 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:30.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.699+0000 7f12311d6640 1 -- 172.21.15.60:0/1734225429 >> 172.21.15.60:0/1734225429 conn(0x7f122c0c87f0 msgr2=0x7f122c158430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:30.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.699+0000 7f12311d6640 1 -- 172.21.15.60:0/1734225429 shutdown_connections 2024-09-12T02:33:30.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.699+0000 7f12311d6640 1 -- 172.21.15.60:0/1734225429 wait complete. 2024-09-12T02:33:30.715 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-12T02:33:30.716 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-12T02:33:30.716 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-12T02:33:30.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.869+0000 7f8a7c067640 1 Processor -- start 2024-09-12T02:33:30.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.869+0000 7f8a7c067640 1 -- start start 2024-09-12T02:33:30.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.870+0000 7f8a7c067640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8a740c5130 0x7f8a741538c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:30.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.870+0000 7f8a7c067640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8a74067950 0x7f8a74153e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:30.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.870+0000 7f8a7c067640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a740c2f60 con 0x7f8a740ad6a0 2024-09-12T02:33:30.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.870+0000 7f8a7c067640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f8a740c1f80 con 0x7f8a740c5130 2024-09-12T02:33:30.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.870+0000 7f8a7c067640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f8a740c3240 con 0x7f8a74067950 2024-09-12T02:33:30.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.870+0000 7f8a79602640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f8a740ad6a0 0x7f8a74159c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:39174/0 (socket says 172.21.15.60:39174) 2024-09-12T02:33:30.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.870+0000 7f8a79602640 1 -- 172.21.15.60:0/4249951014 learned_addr learned my addr 172.21.15.60:0/4249951014 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:33:30.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.870+0000 7f8a79e03640 1 --2- 172.21.15.60:0/4249951014 >> v2:172.21.15.60:3300/0 conn(0x7f8a740c5130 0x7f8a741538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:30.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.870+0000 7f8a7a604640 1 --2- 172.21.15.60:0/4249951014 >> v2:172.21.15.105:3300/0 conn(0x7f8a74067950 0x7f8a74153e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:30.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.871+0000 7f8a79e03640 1 -- 172.21.15.60:0/4249951014 >> v2:172.21.15.105:3300/0 conn(0x7f8a74067950 msgr2=0x7f8a74153e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:30.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.871+0000 7f8a79e03640 1 --2- 172.21.15.60:0/4249951014 >> v2:172.21.15.105:3300/0 conn(0x7f8a74067950 0x7f8a74153e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:30.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.871+0000 7f8a79e03640 1 -- 172.21.15.60:0/4249951014 >> v1:172.21.15.60:6789/0 conn(0x7f8a740ad6a0 legacy=0x7f8a74159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:30.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.871+0000 7f8a79e03640 1 -- 172.21.15.60:0/4249951014 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a740c1c10 con 0x7f8a740c5130 2024-09-12T02:33:30.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.871+0000 7f8a78e01640 1 -- 172.21.15.60:0/4249951014 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2494705718 0 0) 0x7f8a740c2f60 con 0x7f8a740ad6a0 2024-09-12T02:33:30.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.871+0000 7f8a7a604640 1 --2- 172.21.15.60:0/4249951014 >> v2:172.21.15.105:3300/0 conn(0x7f8a74067950 0x7f8a74153e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:33:30.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.872+0000 7f8a79e03640 1 --2- 172.21.15.60:0/4249951014 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a740c5130 0x7f8a741538c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8a74076750 tx=0x7f8a7002a090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ebeb9c0bc303873 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:30.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.872+0000 7f8a78e01640 1 -- 172.21.15.60:0/4249951014 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a70037070 con 0x7f8a740c5130 2024-09-12T02:33:30.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.873+0000 7f8a78e01640 1 -- 172.21.15.60:0/4249951014 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a7002ade0 con 0x7f8a740c5130 2024-09-12T02:33:30.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.873+0000 7f8a78e01640 1 -- 172.21.15.60:0/4249951014 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a70032660 con 0x7f8a740c5130 2024-09-12T02:33:30.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.874+0000 7f8a7c067640 1 -- 172.21.15.60:0/4249951014 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a740c5130 msgr2=0x7f8a741538c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:30.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.874+0000 7f8a7c067640 1 --2- 172.21.15.60:0/4249951014 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a740c5130 0x7f8a741538c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8a74076750 tx=0x7f8a7002a090 comp rx=0 tx=0).stop 2024-09-12T02:33:30.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.874+0000 7f8a7c067640 1 -- 172.21.15.60:0/4249951014 shutdown_connections 2024-09-12T02:33:30.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.874+0000 7f8a7c067640 1 --2- 172.21.15.60:0/4249951014 >> v2:172.21.15.105:3300/0 conn(0x7f8a74067950 0x7f8a74153e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:30.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.874+0000 7f8a7c067640 1 --2- 172.21.15.60:0/4249951014 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a740c5130 0x7f8a741538c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:30.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.874+0000 7f8a7c067640 1 -- 172.21.15.60:0/4249951014 >> 172.21.15.60:0/4249951014 conn(0x7f8a740c8430 msgr2=0x7f8a740c8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:30.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.874+0000 7f8a7c067640 1 -- 172.21.15.60:0/4249951014 shutdown_connections 2024-09-12T02:33:30.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.874+0000 7f8a7c067640 1 -- 172.21.15.60:0/4249951014 wait complete. 2024-09-12T02:33:30.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.876+0000 7f8a7c067640 1 Processor -- start 2024-09-12T02:33:30.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.876+0000 7f8a7c067640 1 -- start start 2024-09-12T02:33:30.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.877+0000 7f8a7c067640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a74067950 0x7f8a740aa980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:30.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.877+0000 7f8a7c067640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8a740ad6a0 0x7f8a740ac790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:30.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.878+0000 7f8a79e03640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a74067950 0x7f8a740aa980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:30.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.878+0000 7f8a7c067640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a7414e540 0x7f8a7414e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:30.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.878+0000 7f8a7c067640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8a740c5690 con 0x7f8a74067950 2024-09-12T02:33:30.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.878+0000 7f8a7c067640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8a740c5510 con 0x7f8a7414e540 2024-09-12T02:33:30.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.878+0000 7f8a7c067640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8a7415a370 con 0x7f8a740ad6a0 2024-09-12T02:33:30.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.878+0000 7f8a79e03640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a74067950 0x7f8a740aa980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39866/0 (socket says 172.21.15.60:39866) 2024-09-12T02:33:30.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.878+0000 7f8a79e03640 1 -- 172.21.15.60:0/1959575263 learned_addr learned my addr 172.21.15.60:0/1959575263 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:33:30.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.878+0000 7f8a7a604640 1 --2- 172.21.15.60:0/1959575263 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a7414e540 0x7f8a7414e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:30.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.878+0000 7f8a79e03640 1 -- 172.21.15.60:0/1959575263 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8a740ad6a0 msgr2=0x7f8a740ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:30.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.878+0000 7f8a79e03640 1 --2- 172.21.15.60:0/1959575263 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8a740ad6a0 0x7f8a740ac790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:30.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.878+0000 7f8a79e03640 1 -- 172.21.15.60:0/1959575263 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a7414e540 msgr2=0x7f8a7414e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:30.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.878+0000 7f8a79e03640 1 --2- 172.21.15.60:0/1959575263 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a7414e540 0x7f8a7414e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:30.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.878+0000 7f8a79e03640 1 -- 172.21.15.60:0/1959575263 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a74074180 con 0x7f8a74067950 2024-09-12T02:33:30.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.878+0000 7f8a79e03640 1 --2- 172.21.15.60:0/1959575263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a74067950 0x7f8a740aa980 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8a70009890 tx=0x7f8a70004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:30.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.879+0000 7f8a6a7fc640 1 -- 172.21.15.60:0/1959575263 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a70042020 con 0x7f8a74067950 2024-09-12T02:33:30.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.879+0000 7f8a6a7fc640 1 -- 172.21.15.60:0/1959575263 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a7003d470 con 0x7f8a74067950 2024-09-12T02:33:30.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.879+0000 7f8a7c067640 1 -- 172.21.15.60:0/1959575263 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a741ec4c0 con 0x7f8a74067950 2024-09-12T02:33:30.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.879+0000 7f8a6a7fc640 1 -- 172.21.15.60:0/1959575263 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a70037040 con 0x7f8a74067950 2024-09-12T02:33:30.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.879+0000 7f8a7c067640 1 -- 172.21.15.60:0/1959575263 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a74072630 con 0x7f8a74067950 2024-09-12T02:33:30.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.880+0000 7f8a7c067640 1 --2- 172.21.15.60:0/1959575263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a74072b50 0x7f8a74072f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:30.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.880+0000 7f8a7c067640 1 -- 172.21.15.60:0/1959575263 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8a7415a760 con 0x7f8a74072b50 2024-09-12T02:33:30.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.880+0000 7f8a79602640 1 --2- 172.21.15.60:0/1959575263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a74072b50 0x7f8a74072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:30.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.881+0000 7f8a79602640 1 -- 172.21.15.60:0/1959575263 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8a74072800 con 0x7f8a74072b50 2024-09-12T02:33:30.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.881+0000 7f8a6a7fc640 1 -- 172.21.15.60:0/1959575263 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8a70045020 con 0x7f8a74067950 2024-09-12T02:33:30.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.881+0000 7f8a79602640 1 --2- 172.21.15.60:0/1959575263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a74072b50 0x7f8a74072f30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8a74159640 tx=0x7f8a6400c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:30.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.881+0000 7f8a6a7fc640 1 --2- 172.21.15.60:0/1959575263 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8a5806be60 0x7f8a5806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:30.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.881+0000 7f8a6a7fc640 1 -- 172.21.15.60:0/1959575263 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f8a700ab700 con 0x7f8a74067950 2024-09-12T02:33:30.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.881+0000 7f8a7a604640 1 --2- 172.21.15.60:0/1959575263 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8a5806be60 0x7f8a5806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:30.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.882+0000 7f8a6a7fc640 1 -- 172.21.15.60:0/1959575263 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a640075a0 con 0x7f8a74072b50 2024-09-12T02:33:30.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.882+0000 7f8a6a7fc640 1 -- 172.21.15.60:0/1959575263 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f8a640047e0 con 0x7f8a74072b50 2024-09-12T02:33:30.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.882+0000 7f8a6a7fc640 1 -- 172.21.15.60:0/1959575263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a74072b50 msgr2=0x7f8a74072f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:30.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.882+0000 7f8a6a7fc640 1 --2- 172.21.15.60:0/1959575263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a74072b50 0x7f8a74072f30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8a74159640 tx=0x7f8a6400c7a0 comp rx=0 tx=0).stop 2024-09-12T02:33:30.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.882+0000 7f8a6a7fc640 1 -- 172.21.15.60:0/1959575263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a74072b50 msgr2=0x7f8a74072f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:33:30.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.882+0000 7f8a6a7fc640 1 --2- 172.21.15.60:0/1959575263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a74072b50 0x7f8a74072f30 secure :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8a74159640 tx=0x7f8a6400c7a0 comp rx=0 tx=0).stop 2024-09-12T02:33:30.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.882+0000 7f8a7a604640 1 --2- 172.21.15.60:0/1959575263 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8a5806be60 0x7f8a5806e320 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c007520 tx=0x7f8a6c00b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:30.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.891+0000 7f8a7c067640 1 --2- 172.21.15.60:0/1959575263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a74073470 0x7f8a741eef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:30.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.891+0000 7f8a7c067640 1 -- 172.21.15.60:0/1959575263 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8a74073850 con 0x7f8a74073470 2024-09-12T02:33:30.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.892+0000 7f8a79602640 1 --2- 172.21.15.60:0/1959575263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a74073470 0x7f8a741eef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:30.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.892+0000 7f8a79602640 1 -- 172.21.15.60:0/1959575263 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8a7406ef10 con 0x7f8a74073470 2024-09-12T02:33:30.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.892+0000 7f8a79602640 1 --2- 172.21.15.60:0/1959575263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a74073470 0x7f8a741eef90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8a64010000 tx=0x7f8a64000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:30.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.892+0000 7f8a6a7fc640 1 -- 172.21.15.60:0/1959575263 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6401b320 con 0x7f8a74073470 2024-09-12T02:33:30.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.893+0000 7f8a6a7fc640 1 -- 172.21.15.60:0/1959575263 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4718 (secure 0 0 0) 0x7f8a64019040 con 0x7f8a74073470 2024-09-12T02:33:30.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.893+0000 7f8a6a7fc640 1 -- 172.21.15.60:0/1959575263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a74073470 msgr2=0x7f8a741eef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:30.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.893+0000 7f8a6a7fc640 1 --2- 172.21.15.60:0/1959575263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a74073470 0x7f8a741eef90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8a64010000 tx=0x7f8a64000ed0 comp rx=0 tx=0).stop 2024-09-12T02:33:30.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.893+0000 7f8a6a7fc640 1 -- 172.21.15.60:0/1959575263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a74073470 msgr2=0x7f8a741eef90 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:33:30.894 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:33:30.895 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:33:30.895 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:33:30.895 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:33:30.895 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 104, 2024-09-12T02:33:30.895 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 27898, 2024-09-12T02:33:30.895 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:33:30.895 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:33:30.895 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:33:30.895 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:33:30.895 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:33:30.895 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 2, 2024-09-12T02:33:30.895 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:33:30.896 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:33:30.896 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:33:30.896 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:33:30.896 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:33:30.896 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:33:30.896 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:33:30.896 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:33:30.896 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:33:30.896 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:33:30.896 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:33:30.896 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:33:30.896 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:33:30.896 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:33:30.897 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:33:30.897 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:33:30.897 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:33:30.897 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:33:30.897 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:33:30.897 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:33:30.897 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:33:30.897 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:33:30.897 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:33:30.897 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:33:30.897 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:33:30.897 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:33:30.897 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:33:30.897 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:33:30.898 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:30.898 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:30.898 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:33:30.898 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:33:30.898 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:33:30.898 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:33:30.898 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:33:30.898 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:33:30.898 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:33:30.898 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:33:30.898 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:33:30.898 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:33:30.898 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:33:30.898 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:33:30.899 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:33:30.899 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:33:30.899 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:33:30.899 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:33:30.899 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:33:30.899 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:33:30.899 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:33:30.899 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:33:30.899 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:33:30.899 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:33:30.899 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:33:30.899 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:33:30.899 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:33:30.900 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:33:30.900 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:33:30.900 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:33:30.900 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:33:30.900 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:33:30.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:30.900 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:33:30.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:30.900 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:33:30.900 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:33:30.900 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:33:30.900 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:33:30.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:30.901 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:33:30.901 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:33:30.901 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:30.901 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:30.901 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:30.901 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:33:30.901 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:33:30.901 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:30.901 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:30.901 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:30.901 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:30.901 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:33:30.901 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:33:30.901 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:33:30.902 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:33:30.902 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:33:30.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:30.902 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:30.902 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:33:30.902 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:33:30.902 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:33:30.902 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:33:30.902 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:30.902 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:33:30.902 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:33:30.902 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:30.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:30.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:30.903 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:33:30.903 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:33:30.903 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:30.903 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:30.903 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:30.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:30.903 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:33:30.903 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:33:30.903 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:33:30.903 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:33:30.903 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:33:30.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:30.904 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:30.904 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:33:30.904 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:33:30.904 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:33:30.904 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:33:30.904 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:30.904 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:33:30.904 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:33:30.904 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:30.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:30.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:30.905 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:33:30.905 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:33:30.905 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:30.905 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:30.905 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:30.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:30.905 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:33:30.905 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:33:30.905 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:33:30.905 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:33:30.906 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:33:30.906 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:30.906 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:30.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:30.906 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:33:30.906 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:33:30.906 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:30.906 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:33:30.906 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:33:30.906 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:33:30.906 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:30.906 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:33:30.906 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:33:30.907 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:30.907 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:33:30.907 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:33:30.907 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:33:30.907 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:30.907 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:33:30.907 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:33:30.907 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:30.907 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:33:30.907 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:33:30.907 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:33:30.907 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:30.907 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:30.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:30.908 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:33:30.908 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:33:30.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.893+0000 7f8a6a7fc640 1 --2- 172.21.15.60:0/1959575263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a74073470 0x7f8a741eef90 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8a64010000 tx=0x7f8a64000ed0 comp rx=0 tx=0).stop 2024-09-12T02:33:30.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.893+0000 7f8a7c067640 1 -- 172.21.15.60:0/1959575263 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8a5806be60 msgr2=0x7f8a5806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:30.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.893+0000 7f8a7c067640 1 --2- 172.21.15.60:0/1959575263 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8a5806be60 0x7f8a5806e320 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c007520 tx=0x7f8a6c00b040 comp rx=0 tx=0).stop 2024-09-12T02:33:30.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.893+0000 7f8a7c067640 1 -- 172.21.15.60:0/1959575263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a74067950 msgr2=0x7f8a740aa980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:30.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.893+0000 7f8a7c067640 1 --2- 172.21.15.60:0/1959575263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a74067950 0x7f8a740aa980 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8a70009890 tx=0x7f8a70004730 comp rx=0 tx=0).stop 2024-09-12T02:33:30.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.893+0000 7f8a7a604640 1 -- 172.21.15.60:0/1959575263 reap_dead start 2024-09-12T02:33:30.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.894+0000 7f8a7a604640 1 -- 172.21.15.60:0/1959575263 reap_dead start 2024-09-12T02:33:30.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.894+0000 7f8a7c067640 1 -- 172.21.15.60:0/1959575263 shutdown_connections 2024-09-12T02:33:30.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.894+0000 7f8a7c067640 1 -- 172.21.15.60:0/1959575263 >> 172.21.15.60:0/1959575263 conn(0x7f8a740c8430 msgr2=0x7f8a74159c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:30.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.894+0000 7f8a7c067640 1 -- 172.21.15.60:0/1959575263 shutdown_connections 2024-09-12T02:33:30.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:30.894+0000 7f8a7c067640 1 -- 172.21.15.60:0/1959575263 wait complete. 2024-09-12T02:33:30.911 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:33:30.911 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-12T02:33:30.911 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-12T02:33:31.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.066+0000 7f464d7e4640 1 Processor -- start 2024-09-12T02:33:31.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.066+0000 7f464d7e4640 1 -- start start 2024-09-12T02:33:31.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.067+0000 7f464d7e4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46480a6c10 0x7f46480c2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:31.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.067+0000 7f464d7e4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f46480c6010 0x7f464806dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:31.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.067+0000 7f464d7e4640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f464815a970 con 0x7f46480c5940 2024-09-12T02:33:31.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.067+0000 7f464d7e4640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f464815ac50 con 0x7f46480c6010 2024-09-12T02:33:31.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.067+0000 7f464d7e4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f464815af30 con 0x7f46480a6c10 2024-09-12T02:33:31.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.068+0000 7f46477fe640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f46480c5940 0x7f464806dff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:33998/0 (socket says 172.21.15.60:33998) 2024-09-12T02:33:31.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.068+0000 7f46477fe640 1 -- 172.21.15.60:0/431025140 learned_addr learned my addr 172.21.15.60:0/431025140 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:33:31.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.069+0000 7f46467fc640 1 --2- 172.21.15.60:0/431025140 >> v2:172.21.15.60:3300/0 conn(0x7f46480c6010 0x7f464806dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:31.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.069+0000 7f4645ffb640 1 -- 172.21.15.60:0/431025140 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1989149573 0 0) 0x7f464815a970 con 0x7f46480c5940 2024-09-12T02:33:31.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.069+0000 7f4645ffb640 1 -- 172.21.15.60:0/431025140 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4630003520 con 0x7f46480c5940 2024-09-12T02:33:31.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.069+0000 7f4646ffd640 1 --2- 172.21.15.60:0/431025140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46480a6c10 0x7f46480c2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:31.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.069+0000 7f46467fc640 1 -- 172.21.15.60:0/431025140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46480a6c10 msgr2=0x7f46480c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:31.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.069+0000 7f46467fc640 1 --2- 172.21.15.60:0/431025140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46480a6c10 0x7f46480c2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:31.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.069+0000 7f46467fc640 1 -- 172.21.15.60:0/431025140 >> v1:172.21.15.105:6789/0 conn(0x7f46480c5940 legacy=0x7f464806dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:31.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.069+0000 7f46467fc640 1 -- 172.21.15.60:0/431025140 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f464815b210 con 0x7f46480c6010 2024-09-12T02:33:31.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.071+0000 7f46467fc640 1 --2- 172.21.15.60:0/431025140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46480c6010 0x7f464806dab0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f46380097a0 tx=0x7f463802a0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83f0dec8e5a35256 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:31.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.071+0000 7f4645ffb640 1 -- 172.21.15.60:0/431025140 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4638037070 con 0x7f46480c6010 2024-09-12T02:33:31.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.072+0000 7f4645ffb640 1 -- 172.21.15.60:0/431025140 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f463802ae40 con 0x7f46480c6010 2024-09-12T02:33:31.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.072+0000 7f4645ffb640 1 -- 172.21.15.60:0/431025140 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4638032660 con 0x7f46480c6010 2024-09-12T02:33:31.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.073+0000 7f464d7e4640 1 -- 172.21.15.60:0/431025140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46480c6010 msgr2=0x7f464806dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:31.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.073+0000 7f464d7e4640 1 --2- 172.21.15.60:0/431025140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46480c6010 0x7f464806dab0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f46380097a0 tx=0x7f463802a0f0 comp rx=0 tx=0).stop 2024-09-12T02:33:31.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.073+0000 7f464d7e4640 1 -- 172.21.15.60:0/431025140 shutdown_connections 2024-09-12T02:33:31.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.073+0000 7f464d7e4640 1 --2- 172.21.15.60:0/431025140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46480c6010 0x7f464806dab0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:31.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.073+0000 7f464d7e4640 1 --2- 172.21.15.60:0/431025140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46480a6c10 0x7f46480c2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:31.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.073+0000 7f464d7e4640 1 -- 172.21.15.60:0/431025140 >> 172.21.15.60:0/431025140 conn(0x7f46480c7a40 msgr2=0x7f46480c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:31.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.074+0000 7f464d7e4640 1 -- 172.21.15.60:0/431025140 shutdown_connections 2024-09-12T02:33:31.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.074+0000 7f464d7e4640 1 -- 172.21.15.60:0/431025140 wait complete. 2024-09-12T02:33:31.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.076+0000 7f464d7e4640 1 Processor -- start 2024-09-12T02:33:31.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.076+0000 7f464d7e4640 1 -- start start 2024-09-12T02:33:31.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.077+0000 7f464d7e4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46480a6c10 0x7f46480c7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:31.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.077+0000 7f464d7e4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46480c5940 0x7f46481f3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:31.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.077+0000 7f464d7e4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46480c6010 0x7f464814d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:31.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.077+0000 7f464d7e4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f46480a73a0 con 0x7f46480c5940 2024-09-12T02:33:31.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.077+0000 7f464d7e4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f464815a620 con 0x7f46480a6c10 2024-09-12T02:33:31.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.077+0000 7f464d7e4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f46480a7520 con 0x7f46480c6010 2024-09-12T02:33:31.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.078+0000 7f46467fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46480c5940 0x7f46481f3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:31.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.078+0000 7f46467fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46480c5940 0x7f46481f3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39912/0 (socket says 172.21.15.60:39912) 2024-09-12T02:33:31.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.078+0000 7f46467fc640 1 -- 172.21.15.60:0/2684842848 learned_addr learned my addr 172.21.15.60:0/2684842848 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:33:31.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.078+0000 7f46477fe640 1 --2- 172.21.15.60:0/2684842848 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46480c6010 0x7f464814d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:31.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.078+0000 7f4646ffd640 1 --2- 172.21.15.60:0/2684842848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46480a6c10 0x7f46480c7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:31.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.079+0000 7f46467fc640 1 -- 172.21.15.60:0/2684842848 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46480c6010 msgr2=0x7f464814d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:31.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.079+0000 7f46467fc640 1 --2- 172.21.15.60:0/2684842848 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46480c6010 0x7f464814d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:31.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.079+0000 7f46467fc640 1 -- 172.21.15.60:0/2684842848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46480a6c10 msgr2=0x7f46480c7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:31.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.079+0000 7f46467fc640 1 --2- 172.21.15.60:0/2684842848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46480a6c10 0x7f46480c7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:31.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.079+0000 7f46467fc640 1 -- 172.21.15.60:0/2684842848 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f464814e350 con 0x7f46480c5940 2024-09-12T02:33:31.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.079+0000 7f46467fc640 1 --2- 172.21.15.60:0/2684842848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46480c5940 0x7f46481f3b10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4638000c00 tx=0x7f46380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:31.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.080+0000 7f462f7fe640 1 -- 172.21.15.60:0/2684842848 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4638041030 con 0x7f46480c5940 2024-09-12T02:33:31.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.080+0000 7f464d7e4640 1 -- 172.21.15.60:0/2684842848 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46481e61b0 con 0x7f46480c5940 2024-09-12T02:33:31.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.080+0000 7f464d7e4640 1 -- 172.21.15.60:0/2684842848 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46481f35f0 con 0x7f46480c5940 2024-09-12T02:33:31.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.080+0000 7f462f7fe640 1 -- 172.21.15.60:0/2684842848 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f463802ac40 con 0x7f46480c5940 2024-09-12T02:33:31.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.080+0000 7f462f7fe640 1 -- 172.21.15.60:0/2684842848 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4638037040 con 0x7f46480c5940 2024-09-12T02:33:31.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.081+0000 7f464d7e4640 1 --2- 172.21.15.60:0/2684842848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4628002a70 0x7f4628004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:31.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.081+0000 7f464d7e4640 1 -- 172.21.15.60:0/2684842848 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4628007ec0 con 0x7f4628002a70 2024-09-12T02:33:31.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.081+0000 7f4646ffd640 1 --2- 172.21.15.60:0/2684842848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4628002a70 0x7f4628004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:31.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.082+0000 7f4646ffd640 1 -- 172.21.15.60:0/2684842848 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f46280080c0 con 0x7f4628002a70 2024-09-12T02:33:31.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.082+0000 7f462f7fe640 1 -- 172.21.15.60:0/2684842848 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4638044030 con 0x7f46480c5940 2024-09-12T02:33:31.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.082+0000 7f4646ffd640 1 --2- 172.21.15.60:0/2684842848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4628002a70 0x7f4628004f30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4640007f00 tx=0x7f46400115a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:31.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.083+0000 7f462f7fe640 1 --2- 172.21.15.60:0/2684842848 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f463406be80 0x7f463406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:31.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.083+0000 7f462f7fe640 1 -- 172.21.15.60:0/2684842848 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f46380aafd0 con 0x7f46480c5940 2024-09-12T02:33:31.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.083+0000 7f46477fe640 1 --2- 172.21.15.60:0/2684842848 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f463406be80 0x7f463406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:31.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.083+0000 7f462f7fe640 1 -- 172.21.15.60:0/2684842848 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4640003990 con 0x7f4628002a70 2024-09-12T02:33:31.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.083+0000 7f462f7fe640 1 -- 172.21.15.60:0/2684842848 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f4640003b30 con 0x7f4628002a70 2024-09-12T02:33:31.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.083+0000 7f46477fe640 1 --2- 172.21.15.60:0/2684842848 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f463406be80 0x7f463406e340 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f464814e8c0 tx=0x7f463c007cb0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:31.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.083+0000 7f462f7fe640 1 -- 172.21.15.60:0/2684842848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4628002a70 msgr2=0x7f4628004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:31.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.083+0000 7f462f7fe640 1 --2- 172.21.15.60:0/2684842848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4628002a70 0x7f4628004f30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4640007f00 tx=0x7f46400115a0 comp rx=0 tx=0).stop 2024-09-12T02:33:31.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.083+0000 7f462f7fe640 1 -- 172.21.15.60:0/2684842848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4628002a70 msgr2=0x7f4628004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:33:31.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.083+0000 7f462f7fe640 1 --2- 172.21.15.60:0/2684842848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4628002a70 0x7f4628004f30 secure :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4640007f00 tx=0x7f46400115a0 comp rx=0 tx=0).stop 2024-09-12T02:33:31.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.094+0000 7f464d7e4640 1 --2- 172.21.15.60:0/2684842848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4628006eb0 0x7f4628007340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:31.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.094+0000 7f464d7e4640 1 -- 172.21.15.60:0/2684842848 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f462800a4a0 con 0x7f4628006eb0 2024-09-12T02:33:31.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.094+0000 7f4646ffd640 1 --2- 172.21.15.60:0/2684842848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4628006eb0 0x7f4628007340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:31.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.095+0000 7f4646ffd640 1 -- 172.21.15.60:0/2684842848 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4628007880 con 0x7f4628006eb0 2024-09-12T02:33:31.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.095+0000 7f4646ffd640 1 --2- 172.21.15.60:0/2684842848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4628006eb0 0x7f4628007340 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4640007f00 tx=0x7f4640004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:31.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.095+0000 7f462f7fe640 1 -- 172.21.15.60:0/2684842848 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4640004570 con 0x7f4628006eb0 2024-09-12T02:33:31.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.096+0000 7f462f7fe640 1 -- 172.21.15.60:0/2684842848 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5051 (secure 0 0 0) 0x7f4640004570 con 0x7f4628006eb0 2024-09-12T02:33:31.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.096+0000 7f462f7fe640 1 -- 172.21.15.60:0/2684842848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4628006eb0 msgr2=0x7f4628007340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:31.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.096+0000 7f462f7fe640 1 --2- 172.21.15.60:0/2684842848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4628006eb0 0x7f4628007340 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4640007f00 tx=0x7f4640004a40 comp rx=0 tx=0).stop 2024-09-12T02:33:31.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.096+0000 7f462f7fe640 1 -- 172.21.15.60:0/2684842848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4628006eb0 msgr2=0x7f4628007340 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:33:31.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.096+0000 7f462f7fe640 1 --2- 172.21.15.60:0/2684842848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4628006eb0 0x7f4628007340 secure :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4640007f00 tx=0x7f4640004a40 comp rx=0 tx=0).stop 2024-09-12T02:33:31.097 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:33:31.097 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:33:31.097 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:33:31.098 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:33:31.098 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 104, 2024-09-12T02:33:31.098 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 556529, 2024-09-12T02:33:31.098 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:33:31.098 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:33:31.098 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:33:31.098 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:33:31.098 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:33:31.098 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 2, 2024-09-12T02:33:31.098 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:33:31.098 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:33:31.098 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:33:31.099 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:33:31.099 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:33:31.099 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:33:31.099 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:33:31.099 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:33:31.099 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:33:31.099 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:33:31.099 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:33:31.099 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:33:31.099 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:33:31.099 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:33:31.099 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:33:31.100 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:33:31.100 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:33:31.100 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:33:31.100 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:33:31.100 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:33:31.100 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:33:31.100 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:33:31.100 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:33:31.100 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:33:31.100 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:33:31.100 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:33:31.100 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:33:31.100 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:33:31.101 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:31.101 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:31.101 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:33:31.101 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:33:31.101 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:33:31.101 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:33:31.101 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:33:31.101 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:33:31.101 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:33:31.101 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:33:31.101 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:33:31.101 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:33:31.102 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:33:31.102 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:33:31.102 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:33:31.102 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:33:31.102 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:33:31.102 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:33:31.102 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:33:31.102 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:33:31.102 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:33:31.102 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:33:31.102 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:33:31.102 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:33:31.102 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:33:31.103 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:33:31.103 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:33:31.103 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:33:31.103 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:33:31.103 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:33:31.103 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:33:31.103 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:33:31.103 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:31.103 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:33:31.103 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:31.103 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:33:31.103 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:33:31.103 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:33:31.104 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:33:31.104 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:31.104 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:33:31.104 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:33:31.104 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:31.104 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:31.104 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:31.104 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:33:31.104 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:33:31.104 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:31.104 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:31.104 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:31.104 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:31.105 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:33:31.105 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:33:31.105 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:33:31.105 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:33:31.105 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:33:31.105 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:31.105 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:31.105 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:33:31.105 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:33:31.105 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:33:31.105 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:33:31.105 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:31.106 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:33:31.106 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:33:31.106 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:31.106 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:31.106 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:31.106 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:33:31.106 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:33:31.106 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:31.106 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:31.106 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:31.106 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:31.106 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:33:31.106 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:33:31.106 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:33:31.107 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:33:31.107 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:33:31.107 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:31.107 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:31.107 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:33:31.107 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:33:31.107 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:33:31.107 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:33:31.107 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:31.107 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:33:31.107 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:33:31.107 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:31.107 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:31.108 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:31.108 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:33:31.108 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:33:31.108 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:31.108 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:31.108 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:31.108 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:31.108 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:33:31.108 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:33:31.108 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:33:31.108 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:33:31.108 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:33:31.108 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:31.108 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:31.109 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:31.109 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:33:31.109 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:33:31.109 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:31.109 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:33:31.109 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:33:31.109 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:33:31.109 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:31.109 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:33:31.109 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:33:31.109 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:31.109 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:33:31.109 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:33:31.110 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:33:31.110 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:31.110 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:33:31.110 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:33:31.110 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:31.110 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:33:31.110 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:33:31.110 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-09-12T02:33:31.110 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:31.110 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:33:31.110 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:33:31.110 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:31.110 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:33:31.111 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:33:31.111 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-09-12T02:33:31.111 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:31.111 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:33:31.111 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:33:31.111 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:31.111 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:33:31.111 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:33:31.111 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:33:31.111 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:31.111 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:31.111 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:31.111 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:33:31.111 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:33:31.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.096+0000 7f464d7e4640 1 -- 172.21.15.60:0/2684842848 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f463406be80 msgr2=0x7f463406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:31.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.096+0000 7f464d7e4640 1 --2- 172.21.15.60:0/2684842848 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f463406be80 0x7f463406e340 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f464814e8c0 tx=0x7f463c007cb0 comp rx=0 tx=0).stop 2024-09-12T02:33:31.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.096+0000 7f46477fe640 1 -- 172.21.15.60:0/2684842848 reap_dead start 2024-09-12T02:33:31.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.096+0000 7f464d7e4640 1 -- 172.21.15.60:0/2684842848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46480c5940 msgr2=0x7f46481f3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:31.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.096+0000 7f464d7e4640 1 --2- 172.21.15.60:0/2684842848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46480c5940 0x7f46481f3b10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4638000c00 tx=0x7f46380046c0 comp rx=0 tx=0).stop 2024-09-12T02:33:31.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.097+0000 7f464d7e4640 1 -- 172.21.15.60:0/2684842848 shutdown_connections 2024-09-12T02:33:31.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.097+0000 7f464d7e4640 1 --2- 172.21.15.60:0/2684842848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46480c5940 0x7f46481f3b10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:31.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.097+0000 7f464d7e4640 1 -- 172.21.15.60:0/2684842848 >> 172.21.15.60:0/2684842848 conn(0x7f46480c7a40 msgr2=0x7f4648158490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:31.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.097+0000 7f464d7e4640 1 -- 172.21.15.60:0/2684842848 shutdown_connections 2024-09-12T02:33:31.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.097+0000 7f464d7e4640 1 -- 172.21.15.60:0/2684842848 wait complete. 2024-09-12T02:33:31.115 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:33:31.115 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-12T02:33:31.115 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-12T02:33:31.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.265+0000 7f0912549640 1 Processor -- start 2024-09-12T02:33:31.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.265+0000 7f0912549640 1 -- start start 2024-09-12T02:33:31.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.266+0000 7f0912549640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f090c1500a0 0x7f090c0c3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:31.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.266+0000 7f0912549640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f090c06e650 0x7f090c150930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:31.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.266+0000 7f0912549640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f090c0c3e00 0x7f090c06dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:31.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.266+0000 7f0912549640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f090c0ad5c0 con 0x7f090c1500a0 2024-09-12T02:33:31.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.266+0000 7f0912549640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f090c06ef50 con 0x7f090c06e650 2024-09-12T02:33:31.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.266+0000 7f0912549640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f090c0ad860 con 0x7f090c0c3e00 2024-09-12T02:33:31.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.266+0000 7f090bfff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f090c1500a0 0x7f090c0c3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:31.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.267+0000 7f090bfff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f090c1500a0 0x7f090c0c3000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39920/0 (socket says 172.21.15.60:39920) 2024-09-12T02:33:31.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.267+0000 7f090bfff640 1 -- 172.21.15.60:0/1580591485 learned_addr learned my addr 172.21.15.60:0/1580591485 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:33:31.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.267+0000 7f090b7fe640 1 --2- 172.21.15.60:0/1580591485 >> v2:172.21.15.105:3300/0 conn(0x7f090c06e650 0x7f090c150930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:31.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.267+0000 7f0910ae6640 1 --2- 172.21.15.60:0/1580591485 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f090c0c3e00 0x7f090c06dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:31.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.267+0000 7f090bfff640 1 -- 172.21.15.60:0/1580591485 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f090c0c3e00 msgr2=0x7f090c06dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:31.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.267+0000 7f090bfff640 1 --2- 172.21.15.60:0/1580591485 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f090c0c3e00 0x7f090c06dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:31.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.267+0000 7f090bfff640 1 -- 172.21.15.60:0/1580591485 >> v2:172.21.15.105:3300/0 conn(0x7f090c06e650 msgr2=0x7f090c150930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:31.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.267+0000 7f090bfff640 1 --2- 172.21.15.60:0/1580591485 >> v2:172.21.15.105:3300/0 conn(0x7f090c06e650 0x7f090c150930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:31.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.267+0000 7f090bfff640 1 -- 172.21.15.60:0/1580591485 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f090c06ec70 con 0x7f090c1500a0 2024-09-12T02:33:31.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.267+0000 7f0910ae6640 1 --2- 172.21.15.60:0/1580591485 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f090c0c3e00 0x7f090c06dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:33:31.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.267+0000 7f090b7fe640 1 --2- 172.21.15.60:0/1580591485 >> v2:172.21.15.105:3300/0 conn(0x7f090c06e650 0x7f090c150930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:31.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.268+0000 7f090bfff640 1 --2- 172.21.15.60:0/1580591485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f090c1500a0 0x7f090c0c3000 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f090c0c1e60 tx=0x7f08fc02b250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c3a5b0f65799c5d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:31.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.268+0000 7f090affd640 1 -- 172.21.15.60:0/1580591485 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08fc038070 con 0x7f090c1500a0 2024-09-12T02:33:31.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.268+0000 7f090affd640 1 -- 172.21.15.60:0/1580591485 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08fc033440 con 0x7f090c1500a0 2024-09-12T02:33:31.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.268+0000 7f090affd640 1 -- 172.21.15.60:0/1580591485 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08fc033810 con 0x7f090c1500a0 2024-09-12T02:33:31.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.269+0000 7f0912549640 1 -- 172.21.15.60:0/1580591485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f090c1500a0 msgr2=0x7f090c0c3000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:31.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.269+0000 7f0912549640 1 --2- 172.21.15.60:0/1580591485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f090c1500a0 0x7f090c0c3000 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f090c0c1e60 tx=0x7f08fc02b250 comp rx=0 tx=0).stop 2024-09-12T02:33:31.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.269+0000 7f0912549640 1 -- 172.21.15.60:0/1580591485 shutdown_connections 2024-09-12T02:33:31.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.269+0000 7f0912549640 1 --2- 172.21.15.60:0/1580591485 >> v2:172.21.15.105:3300/0 conn(0x7f090c06e650 0x7f090c150930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:31.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.269+0000 7f0912549640 1 --2- 172.21.15.60:0/1580591485 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f090c0c3e00 0x7f090c06dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:31.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.269+0000 7f0912549640 1 --2- 172.21.15.60:0/1580591485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f090c1500a0 0x7f090c0c3000 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:31.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.269+0000 7f0912549640 1 -- 172.21.15.60:0/1580591485 >> 172.21.15.60:0/1580591485 conn(0x7f090c0c7a40 msgr2=0x7f090c0c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:31.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.269+0000 7f0912549640 1 -- 172.21.15.60:0/1580591485 shutdown_connections 2024-09-12T02:33:31.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.269+0000 7f0912549640 1 -- 172.21.15.60:0/1580591485 wait complete. 2024-09-12T02:33:31.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.271+0000 7f0912549640 1 Processor -- start 2024-09-12T02:33:31.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.271+0000 7f0912549640 1 -- start start 2024-09-12T02:33:31.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.272+0000 7f0912549640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f090c06e650 0x7f090c1f0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:31.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.272+0000 7f0912549640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f090c0c3e00 0x7f090c0c10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:31.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.272+0000 7f0912549640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f090c1500a0 0x7f090c1ec5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:31.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.272+0000 7f0912549640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f090c150e70 con 0x7f090c0c3e00 2024-09-12T02:33:31.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.272+0000 7f0912549640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f090c0c3540 con 0x7f090c1500a0 2024-09-12T02:33:31.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.272+0000 7f0912549640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f090c0adb10 con 0x7f090c06e650 2024-09-12T02:33:31.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.273+0000 7f090b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f090c0c3e00 0x7f090c0c10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:31.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.273+0000 7f0910ae6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f090c1500a0 0x7f090c1ec5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:31.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.273+0000 7f090bfff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f090c06e650 0x7f090c1f0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:31.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.273+0000 7f0910ae6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f090c1500a0 0x7f090c1ec5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:53076/0 (socket says 172.21.15.60:53076) 2024-09-12T02:33:31.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.273+0000 7f0910ae6640 1 -- 172.21.15.60:0/2084116754 learned_addr learned my addr 172.21.15.60:0/2084116754 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:33:31.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.273+0000 7f090bfff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f090c06e650 0x7f090c1f0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:44324/0 (socket says 172.21.15.60:44324) 2024-09-12T02:33:31.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.273+0000 7f090b7fe640 1 -- 172.21.15.60:0/2084116754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f090c06e650 msgr2=0x7f090c1f0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:31.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.273+0000 7f090b7fe640 1 --2- 172.21.15.60:0/2084116754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f090c06e650 0x7f090c1f0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:31.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.273+0000 7f090b7fe640 1 -- 172.21.15.60:0/2084116754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f090c1500a0 msgr2=0x7f090c1ec5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:31.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.273+0000 7f090b7fe640 1 --2- 172.21.15.60:0/2084116754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f090c1500a0 0x7f090c1ec5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:31.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.273+0000 7f090b7fe640 1 -- 172.21.15.60:0/2084116754 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f090c0aa580 con 0x7f090c0c3e00 2024-09-12T02:33:31.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.273+0000 7f0910ae6640 1 --2- 172.21.15.60:0/2084116754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f090c1500a0 0x7f090c1ec5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:33:31.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.273+0000 7f090bfff640 1 --2- 172.21.15.60:0/2084116754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f090c06e650 0x7f090c1f0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:33:31.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.273+0000 7f090b7fe640 1 --2- 172.21.15.60:0/2084116754 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f090c0c3e00 0x7f090c0c10e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f090000e5e0 tx=0x7f090000eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:31.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.273+0000 7f0908ff9640 1 -- 172.21.15.60:0/2084116754 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0900017070 con 0x7f090c0c3e00 2024-09-12T02:33:31.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.274+0000 7f0908ff9640 1 -- 172.21.15.60:0/2084116754 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0900013610 con 0x7f090c0c3e00 2024-09-12T02:33:31.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.274+0000 7f0912549640 1 -- 172.21.15.60:0/2084116754 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f090c1efbd0 con 0x7f090c0c3e00 2024-09-12T02:33:31.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.274+0000 7f0908ff9640 1 -- 172.21.15.60:0/2084116754 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f090000f040 con 0x7f090c0c3e00 2024-09-12T02:33:31.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.274+0000 7f0912549640 1 -- 172.21.15.60:0/2084116754 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f090c154170 con 0x7f090c0c3e00 2024-09-12T02:33:31.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.275+0000 7f0912549640 1 --2- 172.21.15.60:0/2084116754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f090c156250 0x7f090c1efda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:31.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.276+0000 7f0912549640 1 -- 172.21.15.60:0/2084116754 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f090c069080 con 0x7f090c156250 2024-09-12T02:33:31.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.276+0000 7f0908ff9640 1 -- 172.21.15.60:0/2084116754 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f090001a070 con 0x7f090c0c3e00 2024-09-12T02:33:31.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.276+0000 7f090bfff640 1 --2- 172.21.15.60:0/2084116754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f090c156250 0x7f090c1efda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:31.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.276+0000 7f090bfff640 1 -- 172.21.15.60:0/2084116754 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f090c06e3e0 con 0x7f090c156250 2024-09-12T02:33:31.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.277+0000 7f090bfff640 1 --2- 172.21.15.60:0/2084116754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f090c156250 0x7f090c1efda0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f090c0c8780 tx=0x7f08fc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:31.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.277+0000 7f0908ff9640 1 --2- 172.21.15.60:0/2084116754 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f08f806be30 0x7f08f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:31.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.278+0000 7f0910ae6640 1 --2- 172.21.15.60:0/2084116754 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f08f806be30 0x7f08f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:31.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.278+0000 7f0908ff9640 1 -- 172.21.15.60:0/2084116754 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f090008af60 con 0x7f090c0c3e00 2024-09-12T02:33:31.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.278+0000 7f0908ff9640 1 -- 172.21.15.60:0/2084116754 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08fc042070 con 0x7f090c156250 2024-09-12T02:33:31.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.278+0000 7f0908ff9640 1 -- 172.21.15.60:0/2084116754 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f08fc033440 con 0x7f090c156250 2024-09-12T02:33:31.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.278+0000 7f0908ff9640 1 -- 172.21.15.60:0/2084116754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f090c156250 msgr2=0x7f090c1efda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:31.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.278+0000 7f0908ff9640 1 --2- 172.21.15.60:0/2084116754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f090c156250 0x7f090c1efda0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f090c0c8780 tx=0x7f08fc0046c0 comp rx=0 tx=0).stop 2024-09-12T02:33:31.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.278+0000 7f0908ff9640 1 -- 172.21.15.60:0/2084116754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f090c156250 msgr2=0x7f090c1efda0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:33:31.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.278+0000 7f0908ff9640 1 --2- 172.21.15.60:0/2084116754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f090c156250 0x7f090c1efda0 secure :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f090c0c8780 tx=0x7f08fc0046c0 comp rx=0 tx=0).stop 2024-09-12T02:33:31.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.278+0000 7f0910ae6640 1 --2- 172.21.15.60:0/2084116754 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f08f806be30 0x7f08f806e2f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0904007fd0 tx=0x7f09040077a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:31.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.289+0000 7f0912549640 1 --2- 172.21.15.60:0/2084116754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f090c147c60 0x7f090c148040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:31.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.289+0000 7f0912549640 1 -- 172.21.15.60:0/2084116754 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f090c0aa8e0 con 0x7f090c147c60 2024-09-12T02:33:31.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.290+0000 7f090bfff640 1 --2- 172.21.15.60:0/2084116754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f090c147c60 0x7f090c148040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:31.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.290+0000 7f090bfff640 1 -- 172.21.15.60:0/2084116754 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f090c0ad2c0 con 0x7f090c147c60 2024-09-12T02:33:31.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.290+0000 7f090bfff640 1 --2- 172.21.15.60:0/2084116754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f090c147c60 0x7f090c148040 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f08fc02b290 tx=0x7f08fc008030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:31.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.291+0000 7f0908ff9640 1 -- 172.21.15.60:0/2084116754 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08fc038040 con 0x7f090c147c60 2024-09-12T02:33:31.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.291+0000 7f0908ff9640 1 -- 172.21.15.60:0/2084116754 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4549 (secure 0 0 0) 0x7f08fc003a20 con 0x7f090c147c60 2024-09-12T02:33:31.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.291+0000 7f0908ff9640 1 -- 172.21.15.60:0/2084116754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f090c147c60 msgr2=0x7f090c148040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:31.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.291+0000 7f0908ff9640 1 --2- 172.21.15.60:0/2084116754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f090c147c60 0x7f090c148040 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f08fc02b290 tx=0x7f08fc008030 comp rx=0 tx=0).stop 2024-09-12T02:33:31.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.291+0000 7f0908ff9640 1 -- 172.21.15.60:0/2084116754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f090c147c60 msgr2=0x7f090c148040 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:33:31.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.291+0000 7f0908ff9640 1 --2- 172.21.15.60:0/2084116754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f090c147c60 0x7f090c148040 secure :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f08fc02b290 tx=0x7f08fc008030 comp rx=0 tx=0).stop 2024-09-12T02:33:31.293 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:33:31.293 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:33:31.293 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:33:31.293 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:33:31.293 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 104, 2024-09-12T02:33:31.293 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 85045, 2024-09-12T02:33:31.293 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:33:31.293 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:33:31.293 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:33:31.293 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:33:31.294 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:33:31.294 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 2, 2024-09-12T02:33:31.294 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:33:31.294 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:33:31.294 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:33:31.294 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:33:31.294 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:33:31.294 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:33:31.294 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:33:31.294 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:33:31.294 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:33:31.295 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:33:31.295 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:33:31.295 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:33:31.295 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:33:31.295 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:33:31.295 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:33:31.295 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:33:31.295 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:33:31.295 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:33:31.295 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:33:31.295 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:33:31.296 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:33:31.296 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:33:31.296 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:33:31.296 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:33:31.296 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:33:31.296 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:33:31.296 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:33:31.296 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:33:31.296 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:31.296 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:31.296 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:33:31.297 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:33:31.297 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:33:31.297 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:33:31.297 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:33:31.297 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:33:31.297 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:33:31.297 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:33:31.297 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:33:31.297 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:33:31.297 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:33:31.298 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:33:31.298 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:33:31.298 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:33:31.298 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:33:31.298 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:33:31.298 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:33:31.298 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:33:31.298 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:33:31.298 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:33:31.298 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:33:31.299 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:33:31.299 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:33:31.299 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:33:31.299 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:33:31.299 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:33:31.299 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:33:31.299 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:33:31.299 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:33:31.299 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:33:31.299 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:31.299 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:33:31.300 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:31.300 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:33:31.300 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:33:31.300 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:33:31.300 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:33:31.300 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:31.300 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:33:31.300 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:33:31.300 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:31.300 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:31.301 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:31.301 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:33:31.301 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:33:31.301 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:31.301 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:31.301 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:31.301 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:31.301 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:33:31.301 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:33:31.301 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:33:31.301 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:33:31.302 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:33:31.302 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:31.302 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:31.302 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:33:31.302 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:33:31.302 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:33:31.302 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:33:31.302 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:31.302 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:33:31.302 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:33:31.302 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:31.303 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:31.303 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:31.303 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:33:31.303 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:33:31.303 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:31.303 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:31.303 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:31.303 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:31.303 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:33:31.303 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:33:31.304 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:33:31.304 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:33:31.304 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:33:31.304 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:31.304 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:31.304 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:33:31.304 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:33:31.304 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:33:31.304 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:33:31.304 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:31.305 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:33:31.305 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:33:31.305 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:31.305 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:31.305 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:31.305 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:33:31.305 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:33:31.305 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:31.305 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:31.305 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:31.305 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:31.305 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:33:31.306 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:33:31.306 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:33:31.306 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:33:31.306 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:33:31.306 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:31.306 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:31.306 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:31.306 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:33:31.306 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:33:31.306 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:31.306 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:33:31.307 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:33:31.307 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:33:31.307 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:31.307 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:33:31.307 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:33:31.307 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:31.307 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:33:31.307 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:33:31.307 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:33:31.307 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:31.307 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:31.307 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:31.308 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:33:31.308 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:33:31.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.292+0000 7f08f27fc640 1 -- 172.21.15.60:0/2084116754 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f08f806be30 msgr2=0x7f08f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:31.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.292+0000 7f08f27fc640 1 --2- 172.21.15.60:0/2084116754 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f08f806be30 0x7f08f806e2f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0904007fd0 tx=0x7f09040077a0 comp rx=0 tx=0).stop 2024-09-12T02:33:31.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.292+0000 7f08f27fc640 1 -- 172.21.15.60:0/2084116754 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f090c0c3e00 msgr2=0x7f090c0c10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:31.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.292+0000 7f08f27fc640 1 --2- 172.21.15.60:0/2084116754 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f090c0c3e00 0x7f090c0c10e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f090000e5e0 tx=0x7f090000eaa0 comp rx=0 tx=0).stop 2024-09-12T02:33:31.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.292+0000 7f0910ae6640 1 -- 172.21.15.60:0/2084116754 reap_dead start 2024-09-12T02:33:31.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.292+0000 7f0910ae6640 1 -- 172.21.15.60:0/2084116754 reap_dead start 2024-09-12T02:33:31.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.292+0000 7f08f27fc640 1 -- 172.21.15.60:0/2084116754 shutdown_connections 2024-09-12T02:33:31.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.292+0000 7f08f27fc640 1 -- 172.21.15.60:0/2084116754 >> 172.21.15.60:0/2084116754 conn(0x7f090c0c7a40 msgr2=0x7f090c14f190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:31.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.293+0000 7f08f27fc640 1 -- 172.21.15.60:0/2084116754 shutdown_connections 2024-09-12T02:33:31.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.293+0000 7f08f27fc640 1 -- 172.21.15.60:0/2084116754 wait complete. 2024-09-12T02:33:31.310 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:33:31.310 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-12T02:33:31.311 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-12T02:33:31.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.462+0000 7f63ef4ba640 1 Processor -- start 2024-09-12T02:33:31.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.463+0000 7f63ef4ba640 1 -- start start 2024-09-12T02:33:31.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.464+0000 7f63ef4ba640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f63e8156f50 0x7f63e8161ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:31.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.464+0000 7f63ef4ba640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63e806dd50 con 0x7f63e80733d0 2024-09-12T02:33:31.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.464+0000 7f63ef4ba640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63e806e030 con 0x7f63e8073ae0 2024-09-12T02:33:31.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.464+0000 7f63ef4ba640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f63e806e310 con 0x7f63e8156f50 2024-09-12T02:33:31.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.464+0000 7f63eca55640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f63e80733d0 0x7f63e8156840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:39186/0 (socket says 172.21.15.60:39186) 2024-09-12T02:33:31.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.464+0000 7f63ed256640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f63e8073ae0 0x7f63e8153380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:34000/0 (socket says 172.21.15.60:34000) 2024-09-12T02:33:31.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.464+0000 7f63eca55640 1 -- 172.21.15.60:0/2569727413 learned_addr learned my addr 172.21.15.60:0/2569727413 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:33:31.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.464+0000 7f63eda57640 1 --2- 172.21.15.60:0/2569727413 >> v2:172.21.15.105:3300/0 conn(0x7f63e8156f50 0x7f63e8161ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:31.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.464+0000 7f63dffff640 1 -- 172.21.15.60:0/2569727413 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 687589993 0 0) 0x7f63e806dd50 con 0x7f63e80733d0 2024-09-12T02:33:31.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.464+0000 7f63dffff640 1 -- 172.21.15.60:0/2569727413 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63d4003520 con 0x7f63e80733d0 2024-09-12T02:33:31.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.464+0000 7f63eda57640 1 -- 172.21.15.60:0/2569727413 >> v1:172.21.15.105:6789/0 conn(0x7f63e8073ae0 legacy=0x7f63e8153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:31.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.464+0000 7f63eda57640 1 -- 172.21.15.60:0/2569727413 >> v1:172.21.15.60:6789/0 conn(0x7f63e80733d0 legacy=0x7f63e8156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:31.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.464+0000 7f63eda57640 1 -- 172.21.15.60:0/2569727413 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63e806e5f0 con 0x7f63e8156f50 2024-09-12T02:33:31.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.466+0000 7f63eda57640 1 --2- 172.21.15.60:0/2569727413 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63e8156f50 0x7f63e8161ba0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f63e0009d90 tx=0x7f63e002a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef3c770f186adede server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:31.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.466+0000 7f63dffff640 1 -- 172.21.15.60:0/2569727413 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e0007740 con 0x7f63e8156f50 2024-09-12T02:33:31.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.466+0000 7f63dffff640 1 -- 172.21.15.60:0/2569727413 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63e00078e0 con 0x7f63e8156f50 2024-09-12T02:33:31.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.466+0000 7f63dffff640 1 -- 172.21.15.60:0/2569727413 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e0007c90 con 0x7f63e8156f50 2024-09-12T02:33:31.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.467+0000 7f63ef4ba640 1 -- 172.21.15.60:0/2569727413 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63e8156f50 msgr2=0x7f63e8161ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:31.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.467+0000 7f63ef4ba640 1 --2- 172.21.15.60:0/2569727413 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63e8156f50 0x7f63e8161ba0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f63e0009d90 tx=0x7f63e002a6f0 comp rx=0 tx=0).stop 2024-09-12T02:33:31.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.468+0000 7f63ef4ba640 1 -- 172.21.15.60:0/2569727413 shutdown_connections 2024-09-12T02:33:31.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.468+0000 7f63ef4ba640 1 --2- 172.21.15.60:0/2569727413 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63e8156f50 0x7f63e8161ba0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:31.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.468+0000 7f63ef4ba640 1 -- 172.21.15.60:0/2569727413 >> 172.21.15.60:0/2569727413 conn(0x7f63e80c9d80 msgr2=0x7f63e80ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:31.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.468+0000 7f63ef4ba640 1 -- 172.21.15.60:0/2569727413 shutdown_connections 2024-09-12T02:33:31.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.468+0000 7f63ef4ba640 1 -- 172.21.15.60:0/2569727413 wait complete. 2024-09-12T02:33:31.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.470+0000 7f63ef4ba640 1 Processor -- start 2024-09-12T02:33:31.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.470+0000 7f63ef4ba640 1 -- start start 2024-09-12T02:33:31.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.471+0000 7f63ef4ba640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f63e80733d0 0x7f63e8147b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:31.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.471+0000 7f63ef4ba640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63e8073ae0 0x7f63e8150350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:31.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.471+0000 7f63ef4ba640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63e8156f50 0x7f63e8155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:31.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.471+0000 7f63ef4ba640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f63e806edd0 con 0x7f63e8156f50 2024-09-12T02:33:31.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.471+0000 7f63ef4ba640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f63e806ec50 con 0x7f63e8073ae0 2024-09-12T02:33:31.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.471+0000 7f63ef4ba640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f63e8153a90 con 0x7f63e80733d0 2024-09-12T02:33:31.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.472+0000 7f63eda57640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63e8156f50 0x7f63e8155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:31.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.472+0000 7f63eda57640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63e8156f50 0x7f63e8155710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39940/0 (socket says 172.21.15.60:39940) 2024-09-12T02:33:31.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.472+0000 7f63eda57640 1 -- 172.21.15.60:0/2882059581 learned_addr learned my addr 172.21.15.60:0/2882059581 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:33:31.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.472+0000 7f63eca55640 1 --2- 172.21.15.60:0/2882059581 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63e8073ae0 0x7f63e8150350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:31.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.472+0000 7f63ed256640 1 --2- 172.21.15.60:0/2882059581 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f63e80733d0 0x7f63e8147b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:31.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.472+0000 7f63eda57640 1 -- 172.21.15.60:0/2882059581 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f63e80733d0 msgr2=0x7f63e8147b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:31.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.472+0000 7f63eda57640 1 --2- 172.21.15.60:0/2882059581 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f63e80733d0 0x7f63e8147b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:31.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.472+0000 7f63eda57640 1 -- 172.21.15.60:0/2882059581 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63e8073ae0 msgr2=0x7f63e8150350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:31.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.472+0000 7f63eda57640 1 --2- 172.21.15.60:0/2882059581 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63e8073ae0 0x7f63e8150350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:31.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.472+0000 7f63eda57640 1 -- 172.21.15.60:0/2882059581 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63e8150890 con 0x7f63e8156f50 2024-09-12T02:33:31.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.473+0000 7f63eda57640 1 --2- 172.21.15.60:0/2882059581 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63e8156f50 0x7f63e8155710 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f63e0009d90 tx=0x7f63e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:31.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.473+0000 7f63ddffb640 1 -- 172.21.15.60:0/2882059581 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e0009450 con 0x7f63e8156f50 2024-09-12T02:33:31.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.473+0000 7f63ddffb640 1 -- 172.21.15.60:0/2882059581 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63e0004450 con 0x7f63e8156f50 2024-09-12T02:33:31.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.473+0000 7f63ef4ba640 1 -- 172.21.15.60:0/2882059581 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63e81481a0 con 0x7f63e8156f50 2024-09-12T02:33:31.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.473+0000 7f63ddffb640 1 -- 172.21.15.60:0/2882059581 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e0004820 con 0x7f63e8156f50 2024-09-12T02:33:31.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.473+0000 7f63ef4ba640 1 -- 172.21.15.60:0/2882059581 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63e8146c00 con 0x7f63e8156f50 2024-09-12T02:33:31.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.474+0000 7f63ef4ba640 1 -- 172.21.15.60:0/2882059581 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63e80c5370 con 0x7f63e8156f50 2024-09-12T02:33:31.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.475+0000 7f63ddffb640 1 -- 172.21.15.60:0/2882059581 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f63e0039040 con 0x7f63e8156f50 2024-09-12T02:33:31.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.476+0000 7f63ddffb640 1 --2- 172.21.15.60:0/2882059581 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f63cc06be30 0x7f63cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:31.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.476+0000 7f63ddffb640 1 -- 172.21.15.60:0/2882059581 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f63e00ac160 con 0x7f63e8156f50 2024-09-12T02:33:31.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.476+0000 7f63ed256640 1 --2- 172.21.15.60:0/2882059581 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f63cc06be30 0x7f63cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:31.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.476+0000 7f63ed256640 1 --2- 172.21.15.60:0/2882059581 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f63cc06be30 0x7f63cc06e2f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f63e4000f60 tx=0x7f63e4000ed0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:31.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.484+0000 7f63ddffb640 1 -- 172.21.15.60:0/2882059581 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f63e0040030 con 0x7f63e8156f50 2024-09-12T02:33:31.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.900+0000 7f63ef4ba640 1 -- 172.21.15.60:0/2882059581 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f63e80c4c40 con 0x7f63e8156f50 2024-09-12T02:33:31.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.901+0000 7f63ddffb640 1 -- 172.21.15.60:0/2882059581 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f63e007a120 con 0x7f63e8156f50 2024-09-12T02:33:31.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.904+0000 7f63ef4ba640 1 -- 172.21.15.60:0/2882059581 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f63cc06be30 msgr2=0x7f63cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:31.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.904+0000 7f63ef4ba640 1 --2- 172.21.15.60:0/2882059581 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f63cc06be30 0x7f63cc06e2f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f63e4000f60 tx=0x7f63e4000ed0 comp rx=0 tx=0).stop 2024-09-12T02:33:31.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.904+0000 7f63ef4ba640 1 -- 172.21.15.60:0/2882059581 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63e8156f50 msgr2=0x7f63e8155710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:31.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.904+0000 7f63ef4ba640 1 --2- 172.21.15.60:0/2882059581 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63e8156f50 0x7f63e8155710 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f63e0009d90 tx=0x7f63e0004a40 comp rx=0 tx=0).stop 2024-09-12T02:33:31.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.904+0000 7f63ef4ba640 1 -- 172.21.15.60:0/2882059581 shutdown_connections 2024-09-12T02:33:31.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.904+0000 7f63ef4ba640 1 --2- 172.21.15.60:0/2882059581 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f63cc06be30 0x7f63cc06e2f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:31.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.904+0000 7f63ef4ba640 1 --2- 172.21.15.60:0/2882059581 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63e8156f50 0x7f63e8155710 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:31.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.904+0000 7f63ef4ba640 1 --2- 172.21.15.60:0/2882059581 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63e8073ae0 0x7f63e8150350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:31.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.904+0000 7f63ef4ba640 1 --2- 172.21.15.60:0/2882059581 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f63e80733d0 0x7f63e8147b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:31.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.904+0000 7f63ef4ba640 1 -- 172.21.15.60:0/2882059581 >> 172.21.15.60:0/2882059581 conn(0x7f63e80c9d80 msgr2=0x7f63e80ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:31.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.905+0000 7f63ef4ba640 1 -- 172.21.15.60:0/2882059581 shutdown_connections 2024-09-12T02:33:31.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:31.905+0000 7f63ef4ba640 1 -- 172.21.15.60:0/2882059581 wait complete. 2024-09-12T02:33:31.922 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-12T02:33:41.923 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-12T02:33:41.924 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:33:42.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.077+0000 7f47d9d2c640 1 Processor -- start 2024-09-12T02:33:42.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.077+0000 7f47d9d2c640 1 -- start start 2024-09-12T02:33:42.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.078+0000 7f47d9d2c640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f47d40c8b10 0x7f47d415a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:42.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.078+0000 7f47d9d2c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47d4153be0 0x7f47d4156660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:42.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.079+0000 7f47d9d2c640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47d40c7070 con 0x7f47d406cd80 2024-09-12T02:33:42.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.079+0000 7f47d9d2c640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f47d406d210 con 0x7f47d40c8b10 2024-09-12T02:33:42.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.079+0000 7f47d9d2c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f47d40c69b0 con 0x7f47d4153be0 2024-09-12T02:33:42.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.079+0000 7f47d2ffd640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f47d406cd80 0x7f47d41534d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47176/0 (socket says 172.21.15.60:47176) 2024-09-12T02:33:42.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.079+0000 7f47d2ffd640 1 -- 172.21.15.60:0/2978672594 learned_addr learned my addr 172.21.15.60:0/2978672594 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:33:42.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.079+0000 7f47d3fff640 1 --2- 172.21.15.60:0/2978672594 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47d4153be0 0x7f47d4156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:42.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.079+0000 7f47d37fe640 1 --2- 172.21.15.60:0/2978672594 >> v2:172.21.15.105:3300/0 conn(0x7f47d40c8b10 0x7f47d415a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:42.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.079+0000 7f47d27fc640 1 -- 172.21.15.60:0/2978672594 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1056983562 0 0) 0x7f47d40c7070 con 0x7f47d406cd80 2024-09-12T02:33:42.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.079+0000 7f47d27fc640 1 -- 172.21.15.60:0/2978672594 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47bc003520 con 0x7f47d406cd80 2024-09-12T02:33:42.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.079+0000 7f47d3fff640 1 -- 172.21.15.60:0/2978672594 >> v2:172.21.15.105:3300/0 conn(0x7f47d40c8b10 msgr2=0x7f47d415a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:42.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.079+0000 7f47d3fff640 1 --2- 172.21.15.60:0/2978672594 >> v2:172.21.15.105:3300/0 conn(0x7f47d40c8b10 0x7f47d415a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:42.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.079+0000 7f47d3fff640 1 -- 172.21.15.60:0/2978672594 >> v1:172.21.15.60:6789/0 conn(0x7f47d406cd80 legacy=0x7f47d41534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:42.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.079+0000 7f47d3fff640 1 -- 172.21.15.60:0/2978672594 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d40c6c90 con 0x7f47d4153be0 2024-09-12T02:33:42.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.081+0000 7f47d3fff640 1 --2- 172.21.15.60:0/2978672594 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47d4153be0 0x7f47d4156660 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f47c40097a0 tx=0x7f47c402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5d8b1da13a95272 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:42.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.081+0000 7f47d27fc640 1 -- 172.21.15.60:0/2978672594 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c4037070 con 0x7f47d4153be0 2024-09-12T02:33:42.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.081+0000 7f47d27fc640 1 -- 172.21.15.60:0/2978672594 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47c402ae50 con 0x7f47d4153be0 2024-09-12T02:33:42.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.081+0000 7f47d27fc640 1 -- 172.21.15.60:0/2978672594 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c4032640 con 0x7f47d4153be0 2024-09-12T02:33:42.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.082+0000 7f47d9d2c640 1 -- 172.21.15.60:0/2978672594 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47d4153be0 msgr2=0x7f47d4156660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:42.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.082+0000 7f47d9d2c640 1 --2- 172.21.15.60:0/2978672594 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47d4153be0 0x7f47d4156660 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f47c40097a0 tx=0x7f47c402a100 comp rx=0 tx=0).stop 2024-09-12T02:33:42.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.082+0000 7f47d9d2c640 1 -- 172.21.15.60:0/2978672594 shutdown_connections 2024-09-12T02:33:42.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.082+0000 7f47d9d2c640 1 --2- 172.21.15.60:0/2978672594 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47d4153be0 0x7f47d4156660 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:42.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.082+0000 7f47d9d2c640 1 --2- 172.21.15.60:0/2978672594 >> v2:172.21.15.105:3300/0 conn(0x7f47d40c8b10 0x7f47d415a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:42.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.082+0000 7f47d9d2c640 1 -- 172.21.15.60:0/2978672594 >> 172.21.15.60:0/2978672594 conn(0x7f47d40adb80 msgr2=0x7f47d40adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:42.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.082+0000 7f47d9d2c640 1 -- 172.21.15.60:0/2978672594 shutdown_connections 2024-09-12T02:33:42.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.082+0000 7f47d9d2c640 1 -- 172.21.15.60:0/2978672594 wait complete. 2024-09-12T02:33:42.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.084+0000 7f47d9d2c640 1 Processor -- start 2024-09-12T02:33:42.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.084+0000 7f47d9d2c640 1 -- start start 2024-09-12T02:33:42.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.085+0000 7f47d9d2c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47d40c8b10 0x7f47d41eb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:42.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.085+0000 7f47d9d2c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47d4153be0 0x7f47d4149570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:42.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.085+0000 7f47d9d2c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47d40b1780 0x7f47d4149ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:42.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.086+0000 7f47d37fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47d40c8b10 0x7f47d41eb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:42.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.086+0000 7f47d37fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47d40c8b10 0x7f47d41eb960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:36310/0 (socket says 172.21.15.60:36310) 2024-09-12T02:33:42.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.086+0000 7f47d2ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47d4153be0 0x7f47d4149570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:42.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.086+0000 7f47d2ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47d4153be0 0x7f47d4149570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50158/0 (socket says 172.21.15.60:50158) 2024-09-12T02:33:42.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.086+0000 7f47d2ffd640 1 -- 172.21.15.60:0/1747296079 learned_addr learned my addr 172.21.15.60:0/1747296079 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:33:42.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.086+0000 7f47d9d2c640 1 -- 172.21.15.60:0/1747296079 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f47d40c9070 con 0x7f47d4153be0 2024-09-12T02:33:42.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.086+0000 7f47d9d2c640 1 -- 172.21.15.60:0/1747296079 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f47d40c8ef0 con 0x7f47d40b1780 2024-09-12T02:33:42.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.086+0000 7f47d9d2c640 1 -- 172.21.15.60:0/1747296079 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f47d4156ba0 con 0x7f47d40c8b10 2024-09-12T02:33:42.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.086+0000 7f47d3fff640 1 --2- 172.21.15.60:0/1747296079 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47d40b1780 0x7f47d4149ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:42.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.086+0000 7f47d2ffd640 1 -- 172.21.15.60:0/1747296079 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47d40c8b10 msgr2=0x7f47d41eb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:42.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.086+0000 7f47d2ffd640 1 --2- 172.21.15.60:0/1747296079 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47d40c8b10 0x7f47d41eb960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:42.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.086+0000 7f47d2ffd640 1 -- 172.21.15.60:0/1747296079 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47d40b1780 msgr2=0x7f47d4149ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:42.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.086+0000 7f47d2ffd640 1 --2- 172.21.15.60:0/1747296079 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47d40b1780 0x7f47d4149ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:42.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.086+0000 7f47d2ffd640 1 -- 172.21.15.60:0/1747296079 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d414fb60 con 0x7f47d4153be0 2024-09-12T02:33:42.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.086+0000 7f47d3fff640 1 --2- 172.21.15.60:0/1747296079 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47d40b1780 0x7f47d4149ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:33:42.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.087+0000 7f47d2ffd640 1 --2- 172.21.15.60:0/1747296079 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47d4153be0 0x7f47d4149570 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f47c800c710 tx=0x7f47c800cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:42.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.087+0000 7f47bbfff640 1 -- 172.21.15.60:0/1747296079 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c8017070 con 0x7f47d4153be0 2024-09-12T02:33:42.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.087+0000 7f47bbfff640 1 -- 172.21.15.60:0/1747296079 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47c8005ad0 con 0x7f47d4153be0 2024-09-12T02:33:42.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.087+0000 7f47d9d2c640 1 -- 172.21.15.60:0/1747296079 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47d4150430 con 0x7f47d4153be0 2024-09-12T02:33:42.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.087+0000 7f47d9d2c640 1 -- 172.21.15.60:0/1747296079 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47d41ec310 con 0x7f47d4153be0 2024-09-12T02:33:42.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.087+0000 7f47bbfff640 1 -- 172.21.15.60:0/1747296079 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c800ce20 con 0x7f47d4153be0 2024-09-12T02:33:42.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.090+0000 7f47d9d2c640 1 -- 172.21.15.60:0/1747296079 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47d4157030 con 0x7f47d4153be0 2024-09-12T02:33:42.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.090+0000 7f47bbfff640 1 -- 172.21.15.60:0/1747296079 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f47c801a070 con 0x7f47d4153be0 2024-09-12T02:33:42.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.091+0000 7f47bbfff640 1 --2- 172.21.15.60:0/1747296079 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f47c006be30 0x7f47c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:42.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.091+0000 7f47d37fe640 1 --2- 172.21.15.60:0/1747296079 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f47c006be30 0x7f47c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:42.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.092+0000 7f47bbfff640 1 -- 172.21.15.60:0/1747296079 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f47c808a680 con 0x7f47d4153be0 2024-09-12T02:33:42.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.092+0000 7f47d37fe640 1 --2- 172.21.15.60:0/1747296079 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f47c006be30 0x7f47c006e2f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f47cc0074a0 tx=0x7f47cc00b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:42.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.098+0000 7f47bbfff640 1 -- 172.21.15.60:0/1747296079 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f47c8058660 con 0x7f47d4153be0 2024-09-12T02:33:42.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.524+0000 7f47d9d2c640 1 -- 172.21.15.60:0/1747296079 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f47d40c9d90 con 0x7f47d4153be0 2024-09-12T02:33:42.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.525+0000 7f47bbfff640 1 -- 172.21.15.60:0/1747296079 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1566 (secure 0 0 0) 0x7f47c805c960 con 0x7f47d4153be0 2024-09-12T02:33:42.526 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":104,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:33:42.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.528+0000 7f47d9d2c640 1 -- 172.21.15.60:0/1747296079 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f47c006be30 msgr2=0x7f47c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:42.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.528+0000 7f47d9d2c640 1 --2- 172.21.15.60:0/1747296079 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f47c006be30 0x7f47c006e2f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f47cc0074a0 tx=0x7f47cc00b040 comp rx=0 tx=0).stop 2024-09-12T02:33:42.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.528+0000 7f47d9d2c640 1 -- 172.21.15.60:0/1747296079 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47d4153be0 msgr2=0x7f47d4149570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:42.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.528+0000 7f47d9d2c640 1 --2- 172.21.15.60:0/1747296079 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47d4153be0 0x7f47d4149570 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f47c800c710 tx=0x7f47c800cbd0 comp rx=0 tx=0).stop 2024-09-12T02:33:42.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.528+0000 7f47d9d2c640 1 -- 172.21.15.60:0/1747296079 shutdown_connections 2024-09-12T02:33:42.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.528+0000 7f47d9d2c640 1 --2- 172.21.15.60:0/1747296079 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f47c006be30 0x7f47c006e2f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:42.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.528+0000 7f47d9d2c640 1 --2- 172.21.15.60:0/1747296079 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47d40b1780 0x7f47d4149ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:42.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.528+0000 7f47d9d2c640 1 --2- 172.21.15.60:0/1747296079 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47d4153be0 0x7f47d4149570 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:42.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.528+0000 7f47d9d2c640 1 --2- 172.21.15.60:0/1747296079 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47d40c8b10 0x7f47d41eb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:42.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.528+0000 7f47d9d2c640 1 -- 172.21.15.60:0/1747296079 >> 172.21.15.60:0/1747296079 conn(0x7f47d40adb80 msgr2=0x7f47d4154ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:42.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.528+0000 7f47d9d2c640 1 -- 172.21.15.60:0/1747296079 shutdown_connections 2024-09-12T02:33:42.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.528+0000 7f47d9d2c640 1 -- 172.21.15.60:0/1747296079 wait complete. 2024-09-12T02:33:42.544 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-12T02:33:42.544 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-12T02:33:42.545 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-12T02:33:42.545 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-12T02:33:42.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.701+0000 7f3123b86640 1 Processor -- start 2024-09-12T02:33:42.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.702+0000 7f3123b86640 1 -- start start 2024-09-12T02:33:42.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.703+0000 7f3123b86640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f311c153ce0 0x7f311c0c57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:42.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.703+0000 7f3123b86640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f311c0c8290 con 0x7f311c0bda70 2024-09-12T02:33:42.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.703+0000 7f3123b86640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f311c0c8570 con 0x7f311c150aa0 2024-09-12T02:33:42.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.703+0000 7f3123b86640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f311c074100 con 0x7f311c153ce0 2024-09-12T02:33:42.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.703+0000 7f3121121640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f311c0bda70 0x7f311c0c5090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47186/0 (socket says 172.21.15.60:47186) 2024-09-12T02:33:42.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.703+0000 7f3121121640 1 -- 172.21.15.60:0/3362448902 learned_addr learned my addr 172.21.15.60:0/3362448902 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:33:42.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.703+0000 7f3122123640 1 --2- 172.21.15.60:0/3362448902 >> v2:172.21.15.105:3300/0 conn(0x7f311c153ce0 0x7f311c0c57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:42.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.704+0000 7f3120920640 1 -- 172.21.15.60:0/3362448902 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 556727203 0 0) 0x7f311c0c8290 con 0x7f311c0bda70 2024-09-12T02:33:42.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.704+0000 7f3120920640 1 -- 172.21.15.60:0/3362448902 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3104003520 con 0x7f311c0bda70 2024-09-12T02:33:42.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.704+0000 7f3122123640 1 -- 172.21.15.60:0/3362448902 >> v1:172.21.15.105:6789/0 conn(0x7f311c150aa0 legacy=0x7f311c0bf3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:42.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.704+0000 7f3122123640 1 -- 172.21.15.60:0/3362448902 >> v1:172.21.15.60:6789/0 conn(0x7f311c0bda70 legacy=0x7f311c0c5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:42.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.704+0000 7f3122123640 1 -- 172.21.15.60:0/3362448902 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f311c074350 con 0x7f311c153ce0 2024-09-12T02:33:42.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.705+0000 7f3122123640 1 --2- 172.21.15.60:0/3362448902 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f311c153ce0 0x7f311c0c57a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f311c074280 tx=0x7f311402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c3adc6967cf6a42 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:42.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.705+0000 7f3120920640 1 -- 172.21.15.60:0/3362448902 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3114007740 con 0x7f311c153ce0 2024-09-12T02:33:42.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.705+0000 7f3120920640 1 -- 172.21.15.60:0/3362448902 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31140078e0 con 0x7f311c153ce0 2024-09-12T02:33:42.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.705+0000 7f3120920640 1 -- 172.21.15.60:0/3362448902 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3114007c90 con 0x7f311c153ce0 2024-09-12T02:33:42.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.706+0000 7f3123b86640 1 -- 172.21.15.60:0/3362448902 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f311c153ce0 msgr2=0x7f311c0c57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:42.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.706+0000 7f3123b86640 1 --2- 172.21.15.60:0/3362448902 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f311c153ce0 0x7f311c0c57a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f311c074280 tx=0x7f311402a660 comp rx=0 tx=0).stop 2024-09-12T02:33:42.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.706+0000 7f3123b86640 1 -- 172.21.15.60:0/3362448902 shutdown_connections 2024-09-12T02:33:42.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.706+0000 7f3123b86640 1 --2- 172.21.15.60:0/3362448902 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f311c153ce0 0x7f311c0c57a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:42.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.706+0000 7f3123b86640 1 -- 172.21.15.60:0/3362448902 >> 172.21.15.60:0/3362448902 conn(0x7f311c0c8a50 msgr2=0x7f311c0c8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:42.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.707+0000 7f3123b86640 1 -- 172.21.15.60:0/3362448902 shutdown_connections 2024-09-12T02:33:42.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.707+0000 7f3123b86640 1 -- 172.21.15.60:0/3362448902 wait complete. 2024-09-12T02:33:42.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.708+0000 7f3123b86640 1 Processor -- start 2024-09-12T02:33:42.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.708+0000 7f3123b86640 1 -- start start 2024-09-12T02:33:42.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.709+0000 7f3123b86640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f311c0bda70 0x7f311c151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:42.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.710+0000 7f3123b86640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f311c150aa0 0x7f311c0a72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:42.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.710+0000 7f3123b86640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f311c153ce0 0x7f311c0a7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:42.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.710+0000 7f3123b86640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f311c0c5ce0 con 0x7f311c153ce0 2024-09-12T02:33:42.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.710+0000 7f3123b86640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f311c150e80 con 0x7f311c0bda70 2024-09-12T02:33:42.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.710+0000 7f3121922640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f311c0bda70 0x7f311c151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:42.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.710+0000 7f3121922640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f311c0bda70 0x7f311c151850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:58336/0 (socket says 172.21.15.60:58336) 2024-09-12T02:33:42.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.710+0000 7f3122123640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f311c153ce0 0x7f311c0a7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:42.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.710+0000 7f3121922640 1 -- 172.21.15.60:0/1869085057 learned_addr learned my addr 172.21.15.60:0/1869085057 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:33:42.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.710+0000 7f3121121640 1 --2- 172.21.15.60:0/1869085057 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f311c150aa0 0x7f311c0a72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:42.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.710+0000 7f3123b86640 1 -- 172.21.15.60:0/1869085057 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f311c1540f0 con 0x7f311c150aa0 2024-09-12T02:33:42.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.711+0000 7f3121922640 1 -- 172.21.15.60:0/1869085057 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f311c150aa0 msgr2=0x7f311c0a72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:42.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.711+0000 7f3121922640 1 --2- 172.21.15.60:0/1869085057 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f311c150aa0 0x7f311c0a72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:42.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.711+0000 7f3121922640 1 -- 172.21.15.60:0/1869085057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f311c153ce0 msgr2=0x7f311c0a7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:42.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.711+0000 7f3121922640 1 --2- 172.21.15.60:0/1869085057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f311c153ce0 0x7f311c0a7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:42.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.711+0000 7f3121922640 1 -- 172.21.15.60:0/1869085057 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f311c1df1c0 con 0x7f311c0bda70 2024-09-12T02:33:42.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.711+0000 7f3121922640 1 --2- 172.21.15.60:0/1869085057 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f311c0bda70 0x7f311c151850 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f311000c480 tx=0x7f311000c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:42.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.712+0000 7f311a7fc640 1 -- 172.21.15.60:0/1869085057 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31100052d0 con 0x7f311c0bda70 2024-09-12T02:33:42.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.712+0000 7f3123b86640 1 -- 172.21.15.60:0/1869085057 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f311c1dd900 con 0x7f311c0bda70 2024-09-12T02:33:42.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.712+0000 7f311a7fc640 1 -- 172.21.15.60:0/1869085057 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3110005470 con 0x7f311c0bda70 2024-09-12T02:33:42.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.712+0000 7f3123b86640 1 -- 172.21.15.60:0/1869085057 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f311c1df460 con 0x7f311c0bda70 2024-09-12T02:33:42.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.712+0000 7f311a7fc640 1 -- 172.21.15.60:0/1869085057 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3110012830 con 0x7f311c0bda70 2024-09-12T02:33:42.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.713+0000 7f3123b86640 1 --2- 172.21.15.60:0/1869085057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30fc002a70 0x7f30fc004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:42.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.713+0000 7f3123b86640 1 -- 172.21.15.60:0/1869085057 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f30fc007ec0 con 0x7f30fc002a70 2024-09-12T02:33:42.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.714+0000 7f3121121640 1 --2- 172.21.15.60:0/1869085057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30fc002a70 0x7f30fc004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:42.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.714+0000 7f311a7fc640 1 -- 172.21.15.60:0/1869085057 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f31100129d0 con 0x7f311c0bda70 2024-09-12T02:33:42.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.714+0000 7f3121121640 1 -- 172.21.15.60:0/1869085057 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f30fc0080c0 con 0x7f30fc002a70 2024-09-12T02:33:42.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.714+0000 7f311a7fc640 1 --2- 172.21.15.60:0/1869085057 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f310806be30 0x7f310806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:42.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.715+0000 7f311a7fc640 1 -- 172.21.15.60:0/1869085057 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f311008ad60 con 0x7f311c0bda70 2024-09-12T02:33:42.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.715+0000 7f3121121640 1 --2- 172.21.15.60:0/1869085057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30fc002a70 0x7f30fc004f30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f311c0ade80 tx=0x7f310c0019a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:42.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.715+0000 7f3122123640 1 --2- 172.21.15.60:0/1869085057 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f310806be30 0x7f310806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:42.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.715+0000 7f311a7fc640 1 -- 172.21.15.60:0/1869085057 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310c017020 con 0x7f30fc002a70 2024-09-12T02:33:42.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.715+0000 7f311a7fc640 1 -- 172.21.15.60:0/1869085057 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f310c00f540 con 0x7f30fc002a70 2024-09-12T02:33:42.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.715+0000 7f3122123640 1 --2- 172.21.15.60:0/1869085057 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f310806be30 0x7f310806e2f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3114034000 tx=0x7f311402f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:42.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.715+0000 7f311a7fc640 1 -- 172.21.15.60:0/1869085057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30fc002a70 msgr2=0x7f30fc004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:42.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.715+0000 7f311a7fc640 1 --2- 172.21.15.60:0/1869085057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30fc002a70 0x7f30fc004f30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f311c0ade80 tx=0x7f310c0019a0 comp rx=0 tx=0).stop 2024-09-12T02:33:42.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.715+0000 7f311a7fc640 1 -- 172.21.15.60:0/1869085057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30fc002a70 msgr2=0x7f30fc004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:33:42.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.715+0000 7f311a7fc640 1 --2- 172.21.15.60:0/1869085057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30fc002a70 0x7f30fc004f30 secure :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f311c0ade80 tx=0x7f310c0019a0 comp rx=0 tx=0).stop 2024-09-12T02:33:42.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.726+0000 7f3123b86640 1 --2- 172.21.15.60:0/1869085057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30fc006eb0 0x7f30fc007340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:42.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.726+0000 7f3123b86640 1 -- 172.21.15.60:0/1869085057 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f30fc00a4a0 con 0x7f30fc006eb0 2024-09-12T02:33:42.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.726+0000 7f3121121640 1 --2- 172.21.15.60:0/1869085057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30fc006eb0 0x7f30fc007340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:42.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.726+0000 7f3121121640 1 -- 172.21.15.60:0/1869085057 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f30fc007880 con 0x7f30fc006eb0 2024-09-12T02:33:42.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.726+0000 7f3121121640 1 --2- 172.21.15.60:0/1869085057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30fc006eb0 0x7f30fc007340 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f311c06f500 tx=0x7f310c001150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:42.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.727+0000 7f311a7fc640 1 -- 172.21.15.60:0/1869085057 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310c017050 con 0x7f30fc006eb0 2024-09-12T02:33:42.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.727+0000 7f311a7fc640 1 -- 172.21.15.60:0/1869085057 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4719 (secure 0 0 0) 0x7f310c006450 con 0x7f30fc006eb0 2024-09-12T02:33:42.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.727+0000 7f311a7fc640 1 -- 172.21.15.60:0/1869085057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30fc006eb0 msgr2=0x7f30fc007340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:42.728 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:33:42.728 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:33:42.728 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:33:42.728 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:33:42.728 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 104, 2024-09-12T02:33:42.729 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 39733, 2024-09-12T02:33:42.729 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:33:42.729 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:33:42.729 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:33:42.729 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:33:42.729 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:33:42.729 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 14, 2024-09-12T02:33:42.729 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:33:42.729 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:33:42.729 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:33:42.729 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:33:42.729 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:33:42.729 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:33:42.730 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:33:42.730 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:33:42.730 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:33:42.730 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:33:42.730 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:33:42.730 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:33:42.730 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:33:42.730 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:33:42.730 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:33:42.730 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:33:42.730 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:33:42.730 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:33:42.731 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:33:42.731 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:33:42.731 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:33:42.731 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:33:42.731 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:33:42.731 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:33:42.731 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:33:42.731 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:33:42.731 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:33:42.731 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:33:42.731 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:42.731 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:42.731 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:33:42.732 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:33:42.732 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:33:42.732 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:33:42.732 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:33:42.732 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:33:42.732 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:33:42.732 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:33:42.732 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:33:42.732 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:33:42.732 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:33:42.732 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:33:42.732 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:33:42.733 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:33:42.733 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:33:42.733 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:33:42.733 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:33:42.733 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:33:42.733 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:33:42.733 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:33:42.733 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:33:42.733 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:33:42.733 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:33:42.733 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:33:42.733 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:33:42.733 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:33:42.733 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:33:42.734 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:33:42.734 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:33:42.734 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:33:42.734 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:42.734 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:33:42.734 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:42.734 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:33:42.734 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:33:42.734 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:33:42.734 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:33:42.734 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:42.734 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:33:42.734 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:33:42.735 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:42.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:42.735 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:42.735 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:33:42.735 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:33:42.735 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:42.735 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:42.735 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:42.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:42.735 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:33:42.735 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:33:42.735 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:33:42.735 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:33:42.735 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:33:42.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:42.736 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:42.736 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:33:42.736 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:33:42.736 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:33:42.736 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:33:42.736 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:42.736 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:33:42.736 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:33:42.736 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:42.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:42.736 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:42.736 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:33:42.737 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:33:42.737 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:42.737 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:42.737 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:42.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:42.737 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:33:42.737 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:33:42.737 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:33:42.737 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:33:42.737 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:33:42.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:42.737 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:42.737 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:33:42.737 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:33:42.738 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:33:42.738 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:33:42.738 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:42.738 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:33:42.738 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:33:42.738 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:42.738 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:42.738 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:42.738 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:33:42.738 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:33:42.739 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:42.739 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:42.739 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:42.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:42.739 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:33:42.739 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:33:42.739 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:33:42.739 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:33:42.739 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:33:42.739 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:42.739 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:42.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:42.739 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:33:42.739 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:33:42.740 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:42.740 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:33:42.740 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:33:42.740 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:33:42.740 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:42.740 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:33:42.740 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:33:42.740 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:42.740 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:33:42.740 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:33:42.740 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:33:42.740 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:42.740 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:33:42.741 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:33:42.741 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:42.741 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:33:42.741 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:33:42.741 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:33:42.741 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:42.741 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:42.741 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:42.741 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:33:42.741 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:33:42.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.727+0000 7f311a7fc640 1 --2- 172.21.15.60:0/1869085057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30fc006eb0 0x7f30fc007340 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f311c06f500 tx=0x7f310c001150 comp rx=0 tx=0).stop 2024-09-12T02:33:42.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.727+0000 7f311a7fc640 1 -- 172.21.15.60:0/1869085057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30fc006eb0 msgr2=0x7f30fc007340 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:33:42.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.727+0000 7f311a7fc640 1 --2- 172.21.15.60:0/1869085057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30fc006eb0 0x7f30fc007340 secure :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f311c06f500 tx=0x7f310c001150 comp rx=0 tx=0).stop 2024-09-12T02:33:42.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.728+0000 7f3123b86640 1 -- 172.21.15.60:0/1869085057 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f310806be30 msgr2=0x7f310806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:42.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.728+0000 7f3123b86640 1 --2- 172.21.15.60:0/1869085057 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f310806be30 0x7f310806e2f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3114034000 tx=0x7f311402f000 comp rx=0 tx=0).stop 2024-09-12T02:33:42.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.728+0000 7f3122123640 1 -- 172.21.15.60:0/1869085057 reap_dead start 2024-09-12T02:33:42.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.728+0000 7f3123b86640 1 -- 172.21.15.60:0/1869085057 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f311c0bda70 msgr2=0x7f311c151850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:42.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.728+0000 7f3123b86640 1 --2- 172.21.15.60:0/1869085057 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f311c0bda70 0x7f311c151850 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f311000c480 tx=0x7f311000c940 comp rx=0 tx=0).stop 2024-09-12T02:33:42.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.728+0000 7f3123b86640 1 -- 172.21.15.60:0/1869085057 shutdown_connections 2024-09-12T02:33:42.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.728+0000 7f3123b86640 1 --2- 172.21.15.60:0/1869085057 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f311c0bda70 0x7f311c151850 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:42.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.728+0000 7f3123b86640 1 -- 172.21.15.60:0/1869085057 >> 172.21.15.60:0/1869085057 conn(0x7f311c0c8a50 msgr2=0x7f311c0c6850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:42.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.728+0000 7f3123b86640 1 -- 172.21.15.60:0/1869085057 shutdown_connections 2024-09-12T02:33:42.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.728+0000 7f3123b86640 1 -- 172.21.15.60:0/1869085057 wait complete. 2024-09-12T02:33:42.744 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:33:42.745 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-12T02:33:42.745 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-12T02:33:42.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.905+0000 7fabe4d86640 1 Processor -- start 2024-09-12T02:33:42.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.905+0000 7fabe4d86640 1 -- start start 2024-09-12T02:33:42.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.906+0000 7fabe4d86640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fabe0157f90 0x7fabe00c4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:42.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.906+0000 7fabe4d86640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fabe00a5210 0x7fabe015a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:42.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.906+0000 7fabe4d86640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabe0158370 con 0x7fabe00c40b0 2024-09-12T02:33:42.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.906+0000 7fabe4d86640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fabe00c3b60 con 0x7fabe0157f90 2024-09-12T02:33:42.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.906+0000 7fabe4d86640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fabe00a5db0 con 0x7fabe00a5210 2024-09-12T02:33:42.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.906+0000 7fabddd9b640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fabe00a5210 0x7fabe015a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:42.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.906+0000 7fabde59c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fabe0157f90 0x7fabe00c4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:42.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.907+0000 7fabddd9b640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fabe00a5210 0x7fabe015a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:58338/0 (socket says 172.21.15.60:58338) 2024-09-12T02:33:42.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.907+0000 7fabde59c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fabe0157f90 0x7fabe00c4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50202/0 (socket says 172.21.15.60:50202) 2024-09-12T02:33:42.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.907+0000 7fabddd9b640 1 -- 172.21.15.60:0/2554425904 learned_addr learned my addr 172.21.15.60:0/2554425904 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:33:42.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.907+0000 7fabde59c640 1 -- 172.21.15.60:0/2554425904 >> v2:172.21.15.105:3300/0 conn(0x7fabe00a5210 msgr2=0x7fabe015a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:42.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.907+0000 7fabde59c640 1 --2- 172.21.15.60:0/2554425904 >> v2:172.21.15.105:3300/0 conn(0x7fabe00a5210 0x7fabe015a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:42.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.907+0000 7fabde59c640 1 -- 172.21.15.60:0/2554425904 >> v1:172.21.15.105:6789/0 conn(0x7fabe00c40b0 legacy=0x7fabe015dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:42.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.907+0000 7fabde59c640 1 -- 172.21.15.60:0/2554425904 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabe00c3db0 con 0x7fabe0157f90 2024-09-12T02:33:42.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.907+0000 7fabddd9b640 1 --2- 172.21.15.60:0/2554425904 >> v2:172.21.15.105:3300/0 conn(0x7fabe00a5210 0x7fabe015a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:33:42.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.908+0000 7fabde59c640 1 --2- 172.21.15.60:0/2554425904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fabe0157f90 0x7fabe00c4560 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fabe00c6010 tx=0x7fabd002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3b727218bfb2fe6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:42.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.908+0000 7fabdd59a640 1 -- 172.21.15.60:0/2554425904 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd0037070 con 0x7fabe0157f90 2024-09-12T02:33:42.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.909+0000 7fabdd59a640 1 -- 172.21.15.60:0/2554425904 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabd0032440 con 0x7fabe0157f90 2024-09-12T02:33:42.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.909+0000 7fabdd59a640 1 -- 172.21.15.60:0/2554425904 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd002ae60 con 0x7fabe0157f90 2024-09-12T02:33:42.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.909+0000 7fabe4d86640 1 -- 172.21.15.60:0/2554425904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fabe0157f90 msgr2=0x7fabe00c4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:42.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.909+0000 7fabe4d86640 1 --2- 172.21.15.60:0/2554425904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fabe0157f90 0x7fabe00c4560 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fabe00c6010 tx=0x7fabd002a110 comp rx=0 tx=0).stop 2024-09-12T02:33:42.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.910+0000 7fabe4d86640 1 -- 172.21.15.60:0/2554425904 shutdown_connections 2024-09-12T02:33:42.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.910+0000 7fabe4d86640 1 --2- 172.21.15.60:0/2554425904 >> v2:172.21.15.105:3300/0 conn(0x7fabe00a5210 0x7fabe015a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:42.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.910+0000 7fabe4d86640 1 --2- 172.21.15.60:0/2554425904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fabe0157f90 0x7fabe00c4560 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:42.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.910+0000 7fabe4d86640 1 -- 172.21.15.60:0/2554425904 >> 172.21.15.60:0/2554425904 conn(0x7fabe006c030 msgr2=0x7fabe006c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:42.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.910+0000 7fabe4d86640 1 -- 172.21.15.60:0/2554425904 shutdown_connections 2024-09-12T02:33:42.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.910+0000 7fabe4d86640 1 -- 172.21.15.60:0/2554425904 wait complete. 2024-09-12T02:33:42.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.911+0000 7fabe4d86640 1 Processor -- start 2024-09-12T02:33:42.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.912+0000 7fabe4d86640 1 -- start start 2024-09-12T02:33:42.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.913+0000 7fabe4d86640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fabe00c40b0 0x7fabe015ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:42.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.913+0000 7fabe4d86640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fabe0157f90 0x7fabe01e4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:42.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.913+0000 7fabe4d86640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fabe015e8b0 0x7fabe00acd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:42.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.913+0000 7fabe4d86640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fabe00c3580 con 0x7fabe0157f90 2024-09-12T02:33:42.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.913+0000 7fabe4d86640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fabe00a5a40 con 0x7fabe00c40b0 2024-09-12T02:33:42.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.913+0000 7fabe4d86640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fabe00c3700 con 0x7fabe015e8b0 2024-09-12T02:33:42.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.913+0000 7fabde59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fabe00c40b0 0x7fabe015ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:42.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.913+0000 7fabde59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fabe00c40b0 0x7fabe015ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:58344/0 (socket says 172.21.15.60:58344) 2024-09-12T02:33:42.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.913+0000 7fabde59c640 1 -- 172.21.15.60:0/1940467250 learned_addr learned my addr 172.21.15.60:0/1940467250 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:33:42.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.913+0000 7fabddd9b640 1 --2- 172.21.15.60:0/1940467250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fabe0157f90 0x7fabe01e4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:42.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.913+0000 7fabded9d640 1 --2- 172.21.15.60:0/1940467250 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fabe015e8b0 0x7fabe00acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:42.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.913+0000 7fabde59c640 1 -- 172.21.15.60:0/1940467250 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fabe015e8b0 msgr2=0x7fabe00acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:42.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.913+0000 7fabde59c640 1 --2- 172.21.15.60:0/1940467250 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fabe015e8b0 0x7fabe00acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:42.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.913+0000 7fabde59c640 1 -- 172.21.15.60:0/1940467250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fabe0157f90 msgr2=0x7fabe01e4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:42.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.913+0000 7fabde59c640 1 --2- 172.21.15.60:0/1940467250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fabe0157f90 0x7fabe01e4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:42.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.914+0000 7fabde59c640 1 -- 172.21.15.60:0/1940467250 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabe0151be0 con 0x7fabe00c40b0 2024-09-12T02:33:42.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.914+0000 7fabde59c640 1 --2- 172.21.15.60:0/1940467250 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fabe00c40b0 0x7fabe015ac80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fabd002a150 tx=0x7fabd00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:42.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.914+0000 7fabceffd640 1 -- 172.21.15.60:0/1940467250 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd0037040 con 0x7fabe00c40b0 2024-09-12T02:33:42.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.914+0000 7fabe4d86640 1 -- 172.21.15.60:0/1940467250 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabe01e5860 con 0x7fabe00c40b0 2024-09-12T02:33:42.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.914+0000 7fabceffd640 1 -- 172.21.15.60:0/1940467250 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabd00304c0 con 0x7fabe00c40b0 2024-09-12T02:33:42.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.914+0000 7fabe4d86640 1 -- 172.21.15.60:0/1940467250 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabe01e3c90 con 0x7fabe00c40b0 2024-09-12T02:33:42.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.914+0000 7fabceffd640 1 -- 172.21.15.60:0/1940467250 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd0030870 con 0x7fabe00c40b0 2024-09-12T02:33:42.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.915+0000 7fabe4d86640 1 --2- 172.21.15.60:0/1940467250 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fabe00a5210 0x7fabe01f36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:42.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.915+0000 7fabe4d86640 1 -- 172.21.15.60:0/1940467250 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fabe015b1c0 con 0x7fabe00a5210 2024-09-12T02:33:42.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.916+0000 7fabddd9b640 1 --2- 172.21.15.60:0/1940467250 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fabe00a5210 0x7fabe01f36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:42.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.916+0000 7fabddd9b640 1 -- 172.21.15.60:0/1940467250 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fabe006fa60 con 0x7fabe00a5210 2024-09-12T02:33:42.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.916+0000 7fabddd9b640 1 --2- 172.21.15.60:0/1940467250 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fabe00a5210 0x7fabe01f36e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fabe0074550 tx=0x7fabd4011cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:42.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.916+0000 7fabceffd640 1 -- 172.21.15.60:0/1940467250 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fabd0044020 con 0x7fabe00c40b0 2024-09-12T02:33:42.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.917+0000 7fabceffd640 1 --2- 172.21.15.60:0/1940467250 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fabc006be30 0x7fabc006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:42.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.917+0000 7fabceffd640 1 -- 172.21.15.60:0/1940467250 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fabd00ab3f0 con 0x7fabe00c40b0 2024-09-12T02:33:42.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.917+0000 7fabded9d640 1 --2- 172.21.15.60:0/1940467250 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fabc006be30 0x7fabc006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:42.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.917+0000 7fabceffd640 1 -- 172.21.15.60:0/1940467250 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd400fa70 con 0x7fabe00a5210 2024-09-12T02:33:42.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.917+0000 7fabceffd640 1 -- 172.21.15.60:0/1940467250 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fabd400fc10 con 0x7fabe00a5210 2024-09-12T02:33:42.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.917+0000 7fabceffd640 1 -- 172.21.15.60:0/1940467250 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fabe00a5210 msgr2=0x7fabe01f36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:42.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.917+0000 7fabceffd640 1 --2- 172.21.15.60:0/1940467250 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fabe00a5210 0x7fabe01f36e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fabe0074550 tx=0x7fabd4011cd0 comp rx=0 tx=0).stop 2024-09-12T02:33:42.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.917+0000 7fabceffd640 1 -- 172.21.15.60:0/1940467250 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fabe00a5210 msgr2=0x7fabe01f36e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:33:42.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.917+0000 7fabceffd640 1 --2- 172.21.15.60:0/1940467250 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fabe00a5210 0x7fabe01f36e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:42.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.918+0000 7fabded9d640 1 --2- 172.21.15.60:0/1940467250 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fabc006be30 0x7fabc006e2f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fabd80012e0 tx=0x7fabd8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:42.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.928+0000 7fabe4d86640 1 --2- 172.21.15.60:0/1940467250 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fabe01e68b0 0x7fabe01f3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:42.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.928+0000 7fabe4d86640 1 -- 172.21.15.60:0/1940467250 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fabe00a6240 con 0x7fabe01e68b0 2024-09-12T02:33:42.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.928+0000 7fabddd9b640 1 --2- 172.21.15.60:0/1940467250 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fabe01e68b0 0x7fabe01f3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:42.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.928+0000 7fabddd9b640 1 -- 172.21.15.60:0/1940467250 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fabe015b5d0 con 0x7fabe01e68b0 2024-09-12T02:33:42.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.929+0000 7fabddd9b640 1 --2- 172.21.15.60:0/1940467250 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fabe01e68b0 0x7fabe01f3c20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fabe00ada40 tx=0x7fabd40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:42.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.929+0000 7fabceffd640 1 -- 172.21.15.60:0/1940467250 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd40222e0 con 0x7fabe01e68b0 2024-09-12T02:33:42.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.929+0000 7fabceffd640 1 -- 172.21.15.60:0/1940467250 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5052 (secure 0 0 0) 0x7fabd402c420 con 0x7fabe01e68b0 2024-09-12T02:33:42.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.929+0000 7fabceffd640 1 -- 172.21.15.60:0/1940467250 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fabe01e68b0 msgr2=0x7fabe01f3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:42.930 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:33:42.930 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:33:42.930 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:33:42.930 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:33:42.931 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 104, 2024-09-12T02:33:42.931 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 568363, 2024-09-12T02:33:42.931 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:33:42.931 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:33:42.931 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:33:42.931 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:33:42.931 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:33:42.931 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 14, 2024-09-12T02:33:42.931 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:33:42.931 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:33:42.931 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:33:42.931 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:33:42.931 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:33:42.932 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:33:42.932 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:33:42.932 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:33:42.932 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:33:42.932 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:33:42.932 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:33:42.932 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:33:42.932 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:33:42.932 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:33:42.932 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:33:42.932 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:33:42.932 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:33:42.932 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:33:42.933 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:33:42.933 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:33:42.933 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:33:42.933 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:33:42.933 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:33:42.933 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:33:42.933 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:33:42.933 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:33:42.933 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:33:42.933 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:33:42.933 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:42.933 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:42.933 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:33:42.933 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:33:42.933 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:33:42.934 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:33:42.934 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:33:42.934 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:33:42.934 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:33:42.934 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:33:42.934 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:33:42.934 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:33:42.934 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:33:42.934 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:33:42.934 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:33:42.934 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:33:42.934 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:33:42.934 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:33:42.934 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:33:42.934 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:33:42.935 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:33:42.935 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:33:42.935 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:33:42.935 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:33:42.935 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:33:42.935 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:33:42.935 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:33:42.935 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:33:42.935 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:33:42.935 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:33:42.935 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:33:42.935 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:33:42.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:42.936 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:33:42.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:42.936 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:33:42.936 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:33:42.936 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:33:42.936 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:33:42.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:42.936 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:33:42.936 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:33:42.936 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:42.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:42.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:42.936 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:33:42.937 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:33:42.937 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:42.937 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:42.937 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:42.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:42.937 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:33:42.937 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:33:42.937 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:33:42.937 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:33:42.937 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:33:42.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:42.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:42.937 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:33:42.937 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:33:42.938 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:33:42.938 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:33:42.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:42.938 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:33:42.938 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:33:42.938 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:42.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:42.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:42.938 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:33:42.938 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:33:42.938 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:42.938 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:42.938 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:42.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:42.939 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:33:42.939 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:33:42.939 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:33:42.939 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:33:42.939 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:33:42.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:42.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:42.939 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:33:42.939 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:33:42.939 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:33:42.939 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:33:42.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:42.939 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:33:42.940 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:33:42.940 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:42.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:42.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:42.940 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:33:42.940 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:33:42.940 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:42.940 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:42.940 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:42.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:42.940 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:33:42.940 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:33:42.940 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:33:42.941 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:33:42.941 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:33:42.941 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:42.941 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:42.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:42.941 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:33:42.941 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:33:42.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:42.941 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:33:42.941 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:33:42.941 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:33:42.941 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:42.941 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:33:42.942 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:33:42.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:42.942 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:33:42.942 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:33:42.942 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:33:42.942 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:42.942 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:33:42.942 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:33:42.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:42.942 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:33:42.942 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:33:42.942 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-09-12T02:33:42.942 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:42.942 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:33:42.943 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:33:42.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:42.943 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:33:42.943 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:33:42.943 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 8 2024-09-12T02:33:42.943 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:42.943 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:33:42.943 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:33:42.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:42.943 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:33:42.943 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:33:42.943 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:33:42.943 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:42.944 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:42.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:42.944 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:33:42.944 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:33:42.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.929+0000 7fabceffd640 1 --2- 172.21.15.60:0/1940467250 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fabe01e68b0 0x7fabe01f3c20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fabe00ada40 tx=0x7fabd40046c0 comp rx=0 tx=0).stop 2024-09-12T02:33:42.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.929+0000 7fabceffd640 1 -- 172.21.15.60:0/1940467250 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fabe01e68b0 msgr2=0x7fabe01f3c20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:33:42.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.929+0000 7fabceffd640 1 --2- 172.21.15.60:0/1940467250 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fabe01e68b0 0x7fabe01f3c20 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:42.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.930+0000 7fabe4d86640 1 -- 172.21.15.60:0/1940467250 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fabc006be30 msgr2=0x7fabc006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:42.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.930+0000 7fabe4d86640 1 --2- 172.21.15.60:0/1940467250 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fabc006be30 0x7fabc006e2f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fabd80012e0 tx=0x7fabd8009040 comp rx=0 tx=0).stop 2024-09-12T02:33:42.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.930+0000 7fabded9d640 1 -- 172.21.15.60:0/1940467250 reap_dead start 2024-09-12T02:33:42.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.930+0000 7fabe4d86640 1 -- 172.21.15.60:0/1940467250 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fabe00c40b0 msgr2=0x7fabe015ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:42.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.930+0000 7fabe4d86640 1 --2- 172.21.15.60:0/1940467250 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fabe00c40b0 0x7fabe015ac80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fabd002a150 tx=0x7fabd00046c0 comp rx=0 tx=0).stop 2024-09-12T02:33:42.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.930+0000 7fabe4d86640 1 -- 172.21.15.60:0/1940467250 shutdown_connections 2024-09-12T02:33:42.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.930+0000 7fabe4d86640 1 --2- 172.21.15.60:0/1940467250 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fabe00c40b0 0x7fabe015ac80 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:42.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.930+0000 7fabe4d86640 1 -- 172.21.15.60:0/1940467250 >> 172.21.15.60:0/1940467250 conn(0x7fabe006c030 msgr2=0x7fabe0155670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:42.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.931+0000 7fabe4d86640 1 -- 172.21.15.60:0/1940467250 shutdown_connections 2024-09-12T02:33:42.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:42.931+0000 7fabe4d86640 1 -- 172.21.15.60:0/1940467250 wait complete. 2024-09-12T02:33:42.947 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:33:42.947 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-12T02:33:42.947 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-12T02:33:43.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.102+0000 7f9b21b52640 1 Processor -- start 2024-09-12T02:33:43.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.103+0000 7f9b21b52640 1 -- start start 2024-09-12T02:33:43.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.104+0000 7f9b21b52640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9b1c0acc30 0x7f9b1c0c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:43.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.104+0000 7f9b21b52640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9b1c0c44b0 0x7f9b1c0c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:43.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.104+0000 7f9b21b52640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b1c070590 con 0x7f9b1c0c7fb0 2024-09-12T02:33:43.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.104+0000 7f9b21b52640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f9b1c0c4ea0 con 0x7f9b1c0acc30 2024-09-12T02:33:43.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.104+0000 7f9b21b52640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f9b1c0a8220 con 0x7f9b1c0c44b0 2024-09-12T02:33:43.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.104+0000 7f9b1b7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9b1c0acc30 0x7f9b1c0c3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:43.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.104+0000 7f9b1b7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9b1c0acc30 0x7f9b1c0c3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50226/0 (socket says 172.21.15.60:50226) 2024-09-12T02:33:43.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.104+0000 7f9b1b7fe640 1 -- 172.21.15.60:0/657930007 learned_addr learned my addr 172.21.15.60:0/657930007 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:33:43.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.104+0000 7f9b1affd640 1 --2- 172.21.15.60:0/657930007 >> v2:172.21.15.105:3300/0 conn(0x7f9b1c0c44b0 0x7f9b1c0c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:43.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.104+0000 7f9b1b7fe640 1 -- 172.21.15.60:0/657930007 >> v2:172.21.15.105:3300/0 conn(0x7f9b1c0c44b0 msgr2=0x7f9b1c0c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:43.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.104+0000 7f9b1b7fe640 1 --2- 172.21.15.60:0/657930007 >> v2:172.21.15.105:3300/0 conn(0x7f9b1c0c44b0 0x7f9b1c0c7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:43.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.104+0000 7f9b1b7fe640 1 -- 172.21.15.60:0/657930007 >> v1:172.21.15.60:6789/0 conn(0x7f9b1c0c7fb0 legacy=0x7f9b1c156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:43.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.104+0000 7f9b1b7fe640 1 -- 172.21.15.60:0/657930007 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b1c0a84f0 con 0x7f9b1c0acc30 2024-09-12T02:33:43.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.105+0000 7f9b1b7fe640 1 --2- 172.21.15.60:0/657930007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b1c0acc30 0x7f9b1c0c3f70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c0c4c60 tx=0x7f9b0c02c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19bbe99798da6857 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:43.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.106+0000 7f9b1a7fc640 1 -- 172.21.15.60:0/657930007 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c032710 con 0x7f9b1c0acc30 2024-09-12T02:33:43.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.106+0000 7f9b1a7fc640 1 -- 172.21.15.60:0/657930007 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b0c0328b0 con 0x7f9b1c0acc30 2024-09-12T02:33:43.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.106+0000 7f9b1a7fc640 1 -- 172.21.15.60:0/657930007 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c032ca0 con 0x7f9b1c0acc30 2024-09-12T02:33:43.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.107+0000 7f9b21b52640 1 -- 172.21.15.60:0/657930007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b1c0acc30 msgr2=0x7f9b1c0c3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:43.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.107+0000 7f9b21b52640 1 --2- 172.21.15.60:0/657930007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b1c0acc30 0x7f9b1c0c3f70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c0c4c60 tx=0x7f9b0c02c810 comp rx=0 tx=0).stop 2024-09-12T02:33:43.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.107+0000 7f9b21b52640 1 -- 172.21.15.60:0/657930007 shutdown_connections 2024-09-12T02:33:43.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.108+0000 7f9b21b52640 1 --2- 172.21.15.60:0/657930007 >> v2:172.21.15.105:3300/0 conn(0x7f9b1c0c44b0 0x7f9b1c0c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:43.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.108+0000 7f9b21b52640 1 --2- 172.21.15.60:0/657930007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b1c0acc30 0x7f9b1c0c3f70 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:43.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.108+0000 7f9b21b52640 1 -- 172.21.15.60:0/657930007 >> 172.21.15.60:0/657930007 conn(0x7f9b1c0c5660 msgr2=0x7f9b1c0c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:43.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.108+0000 7f9b21b52640 1 -- 172.21.15.60:0/657930007 shutdown_connections 2024-09-12T02:33:43.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.108+0000 7f9b21b52640 1 -- 172.21.15.60:0/657930007 wait complete. 2024-09-12T02:33:43.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.110+0000 7f9b21b52640 1 Processor -- start 2024-09-12T02:33:43.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.110+0000 7f9b21b52640 1 -- start start 2024-09-12T02:33:43.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.111+0000 7f9b21b52640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9b1c0acc30 0x7f9b1c06f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:43.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.111+0000 7f9b21b52640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b1c0c44b0 0x7f9b1c0a1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:43.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.111+0000 7f9b1affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b1c0c44b0 0x7f9b1c0a1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:43.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.112+0000 7f9b1affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b1c0c44b0 0x7f9b1c0a1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50242/0 (socket says 172.21.15.60:50242) 2024-09-12T02:33:43.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.112+0000 7f9b1b7fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9b1c0acc30 0x7f9b1c06f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:43.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.112+0000 7f9b21b52640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9b1c0c7fb0 0x7f9b1c1ec6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:43.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.112+0000 7f9b1b7fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9b1c0acc30 0x7f9b1c06f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:36340/0 (socket says 172.21.15.60:36340) 2024-09-12T02:33:43.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.112+0000 7f9b1affd640 1 -- 172.21.15.60:0/374574163 learned_addr learned my addr 172.21.15.60:0/374574163 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:33:43.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.112+0000 7f9b21b52640 1 -- 172.21.15.60:0/374574163 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9b1c0c5330 con 0x7f9b1c0c44b0 2024-09-12T02:33:43.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.112+0000 7f9b21b52640 1 -- 172.21.15.60:0/374574163 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9b1c0702b0 con 0x7f9b1c0c7fb0 2024-09-12T02:33:43.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.112+0000 7f9b21b52640 1 -- 172.21.15.60:0/374574163 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9b1c0c63f0 con 0x7f9b1c0acc30 2024-09-12T02:33:43.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.112+0000 7f9b1bfff640 1 --2- 172.21.15.60:0/374574163 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9b1c0c7fb0 0x7f9b1c1ec6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:43.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.112+0000 7f9b1b7fe640 1 -- 172.21.15.60:0/374574163 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9b1c0c7fb0 msgr2=0x7f9b1c1ec6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:43.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.112+0000 7f9b1b7fe640 1 --2- 172.21.15.60:0/374574163 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9b1c0c7fb0 0x7f9b1c1ec6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:43.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.112+0000 7f9b1b7fe640 1 -- 172.21.15.60:0/374574163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b1c0c44b0 msgr2=0x7f9b1c0a1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:43.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.112+0000 7f9b1b7fe640 1 --2- 172.21.15.60:0/374574163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b1c0c44b0 0x7f9b1c0a1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:43.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.112+0000 7f9b1b7fe640 1 -- 172.21.15.60:0/374574163 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b1c09d660 con 0x7f9b1c0acc30 2024-09-12T02:33:43.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.112+0000 7f9b1affd640 1 --2- 172.21.15.60:0/374574163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b1c0c44b0 0x7f9b1c0a1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:33:43.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.113+0000 7f9b1b7fe640 1 --2- 172.21.15.60:0/374574163 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9b1c0acc30 0x7f9b1c06f670 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c034000 tx=0x7f9b0c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:43.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.113+0000 7f9b03fff640 1 -- 172.21.15.60:0/374574163 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c003a20 con 0x7f9b1c0acc30 2024-09-12T02:33:43.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.113+0000 7f9b03fff640 1 -- 172.21.15.60:0/374574163 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b0c043070 con 0x7f9b1c0acc30 2024-09-12T02:33:43.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.113+0000 7f9b03fff640 1 -- 172.21.15.60:0/374574163 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c003e20 con 0x7f9b1c0acc30 2024-09-12T02:33:43.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.113+0000 7f9b21b52640 1 -- 172.21.15.60:0/374574163 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b1c09d940 con 0x7f9b1c0acc30 2024-09-12T02:33:43.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.114+0000 7f9b21b52640 1 -- 172.21.15.60:0/374574163 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b1c0abb90 con 0x7f9b1c0acc30 2024-09-12T02:33:43.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.115+0000 7f9b21b52640 1 --2- 172.21.15.60:0/374574163 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9b1c1eb530 0x7f9b1c1eb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:43.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.115+0000 7f9b21b52640 1 -- 172.21.15.60:0/374574163 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9b1c06ecd0 con 0x7f9b1c1eb530 2024-09-12T02:33:43.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.116+0000 7f9b1affd640 1 --2- 172.21.15.60:0/374574163 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9b1c1eb530 0x7f9b1c1eb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:43.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.116+0000 7f9b03fff640 1 -- 172.21.15.60:0/374574163 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9b0c03d070 con 0x7f9b1c0acc30 2024-09-12T02:33:43.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.116+0000 7f9b1affd640 1 -- 172.21.15.60:0/374574163 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9b1c0c9c50 con 0x7f9b1c1eb530 2024-09-12T02:33:43.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.117+0000 7f9b1affd640 1 --2- 172.21.15.60:0/374574163 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9b1c1eb530 0x7f9b1c1eb910 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c0ac520 tx=0x7f9b100078a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:43.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.117+0000 7f9b03fff640 1 --2- 172.21.15.60:0/374574163 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9b0806bf00 0x7f9b0806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:43.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.117+0000 7f9b03fff640 1 -- 172.21.15.60:0/374574163 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f9b0c0abde0 con 0x7f9b1c0acc30 2024-09-12T02:33:43.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.117+0000 7f9b1bfff640 1 --2- 172.21.15.60:0/374574163 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9b0806bf00 0x7f9b0806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:43.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.117+0000 7f9b03fff640 1 -- 172.21.15.60:0/374574163 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b1001c770 con 0x7f9b1c1eb530 2024-09-12T02:33:43.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.118+0000 7f9b03fff640 1 -- 172.21.15.60:0/374574163 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f9b10022070 con 0x7f9b1c1eb530 2024-09-12T02:33:43.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.118+0000 7f9b03fff640 1 -- 172.21.15.60:0/374574163 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9b1c1eb530 msgr2=0x7f9b1c1eb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:43.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.118+0000 7f9b03fff640 1 --2- 172.21.15.60:0/374574163 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9b1c1eb530 0x7f9b1c1eb910 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c0ac520 tx=0x7f9b100078a0 comp rx=0 tx=0).stop 2024-09-12T02:33:43.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.118+0000 7f9b03fff640 1 -- 172.21.15.60:0/374574163 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9b1c1eb530 msgr2=0x7f9b1c1eb910 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:33:43.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.118+0000 7f9b03fff640 1 --2- 172.21.15.60:0/374574163 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9b1c1eb530 0x7f9b1c1eb910 secure :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c0ac520 tx=0x7f9b100078a0 comp rx=0 tx=0).stop 2024-09-12T02:33:43.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.118+0000 7f9b1bfff640 1 --2- 172.21.15.60:0/374574163 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9b0806bf00 0x7f9b0806e3c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9b140012e0 tx=0x7f9b14009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:43.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.128+0000 7f9b21b52640 1 --2- 172.21.15.60:0/374574163 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9b1c1540f0 0x7f9b1c154500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:43.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.128+0000 7f9b21b52640 1 -- 172.21.15.60:0/374574163 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9b1c0764a0 con 0x7f9b1c1540f0 2024-09-12T02:33:43.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.128+0000 7f9b1affd640 1 --2- 172.21.15.60:0/374574163 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9b1c1540f0 0x7f9b1c154500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:43.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.129+0000 7f9b1affd640 1 -- 172.21.15.60:0/374574163 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9b1c09db10 con 0x7f9b1c1540f0 2024-09-12T02:33:43.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.130+0000 7f9b1affd640 1 --2- 172.21.15.60:0/374574163 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9b1c1540f0 0x7f9b1c154500 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c0ac520 tx=0x7f9b100046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:43.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.130+0000 7f9b03fff640 1 -- 172.21.15.60:0/374574163 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b10031600 con 0x7f9b1c1540f0 2024-09-12T02:33:43.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.130+0000 7f9b03fff640 1 -- 172.21.15.60:0/374574163 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4550 (secure 0 0 0) 0x7f9b1001ce10 con 0x7f9b1c1540f0 2024-09-12T02:33:43.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.130+0000 7f9b03fff640 1 -- 172.21.15.60:0/374574163 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9b1c1540f0 msgr2=0x7f9b1c154500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:43.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.130+0000 7f9b03fff640 1 --2- 172.21.15.60:0/374574163 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9b1c1540f0 0x7f9b1c154500 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c0ac520 tx=0x7f9b100046c0 comp rx=0 tx=0).stop 2024-09-12T02:33:43.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.130+0000 7f9b03fff640 1 -- 172.21.15.60:0/374574163 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9b1c1540f0 msgr2=0x7f9b1c154500 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:33:43.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.130+0000 7f9b03fff640 1 --2- 172.21.15.60:0/374574163 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9b1c1540f0 0x7f9b1c154500 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:43.131 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:33:43.131 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:33:43.132 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:33:43.132 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:33:43.132 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 104, 2024-09-12T02:33:43.132 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 96885, 2024-09-12T02:33:43.132 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:33:43.132 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:33:43.132 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:33:43.132 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:33:43.132 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:33:43.132 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 14, 2024-09-12T02:33:43.132 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:33:43.132 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:33:43.132 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:33:43.133 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:33:43.133 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:33:43.133 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:33:43.133 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:33:43.133 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:33:43.133 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:33:43.133 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:33:43.133 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:33:43.133 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:33:43.133 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:33:43.134 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:33:43.134 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:33:43.134 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:33:43.134 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:33:43.134 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:33:43.134 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:33:43.134 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:33:43.134 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:33:43.134 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:33:43.134 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:33:43.134 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:33:43.134 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:33:43.134 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:33:43.135 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:33:43.135 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:33:43.135 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:43.135 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:43.135 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:33:43.135 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:33:43.135 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:33:43.135 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:33:43.135 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:33:43.135 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:33:43.135 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:33:43.135 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:33:43.135 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:33:43.135 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:33:43.136 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:33:43.136 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:33:43.136 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:33:43.136 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:33:43.136 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:33:43.136 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:33:43.136 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:33:43.136 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:33:43.136 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:33:43.136 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:33:43.136 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:33:43.136 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:33:43.136 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:33:43.136 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:33:43.137 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:33:43.137 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:33:43.137 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:33:43.137 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:33:43.137 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:33:43.137 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:33:43.137 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:43.137 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:33:43.137 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:43.137 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:33:43.137 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:33:43.137 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:33:43.137 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:33:43.138 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:43.138 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:33:43.138 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:33:43.138 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:43.138 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:43.138 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:43.138 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:33:43.138 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:33:43.138 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:43.138 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:43.138 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:43.138 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:43.138 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:33:43.138 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:33:43.139 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:33:43.139 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:33:43.139 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:33:43.139 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:43.139 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:43.139 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:33:43.139 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:33:43.139 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:33:43.139 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:33:43.139 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:43.139 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:33:43.139 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:33:43.139 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:43.140 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:43.140 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:43.140 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:33:43.140 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:33:43.140 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:43.140 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:43.140 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:43.140 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:43.140 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:33:43.140 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:33:43.140 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:33:43.140 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:33:43.140 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:33:43.141 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:43.141 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:43.141 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:33:43.141 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:33:43.141 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:33:43.141 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:33:43.141 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:43.141 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:33:43.141 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:33:43.141 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:43.141 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:43.141 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:43.141 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:33:43.142 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:33:43.142 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:43.142 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:43.142 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:43.142 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:43.142 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:33:43.142 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:33:43.142 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:33:43.142 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:33:43.142 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:33:43.142 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:43.142 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:43.142 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:43.142 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:33:43.142 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:33:43.143 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:43.143 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:33:43.143 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:33:43.143 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:33:43.143 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:43.143 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:33:43.143 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:33:43.143 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:43.143 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:33:43.143 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:33:43.143 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:33:43.143 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:43.143 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:43.144 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:43.144 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:33:43.144 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:33:43.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.131+0000 7f9b21b52640 1 -- 172.21.15.60:0/374574163 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9b0806bf00 msgr2=0x7f9b0806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:43.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.131+0000 7f9b21b52640 1 --2- 172.21.15.60:0/374574163 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9b0806bf00 0x7f9b0806e3c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9b140012e0 tx=0x7f9b14009040 comp rx=0 tx=0).stop 2024-09-12T02:33:43.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.131+0000 7f9b21b52640 1 -- 172.21.15.60:0/374574163 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9b1c0acc30 msgr2=0x7f9b1c06f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:43.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.131+0000 7f9b21b52640 1 --2- 172.21.15.60:0/374574163 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9b1c0acc30 0x7f9b1c06f670 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c034000 tx=0x7f9b0c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:33:43.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.131+0000 7f9b1bfff640 1 -- 172.21.15.60:0/374574163 reap_dead start 2024-09-12T02:33:43.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.131+0000 7f9b21b52640 1 -- 172.21.15.60:0/374574163 shutdown_connections 2024-09-12T02:33:43.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.131+0000 7f9b21b52640 1 --2- 172.21.15.60:0/374574163 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9b1c0acc30 0x7f9b1c06f670 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:43.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.131+0000 7f9b21b52640 1 -- 172.21.15.60:0/374574163 >> 172.21.15.60:0/374574163 conn(0x7f9b1c0c5660 msgr2=0x7f9b1c074000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:43.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.131+0000 7f9b21b52640 1 -- 172.21.15.60:0/374574163 shutdown_connections 2024-09-12T02:33:43.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.131+0000 7f9b21b52640 1 -- 172.21.15.60:0/374574163 wait complete. 2024-09-12T02:33:43.149 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:33:43.149 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-09-12T02:33:43.149 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-12T02:33:43.149 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-09-12T02:33:43.149 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-12T02:33:43.150 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T02:33:43.150 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:33:43.163 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T02:33:43.164 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-12T02:33:43.164 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:33:43.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.364+0000 7feb4aec3640 1 Processor -- start 2024-09-12T02:33:43.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.364+0000 7feb4aec3640 1 -- start start 2024-09-12T02:33:43.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.365+0000 7feb4aec3640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7feb440c5130 0x7feb441538c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:43.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.365+0000 7feb4aec3640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feb440ad6a0 0x7feb44153e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:43.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.365+0000 7feb4aec3640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb440c2f60 con 0x7feb44067950 2024-09-12T02:33:43.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.365+0000 7feb4aec3640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7feb440c1f80 con 0x7feb440c5130 2024-09-12T02:33:43.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.365+0000 7feb4aec3640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7feb440c3240 con 0x7feb440ad6a0 2024-09-12T02:33:43.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.366+0000 7feb48c5f640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7feb440c5130 0x7feb441538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:43.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.366+0000 7feb48c5f640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7feb440c5130 0x7feb441538c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:58408/0 (socket says 172.21.15.60:58408) 2024-09-12T02:33:43.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.366+0000 7feb48c5f640 1 -- 172.21.15.60:0/1892412911 learned_addr learned my addr 172.21.15.60:0/1892412911 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:33:43.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.366+0000 7feb43fff640 1 --2- 172.21.15.60:0/1892412911 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feb440ad6a0 0x7feb44153e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:43.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.366+0000 7feb48c5f640 1 -- 172.21.15.60:0/1892412911 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feb440ad6a0 msgr2=0x7feb44153e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:43.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.366+0000 7feb48c5f640 1 --2- 172.21.15.60:0/1892412911 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feb440ad6a0 0x7feb44153e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:43.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.366+0000 7feb48c5f640 1 -- 172.21.15.60:0/1892412911 >> v1:172.21.15.105:6789/0 conn(0x7feb44067950 legacy=0x7feb44159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:43.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.366+0000 7feb48c5f640 1 -- 172.21.15.60:0/1892412911 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb440c1c10 con 0x7feb440c5130 2024-09-12T02:33:43.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.366+0000 7feb437fe640 1 -- 172.21.15.60:0/1892412911 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 860111163 0 0) 0x7feb440c2f60 con 0x7feb44067950 2024-09-12T02:33:43.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.367+0000 7feb43fff640 1 --2- 172.21.15.60:0/1892412911 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feb440ad6a0 0x7feb44153e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:33:43.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.367+0000 7feb48c5f640 1 --2- 172.21.15.60:0/1892412911 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb440c5130 0x7feb441538c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7feb34009870 tx=0x7feb3402a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=814344c449a47cca server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:43.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.368+0000 7feb437fe640 1 -- 172.21.15.60:0/1892412911 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb34037070 con 0x7feb440c5130 2024-09-12T02:33:43.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.368+0000 7feb437fe640 1 -- 172.21.15.60:0/1892412911 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb34032440 con 0x7feb440c5130 2024-09-12T02:33:43.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.368+0000 7feb437fe640 1 -- 172.21.15.60:0/1892412911 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb34032810 con 0x7feb440c5130 2024-09-12T02:33:43.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.369+0000 7feb4aec3640 1 -- 172.21.15.60:0/1892412911 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb440c5130 msgr2=0x7feb441538c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:43.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.369+0000 7feb4aec3640 1 --2- 172.21.15.60:0/1892412911 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb440c5130 0x7feb441538c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7feb34009870 tx=0x7feb3402a130 comp rx=0 tx=0).stop 2024-09-12T02:33:43.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.369+0000 7feb4aec3640 1 -- 172.21.15.60:0/1892412911 shutdown_connections 2024-09-12T02:33:43.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.369+0000 7feb4aec3640 1 --2- 172.21.15.60:0/1892412911 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feb440ad6a0 0x7feb44153e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:43.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.369+0000 7feb4aec3640 1 --2- 172.21.15.60:0/1892412911 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb440c5130 0x7feb441538c0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:43.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.369+0000 7feb4aec3640 1 -- 172.21.15.60:0/1892412911 >> 172.21.15.60:0/1892412911 conn(0x7feb440c8430 msgr2=0x7feb440c8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:43.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.369+0000 7feb4aec3640 1 -- 172.21.15.60:0/1892412911 shutdown_connections 2024-09-12T02:33:43.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.369+0000 7feb4aec3640 1 -- 172.21.15.60:0/1892412911 wait complete. 2024-09-12T02:33:43.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.370+0000 7feb4aec3640 1 Processor -- start 2024-09-12T02:33:43.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.371+0000 7feb4aec3640 1 -- start start 2024-09-12T02:33:43.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.372+0000 7feb4aec3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb44067950 0x7feb44073610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:43.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.372+0000 7feb4aec3640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feb440ad6a0 0x7feb4414fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:43.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.372+0000 7feb4aec3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb440c5130 0x7feb44150100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:43.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.372+0000 7feb4aec3640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7feb440c5690 con 0x7feb440c5130 2024-09-12T02:33:43.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.372+0000 7feb4aec3640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7feb440c5510 con 0x7feb44067950 2024-09-12T02:33:43.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.372+0000 7feb4aec3640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7feb4415a370 con 0x7feb440ad6a0 2024-09-12T02:33:43.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.372+0000 7feb49460640 1 -- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb440c5130 msgr2=0x7feb44150100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:33:43.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.372+0000 7feb49460640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb440c5130 0x7feb44150100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:33:43.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.372+0000 7feb43fff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feb440ad6a0 0x7feb4414fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:43.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.372+0000 7feb48c5f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb44067950 0x7feb44073610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:43.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.372+0000 7feb43fff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feb440ad6a0 0x7feb4414fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:36384/0 (socket says 172.21.15.60:36384) 2024-09-12T02:33:43.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.372+0000 7feb43fff640 1 -- 172.21.15.60:0/2810881920 learned_addr learned my addr 172.21.15.60:0/2810881920 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:33:43.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.373+0000 7feb43fff640 1 -- 172.21.15.60:0/2810881920 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb44067950 msgr2=0x7feb44073610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:43.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.373+0000 7feb43fff640 1 --2- 172.21.15.60:0/2810881920 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb44067950 0x7feb44073610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:43.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.373+0000 7feb43fff640 1 -- 172.21.15.60:0/2810881920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb440c5130 msgr2=0x7feb44150100 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:33:43.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.373+0000 7feb43fff640 1 --2- 172.21.15.60:0/2810881920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb440c5130 0x7feb44150100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:43.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.373+0000 7feb43fff640 1 -- 172.21.15.60:0/2810881920 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb440aa600 con 0x7feb440ad6a0 2024-09-12T02:33:43.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.373+0000 7feb43fff640 1 --2- 172.21.15.60:0/2810881920 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feb440ad6a0 0x7feb4414fbc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7feb3800c820 tx=0x7feb3800cce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:43.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.373+0000 7feb417fa640 1 -- 172.21.15.60:0/2810881920 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb38004230 con 0x7feb440ad6a0 2024-09-12T02:33:43.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.374+0000 7feb417fa640 1 -- 172.21.15.60:0/2810881920 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb380043d0 con 0x7feb440ad6a0 2024-09-12T02:33:43.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.374+0000 7feb4aec3640 1 -- 172.21.15.60:0/2810881920 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb440aa8c0 con 0x7feb440ad6a0 2024-09-12T02:33:43.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.374+0000 7feb4aec3640 1 -- 172.21.15.60:0/2810881920 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7feb440aae80 con 0x7feb440ad6a0 2024-09-12T02:33:43.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.374+0000 7feb417fa640 1 -- 172.21.15.60:0/2810881920 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb38007a70 con 0x7feb440ad6a0 2024-09-12T02:33:43.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.376+0000 7feb417fa640 1 -- 172.21.15.60:0/2810881920 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feb38007c10 con 0x7feb440ad6a0 2024-09-12T02:33:43.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.376+0000 7feb4aec3640 1 -- 172.21.15.60:0/2810881920 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb44069640 con 0x7feb440ad6a0 2024-09-12T02:33:43.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.376+0000 7feb417fa640 1 --2- 172.21.15.60:0/2810881920 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7feb3006be30 0x7feb3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:43.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.376+0000 7feb417fa640 1 -- 172.21.15.60:0/2810881920 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7feb3808b070 con 0x7feb440ad6a0 2024-09-12T02:33:43.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.377+0000 7feb48c5f640 1 --2- 172.21.15.60:0/2810881920 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7feb3006be30 0x7feb3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:43.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.377+0000 7feb48c5f640 1 --2- 172.21.15.60:0/2810881920 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7feb3006be30 0x7feb3006e2f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7feb34034000 tx=0x7feb3402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:43.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.385+0000 7feb417fa640 1 -- 172.21.15.60:0/2810881920 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7feb44069640 con 0x7feb440ad6a0 2024-09-12T02:33:43.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.809+0000 7feb4aec3640 1 -- 172.21.15.60:0/2810881920 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7feb441587d0 con 0x7feb440ad6a0 2024-09-12T02:33:43.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.810+0000 7feb417fa640 1 -- 172.21.15.60:0/2810881920 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1566 (secure 0 0 0) 0x7feb441587d0 con 0x7feb440ad6a0 2024-09-12T02:33:43.811 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":104,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:33:43.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.813+0000 7feb4aec3640 1 -- 172.21.15.60:0/2810881920 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7feb3006be30 msgr2=0x7feb3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:43.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.813+0000 7feb4aec3640 1 --2- 172.21.15.60:0/2810881920 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7feb3006be30 0x7feb3006e2f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7feb34034000 tx=0x7feb3402e000 comp rx=0 tx=0).stop 2024-09-12T02:33:43.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.813+0000 7feb4aec3640 1 -- 172.21.15.60:0/2810881920 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feb440ad6a0 msgr2=0x7feb4414fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:43.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.813+0000 7feb4aec3640 1 --2- 172.21.15.60:0/2810881920 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feb440ad6a0 0x7feb4414fbc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7feb3800c820 tx=0x7feb3800cce0 comp rx=0 tx=0).stop 2024-09-12T02:33:43.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.813+0000 7feb4aec3640 1 -- 172.21.15.60:0/2810881920 shutdown_connections 2024-09-12T02:33:43.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.813+0000 7feb4aec3640 1 --2- 172.21.15.60:0/2810881920 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7feb3006be30 0x7feb3006e2f0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:43.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.813+0000 7feb4aec3640 1 --2- 172.21.15.60:0/2810881920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb440c5130 0x7feb44150100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:43.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.813+0000 7feb4aec3640 1 --2- 172.21.15.60:0/2810881920 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feb440ad6a0 0x7feb4414fbc0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:43.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.813+0000 7feb4aec3640 1 --2- 172.21.15.60:0/2810881920 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb44067950 0x7feb44073610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:43.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.813+0000 7feb4aec3640 1 -- 172.21.15.60:0/2810881920 >> 172.21.15.60:0/2810881920 conn(0x7feb440c8430 msgr2=0x7feb44159c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:43.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.813+0000 7feb4aec3640 1 -- 172.21.15.60:0/2810881920 shutdown_connections 2024-09-12T02:33:43.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:43.813+0000 7feb4aec3640 1 -- 172.21.15.60:0/2810881920 wait complete. 2024-09-12T02:33:46.833 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:33:47.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.037+0000 7ff1c938d640 1 Processor -- start 2024-09-12T02:33:47.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.037+0000 7ff1c938d640 1 -- start start 2024-09-12T02:33:47.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.039+0000 7ff1c938d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1c40acd50 0x7ff1c415af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:47.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.039+0000 7ff1c938d640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff1c415b470 0x7ff1c40729c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:47.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.039+0000 7ff1c938d640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1c40c63f0 con 0x7ff1c4072f00 2024-09-12T02:33:47.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.039+0000 7ff1c37fe640 1 -- >> v1:172.21.15.60:6789/0 conn(0x7ff1c4072f00 legacy=0x7ff1c40c7a70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:33:47.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.039+0000 7ff1c938d640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff1c4072270 con 0x7ff1c415b470 2024-09-12T02:33:47.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.039+0000 7ff1c938d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff1c4074660 con 0x7ff1c40acd50 2024-09-12T02:33:47.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.039+0000 7ff1c2ffd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1c40acd50 0x7ff1c415af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:47.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.039+0000 7ff1c2ffd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1c40acd50 0x7ff1c415af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:36388/0 (socket says 172.21.15.60:36388) 2024-09-12T02:33:47.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.039+0000 7ff1c2ffd640 1 -- 172.21.15.60:0/2508570793 learned_addr learned my addr 172.21.15.60:0/2508570793 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:33:47.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.039+0000 7ff1c27fc640 1 --2- 172.21.15.60:0/2508570793 >> v2:172.21.15.105:3300/0 conn(0x7ff1c415b470 0x7ff1c40729c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:47.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.039+0000 7ff1c2ffd640 1 -- 172.21.15.60:0/2508570793 >> v2:172.21.15.105:3300/0 conn(0x7ff1c415b470 msgr2=0x7ff1c40729c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:47.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.039+0000 7ff1c2ffd640 1 --2- 172.21.15.60:0/2508570793 >> v2:172.21.15.105:3300/0 conn(0x7ff1c415b470 0x7ff1c40729c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:47.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.039+0000 7ff1c2ffd640 1 -- 172.21.15.60:0/2508570793 >> v1:172.21.15.60:6789/0 conn(0x7ff1c4072f00 legacy=0x7ff1c40c7a70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:33:47.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.039+0000 7ff1c2ffd640 1 -- 172.21.15.60:0/2508570793 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c415dda0 con 0x7ff1c40acd50 2024-09-12T02:33:47.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.041+0000 7ff1c2ffd640 1 --2- 172.21.15.60:0/2508570793 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1c40acd50 0x7ff1c415af30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4009870 tx=0x7ff1b402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c21e7ab7b5b1f2d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:47.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.041+0000 7ff1c1ffb640 1 -- 172.21.15.60:0/2508570793 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4037070 con 0x7ff1c40acd50 2024-09-12T02:33:47.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.041+0000 7ff1c1ffb640 1 -- 172.21.15.60:0/2508570793 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1b4032440 con 0x7ff1c40acd50 2024-09-12T02:33:47.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.041+0000 7ff1c1ffb640 1 -- 172.21.15.60:0/2508570793 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4032810 con 0x7ff1c40acd50 2024-09-12T02:33:47.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.042+0000 7ff1c938d640 1 -- 172.21.15.60:0/2508570793 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1c40acd50 msgr2=0x7ff1c415af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:47.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.042+0000 7ff1c938d640 1 --2- 172.21.15.60:0/2508570793 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1c40acd50 0x7ff1c415af30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4009870 tx=0x7ff1b402a180 comp rx=0 tx=0).stop 2024-09-12T02:33:47.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.042+0000 7ff1c938d640 1 -- 172.21.15.60:0/2508570793 shutdown_connections 2024-09-12T02:33:47.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.042+0000 7ff1c938d640 1 --2- 172.21.15.60:0/2508570793 >> v2:172.21.15.105:3300/0 conn(0x7ff1c415b470 0x7ff1c40729c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:47.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.042+0000 7ff1c938d640 1 --2- 172.21.15.60:0/2508570793 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1c40acd50 0x7ff1c415af30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:47.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.042+0000 7ff1c938d640 1 -- 172.21.15.60:0/2508570793 >> 172.21.15.60:0/2508570793 conn(0x7ff1c40c5660 msgr2=0x7ff1c40c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:47.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.043+0000 7ff1c938d640 1 -- 172.21.15.60:0/2508570793 shutdown_connections 2024-09-12T02:33:47.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.044+0000 7ff1c938d640 1 -- 172.21.15.60:0/2508570793 wait complete. 2024-09-12T02:33:47.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.045+0000 7ff1c938d640 1 Processor -- start 2024-09-12T02:33:47.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.045+0000 7ff1c938d640 1 -- start start 2024-09-12T02:33:47.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.046+0000 7ff1c938d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1c4072f00 0x7ff1c40c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:47.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.047+0000 7ff1c938d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1c40acd50 0x7ff1c415d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:47.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.047+0000 7ff1c938d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1c415b470 0x7ff1c41f03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:47.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.047+0000 7ff1c938d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c4071d40 con 0x7ff1c415b470 2024-09-12T02:33:47.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.047+0000 7ff1c938d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c40748b0 con 0x7ff1c40acd50 2024-09-12T02:33:47.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.047+0000 7ff1c938d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff1c40abc10 con 0x7ff1c4072f00 2024-09-12T02:33:47.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.047+0000 7ff1c37fe640 1 -- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1c415b470 msgr2=0x7ff1c41f03c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:33:47.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.047+0000 7ff1c37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1c415b470 0x7ff1c41f03c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:33:47.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.047+0000 7ff1c2ffd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1c4072f00 0x7ff1c40c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:47.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.047+0000 7ff1c2ffd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1c4072f00 0x7ff1c40c7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:36398/0 (socket says 172.21.15.60:36398) 2024-09-12T02:33:47.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.047+0000 7ff1c2ffd640 1 -- 172.21.15.60:0/1376886840 learned_addr learned my addr 172.21.15.60:0/1376886840 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:33:47.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.047+0000 7ff1c27fc640 1 --2- 172.21.15.60:0/1376886840 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1c40acd50 0x7ff1c415d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:47.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.047+0000 7ff1c2ffd640 1 -- 172.21.15.60:0/1376886840 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1c40acd50 msgr2=0x7ff1c415d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:47.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.047+0000 7ff1c2ffd640 1 --2- 172.21.15.60:0/1376886840 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1c40acd50 0x7ff1c415d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:47.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.047+0000 7ff1c2ffd640 1 -- 172.21.15.60:0/1376886840 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1c415b470 msgr2=0x7ff1c41f03c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:33:47.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.047+0000 7ff1c2ffd640 1 --2- 172.21.15.60:0/1376886840 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1c415b470 0x7ff1c41f03c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:47.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.048+0000 7ff1c2ffd640 1 -- 172.21.15.60:0/1376886840 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c4152280 con 0x7ff1c4072f00 2024-09-12T02:33:47.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.048+0000 7ff1c27fc640 1 --2- 172.21.15.60:0/1376886840 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1c40acd50 0x7ff1c415d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:33:47.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.048+0000 7ff1c2ffd640 1 --2- 172.21.15.60:0/1376886840 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1c4072f00 0x7ff1c40c7cf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4009870 tx=0x7ff1b40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:47.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.048+0000 7ff1ab7fe640 1 -- 172.21.15.60:0/1376886840 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4041020 con 0x7ff1c4072f00 2024-09-12T02:33:47.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.048+0000 7ff1ab7fe640 1 -- 172.21.15.60:0/1376886840 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1b4030640 con 0x7ff1c4072f00 2024-09-12T02:33:47.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.048+0000 7ff1c938d640 1 -- 172.21.15.60:0/1376886840 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1c4153820 con 0x7ff1c4072f00 2024-09-12T02:33:47.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.049+0000 7ff1c938d640 1 -- 172.21.15.60:0/1376886840 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1c4153de0 con 0x7ff1c4072f00 2024-09-12T02:33:47.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.049+0000 7ff1ab7fe640 1 -- 172.21.15.60:0/1376886840 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4037040 con 0x7ff1c4072f00 2024-09-12T02:33:47.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.051+0000 7ff1ab7fe640 1 -- 172.21.15.60:0/1376886840 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff1b4044020 con 0x7ff1c4072f00 2024-09-12T02:33:47.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.051+0000 7ff1c938d640 1 -- 172.21.15.60:0/1376886840 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1c40adba0 con 0x7ff1c4072f00 2024-09-12T02:33:47.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.052+0000 7ff1ab7fe640 1 --2- 172.21.15.60:0/1376886840 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff1b006bde0 0x7ff1b006e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:47.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.052+0000 7ff1ab7fe640 1 -- 172.21.15.60:0/1376886840 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7ff1b40ab920 con 0x7ff1c4072f00 2024-09-12T02:33:47.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.052+0000 7ff1c27fc640 1 --2- 172.21.15.60:0/1376886840 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff1b006bde0 0x7ff1b006e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:47.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.054+0000 7ff1c27fc640 1 --2- 172.21.15.60:0/1376886840 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff1b006bde0 0x7ff1b006e2a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8009ee0 tx=0x7ff1b8009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:47.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.059+0000 7ff1ab7fe640 1 -- 172.21.15.60:0/1376886840 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff1b404b030 con 0x7ff1c4072f00 2024-09-12T02:33:47.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.482+0000 7ff1c938d640 1 -- 172.21.15.60:0/1376886840 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ff1c41effe0 con 0x7ff1c4072f00 2024-09-12T02:33:47.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.483+0000 7ff1ab7fe640 1 -- 172.21.15.60:0/1376886840 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1566 (secure 0 0 0) 0x7ff1b4079ea0 con 0x7ff1c4072f00 2024-09-12T02:33:47.484 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":104,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":19,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:33:47.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.486+0000 7ff1c938d640 1 -- 172.21.15.60:0/1376886840 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff1b006bde0 msgr2=0x7ff1b006e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:47.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.486+0000 7ff1c938d640 1 --2- 172.21.15.60:0/1376886840 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff1b006bde0 0x7ff1b006e2a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8009ee0 tx=0x7ff1b8009190 comp rx=0 tx=0).stop 2024-09-12T02:33:47.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.486+0000 7ff1c938d640 1 -- 172.21.15.60:0/1376886840 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1c4072f00 msgr2=0x7ff1c40c7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:47.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.486+0000 7ff1c938d640 1 --2- 172.21.15.60:0/1376886840 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1c4072f00 0x7ff1c40c7cf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4009870 tx=0x7ff1b40046c0 comp rx=0 tx=0).stop 2024-09-12T02:33:47.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.486+0000 7ff1c938d640 1 -- 172.21.15.60:0/1376886840 shutdown_connections 2024-09-12T02:33:47.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.486+0000 7ff1c938d640 1 --2- 172.21.15.60:0/1376886840 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff1b006bde0 0x7ff1b006e2a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:47.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.486+0000 7ff1c938d640 1 --2- 172.21.15.60:0/1376886840 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1c415b470 0x7ff1c41f03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:47.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.486+0000 7ff1c938d640 1 --2- 172.21.15.60:0/1376886840 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1c40acd50 0x7ff1c415d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:47.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.486+0000 7ff1c938d640 1 --2- 172.21.15.60:0/1376886840 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1c4072f00 0x7ff1c40c7cf0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:47.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.486+0000 7ff1c938d640 1 -- 172.21.15.60:0/1376886840 >> 172.21.15.60:0/1376886840 conn(0x7ff1c40c5660 msgr2=0x7ff1c40c4df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:47.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.486+0000 7ff1c938d640 1 -- 172.21.15.60:0/1376886840 shutdown_connections 2024-09-12T02:33:47.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:47.486+0000 7ff1c938d640 1 -- 172.21.15.60:0/1376886840 wait complete. 2024-09-12T02:33:50.504 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:33:50.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.656+0000 7f65c3d78640 1 Processor -- start 2024-09-12T02:33:50.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.657+0000 7f65c3d78640 1 -- start start 2024-09-12T02:33:50.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.658+0000 7f65c3d78640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65bc0acc30 0x7f65bc0c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:50.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.658+0000 7f65c3d78640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f65bc0c44b0 0x7f65bc0c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:50.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.658+0000 7f65c3d78640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f65bc0c7fb0 0x7f65bc0c8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:50.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.658+0000 7f65c3d78640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f65bc0c4ea0 con 0x7f65bc0c44b0 2024-09-12T02:33:50.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.658+0000 7f65c3d78640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f65bc070590 con 0x7f65bc0c7fb0 2024-09-12T02:33:50.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.658+0000 7f65c3d78640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f65bc0a8220 con 0x7f65bc0acc30 2024-09-12T02:33:50.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.658+0000 7f65c1313640 1 -- >> v2:172.21.15.60:3300/0 conn(0x7f65bc0c44b0 msgr2=0x7f65bc0c7a70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:33:50.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.658+0000 7f65c1313640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f65bc0c44b0 0x7f65bc0c7a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:33:50.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.658+0000 7f65c1b14640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65bc0acc30 0x7f65bc0c3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:50.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.658+0000 7f65c1b14640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65bc0acc30 0x7f65bc0c3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:37156/0 (socket says 172.21.15.60:37156) 2024-09-12T02:33:50.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.658+0000 7f65c1b14640 1 -- 172.21.15.60:0/3286013369 learned_addr learned my addr 172.21.15.60:0/3286013369 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:33:50.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.658+0000 7f65c2315640 1 --2- 172.21.15.60:0/3286013369 >> v2:172.21.15.105:3300/0 conn(0x7f65bc0c7fb0 0x7f65bc0c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:50.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.658+0000 7f65c1b14640 1 -- 172.21.15.60:0/3286013369 >> v2:172.21.15.105:3300/0 conn(0x7f65bc0c7fb0 msgr2=0x7f65bc0c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:50.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.658+0000 7f65c1b14640 1 --2- 172.21.15.60:0/3286013369 >> v2:172.21.15.105:3300/0 conn(0x7f65bc0c7fb0 0x7f65bc0c8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:50.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.659+0000 7f65c1b14640 1 -- 172.21.15.60:0/3286013369 >> v2:172.21.15.60:3300/0 conn(0x7f65bc0c44b0 msgr2=0x7f65bc0c7a70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:33:50.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.659+0000 7f65c1b14640 1 --2- 172.21.15.60:0/3286013369 >> v2:172.21.15.60:3300/0 conn(0x7f65bc0c44b0 0x7f65bc0c7a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:50.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.659+0000 7f65c1b14640 1 -- 172.21.15.60:0/3286013369 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65bc0a84f0 con 0x7f65bc0acc30 2024-09-12T02:33:50.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.660+0000 7f65c1b14640 1 --2- 172.21.15.60:0/3286013369 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65bc0acc30 0x7f65bc0c3f70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f65bc0adbc0 tx=0x7f65b802a0e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1dbf166961e9278 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:50.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.660+0000 7f65c0b12640 1 -- 172.21.15.60:0/3286013369 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65b8037070 con 0x7f65bc0acc30 2024-09-12T02:33:50.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.660+0000 7f65c0b12640 1 -- 172.21.15.60:0/3286013369 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65b802ae30 con 0x7f65bc0acc30 2024-09-12T02:33:50.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.660+0000 7f65c0b12640 1 -- 172.21.15.60:0/3286013369 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65b8032640 con 0x7f65bc0acc30 2024-09-12T02:33:50.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.661+0000 7f65c3d78640 1 -- 172.21.15.60:0/3286013369 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65bc0acc30 msgr2=0x7f65bc0c3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:50.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.661+0000 7f65c3d78640 1 --2- 172.21.15.60:0/3286013369 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65bc0acc30 0x7f65bc0c3f70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f65bc0adbc0 tx=0x7f65b802a0e0 comp rx=0 tx=0).stop 2024-09-12T02:33:50.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.661+0000 7f65c3d78640 1 -- 172.21.15.60:0/3286013369 shutdown_connections 2024-09-12T02:33:50.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.661+0000 7f65c3d78640 1 --2- 172.21.15.60:0/3286013369 >> v2:172.21.15.105:3300/0 conn(0x7f65bc0c7fb0 0x7f65bc0c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:50.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.661+0000 7f65c3d78640 1 --2- 172.21.15.60:0/3286013369 >> v2:172.21.15.60:3300/0 conn(0x7f65bc0c44b0 0x7f65bc0c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:50.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.661+0000 7f65c3d78640 1 --2- 172.21.15.60:0/3286013369 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65bc0acc30 0x7f65bc0c3f70 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:50.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.661+0000 7f65c3d78640 1 -- 172.21.15.60:0/3286013369 >> 172.21.15.60:0/3286013369 conn(0x7f65bc0c5660 msgr2=0x7f65bc0c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:50.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.661+0000 7f65c3d78640 1 -- 172.21.15.60:0/3286013369 shutdown_connections 2024-09-12T02:33:50.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.661+0000 7f65c3d78640 1 -- 172.21.15.60:0/3286013369 wait complete. 2024-09-12T02:33:50.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.663+0000 7f65c3d78640 1 Processor -- start 2024-09-12T02:33:50.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.663+0000 7f65c3d78640 1 -- start start 2024-09-12T02:33:50.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.664+0000 7f65c3d78640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65bc0acc30 0x7f65bc1efb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:50.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.664+0000 7f65c3d78640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65bc0c44b0 0x7f65bc1545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:50.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.665+0000 7f65c1313640 1 -- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65bc0c44b0 msgr2=0x7f65bc1545b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:33:50.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.665+0000 7f65c1313640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65bc0c44b0 0x7f65bc1545b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:33:50.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.665+0000 7f65c1b14640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65bc0acc30 0x7f65bc1efb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:50.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.665+0000 7f65c1b14640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65bc0acc30 0x7f65bc1efb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:35020/0 (socket says 172.21.15.60:35020) 2024-09-12T02:33:50.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.665+0000 7f65c3d78640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65bc0c7fb0 0x7f65bc15c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:50.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.665+0000 7f65c1b14640 1 -- 172.21.15.60:0/2429221384 learned_addr learned my addr 172.21.15.60:0/2429221384 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:33:50.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.665+0000 7f65c3d78640 1 -- 172.21.15.60:0/2429221384 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f65bc0c5330 con 0x7f65bc0c44b0 2024-09-12T02:33:50.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.665+0000 7f65c3d78640 1 -- 172.21.15.60:0/2429221384 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f65bc0702b0 con 0x7f65bc0acc30 2024-09-12T02:33:50.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.665+0000 7f65c3d78640 1 -- 172.21.15.60:0/2429221384 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f65bc0c63f0 con 0x7f65bc0c7fb0 2024-09-12T02:33:50.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.665+0000 7f65c2315640 1 --2- 172.21.15.60:0/2429221384 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65bc0c7fb0 0x7f65bc15c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:50.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.666+0000 7f65c1b14640 1 -- 172.21.15.60:0/2429221384 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65bc0c7fb0 msgr2=0x7f65bc15c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:50.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.666+0000 7f65c1b14640 1 --2- 172.21.15.60:0/2429221384 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65bc0c7fb0 0x7f65bc15c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:50.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.666+0000 7f65c1b14640 1 -- 172.21.15.60:0/2429221384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65bc0c44b0 msgr2=0x7f65bc1545b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:33:50.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.666+0000 7f65c1b14640 1 --2- 172.21.15.60:0/2429221384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65bc0c44b0 0x7f65bc1545b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:50.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.666+0000 7f65c1b14640 1 -- 172.21.15.60:0/2429221384 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65bc1f00b0 con 0x7f65bc0acc30 2024-09-12T02:33:50.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.666+0000 7f65c1b14640 1 --2- 172.21.15.60:0/2429221384 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65bc0acc30 0x7f65bc1efb70 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f65b8009960 tx=0x7f65b80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:50.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.667+0000 7f65b27fc640 1 -- 172.21.15.60:0/2429221384 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65b8041020 con 0x7f65bc0acc30 2024-09-12T02:33:50.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.667+0000 7f65b27fc640 1 -- 172.21.15.60:0/2429221384 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65b802ac30 con 0x7f65bc0acc30 2024-09-12T02:33:50.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.667+0000 7f65c3d78640 1 -- 172.21.15.60:0/2429221384 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65bc06fc30 con 0x7f65bc0acc30 2024-09-12T02:33:50.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.667+0000 7f65c3d78640 1 -- 172.21.15.60:0/2429221384 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65bc14fd00 con 0x7f65bc0acc30 2024-09-12T02:33:50.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.667+0000 7f65b27fc640 1 -- 172.21.15.60:0/2429221384 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65b8037040 con 0x7f65bc0acc30 2024-09-12T02:33:50.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.669+0000 7f65c3d78640 1 -- 172.21.15.60:0/2429221384 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65a4005290 con 0x7f65bc0acc30 2024-09-12T02:33:50.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.669+0000 7f65b27fc640 1 -- 172.21.15.60:0/2429221384 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f65b8044020 con 0x7f65bc0acc30 2024-09-12T02:33:50.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.670+0000 7f65b27fc640 1 --2- 172.21.15.60:0/2429221384 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f65a006bde0 0x7f65a006e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:50.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.670+0000 7f65c1313640 1 --2- 172.21.15.60:0/2429221384 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f65a006bde0 0x7f65a006e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:50.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.671+0000 7f65c1313640 1 --2- 172.21.15.60:0/2429221384 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f65a006bde0 0x7f65a006e2a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f65bc0a7cb0 tx=0x7f65ac006d30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:50.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.671+0000 7f65b27fc640 1 -- 172.21.15.60:0/2429221384 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f65b80ab150 con 0x7f65bc0acc30 2024-09-12T02:33:50.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:50.677+0000 7f65b27fc640 1 -- 172.21.15.60:0/2429221384 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f65b804b070 con 0x7f65bc0acc30 2024-09-12T02:33:51.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:51.089+0000 7f65c3d78640 1 -- 172.21.15.60:0/2429221384 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f65a4005850 con 0x7f65bc0acc30 2024-09-12T02:33:51.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:51.090+0000 7f65b27fc640 1 -- 172.21.15.60:0/2429221384 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1566 (secure 0 0 0) 0x7f65b80797f0 con 0x7f65bc0acc30 2024-09-12T02:33:51.091 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":104,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":22,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:33:51.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:51.093+0000 7f65c3d78640 1 -- 172.21.15.60:0/2429221384 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f65a006bde0 msgr2=0x7f65a006e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:51.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:51.093+0000 7f65c3d78640 1 --2- 172.21.15.60:0/2429221384 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f65a006bde0 0x7f65a006e2a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f65bc0a7cb0 tx=0x7f65ac006d30 comp rx=0 tx=0).stop 2024-09-12T02:33:51.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:51.093+0000 7f65c3d78640 1 -- 172.21.15.60:0/2429221384 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65bc0acc30 msgr2=0x7f65bc1efb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:51.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:51.093+0000 7f65c3d78640 1 --2- 172.21.15.60:0/2429221384 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65bc0acc30 0x7f65bc1efb70 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f65b8009960 tx=0x7f65b80046c0 comp rx=0 tx=0).stop 2024-09-12T02:33:51.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:51.093+0000 7f65c3d78640 1 -- 172.21.15.60:0/2429221384 shutdown_connections 2024-09-12T02:33:51.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:51.093+0000 7f65c3d78640 1 --2- 172.21.15.60:0/2429221384 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f65a006bde0 0x7f65a006e2a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:51.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:51.093+0000 7f65c3d78640 1 --2- 172.21.15.60:0/2429221384 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65bc0c7fb0 0x7f65bc15c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:51.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:51.093+0000 7f65c3d78640 1 --2- 172.21.15.60:0/2429221384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65bc0c44b0 0x7f65bc1545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:51.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:51.093+0000 7f65c3d78640 1 --2- 172.21.15.60:0/2429221384 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65bc0acc30 0x7f65bc1efb70 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:51.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:51.093+0000 7f65c3d78640 1 -- 172.21.15.60:0/2429221384 >> 172.21.15.60:0/2429221384 conn(0x7f65bc0c5660 msgr2=0x7f65bc0741c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:51.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:51.093+0000 7f65c3d78640 1 -- 172.21.15.60:0/2429221384 shutdown_connections 2024-09-12T02:33:51.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:51.093+0000 7f65c3d78640 1 -- 172.21.15.60:0/2429221384 wait complete. 2024-09-12T02:33:54.110 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:33:54.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:54.266+0000 7f3c5085e640 1 Processor -- start 2024-09-12T02:33:54.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:54.266+0000 7f3c5085e640 1 -- start start 2024-09-12T02:33:54.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:54.267+0000 7f3c5085e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3c4c157f00 0x7f3c4c15b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:54.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:54.267+0000 7f3c5085e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c4c0c7a90 0x7f3c4c0c4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:54.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:54.268+0000 7f3c5085e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c4c1582e0 con 0x7f3c4c0c51b0 2024-09-12T02:33:54.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:54.268+0000 7f3c5085e640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f3c4c0c4050 con 0x7f3c4c157f00 2024-09-12T02:33:54.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:54.268+0000 7f3c5085e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3c4c0c3720 con 0x7f3c4c0c7a90 2024-09-12T02:33:54.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:54.268+0000 7f3c4a59c640 1 -- >> v2:172.21.15.60:3300/0 conn(0x7f3c4c157f00 msgr2=0x7f3c4c15b120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:33:54.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:54.268+0000 7f3c4ad9d640 1 -- >> v1:172.21.15.60:6789/0 conn(0x7f3c4c0c51b0 legacy=0x7f3c4c0721f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:33:54.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:54.268+0000 7f3c4a59c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3c4c157f00 0x7f3c4c15b120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:33:54.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:54.268+0000 7f3c49d9b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c4c0c7a90 0x7f3c4c0c4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:54.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:54.268+0000 7f3c49d9b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c4c0c7a90 0x7f3c4c0c4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:37176/0 (socket says 172.21.15.60:37176) 2024-09-12T02:33:54.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:54.268+0000 7f3c49d9b640 1 -- 172.21.15.60:0/54341316 learned_addr learned my addr 172.21.15.60:0/54341316 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:33:54.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:54.269+0000 7f3c49d9b640 1 -- 172.21.15.60:0/54341316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c4c0c7a90 msgr2=0x7f3c4c0c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:33:54.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:54.269+0000 7f3c49d9b640 1 -- 172.21.15.60:0/54341316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c4c0c7a90 msgr2=0x7f3c4c0c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:33:54.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:54.269+0000 7f3c49d9b640 1 --2- 172.21.15.60:0/54341316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c4c0c7a90 0x7f3c4c0c4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:33:54.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:54.269+0000 7f3c49d9b640 1 --2- 172.21.15.60:0/54341316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c4c0c7a90 0x7f3c4c0c4c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:33:54.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:54.469+0000 7f3c4ad9d640 1 -- 172.21.15.60:0/54341316 >> v1:172.21.15.60:6789/0 conn(0x7f3c4c0c51b0 legacy=0x7f3c4c0721f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:33:54.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:54.469+0000 7f3c4a59c640 1 -- 172.21.15.60:0/54341316 >> v2:172.21.15.60:3300/0 conn(0x7f3c4c157f00 msgr2=0x7f3c4c15b120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:33:54.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:54.469+0000 7f3c4a59c640 1 --2- 172.21.15.60:0/54341316 >> v2:172.21.15.60:3300/0 conn(0x7f3c4c157f00 0x7f3c4c15b120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:33:54.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:54.470+0000 7f3c49d9b640 1 --2- 172.21.15.60:0/54341316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c4c0c7a90 0x7f3c4c0c4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:54.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:54.470+0000 7f3c49d9b640 1 -- 172.21.15.60:0/54341316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c4c0c7a90 msgr2=0x7f3c4c0c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:33:54.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:54.470+0000 7f3c49d9b640 1 -- 172.21.15.60:0/54341316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c4c0c7a90 msgr2=0x7f3c4c0c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:33:54.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:54.470+0000 7f3c49d9b640 1 --2- 172.21.15.60:0/54341316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c4c0c7a90 0x7f3c4c0c4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:33:54.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:54.470+0000 7f3c49d9b640 1 --2- 172.21.15.60:0/54341316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c4c0c7a90 0x7f3c4c0c4c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:33:54.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:54.870+0000 7f3c4ad9d640 1 -- 172.21.15.60:0/54341316 >> v1:172.21.15.60:6789/0 conn(0x7f3c4c0c51b0 legacy=0x7f3c4c0721f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:33:54.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:54.870+0000 7f3c4a59c640 1 -- 172.21.15.60:0/54341316 >> v2:172.21.15.60:3300/0 conn(0x7f3c4c157f00 msgr2=0x7f3c4c15b120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:33:54.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:54.870+0000 7f3c4a59c640 1 --2- 172.21.15.60:0/54341316 >> v2:172.21.15.60:3300/0 conn(0x7f3c4c157f00 0x7f3c4c15b120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:33:54.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:54.871+0000 7f3c49d9b640 1 --2- 172.21.15.60:0/54341316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c4c0c7a90 0x7f3c4c0c4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:54.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:54.871+0000 7f3c49d9b640 1 -- 172.21.15.60:0/54341316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c4c0c7a90 msgr2=0x7f3c4c0c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:33:54.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:54.871+0000 7f3c49d9b640 1 -- 172.21.15.60:0/54341316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c4c0c7a90 msgr2=0x7f3c4c0c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:33:54.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:54.871+0000 7f3c49d9b640 1 --2- 172.21.15.60:0/54341316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c4c0c7a90 0x7f3c4c0c4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:33:54.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:54.871+0000 7f3c49d9b640 1 --2- 172.21.15.60:0/54341316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c4c0c7a90 0x7f3c4c0c4c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:33:55.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:55.671+0000 7f3c4a59c640 1 -- 172.21.15.60:0/54341316 >> v2:172.21.15.60:3300/0 conn(0x7f3c4c157f00 msgr2=0x7f3c4c15b120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:33:55.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:55.671+0000 7f3c4ad9d640 1 -- 172.21.15.60:0/54341316 >> v1:172.21.15.60:6789/0 conn(0x7f3c4c0c51b0 legacy=0x7f3c4c0721f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:33:55.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:55.671+0000 7f3c4a59c640 1 --2- 172.21.15.60:0/54341316 >> v2:172.21.15.60:3300/0 conn(0x7f3c4c157f00 0x7f3c4c15b120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:33:55.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:55.672+0000 7f3c49d9b640 1 --2- 172.21.15.60:0/54341316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c4c0c7a90 0x7f3c4c0c4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:55.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:55.672+0000 7f3c49d9b640 1 -- 172.21.15.60:0/54341316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c4c0c7a90 msgr2=0x7f3c4c0c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:33:55.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:55.672+0000 7f3c49d9b640 1 -- 172.21.15.60:0/54341316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c4c0c7a90 msgr2=0x7f3c4c0c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:33:55.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:55.672+0000 7f3c49d9b640 1 --2- 172.21.15.60:0/54341316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c4c0c7a90 0x7f3c4c0c4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:33:55.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:55.672+0000 7f3c49d9b640 1 --2- 172.21.15.60:0/54341316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c4c0c7a90 0x7f3c4c0c4c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:33:57.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.268+0000 7f3c3bfff640 1 -- 172.21.15.60:0/54341316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c4c0c7a90 msgr2=0x7f3c4c0c4c70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:33:57.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.268+0000 7f3c3bfff640 1 --2- 172.21.15.60:0/54341316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c4c0c7a90 0x7f3c4c0c4c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:57.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.268+0000 7f3c3bfff640 1 -- 172.21.15.60:0/54341316 >> v2:172.21.15.60:3300/0 conn(0x7f3c4c157f00 msgr2=0x7f3c4c15b120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:33:57.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.268+0000 7f3c3bfff640 1 --2- 172.21.15.60:0/54341316 >> v2:172.21.15.60:3300/0 conn(0x7f3c4c157f00 0x7f3c4c15b120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:57.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.268+0000 7f3c3bfff640 1 -- 172.21.15.60:0/54341316 >> v1:172.21.15.60:6789/0 conn(0x7f3c4c0c51b0 legacy=0x7f3c4c0721f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:33:57.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.268+0000 7f3c3bfff640 1 --2- 172.21.15.60:0/54341316 >> v2:172.21.15.105:3300/0 conn(0x7f3c2c0036a0 0x7f3c2c005b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:57.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.268+0000 7f3c3bfff640 1 -- 172.21.15.60:0/54341316 --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c4c0c3a00 con 0x7f3c2c006170 2024-09-12T02:33:57.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.268+0000 7f3c3bfff640 1 -- 172.21.15.60:0/54341316 --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f3c4c0c4050 con 0x7f3c2c0036a0 2024-09-12T02:33:57.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.268+0000 7f3c4a59c640 1 --2- 172.21.15.60:0/54341316 >> v2:172.21.15.105:3300/0 conn(0x7f3c2c0036a0 0x7f3c2c005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:57.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.268+0000 7f3c4a59c640 1 -- 172.21.15.60:0/54341316 >> v2:172.21.15.105:3300/0 conn(0x7f3c2c0036a0 msgr2=0x7f3c2c005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:33:57.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.268+0000 7f3c4a59c640 1 -- 172.21.15.60:0/54341316 >> v2:172.21.15.105:3300/0 conn(0x7f3c2c0036a0 msgr2=0x7f3c2c005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:33:57.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.268+0000 7f3c4a59c640 1 --2- 172.21.15.60:0/54341316 >> v2:172.21.15.105:3300/0 conn(0x7f3c2c0036a0 0x7f3c2c005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:33:57.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.268+0000 7f3c4a59c640 1 --2- 172.21.15.60:0/54341316 >> v2:172.21.15.105:3300/0 conn(0x7f3c2c0036a0 0x7f3c2c005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:33:57.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.469+0000 7f3c4a59c640 1 --2- 172.21.15.60:0/54341316 >> v2:172.21.15.105:3300/0 conn(0x7f3c2c0036a0 0x7f3c2c005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:57.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.469+0000 7f3c4a59c640 1 -- 172.21.15.60:0/54341316 >> v2:172.21.15.105:3300/0 conn(0x7f3c2c0036a0 msgr2=0x7f3c2c005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:33:57.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.469+0000 7f3c4a59c640 1 -- 172.21.15.60:0/54341316 >> v2:172.21.15.105:3300/0 conn(0x7f3c2c0036a0 msgr2=0x7f3c2c005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:33:57.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.469+0000 7f3c4a59c640 1 --2- 172.21.15.60:0/54341316 >> v2:172.21.15.105:3300/0 conn(0x7f3c2c0036a0 0x7f3c2c005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:33:57.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.469+0000 7f3c4a59c640 1 --2- 172.21.15.60:0/54341316 >> v2:172.21.15.105:3300/0 conn(0x7f3c2c0036a0 0x7f3c2c005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:33:57.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.544+0000 7f3c4959a640 1 -- 172.21.15.60:0/54341316 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2703561442 0 0) 0x7f3c4c0c3a00 con 0x7f3c2c006170 2024-09-12T02:33:57.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.544+0000 7f3c4959a640 1 -- 172.21.15.60:0/54341316 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c34003520 con 0x7f3c2c006170 2024-09-12T02:33:57.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.548+0000 7f3c4959a640 1 -- 172.21.15.60:0/54341316 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 441686917 0 0) 0x7f3c34003520 con 0x7f3c2c006170 2024-09-12T02:33:57.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.548+0000 7f3c4959a640 1 -- 172.21.15.60:0/54341316 >> v2:172.21.15.105:3300/0 conn(0x7f3c2c0036a0 msgr2=0x7f3c2c005b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:33:57.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.548+0000 7f3c4959a640 1 --2- 172.21.15.60:0/54341316 >> v2:172.21.15.105:3300/0 conn(0x7f3c2c0036a0 0x7f3c2c005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:57.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.548+0000 7f3c4959a640 1 -- 172.21.15.60:0/54341316 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c4c1582e0 con 0x7f3c2c006170 2024-09-12T02:33:57.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.548+0000 7f3c4959a640 1 -- 172.21.15.60:0/54341316 <== mon.1 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7f3c4000f040 con 0x7f3c2c006170 2024-09-12T02:33:57.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.548+0000 7f3c4959a640 1 -- 172.21.15.60:0/54341316 >> v1:172.21.15.105:6789/0 conn(0x7f3c2c006170 legacy=0x7f3c2c008630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:57.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.548+0000 7f3c4959a640 1 --2- 172.21.15.60:0/54341316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c4c0c7a90 0x7f3c340039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:57.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.548+0000 7f3c4959a640 1 --2- 172.21.15.60:0/54341316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c34004000 0x7f3c34004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:57.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.548+0000 7f3c4959a640 1 --2- 172.21.15.60:0/54341316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3c34004d40 0x7f3c340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:57.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.548+0000 7f3c4959a640 1 -- 172.21.15.60:0/54341316 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4c0c4050 con 0x7f3c34004000 2024-09-12T02:33:57.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.548+0000 7f3c4959a640 1 -- 172.21.15.60:0/54341316 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3c3400bc00 con 0x7f3c34004d40 2024-09-12T02:33:57.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.548+0000 7f3c4959a640 1 -- 172.21.15.60:0/54341316 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3c3400be00 con 0x7f3c4c0c7a90 2024-09-12T02:33:57.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.548+0000 7f3c4ad9d640 1 -- 172.21.15.60:0/54341316 reap_dead start 2024-09-12T02:33:57.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.548+0000 7f3c49d9b640 1 -- 172.21.15.60:0/54341316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c34004000 msgr2=0x7f3c34004800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:33:57.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.548+0000 7f3c49d9b640 1 --2- 172.21.15.60:0/54341316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c34004000 0x7f3c34004800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:33:57.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.548+0000 7f3c4ad9d640 1 --2- 172.21.15.60:0/54341316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3c34004d40 0x7f3c340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:57.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.548+0000 7f3c4a59c640 1 --2- 172.21.15.60:0/54341316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c4c0c7a90 0x7f3c340039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:57.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.549+0000 7f3c4ad9d640 1 -- 172.21.15.60:0/54341316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c4c0c7a90 msgr2=0x7f3c340039d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:57.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.549+0000 7f3c4ad9d640 1 --2- 172.21.15.60:0/54341316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c4c0c7a90 0x7f3c340039d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:57.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.549+0000 7f3c4ad9d640 1 -- 172.21.15.60:0/54341316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c34004000 msgr2=0x7f3c34004800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:33:57.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.549+0000 7f3c4ad9d640 1 --2- 172.21.15.60:0/54341316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c34004000 0x7f3c34004800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:57.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.549+0000 7f3c4ad9d640 1 -- 172.21.15.60:0/54341316 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c4c0c3a00 con 0x7f3c34004d40 2024-09-12T02:33:57.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.549+0000 7f3c4a59c640 1 --2- 172.21.15.60:0/54341316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c4c0c7a90 0x7f3c340039d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:33:57.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.550+0000 7f3c4ad9d640 1 --2- 172.21.15.60:0/54341316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3c34004d40 0x7f3c340051c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c068830 tx=0x7f3c34005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eecb002467c47f21 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:57.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.551+0000 7f3c4959a640 1 -- 172.21.15.60:0/54341316 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c44009030 con 0x7f3c34004d40 2024-09-12T02:33:57.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.551+0000 7f3c4959a640 1 -- 172.21.15.60:0/54341316 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c440335f0 con 0x7f3c34004d40 2024-09-12T02:33:57.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.551+0000 7f3c4959a640 1 -- 172.21.15.60:0/54341316 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c44007a10 con 0x7f3c34004d40 2024-09-12T02:33:57.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.552+0000 7f3c5085e640 1 -- 172.21.15.60:0/54341316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3c34004d40 msgr2=0x7f3c340051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:57.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.552+0000 7f3c5085e640 1 --2- 172.21.15.60:0/54341316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3c34004d40 0x7f3c340051c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c068830 tx=0x7f3c34005830 comp rx=0 tx=0).stop 2024-09-12T02:33:57.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.552+0000 7f3c5085e640 1 -- 172.21.15.60:0/54341316 shutdown_connections 2024-09-12T02:33:57.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.552+0000 7f3c5085e640 1 --2- 172.21.15.60:0/54341316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c34004000 0x7f3c34004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:57.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.552+0000 7f3c5085e640 1 --2- 172.21.15.60:0/54341316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3c34004d40 0x7f3c340051c0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:57.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.552+0000 7f3c5085e640 1 --2- 172.21.15.60:0/54341316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c4c0c7a90 0x7f3c340039d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:57.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.552+0000 7f3c5085e640 1 -- 172.21.15.60:0/54341316 >> 172.21.15.60:0/54341316 conn(0x7f3c4c0c5680 msgr2=0x7f3c4c0c5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:57.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.552+0000 7f3c5085e640 1 -- 172.21.15.60:0/54341316 shutdown_connections 2024-09-12T02:33:57.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.552+0000 7f3c5085e640 1 -- 172.21.15.60:0/54341316 wait complete. 2024-09-12T02:33:57.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.554+0000 7f3c5085e640 1 Processor -- start 2024-09-12T02:33:57.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.554+0000 7f3c5085e640 1 -- start start 2024-09-12T02:33:57.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.555+0000 7f3c5085e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c34004000 0x7f3c4c0a5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:57.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.555+0000 7f3c5085e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3c34004d40 0x7f3c4c1597d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:57.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.555+0000 7f3c4a59c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c34004000 0x7f3c4c0a5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:57.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.555+0000 7f3c4a59c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c34004000 0x7f3c4c0a5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:37242/0 (socket says 172.21.15.60:37242) 2024-09-12T02:33:57.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.555+0000 7f3c49d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3c34004d40 0x7f3c4c1597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:57.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.555+0000 7f3c49d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3c34004d40 0x7f3c4c1597d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:35052/0 (socket says 172.21.15.60:35052) 2024-09-12T02:33:57.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.556+0000 7f3c49d9b640 1 -- 172.21.15.60:0/3927912516 learned_addr learned my addr 172.21.15.60:0/3927912516 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:33:57.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.556+0000 7f3c5085e640 1 --2- 172.21.15.60:0/3927912516 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c4c0c7a90 0x7f3c4c15b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:57.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.556+0000 7f3c5085e640 1 -- 172.21.15.60:0/3927912516 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4c0c44e0 con 0x7f3c4c0c7a90 2024-09-12T02:33:57.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.556+0000 7f3c5085e640 1 -- 172.21.15.60:0/3927912516 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4c0c83c0 con 0x7f3c34004d40 2024-09-12T02:33:57.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.556+0000 7f3c4ad9d640 1 -- 172.21.15.60:0/3927912516 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c4c0c7a90 msgr2=0x7f3c4c15b800 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:33:57.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.556+0000 7f3c5085e640 1 -- 172.21.15.60:0/3927912516 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3c4c15b120 con 0x7f3c34004000 2024-09-12T02:33:57.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.556+0000 7f3c4ad9d640 1 --2- 172.21.15.60:0/3927912516 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c4c0c7a90 0x7f3c4c15b800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:33:57.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.557+0000 7f3c4a59c640 1 -- 172.21.15.60:0/3927912516 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3c34004d40 msgr2=0x7f3c4c1597d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:57.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.557+0000 7f3c4a59c640 1 --2- 172.21.15.60:0/3927912516 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3c34004d40 0x7f3c4c1597d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:57.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.557+0000 7f3c4a59c640 1 -- 172.21.15.60:0/3927912516 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c4c0c7a90 msgr2=0x7f3c4c15b800 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:33:57.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.557+0000 7f3c4a59c640 1 --2- 172.21.15.60:0/3927912516 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c4c0c7a90 0x7f3c4c15b800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:57.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.557+0000 7f3c4a59c640 1 -- 172.21.15.60:0/3927912516 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c4c153410 con 0x7f3c34004000 2024-09-12T02:33:57.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.557+0000 7f3c4a59c640 1 --2- 172.21.15.60:0/3927912516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c34004000 0x7f3c4c0a5f40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009b40 tx=0x7f3c3c00c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:57.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.557+0000 7f3c3affd640 1 -- 172.21.15.60:0/3927912516 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c01c070 con 0x7f3c34004000 2024-09-12T02:33:57.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.558+0000 7f3c5085e640 1 -- 172.21.15.60:0/3927912516 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c4c0a5460 con 0x7f3c34004000 2024-09-12T02:33:57.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.558+0000 7f3c3affd640 1 -- 172.21.15.60:0/3927912516 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c3c00a8b0 con 0x7f3c34004000 2024-09-12T02:33:57.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.558+0000 7f3c5085e640 1 -- 172.21.15.60:0/3927912516 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c4c159d10 con 0x7f3c34004000 2024-09-12T02:33:57.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.558+0000 7f3c3affd640 1 -- 172.21.15.60:0/3927912516 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c026060 con 0x7f3c34004000 2024-09-12T02:33:57.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.559+0000 7f3c5085e640 1 -- 172.21.15.60:0/3927912516 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c4c0c3720 con 0x7f3c34004000 2024-09-12T02:33:57.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.561+0000 7f3c3affd640 1 -- 172.21.15.60:0/3927912516 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3c3c01f070 con 0x7f3c34004000 2024-09-12T02:33:57.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.562+0000 7f3c3affd640 1 --2- 172.21.15.60:0/3927912516 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3c2c06ca90 0x7f3c2c06ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:57.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.562+0000 7f3c3affd640 1 -- 172.21.15.60:0/3927912516 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f3c3c00aa60 con 0x7f3c34004000 2024-09-12T02:33:57.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.562+0000 7f3c49d9b640 1 --2- 172.21.15.60:0/3927912516 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3c2c06ca90 0x7f3c2c06ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:57.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.563+0000 7f3c49d9b640 1 --2- 172.21.15.60:0/3927912516 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3c2c06ca90 0x7f3c2c06ef50 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c0abc00 tx=0x7f3c40008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:57.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:57.568+0000 7f3c3affd640 1 -- 172.21.15.60:0/3927912516 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3c3c059b10 con 0x7f3c34004000 2024-09-12T02:33:58.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.004+0000 7f3c5085e640 1 -- 172.21.15.60:0/3927912516 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3c4c0a83b0 con 0x7f3c34004000 2024-09-12T02:33:58.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.005+0000 7f3c3affd640 1 -- 172.21.15.60:0/3927912516 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1559 (secure 0 0 0) 0x7f3c3c05de10 con 0x7f3c34004000 2024-09-12T02:33:58.005 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":106,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:33:58.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.008+0000 7f3c5085e640 1 -- 172.21.15.60:0/3927912516 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3c2c06ca90 msgr2=0x7f3c2c06ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:58.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.008+0000 7f3c5085e640 1 --2- 172.21.15.60:0/3927912516 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3c2c06ca90 0x7f3c2c06ef50 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c0abc00 tx=0x7f3c40008040 comp rx=0 tx=0).stop 2024-09-12T02:33:58.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.008+0000 7f3c5085e640 1 -- 172.21.15.60:0/3927912516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c34004000 msgr2=0x7f3c4c0a5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:58.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.008+0000 7f3c5085e640 1 --2- 172.21.15.60:0/3927912516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c34004000 0x7f3c4c0a5f40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009b40 tx=0x7f3c3c00c400 comp rx=0 tx=0).stop 2024-09-12T02:33:58.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.008+0000 7f3c5085e640 1 -- 172.21.15.60:0/3927912516 shutdown_connections 2024-09-12T02:33:58.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.008+0000 7f3c5085e640 1 --2- 172.21.15.60:0/3927912516 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3c2c06ca90 0x7f3c2c06ef50 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.008+0000 7f3c5085e640 1 --2- 172.21.15.60:0/3927912516 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c4c0c7a90 0x7f3c4c15b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.008+0000 7f3c5085e640 1 --2- 172.21.15.60:0/3927912516 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3c34004d40 0x7f3c4c1597d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.008+0000 7f3c5085e640 1 --2- 172.21.15.60:0/3927912516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c34004000 0x7f3c4c0a5f40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.008+0000 7f3c5085e640 1 -- 172.21.15.60:0/3927912516 >> 172.21.15.60:0/3927912516 conn(0x7f3c4c0c5680 msgr2=0x7f3c4c0aa190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:58.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.008+0000 7f3c5085e640 1 -- 172.21.15.60:0/3927912516 shutdown_connections 2024-09-12T02:33:58.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.008+0000 7f3c5085e640 1 -- 172.21.15.60:0/3927912516 wait complete. 2024-09-12T02:33:58.022 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-12T02:33:58.022 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-12T02:33:58.022 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-12T02:33:58.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.175+0000 7f76b59c4640 1 Processor -- start 2024-09-12T02:33:58.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.175+0000 7f76b59c4640 1 -- start start 2024-09-12T02:33:58.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.176+0000 7f76b59c4640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f76b0156d80 0x7f76b006e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:58.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.176+0000 7f76b59c4640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76b00c6d00 con 0x7f76b00c5d00 2024-09-12T02:33:58.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.176+0000 7f76b59c4640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76b01561b0 con 0x7f76b0150430 2024-09-12T02:33:58.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.176+0000 7f76b59c4640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f76b006eac0 con 0x7f76b0156d80 2024-09-12T02:33:58.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.176+0000 7f76ae7fc640 1 -- >> v1:172.21.15.60:6789/0 conn(0x7f76b00c5d00 legacy=0x7f76b006dab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:33:58.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.176+0000 7f76aeffd640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f76b0150430 0x7f76b0156670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:56616/0 (socket says 172.21.15.60:56616) 2024-09-12T02:33:58.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.176+0000 7f76aeffd640 1 -- 172.21.15.60:0/2742394708 learned_addr learned my addr 172.21.15.60:0/2742394708 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:33:58.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.177+0000 7f76af7fe640 1 --2- 172.21.15.60:0/2742394708 >> v2:172.21.15.105:3300/0 conn(0x7f76b0156d80 0x7f76b006e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:58.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.177+0000 7f76af7fe640 1 -- 172.21.15.60:0/2742394708 >> v1:172.21.15.105:6789/0 conn(0x7f76b0150430 legacy=0x7f76b0156670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:58.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.177+0000 7f76af7fe640 1 -- 172.21.15.60:0/2742394708 >> v1:172.21.15.60:6789/0 conn(0x7f76b00c5d00 legacy=0x7f76b006dab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:33:58.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.177+0000 7f76af7fe640 1 -- 172.21.15.60:0/2742394708 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76b0159760 con 0x7f76b0156d80 2024-09-12T02:33:58.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.179+0000 7f76af7fe640 1 --2- 172.21.15.60:0/2742394708 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76b0156d80 0x7f76b006e1c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f76a8009d90 tx=0x7f76a802a610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92c5d3d2289612cc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:58.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.179+0000 7f76adffb640 1 -- 172.21.15.60:0/2742394708 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a8031600 con 0x7f76b0156d80 2024-09-12T02:33:58.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.179+0000 7f76adffb640 1 -- 172.21.15.60:0/2742394708 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76a80317a0 con 0x7f76b0156d80 2024-09-12T02:33:58.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.179+0000 7f76adffb640 1 -- 172.21.15.60:0/2742394708 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a8031b70 con 0x7f76b0156d80 2024-09-12T02:33:58.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.180+0000 7f76b59c4640 1 -- 172.21.15.60:0/2742394708 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76b0156d80 msgr2=0x7f76b006e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:58.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.180+0000 7f76b59c4640 1 --2- 172.21.15.60:0/2742394708 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76b0156d80 0x7f76b006e1c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f76a8009d90 tx=0x7f76a802a610 comp rx=0 tx=0).stop 2024-09-12T02:33:58.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.180+0000 7f76b59c4640 1 -- 172.21.15.60:0/2742394708 shutdown_connections 2024-09-12T02:33:58.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.180+0000 7f76b59c4640 1 --2- 172.21.15.60:0/2742394708 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76b0156d80 0x7f76b006e1c0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.180+0000 7f76b59c4640 1 -- 172.21.15.60:0/2742394708 >> 172.21.15.60:0/2742394708 conn(0x7f76b00c7a40 msgr2=0x7f76b00c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:58.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.180+0000 7f76b59c4640 1 -- 172.21.15.60:0/2742394708 shutdown_connections 2024-09-12T02:33:58.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.180+0000 7f76b59c4640 1 -- 172.21.15.60:0/2742394708 wait complete. 2024-09-12T02:33:58.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.182+0000 7f76b59c4640 1 Processor -- start 2024-09-12T02:33:58.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.182+0000 7f76b59c4640 1 -- start start 2024-09-12T02:33:58.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.183+0000 7f76b59c4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76b00c5d00 0x7f76b01e1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:58.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.183+0000 7f76b59c4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76b0150430 0x7f76b0157650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:58.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.183+0000 7f76b59c4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76b0156d80 0x7f76b0157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:58.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.183+0000 7f76b59c4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f76b006e700 con 0x7f76b00c5d00 2024-09-12T02:33:58.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.183+0000 7f76b59c4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f76b00a73c0 con 0x7f76b0156d80 2024-09-12T02:33:58.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.183+0000 7f76b59c4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f76b006e880 con 0x7f76b0150430 2024-09-12T02:33:58.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.183+0000 7f76aeffd640 1 -- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76b00c5d00 msgr2=0x7f76b01e1e40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:33:58.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.183+0000 7f76aeffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76b00c5d00 0x7f76b01e1e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:33:58.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.183+0000 7f76ae7fc640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76b0150430 0x7f76b0157650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:58.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.183+0000 7f76ae7fc640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76b0150430 0x7f76b0157650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:37248/0 (socket says 172.21.15.60:37248) 2024-09-12T02:33:58.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.183+0000 7f76ae7fc640 1 -- 172.21.15.60:0/163319540 learned_addr learned my addr 172.21.15.60:0/163319540 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:33:58.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.183+0000 7f76af7fe640 1 --2- 172.21.15.60:0/163319540 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76b0156d80 0x7f76b0157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:58.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.184+0000 7f76af7fe640 1 -- 172.21.15.60:0/163319540 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76b0150430 msgr2=0x7f76b0157650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:58.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.184+0000 7f76af7fe640 1 --2- 172.21.15.60:0/163319540 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76b0150430 0x7f76b0157650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.184+0000 7f76af7fe640 1 -- 172.21.15.60:0/163319540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76b00c5d00 msgr2=0x7f76b01e1e40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:33:58.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.184+0000 7f76af7fe640 1 --2- 172.21.15.60:0/163319540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76b00c5d00 0x7f76b01e1e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.184+0000 7f76af7fe640 1 -- 172.21.15.60:0/163319540 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76b01e03f0 con 0x7f76b0156d80 2024-09-12T02:33:58.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.184+0000 7f76ae7fc640 1 --2- 172.21.15.60:0/163319540 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76b0150430 0x7f76b0157650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:33:58.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.184+0000 7f76af7fe640 1 --2- 172.21.15.60:0/163319540 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76b0156d80 0x7f76b0157b90 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f76a8031000 tx=0x7f76a8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:58.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.185+0000 7f7697fff640 1 -- 172.21.15.60:0/163319540 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a8040070 con 0x7f76b0156d80 2024-09-12T02:33:58.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.185+0000 7f7697fff640 1 -- 172.21.15.60:0/163319540 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76a8030ba0 con 0x7f76b0156d80 2024-09-12T02:33:58.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.185+0000 7f76b59c4640 1 -- 172.21.15.60:0/163319540 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76b014e8b0 con 0x7f76b0156d80 2024-09-12T02:33:58.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.185+0000 7f7697fff640 1 -- 172.21.15.60:0/163319540 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a8045460 con 0x7f76b0156d80 2024-09-12T02:33:58.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.185+0000 7f76b59c4640 1 -- 172.21.15.60:0/163319540 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76b01e2380 con 0x7f76b0156d80 2024-09-12T02:33:58.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.186+0000 7f76b59c4640 1 --2- 172.21.15.60:0/163319540 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76b01dff10 0x7f76b01ef140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:58.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.186+0000 7f76b59c4640 1 -- 172.21.15.60:0/163319540 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f76b0150810 con 0x7f76b01dff10 2024-09-12T02:33:58.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.187+0000 7f76aeffd640 1 --2- 172.21.15.60:0/163319540 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76b01dff10 0x7f76b01ef140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:58.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.187+0000 7f7697fff640 1 -- 172.21.15.60:0/163319540 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f76a8039040 con 0x7f76b0156d80 2024-09-12T02:33:58.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.188+0000 7f7697fff640 1 --2- 172.21.15.60:0/163319540 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f769c06be10 0x7f769c06e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:58.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.188+0000 7f7697fff640 1 -- 172.21.15.60:0/163319540 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f76a80ac400 con 0x7f76b0156d80 2024-09-12T02:33:58.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.188+0000 7f76aeffd640 1 -- 172.21.15.60:0/163319540 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f76b014e660 con 0x7f76b01dff10 2024-09-12T02:33:58.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.188+0000 7f76ae7fc640 1 --2- 172.21.15.60:0/163319540 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f769c06be10 0x7f769c06e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:58.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.189+0000 7f76ae7fc640 1 --2- 172.21.15.60:0/163319540 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f769c06be10 0x7f769c06e2d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f76b01e3360 tx=0x7f76a4009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:58.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.189+0000 7f76aeffd640 1 --2- 172.21.15.60:0/163319540 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76b01dff10 0x7f76b01ef140 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f76a0004810 tx=0x7f76a000c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:58.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.189+0000 7f7697fff640 1 -- 172.21.15.60:0/163319540 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a0017070 con 0x7f76b01dff10 2024-09-12T02:33:58.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.190+0000 7f7697fff640 1 -- 172.21.15.60:0/163319540 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f76a0005ce0 con 0x7f76b01dff10 2024-09-12T02:33:58.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.190+0000 7f7697fff640 1 -- 172.21.15.60:0/163319540 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76b01dff10 msgr2=0x7f76b01ef140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:58.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.190+0000 7f7697fff640 1 --2- 172.21.15.60:0/163319540 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76b01dff10 0x7f76b01ef140 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f76a0004810 tx=0x7f76a000c8e0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.190+0000 7f7697fff640 1 -- 172.21.15.60:0/163319540 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76b01dff10 msgr2=0x7f76b01ef140 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:33:58.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.190+0000 7f7697fff640 1 --2- 172.21.15.60:0/163319540 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76b01dff10 0x7f76b01ef140 secure :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f76a0004810 tx=0x7f76a000c8e0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.202+0000 7f76b59c4640 1 --2- 172.21.15.60:0/163319540 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76b01e1230 0x7f76b01ef680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:58.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.202+0000 7f76b59c4640 1 -- 172.21.15.60:0/163319540 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f76b00764a0 con 0x7f76b01e1230 2024-09-12T02:33:58.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.202+0000 7f76aeffd640 1 --2- 172.21.15.60:0/163319540 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76b01e1230 0x7f76b01ef680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:58.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.203+0000 7f76aeffd640 1 -- 172.21.15.60:0/163319540 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f76b014fa90 con 0x7f76b01e1230 2024-09-12T02:33:58.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.203+0000 7f76aeffd640 1 --2- 172.21.15.60:0/163319540 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76b01e1230 0x7f76b01ef680 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f76a0011000 tx=0x7f76a0000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:58.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.204+0000 7f7697fff640 1 -- 172.21.15.60:0/163319540 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a0017030 con 0x7f76b01e1230 2024-09-12T02:33:58.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.204+0000 7f7697fff640 1 -- 172.21.15.60:0/163319540 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5042 (secure 0 0 0) 0x7f76a001ab70 con 0x7f76b01e1230 2024-09-12T02:33:58.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.204+0000 7f7697fff640 1 -- 172.21.15.60:0/163319540 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76b01e1230 msgr2=0x7f76b01ef680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:58.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.204+0000 7f7697fff640 1 --2- 172.21.15.60:0/163319540 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76b01e1230 0x7f76b01ef680 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f76a0011000 tx=0x7f76a0000bc0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.204+0000 7f7697fff640 1 -- 172.21.15.60:0/163319540 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76b01e1230 msgr2=0x7f76b01ef680 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:33:58.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.204+0000 7f7697fff640 1 --2- 172.21.15.60:0/163319540 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76b01e1230 0x7f76b01ef680 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.208 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:33:58.208 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:33:58.208 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:33:58.208 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:33:58.208 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 106, 2024-09-12T02:33:58.208 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 583639, 2024-09-12T02:33:58.208 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:33:58.208 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:33:58.209 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:33:58.209 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:33:58.209 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-09-12T02:33:58.209 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:33:58.209 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:33:58.209 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:33:58.209 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:33:58.209 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:33:58.209 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:33:58.209 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:33:58.209 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:33:58.209 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:33:58.210 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:33:58.210 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:33:58.210 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:33:58.210 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:33:58.210 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:33:58.210 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:33:58.210 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:33:58.210 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:33:58.210 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:33:58.210 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:33:58.210 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:33:58.210 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:33:58.210 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:33:58.210 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:33:58.211 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:33:58.211 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:33:58.211 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:33:58.211 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:33:58.211 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:33:58.211 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:58.211 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:58.211 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:33:58.211 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:33:58.211 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:33:58.211 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:33:58.211 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:33:58.211 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:33:58.212 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:33:58.212 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:33:58.212 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:33:58.212 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:33:58.212 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:33:58.212 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:33:58.212 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:33:58.212 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:33:58.212 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:33:58.212 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:33:58.212 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:33:58.212 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:33:58.212 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:33:58.212 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:33:58.213 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:33:58.213 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:33:58.213 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:33:58.213 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:33:58.213 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:33:58.213 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:33:58.213 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:33:58.213 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:33:58.213 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:33:58.213 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:33:58.213 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:58.213 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:33:58.213 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:58.214 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:33:58.214 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:33:58.214 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:33:58.214 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:33:58.214 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:58.214 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:33:58.214 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:33:58.214 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:58.214 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:58.214 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:58.215 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:33:58.215 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:33:58.215 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:58.215 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:58.215 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:58.215 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:58.215 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:33:58.215 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:33:58.215 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:33:58.215 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:33:58.215 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:33:58.215 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:58.215 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:58.215 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:33:58.216 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:33:58.216 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:33:58.216 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:33:58.216 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:58.216 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:33:58.216 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:33:58.216 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:58.216 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:58.216 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:58.216 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:33:58.216 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:33:58.216 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:58.216 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:58.216 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:58.217 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:58.217 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:33:58.217 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:33:58.217 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:33:58.217 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:33:58.217 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:33:58.217 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:58.217 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:58.217 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:33:58.217 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:33:58.217 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:33:58.217 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:33:58.218 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:58.218 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:33:58.218 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:33:58.218 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:58.218 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:58.218 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:58.218 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:33:58.218 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:33:58.218 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:58.218 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:58.218 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:58.218 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:58.218 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:33:58.219 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:33:58.219 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:33:58.219 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:33:58.219 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:33:58.219 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:58.219 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:58.219 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:58.219 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:33:58.219 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:33:58.219 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:58.219 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:33:58.219 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:33:58.219 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:33:58.220 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:58.220 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:33:58.220 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:33:58.220 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:58.220 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:33:58.220 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:33:58.220 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:33:58.220 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:58.220 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:33:58.220 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:33:58.220 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:58.220 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:33:58.220 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:33:58.221 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 8 2024-09-12T02:33:58.221 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:58.221 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:33:58.221 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:33:58.221 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:58.221 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:33:58.221 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:33:58.221 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 8 2024-09-12T02:33:58.221 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:58.221 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:33:58.221 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:33:58.221 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:58.221 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:33:58.222 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:33:58.222 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:33:58.222 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:58.222 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:58.222 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:58.222 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:33:58.222 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:33:58.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.204+0000 7f76b59c4640 1 -- 172.21.15.60:0/163319540 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f769c06be10 msgr2=0x7f769c06e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:58.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.204+0000 7f76b59c4640 1 --2- 172.21.15.60:0/163319540 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f769c06be10 0x7f769c06e2d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f76b01e3360 tx=0x7f76a4009190 comp rx=0 tx=0).stop 2024-09-12T02:33:58.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.204+0000 7f76b59c4640 1 -- 172.21.15.60:0/163319540 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76b0156d80 msgr2=0x7f76b0157b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:58.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.204+0000 7f76b59c4640 1 --2- 172.21.15.60:0/163319540 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76b0156d80 0x7f76b0157b90 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f76a8031000 tx=0x7f76a8004a40 comp rx=0 tx=0).stop 2024-09-12T02:33:58.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.205+0000 7f76af7fe640 1 -- 172.21.15.60:0/163319540 reap_dead start 2024-09-12T02:33:58.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.205+0000 7f76af7fe640 1 -- 172.21.15.60:0/163319540 reap_dead start 2024-09-12T02:33:58.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.205+0000 7f76b59c4640 1 -- 172.21.15.60:0/163319540 shutdown_connections 2024-09-12T02:33:58.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.205+0000 7f76b59c4640 1 -- 172.21.15.60:0/163319540 >> 172.21.15.60:0/163319540 conn(0x7f76b00c7a40 msgr2=0x7f76b006dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:58.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.205+0000 7f76b59c4640 1 -- 172.21.15.60:0/163319540 shutdown_connections 2024-09-12T02:33:58.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.205+0000 7f76b59c4640 1 -- 172.21.15.60:0/163319540 wait complete. 2024-09-12T02:33:58.224 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-12T02:33:58.224 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-12T02:33:58.224 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-12T02:33:58.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.379+0000 7f1bc91b7640 1 Processor -- start 2024-09-12T02:33:58.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.379+0000 7f1bc91b7640 1 -- start start 2024-09-12T02:33:58.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.380+0000 7f1bc91b7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1bc40c59d0 0x7f1bc40acb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:58.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.380+0000 7f1bc91b7640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bc40c3e60 con 0x7f1bc40c55f0 2024-09-12T02:33:58.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.380+0000 7f1bc91b7640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bc40c8580 con 0x7f1bc40addf0 2024-09-12T02:33:58.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.380+0000 7f1bc91b7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1bc40c4120 con 0x7f1bc40c59d0 2024-09-12T02:33:58.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.380+0000 7f1bc2d9d640 1 -- >> v1:172.21.15.60:6789/0 conn(0x7f1bc40c55f0 legacy=0x7f1bc40ac470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:33:58.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.380+0000 7f1bc259c640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f1bc40addf0 0x7f1bc4157c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:56628/0 (socket says 172.21.15.60:56628) 2024-09-12T02:33:58.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.380+0000 7f1bc259c640 1 -- 172.21.15.60:0/1758984010 learned_addr learned my addr 172.21.15.60:0/1758984010 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:33:58.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.381+0000 7f1bc1d9b640 1 -- 172.21.15.60:0/1758984010 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4056760235 0 0) 0x7f1bc40c8580 con 0x7f1bc40addf0 2024-09-12T02:33:58.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.381+0000 7f1bc1d9b640 1 -- 172.21.15.60:0/1758984010 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1bb0003520 con 0x7f1bc40addf0 2024-09-12T02:33:58.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.381+0000 7f1bc359e640 1 --2- 172.21.15.60:0/1758984010 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1bc40c59d0 0x7f1bc40acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:58.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.381+0000 7f1bc1d9b640 1 -- 172.21.15.60:0/1758984010 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2161627066 0 0) 0x7f1bb0003520 con 0x7f1bc40addf0 2024-09-12T02:33:58.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.381+0000 7f1bc1d9b640 1 -- 172.21.15.60:0/1758984010 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1bc40c59d0 msgr2=0x7f1bc40acb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:58.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.381+0000 7f1bc1d9b640 1 --2- 172.21.15.60:0/1758984010 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1bc40c59d0 0x7f1bc40acb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.381+0000 7f1bc1d9b640 1 -- 172.21.15.60:0/1758984010 >> v1:172.21.15.60:6789/0 conn(0x7f1bc40c55f0 legacy=0x7f1bc40ac470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:33:58.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.381+0000 7f1bc1d9b640 1 -- 172.21.15.60:0/1758984010 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bc40c4400 con 0x7f1bc40addf0 2024-09-12T02:33:58.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.381+0000 7f1bc1d9b640 1 -- 172.21.15.60:0/1758984010 <== mon.1 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7f1bac001670 con 0x7f1bc40addf0 2024-09-12T02:33:58.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.381+0000 7f1bc1d9b640 1 -- 172.21.15.60:0/1758984010 >> v1:172.21.15.105:6789/0 conn(0x7f1bc40addf0 legacy=0x7f1bc4157c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:58.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.381+0000 7f1bc1d9b640 1 --2- 172.21.15.60:0/1758984010 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1bc40c59d0 0x7f1bb00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:58.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.381+0000 7f1bc1d9b640 1 --2- 172.21.15.60:0/1758984010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bb0003f10 0x7f1bb0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:58.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.381+0000 7f1bc1d9b640 1 --2- 172.21.15.60:0/1758984010 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1bb0004d40 0x7f1bb00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:58.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.381+0000 7f1bc1d9b640 1 -- 172.21.15.60:0/1758984010 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc40c4120 con 0x7f1bb0003f10 2024-09-12T02:33:58.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.381+0000 7f1bc1d9b640 1 -- 172.21.15.60:0/1758984010 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb000ba70 con 0x7f1bb0004d40 2024-09-12T02:33:58.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.381+0000 7f1bc1d9b640 1 -- 172.21.15.60:0/1758984010 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1bb000bc70 con 0x7f1bc40c59d0 2024-09-12T02:33:58.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.381+0000 7f1bc259c640 1 -- 172.21.15.60:0/1758984010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bb0003f10 msgr2=0x7f1bb0004800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:33:58.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.381+0000 7f1bc259c640 1 --2- 172.21.15.60:0/1758984010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bb0003f10 0x7f1bb0004800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:33:58.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.381+0000 7f1bc2d9d640 1 --2- 172.21.15.60:0/1758984010 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1bc40c59d0 0x7f1bb00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:58.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.382+0000 7f1bc359e640 1 --2- 172.21.15.60:0/1758984010 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1bb0004d40 0x7f1bb00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:58.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.382+0000 7f1bc2d9d640 1 -- 172.21.15.60:0/1758984010 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1bb0004d40 msgr2=0x7f1bb00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:33:58.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.382+0000 7f1bc2d9d640 1 --2- 172.21.15.60:0/1758984010 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1bb0004d40 0x7f1bb00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.382+0000 7f1bc2d9d640 1 -- 172.21.15.60:0/1758984010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bb0003f10 msgr2=0x7f1bb0004800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:33:58.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.382+0000 7f1bc2d9d640 1 --2- 172.21.15.60:0/1758984010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bb0003f10 0x7f1bb0004800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.382+0000 7f1bc2d9d640 1 -- 172.21.15.60:0/1758984010 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bc40c4400 con 0x7f1bc40c59d0 2024-09-12T02:33:58.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.383+0000 7f1bc2d9d640 1 --2- 172.21.15.60:0/1758984010 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1bc40c59d0 0x7f1bb00039b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4009e30 tx=0x7f1bb0005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f700d5ecd3dd923 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:58.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.383+0000 7f1bc1d9b640 1 -- 172.21.15.60:0/1758984010 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb4009a30 con 0x7f1bc40c59d0 2024-09-12T02:33:58.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.383+0000 7f1bc1d9b640 1 -- 172.21.15.60:0/1758984010 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bb402c040 con 0x7f1bc40c59d0 2024-09-12T02:33:58.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.383+0000 7f1bc1d9b640 1 -- 172.21.15.60:0/1758984010 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb4030870 con 0x7f1bc40c59d0 2024-09-12T02:33:58.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.384+0000 7f1bc91b7640 1 -- 172.21.15.60:0/1758984010 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1bc40c59d0 msgr2=0x7f1bb00039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:58.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.384+0000 7f1bc91b7640 1 --2- 172.21.15.60:0/1758984010 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1bc40c59d0 0x7f1bb00039b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4009e30 tx=0x7f1bb0005830 comp rx=0 tx=0).stop 2024-09-12T02:33:58.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.384+0000 7f1bc359e640 1 -- 172.21.15.60:0/1758984010 reap_dead start 2024-09-12T02:33:58.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.385+0000 7f1bc91b7640 1 -- 172.21.15.60:0/1758984010 shutdown_connections 2024-09-12T02:33:58.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.385+0000 7f1bc91b7640 1 -- 172.21.15.60:0/1758984010 >> 172.21.15.60:0/1758984010 conn(0x7f1bc40c8a50 msgr2=0x7f1bc40c8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:58.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.386+0000 7f1bc91b7640 1 -- 172.21.15.60:0/1758984010 shutdown_connections 2024-09-12T02:33:58.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.386+0000 7f1bc91b7640 1 -- 172.21.15.60:0/1758984010 wait complete. 2024-09-12T02:33:58.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.388+0000 7f1bc91b7640 1 Processor -- start 2024-09-12T02:33:58.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.389+0000 7f1bc91b7640 1 -- start start 2024-09-12T02:33:58.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.390+0000 7f1bc91b7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1bc40c59d0 0x7f1bc40ab000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:58.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.390+0000 7f1bc91b7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bc40c2850 0x7f1bc40aa600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:58.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.390+0000 7f1bc91b7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1bc41600b0 0x7f1bc4160530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:58.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.390+0000 7f1bc91b7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc40c35d0 con 0x7f1bc40c2850 2024-09-12T02:33:58.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.390+0000 7f1bc91b7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc40c3450 con 0x7f1bc41600b0 2024-09-12T02:33:58.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.390+0000 7f1bc91b7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1bc40abb00 con 0x7f1bc40c59d0 2024-09-12T02:33:58.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.390+0000 7f1bc259c640 1 -- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bc40c2850 msgr2=0x7f1bc40aa600 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:33:58.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.390+0000 7f1bc259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bc40c2850 0x7f1bc40aa600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:33:58.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.390+0000 7f1bc359e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1bc41600b0 0x7f1bc4160530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:58.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.390+0000 7f1bc359e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1bc41600b0 0x7f1bc4160530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:35130/0 (socket says 172.21.15.60:35130) 2024-09-12T02:33:58.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.390+0000 7f1bc359e640 1 -- 172.21.15.60:0/120062218 learned_addr learned my addr 172.21.15.60:0/120062218 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:33:58.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.390+0000 7f1bc2d9d640 1 --2- 172.21.15.60:0/120062218 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1bc40c59d0 0x7f1bc40ab000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:58.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.391+0000 7f1bc359e640 1 -- 172.21.15.60:0/120062218 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1bc40c59d0 msgr2=0x7f1bc40ab000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:58.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.391+0000 7f1bc359e640 1 --2- 172.21.15.60:0/120062218 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1bc40c59d0 0x7f1bc40ab000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.391+0000 7f1bc359e640 1 -- 172.21.15.60:0/120062218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bc40c2850 msgr2=0x7f1bc40aa600 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:33:58.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.391+0000 7f1bc359e640 1 --2- 172.21.15.60:0/120062218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bc40c2850 0x7f1bc40aa600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.391+0000 7f1bc359e640 1 -- 172.21.15.60:0/120062218 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bc4154580 con 0x7f1bc41600b0 2024-09-12T02:33:58.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.391+0000 7f1bc359e640 1 --2- 172.21.15.60:0/120062218 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1bc41600b0 0x7f1bc4160530 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1bc40c5e20 tx=0x7f1bbc011cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:58.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.392+0000 7f1bbb7fe640 1 -- 172.21.15.60:0/120062218 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc019020 con 0x7f1bc41600b0 2024-09-12T02:33:58.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.392+0000 7f1bbb7fe640 1 -- 172.21.15.60:0/120062218 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bbc004240 con 0x7f1bc41600b0 2024-09-12T02:33:58.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.392+0000 7f1bbb7fe640 1 -- 172.21.15.60:0/120062218 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc019020 con 0x7f1bc41600b0 2024-09-12T02:33:58.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.393+0000 7f1bc91b7640 1 -- 172.21.15.60:0/120062218 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bc4154860 con 0x7f1bc41600b0 2024-09-12T02:33:58.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.393+0000 7f1bc91b7640 1 -- 172.21.15.60:0/120062218 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bc4154e20 con 0x7f1bc41600b0 2024-09-12T02:33:58.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.394+0000 7f1bc91b7640 1 --2- 172.21.15.60:0/120062218 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1bc4155020 0x7f1bc41ef150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:58.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.394+0000 7f1bc91b7640 1 -- 172.21.15.60:0/120062218 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1bc4069a00 con 0x7f1bc4155020 2024-09-12T02:33:58.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.394+0000 7f1bc2d9d640 1 --2- 172.21.15.60:0/120062218 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1bc4155020 0x7f1bc41ef150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:58.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.395+0000 7f1bc2d9d640 1 -- 172.21.15.60:0/120062218 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1bc4069190 con 0x7f1bc4155020 2024-09-12T02:33:58.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.396+0000 7f1bbb7fe640 1 -- 172.21.15.60:0/120062218 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1bbc01c020 con 0x7f1bc41600b0 2024-09-12T02:33:58.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.396+0000 7f1bbb7fe640 1 --2- 172.21.15.60:0/120062218 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1ba406c1e0 0x7f1ba406e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:58.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.397+0000 7f1bbb7fe640 1 -- 172.21.15.60:0/120062218 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f1bbc00f040 con 0x7f1bc41600b0 2024-09-12T02:33:58.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.397+0000 7f1bc2d9d640 1 --2- 172.21.15.60:0/120062218 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1bc4155020 0x7f1bc41ef150 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4003d00 tx=0x7f1bb4005d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:58.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.397+0000 7f1bc259c640 1 --2- 172.21.15.60:0/120062218 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1ba406c1e0 0x7f1ba406e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:58.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.397+0000 7f1bbb7fe640 1 -- 172.21.15.60:0/120062218 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb403b860 con 0x7f1bc4155020 2024-09-12T02:33:58.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.397+0000 7f1bc259c640 1 --2- 172.21.15.60:0/120062218 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1ba406c1e0 0x7f1ba406e6a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1bac000f60 tx=0x7f1bac0014b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:58.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.397+0000 7f1bbb7fe640 1 -- 172.21.15.60:0/120062218 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f1bb4009ae0 con 0x7f1bc4155020 2024-09-12T02:33:58.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.397+0000 7f1bbb7fe640 1 -- 172.21.15.60:0/120062218 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1bc4155020 msgr2=0x7f1bc41ef150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:58.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.397+0000 7f1bbb7fe640 1 --2- 172.21.15.60:0/120062218 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1bc4155020 0x7f1bc41ef150 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4003d00 tx=0x7f1bb4005d90 comp rx=0 tx=0).stop 2024-09-12T02:33:58.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.397+0000 7f1bbb7fe640 1 -- 172.21.15.60:0/120062218 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1bc4155020 msgr2=0x7f1bc41ef150 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:33:58.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.397+0000 7f1bbb7fe640 1 --2- 172.21.15.60:0/120062218 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1bc4155020 0x7f1bc41ef150 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.410+0000 7f1bc91b7640 1 --2- 172.21.15.60:0/120062218 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1bc41ef690 0x7f1bc41efa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:58.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.410+0000 7f1bc91b7640 1 -- 172.21.15.60:0/120062218 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1bc40c7d40 con 0x7f1bc41ef690 2024-09-12T02:33:58.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.410+0000 7f1bc2d9d640 1 --2- 172.21.15.60:0/120062218 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1bc41ef690 0x7f1bc41efa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:58.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.411+0000 7f1bc2d9d640 1 -- 172.21.15.60:0/120062218 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1bc4073ee0 con 0x7f1bc41ef690 2024-09-12T02:33:58.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.411+0000 7f1bc2d9d640 1 --2- 172.21.15.60:0/120062218 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1bc41ef690 0x7f1bc41efa70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1bc40c6210 tx=0x7f1bb402f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:58.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.412+0000 7f1bbb7fe640 1 -- 172.21.15.60:0/120062218 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb4057440 con 0x7f1bc41ef690 2024-09-12T02:33:58.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.412+0000 7f1bbb7fe640 1 -- 172.21.15.60:0/120062218 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4539 (secure 0 0 0) 0x7f1bb4057440 con 0x7f1bc41ef690 2024-09-12T02:33:58.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.412+0000 7f1bbb7fe640 1 -- 172.21.15.60:0/120062218 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1bc41ef690 msgr2=0x7f1bc41efa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:58.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.412+0000 7f1bbb7fe640 1 --2- 172.21.15.60:0/120062218 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1bc41ef690 0x7f1bc41efa70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1bc40c6210 tx=0x7f1bb402f000 comp rx=0 tx=0).stop 2024-09-12T02:33:58.413 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:33:58.413 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:33:58.414 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:33:58.414 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:33:58.414 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 106, 2024-09-12T02:33:58.414 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 112166, 2024-09-12T02:33:58.414 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:33:58.414 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:33:58.414 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:33:58.415 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:33:58.415 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-09-12T02:33:58.415 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:33:58.415 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:33:58.415 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:33:58.415 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:33:58.415 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:33:58.415 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:33:58.415 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:33:58.415 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:33:58.415 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:33:58.416 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:33:58.416 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:33:58.416 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:33:58.416 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:33:58.416 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:33:58.416 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:33:58.416 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:33:58.416 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:33:58.416 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:33:58.416 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:33:58.416 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:33:58.416 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:33:58.416 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:33:58.417 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:33:58.417 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:33:58.417 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:33:58.417 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:33:58.417 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:33:58.417 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:33:58.417 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:58.417 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:58.417 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:33:58.417 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:33:58.418 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:33:58.418 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:33:58.418 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:33:58.418 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:33:58.418 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:33:58.418 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:33:58.418 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:33:58.418 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:33:58.418 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:33:58.418 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:33:58.418 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:33:58.419 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:33:58.419 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:33:58.419 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:33:58.419 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:33:58.419 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:33:58.419 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:33:58.419 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:33:58.419 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:33:58.419 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:33:58.419 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:33:58.419 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:33:58.419 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:33:58.419 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:33:58.420 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:33:58.420 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:33:58.420 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:33:58.420 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:33:58.420 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:58.420 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:33:58.420 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:58.420 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:33:58.420 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:33:58.420 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:33:58.420 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:33:58.420 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:58.421 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:33:58.421 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:33:58.421 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:58.421 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:58.421 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:58.421 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:33:58.421 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:33:58.421 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:58.421 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:58.421 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:58.421 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:58.421 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:33:58.421 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:33:58.422 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:33:58.422 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:33:58.422 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:33:58.422 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:58.422 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:58.422 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:33:58.422 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:33:58.422 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:33:58.422 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:33:58.422 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:58.422 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:33:58.422 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:33:58.423 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:58.423 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:58.423 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:58.423 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:33:58.423 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:33:58.423 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:58.423 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:58.424 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:58.424 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:58.424 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:33:58.424 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:33:58.424 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:33:58.424 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:33:58.424 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:33:58.424 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:58.424 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:58.424 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:33:58.424 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:33:58.424 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:33:58.425 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:33:58.425 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:58.425 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:33:58.425 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:33:58.425 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:58.425 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:58.425 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:58.425 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:33:58.425 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:33:58.425 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:33:58.425 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:58.425 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:58.425 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:58.426 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:33:58.426 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:33:58.426 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:33:58.426 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:33:58.426 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:33:58.426 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:58.426 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:58.426 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:58.426 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:33:58.426 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:33:58.426 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:58.426 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:33:58.427 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:33:58.427 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:33:58.427 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:58.427 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:33:58.427 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:33:58.427 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:33:58.427 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:33:58.427 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:33:58.427 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:33:58.427 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:33:58.427 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:33:58.427 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:33:58.427 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:33:58.428 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:33:58.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.412+0000 7f1bbb7fe640 1 -- 172.21.15.60:0/120062218 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1bc41ef690 msgr2=0x7f1bc41efa70 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:33:58.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.412+0000 7f1bbb7fe640 1 --2- 172.21.15.60:0/120062218 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1bc41ef690 0x7f1bc41efa70 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1bc40c6210 tx=0x7f1bb402f000 comp rx=0 tx=0).stop 2024-09-12T02:33:58.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.413+0000 7f1bc91b7640 1 -- 172.21.15.60:0/120062218 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1ba406c1e0 msgr2=0x7f1ba406e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:58.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.413+0000 7f1bc91b7640 1 --2- 172.21.15.60:0/120062218 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1ba406c1e0 0x7f1ba406e6a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1bac000f60 tx=0x7f1bac0014b0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.413+0000 7f1bc359e640 1 -- 172.21.15.60:0/120062218 reap_dead start 2024-09-12T02:33:58.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.413+0000 7f1bc91b7640 1 -- 172.21.15.60:0/120062218 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1bc41600b0 msgr2=0x7f1bc4160530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:58.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.413+0000 7f1bc91b7640 1 --2- 172.21.15.60:0/120062218 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1bc41600b0 0x7f1bc4160530 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1bc40c5e20 tx=0x7f1bbc011cf0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.413+0000 7f1bc91b7640 1 -- 172.21.15.60:0/120062218 shutdown_connections 2024-09-12T02:33:58.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.413+0000 7f1bc91b7640 1 --2- 172.21.15.60:0/120062218 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1bc41600b0 0x7f1bc4160530 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:58.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.413+0000 7f1bc91b7640 1 -- 172.21.15.60:0/120062218 >> 172.21.15.60:0/120062218 conn(0x7f1bc40c8a50 msgr2=0x7f1bc4156db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:58.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.413+0000 7f1bc91b7640 1 -- 172.21.15.60:0/120062218 shutdown_connections 2024-09-12T02:33:58.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:33:58.413+0000 7f1bc91b7640 1 -- 172.21.15.60:0/120062218 wait complete. 2024-09-12T02:33:58.430 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-12T02:33:58.431 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-12T02:34:00.203 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:34:00.206 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:34:18.431 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-12T02:34:18.431 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-09-12T02:34:18.431 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T02:34:18.432 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T02:34:18.434 INFO:tasks.ceph.mon.a:Started 2024-09-12T02:34:18.435 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-12T02:34:18.435 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:34:18.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.587+0000 7f9dea442640 1 Processor -- start 2024-09-12T02:34:18.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.588+0000 7f9dea442640 1 -- start start 2024-09-12T02:34:18.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.589+0000 7f9dea442640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9de414fa90 0x7f9de40c2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:18.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.589+0000 7f9dea442640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9de406f1d0 0x7f9de40c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:18.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.589+0000 7f9dea442640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9de40c4a10 0x7f9de4152a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:18.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.589+0000 7f9de89df640 1 -- >> v2:172.21.15.60:3300/0 conn(0x7f9de40c4a10 msgr2=0x7f9de4152a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:34:18.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.589+0000 7f9de3fff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9de414fa90 0x7f9de40c2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:18.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.589+0000 7f9de3fff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9de414fa90 0x7f9de40c2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:45204/0 (socket says 172.21.15.60:45204) 2024-09-12T02:34:18.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.589+0000 7f9de3fff640 1 -- 172.21.15.60:0/2470051587 learned_addr learned my addr 172.21.15.60:0/2470051587 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:34:18.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.589+0000 7f9de89df640 1 --2- 172.21.15.60:0/2470051587 >> v2:172.21.15.60:3300/0 conn(0x7f9de40c4a10 0x7f9de4152a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:34:18.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.589+0000 7f9dea442640 1 -- 172.21.15.60:0/2470051587 --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f9de40c72b0 con 0x7f9de40c4a10 2024-09-12T02:34:18.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.589+0000 7f9dea442640 1 -- 172.21.15.60:0/2470051587 --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f9de4152580 con 0x7f9de414fa90 2024-09-12T02:34:18.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.589+0000 7f9dea442640 1 -- 172.21.15.60:0/2470051587 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9de40c7500 con 0x7f9de406f1d0 2024-09-12T02:34:18.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.591+0000 7f9ddbfff640 1 --2- 172.21.15.60:0/2470051587 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9de406f1d0 0x7f9de40c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:18.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.591+0000 7f9de3fff640 1 -- 172.21.15.60:0/2470051587 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9de406f1d0 msgr2=0x7f9de40c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:18.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.591+0000 7f9de3fff640 1 --2- 172.21.15.60:0/2470051587 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9de406f1d0 0x7f9de40c44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:18.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.591+0000 7f9de3fff640 1 -- 172.21.15.60:0/2470051587 >> v2:172.21.15.60:3300/0 conn(0x7f9de40c4a10 msgr2=0x7f9de4152a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:34:18.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.591+0000 7f9de3fff640 1 --2- 172.21.15.60:0/2470051587 >> v2:172.21.15.60:3300/0 conn(0x7f9de40c4a10 0x7f9de4152a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:18.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.591+0000 7f9de3fff640 1 -- 172.21.15.60:0/2470051587 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9de4156300 con 0x7f9de414fa90 2024-09-12T02:34:18.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.593+0000 7f9de3fff640 1 --2- 172.21.15.60:0/2470051587 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9de414fa90 0x7f9de40c2e50 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9de40c5060 tx=0x7f9dd402aa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6bcf37063346d30 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:18.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.593+0000 7f9de37fe640 1 -- 172.21.15.60:0/2470051587 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd4033070 con 0x7f9de414fa90 2024-09-12T02:34:18.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.593+0000 7f9de37fe640 1 -- 172.21.15.60:0/2470051587 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dd402f860 con 0x7f9de414fa90 2024-09-12T02:34:18.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.593+0000 7f9de37fe640 1 -- 172.21.15.60:0/2470051587 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd402fc30 con 0x7f9de414fa90 2024-09-12T02:34:18.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.594+0000 7f9dea442640 1 -- 172.21.15.60:0/2470051587 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9de414fa90 msgr2=0x7f9de40c2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:18.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.594+0000 7f9dea442640 1 --2- 172.21.15.60:0/2470051587 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9de414fa90 0x7f9de40c2e50 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9de40c5060 tx=0x7f9dd402aa00 comp rx=0 tx=0).stop 2024-09-12T02:34:18.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.594+0000 7f9dea442640 1 -- 172.21.15.60:0/2470051587 shutdown_connections 2024-09-12T02:34:18.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.594+0000 7f9dea442640 1 --2- 172.21.15.60:0/2470051587 >> v2:172.21.15.60:3300/0 conn(0x7f9de40c4a10 0x7f9de4152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:18.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.594+0000 7f9dea442640 1 --2- 172.21.15.60:0/2470051587 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9de406f1d0 0x7f9de40c44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:18.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.594+0000 7f9dea442640 1 --2- 172.21.15.60:0/2470051587 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9de414fa90 0x7f9de40c2e50 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:18.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.594+0000 7f9dea442640 1 -- 172.21.15.60:0/2470051587 >> 172.21.15.60:0/2470051587 conn(0x7f9de40c7a40 msgr2=0x7f9de40c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:18.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.594+0000 7f9dea442640 1 -- 172.21.15.60:0/2470051587 shutdown_connections 2024-09-12T02:34:18.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.594+0000 7f9dea442640 1 -- 172.21.15.60:0/2470051587 wait complete. 2024-09-12T02:34:18.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.596+0000 7f9dea442640 1 Processor -- start 2024-09-12T02:34:18.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.596+0000 7f9dea442640 1 -- start start 2024-09-12T02:34:18.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.597+0000 7f9dea442640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9de406f1d0 0x7f9de41e90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:18.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.597+0000 7f9dea442640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9de40c4a10 0x7f9de40735b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:18.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.597+0000 7f9dea442640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9de414fa90 0x7f9de40c1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:18.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.597+0000 7f9dea442640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9de414fe70 con 0x7f9de414fa90 2024-09-12T02:34:18.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.597+0000 7f9dea442640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9de40c2b10 con 0x7f9de40c4a10 2024-09-12T02:34:18.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.597+0000 7f9dea442640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9de40c8530 con 0x7f9de406f1d0 2024-09-12T02:34:18.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.597+0000 7f9de3fff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9de406f1d0 0x7f9de41e90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:18.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.597+0000 7f9de3fff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9de406f1d0 0x7f9de41e90c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:35894/0 (socket says 172.21.15.60:35894) 2024-09-12T02:34:18.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.597+0000 7f9de3fff640 1 -- 172.21.15.60:0/1551079131 learned_addr learned my addr 172.21.15.60:0/1551079131 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:34:18.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.597+0000 7f9ddbfff640 1 --2- 172.21.15.60:0/1551079131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9de40c4a10 0x7f9de40735b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:18.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.597+0000 7f9de89df640 1 -- 172.21.15.60:0/1551079131 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9de414fa90 msgr2=0x7f9de40c1440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:34:18.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.597+0000 7f9de89df640 1 --2- 172.21.15.60:0/1551079131 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9de414fa90 0x7f9de40c1440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:34:18.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.598+0000 7f9de3fff640 1 -- 172.21.15.60:0/1551079131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9de40c4a10 msgr2=0x7f9de40735b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:18.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.598+0000 7f9de3fff640 1 --2- 172.21.15.60:0/1551079131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9de40c4a10 0x7f9de40735b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:18.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.598+0000 7f9de3fff640 1 -- 172.21.15.60:0/1551079131 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9de414fa90 msgr2=0x7f9de40c1440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:34:18.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.598+0000 7f9de3fff640 1 --2- 172.21.15.60:0/1551079131 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9de414fa90 0x7f9de40c1440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:18.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.598+0000 7f9de3fff640 1 -- 172.21.15.60:0/1551079131 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9de4070d10 con 0x7f9de406f1d0 2024-09-12T02:34:18.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.599+0000 7f9de3fff640 1 --2- 172.21.15.60:0/1551079131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9de406f1d0 0x7f9de41e90c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9dd402aff0 tx=0x7f9dd40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:18.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.599+0000 7f9de17fa640 1 -- 172.21.15.60:0/1551079131 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd4045070 con 0x7f9de406f1d0 2024-09-12T02:34:18.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.599+0000 7f9de17fa640 1 -- 172.21.15.60:0/1551079131 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dd4038860 con 0x7f9de406f1d0 2024-09-12T02:34:18.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.599+0000 7f9de17fa640 1 -- 172.21.15.60:0/1551079131 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd4033040 con 0x7f9de406f1d0 2024-09-12T02:34:18.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.599+0000 7f9dea442640 1 -- 172.21.15.60:0/1551079131 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9de4070ff0 con 0x7f9de406f1d0 2024-09-12T02:34:18.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.599+0000 7f9dea442640 1 -- 172.21.15.60:0/1551079131 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9de4071f60 con 0x7f9de406f1d0 2024-09-12T02:34:18.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.601+0000 7f9dea442640 1 -- 172.21.15.60:0/1551079131 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9de4072160 con 0x7f9de406f1d0 2024-09-12T02:34:18.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.601+0000 7f9de17fa640 1 -- 172.21.15.60:0/1551079131 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9dd4048070 con 0x7f9de406f1d0 2024-09-12T02:34:18.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.602+0000 7f9de17fa640 1 --2- 172.21.15.60:0/1551079131 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9dc406be30 0x7f9dc406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:18.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.602+0000 7f9de17fa640 1 -- 172.21.15.60:0/1551079131 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f9dd40abaa0 con 0x7f9de406f1d0 2024-09-12T02:34:18.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.602+0000 7f9ddbfff640 1 --2- 172.21.15.60:0/1551079131 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9dc406be30 0x7f9dc406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:18.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.603+0000 7f9ddbfff640 1 --2- 172.21.15.60:0/1551079131 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9dc406be30 0x7f9dc406e2f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9de4151bf0 tx=0x7f9dcc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:18.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:18.610+0000 7f9de17fa640 1 -- 172.21.15.60:0/1551079131 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9de4072160 con 0x7f9de406f1d0 2024-09-12T02:34:19.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:19.050+0000 7f9dea442640 1 -- 172.21.15.60:0/1551079131 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9de40a95a0 con 0x7f9de406f1d0 2024-09-12T02:34:19.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:19.050+0000 7f9de17fa640 1 -- 172.21.15.60:0/1551079131 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1560 (secure 0 0 0) 0x7f9de40a95a0 con 0x7f9de406f1d0 2024-09-12T02:34:19.051 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":106,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:34:19.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:19.053+0000 7f9dea442640 1 -- 172.21.15.60:0/1551079131 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9dc406be30 msgr2=0x7f9dc406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:19.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:19.053+0000 7f9dea442640 1 --2- 172.21.15.60:0/1551079131 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9dc406be30 0x7f9dc406e2f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9de4151bf0 tx=0x7f9dcc008040 comp rx=0 tx=0).stop 2024-09-12T02:34:19.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:19.053+0000 7f9dea442640 1 -- 172.21.15.60:0/1551079131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9de406f1d0 msgr2=0x7f9de41e90c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:19.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:19.053+0000 7f9dea442640 1 --2- 172.21.15.60:0/1551079131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9de406f1d0 0x7f9de41e90c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9dd402aff0 tx=0x7f9dd40046c0 comp rx=0 tx=0).stop 2024-09-12T02:34:19.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:19.053+0000 7f9dea442640 1 -- 172.21.15.60:0/1551079131 shutdown_connections 2024-09-12T02:34:19.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:19.053+0000 7f9dea442640 1 --2- 172.21.15.60:0/1551079131 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9dc406be30 0x7f9dc406e2f0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:19.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:19.053+0000 7f9dea442640 1 --2- 172.21.15.60:0/1551079131 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9de414fa90 0x7f9de40c1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:19.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:19.053+0000 7f9dea442640 1 --2- 172.21.15.60:0/1551079131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9de40c4a10 0x7f9de40735b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:19.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:19.053+0000 7f9dea442640 1 --2- 172.21.15.60:0/1551079131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9de406f1d0 0x7f9de41e90c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:19.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:19.053+0000 7f9dea442640 1 -- 172.21.15.60:0/1551079131 >> 172.21.15.60:0/1551079131 conn(0x7f9de40c7a40 msgr2=0x7f9de40a78a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:19.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:19.054+0000 7f9dea442640 1 -- 172.21.15.60:0/1551079131 shutdown_connections 2024-09-12T02:34:19.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:19.054+0000 7f9dea442640 1 -- 172.21.15.60:0/1551079131 wait complete. 2024-09-12T02:34:22.071 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:34:22.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:22.279+0000 7f3d1969b640 1 Processor -- start 2024-09-12T02:34:22.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:22.280+0000 7f3d1969b640 1 -- start start 2024-09-12T02:34:22.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:22.281+0000 7f3d1969b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3d14154ac0 0x7f3d140708a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:22.281+0000 7f3d1969b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d140703b0 0x7f3d1415e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:22.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:22.281+0000 7f3d1969b640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d14154ff0 con 0x7f3d14151780 2024-09-12T02:34:22.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:22.281+0000 7f3d127fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3d14154ac0 0x7f3d140708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:22.281+0000 7f3d1969b640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f3d1406f5f0 con 0x7f3d14154ac0 2024-09-12T02:34:22.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:22.281+0000 7f3d127fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3d14154ac0 0x7f3d140708a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55464/0 (socket says 172.21.15.60:55464) 2024-09-12T02:34:22.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:22.281+0000 7f3d127fc640 1 -- 172.21.15.60:0/448589366 learned_addr learned my addr 172.21.15.60:0/448589366 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:34:22.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:22.281+0000 7f3d137fe640 1 --2- 172.21.15.60:0/448589366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d140703b0 0x7f3d1415e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:22.281+0000 7f3d1969b640 1 -- 172.21.15.60:0/448589366 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3d1406f8d0 con 0x7f3d140703b0 2024-09-12T02:34:22.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:22.281+0000 7f3d127fc640 1 -- 172.21.15.60:0/448589366 >> v2:172.21.15.60:3300/0 conn(0x7f3d14154ac0 msgr2=0x7f3d140708a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:34:22.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:22.281+0000 7f3d127fc640 1 -- 172.21.15.60:0/448589366 >> v2:172.21.15.60:3300/0 conn(0x7f3d14154ac0 msgr2=0x7f3d140708a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:34:22.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:22.281+0000 7f3d127fc640 1 --2- 172.21.15.60:0/448589366 >> v2:172.21.15.60:3300/0 conn(0x7f3d14154ac0 0x7f3d140708a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:34:22.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:22.281+0000 7f3d127fc640 1 --2- 172.21.15.60:0/448589366 >> v2:172.21.15.60:3300/0 conn(0x7f3d14154ac0 0x7f3d140708a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:34:22.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:22.281+0000 7f3d137fe640 1 -- 172.21.15.60:0/448589366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d140703b0 msgr2=0x7f3d1415e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:34:22.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:22.282+0000 7f3d137fe640 1 -- 172.21.15.60:0/448589366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d140703b0 msgr2=0x7f3d1415e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:34:22.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:22.282+0000 7f3d137fe640 1 --2- 172.21.15.60:0/448589366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d140703b0 0x7f3d1415e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:34:22.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:22.282+0000 7f3d137fe640 1 --2- 172.21.15.60:0/448589366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d140703b0 0x7f3d1415e9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:34:22.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:22.482+0000 7f3d127fc640 1 --2- 172.21.15.60:0/448589366 >> v2:172.21.15.60:3300/0 conn(0x7f3d14154ac0 0x7f3d140708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:22.482+0000 7f3d127fc640 1 -- 172.21.15.60:0/448589366 >> v2:172.21.15.60:3300/0 conn(0x7f3d14154ac0 msgr2=0x7f3d140708a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:34:22.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:22.482+0000 7f3d127fc640 1 -- 172.21.15.60:0/448589366 >> v2:172.21.15.60:3300/0 conn(0x7f3d14154ac0 msgr2=0x7f3d140708a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:34:22.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:22.482+0000 7f3d127fc640 1 --2- 172.21.15.60:0/448589366 >> v2:172.21.15.60:3300/0 conn(0x7f3d14154ac0 0x7f3d140708a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:34:22.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:22.482+0000 7f3d127fc640 1 --2- 172.21.15.60:0/448589366 >> v2:172.21.15.60:3300/0 conn(0x7f3d14154ac0 0x7f3d140708a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:34:22.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:22.483+0000 7f3d137fe640 1 --2- 172.21.15.60:0/448589366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d140703b0 0x7f3d1415e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:22.483+0000 7f3d137fe640 1 -- 172.21.15.60:0/448589366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d140703b0 msgr2=0x7f3d1415e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:34:22.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:22.483+0000 7f3d137fe640 1 -- 172.21.15.60:0/448589366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d140703b0 msgr2=0x7f3d1415e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:34:22.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:22.483+0000 7f3d137fe640 1 --2- 172.21.15.60:0/448589366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d140703b0 0x7f3d1415e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:34:22.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:22.483+0000 7f3d137fe640 1 --2- 172.21.15.60:0/448589366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d140703b0 0x7f3d1415e9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:34:22.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:22.883+0000 7f3d127fc640 1 --2- 172.21.15.60:0/448589366 >> v2:172.21.15.60:3300/0 conn(0x7f3d14154ac0 0x7f3d140708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:22.883+0000 7f3d127fc640 1 -- 172.21.15.60:0/448589366 >> v2:172.21.15.60:3300/0 conn(0x7f3d14154ac0 msgr2=0x7f3d140708a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:34:22.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:22.883+0000 7f3d127fc640 1 -- 172.21.15.60:0/448589366 >> v2:172.21.15.60:3300/0 conn(0x7f3d14154ac0 msgr2=0x7f3d140708a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:34:22.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:22.883+0000 7f3d127fc640 1 --2- 172.21.15.60:0/448589366 >> v2:172.21.15.60:3300/0 conn(0x7f3d14154ac0 0x7f3d140708a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:34:22.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:22.883+0000 7f3d127fc640 1 --2- 172.21.15.60:0/448589366 >> v2:172.21.15.60:3300/0 conn(0x7f3d14154ac0 0x7f3d140708a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:34:22.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:22.884+0000 7f3d137fe640 1 --2- 172.21.15.60:0/448589366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d140703b0 0x7f3d1415e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:22.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:22.884+0000 7f3d137fe640 1 -- 172.21.15.60:0/448589366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d140703b0 msgr2=0x7f3d1415e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:34:22.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:22.884+0000 7f3d137fe640 1 -- 172.21.15.60:0/448589366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d140703b0 msgr2=0x7f3d1415e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:34:22.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:22.884+0000 7f3d137fe640 1 --2- 172.21.15.60:0/448589366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d140703b0 0x7f3d1415e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:34:22.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:22.884+0000 7f3d137fe640 1 --2- 172.21.15.60:0/448589366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d140703b0 0x7f3d1415e9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:34:23.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:23.684+0000 7f3d127fc640 1 --2- 172.21.15.60:0/448589366 >> v2:172.21.15.60:3300/0 conn(0x7f3d14154ac0 0x7f3d140708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:23.684+0000 7f3d127fc640 1 -- 172.21.15.60:0/448589366 >> v2:172.21.15.60:3300/0 conn(0x7f3d14154ac0 msgr2=0x7f3d140708a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:34:23.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:23.684+0000 7f3d127fc640 1 -- 172.21.15.60:0/448589366 >> v2:172.21.15.60:3300/0 conn(0x7f3d14154ac0 msgr2=0x7f3d140708a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:34:23.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:23.684+0000 7f3d127fc640 1 --2- 172.21.15.60:0/448589366 >> v2:172.21.15.60:3300/0 conn(0x7f3d14154ac0 0x7f3d140708a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:34:23.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:23.684+0000 7f3d127fc640 1 --2- 172.21.15.60:0/448589366 >> v2:172.21.15.60:3300/0 conn(0x7f3d14154ac0 0x7f3d140708a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:34:23.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:23.686+0000 7f3d137fe640 1 --2- 172.21.15.60:0/448589366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d140703b0 0x7f3d1415e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:23.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:23.686+0000 7f3d137fe640 1 -- 172.21.15.60:0/448589366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d140703b0 msgr2=0x7f3d1415e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:34:23.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:23.686+0000 7f3d137fe640 1 -- 172.21.15.60:0/448589366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d140703b0 msgr2=0x7f3d1415e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:34:23.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:23.686+0000 7f3d137fe640 1 --2- 172.21.15.60:0/448589366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d140703b0 0x7f3d1415e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:34:23.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:23.686+0000 7f3d137fe640 1 --2- 172.21.15.60:0/448589366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d140703b0 0x7f3d1415e9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:34:25.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.281+0000 7f3d10ff9640 1 -- 172.21.15.60:0/448589366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d140703b0 msgr2=0x7f3d1415e9f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:34:25.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.281+0000 7f3d10ff9640 1 --2- 172.21.15.60:0/448589366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d140703b0 0x7f3d1415e9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.281+0000 7f3d10ff9640 1 -- 172.21.15.60:0/448589366 >> v2:172.21.15.60:3300/0 conn(0x7f3d14154ac0 msgr2=0x7f3d140708a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:34:25.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.281+0000 7f3d10ff9640 1 --2- 172.21.15.60:0/448589366 >> v2:172.21.15.60:3300/0 conn(0x7f3d14154ac0 0x7f3d140708a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.281+0000 7f3d10ff9640 1 -- 172.21.15.60:0/448589366 >> v1:172.21.15.60:6789/0 conn(0x7f3d14151780 legacy=0x7f3d14155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:25.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.281+0000 7f3d10ff9640 1 --2- 172.21.15.60:0/448589366 >> v2:172.21.15.105:3300/0 conn(0x7f3d00003680 0x7f3d00005b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:25.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.281+0000 7f3d10ff9640 1 -- 172.21.15.60:0/448589366 --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d1406fbb0 con 0x7f3d000061f0 2024-09-12T02:34:25.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.281+0000 7f3d10ff9640 1 -- 172.21.15.60:0/448589366 --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f3d1406f5f0 con 0x7f3d00003680 2024-09-12T02:34:25.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.281+0000 7f3d12ffd640 1 --2- 172.21.15.60:0/448589366 >> v2:172.21.15.105:3300/0 conn(0x7f3d00003680 0x7f3d00005b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:25.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.282+0000 7f3d12ffd640 1 -- 172.21.15.60:0/448589366 >> v2:172.21.15.105:3300/0 conn(0x7f3d00003680 msgr2=0x7f3d00005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:34:25.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.282+0000 7f3d12ffd640 1 -- 172.21.15.60:0/448589366 >> v2:172.21.15.105:3300/0 conn(0x7f3d00003680 msgr2=0x7f3d00005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:34:25.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.282+0000 7f3d12ffd640 1 --2- 172.21.15.60:0/448589366 >> v2:172.21.15.105:3300/0 conn(0x7f3d00003680 0x7f3d00005b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:34:25.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.282+0000 7f3d12ffd640 1 --2- 172.21.15.60:0/448589366 >> v2:172.21.15.105:3300/0 conn(0x7f3d00003680 0x7f3d00005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:34:25.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.483+0000 7f3d12ffd640 1 --2- 172.21.15.60:0/448589366 >> v2:172.21.15.105:3300/0 conn(0x7f3d00003680 0x7f3d00005b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:25.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.483+0000 7f3d12ffd640 1 -- 172.21.15.60:0/448589366 >> v2:172.21.15.105:3300/0 conn(0x7f3d00003680 msgr2=0x7f3d00005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:34:25.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.483+0000 7f3d12ffd640 1 -- 172.21.15.60:0/448589366 >> v2:172.21.15.105:3300/0 conn(0x7f3d00003680 msgr2=0x7f3d00005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:34:25.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.483+0000 7f3d12ffd640 1 --2- 172.21.15.60:0/448589366 >> v2:172.21.15.105:3300/0 conn(0x7f3d00003680 0x7f3d00005b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:34:25.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.483+0000 7f3d12ffd640 1 --2- 172.21.15.60:0/448589366 >> v2:172.21.15.105:3300/0 conn(0x7f3d00003680 0x7f3d00005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:34:25.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.842+0000 7f3d11ffb640 1 -- 172.21.15.60:0/448589366 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3983727992 0 0) 0x7f3d1406fbb0 con 0x7f3d000061f0 2024-09-12T02:34:25.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.842+0000 7f3d11ffb640 1 -- 172.21.15.60:0/448589366 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3cfc003520 con 0x7f3d000061f0 2024-09-12T02:34:25.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.848+0000 7f3d11ffb640 1 -- 172.21.15.60:0/448589366 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4073890352 0 0) 0x7f3cfc003520 con 0x7f3d000061f0 2024-09-12T02:34:25.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.848+0000 7f3d11ffb640 1 -- 172.21.15.60:0/448589366 >> v2:172.21.15.105:3300/0 conn(0x7f3d00003680 msgr2=0x7f3d00005b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:34:25.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.848+0000 7f3d11ffb640 1 --2- 172.21.15.60:0/448589366 >> v2:172.21.15.105:3300/0 conn(0x7f3d00003680 0x7f3d00005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.848+0000 7f3d11ffb640 1 -- 172.21.15.60:0/448589366 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d0000b060 con 0x7f3d000061f0 2024-09-12T02:34:25.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.848+0000 7f3d11ffb640 1 -- 172.21.15.60:0/448589366 <== mon.1 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7f3d0800f040 con 0x7f3d000061f0 2024-09-12T02:34:25.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.848+0000 7f3d11ffb640 1 -- 172.21.15.60:0/448589366 >> v1:172.21.15.105:6789/0 conn(0x7f3d000061f0 legacy=0x7f3d000086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:25.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.848+0000 7f3d137fe640 1 -- 172.21.15.60:0/448589366 reap_dead start 2024-09-12T02:34:25.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.848+0000 7f3d11ffb640 1 --2- 172.21.15.60:0/448589366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3cfc0039b0 0x7f3cfc003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:25.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.848+0000 7f3d11ffb640 1 --2- 172.21.15.60:0/448589366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3cfc004800 0x7f3cfc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:25.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.848+0000 7f3d11ffb640 1 --2- 172.21.15.60:0/448589366 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3cfc0052e0 0x7f3cfc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:25.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.848+0000 7f3d11ffb640 1 -- 172.21.15.60:0/448589366 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3d1406f5f0 con 0x7f3cfc004800 2024-09-12T02:34:25.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.848+0000 7f3d11ffb640 1 -- 172.21.15.60:0/448589366 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3cfc00c230 con 0x7f3cfc0052e0 2024-09-12T02:34:25.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.848+0000 7f3d11ffb640 1 -- 172.21.15.60:0/448589366 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3cfc00c430 con 0x7f3cfc0039b0 2024-09-12T02:34:25.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.848+0000 7f3d127fc640 1 --2- 172.21.15.60:0/448589366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3cfc004800 0x7f3cfc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:25.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.848+0000 7f3d12ffd640 1 --2- 172.21.15.60:0/448589366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3cfc0039b0 0x7f3cfc003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:25.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.848+0000 7f3d137fe640 1 --2- 172.21.15.60:0/448589366 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3cfc0052e0 0x7f3cfc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:25.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.848+0000 7f3d127fc640 1 -- 172.21.15.60:0/448589366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3cfc0039b0 msgr2=0x7f3cfc003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:25.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.848+0000 7f3d127fc640 1 --2- 172.21.15.60:0/448589366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3cfc0039b0 0x7f3cfc003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.848+0000 7f3d127fc640 1 -- 172.21.15.60:0/448589366 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3cfc0052e0 msgr2=0x7f3cfc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:25.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.848+0000 7f3d127fc640 1 --2- 172.21.15.60:0/448589366 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3cfc0052e0 0x7f3cfc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.848+0000 7f3d127fc640 1 -- 172.21.15.60:0/448589366 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cfc003520 con 0x7f3cfc004800 2024-09-12T02:34:25.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.893+0000 7f3d127fc640 1 --2- 172.21.15.60:0/448589366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3cfc004800 0x7f3cfc004c80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3d14154f20 tx=0x7f3cfc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a29a69b484bc9fa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:25.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.895+0000 7f3d11ffb640 1 -- 172.21.15.60:0/448589366 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d08039070 con 0x7f3cfc004800 2024-09-12T02:34:25.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.896+0000 7f3d11ffb640 1 -- 172.21.15.60:0/448589366 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d08034410 con 0x7f3cfc004800 2024-09-12T02:34:25.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.896+0000 7f3d11ffb640 1 -- 172.21.15.60:0/448589366 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d0800cbf0 con 0x7f3cfc004800 2024-09-12T02:34:25.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.896+0000 7f3d1969b640 1 -- 172.21.15.60:0/448589366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3cfc004800 msgr2=0x7f3cfc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:25.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.897+0000 7f3d1969b640 1 --2- 172.21.15.60:0/448589366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3cfc004800 0x7f3cfc004c80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3d14154f20 tx=0x7f3cfc005830 comp rx=0 tx=0).stop 2024-09-12T02:34:25.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.897+0000 7f3d1969b640 1 -- 172.21.15.60:0/448589366 shutdown_connections 2024-09-12T02:34:25.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.897+0000 7f3d1969b640 1 --2- 172.21.15.60:0/448589366 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3cfc0052e0 0x7f3cfc00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.897+0000 7f3d1969b640 1 --2- 172.21.15.60:0/448589366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3cfc004800 0x7f3cfc004c80 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.897+0000 7f3d1969b640 1 --2- 172.21.15.60:0/448589366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3cfc0039b0 0x7f3cfc003db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.897+0000 7f3d1969b640 1 -- 172.21.15.60:0/448589366 >> 172.21.15.60:0/448589366 conn(0x7f3d140c6980 msgr2=0x7f3d140c6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:25.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.897+0000 7f3d1969b640 1 -- 172.21.15.60:0/448589366 shutdown_connections 2024-09-12T02:34:25.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.897+0000 7f3d1969b640 1 -- 172.21.15.60:0/448589366 wait complete. 2024-09-12T02:34:25.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.900+0000 7f3d1969b640 1 Processor -- start 2024-09-12T02:34:25.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.900+0000 7f3d1969b640 1 -- start start 2024-09-12T02:34:25.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.901+0000 7f3d1969b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3cfc0039b0 0x7f3d1414df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:25.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.901+0000 7f3d1969b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3cfc004800 0x7f3d14152440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:25.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.901+0000 7f3d1969b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3cfc0052e0 0x7f3d141e9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:25.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.901+0000 7f3d1969b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3d140740b0 con 0x7f3cfc0039b0 2024-09-12T02:34:25.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.901+0000 7f3d1969b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3d14073f30 con 0x7f3cfc0052e0 2024-09-12T02:34:25.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.901+0000 7f3d1969b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3d140af630 con 0x7f3cfc004800 2024-09-12T02:34:25.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.901+0000 7f3d12ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3cfc0039b0 0x7f3d1414df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:25.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.902+0000 7f3d12ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3cfc0039b0 0x7f3d1414df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55512/0 (socket says 172.21.15.60:55512) 2024-09-12T02:34:25.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.902+0000 7f3d12ffd640 1 -- 172.21.15.60:0/3975467199 learned_addr learned my addr 172.21.15.60:0/3975467199 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:34:25.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.902+0000 7f3d137fe640 1 --2- 172.21.15.60:0/3975467199 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3cfc0052e0 0x7f3d141e9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:25.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.902+0000 7f3d127fc640 1 --2- 172.21.15.60:0/3975467199 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3cfc004800 0x7f3d14152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:25.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.902+0000 7f3d127fc640 1 -- 172.21.15.60:0/3975467199 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3cfc004800 msgr2=0x7f3d14152440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-12T02:34:25.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.902+0000 7f3d127fc640 1 -- 172.21.15.60:0/3975467199 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3cfc004800 msgr2=0x7f3d14152440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:34:25.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.902+0000 7f3d127fc640 1 --2- 172.21.15.60:0/3975467199 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3cfc004800 0x7f3d14152440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:34:25.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.902+0000 7f3d127fc640 1 --2- 172.21.15.60:0/3975467199 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3cfc004800 0x7f3d14152440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:34:25.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.902+0000 7f3d137fe640 1 -- 172.21.15.60:0/3975467199 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3cfc004800 msgr2=0x7f3d14152440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:34:25.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.902+0000 7f3d137fe640 1 --2- 172.21.15.60:0/3975467199 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3cfc004800 0x7f3d14152440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.902+0000 7f3d137fe640 1 -- 172.21.15.60:0/3975467199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3cfc0039b0 msgr2=0x7f3d1414df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:25.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.902+0000 7f3d137fe640 1 --2- 172.21.15.60:0/3975467199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3cfc0039b0 0x7f3d1414df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.902+0000 7f3d137fe640 1 -- 172.21.15.60:0/3975467199 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d1414f0f0 con 0x7f3cfc0052e0 2024-09-12T02:34:25.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.903+0000 7f3d137fe640 1 --2- 172.21.15.60:0/3975467199 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3cfc0052e0 0x7f3d141e9b70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3d1406f4e0 tx=0x7f3d0c004910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:25.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.903+0000 7f3cfb7fe640 1 -- 172.21.15.60:0/3975467199 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c01b070 con 0x7f3cfc0052e0 2024-09-12T02:34:25.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.903+0000 7f3d1969b640 1 -- 172.21.15.60:0/3975467199 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d141eda60 con 0x7f3cfc0052e0 2024-09-12T02:34:25.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.903+0000 7f3cfb7fe640 1 -- 172.21.15.60:0/3975467199 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d0c015d50 con 0x7f3cfc0052e0 2024-09-12T02:34:25.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.903+0000 7f3cfb7fe640 1 -- 172.21.15.60:0/3975467199 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c0206a0 con 0x7f3cfc0052e0 2024-09-12T02:34:25.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.904+0000 7f3d1969b640 1 -- 172.21.15.60:0/3975467199 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d141545a0 con 0x7f3cfc0052e0 2024-09-12T02:34:25.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.906+0000 7f3cfb7fe640 1 -- 172.21.15.60:0/3975467199 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3d0c005d10 con 0x7f3cfc0052e0 2024-09-12T02:34:25.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.906+0000 7f3cfb7fe640 1 --2- 172.21.15.60:0/3975467199 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3d0006c740 0x7f3d0006ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:25.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.907+0000 7f3d1969b640 1 -- 172.21.15.60:0/3975467199 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d140c74b0 con 0x7f3cfc0052e0 2024-09-12T02:34:25.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.907+0000 7f3d12ffd640 1 --2- 172.21.15.60:0/3975467199 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3d0006c740 0x7f3d0006ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:25.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.907+0000 7f3cfb7fe640 1 -- 172.21.15.60:0/3975467199 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f3d0c058730 con 0x7f3cfc0052e0 2024-09-12T02:34:25.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.908+0000 7f3d12ffd640 1 --2- 172.21.15.60:0/3975467199 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3d0006c740 0x7f3d0006ec00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3d04007b00 tx=0x7f3d04009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:25.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:25.915+0000 7f3cfb7fe640 1 -- 172.21.15.60:0/3975467199 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3d140c74b0 con 0x7f3cfc0052e0 2024-09-12T02:34:26.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:26.354+0000 7f3d1969b640 1 -- 172.21.15.60:0/3975467199 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3d1406f8d0 con 0x7f3cfc0052e0 2024-09-12T02:34:26.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:26.354+0000 7f3cfb7fe640 1 -- 172.21.15.60:0/3975467199 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1559 (secure 0 0 0) 0x7f3d0c025060 con 0x7f3cfc0052e0 2024-09-12T02:34:26.356 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":110,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:34:26.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:26.358+0000 7f3d1969b640 1 -- 172.21.15.60:0/3975467199 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3d0006c740 msgr2=0x7f3d0006ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:26.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:26.358+0000 7f3d1969b640 1 --2- 172.21.15.60:0/3975467199 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3d0006c740 0x7f3d0006ec00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3d04007b00 tx=0x7f3d04009040 comp rx=0 tx=0).stop 2024-09-12T02:34:26.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:26.358+0000 7f3d1969b640 1 -- 172.21.15.60:0/3975467199 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3cfc0052e0 msgr2=0x7f3d141e9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:26.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:26.358+0000 7f3d1969b640 1 --2- 172.21.15.60:0/3975467199 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3cfc0052e0 0x7f3d141e9b70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3d1406f4e0 tx=0x7f3d0c004910 comp rx=0 tx=0).stop 2024-09-12T02:34:26.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:26.358+0000 7f3d1969b640 1 -- 172.21.15.60:0/3975467199 shutdown_connections 2024-09-12T02:34:26.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:26.358+0000 7f3d1969b640 1 --2- 172.21.15.60:0/3975467199 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3d0006c740 0x7f3d0006ec00 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:26.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:26.358+0000 7f3d1969b640 1 --2- 172.21.15.60:0/3975467199 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3cfc0052e0 0x7f3d141e9b70 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:26.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:26.358+0000 7f3d1969b640 1 --2- 172.21.15.60:0/3975467199 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3cfc004800 0x7f3d14152440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:26.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:26.358+0000 7f3d1969b640 1 --2- 172.21.15.60:0/3975467199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3cfc0039b0 0x7f3d1414df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:26.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:26.358+0000 7f3d1969b640 1 -- 172.21.15.60:0/3975467199 >> 172.21.15.60:0/3975467199 conn(0x7f3d140c6980 msgr2=0x7f3d14072c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:26.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:26.358+0000 7f3d1969b640 1 -- 172.21.15.60:0/3975467199 shutdown_connections 2024-09-12T02:34:26.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:26.358+0000 7f3d1969b640 1 -- 172.21.15.60:0/3975467199 wait complete. 2024-09-12T02:34:26.679 INFO:tasks.workunit.client.0.smithi060.stdout:fs setup took 551 secs 2024-09-12T02:34:28.387 INFO:tasks.workunit.client.0.smithi060.stdout:Syncing()...1 sec 2024-09-12T02:34:28.388 INFO:tasks.workunit.client.0.smithi060.stdout:Starting Actual Benchmark At: Thu Sep 12 02:34:28 2024 2024-09-12T02:34:28.388 INFO:tasks.workunit.client.0.smithi060.stdout: 2024-09-12T02:34:29.378 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:34:29.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:29.554+0000 7fe2a262c640 1 Processor -- start 2024-09-12T02:34:29.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:29.554+0000 7fe2a262c640 1 -- start start 2024-09-12T02:34:29.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:29.556+0000 7fe2a262c640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe29c0ca000 0x7fe29c0c6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:29.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:29.556+0000 7fe2a262c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe29c15a770 0x7fe29c15ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:29.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:29.556+0000 7fe2a262c640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe29c0c6ea0 con 0x7fe29c06cdf0 2024-09-12T02:34:29.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:29.556+0000 7fe2a262c640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fe29c15e690 con 0x7fe29c0ca000 2024-09-12T02:34:29.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:29.556+0000 7fe2a262c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe29c15dd60 con 0x7fe29c15a770 2024-09-12T02:34:29.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:29.557+0000 7fe29bfff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe29c0ca000 0x7fe29c0c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:29.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:29.557+0000 7fe29bfff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe29c0ca000 0x7fe29c0c6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:52656/0 (socket says 172.21.15.60:52656) 2024-09-12T02:34:29.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:29.557+0000 7fe29bfff640 1 -- 172.21.15.60:0/221822393 learned_addr learned my addr 172.21.15.60:0/221822393 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:34:29.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:29.557+0000 7fe29bfff640 1 -- 172.21.15.60:0/221822393 >> v2:172.21.15.105:3300/0 conn(0x7fe29c0ca000 msgr2=0x7fe29c0c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:34:29.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:29.557+0000 7fe29bfff640 1 -- 172.21.15.60:0/221822393 >> v2:172.21.15.105:3300/0 conn(0x7fe29c0ca000 msgr2=0x7fe29c0c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:34:29.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:29.557+0000 7fe29bfff640 1 --2- 172.21.15.60:0/221822393 >> v2:172.21.15.105:3300/0 conn(0x7fe29c0ca000 0x7fe29c0c6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:34:29.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:29.557+0000 7fe29bfff640 1 --2- 172.21.15.60:0/221822393 >> v2:172.21.15.105:3300/0 conn(0x7fe29c0ca000 0x7fe29c0c6810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:34:29.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:29.558+0000 7fe2a0bc9640 1 --2- 172.21.15.60:0/221822393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe29c15a770 0x7fe29c15ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:29.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:29.558+0000 7fe2a0bc9640 1 -- 172.21.15.60:0/221822393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe29c15a770 msgr2=0x7fe29c15ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:34:29.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:29.558+0000 7fe2a0bc9640 1 -- 172.21.15.60:0/221822393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe29c15a770 msgr2=0x7fe29c15ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:34:29.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:29.558+0000 7fe2a0bc9640 1 --2- 172.21.15.60:0/221822393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe29c15a770 0x7fe29c15ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:34:29.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:29.558+0000 7fe2a0bc9640 1 --2- 172.21.15.60:0/221822393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe29c15a770 0x7fe29c15ac00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:34:29.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:29.758+0000 7fe29bfff640 1 --2- 172.21.15.60:0/221822393 >> v2:172.21.15.105:3300/0 conn(0x7fe29c0ca000 0x7fe29c0c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:29.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:29.758+0000 7fe29bfff640 1 -- 172.21.15.60:0/221822393 >> v2:172.21.15.105:3300/0 conn(0x7fe29c0ca000 msgr2=0x7fe29c0c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:34:29.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:29.758+0000 7fe29bfff640 1 -- 172.21.15.60:0/221822393 >> v2:172.21.15.105:3300/0 conn(0x7fe29c0ca000 msgr2=0x7fe29c0c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:34:29.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:29.758+0000 7fe29bfff640 1 --2- 172.21.15.60:0/221822393 >> v2:172.21.15.105:3300/0 conn(0x7fe29c0ca000 0x7fe29c0c6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:34:29.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:29.758+0000 7fe29bfff640 1 --2- 172.21.15.60:0/221822393 >> v2:172.21.15.105:3300/0 conn(0x7fe29c0ca000 0x7fe29c0c6810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:34:29.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:29.759+0000 7fe2a0bc9640 1 --2- 172.21.15.60:0/221822393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe29c15a770 0x7fe29c15ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:29.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:29.759+0000 7fe2a0bc9640 1 -- 172.21.15.60:0/221822393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe29c15a770 msgr2=0x7fe29c15ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:34:29.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:29.759+0000 7fe2a0bc9640 1 -- 172.21.15.60:0/221822393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe29c15a770 msgr2=0x7fe29c15ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:34:29.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:29.759+0000 7fe2a0bc9640 1 --2- 172.21.15.60:0/221822393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe29c15a770 0x7fe29c15ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:34:29.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:29.759+0000 7fe2a0bc9640 1 --2- 172.21.15.60:0/221822393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe29c15a770 0x7fe29c15ac00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:34:30.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:30.159+0000 7fe29bfff640 1 --2- 172.21.15.60:0/221822393 >> v2:172.21.15.105:3300/0 conn(0x7fe29c0ca000 0x7fe29c0c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:30.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:30.159+0000 7fe29bfff640 1 -- 172.21.15.60:0/221822393 >> v2:172.21.15.105:3300/0 conn(0x7fe29c0ca000 msgr2=0x7fe29c0c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:34:30.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:30.159+0000 7fe29bfff640 1 -- 172.21.15.60:0/221822393 >> v2:172.21.15.105:3300/0 conn(0x7fe29c0ca000 msgr2=0x7fe29c0c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:34:30.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:30.159+0000 7fe29bfff640 1 --2- 172.21.15.60:0/221822393 >> v2:172.21.15.105:3300/0 conn(0x7fe29c0ca000 0x7fe29c0c6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:34:30.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:30.159+0000 7fe29bfff640 1 --2- 172.21.15.60:0/221822393 >> v2:172.21.15.105:3300/0 conn(0x7fe29c0ca000 0x7fe29c0c6810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:34:30.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:30.160+0000 7fe2a0bc9640 1 --2- 172.21.15.60:0/221822393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe29c15a770 0x7fe29c15ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:30.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:30.160+0000 7fe2a0bc9640 1 -- 172.21.15.60:0/221822393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe29c15a770 msgr2=0x7fe29c15ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:34:30.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:30.160+0000 7fe2a0bc9640 1 -- 172.21.15.60:0/221822393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe29c15a770 msgr2=0x7fe29c15ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:34:30.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:30.160+0000 7fe2a0bc9640 1 --2- 172.21.15.60:0/221822393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe29c15a770 0x7fe29c15ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:34:30.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:30.160+0000 7fe2a0bc9640 1 --2- 172.21.15.60:0/221822393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe29c15a770 0x7fe29c15ac00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:34:30.494 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:34:30.498 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:34:30.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:30.960+0000 7fe29bfff640 1 --2- 172.21.15.60:0/221822393 >> v2:172.21.15.105:3300/0 conn(0x7fe29c0ca000 0x7fe29c0c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:30.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:30.960+0000 7fe29bfff640 1 -- 172.21.15.60:0/221822393 >> v2:172.21.15.105:3300/0 conn(0x7fe29c0ca000 msgr2=0x7fe29c0c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:34:30.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:30.960+0000 7fe29bfff640 1 -- 172.21.15.60:0/221822393 >> v2:172.21.15.105:3300/0 conn(0x7fe29c0ca000 msgr2=0x7fe29c0c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:34:30.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:30.960+0000 7fe29bfff640 1 --2- 172.21.15.60:0/221822393 >> v2:172.21.15.105:3300/0 conn(0x7fe29c0ca000 0x7fe29c0c6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:34:30.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:30.960+0000 7fe29bfff640 1 --2- 172.21.15.60:0/221822393 >> v2:172.21.15.105:3300/0 conn(0x7fe29c0ca000 0x7fe29c0c6810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:34:30.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:30.961+0000 7fe2a0bc9640 1 --2- 172.21.15.60:0/221822393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe29c15a770 0x7fe29c15ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:30.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:30.961+0000 7fe2a0bc9640 1 -- 172.21.15.60:0/221822393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe29c15a770 msgr2=0x7fe29c15ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:34:30.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:30.961+0000 7fe2a0bc9640 1 -- 172.21.15.60:0/221822393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe29c15a770 msgr2=0x7fe29c15ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:34:30.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:30.961+0000 7fe2a0bc9640 1 --2- 172.21.15.60:0/221822393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe29c15a770 0x7fe29c15ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:34:30.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:30.961+0000 7fe2a0bc9640 1 --2- 172.21.15.60:0/221822393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe29c15a770 0x7fe29c15ac00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:34:31.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.843+0000 7fe29affd640 1 -- 172.21.15.60:0/221822393 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4065937372 0 0) 0x7fe29c0c6ea0 con 0x7fe29c06cdf0 2024-09-12T02:34:31.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.843+0000 7fe29affd640 1 -- 172.21.15.60:0/221822393 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe284003520 con 0x7fe29c06cdf0 2024-09-12T02:34:31.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.844+0000 7fe29affd640 1 -- 172.21.15.60:0/221822393 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2826074729 0 0) 0x7fe284003520 con 0x7fe29c06cdf0 2024-09-12T02:34:31.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.844+0000 7fe29affd640 1 -- 172.21.15.60:0/221822393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe29c15a770 msgr2=0x7fe29c15ac00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:34:31.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.844+0000 7fe29affd640 1 --2- 172.21.15.60:0/221822393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe29c15a770 0x7fe29c15ac00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:31.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.844+0000 7fe29affd640 1 -- 172.21.15.60:0/221822393 >> v2:172.21.15.105:3300/0 conn(0x7fe29c0ca000 msgr2=0x7fe29c0c6810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:34:31.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.844+0000 7fe29affd640 1 --2- 172.21.15.60:0/221822393 >> v2:172.21.15.105:3300/0 conn(0x7fe29c0ca000 0x7fe29c0c6810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:31.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.844+0000 7fe29affd640 1 -- 172.21.15.60:0/221822393 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe29c15e040 con 0x7fe29c06cdf0 2024-09-12T02:34:31.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.844+0000 7fe29affd640 1 -- 172.21.15.60:0/221822393 <== mon.1 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7fe28c001670 con 0x7fe29c06cdf0 2024-09-12T02:34:31.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.844+0000 7fe29affd640 1 -- 172.21.15.60:0/221822393 >> v1:172.21.15.105:6789/0 conn(0x7fe29c06cdf0 legacy=0x7fe29c157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:31.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.844+0000 7fe29affd640 1 --2- 172.21.15.60:0/221822393 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2840039b0 0x7fe284003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:31.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.844+0000 7fe29affd640 1 --2- 172.21.15.60:0/221822393 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe284004800 0x7fe284004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:31.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.844+0000 7fe29affd640 1 --2- 172.21.15.60:0/221822393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe29c15a770 0x7fe284005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:31.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.844+0000 7fe29affd640 1 -- 172.21.15.60:0/221822393 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe29c15e690 con 0x7fe2840039b0 2024-09-12T02:34:31.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.844+0000 7fe29affd640 1 -- 172.21.15.60:0/221822393 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe29c15dd60 con 0x7fe284004800 2024-09-12T02:34:31.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.844+0000 7fe29affd640 1 -- 172.21.15.60:0/221822393 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe28400bba0 con 0x7fe29c15a770 2024-09-12T02:34:31.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.844+0000 7fe2a0bc9640 1 --2- 172.21.15.60:0/221822393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe29c15a770 0x7fe284005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:31.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.844+0000 7fe29b7fe640 1 --2- 172.21.15.60:0/221822393 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe284004800 0x7fe284004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:31.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.844+0000 7fe29bfff640 1 --2- 172.21.15.60:0/221822393 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2840039b0 0x7fe284003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:31.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.845+0000 7fe2a0bc9640 1 -- 172.21.15.60:0/221822393 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe284004800 msgr2=0x7fe284004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:31.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.845+0000 7fe2a0bc9640 1 --2- 172.21.15.60:0/221822393 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe284004800 0x7fe284004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:31.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.845+0000 7fe2a0bc9640 1 -- 172.21.15.60:0/221822393 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2840039b0 msgr2=0x7fe284003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:31.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.845+0000 7fe2a0bc9640 1 --2- 172.21.15.60:0/221822393 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2840039b0 0x7fe284003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:31.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.845+0000 7fe2a0bc9640 1 -- 172.21.15.60:0/221822393 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe29c15e040 con 0x7fe29c15a770 2024-09-12T02:34:31.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.845+0000 7fe29bfff640 1 --2- 172.21.15.60:0/221822393 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2840039b0 0x7fe284003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:31.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.846+0000 7fe2a0bc9640 1 --2- 172.21.15.60:0/221822393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe29c15a770 0x7fe284005270 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe294004440 tx=0x7fe284005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8e26a16edbfce32 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:31.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.846+0000 7fe29affd640 1 -- 172.21.15.60:0/221822393 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe294031070 con 0x7fe29c15a770 2024-09-12T02:34:31.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.846+0000 7fe29affd640 1 -- 172.21.15.60:0/221822393 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe29402baf0 con 0x7fe29c15a770 2024-09-12T02:34:31.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.846+0000 7fe29affd640 1 -- 172.21.15.60:0/221822393 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe294004040 con 0x7fe29c15a770 2024-09-12T02:34:31.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.847+0000 7fe2a262c640 1 -- 172.21.15.60:0/221822393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe29c15a770 msgr2=0x7fe284005270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:31.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.847+0000 7fe2a262c640 1 --2- 172.21.15.60:0/221822393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe29c15a770 0x7fe284005270 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe294004440 tx=0x7fe284005830 comp rx=0 tx=0).stop 2024-09-12T02:34:31.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.847+0000 7fe2a0bc9640 1 -- 172.21.15.60:0/221822393 reap_dead start 2024-09-12T02:34:31.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.848+0000 7fe2a262c640 1 -- 172.21.15.60:0/221822393 shutdown_connections 2024-09-12T02:34:31.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.848+0000 7fe2a262c640 1 -- 172.21.15.60:0/221822393 >> 172.21.15.60:0/221822393 conn(0x7fe29c0adb80 msgr2=0x7fe29c0adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:31.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.848+0000 7fe2a262c640 1 -- 172.21.15.60:0/221822393 shutdown_connections 2024-09-12T02:34:31.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.848+0000 7fe2a262c640 1 -- 172.21.15.60:0/221822393 wait complete. 2024-09-12T02:34:31.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.850+0000 7fe2a262c640 1 Processor -- start 2024-09-12T02:34:31.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.853+0000 7fe2a262c640 1 -- start start 2024-09-12T02:34:31.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.854+0000 7fe2a262c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe29c15a770 0x7fe29c1f0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:31.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.854+0000 7fe2a262c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe29c0af160 0x7fe29c15d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:31.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.854+0000 7fe2a262c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe29c152790 0x7fe29c152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:31.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.854+0000 7fe2a262c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe29c15eb20 con 0x7fe29c15a770 2024-09-12T02:34:31.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.854+0000 7fe2a262c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe29c06d230 con 0x7fe29c0af160 2024-09-12T02:34:31.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.854+0000 7fe2a262c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe29c1f0c40 con 0x7fe29c152790 2024-09-12T02:34:31.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.855+0000 7fe2a0bc9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe29c152790 0x7fe29c152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:31.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.855+0000 7fe2a0bc9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe29c152790 0x7fe29c152c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:35556/0 (socket says 172.21.15.60:35556) 2024-09-12T02:34:31.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.855+0000 7fe2a0bc9640 1 -- 172.21.15.60:0/331493683 learned_addr learned my addr 172.21.15.60:0/331493683 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:34:31.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.855+0000 7fe29b7fe640 1 --2- 172.21.15.60:0/331493683 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe29c0af160 0x7fe29c15d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:31.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.857+0000 7fe29bfff640 1 --2- 172.21.15.60:0/331493683 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe29c15a770 0x7fe29c1f0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:31.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.858+0000 7fe29b7fe640 1 -- 172.21.15.60:0/331493683 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe29c152790 msgr2=0x7fe29c152c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:31.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.858+0000 7fe29b7fe640 1 --2- 172.21.15.60:0/331493683 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe29c152790 0x7fe29c152c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:31.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.858+0000 7fe29b7fe640 1 -- 172.21.15.60:0/331493683 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe29c15a770 msgr2=0x7fe29c1f0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:31.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.858+0000 7fe29b7fe640 1 --2- 172.21.15.60:0/331493683 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe29c15a770 0x7fe29c1f0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:31.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.858+0000 7fe29b7fe640 1 -- 172.21.15.60:0/331493683 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe29c153e70 con 0x7fe29c0af160 2024-09-12T02:34:31.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.858+0000 7fe29bfff640 1 --2- 172.21.15.60:0/331493683 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe29c15a770 0x7fe29c1f0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:31.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.860+0000 7fe29b7fe640 1 --2- 172.21.15.60:0/331493683 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe29c0af160 0x7fe29c15d190 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe28c00e800 tx=0x7fe28c00ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:31.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.860+0000 7fe298ff9640 1 -- 172.21.15.60:0/331493683 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28c0052e0 con 0x7fe29c0af160 2024-09-12T02:34:31.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.860+0000 7fe298ff9640 1 -- 172.21.15.60:0/331493683 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe28c018070 con 0x7fe29c0af160 2024-09-12T02:34:31.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.860+0000 7fe2a262c640 1 -- 172.21.15.60:0/331493683 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe29c154150 con 0x7fe29c0af160 2024-09-12T02:34:31.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.861+0000 7fe298ff9640 1 -- 172.21.15.60:0/331493683 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28c00c8a0 con 0x7fe29c0af160 2024-09-12T02:34:31.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.861+0000 7fe2a262c640 1 -- 172.21.15.60:0/331493683 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe29c15d6d0 con 0x7fe29c0af160 2024-09-12T02:34:31.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.863+0000 7fe2a262c640 1 -- 172.21.15.60:0/331493683 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe29c0ccfe0 con 0x7fe29c0af160 2024-09-12T02:34:31.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.866+0000 7fe298ff9640 1 -- 172.21.15.60:0/331493683 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe28c00ca40 con 0x7fe29c0af160 2024-09-12T02:34:31.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.866+0000 7fe298ff9640 1 --2- 172.21.15.60:0/331493683 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe28806be80 0x7fe28806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:31.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.867+0000 7fe298ff9640 1 -- 172.21.15.60:0/331493683 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fe28c08b110 con 0x7fe29c0af160 2024-09-12T02:34:31.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.867+0000 7fe29bfff640 1 --2- 172.21.15.60:0/331493683 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe28806be80 0x7fe28806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:31.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.867+0000 7fe29bfff640 1 --2- 172.21.15.60:0/331493683 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe28806be80 0x7fe28806e340 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe290009100 tx=0x7fe290008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:31.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:31.874+0000 7fe298ff9640 1 -- 172.21.15.60:0/331493683 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe28c01a310 con 0x7fe29c0af160 2024-09-12T02:34:32.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:32.382+0000 7fe2a262c640 1 -- 172.21.15.60:0/331493683 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe29c15eca0 con 0x7fe29c0af160 2024-09-12T02:34:32.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:32.384+0000 7fe298ff9640 1 -- 172.21.15.60:0/331493683 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1559 (secure 0 0 0) 0x7fe28c059710 con 0x7fe29c0af160 2024-09-12T02:34:32.385 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":114,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:34:32.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:32.387+0000 7fe2a262c640 1 -- 172.21.15.60:0/331493683 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe28806be80 msgr2=0x7fe28806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:32.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:32.387+0000 7fe2a262c640 1 --2- 172.21.15.60:0/331493683 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe28806be80 0x7fe28806e340 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe290009100 tx=0x7fe290008040 comp rx=0 tx=0).stop 2024-09-12T02:34:32.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:32.387+0000 7fe2a262c640 1 -- 172.21.15.60:0/331493683 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe29c0af160 msgr2=0x7fe29c15d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:32.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:32.387+0000 7fe2a262c640 1 --2- 172.21.15.60:0/331493683 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe29c0af160 0x7fe29c15d190 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe28c00e800 tx=0x7fe28c00ecc0 comp rx=0 tx=0).stop 2024-09-12T02:34:32.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:32.388+0000 7fe2a262c640 1 -- 172.21.15.60:0/331493683 shutdown_connections 2024-09-12T02:34:32.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:32.388+0000 7fe2a262c640 1 --2- 172.21.15.60:0/331493683 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe28806be80 0x7fe28806e340 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:32.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:32.388+0000 7fe2a262c640 1 --2- 172.21.15.60:0/331493683 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe29c152790 0x7fe29c152c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:32.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:32.389+0000 7fe2a262c640 1 --2- 172.21.15.60:0/331493683 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe29c0af160 0x7fe29c15d190 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:32.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:32.389+0000 7fe2a262c640 1 --2- 172.21.15.60:0/331493683 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe29c15a770 0x7fe29c1f0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:32.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:32.389+0000 7fe2a262c640 1 -- 172.21.15.60:0/331493683 >> 172.21.15.60:0/331493683 conn(0x7fe29c0adb80 msgr2=0x7fe29c159b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:32.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:32.389+0000 7fe2a262c640 1 -- 172.21.15.60:0/331493683 shutdown_connections 2024-09-12T02:34:32.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:32.391+0000 7fe2a262c640 1 -- 172.21.15.60:0/331493683 wait complete. 2024-09-12T02:34:35.413 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:34:35.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.583+0000 7fc078359640 1 Processor -- start 2024-09-12T02:34:35.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.584+0000 7fc078359640 1 -- start start 2024-09-12T02:34:35.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.585+0000 7fc078359640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc0700c6010 0x7fc07006dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:35.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.586+0000 7fc0758f4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc0700c6010 0x7fc07006dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:35.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.586+0000 7fc0758f4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc0700c6010 0x7fc07006dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55224/0 (socket says 172.21.15.60:55224) 2024-09-12T02:34:35.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.586+0000 7fc0758f4640 1 -- 172.21.15.60:0/1517235761 learned_addr learned my addr 172.21.15.60:0/1517235761 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:34:35.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.586+0000 7fc078359640 1 -- 172.21.15.60:0/1517235761 --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc07015a970 con 0x7fc0700a6c10 2024-09-12T02:34:35.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.586+0000 7fc078359640 1 -- 172.21.15.60:0/1517235761 --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc07015ac50 con 0x7fc0700c5940 2024-09-12T02:34:35.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.586+0000 7fc078359640 1 -- 172.21.15.60:0/1517235761 --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fc07015af30 con 0x7fc0700c6010 2024-09-12T02:34:35.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.586+0000 7fc0758f4640 1 -- 172.21.15.60:0/1517235761 >> v1:172.21.15.105:6789/0 conn(0x7fc0700c5940 legacy=0x7fc07006dff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:34:35.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.586+0000 7fc0758f4640 1 -- 172.21.15.60:0/1517235761 >> v1:172.21.15.60:6789/0 conn(0x7fc0700a6c10 legacy=0x7fc0700c2440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:34:35.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.586+0000 7fc0758f4640 1 -- 172.21.15.60:0/1517235761 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc07015b210 con 0x7fc0700c6010 2024-09-12T02:34:35.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.587+0000 7fc0758f4640 1 --2- 172.21.15.60:0/1517235761 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0700c6010 0x7fc07006dab0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc060009ad0 tx=0x7fc06002a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47a4622353bd9733 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:35.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.589+0000 7fc0750f3640 1 -- 172.21.15.60:0/1517235761 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc060036070 con 0x7fc0700c6010 2024-09-12T02:34:35.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.589+0000 7fc0750f3640 1 -- 172.21.15.60:0/1517235761 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc060031600 con 0x7fc0700c6010 2024-09-12T02:34:35.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.589+0000 7fc0750f3640 1 -- 172.21.15.60:0/1517235761 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0600319d0 con 0x7fc0700c6010 2024-09-12T02:34:35.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.590+0000 7fc078359640 1 -- 172.21.15.60:0/1517235761 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0700c6010 msgr2=0x7fc07006dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:35.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.590+0000 7fc078359640 1 --2- 172.21.15.60:0/1517235761 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0700c6010 0x7fc07006dab0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc060009ad0 tx=0x7fc06002a420 comp rx=0 tx=0).stop 2024-09-12T02:34:35.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.591+0000 7fc078359640 1 -- 172.21.15.60:0/1517235761 shutdown_connections 2024-09-12T02:34:35.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.591+0000 7fc078359640 1 --2- 172.21.15.60:0/1517235761 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0700c6010 0x7fc07006dab0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:35.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.591+0000 7fc078359640 1 -- 172.21.15.60:0/1517235761 >> 172.21.15.60:0/1517235761 conn(0x7fc0700c7a40 msgr2=0x7fc0700c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:35.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.592+0000 7fc078359640 1 -- 172.21.15.60:0/1517235761 shutdown_connections 2024-09-12T02:34:35.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.593+0000 7fc078359640 1 -- 172.21.15.60:0/1517235761 wait complete. 2024-09-12T02:34:35.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.596+0000 7fc078359640 1 Processor -- start 2024-09-12T02:34:35.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.596+0000 7fc078359640 1 -- start start 2024-09-12T02:34:35.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.597+0000 7fc078359640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0700a6c10 0x7fc0701f3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:35.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.597+0000 7fc078359640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0700c5940 0x7fc07015bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:35.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.597+0000 7fc078359640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0700c6010 0x7fc07015c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:35.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.597+0000 7fc078359640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc0700c2b50 con 0x7fc0700c5940 2024-09-12T02:34:35.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.597+0000 7fc078359640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc07015a620 con 0x7fc0700a6c10 2024-09-12T02:34:35.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.597+0000 7fc078359640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc0700c2cd0 con 0x7fc0700c6010 2024-09-12T02:34:35.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.598+0000 7fc0760f5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0700a6c10 0x7fc0701f3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:35.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.598+0000 7fc0760f5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0700a6c10 0x7fc0701f3a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:52736/0 (socket says 172.21.15.60:52736) 2024-09-12T02:34:35.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.598+0000 7fc0760f5640 1 -- 172.21.15.60:0/3638517666 learned_addr learned my addr 172.21.15.60:0/3638517666 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:34:35.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.598+0000 7fc0758f4640 1 --2- 172.21.15.60:0/3638517666 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0700c5940 0x7fc07015bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:35.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.598+0000 7fc0768f6640 1 --2- 172.21.15.60:0/3638517666 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0700c6010 0x7fc07015c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:35.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.598+0000 7fc0768f6640 1 -- 172.21.15.60:0/3638517666 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0700c6010 msgr2=0x7fc07015c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-12T02:34:35.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.598+0000 7fc0768f6640 1 -- 172.21.15.60:0/3638517666 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0700c6010 msgr2=0x7fc07015c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:34:35.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.598+0000 7fc0768f6640 1 --2- 172.21.15.60:0/3638517666 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0700c6010 0x7fc07015c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:34:35.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.598+0000 7fc0768f6640 1 --2- 172.21.15.60:0/3638517666 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0700c6010 0x7fc07015c4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:34:35.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.598+0000 7fc0760f5640 1 -- 172.21.15.60:0/3638517666 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0700c6010 msgr2=0x7fc07015c4f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:34:35.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.598+0000 7fc0760f5640 1 --2- 172.21.15.60:0/3638517666 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0700c6010 0x7fc07015c4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:35.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.599+0000 7fc0760f5640 1 -- 172.21.15.60:0/3638517666 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0700c5940 msgr2=0x7fc07015bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:35.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.599+0000 7fc0760f5640 1 --2- 172.21.15.60:0/3638517666 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0700c5940 0x7fc07015bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:35.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.599+0000 7fc0760f5640 1 -- 172.21.15.60:0/3638517666 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc07015ec40 con 0x7fc0700a6c10 2024-09-12T02:34:35.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.600+0000 7fc0760f5640 1 --2- 172.21.15.60:0/3638517666 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0700a6c10 0x7fc0701f3a50 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc06c00b450 tx=0x7fc06c00b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:35.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.600+0000 7fc066ffd640 1 -- 172.21.15.60:0/3638517666 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc06c015020 con 0x7fc0700a6c10 2024-09-12T02:34:35.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.600+0000 7fc066ffd640 1 -- 172.21.15.60:0/3638517666 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc06c0118b0 con 0x7fc0700a6c10 2024-09-12T02:34:35.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.600+0000 7fc066ffd640 1 -- 172.21.15.60:0/3638517666 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc06c011ca0 con 0x7fc0700a6c10 2024-09-12T02:34:35.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.600+0000 7fc078359640 1 -- 172.21.15.60:0/3638517666 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0701f4290 con 0x7fc0700a6c10 2024-09-12T02:34:35.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.600+0000 7fc078359640 1 -- 172.21.15.60:0/3638517666 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc070157430 con 0x7fc0700a6c10 2024-09-12T02:34:35.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.601+0000 7fc078359640 1 -- 172.21.15.60:0/3638517666 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0700c32a0 con 0x7fc0700a6c10 2024-09-12T02:34:35.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.606+0000 7fc066ffd640 1 -- 172.21.15.60:0/3638517666 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc06c018020 con 0x7fc0700a6c10 2024-09-12T02:34:35.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.606+0000 7fc066ffd640 1 --2- 172.21.15.60:0/3638517666 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc05406bf30 0x7fc05406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:35.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.607+0000 7fc0758f4640 1 --2- 172.21.15.60:0/3638517666 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc05406bf30 0x7fc05406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:35.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.607+0000 7fc066ffd640 1 -- 172.21.15.60:0/3638517666 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fc06c08b5a0 con 0x7fc0700a6c10 2024-09-12T02:34:35.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.607+0000 7fc0758f4640 1 --2- 172.21.15.60:0/3638517666 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc05406bf30 0x7fc05406e3f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc060033000 tx=0x7fc060008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:35.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:35.616+0000 7fc066ffd640 1 -- 172.21.15.60:0/3638517666 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc0700c32a0 con 0x7fc0700a6c10 2024-09-12T02:34:36.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:36.110+0000 7fc078359640 1 -- 172.21.15.60:0/3638517666 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc070159140 con 0x7fc0700a6c10 2024-09-12T02:34:36.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:36.110+0000 7fc066ffd640 1 -- 172.21.15.60:0/3638517666 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1559 (secure 0 0 0) 0x7fc06c01f020 con 0x7fc0700a6c10 2024-09-12T02:34:36.111 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":114,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:34:36.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:36.114+0000 7fc078359640 1 -- 172.21.15.60:0/3638517666 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc05406bf30 msgr2=0x7fc05406e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:36.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:36.114+0000 7fc078359640 1 --2- 172.21.15.60:0/3638517666 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc05406bf30 0x7fc05406e3f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc060033000 tx=0x7fc060008030 comp rx=0 tx=0).stop 2024-09-12T02:34:36.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:36.114+0000 7fc078359640 1 -- 172.21.15.60:0/3638517666 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0700a6c10 msgr2=0x7fc0701f3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:36.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:36.114+0000 7fc078359640 1 --2- 172.21.15.60:0/3638517666 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0700a6c10 0x7fc0701f3a50 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc06c00b450 tx=0x7fc06c00b910 comp rx=0 tx=0).stop 2024-09-12T02:34:36.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:36.114+0000 7fc078359640 1 -- 172.21.15.60:0/3638517666 shutdown_connections 2024-09-12T02:34:36.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:36.114+0000 7fc078359640 1 --2- 172.21.15.60:0/3638517666 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc05406bf30 0x7fc05406e3f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:36.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:36.114+0000 7fc078359640 1 --2- 172.21.15.60:0/3638517666 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0700c6010 0x7fc07015c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:36.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:36.114+0000 7fc078359640 1 --2- 172.21.15.60:0/3638517666 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0700c5940 0x7fc07015bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:36.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:36.114+0000 7fc078359640 1 --2- 172.21.15.60:0/3638517666 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0700a6c10 0x7fc0701f3a50 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:36.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:36.114+0000 7fc078359640 1 -- 172.21.15.60:0/3638517666 >> 172.21.15.60:0/3638517666 conn(0x7fc0700c7a40 msgr2=0x7fc0700c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:36.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:36.115+0000 7fc078359640 1 -- 172.21.15.60:0/3638517666 shutdown_connections 2024-09-12T02:34:36.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:36.115+0000 7fc078359640 1 -- 172.21.15.60:0/3638517666 wait complete. 2024-09-12T02:34:39.136 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:34:39.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.310+0000 7f911c503640 1 Processor -- start 2024-09-12T02:34:39.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.310+0000 7f911c503640 1 -- start start 2024-09-12T02:34:39.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.312+0000 7f911c503640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f911414f820 0x7f91141562d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:39.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.312+0000 7f911c503640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f91140c7230 0x7f911414fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:39.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.312+0000 7f911c503640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f911406edd0 0x7f91140c41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:39.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.312+0000 7f911c503640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f91140c53f0 con 0x7f91140c7230 2024-09-12T02:34:39.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.312+0000 7f911c503640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f91140c2d60 con 0x7f911414f820 2024-09-12T02:34:39.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.312+0000 7f911c503640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f91140c3040 con 0x7f911406edd0 2024-09-12T02:34:39.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.313+0000 7f911a29f640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f911414f820 0x7f91141562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:39.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.313+0000 7f911a29f640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f911414f820 0x7f91141562d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:52746/0 (socket says 172.21.15.60:52746) 2024-09-12T02:34:39.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.313+0000 7f911a29f640 1 -- 172.21.15.60:0/2931365098 learned_addr learned my addr 172.21.15.60:0/2931365098 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:34:39.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.313+0000 7f911aaa0640 1 --2- 172.21.15.60:0/2931365098 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f911406edd0 0x7f91140c41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:39.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.314+0000 7f9119a9e640 1 --2- 172.21.15.60:0/2931365098 >> v2:172.21.15.60:3300/0 conn(0x7f91140c7230 0x7f911414fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:39.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.314+0000 7f911aaa0640 1 -- 172.21.15.60:0/2931365098 >> v2:172.21.15.105:3300/0 conn(0x7f911414f820 msgr2=0x7f91141562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:39.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.314+0000 7f911aaa0640 1 --2- 172.21.15.60:0/2931365098 >> v2:172.21.15.105:3300/0 conn(0x7f911414f820 0x7f91141562d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:39.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.314+0000 7f911aaa0640 1 -- 172.21.15.60:0/2931365098 >> v2:172.21.15.60:3300/0 conn(0x7f91140c7230 msgr2=0x7f911414fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:39.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.314+0000 7f911aaa0640 1 --2- 172.21.15.60:0/2931365098 >> v2:172.21.15.60:3300/0 conn(0x7f91140c7230 0x7f911414fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:39.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.314+0000 7f911aaa0640 1 -- 172.21.15.60:0/2931365098 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91141526a0 con 0x7f911406edd0 2024-09-12T02:34:39.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.315+0000 7f911aaa0640 1 --2- 172.21.15.60:0/2931365098 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f911406edd0 0x7f91140c41e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f91140c51f0 tx=0x7f910402a4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24cc6bdebe4ab2dc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:39.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.316+0000 7f911929d640 1 -- 172.21.15.60:0/2931365098 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9104007740 con 0x7f911406edd0 2024-09-12T02:34:39.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.316+0000 7f911929d640 1 -- 172.21.15.60:0/2931365098 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91040078e0 con 0x7f911406edd0 2024-09-12T02:34:39.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.316+0000 7f911929d640 1 -- 172.21.15.60:0/2931365098 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9104007cb0 con 0x7f911406edd0 2024-09-12T02:34:39.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.317+0000 7f911c503640 1 -- 172.21.15.60:0/2931365098 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f911406edd0 msgr2=0x7f91140c41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:39.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.317+0000 7f911c503640 1 --2- 172.21.15.60:0/2931365098 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f911406edd0 0x7f91140c41e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f91140c51f0 tx=0x7f910402a4b0 comp rx=0 tx=0).stop 2024-09-12T02:34:39.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.318+0000 7f911c503640 1 -- 172.21.15.60:0/2931365098 shutdown_connections 2024-09-12T02:34:39.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.318+0000 7f911c503640 1 --2- 172.21.15.60:0/2931365098 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f911406edd0 0x7f91140c41e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:39.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.318+0000 7f911c503640 1 --2- 172.21.15.60:0/2931365098 >> v2:172.21.15.60:3300/0 conn(0x7f91140c7230 0x7f911414fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:39.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.318+0000 7f911c503640 1 --2- 172.21.15.60:0/2931365098 >> v2:172.21.15.105:3300/0 conn(0x7f911414f820 0x7f91141562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:39.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.318+0000 7f911c503640 1 -- 172.21.15.60:0/2931365098 >> 172.21.15.60:0/2931365098 conn(0x7f91140c7a40 msgr2=0x7f91140c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:39.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.318+0000 7f911c503640 1 -- 172.21.15.60:0/2931365098 shutdown_connections 2024-09-12T02:34:39.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.318+0000 7f911c503640 1 -- 172.21.15.60:0/2931365098 wait complete. 2024-09-12T02:34:39.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.320+0000 7f911c503640 1 Processor -- start 2024-09-12T02:34:39.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.321+0000 7f911c503640 1 -- start start 2024-09-12T02:34:39.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.323+0000 7f911c503640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f911406edd0 0x7f9114143d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:39.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.323+0000 7f911c503640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91140c7230 0x7f91141f2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:39.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.323+0000 7f911c503640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f911414f820 0x7f91140a9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:39.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.324+0000 7f911c503640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f91140c5d70 con 0x7f911414f820 2024-09-12T02:34:39.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.324+0000 7f911c503640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f91140c5bf0 con 0x7f911406edd0 2024-09-12T02:34:39.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.324+0000 7f911c503640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f91140c4720 con 0x7f91140c7230 2024-09-12T02:34:39.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.324+0000 7f911aaa0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f911414f820 0x7f91140a9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:39.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.324+0000 7f911aaa0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f911414f820 0x7f91140a9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55258/0 (socket says 172.21.15.60:55258) 2024-09-12T02:34:39.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.324+0000 7f911aaa0640 1 -- 172.21.15.60:0/645796811 learned_addr learned my addr 172.21.15.60:0/645796811 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:34:39.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.324+0000 7f911a29f640 1 --2- 172.21.15.60:0/645796811 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f911406edd0 0x7f9114143d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:39.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.325+0000 7f911aaa0640 1 -- 172.21.15.60:0/645796811 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91140c7230 msgr2=0x7f91141f2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:39.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.325+0000 7f911aaa0640 1 --2- 172.21.15.60:0/645796811 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91140c7230 0x7f91141f2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:39.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.325+0000 7f911aaa0640 1 -- 172.21.15.60:0/645796811 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f911406edd0 msgr2=0x7f9114143d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:39.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.325+0000 7f911aaa0640 1 --2- 172.21.15.60:0/645796811 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f911406edd0 0x7f9114143d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:39.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.325+0000 7f911aaa0640 1 -- 172.21.15.60:0/645796811 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91140acee0 con 0x7f911414f820 2024-09-12T02:34:39.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.325+0000 7f911aaa0640 1 --2- 172.21.15.60:0/645796811 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f911414f820 0x7f91140a9830 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9104009e50 tx=0x7f9104004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:39.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.325+0000 7f9112ffd640 1 -- 172.21.15.60:0/645796811 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f910403f070 con 0x7f911414f820 2024-09-12T02:34:39.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.326+0000 7f911c503640 1 -- 172.21.15.60:0/645796811 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91140a6000 con 0x7f911414f820 2024-09-12T02:34:39.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.326+0000 7f9112ffd640 1 -- 172.21.15.60:0/645796811 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9104031c70 con 0x7f911414f820 2024-09-12T02:34:39.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.326+0000 7f911c503640 1 -- 172.21.15.60:0/645796811 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91140a65c0 con 0x7f911414f820 2024-09-12T02:34:39.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.326+0000 7f9112ffd640 1 -- 172.21.15.60:0/645796811 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9104009450 con 0x7f911414f820 2024-09-12T02:34:39.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.327+0000 7f911c503640 1 -- 172.21.15.60:0/645796811 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90f4005290 con 0x7f911414f820 2024-09-12T02:34:39.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.330+0000 7f9112ffd640 1 -- 172.21.15.60:0/645796811 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9104044660 con 0x7f911414f820 2024-09-12T02:34:39.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.331+0000 7f9112ffd640 1 --2- 172.21.15.60:0/645796811 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f910006be30 0x7f910006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:39.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.331+0000 7f9112ffd640 1 -- 172.21.15.60:0/645796811 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f91040ac9f0 con 0x7f911414f820 2024-09-12T02:34:39.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.332+0000 7f911a29f640 1 --2- 172.21.15.60:0/645796811 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f910006be30 0x7f910006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:39.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.333+0000 7f911a29f640 1 --2- 172.21.15.60:0/645796811 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f910006be30 0x7f910006e2f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f910c009b30 tx=0x7f910c009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:39.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.339+0000 7f9112ffd640 1 -- 172.21.15.60:0/645796811 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9104031e20 con 0x7f911414f820 2024-09-12T02:34:39.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.839+0000 7f911c503640 1 -- 172.21.15.60:0/645796811 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f90f4005580 con 0x7f911414f820 2024-09-12T02:34:39.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.840+0000 7f9112ffd640 1 -- 172.21.15.60:0/645796811 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f910407ae50 con 0x7f911414f820 2024-09-12T02:34:39.841 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":118,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:34:39.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.844+0000 7f9110ff9640 1 -- 172.21.15.60:0/645796811 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f910006be30 msgr2=0x7f910006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:39.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.844+0000 7f9110ff9640 1 --2- 172.21.15.60:0/645796811 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f910006be30 0x7f910006e2f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f910c009b30 tx=0x7f910c009240 comp rx=0 tx=0).stop 2024-09-12T02:34:39.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.844+0000 7f9110ff9640 1 -- 172.21.15.60:0/645796811 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f911414f820 msgr2=0x7f91140a9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:39.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.844+0000 7f9110ff9640 1 --2- 172.21.15.60:0/645796811 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f911414f820 0x7f91140a9830 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9104009e50 tx=0x7f9104004a40 comp rx=0 tx=0).stop 2024-09-12T02:34:39.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.844+0000 7f9110ff9640 1 -- 172.21.15.60:0/645796811 shutdown_connections 2024-09-12T02:34:39.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.844+0000 7f9110ff9640 1 --2- 172.21.15.60:0/645796811 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f910006be30 0x7f910006e2f0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:39.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.844+0000 7f9110ff9640 1 --2- 172.21.15.60:0/645796811 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f911414f820 0x7f91140a9830 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:39.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.844+0000 7f9110ff9640 1 --2- 172.21.15.60:0/645796811 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91140c7230 0x7f91141f2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:39.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.844+0000 7f9110ff9640 1 --2- 172.21.15.60:0/645796811 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f911406edd0 0x7f9114143d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:39.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.844+0000 7f9110ff9640 1 -- 172.21.15.60:0/645796811 >> 172.21.15.60:0/645796811 conn(0x7f91140c7a40 msgr2=0x7f91140ab770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:39.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.844+0000 7f9110ff9640 1 -- 172.21.15.60:0/645796811 shutdown_connections 2024-09-12T02:34:39.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:39.845+0000 7f9110ff9640 1 -- 172.21.15.60:0/645796811 wait complete. 2024-09-12T02:34:39.865 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-12T02:34:39.865 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-12T02:34:39.866 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-12T02:34:40.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.049+0000 7f5849a1e640 1 Processor -- start 2024-09-12T02:34:40.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.049+0000 7f5849a1e640 1 -- start start 2024-09-12T02:34:40.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.050+0000 7f5849a1e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f58440729c0 0x7f5844072e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.050+0000 7f5849a1e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5844073390 0x7f5844165030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.050+0000 7f5842ffd640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f58440acd50 0x7f584415af30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:58364/0 (socket says 172.21.15.60:58364) 2024-09-12T02:34:40.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.050+0000 7f5849a1e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58440c63f0 con 0x7f58440acd50 2024-09-12T02:34:40.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.051+0000 7f5842ffd640 1 -- 172.21.15.60:0/2271954671 learned_addr learned my addr 172.21.15.60:0/2271954671 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:34:40.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.051+0000 7f58437fe640 1 --2- 172.21.15.60:0/2271954671 >> v2:172.21.15.60:3300/0 conn(0x7f5844073390 0x7f5844165030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.051+0000 7f5849a1e640 1 -- 172.21.15.60:0/2271954671 --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f5844072270 con 0x7f5844073390 2024-09-12T02:34:40.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.051+0000 7f58427fc640 1 --2- 172.21.15.60:0/2271954671 >> v2:172.21.15.105:3300/0 conn(0x7f58440729c0 0x7f5844072e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.051+0000 7f5849a1e640 1 -- 172.21.15.60:0/2271954671 --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f5844074660 con 0x7f58440729c0 2024-09-12T02:34:40.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.051+0000 7f5841ffb640 1 -- 172.21.15.60:0/2271954671 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3268258320 0 0) 0x7f58440c63f0 con 0x7f58440acd50 2024-09-12T02:34:40.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.051+0000 7f5841ffb640 1 -- 172.21.15.60:0/2271954671 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f582c003520 con 0x7f58440acd50 2024-09-12T02:34:40.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.051+0000 7f58427fc640 1 -- 172.21.15.60:0/2271954671 >> v2:172.21.15.60:3300/0 conn(0x7f5844073390 msgr2=0x7f5844165030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:40.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.051+0000 7f58427fc640 1 --2- 172.21.15.60:0/2271954671 >> v2:172.21.15.60:3300/0 conn(0x7f5844073390 0x7f5844165030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.051+0000 7f58427fc640 1 -- 172.21.15.60:0/2271954671 >> v1:172.21.15.60:6789/0 conn(0x7f58440acd50 legacy=0x7f584415af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:40.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.051+0000 7f58427fc640 1 -- 172.21.15.60:0/2271954671 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f584415dda0 con 0x7f58440729c0 2024-09-12T02:34:40.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.052+0000 7f58437fe640 1 --2- 172.21.15.60:0/2271954671 >> v2:172.21.15.60:3300/0 conn(0x7f5844073390 0x7f5844165030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:34:40.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.052+0000 7f58427fc640 1 --2- 172.21.15.60:0/2271954671 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58440729c0 0x7f5844072e50 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f5844071a00 tx=0x7f583802a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfdb4882cb816491 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:40.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.053+0000 7f5841ffb640 1 -- 172.21.15.60:0/2271954671 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5838037070 con 0x7f58440729c0 2024-09-12T02:34:40.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.053+0000 7f5841ffb640 1 -- 172.21.15.60:0/2271954671 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5838032440 con 0x7f58440729c0 2024-09-12T02:34:40.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.053+0000 7f5841ffb640 1 -- 172.21.15.60:0/2271954671 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f583802ae60 con 0x7f58440729c0 2024-09-12T02:34:40.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.054+0000 7f5849a1e640 1 -- 172.21.15.60:0/2271954671 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58440729c0 msgr2=0x7f5844072e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:40.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.054+0000 7f5849a1e640 1 --2- 172.21.15.60:0/2271954671 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58440729c0 0x7f5844072e50 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f5844071a00 tx=0x7f583802a110 comp rx=0 tx=0).stop 2024-09-12T02:34:40.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.054+0000 7f5849a1e640 1 -- 172.21.15.60:0/2271954671 shutdown_connections 2024-09-12T02:34:40.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.054+0000 7f5849a1e640 1 --2- 172.21.15.60:0/2271954671 >> v2:172.21.15.60:3300/0 conn(0x7f5844073390 0x7f5844165030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.054+0000 7f5849a1e640 1 --2- 172.21.15.60:0/2271954671 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58440729c0 0x7f5844072e50 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.054+0000 7f5849a1e640 1 -- 172.21.15.60:0/2271954671 >> 172.21.15.60:0/2271954671 conn(0x7f58440c5660 msgr2=0x7f58440c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:40.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.055+0000 7f5849a1e640 1 -- 172.21.15.60:0/2271954671 shutdown_connections 2024-09-12T02:34:40.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.055+0000 7f5849a1e640 1 -- 172.21.15.60:0/2271954671 wait complete. 2024-09-12T02:34:40.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.056+0000 7f5849a1e640 1 Processor -- start 2024-09-12T02:34:40.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.057+0000 7f5849a1e640 1 -- start start 2024-09-12T02:34:40.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.058+0000 7f5849a1e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58440729c0 0x7f584415d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.058+0000 7f5849a1e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5844073390 0x7f58441f30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.058+0000 7f5849a1e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58440acd50 0x7f58441f3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.058+0000 7f5849a1e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5844071d40 con 0x7f58440acd50 2024-09-12T02:34:40.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.058+0000 7f5849a1e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f58440748b0 con 0x7f5844073390 2024-09-12T02:34:40.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.058+0000 7f5849a1e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f58440abc10 con 0x7f58440729c0 2024-09-12T02:34:40.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.058+0000 7f58427fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5844073390 0x7f58441f30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.058+0000 7f58427fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5844073390 0x7f58441f30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:44224/0 (socket says 172.21.15.60:44224) 2024-09-12T02:34:40.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.058+0000 7f58437fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58440acd50 0x7f58441f3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.058+0000 7f58427fc640 1 -- 172.21.15.60:0/4286467781 learned_addr learned my addr 172.21.15.60:0/4286467781 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:34:40.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.059+0000 7f5842ffd640 1 --2- 172.21.15.60:0/4286467781 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58440729c0 0x7f584415d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.059+0000 7f58427fc640 1 -- 172.21.15.60:0/4286467781 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58440729c0 msgr2=0x7f584415d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:40.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.059+0000 7f58427fc640 1 --2- 172.21.15.60:0/4286467781 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58440729c0 0x7f584415d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.059+0000 7f58427fc640 1 -- 172.21.15.60:0/4286467781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58440acd50 msgr2=0x7f58441f3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:40.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.059+0000 7f58427fc640 1 --2- 172.21.15.60:0/4286467781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58440acd50 0x7f58441f3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.059+0000 7f58427fc640 1 -- 172.21.15.60:0/4286467781 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5844151da0 con 0x7f5844073390 2024-09-12T02:34:40.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.059+0000 7f58427fc640 1 --2- 172.21.15.60:0/4286467781 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5844073390 0x7f58441f30c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f5838000c00 tx=0x7f58380046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:40.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.060+0000 7f582bfff640 1 -- 172.21.15.60:0/4286467781 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5838037040 con 0x7f5844073390 2024-09-12T02:34:40.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.060+0000 7f582bfff640 1 -- 172.21.15.60:0/4286467781 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5838042070 con 0x7f5844073390 2024-09-12T02:34:40.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.060+0000 7f582bfff640 1 -- 172.21.15.60:0/4286467781 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5838006e10 con 0x7f5844073390 2024-09-12T02:34:40.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.060+0000 7f5849a1e640 1 -- 172.21.15.60:0/4286467781 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58441efc60 con 0x7f5844073390 2024-09-12T02:34:40.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.061+0000 7f5849a1e640 1 -- 172.21.15.60:0/4286467781 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58441526a0 con 0x7f5844073390 2024-09-12T02:34:40.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.063+0000 7f5849a1e640 1 --2- 172.21.15.60:0/4286467781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58440c8130 0x7f58441f3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.063+0000 7f5849a1e640 1 -- 172.21.15.60:0/4286467781 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5844152220 con 0x7f58440c8130 2024-09-12T02:34:40.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.063+0000 7f5842ffd640 1 --2- 172.21.15.60:0/4286467781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58440c8130 0x7f58441f3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.064+0000 7f5842ffd640 1 -- 172.21.15.60:0/4286467781 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5844151b50 con 0x7f58440c8130 2024-09-12T02:34:40.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.064+0000 7f5842ffd640 1 --2- 172.21.15.60:0/4286467781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58440c8130 0x7f58441f3b40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5834005880 tx=0x7f583400e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:40.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.064+0000 7f582bfff640 1 -- 172.21.15.60:0/4286467781 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5834019070 con 0x7f58440c8130 2024-09-12T02:34:40.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.065+0000 7f582bfff640 1 -- 172.21.15.60:0/4286467781 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5834005ac0 con 0x7f58440c8130 2024-09-12T02:34:40.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.065+0000 7f582bfff640 1 -- 172.21.15.60:0/4286467781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58440c8130 msgr2=0x7f58441f3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:40.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.065+0000 7f582bfff640 1 --2- 172.21.15.60:0/4286467781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58440c8130 0x7f58441f3b40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5834005880 tx=0x7f583400e960 comp rx=0 tx=0).stop 2024-09-12T02:34:40.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.065+0000 7f582bfff640 1 -- 172.21.15.60:0/4286467781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58440c8130 msgr2=0x7f58441f3b40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:34:40.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.065+0000 7f582bfff640 1 --2- 172.21.15.60:0/4286467781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58440c8130 0x7f58441f3b40 secure :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5834005880 tx=0x7f583400e960 comp rx=0 tx=0).stop 2024-09-12T02:34:40.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.066+0000 7f582bfff640 1 -- 172.21.15.60:0/4286467781 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5838032a50 con 0x7f5844073390 2024-09-12T02:34:40.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.067+0000 7f582bfff640 1 --2- 172.21.15.60:0/4286467781 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f583006b910 0x7f583006ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.068+0000 7f582bfff640 1 -- 172.21.15.60:0/4286467781 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f58380abd00 con 0x7f5844073390 2024-09-12T02:34:40.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.070+0000 7f5842ffd640 1 --2- 172.21.15.60:0/4286467781 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f583006b910 0x7f583006ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.071+0000 7f5842ffd640 1 --2- 172.21.15.60:0/4286467781 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f583006b910 0x7f583006ddd0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5834005880 tx=0x7f5834007000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:40.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.079+0000 7f5849a1e640 1 --2- 172.21.15.60:0/4286467781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58440c6960 0x7f58440c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.079+0000 7f5849a1e640 1 -- 172.21.15.60:0/4286467781 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5844075cc0 con 0x7f58440c6960 2024-09-12T02:34:40.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.079+0000 7f58437fe640 1 --2- 172.21.15.60:0/4286467781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58440c6960 0x7f58440c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.080+0000 7f58437fe640 1 -- 172.21.15.60:0/4286467781 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5844068f80 con 0x7f58440c6960 2024-09-12T02:34:40.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.080+0000 7f58437fe640 1 --2- 172.21.15.60:0/4286467781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58440c6960 0x7f58440c6d70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f583c009e70 tx=0x7f583c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:40.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.082+0000 7f582bfff640 1 -- 172.21.15.60:0/4286467781 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f583c003b90 con 0x7f58440c6960 2024-09-12T02:34:40.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.082+0000 7f582bfff640 1 -- 172.21.15.60:0/4286467781 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4551 (secure 0 0 0) 0x7f583c01d440 con 0x7f58440c6960 2024-09-12T02:34:40.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.082+0000 7f582bfff640 1 -- 172.21.15.60:0/4286467781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58440c6960 msgr2=0x7f58440c6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:40.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.082+0000 7f582bfff640 1 --2- 172.21.15.60:0/4286467781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58440c6960 0x7f58440c6d70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f583c009e70 tx=0x7f583c00f580 comp rx=0 tx=0).stop 2024-09-12T02:34:40.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.082+0000 7f582bfff640 1 -- 172.21.15.60:0/4286467781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58440c6960 msgr2=0x7f58440c6d70 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:34:40.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.082+0000 7f582bfff640 1 --2- 172.21.15.60:0/4286467781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58440c6960 0x7f58440c6d70 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f583c009e70 tx=0x7f583c00f580 comp rx=0 tx=0).stop 2024-09-12T02:34:40.084 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:34:40.084 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:34:40.084 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:34:40.084 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:34:40.084 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 118, 2024-09-12T02:34:40.084 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 20683, 2024-09-12T02:34:40.084 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:34:40.085 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:34:40.085 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:34:40.085 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:34:40.085 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:34:40.085 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 2, 2024-09-12T02:34:40.085 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:34:40.085 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:34:40.085 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:34:40.085 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:34:40.085 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:34:40.085 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:34:40.085 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:34:40.086 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:34:40.086 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:34:40.086 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:34:40.086 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:34:40.086 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:34:40.086 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:34:40.086 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:34:40.086 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:34:40.086 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:34:40.086 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:34:40.086 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:34:40.086 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:34:40.086 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:34:40.087 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:34:40.087 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:34:40.087 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:34:40.087 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:34:40.087 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:34:40.087 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:34:40.087 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:34:40.087 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:34:40.087 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:34:40.087 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:40.087 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:34:40.088 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:34:40.088 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:34:40.088 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:34:40.088 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:34:40.088 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:34:40.088 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:34:40.088 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:34:40.088 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:34:40.088 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:34:40.088 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:34:40.088 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:34:40.088 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:34:40.089 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:34:40.089 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:34:40.089 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:34:40.089 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:34:40.089 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:34:40.089 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:34:40.089 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:34:40.089 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:34:40.089 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:34:40.089 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:34:40.089 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:34:40.089 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:34:40.089 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:34:40.090 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:34:40.090 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:34:40.090 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:34:40.090 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:34:40.090 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:40.090 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:34:40.090 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:40.090 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:34:40.090 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:34:40.090 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:34:40.090 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:34:40.090 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:40.091 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:34:40.091 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:34:40.091 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:34:40.091 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:40.091 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:40.091 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:34:40.091 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:34:40.091 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:34:40.091 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:34:40.091 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:34:40.091 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:40.091 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:34:40.091 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:34:40.091 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:34:40.092 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:34:40.092 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:34:40.092 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:40.092 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:40.092 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:34:40.092 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:34:40.092 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:34:40.092 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:34:40.092 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:40.092 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:34:40.092 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:34:40.092 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:34:40.092 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:40.093 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:40.093 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:34:40.093 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:34:40.093 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:34:40.093 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:34:40.093 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:34:40.093 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:40.093 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:34:40.093 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:34:40.093 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:34:40.093 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:34:40.093 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:34:40.093 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:40.094 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:40.094 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:34:40.094 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:34:40.094 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:34:40.094 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:34:40.094 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:40.094 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:34:40.094 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:34:40.094 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:34:40.094 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:40.094 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:40.094 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:34:40.095 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:34:40.095 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:34:40.095 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:34:40.095 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:34:40.095 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:40.095 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:34:40.095 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:34:40.095 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:34:40.095 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:34:40.095 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:34:40.095 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:34:40.095 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:34:40.095 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:40.095 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:34:40.096 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:34:40.096 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:40.096 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:34:40.096 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:34:40.096 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:34:40.096 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:34:40.096 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:34:40.096 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:34:40.096 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:40.096 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:34:40.096 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:34:40.096 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:34:40.096 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:34:40.097 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:34:40.097 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:40.097 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:34:40.097 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:34:40.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.085+0000 7f5829ffb640 1 -- 172.21.15.60:0/4286467781 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f583006b910 msgr2=0x7f583006ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:40.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.085+0000 7f5829ffb640 1 --2- 172.21.15.60:0/4286467781 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f583006b910 0x7f583006ddd0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5834005880 tx=0x7f5834007000 comp rx=0 tx=0).stop 2024-09-12T02:34:40.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.085+0000 7f5829ffb640 1 -- 172.21.15.60:0/4286467781 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5844073390 msgr2=0x7f58441f30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:40.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.085+0000 7f5829ffb640 1 --2- 172.21.15.60:0/4286467781 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5844073390 0x7f58441f30c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f5838000c00 tx=0x7f58380046c0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.085+0000 7f58437fe640 1 -- 172.21.15.60:0/4286467781 reap_dead start 2024-09-12T02:34:40.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.085+0000 7f58437fe640 1 -- 172.21.15.60:0/4286467781 reap_dead start 2024-09-12T02:34:40.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.085+0000 7f5829ffb640 1 -- 172.21.15.60:0/4286467781 shutdown_connections 2024-09-12T02:34:40.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.085+0000 7f5829ffb640 1 -- 172.21.15.60:0/4286467781 >> 172.21.15.60:0/4286467781 conn(0x7f58440c5660 msgr2=0x7f5844073970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:40.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.087+0000 7f5829ffb640 1 -- 172.21.15.60:0/4286467781 shutdown_connections 2024-09-12T02:34:40.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.087+0000 7f5829ffb640 1 -- 172.21.15.60:0/4286467781 wait complete. 2024-09-12T02:34:40.104 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:34:40.105 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-12T02:34:40.105 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-12T02:34:40.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.286+0000 7f7e853b7640 1 Processor -- start 2024-09-12T02:34:40.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.286+0000 7f7e853b7640 1 -- start start 2024-09-12T02:34:40.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.288+0000 7f7e853b7640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7e800c5110 0x7f7e8006f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.288+0000 7f7e853b7640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7e800c3660 0x7f7e800c3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.288+0000 7f7e7effd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7e800c5110 0x7f7e8006f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.288+0000 7f7e853b7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e801569b0 0x7f7e8014fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.288+0000 7f7e853b7640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f7e800c2e10 con 0x7f7e800c5110 2024-09-12T02:34:40.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.288+0000 7f7e7effd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7e800c5110 0x7f7e8006f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54908/0 (socket says 172.21.15.60:54908) 2024-09-12T02:34:40.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.288+0000 7f7e7effd640 1 -- 172.21.15.60:0/4203331565 learned_addr learned my addr 172.21.15.60:0/4203331565 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:34:40.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.288+0000 7f7e853b7640 1 -- 172.21.15.60:0/4203331565 --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f7e800c30f0 con 0x7f7e800c3660 2024-09-12T02:34:40.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.288+0000 7f7e853b7640 1 -- 172.21.15.60:0/4203331565 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7e80155ed0 con 0x7f7e801569b0 2024-09-12T02:34:40.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.288+0000 7f7e7e7fc640 1 --2- 172.21.15.60:0/4203331565 >> v2:172.21.15.105:3300/0 conn(0x7f7e800c3660 0x7f7e800c3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.289+0000 7f7e7f7fe640 1 --2- 172.21.15.60:0/4203331565 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e801569b0 0x7f7e8014fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.289+0000 7f7e7f7fe640 1 -- 172.21.15.60:0/4203331565 >> v2:172.21.15.105:3300/0 conn(0x7f7e800c3660 msgr2=0x7f7e800c3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:40.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.289+0000 7f7e7f7fe640 1 --2- 172.21.15.60:0/4203331565 >> v2:172.21.15.105:3300/0 conn(0x7f7e800c3660 0x7f7e800c3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.289+0000 7f7e7f7fe640 1 -- 172.21.15.60:0/4203331565 >> v2:172.21.15.60:3300/0 conn(0x7f7e800c5110 msgr2=0x7f7e8006f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:40.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.289+0000 7f7e7f7fe640 1 --2- 172.21.15.60:0/4203331565 >> v2:172.21.15.60:3300/0 conn(0x7f7e800c5110 0x7f7e8006f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.289+0000 7f7e7f7fe640 1 -- 172.21.15.60:0/4203331565 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e801561b0 con 0x7f7e801569b0 2024-09-12T02:34:40.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.289+0000 7f7e7effd640 1 --2- 172.21.15.60:0/4203331565 >> v2:172.21.15.60:3300/0 conn(0x7f7e800c5110 0x7f7e8006f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:34:40.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.290+0000 7f7e7e7fc640 1 --2- 172.21.15.60:0/4203331565 >> v2:172.21.15.105:3300/0 conn(0x7f7e800c3660 0x7f7e800c3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:34:40.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.291+0000 7f7e7f7fe640 1 --2- 172.21.15.60:0/4203331565 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e801569b0 0x7f7e8014fb10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7e800c2ad0 tx=0x7f7e7802e960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68dd1fe1f73d9123 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:40.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.291+0000 7f7e7dffb640 1 -- 172.21.15.60:0/4203331565 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e78034650 con 0x7f7e801569b0 2024-09-12T02:34:40.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.291+0000 7f7e7dffb640 1 -- 172.21.15.60:0/4203331565 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e78039070 con 0x7f7e801569b0 2024-09-12T02:34:40.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.291+0000 7f7e7dffb640 1 -- 172.21.15.60:0/4203331565 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e78034a30 con 0x7f7e801569b0 2024-09-12T02:34:40.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.292+0000 7f7e853b7640 1 -- 172.21.15.60:0/4203331565 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e801569b0 msgr2=0x7f7e8014fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:40.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.293+0000 7f7e853b7640 1 --2- 172.21.15.60:0/4203331565 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e801569b0 0x7f7e8014fb10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7e800c2ad0 tx=0x7f7e7802e960 comp rx=0 tx=0).stop 2024-09-12T02:34:40.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.293+0000 7f7e853b7640 1 -- 172.21.15.60:0/4203331565 shutdown_connections 2024-09-12T02:34:40.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.293+0000 7f7e853b7640 1 --2- 172.21.15.60:0/4203331565 >> v2:172.21.15.105:3300/0 conn(0x7f7e800c3660 0x7f7e800c3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.293+0000 7f7e853b7640 1 --2- 172.21.15.60:0/4203331565 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e801569b0 0x7f7e8014fb10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.293+0000 7f7e853b7640 1 --2- 172.21.15.60:0/4203331565 >> v2:172.21.15.60:3300/0 conn(0x7f7e800c5110 0x7f7e8006f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.293+0000 7f7e853b7640 1 -- 172.21.15.60:0/4203331565 >> 172.21.15.60:0/4203331565 conn(0x7f7e800c8410 msgr2=0x7f7e800c87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:40.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.297+0000 7f7e853b7640 1 -- 172.21.15.60:0/4203331565 shutdown_connections 2024-09-12T02:34:40.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.298+0000 7f7e853b7640 1 -- 172.21.15.60:0/4203331565 wait complete. 2024-09-12T02:34:40.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.301+0000 7f7e853b7640 1 Processor -- start 2024-09-12T02:34:40.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.301+0000 7f7e853b7640 1 -- start start 2024-09-12T02:34:40.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.302+0000 7f7e853b7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e800c3660 0x7f7e800ad810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.302+0000 7f7e853b7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e800c5110 0x7f7e80143470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.302+0000 7f7e853b7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e801569b0 0x7f7e801439b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.302+0000 7f7e853b7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7e800c5670 con 0x7f7e800c5110 2024-09-12T02:34:40.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.302+0000 7f7e853b7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7e800c54f0 con 0x7f7e800c3660 2024-09-12T02:34:40.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.302+0000 7f7e853b7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7e800c4120 con 0x7f7e801569b0 2024-09-12T02:34:40.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.303+0000 7f7e7f7fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e801569b0 0x7f7e801439b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.303+0000 7f7e7f7fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e801569b0 0x7f7e801439b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:59100/0 (socket says 172.21.15.60:59100) 2024-09-12T02:34:40.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.303+0000 7f7e7f7fe640 1 -- 172.21.15.60:0/424261775 learned_addr learned my addr 172.21.15.60:0/424261775 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:34:40.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.303+0000 7f7e7effd640 1 --2- 172.21.15.60:0/424261775 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e800c3660 0x7f7e800ad810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.303+0000 7f7e7e7fc640 1 --2- 172.21.15.60:0/424261775 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e800c5110 0x7f7e80143470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.304+0000 7f7e7effd640 1 -- 172.21.15.60:0/424261775 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e801569b0 msgr2=0x7f7e801439b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:40.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.304+0000 7f7e7effd640 1 --2- 172.21.15.60:0/424261775 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e801569b0 0x7f7e801439b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.304+0000 7f7e7effd640 1 -- 172.21.15.60:0/424261775 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e800c5110 msgr2=0x7f7e80143470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:40.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.304+0000 7f7e7effd640 1 --2- 172.21.15.60:0/424261775 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e800c5110 0x7f7e80143470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.304+0000 7f7e7effd640 1 -- 172.21.15.60:0/424261775 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e801e7650 con 0x7f7e800c3660 2024-09-12T02:34:40.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.304+0000 7f7e7effd640 1 --2- 172.21.15.60:0/424261775 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e800c3660 0x7f7e800ad810 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f7e7000c7f0 tx=0x7f7e7000ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:40.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.305+0000 7f7e677fe640 1 -- 172.21.15.60:0/424261775 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e70015070 con 0x7f7e800c3660 2024-09-12T02:34:40.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.305+0000 7f7e677fe640 1 -- 172.21.15.60:0/424261775 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e70007820 con 0x7f7e800c3660 2024-09-12T02:34:40.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.306+0000 7f7e677fe640 1 -- 172.21.15.60:0/424261775 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e70007c10 con 0x7f7e800c3660 2024-09-12T02:34:40.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.306+0000 7f7e853b7640 1 -- 172.21.15.60:0/424261775 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e801e78d0 con 0x7f7e800c3660 2024-09-12T02:34:40.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.306+0000 7f7e853b7640 1 -- 172.21.15.60:0/424261775 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e801e7e90 con 0x7f7e800c3660 2024-09-12T02:34:40.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.308+0000 7f7e853b7640 1 --2- 172.21.15.60:0/424261775 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e80073ec0 0x7f7e801e8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.308+0000 7f7e853b7640 1 -- 172.21.15.60:0/424261775 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8014bd80 con 0x7f7e80073ec0 2024-09-12T02:34:40.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.308+0000 7f7e7e7fc640 1 --2- 172.21.15.60:0/424261775 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e80073ec0 0x7f7e801e8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.309+0000 7f7e677fe640 1 -- 172.21.15.60:0/424261775 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7e70018070 con 0x7f7e800c3660 2024-09-12T02:34:40.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.309+0000 7f7e7e7fc640 1 -- 172.21.15.60:0/424261775 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7e800add50 con 0x7f7e80073ec0 2024-09-12T02:34:40.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.309+0000 7f7e677fe640 1 --2- 172.21.15.60:0/424261775 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f7e6c06be80 0x7f7e6c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.309+0000 7f7e7e7fc640 1 --2- 172.21.15.60:0/424261775 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e80073ec0 0x7f7e801e8090 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f7e80075420 tx=0x7f7e74010f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:40.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.310+0000 7f7e7f7fe640 1 --2- 172.21.15.60:0/424261775 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f7e6c06be80 0x7f7e6c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.310+0000 7f7e677fe640 1 -- 172.21.15.60:0/424261775 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f7e7008b1b0 con 0x7f7e800c3660 2024-09-12T02:34:40.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.310+0000 7f7e677fe640 1 -- 172.21.15.60:0/424261775 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7400fdd0 con 0x7f7e80073ec0 2024-09-12T02:34:40.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.310+0000 7f7e677fe640 1 -- 172.21.15.60:0/424261775 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f7e7400fdd0 con 0x7f7e80073ec0 2024-09-12T02:34:40.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.310+0000 7f7e677fe640 1 -- 172.21.15.60:0/424261775 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e80073ec0 msgr2=0x7f7e801e8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:40.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.311+0000 7f7e677fe640 1 --2- 172.21.15.60:0/424261775 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e80073ec0 0x7f7e801e8090 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f7e80075420 tx=0x7f7e74010f40 comp rx=0 tx=0).stop 2024-09-12T02:34:40.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.311+0000 7f7e677fe640 1 -- 172.21.15.60:0/424261775 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e80073ec0 msgr2=0x7f7e801e8090 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:34:40.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.311+0000 7f7e677fe640 1 --2- 172.21.15.60:0/424261775 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e80073ec0 0x7f7e801e8090 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.311+0000 7f7e7f7fe640 1 --2- 172.21.15.60:0/424261775 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f7e6c06be80 0x7f7e6c06e340 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7e7800a7f0 tx=0x7f7e7800a000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:40.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.323+0000 7f7e853b7640 1 --2- 172.21.15.60:0/424261775 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e80146f50 0x7f7e80144580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.324+0000 7f7e853b7640 1 -- 172.21.15.60:0/424261775 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7e80149120 con 0x7f7e80146f50 2024-09-12T02:34:40.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.324+0000 7f7e7e7fc640 1 --2- 172.21.15.60:0/424261775 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e80146f50 0x7f7e80144580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.325+0000 7f7e7e7fc640 1 -- 172.21.15.60:0/424261775 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7e800763c0 con 0x7f7e80146f50 2024-09-12T02:34:40.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.326+0000 7f7e7e7fc640 1 --2- 172.21.15.60:0/424261775 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e80146f50 0x7f7e80144580 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7e80075420 tx=0x7f7e740046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:40.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.327+0000 7f7e677fe640 1 -- 172.21.15.60:0/424261775 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e74003610 con 0x7f7e80146f50 2024-09-12T02:34:40.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.327+0000 7f7e677fe640 1 -- 172.21.15.60:0/424261775 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5051 (secure 0 0 0) 0x7f7e74003610 con 0x7f7e80146f50 2024-09-12T02:34:40.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.327+0000 7f7e677fe640 1 -- 172.21.15.60:0/424261775 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e80146f50 msgr2=0x7f7e80144580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:40.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.327+0000 7f7e677fe640 1 --2- 172.21.15.60:0/424261775 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e80146f50 0x7f7e80144580 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7e80075420 tx=0x7f7e740046c0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.327+0000 7f7e677fe640 1 -- 172.21.15.60:0/424261775 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e80146f50 msgr2=0x7f7e80144580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:34:40.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.327+0000 7f7e677fe640 1 --2- 172.21.15.60:0/424261775 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e80146f50 0x7f7e80144580 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.329 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:34:40.329 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:34:40.329 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:34:40.329 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:34:40.329 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 118, 2024-09-12T02:34:40.329 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 625762, 2024-09-12T02:34:40.329 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:34:40.329 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:34:40.329 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:34:40.329 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:34:40.330 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:34:40.330 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 2, 2024-09-12T02:34:40.330 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:34:40.330 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:34:40.330 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:34:40.330 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:34:40.330 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:34:40.330 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:34:40.330 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:34:40.330 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:34:40.330 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:34:40.330 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:34:40.330 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:34:40.331 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:34:40.331 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:34:40.331 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:34:40.331 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:34:40.331 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:34:40.331 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:34:40.331 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:34:40.331 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:34:40.331 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:34:40.331 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:34:40.331 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:34:40.331 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:34:40.331 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:34:40.332 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:34:40.332 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:34:40.332 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:34:40.332 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:34:40.332 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:34:40.332 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:40.332 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:34:40.332 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:34:40.332 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:34:40.332 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:34:40.332 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:34:40.332 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:34:40.332 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:34:40.332 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:34:40.333 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:34:40.333 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:34:40.333 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:34:40.333 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:34:40.333 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:34:40.333 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:34:40.333 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:34:40.333 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:34:40.333 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:34:40.333 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:34:40.333 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:34:40.333 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:34:40.333 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:34:40.334 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:34:40.334 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:34:40.334 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:34:40.334 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:34:40.334 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:34:40.334 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:34:40.334 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:34:40.334 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:34:40.334 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:34:40.334 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:40.334 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:34:40.334 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:40.335 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:34:40.335 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:34:40.335 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:34:40.335 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:34:40.335 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:40.335 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:34:40.335 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:34:40.335 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:34:40.335 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:40.335 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:40.335 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:34:40.335 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:34:40.335 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:34:40.335 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:34:40.336 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:34:40.336 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:40.336 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:34:40.336 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:34:40.336 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:34:40.336 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:34:40.336 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:34:40.336 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:40.336 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:40.336 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:34:40.336 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:34:40.336 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:34:40.336 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:34:40.337 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:40.337 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:34:40.337 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:34:40.337 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:34:40.337 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:40.337 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:40.337 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:34:40.337 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:34:40.337 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:34:40.337 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:34:40.337 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:34:40.337 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:40.337 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:34:40.338 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:34:40.338 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:34:40.338 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:34:40.338 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:34:40.338 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:40.338 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:40.338 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:34:40.338 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:34:40.338 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:34:40.338 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:34:40.338 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:40.338 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:34:40.338 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:34:40.338 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:34:40.339 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:40.339 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:40.339 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:34:40.339 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:34:40.339 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:34:40.339 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:34:40.339 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:34:40.339 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:40.339 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:34:40.339 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:34:40.339 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:34:40.339 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:34:40.339 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:34:40.340 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:34:40.340 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:34:40.340 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:40.340 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:34:40.340 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:34:40.340 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:40.340 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:34:40.340 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:34:40.340 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:34:40.340 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:34:40.340 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:34:40.340 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:34:40.340 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:40.340 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:34:40.341 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:34:40.341 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:34:40.341 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:34:40.341 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:34:40.341 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:34:40.341 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:40.341 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:34:40.341 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:34:40.341 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 8 2024-09-12T02:34:40.341 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:34:40.341 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:34:40.341 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:34:40.342 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:40.342 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:34:40.342 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:34:40.342 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 8 2024-09-12T02:34:40.342 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:34:40.342 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:34:40.342 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:34:40.342 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:40.342 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:34:40.342 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:34:40.342 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:34:40.343 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:34:40.343 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:34:40.343 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:40.343 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:34:40.343 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:34:40.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.328+0000 7f7e657fa640 1 -- 172.21.15.60:0/424261775 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f7e6c06be80 msgr2=0x7f7e6c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:40.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.329+0000 7f7e657fa640 1 --2- 172.21.15.60:0/424261775 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f7e6c06be80 0x7f7e6c06e340 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7e7800a7f0 tx=0x7f7e7800a000 comp rx=0 tx=0).stop 2024-09-12T02:34:40.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.329+0000 7f7e657fa640 1 -- 172.21.15.60:0/424261775 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e800c3660 msgr2=0x7f7e800ad810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:40.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.329+0000 7f7e657fa640 1 --2- 172.21.15.60:0/424261775 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e800c3660 0x7f7e800ad810 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f7e7000c7f0 tx=0x7f7e7000ccb0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.329+0000 7f7e7f7fe640 1 -- 172.21.15.60:0/424261775 reap_dead start 2024-09-12T02:34:40.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.329+0000 7f7e7f7fe640 1 -- 172.21.15.60:0/424261775 reap_dead start 2024-09-12T02:34:40.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.329+0000 7f7e657fa640 1 -- 172.21.15.60:0/424261775 shutdown_connections 2024-09-12T02:34:40.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.329+0000 7f7e657fa640 1 -- 172.21.15.60:0/424261775 >> 172.21.15.60:0/424261775 conn(0x7f7e800c8410 msgr2=0x7f7e800c87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:40.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.329+0000 7f7e657fa640 1 -- 172.21.15.60:0/424261775 shutdown_connections 2024-09-12T02:34:40.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.329+0000 7f7e657fa640 1 -- 172.21.15.60:0/424261775 wait complete. 2024-09-12T02:34:40.349 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:34:40.350 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-12T02:34:40.350 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-12T02:34:40.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.535+0000 7f2cbefbd640 1 Processor -- start 2024-09-12T02:34:40.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.535+0000 7f2cbefbd640 1 -- start start 2024-09-12T02:34:40.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.537+0000 7f2cbefbd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2cb80a6c10 0x7f2cb80c2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.537+0000 7f2cbefbd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2cb80c5940 0x7f2cb806e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.537+0000 7f2cbefbd640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cb815a970 con 0x7f2cb80c6010 2024-09-12T02:34:40.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.537+0000 7f2cbefbd640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f2cb815ac50 con 0x7f2cb80a6c10 2024-09-12T02:34:40.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.537+0000 7f2cbefbd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2cb815af30 con 0x7f2cb80c5940 2024-09-12T02:34:40.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.537+0000 7f2cbcd59640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2cb80a6c10 0x7f2cb80c2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.537+0000 7f2cbd55a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2cb80c5940 0x7f2cb806e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.537+0000 7f2cb7fff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f2cb80c6010 0x7f2cb806dab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:58374/0 (socket says 172.21.15.60:58374) 2024-09-12T02:34:40.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.537+0000 7f2cb7fff640 1 -- 172.21.15.60:0/3952145396 learned_addr learned my addr 172.21.15.60:0/3952145396 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:34:40.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.538+0000 7f2cbcd59640 1 -- 172.21.15.60:0/3952145396 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2cb80c5940 msgr2=0x7f2cb806e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:40.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.538+0000 7f2cbcd59640 1 --2- 172.21.15.60:0/3952145396 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2cb80c5940 0x7f2cb806e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.538+0000 7f2cbcd59640 1 -- 172.21.15.60:0/3952145396 >> v1:172.21.15.60:6789/0 conn(0x7f2cb80c6010 legacy=0x7f2cb806dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:40.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.538+0000 7f2cbcd59640 1 -- 172.21.15.60:0/3952145396 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb815b210 con 0x7f2cb80a6c10 2024-09-12T02:34:40.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.540+0000 7f2cbcd59640 1 --2- 172.21.15.60:0/3952145396 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2cb80a6c10 0x7f2cb80c2440 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2cb0009d90 tx=0x7f2cb002a4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=182ac26a5dd90cba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:40.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.540+0000 7f2cb77fe640 1 -- 172.21.15.60:0/3952145396 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb0007740 con 0x7f2cb80a6c10 2024-09-12T02:34:40.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.540+0000 7f2cb77fe640 1 -- 172.21.15.60:0/3952145396 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cb00078e0 con 0x7f2cb80a6c10 2024-09-12T02:34:40.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.541+0000 7f2cb77fe640 1 -- 172.21.15.60:0/3952145396 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb0007cb0 con 0x7f2cb80a6c10 2024-09-12T02:34:40.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.541+0000 7f2cbefbd640 1 -- 172.21.15.60:0/3952145396 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2cb80a6c10 msgr2=0x7f2cb80c2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:40.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.541+0000 7f2cbefbd640 1 --2- 172.21.15.60:0/3952145396 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2cb80a6c10 0x7f2cb80c2440 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2cb0009d90 tx=0x7f2cb002a4c0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.541+0000 7f2cbefbd640 1 -- 172.21.15.60:0/3952145396 shutdown_connections 2024-09-12T02:34:40.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.541+0000 7f2cbefbd640 1 --2- 172.21.15.60:0/3952145396 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2cb80c5940 0x7f2cb806e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.541+0000 7f2cbefbd640 1 --2- 172.21.15.60:0/3952145396 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2cb80a6c10 0x7f2cb80c2440 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.541+0000 7f2cbefbd640 1 -- 172.21.15.60:0/3952145396 >> 172.21.15.60:0/3952145396 conn(0x7f2cb80c7a40 msgr2=0x7f2cb80c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:40.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.542+0000 7f2cbefbd640 1 -- 172.21.15.60:0/3952145396 shutdown_connections 2024-09-12T02:34:40.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.542+0000 7f2cbefbd640 1 -- 172.21.15.60:0/3952145396 wait complete. 2024-09-12T02:34:40.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.544+0000 7f2cbefbd640 1 Processor -- start 2024-09-12T02:34:40.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.544+0000 7f2cbefbd640 1 -- start start 2024-09-12T02:34:40.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.546+0000 7f2cbefbd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2cb80a6c10 0x7f2cb81fceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.546+0000 7f2cbefbd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cb80c5940 0x7f2cb8152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.546+0000 7f2cbefbd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2cb80c6010 0x7f2cb81f8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.546+0000 7f2cbefbd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb80a73a0 con 0x7f2cb80c5940 2024-09-12T02:34:40.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.546+0000 7f2cbefbd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb815a620 con 0x7f2cb80c6010 2024-09-12T02:34:40.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.546+0000 7f2cbefbd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2cb80a7520 con 0x7f2cb80a6c10 2024-09-12T02:34:40.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.546+0000 7f2cbd55a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2cb80c6010 0x7f2cb81f8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.546+0000 7f2cbd55a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2cb80c6010 0x7f2cb81f8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:44298/0 (socket says 172.21.15.60:44298) 2024-09-12T02:34:40.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.546+0000 7f2cbd55a640 1 -- 172.21.15.60:0/36421180 learned_addr learned my addr 172.21.15.60:0/36421180 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:34:40.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.547+0000 7f2cb7fff640 1 --2- 172.21.15.60:0/36421180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cb80c5940 0x7f2cb8152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.547+0000 7f2cbd55a640 1 -- 172.21.15.60:0/36421180 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2cb80a6c10 msgr2=0x7f2cb81fceb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:34:40.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.547+0000 7f2cbd55a640 1 --2- 172.21.15.60:0/36421180 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2cb80a6c10 0x7f2cb81fceb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.547+0000 7f2cbd55a640 1 -- 172.21.15.60:0/36421180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cb80c5940 msgr2=0x7f2cb8152650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:40.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.547+0000 7f2cbd55a640 1 --2- 172.21.15.60:0/36421180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cb80c5940 0x7f2cb8152650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.547+0000 7f2cbd55a640 1 -- 172.21.15.60:0/36421180 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb81fc410 con 0x7f2cb80c6010 2024-09-12T02:34:40.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.547+0000 7f2cb7fff640 1 --2- 172.21.15.60:0/36421180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cb80c5940 0x7f2cb8152650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:40.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.547+0000 7f2cbd55a640 1 --2- 172.21.15.60:0/36421180 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2cb80c6010 0x7f2cb81f8e00 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2cac00d830 tx=0x7f2cac00dcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:40.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.548+0000 7f2cb57fa640 1 -- 172.21.15.60:0/36421180 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cac00b660 con 0x7f2cb80c6010 2024-09-12T02:34:40.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.548+0000 7f2cb57fa640 1 -- 172.21.15.60:0/36421180 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cac019070 con 0x7f2cb80c6010 2024-09-12T02:34:40.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.548+0000 7f2cb57fa640 1 -- 172.21.15.60:0/36421180 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cac00ba40 con 0x7f2cb80c6010 2024-09-12T02:34:40.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.550+0000 7f2cbefbd640 1 -- 172.21.15.60:0/36421180 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cb81e3f20 con 0x7f2cb80c6010 2024-09-12T02:34:40.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.550+0000 7f2cbefbd640 1 -- 172.21.15.60:0/36421180 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cb81fc6b0 con 0x7f2cb80c6010 2024-09-12T02:34:40.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.552+0000 7f2cbefbd640 1 --2- 172.21.15.60:0/36421180 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2cb81f9340 0x7f2cb81e5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.552+0000 7f2cbefbd640 1 -- 172.21.15.60:0/36421180 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2cb80c2440 con 0x7f2cb81f9340 2024-09-12T02:34:40.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.552+0000 7f2cbcd59640 1 --2- 172.21.15.60:0/36421180 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2cb81f9340 0x7f2cb81e5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.555+0000 7f2cbcd59640 1 -- 172.21.15.60:0/36421180 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2cb80c7e20 con 0x7f2cb81f9340 2024-09-12T02:34:40.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.555+0000 7f2cbcd59640 1 --2- 172.21.15.60:0/36421180 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2cb81f9340 0x7f2cb81e5b70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2cb80709e0 tx=0x7f2cb0004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:40.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.556+0000 7f2cb57fa640 1 -- 172.21.15.60:0/36421180 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb0040070 con 0x7f2cb81f9340 2024-09-12T02:34:40.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.556+0000 7f2cb57fa640 1 -- 172.21.15.60:0/36421180 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f2cb0009a30 con 0x7f2cb81f9340 2024-09-12T02:34:40.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.556+0000 7f2cb57fa640 1 -- 172.21.15.60:0/36421180 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2cb81f9340 msgr2=0x7f2cb81e5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:40.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.556+0000 7f2cb57fa640 1 --2- 172.21.15.60:0/36421180 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2cb81f9340 0x7f2cb81e5b70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2cb80709e0 tx=0x7f2cb0004a40 comp rx=0 tx=0).stop 2024-09-12T02:34:40.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.556+0000 7f2cb57fa640 1 -- 172.21.15.60:0/36421180 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2cb81f9340 msgr2=0x7f2cb81e5b70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:34:40.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.556+0000 7f2cb57fa640 1 --2- 172.21.15.60:0/36421180 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2cb81f9340 0x7f2cb81e5b70 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.556+0000 7f2cb57fa640 1 -- 172.21.15.60:0/36421180 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2cac01e460 con 0x7f2cb80c6010 2024-09-12T02:34:40.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.557+0000 7f2cb57fa640 1 --2- 172.21.15.60:0/36421180 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2ca406b8f0 0x7f2ca406ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.558+0000 7f2cbcd59640 1 --2- 172.21.15.60:0/36421180 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2ca406b8f0 0x7f2ca406ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.558+0000 7f2cbcd59640 1 --2- 172.21.15.60:0/36421180 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2ca406b8f0 0x7f2ca406ddb0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2cb0004000 tx=0x7f2cb0048040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:40.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.559+0000 7f2cb57fa640 1 -- 172.21.15.60:0/36421180 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f2cac08b7b0 con 0x7f2cb80c6010 2024-09-12T02:34:40.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.570+0000 7f2cbefbd640 1 --2- 172.21.15.60:0/36421180 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2cb81fc8b0 0x7f2cb8159990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.570+0000 7f2cbefbd640 1 -- 172.21.15.60:0/36421180 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2cb80c7770 con 0x7f2cb81fc8b0 2024-09-12T02:34:40.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.570+0000 7f2cb7fff640 1 --2- 172.21.15.60:0/36421180 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2cb81fc8b0 0x7f2cb8159990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.570+0000 7f2cb7fff640 1 -- 172.21.15.60:0/36421180 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2cb8152fa0 con 0x7f2cb81fc8b0 2024-09-12T02:34:40.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.570+0000 7f2cb7fff640 1 --2- 172.21.15.60:0/36421180 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2cb81fc8b0 0x7f2cb8159990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2cb81e7e40 tx=0x7f2ca8001960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:40.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.571+0000 7f2cb57fa640 1 -- 172.21.15.60:0/36421180 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca800e640 con 0x7f2cb81fc8b0 2024-09-12T02:34:40.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.571+0000 7f2cb57fa640 1 -- 172.21.15.60:0/36421180 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4550 (secure 0 0 0) 0x7f2ca800e640 con 0x7f2cb81fc8b0 2024-09-12T02:34:40.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.571+0000 7f2cb57fa640 1 -- 172.21.15.60:0/36421180 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2cb81fc8b0 msgr2=0x7f2cb8159990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:40.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.571+0000 7f2cb57fa640 1 --2- 172.21.15.60:0/36421180 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2cb81fc8b0 0x7f2cb8159990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2cb81e7e40 tx=0x7f2ca8001960 comp rx=0 tx=0).stop 2024-09-12T02:34:40.572 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:34:40.572 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:34:40.572 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:34:40.572 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:34:40.572 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 118, 2024-09-12T02:34:40.572 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 154325, 2024-09-12T02:34:40.573 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:34:40.573 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:34:40.573 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:34:40.573 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:34:40.573 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:34:40.573 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 2, 2024-09-12T02:34:40.573 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:34:40.573 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:34:40.573 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:34:40.573 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:34:40.573 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:34:40.573 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:34:40.573 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:34:40.574 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:34:40.574 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:34:40.574 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:34:40.574 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:34:40.574 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:34:40.574 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:34:40.574 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:34:40.574 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:34:40.574 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:34:40.574 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:34:40.574 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:34:40.574 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:34:40.574 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:34:40.574 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:34:40.575 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:34:40.575 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:34:40.575 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:34:40.575 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:34:40.575 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:34:40.575 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:34:40.575 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:34:40.575 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:34:40.576 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:40.576 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:34:40.576 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:34:40.576 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:34:40.576 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:34:40.576 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:34:40.576 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:34:40.576 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:34:40.576 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:34:40.576 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:34:40.576 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:34:40.576 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:34:40.576 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:34:40.576 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:34:40.577 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:34:40.577 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:34:40.577 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:34:40.577 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:34:40.577 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:34:40.577 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:34:40.577 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:34:40.577 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:34:40.577 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:34:40.577 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:34:40.577 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:34:40.577 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:34:40.577 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:34:40.577 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:34:40.578 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:34:40.578 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:34:40.578 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:34:40.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:40.578 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:34:40.578 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:40.578 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:34:40.578 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:34:40.578 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:34:40.578 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:34:40.578 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:40.578 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:34:40.578 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:34:40.578 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:34:40.579 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:40.579 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:40.579 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:34:40.579 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:34:40.579 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:34:40.579 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:34:40.579 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:34:40.579 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:40.579 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:34:40.579 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:34:40.579 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:34:40.579 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:34:40.579 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:34:40.579 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:40.580 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:40.580 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:34:40.580 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:34:40.580 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:34:40.580 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:34:40.580 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:40.580 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:34:40.580 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:34:40.580 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:34:40.580 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:40.580 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:40.580 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:34:40.580 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:34:40.581 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:34:40.581 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:34:40.581 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:34:40.581 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:40.581 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:34:40.581 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:34:40.581 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:34:40.581 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:34:40.581 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:34:40.581 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:40.581 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:40.581 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:34:40.581 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:34:40.581 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:34:40.582 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:34:40.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:40.582 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:34:40.582 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:34:40.582 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:34:40.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:40.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:40.582 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:34:40.582 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:34:40.582 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:34:40.582 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:34:40.582 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:34:40.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:40.583 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:34:40.583 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:34:40.583 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:34:40.583 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:34:40.583 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:34:40.583 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:34:40.584 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:34:40.584 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:40.584 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:34:40.584 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:34:40.584 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:40.584 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:34:40.584 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:34:40.584 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:34:40.584 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:34:40.584 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:34:40.584 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:34:40.584 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:40.585 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:34:40.585 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:34:40.585 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:34:40.585 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:34:40.585 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:34:40.585 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:40.585 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:34:40.585 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:34:40.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.571+0000 7f2cb57fa640 1 -- 172.21.15.60:0/36421180 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2cb81fc8b0 msgr2=0x7f2cb8159990 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:34:40.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.571+0000 7f2cb57fa640 1 --2- 172.21.15.60:0/36421180 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2cb81fc8b0 0x7f2cb8159990 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.571+0000 7f2cbefbd640 1 -- 172.21.15.60:0/36421180 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2ca406b8f0 msgr2=0x7f2ca406ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:40.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.571+0000 7f2cbefbd640 1 --2- 172.21.15.60:0/36421180 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2ca406b8f0 0x7f2ca406ddb0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2cb0004000 tx=0x7f2cb0048040 comp rx=0 tx=0).stop 2024-09-12T02:34:40.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.571+0000 7f2cbefbd640 1 -- 172.21.15.60:0/36421180 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2cb80c6010 msgr2=0x7f2cb81f8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:40.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.571+0000 7f2cbefbd640 1 --2- 172.21.15.60:0/36421180 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2cb80c6010 0x7f2cb81f8e00 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2cac00d830 tx=0x7f2cac00dcf0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.572+0000 7f2cbd55a640 1 -- 172.21.15.60:0/36421180 reap_dead start 2024-09-12T02:34:40.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.572+0000 7f2cbd55a640 1 -- 172.21.15.60:0/36421180 reap_dead start 2024-09-12T02:34:40.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.572+0000 7f2cbefbd640 1 -- 172.21.15.60:0/36421180 shutdown_connections 2024-09-12T02:34:40.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.572+0000 7f2cbefbd640 1 -- 172.21.15.60:0/36421180 >> 172.21.15.60:0/36421180 conn(0x7f2cb80c7a40 msgr2=0x7f2cb80a81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:40.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.572+0000 7f2cbefbd640 1 -- 172.21.15.60:0/36421180 shutdown_connections 2024-09-12T02:34:40.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.572+0000 7f2cbefbd640 1 -- 172.21.15.60:0/36421180 wait complete. 2024-09-12T02:34:40.588 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:34:40.588 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-12T02:34:40.588 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-12T02:34:40.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.753+0000 7fcf822d7640 1 Processor -- start 2024-09-12T02:34:40.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.754+0000 7fcf822d7640 1 -- start start 2024-09-12T02:34:40.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.755+0000 7fcf822d7640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcf74047660 0x7fcf740e2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.755+0000 7fcf80874640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcf74047660 0x7fcf740e2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.755+0000 7fcf80874640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcf74047660 0x7fcf740e2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54918/0 (socket says 172.21.15.60:54918) 2024-09-12T02:34:40.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.755+0000 7fcf80874640 1 -- 172.21.15.60:0/758766774 learned_addr learned my addr 172.21.15.60:0/758766774 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:34:40.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.755+0000 7fcf822d7640 1 -- 172.21.15.60:0/758766774 --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf7402ea60 con 0x7fcf740d4230 2024-09-12T02:34:40.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.755+0000 7fcf7b7fe640 1 --1- 172.21.15.60:0/758766774 >> v1:172.21.15.105:6789/0 conn(0x7fcf7404ad70 0x7fcf74046410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:58990/0 (socket says 172.21.15.60:58990) 2024-09-12T02:34:40.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.755+0000 7fcf822d7640 1 -- 172.21.15.60:0/758766774 --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf740d7420 con 0x7fcf7404ad70 2024-09-12T02:34:40.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.755+0000 7fcf822d7640 1 -- 172.21.15.60:0/758766774 --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fcf74047440 con 0x7fcf74047660 2024-09-12T02:34:40.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.756+0000 7fcf7affd640 1 -- 172.21.15.60:0/758766774 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 967700972 0 0) 0x7fcf7402ea60 con 0x7fcf740d4230 2024-09-12T02:34:40.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.756+0000 7fcf7affd640 1 -- 172.21.15.60:0/758766774 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf6c003520 con 0x7fcf740d4230 2024-09-12T02:34:40.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.756+0000 7fcf7affd640 1 -- 172.21.15.60:0/758766774 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3547228230 0 0) 0x7fcf740d7420 con 0x7fcf7404ad70 2024-09-12T02:34:40.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.756+0000 7fcf80874640 1 -- 172.21.15.60:0/758766774 >> v1:172.21.15.105:6789/0 conn(0x7fcf7404ad70 legacy=0x7fcf74046410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:40.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.756+0000 7fcf80874640 1 -- 172.21.15.60:0/758766774 >> v1:172.21.15.60:6789/0 conn(0x7fcf740d4230 legacy=0x7fcf74006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:40.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.756+0000 7fcf80874640 1 -- 172.21.15.60:0/758766774 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf740d7700 con 0x7fcf74047660 2024-09-12T02:34:40.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.757+0000 7fcf80874640 1 --2- 172.21.15.60:0/758766774 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf74047660 0x7fcf740e2200 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c051790 tx=0x7fcf7c0a6cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5fdec150b37c4f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:40.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.759+0000 7fcf7affd640 1 -- 172.21.15.60:0/758766774 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c0b4070 con 0x7fcf74047660 2024-09-12T02:34:40.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.760+0000 7fcf7affd640 1 -- 172.21.15.60:0/758766774 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf7c0a7ac0 con 0x7fcf74047660 2024-09-12T02:34:40.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.760+0000 7fcf7affd640 1 -- 172.21.15.60:0/758766774 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c0af440 con 0x7fcf74047660 2024-09-12T02:34:40.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.761+0000 7fcf822d7640 1 -- 172.21.15.60:0/758766774 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf74047660 msgr2=0x7fcf740e2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:40.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.761+0000 7fcf822d7640 1 --2- 172.21.15.60:0/758766774 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf74047660 0x7fcf740e2200 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c051790 tx=0x7fcf7c0a6cf0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.761+0000 7fcf822d7640 1 -- 172.21.15.60:0/758766774 shutdown_connections 2024-09-12T02:34:40.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.761+0000 7fcf822d7640 1 --2- 172.21.15.60:0/758766774 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf74047660 0x7fcf740e2200 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.761+0000 7fcf822d7640 1 -- 172.21.15.60:0/758766774 >> 172.21.15.60:0/758766774 conn(0x7fcf74047d10 msgr2=0x7fcf74048120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:40.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.761+0000 7fcf822d7640 1 -- 172.21.15.60:0/758766774 shutdown_connections 2024-09-12T02:34:40.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.761+0000 7fcf822d7640 1 -- 172.21.15.60:0/758766774 wait complete. 2024-09-12T02:34:40.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.763+0000 7fcf822d7640 1 Processor -- start 2024-09-12T02:34:40.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.763+0000 7fcf822d7640 1 -- start start 2024-09-12T02:34:40.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.765+0000 7fcf822d7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcf74047660 0x7fcf740442b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.765+0000 7fcf822d7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf7404ad70 0x7fcf740d2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.765+0000 7fcf7bfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcf74047660 0x7fcf740442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.765+0000 7fcf7bfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcf74047660 0x7fcf740442b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:44310/0 (socket says 172.21.15.60:44310) 2024-09-12T02:34:40.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.765+0000 7fcf7bfff640 1 -- 172.21.15.60:0/441359497 learned_addr learned my addr 172.21.15.60:0/441359497 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:34:40.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.765+0000 7fcf822d7640 1 --2- 172.21.15.60:0/441359497 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcf740d4230 0x7fcf74173310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.766+0000 7fcf822d7640 1 -- 172.21.15.60:0/441359497 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcf74047130 con 0x7fcf7404ad70 2024-09-12T02:34:40.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.766+0000 7fcf80874640 1 --2- 172.21.15.60:0/441359497 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcf740d4230 0x7fcf74173310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.766+0000 7fcf822d7640 1 -- 172.21.15.60:0/441359497 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcf74045ef0 con 0x7fcf74047660 2024-09-12T02:34:40.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.766+0000 7fcf822d7640 1 -- 172.21.15.60:0/441359497 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcf74009a40 con 0x7fcf740d4230 2024-09-12T02:34:40.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.767+0000 7fcf7b7fe640 1 --2- 172.21.15.60:0/441359497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf7404ad70 0x7fcf740d2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.767+0000 7fcf80874640 1 -- 172.21.15.60:0/441359497 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcf74047660 msgr2=0x7fcf740442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:40.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.767+0000 7fcf80874640 1 --2- 172.21.15.60:0/441359497 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcf74047660 0x7fcf740442b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.767+0000 7fcf80874640 1 -- 172.21.15.60:0/441359497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf7404ad70 msgr2=0x7fcf740d2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:40.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.767+0000 7fcf80874640 1 --2- 172.21.15.60:0/441359497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf7404ad70 0x7fcf740d2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:40.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.767+0000 7fcf80874640 1 -- 172.21.15.60:0/441359497 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf74048600 con 0x7fcf740d4230 2024-09-12T02:34:40.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.768+0000 7fcf80874640 1 --2- 172.21.15.60:0/441359497 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcf740d4230 0x7fcf74173310 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c06b980 tx=0x7fcf7c069d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:40.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.768+0000 7fcf78ff9640 1 -- 172.21.15.60:0/441359497 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c0b4050 con 0x7fcf740d4230 2024-09-12T02:34:40.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.768+0000 7fcf78ff9640 1 -- 172.21.15.60:0/441359497 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf7c0b5040 con 0x7fcf740d4230 2024-09-12T02:34:40.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.768+0000 7fcf78ff9640 1 -- 172.21.15.60:0/441359497 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c0b9810 con 0x7fcf740d4230 2024-09-12T02:34:40.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.768+0000 7fcf822d7640 1 -- 172.21.15.60:0/441359497 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf74172b50 con 0x7fcf740d4230 2024-09-12T02:34:40.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.768+0000 7fcf822d7640 1 -- 172.21.15.60:0/441359497 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf74042700 con 0x7fcf740d4230 2024-09-12T02:34:40.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.771+0000 7fcf78ff9640 1 -- 172.21.15.60:0/441359497 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcf7c0c2020 con 0x7fcf740d4230 2024-09-12T02:34:40.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.771+0000 7fcf822d7640 1 -- 172.21.15.60:0/441359497 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf74006a10 con 0x7fcf740d4230 2024-09-12T02:34:40.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.772+0000 7fcf78ff9640 1 --2- 172.21.15.60:0/441359497 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcf6006be30 0x7fcf6006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:40.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.772+0000 7fcf78ff9640 1 -- 172.21.15.60:0/441359497 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fcf7c127da0 con 0x7fcf740d4230 2024-09-12T02:34:40.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.772+0000 7fcf7bfff640 1 --2- 172.21.15.60:0/441359497 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcf6006be30 0x7fcf6006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:40.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.773+0000 7fcf7bfff640 1 --2- 172.21.15.60:0/441359497 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcf6006be30 0x7fcf6006e2f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fcf70000f60 tx=0x7fcf70009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:40.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:40.780+0000 7fcf78ff9640 1 -- 172.21.15.60:0/441359497 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcf7c0f63a0 con 0x7fcf740d4230 2024-09-12T02:34:41.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:41.261+0000 7fcf822d7640 1 -- 172.21.15.60:0/441359497 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fcf740c1e10 con 0x7fcf740d4230 2024-09-12T02:34:41.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:41.264+0000 7fcf78ff9640 1 -- 172.21.15.60:0/441359497 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fcf7c0f5ca0 con 0x7fcf740d4230 2024-09-12T02:34:41.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:41.269+0000 7fcf822d7640 1 -- 172.21.15.60:0/441359497 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcf6006be30 msgr2=0x7fcf6006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:41.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:41.270+0000 7fcf822d7640 1 --2- 172.21.15.60:0/441359497 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcf6006be30 0x7fcf6006e2f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fcf70000f60 tx=0x7fcf70009040 comp rx=0 tx=0).stop 2024-09-12T02:34:41.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:41.270+0000 7fcf822d7640 1 -- 172.21.15.60:0/441359497 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcf740d4230 msgr2=0x7fcf74173310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:41.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:41.270+0000 7fcf822d7640 1 --2- 172.21.15.60:0/441359497 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcf740d4230 0x7fcf74173310 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c06b980 tx=0x7fcf7c069d60 comp rx=0 tx=0).stop 2024-09-12T02:34:41.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:41.270+0000 7fcf822d7640 1 -- 172.21.15.60:0/441359497 shutdown_connections 2024-09-12T02:34:41.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:41.270+0000 7fcf822d7640 1 --2- 172.21.15.60:0/441359497 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcf6006be30 0x7fcf6006e2f0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:41.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:41.271+0000 7fcf822d7640 1 --2- 172.21.15.60:0/441359497 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcf740d4230 0x7fcf74173310 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:41.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:41.271+0000 7fcf822d7640 1 --2- 172.21.15.60:0/441359497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf7404ad70 0x7fcf740d2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:41.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:41.271+0000 7fcf822d7640 1 --2- 172.21.15.60:0/441359497 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcf74047660 0x7fcf740442b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:41.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:41.271+0000 7fcf822d7640 1 -- 172.21.15.60:0/441359497 >> 172.21.15.60:0/441359497 conn(0x7fcf74047d10 msgr2=0x7fcf740303c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:41.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:41.274+0000 7fcf822d7640 1 -- 172.21.15.60:0/441359497 shutdown_connections 2024-09-12T02:34:41.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:41.275+0000 7fcf822d7640 1 -- 172.21.15.60:0/441359497 wait complete. 2024-09-12T02:34:41.294 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-12T02:34:51.295 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-12T02:34:51.295 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:34:51.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.472+0000 7f88e505e640 1 Processor -- start 2024-09-12T02:34:51.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.472+0000 7f88e505e640 1 -- start start 2024-09-12T02:34:51.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.474+0000 7f88e505e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f88e00c7230 0x7f88e01562d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:51.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.474+0000 7f88e505e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f88e006edd0 0x7f88e014fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:51.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.475+0000 7f88e505e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88e00c53f0 con 0x7f88e014f820 2024-09-12T02:34:51.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.475+0000 7f88e505e640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f88e01532d0 con 0x7f88e006edd0 2024-09-12T02:34:51.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.475+0000 7f88e505e640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f88e00c2d60 con 0x7f88e00c7230 2024-09-12T02:34:51.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.475+0000 7f88ded9d640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f88e014f820 0x7f88e0152bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:59848/0 (socket says 172.21.15.60:59848) 2024-09-12T02:34:51.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.475+0000 7f88ded9d640 1 -- 172.21.15.60:0/3926387080 learned_addr learned my addr 172.21.15.60:0/3926387080 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:34:51.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.475+0000 7f88df59e640 1 --2- 172.21.15.60:0/3926387080 >> v2:172.21.15.60:3300/0 conn(0x7f88e006edd0 0x7f88e014fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:51.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.476+0000 7f88de59c640 1 --2- 172.21.15.60:0/3926387080 >> v2:172.21.15.105:3300/0 conn(0x7f88e00c7230 0x7f88e01562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:51.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.476+0000 7f88df59e640 1 -- 172.21.15.60:0/3926387080 >> v2:172.21.15.105:3300/0 conn(0x7f88e00c7230 msgr2=0x7f88e01562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:51.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.476+0000 7f88df59e640 1 --2- 172.21.15.60:0/3926387080 >> v2:172.21.15.105:3300/0 conn(0x7f88e00c7230 0x7f88e01562d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:51.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.476+0000 7f88df59e640 1 -- 172.21.15.60:0/3926387080 >> v1:172.21.15.60:6789/0 conn(0x7f88e014f820 legacy=0x7f88e0152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:51.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.476+0000 7f88df59e640 1 -- 172.21.15.60:0/3926387080 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88e00c3040 con 0x7f88e006edd0 2024-09-12T02:34:51.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.477+0000 7f88df59e640 1 --2- 172.21.15.60:0/3926387080 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88e006edd0 0x7f88e014fc00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f88e0070250 tx=0x7f88d802a550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b627699ad272233 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:51.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.478+0000 7f88ddd9b640 1 -- 172.21.15.60:0/3926387080 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d8007740 con 0x7f88e006edd0 2024-09-12T02:34:51.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.478+0000 7f88ddd9b640 1 -- 172.21.15.60:0/3926387080 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88d80078e0 con 0x7f88e006edd0 2024-09-12T02:34:51.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.478+0000 7f88ddd9b640 1 -- 172.21.15.60:0/3926387080 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d8007cb0 con 0x7f88e006edd0 2024-09-12T02:34:51.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.479+0000 7f88e505e640 1 -- 172.21.15.60:0/3926387080 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88e006edd0 msgr2=0x7f88e014fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:51.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.479+0000 7f88e505e640 1 --2- 172.21.15.60:0/3926387080 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88e006edd0 0x7f88e014fc00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f88e0070250 tx=0x7f88d802a550 comp rx=0 tx=0).stop 2024-09-12T02:34:51.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.479+0000 7f88e505e640 1 -- 172.21.15.60:0/3926387080 shutdown_connections 2024-09-12T02:34:51.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.479+0000 7f88e505e640 1 --2- 172.21.15.60:0/3926387080 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88e006edd0 0x7f88e014fc00 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:51.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.479+0000 7f88e505e640 1 --2- 172.21.15.60:0/3926387080 >> v2:172.21.15.105:3300/0 conn(0x7f88e00c7230 0x7f88e01562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:51.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.479+0000 7f88e505e640 1 -- 172.21.15.60:0/3926387080 >> 172.21.15.60:0/3926387080 conn(0x7f88e00c7a40 msgr2=0x7f88e00c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:51.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.480+0000 7f88e505e640 1 -- 172.21.15.60:0/3926387080 shutdown_connections 2024-09-12T02:34:51.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.480+0000 7f88e505e640 1 -- 172.21.15.60:0/3926387080 wait complete. 2024-09-12T02:34:51.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.482+0000 7f88e505e640 1 Processor -- start 2024-09-12T02:34:51.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.482+0000 7f88e505e640 1 -- start start 2024-09-12T02:34:51.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.483+0000 7f88e505e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88e006edd0 0x7f88e00aa250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:51.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.483+0000 7f88e505e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88e00c7230 0x7f88e00a7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:51.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.483+0000 7f88e505e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88e014f820 0x7f88e0146150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:51.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.483+0000 7f88ded9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88e006edd0 0x7f88e00aa250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:51.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.483+0000 7f88ded9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88e006edd0 0x7f88e00aa250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:33864/0 (socket says 172.21.15.60:33864) 2024-09-12T02:34:51.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.483+0000 7f88de59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88e00c7230 0x7f88e00a7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:51.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.484+0000 7f88de59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88e00c7230 0x7f88e00a7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39636/0 (socket says 172.21.15.60:39636) 2024-09-12T02:34:51.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.484+0000 7f88ded9d640 1 -- 172.21.15.60:0/765746392 learned_addr learned my addr 172.21.15.60:0/765746392 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:34:51.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.484+0000 7f88e505e640 1 -- 172.21.15.60:0/765746392 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f88e00c5bf0 con 0x7f88e00c7230 2024-09-12T02:34:51.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.484+0000 7f88e505e640 1 -- 172.21.15.60:0/765746392 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f88e0152350 con 0x7f88e006edd0 2024-09-12T02:34:51.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.484+0000 7f88e505e640 1 -- 172.21.15.60:0/765746392 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f88e00c5d70 con 0x7f88e014f820 2024-09-12T02:34:51.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.484+0000 7f88df59e640 1 --2- 172.21.15.60:0/765746392 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88e014f820 0x7f88e0146150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:51.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.485+0000 7f88ded9d640 1 -- 172.21.15.60:0/765746392 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88e014f820 msgr2=0x7f88e0146150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:51.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.485+0000 7f88ded9d640 1 --2- 172.21.15.60:0/765746392 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88e014f820 0x7f88e0146150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:51.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.485+0000 7f88ded9d640 1 -- 172.21.15.60:0/765746392 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88e00c7230 msgr2=0x7f88e00a7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:51.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.485+0000 7f88ded9d640 1 --2- 172.21.15.60:0/765746392 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88e00c7230 0x7f88e00a7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:51.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.485+0000 7f88ded9d640 1 -- 172.21.15.60:0/765746392 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88e00a9b60 con 0x7f88e006edd0 2024-09-12T02:34:51.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.485+0000 7f88de59c640 1 --2- 172.21.15.60:0/765746392 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88e00c7230 0x7f88e00a7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:34:51.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.485+0000 7f88ded9d640 1 --2- 172.21.15.60:0/765746392 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88e006edd0 0x7f88e00aa250 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f88d000c460 tx=0x7f88d000c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:51.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.486+0000 7f88c77fe640 1 -- 172.21.15.60:0/765746392 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d0017070 con 0x7f88e006edd0 2024-09-12T02:34:51.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.486+0000 7f88c77fe640 1 -- 172.21.15.60:0/765746392 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88d0005ce0 con 0x7f88e006edd0 2024-09-12T02:34:51.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.486+0000 7f88c77fe640 1 -- 172.21.15.60:0/765746392 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d0007290 con 0x7f88e006edd0 2024-09-12T02:34:51.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.486+0000 7f88e505e640 1 -- 172.21.15.60:0/765746392 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88e00a9e40 con 0x7f88e006edd0 2024-09-12T02:34:51.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.487+0000 7f88e505e640 1 -- 172.21.15.60:0/765746392 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88e0155d30 con 0x7f88e006edd0 2024-09-12T02:34:51.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.488+0000 7f88e505e640 1 -- 172.21.15.60:0/765746392 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88e014fc00 con 0x7f88e006edd0 2024-09-12T02:34:51.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.489+0000 7f88c77fe640 1 -- 172.21.15.60:0/765746392 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f88d001a070 con 0x7f88e006edd0 2024-09-12T02:34:51.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.490+0000 7f88c77fe640 1 --2- 172.21.15.60:0/765746392 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f88cc06bf00 0x7f88cc06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:51.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.490+0000 7f88c77fe640 1 -- 172.21.15.60:0/765746392 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f88d008a530 con 0x7f88e006edd0 2024-09-12T02:34:51.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.491+0000 7f88de59c640 1 --2- 172.21.15.60:0/765746392 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f88cc06bf00 0x7f88cc06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:51.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.493+0000 7f88de59c640 1 --2- 172.21.15.60:0/765746392 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f88cc06bf00 0x7f88cc06e3c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f88e014f2c0 tx=0x7f88d4009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:51.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.497+0000 7f88c77fe640 1 -- 172.21.15.60:0/765746392 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f88d00584d0 con 0x7f88e006edd0 2024-09-12T02:34:51.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.994+0000 7f88e505e640 1 -- 172.21.15.60:0/765746392 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f88e00c7ec0 con 0x7f88e006edd0 2024-09-12T02:34:51.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.995+0000 7f88c77fe640 1 -- 172.21.15.60:0/765746392 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1566 (secure 0 0 0) 0x7f88d005c7d0 con 0x7f88e006edd0 2024-09-12T02:34:51.995 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":118,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:34:51.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.998+0000 7f88e505e640 1 -- 172.21.15.60:0/765746392 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f88cc06bf00 msgr2=0x7f88cc06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:51.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.998+0000 7f88e505e640 1 --2- 172.21.15.60:0/765746392 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f88cc06bf00 0x7f88cc06e3c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f88e014f2c0 tx=0x7f88d4009190 comp rx=0 tx=0).stop 2024-09-12T02:34:51.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.998+0000 7f88e505e640 1 -- 172.21.15.60:0/765746392 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88e006edd0 msgr2=0x7f88e00aa250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:51.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.998+0000 7f88e505e640 1 --2- 172.21.15.60:0/765746392 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88e006edd0 0x7f88e00aa250 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f88d000c460 tx=0x7f88d000c920 comp rx=0 tx=0).stop 2024-09-12T02:34:51.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.998+0000 7f88e505e640 1 -- 172.21.15.60:0/765746392 shutdown_connections 2024-09-12T02:34:52.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.998+0000 7f88e505e640 1 --2- 172.21.15.60:0/765746392 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f88cc06bf00 0x7f88cc06e3c0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:52.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.998+0000 7f88e505e640 1 --2- 172.21.15.60:0/765746392 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88e014f820 0x7f88e0146150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:52.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.998+0000 7f88e505e640 1 --2- 172.21.15.60:0/765746392 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88e00c7230 0x7f88e00a7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:52.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.998+0000 7f88e505e640 1 --2- 172.21.15.60:0/765746392 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88e006edd0 0x7f88e00aa250 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:52.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.998+0000 7f88e505e640 1 -- 172.21.15.60:0/765746392 >> 172.21.15.60:0/765746392 conn(0x7f88e00c7a40 msgr2=0x7f88e00aaed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:52.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.999+0000 7f88e505e640 1 -- 172.21.15.60:0/765746392 shutdown_connections 2024-09-12T02:34:52.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:51.999+0000 7f88e505e640 1 -- 172.21.15.60:0/765746392 wait complete. 2024-09-12T02:34:52.018 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-12T02:34:52.018 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-12T02:34:52.018 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-12T02:34:52.018 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-12T02:34:52.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.187+0000 7f5319450640 1 Processor -- start 2024-09-12T02:34:52.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.187+0000 7f5319450640 1 -- start start 2024-09-12T02:34:52.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.187+0000 7f5319450640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f53140c26b0 0x7f5314166490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:52.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.187+0000 7f5319450640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f53140c5940 0x7f5314163550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:52.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.187+0000 7f5319450640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5314163a90 0x7f531408d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:52.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.187+0000 7f5319450640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f53141630c0 con 0x7f5314163a90 2024-09-12T02:34:52.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.187+0000 7f5319450640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f5314166a70 con 0x7f53140c5940 2024-09-12T02:34:52.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.187+0000 7f5319450640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5314166d50 con 0x7f53140c26b0 2024-09-12T02:34:52.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.187+0000 7f53137fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5314163a90 0x7f531408d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:52.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.188+0000 7f53137fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5314163a90 0x7f531408d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39640/0 (socket says 172.21.15.60:39640) 2024-09-12T02:34:52.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.188+0000 7f53127fc640 1 --2- 172.21.15.60:0/3918807628 >> v2:172.21.15.105:3300/0 conn(0x7f53140c5940 0x7f5314163550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:52.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.188+0000 7f53137fe640 1 -- 172.21.15.60:0/3918807628 learned_addr learned my addr 172.21.15.60:0/3918807628 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:34:52.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.188+0000 7f5312ffd640 1 --2- 172.21.15.60:0/3918807628 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f53140c26b0 0x7f5314166490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:52.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.278+0000 7f5312ffd640 1 -- 172.21.15.60:0/3918807628 >> v2:172.21.15.105:3300/0 conn(0x7f53140c5940 msgr2=0x7f5314163550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:52.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.278+0000 7f5312ffd640 1 --2- 172.21.15.60:0/3918807628 >> v2:172.21.15.105:3300/0 conn(0x7f53140c5940 0x7f5314163550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:52.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.278+0000 7f5312ffd640 1 -- 172.21.15.60:0/3918807628 >> v2:172.21.15.60:3300/0 conn(0x7f5314163a90 msgr2=0x7f531408d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:52.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.278+0000 7f5312ffd640 1 --2- 172.21.15.60:0/3918807628 >> v2:172.21.15.60:3300/0 conn(0x7f5314163a90 0x7f531408d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:52.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.278+0000 7f5312ffd640 1 -- 172.21.15.60:0/3918807628 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5314167030 con 0x7f53140c26b0 2024-09-12T02:34:52.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.284+0000 7f5312ffd640 1 --2- 172.21.15.60:0/3918807628 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f53140c26b0 0x7f5314166490 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f53140c8850 tx=0x7f530402a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bed8271a4680ae1c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:52.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.285+0000 7f5311ffb640 1 -- 172.21.15.60:0/3918807628 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5304037070 con 0x7f53140c26b0 2024-09-12T02:34:52.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.285+0000 7f5311ffb640 1 -- 172.21.15.60:0/3918807628 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5304032440 con 0x7f53140c26b0 2024-09-12T02:34:52.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.285+0000 7f5311ffb640 1 -- 172.21.15.60:0/3918807628 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f530402ae60 con 0x7f53140c26b0 2024-09-12T02:34:52.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.286+0000 7f5319450640 1 -- 172.21.15.60:0/3918807628 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f53140c26b0 msgr2=0x7f5314166490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:52.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.286+0000 7f5319450640 1 --2- 172.21.15.60:0/3918807628 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f53140c26b0 0x7f5314166490 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f53140c8850 tx=0x7f530402a130 comp rx=0 tx=0).stop 2024-09-12T02:34:52.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.286+0000 7f5319450640 1 -- 172.21.15.60:0/3918807628 shutdown_connections 2024-09-12T02:34:52.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.286+0000 7f5319450640 1 --2- 172.21.15.60:0/3918807628 >> v2:172.21.15.105:3300/0 conn(0x7f53140c5940 0x7f5314163550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:52.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.286+0000 7f5319450640 1 --2- 172.21.15.60:0/3918807628 >> v2:172.21.15.60:3300/0 conn(0x7f5314163a90 0x7f531408d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:52.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.286+0000 7f5319450640 1 --2- 172.21.15.60:0/3918807628 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f53140c26b0 0x7f5314166490 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:52.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.286+0000 7f5319450640 1 -- 172.21.15.60:0/3918807628 >> 172.21.15.60:0/3918807628 conn(0x7f53140c7a40 msgr2=0x7f53140c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:52.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.287+0000 7f5319450640 1 -- 172.21.15.60:0/3918807628 shutdown_connections 2024-09-12T02:34:52.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.287+0000 7f5319450640 1 -- 172.21.15.60:0/3918807628 wait complete. 2024-09-12T02:34:52.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.289+0000 7f5319450640 1 Processor -- start 2024-09-12T02:34:52.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.291+0000 7f5319450640 1 -- start start 2024-09-12T02:34:52.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.293+0000 7f5319450640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f53140c26b0 0x7f5314160fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:52.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.293+0000 7f5319450640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53140c5940 0x7f5314071950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:52.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.293+0000 7f5319450640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5314163a90 0x7f5314073c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:52.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.293+0000 7f5312ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f53140c26b0 0x7f5314160fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:52.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.293+0000 7f5312ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f53140c26b0 0x7f5314160fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:33884/0 (socket says 172.21.15.60:33884) 2024-09-12T02:34:52.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.293+0000 7f5312ffd640 1 -- 172.21.15.60:0/2284139571 learned_addr learned my addr 172.21.15.60:0/2284139571 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:34:52.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.293+0000 7f5319450640 1 -- 172.21.15.60:0/2284139571 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f531406f460 con 0x7f53140c5940 2024-09-12T02:34:52.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.294+0000 7f5319450640 1 -- 172.21.15.60:0/2284139571 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f531406f2e0 con 0x7f53140c26b0 2024-09-12T02:34:52.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.294+0000 7f5319450640 1 -- 172.21.15.60:0/2284139571 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f53140c62f0 con 0x7f5314163a90 2024-09-12T02:34:52.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.294+0000 7f53137fe640 1 --2- 172.21.15.60:0/2284139571 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5314163a90 0x7f5314073c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:52.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.294+0000 7f53127fc640 1 --2- 172.21.15.60:0/2284139571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53140c5940 0x7f5314071950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:52.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.295+0000 7f53127fc640 1 -- 172.21.15.60:0/2284139571 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5314163a90 msgr2=0x7f5314073c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:52.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.295+0000 7f53127fc640 1 --2- 172.21.15.60:0/2284139571 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5314163a90 0x7f5314073c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:52.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.295+0000 7f53127fc640 1 -- 172.21.15.60:0/2284139571 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f53140c26b0 msgr2=0x7f5314160fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:52.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.295+0000 7f53127fc640 1 --2- 172.21.15.60:0/2284139571 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f53140c26b0 0x7f5314160fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:52.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.295+0000 7f53127fc640 1 -- 172.21.15.60:0/2284139571 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5314071320 con 0x7f53140c5940 2024-09-12T02:34:52.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.295+0000 7f53127fc640 1 --2- 172.21.15.60:0/2284139571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53140c5940 0x7f5314071950 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5308007fd0 tx=0x7f530800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:52.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.295+0000 7f52fb7fe640 1 -- 172.21.15.60:0/2284139571 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5308019070 con 0x7f53140c5940 2024-09-12T02:34:52.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.295+0000 7f5319450640 1 -- 172.21.15.60:0/2284139571 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5314070d60 con 0x7f53140c5940 2024-09-12T02:34:52.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.295+0000 7f5319450640 1 -- 172.21.15.60:0/2284139571 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53141614e0 con 0x7f53140c5940 2024-09-12T02:34:52.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.297+0000 7f52fb7fe640 1 -- 172.21.15.60:0/2284139571 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f530800ae20 con 0x7f53140c5940 2024-09-12T02:34:52.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.297+0000 7f52fb7fe640 1 -- 172.21.15.60:0/2284139571 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5308014630 con 0x7f53140c5940 2024-09-12T02:34:52.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.297+0000 7f52f97fa640 1 --2- 172.21.15.60:0/2284139571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52f4002a70 0x7f52f4004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:52.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.297+0000 7f52f97fa640 1 -- 172.21.15.60:0/2284139571 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f52f4007ec0 con 0x7f52f4002a70 2024-09-12T02:34:52.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.298+0000 7f5312ffd640 1 --2- 172.21.15.60:0/2284139571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52f4002a70 0x7f52f4004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:52.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.300+0000 7f5312ffd640 1 -- 172.21.15.60:0/2284139571 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f52f40080c0 con 0x7f52f4002a70 2024-09-12T02:34:52.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.301+0000 7f5312ffd640 1 --2- 172.21.15.60:0/2284139571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52f4002a70 0x7f52f4004f30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5304035040 tx=0x7f53040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:52.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.301+0000 7f52fb7fe640 1 -- 172.21.15.60:0/2284139571 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f530801c070 con 0x7f53140c5940 2024-09-12T02:34:52.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.302+0000 7f52fb7fe640 1 --2- 172.21.15.60:0/2284139571 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f530006be30 0x7f530006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:52.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.303+0000 7f53137fe640 1 --2- 172.21.15.60:0/2284139571 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f530006be30 0x7f530006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:52.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.303+0000 7f53137fe640 1 --2- 172.21.15.60:0/2284139571 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f530006be30 0x7f530006e2f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f530c003f30 tx=0x7f530c009130 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:52.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.304+0000 7f52fb7fe640 1 -- 172.21.15.60:0/2284139571 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5304037040 con 0x7f52f4002a70 2024-09-12T02:34:52.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.304+0000 7f52fb7fe640 1 -- 172.21.15.60:0/2284139571 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f530808aee0 con 0x7f53140c5940 2024-09-12T02:34:52.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.304+0000 7f52fb7fe640 1 -- 172.21.15.60:0/2284139571 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5304032440 con 0x7f52f4002a70 2024-09-12T02:34:52.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.304+0000 7f52fb7fe640 1 -- 172.21.15.60:0/2284139571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52f4002a70 msgr2=0x7f52f4004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:52.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.304+0000 7f52fb7fe640 1 --2- 172.21.15.60:0/2284139571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52f4002a70 0x7f52f4004f30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5304035040 tx=0x7f53040046c0 comp rx=0 tx=0).stop 2024-09-12T02:34:52.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.304+0000 7f52fb7fe640 1 -- 172.21.15.60:0/2284139571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52f4002a70 msgr2=0x7f52f4004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:34:52.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.305+0000 7f52fb7fe640 1 --2- 172.21.15.60:0/2284139571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52f4002a70 0x7f52f4004f30 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:52.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.334+0000 7f52f97fa640 1 --2- 172.21.15.60:0/2284139571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52f4006f70 0x7f52f4007400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:52.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.334+0000 7f52f97fa640 1 -- 172.21.15.60:0/2284139571 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f52f400a4a0 con 0x7f52f4006f70 2024-09-12T02:34:52.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.335+0000 7f5312ffd640 1 --2- 172.21.15.60:0/2284139571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52f4006f70 0x7f52f4007400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:52.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.339+0000 7f5312ffd640 1 -- 172.21.15.60:0/2284139571 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f52f4007940 con 0x7f52f4006f70 2024-09-12T02:34:52.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.341+0000 7f5312ffd640 1 --2- 172.21.15.60:0/2284139571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52f4006f70 0x7f52f4007400 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5304043000 tx=0x7f5304008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:52.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.342+0000 7f52fb7fe640 1 -- 172.21.15.60:0/2284139571 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5304037030 con 0x7f52f4006f70 2024-09-12T02:34:52.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.342+0000 7f52fb7fe640 1 -- 172.21.15.60:0/2284139571 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4552 (secure 0 0 0) 0x7f5304030e50 con 0x7f52f4006f70 2024-09-12T02:34:52.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.342+0000 7f52fb7fe640 1 -- 172.21.15.60:0/2284139571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52f4006f70 msgr2=0x7f52f4007400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:52.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.342+0000 7f52fb7fe640 1 --2- 172.21.15.60:0/2284139571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52f4006f70 0x7f52f4007400 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5304043000 tx=0x7f5304008030 comp rx=0 tx=0).stop 2024-09-12T02:34:52.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.342+0000 7f52fb7fe640 1 -- 172.21.15.60:0/2284139571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52f4006f70 msgr2=0x7f52f4007400 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:34:52.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.342+0000 7f52fb7fe640 1 --2- 172.21.15.60:0/2284139571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52f4006f70 0x7f52f4007400 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:52.345 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:34:52.345 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:34:52.345 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:34:52.345 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:34:52.345 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 118, 2024-09-12T02:34:52.345 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 32944, 2024-09-12T02:34:52.345 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:34:52.345 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:34:52.345 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:34:52.346 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:34:52.346 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:34:52.346 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 14, 2024-09-12T02:34:52.346 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:34:52.346 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:34:52.346 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:34:52.346 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:34:52.346 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:34:52.346 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:34:52.346 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:34:52.346 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:34:52.346 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:34:52.347 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:34:52.347 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:34:52.347 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:34:52.347 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:34:52.347 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:34:52.347 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:34:52.347 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:34:52.347 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:34:52.347 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:34:52.347 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:34:52.347 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:34:52.347 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:34:52.347 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:34:52.347 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:34:52.348 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:34:52.348 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:34:52.348 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:34:52.348 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:34:52.348 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:34:52.348 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:34:52.348 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:52.348 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:34:52.348 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:34:52.348 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:34:52.348 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:34:52.348 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:34:52.349 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:34:52.349 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:34:52.349 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:34:52.349 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:34:52.349 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:34:52.349 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:34:52.349 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:34:52.349 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:34:52.401 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:34:52.401 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:34:52.401 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:34:52.401 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:34:52.401 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:34:52.401 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:34:52.401 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:34:52.401 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:34:52.401 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:34:52.401 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:34:52.402 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:34:52.402 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:34:52.402 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:34:52.402 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:34:52.402 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:34:52.402 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:34:52.402 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:34:52.402 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:52.402 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:34:52.402 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:52.402 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:34:52.402 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:34:52.402 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:34:52.403 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:34:52.403 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:52.403 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:34:52.403 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:34:52.403 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:34:52.403 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:52.403 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:52.403 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:34:52.403 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:34:52.403 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:34:52.403 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:34:52.403 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:34:52.403 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:52.404 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:34:52.404 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:34:52.404 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:34:52.404 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:34:52.404 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:34:52.404 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:52.404 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:52.404 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:34:52.404 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:34:52.404 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:34:52.404 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:34:52.404 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:52.404 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:34:52.404 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:34:52.405 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:34:52.405 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:52.405 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:52.405 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:34:52.405 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:34:52.405 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:34:52.405 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:34:52.405 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:34:52.405 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:52.405 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:34:52.405 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:34:52.405 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:34:52.405 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:34:52.406 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:34:52.406 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:52.406 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:52.406 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:34:52.406 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:34:52.406 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:34:52.406 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:34:52.406 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:52.406 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:34:52.406 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:34:52.406 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:34:52.406 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:52.406 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:52.407 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:34:52.407 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:34:52.407 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:34:52.407 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:34:52.407 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:34:52.407 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:52.407 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:34:52.407 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:34:52.407 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:34:52.407 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:34:52.407 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:34:52.407 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:34:52.408 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:34:52.408 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:52.408 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:34:52.408 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:34:52.408 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:52.408 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:34:52.408 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:34:52.408 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:34:52.408 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:34:52.408 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:34:52.408 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:34:52.408 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:52.408 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:34:52.409 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:34:52.409 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:34:52.409 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:34:52.409 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:34:52.409 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:52.409 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:34:52.409 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:34:52.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.351+0000 7f52f97fa640 1 -- 172.21.15.60:0/2284139571 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f530006be30 msgr2=0x7f530006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:52.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.351+0000 7f52f97fa640 1 --2- 172.21.15.60:0/2284139571 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f530006be30 0x7f530006e2f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f530c003f30 tx=0x7f530c009130 comp rx=0 tx=0).stop 2024-09-12T02:34:52.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.351+0000 7f52f97fa640 1 -- 172.21.15.60:0/2284139571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53140c5940 msgr2=0x7f5314071950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:52.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.351+0000 7f52f97fa640 1 --2- 172.21.15.60:0/2284139571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53140c5940 0x7f5314071950 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5308007fd0 tx=0x7f530800a650 comp rx=0 tx=0).stop 2024-09-12T02:34:52.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.354+0000 7f53137fe640 1 -- 172.21.15.60:0/2284139571 reap_dead start 2024-09-12T02:34:52.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.354+0000 7f53137fe640 1 -- 172.21.15.60:0/2284139571 reap_dead start 2024-09-12T02:34:52.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.354+0000 7f52f97fa640 1 -- 172.21.15.60:0/2284139571 shutdown_connections 2024-09-12T02:34:52.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.354+0000 7f52f97fa640 1 -- 172.21.15.60:0/2284139571 >> 172.21.15.60:0/2284139571 conn(0x7f53140c7a40 msgr2=0x7f5314161900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:52.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.356+0000 7f52f97fa640 1 -- 172.21.15.60:0/2284139571 shutdown_connections 2024-09-12T02:34:52.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.356+0000 7f52f97fa640 1 -- 172.21.15.60:0/2284139571 wait complete. 2024-09-12T02:34:52.411 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:34:52.412 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-12T02:34:52.412 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-12T02:34:52.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.599+0000 7f43553c5640 1 Processor -- start 2024-09-12T02:34:52.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.599+0000 7f43553c5640 1 -- start start 2024-09-12T02:34:52.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.600+0000 7f43553c5640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f434803fa30 0x7f43480d7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:52.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.601+0000 7f434ffff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f43480d0b90 0x7f434800bda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:59858/0 (socket says 172.21.15.60:59858) 2024-09-12T02:34:52.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.601+0000 7f434ffff640 1 -- 172.21.15.60:0/3703721177 learned_addr learned my addr 172.21.15.60:0/3703721177 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:34:52.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.601+0000 7f434f7fe640 1 --2- 172.21.15.60:0/3703721177 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f434803fa30 0x7f43480d7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:52.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.601+0000 7f43553c5640 1 -- 172.21.15.60:0/3703721177 --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43480d7e10 con 0x7f43480d0b90 2024-09-12T02:34:52.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.601+0000 7f43553c5640 1 -- 172.21.15.60:0/3703721177 --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4348046ec0 con 0x7f4348007b80 2024-09-12T02:34:52.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.601+0000 7f43553c5640 1 -- 172.21.15.60:0/3703721177 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f43480076f0 con 0x7f434803fa30 2024-09-12T02:34:52.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.601+0000 7f434effd640 1 -- 172.21.15.60:0/3703721177 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 109572551 0 0) 0x7f4344001110 con 0x7f43480d0b90 2024-09-12T02:34:52.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.602+0000 7f434effd640 1 -- 172.21.15.60:0/3703721177 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4340005730 con 0x7f43480d0b90 2024-09-12T02:34:52.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.602+0000 7f434effd640 1 -- 172.21.15.60:0/3703721177 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1601390845 0 0) 0x7f4348046ec0 con 0x7f4348007b80 2024-09-12T02:34:52.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.602+0000 7f434effd640 1 -- 172.21.15.60:0/3703721177 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4344001110 con 0x7f4348007b80 2024-09-12T02:34:52.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.602+0000 7f434f7fe640 1 -- 172.21.15.60:0/3703721177 >> v1:172.21.15.105:6789/0 conn(0x7f4348007b80 legacy=0x7f4348008030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:52.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.602+0000 7f434f7fe640 1 -- 172.21.15.60:0/3703721177 >> v1:172.21.15.60:6789/0 conn(0x7f43480d0b90 legacy=0x7f434800bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:52.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.602+0000 7f434f7fe640 1 -- 172.21.15.60:0/3703721177 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43480471a0 con 0x7f434803fa30 2024-09-12T02:34:52.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.603+0000 7f434f7fe640 1 --2- 172.21.15.60:0/3703721177 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f434803fa30 0x7f43480d7370 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f433c0097d0 tx=0x7f433c02a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b28713a1ba1a5725 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:52.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.604+0000 7f434effd640 1 -- 172.21.15.60:0/3703721177 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f433c037070 con 0x7f434803fa30 2024-09-12T02:34:52.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.605+0000 7f434effd640 1 -- 172.21.15.60:0/3703721177 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f433c02ae40 con 0x7f434803fa30 2024-09-12T02:34:52.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.605+0000 7f434effd640 1 -- 172.21.15.60:0/3703721177 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f433c032640 con 0x7f434803fa30 2024-09-12T02:34:52.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.607+0000 7f43553c5640 1 -- 172.21.15.60:0/3703721177 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f434803fa30 msgr2=0x7f43480d7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:52.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.607+0000 7f43553c5640 1 --2- 172.21.15.60:0/3703721177 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f434803fa30 0x7f43480d7370 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f433c0097d0 tx=0x7f433c02a130 comp rx=0 tx=0).stop 2024-09-12T02:34:52.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.607+0000 7f43553c5640 1 -- 172.21.15.60:0/3703721177 shutdown_connections 2024-09-12T02:34:52.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.607+0000 7f43553c5640 1 --2- 172.21.15.60:0/3703721177 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f434803fa30 0x7f43480d7370 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:52.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.607+0000 7f43553c5640 1 -- 172.21.15.60:0/3703721177 >> 172.21.15.60:0/3703721177 conn(0x7f4348048e20 msgr2=0x7f4348049230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:52.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.608+0000 7f43553c5640 1 -- 172.21.15.60:0/3703721177 shutdown_connections 2024-09-12T02:34:52.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.608+0000 7f43553c5640 1 -- 172.21.15.60:0/3703721177 wait complete. 2024-09-12T02:34:52.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.610+0000 7f43553c5640 1 Processor -- start 2024-09-12T02:34:52.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.610+0000 7f43553c5640 1 -- start start 2024-09-12T02:34:52.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.611+0000 7f43553c5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4348007b80 0x7f4348031430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:52.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.611+0000 7f43553c5640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f434803fa30 0x7f4348031970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:52.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.611+0000 7f43553c5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43480d0b90 0x7f4348173b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:52.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.612+0000 7f43553c5640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f434800c4b0 con 0x7f4348007b80 2024-09-12T02:34:52.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.612+0000 7f434ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4348007b80 0x7f4348031430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:52.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.612+0000 7f434f7fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f434803fa30 0x7f4348031970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:52.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.612+0000 7f43553c5640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4348008f00 con 0x7f43480d0b90 2024-09-12T02:34:52.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.612+0000 7f43553c5640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f43480cf040 con 0x7f434803fa30 2024-09-12T02:34:52.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.612+0000 7f434f7fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f434803fa30 0x7f4348031970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:37220/0 (socket says 172.21.15.60:37220) 2024-09-12T02:34:52.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.612+0000 7f434ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4348007b80 0x7f4348031430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39672/0 (socket says 172.21.15.60:39672) 2024-09-12T02:34:52.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.612+0000 7f434f7fe640 1 -- 172.21.15.60:0/2004832442 learned_addr learned my addr 172.21.15.60:0/2004832442 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:34:52.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.612+0000 7f4354bc4640 1 --2- 172.21.15.60:0/2004832442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43480d0b90 0x7f4348173b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:52.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.612+0000 7f434ffff640 1 -- 172.21.15.60:0/2004832442 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f434803fa30 msgr2=0x7f4348031970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:52.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.612+0000 7f434ffff640 1 --2- 172.21.15.60:0/2004832442 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f434803fa30 0x7f4348031970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:52.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.612+0000 7f434ffff640 1 -- 172.21.15.60:0/2004832442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43480d0b90 msgr2=0x7f4348173b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:52.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.612+0000 7f434ffff640 1 --2- 172.21.15.60:0/2004832442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43480d0b90 0x7f4348173b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:52.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.612+0000 7f434ffff640 1 -- 172.21.15.60:0/2004832442 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4348031eb0 con 0x7f4348007b80 2024-09-12T02:34:52.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.613+0000 7f434ffff640 1 --2- 172.21.15.60:0/2004832442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4348007b80 0x7f4348031430 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f434400c700 tx=0x7f434400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:52.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.613+0000 7f434cff9640 1 -- 172.21.15.60:0/2004832442 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4344017070 con 0x7f4348007b80 2024-09-12T02:34:52.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.613+0000 7f434cff9640 1 -- 172.21.15.60:0/2004832442 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4344005ab0 con 0x7f4348007b80 2024-09-12T02:34:52.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.613+0000 7f43553c5640 1 -- 172.21.15.60:0/2004832442 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f434803f2f0 con 0x7f4348007b80 2024-09-12T02:34:52.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.614+0000 7f43553c5640 1 -- 172.21.15.60:0/2004832442 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4348042800 con 0x7f4348007b80 2024-09-12T02:34:52.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.614+0000 7f434cff9640 1 -- 172.21.15.60:0/2004832442 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4344007070 con 0x7f4348007b80 2024-09-12T02:34:52.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.616+0000 7f434cff9640 1 -- 172.21.15.60:0/2004832442 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f434401a070 con 0x7f4348007b80 2024-09-12T02:34:52.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.616+0000 7f43553c5640 1 --2- 172.21.15.60:0/2004832442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f434802f9e0 0x7f4348174090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:52.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.617+0000 7f43553c5640 1 -- 172.21.15.60:0/2004832442 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f434800c630 con 0x7f434802f9e0 2024-09-12T02:34:52.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.617+0000 7f434cff9640 1 --2- 172.21.15.60:0/2004832442 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f433406be30 0x7f433406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:52.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.617+0000 7f434cff9640 1 -- 172.21.15.60:0/2004832442 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f434408a600 con 0x7f4348007b80 2024-09-12T02:34:52.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.618+0000 7f4354bc4640 1 --2- 172.21.15.60:0/2004832442 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f433406be30 0x7f433406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:52.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.619+0000 7f434f7fe640 1 --2- 172.21.15.60:0/2004832442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f434802f9e0 0x7f4348174090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:52.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.620+0000 7f434f7fe640 1 -- 172.21.15.60:0/2004832442 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4348008ce0 con 0x7f434802f9e0 2024-09-12T02:34:52.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.620+0000 7f4354bc4640 1 --2- 172.21.15.60:0/2004832442 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f433406be30 0x7f433406e2f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f43500518b0 tx=0x7f43500659b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:52.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.621+0000 7f434f7fe640 1 --2- 172.21.15.60:0/2004832442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f434802f9e0 0x7f4348174090 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f433c009720 tx=0x7f433c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:52.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.622+0000 7f434cff9640 1 -- 172.21.15.60:0/2004832442 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f433c042020 con 0x7f434802f9e0 2024-09-12T02:34:52.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.622+0000 7f434cff9640 1 -- 172.21.15.60:0/2004832442 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f433c0093c0 con 0x7f434802f9e0 2024-09-12T02:34:52.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.622+0000 7f434cff9640 1 -- 172.21.15.60:0/2004832442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f434802f9e0 msgr2=0x7f4348174090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:52.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.622+0000 7f434cff9640 1 --2- 172.21.15.60:0/2004832442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f434802f9e0 0x7f4348174090 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f433c009720 tx=0x7f433c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:34:52.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.622+0000 7f434cff9640 1 -- 172.21.15.60:0/2004832442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f434802f9e0 msgr2=0x7f4348174090 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:34:52.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.622+0000 7f434cff9640 1 --2- 172.21.15.60:0/2004832442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f434802f9e0 0x7f4348174090 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:52.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.639+0000 7f43553c5640 1 --2- 172.21.15.60:0/2004832442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43481745d0 0x7f434800bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:52.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.639+0000 7f43553c5640 1 -- 172.21.15.60:0/2004832442 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f43480d8fd0 con 0x7f43481745d0 2024-09-12T02:34:52.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.642+0000 7f434f7fe640 1 --2- 172.21.15.60:0/2004832442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43481745d0 0x7f434800bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:52.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.643+0000 7f434f7fe640 1 -- 172.21.15.60:0/2004832442 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f43480d8cf0 con 0x7f43481745d0 2024-09-12T02:34:52.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.645+0000 7f434f7fe640 1 --2- 172.21.15.60:0/2004832442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43481745d0 0x7f434800bcb0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f433c0091d0 tx=0x7f433c02a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:52.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.645+0000 7f434cff9640 1 -- 172.21.15.60:0/2004832442 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f433c042070 con 0x7f43481745d0 2024-09-12T02:34:52.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.645+0000 7f434cff9640 1 -- 172.21.15.60:0/2004832442 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5052 (secure 0 0 0) 0x7f433c03ddf0 con 0x7f43481745d0 2024-09-12T02:34:52.646 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:34:52.646 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:34:52.647 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:34:52.647 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:34:52.647 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 118, 2024-09-12T02:34:52.647 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 638080, 2024-09-12T02:34:52.647 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:34:52.647 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:34:52.647 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:34:52.647 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:34:52.647 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:34:52.647 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 14, 2024-09-12T02:34:52.647 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:34:52.647 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:34:52.647 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:34:52.648 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:34:52.648 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:34:52.648 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:34:52.648 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:34:52.648 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:34:52.648 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:34:52.648 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:34:52.648 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:34:52.648 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:34:52.648 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:34:52.648 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:34:52.648 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:34:52.648 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:34:52.649 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:34:52.649 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:34:52.649 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:34:52.649 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:34:52.649 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:34:52.649 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:34:52.649 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:34:52.649 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:34:52.649 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:34:52.649 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:34:52.649 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:34:52.649 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:34:52.649 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:34:52.649 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:52.650 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:34:52.650 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:34:52.650 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:34:52.650 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:34:52.650 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:34:52.650 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:34:52.650 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:34:52.650 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:34:52.650 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:34:52.650 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:34:52.650 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:34:52.650 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:34:52.650 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:34:52.650 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:34:52.650 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:34:52.651 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:34:52.651 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:34:52.651 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:34:52.651 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:34:52.651 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:34:52.651 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:34:52.651 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:34:52.651 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:34:52.651 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:34:52.651 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:34:52.651 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:34:52.651 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:34:52.651 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:34:52.651 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:34:52.652 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:34:52.652 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:52.652 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:34:52.652 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:52.652 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:34:52.652 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:34:52.652 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:34:52.652 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:34:52.652 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:52.652 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:34:52.652 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:34:52.652 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:34:52.652 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:52.652 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:52.653 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:34:52.653 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:34:52.653 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:34:52.653 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:34:52.653 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:34:52.653 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:52.653 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:34:52.653 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:34:52.653 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:34:52.653 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:34:52.653 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:34:52.653 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:52.653 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:52.653 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:34:52.653 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:34:52.654 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:34:52.654 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:34:52.654 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:52.654 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:34:52.654 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:34:52.654 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:34:52.654 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:52.654 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:52.654 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:34:52.654 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:34:52.654 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:34:52.654 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:34:52.654 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:34:52.655 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:52.655 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:34:52.655 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:34:52.655 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:34:52.655 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:34:52.655 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:34:52.655 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:52.655 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:52.655 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:34:52.655 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:34:52.655 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:34:52.655 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:34:52.655 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:52.655 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:34:52.655 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:34:52.656 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:34:52.656 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:52.656 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:52.656 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:34:52.656 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:34:52.656 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:34:52.656 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:34:52.656 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:34:52.656 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:52.657 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:34:52.657 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:34:52.657 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:34:52.657 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:34:52.657 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:34:52.657 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:34:52.657 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:34:52.657 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:52.657 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:34:52.657 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:34:52.657 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:52.657 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:34:52.657 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:34:52.658 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:34:52.658 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:34:52.658 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:34:52.658 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:34:52.658 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:52.658 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:34:52.658 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:34:52.658 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:34:52.658 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:34:52.658 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:34:52.658 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:34:52.658 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:52.658 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:34:52.658 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:34:52.659 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 8 2024-09-12T02:34:52.659 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:34:52.659 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:34:52.659 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:34:52.659 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:52.659 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:34:52.659 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:34:52.659 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-09-12T02:34:52.659 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:34:52.659 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:34:52.659 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:34:52.659 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:52.659 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:34:52.659 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:34:52.659 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:34:52.660 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:34:52.660 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:34:52.660 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:52.660 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:34:52.660 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:34:52.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.645+0000 7f434cff9640 1 -- 172.21.15.60:0/2004832442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43481745d0 msgr2=0x7f434800bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:52.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.645+0000 7f434cff9640 1 --2- 172.21.15.60:0/2004832442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43481745d0 0x7f434800bcb0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f433c0091d0 tx=0x7f433c02a130 comp rx=0 tx=0).stop 2024-09-12T02:34:52.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.645+0000 7f434cff9640 1 -- 172.21.15.60:0/2004832442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43481745d0 msgr2=0x7f434800bcb0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:34:52.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.645+0000 7f434cff9640 1 --2- 172.21.15.60:0/2004832442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43481745d0 0x7f434800bcb0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:52.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.646+0000 7f43553c5640 1 -- 172.21.15.60:0/2004832442 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f433406be30 msgr2=0x7f433406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:52.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.646+0000 7f43553c5640 1 --2- 172.21.15.60:0/2004832442 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f433406be30 0x7f433406e2f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f43500518b0 tx=0x7f43500659b0 comp rx=0 tx=0).stop 2024-09-12T02:34:52.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.646+0000 7f4354bc4640 1 -- 172.21.15.60:0/2004832442 reap_dead start 2024-09-12T02:34:52.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.646+0000 7f43553c5640 1 -- 172.21.15.60:0/2004832442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4348007b80 msgr2=0x7f4348031430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:52.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.646+0000 7f43553c5640 1 --2- 172.21.15.60:0/2004832442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4348007b80 0x7f4348031430 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f434400c700 tx=0x7f434400cbc0 comp rx=0 tx=0).stop 2024-09-12T02:34:52.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.647+0000 7f43553c5640 1 -- 172.21.15.60:0/2004832442 shutdown_connections 2024-09-12T02:34:52.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.647+0000 7f43553c5640 1 --2- 172.21.15.60:0/2004832442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4348007b80 0x7f4348031430 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:52.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.647+0000 7f43553c5640 1 -- 172.21.15.60:0/2004832442 >> 172.21.15.60:0/2004832442 conn(0x7f4348048e20 msgr2=0x7f434800ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:52.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.649+0000 7f43553c5640 1 -- 172.21.15.60:0/2004832442 shutdown_connections 2024-09-12T02:34:52.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.650+0000 7f43553c5640 1 -- 172.21.15.60:0/2004832442 wait complete. 2024-09-12T02:34:52.669 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:34:52.669 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-12T02:34:52.669 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-12T02:34:52.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.851+0000 7fa110437640 1 Processor -- start 2024-09-12T02:34:52.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.851+0000 7fa110437640 1 -- start start 2024-09-12T02:34:52.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.853+0000 7fa110437640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa1080c29e0 0x7fa1080c2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:52.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.853+0000 7fa110437640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1081564a0 0x7fa10806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:52.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.853+0000 7fa110437640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1080c6bc0 con 0x7fa1080aa1a0 2024-09-12T02:34:52.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.853+0000 7fa110437640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fa1081569a0 con 0x7fa1080c29e0 2024-09-12T02:34:52.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.853+0000 7fa110437640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa1080c6ea0 con 0x7fa1081564a0 2024-09-12T02:34:52.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.853+0000 7fa10e1d3640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa1080c29e0 0x7fa1080c2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:52.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.853+0000 7fa10e1d3640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa1080c29e0 0x7fa1080c2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:33930/0 (socket says 172.21.15.60:33930) 2024-09-12T02:34:52.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.853+0000 7fa10e1d3640 1 -- 172.21.15.60:0/1382778288 learned_addr learned my addr 172.21.15.60:0/1382778288 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:34:52.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.854+0000 7fa10e9d4640 1 --2- 172.21.15.60:0/1382778288 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1081564a0 0x7fa10806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:52.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.854+0000 7fa10d1d1640 1 -- 172.21.15.60:0/1382778288 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 121577689 0 0) 0x7fa1080c6bc0 con 0x7fa1080aa1a0 2024-09-12T02:34:52.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.854+0000 7fa10d1d1640 1 -- 172.21.15.60:0/1382778288 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0f4003520 con 0x7fa1080aa1a0 2024-09-12T02:34:52.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.854+0000 7fa10e1d3640 1 -- 172.21.15.60:0/1382778288 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1081564a0 msgr2=0x7fa10806d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:34:52.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.854+0000 7fa10e1d3640 1 --2- 172.21.15.60:0/1382778288 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1081564a0 0x7fa10806d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:52.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.854+0000 7fa10e1d3640 1 -- 172.21.15.60:0/1382778288 >> v1:172.21.15.60:6789/0 conn(0x7fa1080aa1a0 legacy=0x7fa108152b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:52.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.854+0000 7fa10e1d3640 1 -- 172.21.15.60:0/1382778288 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa10806cd90 con 0x7fa1080c29e0 2024-09-12T02:34:52.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.856+0000 7fa10e1d3640 1 --2- 172.21.15.60:0/1382778288 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1080c29e0 0x7fa1080c2dc0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8009870 tx=0x7fa0f802e570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dbd4028f08bf432 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:52.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.857+0000 7fa10d1d1640 1 -- 172.21.15.60:0/1382778288 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f803a070 con 0x7fa1080c29e0 2024-09-12T02:34:52.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.857+0000 7fa10d1d1640 1 -- 172.21.15.60:0/1382778288 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0f8033710 con 0x7fa1080c29e0 2024-09-12T02:34:52.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.857+0000 7fa10d1d1640 1 -- 172.21.15.60:0/1382778288 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f8033ac0 con 0x7fa1080c29e0 2024-09-12T02:34:52.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.859+0000 7fa110437640 1 -- 172.21.15.60:0/1382778288 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1080c29e0 msgr2=0x7fa1080c2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:52.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.859+0000 7fa110437640 1 --2- 172.21.15.60:0/1382778288 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1080c29e0 0x7fa1080c2dc0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8009870 tx=0x7fa0f802e570 comp rx=0 tx=0).stop 2024-09-12T02:34:52.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.860+0000 7fa110437640 1 -- 172.21.15.60:0/1382778288 shutdown_connections 2024-09-12T02:34:52.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.860+0000 7fa110437640 1 --2- 172.21.15.60:0/1382778288 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1081564a0 0x7fa10806d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:52.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.860+0000 7fa110437640 1 --2- 172.21.15.60:0/1382778288 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1080c29e0 0x7fa1080c2dc0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:52.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.860+0000 7fa110437640 1 -- 172.21.15.60:0/1382778288 >> 172.21.15.60:0/1382778288 conn(0x7fa1080a9680 msgr2=0x7fa1080a9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:52.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.861+0000 7fa110437640 1 -- 172.21.15.60:0/1382778288 shutdown_connections 2024-09-12T02:34:52.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.862+0000 7fa110437640 1 -- 172.21.15.60:0/1382778288 wait complete. 2024-09-12T02:34:52.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.863+0000 7fa110437640 1 Processor -- start 2024-09-12T02:34:52.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.864+0000 7fa110437640 1 -- start start 2024-09-12T02:34:52.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.865+0000 7fa110437640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1080aa1a0 0x7fa1080bcb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:52.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.865+0000 7fa110437640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1080c29e0 0x7fa108072190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:52.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.865+0000 7fa110437640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1081564a0 0x7fa10814ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:52.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.865+0000 7fa110437640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa1080ad120 con 0x7fa1081564a0 2024-09-12T02:34:52.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.865+0000 7fa110437640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa108153490 con 0x7fa1080c29e0 2024-09-12T02:34:52.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.865+0000 7fa110437640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa1080ad2a0 con 0x7fa1080aa1a0 2024-09-12T02:34:52.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.866+0000 7fa10e9d4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1081564a0 0x7fa10814ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:52.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.866+0000 7fa10e9d4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1081564a0 0x7fa10814ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39686/0 (socket says 172.21.15.60:39686) 2024-09-12T02:34:52.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.866+0000 7fa10e9d4640 1 -- 172.21.15.60:0/1158136203 learned_addr learned my addr 172.21.15.60:0/1158136203 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:34:52.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.866+0000 7fa10e9d4640 1 -- 172.21.15.60:0/1158136203 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1080aa1a0 msgr2=0x7fa1080bcb60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:34:52.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.866+0000 7fa10e9d4640 1 --2- 172.21.15.60:0/1158136203 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1080aa1a0 0x7fa1080bcb60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:52.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.866+0000 7fa10e9d4640 1 -- 172.21.15.60:0/1158136203 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1080c29e0 msgr2=0x7fa108072190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:52.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.866+0000 7fa10d9d2640 1 --2- 172.21.15.60:0/1158136203 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1080c29e0 0x7fa108072190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:52.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.866+0000 7fa10e9d4640 1 --2- 172.21.15.60:0/1158136203 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1080c29e0 0x7fa108072190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:52.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.866+0000 7fa10e9d4640 1 -- 172.21.15.60:0/1158136203 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1081eac40 con 0x7fa1081564a0 2024-09-12T02:34:52.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.867+0000 7fa10e9d4640 1 --2- 172.21.15.60:0/1158136203 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1081564a0 0x7fa10814ec20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa10000bfd0 tx=0x7fa10000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:52.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.867+0000 7fa10d9d2640 1 --2- 172.21.15.60:0/1158136203 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1080c29e0 0x7fa108072190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:34:52.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.867+0000 7fa0feffd640 1 -- 172.21.15.60:0/1158136203 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa100010440 con 0x7fa1081564a0 2024-09-12T02:34:52.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.867+0000 7fa0feffd640 1 -- 172.21.15.60:0/1158136203 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1000105e0 con 0x7fa1081564a0 2024-09-12T02:34:52.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.868+0000 7fa0feffd640 1 -- 172.21.15.60:0/1158136203 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1000109d0 con 0x7fa1081564a0 2024-09-12T02:34:52.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.868+0000 7fa110437640 1 -- 172.21.15.60:0/1158136203 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1081eaf20 con 0x7fa1081564a0 2024-09-12T02:34:52.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.869+0000 7fa110437640 1 -- 172.21.15.60:0/1158136203 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1081eb4e0 con 0x7fa1081564a0 2024-09-12T02:34:52.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.871+0000 7fa0feffd640 1 -- 172.21.15.60:0/1158136203 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa100010b70 con 0x7fa1081564a0 2024-09-12T02:34:52.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.872+0000 7fa0feffd640 1 --2- 172.21.15.60:0/1158136203 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa0ec06bf00 0x7fa0ec06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:52.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.872+0000 7fa0feffd640 1 -- 172.21.15.60:0/1158136203 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fa10008bae0 con 0x7fa1081564a0 2024-09-12T02:34:52.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.873+0000 7fa10e1d3640 1 --2- 172.21.15.60:0/1158136203 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa0ec06bf00 0x7fa0ec06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:52.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.873+0000 7fa110437640 1 --2- 172.21.15.60:0/1158136203 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1080726d0 0x7fa10814f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:52.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.873+0000 7fa110437640 1 -- 172.21.15.60:0/1158136203 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa108068b50 con 0x7fa1080726d0 2024-09-12T02:34:52.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.874+0000 7fa10e1d3640 1 --2- 172.21.15.60:0/1158136203 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa0ec06bf00 0x7fa0ec06e3c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8037000 tx=0x7fa0f8008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:52.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.875+0000 7fa10d9d2640 1 --2- 172.21.15.60:0/1158136203 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1080726d0 0x7fa10814f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:52.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.875+0000 7fa10d9d2640 1 -- 172.21.15.60:0/1158136203 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa1081ea9f0 con 0x7fa1080726d0 2024-09-12T02:34:52.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.876+0000 7fa10d9d2640 1 --2- 172.21.15.60:0/1158136203 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1080726d0 0x7fa10814f160 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa1081555b0 tx=0x7fa10400dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:52.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.876+0000 7fa0feffd640 1 -- 172.21.15.60:0/1158136203 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa104003b80 con 0x7fa1080726d0 2024-09-12T02:34:52.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.877+0000 7fa0feffd640 1 -- 172.21.15.60:0/1158136203 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fa104003b80 con 0x7fa1080726d0 2024-09-12T02:34:52.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.877+0000 7fa0feffd640 1 -- 172.21.15.60:0/1158136203 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1080726d0 msgr2=0x7fa10814f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:52.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.877+0000 7fa0feffd640 1 --2- 172.21.15.60:0/1158136203 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1080726d0 0x7fa10814f160 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa1081555b0 tx=0x7fa10400dcc0 comp rx=0 tx=0).stop 2024-09-12T02:34:52.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.877+0000 7fa0feffd640 1 -- 172.21.15.60:0/1158136203 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1080726d0 msgr2=0x7fa10814f160 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:34:52.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.877+0000 7fa0feffd640 1 --2- 172.21.15.60:0/1158136203 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1080726d0 0x7fa10814f160 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:52.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.897+0000 7fa110437640 1 --2- 172.21.15.60:0/1158136203 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa108072ed0 0x7fa1080732e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:52.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.897+0000 7fa110437640 1 -- 172.21.15.60:0/1158136203 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa1080c2dc0 con 0x7fa108072ed0 2024-09-12T02:34:52.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.898+0000 7fa10d9d2640 1 --2- 172.21.15.60:0/1158136203 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa108072ed0 0x7fa1080732e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:52.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.899+0000 7fa10d9d2640 1 -- 172.21.15.60:0/1158136203 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa1080c67d0 con 0x7fa108072ed0 2024-09-12T02:34:52.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.899+0000 7fa10d9d2640 1 --2- 172.21.15.60:0/1158136203 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa108072ed0 0x7fa1080732e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa104013000 tx=0x7fa1040014d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:52.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.899+0000 7fa0feffd640 1 -- 172.21.15.60:0/1158136203 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa104005650 con 0x7fa108072ed0 2024-09-12T02:34:52.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.900+0000 7fa0feffd640 1 -- 172.21.15.60:0/1158136203 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4551 (secure 0 0 0) 0x7fa104005650 con 0x7fa108072ed0 2024-09-12T02:34:52.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.900+0000 7fa0feffd640 1 -- 172.21.15.60:0/1158136203 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa108072ed0 msgr2=0x7fa1080732e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:52.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.900+0000 7fa0feffd640 1 --2- 172.21.15.60:0/1158136203 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa108072ed0 0x7fa1080732e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa104013000 tx=0x7fa1040014d0 comp rx=0 tx=0).stop 2024-09-12T02:34:52.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.900+0000 7fa0feffd640 1 -- 172.21.15.60:0/1158136203 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa108072ed0 msgr2=0x7fa1080732e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:34:52.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.900+0000 7fa0feffd640 1 --2- 172.21.15.60:0/1158136203 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa108072ed0 0x7fa1080732e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:52.902 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:34:52.902 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:34:52.902 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:34:52.902 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:34:52.902 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 118, 2024-09-12T02:34:52.902 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 166654, 2024-09-12T02:34:52.903 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:34:52.903 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:34:52.903 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:34:52.903 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:34:52.903 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:34:52.903 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 14, 2024-09-12T02:34:52.903 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:34:52.903 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:34:52.903 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:34:52.903 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:34:52.903 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:34:52.904 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:34:52.904 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:34:52.904 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:34:52.904 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:34:52.904 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:34:52.904 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:34:52.904 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:34:52.904 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:34:52.904 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:34:52.904 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:34:52.904 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:34:52.904 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:34:52.905 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:34:52.905 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:34:52.905 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:34:52.905 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:34:52.905 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:34:52.905 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:34:52.905 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:34:52.905 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:34:52.905 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:34:52.905 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:34:52.905 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:34:52.905 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:34:52.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:52.906 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:34:52.906 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:34:52.906 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:34:52.906 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:34:52.906 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:34:52.906 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:34:52.906 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:34:52.906 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:34:52.906 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:34:52.906 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:34:52.906 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:34:52.906 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:34:52.906 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:34:52.906 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:34:52.907 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:34:52.907 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:34:52.907 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:34:52.907 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:34:52.907 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:34:52.907 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:34:52.907 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:34:52.907 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:34:52.907 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:34:52.907 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:34:52.907 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:34:52.907 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:34:52.907 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:34:52.907 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:34:52.908 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:34:52.908 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:34:52.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:52.908 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:34:52.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:52.908 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:34:52.908 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:34:52.908 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:34:52.908 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:34:52.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:52.908 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:34:52.908 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:34:52.909 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:34:52.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:52.909 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:52.909 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:34:52.909 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:34:52.909 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:34:52.909 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:34:52.909 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:34:52.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:52.909 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:34:52.909 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:34:52.909 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:34:52.909 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:34:52.909 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:34:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:34:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:34:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:34:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:34:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:34:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:34:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:34:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:34:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:34:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:34:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:34:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:34:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:34:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:34:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:34:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:34:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:34:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:34:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:34:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:34:52.912 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:34:52.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:52.912 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:34:52.912 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:34:52.912 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:34:52.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:52.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:52.912 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:34:52.912 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:34:52.912 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:34:52.912 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:34:52.912 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:34:52.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:52.913 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:34:52.913 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:34:52.913 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:34:52.913 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:34:52.913 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:34:52.913 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:34:52.913 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:34:52.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:52.913 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:34:52.913 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:34:52.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:52.913 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:34:52.913 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:34:52.913 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:34:52.914 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:34:52.914 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:34:52.914 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:34:52.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:34:52.914 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:34:52.914 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:34:52.914 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:34:52.914 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:34:52.914 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:34:52.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:34:52.914 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:34:52.914 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:34:52.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.901+0000 7fa110437640 1 -- 172.21.15.60:0/1158136203 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa0ec06bf00 msgr2=0x7fa0ec06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:52.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.901+0000 7fa110437640 1 --2- 172.21.15.60:0/1158136203 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa0ec06bf00 0x7fa0ec06e3c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8037000 tx=0x7fa0f8008030 comp rx=0 tx=0).stop 2024-09-12T02:34:52.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.901+0000 7fa10e9d4640 1 -- 172.21.15.60:0/1158136203 reap_dead start 2024-09-12T02:34:52.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.902+0000 7fa110437640 1 -- 172.21.15.60:0/1158136203 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1081564a0 msgr2=0x7fa10814ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:52.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.902+0000 7fa110437640 1 --2- 172.21.15.60:0/1158136203 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1081564a0 0x7fa10814ec20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa10000bfd0 tx=0x7fa10000ef20 comp rx=0 tx=0).stop 2024-09-12T02:34:52.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.902+0000 7fa110437640 1 -- 172.21.15.60:0/1158136203 shutdown_connections 2024-09-12T02:34:52.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.902+0000 7fa110437640 1 --2- 172.21.15.60:0/1158136203 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1081564a0 0x7fa10814ec20 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:52.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.902+0000 7fa110437640 1 -- 172.21.15.60:0/1158136203 >> 172.21.15.60:0/1158136203 conn(0x7fa1080a9680 msgr2=0x7fa1080a7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:52.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.902+0000 7fa110437640 1 -- 172.21.15.60:0/1158136203 shutdown_connections 2024-09-12T02:34:52.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:52.902+0000 7fa110437640 1 -- 172.21.15.60:0/1158136203 wait complete. 2024-09-12T02:34:52.922 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:34:52.922 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-09-12T02:34:52.923 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-12T02:34:52.923 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-09-12T02:34:52.923 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-09-12T02:34:52.923 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T02:34:52.923 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:34:52.947 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T02:34:52.947 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-12T02:34:52.947 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:34:53.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.126+0000 7ffb12e58640 1 Processor -- start 2024-09-12T02:34:53.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.128+0000 7ffb12e58640 1 -- start start 2024-09-12T02:34:53.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.129+0000 7ffb12e58640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ffb040d8170 0x7ffb0404a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:53.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.129+0000 7ffb12e58640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb040ddfc0 0x7ffb040de430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:53.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.129+0000 7ffb12e58640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb0404aeb0 con 0x7ffb040072a0 2024-09-12T02:34:53.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.129+0000 7ffb12e58640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7ffb04046d10 con 0x7ffb040d8170 2024-09-12T02:34:53.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.129+0000 7ffb12e58640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ffb0404b190 con 0x7ffb040ddfc0 2024-09-12T02:34:53.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.130+0000 7ffb11e56640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ffb040d8170 0x7ffb0404a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:53.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.130+0000 7ffb11e56640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ffb040d8170 0x7ffb0404a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39800/0 (socket says 172.21.15.60:39800) 2024-09-12T02:34:53.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.130+0000 7ffb11e56640 1 -- 172.21.15.60:0/1894501855 learned_addr learned my addr 172.21.15.60:0/1894501855 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:34:53.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.131+0000 7ffb11e56640 1 -- 172.21.15.60:0/1894501855 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb040ddfc0 msgr2=0x7ffb040de430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:34:53.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.131+0000 7ffb11e56640 1 --2- 172.21.15.60:0/1894501855 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb040ddfc0 0x7ffb040de430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:53.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.131+0000 7ffb11e56640 1 -- 172.21.15.60:0/1894501855 >> v1:172.21.15.60:6789/0 conn(0x7ffb040072a0 legacy=0x7ffb0400b0e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:34:53.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.131+0000 7ffb11e56640 1 -- 172.21.15.60:0/1894501855 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb040472d0 con 0x7ffb040d8170 2024-09-12T02:34:53.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.132+0000 7ffb11e56640 1 --2- 172.21.15.60:0/1894501855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb040d8170 0x7ffb0404a7b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ffb08009870 tx=0x7ffb0802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6de60f407e8a17b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:53.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.133+0000 7ffb10e54640 1 -- 172.21.15.60:0/1894501855 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb08037070 con 0x7ffb040d8170 2024-09-12T02:34:53.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.133+0000 7ffb10e54640 1 -- 172.21.15.60:0/1894501855 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb08032440 con 0x7ffb040d8170 2024-09-12T02:34:53.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.133+0000 7ffb10e54640 1 -- 172.21.15.60:0/1894501855 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb08032810 con 0x7ffb040d8170 2024-09-12T02:34:53.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.135+0000 7ffb12e58640 1 -- 172.21.15.60:0/1894501855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb040d8170 msgr2=0x7ffb0404a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:53.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.135+0000 7ffb12e58640 1 --2- 172.21.15.60:0/1894501855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb040d8170 0x7ffb0404a7b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ffb08009870 tx=0x7ffb0802a230 comp rx=0 tx=0).stop 2024-09-12T02:34:53.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.136+0000 7ffb12e58640 1 -- 172.21.15.60:0/1894501855 shutdown_connections 2024-09-12T02:34:53.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.136+0000 7ffb12e58640 1 --2- 172.21.15.60:0/1894501855 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb040ddfc0 0x7ffb040de430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:53.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.136+0000 7ffb12e58640 1 --2- 172.21.15.60:0/1894501855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb040d8170 0x7ffb0404a7b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:53.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.136+0000 7ffb12e58640 1 -- 172.21.15.60:0/1894501855 >> 172.21.15.60:0/1894501855 conn(0x7ffb04048160 msgr2=0x7ffb04048570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:53.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.136+0000 7ffb12e58640 1 -- 172.21.15.60:0/1894501855 shutdown_connections 2024-09-12T02:34:53.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.136+0000 7ffb12e58640 1 -- 172.21.15.60:0/1894501855 wait complete. 2024-09-12T02:34:53.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.138+0000 7ffb12e58640 1 Processor -- start 2024-09-12T02:34:53.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.138+0000 7ffb12e58640 1 -- start start 2024-09-12T02:34:53.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.140+0000 7ffb12e58640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffb040072a0 0x7ffb0403f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:53.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.140+0000 7ffb12e58640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb040d8170 0x7ffb04040580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:53.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.140+0000 7ffb11655640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb040d8170 0x7ffb04040580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:53.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.140+0000 7ffb11e56640 1 -- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffb040072a0 msgr2=0x7ffb0403f5d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3300/0 2024-09-12T02:34:53.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.140+0000 7ffb11e56640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffb040072a0 0x7ffb0403f5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:34:53.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.141+0000 7ffb12e58640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb040ddfc0 0x7ffb04041680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:53.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.141+0000 7ffb12e58640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ffb04047890 con 0x7ffb040d8170 2024-09-12T02:34:53.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.141+0000 7ffb12e58640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ffb040de970 con 0x7ffb040072a0 2024-09-12T02:34:53.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.141+0000 7ffb12e58640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ffb0400b7f0 con 0x7ffb040ddfc0 2024-09-12T02:34:53.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.141+0000 7ffb11655640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb040d8170 0x7ffb04040580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39812/0 (socket says 172.21.15.60:39812) 2024-09-12T02:34:53.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.141+0000 7ffb11655640 1 -- 172.21.15.60:0/2078524976 learned_addr learned my addr 172.21.15.60:0/2078524976 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:34:53.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.141+0000 7ffb11655640 1 -- 172.21.15.60:0/2078524976 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb040ddfc0 msgr2=0x7ffb04041680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:53.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.141+0000 7ffb11655640 1 --2- 172.21.15.60:0/2078524976 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb040ddfc0 0x7ffb04041680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:53.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.141+0000 7ffb11655640 1 -- 172.21.15.60:0/2078524976 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffb040072a0 msgr2=0x7ffb0403f5d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:34:53.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.141+0000 7ffb11655640 1 --2- 172.21.15.60:0/2078524976 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffb040072a0 0x7ffb0403f5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:53.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.141+0000 7ffb11655640 1 -- 172.21.15.60:0/2078524976 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb040c5410 con 0x7ffb040d8170 2024-09-12T02:34:53.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.141+0000 7ffb11655640 1 --2- 172.21.15.60:0/2078524976 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb040d8170 0x7ffb04040580 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c076010 tx=0x7ffb0c0699a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:53.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.142+0000 7ffb027fc640 1 -- 172.21.15.60:0/2078524976 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c091070 con 0x7ffb040d8170 2024-09-12T02:34:53.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.142+0000 7ffb027fc640 1 -- 172.21.15.60:0/2078524976 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb0c067d60 con 0x7ffb040d8170 2024-09-12T02:34:53.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.142+0000 7ffb12e58640 1 -- 172.21.15.60:0/2078524976 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb040d51e0 con 0x7ffb040d8170 2024-09-12T02:34:53.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.142+0000 7ffb027fc640 1 -- 172.21.15.60:0/2078524976 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c091070 con 0x7ffb040d8170 2024-09-12T02:34:53.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.142+0000 7ffb12e58640 1 -- 172.21.15.60:0/2078524976 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb04041160 con 0x7ffb040d8170 2024-09-12T02:34:53.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.144+0000 7ffb12e58640 1 -- 172.21.15.60:0/2078524976 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb04047db0 con 0x7ffb040d8170 2024-09-12T02:34:53.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.144+0000 7ffb027fc640 1 -- 172.21.15.60:0/2078524976 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffb0c0741c0 con 0x7ffb040d8170 2024-09-12T02:34:53.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.144+0000 7ffb027fc640 1 --2- 172.21.15.60:0/2078524976 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ffaf006c010 0x7ffaf006e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:53.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.145+0000 7ffb027fc640 1 -- 172.21.15.60:0/2078524976 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7ffb0c106cf0 con 0x7ffb040d8170 2024-09-12T02:34:53.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.145+0000 7ffb11e56640 1 --2- 172.21.15.60:0/2078524976 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ffaf006c010 0x7ffaf006e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:53.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.145+0000 7ffb11e56640 1 --2- 172.21.15.60:0/2078524976 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ffaf006c010 0x7ffaf006e4d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ffb08034000 tx=0x7ffb0802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:53.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.152+0000 7ffb027fc640 1 -- 172.21.15.60:0/2078524976 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffb0c10b070 con 0x7ffb040d8170 2024-09-12T02:34:53.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.643+0000 7ffb12e58640 1 -- 172.21.15.60:0/2078524976 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ffb040458e0 con 0x7ffb040d8170 2024-09-12T02:34:53.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.643+0000 7ffb027fc640 1 -- 172.21.15.60:0/2078524976 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1566 (secure 0 0 0) 0x7ffb0c10b070 con 0x7ffb040d8170 2024-09-12T02:34:53.644 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":118,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:34:53.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.647+0000 7ffb12e58640 1 -- 172.21.15.60:0/2078524976 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ffaf006c010 msgr2=0x7ffaf006e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:53.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.647+0000 7ffb12e58640 1 --2- 172.21.15.60:0/2078524976 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ffaf006c010 0x7ffaf006e4d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ffb08034000 tx=0x7ffb0802e000 comp rx=0 tx=0).stop 2024-09-12T02:34:53.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.647+0000 7ffb12e58640 1 -- 172.21.15.60:0/2078524976 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb040d8170 msgr2=0x7ffb04040580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:53.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.647+0000 7ffb12e58640 1 --2- 172.21.15.60:0/2078524976 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb040d8170 0x7ffb04040580 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c076010 tx=0x7ffb0c0699a0 comp rx=0 tx=0).stop 2024-09-12T02:34:53.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.647+0000 7ffb12e58640 1 -- 172.21.15.60:0/2078524976 shutdown_connections 2024-09-12T02:34:53.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.647+0000 7ffb12e58640 1 --2- 172.21.15.60:0/2078524976 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ffaf006c010 0x7ffaf006e4d0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:53.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.648+0000 7ffb12e58640 1 --2- 172.21.15.60:0/2078524976 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb040ddfc0 0x7ffb04041680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:53.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.648+0000 7ffb12e58640 1 --2- 172.21.15.60:0/2078524976 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb040d8170 0x7ffb04040580 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:53.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.648+0000 7ffb12e58640 1 --2- 172.21.15.60:0/2078524976 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffb040072a0 0x7ffb0403f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:53.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.648+0000 7ffb12e58640 1 -- 172.21.15.60:0/2078524976 >> 172.21.15.60:0/2078524976 conn(0x7ffb04048160 msgr2=0x7ffb040dbe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:53.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.648+0000 7ffb12e58640 1 -- 172.21.15.60:0/2078524976 shutdown_connections 2024-09-12T02:34:53.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:53.648+0000 7ffb12e58640 1 -- 172.21.15.60:0/2078524976 wait complete. 2024-09-12T02:34:56.672 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:34:56.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.842+0000 7fadf3d8d640 1 Processor -- start 2024-09-12T02:34:56.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.842+0000 7fadf3d8d640 1 -- start start 2024-09-12T02:34:56.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.844+0000 7fadf3d8d640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fadec154690 0x7fadec067950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:56.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.844+0000 7fadf3d8d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fadec15a5c0 0x7fadec0ca6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:56.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.844+0000 7fadf3d8d640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadec154a70 con 0x7fadec0cb950 2024-09-12T02:34:56.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.844+0000 7fadf3d8d640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fadec15aac0 con 0x7fadec154690 2024-09-12T02:34:56.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.844+0000 7fadf3d8d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fadec15ada0 con 0x7fadec15a5c0 2024-09-12T02:34:56.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.844+0000 7fadf1b29640 1 -- >> v2:172.21.15.105:3300/0 conn(0x7fadec154690 msgr2=0x7fadec067950 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3300/0 2024-09-12T02:34:56.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.844+0000 7fadf1b29640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fadec154690 0x7fadec067950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:34:56.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.844+0000 7fadf232a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fadec15a5c0 0x7fadec0ca6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:56.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.844+0000 7fadf1328640 1 -- >> v1:172.21.15.105:6789/0 conn(0x7fadec0cb950 legacy=0x7fadec0c9fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.105:6789/0 2024-09-12T02:34:56.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.844+0000 7fadf232a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fadec15a5c0 0x7fadec0ca6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:37368/0 (socket says 172.21.15.60:37368) 2024-09-12T02:34:56.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.844+0000 7fadf232a640 1 -- 172.21.15.60:0/1283350703 learned_addr learned my addr 172.21.15.60:0/1283350703 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:34:56.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.845+0000 7fadf232a640 1 -- 172.21.15.60:0/1283350703 >> v2:172.21.15.105:3300/0 conn(0x7fadec154690 msgr2=0x7fadec067950 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:34:56.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.845+0000 7fadf232a640 1 --2- 172.21.15.60:0/1283350703 >> v2:172.21.15.105:3300/0 conn(0x7fadec154690 0x7fadec067950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.845+0000 7fadf232a640 1 -- 172.21.15.60:0/1283350703 >> v1:172.21.15.105:6789/0 conn(0x7fadec0cb950 legacy=0x7fadec0c9fd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:34:56.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.845+0000 7fadf232a640 1 -- 172.21.15.60:0/1283350703 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadec15b080 con 0x7fadec15a5c0 2024-09-12T02:34:56.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.846+0000 7fadf232a640 1 --2- 172.21.15.60:0/1283350703 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fadec15a5c0 0x7fadec0ca6e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fadec08e2a0 tx=0x7fade402a5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=467d47f67c0b3fa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:56.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.850+0000 7fadf0b27640 1 -- 172.21.15.60:0/1283350703 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade4036070 con 0x7fadec15a5c0 2024-09-12T02:34:56.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.850+0000 7fadf0b27640 1 -- 172.21.15.60:0/1283350703 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fade4031600 con 0x7fadec15a5c0 2024-09-12T02:34:56.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.850+0000 7fadf0b27640 1 -- 172.21.15.60:0/1283350703 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade40319d0 con 0x7fadec15a5c0 2024-09-12T02:34:56.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.852+0000 7fadf3d8d640 1 -- 172.21.15.60:0/1283350703 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fadec15a5c0 msgr2=0x7fadec0ca6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:56.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.852+0000 7fadf3d8d640 1 --2- 172.21.15.60:0/1283350703 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fadec15a5c0 0x7fadec0ca6e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fadec08e2a0 tx=0x7fade402a5b0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.852+0000 7fadf3d8d640 1 -- 172.21.15.60:0/1283350703 shutdown_connections 2024-09-12T02:34:56.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.852+0000 7fadf3d8d640 1 --2- 172.21.15.60:0/1283350703 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fadec15a5c0 0x7fadec0ca6e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.852+0000 7fadf3d8d640 1 --2- 172.21.15.60:0/1283350703 >> v2:172.21.15.105:3300/0 conn(0x7fadec154690 0x7fadec067950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.852+0000 7fadf3d8d640 1 -- 172.21.15.60:0/1283350703 >> 172.21.15.60:0/1283350703 conn(0x7fadec0c87f0 msgr2=0x7fadec0c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:56.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.852+0000 7fadf3d8d640 1 -- 172.21.15.60:0/1283350703 shutdown_connections 2024-09-12T02:34:56.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.853+0000 7fadf3d8d640 1 -- 172.21.15.60:0/1283350703 wait complete. 2024-09-12T02:34:56.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.855+0000 7fadf3d8d640 1 Processor -- start 2024-09-12T02:34:56.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.855+0000 7fadf3d8d640 1 -- start start 2024-09-12T02:34:56.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.856+0000 7fadf3d8d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadec0cb950 0x7fadec15d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:56.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.856+0000 7fadf3d8d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fadec154690 0x7fadec15c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:56.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.856+0000 7fadf3d8d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fadec15a5c0 0x7fadec15ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:56.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.857+0000 7fadf3d8d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fadec067e90 con 0x7fadec0cb950 2024-09-12T02:34:56.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.857+0000 7fadf232a640 1 -- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fadec15a5c0 msgr2=0x7fadec15ccc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3300/0 2024-09-12T02:34:56.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.857+0000 7fadf232a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fadec15a5c0 0x7fadec15ccc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:34:56.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.857+0000 7fadf3d8d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fadec0cac20 con 0x7fadec15a5c0 2024-09-12T02:34:56.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.857+0000 7fadf1328640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fadec154690 0x7fadec15c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:56.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.857+0000 7fadf3d8d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fadec068010 con 0x7fadec154690 2024-09-12T02:34:56.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.857+0000 7fadf1328640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fadec154690 0x7fadec15c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:37378/0 (socket says 172.21.15.60:37378) 2024-09-12T02:34:56.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.857+0000 7fadf1328640 1 -- 172.21.15.60:0/1875548093 learned_addr learned my addr 172.21.15.60:0/1875548093 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:34:56.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.857+0000 7fadf1b29640 1 --2- 172.21.15.60:0/1875548093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadec0cb950 0x7fadec15d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:56.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.858+0000 7fadf1b29640 1 -- 172.21.15.60:0/1875548093 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fadec154690 msgr2=0x7fadec15c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:56.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.858+0000 7fadf1b29640 1 --2- 172.21.15.60:0/1875548093 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fadec154690 0x7fadec15c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.858+0000 7fadf1b29640 1 -- 172.21.15.60:0/1875548093 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fadec15a5c0 msgr2=0x7fadec15ccc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:34:56.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.858+0000 7fadf1b29640 1 --2- 172.21.15.60:0/1875548093 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fadec15a5c0 0x7fadec15ccc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.859+0000 7fadf1b29640 1 -- 172.21.15.60:0/1875548093 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadec1e5fa0 con 0x7fadec0cb950 2024-09-12T02:34:56.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.859+0000 7fadf1b29640 1 --2- 172.21.15.60:0/1875548093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadec0cb950 0x7fadec15d5c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fade8003930 tx=0x7fade800b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:56.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.861+0000 7fade27fc640 1 -- 172.21.15.60:0/1875548093 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade8003dc0 con 0x7fadec0cb950 2024-09-12T02:34:56.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.861+0000 7fade27fc640 1 -- 172.21.15.60:0/1875548093 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fade8005070 con 0x7fadec0cb950 2024-09-12T02:34:56.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.861+0000 7fadf3d8d640 1 -- 172.21.15.60:0/1875548093 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadec1e6280 con 0x7fadec0cb950 2024-09-12T02:34:56.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.861+0000 7fade27fc640 1 -- 172.21.15.60:0/1875548093 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade8005480 con 0x7fadec0cb950 2024-09-12T02:34:56.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.861+0000 7fadf3d8d640 1 -- 172.21.15.60:0/1875548093 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadec1e6840 con 0x7fadec0cb950 2024-09-12T02:34:56.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.863+0000 7fadf3d8d640 1 -- 172.21.15.60:0/1875548093 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadd4005290 con 0x7fadec0cb950 2024-09-12T02:34:56.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.866+0000 7fade27fc640 1 -- 172.21.15.60:0/1875548093 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fade8005620 con 0x7fadec0cb950 2024-09-12T02:34:56.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.866+0000 7fade27fc640 1 --2- 172.21.15.60:0/1875548093 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fadd006be30 0x7fadd006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:56.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.867+0000 7fade27fc640 1 -- 172.21.15.60:0/1875548093 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fade808b7b0 con 0x7fadec0cb950 2024-09-12T02:34:56.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.867+0000 7fadf1328640 1 --2- 172.21.15.60:0/1875548093 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fadd006be30 0x7fadd006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:56.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.868+0000 7fadf1328640 1 --2- 172.21.15.60:0/1875548093 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fadd006be30 0x7fadd006e2f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7faddc006b20 tx=0x7faddc006ab0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:56.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:56.873+0000 7fade27fc640 1 -- 172.21.15.60:0/1875548093 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fade8059da0 con 0x7fadec0cb950 2024-09-12T02:34:57.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:57.350+0000 7fadf3d8d640 1 -- 172.21.15.60:0/1875548093 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fadd4005580 con 0x7fadec0cb950 2024-09-12T02:34:57.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:57.352+0000 7fade27fc640 1 -- 172.21.15.60:0/1875548093 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1566 (secure 0 0 0) 0x7fade80596a0 con 0x7fadec0cb950 2024-09-12T02:34:57.355 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":118,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":19,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:34:57.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:57.358+0000 7fadcffff640 1 -- 172.21.15.60:0/1875548093 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fadd006be30 msgr2=0x7fadd006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:57.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:57.358+0000 7fadcffff640 1 --2- 172.21.15.60:0/1875548093 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fadd006be30 0x7fadd006e2f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7faddc006b20 tx=0x7faddc006ab0 comp rx=0 tx=0).stop 2024-09-12T02:34:57.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:57.358+0000 7fadcffff640 1 -- 172.21.15.60:0/1875548093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadec0cb950 msgr2=0x7fadec15d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:57.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:57.358+0000 7fadcffff640 1 --2- 172.21.15.60:0/1875548093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadec0cb950 0x7fadec15d5c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fade8003930 tx=0x7fade800b9b0 comp rx=0 tx=0).stop 2024-09-12T02:34:57.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:57.360+0000 7fadcffff640 1 -- 172.21.15.60:0/1875548093 shutdown_connections 2024-09-12T02:34:57.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:57.360+0000 7fadcffff640 1 --2- 172.21.15.60:0/1875548093 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fadd006be30 0x7fadd006e2f0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:57.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:57.360+0000 7fadcffff640 1 --2- 172.21.15.60:0/1875548093 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fadec15a5c0 0x7fadec15ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:57.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:57.360+0000 7fadcffff640 1 --2- 172.21.15.60:0/1875548093 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fadec154690 0x7fadec15c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:57.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:57.360+0000 7fadcffff640 1 --2- 172.21.15.60:0/1875548093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadec0cb950 0x7fadec15d5c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:57.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:57.360+0000 7fadcffff640 1 -- 172.21.15.60:0/1875548093 >> 172.21.15.60:0/1875548093 conn(0x7fadec0c87f0 msgr2=0x7fadec0cada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:57.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:57.360+0000 7fadcffff640 1 -- 172.21.15.60:0/1875548093 shutdown_connections 2024-09-12T02:34:57.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:34:57.360+0000 7fadcffff640 1 -- 172.21.15.60:0/1875548093 wait complete. 2024-09-12T02:35:00.388 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:35:00.569 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:35:00.572 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:35:00.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.576+0000 7f024759e640 1 Processor -- start 2024-09-12T02:35:00.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.576+0000 7f024759e640 1 -- start start 2024-09-12T02:35:00.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.577+0000 7f024759e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f024806eb00 0x7f024806e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:00.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.577+0000 7f024759e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f024814f720 0x7f024814fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:00.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.578+0000 7f024759e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02480c4060 con 0x7f02480c23d0 2024-09-12T02:35:00.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.578+0000 7f024759e640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f0248156270 con 0x7f024814f720 2024-09-12T02:35:00.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.578+0000 7f024759e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f024806de50 con 0x7f024806eb00 2024-09-12T02:35:00.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.578+0000 7f024659c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f024806eb00 0x7f024806e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:00.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.579+0000 7f0246d9d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f024814f720 0x7f024814fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:00.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.579+0000 7f0246d9d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f024814f720 0x7f024814fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56500/0 (socket says 172.21.15.60:56500) 2024-09-12T02:35:00.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.579+0000 7f0246d9d640 1 -- 172.21.15.60:0/1735346838 learned_addr learned my addr 172.21.15.60:0/1735346838 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:35:00.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.579+0000 7f024659c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f024806eb00 0x7f024806e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:56270/0 (socket says 172.21.15.60:56270) 2024-09-12T02:35:00.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.581+0000 7f0246d9d640 1 -- 172.21.15.60:0/1735346838 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f024806eb00 msgr2=0x7f024806e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:00.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.581+0000 7f0246d9d640 1 --2- 172.21.15.60:0/1735346838 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f024806eb00 0x7f024806e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:00.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.581+0000 7f0246d9d640 1 -- 172.21.15.60:0/1735346838 >> v1:172.21.15.60:6789/0 conn(0x7f02480c23d0 legacy=0x7f02480c7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:00.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.581+0000 7f0246d9d640 1 -- 172.21.15.60:0/1735346838 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f024806e130 con 0x7f024814f720 2024-09-12T02:35:00.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.582+0000 7f0246d9d640 1 --2- 172.21.15.60:0/1735346838 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f024814f720 0x7f024814fbb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0238009ad0 tx=0x7f023802e7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af0a7764f421f2ef server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:00.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.584+0000 7f024559a640 1 -- 172.21.15.60:0/1735346838 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f023803c070 con 0x7f024814f720 2024-09-12T02:35:00.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.584+0000 7f024559a640 1 -- 172.21.15.60:0/1735346838 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0238033070 con 0x7f024814f720 2024-09-12T02:35:00.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.584+0000 7f024559a640 1 -- 172.21.15.60:0/1735346838 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0238037880 con 0x7f024814f720 2024-09-12T02:35:00.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.586+0000 7f024759e640 1 -- 172.21.15.60:0/1735346838 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f024814f720 msgr2=0x7f024814fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:00.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.586+0000 7f024759e640 1 --2- 172.21.15.60:0/1735346838 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f024814f720 0x7f024814fbb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0238009ad0 tx=0x7f023802e7d0 comp rx=0 tx=0).stop 2024-09-12T02:35:00.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.589+0000 7f024759e640 1 -- 172.21.15.60:0/1735346838 shutdown_connections 2024-09-12T02:35:00.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.589+0000 7f024759e640 1 --2- 172.21.15.60:0/1735346838 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f024814f720 0x7f024814fbb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:00.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.589+0000 7f024759e640 1 --2- 172.21.15.60:0/1735346838 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f024806eb00 0x7f024806e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:00.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.589+0000 7f024759e640 1 -- 172.21.15.60:0/1735346838 >> 172.21.15.60:0/1735346838 conn(0x7f024806d320 msgr2=0x7f024806bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:00.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.591+0000 7f024759e640 1 -- 172.21.15.60:0/1735346838 shutdown_connections 2024-09-12T02:35:00.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.591+0000 7f024759e640 1 -- 172.21.15.60:0/1735346838 wait complete. 2024-09-12T02:35:00.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.593+0000 7f024759e640 1 Processor -- start 2024-09-12T02:35:00.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.593+0000 7f024759e640 1 -- start start 2024-09-12T02:35:00.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.594+0000 7f024759e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f024806eb00 0x7f02481fbc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:00.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.594+0000 7f024759e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02480c23d0 0x7f0248153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:00.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.594+0000 7f024759e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f024814f720 0x7f024814e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:00.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.594+0000 7f024759e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f02480c3e20 con 0x7f024814f720 2024-09-12T02:35:00.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.594+0000 7f024759e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f02480c3ca0 con 0x7f02480c23d0 2024-09-12T02:35:00.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.594+0000 7f024759e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f02481523f0 con 0x7f024806eb00 2024-09-12T02:35:00.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.594+0000 7f0245d9b640 1 -- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02480c23d0 msgr2=0x7f0248153d10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3300/0 2024-09-12T02:35:00.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.595+0000 7f0245d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02480c23d0 0x7f0248153d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:35:00.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.595+0000 7f024659c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f024806eb00 0x7f02481fbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:00.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.595+0000 7f0246d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f024814f720 0x7f024814e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:00.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.595+0000 7f0246d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f024814f720 0x7f024814e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56508/0 (socket says 172.21.15.60:56508) 2024-09-12T02:35:00.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.595+0000 7f0246d9d640 1 -- 172.21.15.60:0/2916035577 learned_addr learned my addr 172.21.15.60:0/2916035577 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:35:00.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.595+0000 7f0246d9d640 1 -- 172.21.15.60:0/2916035577 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f024806eb00 msgr2=0x7f02481fbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:00.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.595+0000 7f0246d9d640 1 --2- 172.21.15.60:0/2916035577 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f024806eb00 0x7f02481fbc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:00.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.595+0000 7f0246d9d640 1 -- 172.21.15.60:0/2916035577 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02480c23d0 msgr2=0x7f0248153d10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:35:00.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.595+0000 7f0246d9d640 1 --2- 172.21.15.60:0/2916035577 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02480c23d0 0x7f0248153d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:00.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.595+0000 7f0246d9d640 1 -- 172.21.15.60:0/2916035577 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02481fc460 con 0x7f024814f720 2024-09-12T02:35:00.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.598+0000 7f0246d9d640 1 --2- 172.21.15.60:0/2916035577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f024814f720 0x7f024814e940 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0238009ad0 tx=0x7f02380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:00.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.599+0000 7f0236ffd640 1 -- 172.21.15.60:0/2916035577 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0238047070 con 0x7f024814f720 2024-09-12T02:35:00.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.599+0000 7f024759e640 1 -- 172.21.15.60:0/2916035577 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0248155930 con 0x7f024814f720 2024-09-12T02:35:00.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.599+0000 7f024759e640 1 -- 172.21.15.60:0/2916035577 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0248155650 con 0x7f024814f720 2024-09-12T02:35:00.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.600+0000 7f0236ffd640 1 -- 172.21.15.60:0/2916035577 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02380039c0 con 0x7f024814f720 2024-09-12T02:35:00.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.600+0000 7f0236ffd640 1 -- 172.21.15.60:0/2916035577 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f023803c070 con 0x7f024814f720 2024-09-12T02:35:00.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.602+0000 7f0236ffd640 1 -- 172.21.15.60:0/2916035577 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f023804a070 con 0x7f024814f720 2024-09-12T02:35:00.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.602+0000 7f0236ffd640 1 --2- 172.21.15.60:0/2916035577 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f022806be30 0x7f022806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:00.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.603+0000 7f024659c640 1 --2- 172.21.15.60:0/2916035577 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f022806be30 0x7f022806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:00.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.603+0000 7f0236ffd640 1 -- 172.21.15.60:0/2916035577 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f02380ab310 con 0x7f024814f720 2024-09-12T02:35:00.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.606+0000 7f024759e640 1 -- 172.21.15.60:0/2916035577 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f022c005290 con 0x7f024814f720 2024-09-12T02:35:00.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.607+0000 7f024659c640 1 --2- 172.21.15.60:0/2916035577 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f022806be30 0x7f022806e2f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0240009a60 tx=0x7f0240003990 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:00.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:00.617+0000 7f0236ffd640 1 -- 172.21.15.60:0/2916035577 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f02380799d0 con 0x7f024814f720 2024-09-12T02:35:01.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:01.126+0000 7f024759e640 1 -- 172.21.15.60:0/2916035577 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f022c005580 con 0x7f024814f720 2024-09-12T02:35:01.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:01.127+0000 7f0236ffd640 1 -- 172.21.15.60:0/2916035577 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1566 (secure 0 0 0) 0x7f02380792d0 con 0x7f024814f720 2024-09-12T02:35:01.128 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":118,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:35:01.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:01.131+0000 7f024759e640 1 -- 172.21.15.60:0/2916035577 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f022806be30 msgr2=0x7f022806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:01.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:01.131+0000 7f024759e640 1 --2- 172.21.15.60:0/2916035577 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f022806be30 0x7f022806e2f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0240009a60 tx=0x7f0240003990 comp rx=0 tx=0).stop 2024-09-12T02:35:01.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:01.131+0000 7f024759e640 1 -- 172.21.15.60:0/2916035577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f024814f720 msgr2=0x7f024814e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:01.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:01.131+0000 7f024759e640 1 --2- 172.21.15.60:0/2916035577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f024814f720 0x7f024814e940 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0238009ad0 tx=0x7f02380046c0 comp rx=0 tx=0).stop 2024-09-12T02:35:01.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:01.132+0000 7f024759e640 1 -- 172.21.15.60:0/2916035577 shutdown_connections 2024-09-12T02:35:01.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:01.132+0000 7f024759e640 1 --2- 172.21.15.60:0/2916035577 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f022806be30 0x7f022806e2f0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:01.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:01.132+0000 7f024759e640 1 --2- 172.21.15.60:0/2916035577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f024814f720 0x7f024814e940 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:01.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:01.132+0000 7f024759e640 1 --2- 172.21.15.60:0/2916035577 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02480c23d0 0x7f0248153d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:01.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:01.132+0000 7f024759e640 1 --2- 172.21.15.60:0/2916035577 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f024806eb00 0x7f02481fbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:01.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:01.132+0000 7f024759e640 1 -- 172.21.15.60:0/2916035577 >> 172.21.15.60:0/2916035577 conn(0x7f024806d320 msgr2=0x7f02480c43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:01.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:01.132+0000 7f024759e640 1 -- 172.21.15.60:0/2916035577 shutdown_connections 2024-09-12T02:35:01.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:01.133+0000 7f024759e640 1 -- 172.21.15.60:0/2916035577 wait complete. 2024-09-12T02:35:04.156 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:35:04.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:04.333+0000 7f32e4a2d640 1 Processor -- start 2024-09-12T02:35:04.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:04.334+0000 7f32e4a2d640 1 -- start start 2024-09-12T02:35:04.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:04.336+0000 7f32e4a2d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32e014f990 0x7f32e01522f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:04.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:04.336+0000 7f32e4a2d640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32e014fd70 con 0x7f32e00c44f0 2024-09-12T02:35:04.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:04.336+0000 7f32e4a2d640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32e0152b90 con 0x7f32e00c2340 2024-09-12T02:35:04.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:04.336+0000 7f32e4a2d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f32e00c8850 con 0x7f32e014f990 2024-09-12T02:35:04.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:04.336+0000 7f32de59c640 1 -- >> v1:172.21.15.105:6789/0 conn(0x7f32e00c2340 legacy=0x7f32e006e800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.105:6789/0 2024-09-12T02:35:04.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:04.336+0000 7f32df59e640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f32e00c44f0 0x7f32e00c4980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:56040/0 (socket says 172.21.15.60:56040) 2024-09-12T02:35:04.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:04.336+0000 7f32df59e640 1 -- 172.21.15.60:0/1377594882 learned_addr learned my addr 172.21.15.60:0/1377594882 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:35:04.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:04.337+0000 7f32ded9d640 1 --2- 172.21.15.60:0/1377594882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32e014f990 0x7f32e01522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:04.337+0000 7f32ded9d640 1 -- 172.21.15.60:0/1377594882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32e014f990 msgr2=0x7f32e01522f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:35:04.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:04.337+0000 7f32ded9d640 1 -- 172.21.15.60:0/1377594882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32e014f990 msgr2=0x7f32e01522f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:35:04.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:04.337+0000 7f32ded9d640 1 --2- 172.21.15.60:0/1377594882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32e014f990 0x7f32e01522f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:35:04.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:04.337+0000 7f32ded9d640 1 --2- 172.21.15.60:0/1377594882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32e014f990 0x7f32e01522f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:35:04.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:04.537+0000 7f32de59c640 1 -- 172.21.15.60:0/1377594882 >> v1:172.21.15.105:6789/0 conn(0x7f32e00c2340 legacy=0x7f32e006e800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.105:6789/0 2024-09-12T02:35:04.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:04.538+0000 7f32ded9d640 1 --2- 172.21.15.60:0/1377594882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32e014f990 0x7f32e01522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:04.538+0000 7f32ded9d640 1 -- 172.21.15.60:0/1377594882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32e014f990 msgr2=0x7f32e01522f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:35:04.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:04.538+0000 7f32ded9d640 1 -- 172.21.15.60:0/1377594882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32e014f990 msgr2=0x7f32e01522f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:35:04.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:04.538+0000 7f32ded9d640 1 --2- 172.21.15.60:0/1377594882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32e014f990 0x7f32e01522f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:35:04.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:04.538+0000 7f32ded9d640 1 --2- 172.21.15.60:0/1377594882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32e014f990 0x7f32e01522f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:35:04.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:04.938+0000 7f32de59c640 1 -- 172.21.15.60:0/1377594882 >> v1:172.21.15.105:6789/0 conn(0x7f32e00c2340 legacy=0x7f32e006e800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.105:6789/0 2024-09-12T02:35:04.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:04.939+0000 7f32ded9d640 1 --2- 172.21.15.60:0/1377594882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32e014f990 0x7f32e01522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:04.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:04.939+0000 7f32ded9d640 1 -- 172.21.15.60:0/1377594882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32e014f990 msgr2=0x7f32e01522f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:35:04.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:04.939+0000 7f32ded9d640 1 -- 172.21.15.60:0/1377594882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32e014f990 msgr2=0x7f32e01522f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:35:04.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:04.939+0000 7f32ded9d640 1 --2- 172.21.15.60:0/1377594882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32e014f990 0x7f32e01522f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:35:04.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:04.939+0000 7f32ded9d640 1 --2- 172.21.15.60:0/1377594882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32e014f990 0x7f32e01522f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:35:05.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:05.739+0000 7f32de59c640 1 -- 172.21.15.60:0/1377594882 >> v1:172.21.15.105:6789/0 conn(0x7f32e00c2340 legacy=0x7f32e006e800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.105:6789/0 2024-09-12T02:35:05.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:05.741+0000 7f32ded9d640 1 --2- 172.21.15.60:0/1377594882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32e014f990 0x7f32e01522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:05.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:05.741+0000 7f32ded9d640 1 -- 172.21.15.60:0/1377594882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32e014f990 msgr2=0x7f32e01522f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:35:05.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:05.741+0000 7f32ded9d640 1 -- 172.21.15.60:0/1377594882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32e014f990 msgr2=0x7f32e01522f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:35:05.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:05.741+0000 7f32ded9d640 1 --2- 172.21.15.60:0/1377594882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32e014f990 0x7f32e01522f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:35:05.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:05.741+0000 7f32ded9d640 1 --2- 172.21.15.60:0/1377594882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32e014f990 0x7f32e01522f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:35:07.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.014+0000 7f32ddd9b640 1 -- 172.21.15.60:0/1377594882 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 723035245 0 0) 0x7f32d0001110 con 0x7f32e00c44f0 2024-09-12T02:35:07.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.015+0000 7f32ddd9b640 1 -- 172.21.15.60:0/1377594882 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32c8003520 con 0x7f32e00c44f0 2024-09-12T02:35:07.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.019+0000 7f32ddd9b640 1 -- 172.21.15.60:0/1377594882 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2453669003 0 0) 0x7f32c8003520 con 0x7f32e00c44f0 2024-09-12T02:35:07.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.019+0000 7f32ddd9b640 1 -- 172.21.15.60:0/1377594882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32e014f990 msgr2=0x7f32e01522f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:35:07.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.019+0000 7f32ddd9b640 1 --2- 172.21.15.60:0/1377594882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32e014f990 0x7f32e01522f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.019+0000 7f32ddd9b640 1 -- 172.21.15.60:0/1377594882 >> v1:172.21.15.105:6789/0 conn(0x7f32e00c2340 legacy=0x7f32e006e800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:35:07.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.019+0000 7f32ddd9b640 1 -- 172.21.15.60:0/1377594882 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32e0152e70 con 0x7f32e00c44f0 2024-09-12T02:35:07.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.019+0000 7f32ddd9b640 1 -- 172.21.15.60:0/1377594882 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7f32d0001820 con 0x7f32e00c44f0 2024-09-12T02:35:07.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.019+0000 7f32ddd9b640 1 -- 172.21.15.60:0/1377594882 >> v1:172.21.15.60:6789/0 conn(0x7f32e00c44f0 legacy=0x7f32e00c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:07.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.020+0000 7f32ddd9b640 1 --2- 172.21.15.60:0/1377594882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32e014f990 0x7f32c80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.020+0000 7f32ddd9b640 1 --2- 172.21.15.60:0/1377594882 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32c8003ff0 0x7f32c8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.020+0000 7f32de59c640 1 -- 172.21.15.60:0/1377594882 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32c8003ff0 msgr2=0x7f32c8004800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3300/0 2024-09-12T02:35:07.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.020+0000 7f32de59c640 1 --2- 172.21.15.60:0/1377594882 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32c8003ff0 0x7f32c8004800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:35:07.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.020+0000 7f32ded9d640 1 --2- 172.21.15.60:0/1377594882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32e014f990 0x7f32c80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:07.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.020+0000 7f32ddd9b640 1 --2- 172.21.15.60:0/1377594882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32c8004d40 0x7f32c80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.020+0000 7f32ddd9b640 1 -- 172.21.15.60:0/1377594882 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f32e00c8850 con 0x7f32c8004d40 2024-09-12T02:35:07.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.020+0000 7f32ddd9b640 1 -- 172.21.15.60:0/1377594882 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f32c800baa0 con 0x7f32c8003ff0 2024-09-12T02:35:07.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.020+0000 7f32ddd9b640 1 -- 172.21.15.60:0/1377594882 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f32c800bca0 con 0x7f32e014f990 2024-09-12T02:35:07.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.021+0000 7f32df59e640 1 --2- 172.21.15.60:0/1377594882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32c8004d40 0x7f32c80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:07.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.021+0000 7f32ded9d640 1 -- 172.21.15.60:0/1377594882 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32c8003ff0 msgr2=0x7f32c8004800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:35:07.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.021+0000 7f32ded9d640 1 --2- 172.21.15.60:0/1377594882 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32c8003ff0 0x7f32c8004800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.021+0000 7f32ded9d640 1 -- 172.21.15.60:0/1377594882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32c8004d40 msgr2=0x7f32c80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:07.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.021+0000 7f32ded9d640 1 --2- 172.21.15.60:0/1377594882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32c8004d40 0x7f32c80051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.021+0000 7f32ded9d640 1 -- 172.21.15.60:0/1377594882 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32c8003520 con 0x7f32e014f990 2024-09-12T02:35:07.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.022+0000 7f32ded9d640 1 --2- 172.21.15.60:0/1377594882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32e014f990 0x7f32c80039e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f32d4011b90 tx=0x7f32c8005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70984d0cfb75a87f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:07.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.023+0000 7f32ddd9b640 1 -- 172.21.15.60:0/1377594882 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d4031070 con 0x7f32e014f990 2024-09-12T02:35:07.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.023+0000 7f32ddd9b640 1 -- 172.21.15.60:0/1377594882 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32d402b7e0 con 0x7f32e014f990 2024-09-12T02:35:07.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.024+0000 7f32e4a2d640 1 -- 172.21.15.60:0/1377594882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32e014f990 msgr2=0x7f32c80039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:07.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.024+0000 7f32e4a2d640 1 --2- 172.21.15.60:0/1377594882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32e014f990 0x7f32c80039e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f32d4011b90 tx=0x7f32c8005830 comp rx=0 tx=0).stop 2024-09-12T02:35:07.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.024+0000 7f32df59e640 1 -- 172.21.15.60:0/1377594882 reap_dead start 2024-09-12T02:35:07.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.024+0000 7f32e4a2d640 1 -- 172.21.15.60:0/1377594882 shutdown_connections 2024-09-12T02:35:07.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.024+0000 7f32e4a2d640 1 -- 172.21.15.60:0/1377594882 >> 172.21.15.60:0/1377594882 conn(0x7f32e006bbe0 msgr2=0x7f32e006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:07.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.025+0000 7f32e4a2d640 1 -- 172.21.15.60:0/1377594882 shutdown_connections 2024-09-12T02:35:07.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.025+0000 7f32e4a2d640 1 -- 172.21.15.60:0/1377594882 wait complete. 2024-09-12T02:35:07.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.027+0000 7f32e4a2d640 1 Processor -- start 2024-09-12T02:35:07.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.032+0000 7f32e4a2d640 1 -- start start 2024-09-12T02:35:07.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.033+0000 7f32e4a2d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32e014f990 0x7f32e01f5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.034+0000 7f32ded9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32e014f990 0x7f32e01f5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:07.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.034+0000 7f32ded9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32e014f990 0x7f32e01f5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56532/0 (socket says 172.21.15.60:56532) 2024-09-12T02:35:07.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.034+0000 7f32e4a2d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32e006dad0 0x7f32e0155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.034+0000 7f32ded9d640 1 -- 172.21.15.60:0/2435690662 learned_addr learned my addr 172.21.15.60:0/2435690662 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:35:07.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.034+0000 7f32de59c640 1 -- 172.21.15.60:0/2435690662 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32e006dad0 msgr2=0x7f32e0155620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3300/0 2024-09-12T02:35:07.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.034+0000 7f32de59c640 1 --2- 172.21.15.60:0/2435690662 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32e006dad0 0x7f32e0155620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:35:07.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.034+0000 7f32e4a2d640 1 --2- 172.21.15.60:0/2435690662 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32e0155b60 0x7f32e0071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.035+0000 7f32e4a2d640 1 -- 172.21.15.60:0/2435690662 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f32e00c3c80 con 0x7f32e014f990 2024-09-12T02:35:07.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.035+0000 7f32e4a2d640 1 -- 172.21.15.60:0/2435690662 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f32e00c3fd0 con 0x7f32e006dad0 2024-09-12T02:35:07.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.035+0000 7f32df59e640 1 --2- 172.21.15.60:0/2435690662 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32e0155b60 0x7f32e0071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:07.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.035+0000 7f32e4a2d640 1 -- 172.21.15.60:0/2435690662 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f32e006ef10 con 0x7f32e0155b60 2024-09-12T02:35:07.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.036+0000 7f32ded9d640 1 -- 172.21.15.60:0/2435690662 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32e0155b60 msgr2=0x7f32e0071040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:07.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.036+0000 7f32ded9d640 1 --2- 172.21.15.60:0/2435690662 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32e0155b60 0x7f32e0071040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.036+0000 7f32ded9d640 1 -- 172.21.15.60:0/2435690662 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32e006dad0 msgr2=0x7f32e0155620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:35:07.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.036+0000 7f32ded9d640 1 --2- 172.21.15.60:0/2435690662 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32e006dad0 0x7f32e0155620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.036+0000 7f32ded9d640 1 -- 172.21.15.60:0/2435690662 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32e0074560 con 0x7f32e014f990 2024-09-12T02:35:07.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.037+0000 7f32ded9d640 1 --2- 172.21.15.60:0/2435690662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32e014f990 0x7f32e01f5a10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f32d402b4d0 tx=0x7f32d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:07.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.037+0000 7f32c77fe640 1 -- 172.21.15.60:0/2435690662 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d4041070 con 0x7f32e014f990 2024-09-12T02:35:07.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.037+0000 7f32c77fe640 1 -- 172.21.15.60:0/2435690662 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32d4035a40 con 0x7f32e014f990 2024-09-12T02:35:07.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.037+0000 7f32e4a2d640 1 -- 172.21.15.60:0/2435690662 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32e01f9010 con 0x7f32e014f990 2024-09-12T02:35:07.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.037+0000 7f32c77fe640 1 -- 172.21.15.60:0/2435690662 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d4035e10 con 0x7f32e014f990 2024-09-12T02:35:07.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.039+0000 7f32e4a2d640 1 -- 172.21.15.60:0/2435690662 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32e01566e0 con 0x7f32e014f990 2024-09-12T02:35:07.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.040+0000 7f32c77fe640 1 -- 172.21.15.60:0/2435690662 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f32d4044070 con 0x7f32e014f990 2024-09-12T02:35:07.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.041+0000 7f32c77fe640 1 --2- 172.21.15.60:0/2435690662 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f32cc06be60 0x7f32cc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.042+0000 7f32e4a2d640 1 -- 172.21.15.60:0/2435690662 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32e006c7a0 con 0x7f32e014f990 2024-09-12T02:35:07.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.043+0000 7f32de59c640 1 --2- 172.21.15.60:0/2435690662 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f32cc06be60 0x7f32cc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:07.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.044+0000 7f32de59c640 1 --2- 172.21.15.60:0/2435690662 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f32cc06be60 0x7f32cc06e320 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f32e014e850 tx=0x7f32d8007210 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:07.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.044+0000 7f32c77fe640 1 -- 172.21.15.60:0/2435690662 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f32d40aae70 con 0x7f32e014f990 2024-09-12T02:35:07.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.053+0000 7f32c77fe640 1 -- 172.21.15.60:0/2435690662 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f32d40795b0 con 0x7f32e014f990 2024-09-12T02:35:07.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.546+0000 7f32e4a2d640 1 -- 172.21.15.60:0/2435690662 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f32e00c5d90 con 0x7f32e014f990 2024-09-12T02:35:07.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.547+0000 7f32c77fe640 1 -- 172.21.15.60:0/2435690662 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1559 (secure 0 0 0) 0x7f32d407d8b0 con 0x7f32e014f990 2024-09-12T02:35:07.548 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":122,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:35:07.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.551+0000 7f32e4a2d640 1 -- 172.21.15.60:0/2435690662 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f32cc06be60 msgr2=0x7f32cc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:07.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.551+0000 7f32e4a2d640 1 --2- 172.21.15.60:0/2435690662 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f32cc06be60 0x7f32cc06e320 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f32e014e850 tx=0x7f32d8007210 comp rx=0 tx=0).stop 2024-09-12T02:35:07.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.551+0000 7f32e4a2d640 1 -- 172.21.15.60:0/2435690662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32e014f990 msgr2=0x7f32e01f5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:07.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.551+0000 7f32e4a2d640 1 --2- 172.21.15.60:0/2435690662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32e014f990 0x7f32e01f5a10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f32d402b4d0 tx=0x7f32d40046c0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.551+0000 7f32e4a2d640 1 -- 172.21.15.60:0/2435690662 shutdown_connections 2024-09-12T02:35:07.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.551+0000 7f32e4a2d640 1 --2- 172.21.15.60:0/2435690662 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f32cc06be60 0x7f32cc06e320 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.551+0000 7f32e4a2d640 1 --2- 172.21.15.60:0/2435690662 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32e0155b60 0x7f32e0071040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.551+0000 7f32e4a2d640 1 --2- 172.21.15.60:0/2435690662 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32e006dad0 0x7f32e0155620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.551+0000 7f32e4a2d640 1 --2- 172.21.15.60:0/2435690662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32e014f990 0x7f32e01f5a10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.551+0000 7f32e4a2d640 1 -- 172.21.15.60:0/2435690662 >> 172.21.15.60:0/2435690662 conn(0x7f32e006bbe0 msgr2=0x7f32e01521b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:07.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.551+0000 7f32e4a2d640 1 -- 172.21.15.60:0/2435690662 shutdown_connections 2024-09-12T02:35:07.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.551+0000 7f32e4a2d640 1 -- 172.21.15.60:0/2435690662 wait complete. 2024-09-12T02:35:07.569 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-12T02:35:07.569 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-09-12T02:35:07.569 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-12T02:35:07.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.754+0000 7f8b68082640 1 Processor -- start 2024-09-12T02:35:07.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.754+0000 7f8b68082640 1 -- start start 2024-09-12T02:35:07.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.755+0000 7f8b68082640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8b60072ec0 0x7f8b60153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.756+0000 7f8b68082640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b600c4ac0 0x7f8b60070040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.756+0000 7f8b68082640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b6006efa0 con 0x7f8b600afc60 2024-09-12T02:35:07.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.756+0000 7f8b68082640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f8b6006f280 con 0x7f8b60072ec0 2024-09-12T02:35:07.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.756+0000 7f8b68082640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8b6006f560 con 0x7f8b600c4ac0 2024-09-12T02:35:07.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.756+0000 7f8b65e1e640 1 -- >> v2:172.21.15.105:3300/0 conn(0x7f8b60072ec0 msgr2=0x7f8b60153ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3300/0 2024-09-12T02:35:07.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.756+0000 7f8b65e1e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8b60072ec0 0x7f8b60153ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:35:07.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.757+0000 7f8b6661f640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f8b600afc60 0x7f8b60151380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:56056/0 (socket says 172.21.15.60:56056) 2024-09-12T02:35:07.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.757+0000 7f8b6661f640 1 -- 172.21.15.60:0/2773093224 learned_addr learned my addr 172.21.15.60:0/2773093224 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:35:07.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.757+0000 7f8b6561d640 1 --2- 172.21.15.60:0/2773093224 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b600c4ac0 0x7f8b60070040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:07.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.758+0000 7f8b64e1c640 1 -- 172.21.15.60:0/2773093224 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1775671796 0 0) 0x7f8b6006efa0 con 0x7f8b600afc60 2024-09-12T02:35:07.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.758+0000 7f8b64e1c640 1 -- 172.21.15.60:0/2773093224 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b4c003520 con 0x7f8b600afc60 2024-09-12T02:35:07.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.758+0000 7f8b6561d640 1 -- 172.21.15.60:0/2773093224 >> v2:172.21.15.105:3300/0 conn(0x7f8b60072ec0 msgr2=0x7f8b60153ff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:35:07.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.758+0000 7f8b6561d640 1 --2- 172.21.15.60:0/2773093224 >> v2:172.21.15.105:3300/0 conn(0x7f8b60072ec0 0x7f8b60153ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.758+0000 7f8b6561d640 1 -- 172.21.15.60:0/2773093224 >> v1:172.21.15.60:6789/0 conn(0x7f8b600afc60 legacy=0x7f8b60151380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:07.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.758+0000 7f8b6561d640 1 -- 172.21.15.60:0/2773093224 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b6006f840 con 0x7f8b600c4ac0 2024-09-12T02:35:07.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.760+0000 7f8b6561d640 1 --2- 172.21.15.60:0/2773093224 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b600c4ac0 0x7f8b60070040 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8b500097a0 tx=0x7f8b5002a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ca59710442ce45f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:07.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.760+0000 7f8b64e1c640 1 -- 172.21.15.60:0/2773093224 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b50037070 con 0x7f8b600c4ac0 2024-09-12T02:35:07.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.760+0000 7f8b64e1c640 1 -- 172.21.15.60:0/2773093224 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b5002add0 con 0x7f8b600c4ac0 2024-09-12T02:35:07.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.760+0000 7f8b64e1c640 1 -- 172.21.15.60:0/2773093224 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b50037070 con 0x7f8b600c4ac0 2024-09-12T02:35:07.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.761+0000 7f8b68082640 1 -- 172.21.15.60:0/2773093224 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b600c4ac0 msgr2=0x7f8b60070040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:07.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.761+0000 7f8b68082640 1 --2- 172.21.15.60:0/2773093224 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b600c4ac0 0x7f8b60070040 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8b500097a0 tx=0x7f8b5002a080 comp rx=0 tx=0).stop 2024-09-12T02:35:07.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.762+0000 7f8b68082640 1 -- 172.21.15.60:0/2773093224 shutdown_connections 2024-09-12T02:35:07.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.762+0000 7f8b68082640 1 --2- 172.21.15.60:0/2773093224 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b600c4ac0 0x7f8b60070040 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.762+0000 7f8b68082640 1 --2- 172.21.15.60:0/2773093224 >> v2:172.21.15.105:3300/0 conn(0x7f8b60072ec0 0x7f8b60153ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.762+0000 7f8b68082640 1 -- 172.21.15.60:0/2773093224 >> 172.21.15.60:0/2773093224 conn(0x7f8b600c9d80 msgr2=0x7f8b600ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:07.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.762+0000 7f8b68082640 1 -- 172.21.15.60:0/2773093224 shutdown_connections 2024-09-12T02:35:07.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.762+0000 7f8b68082640 1 -- 172.21.15.60:0/2773093224 wait complete. 2024-09-12T02:35:07.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.764+0000 7f8b68082640 1 Processor -- start 2024-09-12T02:35:07.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.764+0000 7f8b68082640 1 -- start start 2024-09-12T02:35:07.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.765+0000 7f8b68082640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b60072ec0 0x7f8b6014fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.765+0000 7f8b68082640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b600afc60 0x7f8b6014ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.765+0000 7f8b68082640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b600c4ac0 0x7f8b601ef600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.765+0000 7f8b68082640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8b600732a0 con 0x7f8b600c4ac0 2024-09-12T02:35:07.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.765+0000 7f8b68082640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8b600c47f0 con 0x7f8b600afc60 2024-09-12T02:35:07.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.765+0000 7f8b68082640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8b60073420 con 0x7f8b60072ec0 2024-09-12T02:35:07.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.765+0000 7f8b6561d640 1 -- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b600afc60 msgr2=0x7f8b6014ff50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3300/0 2024-09-12T02:35:07.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.765+0000 7f8b6561d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b600afc60 0x7f8b6014ff50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:35:07.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.765+0000 7f8b6661f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b600c4ac0 0x7f8b601ef600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:07.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.765+0000 7f8b6661f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b600c4ac0 0x7f8b601ef600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56548/0 (socket says 172.21.15.60:56548) 2024-09-12T02:35:07.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.765+0000 7f8b6661f640 1 -- 172.21.15.60:0/3047083751 learned_addr learned my addr 172.21.15.60:0/3047083751 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:35:07.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.766+0000 7f8b6661f640 1 -- 172.21.15.60:0/3047083751 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b60072ec0 msgr2=0x7f8b6014fa10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:35:07.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.766+0000 7f8b6661f640 1 --2- 172.21.15.60:0/3047083751 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b60072ec0 0x7f8b6014fa10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.766+0000 7f8b6661f640 1 -- 172.21.15.60:0/3047083751 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b600afc60 msgr2=0x7f8b6014ff50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:35:07.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.766+0000 7f8b6661f640 1 --2- 172.21.15.60:0/3047083751 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b600afc60 0x7f8b6014ff50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.766+0000 7f8b6661f640 1 -- 172.21.15.60:0/3047083751 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b6006ebf0 con 0x7f8b600c4ac0 2024-09-12T02:35:07.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.766+0000 7f8b6661f640 1 --2- 172.21.15.60:0/3047083751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b600c4ac0 0x7f8b601ef600 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c00ca20 tx=0x7f8b5c00cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:07.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.766+0000 7f8b567fc640 1 -- 172.21.15.60:0/3047083751 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c017070 con 0x7f8b600c4ac0 2024-09-12T02:35:07.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.767+0000 7f8b68082640 1 -- 172.21.15.60:0/3047083751 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b601ec2a0 con 0x7f8b600c4ac0 2024-09-12T02:35:07.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.767+0000 7f8b68082640 1 -- 172.21.15.60:0/3047083751 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b601ec860 con 0x7f8b600c4ac0 2024-09-12T02:35:07.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.767+0000 7f8b567fc640 1 -- 172.21.15.60:0/3047083751 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b5c00abd0 con 0x7f8b600c4ac0 2024-09-12T02:35:07.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.770+0000 7f8b567fc640 1 -- 172.21.15.60:0/3047083751 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c012400 con 0x7f8b600c4ac0 2024-09-12T02:35:07.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.771+0000 7f8b567fc640 1 -- 172.21.15.60:0/3047083751 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8b5c01a070 con 0x7f8b600c4ac0 2024-09-12T02:35:07.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.771+0000 7f8b68082640 1 --2- 172.21.15.60:0/3047083751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b48002a70 0x7f8b48004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.771+0000 7f8b68082640 1 -- 172.21.15.60:0/3047083751 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8b48007ec0 con 0x7f8b48002a70 2024-09-12T02:35:07.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.772+0000 7f8b65e1e640 1 --2- 172.21.15.60:0/3047083751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b48002a70 0x7f8b48004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:07.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.773+0000 7f8b65e1e640 1 -- 172.21.15.60:0/3047083751 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8b480080c0 con 0x7f8b48002a70 2024-09-12T02:35:07.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.773+0000 7f8b65e1e640 1 --2- 172.21.15.60:0/3047083751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b48002a70 0x7f8b48004f30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8b5800b310 tx=0x7f8b5800b7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:07.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.774+0000 7f8b567fc640 1 --2- 172.21.15.60:0/3047083751 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8b4406bde0 0x7f8b4406e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.774+0000 7f8b567fc640 1 -- 172.21.15.60:0/3047083751 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f8b5c08afc0 con 0x7f8b600c4ac0 2024-09-12T02:35:07.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.774+0000 7f8b567fc640 1 -- 172.21.15.60:0/3047083751 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b58003dc0 con 0x7f8b48002a70 2024-09-12T02:35:07.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.774+0000 7f8b6561d640 1 --2- 172.21.15.60:0/3047083751 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8b4406bde0 0x7f8b4406e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:07.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.774+0000 7f8b567fc640 1 -- 172.21.15.60:0/3047083751 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f8b580050d0 con 0x7f8b48002a70 2024-09-12T02:35:07.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.775+0000 7f8b567fc640 1 -- 172.21.15.60:0/3047083751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b48002a70 msgr2=0x7f8b48004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:07.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.775+0000 7f8b567fc640 1 --2- 172.21.15.60:0/3047083751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b48002a70 0x7f8b48004f30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8b5800b310 tx=0x7f8b5800b7d0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.775+0000 7f8b567fc640 1 -- 172.21.15.60:0/3047083751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b48002a70 msgr2=0x7f8b48004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:35:07.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.775+0000 7f8b567fc640 1 --2- 172.21.15.60:0/3047083751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b48002a70 0x7f8b48004f30 secure :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8b5800b310 tx=0x7f8b5800b7d0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.775+0000 7f8b6561d640 1 --2- 172.21.15.60:0/3047083751 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8b4406bde0 0x7f8b4406e2a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8b50034000 tx=0x7f8b5002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:07.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.787+0000 7f8b68082640 1 --2- 172.21.15.60:0/3047083751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b48006f30 0x7f8b480073c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:07.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.787+0000 7f8b68082640 1 -- 172.21.15.60:0/3047083751 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8b4800a4a0 con 0x7f8b48006f30 2024-09-12T02:35:07.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.787+0000 7f8b65e1e640 1 --2- 172.21.15.60:0/3047083751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b48006f30 0x7f8b480073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:07.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.793+0000 7f8b65e1e640 1 -- 172.21.15.60:0/3047083751 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8b48007900 con 0x7f8b48006f30 2024-09-12T02:35:07.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.797+0000 7f8b65e1e640 1 --2- 172.21.15.60:0/3047083751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b48006f30 0x7f8b480073c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8b5800bd70 tx=0x7f8b580059d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:07.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.797+0000 7f8b567fc640 1 -- 172.21.15.60:0/3047083751 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5801adf0 con 0x7f8b48006f30 2024-09-12T02:35:07.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.798+0000 7f8b567fc640 1 -- 172.21.15.60:0/3047083751 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5041 (secure 0 0 0) 0x7f8b5801adf0 con 0x7f8b48006f30 2024-09-12T02:35:07.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.798+0000 7f8b567fc640 1 -- 172.21.15.60:0/3047083751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b48006f30 msgr2=0x7f8b480073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:07.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.798+0000 7f8b567fc640 1 --2- 172.21.15.60:0/3047083751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b48006f30 0x7f8b480073c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8b5800bd70 tx=0x7f8b580059d0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.798+0000 7f8b567fc640 1 -- 172.21.15.60:0/3047083751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b48006f30 msgr2=0x7f8b480073c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:35:07.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.798+0000 7f8b567fc640 1 --2- 172.21.15.60:0/3047083751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b48006f30 0x7f8b480073c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.799 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:35:07.799 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:35:07.799 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:35:07.799 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:35:07.799 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 122, 2024-09-12T02:35:07.799 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 48399, 2024-09-12T02:35:07.799 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:35:07.800 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:35:07.800 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:35:07.800 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:35:07.800 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-09-12T02:35:07.800 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:35:07.800 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:35:07.800 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:35:07.800 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:35:07.800 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:35:07.800 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:35:07.800 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:35:07.800 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:35:07.800 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:35:07.800 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:35:07.801 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:35:07.801 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:35:07.801 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:35:07.801 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:35:07.801 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:35:07.801 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:35:07.801 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:35:07.801 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:35:07.801 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:35:07.801 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:35:07.801 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:35:07.801 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:35:07.801 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:35:07.802 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:35:07.802 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:35:07.802 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:35:07.802 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:35:07.802 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:35:07.802 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:07.802 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:07.802 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:35:07.802 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:35:07.802 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:35:07.802 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:35:07.802 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:35:07.802 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:35:07.802 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:35:07.803 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:35:07.803 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:35:07.803 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:35:07.803 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:35:07.803 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:35:07.803 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:35:07.803 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:35:07.803 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:35:07.803 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:35:07.803 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:35:07.803 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:35:07.803 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:35:07.803 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:35:07.803 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:35:07.804 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:35:07.804 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:35:07.804 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:35:07.804 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:35:07.804 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:35:07.804 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:35:07.804 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:35:07.804 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:35:07.804 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:35:07.804 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:07.804 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:35:07.804 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:07.804 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:35:07.805 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:35:07.805 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:35:07.805 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:35:07.805 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:07.805 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:35:07.805 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:35:07.805 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:07.805 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:07.805 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:07.805 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:35:07.805 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:35:07.805 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:07.805 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:07.806 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:07.806 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:07.806 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:35:07.806 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:35:07.806 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:35:07.806 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:35:07.806 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:35:07.806 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:07.806 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:07.806 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:35:07.806 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:35:07.806 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:35:07.806 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:35:07.806 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:07.807 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:35:07.807 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:35:07.807 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:07.807 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:07.807 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:07.807 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:35:07.807 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:35:07.807 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:07.807 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:07.807 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:07.807 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:07.807 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:35:07.807 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:35:07.808 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:35:07.808 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:35:07.808 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:35:07.808 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:07.808 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:07.808 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:35:07.808 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:35:07.808 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:35:07.808 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:35:07.808 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:07.808 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:35:07.808 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:35:07.808 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:07.808 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:07.809 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:07.809 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:35:07.809 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:35:07.809 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:07.809 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:07.809 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:07.809 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:07.809 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:35:07.809 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:35:07.809 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:35:07.809 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:35:07.809 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:35:07.809 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:07.810 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:07.810 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:07.810 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:35:07.810 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:35:07.810 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:07.810 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:35:07.810 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:35:07.810 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:35:07.810 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:07.810 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:35:07.810 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:35:07.811 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:07.811 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:35:07.811 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:35:07.811 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:35:07.811 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:07.811 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:35:07.811 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:35:07.811 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:07.811 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:35:07.811 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:35:07.811 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-09-12T02:35:07.811 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:07.811 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:35:07.811 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:35:07.812 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:07.812 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:35:07.812 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:35:07.812 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-09-12T02:35:07.812 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:07.812 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:35:07.812 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:35:07.812 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:07.812 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:35:07.812 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:35:07.812 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:35:07.812 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:07.812 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:07.812 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:07.813 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:35:07.813 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:35:07.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.798+0000 7f8b68082640 1 -- 172.21.15.60:0/3047083751 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8b4406bde0 msgr2=0x7f8b4406e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:07.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.798+0000 7f8b68082640 1 --2- 172.21.15.60:0/3047083751 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8b4406bde0 0x7f8b4406e2a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8b50034000 tx=0x7f8b5002e000 comp rx=0 tx=0).stop 2024-09-12T02:35:07.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.798+0000 7f8b6661f640 1 -- 172.21.15.60:0/3047083751 reap_dead start 2024-09-12T02:35:07.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.798+0000 7f8b68082640 1 -- 172.21.15.60:0/3047083751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b600c4ac0 msgr2=0x7f8b601ef600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:07.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.799+0000 7f8b68082640 1 --2- 172.21.15.60:0/3047083751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b600c4ac0 0x7f8b601ef600 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c00ca20 tx=0x7f8b5c00cee0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.799+0000 7f8b68082640 1 -- 172.21.15.60:0/3047083751 shutdown_connections 2024-09-12T02:35:07.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.799+0000 7f8b68082640 1 --2- 172.21.15.60:0/3047083751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b600c4ac0 0x7f8b601ef600 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.799+0000 7f8b68082640 1 -- 172.21.15.60:0/3047083751 >> 172.21.15.60:0/3047083751 conn(0x7f8b600c9d80 msgr2=0x7f8b600c5af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:07.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.799+0000 7f8b68082640 1 -- 172.21.15.60:0/3047083751 shutdown_connections 2024-09-12T02:35:07.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:07.799+0000 7f8b68082640 1 -- 172.21.15.60:0/3047083751 wait complete. 2024-09-12T02:35:07.818 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-12T02:35:07.818 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-12T02:35:07.818 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-12T02:35:08.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.004+0000 7fc29f5f6640 1 Processor -- start 2024-09-12T02:35:08.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.004+0000 7fc29f5f6640 1 -- start start 2024-09-12T02:35:08.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.005+0000 7fc29f5f6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc298153de0 0x7fc2980ca640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:08.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.005+0000 7fc29f5f6640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc2981598c0 0x7fc298159d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:08.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.005+0000 7fc29f5f6640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2980cab80 con 0x7fc29806bbe0 2024-09-12T02:35:08.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.005+0000 7fc29f5f6640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc2980c9480 con 0x7fc2981598c0 2024-09-12T02:35:08.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.005+0000 7fc29f5f6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc2980cb620 con 0x7fc298153de0 2024-09-12T02:35:08.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.006+0000 7fc29db93640 1 -- >> v2:172.21.15.105:3300/0 conn(0x7fc2981598c0 msgr2=0x7fc298159d70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3300/0 2024-09-12T02:35:08.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.006+0000 7fc29db93640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc2981598c0 0x7fc298159d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:35:08.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.006+0000 7fc29d392640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc298153de0 0x7fc2980ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:08.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.006+0000 7fc29cb91640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fc29806bbe0 0x7fc29806c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:56058/0 (socket says 172.21.15.60:56058) 2024-09-12T02:35:08.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.006+0000 7fc29cb91640 1 -- 172.21.15.60:0/3466524183 learned_addr learned my addr 172.21.15.60:0/3466524183 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:35:08.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.007+0000 7fc28ffff640 1 -- 172.21.15.60:0/3466524183 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1990723397 0 0) 0x7fc294001110 con 0x7fc29806bbe0 2024-09-12T02:35:08.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.007+0000 7fc29d392640 1 -- 172.21.15.60:0/3466524183 >> v2:172.21.15.105:3300/0 conn(0x7fc2981598c0 msgr2=0x7fc298159d70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:35:08.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.007+0000 7fc29d392640 1 --2- 172.21.15.60:0/3466524183 >> v2:172.21.15.105:3300/0 conn(0x7fc2981598c0 0x7fc298159d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:08.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.007+0000 7fc29d392640 1 -- 172.21.15.60:0/3466524183 >> v1:172.21.15.60:6789/0 conn(0x7fc29806bbe0 legacy=0x7fc29806c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:08.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.007+0000 7fc29d392640 1 -- 172.21.15.60:0/3466524183 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2980c6b20 con 0x7fc298153de0 2024-09-12T02:35:08.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.010+0000 7fc29d392640 1 --2- 172.21.15.60:0/3466524183 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc298153de0 0x7fc2980ca640 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc2880097a0 tx=0x7fc28802a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29b49593f6bea6dc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:08.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.017+0000 7fc28ffff640 1 -- 172.21.15.60:0/3466524183 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc288037070 con 0x7fc298153de0 2024-09-12T02:35:08.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.017+0000 7fc28ffff640 1 -- 172.21.15.60:0/3466524183 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc288032440 con 0x7fc298153de0 2024-09-12T02:35:08.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.017+0000 7fc28ffff640 1 -- 172.21.15.60:0/3466524183 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc288032810 con 0x7fc298153de0 2024-09-12T02:35:08.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.018+0000 7fc29f5f6640 1 -- 172.21.15.60:0/3466524183 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc298153de0 msgr2=0x7fc2980ca640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:08.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.018+0000 7fc29f5f6640 1 --2- 172.21.15.60:0/3466524183 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc298153de0 0x7fc2980ca640 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc2880097a0 tx=0x7fc28802a1a0 comp rx=0 tx=0).stop 2024-09-12T02:35:08.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.018+0000 7fc29f5f6640 1 -- 172.21.15.60:0/3466524183 shutdown_connections 2024-09-12T02:35:08.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.018+0000 7fc29f5f6640 1 --2- 172.21.15.60:0/3466524183 >> v2:172.21.15.105:3300/0 conn(0x7fc2981598c0 0x7fc298159d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:08.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.018+0000 7fc29f5f6640 1 --2- 172.21.15.60:0/3466524183 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc298153de0 0x7fc2980ca640 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:08.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.018+0000 7fc29f5f6640 1 -- 172.21.15.60:0/3466524183 >> 172.21.15.60:0/3466524183 conn(0x7fc2980c8800 msgr2=0x7fc2980c8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:08.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.018+0000 7fc29f5f6640 1 -- 172.21.15.60:0/3466524183 shutdown_connections 2024-09-12T02:35:08.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.018+0000 7fc29f5f6640 1 -- 172.21.15.60:0/3466524183 wait complete. 2024-09-12T02:35:08.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.020+0000 7fc29f5f6640 1 Processor -- start 2024-09-12T02:35:08.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.020+0000 7fc29f5f6640 1 -- start start 2024-09-12T02:35:08.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.022+0000 7fc29f5f6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc29806bbe0 0x7fc29814e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:08.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.022+0000 7fc29f5f6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc298153de0 0x7fc2981437c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:08.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.022+0000 7fc29f5f6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2981598c0 0x7fc298143d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:08.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.022+0000 7fc29cb91640 1 -- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc298153de0 msgr2=0x7fc2981437c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3300/0 2024-09-12T02:35:08.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.022+0000 7fc29cb91640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc298153de0 0x7fc2981437c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:35:08.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.022+0000 7fc29f5f6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc2980cbab0 con 0x7fc29806bbe0 2024-09-12T02:35:08.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.023+0000 7fc29db93640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2981598c0 0x7fc298143d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:08.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.023+0000 7fc29db93640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2981598c0 0x7fc298143d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:56356/0 (socket says 172.21.15.60:56356) 2024-09-12T02:35:08.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.023+0000 7fc29db93640 1 -- 172.21.15.60:0/2416618026 learned_addr learned my addr 172.21.15.60:0/2416618026 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:35:08.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.023+0000 7fc29f5f6640 1 -- 172.21.15.60:0/2416618026 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc2980c70e0 con 0x7fc298153de0 2024-09-12T02:35:08.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.023+0000 7fc29f5f6640 1 -- 172.21.15.60:0/2416618026 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc29815a2b0 con 0x7fc2981598c0 2024-09-12T02:35:08.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.024+0000 7fc29db93640 1 -- 172.21.15.60:0/2416618026 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc298153de0 msgr2=0x7fc2981437c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:35:08.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.024+0000 7fc29d392640 1 --2- 172.21.15.60:0/2416618026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc29806bbe0 0x7fc29814e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:08.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.024+0000 7fc29db93640 1 --2- 172.21.15.60:0/2416618026 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc298153de0 0x7fc2981437c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:08.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.024+0000 7fc29db93640 1 -- 172.21.15.60:0/2416618026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc29806bbe0 msgr2=0x7fc29814e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:08.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.024+0000 7fc29db93640 1 --2- 172.21.15.60:0/2416618026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc29806bbe0 0x7fc29814e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:08.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.024+0000 7fc29db93640 1 -- 172.21.15.60:0/2416618026 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2981e0f80 con 0x7fc2981598c0 2024-09-12T02:35:08.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.025+0000 7fc29d392640 1 --2- 172.21.15.60:0/2416618026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc29806bbe0 0x7fc29814e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:08.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.027+0000 7fc29db93640 1 --2- 172.21.15.60:0/2416618026 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2981598c0 0x7fc298143d00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc29000b990 tx=0x7fc29000be50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:08.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.031+0000 7fc28dffb640 1 -- 172.21.15.60:0/2416618026 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc29000cb20 con 0x7fc2981598c0 2024-09-12T02:35:08.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.031+0000 7fc28dffb640 1 -- 172.21.15.60:0/2416618026 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc290010070 con 0x7fc2981598c0 2024-09-12T02:35:08.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.031+0000 7fc28dffb640 1 -- 172.21.15.60:0/2416618026 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc29000cb20 con 0x7fc2981598c0 2024-09-12T02:35:08.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.031+0000 7fc29f5f6640 1 -- 172.21.15.60:0/2416618026 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2981e1260 con 0x7fc2981598c0 2024-09-12T02:35:08.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.031+0000 7fc29f5f6640 1 -- 172.21.15.60:0/2416618026 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc29814e770 con 0x7fc2981598c0 2024-09-12T02:35:08.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.033+0000 7fc29f5f6640 1 --2- 172.21.15.60:0/2416618026 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2981e2340 0x7fc2981588a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:08.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.033+0000 7fc29f5f6640 1 -- 172.21.15.60:0/2416618026 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc298144240 con 0x7fc2981e2340 2024-09-12T02:35:08.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.033+0000 7fc29d392640 1 --2- 172.21.15.60:0/2416618026 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2981e2340 0x7fc2981588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:08.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.033+0000 7fc28dffb640 1 -- 172.21.15.60:0/2416618026 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc290015470 con 0x7fc2981598c0 2024-09-12T02:35:08.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.034+0000 7fc28dffb640 1 --2- 172.21.15.60:0/2416618026 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc27c06c1e0 0x7fc27c06e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:08.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.034+0000 7fc28dffb640 1 -- 172.21.15.60:0/2416618026 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fc29000c920 con 0x7fc2981598c0 2024-09-12T02:35:08.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.035+0000 7fc29d392640 1 -- 172.21.15.60:0/2416618026 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc2981eff30 con 0x7fc2981e2340 2024-09-12T02:35:08.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.035+0000 7fc29cb91640 1 --2- 172.21.15.60:0/2416618026 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc27c06c1e0 0x7fc27c06e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:08.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.036+0000 7fc29cb91640 1 --2- 172.21.15.60:0/2416618026 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc27c06c1e0 0x7fc27c06e6a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc2940012b0 tx=0x7fc294007810 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:08.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.039+0000 7fc29d392640 1 --2- 172.21.15.60:0/2416618026 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2981e2340 0x7fc2981588a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc29806de50 tx=0x7fc2880046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:08.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.041+0000 7fc28dffb640 1 -- 172.21.15.60:0/2416618026 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc288042070 con 0x7fc2981e2340 2024-09-12T02:35:08.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.043+0000 7fc28dffb640 1 -- 172.21.15.60:0/2416618026 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc28803d640 con 0x7fc2981e2340 2024-09-12T02:35:08.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.043+0000 7fc28dffb640 1 -- 172.21.15.60:0/2416618026 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2981e2340 msgr2=0x7fc2981588a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:08.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.043+0000 7fc28dffb640 1 --2- 172.21.15.60:0/2416618026 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2981e2340 0x7fc2981588a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc29806de50 tx=0x7fc2880046c0 comp rx=0 tx=0).stop 2024-09-12T02:35:08.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.043+0000 7fc28dffb640 1 -- 172.21.15.60:0/2416618026 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2981e2340 msgr2=0x7fc2981588a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:35:08.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.043+0000 7fc28dffb640 1 --2- 172.21.15.60:0/2416618026 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2981e2340 0x7fc2981588a0 secure :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc29806de50 tx=0x7fc2880046c0 comp rx=0 tx=0).stop 2024-09-12T02:35:08.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.061+0000 7fc29f5f6640 1 --2- 172.21.15.60:0/2416618026 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2981ef9e0 0x7fc298158de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:08.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.061+0000 7fc29f5f6640 1 -- 172.21.15.60:0/2416618026 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc298158430 con 0x7fc2981ef9e0 2024-09-12T02:35:08.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.062+0000 7fc29d392640 1 --2- 172.21.15.60:0/2416618026 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2981ef9e0 0x7fc298158de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:08.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.062+0000 7fc29d392640 1 -- 172.21.15.60:0/2416618026 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc2980ca640 con 0x7fc2981ef9e0 2024-09-12T02:35:08.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.063+0000 7fc29d392640 1 --2- 172.21.15.60:0/2416618026 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2981ef9e0 0x7fc298158de0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc28802a1e0 tx=0x7fc288009190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:08.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.063+0000 7fc28dffb640 1 -- 172.21.15.60:0/2416618026 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc288055020 con 0x7fc2981ef9e0 2024-09-12T02:35:08.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.064+0000 7fc28dffb640 1 -- 172.21.15.60:0/2416618026 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4873 (secure 0 0 0) 0x7fc28803c3e0 con 0x7fc2981ef9e0 2024-09-12T02:35:08.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.064+0000 7fc28dffb640 1 -- 172.21.15.60:0/2416618026 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2981ef9e0 msgr2=0x7fc298158de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:08.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.064+0000 7fc28dffb640 1 --2- 172.21.15.60:0/2416618026 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2981ef9e0 0x7fc298158de0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc28802a1e0 tx=0x7fc288009190 comp rx=0 tx=0).stop 2024-09-12T02:35:08.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.064+0000 7fc28dffb640 1 -- 172.21.15.60:0/2416618026 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2981ef9e0 msgr2=0x7fc298158de0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:35:08.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.064+0000 7fc28dffb640 1 --2- 172.21.15.60:0/2416618026 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2981ef9e0 0x7fc298158de0 secure :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc28802a1e0 tx=0x7fc288009190 comp rx=0 tx=0).stop 2024-09-12T02:35:08.065 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:35:08.065 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:35:08.065 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:35:08.065 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:35:08.065 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 122, 2024-09-12T02:35:08.065 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 181818, 2024-09-12T02:35:08.065 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:35:08.065 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:35:08.065 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:35:08.065 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:35:08.066 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 1, 2024-09-12T02:35:08.066 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:35:08.066 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:35:08.066 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:35:08.066 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:35:08.066 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:35:08.066 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:35:08.066 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:35:08.066 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:35:08.066 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:35:08.066 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:35:08.066 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:35:08.066 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:35:08.067 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:35:08.067 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:35:08.067 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:35:08.067 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:35:08.067 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:35:08.067 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:35:08.067 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:35:08.067 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:35:08.067 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:35:08.067 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:35:08.067 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:35:08.067 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:35:08.067 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:35:08.067 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:35:08.068 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:35:08.068 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:35:08.068 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:08.068 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:08.068 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:35:08.068 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:35:08.068 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:35:08.068 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:35:08.068 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:35:08.068 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:35:08.068 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:35:08.068 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:35:08.068 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:35:08.069 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:35:08.069 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:35:08.069 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:35:08.069 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:35:08.069 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:35:08.069 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:35:08.069 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:35:08.069 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:35:08.069 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:35:08.069 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:35:08.069 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:35:08.069 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:35:08.069 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:35:08.070 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:35:08.070 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:35:08.070 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:35:08.070 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:35:08.070 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:35:08.070 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:35:08.070 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:35:08.070 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:35:08.070 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:08.070 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:35:08.070 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:08.070 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:35:08.070 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:35:08.071 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:35:08.071 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:35:08.071 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:08.071 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:35:08.071 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:35:08.071 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:08.071 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:08.071 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:08.071 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:35:08.071 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:35:08.071 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:08.071 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:08.071 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:08.071 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:08.072 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:35:08.072 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:35:08.072 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:35:08.072 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:35:08.072 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:35:08.072 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:08.072 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:08.073 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:35:08.073 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:35:08.073 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:35:08.073 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:35:08.073 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:08.073 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:35:08.073 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:35:08.073 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:08.073 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:08.073 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:08.073 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:35:08.073 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:35:08.073 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:08.074 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:08.074 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:08.074 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:08.074 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:35:08.074 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:35:08.074 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:35:08.074 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:35:08.074 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:35:08.074 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:08.074 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:08.074 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:35:08.074 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:35:08.074 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:35:08.074 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:35:08.075 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:08.075 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:35:08.075 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:35:08.075 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:08.075 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:08.075 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:08.075 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:35:08.075 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:35:08.075 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:08.075 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:08.075 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:08.075 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:08.075 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:35:08.076 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:35:08.076 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:35:08.076 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:35:08.076 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:35:08.076 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:08.076 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:08.076 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:08.076 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:35:08.076 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:35:08.076 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:08.076 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:35:08.076 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:35:08.076 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:35:08.077 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:08.077 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:35:08.077 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:35:08.077 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:08.077 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:35:08.077 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:35:08.077 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:35:08.077 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:08.077 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:35:08.077 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:35:08.078 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:08.078 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:35:08.078 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:35:08.078 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:35:08.078 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:08.078 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:35:08.078 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:35:08.078 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:08.078 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:35:08.078 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:35:08.078 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-09-12T02:35:08.078 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:08.078 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:08.079 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:08.079 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:35:08.079 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:35:08.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.066+0000 7fc29f5f6640 1 -- 172.21.15.60:0/2416618026 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc27c06c1e0 msgr2=0x7fc27c06e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:08.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.066+0000 7fc29f5f6640 1 --2- 172.21.15.60:0/2416618026 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc27c06c1e0 0x7fc27c06e6a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc2940012b0 tx=0x7fc294007810 comp rx=0 tx=0).stop 2024-09-12T02:35:08.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.066+0000 7fc29db93640 1 -- 172.21.15.60:0/2416618026 reap_dead start 2024-09-12T02:35:08.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.066+0000 7fc29f5f6640 1 -- 172.21.15.60:0/2416618026 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2981598c0 msgr2=0x7fc298143d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:08.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.066+0000 7fc29f5f6640 1 --2- 172.21.15.60:0/2416618026 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2981598c0 0x7fc298143d00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc29000b990 tx=0x7fc29000be50 comp rx=0 tx=0).stop 2024-09-12T02:35:08.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.067+0000 7fc29f5f6640 1 -- 172.21.15.60:0/2416618026 shutdown_connections 2024-09-12T02:35:08.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.067+0000 7fc29f5f6640 1 --2- 172.21.15.60:0/2416618026 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2981598c0 0x7fc298143d00 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:08.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.067+0000 7fc29f5f6640 1 -- 172.21.15.60:0/2416618026 >> 172.21.15.60:0/2416618026 conn(0x7fc2980c8800 msgr2=0x7fc29806c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:08.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.068+0000 7fc29f5f6640 1 -- 172.21.15.60:0/2416618026 shutdown_connections 2024-09-12T02:35:08.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:08.068+0000 7fc29f5f6640 1 -- 172.21.15.60:0/2416618026 wait complete. 2024-09-12T02:35:08.101 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-12T02:35:08.102 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-12T02:35:28.102 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-09-12T02:35:28.103 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-09-12T02:35:28.103 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T02:35:28.103 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T02:35:28.106 INFO:tasks.ceph.mon.b:Started 2024-09-12T02:35:28.106 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-12T02:35:28.107 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:35:28.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.278+0000 7f6acb623640 1 Processor -- start 2024-09-12T02:35:28.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.279+0000 7f6acb623640 1 -- start start 2024-09-12T02:35:28.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.280+0000 7f6acb623640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6ac40729c0 0x7f6ac4072e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:28.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.280+0000 7f6acb623640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6ac4073390 0x7f6ac4165030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:28.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.280+0000 7f6acb623640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ac40c63f0 con 0x7f6ac40acd50 2024-09-12T02:35:28.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.280+0000 7f6acb623640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f6ac4072270 con 0x7f6ac40729c0 2024-09-12T02:35:28.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.280+0000 7f6acb623640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f6ac4074660 con 0x7f6ac4073390 2024-09-12T02:35:28.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.280+0000 7f6ac9bc0640 1 -- >> v2:172.21.15.105:3300/0 conn(0x7f6ac4073390 msgr2=0x7f6ac4165030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3300/0 2024-09-12T02:35:28.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.280+0000 7f6ac9bc0640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6ac4073390 0x7f6ac4165030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:35:28.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.281+0000 7f6ac8bbe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6ac40729c0 0x7f6ac4072e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:28.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.281+0000 7f6ac8bbe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6ac40729c0 0x7f6ac4072e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44666/0 (socket says 172.21.15.60:44666) 2024-09-12T02:35:28.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.281+0000 7f6ac8bbe640 1 -- 172.21.15.60:0/3500994587 learned_addr learned my addr 172.21.15.60:0/3500994587 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:35:28.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.282+0000 7f6ac8bbe640 1 -- 172.21.15.60:0/3500994587 >> v2:172.21.15.105:3300/0 conn(0x7f6ac4073390 msgr2=0x7f6ac4165030 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:35:28.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.282+0000 7f6ac8bbe640 1 --2- 172.21.15.60:0/3500994587 >> v2:172.21.15.105:3300/0 conn(0x7f6ac4073390 0x7f6ac4165030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.282+0000 7f6ac8bbe640 1 -- 172.21.15.60:0/3500994587 >> v1:172.21.15.60:6789/0 conn(0x7f6ac40acd50 legacy=0x7f6ac415af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:28.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.282+0000 7f6ac8bbe640 1 -- 172.21.15.60:0/3500994587 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac415dda0 con 0x7f6ac40729c0 2024-09-12T02:35:28.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.283+0000 7f6ac8bbe640 1 --2- 172.21.15.60:0/3500994587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ac40729c0 0x7f6ac4072e50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4068600 tx=0x7f6ab802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61ab744478101415 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:28.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.284+0000 7f6ac3fff640 1 -- 172.21.15.60:0/3500994587 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab8037070 con 0x7f6ac40729c0 2024-09-12T02:35:28.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.284+0000 7f6ac3fff640 1 -- 172.21.15.60:0/3500994587 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ab8032440 con 0x7f6ac40729c0 2024-09-12T02:35:28.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.285+0000 7f6acb623640 1 -- 172.21.15.60:0/3500994587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ac40729c0 msgr2=0x7f6ac4072e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:28.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.285+0000 7f6ac3fff640 1 -- 172.21.15.60:0/3500994587 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab8037070 con 0x7f6ac40729c0 2024-09-12T02:35:28.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.285+0000 7f6acb623640 1 --2- 172.21.15.60:0/3500994587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ac40729c0 0x7f6ac4072e50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4068600 tx=0x7f6ab802a210 comp rx=0 tx=0).stop 2024-09-12T02:35:28.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.285+0000 7f6acb623640 1 -- 172.21.15.60:0/3500994587 shutdown_connections 2024-09-12T02:35:28.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.286+0000 7f6acb623640 1 --2- 172.21.15.60:0/3500994587 >> v2:172.21.15.105:3300/0 conn(0x7f6ac4073390 0x7f6ac4165030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.286+0000 7f6acb623640 1 --2- 172.21.15.60:0/3500994587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ac40729c0 0x7f6ac4072e50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.286+0000 7f6acb623640 1 -- 172.21.15.60:0/3500994587 >> 172.21.15.60:0/3500994587 conn(0x7f6ac40c5660 msgr2=0x7f6ac40c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:28.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.286+0000 7f6acb623640 1 -- 172.21.15.60:0/3500994587 shutdown_connections 2024-09-12T02:35:28.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.286+0000 7f6acb623640 1 -- 172.21.15.60:0/3500994587 wait complete. 2024-09-12T02:35:28.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.288+0000 7f6acb623640 1 Processor -- start 2024-09-12T02:35:28.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.289+0000 7f6acb623640 1 -- start start 2024-09-12T02:35:28.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.290+0000 7f6acb623640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ac40729c0 0x7f6ac40a5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:28.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.290+0000 7f6acb623640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ac4073390 0x7f6ac406f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:28.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.290+0000 7f6acb623640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ac40acd50 0x7f6ac41e6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:28.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.290+0000 7f6acb623640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac4071d40 con 0x7f6ac40acd50 2024-09-12T02:35:28.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.291+0000 7f6acb623640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac40748b0 con 0x7f6ac4073390 2024-09-12T02:35:28.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.291+0000 7f6acb623640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6ac40abc10 con 0x7f6ac40729c0 2024-09-12T02:35:28.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.291+0000 7f6ac9bc0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ac40acd50 0x7f6ac41e6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:28.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.291+0000 7f6ac9bc0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ac40acd50 0x7f6ac41e6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44682/0 (socket says 172.21.15.60:44682) 2024-09-12T02:35:28.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.291+0000 7f6ac9bc0640 1 -- 172.21.15.60:0/1248928536 learned_addr learned my addr 172.21.15.60:0/1248928536 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:35:28.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.291+0000 7f6ac9bc0640 1 -- 172.21.15.60:0/1248928536 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ac40729c0 msgr2=0x7f6ac40a5ca0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:35:28.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.291+0000 7f6ac9bc0640 1 --2- 172.21.15.60:0/1248928536 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ac40729c0 0x7f6ac40a5ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.291+0000 7f6ac9bc0640 1 -- 172.21.15.60:0/1248928536 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ac4073390 msgr2=0x7f6ac406f910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:35:28.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.292+0000 7f6ac8bbe640 1 -- 172.21.15.60:0/1248928536 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ac4073390 msgr2=0x7f6ac406f910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3300/0 2024-09-12T02:35:28.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.292+0000 7f6ac8bbe640 1 --2- 172.21.15.60:0/1248928536 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ac4073390 0x7f6ac406f910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:35:28.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.292+0000 7f6ac9bc0640 1 --2- 172.21.15.60:0/1248928536 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ac4073390 0x7f6ac406f910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.292+0000 7f6ac9bc0640 1 -- 172.21.15.60:0/1248928536 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac41e54a0 con 0x7f6ac40acd50 2024-09-12T02:35:28.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.292+0000 7f6ac9bc0640 1 --2- 172.21.15.60:0/1248928536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ac40acd50 0x7f6ac41e6260 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6ab400be50 tx=0x7f6ab400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:28.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.293+0000 7f6ac1ffb640 1 -- 172.21.15.60:0/1248928536 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab4016430 con 0x7f6ac40acd50 2024-09-12T02:35:28.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.293+0000 7f6acb623640 1 -- 172.21.15.60:0/1248928536 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ac41e5780 con 0x7f6ac40acd50 2024-09-12T02:35:28.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.293+0000 7f6acb623640 1 -- 172.21.15.60:0/1248928536 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ac41e5d40 con 0x7f6ac40acd50 2024-09-12T02:35:28.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.294+0000 7f6ac1ffb640 1 -- 172.21.15.60:0/1248928536 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ab4010030 con 0x7f6ac40acd50 2024-09-12T02:35:28.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.295+0000 7f6ac1ffb640 1 -- 172.21.15.60:0/1248928536 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab4016850 con 0x7f6ac40acd50 2024-09-12T02:35:28.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.296+0000 7f6acb623640 1 -- 172.21.15.60:0/1248928536 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6aa4005290 con 0x7f6ac40acd50 2024-09-12T02:35:28.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.299+0000 7f6ac1ffb640 1 -- 172.21.15.60:0/1248928536 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6ab40153e0 con 0x7f6ac40acd50 2024-09-12T02:35:28.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.299+0000 7f6ac1ffb640 1 --2- 172.21.15.60:0/1248928536 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f6ab006be60 0x7f6ab006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:28.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.299+0000 7f6ac1ffb640 1 -- 172.21.15.60:0/1248928536 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f6ab408bcc0 con 0x7f6ac40acd50 2024-09-12T02:35:28.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.300+0000 7f6ac93bf640 1 --2- 172.21.15.60:0/1248928536 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f6ab006be60 0x7f6ab006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:28.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.301+0000 7f6ac93bf640 1 --2- 172.21.15.60:0/1248928536 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f6ab006be60 0x7f6ab006e320 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6abc000f60 tx=0x7f6abc0079b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:28.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.307+0000 7f6ac1ffb640 1 -- 172.21.15.60:0/1248928536 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6ab405a340 con 0x7f6ac40acd50 2024-09-12T02:35:28.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.818+0000 7f6acb623640 1 -- 172.21.15.60:0/1248928536 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6aa4005580 con 0x7f6ac40acd50 2024-09-12T02:35:28.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.822+0000 7f6ac1ffb640 1 -- 172.21.15.60:0/1248928536 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1560 (secure 0 0 0) 0x7f6ab4059c40 con 0x7f6ac40acd50 2024-09-12T02:35:28.823 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":122,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:35:28.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.828+0000 7f6aab7fe640 1 -- 172.21.15.60:0/1248928536 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f6ab006be60 msgr2=0x7f6ab006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:28.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.828+0000 7f6aab7fe640 1 --2- 172.21.15.60:0/1248928536 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f6ab006be60 0x7f6ab006e320 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6abc000f60 tx=0x7f6abc0079b0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.828+0000 7f6aab7fe640 1 -- 172.21.15.60:0/1248928536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ac40acd50 msgr2=0x7f6ac41e6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:28.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.828+0000 7f6aab7fe640 1 --2- 172.21.15.60:0/1248928536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ac40acd50 0x7f6ac41e6260 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6ab400be50 tx=0x7f6ab400be80 comp rx=0 tx=0).stop 2024-09-12T02:35:28.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.829+0000 7f6aab7fe640 1 -- 172.21.15.60:0/1248928536 shutdown_connections 2024-09-12T02:35:28.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.829+0000 7f6aab7fe640 1 --2- 172.21.15.60:0/1248928536 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f6ab006be60 0x7f6ab006e320 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.829+0000 7f6aab7fe640 1 --2- 172.21.15.60:0/1248928536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ac40acd50 0x7f6ac41e6260 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.829+0000 7f6aab7fe640 1 --2- 172.21.15.60:0/1248928536 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ac4073390 0x7f6ac406f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.829+0000 7f6aab7fe640 1 --2- 172.21.15.60:0/1248928536 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ac40729c0 0x7f6ac40a5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.829+0000 7f6aab7fe640 1 -- 172.21.15.60:0/1248928536 >> 172.21.15.60:0/1248928536 conn(0x7f6ac40c5660 msgr2=0x7f6ac415a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:28.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.829+0000 7f6aab7fe640 1 -- 172.21.15.60:0/1248928536 shutdown_connections 2024-09-12T02:35:28.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:28.829+0000 7f6aab7fe640 1 -- 172.21.15.60:0/1248928536 wait complete. 2024-09-12T02:35:30.654 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:35:30.657 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:35:31.851 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:35:32.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.034+0000 7f24aa95b640 1 Processor -- start 2024-09-12T02:35:32.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.035+0000 7f24aa95b640 1 -- start start 2024-09-12T02:35:32.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.036+0000 7f24aa95b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f24a40c7230 0x7f24a41562d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:32.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.036+0000 7f24aa95b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24a414f820 0x7f24a414fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:32.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.036+0000 7f24aa95b640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24a40c2d60 con 0x7f24a406edd0 2024-09-12T02:35:32.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.036+0000 7f24aa95b640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f24a41532d0 con 0x7f24a40c7230 2024-09-12T02:35:32.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.036+0000 7f24aa95b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f24a40c3040 con 0x7f24a414f820 2024-09-12T02:35:32.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.037+0000 7f24a3fff640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f24a406edd0 0x7f24a4152bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:45796/0 (socket says 172.21.15.60:45796) 2024-09-12T02:35:32.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.037+0000 7f24a3fff640 1 -- 172.21.15.60:0/3552967470 learned_addr learned my addr 172.21.15.60:0/3552967470 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:35:32.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.038+0000 7f24a37fe640 1 --2- 172.21.15.60:0/3552967470 >> v2:172.21.15.60:3300/0 conn(0x7f24a40c7230 0x7f24a41562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:32.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.038+0000 7f24a37fe640 1 -- 172.21.15.60:0/3552967470 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24a414f820 msgr2=0x7f24a414fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:32.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.038+0000 7f24a8ef8640 1 --2- 172.21.15.60:0/3552967470 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24a414f820 0x7f24a414fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:32.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.039+0000 7f24a37fe640 1 --2- 172.21.15.60:0/3552967470 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24a414f820 0x7f24a414fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:32.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.039+0000 7f24a37fe640 1 -- 172.21.15.60:0/3552967470 >> v1:172.21.15.105:6789/0 conn(0x7f24a406edd0 legacy=0x7f24a4152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:32.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.039+0000 7f24a37fe640 1 -- 172.21.15.60:0/3552967470 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24a41526a0 con 0x7f24a40c7230 2024-09-12T02:35:32.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.040+0000 7f24a8ef8640 1 --2- 172.21.15.60:0/3552967470 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24a414f820 0x7f24a414fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:35:32.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.040+0000 7f24a37fe640 1 --2- 172.21.15.60:0/3552967470 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24a40c7230 0x7f24a41562d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f24940097a0 tx=0x7f249402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fd1331c5fa216ae server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:32.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.041+0000 7f24a2ffd640 1 -- 172.21.15.60:0/3552967470 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2494037070 con 0x7f24a40c7230 2024-09-12T02:35:32.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.041+0000 7f24a2ffd640 1 -- 172.21.15.60:0/3552967470 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2494032440 con 0x7f24a40c7230 2024-09-12T02:35:32.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.042+0000 7f24aa95b640 1 -- 172.21.15.60:0/3552967470 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24a40c7230 msgr2=0x7f24a41562d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:32.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.042+0000 7f24aa95b640 1 --2- 172.21.15.60:0/3552967470 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24a40c7230 0x7f24a41562d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f24940097a0 tx=0x7f249402a110 comp rx=0 tx=0).stop 2024-09-12T02:35:32.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.043+0000 7f24aa95b640 1 -- 172.21.15.60:0/3552967470 shutdown_connections 2024-09-12T02:35:32.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.043+0000 7f24aa95b640 1 --2- 172.21.15.60:0/3552967470 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24a414f820 0x7f24a414fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:32.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.043+0000 7f24aa95b640 1 --2- 172.21.15.60:0/3552967470 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24a40c7230 0x7f24a41562d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:32.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.043+0000 7f24aa95b640 1 -- 172.21.15.60:0/3552967470 >> 172.21.15.60:0/3552967470 conn(0x7f24a40c7a40 msgr2=0x7f24a40c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:32.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.046+0000 7f24aa95b640 1 -- 172.21.15.60:0/3552967470 shutdown_connections 2024-09-12T02:35:32.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.047+0000 7f24aa95b640 1 -- 172.21.15.60:0/3552967470 wait complete. 2024-09-12T02:35:32.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.049+0000 7f24aa95b640 1 Processor -- start 2024-09-12T02:35:32.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.052+0000 7f24aa95b640 1 -- start start 2024-09-12T02:35:32.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.053+0000 7f24aa95b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24a406edd0 0x7f24a41f8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:32.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.053+0000 7f24aa95b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24a40c7230 0x7f24a4144250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:32.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.053+0000 7f24aa95b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24a414f820 0x7f24a40a8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:32.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.053+0000 7f24aa95b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f24a40c41e0 con 0x7f24a40c7230 2024-09-12T02:35:32.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.053+0000 7f24aa95b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f24a4152350 con 0x7f24a414f820 2024-09-12T02:35:32.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.053+0000 7f24aa95b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f24a40c4360 con 0x7f24a406edd0 2024-09-12T02:35:32.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.055+0000 7f24a8ef8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24a414f820 0x7f24a40a8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:32.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.055+0000 7f24a37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24a40c7230 0x7f24a4144250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:32.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.055+0000 7f24a37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24a40c7230 0x7f24a4144250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43588/0 (socket says 172.21.15.60:43588) 2024-09-12T02:35:32.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.056+0000 7f24a37fe640 1 -- 172.21.15.60:0/1603664794 learned_addr learned my addr 172.21.15.60:0/1603664794 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:35:32.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.056+0000 7f24a37fe640 1 -- 172.21.15.60:0/1603664794 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24a406edd0 msgr2=0x7f24a41f8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:32.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.056+0000 7f24a37fe640 1 --2- 172.21.15.60:0/1603664794 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24a406edd0 0x7f24a41f8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:32.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.056+0000 7f24a8ef8640 1 -- 172.21.15.60:0/1603664794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24a414f820 msgr2=0x7f24a40a8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-12T02:35:32.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.057+0000 7f24a8ef8640 1 -- 172.21.15.60:0/1603664794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24a414f820 msgr2=0x7f24a40a8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:35:32.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.057+0000 7f24a8ef8640 1 --2- 172.21.15.60:0/1603664794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24a414f820 0x7f24a40a8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:35:32.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.057+0000 7f24a8ef8640 1 --2- 172.21.15.60:0/1603664794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24a414f820 0x7f24a40a8e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:35:32.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.057+0000 7f24a37fe640 1 -- 172.21.15.60:0/1603664794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24a414f820 msgr2=0x7f24a40a8e20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:35:32.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.057+0000 7f24a37fe640 1 --2- 172.21.15.60:0/1603664794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24a414f820 0x7f24a40a8e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:32.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.057+0000 7f24a37fe640 1 -- 172.21.15.60:0/1603664794 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24a4074870 con 0x7f24a40c7230 2024-09-12T02:35:32.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.057+0000 7f24a37fe640 1 --2- 172.21.15.60:0/1603664794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24a40c7230 0x7f24a4144250 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f249402a700 tx=0x7f24940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:32.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.058+0000 7f24a0ff9640 1 -- 172.21.15.60:0/1603664794 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2494042020 con 0x7f24a40c7230 2024-09-12T02:35:32.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.058+0000 7f24aa95b640 1 -- 172.21.15.60:0/1603664794 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24a40a9ec0 con 0x7f24a40c7230 2024-09-12T02:35:32.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.058+0000 7f24aa95b640 1 -- 172.21.15.60:0/1603664794 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24a40aa480 con 0x7f24a40c7230 2024-09-12T02:35:32.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.058+0000 7f24a0ff9640 1 -- 172.21.15.60:0/1603664794 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2494030c30 con 0x7f24a40c7230 2024-09-12T02:35:32.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.061+0000 7f24a0ff9640 1 -- 172.21.15.60:0/1603664794 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2494037040 con 0x7f24a40c7230 2024-09-12T02:35:32.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.061+0000 7f24aa95b640 1 -- 172.21.15.60:0/1603664794 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24a40c47f0 con 0x7f24a40c7230 2024-09-12T02:35:32.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.062+0000 7f24a0ff9640 1 -- 172.21.15.60:0/1603664794 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2494045020 con 0x7f24a40c7230 2024-09-12T02:35:32.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.063+0000 7f24a0ff9640 1 --2- 172.21.15.60:0/1603664794 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f249006bf30 0x7f249006e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:32.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.063+0000 7f24a0ff9640 1 -- 172.21.15.60:0/1603664794 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f24940abd40 con 0x7f24a40c7230 2024-09-12T02:35:32.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.064+0000 7f24a3fff640 1 --2- 172.21.15.60:0/1603664794 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f249006bf30 0x7f249006e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:32.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.066+0000 7f24a3fff640 1 --2- 172.21.15.60:0/1603664794 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f249006bf30 0x7f249006e3f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f249c002070 tx=0x7f249c001660 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:32.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.073+0000 7f24a0ff9640 1 -- 172.21.15.60:0/1603664794 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f249407a4e0 con 0x7f24a40c7230 2024-09-12T02:35:32.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.578+0000 7f24aa95b640 1 -- 172.21.15.60:0/1603664794 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f24a40764a0 con 0x7f24a40c7230 2024-09-12T02:35:32.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.579+0000 7f24a0ff9640 1 -- 172.21.15.60:0/1603664794 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1560 (secure 0 0 0) 0x7f2494079de0 con 0x7f24a40c7230 2024-09-12T02:35:32.580 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":122,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":25,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:35:32.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.582+0000 7f24aa95b640 1 -- 172.21.15.60:0/1603664794 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f249006bf30 msgr2=0x7f249006e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:32.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.582+0000 7f24aa95b640 1 --2- 172.21.15.60:0/1603664794 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f249006bf30 0x7f249006e3f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f249c002070 tx=0x7f249c001660 comp rx=0 tx=0).stop 2024-09-12T02:35:32.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.583+0000 7f24aa95b640 1 -- 172.21.15.60:0/1603664794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24a40c7230 msgr2=0x7f24a4144250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:32.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.583+0000 7f24aa95b640 1 --2- 172.21.15.60:0/1603664794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24a40c7230 0x7f24a4144250 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f249402a700 tx=0x7f24940046c0 comp rx=0 tx=0).stop 2024-09-12T02:35:32.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.583+0000 7f24aa95b640 1 -- 172.21.15.60:0/1603664794 shutdown_connections 2024-09-12T02:35:32.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.583+0000 7f24aa95b640 1 --2- 172.21.15.60:0/1603664794 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f249006bf30 0x7f249006e3f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:32.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.583+0000 7f24aa95b640 1 --2- 172.21.15.60:0/1603664794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24a414f820 0x7f24a40a8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:32.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.583+0000 7f24aa95b640 1 --2- 172.21.15.60:0/1603664794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24a40c7230 0x7f24a4144250 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:32.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.583+0000 7f24aa95b640 1 --2- 172.21.15.60:0/1603664794 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24a406edd0 0x7f24a41f8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:32.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.583+0000 7f24aa95b640 1 -- 172.21.15.60:0/1603664794 >> 172.21.15.60:0/1603664794 conn(0x7f24a40c7a40 msgr2=0x7f24a40ab870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:32.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.583+0000 7f24aa95b640 1 -- 172.21.15.60:0/1603664794 shutdown_connections 2024-09-12T02:35:32.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:32.584+0000 7f24aa95b640 1 -- 172.21.15.60:0/1603664794 wait complete. 2024-09-12T02:35:35.605 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:35:35.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.781+0000 7f5ed0846640 1 Processor -- start 2024-09-12T02:35:35.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.781+0000 7f5ed0846640 1 -- start start 2024-09-12T02:35:35.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.783+0000 7f5ed0846640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f5ecc06d060 0x7f5ecc156160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:35.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.783+0000 7f5ed0846640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ecc159750 con 0x7f5ecc06c160 2024-09-12T02:35:35.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.783+0000 7f5ed0846640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ecc159a30 con 0x7f5ecc1538e0 2024-09-12T02:35:35.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.783+0000 7f5ed0846640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f5ecc159d10 con 0x7f5ecc06d060 2024-09-12T02:35:35.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.783+0000 7f5ecad9d640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f5ecc1538e0 0x7f5ecc0c8430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:45812/0 (socket says 172.21.15.60:45812) 2024-09-12T02:35:35.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.783+0000 7f5ecad9d640 1 -- 172.21.15.60:0/3420292691 learned_addr learned my addr 172.21.15.60:0/3420292691 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:35:35.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.783+0000 7f5ecb59e640 1 --2- 172.21.15.60:0/3420292691 >> v2:172.21.15.105:3300/0 conn(0x7f5ecc06d060 0x7f5ecc156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:35.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.783+0000 7f5ecb59e640 1 -- 172.21.15.60:0/3420292691 >> v1:172.21.15.105:6789/0 conn(0x7f5ecc1538e0 legacy=0x7f5ecc0c8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:35.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.783+0000 7f5ecb59e640 1 -- 172.21.15.60:0/3420292691 >> v1:172.21.15.60:6789/0 conn(0x7f5ecc06c160 legacy=0x7f5ecc0c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:35.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.783+0000 7f5ecb59e640 1 -- 172.21.15.60:0/3420292691 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ecc159ff0 con 0x7f5ecc06d060 2024-09-12T02:35:35.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.786+0000 7f5ecb59e640 1 --2- 172.21.15.60:0/3420292691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ecc06d060 0x7f5ecc156160 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5eb40097a0 tx=0x7f5eb402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5b5385e223d1c56 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:35.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.786+0000 7f5ec9d9b640 1 -- 172.21.15.60:0/3420292691 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb4037070 con 0x7f5ecc06d060 2024-09-12T02:35:35.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.787+0000 7f5ec9d9b640 1 -- 172.21.15.60:0/3420292691 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5eb4032440 con 0x7f5ecc06d060 2024-09-12T02:35:35.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.787+0000 7f5ec9d9b640 1 -- 172.21.15.60:0/3420292691 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb4032810 con 0x7f5ecc06d060 2024-09-12T02:35:35.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.788+0000 7f5ed0846640 1 -- 172.21.15.60:0/3420292691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ecc06d060 msgr2=0x7f5ecc156160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:35.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.788+0000 7f5ed0846640 1 --2- 172.21.15.60:0/3420292691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ecc06d060 0x7f5ecc156160 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5eb40097a0 tx=0x7f5eb402a1a0 comp rx=0 tx=0).stop 2024-09-12T02:35:35.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.788+0000 7f5ed0846640 1 -- 172.21.15.60:0/3420292691 shutdown_connections 2024-09-12T02:35:35.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.788+0000 7f5ed0846640 1 --2- 172.21.15.60:0/3420292691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ecc06d060 0x7f5ecc156160 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:35.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.788+0000 7f5ed0846640 1 -- 172.21.15.60:0/3420292691 >> 172.21.15.60:0/3420292691 conn(0x7f5ecc0adb10 msgr2=0x7f5ecc0adf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:35.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.788+0000 7f5ed0846640 1 -- 172.21.15.60:0/3420292691 shutdown_connections 2024-09-12T02:35:35.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.788+0000 7f5ed0846640 1 -- 172.21.15.60:0/3420292691 wait complete. 2024-09-12T02:35:35.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.790+0000 7f5ed0846640 1 Processor -- start 2024-09-12T02:35:35.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.790+0000 7f5ed0846640 1 -- start start 2024-09-12T02:35:35.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.791+0000 7f5ed0846640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ecc06c160 0x7f5ecc1e1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:35.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.791+0000 7f5ed0846640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ecc06d060 0x7f5ecc151000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:35.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.791+0000 7f5ed0846640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ecc1538e0 0x7f5ecc1df7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:35.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.791+0000 7f5ed0846640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5ecc153cc0 con 0x7f5ecc06d060 2024-09-12T02:35:35.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.791+0000 7f5ed0846640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5ecc1566a0 con 0x7f5ecc06c160 2024-09-12T02:35:35.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.791+0000 7f5ed0846640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5ecc158450 con 0x7f5ecc1538e0 2024-09-12T02:35:35.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.791+0000 7f5ecad9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ecc06c160 0x7f5ecc1e1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:35.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.791+0000 7f5ecad9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ecc06c160 0x7f5ecc1e1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:38246/0 (socket says 172.21.15.60:38246) 2024-09-12T02:35:35.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.792+0000 7f5ecad9d640 1 -- 172.21.15.60:0/1111443599 learned_addr learned my addr 172.21.15.60:0/1111443599 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:35:35.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.792+0000 7f5ecb59e640 1 --2- 172.21.15.60:0/1111443599 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ecc1538e0 0x7f5ecc1df7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:35.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.792+0000 7f5eca59c640 1 --2- 172.21.15.60:0/1111443599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ecc06d060 0x7f5ecc151000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:35.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.792+0000 7f5ecb59e640 1 -- 172.21.15.60:0/1111443599 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ecc06c160 msgr2=0x7f5ecc1e1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:35.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.792+0000 7f5ecb59e640 1 --2- 172.21.15.60:0/1111443599 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ecc06c160 0x7f5ecc1e1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:35.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.792+0000 7f5ecb59e640 1 -- 172.21.15.60:0/1111443599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ecc06d060 msgr2=0x7f5ecc151000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:35.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.792+0000 7f5ecb59e640 1 --2- 172.21.15.60:0/1111443599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ecc06d060 0x7f5ecc151000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:35.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.792+0000 7f5ecb59e640 1 -- 172.21.15.60:0/1111443599 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ecc1e1fc0 con 0x7f5ecc1538e0 2024-09-12T02:35:35.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.792+0000 7f5ecb59e640 1 --2- 172.21.15.60:0/1111443599 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ecc1538e0 0x7f5ecc1df7c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5eb4031000 tx=0x7f5eb40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:35.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.793+0000 7f5ec37fe640 1 -- 172.21.15.60:0/1111443599 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb4032e60 con 0x7f5ecc1538e0 2024-09-12T02:35:35.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.793+0000 7f5ed0846640 1 -- 172.21.15.60:0/1111443599 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ecc1e22a0 con 0x7f5ecc1538e0 2024-09-12T02:35:35.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.793+0000 7f5ed0846640 1 -- 172.21.15.60:0/1111443599 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ecc151540 con 0x7f5ecc1538e0 2024-09-12T02:35:35.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.794+0000 7f5ec37fe640 1 -- 172.21.15.60:0/1111443599 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5eb4032440 con 0x7f5ecc1538e0 2024-09-12T02:35:35.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.794+0000 7f5ec37fe640 1 -- 172.21.15.60:0/1111443599 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb4037040 con 0x7f5ecc1538e0 2024-09-12T02:35:35.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.795+0000 7f5ed0846640 1 -- 172.21.15.60:0/1111443599 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5eb0005290 con 0x7f5ecc1538e0 2024-09-12T02:35:35.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.796+0000 7f5ec37fe640 1 -- 172.21.15.60:0/1111443599 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5eb4044020 con 0x7f5ecc1538e0 2024-09-12T02:35:35.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.796+0000 7f5ec37fe640 1 --2- 172.21.15.60:0/1111443599 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f5eac06be30 0x7f5eac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:35.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.797+0000 7f5ec37fe640 1 -- 172.21.15.60:0/1111443599 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f5eb40ab500 con 0x7f5ecc1538e0 2024-09-12T02:35:35.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.797+0000 7f5ecad9d640 1 --2- 172.21.15.60:0/1111443599 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f5eac06be30 0x7f5eac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:35.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.797+0000 7f5ecad9d640 1 --2- 172.21.15.60:0/1111443599 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f5eac06be30 0x7f5eac06e2f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4005880 tx=0x7f5ec4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:35.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:35.807+0000 7f5ec37fe640 1 -- 172.21.15.60:0/1111443599 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5eb4079b00 con 0x7f5ecc1538e0 2024-09-12T02:35:36.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.318+0000 7f5ed0846640 1 -- 172.21.15.60:0/1111443599 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f5eb0005580 con 0x7f5ecc1538e0 2024-09-12T02:35:36.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.318+0000 7f5ec37fe640 1 -- 172.21.15.60:0/1111443599 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f5eb4079400 con 0x7f5ecc1538e0 2024-09-12T02:35:36.319 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":124,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:35:36.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.322+0000 7f5ed0846640 1 -- 172.21.15.60:0/1111443599 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f5eac06be30 msgr2=0x7f5eac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:36.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.322+0000 7f5ed0846640 1 --2- 172.21.15.60:0/1111443599 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f5eac06be30 0x7f5eac06e2f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4005880 tx=0x7f5ec4009040 comp rx=0 tx=0).stop 2024-09-12T02:35:36.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.322+0000 7f5ed0846640 1 -- 172.21.15.60:0/1111443599 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ecc1538e0 msgr2=0x7f5ecc1df7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:36.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.322+0000 7f5ed0846640 1 --2- 172.21.15.60:0/1111443599 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ecc1538e0 0x7f5ecc1df7c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5eb4031000 tx=0x7f5eb40046c0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.323+0000 7f5ed0846640 1 -- 172.21.15.60:0/1111443599 shutdown_connections 2024-09-12T02:35:36.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.323+0000 7f5ed0846640 1 --2- 172.21.15.60:0/1111443599 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f5eac06be30 0x7f5eac06e2f0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.323+0000 7f5ed0846640 1 --2- 172.21.15.60:0/1111443599 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ecc1538e0 0x7f5ecc1df7c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.323+0000 7f5ed0846640 1 --2- 172.21.15.60:0/1111443599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ecc06d060 0x7f5ecc151000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.323+0000 7f5ed0846640 1 --2- 172.21.15.60:0/1111443599 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ecc06c160 0x7f5ecc1e1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.323+0000 7f5ed0846640 1 -- 172.21.15.60:0/1111443599 >> 172.21.15.60:0/1111443599 conn(0x7f5ecc0adb10 msgr2=0x7f5ecc151d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:36.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.323+0000 7f5ed0846640 1 -- 172.21.15.60:0/1111443599 shutdown_connections 2024-09-12T02:35:36.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.323+0000 7f5ed0846640 1 -- 172.21.15.60:0/1111443599 wait complete. 2024-09-12T02:35:36.342 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-12T02:35:36.343 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-12T02:35:36.343 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-12T02:35:36.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.532+0000 7f8cfbfff640 1 Processor -- start 2024-09-12T02:35:36.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.532+0000 7f8cfbfff640 1 -- start start 2024-09-12T02:35:36.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.533+0000 7f8cfbfff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8cf40d7890 0x7f8cf4005d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:36.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.533+0000 7f8cfbfff640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cf40da8c0 con 0x7f8cf404dc60 2024-09-12T02:35:36.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.533+0000 7f8cfbfff640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cf40daba0 con 0x7f8cf4049fc0 2024-09-12T02:35:36.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.533+0000 7f8cfbfff640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f8cf404e330 con 0x7f8cf40d7890 2024-09-12T02:35:36.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.533+0000 7f8cfb7fe640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f8cf4049fc0 0x7f8cf404a410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:45824/0 (socket says 172.21.15.60:45824) 2024-09-12T02:35:36.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.533+0000 7f8cfb7fe640 1 -- 172.21.15.60:0/3974614367 learned_addr learned my addr 172.21.15.60:0/3974614367 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:35:36.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.536+0000 7f8cfaffd640 1 --2- 172.21.15.60:0/3974614367 >> v2:172.21.15.105:3300/0 conn(0x7f8cf40d7890 0x7f8cf4005d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:36.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.537+0000 7f8cf9ffb640 1 -- 172.21.15.60:0/3974614367 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 883635183 0 0) 0x7f8cf40daba0 con 0x7f8cf4049fc0 2024-09-12T02:35:36.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.537+0000 7f8cf9ffb640 1 -- 172.21.15.60:0/3974614367 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ce4003520 con 0x7f8cf4049fc0 2024-09-12T02:35:36.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.538+0000 7f8cfaffd640 1 -- 172.21.15.60:0/3974614367 >> v1:172.21.15.105:6789/0 conn(0x7f8cf4049fc0 legacy=0x7f8cf404a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:36.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.538+0000 7f8cfaffd640 1 -- 172.21.15.60:0/3974614367 >> v1:172.21.15.60:6789/0 conn(0x7f8cf404dc60 legacy=0x7f8cf404ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:36.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.538+0000 7f8cfaffd640 1 -- 172.21.15.60:0/3974614367 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cf404e610 con 0x7f8cf40d7890 2024-09-12T02:35:36.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.540+0000 7f8cfaffd640 1 --2- 172.21.15.60:0/3974614367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8cf40d7890 0x7f8cf4005d30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8cf00097a0 tx=0x7f8cf002a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5415842ad0db9247 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:36.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.540+0000 7f8cf9ffb640 1 -- 172.21.15.60:0/3974614367 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf0037070 con 0x7f8cf40d7890 2024-09-12T02:35:36.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.541+0000 7f8cf9ffb640 1 -- 172.21.15.60:0/3974614367 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cf0032440 con 0x7f8cf40d7890 2024-09-12T02:35:36.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.541+0000 7f8cf9ffb640 1 -- 172.21.15.60:0/3974614367 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf0032870 con 0x7f8cf40d7890 2024-09-12T02:35:36.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.543+0000 7f8cfbfff640 1 -- 172.21.15.60:0/3974614367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8cf40d7890 msgr2=0x7f8cf4005d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:36.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.543+0000 7f8cfbfff640 1 --2- 172.21.15.60:0/3974614367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8cf40d7890 0x7f8cf4005d30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8cf00097a0 tx=0x7f8cf002a1e0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.544+0000 7f8cfbfff640 1 -- 172.21.15.60:0/3974614367 shutdown_connections 2024-09-12T02:35:36.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.544+0000 7f8cfbfff640 1 --2- 172.21.15.60:0/3974614367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8cf40d7890 0x7f8cf4005d30 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.544+0000 7f8cfbfff640 1 -- 172.21.15.60:0/3974614367 >> 172.21.15.60:0/3974614367 conn(0x7f8cf404c0c0 msgr2=0x7f8cf404c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:36.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.544+0000 7f8cfbfff640 1 -- 172.21.15.60:0/3974614367 shutdown_connections 2024-09-12T02:35:36.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.544+0000 7f8cfbfff640 1 -- 172.21.15.60:0/3974614367 wait complete. 2024-09-12T02:35:36.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.546+0000 7f8cfbfff640 1 Processor -- start 2024-09-12T02:35:36.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.546+0000 7f8cfbfff640 1 -- start start 2024-09-12T02:35:36.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.547+0000 7f8cfbfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8cf4049fc0 0x7f8cf417c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:36.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.547+0000 7f8cfbfff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cf404dc60 0x7f8cf40d9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:36.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.547+0000 7f8cfbfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cf40d7890 0x7f8cf41804a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:36.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.547+0000 7f8cfbfff640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf4042f70 con 0x7f8cf40d7890 2024-09-12T02:35:36.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.548+0000 7f8cfbfff640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf4042df0 con 0x7f8cf4049fc0 2024-09-12T02:35:36.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.548+0000 7f8cfbfff640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8cf40e56f0 con 0x7f8cf404dc60 2024-09-12T02:35:36.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.548+0000 7f8cfb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cf40d7890 0x7f8cf41804a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:36.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.548+0000 7f8cfb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cf40d7890 0x7f8cf41804a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43602/0 (socket says 172.21.15.60:43602) 2024-09-12T02:35:36.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.548+0000 7f8cfb7fe640 1 -- 172.21.15.60:0/2911852587 learned_addr learned my addr 172.21.15.60:0/2911852587 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:35:36.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.548+0000 7f8cfaffd640 1 --2- 172.21.15.60:0/2911852587 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8cf4049fc0 0x7f8cf417c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:36.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.548+0000 7f8cfb7fe640 1 -- 172.21.15.60:0/2911852587 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cf404dc60 msgr2=0x7f8cf40d9390 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:35:36.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.548+0000 7f8cfb7fe640 1 --2- 172.21.15.60:0/2911852587 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cf404dc60 0x7f8cf40d9390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.548+0000 7f8cfb7fe640 1 -- 172.21.15.60:0/2911852587 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8cf4049fc0 msgr2=0x7f8cf417c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:36.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.548+0000 7f8cfb7fe640 1 --2- 172.21.15.60:0/2911852587 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8cf4049fc0 0x7f8cf417c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.548+0000 7f8cfb7fe640 1 -- 172.21.15.60:0/2911852587 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cf4044bc0 con 0x7f8cf40d7890 2024-09-12T02:35:36.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.549+0000 7f8cfb7fe640 1 --2- 172.21.15.60:0/2911852587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cf40d7890 0x7f8cf41804a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc06b980 tx=0x7f8cfc051030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:36.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.554+0000 7f8ce37fe640 1 -- 172.21.15.60:0/2911852587 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cfc0766c0 con 0x7f8cf40d7890 2024-09-12T02:35:36.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.554+0000 7f8cfbfff640 1 -- 172.21.15.60:0/2911852587 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cf417cb40 con 0x7f8cf40d7890 2024-09-12T02:35:36.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.554+0000 7f8cfbfff640 1 -- 172.21.15.60:0/2911852587 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cf4045d50 con 0x7f8cf40d7890 2024-09-12T02:35:36.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.554+0000 7f8ce37fe640 1 -- 172.21.15.60:0/2911852587 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cfc092020 con 0x7f8cf40d7890 2024-09-12T02:35:36.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.555+0000 7f8ce37fe640 1 -- 172.21.15.60:0/2911852587 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cfc06be20 con 0x7f8cf40d7890 2024-09-12T02:35:36.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.555+0000 7f8cfbfff640 1 --2- 172.21.15.60:0/2911852587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cdc002a70 0x7f8cdc004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:36.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.556+0000 7f8cfbfff640 1 -- 172.21.15.60:0/2911852587 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8cdc007ec0 con 0x7f8cdc002a70 2024-09-12T02:35:36.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.557+0000 7f8ce37fe640 1 -- 172.21.15.60:0/2911852587 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8cfc0741c0 con 0x7f8cf40d7890 2024-09-12T02:35:36.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.558+0000 7f8ce37fe640 1 --2- 172.21.15.60:0/2911852587 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8ce806bf30 0x7f8ce806e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:36.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.558+0000 7f8ce37fe640 1 -- 172.21.15.60:0/2911852587 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f8cfc107220 con 0x7f8cf40d7890 2024-09-12T02:35:36.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.559+0000 7f8cfa7fc640 1 --2- 172.21.15.60:0/2911852587 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8ce806bf30 0x7f8ce806e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:36.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.561+0000 7f8cfa7fc640 1 --2- 172.21.15.60:0/2911852587 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8ce806bf30 0x7f8ce806e3f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8cec000f60 tx=0x7f8cec0079b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:36.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.561+0000 7f8cfaffd640 1 --2- 172.21.15.60:0/2911852587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cdc002a70 0x7f8cdc004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:36.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.561+0000 7f8cfaffd640 1 -- 172.21.15.60:0/2911852587 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8cdc0080c0 con 0x7f8cdc002a70 2024-09-12T02:35:36.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.562+0000 7f8cfaffd640 1 --2- 172.21.15.60:0/2911852587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cdc002a70 0x7f8cdc004f30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8cf404ba40 tx=0x7f8cf00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:36.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.562+0000 7f8ce37fe640 1 -- 172.21.15.60:0/2911852587 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf0042070 con 0x7f8cdc002a70 2024-09-12T02:35:36.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.563+0000 7f8ce37fe640 1 -- 172.21.15.60:0/2911852587 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f8cf0006dd0 con 0x7f8cdc002a70 2024-09-12T02:35:36.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.563+0000 7f8ce37fe640 1 -- 172.21.15.60:0/2911852587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cdc002a70 msgr2=0x7f8cdc004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:36.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.563+0000 7f8ce37fe640 1 --2- 172.21.15.60:0/2911852587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cdc002a70 0x7f8cdc004f30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8cf404ba40 tx=0x7f8cf00046c0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.563+0000 7f8ce37fe640 1 -- 172.21.15.60:0/2911852587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cdc002a70 msgr2=0x7f8cdc004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:35:36.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.563+0000 7f8ce37fe640 1 --2- 172.21.15.60:0/2911852587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cdc002a70 0x7f8cdc004f30 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8cf404ba40 tx=0x7f8cf00046c0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.575+0000 7f8cfbfff640 1 --2- 172.21.15.60:0/2911852587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cdc006eb0 0x7f8cdc007340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:36.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.575+0000 7f8cfbfff640 1 -- 172.21.15.60:0/2911852587 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8cdc00a4a0 con 0x7f8cdc006eb0 2024-09-12T02:35:36.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.577+0000 7f8cfaffd640 1 --2- 172.21.15.60:0/2911852587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cdc006eb0 0x7f8cdc007340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:36.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.578+0000 7f8cfaffd640 1 -- 172.21.15.60:0/2911852587 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8cdc007880 con 0x7f8cdc006eb0 2024-09-12T02:35:36.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.578+0000 7f8cfaffd640 1 --2- 172.21.15.60:0/2911852587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cdc006eb0 0x7f8cdc007340 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8cf00097a0 tx=0x7f8cf0008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:36.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.579+0000 7f8ce37fe640 1 -- 172.21.15.60:0/2911852587 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf004d070 con 0x7f8cdc006eb0 2024-09-12T02:35:36.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.579+0000 7f8ce37fe640 1 -- 172.21.15.60:0/2911852587 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5052 (secure 0 0 0) 0x7f8cf003cb20 con 0x7f8cdc006eb0 2024-09-12T02:35:36.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.579+0000 7f8ce37fe640 1 -- 172.21.15.60:0/2911852587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cdc006eb0 msgr2=0x7f8cdc007340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:36.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.579+0000 7f8ce37fe640 1 --2- 172.21.15.60:0/2911852587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cdc006eb0 0x7f8cdc007340 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8cf00097a0 tx=0x7f8cf0008030 comp rx=0 tx=0).stop 2024-09-12T02:35:36.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.579+0000 7f8ce37fe640 1 -- 172.21.15.60:0/2911852587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cdc006eb0 msgr2=0x7f8cdc007340 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:35:36.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.579+0000 7f8ce37fe640 1 --2- 172.21.15.60:0/2911852587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cdc006eb0 0x7f8cdc007340 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8cf00097a0 tx=0x7f8cf0008030 comp rx=0 tx=0).stop 2024-09-12T02:35:36.581 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:35:36.581 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:35:36.581 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:35:36.581 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:35:36.581 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 124, 2024-09-12T02:35:36.581 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 77181, 2024-09-12T02:35:36.581 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:35:36.581 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:35:36.581 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:35:36.582 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:35:36.582 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:35:36.582 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-09-12T02:35:36.582 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:35:36.582 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:35:36.582 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:35:36.582 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:35:36.582 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:35:36.582 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:35:36.582 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:35:36.582 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:35:36.582 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:35:36.582 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:35:36.583 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:35:36.583 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:35:36.583 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:35:36.583 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:35:36.583 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:35:36.583 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:35:36.583 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:35:36.583 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:35:36.583 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:35:36.584 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:35:36.584 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:35:36.584 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:35:36.584 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:35:36.584 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:35:36.584 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:35:36.584 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:35:36.584 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:35:36.584 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:35:36.584 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:36.584 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:36.585 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:35:36.585 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:35:36.585 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:35:36.585 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:35:36.585 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:35:36.585 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:35:36.585 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:35:36.585 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:35:36.585 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:35:36.585 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:35:36.585 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:35:36.585 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:35:36.585 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:35:36.586 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:35:36.586 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:35:36.586 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:35:36.586 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:35:36.586 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:35:36.586 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:35:36.586 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:35:36.586 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:35:36.586 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:35:36.586 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:35:36.586 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:35:36.586 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:35:36.586 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:35:36.586 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:35:36.587 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:35:36.587 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:35:36.587 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:35:36.587 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:36.587 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:35:36.587 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:36.587 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:35:36.587 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:35:36.587 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:35:36.587 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:35:36.587 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:36.587 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:35:36.587 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:35:36.588 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:36.588 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:36.588 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:36.588 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:35:36.588 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:35:36.588 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:36.588 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:36.588 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:36.588 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:36.588 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:35:36.588 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:35:36.588 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:35:36.588 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:35:36.588 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:35:36.589 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:36.589 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:36.589 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:35:36.589 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:35:36.589 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:35:36.589 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:35:36.589 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:36.589 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:35:36.589 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:35:36.589 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:36.589 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:36.589 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:36.589 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:35:36.589 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:35:36.590 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:36.590 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:36.590 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:36.590 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:36.590 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:35:36.590 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:35:36.590 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:35:36.590 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:35:36.590 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:35:36.590 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:36.590 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:36.590 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:35:36.590 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:35:36.590 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:35:36.591 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:35:36.591 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:36.591 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:35:36.591 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:35:36.591 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:36.591 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:36.591 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:36.591 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:35:36.591 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:35:36.591 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:36.591 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:36.591 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:36.591 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:36.592 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:35:36.592 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:35:36.592 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:35:36.592 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:35:36.592 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:35:36.592 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:36.592 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:36.592 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:36.592 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:35:36.592 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:35:36.592 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:36.592 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:35:36.593 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:35:36.593 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:35:36.593 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:36.593 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:35:36.593 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:35:36.593 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:36.593 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:35:36.593 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:35:36.593 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:35:36.593 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:36.593 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:35:36.593 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:35:36.593 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:36.594 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:35:36.594 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:35:36.594 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-09-12T02:35:36.594 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:36.594 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:35:36.594 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:35:36.594 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:36.594 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:35:36.594 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:35:36.594 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-09-12T02:35:36.595 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:36.595 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:35:36.595 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:35:36.595 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:36.595 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:35:36.595 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:35:36.595 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:35:36.595 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:36.595 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:36.595 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:36.595 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:35:36.595 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:35:36.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.580+0000 7f8ce17fa640 1 -- 172.21.15.60:0/2911852587 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8ce806bf30 msgr2=0x7f8ce806e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:36.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.580+0000 7f8ce17fa640 1 --2- 172.21.15.60:0/2911852587 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8ce806bf30 0x7f8ce806e3f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8cec000f60 tx=0x7f8cec0079b0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.580+0000 7f8ce17fa640 1 -- 172.21.15.60:0/2911852587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cf40d7890 msgr2=0x7f8cf41804a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:36.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.580+0000 7f8ce17fa640 1 --2- 172.21.15.60:0/2911852587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cf40d7890 0x7f8cf41804a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc06b980 tx=0x7f8cfc051030 comp rx=0 tx=0).stop 2024-09-12T02:35:36.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.582+0000 7f8cfb7fe640 1 -- 172.21.15.60:0/2911852587 reap_dead start 2024-09-12T02:35:36.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.582+0000 7f8cfb7fe640 1 -- 172.21.15.60:0/2911852587 reap_dead start 2024-09-12T02:35:36.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.582+0000 7f8ce17fa640 1 -- 172.21.15.60:0/2911852587 shutdown_connections 2024-09-12T02:35:36.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.582+0000 7f8ce17fa640 1 -- 172.21.15.60:0/2911852587 >> 172.21.15.60:0/2911852587 conn(0x7f8cf404c0c0 msgr2=0x7f8cf4042610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:36.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.582+0000 7f8ce17fa640 1 -- 172.21.15.60:0/2911852587 shutdown_connections 2024-09-12T02:35:36.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.582+0000 7f8ce17fa640 1 -- 172.21.15.60:0/2911852587 wait complete. 2024-09-12T02:35:36.600 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:35:36.600 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-12T02:35:36.600 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-12T02:35:36.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.784+0000 7f2e48957640 1 Processor -- start 2024-09-12T02:35:36.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.785+0000 7f2e48957640 1 -- start start 2024-09-12T02:35:36.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.786+0000 7f2e48957640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2e3c0dbaf0 0x7f2e3c0deca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:36.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.787+0000 7f2e48957640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e3c04a730 con 0x7f2e3c04e270 2024-09-12T02:35:36.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.787+0000 7f2e48957640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e3c04d790 con 0x7f2e3c049fc0 2024-09-12T02:35:36.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.787+0000 7f2e48957640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f2e3c04d540 con 0x7f2e3c0dbaf0 2024-09-12T02:35:36.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.787+0000 7f2e43fff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f2e3c04e270 0x7f2e3c04e6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:58412/0 (socket says 172.21.15.60:58412) 2024-09-12T02:35:36.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.787+0000 7f2e43fff640 1 -- 172.21.15.60:0/1406584729 learned_addr learned my addr 172.21.15.60:0/1406584729 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:35:36.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.787+0000 7f2e437fe640 1 --2- 172.21.15.60:0/1406584729 >> v2:172.21.15.60:3300/0 conn(0x7f2e3c0dbaf0 0x7f2e3c0deca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:36.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.788+0000 7f2e437fe640 1 -- 172.21.15.60:0/1406584729 >> v1:172.21.15.105:6789/0 conn(0x7f2e3c049fc0 legacy=0x7f2e3c006d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:36.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.788+0000 7f2e437fe640 1 -- 172.21.15.60:0/1406584729 >> v1:172.21.15.60:6789/0 conn(0x7f2e3c04e270 legacy=0x7f2e3c04e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:36.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.788+0000 7f2e437fe640 1 -- 172.21.15.60:0/1406584729 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e3c04da70 con 0x7f2e3c0dbaf0 2024-09-12T02:35:36.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.789+0000 7f2e437fe640 1 --2- 172.21.15.60:0/1406584729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e3c0dbaf0 0x7f2e3c0deca0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2e380097a0 tx=0x7f2e3802a010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95eef5a19ec70a85 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:36.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.790+0000 7f2e427fc640 1 -- 172.21.15.60:0/1406584729 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e38037070 con 0x7f2e3c0dbaf0 2024-09-12T02:35:36.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.790+0000 7f2e427fc640 1 -- 172.21.15.60:0/1406584729 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e3802aca0 con 0x7f2e3c0dbaf0 2024-09-12T02:35:36.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.790+0000 7f2e427fc640 1 -- 172.21.15.60:0/1406584729 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e38032640 con 0x7f2e3c0dbaf0 2024-09-12T02:35:36.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.792+0000 7f2e48957640 1 -- 172.21.15.60:0/1406584729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e3c0dbaf0 msgr2=0x7f2e3c0deca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:36.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.792+0000 7f2e48957640 1 --2- 172.21.15.60:0/1406584729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e3c0dbaf0 0x7f2e3c0deca0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2e380097a0 tx=0x7f2e3802a010 comp rx=0 tx=0).stop 2024-09-12T02:35:36.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.792+0000 7f2e48957640 1 -- 172.21.15.60:0/1406584729 shutdown_connections 2024-09-12T02:35:36.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.792+0000 7f2e48957640 1 --2- 172.21.15.60:0/1406584729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e3c0dbaf0 0x7f2e3c0deca0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.792+0000 7f2e48957640 1 -- 172.21.15.60:0/1406584729 >> 172.21.15.60:0/1406584729 conn(0x7f2e3c04c0c0 msgr2=0x7f2e3c04c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:36.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.800+0000 7f2e48957640 1 -- 172.21.15.60:0/1406584729 shutdown_connections 2024-09-12T02:35:36.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.800+0000 7f2e48957640 1 -- 172.21.15.60:0/1406584729 wait complete. 2024-09-12T02:35:36.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.802+0000 7f2e48957640 1 Processor -- start 2024-09-12T02:35:36.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.803+0000 7f2e48957640 1 -- start start 2024-09-12T02:35:36.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.804+0000 7f2e48957640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e3c049fc0 0x7f2e3c048d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:36.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.804+0000 7f2e48957640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e3c04e270 0x7f2e3c0da0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:36.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.805+0000 7f2e42ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e3c04e270 0x7f2e3c0da0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:36.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.805+0000 7f2e42ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e3c04e270 0x7f2e3c0da0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43646/0 (socket says 172.21.15.60:43646) 2024-09-12T02:35:36.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.805+0000 7f2e42ffd640 1 -- 172.21.15.60:0/2183086059 learned_addr learned my addr 172.21.15.60:0/2183086059 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:35:36.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.805+0000 7f2e48957640 1 --2- 172.21.15.60:0/2183086059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e3c0dbaf0 0x7f2e3c0da620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:36.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.805+0000 7f2e48957640 1 -- 172.21.15.60:0/2183086059 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3c007430 con 0x7f2e3c04e270 2024-09-12T02:35:36.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.806+0000 7f2e43fff640 1 --2- 172.21.15.60:0/2183086059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e3c0dbaf0 0x7f2e3c0da620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:36.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.806+0000 7f2e48957640 1 -- 172.21.15.60:0/2183086059 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3c04a450 con 0x7f2e3c0dbaf0 2024-09-12T02:35:36.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.806+0000 7f2e48957640 1 -- 172.21.15.60:0/2183086059 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2e3c0075b0 con 0x7f2e3c049fc0 2024-09-12T02:35:36.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.807+0000 7f2e42ffd640 1 -- 172.21.15.60:0/2183086059 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e3c049fc0 msgr2=0x7f2e3c048d50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:35:36.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.807+0000 7f2e42ffd640 1 --2- 172.21.15.60:0/2183086059 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e3c049fc0 0x7f2e3c048d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.807+0000 7f2e42ffd640 1 -- 172.21.15.60:0/2183086059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e3c0dbaf0 msgr2=0x7f2e3c0da620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:36.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.807+0000 7f2e42ffd640 1 --2- 172.21.15.60:0/2183086059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e3c0dbaf0 0x7f2e3c0da620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.807+0000 7f2e42ffd640 1 -- 172.21.15.60:0/2183086059 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e3c0481c0 con 0x7f2e3c04e270 2024-09-12T02:35:36.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.807+0000 7f2e43fff640 1 --2- 172.21.15.60:0/2183086059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e3c0dbaf0 0x7f2e3c0da620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:36.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.808+0000 7f2e42ffd640 1 --2- 172.21.15.60:0/2183086059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e3c04e270 0x7f2e3c0da0e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2e3000c400 tx=0x7f2e3000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:36.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.809+0000 7f2e2ffff640 1 -- 172.21.15.60:0/2183086059 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e300052d0 con 0x7f2e3c04e270 2024-09-12T02:35:36.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.810+0000 7f2e2ffff640 1 -- 172.21.15.60:0/2183086059 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e30005470 con 0x7f2e3c04e270 2024-09-12T02:35:36.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.810+0000 7f2e2ffff640 1 -- 172.21.15.60:0/2183086059 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e30007240 con 0x7f2e3c04e270 2024-09-12T02:35:36.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.810+0000 7f2e48957640 1 -- 172.21.15.60:0/2183086059 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e3c047400 con 0x7f2e3c04e270 2024-09-12T02:35:36.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.812+0000 7f2e48957640 1 -- 172.21.15.60:0/2183086059 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e3c0479c0 con 0x7f2e3c04e270 2024-09-12T02:35:36.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.814+0000 7f2e48957640 1 --2- 172.21.15.60:0/2183086059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e3c00eb20 0x7f2e3c043310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:36.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.814+0000 7f2e48957640 1 -- 172.21.15.60:0/2183086059 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3c0deca0 con 0x7f2e3c00eb20 2024-09-12T02:35:36.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.815+0000 7f2e2ffff640 1 -- 172.21.15.60:0/2183086059 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2e300073e0 con 0x7f2e3c04e270 2024-09-12T02:35:36.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.816+0000 7f2e2ffff640 1 --2- 172.21.15.60:0/2183086059 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2e2806be80 0x7f2e2806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:36.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.816+0000 7f2e437fe640 1 --2- 172.21.15.60:0/2183086059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e3c00eb20 0x7f2e3c043310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:36.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.817+0000 7f2e437fe640 1 -- 172.21.15.60:0/2183086059 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2e3c00f5c0 con 0x7f2e3c00eb20 2024-09-12T02:35:36.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.817+0000 7f2e43fff640 1 --2- 172.21.15.60:0/2183086059 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2e2806be80 0x7f2e2806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:36.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.817+0000 7f2e2ffff640 1 -- 172.21.15.60:0/2183086059 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f2e30088770 con 0x7f2e3c04e270 2024-09-12T02:35:36.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.818+0000 7f2e43fff640 1 --2- 172.21.15.60:0/2183086059 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2e2806be80 0x7f2e2806e340 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2e440504d0 tx=0x7f2e440659b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:36.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.818+0000 7f2e437fe640 1 --2- 172.21.15.60:0/2183086059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e3c00eb20 0x7f2e3c043310 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c0e27a0 tx=0x7f2e380046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:36.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.819+0000 7f2e2ffff640 1 -- 172.21.15.60:0/2183086059 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e38042020 con 0x7f2e3c00eb20 2024-09-12T02:35:36.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.823+0000 7f2e2ffff640 1 -- 172.21.15.60:0/2183086059 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f2e380093c0 con 0x7f2e3c00eb20 2024-09-12T02:35:36.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.824+0000 7f2e2ffff640 1 -- 172.21.15.60:0/2183086059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e3c00eb20 msgr2=0x7f2e3c043310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:36.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.824+0000 7f2e2ffff640 1 --2- 172.21.15.60:0/2183086059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e3c00eb20 0x7f2e3c043310 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c0e27a0 tx=0x7f2e380046c0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.824+0000 7f2e2ffff640 1 -- 172.21.15.60:0/2183086059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e3c00eb20 msgr2=0x7f2e3c043310 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:35:36.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.824+0000 7f2e2ffff640 1 --2- 172.21.15.60:0/2183086059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e3c00eb20 0x7f2e3c043310 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c0e27a0 tx=0x7f2e380046c0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.839+0000 7f2e48957640 1 --2- 172.21.15.60:0/2183086059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e3c047bc0 0x7f2e3c043850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:36.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.839+0000 7f2e48957640 1 -- 172.21.15.60:0/2183086059 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3c043d90 con 0x7f2e3c047bc0 2024-09-12T02:35:36.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.839+0000 7f2e437fe640 1 --2- 172.21.15.60:0/2183086059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e3c047bc0 0x7f2e3c043850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:36.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.840+0000 7f2e437fe640 1 -- 172.21.15.60:0/2183086059 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2e3c049290 con 0x7f2e3c047bc0 2024-09-12T02:35:36.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.841+0000 7f2e437fe640 1 --2- 172.21.15.60:0/2183086059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e3c047bc0 0x7f2e3c043850 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2e38000c00 tx=0x7f2e38009190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:36.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.842+0000 7f2e2ffff640 1 -- 172.21.15.60:0/2183086059 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e38042040 con 0x7f2e3c047bc0 2024-09-12T02:35:36.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.842+0000 7f2e2ffff640 1 -- 172.21.15.60:0/2183086059 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4548 (secure 0 0 0) 0x7f2e38049a60 con 0x7f2e3c047bc0 2024-09-12T02:35:36.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.842+0000 7f2e2ffff640 1 -- 172.21.15.60:0/2183086059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e3c047bc0 msgr2=0x7f2e3c043850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:36.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.842+0000 7f2e2ffff640 1 --2- 172.21.15.60:0/2183086059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e3c047bc0 0x7f2e3c043850 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2e38000c00 tx=0x7f2e38009190 comp rx=0 tx=0).stop 2024-09-12T02:35:36.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.843+0000 7f2e2ffff640 1 -- 172.21.15.60:0/2183086059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e3c047bc0 msgr2=0x7f2e3c043850 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:35:36.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.843+0000 7f2e2ffff640 1 --2- 172.21.15.60:0/2183086059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e3c047bc0 0x7f2e3c043850 secure :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2e38000c00 tx=0x7f2e38009190 comp rx=0 tx=0).stop 2024-09-12T02:35:36.844 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:35:36.844 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:35:36.844 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:35:36.844 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:35:36.844 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 124, 2024-09-12T02:35:36.844 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 8421, 2024-09-12T02:35:36.844 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:35:36.845 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:35:36.845 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:35:36.845 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:35:36.845 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:35:36.845 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-09-12T02:35:36.845 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:35:36.845 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:35:36.845 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:35:36.845 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:35:36.845 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:35:36.845 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:35:36.845 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:35:36.845 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:35:36.845 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:35:36.846 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:35:36.846 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:35:36.846 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:35:36.846 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:35:36.846 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:35:36.846 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:35:36.846 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:35:36.846 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:35:36.846 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:35:36.846 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:35:36.846 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:35:36.846 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:35:36.846 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:35:36.846 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:35:36.847 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:35:36.847 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:35:36.847 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:35:36.847 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:35:36.847 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:35:36.847 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:36.847 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:36.847 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:35:36.847 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:35:36.847 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:35:36.847 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:35:36.847 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:35:36.847 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:35:36.847 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:35:36.848 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:35:36.848 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:35:36.848 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:35:36.848 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:35:36.848 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:35:36.848 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:35:36.848 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:35:36.848 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:35:36.848 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:35:36.848 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:35:36.848 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:35:36.848 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:35:36.848 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:35:36.849 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:35:36.849 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:35:36.849 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:35:36.849 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:35:36.849 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:35:36.849 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:35:36.849 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:35:36.849 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:35:36.849 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:35:36.849 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:35:36.850 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:36.850 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:35:36.850 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:36.850 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:35:36.850 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:35:36.850 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:35:36.850 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:35:36.850 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:36.850 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:35:36.850 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:35:36.850 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:36.850 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:36.850 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:36.850 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:35:36.851 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:35:36.851 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:36.851 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:36.851 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:36.851 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:36.851 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:35:36.851 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:35:36.851 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:35:36.851 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:35:36.851 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:35:36.851 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:36.851 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:36.851 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:35:36.852 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:35:36.852 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:35:36.852 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:35:36.852 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:36.852 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:35:36.852 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:35:36.852 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:36.852 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:36.852 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:36.852 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:35:36.852 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:35:36.852 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:36.852 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:36.852 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:36.853 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:36.853 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:35:36.853 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:35:36.853 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:35:36.853 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:35:36.853 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:35:36.853 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:36.853 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:36.854 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:35:36.854 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:35:36.854 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:35:36.854 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:35:36.854 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:36.854 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:35:36.854 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:35:36.855 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:36.855 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:36.855 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:36.855 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:35:36.855 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:35:36.855 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:36.856 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:36.856 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:36.856 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:36.856 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:35:36.856 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:35:36.856 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:35:36.857 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:35:36.857 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:35:36.857 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:36.857 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:36.857 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:36.857 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:35:36.858 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:35:36.858 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:36.858 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:35:36.858 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:35:36.858 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:35:36.858 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:36.859 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:35:36.859 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:35:36.859 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:36.859 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:35:36.859 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:35:36.859 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:35:36.859 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:36.860 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:36.860 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:36.860 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:35:36.860 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:35:36.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.846+0000 7f2e48957640 1 -- 172.21.15.60:0/2183086059 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2e2806be80 msgr2=0x7f2e2806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:36.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.846+0000 7f2e48957640 1 --2- 172.21.15.60:0/2183086059 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2e2806be80 0x7f2e2806e340 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2e440504d0 tx=0x7f2e440659b0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.846+0000 7f2e43fff640 1 -- 172.21.15.60:0/2183086059 reap_dead start 2024-09-12T02:35:36.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.846+0000 7f2e48957640 1 -- 172.21.15.60:0/2183086059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e3c04e270 msgr2=0x7f2e3c0da0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:36.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.846+0000 7f2e48957640 1 --2- 172.21.15.60:0/2183086059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e3c04e270 0x7f2e3c0da0e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2e3000c400 tx=0x7f2e3000c8c0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.846+0000 7f2e48957640 1 -- 172.21.15.60:0/2183086059 shutdown_connections 2024-09-12T02:35:36.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.847+0000 7f2e48957640 1 --2- 172.21.15.60:0/2183086059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e3c04e270 0x7f2e3c0da0e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:36.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.847+0000 7f2e48957640 1 -- 172.21.15.60:0/2183086059 >> 172.21.15.60:0/2183086059 conn(0x7f2e3c04c0c0 msgr2=0x7f2e3c006c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:36.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.849+0000 7f2e48957640 1 -- 172.21.15.60:0/2183086059 shutdown_connections 2024-09-12T02:35:36.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:36.849+0000 7f2e48957640 1 -- 172.21.15.60:0/2183086059 wait complete. 2024-09-12T02:35:36.872 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:35:36.872 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-12T02:35:36.872 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-12T02:35:37.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.059+0000 7f1dcb4aa640 1 Processor -- start 2024-09-12T02:35:37.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.059+0000 7f1dcb4aa640 1 -- start start 2024-09-12T02:35:37.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.061+0000 7f1dcb4aa640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1dc4153370 0x7f1dc414f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:37.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.061+0000 7f1dcb4aa640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1dc406d520 0x7f1dc414fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:37.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.061+0000 7f1dcb4aa640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dc4156900 con 0x7f1dc40c5390 2024-09-12T02:35:37.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.061+0000 7f1dcb4aa640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f1dc41527d0 con 0x7f1dc4153370 2024-09-12T02:35:37.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.061+0000 7f1dcb4aa640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f1dc40ab790 con 0x7f1dc406d520 2024-09-12T02:35:37.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.061+0000 7f1dcaca9640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1dc406d520 0x7f1dc414fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:37.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.061+0000 7f1dcaca9640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1dc406d520 0x7f1dc414fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:38308/0 (socket says 172.21.15.60:38308) 2024-09-12T02:35:37.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.061+0000 7f1dcaca9640 1 -- 172.21.15.60:0/1866294543 learned_addr learned my addr 172.21.15.60:0/1866294543 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:35:37.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.063+0000 7f1dcaca9640 1 -- 172.21.15.60:0/1866294543 >> v2:172.21.15.60:3300/0 conn(0x7f1dc4153370 msgr2=0x7f1dc414f950 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:35:37.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.063+0000 7f1dcaca9640 1 --2- 172.21.15.60:0/1866294543 >> v2:172.21.15.60:3300/0 conn(0x7f1dc4153370 0x7f1dc414f950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.063+0000 7f1dcaca9640 1 -- 172.21.15.60:0/1866294543 >> v1:172.21.15.60:6789/0 conn(0x7f1dc40c5390 legacy=0x7f1dc4152c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:37.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.063+0000 7f1dcaca9640 1 -- 172.21.15.60:0/1866294543 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dc41565b0 con 0x7f1dc406d520 2024-09-12T02:35:37.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.065+0000 7f1dcaca9640 1 --2- 172.21.15.60:0/1866294543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1dc406d520 0x7f1dc414fe90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1dc40c4bf0 tx=0x7f1dbc02b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bad32de2119f474 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:37.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.065+0000 7f1dc94a6640 1 -- 172.21.15.60:0/1866294543 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc037070 con 0x7f1dc406d520 2024-09-12T02:35:37.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.065+0000 7f1dc94a6640 1 -- 172.21.15.60:0/1866294543 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dbc032600 con 0x7f1dc406d520 2024-09-12T02:35:37.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.065+0000 7f1dc94a6640 1 -- 172.21.15.60:0/1866294543 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc0329d0 con 0x7f1dc406d520 2024-09-12T02:35:37.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.066+0000 7f1dcb4aa640 1 -- 172.21.15.60:0/1866294543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1dc406d520 msgr2=0x7f1dc414fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:37.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.066+0000 7f1dcb4aa640 1 --2- 172.21.15.60:0/1866294543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1dc406d520 0x7f1dc414fe90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1dc40c4bf0 tx=0x7f1dbc02b790 comp rx=0 tx=0).stop 2024-09-12T02:35:37.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.067+0000 7f1dcb4aa640 1 -- 172.21.15.60:0/1866294543 shutdown_connections 2024-09-12T02:35:37.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.067+0000 7f1dcb4aa640 1 --2- 172.21.15.60:0/1866294543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1dc406d520 0x7f1dc414fe90 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.067+0000 7f1dcb4aa640 1 --2- 172.21.15.60:0/1866294543 >> v2:172.21.15.60:3300/0 conn(0x7f1dc4153370 0x7f1dc414f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.067+0000 7f1dcb4aa640 1 -- 172.21.15.60:0/1866294543 >> 172.21.15.60:0/1866294543 conn(0x7f1dc406c000 msgr2=0x7f1dc406c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:37.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.070+0000 7f1dcb4aa640 1 -- 172.21.15.60:0/1866294543 shutdown_connections 2024-09-12T02:35:37.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.070+0000 7f1dcb4aa640 1 -- 172.21.15.60:0/1866294543 wait complete. 2024-09-12T02:35:37.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.072+0000 7f1dcb4aa640 1 Processor -- start 2024-09-12T02:35:37.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.073+0000 7f1dcb4aa640 1 -- start start 2024-09-12T02:35:37.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.074+0000 7f1dcb4aa640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1dc406d520 0x7f1dc40c7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:37.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.075+0000 7f1dcb4aa640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1dc40c5390 0x7f1dc4073c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:37.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.075+0000 7f1dcb4aa640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1dc4153370 0x7f1dc4072070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:37.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.075+0000 7f1dcb4aa640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc406da70 con 0x7f1dc4153370 2024-09-12T02:35:37.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.075+0000 7f1dcb4aa640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc40c5770 con 0x7f1dc406d520 2024-09-12T02:35:37.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.075+0000 7f1dcb4aa640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1dc41eaef0 con 0x7f1dc40c5390 2024-09-12T02:35:37.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.075+0000 7f1dca4a8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1dc406d520 0x7f1dc40c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:37.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.075+0000 7f1dc9ca7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1dc40c5390 0x7f1dc4073c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:37.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.075+0000 7f1dcaca9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1dc4153370 0x7f1dc4072070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:37.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.075+0000 7f1dca4a8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1dc406d520 0x7f1dc40c7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:38316/0 (socket says 172.21.15.60:38316) 2024-09-12T02:35:37.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.075+0000 7f1dca4a8640 1 -- 172.21.15.60:0/2020170868 learned_addr learned my addr 172.21.15.60:0/2020170868 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:35:37.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.076+0000 7f1dcaca9640 1 -- 172.21.15.60:0/2020170868 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1dc40c5390 msgr2=0x7f1dc4073c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:37.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.076+0000 7f1dcaca9640 1 --2- 172.21.15.60:0/2020170868 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1dc40c5390 0x7f1dc4073c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.076+0000 7f1dcaca9640 1 -- 172.21.15.60:0/2020170868 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1dc406d520 msgr2=0x7f1dc40c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:37.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.076+0000 7f1dcaca9640 1 --2- 172.21.15.60:0/2020170868 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1dc406d520 0x7f1dc40c7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.076+0000 7f1dcaca9640 1 -- 172.21.15.60:0/2020170868 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dc40c7be0 con 0x7f1dc4153370 2024-09-12T02:35:37.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.076+0000 7f1dc9ca7640 1 --2- 172.21.15.60:0/2020170868 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1dc40c5390 0x7f1dc4073c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:37.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.076+0000 7f1dcaca9640 1 --2- 172.21.15.60:0/2020170868 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1dc4153370 0x7f1dc4072070 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc031000 tx=0x7f1dbc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:37.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.076+0000 7f1dbaffd640 1 -- 172.21.15.60:0/2020170868 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc037050 con 0x7f1dc4153370 2024-09-12T02:35:37.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.077+0000 7f1dbaffd640 1 -- 172.21.15.60:0/2020170868 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dbc041070 con 0x7f1dc4153370 2024-09-12T02:35:37.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.077+0000 7f1dcb4aa640 1 -- 172.21.15.60:0/2020170868 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dc41eb140 con 0x7f1dc4153370 2024-09-12T02:35:37.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.077+0000 7f1dcb4aa640 1 -- 172.21.15.60:0/2020170868 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dc40741a0 con 0x7f1dc4153370 2024-09-12T02:35:37.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.077+0000 7f1dbaffd640 1 -- 172.21.15.60:0/2020170868 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc009510 con 0x7f1dc4153370 2024-09-12T02:35:37.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.078+0000 7f1dcb4aa640 1 --2- 172.21.15.60:0/2020170868 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1dc414e500 0x7f1dc40725b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:37.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.078+0000 7f1dcb4aa640 1 -- 172.21.15.60:0/2020170868 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1dc406dbf0 con 0x7f1dc414e500 2024-09-12T02:35:37.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.079+0000 7f1dca4a8640 1 --2- 172.21.15.60:0/2020170868 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1dc414e500 0x7f1dc40725b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:37.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.079+0000 7f1dbaffd640 1 -- 172.21.15.60:0/2020170868 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1dbc007b70 con 0x7f1dc4153370 2024-09-12T02:35:37.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.080+0000 7f1dca4a8640 1 -- 172.21.15.60:0/2020170868 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1dc414b520 con 0x7f1dc414e500 2024-09-12T02:35:37.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.080+0000 7f1dca4a8640 1 --2- 172.21.15.60:0/2020170868 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1dc414e500 0x7f1dc40725b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1db400e770 tx=0x7f1db400ec30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:37.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.081+0000 7f1dbaffd640 1 --2- 172.21.15.60:0/2020170868 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1da806be30 0x7f1da806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:37.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.081+0000 7f1dbaffd640 1 -- 172.21.15.60:0/2020170868 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f1dbc0ab8c0 con 0x7f1dc4153370 2024-09-12T02:35:37.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.081+0000 7f1dc9ca7640 1 --2- 172.21.15.60:0/2020170868 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1da806be30 0x7f1da806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:37.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.081+0000 7f1dbaffd640 1 -- 172.21.15.60:0/2020170868 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db4017070 con 0x7f1dc414e500 2024-09-12T02:35:37.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.081+0000 7f1dbaffd640 1 -- 172.21.15.60:0/2020170868 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f1db400c7a0 con 0x7f1dc414e500 2024-09-12T02:35:37.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.081+0000 7f1dbaffd640 1 -- 172.21.15.60:0/2020170868 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1dc414e500 msgr2=0x7f1dc40725b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:37.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.081+0000 7f1dbaffd640 1 --2- 172.21.15.60:0/2020170868 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1dc414e500 0x7f1dc40725b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1db400e770 tx=0x7f1db400ec30 comp rx=0 tx=0).stop 2024-09-12T02:35:37.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.081+0000 7f1dbaffd640 1 -- 172.21.15.60:0/2020170868 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1dc414e500 msgr2=0x7f1dc40725b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:35:37.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.081+0000 7f1dbaffd640 1 --2- 172.21.15.60:0/2020170868 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1dc414e500 0x7f1dc40725b0 secure :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1db400e770 tx=0x7f1db400ec30 comp rx=0 tx=0).stop 2024-09-12T02:35:37.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.082+0000 7f1dc9ca7640 1 --2- 172.21.15.60:0/2020170868 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1da806be30 0x7f1da806e2f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1dc40c7500 tx=0x7f1dc00090e0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:37.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.093+0000 7f1dcb4aa640 1 --2- 172.21.15.60:0/2020170868 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1dc41ebb20 0x7f1dc41494d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:37.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.093+0000 7f1dcb4aa640 1 -- 172.21.15.60:0/2020170868 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1dc41f4270 con 0x7f1dc41ebb20 2024-09-12T02:35:37.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.093+0000 7f1dca4a8640 1 --2- 172.21.15.60:0/2020170868 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1dc41ebb20 0x7f1dc41494d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:37.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.095+0000 7f1dca4a8640 1 -- 172.21.15.60:0/2020170868 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1dc40abd60 con 0x7f1dc41ebb20 2024-09-12T02:35:37.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.095+0000 7f1dca4a8640 1 --2- 172.21.15.60:0/2020170868 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1dc41ebb20 0x7f1dc41494d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1db4009fd0 tx=0x7f1db40046b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:37.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.096+0000 7f1dbaffd640 1 -- 172.21.15.60:0/2020170868 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db4017070 con 0x7f1dc41ebb20 2024-09-12T02:35:37.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.096+0000 7f1dbaffd640 1 -- 172.21.15.60:0/2020170868 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4884 (secure 0 0 0) 0x7f1db4006250 con 0x7f1dc41ebb20 2024-09-12T02:35:37.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.096+0000 7f1dbaffd640 1 -- 172.21.15.60:0/2020170868 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1dc41ebb20 msgr2=0x7f1dc41494d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:37.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.096+0000 7f1dbaffd640 1 --2- 172.21.15.60:0/2020170868 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1dc41ebb20 0x7f1dc41494d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1db4009fd0 tx=0x7f1db40046b0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.096+0000 7f1dbaffd640 1 -- 172.21.15.60:0/2020170868 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1dc41ebb20 msgr2=0x7f1dc41494d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:35:37.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.096+0000 7f1dbaffd640 1 --2- 172.21.15.60:0/2020170868 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1dc41ebb20 0x7f1dc41494d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.098 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:35:37.098 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:35:37.098 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:35:37.098 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:35:37.098 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 124, 2024-09-12T02:35:37.098 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 210851, 2024-09-12T02:35:37.098 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:35:37.098 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:35:37.099 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:35:37.099 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:35:37.099 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:35:37.099 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-09-12T02:35:37.099 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:35:37.099 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:35:37.099 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:35:37.099 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:35:37.099 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:35:37.099 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:35:37.099 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:35:37.099 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:35:37.100 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:35:37.100 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:35:37.100 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:35:37.100 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:35:37.100 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:35:37.100 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:35:37.100 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:35:37.100 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:35:37.100 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:35:37.100 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:35:37.100 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:35:37.100 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:35:37.101 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:35:37.101 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:35:37.101 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:35:37.101 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:35:37.101 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:35:37.101 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:35:37.101 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:35:37.101 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:35:37.101 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:37.101 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:37.102 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:35:37.102 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:35:37.102 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:35:37.102 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:35:37.102 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:35:37.102 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:35:37.102 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:35:37.102 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:35:37.102 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:35:37.102 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:35:37.102 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:35:37.102 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:35:37.102 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:35:37.103 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:35:37.103 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:35:37.103 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:35:37.103 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:35:37.103 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:35:37.103 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:35:37.103 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:35:37.103 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:35:37.103 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:35:37.103 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:35:37.103 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:35:37.103 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:35:37.103 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:35:37.104 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:35:37.104 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:35:37.104 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:35:37.104 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:35:37.104 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:37.104 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:35:37.104 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:37.104 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:35:37.104 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:35:37.104 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:35:37.104 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:35:37.104 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:37.104 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:35:37.104 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:35:37.105 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:37.105 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:37.105 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:37.105 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:35:37.105 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:35:37.105 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:37.105 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:37.105 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:37.105 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:37.105 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:35:37.105 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:35:37.105 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:35:37.105 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:35:37.106 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:35:37.106 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:37.106 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:37.106 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:35:37.106 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:35:37.106 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:35:37.106 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:35:37.106 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:37.106 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:35:37.106 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:35:37.106 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:37.106 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:37.106 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:37.107 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:35:37.107 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:35:37.107 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:37.107 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:37.107 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:37.107 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:37.107 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:35:37.107 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:35:37.107 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:35:37.107 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:35:37.107 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:35:37.107 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:37.107 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:37.107 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:35:37.108 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:35:37.108 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:35:37.108 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:35:37.108 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:37.108 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:35:37.108 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:35:37.108 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:37.108 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:37.108 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:37.108 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:35:37.108 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:35:37.108 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:37.108 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:37.109 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:37.109 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:37.109 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:35:37.109 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:35:37.109 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:35:37.109 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:35:37.109 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:35:37.109 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:37.109 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:37.109 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:37.109 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:35:37.109 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:35:37.109 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:37.110 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:35:37.110 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:35:37.110 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:35:37.110 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:37.110 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:35:37.110 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:35:37.110 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:37.110 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:35:37.110 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:35:37.110 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:35:37.110 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:37.110 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:35:37.110 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:35:37.110 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:37.111 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:35:37.111 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:35:37.111 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:35:37.111 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:37.111 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:35:37.111 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:35:37.111 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:37.111 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:35:37.111 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:35:37.111 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:35:37.111 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:37.111 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:37.111 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:37.112 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:35:37.112 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:35:37.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.098+0000 7f1dcb4aa640 1 -- 172.21.15.60:0/2020170868 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1da806be30 msgr2=0x7f1da806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:37.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.098+0000 7f1dcb4aa640 1 --2- 172.21.15.60:0/2020170868 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f1da806be30 0x7f1da806e2f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1dc40c7500 tx=0x7f1dc00090e0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.098+0000 7f1dcb4aa640 1 -- 172.21.15.60:0/2020170868 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1dc4153370 msgr2=0x7f1dc4072070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:37.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.098+0000 7f1dcb4aa640 1 --2- 172.21.15.60:0/2020170868 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1dc4153370 0x7f1dc4072070 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc031000 tx=0x7f1dbc004a40 comp rx=0 tx=0).stop 2024-09-12T02:35:37.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.099+0000 7f1dcaca9640 1 -- 172.21.15.60:0/2020170868 reap_dead start 2024-09-12T02:35:37.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.099+0000 7f1dcaca9640 1 -- 172.21.15.60:0/2020170868 reap_dead start 2024-09-12T02:35:37.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.099+0000 7f1dcb4aa640 1 -- 172.21.15.60:0/2020170868 shutdown_connections 2024-09-12T02:35:37.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.099+0000 7f1dcb4aa640 1 -- 172.21.15.60:0/2020170868 >> 172.21.15.60:0/2020170868 conn(0x7f1dc406c000 msgr2=0x7f1dc414ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:37.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.099+0000 7f1dcb4aa640 1 -- 172.21.15.60:0/2020170868 shutdown_connections 2024-09-12T02:35:37.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.099+0000 7f1dcb4aa640 1 -- 172.21.15.60:0/2020170868 wait complete. 2024-09-12T02:35:37.123 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:35:37.123 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-12T02:35:37.123 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-12T02:35:37.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.301+0000 7ff3b988f640 1 Processor -- start 2024-09-12T02:35:37.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.301+0000 7ff3b988f640 1 -- start start 2024-09-12T02:35:37.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.303+0000 7ff3b988f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3ac0d8170 0x7ff3ac04a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:37.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.303+0000 7ff3b988f640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff3ac0072a0 0x7ff3ac00b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:37.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.303+0000 7ff3b988f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff3ac00b620 0x7ff3ac0ddfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:37.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.303+0000 7ff3b988f640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7ff3ac046d10 con 0x7ff3ac00b620 2024-09-12T02:35:37.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.303+0000 7ff3b988f640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff3ac04b190 con 0x7ff3ac0072a0 2024-09-12T02:35:37.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.304+0000 7ff3b988f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff3ac04aeb0 con 0x7ff3ac0d8170 2024-09-12T02:35:37.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.304+0000 7ff3b888d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3ac0d8170 0x7ff3ac04a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:37.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.304+0000 7ff3b888d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3ac0d8170 0x7ff3ac04a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:58474/0 (socket says 172.21.15.60:58474) 2024-09-12T02:35:37.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.304+0000 7ff3b3fff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff3ac0072a0 0x7ff3ac00b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:37.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.304+0000 7ff3b3fff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff3ac0072a0 0x7ff3ac00b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:38330/0 (socket says 172.21.15.60:38330) 2024-09-12T02:35:37.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.304+0000 7ff3b888d640 1 -- 172.21.15.60:0/2650567882 learned_addr learned my addr 172.21.15.60:0/2650567882 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:35:37.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.304+0000 7ff3b908e640 1 --2- 172.21.15.60:0/2650567882 >> v2:172.21.15.60:3300/0 conn(0x7ff3ac00b620 0x7ff3ac0ddfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:37.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.305+0000 7ff3b908e640 1 -- 172.21.15.60:0/2650567882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3ac0d8170 msgr2=0x7ff3ac04a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:37.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.305+0000 7ff3b908e640 1 --2- 172.21.15.60:0/2650567882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3ac0d8170 0x7ff3ac04a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.305+0000 7ff3b908e640 1 -- 172.21.15.60:0/2650567882 >> v2:172.21.15.105:3300/0 conn(0x7ff3ac0072a0 msgr2=0x7ff3ac00b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:37.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.305+0000 7ff3b908e640 1 --2- 172.21.15.60:0/2650567882 >> v2:172.21.15.105:3300/0 conn(0x7ff3ac0072a0 0x7ff3ac00b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.305+0000 7ff3b908e640 1 -- 172.21.15.60:0/2650567882 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3ac0472d0 con 0x7ff3ac00b620 2024-09-12T02:35:37.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.307+0000 7ff3b908e640 1 --2- 172.21.15.60:0/2650567882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3ac00b620 0x7ff3ac0ddfc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac00d590 tx=0x7ff3a802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ca88112e2c35db9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:37.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.308+0000 7ff3b37fe640 1 -- 172.21.15.60:0/2650567882 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a8037070 con 0x7ff3ac00b620 2024-09-12T02:35:37.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.309+0000 7ff3b37fe640 1 -- 172.21.15.60:0/2650567882 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3a802ae50 con 0x7ff3ac00b620 2024-09-12T02:35:37.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.309+0000 7ff3b37fe640 1 -- 172.21.15.60:0/2650567882 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a8032660 con 0x7ff3ac00b620 2024-09-12T02:35:37.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.310+0000 7ff3b988f640 1 -- 172.21.15.60:0/2650567882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3ac00b620 msgr2=0x7ff3ac0ddfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:37.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.310+0000 7ff3b988f640 1 --2- 172.21.15.60:0/2650567882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3ac00b620 0x7ff3ac0ddfc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac00d590 tx=0x7ff3a802a100 comp rx=0 tx=0).stop 2024-09-12T02:35:37.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.312+0000 7ff3b988f640 1 -- 172.21.15.60:0/2650567882 shutdown_connections 2024-09-12T02:35:37.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.312+0000 7ff3b988f640 1 --2- 172.21.15.60:0/2650567882 >> v2:172.21.15.105:3300/0 conn(0x7ff3ac0072a0 0x7ff3ac00b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.312+0000 7ff3b988f640 1 --2- 172.21.15.60:0/2650567882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3ac00b620 0x7ff3ac0ddfc0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.312+0000 7ff3b988f640 1 --2- 172.21.15.60:0/2650567882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3ac0d8170 0x7ff3ac04a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.312+0000 7ff3b988f640 1 -- 172.21.15.60:0/2650567882 >> 172.21.15.60:0/2650567882 conn(0x7ff3ac048160 msgr2=0x7ff3ac048570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:37.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.313+0000 7ff3b988f640 1 -- 172.21.15.60:0/2650567882 shutdown_connections 2024-09-12T02:35:37.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.313+0000 7ff3b988f640 1 -- 172.21.15.60:0/2650567882 wait complete. 2024-09-12T02:35:37.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.315+0000 7ff3b988f640 1 Processor -- start 2024-09-12T02:35:37.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.315+0000 7ff3b988f640 1 -- start start 2024-09-12T02:35:37.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.317+0000 7ff3b988f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3ac0072a0 0x7ff3ac045030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:37.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.317+0000 7ff3b988f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3ac00b620 0x7ff3ac0dc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:37.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.317+0000 7ff3b988f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3ac0d8170 0x7ff3ac0dc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:37.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.317+0000 7ff3b988f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff3ac047db0 con 0x7ff3ac00b620 2024-09-12T02:35:37.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.317+0000 7ff3b988f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff3ac047890 con 0x7ff3ac0d8170 2024-09-12T02:35:37.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.317+0000 7ff3b988f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff3ac047f30 con 0x7ff3ac0072a0 2024-09-12T02:35:37.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.317+0000 7ff3b888d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3ac0072a0 0x7ff3ac045030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:37.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.317+0000 7ff3b888d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3ac0072a0 0x7ff3ac045030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:58490/0 (socket says 172.21.15.60:58490) 2024-09-12T02:35:37.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.317+0000 7ff3b888d640 1 -- 172.21.15.60:0/4080095025 learned_addr learned my addr 172.21.15.60:0/4080095025 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:35:37.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.318+0000 7ff3b908e640 1 --2- 172.21.15.60:0/4080095025 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3ac0d8170 0x7ff3ac0dc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:37.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.318+0000 7ff3b3fff640 1 --2- 172.21.15.60:0/4080095025 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3ac00b620 0x7ff3ac0dc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:37.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.318+0000 7ff3b888d640 1 -- 172.21.15.60:0/4080095025 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3ac0d8170 msgr2=0x7ff3ac0dc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:37.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.318+0000 7ff3b888d640 1 --2- 172.21.15.60:0/4080095025 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3ac0d8170 0x7ff3ac0dc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.318+0000 7ff3b888d640 1 -- 172.21.15.60:0/4080095025 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3ac00b620 msgr2=0x7ff3ac0dc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:37.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.319+0000 7ff3b888d640 1 --2- 172.21.15.60:0/4080095025 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3ac00b620 0x7ff3ac0dc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.319+0000 7ff3b888d640 1 -- 172.21.15.60:0/4080095025 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3ac040750 con 0x7ff3ac0072a0 2024-09-12T02:35:37.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.319+0000 7ff3b888d640 1 --2- 172.21.15.60:0/4080095025 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3ac0072a0 0x7ff3ac045030 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4051220 tx=0x7ff3b40699a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:37.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.320+0000 7ff3b17fa640 1 -- 172.21.15.60:0/4080095025 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b409b070 con 0x7ff3ac0072a0 2024-09-12T02:35:37.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.320+0000 7ff3b17fa640 1 -- 172.21.15.60:0/4080095025 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3b40743c0 con 0x7ff3ac0072a0 2024-09-12T02:35:37.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.321+0000 7ff3b17fa640 1 -- 172.21.15.60:0/4080095025 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b40747b0 con 0x7ff3ac0072a0 2024-09-12T02:35:37.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.321+0000 7ff3b988f640 1 -- 172.21.15.60:0/4080095025 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3ac0412e0 con 0x7ff3ac0072a0 2024-09-12T02:35:37.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.322+0000 7ff3b988f640 1 -- 172.21.15.60:0/4080095025 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3ac0415a0 con 0x7ff3ac0072a0 2024-09-12T02:35:37.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.324+0000 7ff3b988f640 1 -- 172.21.15.60:0/4080095025 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3ac00b0e0 con 0x7ff3ac0072a0 2024-09-12T02:35:37.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.325+0000 7ff3b17fa640 1 -- 172.21.15.60:0/4080095025 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff3b409e070 con 0x7ff3ac0072a0 2024-09-12T02:35:37.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.325+0000 7ff3b17fa640 1 --2- 172.21.15.60:0/4080095025 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff39806bf30 0x7ff39806e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:37.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.326+0000 7ff3b17fa640 1 -- 172.21.15.60:0/4080095025 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7ff3b4107110 con 0x7ff3ac0072a0 2024-09-12T02:35:37.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.326+0000 7ff3b3fff640 1 --2- 172.21.15.60:0/4080095025 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff39806bf30 0x7ff39806e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:37.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.327+0000 7ff3b3fff640 1 --2- 172.21.15.60:0/4080095025 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff39806bf30 0x7ff39806e3f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac0402b0 tx=0x7ff3a0009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:37.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.333+0000 7ff3b17fa640 1 -- 172.21.15.60:0/4080095025 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff3b4093070 con 0x7ff3ac0072a0 2024-09-12T02:35:37.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.849+0000 7ff3b988f640 1 -- 172.21.15.60:0/4080095025 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7ff3ac0458e0 con 0x7ff3ac0072a0 2024-09-12T02:35:37.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.853+0000 7ff3b17fa640 1 -- 172.21.15.60:0/4080095025 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7ff3b40d5140 con 0x7ff3ac0072a0 2024-09-12T02:35:37.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.859+0000 7ff39effd640 1 -- 172.21.15.60:0/4080095025 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff39806bf30 msgr2=0x7ff39806e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:37.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.859+0000 7ff39effd640 1 --2- 172.21.15.60:0/4080095025 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff39806bf30 0x7ff39806e3f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac0402b0 tx=0x7ff3a0009190 comp rx=0 tx=0).stop 2024-09-12T02:35:37.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.859+0000 7ff39effd640 1 -- 172.21.15.60:0/4080095025 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3ac0072a0 msgr2=0x7ff3ac045030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:37.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.859+0000 7ff39effd640 1 --2- 172.21.15.60:0/4080095025 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3ac0072a0 0x7ff3ac045030 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4051220 tx=0x7ff3b40699a0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.860+0000 7ff39effd640 1 -- 172.21.15.60:0/4080095025 shutdown_connections 2024-09-12T02:35:37.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.860+0000 7ff39effd640 1 --2- 172.21.15.60:0/4080095025 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff39806bf30 0x7ff39806e3f0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.860+0000 7ff39effd640 1 --2- 172.21.15.60:0/4080095025 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3ac0d8170 0x7ff3ac0dc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.860+0000 7ff39effd640 1 --2- 172.21.15.60:0/4080095025 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3ac00b620 0x7ff3ac0dc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.860+0000 7ff39effd640 1 --2- 172.21.15.60:0/4080095025 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3ac0072a0 0x7ff3ac045030 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.860+0000 7ff39effd640 1 -- 172.21.15.60:0/4080095025 >> 172.21.15.60:0/4080095025 conn(0x7ff3ac048160 msgr2=0x7ff3ac0d6c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:37.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.860+0000 7ff39effd640 1 -- 172.21.15.60:0/4080095025 shutdown_connections 2024-09-12T02:35:37.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:37.862+0000 7ff39effd640 1 -- 172.21.15.60:0/4080095025 wait complete. 2024-09-12T02:35:37.886 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-12T02:35:47.887 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-12T02:35:47.887 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:35:48.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.077+0000 7faa2f880640 1 Processor -- start 2024-09-12T02:35:48.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.080+0000 7faa2f880640 1 -- start start 2024-09-12T02:35:48.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.081+0000 7faa2f880640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7faa28067bc0 0x7faa28156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:48.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.081+0000 7faa2f880640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa280ca010 0x7faa280ca430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:48.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.081+0000 7faa2f880640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa2806d1c0 con 0x7faa280c6190 2024-09-12T02:35:48.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.081+0000 7faa2f880640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7faa2806d460 con 0x7faa28067bc0 2024-09-12T02:35:48.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.081+0000 7faa2f880640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7faa2806d740 con 0x7faa280ca010 2024-09-12T02:35:48.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.081+0000 7faa2d61c640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7faa28067bc0 0x7faa28156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:48.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.082+0000 7faa2ce1b640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7faa280c6190 0x7faa28153640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:40334/0 (socket says 172.21.15.60:40334) 2024-09-12T02:35:48.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.082+0000 7faa2ce1b640 1 -- 172.21.15.60:0/448447242 learned_addr learned my addr 172.21.15.60:0/448447242 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:35:48.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.082+0000 7faa2d61c640 1 -- 172.21.15.60:0/448447242 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa280ca010 msgr2=0x7faa280ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:48.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.082+0000 7faa2d61c640 1 --2- 172.21.15.60:0/448447242 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa280ca010 0x7faa280ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.082+0000 7faa2d61c640 1 -- 172.21.15.60:0/448447242 >> v1:172.21.15.105:6789/0 conn(0x7faa280c6190 legacy=0x7faa28153640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:48.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.083+0000 7faa2d61c640 1 -- 172.21.15.60:0/448447242 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa2806da20 con 0x7faa28067bc0 2024-09-12T02:35:48.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.084+0000 7faa2d61c640 1 --2- 172.21.15.60:0/448447242 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa28067bc0 0x7faa28156cc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7faa20009d90 tx=0x7faa2002a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd2f9030068b0d1f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:48.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.084+0000 7faa1ffff640 1 -- 172.21.15.60:0/448447242 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa20031600 con 0x7faa28067bc0 2024-09-12T02:35:48.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.084+0000 7faa1ffff640 1 -- 172.21.15.60:0/448447242 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa200317a0 con 0x7faa28067bc0 2024-09-12T02:35:48.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.085+0000 7faa1ffff640 1 -- 172.21.15.60:0/448447242 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa20031b70 con 0x7faa28067bc0 2024-09-12T02:35:48.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.086+0000 7faa2f880640 1 -- 172.21.15.60:0/448447242 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa28067bc0 msgr2=0x7faa28156cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:48.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.086+0000 7faa2f880640 1 --2- 172.21.15.60:0/448447242 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa28067bc0 0x7faa28156cc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7faa20009d90 tx=0x7faa2002a5d0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.086+0000 7faa2f880640 1 -- 172.21.15.60:0/448447242 shutdown_connections 2024-09-12T02:35:48.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.086+0000 7faa2f880640 1 --2- 172.21.15.60:0/448447242 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa280ca010 0x7faa280ca430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.086+0000 7faa2f880640 1 --2- 172.21.15.60:0/448447242 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa28067bc0 0x7faa28156cc0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.086+0000 7faa2f880640 1 -- 172.21.15.60:0/448447242 >> 172.21.15.60:0/448447242 conn(0x7faa280c87f0 msgr2=0x7faa280c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:48.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.086+0000 7faa2f880640 1 -- 172.21.15.60:0/448447242 shutdown_connections 2024-09-12T02:35:48.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.087+0000 7faa2f880640 1 -- 172.21.15.60:0/448447242 wait complete. 2024-09-12T02:35:48.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.088+0000 7faa2f880640 1 Processor -- start 2024-09-12T02:35:48.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.088+0000 7faa2f880640 1 -- start start 2024-09-12T02:35:48.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.090+0000 7faa2f880640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa28067bc0 0x7faa2815a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:48.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.090+0000 7faa2f880640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa280c6190 0x7faa28155880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:48.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.090+0000 7faa2d61c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa28067bc0 0x7faa2815a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:48.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.090+0000 7faa2d61c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa28067bc0 0x7faa2815a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:39872/0 (socket says 172.21.15.60:39872) 2024-09-12T02:35:48.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.090+0000 7faa2ce1b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa280c6190 0x7faa28155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:48.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.091+0000 7faa2ce1b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa280c6190 0x7faa28155880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:48588/0 (socket says 172.21.15.60:48588) 2024-09-12T02:35:48.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.091+0000 7faa2d61c640 1 -- 172.21.15.60:0/4248659262 learned_addr learned my addr 172.21.15.60:0/4248659262 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:35:48.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.091+0000 7faa2f880640 1 --2- 172.21.15.60:0/4248659262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa280ca010 0x7faa281f87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:48.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.091+0000 7faa2de1d640 1 --2- 172.21.15.60:0/4248659262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa280ca010 0x7faa281f87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:48.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.091+0000 7faa2f880640 1 -- 172.21.15.60:0/4248659262 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7faa28153ed0 con 0x7faa280ca010 2024-09-12T02:35:48.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.091+0000 7faa2f880640 1 -- 172.21.15.60:0/4248659262 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7faa28153d50 con 0x7faa28067bc0 2024-09-12T02:35:48.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.091+0000 7faa2f880640 1 -- 172.21.15.60:0/4248659262 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7faa28067fa0 con 0x7faa280c6190 2024-09-12T02:35:48.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.093+0000 7faa2d61c640 1 -- 172.21.15.60:0/4248659262 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa280c6190 msgr2=0x7faa28155880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:48.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.093+0000 7faa2d61c640 1 --2- 172.21.15.60:0/4248659262 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa280c6190 0x7faa28155880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.093+0000 7faa2d61c640 1 -- 172.21.15.60:0/4248659262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa280ca010 msgr2=0x7faa281f87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:48.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.093+0000 7faa2d61c640 1 --2- 172.21.15.60:0/4248659262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa280ca010 0x7faa281f87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.093+0000 7faa2d61c640 1 -- 172.21.15.60:0/4248659262 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa28158650 con 0x7faa28067bc0 2024-09-12T02:35:48.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.093+0000 7faa2de1d640 1 --2- 172.21.15.60:0/4248659262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa280ca010 0x7faa281f87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:48.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.093+0000 7faa2d61c640 1 --2- 172.21.15.60:0/4248659262 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa28067bc0 0x7faa2815a560 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7faa20009eb0 tx=0x7faa20004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:48.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.094+0000 7faa1dffb640 1 -- 172.21.15.60:0/4248659262 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa20040070 con 0x7faa28067bc0 2024-09-12T02:35:48.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.094+0000 7faa1dffb640 1 -- 172.21.15.60:0/4248659262 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa20030cb0 con 0x7faa28067bc0 2024-09-12T02:35:48.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.094+0000 7faa1dffb640 1 -- 172.21.15.60:0/4248659262 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa20030e60 con 0x7faa28067bc0 2024-09-12T02:35:48.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.094+0000 7faa2f880640 1 -- 172.21.15.60:0/4248659262 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa28158090 con 0x7faa28067bc0 2024-09-12T02:35:48.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.094+0000 7faa2f880640 1 -- 172.21.15.60:0/4248659262 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa28159d60 con 0x7faa28067bc0 2024-09-12T02:35:48.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.095+0000 7faa2f880640 1 -- 172.21.15.60:0/4248659262 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa28156cc0 con 0x7faa28067bc0 2024-09-12T02:35:48.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.096+0000 7faa1dffb640 1 -- 172.21.15.60:0/4248659262 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faa20039040 con 0x7faa28067bc0 2024-09-12T02:35:48.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.097+0000 7faa1dffb640 1 --2- 172.21.15.60:0/4248659262 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7faa0c06be30 0x7faa0c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:48.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.097+0000 7faa1dffb640 1 -- 172.21.15.60:0/4248659262 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7faa200acad0 con 0x7faa28067bc0 2024-09-12T02:35:48.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.097+0000 7faa2ce1b640 1 --2- 172.21.15.60:0/4248659262 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7faa0c06be30 0x7faa0c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:48.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.098+0000 7faa2ce1b640 1 --2- 172.21.15.60:0/4248659262 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7faa0c06be30 0x7faa0c06e2f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7faa280b21b0 tx=0x7faa24009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:48.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.109+0000 7faa1dffb640 1 -- 172.21.15.60:0/4248659262 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faa2007b1f0 con 0x7faa28067bc0 2024-09-12T02:35:48.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.619+0000 7faa2f880640 1 -- 172.21.15.60:0/4248659262 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7faa28159b30 con 0x7faa28067bc0 2024-09-12T02:35:48.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.623+0000 7faa1dffb640 1 -- 172.21.15.60:0/4248659262 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1566 (secure 0 0 0) 0x7faa2007aaf0 con 0x7faa28067bc0 2024-09-12T02:35:48.627 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":124,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:35:48.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.627+0000 7faa2f880640 1 -- 172.21.15.60:0/4248659262 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7faa0c06be30 msgr2=0x7faa0c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:48.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.627+0000 7faa2f880640 1 --2- 172.21.15.60:0/4248659262 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7faa0c06be30 0x7faa0c06e2f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7faa280b21b0 tx=0x7faa24009040 comp rx=0 tx=0).stop 2024-09-12T02:35:48.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.627+0000 7faa2f880640 1 -- 172.21.15.60:0/4248659262 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa28067bc0 msgr2=0x7faa2815a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:48.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.628+0000 7faa2f880640 1 --2- 172.21.15.60:0/4248659262 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa28067bc0 0x7faa2815a560 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7faa20009eb0 tx=0x7faa20004a40 comp rx=0 tx=0).stop 2024-09-12T02:35:48.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.632+0000 7faa2f880640 1 -- 172.21.15.60:0/4248659262 shutdown_connections 2024-09-12T02:35:48.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.632+0000 7faa2f880640 1 --2- 172.21.15.60:0/4248659262 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7faa0c06be30 0x7faa0c06e2f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.632+0000 7faa2f880640 1 --2- 172.21.15.60:0/4248659262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa280ca010 0x7faa281f87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.632+0000 7faa2f880640 1 --2- 172.21.15.60:0/4248659262 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa280c6190 0x7faa28155880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.632+0000 7faa2f880640 1 --2- 172.21.15.60:0/4248659262 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa28067bc0 0x7faa2815a560 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.632+0000 7faa2f880640 1 -- 172.21.15.60:0/4248659262 >> 172.21.15.60:0/4248659262 conn(0x7faa280c87f0 msgr2=0x7faa280c72e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:48.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.636+0000 7faa2f880640 1 -- 172.21.15.60:0/4248659262 shutdown_connections 2024-09-12T02:35:48.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.636+0000 7faa2f880640 1 -- 172.21.15.60:0/4248659262 wait complete. 2024-09-12T02:35:48.659 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-12T02:35:48.660 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-12T02:35:48.660 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-12T02:35:48.660 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-12T02:35:48.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.843+0000 7faa31837640 1 Processor -- start 2024-09-12T02:35:48.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.843+0000 7faa31837640 1 -- start start 2024-09-12T02:35:48.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.844+0000 7faa31837640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa2c157f50 0x7faa2c071140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:48.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.844+0000 7faa31837640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7faa2c0ab9b0 0x7faa2c0abe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:48.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.844+0000 7faa31837640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa2c158330 con 0x7faa2c073ec0 2024-09-12T02:35:48.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.844+0000 7faa31837640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7faa2c15a7a0 con 0x7faa2c0ab9b0 2024-09-12T02:35:48.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.844+0000 7faa31837640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7faa2c15aa80 con 0x7faa2c157f50 2024-09-12T02:35:48.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.845+0000 7faa2b7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7faa2c0ab9b0 0x7faa2c0abe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:48.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.845+0000 7faa2b7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7faa2c0ab9b0 0x7faa2c0abe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53630/0 (socket says 172.21.15.60:53630) 2024-09-12T02:35:48.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.845+0000 7faa2b7fe640 1 -- 172.21.15.60:0/334917560 learned_addr learned my addr 172.21.15.60:0/334917560 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:35:48.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.845+0000 7faa2affd640 1 --2- 172.21.15.60:0/334917560 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa2c157f50 0x7faa2c071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:48.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.845+0000 7faa2b7fe640 1 -- 172.21.15.60:0/334917560 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa2c157f50 msgr2=0x7faa2c071140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:48.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.845+0000 7faa2b7fe640 1 --2- 172.21.15.60:0/334917560 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa2c157f50 0x7faa2c071140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.845+0000 7faa2b7fe640 1 -- 172.21.15.60:0/334917560 >> v1:172.21.15.105:6789/0 conn(0x7faa2c073ec0 legacy=0x7faa2c0ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:48.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.846+0000 7faa2b7fe640 1 -- 172.21.15.60:0/334917560 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa2c15ad60 con 0x7faa2c0ab9b0 2024-09-12T02:35:48.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.849+0000 7faa2b7fe640 1 --2- 172.21.15.60:0/334917560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa2c0ab9b0 0x7faa2c0abe30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7faa24009e50 tx=0x7faa2403b640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b380daecd364839 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:48.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.849+0000 7faa29ffb640 1 -- 172.21.15.60:0/334917560 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa24047070 con 0x7faa2c0ab9b0 2024-09-12T02:35:48.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.849+0000 7faa29ffb640 1 -- 172.21.15.60:0/334917560 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa24042600 con 0x7faa2c0ab9b0 2024-09-12T02:35:48.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.850+0000 7faa29ffb640 1 -- 172.21.15.60:0/334917560 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa2403be60 con 0x7faa2c0ab9b0 2024-09-12T02:35:48.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.850+0000 7faa31837640 1 -- 172.21.15.60:0/334917560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa2c0ab9b0 msgr2=0x7faa2c0abe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:48.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.850+0000 7faa31837640 1 --2- 172.21.15.60:0/334917560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa2c0ab9b0 0x7faa2c0abe30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7faa24009e50 tx=0x7faa2403b640 comp rx=0 tx=0).stop 2024-09-12T02:35:48.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.850+0000 7faa31837640 1 -- 172.21.15.60:0/334917560 shutdown_connections 2024-09-12T02:35:48.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.850+0000 7faa31837640 1 --2- 172.21.15.60:0/334917560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa2c0ab9b0 0x7faa2c0abe30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.850+0000 7faa31837640 1 --2- 172.21.15.60:0/334917560 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa2c157f50 0x7faa2c071140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.850+0000 7faa31837640 1 -- 172.21.15.60:0/334917560 >> 172.21.15.60:0/334917560 conn(0x7faa2c0c6980 msgr2=0x7faa2c0c6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:48.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.850+0000 7faa31837640 1 -- 172.21.15.60:0/334917560 shutdown_connections 2024-09-12T02:35:48.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.851+0000 7faa31837640 1 -- 172.21.15.60:0/334917560 wait complete. 2024-09-12T02:35:48.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.852+0000 7faa31837640 1 Processor -- start 2024-09-12T02:35:48.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.853+0000 7faa31837640 1 -- start start 2024-09-12T02:35:48.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.854+0000 7faa31837640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa2c073ec0 0x7faa2c15e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:48.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.854+0000 7faa31837640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa2c0ab9b0 0x7faa2c15d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:48.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.854+0000 7faa31837640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa2c157f50 0x7faa2c15d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:48.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.854+0000 7faa31837640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7faa2c0ad6b0 con 0x7faa2c073ec0 2024-09-12T02:35:48.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.854+0000 7faa31837640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7faa2c0ad530 con 0x7faa2c157f50 2024-09-12T02:35:48.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.854+0000 7faa31837640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7faa2c0ac370 con 0x7faa2c0ab9b0 2024-09-12T02:35:48.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.854+0000 7faa2b7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa2c157f50 0x7faa2c15d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:48.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.854+0000 7faa2b7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa2c157f50 0x7faa2c15d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:39882/0 (socket says 172.21.15.60:39882) 2024-09-12T02:35:48.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.854+0000 7faa2b7fe640 1 -- 172.21.15.60:0/2312773426 learned_addr learned my addr 172.21.15.60:0/2312773426 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:35:48.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.854+0000 7faa2a7fc640 1 --2- 172.21.15.60:0/2312773426 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa2c0ab9b0 0x7faa2c15d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:48.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.855+0000 7faa2affd640 1 --2- 172.21.15.60:0/2312773426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa2c073ec0 0x7faa2c15e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:48.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.855+0000 7faa2a7fc640 1 -- 172.21.15.60:0/2312773426 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa2c157f50 msgr2=0x7faa2c15d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:48.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.855+0000 7faa2a7fc640 1 --2- 172.21.15.60:0/2312773426 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa2c157f50 0x7faa2c15d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.855+0000 7faa2a7fc640 1 -- 172.21.15.60:0/2312773426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa2c073ec0 msgr2=0x7faa2c15e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:48.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.855+0000 7faa2a7fc640 1 --2- 172.21.15.60:0/2312773426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa2c073ec0 0x7faa2c15e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.855+0000 7faa2a7fc640 1 -- 172.21.15.60:0/2312773426 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa2c14b410 con 0x7faa2c0ab9b0 2024-09-12T02:35:48.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.855+0000 7faa2b7fe640 1 --2- 172.21.15.60:0/2312773426 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa2c157f50 0x7faa2c15d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:48.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.855+0000 7faa2a7fc640 1 --2- 172.21.15.60:0/2312773426 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa2c0ab9b0 0x7faa2c15d070 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7faa2000c390 tx=0x7faa2000c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:48.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.856+0000 7faa13fff640 1 -- 172.21.15.60:0/2312773426 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa20017070 con 0x7faa2c0ab9b0 2024-09-12T02:35:48.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.856+0000 7faa31837640 1 -- 172.21.15.60:0/2312773426 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa2c070340 con 0x7faa2c0ab9b0 2024-09-12T02:35:48.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.856+0000 7faa31837640 1 -- 172.21.15.60:0/2312773426 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7faa2c0c4da0 con 0x7faa2c0ab9b0 2024-09-12T02:35:48.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.856+0000 7faa13fff640 1 -- 172.21.15.60:0/2312773426 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa200052d0 con 0x7faa2c0ab9b0 2024-09-12T02:35:48.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.857+0000 7faa13fff640 1 -- 172.21.15.60:0/2312773426 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa20003830 con 0x7faa2c0ab9b0 2024-09-12T02:35:48.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.857+0000 7faa31837640 1 --2- 172.21.15.60:0/2312773426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa0c002a70 0x7faa0c004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:48.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.857+0000 7faa31837640 1 -- 172.21.15.60:0/2312773426 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c007ec0 con 0x7faa0c002a70 2024-09-12T02:35:48.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.858+0000 7faa2affd640 1 --2- 172.21.15.60:0/2312773426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa0c002a70 0x7faa0c004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:48.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.858+0000 7faa2affd640 1 -- 172.21.15.60:0/2312773426 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faa0c0080c0 con 0x7faa0c002a70 2024-09-12T02:35:48.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.859+0000 7faa13fff640 1 -- 172.21.15.60:0/2312773426 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faa2001a070 con 0x7faa2c0ab9b0 2024-09-12T02:35:48.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.859+0000 7faa2affd640 1 --2- 172.21.15.60:0/2312773426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa0c002a70 0x7faa0c004f30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faa1c00f810 tx=0x7faa1c00fcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:48.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.859+0000 7faa13fff640 1 --2- 172.21.15.60:0/2312773426 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7faa1806be60 0x7faa1806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:48.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.860+0000 7faa2b7fe640 1 --2- 172.21.15.60:0/2312773426 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7faa1806be60 0x7faa1806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:48.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.860+0000 7faa13fff640 1 -- 172.21.15.60:0/2312773426 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7faa2008a470 con 0x7faa2c0ab9b0 2024-09-12T02:35:48.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.860+0000 7faa13fff640 1 -- 172.21.15.60:0/2312773426 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1c00dc20 con 0x7faa0c002a70 2024-09-12T02:35:48.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.860+0000 7faa13fff640 1 -- 172.21.15.60:0/2312773426 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7faa1c00ddc0 con 0x7faa0c002a70 2024-09-12T02:35:48.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.860+0000 7faa13fff640 1 -- 172.21.15.60:0/2312773426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa0c002a70 msgr2=0x7faa0c004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:48.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.860+0000 7faa13fff640 1 --2- 172.21.15.60:0/2312773426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa0c002a70 0x7faa0c004f30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faa1c00f810 tx=0x7faa1c00fcd0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.860+0000 7faa13fff640 1 -- 172.21.15.60:0/2312773426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa0c002a70 msgr2=0x7faa0c004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:35:48.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.860+0000 7faa13fff640 1 --2- 172.21.15.60:0/2312773426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa0c002a70 0x7faa0c004f30 secure :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faa1c00f810 tx=0x7faa1c00fcd0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.861+0000 7faa2b7fe640 1 --2- 172.21.15.60:0/2312773426 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7faa1806be60 0x7faa1806e320 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7faa2403b680 tx=0x7faa24009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:48.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.872+0000 7faa31837640 1 --2- 172.21.15.60:0/2312773426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa0c006f00 0x7faa0c007390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:48.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.873+0000 7faa31837640 1 -- 172.21.15.60:0/2312773426 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c00a4a0 con 0x7faa0c006f00 2024-09-12T02:35:48.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.873+0000 7faa2affd640 1 --2- 172.21.15.60:0/2312773426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa0c006f00 0x7faa0c007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:48.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.873+0000 7faa2affd640 1 -- 172.21.15.60:0/2312773426 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7faa0c0078d0 con 0x7faa0c006f00 2024-09-12T02:35:48.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.874+0000 7faa2affd640 1 --2- 172.21.15.60:0/2312773426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa0c006f00 0x7faa0c007390 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7faa1c00f810 tx=0x7faa1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:48.876 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:35:48.876 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:35:48.876 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:35:48.876 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:35:48.877 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 124, 2024-09-12T02:35:48.877 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 89476, 2024-09-12T02:35:48.877 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:35:48.877 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:35:48.877 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:35:48.877 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:35:48.877 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:35:48.877 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 15, 2024-09-12T02:35:48.877 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:35:48.877 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:35:48.877 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:35:48.877 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:35:48.877 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:35:48.878 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:35:48.878 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:35:48.878 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:35:48.878 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:35:48.878 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:35:48.878 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:35:48.878 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:35:48.878 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:35:48.878 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:35:48.878 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:35:48.878 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:35:48.878 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:35:48.878 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:35:48.878 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:35:48.879 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:35:48.879 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:35:48.879 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:35:48.879 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:35:48.879 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:35:48.879 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:35:48.879 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:35:48.879 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:35:48.879 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:35:48.879 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:48.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:48.879 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:35:48.879 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:35:48.879 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:35:48.880 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:35:48.880 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:35:48.880 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:35:48.880 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:35:48.880 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:35:48.880 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:35:48.880 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:35:48.880 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:35:48.880 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:35:48.880 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:35:48.880 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:35:48.880 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:35:48.880 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:35:48.881 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:35:48.881 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:35:48.881 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:35:48.881 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:35:48.881 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:35:48.881 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:35:48.881 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:35:48.881 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:35:48.881 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:35:48.881 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:35:48.881 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:35:48.881 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:35:48.881 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:35:48.881 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:35:48.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:48.882 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:35:48.882 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:48.882 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:35:48.882 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:35:48.882 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:35:48.882 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:35:48.883 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:48.883 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:35:48.883 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:35:48.883 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:48.883 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:48.883 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:48.883 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:35:48.884 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:35:48.884 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:48.884 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:48.884 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:48.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:48.884 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:35:48.884 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:35:48.884 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:35:48.884 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:35:48.884 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:35:48.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:48.884 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:48.884 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:35:48.885 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:35:48.885 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:35:48.885 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:35:48.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:48.885 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:35:48.885 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:35:48.885 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:48.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:48.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:48.885 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:35:48.885 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:35:48.885 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:48.885 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:48.886 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:48.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:48.886 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:35:48.886 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:35:48.886 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:35:48.886 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:35:48.886 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:35:48.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:48.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:48.886 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:35:48.886 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:35:48.886 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:35:48.886 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:35:48.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:48.887 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:35:48.887 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:35:48.887 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:48.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:48.887 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:48.887 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:35:48.887 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:35:48.887 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:48.887 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:48.887 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:48.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:48.888 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:35:48.888 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:35:48.888 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:35:48.888 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:35:48.888 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:35:48.888 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:48.888 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:48.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:48.888 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:35:48.888 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:35:48.888 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:48.888 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:35:48.889 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:35:48.889 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:35:48.889 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:48.889 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:35:48.889 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:35:48.889 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:48.889 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:35:48.889 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:35:48.889 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:35:48.889 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:48.889 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:35:48.889 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:35:48.889 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:48.890 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:35:48.890 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:35:48.890 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-09-12T02:35:48.890 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:48.890 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:35:48.890 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:35:48.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:48.890 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:35:48.890 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:35:48.890 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:35:48.890 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:48.890 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:35:48.891 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:35:48.891 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:48.891 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:35:48.891 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:35:48.891 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:35:48.891 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:48.891 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:48.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:48.891 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:35:48.891 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:35:48.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.874+0000 7faa13fff640 1 -- 172.21.15.60:0/2312773426 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1c00dc20 con 0x7faa0c006f00 2024-09-12T02:35:48.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.875+0000 7faa13fff640 1 -- 172.21.15.60:0/2312773426 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5053 (secure 0 0 0) 0x7faa1c003820 con 0x7faa0c006f00 2024-09-12T02:35:48.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.875+0000 7faa13fff640 1 -- 172.21.15.60:0/2312773426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa0c006f00 msgr2=0x7faa0c007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:48.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.875+0000 7faa13fff640 1 --2- 172.21.15.60:0/2312773426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa0c006f00 0x7faa0c007390 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7faa1c00f810 tx=0x7faa1c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.875+0000 7faa13fff640 1 -- 172.21.15.60:0/2312773426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa0c006f00 msgr2=0x7faa0c007390 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:35:48.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.875+0000 7faa13fff640 1 --2- 172.21.15.60:0/2312773426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa0c006f00 0x7faa0c007390 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.878+0000 7faa31837640 1 -- 172.21.15.60:0/2312773426 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7faa1806be60 msgr2=0x7faa1806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:48.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.878+0000 7faa31837640 1 --2- 172.21.15.60:0/2312773426 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7faa1806be60 0x7faa1806e320 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7faa2403b680 tx=0x7faa24009000 comp rx=0 tx=0).stop 2024-09-12T02:35:48.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.878+0000 7faa31837640 1 -- 172.21.15.60:0/2312773426 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa2c0ab9b0 msgr2=0x7faa2c15d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:48.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.878+0000 7faa31837640 1 --2- 172.21.15.60:0/2312773426 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa2c0ab9b0 0x7faa2c15d070 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7faa2000c390 tx=0x7faa2000c850 comp rx=0 tx=0).stop 2024-09-12T02:35:48.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.879+0000 7faa2b7fe640 1 -- 172.21.15.60:0/2312773426 reap_dead start 2024-09-12T02:35:48.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.880+0000 7faa2b7fe640 1 -- 172.21.15.60:0/2312773426 reap_dead start 2024-09-12T02:35:48.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.880+0000 7faa31837640 1 -- 172.21.15.60:0/2312773426 shutdown_connections 2024-09-12T02:35:48.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.880+0000 7faa31837640 1 -- 172.21.15.60:0/2312773426 >> 172.21.15.60:0/2312773426 conn(0x7faa2c0c6980 msgr2=0x7faa2c0c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:48.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.882+0000 7faa31837640 1 -- 172.21.15.60:0/2312773426 shutdown_connections 2024-09-12T02:35:48.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:48.882+0000 7faa31837640 1 -- 172.21.15.60:0/2312773426 wait complete. 2024-09-12T02:35:48.909 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:35:48.909 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-12T02:35:48.909 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-12T02:35:49.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.115+0000 7f4af97e8640 1 Processor -- start 2024-09-12T02:35:49.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.117+0000 7f4af97e8640 1 -- start start 2024-09-12T02:35:49.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.118+0000 7f4af97e8640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4af40c3e00 0x7f4af406dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:49.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.118+0000 7f4af97e8640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4af40ad5c0 con 0x7f4af41500a0 2024-09-12T02:35:49.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.118+0000 7f4af97e8640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4af406ef50 con 0x7f4af406e650 2024-09-12T02:35:49.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.118+0000 7f4af97e8640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f4af40ad860 con 0x7f4af40c3e00 2024-09-12T02:35:49.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.118+0000 7f4af37fe640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4af40c3e00 0x7f4af406dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:49.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.118+0000 7f4af2ffd640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f4af41500a0 0x7f4af40c3000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53572/0 (socket says 172.21.15.60:53572) 2024-09-12T02:35:49.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.118+0000 7f4af2ffd640 1 -- 172.21.15.60:0/200465753 learned_addr learned my addr 172.21.15.60:0/200465753 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:35:49.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.120+0000 7f4af1ffb640 1 -- 172.21.15.60:0/200465753 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 694903525 0 0) 0x7f4af406ef50 con 0x7f4af406e650 2024-09-12T02:35:49.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.120+0000 7f4af1ffb640 1 -- 172.21.15.60:0/200465753 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4adc005730 con 0x7f4af406e650 2024-09-12T02:35:49.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.120+0000 7f4af37fe640 1 -- 172.21.15.60:0/200465753 >> v1:172.21.15.105:6789/0 conn(0x7f4af406e650 legacy=0x7f4af4150930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:49.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.120+0000 7f4af37fe640 1 -- 172.21.15.60:0/200465753 >> v1:172.21.15.60:6789/0 conn(0x7f4af41500a0 legacy=0x7f4af40c3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:49.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.120+0000 7f4af1ffb640 1 -- 172.21.15.60:0/200465753 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3084549555 0 0) 0x7f4af40ad5c0 con 0x7f4af41500a0 2024-09-12T02:35:49.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.120+0000 7f4af37fe640 1 -- 172.21.15.60:0/200465753 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4af406ec70 con 0x7f4af40c3e00 2024-09-12T02:35:49.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.123+0000 7f4af37fe640 1 --2- 172.21.15.60:0/200465753 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4af40c3e00 0x7f4af406dab0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4ae40097a0 tx=0x7f4ae402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8d8378e92f0c57c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:49.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.124+0000 7f4af1ffb640 1 -- 172.21.15.60:0/200465753 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4037070 con 0x7f4af40c3e00 2024-09-12T02:35:49.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.125+0000 7f4af1ffb640 1 -- 172.21.15.60:0/200465753 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ae4032440 con 0x7f4af40c3e00 2024-09-12T02:35:49.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.125+0000 7f4af1ffb640 1 -- 172.21.15.60:0/200465753 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae40327f0 con 0x7f4af40c3e00 2024-09-12T02:35:49.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.126+0000 7f4af97e8640 1 -- 172.21.15.60:0/200465753 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4af40c3e00 msgr2=0x7f4af406dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:49.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.126+0000 7f4af97e8640 1 --2- 172.21.15.60:0/200465753 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4af40c3e00 0x7f4af406dab0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4ae40097a0 tx=0x7f4ae402a1a0 comp rx=0 tx=0).stop 2024-09-12T02:35:49.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.126+0000 7f4af97e8640 1 -- 172.21.15.60:0/200465753 shutdown_connections 2024-09-12T02:35:49.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.127+0000 7f4af97e8640 1 --2- 172.21.15.60:0/200465753 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4af40c3e00 0x7f4af406dab0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:49.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.127+0000 7f4af97e8640 1 -- 172.21.15.60:0/200465753 >> 172.21.15.60:0/200465753 conn(0x7f4af40c7a40 msgr2=0x7f4af40c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:49.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.129+0000 7f4af97e8640 1 -- 172.21.15.60:0/200465753 shutdown_connections 2024-09-12T02:35:49.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.129+0000 7f4af97e8640 1 -- 172.21.15.60:0/200465753 wait complete. 2024-09-12T02:35:49.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.131+0000 7f4af97e8640 1 Processor -- start 2024-09-12T02:35:49.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.132+0000 7f4af97e8640 1 -- start start 2024-09-12T02:35:49.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.133+0000 7f4af97e8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4af406e650 0x7f4af4074370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:49.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.133+0000 7f4af97e8640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4af40c3e00 0x7f4af4156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:49.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.133+0000 7f4af97e8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4af41500a0 0x7f4af41479a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:49.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.133+0000 7f4af97e8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4af4150480 con 0x7f4af41500a0 2024-09-12T02:35:49.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.133+0000 7f4af97e8640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4af40adb10 con 0x7f4af406e650 2024-09-12T02:35:49.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.133+0000 7f4af97e8640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4af4150600 con 0x7f4af40c3e00 2024-09-12T02:35:49.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.133+0000 7f4af37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4af41500a0 0x7f4af41479a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:49.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.133+0000 7f4af37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4af41500a0 0x7f4af41479a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53662/0 (socket says 172.21.15.60:53662) 2024-09-12T02:35:49.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.133+0000 7f4af37fe640 1 -- 172.21.15.60:0/132640973 learned_addr learned my addr 172.21.15.60:0/132640973 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:35:49.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.133+0000 7f4af37fe640 1 -- 172.21.15.60:0/132640973 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4af40c3e00 msgr2=0x7f4af4156430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:35:49.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.133+0000 7f4af37fe640 1 --2- 172.21.15.60:0/132640973 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4af40c3e00 0x7f4af4156430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:49.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.133+0000 7f4af37fe640 1 -- 172.21.15.60:0/132640973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4af406e650 msgr2=0x7f4af4074370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:35:49.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.133+0000 7f4af37fe640 1 --2- 172.21.15.60:0/132640973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4af406e650 0x7f4af4074370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:49.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.133+0000 7f4af37fe640 1 -- 172.21.15.60:0/132640973 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4af40aa300 con 0x7f4af41500a0 2024-09-12T02:35:49.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.134+0000 7f4af37fe640 1 --2- 172.21.15.60:0/132640973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4af41500a0 0x7f4af41479a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4ae40097a0 tx=0x7f4ae40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:49.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.136+0000 7f4adb7fe640 1 -- 172.21.15.60:0/132640973 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4037040 con 0x7f4af41500a0 2024-09-12T02:35:49.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.136+0000 7f4af97e8640 1 -- 172.21.15.60:0/132640973 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4af4154560 con 0x7f4af41500a0 2024-09-12T02:35:49.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.136+0000 7f4af97e8640 1 -- 172.21.15.60:0/132640973 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4af40aa5a0 con 0x7f4af41500a0 2024-09-12T02:35:49.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.136+0000 7f4adb7fe640 1 -- 172.21.15.60:0/132640973 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ae4042070 con 0x7f4af41500a0 2024-09-12T02:35:49.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.136+0000 7f4adb7fe640 1 -- 172.21.15.60:0/132640973 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4006e10 con 0x7f4af41500a0 2024-09-12T02:35:49.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.137+0000 7f4af97e8640 1 --2- 172.21.15.60:0/132640973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4af4154a40 0x7f4af40a9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:49.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.137+0000 7f4af97e8640 1 -- 172.21.15.60:0/132640973 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4af4154730 con 0x7f4af4154a40 2024-09-12T02:35:49.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.138+0000 7f4af2ffd640 1 --2- 172.21.15.60:0/132640973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4af4154a40 0x7f4af40a9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:49.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.140+0000 7f4af2ffd640 1 -- 172.21.15.60:0/132640973 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4af4156fb0 con 0x7f4af4154a40 2024-09-12T02:35:49.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.140+0000 7f4adb7fe640 1 -- 172.21.15.60:0/132640973 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4ae40327f0 con 0x7f4af41500a0 2024-09-12T02:35:49.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.141+0000 7f4adb7fe640 1 --2- 172.21.15.60:0/132640973 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4ae006bf00 0x7f4ae006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:49.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.141+0000 7f4adb7fe640 1 -- 172.21.15.60:0/132640973 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f4ae40abc50 con 0x7f4af41500a0 2024-09-12T02:35:49.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.141+0000 7f4af27fc640 1 --2- 172.21.15.60:0/132640973 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4ae006bf00 0x7f4ae006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:49.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.141+0000 7f4af2ffd640 1 --2- 172.21.15.60:0/132640973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4af4154a40 0x7f4af40a9950 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4aec001560 tx=0x7f4aec00cb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:49.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.142+0000 7f4af27fc640 1 --2- 172.21.15.60:0/132640973 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4ae006bf00 0x7f4ae006e3c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8001110 tx=0x7f4ae8007950 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:49.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.143+0000 7f4adb7fe640 1 -- 172.21.15.60:0/132640973 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aec004d60 con 0x7f4af4154a40 2024-09-12T02:35:49.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.143+0000 7f4adb7fe640 1 -- 172.21.15.60:0/132640973 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f4aec015030 con 0x7f4af4154a40 2024-09-12T02:35:49.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.143+0000 7f4adb7fe640 1 -- 172.21.15.60:0/132640973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4af4154a40 msgr2=0x7f4af40a9950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:49.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.143+0000 7f4adb7fe640 1 --2- 172.21.15.60:0/132640973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4af4154a40 0x7f4af40a9950 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4aec001560 tx=0x7f4aec00cb80 comp rx=0 tx=0).stop 2024-09-12T02:35:49.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.143+0000 7f4adb7fe640 1 -- 172.21.15.60:0/132640973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4af4154a40 msgr2=0x7f4af40a9950 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:35:49.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.143+0000 7f4adb7fe640 1 --2- 172.21.15.60:0/132640973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4af4154a40 0x7f4af40a9950 secure :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4aec001560 tx=0x7f4aec00cb80 comp rx=0 tx=0).stop 2024-09-12T02:35:49.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.165+0000 7f4af97e8640 1 --2- 172.21.15.60:0/132640973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4af4153dc0 0x7f4af4147ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:49.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.165+0000 7f4af97e8640 1 -- 172.21.15.60:0/132640973 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4af4150930 con 0x7f4af4153dc0 2024-09-12T02:35:49.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.165+0000 7f4af2ffd640 1 --2- 172.21.15.60:0/132640973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4af4153dc0 0x7f4af4147ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:49.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.166+0000 7f4af2ffd640 1 -- 172.21.15.60:0/132640973 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4af40c2770 con 0x7f4af4153dc0 2024-09-12T02:35:49.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.167+0000 7f4af2ffd640 1 --2- 172.21.15.60:0/132640973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4af4153dc0 0x7f4af4147ee0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4aec018000 tx=0x7f4aec001250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:49.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.168+0000 7f4adb7fe640 1 -- 172.21.15.60:0/132640973 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aec011970 con 0x7f4af4153dc0 2024-09-12T02:35:49.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.168+0000 7f4adb7fe640 1 -- 172.21.15.60:0/132640973 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4550 (secure 0 0 0) 0x7f4aec011970 con 0x7f4af4153dc0 2024-09-12T02:35:49.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.168+0000 7f4adb7fe640 1 -- 172.21.15.60:0/132640973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4af4153dc0 msgr2=0x7f4af4147ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:49.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.168+0000 7f4adb7fe640 1 --2- 172.21.15.60:0/132640973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4af4153dc0 0x7f4af4147ee0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4aec018000 tx=0x7f4aec001250 comp rx=0 tx=0).stop 2024-09-12T02:35:49.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.168+0000 7f4adb7fe640 1 -- 172.21.15.60:0/132640973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4af4153dc0 msgr2=0x7f4af4147ee0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:35:49.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.168+0000 7f4adb7fe640 1 --2- 172.21.15.60:0/132640973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4af4153dc0 0x7f4af4147ee0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:49.169 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:35:49.170 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:35:49.170 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:35:49.170 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:35:49.170 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 124, 2024-09-12T02:35:49.170 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 20746, 2024-09-12T02:35:49.170 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:35:49.170 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:35:49.170 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:35:49.170 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:35:49.170 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:35:49.171 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 15, 2024-09-12T02:35:49.171 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:35:49.171 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:35:49.171 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:35:49.171 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:35:49.171 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:35:49.172 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:35:49.172 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:35:49.172 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:35:49.172 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:35:49.172 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:35:49.172 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:35:49.172 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:35:49.172 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:35:49.172 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:35:49.172 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:35:49.172 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:35:49.173 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:35:49.173 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:35:49.173 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:35:49.173 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:35:49.173 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:35:49.173 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:35:49.174 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:35:49.174 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:35:49.174 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:35:49.174 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:35:49.174 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:35:49.174 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:35:49.174 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:49.174 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:49.175 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:35:49.175 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:35:49.175 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:35:49.175 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:35:49.175 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:35:49.175 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:35:49.175 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:35:49.175 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:35:49.176 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:35:49.176 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:35:49.176 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:35:49.176 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:35:49.176 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:35:49.176 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:35:49.176 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:35:49.176 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:35:49.177 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:35:49.177 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:35:49.177 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:35:49.177 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:35:49.177 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:35:49.177 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:35:49.178 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:35:49.178 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:35:49.178 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:35:49.178 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:35:49.179 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:35:49.179 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:35:49.179 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:35:49.179 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:35:49.179 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:49.180 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:35:49.180 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:49.180 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:35:49.180 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:35:49.181 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:35:49.181 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:35:49.181 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:49.181 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:35:49.181 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:35:49.182 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:49.182 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:49.182 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:49.182 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:35:49.182 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:35:49.182 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:49.182 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:49.182 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:49.183 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:49.183 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:35:49.183 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:35:49.183 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:35:49.183 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:35:49.183 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:35:49.183 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:49.183 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:49.183 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:35:49.183 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:35:49.183 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:35:49.184 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:35:49.184 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:49.184 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:35:49.184 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:35:49.184 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:49.184 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:49.184 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:49.184 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:35:49.184 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:35:49.185 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:49.185 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:49.185 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:49.185 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:49.186 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:35:49.186 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:35:49.186 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:35:49.186 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:35:49.186 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:35:49.187 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:49.187 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:49.187 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:35:49.187 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:35:49.187 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:35:49.188 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:35:49.188 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:49.188 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:35:49.188 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:35:49.188 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:49.188 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:49.188 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:49.188 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:35:49.188 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:35:49.188 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:49.189 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:49.189 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:49.189 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:49.189 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:35:49.189 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:35:49.189 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:35:49.189 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:35:49.189 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:35:49.190 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:49.190 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:49.190 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:49.190 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:35:49.190 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:35:49.190 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:49.190 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:35:49.191 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:35:49.191 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:35:49.191 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:49.191 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:35:49.191 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:35:49.191 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:49.191 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:35:49.192 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:35:49.192 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:35:49.192 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:49.192 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:49.192 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:49.192 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:35:49.192 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:35:49.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.170+0000 7f4af97e8640 1 -- 172.21.15.60:0/132640973 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4ae006bf00 msgr2=0x7f4ae006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:49.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.170+0000 7f4af97e8640 1 --2- 172.21.15.60:0/132640973 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4ae006bf00 0x7f4ae006e3c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8001110 tx=0x7f4ae8007950 comp rx=0 tx=0).stop 2024-09-12T02:35:49.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.170+0000 7f4af37fe640 1 -- 172.21.15.60:0/132640973 reap_dead start 2024-09-12T02:35:49.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.170+0000 7f4af97e8640 1 -- 172.21.15.60:0/132640973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4af41500a0 msgr2=0x7f4af41479a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:49.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.170+0000 7f4af97e8640 1 --2- 172.21.15.60:0/132640973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4af41500a0 0x7f4af41479a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4ae40097a0 tx=0x7f4ae40046c0 comp rx=0 tx=0).stop 2024-09-12T02:35:49.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.173+0000 7f4af97e8640 1 -- 172.21.15.60:0/132640973 shutdown_connections 2024-09-12T02:35:49.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.173+0000 7f4af97e8640 1 --2- 172.21.15.60:0/132640973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4af41500a0 0x7f4af41479a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:49.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.173+0000 7f4af97e8640 1 -- 172.21.15.60:0/132640973 >> 172.21.15.60:0/132640973 conn(0x7f4af40c7a40 msgr2=0x7f4af414d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:49.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.173+0000 7f4af97e8640 1 -- 172.21.15.60:0/132640973 shutdown_connections 2024-09-12T02:35:49.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.173+0000 7f4af97e8640 1 -- 172.21.15.60:0/132640973 wait complete. 2024-09-12T02:35:49.197 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:35:49.197 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-12T02:35:49.197 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-12T02:35:49.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.406+0000 7faac2b36640 1 Processor -- start 2024-09-12T02:35:49.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.407+0000 7faac2b36640 1 -- start start 2024-09-12T02:35:49.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.408+0000 7faac2b36640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7faab40d0bb0 0x7faab4008760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:49.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.408+0000 7faac2b36640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7faab403faa0 0x7faab40d7380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:49.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.408+0000 7faac2b36640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faab4046dc0 con 0x7faab404a2a0 2024-09-12T02:35:49.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.408+0000 7faac2b36640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7faab40d78c0 con 0x7faab40d0bb0 2024-09-12T02:35:49.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.408+0000 7faac2b36640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7faab4047030 con 0x7faab403faa0 2024-09-12T02:35:49.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.410+0000 7faac1b34640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7faab40d0bb0 0x7faab4008760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:49.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.410+0000 7faac1b34640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7faab40d0bb0 0x7faab4008760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53670/0 (socket says 172.21.15.60:53670) 2024-09-12T02:35:49.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.410+0000 7faac1b34640 1 -- 172.21.15.60:0/3798324898 learned_addr learned my addr 172.21.15.60:0/3798324898 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:35:49.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.410+0000 7faac1b34640 1 -- 172.21.15.60:0/3798324898 >> v2:172.21.15.105:3300/0 conn(0x7faab403faa0 msgr2=0x7faab40d7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:49.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.410+0000 7faac1b34640 1 --2- 172.21.15.60:0/3798324898 >> v2:172.21.15.105:3300/0 conn(0x7faab403faa0 0x7faab40d7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:49.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.410+0000 7faac1b34640 1 -- 172.21.15.60:0/3798324898 >> v1:172.21.15.105:6789/0 conn(0x7faab404a2a0 legacy=0x7faab40d6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:49.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.410+0000 7faac1b34640 1 -- 172.21.15.60:0/3798324898 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faab4047310 con 0x7faab40d0bb0 2024-09-12T02:35:49.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.411+0000 7faac1b34640 1 --2- 172.21.15.60:0/3798324898 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faab40d0bb0 0x7faab4008760 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7faab400bee0 tx=0x7faab802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=735b3ec0097e2212 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:49.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.412+0000 7faac0b32640 1 -- 172.21.15.60:0/3798324898 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab8037070 con 0x7faab40d0bb0 2024-09-12T02:35:49.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.412+0000 7faac0b32640 1 -- 172.21.15.60:0/3798324898 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faab8032440 con 0x7faab40d0bb0 2024-09-12T02:35:49.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.412+0000 7faac0b32640 1 -- 172.21.15.60:0/3798324898 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab8032810 con 0x7faab40d0bb0 2024-09-12T02:35:49.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.413+0000 7faac2b36640 1 -- 172.21.15.60:0/3798324898 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faab40d0bb0 msgr2=0x7faab4008760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:49.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.413+0000 7faac2b36640 1 --2- 172.21.15.60:0/3798324898 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faab40d0bb0 0x7faab4008760 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7faab400bee0 tx=0x7faab802a250 comp rx=0 tx=0).stop 2024-09-12T02:35:49.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.415+0000 7faac2b36640 1 -- 172.21.15.60:0/3798324898 shutdown_connections 2024-09-12T02:35:49.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.416+0000 7faac2b36640 1 --2- 172.21.15.60:0/3798324898 >> v2:172.21.15.105:3300/0 conn(0x7faab403faa0 0x7faab40d7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:49.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.416+0000 7faac2b36640 1 --2- 172.21.15.60:0/3798324898 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faab40d0bb0 0x7faab4008760 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:49.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.416+0000 7faac2b36640 1 -- 172.21.15.60:0/3798324898 >> 172.21.15.60:0/3798324898 conn(0x7faab4048e20 msgr2=0x7faab4049230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:49.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.418+0000 7faac2b36640 1 -- 172.21.15.60:0/3798324898 shutdown_connections 2024-09-12T02:35:49.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.419+0000 7faac2b36640 1 -- 172.21.15.60:0/3798324898 wait complete. 2024-09-12T02:35:49.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.421+0000 7faac2b36640 1 Processor -- start 2024-09-12T02:35:49.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.423+0000 7faac2b36640 1 -- start start 2024-09-12T02:35:49.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.424+0000 7faac2b36640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faab403faa0 0x7faab40cea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:49.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.424+0000 7faac2b36640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faab404a2a0 0x7faab4174020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:49.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.424+0000 7faac2b36640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faab40d0bb0 0x7faab4174560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:49.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.424+0000 7faac2b36640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7faab40da910 con 0x7faab40d0bb0 2024-09-12T02:35:49.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.424+0000 7faac2b36640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7faab40dad40 con 0x7faab404a2a0 2024-09-12T02:35:49.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.424+0000 7faac2b36640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7faab40daa90 con 0x7faab403faa0 2024-09-12T02:35:49.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.425+0000 7faac2335640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faab40d0bb0 0x7faab4174560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:49.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.425+0000 7faac1333640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faab404a2a0 0x7faab4174020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:49.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.425+0000 7faac2335640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faab40d0bb0 0x7faab4174560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33826/0 (socket says 172.21.15.60:33826) 2024-09-12T02:35:49.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.425+0000 7faac2335640 1 -- 172.21.15.60:0/661666754 learned_addr learned my addr 172.21.15.60:0/661666754 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:35:49.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.425+0000 7faac1b34640 1 --2- 172.21.15.60:0/661666754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faab403faa0 0x7faab40cea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:49.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.426+0000 7faac2335640 1 -- 172.21.15.60:0/661666754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faab403faa0 msgr2=0x7faab40cea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:49.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.426+0000 7faac2335640 1 --2- 172.21.15.60:0/661666754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faab403faa0 0x7faab40cea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:49.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.426+0000 7faac2335640 1 -- 172.21.15.60:0/661666754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faab404a2a0 msgr2=0x7faab4174020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:49.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.426+0000 7faac2335640 1 --2- 172.21.15.60:0/661666754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faab404a2a0 0x7faab4174020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:49.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.426+0000 7faac2335640 1 -- 172.21.15.60:0/661666754 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faab403ec10 con 0x7faab40d0bb0 2024-09-12T02:35:49.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.427+0000 7faac2335640 1 --2- 172.21.15.60:0/661666754 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faab40d0bb0 0x7faab4174560 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7faabc06ae80 tx=0x7faabc0699a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:49.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.427+0000 7faab27fc640 1 -- 172.21.15.60:0/661666754 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faabc091070 con 0x7faab40d0bb0 2024-09-12T02:35:49.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.427+0000 7faac2b36640 1 -- 172.21.15.60:0/661666754 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faab41783f0 con 0x7faab40d0bb0 2024-09-12T02:35:49.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.428+0000 7faac2b36640 1 -- 172.21.15.60:0/661666754 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faab403e930 con 0x7faab40d0bb0 2024-09-12T02:35:49.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.428+0000 7faab27fc640 1 -- 172.21.15.60:0/661666754 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faabc067d60 con 0x7faab40d0bb0 2024-09-12T02:35:49.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.428+0000 7faab27fc640 1 -- 172.21.15.60:0/661666754 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faabc091070 con 0x7faab40d0bb0 2024-09-12T02:35:49.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.430+0000 7faac2b36640 1 --2- 172.21.15.60:0/661666754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faaa4002a70 0x7faaa4004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:49.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.430+0000 7faac2b36640 1 -- 172.21.15.60:0/661666754 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7faaa4007ec0 con 0x7faaa4002a70 2024-09-12T02:35:49.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.431+0000 7faab27fc640 1 -- 172.21.15.60:0/661666754 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faabc0741c0 con 0x7faab40d0bb0 2024-09-12T02:35:49.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.432+0000 7faab27fc640 1 --2- 172.21.15.60:0/661666754 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7faaa006c230 0x7faaa006e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:49.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.432+0000 7faac1333640 1 --2- 172.21.15.60:0/661666754 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7faaa006c230 0x7faaa006e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:49.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.432+0000 7faab27fc640 1 -- 172.21.15.60:0/661666754 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7faabc067b60 con 0x7faab40d0bb0 2024-09-12T02:35:49.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.433+0000 7faac1b34640 1 --2- 172.21.15.60:0/661666754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faaa4002a70 0x7faaa4004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:49.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.433+0000 7faac1333640 1 --2- 172.21.15.60:0/661666754 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7faaa006c230 0x7faaa006e6f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7faab40d6450 tx=0x7faaac009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:49.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.436+0000 7faac1b34640 1 -- 172.21.15.60:0/661666754 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faaa40080c0 con 0x7faaa4002a70 2024-09-12T02:35:49.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.438+0000 7faac1b34640 1 --2- 172.21.15.60:0/661666754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faaa4002a70 0x7faaa4004f30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7faab402be70 tx=0x7faab80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:49.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.440+0000 7faab27fc640 1 -- 172.21.15.60:0/661666754 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab8037040 con 0x7faaa4002a70 2024-09-12T02:35:49.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.440+0000 7faab27fc640 1 -- 172.21.15.60:0/661666754 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7faab8032440 con 0x7faaa4002a70 2024-09-12T02:35:49.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.440+0000 7faab27fc640 1 -- 172.21.15.60:0/661666754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faaa4002a70 msgr2=0x7faaa4004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:49.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.440+0000 7faab27fc640 1 --2- 172.21.15.60:0/661666754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faaa4002a70 0x7faaa4004f30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7faab402be70 tx=0x7faab80046c0 comp rx=0 tx=0).stop 2024-09-12T02:35:49.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.440+0000 7faab27fc640 1 -- 172.21.15.60:0/661666754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faaa4002a70 msgr2=0x7faaa4004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:35:49.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.440+0000 7faab27fc640 1 --2- 172.21.15.60:0/661666754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faaa4002a70 0x7faaa4004f30 secure :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7faab402be70 tx=0x7faab80046c0 comp rx=0 tx=0).stop 2024-09-12T02:35:49.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.457+0000 7faac2b36640 1 --2- 172.21.15.60:0/661666754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faaa4006eb0 0x7faaa4007340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:49.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.457+0000 7faac2b36640 1 -- 172.21.15.60:0/661666754 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7faaa400a4a0 con 0x7faaa4006eb0 2024-09-12T02:35:49.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.459+0000 7faac1b34640 1 --2- 172.21.15.60:0/661666754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faaa4006eb0 0x7faaa4007340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:49.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.462+0000 7faac1b34640 1 -- 172.21.15.60:0/661666754 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7faaa4007880 con 0x7faaa4006eb0 2024-09-12T02:35:49.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.463+0000 7faac1b34640 1 --2- 172.21.15.60:0/661666754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faaa4006eb0 0x7faaa4007340 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faab8000c00 tx=0x7faab8008030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:49.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.464+0000 7faab27fc640 1 -- 172.21.15.60:0/661666754 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab8037040 con 0x7faaa4006eb0 2024-09-12T02:35:49.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.464+0000 7faab27fc640 1 -- 172.21.15.60:0/661666754 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4885 (secure 0 0 0) 0x7faab804c2b0 con 0x7faaa4006eb0 2024-09-12T02:35:49.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.465+0000 7faab27fc640 1 -- 172.21.15.60:0/661666754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faaa4006eb0 msgr2=0x7faaa4007340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:49.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.465+0000 7faab27fc640 1 --2- 172.21.15.60:0/661666754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faaa4006eb0 0x7faaa4007340 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faab8000c00 tx=0x7faab8008030 comp rx=0 tx=0).stop 2024-09-12T02:35:49.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.465+0000 7faab27fc640 1 -- 172.21.15.60:0/661666754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faaa4006eb0 msgr2=0x7faaa4007340 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:35:49.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.465+0000 7faab27fc640 1 --2- 172.21.15.60:0/661666754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faaa4006eb0 0x7faaa4007340 secure :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faab8000c00 tx=0x7faab8008030 comp rx=0 tx=0).stop 2024-09-12T02:35:49.467 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:35:49.467 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:35:49.467 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:35:49.467 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:35:49.467 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 124, 2024-09-12T02:35:49.467 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 223219, 2024-09-12T02:35:49.467 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:35:49.467 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:35:49.467 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:35:49.468 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:35:49.468 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:35:49.468 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 16, 2024-09-12T02:35:49.468 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:35:49.468 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:35:49.468 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:35:49.468 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:35:49.468 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:35:49.468 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:35:49.468 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:35:49.468 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:35:49.468 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:35:49.468 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:35:49.468 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:35:49.469 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:35:49.469 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:35:49.469 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:35:49.469 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:35:49.469 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:35:49.469 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:35:49.469 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:35:49.469 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:35:49.469 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:35:49.469 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:35:49.469 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:35:49.469 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:35:49.470 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:35:49.470 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:35:49.470 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:35:49.470 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:35:49.470 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:35:49.470 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:49.470 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:49.470 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:35:49.470 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:35:49.470 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:35:49.470 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:35:49.470 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:35:49.470 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:35:49.471 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:35:49.471 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:35:49.471 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:35:49.471 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:35:49.471 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:35:49.471 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:35:49.471 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:35:49.471 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:35:49.471 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:35:49.471 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:35:49.471 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:35:49.471 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:35:49.471 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:35:49.471 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:35:49.472 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:35:49.472 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:35:49.472 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:35:49.472 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:35:49.472 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:35:49.472 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:35:49.472 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:35:49.472 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:35:49.472 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:35:49.472 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:35:49.472 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:49.473 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:35:49.473 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:49.473 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:35:49.473 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:35:49.473 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:35:49.473 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:35:49.473 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:49.473 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:35:49.473 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:35:49.473 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:49.473 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:49.473 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:49.473 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:35:49.474 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:35:49.474 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:49.474 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:49.474 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:49.474 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:49.474 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:35:49.474 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:35:49.474 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:35:49.475 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:35:49.475 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:35:49.475 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:49.475 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:49.475 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:35:49.475 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:35:49.475 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:35:49.475 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:35:49.475 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:49.475 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:35:49.475 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:35:49.476 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:49.476 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:49.476 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:49.476 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:35:49.476 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:35:49.476 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:49.476 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:49.476 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:49.476 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:49.476 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:35:49.476 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:35:49.476 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:35:49.476 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:35:49.476 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:35:49.477 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:49.477 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:49.477 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:35:49.477 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:35:49.477 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:35:49.477 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:35:49.477 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:49.477 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:35:49.477 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:35:49.477 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:49.479 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:49.479 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:49.479 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:35:49.479 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:35:49.479 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:35:49.479 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:49.479 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:49.480 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:49.480 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:35:49.480 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:35:49.480 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:35:49.480 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:35:49.480 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:35:49.480 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:49.480 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:49.480 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:49.480 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:35:49.480 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:35:49.481 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:49.481 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:35:49.481 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:35:49.481 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:35:49.481 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:49.481 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:35:49.481 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:35:49.481 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:49.481 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:35:49.481 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:35:49.481 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:35:49.482 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:49.482 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:35:49.482 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:35:49.482 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:49.482 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:35:49.482 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:35:49.482 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:35:49.482 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:49.482 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:35:49.482 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:35:49.482 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:35:49.482 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:35:49.483 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:35:49.483 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:35:49.483 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:35:49.483 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:35:49.483 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:35:49.483 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:35:49.483 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:35:49.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.469+0000 7faac2b36640 1 -- 172.21.15.60:0/661666754 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7faaa006c230 msgr2=0x7faaa006e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:49.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.469+0000 7faac2b36640 1 --2- 172.21.15.60:0/661666754 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7faaa006c230 0x7faaa006e6f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7faab40d6450 tx=0x7faaac009040 comp rx=0 tx=0).stop 2024-09-12T02:35:49.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.469+0000 7faac2335640 1 -- 172.21.15.60:0/661666754 reap_dead start 2024-09-12T02:35:49.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.469+0000 7faac2b36640 1 -- 172.21.15.60:0/661666754 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faab40d0bb0 msgr2=0x7faab4174560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:49.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.469+0000 7faac2b36640 1 --2- 172.21.15.60:0/661666754 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faab40d0bb0 0x7faab4174560 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7faabc06ae80 tx=0x7faabc0699a0 comp rx=0 tx=0).stop 2024-09-12T02:35:49.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.469+0000 7faac2b36640 1 -- 172.21.15.60:0/661666754 shutdown_connections 2024-09-12T02:35:49.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.469+0000 7faac2b36640 1 --2- 172.21.15.60:0/661666754 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faab40d0bb0 0x7faab4174560 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:49.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.469+0000 7faac2b36640 1 -- 172.21.15.60:0/661666754 >> 172.21.15.60:0/661666754 conn(0x7faab4048e20 msgr2=0x7faab402c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:49.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.469+0000 7faac2b36640 1 -- 172.21.15.60:0/661666754 shutdown_connections 2024-09-12T02:35:49.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.470+0000 7faac2b36640 1 -- 172.21.15.60:0/661666754 wait complete. 2024-09-12T02:35:49.497 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:35:49.498 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-09-12T02:35:49.498 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-12T02:35:49.498 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-09-12T02:35:49.498 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-12T02:35:49.498 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T02:35:49.498 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:35:49.525 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T02:35:49.525 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-12T02:35:49.525 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:35:49.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.742+0000 7fd0d359e640 1 Processor -- start 2024-09-12T02:35:49.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.742+0000 7fd0d359e640 1 -- start start 2024-09-12T02:35:49.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.743+0000 7fd0d359e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd0d4154280 0x7fd0d41546f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:49.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.743+0000 7fd0d359e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd0d4154c30 0x7fd0d40c1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:49.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.743+0000 7fd0d359e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0d4157860 con 0x7fd0d40addb0 2024-09-12T02:35:49.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.743+0000 7fd0d359e640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fd0d4157b20 con 0x7fd0d4154280 2024-09-12T02:35:49.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.743+0000 7fd0d359e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd0d4157e00 con 0x7fd0d4154c30 2024-09-12T02:35:49.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.743+0000 7fd0d259c640 1 -- >> v1:172.21.15.60:6789/0 conn(0x7fd0d40addb0 legacy=0x7fd0d40c4380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:35:49.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.744+0000 7fd0d1d9b640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd0d4154280 0x7fd0d41546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:49.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.744+0000 7fd0d2d9d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd0d4154c30 0x7fd0d40c1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:49.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.744+0000 7fd0d1d9b640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd0d4154280 0x7fd0d41546f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:60016/0 (socket says 172.21.15.60:60016) 2024-09-12T02:35:49.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.744+0000 7fd0d1d9b640 1 -- 172.21.15.60:0/1341643292 learned_addr learned my addr 172.21.15.60:0/1341643292 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:35:49.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.745+0000 7fd0d1d9b640 1 -- 172.21.15.60:0/1341643292 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd0d4154c30 msgr2=0x7fd0d40c1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:49.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.745+0000 7fd0d1d9b640 1 --2- 172.21.15.60:0/1341643292 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd0d4154c30 0x7fd0d40c1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:49.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.745+0000 7fd0d1d9b640 1 -- 172.21.15.60:0/1341643292 >> v1:172.21.15.60:6789/0 conn(0x7fd0d40addb0 legacy=0x7fd0d40c4380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:35:49.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.745+0000 7fd0d1d9b640 1 -- 172.21.15.60:0/1341643292 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0d41580e0 con 0x7fd0d4154280 2024-09-12T02:35:49.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.746+0000 7fd0d1d9b640 1 --2- 172.21.15.60:0/1341643292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0d4154280 0x7fd0d41546f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8009870 tx=0x7fd0c802a0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d220fb7b9e3c4c3a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:49.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.747+0000 7fd0d159a640 1 -- 172.21.15.60:0/1341643292 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c8037070 con 0x7fd0d4154280 2024-09-12T02:35:49.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.747+0000 7fd0d159a640 1 -- 172.21.15.60:0/1341643292 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0c802ae00 con 0x7fd0d4154280 2024-09-12T02:35:49.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.747+0000 7fd0d159a640 1 -- 172.21.15.60:0/1341643292 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c8032660 con 0x7fd0d4154280 2024-09-12T02:35:49.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.748+0000 7fd0d359e640 1 -- 172.21.15.60:0/1341643292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0d4154280 msgr2=0x7fd0d41546f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:49.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.748+0000 7fd0d359e640 1 --2- 172.21.15.60:0/1341643292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0d4154280 0x7fd0d41546f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8009870 tx=0x7fd0c802a0f0 comp rx=0 tx=0).stop 2024-09-12T02:35:49.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.749+0000 7fd0d359e640 1 -- 172.21.15.60:0/1341643292 shutdown_connections 2024-09-12T02:35:49.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.749+0000 7fd0d359e640 1 --2- 172.21.15.60:0/1341643292 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd0d4154c30 0x7fd0d40c1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:49.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.749+0000 7fd0d359e640 1 --2- 172.21.15.60:0/1341643292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0d4154280 0x7fd0d41546f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:49.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.749+0000 7fd0d359e640 1 -- 172.21.15.60:0/1341643292 >> 172.21.15.60:0/1341643292 conn(0x7fd0d40c8250 msgr2=0x7fd0d40c8630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:49.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.749+0000 7fd0d359e640 1 -- 172.21.15.60:0/1341643292 shutdown_connections 2024-09-12T02:35:49.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.749+0000 7fd0d359e640 1 -- 172.21.15.60:0/1341643292 wait complete. 2024-09-12T02:35:49.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.751+0000 7fd0d359e640 1 Processor -- start 2024-09-12T02:35:49.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.752+0000 7fd0d359e640 1 -- start start 2024-09-12T02:35:49.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.753+0000 7fd0d359e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd0d40addb0 0x7fd0d41f59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:49.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.753+0000 7fd0d359e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0d4154280 0x7fd0d40bf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:49.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.753+0000 7fd0d359e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0d4154c30 0x7fd0d40bfd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:49.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.753+0000 7fd0d1d9b640 1 -- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0d4154280 msgr2=0x7fd0d40bf7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:35:49.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.753+0000 7fd0d359e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d40c1cb0 con 0x7fd0d4154280 2024-09-12T02:35:49.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.753+0000 7fd0d1d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0d4154280 0x7fd0d40bf7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:35:49.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.753+0000 7fd0d359e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d40ae3a0 con 0x7fd0d4154c30 2024-09-12T02:35:49.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.753+0000 7fd0d359e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd0d40c1e30 con 0x7fd0d40addb0 2024-09-12T02:35:49.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.754+0000 7fd0d259c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd0d40addb0 0x7fd0d41f59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:49.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.754+0000 7fd0d2d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0d4154c30 0x7fd0d40bfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:49.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.754+0000 7fd0d2d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0d4154c30 0x7fd0d40bfd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:60032/0 (socket says 172.21.15.60:60032) 2024-09-12T02:35:49.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.754+0000 7fd0d2d9d640 1 -- 172.21.15.60:0/539853707 learned_addr learned my addr 172.21.15.60:0/539853707 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:35:49.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.754+0000 7fd0d259c640 1 -- 172.21.15.60:0/539853707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0d4154c30 msgr2=0x7fd0d40bfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:49.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.754+0000 7fd0d259c640 1 --2- 172.21.15.60:0/539853707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0d4154c30 0x7fd0d40bfd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:49.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.754+0000 7fd0d259c640 1 -- 172.21.15.60:0/539853707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0d4154280 msgr2=0x7fd0d40bf7c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:35:49.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.754+0000 7fd0d259c640 1 --2- 172.21.15.60:0/539853707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0d4154280 0x7fd0d40bf7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:49.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.754+0000 7fd0d259c640 1 -- 172.21.15.60:0/539853707 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0d40c76d0 con 0x7fd0d40addb0 2024-09-12T02:35:49.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.754+0000 7fd0d2d9d640 1 --2- 172.21.15.60:0/539853707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0d4154c30 0x7fd0d40bfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:49.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.755+0000 7fd0d259c640 1 --2- 172.21.15.60:0/539853707 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd0d40addb0 0x7fd0d41f59f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd0c400c190 tx=0x7fd0c400b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:49.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.758+0000 7fd0c2ffd640 1 -- 172.21.15.60:0/539853707 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c4016070 con 0x7fd0d40addb0 2024-09-12T02:35:49.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.758+0000 7fd0d359e640 1 -- 172.21.15.60:0/539853707 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0d40c5ef0 con 0x7fd0d40addb0 2024-09-12T02:35:49.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.758+0000 7fd0d359e640 1 -- 172.21.15.60:0/539853707 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0d40c7f50 con 0x7fd0d40addb0 2024-09-12T02:35:49.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.759+0000 7fd0c2ffd640 1 -- 172.21.15.60:0/539853707 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0c40054e0 con 0x7fd0d40addb0 2024-09-12T02:35:49.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.759+0000 7fd0c2ffd640 1 -- 172.21.15.60:0/539853707 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c4003990 con 0x7fd0d40addb0 2024-09-12T02:35:49.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.760+0000 7fd0d359e640 1 -- 172.21.15.60:0/539853707 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0d41546f0 con 0x7fd0d40addb0 2024-09-12T02:35:49.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.761+0000 7fd0c2ffd640 1 -- 172.21.15.60:0/539853707 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd0c4003b30 con 0x7fd0d40addb0 2024-09-12T02:35:49.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.765+0000 7fd0c2ffd640 1 --2- 172.21.15.60:0/539853707 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd0b406bde0 0x7fd0b406e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:49.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.765+0000 7fd0c2ffd640 1 -- 172.21.15.60:0/539853707 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fd0c408a620 con 0x7fd0d40addb0 2024-09-12T02:35:49.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.765+0000 7fd0d1d9b640 1 --2- 172.21.15.60:0/539853707 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd0b406bde0 0x7fd0b406e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:49.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.767+0000 7fd0d1d9b640 1 --2- 172.21.15.60:0/539853707 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd0b406bde0 0x7fd0b406e2a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8034000 tx=0x7fd0c802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:49.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:49.773+0000 7fd0c2ffd640 1 -- 172.21.15.60:0/539853707 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd0c4003e20 con 0x7fd0d40addb0 2024-09-12T02:35:50.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:50.293+0000 7fd0d359e640 1 -- 172.21.15.60:0/539853707 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd0d40008d0 con 0x7fd0d40addb0 2024-09-12T02:35:50.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:50.294+0000 7fd0c2ffd640 1 -- 172.21.15.60:0/539853707 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1566 (secure 0 0 0) 0x7fd0c4058550 con 0x7fd0d40addb0 2024-09-12T02:35:50.295 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":124,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:35:50.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:50.298+0000 7fd0d359e640 1 -- 172.21.15.60:0/539853707 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd0b406bde0 msgr2=0x7fd0b406e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:50.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:50.298+0000 7fd0d359e640 1 --2- 172.21.15.60:0/539853707 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd0b406bde0 0x7fd0b406e2a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8034000 tx=0x7fd0c802e000 comp rx=0 tx=0).stop 2024-09-12T02:35:50.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:50.298+0000 7fd0d359e640 1 -- 172.21.15.60:0/539853707 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd0d40addb0 msgr2=0x7fd0d41f59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:50.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:50.298+0000 7fd0d359e640 1 --2- 172.21.15.60:0/539853707 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd0d40addb0 0x7fd0d41f59f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd0c400c190 tx=0x7fd0c400b8d0 comp rx=0 tx=0).stop 2024-09-12T02:35:50.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:50.298+0000 7fd0d359e640 1 -- 172.21.15.60:0/539853707 shutdown_connections 2024-09-12T02:35:50.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:50.298+0000 7fd0d359e640 1 --2- 172.21.15.60:0/539853707 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd0b406bde0 0x7fd0b406e2a0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:50.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:50.298+0000 7fd0d359e640 1 --2- 172.21.15.60:0/539853707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0d4154c30 0x7fd0d40bfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:50.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:50.299+0000 7fd0d359e640 1 --2- 172.21.15.60:0/539853707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0d4154280 0x7fd0d40bf7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:50.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:50.299+0000 7fd0d359e640 1 --2- 172.21.15.60:0/539853707 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd0d40addb0 0x7fd0d41f59f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:50.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:50.299+0000 7fd0d359e640 1 -- 172.21.15.60:0/539853707 >> 172.21.15.60:0/539853707 conn(0x7fd0d40c8250 msgr2=0x7fd0d40c8630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:50.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:50.299+0000 7fd0d359e640 1 -- 172.21.15.60:0/539853707 shutdown_connections 2024-09-12T02:35:50.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:50.299+0000 7fd0d359e640 1 -- 172.21.15.60:0/539853707 wait complete. 2024-09-12T02:35:53.318 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:35:53.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.493+0000 7fc6c3323640 1 Processor -- start 2024-09-12T02:35:53.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.494+0000 7fc6c3323640 1 -- start start 2024-09-12T02:35:53.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.495+0000 7fc6c3323640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6bc0c3540 0x7fc6bc0c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:53.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.495+0000 7fc6c3323640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc6bc0c22d0 0x7fc6bc157160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:53.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.495+0000 7fc6c3323640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6bc0c6bb0 con 0x7fc6bc06e2f0 2024-09-12T02:35:53.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.495+0000 7fc6c3323640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fc6bc152d70 con 0x7fc6bc0c22d0 2024-09-12T02:35:53.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.495+0000 7fc6c3323640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc6bc0c6e50 con 0x7fc6bc0c3540 2024-09-12T02:35:53.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.495+0000 7fc6c18c0640 1 -- >> v2:172.21.15.60:3300/0 conn(0x7fc6bc0c22d0 msgr2=0x7fc6bc157160 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:35:53.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.495+0000 7fc6c18c0640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc6bc0c22d0 0x7fc6bc157160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:35:53.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.495+0000 7fc6c10bf640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6bc0c3540 0x7fc6bc0c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:53.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.495+0000 7fc6c10bf640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6bc0c3540 0x7fc6bc0c57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:47906/0 (socket says 172.21.15.60:47906) 2024-09-12T02:35:53.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.495+0000 7fc6c10bf640 1 -- 172.21.15.60:0/328323864 learned_addr learned my addr 172.21.15.60:0/328323864 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:35:53.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.496+0000 7fc6c10bf640 1 -- 172.21.15.60:0/328323864 >> v2:172.21.15.60:3300/0 conn(0x7fc6bc0c22d0 msgr2=0x7fc6bc157160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:35:53.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.496+0000 7fc6c10bf640 1 --2- 172.21.15.60:0/328323864 >> v2:172.21.15.60:3300/0 conn(0x7fc6bc0c22d0 0x7fc6bc157160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:53.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.496+0000 7fc6c10bf640 1 -- 172.21.15.60:0/328323864 >> v1:172.21.15.105:6789/0 conn(0x7fc6bc06e2f0 legacy=0x7fc6bc153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:53.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.496+0000 7fc6c10bf640 1 -- 172.21.15.60:0/328323864 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6bc152a00 con 0x7fc6bc0c3540 2024-09-12T02:35:53.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.497+0000 7fc6c10bf640 1 --2- 172.21.15.60:0/328323864 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6bc0c3540 0x7fc6bc0c57d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac009870 tx=0x7fc6ac02a160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da9f38e4ac2711f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:53.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.498+0000 7fc6bbfff640 1 -- 172.21.15.60:0/328323864 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac037070 con 0x7fc6bc0c3540 2024-09-12T02:35:53.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.498+0000 7fc6bbfff640 1 -- 172.21.15.60:0/328323864 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6ac032440 con 0x7fc6bc0c3540 2024-09-12T02:35:53.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.498+0000 7fc6bbfff640 1 -- 172.21.15.60:0/328323864 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac032810 con 0x7fc6bc0c3540 2024-09-12T02:35:53.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.499+0000 7fc6c3323640 1 -- 172.21.15.60:0/328323864 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6bc0c3540 msgr2=0x7fc6bc0c57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:53.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.499+0000 7fc6c3323640 1 --2- 172.21.15.60:0/328323864 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6bc0c3540 0x7fc6bc0c57d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac009870 tx=0x7fc6ac02a160 comp rx=0 tx=0).stop 2024-09-12T02:35:53.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.503+0000 7fc6c3323640 1 -- 172.21.15.60:0/328323864 shutdown_connections 2024-09-12T02:35:53.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.503+0000 7fc6c3323640 1 --2- 172.21.15.60:0/328323864 >> v2:172.21.15.60:3300/0 conn(0x7fc6bc0c22d0 0x7fc6bc157160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:53.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.503+0000 7fc6c3323640 1 --2- 172.21.15.60:0/328323864 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6bc0c3540 0x7fc6bc0c57d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:53.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.503+0000 7fc6c3323640 1 -- 172.21.15.60:0/328323864 >> 172.21.15.60:0/328323864 conn(0x7fc6bc0a9680 msgr2=0x7fc6bc0a9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:53.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.504+0000 7fc6c3323640 1 -- 172.21.15.60:0/328323864 shutdown_connections 2024-09-12T02:35:53.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.504+0000 7fc6c3323640 1 -- 172.21.15.60:0/328323864 wait complete. 2024-09-12T02:35:53.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.506+0000 7fc6c3323640 1 Processor -- start 2024-09-12T02:35:53.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.506+0000 7fc6c3323640 1 -- start start 2024-09-12T02:35:53.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.507+0000 7fc6c3323640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6bc06e2f0 0x7fc6bc140740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:53.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.507+0000 7fc6c3323640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6bc0c22d0 0x7fc6bc156770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:53.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.507+0000 7fc6c08be640 1 -- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6bc0c22d0 msgr2=0x7fc6bc156770 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:35:53.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.507+0000 7fc6c08be640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6bc0c22d0 0x7fc6bc156770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:35:53.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.507+0000 7fc6c10bf640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6bc06e2f0 0x7fc6bc140740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:53.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.508+0000 7fc6c3323640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6bc0c3540 0x7fc6bc0c4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:53.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.508+0000 7fc6c10bf640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6bc06e2f0 0x7fc6bc140740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:60046/0 (socket says 172.21.15.60:60046) 2024-09-12T02:35:53.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.508+0000 7fc6c3323640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc6bc0c28e0 con 0x7fc6bc0c22d0 2024-09-12T02:35:53.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.508+0000 7fc6c3323640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc6bc0c2760 con 0x7fc6bc06e2f0 2024-09-12T02:35:53.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.508+0000 7fc6c3323640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc6bc06ccf0 con 0x7fc6bc0c3540 2024-09-12T02:35:53.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.508+0000 7fc6c18c0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6bc0c3540 0x7fc6bc0c4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:53.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.508+0000 7fc6c18c0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6bc0c3540 0x7fc6bc0c4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:47918/0 (socket says 172.21.15.60:47918) 2024-09-12T02:35:53.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.508+0000 7fc6c18c0640 1 -- 172.21.15.60:0/1139943649 learned_addr learned my addr 172.21.15.60:0/1139943649 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:35:53.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.509+0000 7fc6c10bf640 1 -- 172.21.15.60:0/1139943649 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6bc0c3540 msgr2=0x7fc6bc0c4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:53.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.509+0000 7fc6c10bf640 1 --2- 172.21.15.60:0/1139943649 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6bc0c3540 0x7fc6bc0c4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:53.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.509+0000 7fc6c10bf640 1 -- 172.21.15.60:0/1139943649 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6bc0c22d0 msgr2=0x7fc6bc156770 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:35:53.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.509+0000 7fc6c10bf640 1 --2- 172.21.15.60:0/1139943649 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6bc0c22d0 0x7fc6bc156770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:53.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.509+0000 7fc6c10bf640 1 -- 172.21.15.60:0/1139943649 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6bc0a8e40 con 0x7fc6bc06e2f0 2024-09-12T02:35:53.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.510+0000 7fc6c10bf640 1 --2- 172.21.15.60:0/1139943649 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6bc06e2f0 0x7fc6bc140740 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc0c6d80 tx=0x7fc6ac0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:53.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.511+0000 7fc6b9ffb640 1 -- 172.21.15.60:0/1139943649 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac041070 con 0x7fc6bc06e2f0 2024-09-12T02:35:53.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.511+0000 7fc6c3323640 1 -- 172.21.15.60:0/1139943649 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6bc1f4440 con 0x7fc6bc06e2f0 2024-09-12T02:35:53.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.511+0000 7fc6c3323640 1 -- 172.21.15.60:0/1139943649 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6bc1f4a00 con 0x7fc6bc06e2f0 2024-09-12T02:35:53.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.511+0000 7fc6b9ffb640 1 -- 172.21.15.60:0/1139943649 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6ac032440 con 0x7fc6bc06e2f0 2024-09-12T02:35:53.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.511+0000 7fc6b9ffb640 1 -- 172.21.15.60:0/1139943649 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac037040 con 0x7fc6bc06e2f0 2024-09-12T02:35:53.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.513+0000 7fc6c3323640 1 -- 172.21.15.60:0/1139943649 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6a0005290 con 0x7fc6bc06e2f0 2024-09-12T02:35:53.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.514+0000 7fc6b9ffb640 1 -- 172.21.15.60:0/1139943649 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc6ac044070 con 0x7fc6bc06e2f0 2024-09-12T02:35:53.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.515+0000 7fc6b9ffb640 1 --2- 172.21.15.60:0/1139943649 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc69c06bde0 0x7fc69c06e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:53.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.515+0000 7fc6b9ffb640 1 -- 172.21.15.60:0/1139943649 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fc6ac0abf80 con 0x7fc6bc06e2f0 2024-09-12T02:35:53.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.516+0000 7fc6c08be640 1 --2- 172.21.15.60:0/1139943649 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc69c06bde0 0x7fc69c06e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:53.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.522+0000 7fc6c08be640 1 --2- 172.21.15.60:0/1139943649 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc69c06bde0 0x7fc69c06e2a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc13eba0 tx=0x7fc6a40079d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:53.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:53.528+0000 7fc6b9ffb640 1 -- 172.21.15.60:0/1139943649 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc6ac079f50 con 0x7fc6bc06e2f0 2024-09-12T02:35:54.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:54.071+0000 7fc6c3323640 1 -- 172.21.15.60:0/1139943649 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc6a0005850 con 0x7fc6bc06e2f0 2024-09-12T02:35:54.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:54.073+0000 7fc6b9ffb640 1 -- 172.21.15.60:0/1139943649 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1566 (secure 0 0 0) 0x7fc6ac07e250 con 0x7fc6bc06e2f0 2024-09-12T02:35:54.074 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":124,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:35:54.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:54.078+0000 7fc6c3323640 1 -- 172.21.15.60:0/1139943649 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc69c06bde0 msgr2=0x7fc69c06e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:54.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:54.078+0000 7fc6c3323640 1 --2- 172.21.15.60:0/1139943649 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc69c06bde0 0x7fc69c06e2a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc13eba0 tx=0x7fc6a40079d0 comp rx=0 tx=0).stop 2024-09-12T02:35:54.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:54.078+0000 7fc6c3323640 1 -- 172.21.15.60:0/1139943649 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6bc06e2f0 msgr2=0x7fc6bc140740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:54.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:54.078+0000 7fc6c3323640 1 --2- 172.21.15.60:0/1139943649 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6bc06e2f0 0x7fc6bc140740 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc0c6d80 tx=0x7fc6ac0046c0 comp rx=0 tx=0).stop 2024-09-12T02:35:54.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:54.078+0000 7fc6c3323640 1 -- 172.21.15.60:0/1139943649 shutdown_connections 2024-09-12T02:35:54.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:54.078+0000 7fc6c3323640 1 --2- 172.21.15.60:0/1139943649 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc69c06bde0 0x7fc69c06e2a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:54.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:54.078+0000 7fc6c3323640 1 --2- 172.21.15.60:0/1139943649 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6bc0c3540 0x7fc6bc0c4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:54.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:54.078+0000 7fc6c3323640 1 --2- 172.21.15.60:0/1139943649 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6bc0c22d0 0x7fc6bc156770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:54.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:54.078+0000 7fc6c3323640 1 --2- 172.21.15.60:0/1139943649 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6bc06e2f0 0x7fc6bc140740 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:54.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:54.078+0000 7fc6c3323640 1 -- 172.21.15.60:0/1139943649 >> 172.21.15.60:0/1139943649 conn(0x7fc6bc0a9680 msgr2=0x7fc6bc143c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:54.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:54.078+0000 7fc6c3323640 1 -- 172.21.15.60:0/1139943649 shutdown_connections 2024-09-12T02:35:54.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:54.078+0000 7fc6c3323640 1 -- 172.21.15.60:0/1139943649 wait complete. 2024-09-12T02:35:57.098 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:35:57.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.279+0000 7faf7759e640 1 Processor -- start 2024-09-12T02:35:57.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.279+0000 7faf7759e640 1 -- start start 2024-09-12T02:35:57.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.281+0000 7faf7759e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf700465c0 0x7faf700d66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:57.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.281+0000 7faf7759e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf700071d0 con 0x7faf70048820 2024-09-12T02:35:57.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.281+0000 7faf7759e640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf7004a980 con 0x7faf70049180 2024-09-12T02:35:57.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.281+0000 7faf7759e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7faf700da320 con 0x7faf700465c0 2024-09-12T02:35:57.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.281+0000 7faf7659c640 1 -- >> v1:172.21.15.60:6789/0 conn(0x7faf70048820 legacy=0x7faf7000ae60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:35:57.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.281+0000 7faf75d9b640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7faf70049180 0x7faf700d9c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:38282/0 (socket says 172.21.15.60:38282) 2024-09-12T02:35:57.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.281+0000 7faf75d9b640 1 -- 172.21.15.60:0/3427806914 learned_addr learned my addr 172.21.15.60:0/3427806914 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:35:57.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.281+0000 7faf76d9d640 1 --2- 172.21.15.60:0/3427806914 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf700465c0 0x7faf700d66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:57.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.284+0000 7faf76d9d640 1 -- 172.21.15.60:0/3427806914 >> v1:172.21.15.105:6789/0 conn(0x7faf70049180 legacy=0x7faf700d9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:57.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.284+0000 7faf76d9d640 1 -- 172.21.15.60:0/3427806914 >> v1:172.21.15.60:6789/0 conn(0x7faf70048820 legacy=0x7faf7000ae60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:35:57.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.284+0000 7faf76d9d640 1 -- 172.21.15.60:0/3427806914 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf7004ac60 con 0x7faf700465c0 2024-09-12T02:35:57.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.285+0000 7faf76d9d640 1 --2- 172.21.15.60:0/3427806914 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf700465c0 0x7faf700d66e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7faf78000b60 tx=0x7faf780a6c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=717ae773b1f8be88 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:57.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.286+0000 7faf7559a640 1 -- 172.21.15.60:0/3427806914 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf780b4070 con 0x7faf700465c0 2024-09-12T02:35:57.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.286+0000 7faf7559a640 1 -- 172.21.15.60:0/3427806914 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf780a7a20 con 0x7faf700465c0 2024-09-12T02:35:57.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.286+0000 7faf7559a640 1 -- 172.21.15.60:0/3427806914 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf780a7e50 con 0x7faf700465c0 2024-09-12T02:35:57.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.288+0000 7faf7759e640 1 -- 172.21.15.60:0/3427806914 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf700465c0 msgr2=0x7faf700d66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:57.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.288+0000 7faf7759e640 1 --2- 172.21.15.60:0/3427806914 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf700465c0 0x7faf700d66e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7faf78000b60 tx=0x7faf780a6c10 comp rx=0 tx=0).stop 2024-09-12T02:35:57.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.291+0000 7faf7759e640 1 -- 172.21.15.60:0/3427806914 shutdown_connections 2024-09-12T02:35:57.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.292+0000 7faf7759e640 1 --2- 172.21.15.60:0/3427806914 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf700465c0 0x7faf700d66e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:57.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.292+0000 7faf7759e640 1 -- 172.21.15.60:0/3427806914 >> 172.21.15.60:0/3427806914 conn(0x7faf70047d00 msgr2=0x7faf70048110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:57.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.293+0000 7faf7759e640 1 -- 172.21.15.60:0/3427806914 shutdown_connections 2024-09-12T02:35:57.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.293+0000 7faf7759e640 1 -- 172.21.15.60:0/3427806914 wait complete. 2024-09-12T02:35:57.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.295+0000 7faf7759e640 1 Processor -- start 2024-09-12T02:35:57.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.295+0000 7faf7759e640 1 -- start start 2024-09-12T02:35:57.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.296+0000 7faf7759e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf700465c0 0x7faf70044790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:57.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.296+0000 7faf7759e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf70048820 0x7faf700316c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:57.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.296+0000 7faf7759e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf70049180 0x7faf70031c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:57.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.296+0000 7faf7759e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7faf700d96f0 con 0x7faf700465c0 2024-09-12T02:35:57.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.296+0000 7faf7759e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7faf700d9410 con 0x7faf70049180 2024-09-12T02:35:57.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.296+0000 7faf7759e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7faf70046a10 con 0x7faf70048820 2024-09-12T02:35:57.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.296+0000 7faf7659c640 1 -- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf700465c0 msgr2=0x7faf70044790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:35:57.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.296+0000 7faf7659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf700465c0 0x7faf70044790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:35:57.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.297+0000 7faf75d9b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf70048820 0x7faf700316c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:57.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.297+0000 7faf75d9b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf70048820 0x7faf700316c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:47938/0 (socket says 172.21.15.60:47938) 2024-09-12T02:35:57.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.297+0000 7faf75d9b640 1 -- 172.21.15.60:0/732834640 learned_addr learned my addr 172.21.15.60:0/732834640 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:35:57.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.299+0000 7faf76d9d640 1 --2- 172.21.15.60:0/732834640 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf70049180 0x7faf70031c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:57.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.299+0000 7faf75d9b640 1 -- 172.21.15.60:0/732834640 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf70049180 msgr2=0x7faf70031c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:57.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.299+0000 7faf75d9b640 1 --2- 172.21.15.60:0/732834640 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf70049180 0x7faf70031c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:57.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.299+0000 7faf75d9b640 1 -- 172.21.15.60:0/732834640 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf700465c0 msgr2=0x7faf70044790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:35:57.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.299+0000 7faf75d9b640 1 --2- 172.21.15.60:0/732834640 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf700465c0 0x7faf70044790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:57.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.299+0000 7faf75d9b640 1 -- 172.21.15.60:0/732834640 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf70041cb0 con 0x7faf70048820 2024-09-12T02:35:57.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.300+0000 7faf75d9b640 1 --2- 172.21.15.60:0/732834640 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf70048820 0x7faf700316c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7faf6c00c480 tx=0x7faf6c00c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:57.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.300+0000 7faf66ffd640 1 -- 172.21.15.60:0/732834640 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf6c018070 con 0x7faf70048820 2024-09-12T02:35:57.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.301+0000 7faf7759e640 1 -- 172.21.15.60:0/732834640 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf70032140 con 0x7faf70048820 2024-09-12T02:35:57.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.301+0000 7faf7759e640 1 -- 172.21.15.60:0/732834640 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7faf700e7a10 con 0x7faf70048820 2024-09-12T02:35:57.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.301+0000 7faf66ffd640 1 -- 172.21.15.60:0/732834640 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf6c005ce0 con 0x7faf70048820 2024-09-12T02:35:57.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.301+0000 7faf66ffd640 1 -- 172.21.15.60:0/732834640 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf6c0072d0 con 0x7faf70048820 2024-09-12T02:35:57.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.304+0000 7faf7759e640 1 -- 172.21.15.60:0/732834640 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf5c005290 con 0x7faf70048820 2024-09-12T02:35:57.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.305+0000 7faf66ffd640 1 -- 172.21.15.60:0/732834640 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faf6c01b070 con 0x7faf70048820 2024-09-12T02:35:57.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.305+0000 7faf66ffd640 1 --2- 172.21.15.60:0/732834640 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7faf5806be30 0x7faf5806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:57.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.306+0000 7faf66ffd640 1 -- 172.21.15.60:0/732834640 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7faf6c08a3b0 con 0x7faf70048820 2024-09-12T02:35:57.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.306+0000 7faf7659c640 1 --2- 172.21.15.60:0/732834640 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7faf5806be30 0x7faf5806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:57.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.306+0000 7faf7659c640 1 --2- 172.21.15.60:0/732834640 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7faf5806be30 0x7faf5806e2f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7faf68003980 tx=0x7faf68006d30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:57.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.315+0000 7faf66ffd640 1 -- 172.21.15.60:0/732834640 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faf70032140 con 0x7faf70048820 2024-09-12T02:35:57.831 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":124,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:35:57.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.830+0000 7faf7759e640 1 -- 172.21.15.60:0/732834640 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7faf5c005580 con 0x7faf70048820 2024-09-12T02:35:57.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.831+0000 7faf66ffd640 1 -- 172.21.15.60:0/732834640 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1566 (secure 0 0 0) 0x7faf6c058360 con 0x7faf70048820 2024-09-12T02:35:57.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.834+0000 7faf64ff9640 1 -- 172.21.15.60:0/732834640 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7faf5806be30 msgr2=0x7faf5806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:57.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.834+0000 7faf64ff9640 1 --2- 172.21.15.60:0/732834640 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7faf5806be30 0x7faf5806e2f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7faf68003980 tx=0x7faf68006d30 comp rx=0 tx=0).stop 2024-09-12T02:35:57.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.834+0000 7faf64ff9640 1 -- 172.21.15.60:0/732834640 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf70048820 msgr2=0x7faf700316c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:57.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.834+0000 7faf64ff9640 1 --2- 172.21.15.60:0/732834640 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf70048820 0x7faf700316c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7faf6c00c480 tx=0x7faf6c00c940 comp rx=0 tx=0).stop 2024-09-12T02:35:57.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.835+0000 7faf64ff9640 1 -- 172.21.15.60:0/732834640 shutdown_connections 2024-09-12T02:35:57.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.835+0000 7faf64ff9640 1 --2- 172.21.15.60:0/732834640 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7faf5806be30 0x7faf5806e2f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:57.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.835+0000 7faf64ff9640 1 --2- 172.21.15.60:0/732834640 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf70049180 0x7faf70031c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:57.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.835+0000 7faf64ff9640 1 --2- 172.21.15.60:0/732834640 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf70048820 0x7faf700316c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:57.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.835+0000 7faf64ff9640 1 --2- 172.21.15.60:0/732834640 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf700465c0 0x7faf70044790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:57.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.835+0000 7faf64ff9640 1 -- 172.21.15.60:0/732834640 >> 172.21.15.60:0/732834640 conn(0x7faf70047d00 msgr2=0x7faf7002ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:57.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.835+0000 7faf64ff9640 1 -- 172.21.15.60:0/732834640 shutdown_connections 2024-09-12T02:35:57.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:35:57.835+0000 7faf64ff9640 1 -- 172.21.15.60:0/732834640 wait complete. 2024-09-12T02:36:00.831 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:36:00.834 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:36:00.856 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:36:01.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:01.067+0000 7f5f17fd8640 1 Processor -- start 2024-09-12T02:36:01.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:01.067+0000 7f5f17fd8640 1 -- start start 2024-09-12T02:36:01.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:01.068+0000 7f5f17fd8640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5f101505f0 0x7f5f10153910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:01.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:01.069+0000 7f5f17fd8640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f100c42b0 0x7f5f100c46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:01.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:01.069+0000 7f5f15d74640 1 -- >> v2:172.21.15.60:3300/0 conn(0x7f5f101505f0 msgr2=0x7f5f10153910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:36:01.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:01.069+0000 7f5f15d74640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5f101505f0 0x7f5f10153910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:36:01.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:01.069+0000 7f5f17fd8640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f100c5940 con 0x7f5f100c69c0 2024-09-12T02:36:01.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:01.069+0000 7f5f17fd8640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f5f100c7860 con 0x7f5f101505f0 2024-09-12T02:36:01.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:01.069+0000 7f5f17fd8640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5f100c5c00 con 0x7f5f100c42b0 2024-09-12T02:36:01.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:01.069+0000 7f5f16575640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f100c42b0 0x7f5f100c46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:01.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:01.069+0000 7f5f16575640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f100c42b0 0x7f5f100c46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:52482/0 (socket says 172.21.15.60:52482) 2024-09-12T02:36:01.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:01.069+0000 7f5f16575640 1 -- 172.21.15.60:0/903535844 learned_addr learned my addr 172.21.15.60:0/903535844 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:36:01.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:01.069+0000 7f5f16575640 1 -- 172.21.15.60:0/903535844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f100c42b0 msgr2=0x7f5f100c46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:36:01.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:01.069+0000 7f5f16575640 1 -- 172.21.15.60:0/903535844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f100c42b0 msgr2=0x7f5f100c46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:36:01.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:01.069+0000 7f5f16575640 1 --2- 172.21.15.60:0/903535844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f100c42b0 0x7f5f100c46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:36:01.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:01.069+0000 7f5f16575640 1 --2- 172.21.15.60:0/903535844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f100c42b0 0x7f5f100c46d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:36:01.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:01.270+0000 7f5f15d74640 1 -- 172.21.15.60:0/903535844 >> v2:172.21.15.60:3300/0 conn(0x7f5f101505f0 msgr2=0x7f5f10153910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:36:01.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:01.270+0000 7f5f15d74640 1 --2- 172.21.15.60:0/903535844 >> v2:172.21.15.60:3300/0 conn(0x7f5f101505f0 0x7f5f10153910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:36:01.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:01.270+0000 7f5f16575640 1 --2- 172.21.15.60:0/903535844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f100c42b0 0x7f5f100c46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:01.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:01.270+0000 7f5f16575640 1 -- 172.21.15.60:0/903535844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f100c42b0 msgr2=0x7f5f100c46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:36:01.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:01.270+0000 7f5f16575640 1 -- 172.21.15.60:0/903535844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f100c42b0 msgr2=0x7f5f100c46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:36:01.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:01.270+0000 7f5f16575640 1 --2- 172.21.15.60:0/903535844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f100c42b0 0x7f5f100c46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:36:01.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:01.270+0000 7f5f16575640 1 --2- 172.21.15.60:0/903535844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f100c42b0 0x7f5f100c46d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:36:01.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:01.671+0000 7f5f15d74640 1 -- 172.21.15.60:0/903535844 >> v2:172.21.15.60:3300/0 conn(0x7f5f101505f0 msgr2=0x7f5f10153910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:36:01.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:01.671+0000 7f5f15d74640 1 --2- 172.21.15.60:0/903535844 >> v2:172.21.15.60:3300/0 conn(0x7f5f101505f0 0x7f5f10153910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:36:01.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:01.673+0000 7f5f16575640 1 --2- 172.21.15.60:0/903535844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f100c42b0 0x7f5f100c46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:01.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:01.673+0000 7f5f16575640 1 -- 172.21.15.60:0/903535844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f100c42b0 msgr2=0x7f5f100c46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:36:01.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:01.673+0000 7f5f16575640 1 -- 172.21.15.60:0/903535844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f100c42b0 msgr2=0x7f5f100c46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:36:01.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:01.673+0000 7f5f16575640 1 --2- 172.21.15.60:0/903535844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f100c42b0 0x7f5f100c46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:36:01.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:01.673+0000 7f5f16575640 1 --2- 172.21.15.60:0/903535844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f100c42b0 0x7f5f100c46d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:36:02.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:02.472+0000 7f5f15d74640 1 -- 172.21.15.60:0/903535844 >> v2:172.21.15.60:3300/0 conn(0x7f5f101505f0 msgr2=0x7f5f10153910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:36:02.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:02.472+0000 7f5f15d74640 1 --2- 172.21.15.60:0/903535844 >> v2:172.21.15.60:3300/0 conn(0x7f5f101505f0 0x7f5f10153910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:36:02.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:02.476+0000 7f5f16575640 1 --2- 172.21.15.60:0/903535844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f100c42b0 0x7f5f100c46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:02.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:02.476+0000 7f5f16575640 1 -- 172.21.15.60:0/903535844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f100c42b0 msgr2=0x7f5f100c46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:36:02.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:02.476+0000 7f5f16575640 1 -- 172.21.15.60:0/903535844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f100c42b0 msgr2=0x7f5f100c46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:36:02.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:02.476+0000 7f5f16575640 1 --2- 172.21.15.60:0/903535844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f100c42b0 0x7f5f100c46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:36:02.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:02.476+0000 7f5f16575640 1 --2- 172.21.15.60:0/903535844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f100c42b0 0x7f5f100c46d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:36:03.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.552+0000 7f5f14d72640 1 -- 172.21.15.60:0/903535844 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2880909056 0 0) 0x7f5f100c5940 con 0x7f5f100c69c0 2024-09-12T02:36:03.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.552+0000 7f5f14d72640 1 -- 172.21.15.60:0/903535844 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5efc005730 con 0x7f5f100c69c0 2024-09-12T02:36:03.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.574+0000 7f5f14d72640 1 -- 172.21.15.60:0/903535844 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3851588655 0 0) 0x7f5efc005730 con 0x7f5f100c69c0 2024-09-12T02:36:03.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.574+0000 7f5f14d72640 1 -- 172.21.15.60:0/903535844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f100c42b0 msgr2=0x7f5f100c46d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:36:03.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.574+0000 7f5f14d72640 1 --2- 172.21.15.60:0/903535844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f100c42b0 0x7f5f100c46d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:03.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.574+0000 7f5f14d72640 1 -- 172.21.15.60:0/903535844 >> v2:172.21.15.60:3300/0 conn(0x7f5f101505f0 msgr2=0x7f5f10153910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:36:03.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.574+0000 7f5f14d72640 1 --2- 172.21.15.60:0/903535844 >> v2:172.21.15.60:3300/0 conn(0x7f5f101505f0 0x7f5f10153910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:03.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.574+0000 7f5f14d72640 1 -- 172.21.15.60:0/903535844 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f100c5ee0 con 0x7f5f100c69c0 2024-09-12T02:36:03.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.574+0000 7f5f14d72640 1 -- 172.21.15.60:0/903535844 <== mon.1 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7f5f00001650 con 0x7f5f100c69c0 2024-09-12T02:36:03.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.574+0000 7f5f14d72640 1 -- 172.21.15.60:0/903535844 >> v1:172.21.15.105:6789/0 conn(0x7f5f100c69c0 legacy=0x7f5f100c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:03.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.574+0000 7f5f14d72640 1 --2- 172.21.15.60:0/903535844 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5efc005bc0 0x7f5efc005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:03.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.574+0000 7f5f14d72640 1 --2- 172.21.15.60:0/903535844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f100c42b0 0x7f5efc006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:03.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.574+0000 7f5f14d72640 1 --2- 172.21.15.60:0/903535844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5efc006f50 0x7f5efc0073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:03.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.574+0000 7f5f14d72640 1 -- 172.21.15.60:0/903535844 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5f100c5c00 con 0x7f5efc006f50 2024-09-12T02:36:03.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.574+0000 7f5f14d72640 1 -- 172.21.15.60:0/903535844 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5efc00dcd0 con 0x7f5efc005bc0 2024-09-12T02:36:03.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.574+0000 7f5f14d72640 1 -- 172.21.15.60:0/903535844 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5efc00ded0 con 0x7f5f100c42b0 2024-09-12T02:36:03.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.574+0000 7f5f16575640 1 -- 172.21.15.60:0/903535844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5efc006f50 msgr2=0x7f5efc0073d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:36:03.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.574+0000 7f5f16575640 1 --2- 172.21.15.60:0/903535844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5efc006f50 0x7f5efc0073d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:36:03.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.574+0000 7f5f15573640 1 --2- 172.21.15.60:0/903535844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f100c42b0 0x7f5efc006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:03.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.574+0000 7f5f15d74640 1 --2- 172.21.15.60:0/903535844 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5efc005bc0 0x7f5efc005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:03.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.575+0000 7f5f15573640 1 -- 172.21.15.60:0/903535844 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5efc005bc0 msgr2=0x7f5efc005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:03.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.575+0000 7f5f15573640 1 --2- 172.21.15.60:0/903535844 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5efc005bc0 0x7f5efc005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:03.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.575+0000 7f5f15573640 1 -- 172.21.15.60:0/903535844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5efc006f50 msgr2=0x7f5efc0073d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:36:03.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.575+0000 7f5f15573640 1 --2- 172.21.15.60:0/903535844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5efc006f50 0x7f5efc0073d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:03.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.575+0000 7f5f15573640 1 -- 172.21.15.60:0/903535844 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5efc005730 con 0x7f5f100c42b0 2024-09-12T02:36:03.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.576+0000 7f5f15573640 1 --2- 172.21.15.60:0/903535844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f100c42b0 0x7f5efc006a10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5f00007f90 tx=0x7f5efc007a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9f112d05c5391d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:03.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.578+0000 7f5f14d72640 1 -- 172.21.15.60:0/903535844 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f00036070 con 0x7f5f100c42b0 2024-09-12T02:36:03.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.578+0000 7f5f14d72640 1 -- 172.21.15.60:0/903535844 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f00031600 con 0x7f5f100c42b0 2024-09-12T02:36:03.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.578+0000 7f5f14d72640 1 -- 172.21.15.60:0/903535844 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f00007be0 con 0x7f5f100c42b0 2024-09-12T02:36:03.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.579+0000 7f5f17fd8640 1 -- 172.21.15.60:0/903535844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f100c42b0 msgr2=0x7f5efc006a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:03.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.580+0000 7f5f17fd8640 1 --2- 172.21.15.60:0/903535844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f100c42b0 0x7f5efc006a10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5f00007f90 tx=0x7f5efc007a40 comp rx=0 tx=0).stop 2024-09-12T02:36:03.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.580+0000 7f5f16575640 1 -- 172.21.15.60:0/903535844 reap_dead start 2024-09-12T02:36:03.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.580+0000 7f5f17fd8640 1 -- 172.21.15.60:0/903535844 shutdown_connections 2024-09-12T02:36:03.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.580+0000 7f5f17fd8640 1 -- 172.21.15.60:0/903535844 >> 172.21.15.60:0/903535844 conn(0x7f5f100c7a40 msgr2=0x7f5f100c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:03.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.580+0000 7f5f17fd8640 1 -- 172.21.15.60:0/903535844 shutdown_connections 2024-09-12T02:36:03.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.580+0000 7f5f17fd8640 1 -- 172.21.15.60:0/903535844 wait complete. 2024-09-12T02:36:03.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.582+0000 7f5f17fd8640 1 Processor -- start 2024-09-12T02:36:03.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.583+0000 7f5f17fd8640 1 -- start start 2024-09-12T02:36:03.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.586+0000 7f5f17fd8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5f100ace10 0x7f5f10072330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:03.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.586+0000 7f5f17fd8640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f101570a0 0x7f5f101e75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:03.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.586+0000 7f5f17fd8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f100713a0 0x7f5f1014bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:03.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.586+0000 7f5f15d74640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5f100ace10 0x7f5f10072330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:03.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.586+0000 7f5f15d74640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5f100ace10 0x7f5f10072330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:50320/0 (socket says 172.21.15.60:50320) 2024-09-12T02:36:03.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.586+0000 7f5f15d74640 1 -- 172.21.15.60:0/2119028091 learned_addr learned my addr 172.21.15.60:0/2119028091 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:36:03.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.586+0000 7f5f16575640 1 -- 172.21.15.60:0/2119028091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f100713a0 msgr2=0x7f5f1014bd30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:36:03.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.587+0000 7f5f15573640 1 --2- 172.21.15.60:0/2119028091 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f101570a0 0x7f5f101e75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:03.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.587+0000 7f5f16575640 1 --2- 172.21.15.60:0/2119028091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f100713a0 0x7f5f1014bd30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:36:03.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.587+0000 7f5f17fd8640 1 -- 172.21.15.60:0/2119028091 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5f101509d0 con 0x7f5f100713a0 2024-09-12T02:36:03.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.587+0000 7f5f17fd8640 1 -- 172.21.15.60:0/2119028091 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5f100c64a0 con 0x7f5f100ace10 2024-09-12T02:36:03.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.587+0000 7f5f17fd8640 1 -- 172.21.15.60:0/2119028091 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5f10150b50 con 0x7f5f101570a0 2024-09-12T02:36:03.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.587+0000 7f5f15573640 1 -- 172.21.15.60:0/2119028091 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5f100ace10 msgr2=0x7f5f10072330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:03.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.587+0000 7f5f15573640 1 --2- 172.21.15.60:0/2119028091 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5f100ace10 0x7f5f10072330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:03.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.587+0000 7f5f15573640 1 -- 172.21.15.60:0/2119028091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f100713a0 msgr2=0x7f5f1014bd30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:36:03.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.587+0000 7f5f15573640 1 --2- 172.21.15.60:0/2119028091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f100713a0 0x7f5f1014bd30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:03.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.587+0000 7f5f15573640 1 -- 172.21.15.60:0/2119028091 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f10074220 con 0x7f5f101570a0 2024-09-12T02:36:03.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.588+0000 7f5f15573640 1 --2- 172.21.15.60:0/2119028091 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f101570a0 0x7f5f101e75a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5efc00e0a0 tx=0x7f5f000019e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:03.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.588+0000 7f5f067fc640 1 -- 172.21.15.60:0/2119028091 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f00040020 con 0x7f5f101570a0 2024-09-12T02:36:03.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.588+0000 7f5f17fd8640 1 -- 172.21.15.60:0/2119028091 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f10072870 con 0x7f5f101570a0 2024-09-12T02:36:03.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.588+0000 7f5f067fc640 1 -- 172.21.15.60:0/2119028091 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f000317b0 con 0x7f5f101570a0 2024-09-12T02:36:03.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.588+0000 7f5f067fc640 1 -- 172.21.15.60:0/2119028091 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f00036040 con 0x7f5f101570a0 2024-09-12T02:36:03.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.588+0000 7f5f17fd8640 1 -- 172.21.15.60:0/2119028091 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f100744c0 con 0x7f5f101570a0 2024-09-12T02:36:03.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.590+0000 7f5f17fd8640 1 -- 172.21.15.60:0/2119028091 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ef8005290 con 0x7f5f101570a0 2024-09-12T02:36:03.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.595+0000 7f5f067fc640 1 -- 172.21.15.60:0/2119028091 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5f00043020 con 0x7f5f101570a0 2024-09-12T02:36:03.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.596+0000 7f5f067fc640 1 --2- 172.21.15.60:0/2119028091 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f5ef406be10 0x7f5ef406e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:03.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.596+0000 7f5f067fc640 1 -- 172.21.15.60:0/2119028091 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f5f000aaf40 con 0x7f5f101570a0 2024-09-12T02:36:03.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.597+0000 7f5f15d74640 1 --2- 172.21.15.60:0/2119028091 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f5ef406be10 0x7f5ef406e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:03.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.597+0000 7f5f15d74640 1 --2- 172.21.15.60:0/2119028091 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f5ef406be10 0x7f5ef406e2d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c000ea0 tx=0x7f5f0c0094c0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:03.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:03.600+0000 7f5f067fc640 1 -- 172.21.15.60:0/2119028091 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5f0004a070 con 0x7f5f101570a0 2024-09-12T02:36:04.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.107+0000 7f5f17fd8640 1 -- 172.21.15.60:0/2119028091 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f5ef8005580 con 0x7f5f101570a0 2024-09-12T02:36:04.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.108+0000 7f5f067fc640 1 -- 172.21.15.60:0/2119028091 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1559 (secure 0 0 0) 0x7f5f00078ef0 con 0x7f5f101570a0 2024-09-12T02:36:04.109 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":126,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:36:04.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.112+0000 7f5f17fd8640 1 -- 172.21.15.60:0/2119028091 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f5ef406be10 msgr2=0x7f5ef406e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:04.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.112+0000 7f5f17fd8640 1 --2- 172.21.15.60:0/2119028091 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f5ef406be10 0x7f5ef406e2d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c000ea0 tx=0x7f5f0c0094c0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.112+0000 7f5f17fd8640 1 -- 172.21.15.60:0/2119028091 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f101570a0 msgr2=0x7f5f101e75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:04.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.112+0000 7f5f17fd8640 1 --2- 172.21.15.60:0/2119028091 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f101570a0 0x7f5f101e75a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5efc00e0a0 tx=0x7f5f000019e0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.113+0000 7f5f17fd8640 1 -- 172.21.15.60:0/2119028091 shutdown_connections 2024-09-12T02:36:04.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.113+0000 7f5f17fd8640 1 --2- 172.21.15.60:0/2119028091 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f5ef406be10 0x7f5ef406e2d0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.113+0000 7f5f17fd8640 1 --2- 172.21.15.60:0/2119028091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f100713a0 0x7f5f1014bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.113+0000 7f5f17fd8640 1 --2- 172.21.15.60:0/2119028091 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f101570a0 0x7f5f101e75a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.113+0000 7f5f17fd8640 1 --2- 172.21.15.60:0/2119028091 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5f100ace10 0x7f5f10072330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.113+0000 7f5f17fd8640 1 -- 172.21.15.60:0/2119028091 >> 172.21.15.60:0/2119028091 conn(0x7f5f100c7a40 msgr2=0x7f5f1006db40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:04.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.113+0000 7f5f17fd8640 1 -- 172.21.15.60:0/2119028091 shutdown_connections 2024-09-12T02:36:04.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.115+0000 7f5f17fd8640 1 -- 172.21.15.60:0/2119028091 wait complete. 2024-09-12T02:36:04.138 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-12T02:36:04.138 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-12T02:36:04.139 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-12T02:36:04.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.367+0000 7f9c30f5b640 1 Processor -- start 2024-09-12T02:36:04.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.367+0000 7f9c30f5b640 1 -- start start 2024-09-12T02:36:04.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.369+0000 7f9c30f5b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9c2c14f7b0 0x7f9c2c152d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:04.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.369+0000 7f9c30f5b640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9c2c0c27d0 0x7f9c2c0c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:04.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.369+0000 7f9c30f5b640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c2c152280 con 0x7f9c2c14fb90 2024-09-12T02:36:04.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.369+0000 7f9c30f5b640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f9c2c152890 con 0x7f9c2c14f7b0 2024-09-12T02:36:04.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.369+0000 7f9c30f5b640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f9c2c0c2c60 con 0x7f9c2c0c27d0 2024-09-12T02:36:04.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.369+0000 7f9c2bfff640 1 -- >> v1:172.21.15.60:6789/0 conn(0x7f9c2c14fb90 legacy=0x7f9c2c06cbf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:36:04.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.369+0000 7f9c2affd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9c2c0c27d0 0x7f9c2c0c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:04.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.369+0000 7f9c2affd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9c2c0c27d0 0x7f9c2c0c58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:50334/0 (socket says 172.21.15.60:50334) 2024-09-12T02:36:04.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.369+0000 7f9c2b7fe640 1 -- >> v2:172.21.15.60:3300/0 conn(0x7f9c2c14f7b0 msgr2=0x7f9c2c152d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:36:04.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.369+0000 7f9c2affd640 1 -- 172.21.15.60:0/2384081176 learned_addr learned my addr 172.21.15.60:0/2384081176 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:36:04.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.369+0000 7f9c2b7fe640 1 --2- 172.21.15.60:0/2384081176 >> v2:172.21.15.60:3300/0 conn(0x7f9c2c14f7b0 0x7f9c2c152d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:36:04.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.370+0000 7f9c2affd640 1 -- 172.21.15.60:0/2384081176 >> v2:172.21.15.60:3300/0 conn(0x7f9c2c14f7b0 msgr2=0x7f9c2c152d20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:36:04.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.370+0000 7f9c2affd640 1 --2- 172.21.15.60:0/2384081176 >> v2:172.21.15.60:3300/0 conn(0x7f9c2c14f7b0 0x7f9c2c152d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.370+0000 7f9c2affd640 1 -- 172.21.15.60:0/2384081176 >> v1:172.21.15.60:6789/0 conn(0x7f9c2c14fb90 legacy=0x7f9c2c06cbf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:36:04.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.370+0000 7f9c2affd640 1 -- 172.21.15.60:0/2384081176 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c2c152520 con 0x7f9c2c0c27d0 2024-09-12T02:36:04.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.372+0000 7f9c2affd640 1 --2- 172.21.15.60:0/2384081176 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c2c0c27d0 0x7f9c2c0c58d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c0aa7e0 tx=0x7f9c2002ea70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b69d90e46ab3980f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:04.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.373+0000 7f9c2a7fc640 1 -- 172.21.15.60:0/2384081176 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c20037070 con 0x7f9c2c0c27d0 2024-09-12T02:36:04.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.373+0000 7f9c2a7fc640 1 -- 172.21.15.60:0/2384081176 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c20033890 con 0x7f9c2c0c27d0 2024-09-12T02:36:04.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.373+0000 7f9c2a7fc640 1 -- 172.21.15.60:0/2384081176 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c20033c60 con 0x7f9c2c0c27d0 2024-09-12T02:36:04.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.374+0000 7f9c30f5b640 1 -- 172.21.15.60:0/2384081176 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c2c0c27d0 msgr2=0x7f9c2c0c58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.374+0000 7f9c30f5b640 1 --2- 172.21.15.60:0/2384081176 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c2c0c27d0 0x7f9c2c0c58d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c0aa7e0 tx=0x7f9c2002ea70 comp rx=0 tx=0).stop 2024-09-12T02:36:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.375+0000 7f9c30f5b640 1 -- 172.21.15.60:0/2384081176 shutdown_connections 2024-09-12T02:36:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.375+0000 7f9c30f5b640 1 --2- 172.21.15.60:0/2384081176 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c2c0c27d0 0x7f9c2c0c58d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.375+0000 7f9c30f5b640 1 --2- 172.21.15.60:0/2384081176 >> v2:172.21.15.60:3300/0 conn(0x7f9c2c14f7b0 0x7f9c2c152d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.375+0000 7f9c30f5b640 1 -- 172.21.15.60:0/2384081176 >> 172.21.15.60:0/2384081176 conn(0x7f9c2c0a9780 msgr2=0x7f9c2c0a9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.376+0000 7f9c30f5b640 1 -- 172.21.15.60:0/2384081176 shutdown_connections 2024-09-12T02:36:04.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.376+0000 7f9c30f5b640 1 -- 172.21.15.60:0/2384081176 wait complete. 2024-09-12T02:36:04.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.378+0000 7f9c30f5b640 1 Processor -- start 2024-09-12T02:36:04.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.378+0000 7f9c30f5b640 1 -- start start 2024-09-12T02:36:04.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.379+0000 7f9c30f5b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c2c14f7b0 0x7f9c2c14d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:04.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.379+0000 7f9c30f5b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c2c14fb90 0x7f9c2c1501c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:04.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.379+0000 7f9c30f5b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c2c0ac060 0x7f9c2c14dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:04.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.379+0000 7f9c30f5b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9c2c06d480 con 0x7f9c2c14fb90 2024-09-12T02:36:04.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.380+0000 7f9c30f5b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9c2c06d300 con 0x7f9c2c14f7b0 2024-09-12T02:36:04.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.380+0000 7f9c30f5b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9c2c0a7210 con 0x7f9c2c0ac060 2024-09-12T02:36:04.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.380+0000 7f9c2bfff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c2c0ac060 0x7f9c2c14dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:04.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.380+0000 7f9c2bfff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c2c0ac060 0x7f9c2c14dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:52542/0 (socket says 172.21.15.60:52542) 2024-09-12T02:36:04.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.380+0000 7f9c2bfff640 1 -- 172.21.15.60:0/3857984191 learned_addr learned my addr 172.21.15.60:0/3857984191 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:36:04.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.380+0000 7f9c2b7fe640 1 --2- 172.21.15.60:0/3857984191 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c2c14f7b0 0x7f9c2c14d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:04.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.381+0000 7f9c2affd640 1 -- 172.21.15.60:0/3857984191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c2c14fb90 msgr2=0x7f9c2c1501c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:36:04.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.381+0000 7f9c2affd640 1 --2- 172.21.15.60:0/3857984191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c2c14fb90 0x7f9c2c1501c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:36:04.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.381+0000 7f9c2bfff640 1 -- 172.21.15.60:0/3857984191 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c2c14f7b0 msgr2=0x7f9c2c14d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:04.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.381+0000 7f9c2bfff640 1 --2- 172.21.15.60:0/3857984191 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c2c14f7b0 0x7f9c2c14d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.381+0000 7f9c2bfff640 1 -- 172.21.15.60:0/3857984191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c2c14fb90 msgr2=0x7f9c2c1501c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:36:04.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.382+0000 7f9c2bfff640 1 --2- 172.21.15.60:0/3857984191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c2c14fb90 0x7f9c2c1501c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.382+0000 7f9c2bfff640 1 -- 172.21.15.60:0/3857984191 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c2c0ab620 con 0x7f9c2c0ac060 2024-09-12T02:36:04.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.382+0000 7f9c2bfff640 1 --2- 172.21.15.60:0/3857984191 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c2c0ac060 0x7f9c2c14dce0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9c2400be80 tx=0x7f9c24009f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:04.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.383+0000 7f9c13fff640 1 -- 172.21.15.60:0/3857984191 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c24016430 con 0x7f9c2c0ac060 2024-09-12T02:36:04.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.383+0000 7f9c30f5b640 1 -- 172.21.15.60:0/3857984191 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c2c0ab900 con 0x7f9c2c0ac060 2024-09-12T02:36:04.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.383+0000 7f9c30f5b640 1 -- 172.21.15.60:0/3857984191 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c2c14cde0 con 0x7f9c2c0ac060 2024-09-12T02:36:04.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.383+0000 7f9c13fff640 1 -- 172.21.15.60:0/3857984191 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c24010030 con 0x7f9c2c0ac060 2024-09-12T02:36:04.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.383+0000 7f9c13fff640 1 -- 172.21.15.60:0/3857984191 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c24016810 con 0x7f9c2c0ac060 2024-09-12T02:36:04.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.394+0000 7f9c13fff640 1 -- 172.21.15.60:0/3857984191 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9c24006150 con 0x7f9c2c0ac060 2024-09-12T02:36:04.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.395+0000 7f9c13fff640 1 --2- 172.21.15.60:0/3857984191 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9c1806bde0 0x7f9c1806e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:04.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.395+0000 7f9c13fff640 1 -- 172.21.15.60:0/3857984191 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f9c2408b600 con 0x7f9c2c0ac060 2024-09-12T02:36:04.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.396+0000 7f9c2b7fe640 1 --2- 172.21.15.60:0/3857984191 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9c1806bde0 0x7f9c1806e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:04.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.396+0000 7f9c2b7fe640 1 --2- 172.21.15.60:0/3857984191 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9c1806bde0 0x7f9c1806e2a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c1fd170 tx=0x7f9c1c009110 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:04.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.402+0000 7f9c30f5b640 1 --2- 172.21.15.60:0/3857984191 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c0c002a70 0x7f9c0c004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:04.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.402+0000 7f9c30f5b640 1 -- 172.21.15.60:0/3857984191 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0c007ec0 con 0x7f9c0c002a70 2024-09-12T02:36:04.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.406+0000 7f9c2affd640 1 --2- 172.21.15.60:0/3857984191 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c0c002a70 0x7f9c0c004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:04.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.414+0000 7f9c2affd640 1 -- 172.21.15.60:0/3857984191 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9c0c0080c0 con 0x7f9c0c002a70 2024-09-12T02:36:04.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.414+0000 7f9c2affd640 1 --2- 172.21.15.60:0/3857984191 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c0c002a70 0x7f9c0c004f30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c0a7580 tx=0x7f9c200046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:04.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.416+0000 7f9c13fff640 1 -- 172.21.15.60:0/3857984191 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c20037040 con 0x7f9c0c002a70 2024-09-12T02:36:04.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.416+0000 7f9c13fff640 1 -- 172.21.15.60:0/3857984191 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f9c20040030 con 0x7f9c0c002a70 2024-09-12T02:36:04.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.416+0000 7f9c13fff640 1 -- 172.21.15.60:0/3857984191 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c0c002a70 msgr2=0x7f9c0c004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:04.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.417+0000 7f9c13fff640 1 --2- 172.21.15.60:0/3857984191 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c0c002a70 0x7f9c0c004f30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c0a7580 tx=0x7f9c200046c0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.417+0000 7f9c13fff640 1 -- 172.21.15.60:0/3857984191 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c0c002a70 msgr2=0x7f9c0c004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:36:04.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.417+0000 7f9c13fff640 1 --2- 172.21.15.60:0/3857984191 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c0c002a70 0x7f9c0c004f30 secure :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c0a7580 tx=0x7f9c200046c0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.433+0000 7f9c30f5b640 1 --2- 172.21.15.60:0/3857984191 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c0c006eb0 0x7f9c0c007340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:04.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.433+0000 7f9c30f5b640 1 -- 172.21.15.60:0/3857984191 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0c00a4a0 con 0x7f9c0c006eb0 2024-09-12T02:36:04.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.434+0000 7f9c2affd640 1 --2- 172.21.15.60:0/3857984191 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c0c006eb0 0x7f9c0c007340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:04.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.434+0000 7f9c2affd640 1 -- 172.21.15.60:0/3857984191 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9c0c007880 con 0x7f9c0c006eb0 2024-09-12T02:36:04.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.435+0000 7f9c2affd640 1 --2- 172.21.15.60:0/3857984191 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c0c006eb0 0x7f9c0c007340 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c008090 tx=0x7f9c20005ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:04.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.435+0000 7f9c13fff640 1 -- 172.21.15.60:0/3857984191 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c20037040 con 0x7f9c0c006eb0 2024-09-12T02:36:04.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.435+0000 7f9c13fff640 1 -- 172.21.15.60:0/3857984191 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4874 (secure 0 0 0) 0x7f9c20005fe0 con 0x7f9c0c006eb0 2024-09-12T02:36:04.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.435+0000 7f9c13fff640 1 -- 172.21.15.60:0/3857984191 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c0c006eb0 msgr2=0x7f9c0c007340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:04.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.435+0000 7f9c13fff640 1 --2- 172.21.15.60:0/3857984191 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c0c006eb0 0x7f9c0c007340 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c008090 tx=0x7f9c20005ce0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.435+0000 7f9c13fff640 1 -- 172.21.15.60:0/3857984191 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c0c006eb0 msgr2=0x7f9c0c007340 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:36:04.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.435+0000 7f9c13fff640 1 --2- 172.21.15.60:0/3857984191 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c0c006eb0 0x7f9c0c007340 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.437 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:36:04.437 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:36:04.437 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:36:04.437 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:36:04.437 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 126, 2024-09-12T02:36:04.437 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 36014, 2024-09-12T02:36:04.437 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:36:04.437 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:36:04.437 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:36:04.437 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:36:04.437 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-09-12T02:36:04.437 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:36:04.438 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:36:04.438 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:36:04.438 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:36:04.438 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:36:04.438 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:36:04.438 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:36:04.438 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:36:04.438 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:36:04.438 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:36:04.438 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:36:04.438 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:36:04.438 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:36:04.438 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:36:04.439 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:36:04.439 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:36:04.439 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:36:04.439 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:36:04.439 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:36:04.439 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:36:04.439 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:36:04.439 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:36:04.439 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:36:04.439 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:36:04.439 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:36:04.439 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:36:04.439 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:36:04.440 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:36:04.440 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:36:04.440 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:04.440 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:36:04.440 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:36:04.440 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:36:04.440 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:36:04.440 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:36:04.440 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:36:04.440 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:36:04.440 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:36:04.440 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:36:04.440 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:36:04.441 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:36:04.441 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:36:04.441 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:36:04.441 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:36:04.441 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:36:04.441 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:36:04.441 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:36:04.441 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:36:04.441 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:36:04.441 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:36:04.441 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:36:04.441 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:36:04.441 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:36:04.442 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:36:04.442 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:36:04.442 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:36:04.442 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:36:04.442 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:36:04.442 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:36:04.442 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:36:04.442 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:04.442 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:36:04.442 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:04.442 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:36:04.442 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:36:04.442 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:36:04.442 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:36:04.443 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:04.443 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:36:04.443 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:36:04.443 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:36:04.443 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:04.443 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:04.443 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:36:04.443 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:36:04.443 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:36:04.443 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:36:04.443 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:36:04.443 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:04.443 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:36:04.444 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:36:04.444 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:36:04.444 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:36:04.444 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:36:04.444 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:04.444 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:04.444 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:36:04.444 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:36:04.444 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:36:04.444 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:36:04.444 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:04.444 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:36:04.444 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:36:04.445 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:36:04.445 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:04.445 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:04.445 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:36:04.445 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:36:04.445 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:36:04.445 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:36:04.445 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:36:04.445 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:04.445 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:36:04.445 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:36:04.445 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:36:04.445 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:36:04.446 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:36:04.446 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:04.446 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:04.446 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:36:04.446 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:36:04.446 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:36:04.446 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:36:04.446 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:04.446 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:36:04.446 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:36:04.446 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:36:04.446 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:04.446 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:04.446 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:36:04.447 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:36:04.447 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:36:04.447 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:36:04.447 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:36:04.447 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:04.447 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:36:04.447 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:36:04.447 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:36:04.447 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:36:04.447 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:36:04.447 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:36:04.447 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:36:04.447 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:04.448 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:36:04.448 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:36:04.448 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:04.448 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:36:04.448 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:36:04.448 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:36:04.448 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:36:04.448 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:36:04.448 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:36:04.448 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:04.448 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:36:04.449 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:36:04.449 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:36:04.449 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:36:04.449 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:36:04.449 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:36:04.449 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:04.449 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:36:04.449 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:36:04.449 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:36:04.449 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:36:04.449 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:36:04.449 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:36:04.450 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:04.450 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:36:04.450 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:36:04.450 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:36:04.450 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:36:04.450 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:36:04.450 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:04.450 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:36:04.450 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:36:04.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.436+0000 7f9c30f5b640 1 -- 172.21.15.60:0/3857984191 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9c1806bde0 msgr2=0x7f9c1806e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:04.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.436+0000 7f9c30f5b640 1 --2- 172.21.15.60:0/3857984191 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9c1806bde0 0x7f9c1806e2a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c1fd170 tx=0x7f9c1c009110 comp rx=0 tx=0).stop 2024-09-12T02:36:04.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.436+0000 7f9c30f5b640 1 -- 172.21.15.60:0/3857984191 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c2c0ac060 msgr2=0x7f9c2c14dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:04.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.436+0000 7f9c30f5b640 1 --2- 172.21.15.60:0/3857984191 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c2c0ac060 0x7f9c2c14dce0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9c2400be80 tx=0x7f9c24009f40 comp rx=0 tx=0).stop 2024-09-12T02:36:04.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.436+0000 7f9c2bfff640 1 -- 172.21.15.60:0/3857984191 reap_dead start 2024-09-12T02:36:04.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.436+0000 7f9c2bfff640 1 -- 172.21.15.60:0/3857984191 reap_dead start 2024-09-12T02:36:04.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.438+0000 7f9c30f5b640 1 -- 172.21.15.60:0/3857984191 shutdown_connections 2024-09-12T02:36:04.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.438+0000 7f9c30f5b640 1 -- 172.21.15.60:0/3857984191 >> 172.21.15.60:0/3857984191 conn(0x7f9c2c0a9780 msgr2=0x7f9c2c0c57d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:04.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.439+0000 7f9c30f5b640 1 -- 172.21.15.60:0/3857984191 shutdown_connections 2024-09-12T02:36:04.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.439+0000 7f9c30f5b640 1 -- 172.21.15.60:0/3857984191 wait complete. 2024-09-12T02:36:04.465 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-12T02:36:04.465 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-12T02:36:04.465 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-12T02:36:04.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.659+0000 7f265244c640 1 Processor -- start 2024-09-12T02:36:04.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.659+0000 7f265244c640 1 -- start start 2024-09-12T02:36:04.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.661+0000 7f265244c640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f26440dbad0 0x7f264400ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:04.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.661+0000 7f265244c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f26440e2130 0x7f2644005d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:04.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.661+0000 7f2651c4b640 1 -- >> v1:172.21.15.60:6789/0 conn(0x7f2644006f40 legacy=0x7f2644006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:36:04.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.661+0000 7f265244c640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2644047a50 con 0x7f2644006f40 2024-09-12T02:36:04.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.661+0000 7f2650c49640 1 -- >> v2:172.21.15.60:3300/0 conn(0x7f26440e2130 msgr2=0x7f2644005d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:36:04.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.661+0000 7f2650c49640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f26440e2130 0x7f2644005d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:36:04.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.661+0000 7f265244c640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f26440471b0 con 0x7f26440e2130 2024-09-12T02:36:04.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.661+0000 7f265244c640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f2644047490 con 0x7f26440dbad0 2024-09-12T02:36:04.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.662+0000 7f265144a640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f26440dbad0 0x7f264400ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:04.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.662+0000 7f265144a640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f26440dbad0 0x7f264400ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:50370/0 (socket says 172.21.15.60:50370) 2024-09-12T02:36:04.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.662+0000 7f265144a640 1 -- 172.21.15.60:0/3727219276 learned_addr learned my addr 172.21.15.60:0/3727219276 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:36:04.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.662+0000 7f265144a640 1 -- 172.21.15.60:0/3727219276 >> v2:172.21.15.60:3300/0 conn(0x7f26440e2130 msgr2=0x7f2644005d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:36:04.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.662+0000 7f265144a640 1 --2- 172.21.15.60:0/3727219276 >> v2:172.21.15.60:3300/0 conn(0x7f26440e2130 0x7f2644005d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.662+0000 7f265144a640 1 -- 172.21.15.60:0/3727219276 >> v1:172.21.15.60:6789/0 conn(0x7f2644006f40 legacy=0x7f2644006290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:36:04.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.662+0000 7f265144a640 1 -- 172.21.15.60:0/3727219276 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2644047770 con 0x7f26440dbad0 2024-09-12T02:36:04.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.663+0000 7f265144a640 1 --2- 172.21.15.60:0/3727219276 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26440dbad0 0x7f264400ac90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f264c06b300 tx=0x7f264c0a6c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dd2cabdfcb0425a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:04.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.664+0000 7f2643fff640 1 -- 172.21.15.60:0/3727219276 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f264c0b4070 con 0x7f26440dbad0 2024-09-12T02:36:04.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.664+0000 7f2643fff640 1 -- 172.21.15.60:0/3727219276 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f264c0a7a40 con 0x7f26440dbad0 2024-09-12T02:36:04.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.664+0000 7f2643fff640 1 -- 172.21.15.60:0/3727219276 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f264c0af440 con 0x7f26440dbad0 2024-09-12T02:36:04.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.665+0000 7f265244c640 1 -- 172.21.15.60:0/3727219276 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26440dbad0 msgr2=0x7f264400ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:04.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.665+0000 7f265244c640 1 --2- 172.21.15.60:0/3727219276 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26440dbad0 0x7f264400ac90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f264c06b300 tx=0x7f264c0a6c70 comp rx=0 tx=0).stop 2024-09-12T02:36:04.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.665+0000 7f265244c640 1 -- 172.21.15.60:0/3727219276 shutdown_connections 2024-09-12T02:36:04.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.665+0000 7f265244c640 1 --2- 172.21.15.60:0/3727219276 >> v2:172.21.15.60:3300/0 conn(0x7f26440e2130 0x7f2644005d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.665+0000 7f265244c640 1 --2- 172.21.15.60:0/3727219276 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26440dbad0 0x7f264400ac90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.665+0000 7f265244c640 1 -- 172.21.15.60:0/3727219276 >> 172.21.15.60:0/3727219276 conn(0x7f2644047d10 msgr2=0x7f2644048120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:04.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.665+0000 7f265244c640 1 -- 172.21.15.60:0/3727219276 shutdown_connections 2024-09-12T02:36:04.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.665+0000 7f265244c640 1 -- 172.21.15.60:0/3727219276 wait complete. 2024-09-12T02:36:04.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.667+0000 7f265244c640 1 Processor -- start 2024-09-12T02:36:04.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.667+0000 7f265244c640 1 -- start start 2024-09-12T02:36:04.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.668+0000 7f265244c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2644006f40 0x7f26441687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:04.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.668+0000 7f265244c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26440dbad0 0x7f2644177e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:04.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.668+0000 7f265244c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26440e2130 0x7f2644178370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:04.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.668+0000 7f265244c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f264400b350 con 0x7f26440dbad0 2024-09-12T02:36:04.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.668+0000 7f265244c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f264400b1d0 con 0x7f26440e2130 2024-09-12T02:36:04.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.668+0000 7f265244c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f264400b4d0 con 0x7f2644006f40 2024-09-12T02:36:04.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.669+0000 7f2650c49640 1 -- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26440dbad0 msgr2=0x7f2644177e30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:36:04.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.669+0000 7f2650c49640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26440dbad0 0x7f2644177e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:36:04.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.669+0000 7f2651c4b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26440e2130 0x7f2644178370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:04.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.669+0000 7f265144a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2644006f40 0x7f26441687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:04.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.669+0000 7f265144a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2644006f40 0x7f26441687e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:52558/0 (socket says 172.21.15.60:52558) 2024-09-12T02:36:04.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.669+0000 7f265144a640 1 -- 172.21.15.60:0/1383583391 learned_addr learned my addr 172.21.15.60:0/1383583391 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:36:04.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.670+0000 7f265144a640 1 -- 172.21.15.60:0/1383583391 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26440e2130 msgr2=0x7f2644178370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:04.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.670+0000 7f265144a640 1 --2- 172.21.15.60:0/1383583391 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26440e2130 0x7f2644178370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.670+0000 7f265144a640 1 -- 172.21.15.60:0/1383583391 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26440dbad0 msgr2=0x7f2644177e30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:36:04.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.670+0000 7f265144a640 1 --2- 172.21.15.60:0/1383583391 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26440dbad0 0x7f2644177e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.670+0000 7f265144a640 1 -- 172.21.15.60:0/1383583391 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26440e15b0 con 0x7f2644006f40 2024-09-12T02:36:04.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.671+0000 7f265144a640 1 --2- 172.21.15.60:0/1383583391 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2644006f40 0x7f26441687e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f264c051790 tx=0x7f264c069e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:04.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.671+0000 7f2641ffb640 1 -- 172.21.15.60:0/1383583391 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f264c0b4050 con 0x7f2644006f40 2024-09-12T02:36:04.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.671+0000 7f265244c640 1 -- 172.21.15.60:0/1383583391 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26440e12d0 con 0x7f2644006f40 2024-09-12T02:36:04.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.672+0000 7f265244c640 1 -- 172.21.15.60:0/1383583391 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f26440dec90 con 0x7f2644006f40 2024-09-12T02:36:04.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.672+0000 7f2641ffb640 1 -- 172.21.15.60:0/1383583391 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f264c0b5040 con 0x7f2644006f40 2024-09-12T02:36:04.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.672+0000 7f2641ffb640 1 -- 172.21.15.60:0/1383583391 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f264c062cf0 con 0x7f2644006f40 2024-09-12T02:36:04.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.673+0000 7f265244c640 1 --2- 172.21.15.60:0/1383583391 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2644041a90 0x7f26441748d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:04.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.673+0000 7f265244c640 1 -- 172.21.15.60:0/1383583391 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f26440dea40 con 0x7f2644041a90 2024-09-12T02:36:04.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.674+0000 7f2641ffb640 1 -- 172.21.15.60:0/1383583391 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f264c0c2020 con 0x7f2644006f40 2024-09-12T02:36:04.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.676+0000 7f2650c49640 1 --2- 172.21.15.60:0/1383583391 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2644041a90 0x7f26441748d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:04.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.676+0000 7f2641ffb640 1 --2- 172.21.15.60:0/1383583391 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f263006bde0 0x7f263006e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:04.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.676+0000 7f2641ffb640 1 -- 172.21.15.60:0/1383583391 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f264c127d30 con 0x7f2644006f40 2024-09-12T02:36:04.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.676+0000 7f2650c49640 1 -- 172.21.15.60:0/1383583391 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f264400ac90 con 0x7f2644041a90 2024-09-12T02:36:04.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.677+0000 7f2651c4b640 1 --2- 172.21.15.60:0/1383583391 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f263006bde0 0x7f263006e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:04.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.677+0000 7f2650c49640 1 --2- 172.21.15.60:0/1383583391 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2644041a90 0x7f26441748d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f26440dae50 tx=0x7f263c00b8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:04.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.678+0000 7f2651c4b640 1 --2- 172.21.15.60:0/1383583391 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f263006bde0 0x7f263006e2a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2648006fd0 tx=0x7f2648008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:04.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.681+0000 7f2641ffb640 1 -- 172.21.15.60:0/1383583391 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f263c016070 con 0x7f2644041a90 2024-09-12T02:36:04.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.681+0000 7f2641ffb640 1 -- 172.21.15.60:0/1383583391 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f263c003dc0 con 0x7f2644041a90 2024-09-12T02:36:04.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.681+0000 7f2641ffb640 1 -- 172.21.15.60:0/1383583391 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2644041a90 msgr2=0x7f26441748d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:04.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.681+0000 7f2641ffb640 1 --2- 172.21.15.60:0/1383583391 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2644041a90 0x7f26441748d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f26440dae50 tx=0x7f263c00b8e0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.681+0000 7f2641ffb640 1 -- 172.21.15.60:0/1383583391 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2644041a90 msgr2=0x7f26441748d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:36:04.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.681+0000 7f2641ffb640 1 --2- 172.21.15.60:0/1383583391 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2644041a90 0x7f26441748d0 secure :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f26440dae50 tx=0x7f263c00b8e0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.699+0000 7f265244c640 1 --2- 172.21.15.60:0/1383583391 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2644045490 0x7f2644174e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:04.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.699+0000 7f265244c640 1 -- 172.21.15.60:0/1383583391 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f264416a380 con 0x7f2644045490 2024-09-12T02:36:04.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.700+0000 7f2650c49640 1 --2- 172.21.15.60:0/1383583391 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2644045490 0x7f2644174e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:04.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.700+0000 7f2650c49640 1 -- 172.21.15.60:0/1383583391 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f264416a0a0 con 0x7f2644045490 2024-09-12T02:36:04.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.701+0000 7f2650c49640 1 --2- 172.21.15.60:0/1383583391 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2644045490 0x7f2644174e10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f26440debc0 tx=0x7f263c0059d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:04.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.701+0000 7f2641ffb640 1 -- 172.21.15.60:0/1383583391 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f263c016040 con 0x7f2644045490 2024-09-12T02:36:04.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.702+0000 7f2641ffb640 1 -- 172.21.15.60:0/1383583391 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5040 (secure 0 0 0) 0x7f263c0213b0 con 0x7f2644045490 2024-09-12T02:36:04.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.702+0000 7f2641ffb640 1 -- 172.21.15.60:0/1383583391 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2644045490 msgr2=0x7f2644174e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:04.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.702+0000 7f2641ffb640 1 --2- 172.21.15.60:0/1383583391 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2644045490 0x7f2644174e10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f26440debc0 tx=0x7f263c0059d0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.702+0000 7f2641ffb640 1 -- 172.21.15.60:0/1383583391 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2644045490 msgr2=0x7f2644174e10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:36:04.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.702+0000 7f2641ffb640 1 --2- 172.21.15.60:0/1383583391 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2644045490 0x7f2644174e10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.703 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:36:04.703 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:36:04.703 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:36:04.703 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:36:04.703 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 126, 2024-09-12T02:36:04.704 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 238456, 2024-09-12T02:36:04.704 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:36:04.704 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:36:04.704 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:36:04.704 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:36:04.704 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 1, 2024-09-12T02:36:04.704 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:36:04.704 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:36:04.704 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:36:04.704 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:36:04.704 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:36:04.704 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:36:04.704 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:36:04.705 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:36:04.705 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:36:04.705 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:36:04.705 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:36:04.705 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:36:04.705 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:36:04.705 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:36:04.705 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:36:04.705 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:36:04.705 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:36:04.705 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:36:04.705 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:36:04.705 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:36:04.706 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:36:04.706 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:36:04.706 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:36:04.706 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:36:04.706 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:36:04.706 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:36:04.706 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:36:04.706 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:36:04.706 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:36:04.706 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:04.706 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:36:04.706 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:36:04.706 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:36:04.707 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:36:04.707 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:36:04.707 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:36:04.707 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:36:04.707 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:36:04.707 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:36:04.707 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:36:04.707 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:36:04.707 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:36:04.707 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:36:04.707 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:36:04.707 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:36:04.707 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:36:04.707 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:36:04.708 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:36:04.708 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:36:04.708 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:36:04.708 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:36:04.708 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:36:04.708 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:36:04.708 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:36:04.708 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:36:04.708 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:36:04.708 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:36:04.708 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:36:04.708 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:36:04.708 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:36:04.709 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:04.709 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:36:04.709 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:04.709 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:36:04.709 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:36:04.709 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:36:04.709 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:36:04.709 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:04.709 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:36:04.709 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:36:04.709 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:36:04.709 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:04.709 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:04.709 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:36:04.710 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:36:04.710 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:36:04.710 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:36:04.710 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:36:04.710 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:04.710 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:36:04.710 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:36:04.710 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:36:04.710 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:36:04.710 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:36:04.710 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:04.710 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:04.710 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:36:04.710 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:36:04.710 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:36:04.710 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:36:04.711 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:04.711 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:36:04.711 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:36:04.711 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:36:04.711 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:04.711 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:04.711 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:36:04.711 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:36:04.711 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:36:04.711 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:36:04.711 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:36:04.711 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:04.711 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:36:04.712 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:36:04.712 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:36:04.712 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:36:04.712 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:36:04.712 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:04.712 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:04.712 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:36:04.712 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:36:04.712 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:36:04.712 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:36:04.712 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:04.712 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:36:04.712 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:36:04.713 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:36:04.713 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:04.713 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:04.713 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:36:04.713 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:36:04.713 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:36:04.713 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:36:04.713 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:36:04.713 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:04.713 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:36:04.713 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:36:04.713 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:36:04.713 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:36:04.714 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:36:04.714 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:36:04.714 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:36:04.714 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:04.714 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:36:04.714 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:36:04.714 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:04.714 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:36:04.714 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:36:04.714 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:36:04.714 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:36:04.714 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:36:04.714 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:36:04.714 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:04.715 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:36:04.715 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:36:04.715 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:36:04.715 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:36:04.715 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:36:04.715 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:36:04.715 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:04.715 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:36:04.715 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:36:04.715 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-09-12T02:36:04.715 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:36:04.715 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:36:04.715 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:36:04.715 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:04.716 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:36:04.716 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:36:04.716 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 8 2024-09-12T02:36:04.716 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:36:04.716 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:36:04.716 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:36:04.716 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:04.716 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:36:04.716 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:36:04.716 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:36:04.716 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:36:04.716 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:36:04.716 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:04.717 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:36:04.717 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:36:04.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.703+0000 7f265244c640 1 -- 172.21.15.60:0/1383583391 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f263006bde0 msgr2=0x7f263006e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:04.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.703+0000 7f265244c640 1 --2- 172.21.15.60:0/1383583391 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f263006bde0 0x7f263006e2a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2648006fd0 tx=0x7f2648008040 comp rx=0 tx=0).stop 2024-09-12T02:36:04.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.703+0000 7f265244c640 1 -- 172.21.15.60:0/1383583391 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2644006f40 msgr2=0x7f26441687e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:04.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.703+0000 7f265244c640 1 --2- 172.21.15.60:0/1383583391 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2644006f40 0x7f26441687e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f264c051790 tx=0x7f264c069e30 comp rx=0 tx=0).stop 2024-09-12T02:36:04.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.705+0000 7f2651c4b640 1 -- 172.21.15.60:0/1383583391 reap_dead start 2024-09-12T02:36:04.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.705+0000 7f2651c4b640 1 -- 172.21.15.60:0/1383583391 reap_dead start 2024-09-12T02:36:04.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.705+0000 7f265244c640 1 -- 172.21.15.60:0/1383583391 shutdown_connections 2024-09-12T02:36:04.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.705+0000 7f265244c640 1 -- 172.21.15.60:0/1383583391 >> 172.21.15.60:0/1383583391 conn(0x7f2644047d10 msgr2=0x7f2644005d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:04.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.707+0000 7f265244c640 1 -- 172.21.15.60:0/1383583391 shutdown_connections 2024-09-12T02:36:04.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:04.708+0000 7f265244c640 1 -- 172.21.15.60:0/1383583391 wait complete. 2024-09-12T02:36:04.729 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-12T02:36:04.729 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-12T02:36:24.730 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-12T02:36:24.730 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-09-12T02:36:24.730 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T02:36:24.731 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T02:36:24.734 INFO:tasks.ceph.mon.a:Started 2024-09-12T02:36:24.735 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-12T02:36:24.735 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:36:24.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.932+0000 7f513c5f6640 1 Processor -- start 2024-09-12T02:36:24.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.932+0000 7f513c5f6640 1 -- start start 2024-09-12T02:36:24.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.933+0000 7f513c5f6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f51340c5940 0x7f5134166490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:24.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.933+0000 7f513c5f6640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5134166a70 con 0x7f513408d440 2024-09-12T02:36:24.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.933+0000 7f513c5f6640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5134166d50 con 0x7f51340c26b0 2024-09-12T02:36:24.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.933+0000 7f513c5f6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f51341630c0 con 0x7f51340c5940 2024-09-12T02:36:24.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.934+0000 7f513ab93640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f513408d440 0x7f513408d870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:44426/0 (socket says 172.21.15.60:44426) 2024-09-12T02:36:24.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.934+0000 7f513ab93640 1 -- 172.21.15.60:0/1166859633 learned_addr learned my addr 172.21.15.60:0/1166859633 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:36:24.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.934+0000 7f5139b91640 1 --2- 172.21.15.60:0/1166859633 >> v2:172.21.15.60:3300/0 conn(0x7f51340c5940 0x7f5134166490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:24.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.935+0000 7f5139b91640 1 -- 172.21.15.60:0/1166859633 >> v2:172.21.15.60:3300/0 conn(0x7f51340c5940 msgr2=0x7f5134166490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:36:24.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.935+0000 7f5139b91640 1 -- 172.21.15.60:0/1166859633 >> v2:172.21.15.60:3300/0 conn(0x7f51340c5940 msgr2=0x7f5134166490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:36:24.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.935+0000 7f5139b91640 1 --2- 172.21.15.60:0/1166859633 >> v2:172.21.15.60:3300/0 conn(0x7f51340c5940 0x7f5134166490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:36:24.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.935+0000 7f5139b91640 1 --2- 172.21.15.60:0/1166859633 >> v2:172.21.15.60:3300/0 conn(0x7f51340c5940 0x7f5134166490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:36:24.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.944+0000 7f5139390640 1 -- 172.21.15.60:0/1166859633 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2091068852 0 0) 0x7f5134166d50 con 0x7f51340c26b0 2024-09-12T02:36:24.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.944+0000 7f5139390640 1 -- 172.21.15.60:0/1166859633 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5120003520 con 0x7f51340c26b0 2024-09-12T02:36:24.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.944+0000 7f5139390640 1 -- 172.21.15.60:0/1166859633 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3717876230 0 0) 0x7f5120003520 con 0x7f51340c26b0 2024-09-12T02:36:24.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.944+0000 7f5139390640 1 -- 172.21.15.60:0/1166859633 >> v2:172.21.15.60:3300/0 conn(0x7f51340c5940 msgr2=0x7f5134166490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:36:24.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.944+0000 7f5139390640 1 --2- 172.21.15.60:0/1166859633 >> v2:172.21.15.60:3300/0 conn(0x7f51340c5940 0x7f5134166490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:24.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.944+0000 7f5139390640 1 -- 172.21.15.60:0/1166859633 >> v1:172.21.15.60:6789/0 conn(0x7f513408d440 legacy=0x7f513408d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:24.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.944+0000 7f5139390640 1 -- 172.21.15.60:0/1166859633 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5134167030 con 0x7f51340c26b0 2024-09-12T02:36:24.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.945+0000 7f5139390640 1 -- 172.21.15.60:0/1166859633 <== mon.1 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7f5130001650 con 0x7f51340c26b0 2024-09-12T02:36:24.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.945+0000 7f5139390640 1 -- 172.21.15.60:0/1166859633 >> v1:172.21.15.105:6789/0 conn(0x7f51340c26b0 legacy=0x7f5134163550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:24.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.945+0000 7f5139390640 1 --2- 172.21.15.60:0/1166859633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51200039d0 0x7f5120003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:24.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.945+0000 7f5139390640 1 --2- 172.21.15.60:0/1166859633 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5120004800 0x7f5120004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:24.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.945+0000 7f5139390640 1 --2- 172.21.15.60:0/1166859633 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f51200052e0 0x7f512000fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:24.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.945+0000 7f5139390640 1 -- 172.21.15.60:0/1166859633 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f51341630c0 con 0x7f51200039d0 2024-09-12T02:36:24.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.945+0000 7f5139390640 1 -- 172.21.15.60:0/1166859633 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f51200105c0 con 0x7f5120004800 2024-09-12T02:36:24.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.945+0000 7f5139390640 1 -- 172.21.15.60:0/1166859633 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f51200107c0 con 0x7f51200052e0 2024-09-12T02:36:24.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.945+0000 7f513ab93640 1 --2- 172.21.15.60:0/1166859633 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f51200052e0 0x7f512000fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:24.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.945+0000 7f5139b91640 1 --2- 172.21.15.60:0/1166859633 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5120004800 0x7f5120004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:24.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.945+0000 7f513ab93640 1 -- 172.21.15.60:0/1166859633 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5120004800 msgr2=0x7f5120004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:24.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.945+0000 7f513ab93640 1 --2- 172.21.15.60:0/1166859633 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5120004800 0x7f5120004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:24.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.945+0000 7f513ab93640 1 -- 172.21.15.60:0/1166859633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51200039d0 msgr2=0x7f5120003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:24.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.945+0000 7f513ab93640 1 --2- 172.21.15.60:0/1166859633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51200039d0 0x7f5120003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:24.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.945+0000 7f513ab93640 1 -- 172.21.15.60:0/1166859633 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5134167030 con 0x7f51200052e0 2024-09-12T02:36:24.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.946+0000 7f513ab93640 1 -- 172.21.15.60:0/1166859633 reap_dead start 2024-09-12T02:36:24.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.947+0000 7f513ab93640 1 --2- 172.21.15.60:0/1166859633 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f51200052e0 0x7f512000fdd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f512c00c160 tx=0x7f5120005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1d825a503c0911 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:24.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.948+0000 7f5139390640 1 -- 172.21.15.60:0/1166859633 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512c001ee0 con 0x7f51200052e0 2024-09-12T02:36:24.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.948+0000 7f5139390640 1 -- 172.21.15.60:0/1166859633 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f512c032630 con 0x7f51200052e0 2024-09-12T02:36:24.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.948+0000 7f5139390640 1 -- 172.21.15.60:0/1166859633 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512c032a00 con 0x7f51200052e0 2024-09-12T02:36:24.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.949+0000 7f513c5f6640 1 -- 172.21.15.60:0/1166859633 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f51200052e0 msgr2=0x7f512000fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:24.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.949+0000 7f513c5f6640 1 --2- 172.21.15.60:0/1166859633 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f51200052e0 0x7f512000fdd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f512c00c160 tx=0x7f5120005830 comp rx=0 tx=0).stop 2024-09-12T02:36:24.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.953+0000 7f513c5f6640 1 -- 172.21.15.60:0/1166859633 shutdown_connections 2024-09-12T02:36:24.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.953+0000 7f513c5f6640 1 --2- 172.21.15.60:0/1166859633 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f51200052e0 0x7f512000fdd0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:24.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.953+0000 7f513c5f6640 1 -- 172.21.15.60:0/1166859633 >> 172.21.15.60:0/1166859633 conn(0x7f51340c7a40 msgr2=0x7f51340c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:24.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.954+0000 7f513c5f6640 1 -- 172.21.15.60:0/1166859633 shutdown_connections 2024-09-12T02:36:24.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.955+0000 7f513c5f6640 1 -- 172.21.15.60:0/1166859633 wait complete. 2024-09-12T02:36:24.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.957+0000 7f513c5f6640 1 Processor -- start 2024-09-12T02:36:24.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.957+0000 7f513c5f6640 1 -- start start 2024-09-12T02:36:24.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.958+0000 7f513c5f6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f51200052e0 0x7f5134200f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:24.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.959+0000 7f513c5f6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51340aae30 0x7f5134165ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:24.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.959+0000 7f513c5f6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f51340ab940 0x7f513408c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:24.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.959+0000 7f513c5f6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f513406f460 con 0x7f51340aae30 2024-09-12T02:36:24.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.959+0000 7f513c5f6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f513406f2e0 con 0x7f51340ab940 2024-09-12T02:36:24.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.959+0000 7f513c5f6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f51340c62f0 con 0x7f51200052e0 2024-09-12T02:36:24.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.959+0000 7f5139b91640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51340aae30 0x7f5134165ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:24.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.959+0000 7f5139b91640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51340aae30 0x7f5134165ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47530/0 (socket says 172.21.15.60:47530) 2024-09-12T02:36:24.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.959+0000 7f5139b91640 1 -- 172.21.15.60:0/2266997929 learned_addr learned my addr 172.21.15.60:0/2266997929 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:36:24.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.959+0000 7f513ab93640 1 --2- 172.21.15.60:0/2266997929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f51340ab940 0x7f513408c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:24.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.959+0000 7f5139b91640 1 -- 172.21.15.60:0/2266997929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51340aae30 msgr2=0x7f5134165ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-12T02:36:24.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.959+0000 7f5139b91640 1 -- 172.21.15.60:0/2266997929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51340aae30 msgr2=0x7f5134165ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:36:24.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.959+0000 7f5139b91640 1 --2- 172.21.15.60:0/2266997929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51340aae30 0x7f5134165ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:36:24.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.959+0000 7f5139b91640 1 --2- 172.21.15.60:0/2266997929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51340aae30 0x7f5134165ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:36:24.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.960+0000 7f513ab93640 1 -- 172.21.15.60:0/2266997929 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f51200052e0 msgr2=0x7f5134200f10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:36:24.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.960+0000 7f513ab93640 1 --2- 172.21.15.60:0/2266997929 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f51200052e0 0x7f5134200f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:24.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.960+0000 7f513ab93640 1 -- 172.21.15.60:0/2266997929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51340aae30 msgr2=0x7f5134165ed0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:36:24.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.960+0000 7f513ab93640 1 --2- 172.21.15.60:0/2266997929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51340aae30 0x7f5134165ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:24.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.960+0000 7f513ab93640 1 -- 172.21.15.60:0/2266997929 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51340aabc0 con 0x7f51340ab940 2024-09-12T02:36:24.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.960+0000 7f513ab93640 1 --2- 172.21.15.60:0/2266997929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f51340ab940 0x7f513408c530 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f51340c3160 tx=0x7f512c0014a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:24.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.962+0000 7f512affd640 1 -- 172.21.15.60:0/2266997929 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512c037040 con 0x7f51340ab940 2024-09-12T02:36:24.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.962+0000 7f512affd640 1 -- 172.21.15.60:0/2266997929 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f512c0327e0 con 0x7f51340ab940 2024-09-12T02:36:24.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.962+0000 7f513c5f6640 1 -- 172.21.15.60:0/2266997929 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51340aa8e0 con 0x7f51340ab940 2024-09-12T02:36:24.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.963+0000 7f513c5f6640 1 -- 172.21.15.60:0/2266997929 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51340ad930 con 0x7f51340ab940 2024-09-12T02:36:24.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.963+0000 7f512affd640 1 -- 172.21.15.60:0/2266997929 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512c032bd0 con 0x7f51340ab940 2024-09-12T02:36:24.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.965+0000 7f513c5f6640 1 -- 172.21.15.60:0/2266997929 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f511c005290 con 0x7f51340ab940 2024-09-12T02:36:24.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.967+0000 7f512affd640 1 -- 172.21.15.60:0/2266997929 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f512c062480 con 0x7f51340ab940 2024-09-12T02:36:24.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.967+0000 7f512affd640 1 --2- 172.21.15.60:0/2266997929 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f511806bf00 0x7f511806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:24.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.968+0000 7f512affd640 1 -- 172.21.15.60:0/2266997929 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f512c0ab510 con 0x7f51340ab940 2024-09-12T02:36:24.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.968+0000 7f513a392640 1 --2- 172.21.15.60:0/2266997929 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f511806bf00 0x7f511806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:24.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.969+0000 7f513a392640 1 --2- 172.21.15.60:0/2266997929 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f511806bf00 0x7f511806e3c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5130000f60 tx=0x7f5130001510 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:24.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:24.975+0000 7f512affd640 1 -- 172.21.15.60:0/2266997929 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f512c03b370 con 0x7f51340ab940 2024-09-12T02:36:25.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:25.496+0000 7f513c5f6640 1 -- 172.21.15.60:0/2266997929 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f511c005580 con 0x7f51340ab940 2024-09-12T02:36:25.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:25.497+0000 7f512affd640 1 -- 172.21.15.60:0/2266997929 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1560 (secure 0 0 0) 0x7f512c079b90 con 0x7f51340ab940 2024-09-12T02:36:25.498 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":126,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:36:25.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:25.500+0000 7f513c5f6640 1 -- 172.21.15.60:0/2266997929 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f511806bf00 msgr2=0x7f511806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:25.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:25.501+0000 7f513c5f6640 1 --2- 172.21.15.60:0/2266997929 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f511806bf00 0x7f511806e3c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5130000f60 tx=0x7f5130001510 comp rx=0 tx=0).stop 2024-09-12T02:36:25.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:25.501+0000 7f513c5f6640 1 -- 172.21.15.60:0/2266997929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f51340ab940 msgr2=0x7f513408c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:25.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:25.501+0000 7f513c5f6640 1 --2- 172.21.15.60:0/2266997929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f51340ab940 0x7f513408c530 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f51340c3160 tx=0x7f512c0014a0 comp rx=0 tx=0).stop 2024-09-12T02:36:25.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:25.501+0000 7f513c5f6640 1 -- 172.21.15.60:0/2266997929 shutdown_connections 2024-09-12T02:36:25.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:25.501+0000 7f513c5f6640 1 --2- 172.21.15.60:0/2266997929 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f511806bf00 0x7f511806e3c0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:25.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:25.501+0000 7f513c5f6640 1 --2- 172.21.15.60:0/2266997929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f51340ab940 0x7f513408c530 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:25.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:25.501+0000 7f513c5f6640 1 --2- 172.21.15.60:0/2266997929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51340aae30 0x7f5134165ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:25.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:25.501+0000 7f513c5f6640 1 --2- 172.21.15.60:0/2266997929 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f51200052e0 0x7f5134200f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:25.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:25.501+0000 7f513c5f6640 1 -- 172.21.15.60:0/2266997929 >> 172.21.15.60:0/2266997929 conn(0x7f51340c7a40 msgr2=0x7f51340a8300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:25.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:25.501+0000 7f513c5f6640 1 -- 172.21.15.60:0/2266997929 shutdown_connections 2024-09-12T02:36:25.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:25.501+0000 7f513c5f6640 1 -- 172.21.15.60:0/2266997929 wait complete. 2024-09-12T02:36:28.522 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:36:28.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.714+0000 7fb19165e640 1 Processor -- start 2024-09-12T02:36:28.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.715+0000 7fb19165e640 1 -- start start 2024-09-12T02:36:28.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.716+0000 7fb19165e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb18c0a6c10 0x7fb18c0c2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:28.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.717+0000 7fb19165e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb18c0c6010 0x7fb18c06dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:28.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.717+0000 7fb19165e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb18c15a970 con 0x7fb18c0c5940 2024-09-12T02:36:28.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.717+0000 7fb19165e640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fb18c15ac50 con 0x7fb18c0c6010 2024-09-12T02:36:28.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.717+0000 7fb19165e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb18c15af30 con 0x7fb18c0a6c10 2024-09-12T02:36:28.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.717+0000 7fb18b7fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb18c0c5940 0x7fb18c06dff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:44438/0 (socket says 172.21.15.60:44438) 2024-09-12T02:36:28.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.717+0000 7fb18b7fe640 1 -- 172.21.15.60:0/728417476 learned_addr learned my addr 172.21.15.60:0/728417476 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:36:28.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.718+0000 7fb18a7fc640 1 --2- 172.21.15.60:0/728417476 >> v2:172.21.15.60:3300/0 conn(0x7fb18c0c6010 0x7fb18c06dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:28.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.718+0000 7fb18a7fc640 1 -- 172.21.15.60:0/728417476 >> v2:172.21.15.60:3300/0 conn(0x7fb18c0c6010 msgr2=0x7fb18c06dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:36:28.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.718+0000 7fb18a7fc640 1 -- 172.21.15.60:0/728417476 >> v2:172.21.15.60:3300/0 conn(0x7fb18c0c6010 msgr2=0x7fb18c06dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:36:28.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.718+0000 7fb18a7fc640 1 --2- 172.21.15.60:0/728417476 >> v2:172.21.15.60:3300/0 conn(0x7fb18c0c6010 0x7fb18c06dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:36:28.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.719+0000 7fb18a7fc640 1 --2- 172.21.15.60:0/728417476 >> v2:172.21.15.60:3300/0 conn(0x7fb18c0c6010 0x7fb18c06dab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:36:28.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.721+0000 7fb18affd640 1 --2- 172.21.15.60:0/728417476 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb18c0a6c10 0x7fb18c0c2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:28.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.723+0000 7fb18affd640 1 -- 172.21.15.60:0/728417476 >> v2:172.21.15.60:3300/0 conn(0x7fb18c0c6010 msgr2=0x7fb18c06dab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:36:28.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.723+0000 7fb18affd640 1 --2- 172.21.15.60:0/728417476 >> v2:172.21.15.60:3300/0 conn(0x7fb18c0c6010 0x7fb18c06dab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:28.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.723+0000 7fb18affd640 1 -- 172.21.15.60:0/728417476 >> v1:172.21.15.60:6789/0 conn(0x7fb18c0c5940 legacy=0x7fb18c06dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:28.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.723+0000 7fb18affd640 1 -- 172.21.15.60:0/728417476 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb18c15b210 con 0x7fb18c0a6c10 2024-09-12T02:36:28.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.725+0000 7fb18affd640 1 --2- 172.21.15.60:0/728417476 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb18c0a6c10 0x7fb18c0c2440 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb17c0097a0 tx=0x7fb17c02a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23d31e64e394de98 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:28.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.727+0000 7fb189ffb640 1 -- 172.21.15.60:0/728417476 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb17c037070 con 0x7fb18c0a6c10 2024-09-12T02:36:28.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.728+0000 7fb189ffb640 1 -- 172.21.15.60:0/728417476 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb17c032440 con 0x7fb18c0a6c10 2024-09-12T02:36:28.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.728+0000 7fb189ffb640 1 -- 172.21.15.60:0/728417476 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb17c037070 con 0x7fb18c0a6c10 2024-09-12T02:36:28.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.729+0000 7fb19165e640 1 -- 172.21.15.60:0/728417476 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb18c0a6c10 msgr2=0x7fb18c0c2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:28.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.729+0000 7fb19165e640 1 --2- 172.21.15.60:0/728417476 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb18c0a6c10 0x7fb18c0c2440 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb17c0097a0 tx=0x7fb17c02a110 comp rx=0 tx=0).stop 2024-09-12T02:36:28.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.730+0000 7fb19165e640 1 -- 172.21.15.60:0/728417476 shutdown_connections 2024-09-12T02:36:28.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.730+0000 7fb19165e640 1 --2- 172.21.15.60:0/728417476 >> v2:172.21.15.60:3300/0 conn(0x7fb18c0c6010 0x7fb18c06dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:28.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.730+0000 7fb19165e640 1 --2- 172.21.15.60:0/728417476 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb18c0a6c10 0x7fb18c0c2440 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:28.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.730+0000 7fb19165e640 1 -- 172.21.15.60:0/728417476 >> 172.21.15.60:0/728417476 conn(0x7fb18c0c7a40 msgr2=0x7fb18c0c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:28.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.732+0000 7fb19165e640 1 -- 172.21.15.60:0/728417476 shutdown_connections 2024-09-12T02:36:28.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.732+0000 7fb19165e640 1 -- 172.21.15.60:0/728417476 wait complete. 2024-09-12T02:36:28.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.735+0000 7fb19165e640 1 Processor -- start 2024-09-12T02:36:28.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.738+0000 7fb19165e640 1 -- start start 2024-09-12T02:36:28.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.739+0000 7fb19165e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb18c0a6c10 0x7fb18c0a7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:28.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.739+0000 7fb19165e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb18c0c5940 0x7fb18c153cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:28.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.739+0000 7fb18a7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb18c0c5940 0x7fb18c153cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:28.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.740+0000 7fb18a7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb18c0c5940 0x7fb18c153cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47552/0 (socket says 172.21.15.60:47552) 2024-09-12T02:36:28.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.740+0000 7fb18a7fc640 1 -- 172.21.15.60:0/2339510922 learned_addr learned my addr 172.21.15.60:0/2339510922 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:36:28.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.740+0000 7fb19165e640 1 --2- 172.21.15.60:0/2339510922 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb18c0c6010 0x7fb18c1541f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:28.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.740+0000 7fb19165e640 1 -- 172.21.15.60:0/2339510922 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb18c0a73a0 con 0x7fb18c0c5940 2024-09-12T02:36:28.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.740+0000 7fb19165e640 1 -- 172.21.15.60:0/2339510922 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb18c15a620 con 0x7fb18c0a6c10 2024-09-12T02:36:28.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.740+0000 7fb19165e640 1 -- 172.21.15.60:0/2339510922 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb18c0a7520 con 0x7fb18c0c6010 2024-09-12T02:36:28.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.740+0000 7fb18a7fc640 1 -- 172.21.15.60:0/2339510922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb18c0c5940 msgr2=0x7fb18c153cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-12T02:36:28.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.740+0000 7fb18a7fc640 1 -- 172.21.15.60:0/2339510922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb18c0c5940 msgr2=0x7fb18c153cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:36:28.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.740+0000 7fb18a7fc640 1 --2- 172.21.15.60:0/2339510922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb18c0c5940 0x7fb18c153cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:36:28.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.740+0000 7fb18a7fc640 1 --2- 172.21.15.60:0/2339510922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb18c0c5940 0x7fb18c153cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:36:28.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.741+0000 7fb18affd640 1 --2- 172.21.15.60:0/2339510922 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb18c0a6c10 0x7fb18c0a7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:28.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.741+0000 7fb18b7fe640 1 --2- 172.21.15.60:0/2339510922 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb18c0c6010 0x7fb18c1541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:28.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.745+0000 7fb18affd640 1 -- 172.21.15.60:0/2339510922 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb18c0c6010 msgr2=0x7fb18c1541f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:28.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.745+0000 7fb18affd640 1 --2- 172.21.15.60:0/2339510922 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb18c0c6010 0x7fb18c1541f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:28.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.745+0000 7fb18affd640 1 -- 172.21.15.60:0/2339510922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb18c0c5940 msgr2=0x7fb18c153cb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:36:28.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.745+0000 7fb18affd640 1 --2- 172.21.15.60:0/2339510922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb18c0c5940 0x7fb18c153cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:28.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.745+0000 7fb18affd640 1 -- 172.21.15.60:0/2339510922 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb18c1f9820 con 0x7fb18c0a6c10 2024-09-12T02:36:28.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.748+0000 7fb18affd640 1 --2- 172.21.15.60:0/2339510922 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb18c0a6c10 0x7fb18c0a7910 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb18c0a9730 tx=0x7fb17c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:28.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.748+0000 7fb1737fe640 1 -- 172.21.15.60:0/2339510922 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb17c042070 con 0x7fb18c0a6c10 2024-09-12T02:36:28.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.748+0000 7fb19165e640 1 -- 172.21.15.60:0/2339510922 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb18c0ab210 con 0x7fb18c0a6c10 2024-09-12T02:36:28.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.749+0000 7fb19165e640 1 -- 172.21.15.60:0/2339510922 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb18c1f9540 con 0x7fb18c0a6c10 2024-09-12T02:36:28.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.749+0000 7fb1737fe640 1 -- 172.21.15.60:0/2339510922 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb17c006dd0 con 0x7fb18c0a6c10 2024-09-12T02:36:28.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.749+0000 7fb1737fe640 1 -- 172.21.15.60:0/2339510922 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb17c02ae60 con 0x7fb18c0a6c10 2024-09-12T02:36:28.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.750+0000 7fb19165e640 1 -- 172.21.15.60:0/2339510922 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb16c005290 con 0x7fb18c0a6c10 2024-09-12T02:36:28.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.752+0000 7fb1737fe640 1 -- 172.21.15.60:0/2339510922 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb17c045070 con 0x7fb18c0a6c10 2024-09-12T02:36:28.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.754+0000 7fb1737fe640 1 --2- 172.21.15.60:0/2339510922 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb17806bf00 0x7fb17806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:28.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.754+0000 7fb1737fe640 1 -- 172.21.15.60:0/2339510922 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fb17c0abaf0 con 0x7fb18c0a6c10 2024-09-12T02:36:28.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.754+0000 7fb18a7fc640 1 --2- 172.21.15.60:0/2339510922 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb17806bf00 0x7fb17806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:28.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.755+0000 7fb18a7fc640 1 --2- 172.21.15.60:0/2339510922 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb17806bf00 0x7fb17806e3c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb18c0a9660 tx=0x7fb18400b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:28.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:28.764+0000 7fb1737fe640 1 -- 172.21.15.60:0/2339510922 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb17c079c40 con 0x7fb18c0a6c10 2024-09-12T02:36:29.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:29.269+0000 7fb19165e640 1 -- 172.21.15.60:0/2339510922 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb16c005580 con 0x7fb18c0a6c10 2024-09-12T02:36:29.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:29.271+0000 7fb1737fe640 1 -- 172.21.15.60:0/2339510922 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1560 (secure 0 0 0) 0x7fb17c07df40 con 0x7fb18c0a6c10 2024-09-12T02:36:29.273 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":126,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":25,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:36:29.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:29.276+0000 7fb19165e640 1 -- 172.21.15.60:0/2339510922 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb17806bf00 msgr2=0x7fb17806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:29.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:29.276+0000 7fb19165e640 1 --2- 172.21.15.60:0/2339510922 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb17806bf00 0x7fb17806e3c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb18c0a9660 tx=0x7fb18400b040 comp rx=0 tx=0).stop 2024-09-12T02:36:29.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:29.276+0000 7fb19165e640 1 -- 172.21.15.60:0/2339510922 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb18c0a6c10 msgr2=0x7fb18c0a7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:29.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:29.276+0000 7fb19165e640 1 --2- 172.21.15.60:0/2339510922 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb18c0a6c10 0x7fb18c0a7910 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb18c0a9730 tx=0x7fb17c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:36:29.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:29.276+0000 7fb19165e640 1 -- 172.21.15.60:0/2339510922 shutdown_connections 2024-09-12T02:36:29.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:29.276+0000 7fb19165e640 1 --2- 172.21.15.60:0/2339510922 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb17806bf00 0x7fb17806e3c0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:29.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:29.276+0000 7fb19165e640 1 --2- 172.21.15.60:0/2339510922 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb18c0c6010 0x7fb18c1541f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:29.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:29.276+0000 7fb19165e640 1 --2- 172.21.15.60:0/2339510922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb18c0c5940 0x7fb18c153cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:29.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:29.277+0000 7fb19165e640 1 --2- 172.21.15.60:0/2339510922 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb18c0a6c10 0x7fb18c0a7910 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:29.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:29.277+0000 7fb19165e640 1 -- 172.21.15.60:0/2339510922 >> 172.21.15.60:0/2339510922 conn(0x7fb18c0c7a40 msgr2=0x7fb18c0a8940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:29.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:29.277+0000 7fb19165e640 1 -- 172.21.15.60:0/2339510922 shutdown_connections 2024-09-12T02:36:29.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:29.277+0000 7fb19165e640 1 -- 172.21.15.60:0/2339510922 wait complete. 2024-09-12T02:36:31.197 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:36:31.375 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:36:32.302 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:36:32.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:32.488+0000 7fdb5ffff640 1 Processor -- start 2024-09-12T02:36:32.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:32.491+0000 7fdb5ffff640 1 -- start start 2024-09-12T02:36:32.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:32.492+0000 7fdb5ffff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58048830 0x7fdb58049190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:32.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:32.492+0000 7fdb5ffff640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb5804a990 con 0x7fdb580465d0 2024-09-12T02:36:32.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:32.492+0000 7fdb5ffff640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb5804ac70 con 0x7fdb5800ac90 2024-09-12T02:36:32.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:32.492+0000 7fdb5ffff640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdb580da330 con 0x7fdb58048830 2024-09-12T02:36:32.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:32.494+0000 7fdb5effd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58048830 0x7fdb58049190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:32.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:32.494+0000 7fdb5f7fe640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fdb5800ac90 0x7fdb580d66f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:50768/0 (socket says 172.21.15.60:50768) 2024-09-12T02:36:32.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:32.494+0000 7fdb5f7fe640 1 -- 172.21.15.60:0/896833028 learned_addr learned my addr 172.21.15.60:0/896833028 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:36:32.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:32.495+0000 7fdb5effd640 1 -- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58048830 msgr2=0x7fdb58049190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:36:32.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:32.495+0000 7fdb5effd640 1 -- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58048830 msgr2=0x7fdb58049190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:36:32.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:32.495+0000 7fdb5effd640 1 --2- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58048830 0x7fdb58049190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:36:32.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:32.495+0000 7fdb5effd640 1 --2- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58048830 0x7fdb58049190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:36:32.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:32.696+0000 7fdb5effd640 1 --2- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58048830 0x7fdb58049190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:32.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:32.696+0000 7fdb5effd640 1 -- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58048830 msgr2=0x7fdb58049190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:36:32.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:32.696+0000 7fdb5effd640 1 -- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58048830 msgr2=0x7fdb58049190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:36:32.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:32.696+0000 7fdb5effd640 1 --2- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58048830 0x7fdb58049190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:36:32.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:32.696+0000 7fdb5effd640 1 --2- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58048830 0x7fdb58049190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:36:33.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:33.097+0000 7fdb5effd640 1 --2- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58048830 0x7fdb58049190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:33.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:33.097+0000 7fdb5effd640 1 -- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58048830 msgr2=0x7fdb58049190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:36:33.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:33.097+0000 7fdb5effd640 1 -- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58048830 msgr2=0x7fdb58049190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:36:33.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:33.097+0000 7fdb5effd640 1 --2- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58048830 0x7fdb58049190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:36:33.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:33.097+0000 7fdb5effd640 1 --2- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58048830 0x7fdb58049190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:36:33.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:33.898+0000 7fdb5effd640 1 --2- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58048830 0x7fdb58049190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:33.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:33.898+0000 7fdb5effd640 1 -- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58048830 msgr2=0x7fdb58049190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:36:33.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:33.898+0000 7fdb5effd640 1 -- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58048830 msgr2=0x7fdb58049190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:36:33.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:33.898+0000 7fdb5effd640 1 --2- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58048830 0x7fdb58049190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:36:33.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:33.898+0000 7fdb5effd640 1 --2- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58048830 0x7fdb58049190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:36:34.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:34.927+0000 7fdb5e7fc640 1 -- 172.21.15.60:0/896833028 >> v1:172.21.15.60:6789/0 conn(0x7fdb580465d0 legacy=0x7fdb580d9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-12T02:36:34.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:34.927+0000 7fdb5e7fc640 1 -- 172.21.15.60:0/896833028 >> v1:172.21.15.60:6789/0 conn(0x7fdb580465d0 legacy=0x7fdb580d9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:36:34.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:34.927+0000 7fdb5e7fc640 1 --1- 172.21.15.60:0/896833028 >> v1:172.21.15.60:6789/0 conn(0x7fdb580465d0 0x7fdb580d9c20 :-1 s=OPENED pgs=26 cs=1 l=1).handle_message read tag failed 2024-09-12T02:36:34.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:34.927+0000 7fdb5e7fc640 1 --1- 172.21.15.60:0/896833028 >> v1:172.21.15.60:6789/0 conn(0x7fdb580465d0 0x7fdb580d9c20 :-1 s=OPENED pgs=26 cs=1 l=1).fault on lossy channel, failing 2024-09-12T02:36:35.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:35.492+0000 7fdb5cff9640 1 -- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58048830 msgr2=0x7fdb58049190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:36:35.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:35.492+0000 7fdb5cff9640 1 --2- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58048830 0x7fdb58049190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:35.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:35.492+0000 7fdb5cff9640 1 -- 172.21.15.60:0/896833028 >> v1:172.21.15.105:6789/0 conn(0x7fdb5800ac90 legacy=0x7fdb580d66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:35.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:35.492+0000 7fdb5cff9640 1 -- 172.21.15.60:0/896833028 >> v1:172.21.15.60:6789/0 conn(0x7fdb580465d0 legacy=0x7fdb580d9c20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:36:35.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:35.492+0000 7fdb5cff9640 1 --2- 172.21.15.60:0/896833028 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c003640 0x7fdb4c005ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:35.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:35.492+0000 7fdb5cff9640 1 --2- 172.21.15.60:0/896833028 >> v2:172.21.15.105:3300/0 conn(0x7fdb4c006110 0x7fdb4c0085d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:35.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:35.492+0000 7fdb5cff9640 1 -- 172.21.15.60:0/896833028 --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fdb580da330 con 0x7fdb4c003640 2024-09-12T02:36:35.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:35.492+0000 7fdb5cff9640 1 -- 172.21.15.60:0/896833028 --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fdb4c008c80 con 0x7fdb4c006110 2024-09-12T02:36:35.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:35.492+0000 7fdb5effd640 1 --2- 172.21.15.60:0/896833028 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c003640 0x7fdb4c005ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:35.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:35.493+0000 7fdb5effd640 1 -- 172.21.15.60:0/896833028 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c003640 msgr2=0x7fdb4c005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:36:35.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:35.493+0000 7fdb5effd640 1 -- 172.21.15.60:0/896833028 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c003640 msgr2=0x7fdb4c005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:36:35.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:35.493+0000 7fdb5effd640 1 --2- 172.21.15.60:0/896833028 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c003640 0x7fdb4c005ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:36:35.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:35.493+0000 7fdb5effd640 1 --2- 172.21.15.60:0/896833028 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c003640 0x7fdb4c005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:36:35.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:35.493+0000 7fdb5e7fc640 1 --2- 172.21.15.60:0/896833028 >> v2:172.21.15.105:3300/0 conn(0x7fdb4c006110 0x7fdb4c0085d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:35.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:35.493+0000 7fdb5e7fc640 1 -- 172.21.15.60:0/896833028 >> v2:172.21.15.105:3300/0 conn(0x7fdb4c006110 msgr2=0x7fdb4c0085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:36:35.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:35.493+0000 7fdb5e7fc640 1 -- 172.21.15.60:0/896833028 >> v2:172.21.15.105:3300/0 conn(0x7fdb4c006110 msgr2=0x7fdb4c0085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:36:35.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:35.493+0000 7fdb5e7fc640 1 --2- 172.21.15.60:0/896833028 >> v2:172.21.15.105:3300/0 conn(0x7fdb4c006110 0x7fdb4c0085d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:36:35.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:35.493+0000 7fdb5e7fc640 1 --2- 172.21.15.60:0/896833028 >> v2:172.21.15.105:3300/0 conn(0x7fdb4c006110 0x7fdb4c0085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:36:35.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:35.695+0000 7fdb5e7fc640 1 --2- 172.21.15.60:0/896833028 >> v2:172.21.15.105:3300/0 conn(0x7fdb4c006110 0x7fdb4c0085d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:35.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:35.695+0000 7fdb5effd640 1 --2- 172.21.15.60:0/896833028 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c003640 0x7fdb4c005ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:35.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:35.695+0000 7fdb5e7fc640 1 -- 172.21.15.60:0/896833028 >> v2:172.21.15.105:3300/0 conn(0x7fdb4c006110 msgr2=0x7fdb4c0085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:36:35.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:35.695+0000 7fdb5e7fc640 1 -- 172.21.15.60:0/896833028 >> v2:172.21.15.105:3300/0 conn(0x7fdb4c006110 msgr2=0x7fdb4c0085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:36:35.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:35.695+0000 7fdb5e7fc640 1 --2- 172.21.15.60:0/896833028 >> v2:172.21.15.105:3300/0 conn(0x7fdb4c006110 0x7fdb4c0085d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:36:35.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:35.695+0000 7fdb5e7fc640 1 --2- 172.21.15.60:0/896833028 >> v2:172.21.15.105:3300/0 conn(0x7fdb4c006110 0x7fdb4c0085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:36:35.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:35.696+0000 7fdb5effd640 1 -- 172.21.15.60:0/896833028 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c003640 msgr2=0x7fdb4c005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:36:35.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:35.696+0000 7fdb5effd640 1 -- 172.21.15.60:0/896833028 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c003640 msgr2=0x7fdb4c005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:36:35.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:35.696+0000 7fdb5effd640 1 --2- 172.21.15.60:0/896833028 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c003640 0x7fdb4c005ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:36:35.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:35.696+0000 7fdb5effd640 1 --2- 172.21.15.60:0/896833028 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c003640 0x7fdb4c005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:36:36.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:36.097+0000 7fdb5e7fc640 1 --2- 172.21.15.60:0/896833028 >> v2:172.21.15.105:3300/0 conn(0x7fdb4c006110 0x7fdb4c0085d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:36.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:36.097+0000 7fdb5effd640 1 --2- 172.21.15.60:0/896833028 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c003640 0x7fdb4c005ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:36.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:36.097+0000 7fdb5e7fc640 1 -- 172.21.15.60:0/896833028 >> v2:172.21.15.105:3300/0 conn(0x7fdb4c006110 msgr2=0x7fdb4c0085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:36:36.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:36.097+0000 7fdb5e7fc640 1 -- 172.21.15.60:0/896833028 >> v2:172.21.15.105:3300/0 conn(0x7fdb4c006110 msgr2=0x7fdb4c0085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:36:36.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:36.097+0000 7fdb5e7fc640 1 --2- 172.21.15.60:0/896833028 >> v2:172.21.15.105:3300/0 conn(0x7fdb4c006110 0x7fdb4c0085d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:36:36.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:36.097+0000 7fdb5e7fc640 1 --2- 172.21.15.60:0/896833028 >> v2:172.21.15.105:3300/0 conn(0x7fdb4c006110 0x7fdb4c0085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:36:36.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:36.098+0000 7fdb5effd640 1 -- 172.21.15.60:0/896833028 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c003640 msgr2=0x7fdb4c005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:36:36.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:36.098+0000 7fdb5effd640 1 -- 172.21.15.60:0/896833028 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c003640 msgr2=0x7fdb4c005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:36:36.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:36.098+0000 7fdb5effd640 1 --2- 172.21.15.60:0/896833028 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c003640 0x7fdb4c005ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:36:36.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:36.098+0000 7fdb5effd640 1 --2- 172.21.15.60:0/896833028 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c003640 0x7fdb4c005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:36:36.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:36.898+0000 7fdb5e7fc640 1 --2- 172.21.15.60:0/896833028 >> v2:172.21.15.105:3300/0 conn(0x7fdb4c006110 0x7fdb4c0085d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:36.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:36.899+0000 7fdb5effd640 1 --2- 172.21.15.60:0/896833028 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c003640 0x7fdb4c005ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:36.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:36.899+0000 7fdb5effd640 1 -- 172.21.15.60:0/896833028 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c003640 msgr2=0x7fdb4c005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:36:36.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:36.899+0000 7fdb5effd640 1 -- 172.21.15.60:0/896833028 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c003640 msgr2=0x7fdb4c005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:36:36.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:36.899+0000 7fdb5effd640 1 --2- 172.21.15.60:0/896833028 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c003640 0x7fdb4c005ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:36:36.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:36.899+0000 7fdb5effd640 1 --2- 172.21.15.60:0/896833028 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c003640 0x7fdb4c005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:36:36.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:36.901+0000 7fdb5e7fc640 1 -- 172.21.15.60:0/896833028 >> v2:172.21.15.105:3300/0 conn(0x7fdb4c006110 msgr2=0x7fdb4c0085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:36:36.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:36.901+0000 7fdb5e7fc640 1 -- 172.21.15.60:0/896833028 >> v2:172.21.15.105:3300/0 conn(0x7fdb4c006110 msgr2=0x7fdb4c0085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:36:36.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:36.901+0000 7fdb5e7fc640 1 --2- 172.21.15.60:0/896833028 >> v2:172.21.15.105:3300/0 conn(0x7fdb4c006110 0x7fdb4c0085d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:36:36.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:36.901+0000 7fdb5e7fc640 1 --2- 172.21.15.60:0/896833028 >> v2:172.21.15.105:3300/0 conn(0x7fdb4c006110 0x7fdb4c0085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:36:38.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:38.492+0000 7fdb5cff9640 1 -- 172.21.15.60:0/896833028 >> v2:172.21.15.105:3300/0 conn(0x7fdb4c006110 msgr2=0x7fdb4c0085d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:36:38.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:38.492+0000 7fdb5cff9640 1 --2- 172.21.15.60:0/896833028 >> v2:172.21.15.105:3300/0 conn(0x7fdb4c006110 0x7fdb4c0085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:38.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:38.492+0000 7fdb5cff9640 1 -- 172.21.15.60:0/896833028 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c003640 msgr2=0x7fdb4c005ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:36:38.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:38.492+0000 7fdb5cff9640 1 --2- 172.21.15.60:0/896833028 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c003640 0x7fdb4c005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:38.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:38.492+0000 7fdb5cff9640 1 --2- 172.21.15.60:0/896833028 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c014ff0 0x7fdb4c017480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:38.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:38.492+0000 7fdb5cff9640 1 --2- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58048830 0x7fdb4c019b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:38.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:38.492+0000 7fdb5cff9640 1 -- 172.21.15.60:0/896833028 --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb5804af50 con 0x7fdb580465d0 2024-09-12T02:36:38.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:38.492+0000 7fdb5cff9640 1 -- 172.21.15.60:0/896833028 --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fdb580da330 con 0x7fdb4c014ff0 2024-09-12T02:36:38.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:38.492+0000 7fdb5cff9640 1 -- 172.21.15.60:0/896833028 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdb4c008c80 con 0x7fdb58048830 2024-09-12T02:36:38.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:38.492+0000 7fdb5f7fe640 1 -- 172.21.15.60:0/896833028 reap_dead start 2024-09-12T02:36:38.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:38.494+0000 7fdb5e7fc640 1 --2- 172.21.15.60:0/896833028 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c014ff0 0x7fdb4c017480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:38.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:38.494+0000 7fdb5f7fe640 1 --2- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58048830 0x7fdb4c019b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:38.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:38.494+0000 7fdb5e7fc640 1 -- 172.21.15.60:0/896833028 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c014ff0 msgr2=0x7fdb4c017480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:36:38.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:38.494+0000 7fdb5e7fc640 1 -- 172.21.15.60:0/896833028 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c014ff0 msgr2=0x7fdb4c017480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:36:38.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:38.494+0000 7fdb5e7fc640 1 --2- 172.21.15.60:0/896833028 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c014ff0 0x7fdb4c017480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:36:38.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:38.494+0000 7fdb5e7fc640 1 --2- 172.21.15.60:0/896833028 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c014ff0 0x7fdb4c017480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:36:38.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:38.496+0000 7fdb5f7fe640 1 -- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58048830 msgr2=0x7fdb4c019b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:36:38.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:38.496+0000 7fdb5f7fe640 1 -- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58048830 msgr2=0x7fdb4c019b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:36:38.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:38.496+0000 7fdb5f7fe640 1 --2- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58048830 0x7fdb4c019b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:36:38.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:38.496+0000 7fdb5f7fe640 1 --2- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58048830 0x7fdb4c019b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:36:38.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:38.695+0000 7fdb5e7fc640 1 --2- 172.21.15.60:0/896833028 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c014ff0 0x7fdb4c017480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:38.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:38.695+0000 7fdb5e7fc640 1 -- 172.21.15.60:0/896833028 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c014ff0 msgr2=0x7fdb4c017480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:36:38.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:38.695+0000 7fdb5e7fc640 1 -- 172.21.15.60:0/896833028 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c014ff0 msgr2=0x7fdb4c017480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:36:38.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:38.695+0000 7fdb5e7fc640 1 --2- 172.21.15.60:0/896833028 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c014ff0 0x7fdb4c017480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:36:38.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:38.695+0000 7fdb5e7fc640 1 --2- 172.21.15.60:0/896833028 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c014ff0 0x7fdb4c017480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:36:38.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:38.697+0000 7fdb5f7fe640 1 --2- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58048830 0x7fdb4c019b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:38.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:38.697+0000 7fdb5f7fe640 1 -- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58048830 msgr2=0x7fdb4c019b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:36:38.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:38.697+0000 7fdb5f7fe640 1 -- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58048830 msgr2=0x7fdb4c019b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:36:38.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:38.697+0000 7fdb5f7fe640 1 --2- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58048830 0x7fdb4c019b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:36:38.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:38.697+0000 7fdb5f7fe640 1 --2- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58048830 0x7fdb4c019b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:36:39.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:39.096+0000 7fdb5e7fc640 1 --2- 172.21.15.60:0/896833028 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c014ff0 0x7fdb4c017480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:39.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:39.096+0000 7fdb5e7fc640 1 -- 172.21.15.60:0/896833028 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c014ff0 msgr2=0x7fdb4c017480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:36:39.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:39.096+0000 7fdb5e7fc640 1 -- 172.21.15.60:0/896833028 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c014ff0 msgr2=0x7fdb4c017480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:36:39.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:39.096+0000 7fdb5e7fc640 1 --2- 172.21.15.60:0/896833028 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c014ff0 0x7fdb4c017480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:36:39.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:39.096+0000 7fdb5e7fc640 1 --2- 172.21.15.60:0/896833028 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c014ff0 0x7fdb4c017480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:36:39.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:39.098+0000 7fdb5f7fe640 1 --2- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58048830 0x7fdb4c019b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:39.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:39.098+0000 7fdb5f7fe640 1 -- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58048830 msgr2=0x7fdb4c019b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:36:39.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:39.098+0000 7fdb5f7fe640 1 -- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58048830 msgr2=0x7fdb4c019b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:36:39.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:39.098+0000 7fdb5f7fe640 1 --2- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58048830 0x7fdb4c019b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:36:39.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:39.098+0000 7fdb5f7fe640 1 --2- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58048830 0x7fdb4c019b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:36:39.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:39.897+0000 7fdb5e7fc640 1 --2- 172.21.15.60:0/896833028 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c014ff0 0x7fdb4c017480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:39.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:39.897+0000 7fdb5e7fc640 1 -- 172.21.15.60:0/896833028 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c014ff0 msgr2=0x7fdb4c017480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:36:39.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:39.897+0000 7fdb5e7fc640 1 -- 172.21.15.60:0/896833028 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c014ff0 msgr2=0x7fdb4c017480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:36:39.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:39.897+0000 7fdb5e7fc640 1 --2- 172.21.15.60:0/896833028 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c014ff0 0x7fdb4c017480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:36:39.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:39.897+0000 7fdb5e7fc640 1 --2- 172.21.15.60:0/896833028 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c014ff0 0x7fdb4c017480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:36:39.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:39.900+0000 7fdb5f7fe640 1 --2- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58048830 0x7fdb4c019b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:39.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:39.901+0000 7fdb5f7fe640 1 -- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58048830 msgr2=0x7fdb4c019b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:36:39.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:39.901+0000 7fdb5f7fe640 1 -- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58048830 msgr2=0x7fdb4c019b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:36:39.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:39.901+0000 7fdb5f7fe640 1 --2- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58048830 0x7fdb4c019b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:36:39.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:39.901+0000 7fdb5f7fe640 1 --2- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58048830 0x7fdb4c019b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:36:41.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.492+0000 7fdb5cff9640 1 -- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58048830 msgr2=0x7fdb4c019b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:36:41.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.492+0000 7fdb5cff9640 1 --2- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58048830 0x7fdb4c019b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:41.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.492+0000 7fdb5cff9640 1 -- 172.21.15.60:0/896833028 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c014ff0 msgr2=0x7fdb4c017480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:36:41.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.492+0000 7fdb5cff9640 1 --2- 172.21.15.60:0/896833028 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c014ff0 0x7fdb4c017480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:41.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.492+0000 7fdb5cff9640 1 -- 172.21.15.60:0/896833028 >> v1:172.21.15.60:6789/0 conn(0x7fdb580465d0 legacy=0x7fdb4c0138b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:41.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.492+0000 7fdb5cff9640 1 --2- 172.21.15.60:0/896833028 >> v2:172.21.15.105:3300/0 conn(0x7fdb4c01a210 0x7fdb4c005ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:41.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.492+0000 7fdb5cff9640 1 -- 172.21.15.60:0/896833028 --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb4c01b210 con 0x7fdb4c01a6c0 2024-09-12T02:36:41.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.492+0000 7fdb5cff9640 1 -- 172.21.15.60:0/896833028 --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fdb580da330 con 0x7fdb4c01a210 2024-09-12T02:36:41.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.493+0000 7fdb5effd640 1 --2- 172.21.15.60:0/896833028 >> v2:172.21.15.105:3300/0 conn(0x7fdb4c01a210 0x7fdb4c005ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:41.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.493+0000 7fdb5effd640 1 -- 172.21.15.60:0/896833028 >> v1:172.21.15.105:6789/0 conn(0x7fdb4c01a6c0 legacy=0x7fdb4c01b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:41.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.493+0000 7fdb5effd640 1 -- 172.21.15.60:0/896833028 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb4c01ac30 con 0x7fdb4c01a210 2024-09-12T02:36:41.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.494+0000 7fdb5effd640 1 --2- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb4c01a210 0x7fdb4c005ac0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c006020 tx=0x7fdb5002c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=221f1da4492a23b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:41.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.494+0000 7fdb5dffb640 1 -- 172.21.15.60:0/896833028 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb50032070 con 0x7fdb4c01a210 2024-09-12T02:36:41.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.494+0000 7fdb5dffb640 1 -- 172.21.15.60:0/896833028 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb5002cc40 con 0x7fdb4c01a210 2024-09-12T02:36:41.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.494+0000 7fdb5dffb640 1 -- 172.21.15.60:0/896833028 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb50036400 con 0x7fdb4c01a210 2024-09-12T02:36:41.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.495+0000 7fdb5ffff640 1 -- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb4c01a210 msgr2=0x7fdb4c005ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:41.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.495+0000 7fdb5ffff640 1 --2- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb4c01a210 0x7fdb4c005ac0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c006020 tx=0x7fdb5002c3c0 comp rx=0 tx=0).stop 2024-09-12T02:36:41.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.495+0000 7fdb5f7fe640 1 -- 172.21.15.60:0/896833028 reap_dead start 2024-09-12T02:36:41.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.495+0000 7fdb5ffff640 1 -- 172.21.15.60:0/896833028 shutdown_connections 2024-09-12T02:36:41.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.495+0000 7fdb5ffff640 1 --2- 172.21.15.60:0/896833028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb4c01a210 0x7fdb4c005ac0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:41.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.495+0000 7fdb5ffff640 1 -- 172.21.15.60:0/896833028 >> 172.21.15.60:0/896833028 conn(0x7fdb58047d10 msgr2=0x7fdb58048120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:41.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.495+0000 7fdb5ffff640 1 -- 172.21.15.60:0/896833028 shutdown_connections 2024-09-12T02:36:41.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.495+0000 7fdb5ffff640 1 -- 172.21.15.60:0/896833028 wait complete. 2024-09-12T02:36:41.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.497+0000 7fdb5ffff640 1 Processor -- start 2024-09-12T02:36:41.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.497+0000 7fdb5ffff640 1 -- start start 2024-09-12T02:36:41.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.498+0000 7fdb5ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb4c01a210 0x7fdb58043710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:41.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.498+0000 7fdb5ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb5803f260 0x7fdb58041810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:41.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.498+0000 7fdb5ffff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58041d50 0x7fdb580d2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:41.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.498+0000 7fdb5ffff640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdb58046a10 con 0x7fdb4c01a210 2024-09-12T02:36:41.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.498+0000 7fdb5ffff640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdb580d9700 con 0x7fdb5803f260 2024-09-12T02:36:41.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.498+0000 7fdb5ffff640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdb580478d0 con 0x7fdb58041d50 2024-09-12T02:36:41.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.499+0000 7fdb5e7fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb5803f260 0x7fdb58041810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:41.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.499+0000 7fdb5e7fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb5803f260 0x7fdb58041810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:40206/0 (socket says 172.21.15.60:40206) 2024-09-12T02:36:41.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.499+0000 7fdb5e7fc640 1 -- 172.21.15.60:0/1464618495 learned_addr learned my addr 172.21.15.60:0/1464618495 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:36:41.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.499+0000 7fdb5effd640 1 --2- 172.21.15.60:0/1464618495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb4c01a210 0x7fdb58043710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:41.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.499+0000 7fdb5e7fc640 1 -- 172.21.15.60:0/1464618495 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58041d50 msgr2=0x7fdb580d2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:41.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.499+0000 7fdb5e7fc640 1 --2- 172.21.15.60:0/1464618495 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58041d50 0x7fdb580d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:41.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.499+0000 7fdb5e7fc640 1 -- 172.21.15.60:0/1464618495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb4c01a210 msgr2=0x7fdb58043710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:41.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.500+0000 7fdb5e7fc640 1 --2- 172.21.15.60:0/1464618495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb4c01a210 0x7fdb58043710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:41.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.500+0000 7fdb5e7fc640 1 -- 172.21.15.60:0/1464618495 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb58044a70 con 0x7fdb5803f260 2024-09-12T02:36:41.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.502+0000 7fdb5e7fc640 1 --2- 172.21.15.60:0/1464618495 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb5803f260 0x7fdb58041810 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdb54000f60 tx=0x7fdb54016b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:41.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.502+0000 7fdb477fe640 1 -- 172.21.15.60:0/1464618495 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb54015ba0 con 0x7fdb5803f260 2024-09-12T02:36:41.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.502+0000 7fdb477fe640 1 -- 172.21.15.60:0/1464618495 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb54015d40 con 0x7fdb5803f260 2024-09-12T02:36:41.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.502+0000 7fdb477fe640 1 -- 172.21.15.60:0/1464618495 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb540070d0 con 0x7fdb5803f260 2024-09-12T02:36:41.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.502+0000 7fdb5effd640 1 --2- 172.21.15.60:0/1464618495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb4c01a210 0x7fdb58043710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:36:41.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.507+0000 7fdb5ffff640 1 -- 172.21.15.60:0/1464618495 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb58043c50 con 0x7fdb5803f260 2024-09-12T02:36:41.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.507+0000 7fdb5ffff640 1 -- 172.21.15.60:0/1464618495 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb58042f10 con 0x7fdb5803f260 2024-09-12T02:36:41.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.510+0000 7fdb477fe640 1 -- 172.21.15.60:0/1464618495 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdb54013040 con 0x7fdb5803f260 2024-09-12T02:36:41.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.510+0000 7fdb5ffff640 1 -- 172.21.15.60:0/1464618495 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb5800b100 con 0x7fdb5803f260 2024-09-12T02:36:41.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.511+0000 7fdb477fe640 1 --2- 172.21.15.60:0/1464618495 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fdb4c06da10 0x7fdb4c06fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:41.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.511+0000 7fdb477fe640 1 -- 172.21.15.60:0/1464618495 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fdb5408be70 con 0x7fdb5803f260 2024-09-12T02:36:41.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.512+0000 7fdb5effd640 1 --2- 172.21.15.60:0/1464618495 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fdb4c06da10 0x7fdb4c06fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:41.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.513+0000 7fdb5effd640 1 --2- 172.21.15.60:0/1464618495 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fdb4c06da10 0x7fdb4c06fed0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fdb50037000 tx=0x7fdb50032000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:41.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:41.518+0000 7fdb477fe640 1 -- 172.21.15.60:0/1464618495 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdb5405a470 con 0x7fdb5803f260 2024-09-12T02:36:42.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:42.056+0000 7fdb5ffff640 1 -- 172.21.15.60:0/1464618495 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fdb58048e60 con 0x7fdb5803f260 2024-09-12T02:36:42.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:42.059+0000 7fdb477fe640 1 -- 172.21.15.60:0/1464618495 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1559 (secure 0 0 0) 0x7fdb54059d70 con 0x7fdb5803f260 2024-09-12T02:36:42.060 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":132,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:36:42.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:42.063+0000 7fdb457fa640 1 -- 172.21.15.60:0/1464618495 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fdb4c06da10 msgr2=0x7fdb4c06fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:42.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:42.063+0000 7fdb457fa640 1 --2- 172.21.15.60:0/1464618495 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fdb4c06da10 0x7fdb4c06fed0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fdb50037000 tx=0x7fdb50032000 comp rx=0 tx=0).stop 2024-09-12T02:36:42.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:42.063+0000 7fdb457fa640 1 -- 172.21.15.60:0/1464618495 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb5803f260 msgr2=0x7fdb58041810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:42.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:42.063+0000 7fdb457fa640 1 --2- 172.21.15.60:0/1464618495 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb5803f260 0x7fdb58041810 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdb54000f60 tx=0x7fdb54016b30 comp rx=0 tx=0).stop 2024-09-12T02:36:42.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:42.063+0000 7fdb457fa640 1 -- 172.21.15.60:0/1464618495 shutdown_connections 2024-09-12T02:36:42.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:42.063+0000 7fdb457fa640 1 --2- 172.21.15.60:0/1464618495 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fdb4c06da10 0x7fdb4c06fed0 secure :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fdb50037000 tx=0x7fdb50032000 comp rx=0 tx=0).stop 2024-09-12T02:36:42.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:42.063+0000 7fdb457fa640 1 --2- 172.21.15.60:0/1464618495 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb58041d50 0x7fdb580d2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:42.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:42.063+0000 7fdb457fa640 1 --2- 172.21.15.60:0/1464618495 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb5803f260 0x7fdb58041810 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdb54000f60 tx=0x7fdb54016b30 comp rx=0 tx=0).stop 2024-09-12T02:36:42.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:42.063+0000 7fdb457fa640 1 --2- 172.21.15.60:0/1464618495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb4c01a210 0x7fdb58043710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:42.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:42.063+0000 7fdb457fa640 1 -- 172.21.15.60:0/1464618495 >> 172.21.15.60:0/1464618495 conn(0x7fdb58047d10 msgr2=0x7fdb58049380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:42.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:42.069+0000 7fdb457fa640 1 -- 172.21.15.60:0/1464618495 shutdown_connections 2024-09-12T02:36:42.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:42.070+0000 7fdb457fa640 1 -- 172.21.15.60:0/1464618495 wait complete. 2024-09-12T02:36:45.096 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:36:45.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.280+0000 7f87b8d8b640 1 Processor -- start 2024-09-12T02:36:45.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.280+0000 7f87b8d8b640 1 -- start start 2024-09-12T02:36:45.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.281+0000 7f87b8d8b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f87ac00aef0 0x7f87ac049180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:45.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.281+0000 7f87b8d8b640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f87ac0465c0 0x7f87ac0d9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:45.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.281+0000 7f87b8d8b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f87ac0d66e0 0x7f87ac0d6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:45.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.281+0000 7f87b8d8b640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f87ac0071d0 con 0x7f87ac00aef0 2024-09-12T02:36:45.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.281+0000 7f87b8d8b640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f87ac04a980 con 0x7f87ac0465c0 2024-09-12T02:36:45.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.281+0000 7f87b8d8b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f87ac04ac60 con 0x7f87ac0d66e0 2024-09-12T02:36:45.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.282+0000 7f87b2ffd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f87ac0465c0 0x7f87ac0d9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:45.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.282+0000 7f87b3fff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f87ac0d66e0 0x7f87ac0d6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:45.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.282+0000 7f87b37fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f87ac00aef0 0x7f87ac049180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:45.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.282+0000 7f87b2ffd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f87ac0465c0 0x7f87ac0d9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:40218/0 (socket says 172.21.15.60:40218) 2024-09-12T02:36:45.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.282+0000 7f87b37fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f87ac00aef0 0x7f87ac049180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35868/0 (socket says 172.21.15.60:35868) 2024-09-12T02:36:45.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.282+0000 7f87b2ffd640 1 -- 172.21.15.60:0/2454105840 learned_addr learned my addr 172.21.15.60:0/2454105840 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:36:45.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.282+0000 7f87b37fe640 1 -- 172.21.15.60:0/2454105840 >> v2:172.21.15.60:3300/0 conn(0x7f87ac00aef0 msgr2=0x7f87ac049180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:36:45.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.282+0000 7f87b37fe640 1 -- 172.21.15.60:0/2454105840 >> v2:172.21.15.60:3300/0 conn(0x7f87ac00aef0 msgr2=0x7f87ac049180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:36:45.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.282+0000 7f87b37fe640 1 --2- 172.21.15.60:0/2454105840 >> v2:172.21.15.60:3300/0 conn(0x7f87ac00aef0 0x7f87ac049180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:36:45.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.282+0000 7f87b37fe640 1 --2- 172.21.15.60:0/2454105840 >> v2:172.21.15.60:3300/0 conn(0x7f87ac00aef0 0x7f87ac049180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:36:45.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.283+0000 7f87b2ffd640 1 -- 172.21.15.60:0/2454105840 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f87ac0d66e0 msgr2=0x7f87ac0d6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:45.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.283+0000 7f87b2ffd640 1 --2- 172.21.15.60:0/2454105840 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f87ac0d66e0 0x7f87ac0d6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:45.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.283+0000 7f87b2ffd640 1 -- 172.21.15.60:0/2454105840 >> v2:172.21.15.60:3300/0 conn(0x7f87ac00aef0 msgr2=0x7f87ac049180 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:36:45.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.283+0000 7f87b2ffd640 1 --2- 172.21.15.60:0/2454105840 >> v2:172.21.15.60:3300/0 conn(0x7f87ac00aef0 0x7f87ac049180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:45.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.283+0000 7f87b2ffd640 1 -- 172.21.15.60:0/2454105840 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87ac04af40 con 0x7f87ac0465c0 2024-09-12T02:36:45.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.287+0000 7f87b2ffd640 1 --2- 172.21.15.60:0/2454105840 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87ac0465c0 0x7f87ac0d9c10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f87ac02ad20 tx=0x7f87a802a0d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7516511cc3f709bb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:45.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.288+0000 7f87b27fc640 1 -- 172.21.15.60:0/2454105840 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a8037070 con 0x7f87ac0465c0 2024-09-12T02:36:45.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.288+0000 7f87b27fc640 1 -- 172.21.15.60:0/2454105840 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87a802ae20 con 0x7f87ac0465c0 2024-09-12T02:36:45.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.288+0000 7f87b27fc640 1 -- 172.21.15.60:0/2454105840 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a8032640 con 0x7f87ac0465c0 2024-09-12T02:36:45.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.289+0000 7f87b8d8b640 1 -- 172.21.15.60:0/2454105840 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87ac0465c0 msgr2=0x7f87ac0d9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:45.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.289+0000 7f87b8d8b640 1 --2- 172.21.15.60:0/2454105840 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87ac0465c0 0x7f87ac0d9c10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f87ac02ad20 tx=0x7f87a802a0d0 comp rx=0 tx=0).stop 2024-09-12T02:36:45.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.290+0000 7f87b8d8b640 1 -- 172.21.15.60:0/2454105840 shutdown_connections 2024-09-12T02:36:45.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.290+0000 7f87b8d8b640 1 --2- 172.21.15.60:0/2454105840 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87ac0465c0 0x7f87ac0d9c10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:45.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.290+0000 7f87b8d8b640 1 --2- 172.21.15.60:0/2454105840 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f87ac0d66e0 0x7f87ac0d6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:45.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.290+0000 7f87b8d8b640 1 --2- 172.21.15.60:0/2454105840 >> v2:172.21.15.60:3300/0 conn(0x7f87ac00aef0 0x7f87ac049180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:45.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.290+0000 7f87b8d8b640 1 -- 172.21.15.60:0/2454105840 >> 172.21.15.60:0/2454105840 conn(0x7f87ac047d00 msgr2=0x7f87ac048110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:45.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.291+0000 7f87b8d8b640 1 -- 172.21.15.60:0/2454105840 shutdown_connections 2024-09-12T02:36:45.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.291+0000 7f87b8d8b640 1 -- 172.21.15.60:0/2454105840 wait complete. 2024-09-12T02:36:45.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.296+0000 7f87b8d8b640 1 Processor -- start 2024-09-12T02:36:45.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.297+0000 7f87b8d8b640 1 -- start start 2024-09-12T02:36:45.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.298+0000 7f87b8d8b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87ac00aef0 0x7f87ac040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:45.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.298+0000 7f87b8d8b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87ac0465c0 0x7f87ac0d5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:45.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.298+0000 7f87b8d8b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f87ac0d66e0 0x7f87ac02f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:45.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.298+0000 7f87b8d8b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f87ac046a00 con 0x7f87ac00aef0 2024-09-12T02:36:45.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.298+0000 7f87b8d8b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f87ac0d96f0 con 0x7f87ac0465c0 2024-09-12T02:36:45.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.298+0000 7f87b8d8b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f87ac0da150 con 0x7f87ac0d66e0 2024-09-12T02:36:45.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.299+0000 7f87b2ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87ac0465c0 0x7f87ac0d5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:45.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.299+0000 7f87b2ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87ac0465c0 0x7f87ac0d5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:40232/0 (socket says 172.21.15.60:40232) 2024-09-12T02:36:45.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.299+0000 7f87b2ffd640 1 -- 172.21.15.60:0/3055229329 learned_addr learned my addr 172.21.15.60:0/3055229329 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:36:45.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.299+0000 7f87b37fe640 1 --2- 172.21.15.60:0/3055229329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87ac00aef0 0x7f87ac040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:45.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.300+0000 7f87b37fe640 1 -- 172.21.15.60:0/3055229329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87ac00aef0 msgr2=0x7f87ac040350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-12T02:36:45.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.300+0000 7f87b37fe640 1 -- 172.21.15.60:0/3055229329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87ac00aef0 msgr2=0x7f87ac040350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:36:45.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.300+0000 7f87b37fe640 1 --2- 172.21.15.60:0/3055229329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87ac00aef0 0x7f87ac040350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:36:45.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.300+0000 7f87b37fe640 1 --2- 172.21.15.60:0/3055229329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87ac00aef0 0x7f87ac040350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:36:45.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.300+0000 7f87b2ffd640 1 -- 172.21.15.60:0/3055229329 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f87ac0d66e0 msgr2=0x7f87ac02f6e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:36:45.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.300+0000 7f87b2ffd640 1 --2- 172.21.15.60:0/3055229329 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f87ac0d66e0 0x7f87ac02f6e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:45.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.300+0000 7f87b2ffd640 1 -- 172.21.15.60:0/3055229329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87ac00aef0 msgr2=0x7f87ac040350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:36:45.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.300+0000 7f87b2ffd640 1 --2- 172.21.15.60:0/3055229329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87ac00aef0 0x7f87ac040350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:45.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.300+0000 7f87b2ffd640 1 -- 172.21.15.60:0/3055229329 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87ac040890 con 0x7f87ac0465c0 2024-09-12T02:36:45.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.304+0000 7f87b2ffd640 1 --2- 172.21.15.60:0/3055229329 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87ac0465c0 0x7f87ac0d5680 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f87a802a6c0 tx=0x7f87a80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:45.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.304+0000 7f879ffff640 1 -- 172.21.15.60:0/3055229329 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a8041070 con 0x7f87ac0465c0 2024-09-12T02:36:45.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.304+0000 7f87b8d8b640 1 -- 172.21.15.60:0/3055229329 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87ac0d5bc0 con 0x7f87ac0465c0 2024-09-12T02:36:45.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.304+0000 7f87b8d8b640 1 -- 172.21.15.60:0/3055229329 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87ac045220 con 0x7f87ac0465c0 2024-09-12T02:36:45.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.305+0000 7f879ffff640 1 -- 172.21.15.60:0/3055229329 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87a803c460 con 0x7f87ac0465c0 2024-09-12T02:36:45.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.305+0000 7f879ffff640 1 -- 172.21.15.60:0/3055229329 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a8037040 con 0x7f87ac0465c0 2024-09-12T02:36:45.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.306+0000 7f87b8d8b640 1 -- 172.21.15.60:0/3055229329 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8794005290 con 0x7f87ac0465c0 2024-09-12T02:36:45.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.308+0000 7f879ffff640 1 -- 172.21.15.60:0/3055229329 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f87a8044070 con 0x7f87ac0465c0 2024-09-12T02:36:45.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.309+0000 7f879ffff640 1 --2- 172.21.15.60:0/3055229329 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f879806be30 0x7f879806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:45.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.309+0000 7f879ffff640 1 -- 172.21.15.60:0/3055229329 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f87a80ab870 con 0x7f87ac0465c0 2024-09-12T02:36:45.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.309+0000 7f87b37fe640 1 --2- 172.21.15.60:0/3055229329 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f879806be30 0x7f879806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:45.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.312+0000 7f87b37fe640 1 --2- 172.21.15.60:0/3055229329 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f879806be30 0x7f879806e2f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f87b4051220 tx=0x7f87b408df90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:45.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.316+0000 7f879ffff640 1 -- 172.21.15.60:0/3055229329 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f87a804b030 con 0x7f87ac0465c0 2024-09-12T02:36:45.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.830+0000 7f87b8d8b640 1 -- 172.21.15.60:0/3055229329 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f8794005580 con 0x7f87ac0465c0 2024-09-12T02:36:45.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.831+0000 7f879ffff640 1 -- 172.21.15.60:0/3055229329 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1559 (secure 0 0 0) 0x7f87a802ae20 con 0x7f87ac0465c0 2024-09-12T02:36:45.833 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":132,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":4,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:36:45.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.836+0000 7f87b8d8b640 1 -- 172.21.15.60:0/3055229329 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f879806be30 msgr2=0x7f879806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:45.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.836+0000 7f87b8d8b640 1 --2- 172.21.15.60:0/3055229329 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f879806be30 0x7f879806e2f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f87b4051220 tx=0x7f87b408df90 comp rx=0 tx=0).stop 2024-09-12T02:36:45.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.836+0000 7f87b8d8b640 1 -- 172.21.15.60:0/3055229329 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87ac0465c0 msgr2=0x7f87ac0d5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:45.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.836+0000 7f87b8d8b640 1 --2- 172.21.15.60:0/3055229329 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87ac0465c0 0x7f87ac0d5680 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f87a802a6c0 tx=0x7f87a80046c0 comp rx=0 tx=0).stop 2024-09-12T02:36:45.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.836+0000 7f87b8d8b640 1 -- 172.21.15.60:0/3055229329 shutdown_connections 2024-09-12T02:36:45.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.836+0000 7f87b8d8b640 1 --2- 172.21.15.60:0/3055229329 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f879806be30 0x7f879806e2f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:45.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.836+0000 7f87b8d8b640 1 --2- 172.21.15.60:0/3055229329 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f87ac0d66e0 0x7f87ac02f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:45.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.836+0000 7f87b8d8b640 1 --2- 172.21.15.60:0/3055229329 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87ac0465c0 0x7f87ac0d5680 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:45.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.836+0000 7f87b8d8b640 1 --2- 172.21.15.60:0/3055229329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87ac00aef0 0x7f87ac040350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:45.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.836+0000 7f87b8d8b640 1 -- 172.21.15.60:0/3055229329 >> 172.21.15.60:0/3055229329 conn(0x7f87ac047d00 msgr2=0x7f87ac03e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:45.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.837+0000 7f87b8d8b640 1 -- 172.21.15.60:0/3055229329 shutdown_connections 2024-09-12T02:36:45.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:45.837+0000 7f87b8d8b640 1 -- 172.21.15.60:0/3055229329 wait complete. 2024-09-12T02:36:48.857 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:36:49.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:49.062+0000 7f703a2cf640 1 Processor -- start 2024-09-12T02:36:49.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:49.062+0000 7f703a2cf640 1 -- start start 2024-09-12T02:36:49.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:49.063+0000 7f703a2cf640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7034150fb0 0x7f70340c2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:49.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:49.063+0000 7f703a2cf640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f70340c5e80 0x7f703406d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:49.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:49.063+0000 7f703a2cf640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f703415a4d0 con 0x7f70340c27a0 2024-09-12T02:36:49.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:49.063+0000 7f703a2cf640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f70341581c0 con 0x7f70340c5e80 2024-09-12T02:36:49.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:49.063+0000 7f703a2cf640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f703415b0c0 con 0x7f7034150fb0 2024-09-12T02:36:49.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:49.064+0000 7f70392cd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7034150fb0 0x7f70340c2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:49.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:49.066+0000 7f70392cd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7034150fb0 0x7f70340c2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:33852/0 (socket says 172.21.15.60:33852) 2024-09-12T02:36:49.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:49.066+0000 7f70392cd640 1 -- 172.21.15.60:0/1863716516 learned_addr learned my addr 172.21.15.60:0/1863716516 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:36:49.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:49.067+0000 7f70392cd640 1 -- 172.21.15.60:0/1863716516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7034150fb0 msgr2=0x7f70340c2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:36:49.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:49.067+0000 7f70392cd640 1 -- 172.21.15.60:0/1863716516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7034150fb0 msgr2=0x7f70340c2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:36:49.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:49.067+0000 7f70392cd640 1 --2- 172.21.15.60:0/1863716516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7034150fb0 0x7f70340c2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:36:49.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:49.067+0000 7f70392cd640 1 --2- 172.21.15.60:0/1863716516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7034150fb0 0x7f70340c2260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:36:49.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:49.069+0000 7f7038acc640 1 --2- 172.21.15.60:0/1863716516 >> v2:172.21.15.105:3300/0 conn(0x7f70340c5e80 0x7f703406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:49.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:49.071+0000 7f7038acc640 1 -- 172.21.15.60:0/1863716516 >> v2:172.21.15.105:3300/0 conn(0x7f70340c5e80 msgr2=0x7f703406d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:36:49.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:49.071+0000 7f7038acc640 1 -- 172.21.15.60:0/1863716516 >> v2:172.21.15.105:3300/0 conn(0x7f70340c5e80 msgr2=0x7f703406d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:36:49.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:49.071+0000 7f7038acc640 1 --2- 172.21.15.60:0/1863716516 >> v2:172.21.15.105:3300/0 conn(0x7f70340c5e80 0x7f703406d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:36:49.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:49.071+0000 7f7038acc640 1 --2- 172.21.15.60:0/1863716516 >> v2:172.21.15.105:3300/0 conn(0x7f70340c5e80 0x7f703406d870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:36:49.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:49.268+0000 7f70392cd640 1 --2- 172.21.15.60:0/1863716516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7034150fb0 0x7f70340c2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:49.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:49.270+0000 7f70392cd640 1 -- 172.21.15.60:0/1863716516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7034150fb0 msgr2=0x7f70340c2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:36:49.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:49.270+0000 7f70392cd640 1 -- 172.21.15.60:0/1863716516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7034150fb0 msgr2=0x7f70340c2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:36:49.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:49.270+0000 7f70392cd640 1 --2- 172.21.15.60:0/1863716516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7034150fb0 0x7f70340c2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:36:49.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:49.270+0000 7f70392cd640 1 --2- 172.21.15.60:0/1863716516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7034150fb0 0x7f70340c2260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:36:49.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:49.272+0000 7f7038acc640 1 --2- 172.21.15.60:0/1863716516 >> v2:172.21.15.105:3300/0 conn(0x7f70340c5e80 0x7f703406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:49.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:49.272+0000 7f7038acc640 1 -- 172.21.15.60:0/1863716516 >> v2:172.21.15.105:3300/0 conn(0x7f70340c5e80 msgr2=0x7f703406d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:36:49.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:49.272+0000 7f7038acc640 1 -- 172.21.15.60:0/1863716516 >> v2:172.21.15.105:3300/0 conn(0x7f70340c5e80 msgr2=0x7f703406d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:36:49.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:49.272+0000 7f7038acc640 1 --2- 172.21.15.60:0/1863716516 >> v2:172.21.15.105:3300/0 conn(0x7f70340c5e80 0x7f703406d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:36:49.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:49.273+0000 7f7038acc640 1 --2- 172.21.15.60:0/1863716516 >> v2:172.21.15.105:3300/0 conn(0x7f70340c5e80 0x7f703406d870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:36:49.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:49.674+0000 7f70392cd640 1 --2- 172.21.15.60:0/1863716516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7034150fb0 0x7f70340c2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:49.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:49.674+0000 7f7038acc640 1 --2- 172.21.15.60:0/1863716516 >> v2:172.21.15.105:3300/0 conn(0x7f70340c5e80 0x7f703406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:49.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:49.674+0000 7f70392cd640 1 -- 172.21.15.60:0/1863716516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7034150fb0 msgr2=0x7f70340c2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:36:49.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:49.674+0000 7f70392cd640 1 -- 172.21.15.60:0/1863716516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7034150fb0 msgr2=0x7f70340c2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:36:49.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:49.674+0000 7f70392cd640 1 --2- 172.21.15.60:0/1863716516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7034150fb0 0x7f70340c2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:36:49.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:49.674+0000 7f70392cd640 1 --2- 172.21.15.60:0/1863716516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7034150fb0 0x7f70340c2260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:36:49.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:49.675+0000 7f7038acc640 1 -- 172.21.15.60:0/1863716516 >> v2:172.21.15.105:3300/0 conn(0x7f70340c5e80 msgr2=0x7f703406d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:36:49.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:49.675+0000 7f7038acc640 1 -- 172.21.15.60:0/1863716516 >> v2:172.21.15.105:3300/0 conn(0x7f70340c5e80 msgr2=0x7f703406d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:36:49.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:49.675+0000 7f7038acc640 1 --2- 172.21.15.60:0/1863716516 >> v2:172.21.15.105:3300/0 conn(0x7f70340c5e80 0x7f703406d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:36:49.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:49.675+0000 7f7038acc640 1 --2- 172.21.15.60:0/1863716516 >> v2:172.21.15.105:3300/0 conn(0x7f70340c5e80 0x7f703406d870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:36:50.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.403+0000 7f702bfff640 1 -- 172.21.15.60:0/1863716516 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2221216586 0 0) 0x7f703415a4d0 con 0x7f70340c27a0 2024-09-12T02:36:50.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.403+0000 7f702bfff640 1 -- 172.21.15.60:0/1863716516 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7020003520 con 0x7f70340c27a0 2024-09-12T02:36:50.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.407+0000 7f702bfff640 1 -- 172.21.15.60:0/1863716516 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1091622820 0 0) 0x7f7020003520 con 0x7f70340c27a0 2024-09-12T02:36:50.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.407+0000 7f702bfff640 1 -- 172.21.15.60:0/1863716516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7034150fb0 msgr2=0x7f70340c2260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:36:50.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.407+0000 7f702bfff640 1 --2- 172.21.15.60:0/1863716516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7034150fb0 0x7f70340c2260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:50.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.407+0000 7f702bfff640 1 -- 172.21.15.60:0/1863716516 >> v2:172.21.15.105:3300/0 conn(0x7f70340c5e80 msgr2=0x7f703406d870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:36:50.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.407+0000 7f702bfff640 1 --2- 172.21.15.60:0/1863716516 >> v2:172.21.15.105:3300/0 conn(0x7f70340c5e80 0x7f703406d870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:50.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.407+0000 7f702bfff640 1 -- 172.21.15.60:0/1863716516 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f703415a790 con 0x7f70340c27a0 2024-09-12T02:36:50.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.407+0000 7f702bfff640 1 -- 172.21.15.60:0/1863716516 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7f702c0019f0 con 0x7f70340c27a0 2024-09-12T02:36:50.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.407+0000 7f702bfff640 1 -- 172.21.15.60:0/1863716516 >> v1:172.21.15.60:6789/0 conn(0x7f70340c27a0 legacy=0x7f703406ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:50.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.407+0000 7f702bfff640 1 --2- 172.21.15.60:0/1863716516 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70200039b0 0x7f7020003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:50.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.407+0000 7f702bfff640 1 --2- 172.21.15.60:0/1863716516 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7020004800 0x7f7020004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:50.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.407+0000 7f702bfff640 1 --2- 172.21.15.60:0/1863716516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f70200051c0 0x7f702000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:50.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.407+0000 7f702bfff640 1 -- 172.21.15.60:0/1863716516 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f70341581c0 con 0x7f7020004800 2024-09-12T02:36:50.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.407+0000 7f702bfff640 1 -- 172.21.15.60:0/1863716516 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f703415b0c0 con 0x7f70200039b0 2024-09-12T02:36:50.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.407+0000 7f702bfff640 1 -- 172.21.15.60:0/1863716516 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f702000c090 con 0x7f70200051c0 2024-09-12T02:36:50.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.407+0000 7f70392cd640 1 --2- 172.21.15.60:0/1863716516 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70200039b0 0x7f7020003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:50.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.408+0000 7f7039ace640 1 --2- 172.21.15.60:0/1863716516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f70200051c0 0x7f702000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:50.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.408+0000 7f70392cd640 1 -- 172.21.15.60:0/1863716516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f70200051c0 msgr2=0x7f702000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:50.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.408+0000 7f70392cd640 1 --2- 172.21.15.60:0/1863716516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f70200051c0 0x7f702000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:50.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.408+0000 7f70392cd640 1 -- 172.21.15.60:0/1863716516 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7020004800 msgr2=0x7f7020004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:50.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.408+0000 7f70392cd640 1 --2- 172.21.15.60:0/1863716516 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7020004800 0x7f7020004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:50.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.408+0000 7f70392cd640 1 -- 172.21.15.60:0/1863716516 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f703415a790 con 0x7f70200039b0 2024-09-12T02:36:50.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.409+0000 7f70392cd640 1 --2- 172.21.15.60:0/1863716516 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70200039b0 0x7f7020003dd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7024009100 tx=0x7f7020005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1581d7bba8eda669 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:50.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.410+0000 7f702bfff640 1 -- 172.21.15.60:0/1863716516 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702400f040 con 0x7f70200039b0 2024-09-12T02:36:50.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.410+0000 7f702bfff640 1 -- 172.21.15.60:0/1863716516 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7024004030 con 0x7f70200039b0 2024-09-12T02:36:50.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.411+0000 7f702bfff640 1 -- 172.21.15.60:0/1863716516 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7024004420 con 0x7f70200039b0 2024-09-12T02:36:50.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.411+0000 7f703a2cf640 1 -- 172.21.15.60:0/1863716516 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70200039b0 msgr2=0x7f7020003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:50.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.411+0000 7f703a2cf640 1 --2- 172.21.15.60:0/1863716516 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70200039b0 0x7f7020003dd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7024009100 tx=0x7f7020005830 comp rx=0 tx=0).stop 2024-09-12T02:36:50.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.411+0000 7f7039ace640 1 -- 172.21.15.60:0/1863716516 reap_dead start 2024-09-12T02:36:50.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.412+0000 7f703a2cf640 1 -- 172.21.15.60:0/1863716516 shutdown_connections 2024-09-12T02:36:50.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.412+0000 7f703a2cf640 1 -- 172.21.15.60:0/1863716516 >> 172.21.15.60:0/1863716516 conn(0x7f70340c7860 msgr2=0x7f70340c7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:50.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.412+0000 7f703a2cf640 1 -- 172.21.15.60:0/1863716516 shutdown_connections 2024-09-12T02:36:50.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.412+0000 7f703a2cf640 1 -- 172.21.15.60:0/1863716516 wait complete. 2024-09-12T02:36:50.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.414+0000 7f703a2cf640 1 Processor -- start 2024-09-12T02:36:50.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.414+0000 7f703a2cf640 1 -- start start 2024-09-12T02:36:50.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.415+0000 7f703a2cf640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70200039b0 0x7f7034159600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:50.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.415+0000 7f703a2cf640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f703415b8c0 0x7f703413ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:50.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.415+0000 7f703a2cf640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f70340ab040 0x7f703407cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:50.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.415+0000 7f703a2cf640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7034151390 con 0x7f703415b8c0 2024-09-12T02:36:50.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.415+0000 7f703a2cf640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f703415ad50 con 0x7f70200039b0 2024-09-12T02:36:50.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.415+0000 7f703a2cf640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f703406e4c0 con 0x7f70340ab040 2024-09-12T02:36:50.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.415+0000 7f7039ace640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f70340ab040 0x7f703407cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:50.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.416+0000 7f7039ace640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f70340ab040 0x7f703407cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:47664/0 (socket says 172.21.15.60:47664) 2024-09-12T02:36:50.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.416+0000 7f7039ace640 1 -- 172.21.15.60:0/2235904476 learned_addr learned my addr 172.21.15.60:0/2235904476 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:36:50.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.416+0000 7f7039ace640 1 -- 172.21.15.60:0/2235904476 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70200039b0 msgr2=0x7f7034159600 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:36:50.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.416+0000 7f7039ace640 1 --2- 172.21.15.60:0/2235904476 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70200039b0 0x7f7034159600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:50.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.416+0000 7f7039ace640 1 -- 172.21.15.60:0/2235904476 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f703415b8c0 msgr2=0x7f703413ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:50.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.416+0000 7f7039ace640 1 --2- 172.21.15.60:0/2235904476 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f703415b8c0 0x7f703413ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:50.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.416+0000 7f7039ace640 1 -- 172.21.15.60:0/2235904476 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f703415e130 con 0x7f70340ab040 2024-09-12T02:36:50.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.417+0000 7f7039ace640 1 --2- 172.21.15.60:0/2235904476 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f70340ab040 0x7f703407cf80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f702c000f80 tx=0x7f702c00ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:50.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.420+0000 7f7029ffb640 1 -- 172.21.15.60:0/2235904476 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702c003b80 con 0x7f70340ab040 2024-09-12T02:36:50.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.421+0000 7f703a2cf640 1 -- 172.21.15.60:0/2235904476 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f703415e410 con 0x7f70340ab040 2024-09-12T02:36:50.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.421+0000 7f703a2cf640 1 -- 172.21.15.60:0/2235904476 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f703413a700 con 0x7f70340ab040 2024-09-12T02:36:50.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.423+0000 7f7029ffb640 1 -- 172.21.15.60:0/2235904476 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f702c018070 con 0x7f70340ab040 2024-09-12T02:36:50.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.424+0000 7f7029ffb640 1 -- 172.21.15.60:0/2235904476 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702c0050d0 con 0x7f70340ab040 2024-09-12T02:36:50.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.426+0000 7f701f7fe640 1 -- 172.21.15.60:0/2235904476 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7014005290 con 0x7f70340ab040 2024-09-12T02:36:50.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.426+0000 7f7029ffb640 1 -- 172.21.15.60:0/2235904476 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f702c005270 con 0x7f70340ab040 2024-09-12T02:36:50.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.427+0000 7f7029ffb640 1 --2- 172.21.15.60:0/2235904476 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f701806beb0 0x7f701806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:50.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.427+0000 7f7029ffb640 1 -- 172.21.15.60:0/2235904476 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f702c08b080 con 0x7f70340ab040 2024-09-12T02:36:50.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.427+0000 7f70392cd640 1 --2- 172.21.15.60:0/2235904476 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f701806beb0 0x7f701806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:50.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.428+0000 7f70392cd640 1 --2- 172.21.15.60:0/2235904476 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f701806beb0 0x7f701806e370 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7024009100 tx=0x7f7024010040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:50.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.435+0000 7f7029ffb640 1 -- 172.21.15.60:0/2235904476 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f702c059670 con 0x7f70340ab040 2024-09-12T02:36:50.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.933+0000 7f701f7fe640 1 -- 172.21.15.60:0/2235904476 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f7014005580 con 0x7f70340ab040 2024-09-12T02:36:50.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.936+0000 7f7029ffb640 1 -- 172.21.15.60:0/2235904476 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f702c01be40 con 0x7f70340ab040 2024-09-12T02:36:50.937 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":136,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:36:50.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.940+0000 7f701f7fe640 1 -- 172.21.15.60:0/2235904476 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f701806beb0 msgr2=0x7f701806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:50.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.940+0000 7f701f7fe640 1 --2- 172.21.15.60:0/2235904476 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f701806beb0 0x7f701806e370 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7024009100 tx=0x7f7024010040 comp rx=0 tx=0).stop 2024-09-12T02:36:50.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.940+0000 7f701f7fe640 1 -- 172.21.15.60:0/2235904476 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f70340ab040 msgr2=0x7f703407cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:50.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.940+0000 7f701f7fe640 1 --2- 172.21.15.60:0/2235904476 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f70340ab040 0x7f703407cf80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f702c000f80 tx=0x7f702c00ed50 comp rx=0 tx=0).stop 2024-09-12T02:36:50.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.944+0000 7f701f7fe640 1 -- 172.21.15.60:0/2235904476 shutdown_connections 2024-09-12T02:36:50.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.944+0000 7f701f7fe640 1 --2- 172.21.15.60:0/2235904476 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f701806beb0 0x7f701806e370 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:50.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.944+0000 7f701f7fe640 1 --2- 172.21.15.60:0/2235904476 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f70340ab040 0x7f703407cf80 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:50.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.944+0000 7f701f7fe640 1 --2- 172.21.15.60:0/2235904476 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f703415b8c0 0x7f703413ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:50.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.944+0000 7f701f7fe640 1 --2- 172.21.15.60:0/2235904476 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70200039b0 0x7f7034159600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:50.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.944+0000 7f701f7fe640 1 -- 172.21.15.60:0/2235904476 >> 172.21.15.60:0/2235904476 conn(0x7f70340c7860 msgr2=0x7f7034165700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:50.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.949+0000 7f701f7fe640 1 -- 172.21.15.60:0/2235904476 shutdown_connections 2024-09-12T02:36:50.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:50.949+0000 7f701f7fe640 1 -- 172.21.15.60:0/2235904476 wait complete. 2024-09-12T02:36:50.973 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-12T02:36:50.973 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-12T02:36:50.973 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-12T02:36:51.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.190+0000 7fbcca731640 1 Processor -- start 2024-09-12T02:36:51.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.190+0000 7fbcca731640 1 -- start start 2024-09-12T02:36:51.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.191+0000 7fbcca731640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbcc40c6190 0x7fbcc4156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:51.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.192+0000 7fbcc37fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbcc40c6190 0x7fbcc4156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:51.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.192+0000 7fbcc37fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbcc40c6190 0x7fbcc4156cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50340/0 (socket says 172.21.15.60:50340) 2024-09-12T02:36:51.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.192+0000 7fbcc37fe640 1 -- 172.21.15.60:0/1100397368 learned_addr learned my addr 172.21.15.60:0/1100397368 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:36:51.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.193+0000 7fbcca731640 1 -- 172.21.15.60:0/1100397368 --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcc406d1c0 con 0x7fbcc40ca010 2024-09-12T02:36:51.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.193+0000 7fbcca731640 1 -- 172.21.15.60:0/1100397368 --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcc406d460 con 0x7fbcc4067bc0 2024-09-12T02:36:51.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.193+0000 7fbcca731640 1 -- 172.21.15.60:0/1100397368 --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fbcc406d740 con 0x7fbcc40c6190 2024-09-12T02:36:51.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.194+0000 7fbcc37fe640 1 -- 172.21.15.60:0/1100397368 >> v1:172.21.15.105:6789/0 conn(0x7fbcc4067bc0 legacy=0x7fbcc4153640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:36:51.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.194+0000 7fbcc37fe640 1 -- 172.21.15.60:0/1100397368 >> v1:172.21.15.60:6789/0 conn(0x7fbcc40ca010 legacy=0x7fbcc40ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:51.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.194+0000 7fbcc37fe640 1 -- 172.21.15.60:0/1100397368 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc406da20 con 0x7fbcc40c6190 2024-09-12T02:36:51.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.196+0000 7fbcc37fe640 1 --2- 172.21.15.60:0/1100397368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbcc40c6190 0x7fbcc4156cc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbcac009ad0 tx=0x7fbcac02a370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be7a3c529c36b991 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:51.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.198+0000 7fbcc2ffd640 1 -- 172.21.15.60:0/1100397368 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcac037070 con 0x7fbcc40c6190 2024-09-12T02:36:51.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.198+0000 7fbcc2ffd640 1 -- 172.21.15.60:0/1100397368 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcac02adf0 con 0x7fbcc40c6190 2024-09-12T02:36:51.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.199+0000 7fbcca731640 1 -- 172.21.15.60:0/1100397368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbcc40c6190 msgr2=0x7fbcc4156cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:51.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.199+0000 7fbcca731640 1 --2- 172.21.15.60:0/1100397368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbcc40c6190 0x7fbcc4156cc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbcac009ad0 tx=0x7fbcac02a370 comp rx=0 tx=0).stop 2024-09-12T02:36:51.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.201+0000 7fbcca731640 1 -- 172.21.15.60:0/1100397368 shutdown_connections 2024-09-12T02:36:51.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.201+0000 7fbcca731640 1 --2- 172.21.15.60:0/1100397368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbcc40c6190 0x7fbcc4156cc0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:51.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.201+0000 7fbcca731640 1 -- 172.21.15.60:0/1100397368 >> 172.21.15.60:0/1100397368 conn(0x7fbcc40c87f0 msgr2=0x7fbcc40c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:51.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.202+0000 7fbcca731640 1 -- 172.21.15.60:0/1100397368 shutdown_connections 2024-09-12T02:36:51.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.205+0000 7fbcca731640 1 -- 172.21.15.60:0/1100397368 wait complete. 2024-09-12T02:36:51.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.207+0000 7fbcca731640 1 Processor -- start 2024-09-12T02:36:51.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.211+0000 7fbcca731640 1 -- start start 2024-09-12T02:36:51.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.212+0000 7fbcca731640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbcc4067bc0 0x7fbcc41ef200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:51.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.213+0000 7fbcca731640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbcc40c6190 0x7fbcc4158a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:51.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.213+0000 7fbcca731640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbcc40ca010 0x7fbcc4158f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:51.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.213+0000 7fbcca731640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc4153ed0 con 0x7fbcc4067bc0 2024-09-12T02:36:51.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.213+0000 7fbcca731640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc4153d50 con 0x7fbcc40ca010 2024-09-12T02:36:51.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.213+0000 7fbcca731640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbcc40cab40 con 0x7fbcc40c6190 2024-09-12T02:36:51.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.213+0000 7fbcc3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbcc4067bc0 0x7fbcc41ef200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:51.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.213+0000 7fbcc3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbcc4067bc0 0x7fbcc41ef200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50350/0 (socket says 172.21.15.60:50350) 2024-09-12T02:36:51.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.213+0000 7fbcc3fff640 1 -- 172.21.15.60:0/26156217 learned_addr learned my addr 172.21.15.60:0/26156217 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:36:51.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.213+0000 7fbcc8cce640 1 --2- 172.21.15.60:0/26156217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbcc40ca010 0x7fbcc4158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:51.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.214+0000 7fbcc37fe640 1 --2- 172.21.15.60:0/26156217 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbcc40c6190 0x7fbcc4158a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:51.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.215+0000 7fbcc8cce640 1 -- 172.21.15.60:0/26156217 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbcc40c6190 msgr2=0x7fbcc4158a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:51.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.215+0000 7fbcc8cce640 1 --2- 172.21.15.60:0/26156217 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbcc40c6190 0x7fbcc4158a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:51.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.215+0000 7fbcc8cce640 1 -- 172.21.15.60:0/26156217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbcc4067bc0 msgr2=0x7fbcc41ef200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:51.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.215+0000 7fbcc8cce640 1 --2- 172.21.15.60:0/26156217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbcc4067bc0 0x7fbcc41ef200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:51.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.215+0000 7fbcc8cce640 1 -- 172.21.15.60:0/26156217 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc40b1050 con 0x7fbcc40ca010 2024-09-12T02:36:51.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.216+0000 7fbcc8cce640 1 --2- 172.21.15.60:0/26156217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbcc40ca010 0x7fbcc4158f80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc00c810 tx=0x7fbcbc00ccd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:51.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.217+0000 7fbcc0ff9640 1 -- 172.21.15.60:0/26156217 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc017070 con 0x7fbcc40ca010 2024-09-12T02:36:51.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.218+0000 7fbcc0ff9640 1 -- 172.21.15.60:0/26156217 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcbc003da0 con 0x7fbcc40ca010 2024-09-12T02:36:51.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.218+0000 7fbcc0ff9640 1 -- 172.21.15.60:0/26156217 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc005290 con 0x7fbcc40ca010 2024-09-12T02:36:51.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.218+0000 7fbcca731640 1 -- 172.21.15.60:0/26156217 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcc41efad0 con 0x7fbcc40ca010 2024-09-12T02:36:51.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.218+0000 7fbcca731640 1 -- 172.21.15.60:0/26156217 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcc41efd70 con 0x7fbcc40ca010 2024-09-12T02:36:51.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.221+0000 7fbcc0ff9640 1 -- 172.21.15.60:0/26156217 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbcbc01a070 con 0x7fbcc40ca010 2024-09-12T02:36:51.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.222+0000 7fbcc0ff9640 1 --2- 172.21.15.60:0/26156217 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbca406bf00 0x7fbca406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:51.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.222+0000 7fbcc0ff9640 1 -- 172.21.15.60:0/26156217 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fbcbc08a8c0 con 0x7fbcc40ca010 2024-09-12T02:36:51.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.222+0000 7fbcc3fff640 1 --2- 172.21.15.60:0/26156217 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbca406bf00 0x7fbca406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:51.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.223+0000 7fbcca731640 1 --2- 172.21.15.60:0/26156217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbca8002a70 0x7fbca8004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:51.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.223+0000 7fbcca731640 1 -- 172.21.15.60:0/26156217 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbca8007ec0 con 0x7fbca8002a70 2024-09-12T02:36:51.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.223+0000 7fbcc3fff640 1 --2- 172.21.15.60:0/26156217 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbca406bf00 0x7fbca406e3c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4006fd0 tx=0x7fbcb4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:51.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.225+0000 7fbcc37fe640 1 --2- 172.21.15.60:0/26156217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbca8002a70 0x7fbca8004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:51.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.228+0000 7fbcc37fe640 1 -- 172.21.15.60:0/26156217 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbca80080c0 con 0x7fbca8002a70 2024-09-12T02:36:51.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.230+0000 7fbcc37fe640 1 --2- 172.21.15.60:0/26156217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbca8002a70 0x7fbca8004f30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbcc40687b0 tx=0x7fbcac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:51.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.235+0000 7fbcc0ff9640 1 -- 172.21.15.60:0/26156217 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcac04e070 con 0x7fbca8002a70 2024-09-12T02:36:51.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.235+0000 7fbcc0ff9640 1 -- 172.21.15.60:0/26156217 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fbcac049470 con 0x7fbca8002a70 2024-09-12T02:36:51.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.235+0000 7fbcc0ff9640 1 -- 172.21.15.60:0/26156217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbca8002a70 msgr2=0x7fbca8004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:51.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.235+0000 7fbcc0ff9640 1 --2- 172.21.15.60:0/26156217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbca8002a70 0x7fbca8004f30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbcc40687b0 tx=0x7fbcac004730 comp rx=0 tx=0).stop 2024-09-12T02:36:51.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.235+0000 7fbcc0ff9640 1 -- 172.21.15.60:0/26156217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbca8002a70 msgr2=0x7fbca8004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:36:51.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.235+0000 7fbcc0ff9640 1 --2- 172.21.15.60:0/26156217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbca8002a70 0x7fbca8004f30 secure :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbcc40687b0 tx=0x7fbcac004730 comp rx=0 tx=0).stop 2024-09-12T02:36:51.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.248+0000 7fbcca731640 1 --2- 172.21.15.60:0/26156217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbca8006f00 0x7fbca8007390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:51.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.248+0000 7fbcca731640 1 -- 172.21.15.60:0/26156217 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbca800a4a0 con 0x7fbca8006f00 2024-09-12T02:36:51.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.250+0000 7fbcc37fe640 1 --2- 172.21.15.60:0/26156217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbca8006f00 0x7fbca8007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:51.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.250+0000 7fbcc37fe640 1 -- 172.21.15.60:0/26156217 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbca80078d0 con 0x7fbca8006f00 2024-09-12T02:36:51.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.251+0000 7fbcc37fe640 1 --2- 172.21.15.60:0/26156217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbca8006f00 0x7fbca8007390 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbcac02a3b0 tx=0x7fbcac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:51.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.252+0000 7fbcc0ff9640 1 -- 172.21.15.60:0/26156217 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcac04e040 con 0x7fbca8006f00 2024-09-12T02:36:51.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.252+0000 7fbcc0ff9640 1 -- 172.21.15.60:0/26156217 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4551 (secure 0 0 0) 0x7fbcac051af0 con 0x7fbca8006f00 2024-09-12T02:36:51.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.252+0000 7fbcc0ff9640 1 -- 172.21.15.60:0/26156217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbca8006f00 msgr2=0x7fbca8007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:51.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.252+0000 7fbcc0ff9640 1 --2- 172.21.15.60:0/26156217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbca8006f00 0x7fbca8007390 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbcac02a3b0 tx=0x7fbcac0046c0 comp rx=0 tx=0).stop 2024-09-12T02:36:51.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.252+0000 7fbcc0ff9640 1 -- 172.21.15.60:0/26156217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbca8006f00 msgr2=0x7fbca8007390 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:36:51.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.252+0000 7fbcc0ff9640 1 --2- 172.21.15.60:0/26156217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbca8006f00 0x7fbca8007390 secure :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbcac02a3b0 tx=0x7fbcac0046c0 comp rx=0 tx=0).stop 2024-09-12T02:36:51.254 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:36:51.254 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:36:51.254 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:36:51.254 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:36:51.254 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 136, 2024-09-12T02:36:51.254 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 26339, 2024-09-12T02:36:51.254 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:36:51.254 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:36:51.254 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:36:51.254 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:36:51.254 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:36:51.254 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-09-12T02:36:51.255 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:36:51.255 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:36:51.255 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:36:51.255 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:36:51.255 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:36:51.255 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:36:51.255 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:36:51.255 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:36:51.255 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:36:51.255 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:36:51.255 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:36:51.255 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:36:51.255 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:36:51.255 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:36:51.256 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:36:51.256 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:36:51.256 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:36:51.256 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:36:51.256 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:36:51.256 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:36:51.256 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:36:51.256 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:36:51.256 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:36:51.256 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:36:51.256 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:36:51.256 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:36:51.256 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:36:51.256 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:36:51.257 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:36:51.257 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:51.257 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:36:51.257 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:36:51.257 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:36:51.257 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:36:51.257 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:36:51.257 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:36:51.257 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:36:51.257 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:36:51.257 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:36:51.257 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:36:51.257 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:36:51.258 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:36:51.258 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:36:51.258 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:36:51.258 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:36:51.258 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:36:51.258 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:36:51.258 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:36:51.258 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:36:51.258 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:36:51.258 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:36:51.258 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:36:51.258 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:36:51.258 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:36:51.258 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:36:51.259 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:36:51.259 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:36:51.259 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:36:51.259 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:36:51.259 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:36:51.259 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:51.259 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:36:51.259 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:51.259 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:36:51.259 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:36:51.259 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:36:51.259 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:36:51.259 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:51.259 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:36:51.260 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:36:51.260 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:36:51.260 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:51.260 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:51.260 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:36:51.260 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:36:51.260 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:36:51.260 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:36:51.260 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:36:51.260 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:51.260 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:36:51.260 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:36:51.260 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:36:51.261 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:36:51.261 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:36:51.261 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:51.261 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:51.261 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:36:51.261 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:36:51.261 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:36:51.261 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:36:51.261 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:51.261 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:36:51.261 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:36:51.261 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:36:51.261 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:51.261 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:51.262 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:36:51.262 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:36:51.262 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:36:51.262 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:36:51.262 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:36:51.262 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:51.262 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:36:51.262 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:36:51.262 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:36:51.262 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:36:51.262 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:36:51.262 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:51.262 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:51.262 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:36:51.263 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:36:51.263 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:36:51.263 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:36:51.263 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:51.263 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:36:51.263 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:36:51.263 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:36:51.263 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:51.263 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:51.263 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:36:51.263 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:36:51.263 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:36:51.263 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:36:51.263 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:36:51.264 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:51.264 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:36:51.264 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:36:51.264 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:36:51.264 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:36:51.264 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:36:51.264 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:36:51.264 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:36:51.264 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:51.264 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:36:51.264 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:36:51.264 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:51.264 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:36:51.265 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:36:51.265 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:36:51.265 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:36:51.265 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:36:51.265 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:36:51.265 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:51.265 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:36:51.265 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:36:51.265 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:36:51.265 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:36:51.265 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:36:51.265 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:51.265 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:36:51.266 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:36:51.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.257+0000 7fbcba7fc640 1 -- 172.21.15.60:0/26156217 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbca406bf00 msgr2=0x7fbca406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:51.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.257+0000 7fbcba7fc640 1 --2- 172.21.15.60:0/26156217 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbca406bf00 0x7fbca406e3c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4006fd0 tx=0x7fbcb4008040 comp rx=0 tx=0).stop 2024-09-12T02:36:51.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.257+0000 7fbcba7fc640 1 -- 172.21.15.60:0/26156217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbcc40ca010 msgr2=0x7fbcc4158f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:51.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.257+0000 7fbcba7fc640 1 --2- 172.21.15.60:0/26156217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbcc40ca010 0x7fbcc4158f80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc00c810 tx=0x7fbcbc00ccd0 comp rx=0 tx=0).stop 2024-09-12T02:36:51.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.257+0000 7fbcc8cce640 1 -- 172.21.15.60:0/26156217 reap_dead start 2024-09-12T02:36:51.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.257+0000 7fbcc8cce640 1 -- 172.21.15.60:0/26156217 reap_dead start 2024-09-12T02:36:51.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.258+0000 7fbcba7fc640 1 -- 172.21.15.60:0/26156217 shutdown_connections 2024-09-12T02:36:51.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.258+0000 7fbcba7fc640 1 -- 172.21.15.60:0/26156217 >> 172.21.15.60:0/26156217 conn(0x7fbcc40c87f0 msgr2=0x7fbcc40c72e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:51.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.262+0000 7fbcba7fc640 1 -- 172.21.15.60:0/26156217 shutdown_connections 2024-09-12T02:36:51.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.264+0000 7fbcba7fc640 1 -- 172.21.15.60:0/26156217 wait complete. 2024-09-12T02:36:51.290 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:36:51.290 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-12T02:36:51.291 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-12T02:36:51.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.494+0000 7f08a8f2a640 1 Processor -- start 2024-09-12T02:36:51.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.494+0000 7f08a8f2a640 1 -- start start 2024-09-12T02:36:51.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.496+0000 7f08a8f2a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08a4156ce0 0x7f08a40cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:51.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.496+0000 7f08a8f2a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f08a406c610 0x7f08a40ca750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:51.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.496+0000 7f08a8f2a640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08a4150690 con 0x7f08a40caff0 2024-09-12T02:36:51.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.496+0000 7f08a259c640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f08a40caff0 0x7f08a40ca040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:54086/0 (socket says 172.21.15.60:54086) 2024-09-12T02:36:51.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.496+0000 7f08a259c640 1 -- 172.21.15.60:0/2518832778 learned_addr learned my addr 172.21.15.60:0/2518832778 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:36:51.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.496+0000 7f08a1d9b640 1 --2- 172.21.15.60:0/2518832778 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08a4156ce0 0x7f08a40cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:51.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.496+0000 7f08a2d9d640 1 --2- 172.21.15.60:0/2518832778 >> v2:172.21.15.60:3300/0 conn(0x7f08a406c610 0x7f08a40ca750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:51.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.496+0000 7f08a8f2a640 1 -- 172.21.15.60:0/2518832778 --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f08a41571e0 con 0x7f08a406c610 2024-09-12T02:36:51.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.496+0000 7f08a8f2a640 1 -- 172.21.15.60:0/2518832778 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f08a40cbb20 con 0x7f08a4156ce0 2024-09-12T02:36:51.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.497+0000 7f08a159a640 1 -- 172.21.15.60:0/2518832778 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2806927842 0 0) 0x7f08a4150690 con 0x7f08a40caff0 2024-09-12T02:36:51.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.497+0000 7f08a159a640 1 -- 172.21.15.60:0/2518832778 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f088c003520 con 0x7f08a40caff0 2024-09-12T02:36:51.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.497+0000 7f08a1d9b640 1 -- 172.21.15.60:0/2518832778 >> v2:172.21.15.60:3300/0 conn(0x7f08a406c610 msgr2=0x7f08a40ca750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:51.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.497+0000 7f08a1d9b640 1 --2- 172.21.15.60:0/2518832778 >> v2:172.21.15.60:3300/0 conn(0x7f08a406c610 0x7f08a40ca750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:51.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.497+0000 7f08a1d9b640 1 -- 172.21.15.60:0/2518832778 >> v1:172.21.15.60:6789/0 conn(0x7f08a40caff0 legacy=0x7f08a40ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:51.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.497+0000 7f08a1d9b640 1 -- 172.21.15.60:0/2518832778 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08a40cbdc0 con 0x7f08a4156ce0 2024-09-12T02:36:51.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.501+0000 7f08a1d9b640 1 --2- 172.21.15.60:0/2518832778 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08a4156ce0 0x7f08a40cb3d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f08980097a0 tx=0x7f089802a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da6e01e2eec72529 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:51.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.502+0000 7f08a159a640 1 -- 172.21.15.60:0/2518832778 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0898037070 con 0x7f08a4156ce0 2024-09-12T02:36:51.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.502+0000 7f08a159a640 1 -- 172.21.15.60:0/2518832778 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0898032440 con 0x7f08a4156ce0 2024-09-12T02:36:51.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.502+0000 7f08a159a640 1 -- 172.21.15.60:0/2518832778 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089802ae60 con 0x7f08a4156ce0 2024-09-12T02:36:51.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.503+0000 7f08a8f2a640 1 -- 172.21.15.60:0/2518832778 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08a4156ce0 msgr2=0x7f08a40cb3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:51.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.503+0000 7f08a8f2a640 1 --2- 172.21.15.60:0/2518832778 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08a4156ce0 0x7f08a40cb3d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f08980097a0 tx=0x7f089802a110 comp rx=0 tx=0).stop 2024-09-12T02:36:51.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.503+0000 7f08a8f2a640 1 -- 172.21.15.60:0/2518832778 shutdown_connections 2024-09-12T02:36:51.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.503+0000 7f08a8f2a640 1 --2- 172.21.15.60:0/2518832778 >> v2:172.21.15.60:3300/0 conn(0x7f08a406c610 0x7f08a40ca750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:51.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.503+0000 7f08a8f2a640 1 --2- 172.21.15.60:0/2518832778 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08a4156ce0 0x7f08a40cb3d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:51.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.503+0000 7f08a8f2a640 1 -- 172.21.15.60:0/2518832778 >> 172.21.15.60:0/2518832778 conn(0x7f08a4068010 msgr2=0x7f08a4073310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:51.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.504+0000 7f08a8f2a640 1 -- 172.21.15.60:0/2518832778 shutdown_connections 2024-09-12T02:36:51.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.504+0000 7f08a8f2a640 1 -- 172.21.15.60:0/2518832778 wait complete. 2024-09-12T02:36:51.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.506+0000 7f08a8f2a640 1 Processor -- start 2024-09-12T02:36:51.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.506+0000 7f08a8f2a640 1 -- start start 2024-09-12T02:36:51.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.507+0000 7f08a8f2a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08a406c610 0x7f08a4157750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:51.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.507+0000 7f08a8f2a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08a40caff0 0x7f08a4151c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:51.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.507+0000 7f08a8f2a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08a4156ce0 0x7f08a41f38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:51.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.507+0000 7f08a8f2a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f08a40cac90 con 0x7f08a40caff0 2024-09-12T02:36:51.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.507+0000 7f08a8f2a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f08a40cc380 con 0x7f08a406c610 2024-09-12T02:36:51.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.507+0000 7f08a8f2a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f08a406bbe0 con 0x7f08a4156ce0 2024-09-12T02:36:51.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.508+0000 7f08a259c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08a406c610 0x7f08a4157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:51.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.508+0000 7f08a1d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08a40caff0 0x7f08a4151c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:51.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.508+0000 7f08a1d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08a40caff0 0x7f08a4151c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50384/0 (socket says 172.21.15.60:50384) 2024-09-12T02:36:51.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.508+0000 7f08a259c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08a406c610 0x7f08a4157750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:51438/0 (socket says 172.21.15.60:51438) 2024-09-12T02:36:51.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.508+0000 7f08a1d9b640 1 -- 172.21.15.60:0/2668181150 learned_addr learned my addr 172.21.15.60:0/2668181150 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:36:51.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.508+0000 7f08a2d9d640 1 --2- 172.21.15.60:0/2668181150 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08a4156ce0 0x7f08a41f38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:51.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.508+0000 7f08a2d9d640 1 -- 172.21.15.60:0/2668181150 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08a406c610 msgr2=0x7f08a4157750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:51.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.508+0000 7f08a2d9d640 1 --2- 172.21.15.60:0/2668181150 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08a406c610 0x7f08a4157750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:51.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.508+0000 7f08a2d9d640 1 -- 172.21.15.60:0/2668181150 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08a40caff0 msgr2=0x7f08a4151c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:51.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.508+0000 7f08a2d9d640 1 --2- 172.21.15.60:0/2668181150 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08a40caff0 0x7f08a4151c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:51.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.508+0000 7f08a2d9d640 1 -- 172.21.15.60:0/2668181150 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08a4152980 con 0x7f08a4156ce0 2024-09-12T02:36:51.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.508+0000 7f08a1d9b640 1 --2- 172.21.15.60:0/2668181150 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08a40caff0 0x7f08a4151c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:36:51.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.509+0000 7f08a2d9d640 1 --2- 172.21.15.60:0/2668181150 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08a4156ce0 0x7f08a41f38f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f089c00eba0 tx=0x7f089c00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:51.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.509+0000 7f0892ffd640 1 -- 172.21.15.60:0/2668181150 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089c018020 con 0x7f08a4156ce0 2024-09-12T02:36:51.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.509+0000 7f08a8f2a640 1 -- 172.21.15.60:0/2668181150 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08a4152c60 con 0x7f08a4156ce0 2024-09-12T02:36:51.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.509+0000 7f08a8f2a640 1 -- 172.21.15.60:0/2668181150 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f08a4151440 con 0x7f08a4156ce0 2024-09-12T02:36:51.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.509+0000 7f0892ffd640 1 -- 172.21.15.60:0/2668181150 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f089c00cd20 con 0x7f08a4156ce0 2024-09-12T02:36:51.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.509+0000 7f0892ffd640 1 -- 172.21.15.60:0/2668181150 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089c014680 con 0x7f08a4156ce0 2024-09-12T02:36:51.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.510+0000 7f08a8f2a640 1 --2- 172.21.15.60:0/2668181150 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0888002a70 0x7f0888004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:51.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.510+0000 7f08a8f2a640 1 -- 172.21.15.60:0/2668181150 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0888007ec0 con 0x7f0888002a70 2024-09-12T02:36:51.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.510+0000 7f08a259c640 1 --2- 172.21.15.60:0/2668181150 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0888002a70 0x7f0888004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:51.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.511+0000 7f08a259c640 1 -- 172.21.15.60:0/2668181150 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f08880080c0 con 0x7f0888002a70 2024-09-12T02:36:51.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.512+0000 7f0892ffd640 1 -- 172.21.15.60:0/2668181150 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f089c005d10 con 0x7f08a4156ce0 2024-09-12T02:36:51.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.512+0000 7f08a259c640 1 --2- 172.21.15.60:0/2668181150 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0888002a70 0x7f0888004f30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f08940011e0 tx=0x7f08940019d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:51.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.512+0000 7f0892ffd640 1 --2- 172.21.15.60:0/2668181150 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f088406be30 0x7f088406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:51.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.513+0000 7f0892ffd640 1 -- 172.21.15.60:0/2668181150 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f089c08bdd0 con 0x7f08a4156ce0 2024-09-12T02:36:51.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.513+0000 7f0892ffd640 1 -- 172.21.15.60:0/2668181150 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08940115d0 con 0x7f0888002a70 2024-09-12T02:36:51.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.516+0000 7f0892ffd640 1 -- 172.21.15.60:0/2668181150 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f0894018070 con 0x7f0888002a70 2024-09-12T02:36:51.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.516+0000 7f0892ffd640 1 -- 172.21.15.60:0/2668181150 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0888002a70 msgr2=0x7f0888004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:51.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.516+0000 7f0892ffd640 1 --2- 172.21.15.60:0/2668181150 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0888002a70 0x7f0888004f30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f08940011e0 tx=0x7f08940019d0 comp rx=0 tx=0).stop 2024-09-12T02:36:51.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.516+0000 7f0892ffd640 1 -- 172.21.15.60:0/2668181150 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0888002a70 msgr2=0x7f0888004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:36:51.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.516+0000 7f0892ffd640 1 --2- 172.21.15.60:0/2668181150 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0888002a70 0x7f0888004f30 secure :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f08940011e0 tx=0x7f08940019d0 comp rx=0 tx=0).stop 2024-09-12T02:36:51.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.518+0000 7f08a1d9b640 1 --2- 172.21.15.60:0/2668181150 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f088406be30 0x7f088406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:51.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.519+0000 7f08a1d9b640 1 --2- 172.21.15.60:0/2668181150 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f088406be30 0x7f088406e2f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f089802a150 tx=0x7f089802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:51.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.531+0000 7f08a8f2a640 1 --2- 172.21.15.60:0/2668181150 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0888006eb0 0x7f0888007340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:51.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.531+0000 7f08a8f2a640 1 -- 172.21.15.60:0/2668181150 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f088800a4a0 con 0x7f0888006eb0 2024-09-12T02:36:51.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.532+0000 7f08a259c640 1 --2- 172.21.15.60:0/2668181150 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0888006eb0 0x7f0888007340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:51.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.533+0000 7f08a259c640 1 -- 172.21.15.60:0/2668181150 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0888007880 con 0x7f0888006eb0 2024-09-12T02:36:51.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.533+0000 7f08a259c640 1 --2- 172.21.15.60:0/2668181150 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0888006eb0 0x7f0888007340 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f08940011e0 tx=0x7f0894001150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:51.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.534+0000 7f0892ffd640 1 -- 172.21.15.60:0/2668181150 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089401c810 con 0x7f0888006eb0 2024-09-12T02:36:51.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.534+0000 7f0892ffd640 1 -- 172.21.15.60:0/2668181150 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4883 (secure 0 0 0) 0x7f089401c9b0 con 0x7f0888006eb0 2024-09-12T02:36:51.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.534+0000 7f0892ffd640 1 -- 172.21.15.60:0/2668181150 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0888006eb0 msgr2=0x7f0888007340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:51.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.534+0000 7f0892ffd640 1 --2- 172.21.15.60:0/2668181150 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0888006eb0 0x7f0888007340 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f08940011e0 tx=0x7f0894001150 comp rx=0 tx=0).stop 2024-09-12T02:36:51.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.535+0000 7f0892ffd640 1 -- 172.21.15.60:0/2668181150 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0888006eb0 msgr2=0x7f0888007340 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:36:51.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.535+0000 7f0892ffd640 1 --2- 172.21.15.60:0/2668181150 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0888006eb0 0x7f0888007340 secure :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f08940011e0 tx=0x7f0894001150 comp rx=0 tx=0).stop 2024-09-12T02:36:51.537 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:36:51.537 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:36:51.537 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:36:51.537 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:36:51.537 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 136, 2024-09-12T02:36:51.537 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 83112, 2024-09-12T02:36:51.538 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:36:51.538 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:36:51.538 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:36:51.538 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:36:51.538 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:36:51.538 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 1, 2024-09-12T02:36:51.538 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:36:51.538 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:36:51.538 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:36:51.538 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:36:51.538 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:36:51.538 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:36:51.538 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:36:51.539 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:36:51.539 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:36:51.539 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:36:51.539 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:36:51.539 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:36:51.539 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:36:51.539 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:36:51.539 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:36:51.539 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:36:51.539 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:36:51.539 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:36:51.539 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:36:51.539 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:36:51.539 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:36:51.540 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:36:51.540 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:36:51.540 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:36:51.540 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:36:51.540 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:36:51.540 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:36:51.540 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:36:51.540 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:36:51.540 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:51.540 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:36:51.540 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:36:51.540 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:36:51.540 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:36:51.540 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:36:51.541 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:36:51.541 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:36:51.541 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:36:51.541 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:36:51.541 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:36:51.541 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:36:51.541 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:36:51.541 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:36:51.541 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:36:51.541 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:36:51.541 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:36:51.541 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:36:51.541 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:36:51.542 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:36:51.542 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:36:51.542 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:36:51.542 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:36:51.542 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:36:51.542 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:36:51.542 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:36:51.542 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:36:51.542 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:36:51.542 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:36:51.542 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:36:51.542 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:36:51.542 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:51.543 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:36:51.543 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:51.543 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:36:51.543 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:36:51.543 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:36:51.543 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:36:51.543 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:51.543 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:36:51.543 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:36:51.543 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:36:51.543 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:51.543 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:51.543 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:36:51.543 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:36:51.544 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:36:51.544 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:36:51.544 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:36:51.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:51.544 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:36:51.544 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:36:51.544 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:36:51.544 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:36:51.544 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:36:51.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:51.544 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:51.544 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:36:51.544 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:36:51.545 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:36:51.545 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:36:51.545 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:51.545 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:36:51.545 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:36:51.545 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:36:51.545 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:51.545 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:51.545 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:36:51.545 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:36:51.545 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:36:51.545 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:36:51.545 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:36:51.546 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:51.546 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:36:51.546 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:36:51.546 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:36:51.546 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:36:51.546 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:36:51.546 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:51.546 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:51.546 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:36:51.546 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:36:51.546 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:36:51.546 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:36:51.546 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:51.546 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:36:51.547 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:36:51.547 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:36:51.547 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:51.547 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:51.547 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:36:51.547 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:36:51.547 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:36:51.547 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:36:51.547 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:36:51.547 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:51.547 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:36:51.547 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:36:51.547 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:36:51.547 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:36:51.548 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:36:51.548 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:36:51.548 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:36:51.548 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:51.548 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:36:51.548 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:36:51.548 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:51.548 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:36:51.548 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:36:51.549 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:36:51.549 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:36:51.549 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:36:51.549 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:36:51.549 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:51.549 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:36:51.549 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:36:51.549 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:36:51.549 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:36:51.549 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:36:51.549 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:36:51.549 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:51.549 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:36:51.550 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:36:51.550 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:36:51.550 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:36:51.550 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:36:51.550 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:36:51.550 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:51.550 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:36:51.550 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:36:51.550 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:36:51.550 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:36:51.550 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:36:51.550 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:51.550 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:36:51.551 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:36:51.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.537+0000 7f08a8f2a640 1 -- 172.21.15.60:0/2668181150 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f088406be30 msgr2=0x7f088406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:51.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.537+0000 7f08a8f2a640 1 --2- 172.21.15.60:0/2668181150 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f088406be30 0x7f088406e2f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f089802a150 tx=0x7f089802e000 comp rx=0 tx=0).stop 2024-09-12T02:36:51.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.537+0000 7f08a8f2a640 1 -- 172.21.15.60:0/2668181150 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08a4156ce0 msgr2=0x7f08a41f38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:51.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.537+0000 7f08a8f2a640 1 --2- 172.21.15.60:0/2668181150 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08a4156ce0 0x7f08a41f38f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f089c00eba0 tx=0x7f089c00c490 comp rx=0 tx=0).stop 2024-09-12T02:36:51.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.537+0000 7f08a2d9d640 1 -- 172.21.15.60:0/2668181150 reap_dead start 2024-09-12T02:36:51.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.537+0000 7f08a2d9d640 1 -- 172.21.15.60:0/2668181150 reap_dead start 2024-09-12T02:36:51.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.538+0000 7f08a8f2a640 1 -- 172.21.15.60:0/2668181150 shutdown_connections 2024-09-12T02:36:51.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.538+0000 7f08a8f2a640 1 -- 172.21.15.60:0/2668181150 >> 172.21.15.60:0/2668181150 conn(0x7f08a4068010 msgr2=0x7f08a41e18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:51.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.539+0000 7f08a8f2a640 1 -- 172.21.15.60:0/2668181150 shutdown_connections 2024-09-12T02:36:51.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.539+0000 7f08a8f2a640 1 -- 172.21.15.60:0/2668181150 wait complete. 2024-09-12T02:36:51.561 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:36:51.561 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-12T02:36:51.561 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-12T02:36:51.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.764+0000 7f971b0f8640 1 Processor -- start 2024-09-12T02:36:51.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.764+0000 7f971b0f8640 1 -- start start 2024-09-12T02:36:51.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.765+0000 7f971b0f8640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f97140c26b0 0x7f9714166490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:51.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.765+0000 7f971b0f8640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f97140c5940 0x7f9714163550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:51.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.765+0000 7f971b0f8640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9714166a70 con 0x7f9714163a90 2024-09-12T02:36:51.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.765+0000 7f971b0f8640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f97141630c0 con 0x7f97140c5940 2024-09-12T02:36:51.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.765+0000 7f971b0f8640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f9714166d50 con 0x7f97140c26b0 2024-09-12T02:36:51.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.766+0000 7f9713fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f97140c5940 0x7f9714163550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:51.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.766+0000 7f9713fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f97140c5940 0x7f9714163550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50400/0 (socket says 172.21.15.60:50400) 2024-09-12T02:36:51.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.766+0000 7f9713fff640 1 -- 172.21.15.60:0/2255517157 learned_addr learned my addr 172.21.15.60:0/2255517157 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:36:51.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.767+0000 7f9713fff640 1 -- 172.21.15.60:0/2255517157 >> v2:172.21.15.105:3300/0 conn(0x7f97140c26b0 msgr2=0x7f9714166490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:51.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.767+0000 7f9713fff640 1 --2- 172.21.15.60:0/2255517157 >> v2:172.21.15.105:3300/0 conn(0x7f97140c26b0 0x7f9714166490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:51.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.767+0000 7f9713fff640 1 -- 172.21.15.60:0/2255517157 >> v1:172.21.15.105:6789/0 conn(0x7f9714163a90 legacy=0x7f971408d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:51.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.767+0000 7f9713fff640 1 -- 172.21.15.60:0/2255517157 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9714167030 con 0x7f97140c5940 2024-09-12T02:36:51.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.768+0000 7f9713fff640 1 --2- 172.21.15.60:0/2255517157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97140c5940 0x7f9714163550 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f97140aa8b0 tx=0x7f970c02cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6572ddd91abbdc08 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:51.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.769+0000 7f97137fe640 1 -- 172.21.15.60:0/2255517157 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970c03a070 con 0x7f97140c5940 2024-09-12T02:36:51.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.769+0000 7f97137fe640 1 -- 172.21.15.60:0/2255517157 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f970c02d710 con 0x7f97140c5940 2024-09-12T02:36:51.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.770+0000 7f97137fe640 1 -- 172.21.15.60:0/2255517157 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970c02dae0 con 0x7f97140c5940 2024-09-12T02:36:51.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.770+0000 7f971b0f8640 1 -- 172.21.15.60:0/2255517157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97140c5940 msgr2=0x7f9714163550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:51.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.770+0000 7f971b0f8640 1 --2- 172.21.15.60:0/2255517157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97140c5940 0x7f9714163550 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f97140aa8b0 tx=0x7f970c02cc10 comp rx=0 tx=0).stop 2024-09-12T02:36:51.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.771+0000 7f971b0f8640 1 -- 172.21.15.60:0/2255517157 shutdown_connections 2024-09-12T02:36:51.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.771+0000 7f971b0f8640 1 --2- 172.21.15.60:0/2255517157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97140c5940 0x7f9714163550 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:51.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.771+0000 7f971b0f8640 1 --2- 172.21.15.60:0/2255517157 >> v2:172.21.15.105:3300/0 conn(0x7f97140c26b0 0x7f9714166490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:51.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.771+0000 7f971b0f8640 1 -- 172.21.15.60:0/2255517157 >> 172.21.15.60:0/2255517157 conn(0x7f97140c7a40 msgr2=0x7f97140c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:51.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.771+0000 7f971b0f8640 1 -- 172.21.15.60:0/2255517157 shutdown_connections 2024-09-12T02:36:51.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.771+0000 7f971b0f8640 1 -- 172.21.15.60:0/2255517157 wait complete. 2024-09-12T02:36:51.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.773+0000 7f971b0f8640 1 Processor -- start 2024-09-12T02:36:51.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.773+0000 7f971b0f8640 1 -- start start 2024-09-12T02:36:51.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.774+0000 7f971b0f8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97140c26b0 0x7f97141fbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:51.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.774+0000 7f971b0f8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97140c5940 0x7f9714073b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:51.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.774+0000 7f971b0f8640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9714163a90 0x7f9714074080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:51.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.774+0000 7f971b0f8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f971406f460 con 0x7f97140c26b0 2024-09-12T02:36:51.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.774+0000 7f971b0f8640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f971406f2e0 con 0x7f97140c5940 2024-09-12T02:36:51.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.774+0000 7f971b0f8640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f97140c62f0 con 0x7f9714163a90 2024-09-12T02:36:51.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.775+0000 7f9718e94640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97140c26b0 0x7f97141fbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:51.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.775+0000 7f9718e94640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97140c26b0 0x7f97141fbc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50414/0 (socket says 172.21.15.60:50414) 2024-09-12T02:36:51.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.775+0000 7f9718e94640 1 -- 172.21.15.60:0/3383053664 learned_addr learned my addr 172.21.15.60:0/3383053664 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:36:51.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.775+0000 7f9718e94640 1 -- 172.21.15.60:0/3383053664 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9714163a90 msgr2=0x7f9714074080 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:36:51.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.775+0000 7f9718e94640 1 --2- 172.21.15.60:0/3383053664 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9714163a90 0x7f9714074080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:51.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.775+0000 7f9718e94640 1 -- 172.21.15.60:0/3383053664 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97140c5940 msgr2=0x7f9714073b40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:36:51.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.775+0000 7f9718e94640 1 --2- 172.21.15.60:0/3383053664 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97140c5940 0x7f9714073b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:51.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.775+0000 7f9718e94640 1 -- 172.21.15.60:0/3383053664 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97141eea00 con 0x7f97140c26b0 2024-09-12T02:36:51.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.776+0000 7f9718e94640 1 --2- 172.21.15.60:0/3383053664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97140c26b0 0x7f97141fbc70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f970400b730 tx=0x7f970400bbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:51.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.778+0000 7f97117fa640 1 -- 172.21.15.60:0/3383053664 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9704019070 con 0x7f97140c26b0 2024-09-12T02:36:51.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.778+0000 7f971b0f8640 1 -- 172.21.15.60:0/3383053664 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97141ef1a0 con 0x7f97140c26b0 2024-09-12T02:36:51.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.778+0000 7f971b0f8640 1 -- 172.21.15.60:0/3383053664 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9714087230 con 0x7f97140c26b0 2024-09-12T02:36:51.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.779+0000 7f971b0f8640 1 --2- 172.21.15.60:0/3383053664 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97141eebe0 0x7f9714164080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:51.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.779+0000 7f971b0f8640 1 -- 172.21.15.60:0/3383053664 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f97140c2a90 con 0x7f97141eebe0 2024-09-12T02:36:51.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.780+0000 7f97117fa640 1 -- 172.21.15.60:0/3383053664 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f970400c7e0 con 0x7f97140c26b0 2024-09-12T02:36:51.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.780+0000 7f97117fa640 1 -- 172.21.15.60:0/3383053664 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970400cbd0 con 0x7f97140c26b0 2024-09-12T02:36:51.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.782+0000 7f9713fff640 1 --2- 172.21.15.60:0/3383053664 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97141eebe0 0x7f9714164080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:51.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.782+0000 7f97117fa640 1 -- 172.21.15.60:0/3383053664 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f970401c070 con 0x7f97140c26b0 2024-09-12T02:36:51.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.783+0000 7f9713fff640 1 -- 172.21.15.60:0/3383053664 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f97140c1cc0 con 0x7f97141eebe0 2024-09-12T02:36:51.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.783+0000 7f9713fff640 1 --2- 172.21.15.60:0/3383053664 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97141eebe0 0x7f9714164080 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9714162f40 tx=0x7f970c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:51.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.783+0000 7f97117fa640 1 --2- 172.21.15.60:0/3383053664 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f970006bf00 0x7f970006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:51.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.784+0000 7f97117fa640 1 -- 172.21.15.60:0/3383053664 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f970408a770 con 0x7f97140c26b0 2024-09-12T02:36:51.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.784+0000 7f97117fa640 1 -- 172.21.15.60:0/3383053664 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970c03a070 con 0x7f97141eebe0 2024-09-12T02:36:51.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.784+0000 7f97117fa640 1 -- 172.21.15.60:0/3383053664 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f970c045070 con 0x7f97141eebe0 2024-09-12T02:36:51.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.784+0000 7f97117fa640 1 -- 172.21.15.60:0/3383053664 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97141eebe0 msgr2=0x7f9714164080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:51.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.784+0000 7f97117fa640 1 --2- 172.21.15.60:0/3383053664 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97141eebe0 0x7f9714164080 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9714162f40 tx=0x7f970c004a40 comp rx=0 tx=0).stop 2024-09-12T02:36:51.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.785+0000 7f97117fa640 1 -- 172.21.15.60:0/3383053664 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97141eebe0 msgr2=0x7f9714164080 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:36:51.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.785+0000 7f97117fa640 1 --2- 172.21.15.60:0/3383053664 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97141eebe0 0x7f9714164080 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:51.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.785+0000 7f9719695640 1 --2- 172.21.15.60:0/3383053664 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f970006bf00 0x7f970006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:51.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.786+0000 7f9719695640 1 --2- 172.21.15.60:0/3383053664 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f970006bf00 0x7f970006e3c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f97140a80f0 tx=0x7f9708006b30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:51.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.798+0000 7f971b0f8640 1 --2- 172.21.15.60:0/3383053664 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f971408a040 0x7f97141fc570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:51.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.798+0000 7f971b0f8640 1 -- 172.21.15.60:0/3383053664 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f97140764a0 con 0x7f971408a040 2024-09-12T02:36:51.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.801+0000 7f9713fff640 1 --2- 172.21.15.60:0/3383053664 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f971408a040 0x7f97141fc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:51.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.806+0000 7f9713fff640 1 -- 172.21.15.60:0/3383053664 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9714160c50 con 0x7f971408a040 2024-09-12T02:36:51.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.807+0000 7f9713fff640 1 --2- 172.21.15.60:0/3383053664 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f971408a040 0x7f97141fc570 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f97140c23c0 tx=0x7f970c008800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:51.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.808+0000 7f97117fa640 1 -- 172.21.15.60:0/3383053664 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970c02d7e0 con 0x7f971408a040 2024-09-12T02:36:51.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.808+0000 7f97117fa640 1 -- 172.21.15.60:0/3383053664 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5051 (secure 0 0 0) 0x7f970c03b040 con 0x7f971408a040 2024-09-12T02:36:51.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.808+0000 7f97117fa640 1 -- 172.21.15.60:0/3383053664 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f971408a040 msgr2=0x7f97141fc570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:51.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.808+0000 7f97117fa640 1 --2- 172.21.15.60:0/3383053664 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f971408a040 0x7f97141fc570 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f97140c23c0 tx=0x7f970c008800 comp rx=0 tx=0).stop 2024-09-12T02:36:51.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.808+0000 7f97117fa640 1 -- 172.21.15.60:0/3383053664 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f971408a040 msgr2=0x7f97141fc570 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:36:51.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.808+0000 7f97117fa640 1 --2- 172.21.15.60:0/3383053664 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f971408a040 0x7f97141fc570 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:51.810 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:36:51.810 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:36:51.810 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:36:51.810 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:36:51.810 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 136, 2024-09-12T02:36:51.810 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 285562, 2024-09-12T02:36:51.811 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:36:51.811 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:36:51.811 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:36:51.811 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:36:51.811 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:36:51.811 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 1, 2024-09-12T02:36:51.811 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:36:51.811 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:36:51.811 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:36:51.811 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:36:51.811 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:36:51.811 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:36:51.811 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:36:51.812 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:36:51.812 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:36:51.812 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:36:51.812 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:36:51.812 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:36:51.812 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:36:51.812 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:36:51.812 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:36:51.812 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:36:51.812 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:36:51.812 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:36:51.812 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:36:51.812 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:36:51.813 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:36:51.813 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:36:51.813 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:36:51.813 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:36:51.813 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:36:51.813 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:36:51.813 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:36:51.813 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:36:51.813 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:36:51.813 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:51.813 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:36:51.813 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:36:51.813 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:36:51.813 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:36:51.814 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:36:51.814 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:36:51.814 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:36:51.814 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:36:51.814 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:36:51.814 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:36:51.814 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:36:51.814 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:36:51.814 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:36:51.814 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:36:51.814 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:36:51.814 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:36:51.814 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:36:51.814 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:36:51.815 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:36:51.815 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:36:51.815 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:36:51.815 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:36:51.815 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:36:51.815 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:36:51.815 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:36:51.815 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:36:51.815 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:36:51.815 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:36:51.815 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:36:51.815 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:36:51.815 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:51.815 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:36:51.816 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:51.816 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:36:51.816 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:36:51.816 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:36:51.816 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:36:51.816 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:51.816 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:36:51.816 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:36:51.816 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:36:51.816 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:51.816 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:51.816 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:36:51.816 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:36:51.817 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:36:51.817 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:36:51.817 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:36:51.817 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:51.817 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:36:51.817 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:36:51.817 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:36:51.817 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:36:51.817 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:36:51.817 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:51.817 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:51.817 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:36:51.817 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:36:51.817 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:36:51.818 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:36:51.818 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:51.818 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:36:51.818 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:36:51.818 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:36:51.818 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:51.818 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:51.818 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:36:51.818 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:36:51.818 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:36:51.818 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:36:51.818 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:36:51.818 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:51.818 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:36:51.819 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:36:51.819 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:36:51.819 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:36:51.819 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:36:51.819 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:51.819 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:51.819 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:36:51.819 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:36:51.819 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:36:51.819 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:36:51.819 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:51.819 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:36:51.819 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:36:51.819 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:36:51.820 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:51.820 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:51.820 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:36:51.820 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:36:51.820 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:36:51.820 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:36:51.820 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:36:51.820 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:51.820 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:36:51.820 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:36:51.820 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:36:51.820 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:36:51.820 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:36:51.821 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:36:51.821 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:36:51.821 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:51.821 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:36:51.821 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:36:51.821 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:51.821 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:36:51.821 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:36:51.821 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:36:51.821 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:36:51.821 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:36:51.821 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:36:51.821 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:51.821 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:36:51.822 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:36:51.822 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:36:51.822 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:36:51.822 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:36:51.822 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:36:51.822 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:51.822 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:36:51.822 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:36:51.822 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-09-12T02:36:51.822 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:36:51.822 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:36:51.822 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:36:51.822 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:51.822 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:36:51.823 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:36:51.823 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-09-12T02:36:51.823 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:36:51.823 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:36:51.823 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:36:51.823 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:36:51.823 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:36:51.823 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:36:51.823 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:36:51.823 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:36:51.823 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:36:51.823 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:36:51.823 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:36:51.823 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:36:51.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.810+0000 7f971b0f8640 1 -- 172.21.15.60:0/3383053664 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f970006bf00 msgr2=0x7f970006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:51.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.810+0000 7f971b0f8640 1 --2- 172.21.15.60:0/3383053664 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f970006bf00 0x7f970006e3c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f97140a80f0 tx=0x7f9708006b30 comp rx=0 tx=0).stop 2024-09-12T02:36:51.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.810+0000 7f971b0f8640 1 -- 172.21.15.60:0/3383053664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97140c26b0 msgr2=0x7f97141fbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:51.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.810+0000 7f971b0f8640 1 --2- 172.21.15.60:0/3383053664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97140c26b0 0x7f97141fbc70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f970400b730 tx=0x7f970400bbf0 comp rx=0 tx=0).stop 2024-09-12T02:36:51.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.810+0000 7f9719695640 1 -- 172.21.15.60:0/3383053664 reap_dead start 2024-09-12T02:36:51.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.810+0000 7f9719695640 1 -- 172.21.15.60:0/3383053664 reap_dead start 2024-09-12T02:36:51.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.810+0000 7f971b0f8640 1 -- 172.21.15.60:0/3383053664 shutdown_connections 2024-09-12T02:36:51.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.810+0000 7f971b0f8640 1 -- 172.21.15.60:0/3383053664 >> 172.21.15.60:0/3383053664 conn(0x7f97140c7a40 msgr2=0x7f97140a76f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:51.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.811+0000 7f971b0f8640 1 -- 172.21.15.60:0/3383053664 shutdown_connections 2024-09-12T02:36:51.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:51.811+0000 7f971b0f8640 1 -- 172.21.15.60:0/3383053664 wait complete. 2024-09-12T02:36:51.836 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:36:51.836 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-12T02:36:51.836 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-12T02:36:52.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.028+0000 7faf78cb7640 1 Processor -- start 2024-09-12T02:36:52.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.028+0000 7faf78cb7640 1 -- start start 2024-09-12T02:36:52.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.030+0000 7faf78cb7640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7faf6c00b0e0 0x7faf6c00b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:52.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.030+0000 7faf78cb7640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7faf6c047bc0 0x7faf6c006230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:52.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.030+0000 7faf78cb7640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf6c006e80 con 0x7faf6c0072a0 2024-09-12T02:36:52.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.030+0000 7faf78cb7640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7faf6c0de0c0 con 0x7faf6c047bc0 2024-09-12T02:36:52.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.030+0000 7faf78cb7640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7faf6c0ddde0 con 0x7faf6c00b0e0 2024-09-12T02:36:52.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.031+0000 7faf71d9b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7faf6c047bc0 0x7faf6c006230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:52.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.031+0000 7faf71d9b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7faf6c047bc0 0x7faf6c006230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50424/0 (socket says 172.21.15.60:50424) 2024-09-12T02:36:52.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.031+0000 7faf71d9b640 1 -- 172.21.15.60:0/1128572760 learned_addr learned my addr 172.21.15.60:0/1128572760 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:36:52.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.031+0000 7faf7259c640 1 --2- 172.21.15.60:0/1128572760 >> v2:172.21.15.105:3300/0 conn(0x7faf6c00b0e0 0x7faf6c00b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:52.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.031+0000 7faf71d9b640 1 -- 172.21.15.60:0/1128572760 >> v2:172.21.15.105:3300/0 conn(0x7faf6c00b0e0 msgr2=0x7faf6c00b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:36:52.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.031+0000 7faf71d9b640 1 --2- 172.21.15.60:0/1128572760 >> v2:172.21.15.105:3300/0 conn(0x7faf6c00b0e0 0x7faf6c00b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:52.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.031+0000 7faf71d9b640 1 -- 172.21.15.60:0/1128572760 >> v1:172.21.15.105:6789/0 conn(0x7faf6c0072a0 legacy=0x7faf6c006770 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:36:52.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.031+0000 7faf71d9b640 1 -- 172.21.15.60:0/1128572760 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf6c046100 con 0x7faf6c047bc0 2024-09-12T02:36:52.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.032+0000 7faf71d9b640 1 --2- 172.21.15.60:0/1128572760 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf6c047bc0 0x7faf6c006230 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7faf74051790 tx=0x7faf740a6d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dca0da7c1650504a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:52.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.033+0000 7faf7159a640 1 -- 172.21.15.60:0/1128572760 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf740b4070 con 0x7faf6c047bc0 2024-09-12T02:36:52.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.033+0000 7faf7159a640 1 -- 172.21.15.60:0/1128572760 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf740a7b60 con 0x7faf6c047bc0 2024-09-12T02:36:52.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.034+0000 7faf78cb7640 1 -- 172.21.15.60:0/1128572760 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf6c047bc0 msgr2=0x7faf6c006230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:52.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.034+0000 7faf78cb7640 1 --2- 172.21.15.60:0/1128572760 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf6c047bc0 0x7faf6c006230 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7faf74051790 tx=0x7faf740a6d90 comp rx=0 tx=0).stop 2024-09-12T02:36:52.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.037+0000 7faf78cb7640 1 -- 172.21.15.60:0/1128572760 shutdown_connections 2024-09-12T02:36:52.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.037+0000 7faf78cb7640 1 --2- 172.21.15.60:0/1128572760 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf6c047bc0 0x7faf6c006230 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:52.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.037+0000 7faf78cb7640 1 --2- 172.21.15.60:0/1128572760 >> v2:172.21.15.105:3300/0 conn(0x7faf6c00b0e0 0x7faf6c00b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:52.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.037+0000 7faf78cb7640 1 -- 172.21.15.60:0/1128572760 >> 172.21.15.60:0/1128572760 conn(0x7faf6c048160 msgr2=0x7faf6c048570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:52.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.037+0000 7faf78cb7640 1 -- 172.21.15.60:0/1128572760 shutdown_connections 2024-09-12T02:36:52.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.038+0000 7faf78cb7640 1 -- 172.21.15.60:0/1128572760 wait complete. 2024-09-12T02:36:52.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.040+0000 7faf78cb7640 1 Processor -- start 2024-09-12T02:36:52.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.044+0000 7faf78cb7640 1 -- start start 2024-09-12T02:36:52.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.045+0000 7faf78cb7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf6c0072a0 0x7faf6c02c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:52.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.045+0000 7faf78cb7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf6c00b0e0 0x7faf6c0d30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:52.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.045+0000 7faf78cb7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf6c047bc0 0x7faf6c0d3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:52.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.045+0000 7faf78cb7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7faf6c0d77d0 con 0x7faf6c047bc0 2024-09-12T02:36:52.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.045+0000 7faf78cb7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7faf6c031570 con 0x7faf6c00b0e0 2024-09-12T02:36:52.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.045+0000 7faf78cb7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7faf6c031a90 con 0x7faf6c0072a0 2024-09-12T02:36:52.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.046+0000 7faf71d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf6c00b0e0 0x7faf6c0d30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:52.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.046+0000 7faf71d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf6c00b0e0 0x7faf6c0d30e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:51478/0 (socket says 172.21.15.60:51478) 2024-09-12T02:36:52.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.046+0000 7faf71d9b640 1 -- 172.21.15.60:0/2399745802 learned_addr learned my addr 172.21.15.60:0/2399745802 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:36:52.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.047+0000 7faf7259c640 1 --2- 172.21.15.60:0/2399745802 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf6c0072a0 0x7faf6c02c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:52.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.047+0000 7faf7259c640 1 -- 172.21.15.60:0/2399745802 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf6c00b0e0 msgr2=0x7faf6c0d30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:52.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.047+0000 7faf7259c640 1 --2- 172.21.15.60:0/2399745802 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf6c00b0e0 0x7faf6c0d30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:52.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.047+0000 7faf7259c640 1 -- 172.21.15.60:0/2399745802 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf6c047bc0 msgr2=0x7faf6c0d3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:52.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.047+0000 7faf7259c640 1 --2- 172.21.15.60:0/2399745802 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf6c047bc0 0x7faf6c0d3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:52.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.047+0000 7faf7259c640 1 -- 172.21.15.60:0/2399745802 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf6c0ceab0 con 0x7faf6c0072a0 2024-09-12T02:36:52.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.048+0000 7faf7259c640 1 --2- 172.21.15.60:0/2399745802 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf6c0072a0 0x7faf6c02c580 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7faf68013f80 tx=0x7faf680174a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:52.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.049+0000 7faf62ffd640 1 -- 172.21.15.60:0/2399745802 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf68012ae0 con 0x7faf6c0072a0 2024-09-12T02:36:52.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.049+0000 7faf78cb7640 1 -- 172.21.15.60:0/2399745802 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf6c16b770 con 0x7faf6c0072a0 2024-09-12T02:36:52.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.049+0000 7faf78cb7640 1 -- 172.21.15.60:0/2399745802 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7faf6c0d70e0 con 0x7faf6c0072a0 2024-09-12T02:36:52.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.051+0000 7faf62ffd640 1 -- 172.21.15.60:0/2399745802 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf68012c80 con 0x7faf6c0072a0 2024-09-12T02:36:52.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.051+0000 7faf62ffd640 1 -- 172.21.15.60:0/2399745802 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf68013220 con 0x7faf6c0072a0 2024-09-12T02:36:52.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.051+0000 7faf78cb7640 1 -- 172.21.15.60:0/2399745802 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf6c008b90 con 0x7faf6c0072a0 2024-09-12T02:36:52.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.052+0000 7faf62ffd640 1 -- 172.21.15.60:0/2399745802 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faf680133c0 con 0x7faf6c0072a0 2024-09-12T02:36:52.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.053+0000 7faf62ffd640 1 --2- 172.21.15.60:0/2399745802 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7faf5406bf00 0x7faf5406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:52.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.053+0000 7faf62ffd640 1 -- 172.21.15.60:0/2399745802 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7faf68093ad0 con 0x7faf6c0072a0 2024-09-12T02:36:52.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.054+0000 7faf71d9b640 1 --2- 172.21.15.60:0/2399745802 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7faf5406bf00 0x7faf5406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:52.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.055+0000 7faf71d9b640 1 --2- 172.21.15.60:0/2399745802 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7faf5406bf00 0x7faf5406e3c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7faf74050d60 tx=0x7faf740ab000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:52.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.060+0000 7faf62ffd640 1 -- 172.21.15.60:0/2399745802 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faf6c008b90 con 0x7faf6c0072a0 2024-09-12T02:36:52.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.601+0000 7faf78cb7640 1 -- 172.21.15.60:0/2399745802 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7faf6c00b4c0 con 0x7faf6c0072a0 2024-09-12T02:36:52.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.604+0000 7faf62ffd640 1 -- 172.21.15.60:0/2399745802 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7faf6802d020 con 0x7faf6c0072a0 2024-09-12T02:36:52.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.607+0000 7faf60ff9640 1 -- 172.21.15.60:0/2399745802 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7faf5406bf00 msgr2=0x7faf5406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:52.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.608+0000 7faf60ff9640 1 --2- 172.21.15.60:0/2399745802 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7faf5406bf00 0x7faf5406e3c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7faf74050d60 tx=0x7faf740ab000 comp rx=0 tx=0).stop 2024-09-12T02:36:52.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.608+0000 7faf60ff9640 1 -- 172.21.15.60:0/2399745802 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf6c0072a0 msgr2=0x7faf6c02c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:52.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.608+0000 7faf60ff9640 1 --2- 172.21.15.60:0/2399745802 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf6c0072a0 0x7faf6c02c580 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7faf68013f80 tx=0x7faf680174a0 comp rx=0 tx=0).stop 2024-09-12T02:36:52.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.608+0000 7faf60ff9640 1 -- 172.21.15.60:0/2399745802 shutdown_connections 2024-09-12T02:36:52.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.608+0000 7faf60ff9640 1 --2- 172.21.15.60:0/2399745802 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7faf5406bf00 0x7faf5406e3c0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:52.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.608+0000 7faf60ff9640 1 --2- 172.21.15.60:0/2399745802 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf6c047bc0 0x7faf6c0d3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:52.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.608+0000 7faf60ff9640 1 --2- 172.21.15.60:0/2399745802 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf6c00b0e0 0x7faf6c0d30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:52.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.609+0000 7faf60ff9640 1 --2- 172.21.15.60:0/2399745802 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf6c0072a0 0x7faf6c02c580 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:52.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.609+0000 7faf60ff9640 1 -- 172.21.15.60:0/2399745802 >> 172.21.15.60:0/2399745802 conn(0x7faf6c048160 msgr2=0x7faf6c02e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:52.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.609+0000 7faf60ff9640 1 -- 172.21.15.60:0/2399745802 shutdown_connections 2024-09-12T02:36:52.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:36:52.609+0000 7faf60ff9640 1 -- 172.21.15.60:0/2399745802 wait complete. 2024-09-12T02:36:52.631 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-12T02:37:01.687 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:37:01.694 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:37:02.632 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-12T02:37:02.632 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:37:02.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.822+0000 7fc601a1e640 1 Processor -- start 2024-09-12T02:37:02.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.825+0000 7fc601a1e640 1 -- start start 2024-09-12T02:37:02.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.827+0000 7fc601a1e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc5fc152f20 0x7fc5fc0ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:02.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.829+0000 7fc5faffd640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fc5fc14fa60 0x7fc5fc06f280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:34332/0 (socket says 172.21.15.60:34332) 2024-09-12T02:37:02.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.830+0000 7fc601a1e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc5fc0744e0 0x7fc5fc0ac810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:02.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.830+0000 7fc601a1e640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5fc0ab510 con 0x7fc5fc14fa60 2024-09-12T02:37:02.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.830+0000 7fc601a1e640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc5fc153490 con 0x7fc5fc0744e0 2024-09-12T02:37:02.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.830+0000 7fc601a1e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc5fc0ab7f0 con 0x7fc5fc152f20 2024-09-12T02:37:02.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.830+0000 7fc5faffd640 1 -- 172.21.15.60:0/1421958296 learned_addr learned my addr 172.21.15.60:0/1421958296 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:37:02.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.832+0000 7fc5fa7fc640 1 -- 172.21.15.60:0/1421958296 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3027158295 0 0) 0x7fc5fc0ab510 con 0x7fc5fc14fa60 2024-09-12T02:37:02.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.832+0000 7fc5fa7fc640 1 -- 172.21.15.60:0/1421958296 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5e8003520 con 0x7fc5fc14fa60 2024-09-12T02:37:02.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.832+0000 7fc5f3fff640 1 --2- 172.21.15.60:0/1421958296 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc5fc152f20 0x7fc5fc0ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:02.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.832+0000 7fc5fa7fc640 1 -- 172.21.15.60:0/1421958296 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2367525247 0 0) 0x7fc5e8003520 con 0x7fc5fc14fa60 2024-09-12T02:37:02.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.832+0000 7fc5fa7fc640 1 -- 172.21.15.60:0/1421958296 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc5fc152f20 msgr2=0x7fc5fc0ac2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:02.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.832+0000 7fc5fa7fc640 1 --2- 172.21.15.60:0/1421958296 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc5fc152f20 0x7fc5fc0ac2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:02.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.832+0000 7fc5fa7fc640 1 -- 172.21.15.60:0/1421958296 >> v2:172.21.15.105:3300/0 conn(0x7fc5fc0744e0 msgr2=0x7fc5fc0ac810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:02.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.832+0000 7fc5fb7fe640 1 --2- 172.21.15.60:0/1421958296 >> v2:172.21.15.105:3300/0 conn(0x7fc5fc0744e0 0x7fc5fc0ac810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:02.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.833+0000 7fc5fa7fc640 1 --2- 172.21.15.60:0/1421958296 >> v2:172.21.15.105:3300/0 conn(0x7fc5fc0744e0 0x7fc5fc0ac810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:02.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.833+0000 7fc5fa7fc640 1 -- 172.21.15.60:0/1421958296 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5fc0abad0 con 0x7fc5fc14fa60 2024-09-12T02:37:02.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.833+0000 7fc5fa7fc640 1 -- 172.21.15.60:0/1421958296 <== mon.1 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7fc5e4001670 con 0x7fc5fc14fa60 2024-09-12T02:37:02.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.833+0000 7fc5fa7fc640 1 -- 172.21.15.60:0/1421958296 >> v1:172.21.15.105:6789/0 conn(0x7fc5fc14fa60 legacy=0x7fc5fc06f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:02.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.833+0000 7fc5fa7fc640 1 --2- 172.21.15.60:0/1421958296 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5e80039b0 0x7fc5e8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:02.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.833+0000 7fc5fa7fc640 1 --2- 172.21.15.60:0/1421958296 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc5fc152f20 0x7fc5e8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:02.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.833+0000 7fc5fa7fc640 1 --2- 172.21.15.60:0/1421958296 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5e8004d90 0x7fc5e8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:02.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.833+0000 7fc5faffd640 1 --2- 172.21.15.60:0/1421958296 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5e80039b0 0x7fc5e8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:02.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.833+0000 7fc5fa7fc640 1 -- 172.21.15.60:0/1421958296 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc5fc153490 con 0x7fc5e8004d90 2024-09-12T02:37:02.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.833+0000 7fc5fa7fc640 1 -- 172.21.15.60:0/1421958296 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc5fc0ab7f0 con 0x7fc5e80039b0 2024-09-12T02:37:02.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.833+0000 7fc5fa7fc640 1 -- 172.21.15.60:0/1421958296 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc5e800bca0 con 0x7fc5fc152f20 2024-09-12T02:37:02.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.833+0000 7fc5fb7fe640 1 --2- 172.21.15.60:0/1421958296 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5e8004d90 0x7fc5e8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:02.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.833+0000 7fc5faffd640 1 -- 172.21.15.60:0/1421958296 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc5fc152f20 msgr2=0x7fc5e8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:02.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.833+0000 7fc5faffd640 1 --2- 172.21.15.60:0/1421958296 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc5fc152f20 0x7fc5e8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:02.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.833+0000 7fc5faffd640 1 -- 172.21.15.60:0/1421958296 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5e8004d90 msgr2=0x7fc5e8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:02.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.833+0000 7fc5faffd640 1 --2- 172.21.15.60:0/1421958296 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5e8004d90 0x7fc5e8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:02.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.833+0000 7fc5faffd640 1 -- 172.21.15.60:0/1421958296 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5e8003520 con 0x7fc5e80039b0 2024-09-12T02:37:02.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.836+0000 7fc5faffd640 1 --2- 172.21.15.60:0/1421958296 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5e80039b0 0x7fc5e8003dd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc5e400c210 tx=0x7fc5e8005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7dea90f76dfe5772 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:02.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.836+0000 7fc5fa7fc640 1 -- 172.21.15.60:0/1421958296 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e4007d50 con 0x7fc5e80039b0 2024-09-12T02:37:02.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.836+0000 7fc5fa7fc640 1 -- 172.21.15.60:0/1421958296 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5e4005af0 con 0x7fc5e80039b0 2024-09-12T02:37:02.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.836+0000 7fc5fa7fc640 1 -- 172.21.15.60:0/1421958296 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e4007070 con 0x7fc5e80039b0 2024-09-12T02:37:02.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.837+0000 7fc601a1e640 1 -- 172.21.15.60:0/1421958296 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5e80039b0 msgr2=0x7fc5e8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:02.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.837+0000 7fc601a1e640 1 --2- 172.21.15.60:0/1421958296 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5e80039b0 0x7fc5e8003dd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc5e400c210 tx=0x7fc5e8005830 comp rx=0 tx=0).stop 2024-09-12T02:37:02.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.838+0000 7fc5fb7fe640 1 -- 172.21.15.60:0/1421958296 reap_dead start 2024-09-12T02:37:02.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.838+0000 7fc601a1e640 1 -- 172.21.15.60:0/1421958296 shutdown_connections 2024-09-12T02:37:02.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.838+0000 7fc601a1e640 1 -- 172.21.15.60:0/1421958296 >> 172.21.15.60:0/1421958296 conn(0x7fc5fc0c4e30 msgr2=0x7fc5fc0c5210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:02.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.838+0000 7fc601a1e640 1 -- 172.21.15.60:0/1421958296 shutdown_connections 2024-09-12T02:37:02.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.842+0000 7fc601a1e640 1 -- 172.21.15.60:0/1421958296 wait complete. 2024-09-12T02:37:02.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.843+0000 7fc601a1e640 1 Processor -- start 2024-09-12T02:37:02.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.844+0000 7fc601a1e640 1 -- start start 2024-09-12T02:37:02.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.845+0000 7fc601a1e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5fc1fba80 0x7fc5fc153ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:02.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.845+0000 7fc601a1e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5fc0732d0 0x7fc5fc1fbe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:02.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.845+0000 7fc601a1e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc5fc0c6f80 0x7fc5fc0c7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:02.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.845+0000 7fc601a1e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc5fc06f990 con 0x7fc5fc1fba80 2024-09-12T02:37:02.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.845+0000 7fc601a1e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc5fc14fe40 con 0x7fc5fc0732d0 2024-09-12T02:37:02.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.845+0000 7fc601a1e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc5fc06fb10 con 0x7fc5fc0c6f80 2024-09-12T02:37:02.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.847+0000 7fc5faffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5fc1fba80 0x7fc5fc153ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:02.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.847+0000 7fc5faffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5fc1fba80 0x7fc5fc153ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37240/0 (socket says 172.21.15.60:37240) 2024-09-12T02:37:02.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.847+0000 7fc5faffd640 1 -- 172.21.15.60:0/3953361071 learned_addr learned my addr 172.21.15.60:0/3953361071 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:37:02.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.847+0000 7fc5fb7fe640 1 --2- 172.21.15.60:0/3953361071 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc5fc0c6f80 0x7fc5fc0c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:02.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.848+0000 7fc5faffd640 1 -- 172.21.15.60:0/3953361071 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc5fc0c6f80 msgr2=0x7fc5fc0c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:02.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.848+0000 7fc5faffd640 1 --2- 172.21.15.60:0/3953361071 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc5fc0c6f80 0x7fc5fc0c7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:02.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.848+0000 7fc5faffd640 1 -- 172.21.15.60:0/3953361071 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5fc0732d0 msgr2=0x7fc5fc1fbe60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:37:02.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.848+0000 7fc5faffd640 1 --2- 172.21.15.60:0/3953361071 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5fc0732d0 0x7fc5fc1fbe60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:02.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.848+0000 7fc5faffd640 1 -- 172.21.15.60:0/3953361071 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5fc0723c0 con 0x7fc5fc1fba80 2024-09-12T02:37:02.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.848+0000 7fc5faffd640 1 --2- 172.21.15.60:0/3953361071 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5fc1fba80 0x7fc5fc153ab0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc5e400c330 tx=0x7fc5e4001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:02.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.849+0000 7fc5f8ff9640 1 -- 172.21.15.60:0/3953361071 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e4042020 con 0x7fc5fc1fba80 2024-09-12T02:37:02.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.849+0000 7fc601a1e640 1 -- 172.21.15.60:0/3953361071 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5fc1fc770 con 0x7fc5fc1fba80 2024-09-12T02:37:02.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.849+0000 7fc601a1e640 1 -- 172.21.15.60:0/3953361071 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5fc0715c0 con 0x7fc5fc1fba80 2024-09-12T02:37:02.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.849+0000 7fc5f8ff9640 1 -- 172.21.15.60:0/3953361071 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5e4007290 con 0x7fc5fc1fba80 2024-09-12T02:37:02.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.849+0000 7fc5f8ff9640 1 -- 172.21.15.60:0/3953361071 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e4007d50 con 0x7fc5fc1fba80 2024-09-12T02:37:02.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.853+0000 7fc5f1ffb640 1 -- 172.21.15.60:0/3953361071 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5fc1fc940 con 0x7fc5fc1fba80 2024-09-12T02:37:02.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.854+0000 7fc5f8ff9640 1 -- 172.21.15.60:0/3953361071 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc5e4045020 con 0x7fc5fc1fba80 2024-09-12T02:37:02.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.855+0000 7fc5f8ff9640 1 --2- 172.21.15.60:0/3953361071 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc5dc06bf30 0x7fc5dc06e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:02.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.855+0000 7fc5f8ff9640 1 -- 172.21.15.60:0/3953361071 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fc5e40ab900 con 0x7fc5fc1fba80 2024-09-12T02:37:02.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.865+0000 7fc5f8ff9640 1 -- 172.21.15.60:0/3953361071 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc5e404c030 con 0x7fc5fc1fba80 2024-09-12T02:37:02.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.867+0000 7fc5f3fff640 1 --2- 172.21.15.60:0/3953361071 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc5dc06bf30 0x7fc5dc06e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:02.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:02.867+0000 7fc5f3fff640 1 --2- 172.21.15.60:0/3953361071 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc5dc06bf30 0x7fc5dc06e3f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc148800 tx=0x7fc5ec008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:03.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.413+0000 7fc5f1ffb640 1 -- 172.21.15.60:0/3953361071 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc5fc06e4a0 con 0x7fc5fc1fba80 2024-09-12T02:37:03.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.416+0000 7fc5f8ff9640 1 -- 172.21.15.60:0/3953361071 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1566 (secure 0 0 0) 0x7fc5e4079f80 con 0x7fc5fc1fba80 2024-09-12T02:37:03.416 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":136,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:37:03.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.419+0000 7fc5f1ffb640 1 -- 172.21.15.60:0/3953361071 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc5dc06bf30 msgr2=0x7fc5dc06e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:03.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.419+0000 7fc5f1ffb640 1 --2- 172.21.15.60:0/3953361071 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc5dc06bf30 0x7fc5dc06e3f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc148800 tx=0x7fc5ec008040 comp rx=0 tx=0).stop 2024-09-12T02:37:03.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.420+0000 7fc5f1ffb640 1 -- 172.21.15.60:0/3953361071 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5fc1fba80 msgr2=0x7fc5fc153ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:03.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.420+0000 7fc5f1ffb640 1 --2- 172.21.15.60:0/3953361071 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5fc1fba80 0x7fc5fc153ab0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc5e400c330 tx=0x7fc5e4001a40 comp rx=0 tx=0).stop 2024-09-12T02:37:03.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.422+0000 7fc5f1ffb640 1 -- 172.21.15.60:0/3953361071 shutdown_connections 2024-09-12T02:37:03.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.422+0000 7fc5f1ffb640 1 --2- 172.21.15.60:0/3953361071 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc5dc06bf30 0x7fc5dc06e3f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:03.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.422+0000 7fc5f1ffb640 1 --2- 172.21.15.60:0/3953361071 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc5fc0c6f80 0x7fc5fc0c7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:03.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.422+0000 7fc5f1ffb640 1 --2- 172.21.15.60:0/3953361071 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5fc0732d0 0x7fc5fc1fbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:03.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.422+0000 7fc5f1ffb640 1 --2- 172.21.15.60:0/3953361071 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5fc1fba80 0x7fc5fc153ab0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:03.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.422+0000 7fc5f1ffb640 1 -- 172.21.15.60:0/3953361071 >> 172.21.15.60:0/3953361071 conn(0x7fc5fc0c4e30 msgr2=0x7fc5fc14c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:03.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.425+0000 7fc5f1ffb640 1 -- 172.21.15.60:0/3953361071 shutdown_connections 2024-09-12T02:37:03.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.430+0000 7fc5f1ffb640 1 -- 172.21.15.60:0/3953361071 wait complete. 2024-09-12T02:37:03.453 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-12T02:37:03.453 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-12T02:37:03.453 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-12T02:37:03.453 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-12T02:37:03.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.645+0000 7fa31359e640 1 Processor -- start 2024-09-12T02:37:03.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.645+0000 7fa31359e640 1 -- start start 2024-09-12T02:37:03.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.664+0000 7fa31359e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3140c6500 0x7fa3141574f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:03.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.664+0000 7fa31359e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa31406bbe0 0x7fa31406c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:03.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.664+0000 7fa31359e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa314156350 con 0x7fa314153650 2024-09-12T02:37:03.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.664+0000 7fa31359e640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fa31406c8e0 con 0x7fa31406bbe0 2024-09-12T02:37:03.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.664+0000 7fa31359e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa3140c83d0 con 0x7fa3140c6500 2024-09-12T02:37:03.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.665+0000 7fa312d9d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa31406bbe0 0x7fa31406c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:03.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.666+0000 7fa312d9d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa31406bbe0 0x7fa31406c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37248/0 (socket says 172.21.15.60:37248) 2024-09-12T02:37:03.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.666+0000 7fa312d9d640 1 -- 172.21.15.60:0/804727496 learned_addr learned my addr 172.21.15.60:0/804727496 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:37:03.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.666+0000 7fa311d9b640 1 --2- 172.21.15.60:0/804727496 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3140c6500 0x7fa3141574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:03.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.666+0000 7fa312d9d640 1 -- 172.21.15.60:0/804727496 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3140c6500 msgr2=0x7fa3141574f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:03.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.666+0000 7fa312d9d640 1 --2- 172.21.15.60:0/804727496 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3140c6500 0x7fa3141574f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:03.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.666+0000 7fa312d9d640 1 -- 172.21.15.60:0/804727496 >> v1:172.21.15.60:6789/0 conn(0x7fa314153650 legacy=0x7fa3140c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:03.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.666+0000 7fa312d9d640 1 -- 172.21.15.60:0/804727496 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3140c6f00 con 0x7fa31406bbe0 2024-09-12T02:37:03.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.668+0000 7fa312d9d640 1 --2- 172.21.15.60:0/804727496 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa31406bbe0 0x7fa31406c090 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa304009ad0 tx=0x7fa30402a490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee836bb2321cfe3e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:03.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.669+0000 7fa31159a640 1 -- 172.21.15.60:0/804727496 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa304036070 con 0x7fa31406bbe0 2024-09-12T02:37:03.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.669+0000 7fa31159a640 1 -- 172.21.15.60:0/804727496 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa304031600 con 0x7fa31406bbe0 2024-09-12T02:37:03.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.670+0000 7fa31359e640 1 -- 172.21.15.60:0/804727496 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa31406bbe0 msgr2=0x7fa31406c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:03.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.670+0000 7fa31359e640 1 --2- 172.21.15.60:0/804727496 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa31406bbe0 0x7fa31406c090 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa304009ad0 tx=0x7fa30402a490 comp rx=0 tx=0).stop 2024-09-12T02:37:03.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.671+0000 7fa31359e640 1 -- 172.21.15.60:0/804727496 shutdown_connections 2024-09-12T02:37:03.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.671+0000 7fa31359e640 1 --2- 172.21.15.60:0/804727496 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa31406bbe0 0x7fa31406c090 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:03.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.671+0000 7fa31359e640 1 --2- 172.21.15.60:0/804727496 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3140c6500 0x7fa3141574f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:03.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.671+0000 7fa31359e640 1 -- 172.21.15.60:0/804727496 >> 172.21.15.60:0/804727496 conn(0x7fa3140ad8b0 msgr2=0x7fa3140adcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:03.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.671+0000 7fa31359e640 1 -- 172.21.15.60:0/804727496 shutdown_connections 2024-09-12T02:37:03.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.671+0000 7fa31359e640 1 -- 172.21.15.60:0/804727496 wait complete. 2024-09-12T02:37:03.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.673+0000 7fa31359e640 1 Processor -- start 2024-09-12T02:37:03.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.674+0000 7fa31359e640 1 -- start start 2024-09-12T02:37:03.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.675+0000 7fa31359e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa31406bbe0 0x7fa314154760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:03.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.675+0000 7fa31359e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3140c6500 0x7fa3141e3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:03.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.675+0000 7fa31359e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa314153650 0x7fa3141f8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:03.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.675+0000 7fa31359e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa3140c74c0 con 0x7fa3140c6500 2024-09-12T02:37:03.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.675+0000 7fa31359e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa31406d5c0 con 0x7fa314153650 2024-09-12T02:37:03.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.675+0000 7fa31359e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa3140c77a0 con 0x7fa31406bbe0 2024-09-12T02:37:03.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.675+0000 7fa311d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3140c6500 0x7fa3141e3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:03.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.675+0000 7fa311d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3140c6500 0x7fa3141e3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37252/0 (socket says 172.21.15.60:37252) 2024-09-12T02:37:03.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.675+0000 7fa311d9b640 1 -- 172.21.15.60:0/1363476596 learned_addr learned my addr 172.21.15.60:0/1363476596 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:37:03.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.676+0000 7fa311d9b640 1 -- 172.21.15.60:0/1363476596 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa31406bbe0 msgr2=0x7fa314154760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:37:03.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.676+0000 7fa311d9b640 1 --2- 172.21.15.60:0/1363476596 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa31406bbe0 0x7fa314154760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:03.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.676+0000 7fa311d9b640 1 -- 172.21.15.60:0/1363476596 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa314153650 msgr2=0x7fa3141f8730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:37:03.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.676+0000 7fa311d9b640 1 --2- 172.21.15.60:0/1363476596 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa314153650 0x7fa3141f8730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:03.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.676+0000 7fa311d9b640 1 -- 172.21.15.60:0/1363476596 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3140abad0 con 0x7fa3140c6500 2024-09-12T02:37:03.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.676+0000 7fa311d9b640 1 --2- 172.21.15.60:0/1363476596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3140c6500 0x7fa3141e3e60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa30c00a2c0 tx=0x7fa30c00a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:03.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.677+0000 7fa302ffd640 1 -- 172.21.15.60:0/1363476596 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa30c003b90 con 0x7fa3140c6500 2024-09-12T02:37:03.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.677+0000 7fa31359e640 1 -- 172.21.15.60:0/1363476596 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3140cb140 con 0x7fa3140c6500 2024-09-12T02:37:03.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.677+0000 7fa31359e640 1 -- 172.21.15.60:0/1363476596 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3140cb700 con 0x7fa3140c6500 2024-09-12T02:37:03.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.681+0000 7fa302ffd640 1 -- 172.21.15.60:0/1363476596 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa30c003d30 con 0x7fa3140c6500 2024-09-12T02:37:03.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.681+0000 7fa302ffd640 1 -- 172.21.15.60:0/1363476596 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa30c004270 con 0x7fa3140c6500 2024-09-12T02:37:03.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.681+0000 7fa302ffd640 1 -- 172.21.15.60:0/1363476596 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa30c004490 con 0x7fa3140c6500 2024-09-12T02:37:03.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.684+0000 7fa302ffd640 1 --2- 172.21.15.60:0/1363476596 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa2f406bf30 0x7fa2f406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:03.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.684+0000 7fa302ffd640 1 -- 172.21.15.60:0/1363476596 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fa30c08bd60 con 0x7fa3140c6500 2024-09-12T02:37:03.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.685+0000 7fa300ff9640 1 --2- 172.21.15.60:0/1363476596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2f8002a70 0x7fa2f8004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:03.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.685+0000 7fa300ff9640 1 -- 172.21.15.60:0/1363476596 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f8007ec0 con 0x7fa2f8002a70 2024-09-12T02:37:03.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.686+0000 7fa31259c640 1 --2- 172.21.15.60:0/1363476596 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa2f406bf30 0x7fa2f406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:03.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.687+0000 7fa31259c640 1 --2- 172.21.15.60:0/1363476596 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa2f406bf30 0x7fa2f406e3f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa308009620 tx=0x7fa308006b30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:03.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.688+0000 7fa312d9d640 1 --2- 172.21.15.60:0/1363476596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2f8002a70 0x7fa2f8004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:03.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.688+0000 7fa312d9d640 1 -- 172.21.15.60:0/1363476596 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa2f80080c0 con 0x7fa2f8002a70 2024-09-12T02:37:03.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.688+0000 7fa312d9d640 1 --2- 172.21.15.60:0/1363476596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2f8002a70 0x7fa2f8004f30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa314068b60 tx=0x7fa3040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:03.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.689+0000 7fa302ffd640 1 -- 172.21.15.60:0/1363476596 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa304040070 con 0x7fa2f8002a70 2024-09-12T02:37:03.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.689+0000 7fa302ffd640 1 -- 172.21.15.60:0/1363476596 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fa3040307d0 con 0x7fa2f8002a70 2024-09-12T02:37:03.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.689+0000 7fa302ffd640 1 -- 172.21.15.60:0/1363476596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2f8002a70 msgr2=0x7fa2f8004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:03.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.689+0000 7fa302ffd640 1 --2- 172.21.15.60:0/1363476596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2f8002a70 0x7fa2f8004f30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa314068b60 tx=0x7fa3040046c0 comp rx=0 tx=0).stop 2024-09-12T02:37:03.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.690+0000 7fa302ffd640 1 -- 172.21.15.60:0/1363476596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2f8002a70 msgr2=0x7fa2f8004f30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:37:03.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.690+0000 7fa302ffd640 1 --2- 172.21.15.60:0/1363476596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2f8002a70 0x7fa2f8004f30 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:03.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.716+0000 7fa300ff9640 1 --2- 172.21.15.60:0/1363476596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2f8006ee0 0x7fa2f8007370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:03.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.717+0000 7fa300ff9640 1 -- 172.21.15.60:0/1363476596 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f800a4a0 con 0x7fa2f8006ee0 2024-09-12T02:37:03.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.717+0000 7fa312d9d640 1 --2- 172.21.15.60:0/1363476596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2f8006ee0 0x7fa2f8007370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:03.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.718+0000 7fa312d9d640 1 -- 172.21.15.60:0/1363476596 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa2f80078b0 con 0x7fa2f8006ee0 2024-09-12T02:37:03.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.718+0000 7fa312d9d640 1 --2- 172.21.15.60:0/1363476596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2f8006ee0 0x7fa2f8007370 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa304009ad0 tx=0x7fa304009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:03.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.720+0000 7fa302ffd640 1 -- 172.21.15.60:0/1363476596 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa304036040 con 0x7fa2f8006ee0 2024-09-12T02:37:03.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.720+0000 7fa302ffd640 1 -- 172.21.15.60:0/1363476596 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4552 (secure 0 0 0) 0x7fa304003b20 con 0x7fa2f8006ee0 2024-09-12T02:37:03.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.720+0000 7fa302ffd640 1 -- 172.21.15.60:0/1363476596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2f8006ee0 msgr2=0x7fa2f8007370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:03.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.720+0000 7fa302ffd640 1 --2- 172.21.15.60:0/1363476596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2f8006ee0 0x7fa2f8007370 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa304009ad0 tx=0x7fa304009240 comp rx=0 tx=0).stop 2024-09-12T02:37:03.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.721+0000 7fa302ffd640 1 -- 172.21.15.60:0/1363476596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2f8006ee0 msgr2=0x7fa2f8007370 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:37:03.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.721+0000 7fa302ffd640 1 --2- 172.21.15.60:0/1363476596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2f8006ee0 0x7fa2f8007370 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:03.725 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:37:03.725 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:37:03.725 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:37:03.725 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:37:03.725 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 136, 2024-09-12T02:37:03.725 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 38807, 2024-09-12T02:37:03.725 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:37:03.725 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:37:03.725 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:37:03.726 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:37:03.726 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:03.726 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 13, 2024-09-12T02:37:03.726 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:37:03.726 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:37:03.726 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:37:03.726 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:37:03.726 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:37:03.726 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:37:03.726 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:37:03.726 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:37:03.726 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:37:03.726 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:37:03.726 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:37:03.726 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:37:03.727 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:37:03.727 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:37:03.727 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:03.727 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:37:03.727 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:37:03.727 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:37:03.727 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:37:03.727 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:37:03.727 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:37:03.727 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:37:03.727 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:37:03.727 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:37:03.727 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:37:03.727 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:37:03.728 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:37:03.728 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:37:03.728 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:03.728 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:03.728 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:37:03.728 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:37:03.728 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:37:03.728 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:37:03.728 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:37:03.728 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:37:03.728 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:37:03.728 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:37:03.728 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:37:03.729 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:37:03.729 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:37:03.729 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:37:03.729 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:37:03.729 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:37:03.729 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:37:03.729 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:37:03.729 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:37:03.729 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:37:03.729 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:37:03.729 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:37:03.729 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:37:03.730 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:37:03.730 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:37:03.730 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:37:03.730 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:37:03.730 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:37:03.730 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:37:03.730 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:37:03.730 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:03.730 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:37:03.730 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:03.730 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:37:03.730 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:03.730 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:37:03.731 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:37:03.731 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:37:03.731 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:37:03.731 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:03.731 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:37:03.731 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:37:03.731 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:03.731 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:03.731 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:03.731 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:37:03.731 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:37:03.731 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:03.731 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:03.731 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:03.731 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:03.732 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:37:03.732 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:37:03.732 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:37:03.732 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:37:03.732 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:37:03.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:03.732 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:03.732 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:37:03.732 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:37:03.732 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:37:03.732 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:37:03.732 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:03.733 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:37:03.733 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:37:03.733 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:03.733 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:03.733 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:03.733 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:37:03.733 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:37:03.733 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:03.733 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:03.733 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:03.733 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:03.733 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:37:03.733 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:37:03.734 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:37:03.734 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:37:03.734 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:37:03.734 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:03.734 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:03.734 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:37:03.734 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:37:03.734 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:37:03.734 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:37:03.734 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:03.734 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:37:03.734 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:37:03.734 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:03.734 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:03.734 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:03.735 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:37:03.735 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:37:03.735 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:03.735 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:03.735 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:03.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:03.735 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:37:03.735 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:37:03.735 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:37:03.735 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:37:03.735 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:37:03.735 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:03.735 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:03.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:03.735 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:37:03.736 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:37:03.736 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:03.736 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:37:03.736 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:37:03.736 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:37:03.736 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:03.736 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:03.736 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:37:03.736 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:03.736 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:37:03.736 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:37:03.736 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:37:03.736 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:03.737 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:03.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:03.737 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:37:03.737 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:37:03.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.729+0000 7fa300ff9640 1 -- 172.21.15.60:0/1363476596 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa2f406bf30 msgr2=0x7fa2f406e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:03.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.729+0000 7fa300ff9640 1 --2- 172.21.15.60:0/1363476596 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa2f406bf30 0x7fa2f406e3f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa308009620 tx=0x7fa308006b30 comp rx=0 tx=0).stop 2024-09-12T02:37:03.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.729+0000 7fa300ff9640 1 -- 172.21.15.60:0/1363476596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3140c6500 msgr2=0x7fa3141e3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:03.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.729+0000 7fa300ff9640 1 --2- 172.21.15.60:0/1363476596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3140c6500 0x7fa3141e3e60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa30c00a2c0 tx=0x7fa30c00a780 comp rx=0 tx=0).stop 2024-09-12T02:37:03.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.732+0000 7fa312d9d640 1 -- 172.21.15.60:0/1363476596 reap_dead start 2024-09-12T02:37:03.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.732+0000 7fa300ff9640 1 -- 172.21.15.60:0/1363476596 shutdown_connections 2024-09-12T02:37:03.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.732+0000 7fa300ff9640 1 -- 172.21.15.60:0/1363476596 >> 172.21.15.60:0/1363476596 conn(0x7fa3140ad8b0 msgr2=0x7fa314158d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:03.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.735+0000 7fa300ff9640 1 -- 172.21.15.60:0/1363476596 shutdown_connections 2024-09-12T02:37:03.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.735+0000 7fa300ff9640 1 -- 172.21.15.60:0/1363476596 wait complete. 2024-09-12T02:37:03.760 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:37:03.760 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-12T02:37:03.760 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-12T02:37:03.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.962+0000 7f044292f640 1 Processor -- start 2024-09-12T02:37:03.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.962+0000 7f044292f640 1 -- start start 2024-09-12T02:37:03.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.963+0000 7f044292f640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f043c0c27d0 0x7f043c152d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:03.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.963+0000 7f044292f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f043c14fb90 0x7f043c06cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:03.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.963+0000 7f044292f640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f043c0c5fe0 con 0x7f043c14f7b0 2024-09-12T02:37:03.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.963+0000 7f044292f640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f043c152890 con 0x7f043c14fb90 2024-09-12T02:37:03.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.963+0000 7f044292f640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f043c152280 con 0x7f043c0c27d0 2024-09-12T02:37:03.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.963+0000 7f044192d640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f043c14f7b0 0x7f043c0c58d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51094/0 (socket says 172.21.15.60:51094) 2024-09-12T02:37:03.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.963+0000 7f044192d640 1 -- 172.21.15.60:0/3925269883 learned_addr learned my addr 172.21.15.60:0/3925269883 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:37:03.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.964+0000 7f044112c640 1 --2- 172.21.15.60:0/3925269883 >> v2:172.21.15.105:3300/0 conn(0x7f043c0c27d0 0x7f043c152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:03.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.964+0000 7f044212e640 1 --2- 172.21.15.60:0/3925269883 >> v2:172.21.15.60:3300/0 conn(0x7f043c14fb90 0x7f043c06cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:03.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.964+0000 7f044112c640 1 -- 172.21.15.60:0/3925269883 >> v2:172.21.15.60:3300/0 conn(0x7f043c14fb90 msgr2=0x7f043c06cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:03.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.964+0000 7f044112c640 1 --2- 172.21.15.60:0/3925269883 >> v2:172.21.15.60:3300/0 conn(0x7f043c14fb90 0x7f043c06cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:03.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.964+0000 7f044112c640 1 -- 172.21.15.60:0/3925269883 >> v1:172.21.15.60:6789/0 conn(0x7f043c14f7b0 legacy=0x7f043c0c58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:03.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.964+0000 7f044112c640 1 -- 172.21.15.60:0/3925269883 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f043c0c2c60 con 0x7f043c0c27d0 2024-09-12T02:37:03.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.970+0000 7f044112c640 1 --2- 172.21.15.60:0/3925269883 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f043c0c27d0 0x7f043c152d20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f043c0a9730 tx=0x7f043002a450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33db308ca734a69a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:03.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.975+0000 7f044092b640 1 -- 172.21.15.60:0/3925269883 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0430030070 con 0x7f043c0c27d0 2024-09-12T02:37:03.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.975+0000 7f044092b640 1 -- 172.21.15.60:0/3925269883 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0430034600 con 0x7f043c0c27d0 2024-09-12T02:37:03.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.976+0000 7f044292f640 1 -- 172.21.15.60:0/3925269883 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f043c0c27d0 msgr2=0x7f043c152d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:03.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.976+0000 7f044292f640 1 --2- 172.21.15.60:0/3925269883 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f043c0c27d0 0x7f043c152d20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f043c0a9730 tx=0x7f043002a450 comp rx=0 tx=0).stop 2024-09-12T02:37:03.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.976+0000 7f044292f640 1 -- 172.21.15.60:0/3925269883 shutdown_connections 2024-09-12T02:37:03.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.976+0000 7f044292f640 1 --2- 172.21.15.60:0/3925269883 >> v2:172.21.15.60:3300/0 conn(0x7f043c14fb90 0x7f043c06cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:03.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.976+0000 7f044292f640 1 --2- 172.21.15.60:0/3925269883 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f043c0c27d0 0x7f043c152d20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:03.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.976+0000 7f044292f640 1 -- 172.21.15.60:0/3925269883 >> 172.21.15.60:0/3925269883 conn(0x7f043c0a9780 msgr2=0x7f043c0a9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:03.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.979+0000 7f044292f640 1 -- 172.21.15.60:0/3925269883 shutdown_connections 2024-09-12T02:37:03.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.979+0000 7f044292f640 1 -- 172.21.15.60:0/3925269883 wait complete. 2024-09-12T02:37:03.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.981+0000 7f044292f640 1 Processor -- start 2024-09-12T02:37:03.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.985+0000 7f044292f640 1 -- start start 2024-09-12T02:37:03.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.986+0000 7f044292f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f043c14f7b0 0x7f043c154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:03.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.986+0000 7f044292f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f043c14fb90 0x7f043c1eba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:03.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.986+0000 7f044292f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f043c1ebf60 0x7f043c1f8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:03.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.986+0000 7f044292f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f043c0a7210 con 0x7f043c1ebf60 2024-09-12T02:37:03.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.986+0000 7f044292f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f043c0c2f40 con 0x7f043c14f7b0 2024-09-12T02:37:03.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.986+0000 7f044292f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f043c0a7390 con 0x7f043c14fb90 2024-09-12T02:37:03.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.986+0000 7f044212e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f043c1ebf60 0x7f043c1f8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:03.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.986+0000 7f044212e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f043c1ebf60 0x7f043c1f8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37300/0 (socket says 172.21.15.60:37300) 2024-09-12T02:37:03.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.986+0000 7f044212e640 1 -- 172.21.15.60:0/671293832 learned_addr learned my addr 172.21.15.60:0/671293832 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:37:03.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.987+0000 7f044112c640 1 --2- 172.21.15.60:0/671293832 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f043c14fb90 0x7f043c1eba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:03.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.987+0000 7f044212e640 1 -- 172.21.15.60:0/671293832 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f043c14fb90 msgr2=0x7f043c1eba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:03.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.987+0000 7f044212e640 1 --2- 172.21.15.60:0/671293832 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f043c14fb90 0x7f043c1eba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:03.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.987+0000 7f044212e640 1 -- 172.21.15.60:0/671293832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f043c14f7b0 msgr2=0x7f043c154330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:03.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.987+0000 7f044212e640 1 --2- 172.21.15.60:0/671293832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f043c14f7b0 0x7f043c154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:03.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.987+0000 7f044212e640 1 -- 172.21.15.60:0/671293832 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f043c156230 con 0x7f043c1ebf60 2024-09-12T02:37:03.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.987+0000 7f044112c640 1 --2- 172.21.15.60:0/671293832 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f043c14fb90 0x7f043c1eba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:37:03.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.987+0000 7f044212e640 1 --2- 172.21.15.60:0/671293832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f043c1ebf60 0x7f043c1f8870 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0434007850 tx=0x7f0434007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:03.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.991+0000 7f042e7fc640 1 -- 172.21.15.60:0/671293832 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0434003990 con 0x7f043c1ebf60 2024-09-12T02:37:03.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.991+0000 7f044292f640 1 -- 172.21.15.60:0/671293832 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f043c1ee640 con 0x7f043c1ebf60 2024-09-12T02:37:03.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.991+0000 7f044292f640 1 -- 172.21.15.60:0/671293832 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f043c154870 con 0x7f043c1ebf60 2024-09-12T02:37:03.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.994+0000 7f042e7fc640 1 -- 172.21.15.60:0/671293832 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0434003b30 con 0x7f043c1ebf60 2024-09-12T02:37:03.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.994+0000 7f044292f640 1 --2- 172.21.15.60:0/671293832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f043c0c27d0 0x7f043c1f8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:03.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.994+0000 7f044292f640 1 -- 172.21.15.60:0/671293832 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f043c1eeb60 con 0x7f043c0c27d0 2024-09-12T02:37:03.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.997+0000 7f042e7fc640 1 -- 172.21.15.60:0/671293832 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043400d110 con 0x7f043c1ebf60 2024-09-12T02:37:03.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.998+0000 7f044192d640 1 --2- 172.21.15.60:0/671293832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f043c0c27d0 0x7f043c1f8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:04.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.999+0000 7f044192d640 1 -- 172.21.15.60:0/671293832 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f043c0aa270 con 0x7f043c0c27d0 2024-09-12T02:37:04.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:03.999+0000 7f044192d640 1 --2- 172.21.15.60:0/671293832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f043c0c27d0 0x7f043c1f8db0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f043800bd30 tx=0x7f0438009ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:04.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.001+0000 7f042e7fc640 1 -- 172.21.15.60:0/671293832 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f043400d370 con 0x7f043c1ebf60 2024-09-12T02:37:04.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.001+0000 7f042e7fc640 1 --2- 172.21.15.60:0/671293832 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f042006beb0 0x7f042006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:04.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.002+0000 7f044112c640 1 --2- 172.21.15.60:0/671293832 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f042006beb0 0x7f042006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:04.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.003+0000 7f044112c640 1 --2- 172.21.15.60:0/671293832 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f042006beb0 0x7f042006e370 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0430035000 tx=0x7f0430030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:04.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.003+0000 7f042e7fc640 1 -- 172.21.15.60:0/671293832 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043800cdf0 con 0x7f043c0c27d0 2024-09-12T02:37:04.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.003+0000 7f042e7fc640 1 -- 172.21.15.60:0/671293832 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f043408bca0 con 0x7f043c1ebf60 2024-09-12T02:37:04.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.003+0000 7f042e7fc640 1 -- 172.21.15.60:0/671293832 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f0438010070 con 0x7f043c0c27d0 2024-09-12T02:37:04.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.004+0000 7f042e7fc640 1 -- 172.21.15.60:0/671293832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f043c0c27d0 msgr2=0x7f043c1f8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:04.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.004+0000 7f042e7fc640 1 --2- 172.21.15.60:0/671293832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f043c0c27d0 0x7f043c1f8db0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f043800bd30 tx=0x7f0438009ef0 comp rx=0 tx=0).stop 2024-09-12T02:37:04.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.004+0000 7f042e7fc640 1 -- 172.21.15.60:0/671293832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f043c0c27d0 msgr2=0x7f043c1f8db0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:37:04.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.004+0000 7f042e7fc640 1 --2- 172.21.15.60:0/671293832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f043c0c27d0 0x7f043c1f8db0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:04.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.035+0000 7f044292f640 1 --2- 172.21.15.60:0/671293832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f043c1f92f0 0x7f043c1fbd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:04.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.035+0000 7f044292f640 1 -- 172.21.15.60:0/671293832 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f043c151ed0 con 0x7f043c1f92f0 2024-09-12T02:37:04.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.036+0000 7f044192d640 1 --2- 172.21.15.60:0/671293832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f043c1f92f0 0x7f043c1fbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:04.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.037+0000 7f044192d640 1 -- 172.21.15.60:0/671293832 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f043c0c23a0 con 0x7f043c1f92f0 2024-09-12T02:37:04.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.039+0000 7f044192d640 1 --2- 172.21.15.60:0/671293832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f043c1f92f0 0x7f043c1fbd00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0438014000 tx=0x7f0438004850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:04.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.041+0000 7f042e7fc640 1 -- 172.21.15.60:0/671293832 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043801bcc0 con 0x7f043c1f92f0 2024-09-12T02:37:04.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.041+0000 7f042e7fc640 1 -- 172.21.15.60:0/671293832 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4884 (secure 0 0 0) 0x7f0438015550 con 0x7f043c1f92f0 2024-09-12T02:37:04.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.041+0000 7f042e7fc640 1 -- 172.21.15.60:0/671293832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f043c1f92f0 msgr2=0x7f043c1fbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:04.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.041+0000 7f042e7fc640 1 --2- 172.21.15.60:0/671293832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f043c1f92f0 0x7f043c1fbd00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0438014000 tx=0x7f0438004850 comp rx=0 tx=0).stop 2024-09-12T02:37:04.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.041+0000 7f042e7fc640 1 -- 172.21.15.60:0/671293832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f043c1f92f0 msgr2=0x7f043c1fbd00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:37:04.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.041+0000 7f042e7fc640 1 --2- 172.21.15.60:0/671293832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f043c1f92f0 0x7f043c1fbd00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:04.044 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:37:04.044 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:37:04.044 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:37:04.044 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:37:04.045 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 136, 2024-09-12T02:37:04.045 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 95618, 2024-09-12T02:37:04.045 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:37:04.045 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:37:04.045 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:37:04.046 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:37:04.046 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:04.046 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 13, 2024-09-12T02:37:04.046 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:37:04.046 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:37:04.046 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:37:04.047 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:37:04.047 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:37:04.047 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:37:04.047 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:37:04.047 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:37:04.048 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:37:04.048 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:37:04.048 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:37:04.048 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:37:04.048 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:37:04.048 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:37:04.049 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:04.049 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:37:04.049 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:37:04.049 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:37:04.049 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:37:04.049 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:37:04.050 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:37:04.050 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:37:04.050 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:37:04.050 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:37:04.050 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:37:04.051 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:37:04.051 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:37:04.051 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:37:04.051 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:04.051 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:04.051 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:37:04.052 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:37:04.052 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:37:04.052 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:37:04.052 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:37:04.052 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:37:04.052 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:37:04.053 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:37:04.053 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:37:04.053 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:37:04.053 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:37:04.053 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:37:04.053 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:37:04.054 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:37:04.054 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:37:04.054 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:37:04.054 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:37:04.054 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:37:04.054 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:37:04.055 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:37:04.055 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:37:04.055 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:37:04.055 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:37:04.055 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:37:04.055 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:37:04.056 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:37:04.056 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:37:04.056 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:37:04.056 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:04.056 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:37:04.057 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:04.057 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:37:04.057 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:04.057 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:37:04.057 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:37:04.058 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:37:04.058 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:37:04.058 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:04.058 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:37:04.058 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:37:04.058 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:04.058 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:04.059 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:04.059 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:37:04.059 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:37:04.059 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:04.059 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:04.059 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:04.059 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:04.060 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:37:04.060 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:37:04.060 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:37:04.060 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:37:04.060 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:37:04.060 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:04.060 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:04.061 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:37:04.061 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:37:04.061 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:37:04.061 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:37:04.061 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:04.061 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:37:04.061 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:37:04.061 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:04.061 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:04.061 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:04.061 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:37:04.061 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:37:04.061 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:04.062 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:04.062 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:04.062 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:04.062 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:37:04.062 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:37:04.062 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:37:04.062 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:37:04.062 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:37:04.062 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:04.062 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:04.062 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:37:04.062 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:37:04.062 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:37:04.062 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:37:04.063 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:04.063 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:37:04.063 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:37:04.063 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:04.063 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:04.063 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:04.063 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:37:04.063 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:37:04.063 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:04.063 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:04.063 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:04.063 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:04.063 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:37:04.063 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:37:04.063 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:37:04.064 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:37:04.064 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:37:04.064 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:04.064 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:04.064 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:04.064 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:37:04.064 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:37:04.064 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:04.064 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:37:04.064 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:37:04.064 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:37:04.064 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:04.064 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:04.065 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:37:04.065 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:04.065 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:37:04.065 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:37:04.065 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:37:04.065 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:04.065 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:04.065 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:37:04.065 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:04.065 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:37:04.065 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:37:04.065 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:37:04.065 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:04.066 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:04.066 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:37:04.066 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:04.066 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:37:04.066 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:37:04.066 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:37:04.066 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:04.066 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:04.066 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:04.066 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:37:04.066 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:37:04.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.043+0000 7f044292f640 1 -- 172.21.15.60:0/671293832 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f042006beb0 msgr2=0x7f042006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:04.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.043+0000 7f044292f640 1 --2- 172.21.15.60:0/671293832 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f042006beb0 0x7f042006e370 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0430035000 tx=0x7f0430030000 comp rx=0 tx=0).stop 2024-09-12T02:37:04.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.043+0000 7f044292f640 1 -- 172.21.15.60:0/671293832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f043c1ebf60 msgr2=0x7f043c1f8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:04.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.043+0000 7f044292f640 1 --2- 172.21.15.60:0/671293832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f043c1ebf60 0x7f043c1f8870 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0434007850 tx=0x7f0434007d10 comp rx=0 tx=0).stop 2024-09-12T02:37:04.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.043+0000 7f044212e640 1 -- 172.21.15.60:0/671293832 reap_dead start 2024-09-12T02:37:04.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.043+0000 7f044212e640 1 -- 172.21.15.60:0/671293832 reap_dead start 2024-09-12T02:37:04.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.046+0000 7f044292f640 1 -- 172.21.15.60:0/671293832 shutdown_connections 2024-09-12T02:37:04.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.046+0000 7f044292f640 1 -- 172.21.15.60:0/671293832 >> 172.21.15.60:0/671293832 conn(0x7f043c0a9780 msgr2=0x7f043c06d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:04.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.048+0000 7f044292f640 1 -- 172.21.15.60:0/671293832 shutdown_connections 2024-09-12T02:37:04.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.048+0000 7f044292f640 1 -- 172.21.15.60:0/671293832 wait complete. 2024-09-12T02:37:04.076 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:37:04.076 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-12T02:37:04.076 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-12T02:37:04.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.258+0000 7fea6279f640 1 Processor -- start 2024-09-12T02:37:04.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.258+0000 7fea6279f640 1 -- start start 2024-09-12T02:37:04.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.259+0000 7fea6279f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fea5c0c24e0 0x7fea5c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:04.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.259+0000 7fea6279f640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea5c0c6430 con 0x7fea5c15dca0 2024-09-12T02:37:04.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.259+0000 7fea6279f640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea5c0c6710 con 0x7fea5c157e80 2024-09-12T02:37:04.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.259+0000 7fea6279f640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fea5c0c61e0 con 0x7fea5c0c24e0 2024-09-12T02:37:04.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.259+0000 7fea60d3c640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fea5c15dca0 0x7fea5c15e110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51106/0 (socket says 172.21.15.60:51106) 2024-09-12T02:37:04.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.260+0000 7fea60d3c640 1 -- 172.21.15.60:0/952906521 learned_addr learned my addr 172.21.15.60:0/952906521 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:37:04.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.260+0000 7fea5b7fe640 1 --2- 172.21.15.60:0/952906521 >> v2:172.21.15.60:3300/0 conn(0x7fea5c0c24e0 0x7fea5c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:04.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.260+0000 7fea5b7fe640 1 -- 172.21.15.60:0/952906521 >> v1:172.21.15.105:6789/0 conn(0x7fea5c157e80 legacy=0x7fea5c06cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:04.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.261+0000 7fea5b7fe640 1 -- 172.21.15.60:0/952906521 >> v1:172.21.15.60:6789/0 conn(0x7fea5c15dca0 legacy=0x7fea5c15e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:04.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.261+0000 7fea5b7fe640 1 -- 172.21.15.60:0/952906521 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea5c0c6f10 con 0x7fea5c0c24e0 2024-09-12T02:37:04.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.267+0000 7fea5b7fe640 1 --2- 172.21.15.60:0/952906521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea5c0c24e0 0x7fea5c06d300 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fea500097a0 tx=0x7fea5002a120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8b63749a2faaaa5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:04.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.269+0000 7fea5affd640 1 -- 172.21.15.60:0/952906521 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea50037070 con 0x7fea5c0c24e0 2024-09-12T02:37:04.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.269+0000 7fea5affd640 1 -- 172.21.15.60:0/952906521 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea5002adb0 con 0x7fea5c0c24e0 2024-09-12T02:37:04.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.270+0000 7fea6279f640 1 -- 172.21.15.60:0/952906521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea5c0c24e0 msgr2=0x7fea5c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:04.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.270+0000 7fea5affd640 1 -- 172.21.15.60:0/952906521 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea50037070 con 0x7fea5c0c24e0 2024-09-12T02:37:04.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.270+0000 7fea6279f640 1 --2- 172.21.15.60:0/952906521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea5c0c24e0 0x7fea5c06d300 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fea500097a0 tx=0x7fea5002a120 comp rx=0 tx=0).stop 2024-09-12T02:37:04.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.270+0000 7fea6279f640 1 -- 172.21.15.60:0/952906521 shutdown_connections 2024-09-12T02:37:04.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.270+0000 7fea6279f640 1 --2- 172.21.15.60:0/952906521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea5c0c24e0 0x7fea5c06d300 secure :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fea500097a0 tx=0x7fea5002a120 comp rx=0 tx=0).stop 2024-09-12T02:37:04.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.270+0000 7fea6279f640 1 -- 172.21.15.60:0/952906521 >> 172.21.15.60:0/952906521 conn(0x7fea5c0a9680 msgr2=0x7fea5c0a9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:04.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.271+0000 7fea6279f640 1 -- 172.21.15.60:0/952906521 shutdown_connections 2024-09-12T02:37:04.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.271+0000 7fea6279f640 1 -- 172.21.15.60:0/952906521 wait complete. 2024-09-12T02:37:04.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.272+0000 7fea6279f640 1 Processor -- start 2024-09-12T02:37:04.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.273+0000 7fea6279f640 1 -- start start 2024-09-12T02:37:04.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.274+0000 7fea6279f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea5c157e80 0x7fea5c0aa770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:04.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.274+0000 7fea6279f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea5c15dca0 0x7fea5c1e60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:04.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.274+0000 7fea6279f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea5c15af50 0x7fea5c1585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:04.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.274+0000 7fea6279f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fea5c0c2920 con 0x7fea5c157e80 2024-09-12T02:37:04.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.274+0000 7fea6279f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fea5c0c7280 con 0x7fea5c15dca0 2024-09-12T02:37:04.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.274+0000 7fea6279f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fea5c06d840 con 0x7fea5c15af50 2024-09-12T02:37:04.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.278+0000 7fea60d3c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea5c15af50 0x7fea5c1585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:04.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.278+0000 7fea5bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea5c157e80 0x7fea5c0aa770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:04.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.278+0000 7fea5bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea5c157e80 0x7fea5c0aa770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37326/0 (socket says 172.21.15.60:37326) 2024-09-12T02:37:04.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.278+0000 7fea5bfff640 1 -- 172.21.15.60:0/522866502 learned_addr learned my addr 172.21.15.60:0/522866502 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:37:04.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.279+0000 7fea5bfff640 1 -- 172.21.15.60:0/522866502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea5c15af50 msgr2=0x7fea5c1585a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:04.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.280+0000 7fea5bfff640 1 --2- 172.21.15.60:0/522866502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea5c15af50 0x7fea5c1585a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:04.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.280+0000 7fea5bfff640 1 -- 172.21.15.60:0/522866502 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea5c15dca0 msgr2=0x7fea5c1e60f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:37:04.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.280+0000 7fea5bfff640 1 --2- 172.21.15.60:0/522866502 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea5c15dca0 0x7fea5c1e60f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:04.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.280+0000 7fea5bfff640 1 -- 172.21.15.60:0/522866502 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea5c0ad200 con 0x7fea5c157e80 2024-09-12T02:37:04.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.280+0000 7fea60d3c640 1 --2- 172.21.15.60:0/522866502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea5c15af50 0x7fea5c1585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:37:04.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.281+0000 7fea5bfff640 1 --2- 172.21.15.60:0/522866502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea5c157e80 0x7fea5c0aa770 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fea4c00c780 tx=0x7fea4c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:04.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.281+0000 7fea58ff9640 1 -- 172.21.15.60:0/522866502 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea4c0052d0 con 0x7fea5c157e80 2024-09-12T02:37:04.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.282+0000 7fea6279f640 1 -- 172.21.15.60:0/522866502 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea5c1f45e0 con 0x7fea5c157e80 2024-09-12T02:37:04.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.282+0000 7fea6279f640 1 -- 172.21.15.60:0/522866502 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea5c15a750 con 0x7fea5c157e80 2024-09-12T02:37:04.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.283+0000 7fea58ff9640 1 -- 172.21.15.60:0/522866502 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea4c005470 con 0x7fea5c157e80 2024-09-12T02:37:04.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.284+0000 7fea58ff9640 1 -- 172.21.15.60:0/522866502 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea4c00a880 con 0x7fea5c157e80 2024-09-12T02:37:04.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.285+0000 7fea58ff9640 1 -- 172.21.15.60:0/522866502 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fea4c00aa20 con 0x7fea5c157e80 2024-09-12T02:37:04.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.286+0000 7fea58ff9640 1 --2- 172.21.15.60:0/522866502 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fea4806bf00 0x7fea4806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:04.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.286+0000 7fea58ff9640 1 -- 172.21.15.60:0/522866502 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fea4c08ad00 con 0x7fea5c157e80 2024-09-12T02:37:04.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.287+0000 7fea5b7fe640 1 --2- 172.21.15.60:0/522866502 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fea4806bf00 0x7fea4806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:04.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.287+0000 7fea6279f640 1 --2- 172.21.15.60:0/522866502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea5c15b330 0x7fea5c158ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:04.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.287+0000 7fea6279f640 1 -- 172.21.15.60:0/522866502 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fea5c068b50 con 0x7fea5c15b330 2024-09-12T02:37:04.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.287+0000 7fea60d3c640 1 --2- 172.21.15.60:0/522866502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea5c15b330 0x7fea5c158ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:04.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.290+0000 7fea5b7fe640 1 --2- 172.21.15.60:0/522866502 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fea4806bf00 0x7fea4806e3c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fea50034000 tx=0x7fea5002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:04.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.296+0000 7fea60d3c640 1 -- 172.21.15.60:0/522866502 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fea5c1f4390 con 0x7fea5c15b330 2024-09-12T02:37:04.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.296+0000 7fea60d3c640 1 --2- 172.21.15.60:0/522866502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea5c15b330 0x7fea5c158ae0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fea54007970 tx=0x7fea5400f5a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:04.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.297+0000 7fea58ff9640 1 -- 172.21.15.60:0/522866502 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea540133f0 con 0x7fea5c15b330 2024-09-12T02:37:04.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.297+0000 7fea58ff9640 1 -- 172.21.15.60:0/522866502 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fea54018070 con 0x7fea5c15b330 2024-09-12T02:37:04.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.297+0000 7fea58ff9640 1 -- 172.21.15.60:0/522866502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea5c15b330 msgr2=0x7fea5c158ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:04.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.297+0000 7fea58ff9640 1 --2- 172.21.15.60:0/522866502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea5c15b330 0x7fea5c158ae0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fea54007970 tx=0x7fea5400f5a0 comp rx=0 tx=0).stop 2024-09-12T02:37:04.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.298+0000 7fea58ff9640 1 -- 172.21.15.60:0/522866502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea5c15b330 msgr2=0x7fea5c158ae0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:37:04.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.298+0000 7fea58ff9640 1 --2- 172.21.15.60:0/522866502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea5c15b330 0x7fea5c158ae0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:04.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.326+0000 7fea6279f640 1 --2- 172.21.15.60:0/522866502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea5c159020 0x7fea5c1e3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:04.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.326+0000 7fea6279f640 1 -- 172.21.15.60:0/522866502 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fea5c1f48c0 con 0x7fea5c159020 2024-09-12T02:37:04.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.328+0000 7fea60d3c640 1 --2- 172.21.15.60:0/522866502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea5c159020 0x7fea5c1e3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:04.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.332+0000 7fea60d3c640 1 -- 172.21.15.60:0/522866502 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fea5c159400 con 0x7fea5c159020 2024-09-12T02:37:04.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.333+0000 7fea60d3c640 1 --2- 172.21.15.60:0/522866502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea5c159020 0x7fea5c1e3cb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fea54007970 tx=0x7fea54001250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:04.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.333+0000 7fea58ff9640 1 -- 172.21.15.60:0/522866502 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea54013c90 con 0x7fea5c159020 2024-09-12T02:37:04.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.335+0000 7fea58ff9640 1 -- 172.21.15.60:0/522866502 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5052 (secure 0 0 0) 0x7fea54013c90 con 0x7fea5c159020 2024-09-12T02:37:04.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.335+0000 7fea58ff9640 1 -- 172.21.15.60:0/522866502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea5c159020 msgr2=0x7fea5c1e3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:04.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.335+0000 7fea58ff9640 1 --2- 172.21.15.60:0/522866502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea5c159020 0x7fea5c1e3cb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fea54007970 tx=0x7fea54001250 comp rx=0 tx=0).stop 2024-09-12T02:37:04.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.335+0000 7fea58ff9640 1 -- 172.21.15.60:0/522866502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea5c159020 msgr2=0x7fea5c1e3cb0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:37:04.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.335+0000 7fea58ff9640 1 --2- 172.21.15.60:0/522866502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea5c159020 0x7fea5c1e3cb0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:04.338 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:37:04.338 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:37:04.338 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:37:04.338 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:37:04.338 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 136, 2024-09-12T02:37:04.339 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 298088, 2024-09-12T02:37:04.339 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:37:04.339 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:37:04.339 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:37:04.339 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:37:04.339 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:04.339 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 13, 2024-09-12T02:37:04.339 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:37:04.339 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:37:04.339 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:37:04.339 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:37:04.339 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:37:04.339 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:37:04.340 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:37:04.340 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:37:04.340 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:37:04.340 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:37:04.340 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:37:04.340 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:37:04.340 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:37:04.340 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:37:04.340 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:04.340 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:37:04.340 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:37:04.340 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:37:04.340 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:37:04.340 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:37:04.341 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:37:04.341 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:37:04.341 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:37:04.341 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:37:04.341 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:37:04.341 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:37:04.341 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:37:04.341 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:37:04.341 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:04.341 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:04.341 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:37:04.341 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:37:04.341 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:37:04.342 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:37:04.342 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:37:04.342 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:37:04.342 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:37:04.342 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:37:04.342 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:37:04.342 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:37:04.342 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:37:04.342 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:37:04.342 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:37:04.342 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:37:04.342 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:37:04.342 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:37:04.342 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:37:04.343 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:37:04.343 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:37:04.343 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:37:04.343 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:37:04.343 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:37:04.343 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:37:04.343 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:37:04.343 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:37:04.343 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:37:04.343 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:37:04.343 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:37:04.343 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:04.343 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:37:04.344 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:04.344 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:37:04.344 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:04.344 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:37:04.344 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:37:04.344 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:37:04.344 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:37:04.344 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:04.344 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:37:04.344 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:37:04.344 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:04.344 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:04.345 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:04.345 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:37:04.345 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:37:04.345 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:04.345 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:04.345 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:04.345 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:04.345 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:37:04.345 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:37:04.345 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:37:04.346 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:37:04.346 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:37:04.346 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:04.346 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:04.346 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:37:04.346 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:37:04.346 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:37:04.346 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:37:04.346 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:04.346 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:37:04.346 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:37:04.346 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:04.346 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:04.346 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:04.347 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:37:04.347 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:37:04.347 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:04.347 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:04.347 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:04.347 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:04.347 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:37:04.347 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:37:04.347 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:37:04.348 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:37:04.348 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:37:04.348 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:04.348 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:04.348 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:37:04.348 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:37:04.348 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:37:04.348 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:37:04.348 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:04.348 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:37:04.349 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:37:04.349 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:04.349 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:04.349 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:04.349 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:37:04.349 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:37:04.349 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:04.349 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:04.349 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:04.349 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:04.349 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:37:04.349 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:37:04.350 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:37:04.350 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:37:04.350 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:37:04.350 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:04.350 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:04.350 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:04.350 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:37:04.350 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:37:04.350 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:04.350 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:37:04.350 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:37:04.350 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:37:04.350 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:04.350 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:04.351 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:37:04.351 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:04.351 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:37:04.351 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:37:04.351 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:37:04.351 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:04.351 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:04.351 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:37:04.351 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:04.351 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:37:04.351 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:37:04.351 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-09-12T02:37:04.352 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:04.352 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:04.352 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:37:04.352 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:04.352 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:37:04.352 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:37:04.352 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-09-12T02:37:04.352 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:04.352 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:04.352 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:37:04.352 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:04.352 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:37:04.352 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:37:04.353 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:37:04.353 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:04.353 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:04.353 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:04.353 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:37:04.353 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:37:04.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.344+0000 7fea6279f640 1 -- 172.21.15.60:0/522866502 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fea4806bf00 msgr2=0x7fea4806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:04.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.344+0000 7fea6279f640 1 --2- 172.21.15.60:0/522866502 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fea4806bf00 0x7fea4806e3c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fea50034000 tx=0x7fea5002e000 comp rx=0 tx=0).stop 2024-09-12T02:37:04.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.344+0000 7fea6279f640 1 -- 172.21.15.60:0/522866502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea5c157e80 msgr2=0x7fea5c0aa770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:04.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.344+0000 7fea6279f640 1 --2- 172.21.15.60:0/522866502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea5c157e80 0x7fea5c0aa770 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fea4c00c780 tx=0x7fea4c00cc40 comp rx=0 tx=0).stop 2024-09-12T02:37:04.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.347+0000 7fea60d3c640 1 -- 172.21.15.60:0/522866502 reap_dead start 2024-09-12T02:37:04.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.347+0000 7fea6279f640 1 -- 172.21.15.60:0/522866502 shutdown_connections 2024-09-12T02:37:04.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.347+0000 7fea6279f640 1 -- 172.21.15.60:0/522866502 >> 172.21.15.60:0/522866502 conn(0x7fea5c0a9680 msgr2=0x7fea5c0c56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:04.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.348+0000 7fea6279f640 1 -- 172.21.15.60:0/522866502 shutdown_connections 2024-09-12T02:37:04.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.352+0000 7fea6279f640 1 -- 172.21.15.60:0/522866502 wait complete. 2024-09-12T02:37:04.379 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:37:04.380 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-09-12T02:37:04.380 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-12T02:37:04.380 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-09-12T02:37:04.380 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-12T02:37:04.380 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T02:37:04.380 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:37:04.400 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T02:37:04.400 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-12T02:37:04.400 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:37:04.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.657+0000 7f7a3ffff640 1 Processor -- start 2024-09-12T02:37:04.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.657+0000 7f7a3ffff640 1 -- start start 2024-09-12T02:37:04.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.658+0000 7f7a3ffff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a4015b300 0x7f7a4006ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:04.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.658+0000 7f7a3ffff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7a4006f210 0x7f7a400be960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:04.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.659+0000 7f7a3ffff640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a4015a7b0 con 0x7f7a4006e780 2024-09-12T02:37:04.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.659+0000 7f7a3ffff640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f7a40158470 con 0x7f7a4006f210 2024-09-12T02:37:04.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.659+0000 7f7a3ffff640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7a400bf440 con 0x7f7a4015b300 2024-09-12T02:37:04.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.659+0000 7f7a3e7fc640 1 -- >> v1:172.21.15.60:6789/0 conn(0x7f7a4006e780 legacy=0x7f7a400be250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:37:04.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.659+0000 7f7a3f7fe640 1 -- >> v2:172.21.15.60:3300/0 conn(0x7f7a4006f210 msgr2=0x7f7a400be960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:37:04.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.659+0000 7f7a3f7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7a4006f210 0x7f7a400be960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:37:04.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.663+0000 7f7a3effd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a4015b300 0x7f7a4006ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:04.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.663+0000 7f7a3effd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a4015b300 0x7f7a4006ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:49328/0 (socket says 172.21.15.60:49328) 2024-09-12T02:37:04.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.663+0000 7f7a3effd640 1 -- 172.21.15.60:0/2185161782 learned_addr learned my addr 172.21.15.60:0/2185161782 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:37:04.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.665+0000 7f7a3effd640 1 -- 172.21.15.60:0/2185161782 >> v2:172.21.15.60:3300/0 conn(0x7f7a4006f210 msgr2=0x7f7a400be960 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:37:04.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.665+0000 7f7a3effd640 1 --2- 172.21.15.60:0/2185161782 >> v2:172.21.15.60:3300/0 conn(0x7f7a4006f210 0x7f7a400be960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:04.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.665+0000 7f7a3effd640 1 -- 172.21.15.60:0/2185161782 >> v1:172.21.15.60:6789/0 conn(0x7f7a4006e780 legacy=0x7f7a400be250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:37:04.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.665+0000 7f7a3effd640 1 -- 172.21.15.60:0/2185161782 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a400bf180 con 0x7f7a4015b300 2024-09-12T02:37:04.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.667+0000 7f7a3effd640 1 --2- 172.21.15.60:0/2185161782 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a4015b300 0x7f7a4006ecd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7a300098a0 tx=0x7f7a3002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f5a4bdf04ef17fc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:04.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.668+0000 7f7a3dffb640 1 -- 172.21.15.60:0/2185161782 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a30037070 con 0x7f7a4015b300 2024-09-12T02:37:04.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.668+0000 7f7a3dffb640 1 -- 172.21.15.60:0/2185161782 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a30032440 con 0x7f7a4015b300 2024-09-12T02:37:04.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.668+0000 7f7a3dffb640 1 -- 172.21.15.60:0/2185161782 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a30032810 con 0x7f7a4015b300 2024-09-12T02:37:04.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.669+0000 7f7a3ffff640 1 -- 172.21.15.60:0/2185161782 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a4015b300 msgr2=0x7f7a4006ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:04.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.669+0000 7f7a3ffff640 1 --2- 172.21.15.60:0/2185161782 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a4015b300 0x7f7a4006ecd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7a300098a0 tx=0x7f7a3002a1c0 comp rx=0 tx=0).stop 2024-09-12T02:37:04.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.670+0000 7f7a3ffff640 1 -- 172.21.15.60:0/2185161782 shutdown_connections 2024-09-12T02:37:04.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.670+0000 7f7a3ffff640 1 --2- 172.21.15.60:0/2185161782 >> v2:172.21.15.60:3300/0 conn(0x7f7a4006f210 0x7f7a400be960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:04.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.670+0000 7f7a3ffff640 1 --2- 172.21.15.60:0/2185161782 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a4015b300 0x7f7a4006ecd0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:04.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.670+0000 7f7a3ffff640 1 -- 172.21.15.60:0/2185161782 >> 172.21.15.60:0/2185161782 conn(0x7f7a400c8250 msgr2=0x7f7a400c8630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:04.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.670+0000 7f7a3ffff640 1 -- 172.21.15.60:0/2185161782 shutdown_connections 2024-09-12T02:37:04.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.670+0000 7f7a3ffff640 1 -- 172.21.15.60:0/2185161782 wait complete. 2024-09-12T02:37:04.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.672+0000 7f7a3ffff640 1 Processor -- start 2024-09-12T02:37:04.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.672+0000 7f7a3ffff640 1 -- start start 2024-09-12T02:37:04.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.673+0000 7f7a3ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a4006e780 0x7f7a401f3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:04.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.673+0000 7f7a3ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a4006f210 0x7f7a40153350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:04.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.673+0000 7f7a3ffff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a4015b300 0x7f7a40153890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:04.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.673+0000 7f7a3ffff640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7a400c2dd0 con 0x7f7a4006f210 2024-09-12T02:37:04.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.673+0000 7f7a3ffff640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7a400c34f0 con 0x7f7a4006e780 2024-09-12T02:37:04.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.673+0000 7f7a3ffff640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7a400c30b0 con 0x7f7a4015b300 2024-09-12T02:37:04.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.673+0000 7f7a3e7fc640 1 -- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a4006f210 msgr2=0x7f7a40153350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:37:04.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.673+0000 7f7a3e7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a4006f210 0x7f7a40153350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:37:04.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.674+0000 7f7a3effd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a4006e780 0x7f7a401f3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:04.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.674+0000 7f7a3effd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a4006e780 0x7f7a401f3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:55056/0 (socket says 172.21.15.60:55056) 2024-09-12T02:37:04.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.674+0000 7f7a3effd640 1 -- 172.21.15.60:0/149393983 learned_addr learned my addr 172.21.15.60:0/149393983 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:37:04.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.674+0000 7f7a3f7fe640 1 --2- 172.21.15.60:0/149393983 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a4015b300 0x7f7a40153890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:04.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.674+0000 7f7a3f7fe640 1 -- 172.21.15.60:0/149393983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a4006e780 msgr2=0x7f7a401f3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:04.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.674+0000 7f7a3f7fe640 1 --2- 172.21.15.60:0/149393983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a4006e780 0x7f7a401f3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:04.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.674+0000 7f7a3f7fe640 1 -- 172.21.15.60:0/149393983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a4006f210 msgr2=0x7f7a40153350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:37:04.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.674+0000 7f7a3f7fe640 1 --2- 172.21.15.60:0/149393983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a4006f210 0x7f7a40153350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:04.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.674+0000 7f7a3f7fe640 1 -- 172.21.15.60:0/149393983 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a40151dc0 con 0x7f7a4015b300 2024-09-12T02:37:04.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.675+0000 7f7a3f7fe640 1 --2- 172.21.15.60:0/149393983 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a4015b300 0x7f7a40153890 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7a34003930 tx=0x7f7a3400b870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:04.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.677+0000 7f7a277fe640 1 -- 172.21.15.60:0/149393983 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a34017070 con 0x7f7a4015b300 2024-09-12T02:37:04.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.677+0000 7f7a277fe640 1 -- 172.21.15.60:0/149393983 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a34003dc0 con 0x7f7a4015b300 2024-09-12T02:37:04.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.677+0000 7f7a277fe640 1 -- 172.21.15.60:0/149393983 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a34006310 con 0x7f7a4015b300 2024-09-12T02:37:04.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.677+0000 7f7a3ffff640 1 -- 172.21.15.60:0/149393983 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a401f42c0 con 0x7f7a4015b300 2024-09-12T02:37:04.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.677+0000 7f7a3ffff640 1 -- 172.21.15.60:0/149393983 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a401f3fc0 con 0x7f7a4015b300 2024-09-12T02:37:04.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.680+0000 7f7a257fa640 1 -- 172.21.15.60:0/149393983 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a400c4390 con 0x7f7a4015b300 2024-09-12T02:37:04.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.688+0000 7f7a277fe640 1 -- 172.21.15.60:0/149393983 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7a3401a070 con 0x7f7a4015b300 2024-09-12T02:37:04.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.689+0000 7f7a277fe640 1 --2- 172.21.15.60:0/149393983 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f7a2c06be30 0x7f7a2c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:04.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.694+0000 7f7a277fe640 1 -- 172.21.15.60:0/149393983 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f7a3408ac50 con 0x7f7a4015b300 2024-09-12T02:37:04.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.694+0000 7f7a3effd640 1 --2- 172.21.15.60:0/149393983 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f7a2c06be30 0x7f7a2c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:04.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.695+0000 7f7a277fe640 1 -- 172.21.15.60:0/149393983 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7a340b8df0 con 0x7f7a4015b300 2024-09-12T02:37:04.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:04.695+0000 7f7a3effd640 1 --2- 172.21.15.60:0/149393983 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f7a2c06be30 0x7f7a2c06e2f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7a30009630 tx=0x7f7a3002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:05.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:05.216+0000 7f7a257fa640 1 -- 172.21.15.60:0/149393983 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f7a40075380 con 0x7f7a4015b300 2024-09-12T02:37:05.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:05.219+0000 7f7a277fe640 1 -- 172.21.15.60:0/149393983 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1566 (secure 0 0 0) 0x7f7a340592d0 con 0x7f7a4015b300 2024-09-12T02:37:05.226 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":136,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:37:05.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:05.223+0000 7f7a257fa640 1 -- 172.21.15.60:0/149393983 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f7a2c06be30 msgr2=0x7f7a2c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:05.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:05.223+0000 7f7a257fa640 1 --2- 172.21.15.60:0/149393983 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f7a2c06be30 0x7f7a2c06e2f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7a30009630 tx=0x7f7a3002e000 comp rx=0 tx=0).stop 2024-09-12T02:37:05.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:05.223+0000 7f7a257fa640 1 -- 172.21.15.60:0/149393983 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a4015b300 msgr2=0x7f7a40153890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:05.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:05.223+0000 7f7a257fa640 1 --2- 172.21.15.60:0/149393983 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a4015b300 0x7f7a40153890 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7a34003930 tx=0x7f7a3400b870 comp rx=0 tx=0).stop 2024-09-12T02:37:05.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:05.225+0000 7f7a257fa640 1 -- 172.21.15.60:0/149393983 shutdown_connections 2024-09-12T02:37:05.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:05.225+0000 7f7a257fa640 1 --2- 172.21.15.60:0/149393983 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f7a2c06be30 0x7f7a2c06e2f0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:05.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:05.226+0000 7f7a257fa640 1 --2- 172.21.15.60:0/149393983 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a4015b300 0x7f7a40153890 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:05.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:05.226+0000 7f7a257fa640 1 --2- 172.21.15.60:0/149393983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a4006f210 0x7f7a40153350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:05.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:05.226+0000 7f7a257fa640 1 --2- 172.21.15.60:0/149393983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a4006e780 0x7f7a401f3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:05.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:05.226+0000 7f7a257fa640 1 -- 172.21.15.60:0/149393983 >> 172.21.15.60:0/149393983 conn(0x7f7a400c8250 msgr2=0x7f7a400c7450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:05.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:05.226+0000 7f7a257fa640 1 -- 172.21.15.60:0/149393983 shutdown_connections 2024-09-12T02:37:05.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:05.228+0000 7f7a257fa640 1 -- 172.21.15.60:0/149393983 wait complete. 2024-09-12T02:37:08.258 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:37:08.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.453+0000 7f6af12d0640 1 Processor -- start 2024-09-12T02:37:08.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.453+0000 7f6af12d0640 1 -- start start 2024-09-12T02:37:08.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.454+0000 7f6af12d0640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6aec157e80 0x7f6aec0c24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:08.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.454+0000 7f6af12d0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6aec15dca0 0x7f6aec15e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:08.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.454+0000 7f6af12d0640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6aec0c6430 con 0x7f6aec06cbf0 2024-09-12T02:37:08.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.454+0000 7f6af12d0640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f6aec0c61e0 con 0x7f6aec157e80 2024-09-12T02:37:08.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.454+0000 7f6af12d0640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6aec0c7280 con 0x7f6aec15dca0 2024-09-12T02:37:08.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.454+0000 7f6aea7fc640 1 -- >> v1:172.21.15.60:6789/0 conn(0x7f6aec06cbf0 legacy=0x7f6aec06d030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:37:08.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.454+0000 7f6aeb7fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6aec15dca0 0x7f6aec15e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:08.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.455+0000 7f6aeb7fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6aec15dca0 0x7f6aec15e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:49340/0 (socket says 172.21.15.60:49340) 2024-09-12T02:37:08.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.455+0000 7f6aeb7fe640 1 -- 172.21.15.60:0/3452806376 learned_addr learned my addr 172.21.15.60:0/3452806376 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:37:08.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.455+0000 7f6aeb7fe640 1 -- 172.21.15.60:0/3452806376 >> v2:172.21.15.105:3300/0 conn(0x7f6aec157e80 msgr2=0x7f6aec0c24e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:37:08.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.455+0000 7f6aeb7fe640 1 --2- 172.21.15.60:0/3452806376 >> v2:172.21.15.105:3300/0 conn(0x7f6aec157e80 0x7f6aec0c24e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:08.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.455+0000 7f6aeb7fe640 1 -- 172.21.15.60:0/3452806376 >> v1:172.21.15.60:6789/0 conn(0x7f6aec06cbf0 legacy=0x7f6aec06d030 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:37:08.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.455+0000 7f6aeb7fe640 1 -- 172.21.15.60:0/3452806376 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6aec0c6710 con 0x7f6aec15dca0 2024-09-12T02:37:08.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.460+0000 7f6aeb7fe640 1 --2- 172.21.15.60:0/3452806376 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6aec15dca0 0x7f6aec15e130 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6adc009870 tx=0x7f6adc02a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51db9ad889b8e6a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:08.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.461+0000 7f6ae9ffb640 1 -- 172.21.15.60:0/3452806376 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6adc037070 con 0x7f6aec15dca0 2024-09-12T02:37:08.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.461+0000 7f6ae9ffb640 1 -- 172.21.15.60:0/3452806376 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6adc032440 con 0x7f6aec15dca0 2024-09-12T02:37:08.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.462+0000 7f6af12d0640 1 -- 172.21.15.60:0/3452806376 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6aec15dca0 msgr2=0x7f6aec15e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:08.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.462+0000 7f6af12d0640 1 --2- 172.21.15.60:0/3452806376 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6aec15dca0 0x7f6aec15e130 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6adc009870 tx=0x7f6adc02a230 comp rx=0 tx=0).stop 2024-09-12T02:37:08.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.462+0000 7f6af12d0640 1 -- 172.21.15.60:0/3452806376 shutdown_connections 2024-09-12T02:37:08.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.462+0000 7f6af12d0640 1 --2- 172.21.15.60:0/3452806376 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6aec15dca0 0x7f6aec15e130 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:08.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.462+0000 7f6af12d0640 1 --2- 172.21.15.60:0/3452806376 >> v2:172.21.15.105:3300/0 conn(0x7f6aec157e80 0x7f6aec0c24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:08.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.462+0000 7f6af12d0640 1 -- 172.21.15.60:0/3452806376 >> 172.21.15.60:0/3452806376 conn(0x7f6aec0a9680 msgr2=0x7f6aec0a9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:08.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.467+0000 7f6af12d0640 1 -- 172.21.15.60:0/3452806376 shutdown_connections 2024-09-12T02:37:08.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.468+0000 7f6af12d0640 1 -- 172.21.15.60:0/3452806376 wait complete. 2024-09-12T02:37:08.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.470+0000 7f6af12d0640 1 Processor -- start 2024-09-12T02:37:08.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.470+0000 7f6af12d0640 1 -- start start 2024-09-12T02:37:08.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.472+0000 7f6af12d0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6aec06cbf0 0x7f6aec0ad020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:08.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.472+0000 7f6af12d0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6aec157e80 0x7f6aec152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:08.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.472+0000 7f6af12d0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6aec15dca0 0x7f6aec152da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:08.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.472+0000 7f6af12d0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6aec06d740 con 0x7f6aec06cbf0 2024-09-12T02:37:08.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.472+0000 7f6af12d0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6aec0c2e00 con 0x7f6aec157e80 2024-09-12T02:37:08.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.472+0000 7f6af12d0640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6aec158260 con 0x7f6aec15dca0 2024-09-12T02:37:08.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.472+0000 7f6aeb7fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6aec15dca0 0x7f6aec152da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:08.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.472+0000 7f6aeaffd640 1 -- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6aec06cbf0 msgr2=0x7f6aec0ad020 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:37:08.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.472+0000 7f6aeb7fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6aec15dca0 0x7f6aec152da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:49344/0 (socket says 172.21.15.60:49344) 2024-09-12T02:37:08.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.472+0000 7f6aeb7fe640 1 -- 172.21.15.60:0/1938934004 learned_addr learned my addr 172.21.15.60:0/1938934004 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:37:08.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.472+0000 7f6aeaffd640 1 --2- 172.21.15.60:0/1938934004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6aec06cbf0 0x7f6aec0ad020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:37:08.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.473+0000 7f6aeb7fe640 1 -- 172.21.15.60:0/1938934004 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6aec157e80 msgr2=0x7f6aec152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:08.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.473+0000 7f6aeb7fe640 1 --2- 172.21.15.60:0/1938934004 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6aec157e80 0x7f6aec152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:08.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.473+0000 7f6aeb7fe640 1 -- 172.21.15.60:0/1938934004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6aec06cbf0 msgr2=0x7f6aec0ad020 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:37:08.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.473+0000 7f6aeb7fe640 1 --2- 172.21.15.60:0/1938934004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6aec06cbf0 0x7f6aec0ad020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:08.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.473+0000 7f6aeb7fe640 1 -- 172.21.15.60:0/1938934004 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6aec0744f0 con 0x7f6aec15dca0 2024-09-12T02:37:08.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.474+0000 7f6aeb7fe640 1 --2- 172.21.15.60:0/1938934004 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6aec15dca0 0x7f6aec152da0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6adc0090b0 tx=0x7f6adc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:08.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.475+0000 7f6ad37fe640 1 -- 172.21.15.60:0/1938934004 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6adc037050 con 0x7f6aec15dca0 2024-09-12T02:37:08.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.475+0000 7f6af12d0640 1 -- 172.21.15.60:0/1938934004 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6aec1532e0 con 0x7f6aec15dca0 2024-09-12T02:37:08.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.475+0000 7f6af12d0640 1 -- 172.21.15.60:0/1938934004 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6aec072ba0 con 0x7f6aec15dca0 2024-09-12T02:37:08.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.477+0000 7f6ad37fe640 1 -- 172.21.15.60:0/1938934004 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6adc043070 con 0x7f6aec15dca0 2024-09-12T02:37:08.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.477+0000 7f6ad37fe640 1 -- 172.21.15.60:0/1938934004 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6adc03e450 con 0x7f6aec15dca0 2024-09-12T02:37:08.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.480+0000 7f6ad37fe640 1 -- 172.21.15.60:0/1938934004 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6adc032440 con 0x7f6aec15dca0 2024-09-12T02:37:08.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.481+0000 7f6af12d0640 1 -- 172.21.15.60:0/1938934004 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6acc005290 con 0x7f6aec15dca0 2024-09-12T02:37:08.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.482+0000 7f6ad37fe640 1 --2- 172.21.15.60:0/1938934004 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f6ad806be30 0x7f6ad806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:08.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.482+0000 7f6ad37fe640 1 -- 172.21.15.60:0/1938934004 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f6adc0ac0e0 con 0x7f6aec15dca0 2024-09-12T02:37:08.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.490+0000 7f6ad37fe640 1 -- 172.21.15.60:0/1938934004 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6adc07a760 con 0x7f6aec15dca0 2024-09-12T02:37:08.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.490+0000 7f6aeaffd640 1 --2- 172.21.15.60:0/1938934004 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f6ad806be30 0x7f6ad806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:08.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:08.492+0000 7f6aeaffd640 1 --2- 172.21.15.60:0/1938934004 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f6ad806be30 0x7f6ad806e2f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6aec08d810 tx=0x7f6ae0006cc0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:09.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:09.056+0000 7f6af12d0640 1 -- 172.21.15.60:0/1938934004 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6acc005580 con 0x7f6aec15dca0 2024-09-12T02:37:09.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:09.057+0000 7f6ad37fe640 1 -- 172.21.15.60:0/1938934004 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1566 (secure 0 0 0) 0x7f6adc07a060 con 0x7f6aec15dca0 2024-09-12T02:37:09.061 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":136,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:37:09.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:09.064+0000 7f6af12d0640 1 -- 172.21.15.60:0/1938934004 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f6ad806be30 msgr2=0x7f6ad806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:09.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:09.064+0000 7f6af12d0640 1 --2- 172.21.15.60:0/1938934004 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f6ad806be30 0x7f6ad806e2f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6aec08d810 tx=0x7f6ae0006cc0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:09.064+0000 7f6af12d0640 1 -- 172.21.15.60:0/1938934004 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6aec15dca0 msgr2=0x7f6aec152da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:09.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:09.064+0000 7f6af12d0640 1 --2- 172.21.15.60:0/1938934004 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6aec15dca0 0x7f6aec152da0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6adc0090b0 tx=0x7f6adc0046c0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:09.064+0000 7f6af12d0640 1 -- 172.21.15.60:0/1938934004 shutdown_connections 2024-09-12T02:37:09.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:09.064+0000 7f6af12d0640 1 --2- 172.21.15.60:0/1938934004 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f6ad806be30 0x7f6ad806e2f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:09.064+0000 7f6af12d0640 1 --2- 172.21.15.60:0/1938934004 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6aec15dca0 0x7f6aec152da0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:09.064+0000 7f6af12d0640 1 --2- 172.21.15.60:0/1938934004 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6aec157e80 0x7f6aec152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:09.064+0000 7f6af12d0640 1 --2- 172.21.15.60:0/1938934004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6aec06cbf0 0x7f6aec0ad020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:09.064+0000 7f6af12d0640 1 -- 172.21.15.60:0/1938934004 >> 172.21.15.60:0/1938934004 conn(0x7f6aec0a9680 msgr2=0x7f6aec1656d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:09.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:09.064+0000 7f6af12d0640 1 -- 172.21.15.60:0/1938934004 shutdown_connections 2024-09-12T02:37:09.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:09.064+0000 7f6af12d0640 1 -- 172.21.15.60:0/1938934004 wait complete. 2024-09-12T02:37:12.085 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:37:12.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:12.270+0000 7ff76d243640 1 Processor -- start 2024-09-12T02:37:12.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:12.271+0000 7ff76d243640 1 -- start start 2024-09-12T02:37:12.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:12.272+0000 7ff76d243640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff7600d5230 0x7ff760049ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:12.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:12.272+0000 7ff76d243640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7600d8890 con 0x7ff76004b3b0 2024-09-12T02:37:12.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:12.272+0000 7ff76d243640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff760048080 con 0x7ff760040b40 2024-09-12T02:37:12.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:12.272+0000 7ff76d243640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7ff760047e30 con 0x7ff7600d5230 2024-09-12T02:37:12.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:12.272+0000 7ff767fff640 1 -- >> v2:172.21.15.60:3300/0 conn(0x7ff7600d5230 msgr2=0x7ff760049ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:37:12.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:12.272+0000 7ff767fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff7600d5230 0x7ff760049ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:37:12.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:12.272+0000 7ff76ca42640 1 -- >> v1:172.21.15.60:6789/0 conn(0x7ff76004b3b0 legacy=0x7ff76000c860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:37:12.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:12.276+0000 7ff7677fe640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7ff760040b40 0x7ff76000c150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:53082/0 (socket says 172.21.15.60:53082) 2024-09-12T02:37:12.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:12.276+0000 7ff7677fe640 1 -- 172.21.15.60:0/3295581084 learned_addr learned my addr 172.21.15.60:0/3295581084 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:37:12.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:12.473+0000 7ff76ca42640 1 -- 172.21.15.60:0/3295581084 >> v1:172.21.15.60:6789/0 conn(0x7ff76004b3b0 legacy=0x7ff76000c860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:37:12.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:12.473+0000 7ff767fff640 1 -- 172.21.15.60:0/3295581084 >> v2:172.21.15.60:3300/0 conn(0x7ff7600d5230 msgr2=0x7ff760049ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:37:12.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:12.473+0000 7ff767fff640 1 --2- 172.21.15.60:0/3295581084 >> v2:172.21.15.60:3300/0 conn(0x7ff7600d5230 0x7ff760049ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:37:12.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:12.874+0000 7ff767fff640 1 -- 172.21.15.60:0/3295581084 >> v2:172.21.15.60:3300/0 conn(0x7ff7600d5230 msgr2=0x7ff760049ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:37:12.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:12.874+0000 7ff767fff640 1 --2- 172.21.15.60:0/3295581084 >> v2:172.21.15.60:3300/0 conn(0x7ff7600d5230 0x7ff760049ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:37:12.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:12.874+0000 7ff76ca42640 1 -- 172.21.15.60:0/3295581084 >> v1:172.21.15.60:6789/0 conn(0x7ff76004b3b0 legacy=0x7ff76000c860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:37:13.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:13.675+0000 7ff76ca42640 1 -- 172.21.15.60:0/3295581084 >> v1:172.21.15.60:6789/0 conn(0x7ff76004b3b0 legacy=0x7ff76000c860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:37:13.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:13.675+0000 7ff767fff640 1 -- 172.21.15.60:0/3295581084 >> v2:172.21.15.60:3300/0 conn(0x7ff7600d5230 msgr2=0x7ff760049ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:37:13.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:13.675+0000 7ff767fff640 1 --2- 172.21.15.60:0/3295581084 >> v2:172.21.15.60:3300/0 conn(0x7ff7600d5230 0x7ff760049ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:37:15.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:15.272+0000 7ff765ffb640 1 -- 172.21.15.60:0/3295581084 >> v2:172.21.15.60:3300/0 conn(0x7ff7600d5230 msgr2=0x7ff760049ec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:37:15.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:15.272+0000 7ff765ffb640 1 --2- 172.21.15.60:0/3295581084 >> v2:172.21.15.60:3300/0 conn(0x7ff7600d5230 0x7ff760049ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:15.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:15.272+0000 7ff765ffb640 1 -- 172.21.15.60:0/3295581084 >> v1:172.21.15.105:6789/0 conn(0x7ff760040b40 legacy=0x7ff76000c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:15.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:15.272+0000 7ff765ffb640 1 -- 172.21.15.60:0/3295581084 >> v1:172.21.15.60:6789/0 conn(0x7ff76004b3b0 legacy=0x7ff76000c860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:37:15.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:15.272+0000 7ff765ffb640 1 --2- 172.21.15.60:0/3295581084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff74c007ad0 0x7ff74c009f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:15.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:15.272+0000 7ff765ffb640 1 --2- 172.21.15.60:0/3295581084 >> v2:172.21.15.105:3300/0 conn(0x7ff74c00a630 0x7ff74c00caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:15.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:15.272+0000 7ff765ffb640 1 -- 172.21.15.60:0/3295581084 --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff760047e30 con 0x7ff74c00a630 2024-09-12T02:37:15.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:15.272+0000 7ff765ffb640 1 -- 172.21.15.60:0/3295581084 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff74c00d1b0 con 0x7ff74c007ad0 2024-09-12T02:37:15.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:15.272+0000 7ff7677fe640 1 --2- 172.21.15.60:0/3295581084 >> v2:172.21.15.105:3300/0 conn(0x7ff74c00a630 0x7ff74c00caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:15.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:15.272+0000 7ff767fff640 1 --2- 172.21.15.60:0/3295581084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff74c007ad0 0x7ff74c009f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:15.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:15.273+0000 7ff7677fe640 1 -- 172.21.15.60:0/3295581084 >> v2:172.21.15.105:3300/0 conn(0x7ff74c00a630 msgr2=0x7ff74c00caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:37:15.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:15.273+0000 7ff7677fe640 1 -- 172.21.15.60:0/3295581084 >> v2:172.21.15.105:3300/0 conn(0x7ff74c00a630 msgr2=0x7ff74c00caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:37:15.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:15.273+0000 7ff7677fe640 1 --2- 172.21.15.60:0/3295581084 >> v2:172.21.15.105:3300/0 conn(0x7ff74c00a630 0x7ff74c00caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:37:15.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:15.273+0000 7ff7677fe640 1 --2- 172.21.15.60:0/3295581084 >> v2:172.21.15.105:3300/0 conn(0x7ff74c00a630 0x7ff74c00caf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:37:15.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:15.273+0000 7ff767fff640 1 -- 172.21.15.60:0/3295581084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff74c007ad0 msgr2=0x7ff74c009f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:37:15.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:15.273+0000 7ff767fff640 1 -- 172.21.15.60:0/3295581084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff74c007ad0 msgr2=0x7ff74c009f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:37:15.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:15.273+0000 7ff767fff640 1 --2- 172.21.15.60:0/3295581084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff74c007ad0 0x7ff74c009f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:37:15.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:15.273+0000 7ff767fff640 1 --2- 172.21.15.60:0/3295581084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff74c007ad0 0x7ff74c009f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:37:15.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:15.474+0000 7ff7677fe640 1 --2- 172.21.15.60:0/3295581084 >> v2:172.21.15.105:3300/0 conn(0x7ff74c00a630 0x7ff74c00caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:15.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:15.474+0000 7ff767fff640 1 --2- 172.21.15.60:0/3295581084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff74c007ad0 0x7ff74c009f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:15.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:15.474+0000 7ff7677fe640 1 -- 172.21.15.60:0/3295581084 >> v2:172.21.15.105:3300/0 conn(0x7ff74c00a630 msgr2=0x7ff74c00caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:37:15.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:15.474+0000 7ff7677fe640 1 -- 172.21.15.60:0/3295581084 >> v2:172.21.15.105:3300/0 conn(0x7ff74c00a630 msgr2=0x7ff74c00caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:37:15.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:15.474+0000 7ff7677fe640 1 --2- 172.21.15.60:0/3295581084 >> v2:172.21.15.105:3300/0 conn(0x7ff74c00a630 0x7ff74c00caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:37:15.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:15.474+0000 7ff7677fe640 1 --2- 172.21.15.60:0/3295581084 >> v2:172.21.15.105:3300/0 conn(0x7ff74c00a630 0x7ff74c00caf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:37:15.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:15.475+0000 7ff767fff640 1 -- 172.21.15.60:0/3295581084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff74c007ad0 msgr2=0x7ff74c009f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:37:15.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:15.475+0000 7ff767fff640 1 -- 172.21.15.60:0/3295581084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff74c007ad0 msgr2=0x7ff74c009f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:37:15.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:15.475+0000 7ff767fff640 1 --2- 172.21.15.60:0/3295581084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff74c007ad0 0x7ff74c009f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:37:15.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:15.475+0000 7ff767fff640 1 --2- 172.21.15.60:0/3295581084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff74c007ad0 0x7ff74c009f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:37:15.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:15.875+0000 7ff7677fe640 1 --2- 172.21.15.60:0/3295581084 >> v2:172.21.15.105:3300/0 conn(0x7ff74c00a630 0x7ff74c00caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:15.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:15.875+0000 7ff7677fe640 1 -- 172.21.15.60:0/3295581084 >> v2:172.21.15.105:3300/0 conn(0x7ff74c00a630 msgr2=0x7ff74c00caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:37:15.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:15.875+0000 7ff7677fe640 1 -- 172.21.15.60:0/3295581084 >> v2:172.21.15.105:3300/0 conn(0x7ff74c00a630 msgr2=0x7ff74c00caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:37:15.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:15.875+0000 7ff7677fe640 1 --2- 172.21.15.60:0/3295581084 >> v2:172.21.15.105:3300/0 conn(0x7ff74c00a630 0x7ff74c00caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:37:15.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:15.875+0000 7ff7677fe640 1 --2- 172.21.15.60:0/3295581084 >> v2:172.21.15.105:3300/0 conn(0x7ff74c00a630 0x7ff74c00caf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:37:15.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:15.876+0000 7ff767fff640 1 --2- 172.21.15.60:0/3295581084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff74c007ad0 0x7ff74c009f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:15.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:15.876+0000 7ff767fff640 1 -- 172.21.15.60:0/3295581084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff74c007ad0 msgr2=0x7ff74c009f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:37:15.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:15.876+0000 7ff767fff640 1 -- 172.21.15.60:0/3295581084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff74c007ad0 msgr2=0x7ff74c009f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:37:15.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:15.876+0000 7ff767fff640 1 --2- 172.21.15.60:0/3295581084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff74c007ad0 0x7ff74c009f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:37:15.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:15.876+0000 7ff767fff640 1 --2- 172.21.15.60:0/3295581084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff74c007ad0 0x7ff74c009f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:37:16.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:16.676+0000 7ff7677fe640 1 --2- 172.21.15.60:0/3295581084 >> v2:172.21.15.105:3300/0 conn(0x7ff74c00a630 0x7ff74c00caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:16.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:16.676+0000 7ff7677fe640 1 -- 172.21.15.60:0/3295581084 >> v2:172.21.15.105:3300/0 conn(0x7ff74c00a630 msgr2=0x7ff74c00caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:37:16.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:16.676+0000 7ff7677fe640 1 -- 172.21.15.60:0/3295581084 >> v2:172.21.15.105:3300/0 conn(0x7ff74c00a630 msgr2=0x7ff74c00caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:37:16.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:16.676+0000 7ff7677fe640 1 --2- 172.21.15.60:0/3295581084 >> v2:172.21.15.105:3300/0 conn(0x7ff74c00a630 0x7ff74c00caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:37:16.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:16.676+0000 7ff7677fe640 1 --2- 172.21.15.60:0/3295581084 >> v2:172.21.15.105:3300/0 conn(0x7ff74c00a630 0x7ff74c00caf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:37:16.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:16.677+0000 7ff767fff640 1 --2- 172.21.15.60:0/3295581084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff74c007ad0 0x7ff74c009f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:16.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:16.677+0000 7ff767fff640 1 -- 172.21.15.60:0/3295581084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff74c007ad0 msgr2=0x7ff74c009f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:37:16.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:16.677+0000 7ff767fff640 1 -- 172.21.15.60:0/3295581084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff74c007ad0 msgr2=0x7ff74c009f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:37:16.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:16.677+0000 7ff767fff640 1 --2- 172.21.15.60:0/3295581084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff74c007ad0 0x7ff74c009f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:37:16.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:16.677+0000 7ff767fff640 1 --2- 172.21.15.60:0/3295581084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff74c007ad0 0x7ff74c009f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:37:18.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.272+0000 7ff765ffb640 1 -- 172.21.15.60:0/3295581084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff74c007ad0 msgr2=0x7ff74c009f00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:37:18.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.272+0000 7ff765ffb640 1 --2- 172.21.15.60:0/3295581084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff74c007ad0 0x7ff74c009f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:18.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.272+0000 7ff765ffb640 1 -- 172.21.15.60:0/3295581084 >> v2:172.21.15.105:3300/0 conn(0x7ff74c00a630 msgr2=0x7ff74c00caf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:37:18.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.272+0000 7ff765ffb640 1 --2- 172.21.15.60:0/3295581084 >> v2:172.21.15.105:3300/0 conn(0x7ff74c00a630 0x7ff74c00caf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:18.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.272+0000 7ff765ffb640 1 --2- 172.21.15.60:0/3295581084 >> v2:172.21.15.105:3300/0 conn(0x7ff74c00a630 0x7ff74c00caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:18.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.272+0000 7ff765ffb640 1 --2- 172.21.15.60:0/3295581084 >> v2:172.21.15.60:3300/0 conn(0x7ff7600d5230 0x7ff74c00f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:18.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.272+0000 7ff765ffb640 1 --2- 172.21.15.60:0/3295581084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff74c007ad0 0x7ff74c009f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:18.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.272+0000 7ff765ffb640 1 -- 172.21.15.60:0/3295581084 --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7ff760047e30 con 0x7ff7600d5230 2024-09-12T02:37:18.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.272+0000 7ff765ffb640 1 -- 172.21.15.60:0/3295581084 --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff74c00d1b0 con 0x7ff74c00a630 2024-09-12T02:37:18.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.272+0000 7ff765ffb640 1 -- 172.21.15.60:0/3295581084 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff74c00fb80 con 0x7ff74c007ad0 2024-09-12T02:37:18.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.272+0000 7ff76ca42640 1 -- 172.21.15.60:0/3295581084 reap_dead start 2024-09-12T02:37:18.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.273+0000 7ff7677fe640 1 -- 172.21.15.60:0/3295581084 >> v2:172.21.15.60:3300/0 conn(0x7ff7600d5230 msgr2=0x7ff74c00f620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:37:18.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.273+0000 7ff76ca42640 1 --2- 172.21.15.60:0/3295581084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff74c007ad0 0x7ff74c009f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:18.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.273+0000 7ff767fff640 1 --2- 172.21.15.60:0/3295581084 >> v2:172.21.15.105:3300/0 conn(0x7ff74c00a630 0x7ff74c00caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:18.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.273+0000 7ff7677fe640 1 --2- 172.21.15.60:0/3295581084 >> v2:172.21.15.60:3300/0 conn(0x7ff7600d5230 0x7ff74c00f620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:37:18.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.273+0000 7ff76ca42640 1 -- 172.21.15.60:0/3295581084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff74c007ad0 msgr2=0x7ff74c009f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:37:18.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.273+0000 7ff76ca42640 1 -- 172.21.15.60:0/3295581084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff74c007ad0 msgr2=0x7ff74c009f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:37:18.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.273+0000 7ff76ca42640 1 --2- 172.21.15.60:0/3295581084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff74c007ad0 0x7ff74c009f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:37:18.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.273+0000 7ff76ca42640 1 --2- 172.21.15.60:0/3295581084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff74c007ad0 0x7ff74c009f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:37:18.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.273+0000 7ff767fff640 1 -- 172.21.15.60:0/3295581084 >> v2:172.21.15.105:3300/0 conn(0x7ff74c00a630 msgr2=0x7ff74c00caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:37:18.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.273+0000 7ff767fff640 1 -- 172.21.15.60:0/3295581084 >> v2:172.21.15.105:3300/0 conn(0x7ff74c00a630 msgr2=0x7ff74c00caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:37:18.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.273+0000 7ff767fff640 1 --2- 172.21.15.60:0/3295581084 >> v2:172.21.15.105:3300/0 conn(0x7ff74c00a630 0x7ff74c00caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:37:18.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.273+0000 7ff767fff640 1 --2- 172.21.15.60:0/3295581084 >> v2:172.21.15.105:3300/0 conn(0x7ff74c00a630 0x7ff74c00caf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:37:18.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.474+0000 7ff7677fe640 1 -- 172.21.15.60:0/3295581084 >> v2:172.21.15.60:3300/0 conn(0x7ff7600d5230 msgr2=0x7ff74c00f620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:37:18.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.474+0000 7ff7677fe640 1 --2- 172.21.15.60:0/3295581084 >> v2:172.21.15.60:3300/0 conn(0x7ff7600d5230 0x7ff74c00f620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:37:18.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.474+0000 7ff76ca42640 1 --2- 172.21.15.60:0/3295581084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff74c007ad0 0x7ff74c009f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:18.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.474+0000 7ff767fff640 1 --2- 172.21.15.60:0/3295581084 >> v2:172.21.15.105:3300/0 conn(0x7ff74c00a630 0x7ff74c00caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:18.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.474+0000 7ff76ca42640 1 -- 172.21.15.60:0/3295581084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff74c007ad0 msgr2=0x7ff74c009f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:37:18.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.474+0000 7ff767fff640 1 -- 172.21.15.60:0/3295581084 >> v2:172.21.15.105:3300/0 conn(0x7ff74c00a630 msgr2=0x7ff74c00caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:37:18.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.474+0000 7ff767fff640 1 -- 172.21.15.60:0/3295581084 >> v2:172.21.15.105:3300/0 conn(0x7ff74c00a630 msgr2=0x7ff74c00caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:37:18.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.474+0000 7ff767fff640 1 --2- 172.21.15.60:0/3295581084 >> v2:172.21.15.105:3300/0 conn(0x7ff74c00a630 0x7ff74c00caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:37:18.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.474+0000 7ff767fff640 1 --2- 172.21.15.60:0/3295581084 >> v2:172.21.15.105:3300/0 conn(0x7ff74c00a630 0x7ff74c00caf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:37:18.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.474+0000 7ff76ca42640 1 -- 172.21.15.60:0/3295581084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff74c007ad0 msgr2=0x7ff74c009f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:37:18.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.474+0000 7ff76ca42640 1 --2- 172.21.15.60:0/3295581084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff74c007ad0 0x7ff74c009f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:37:18.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.474+0000 7ff76ca42640 1 --2- 172.21.15.60:0/3295581084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff74c007ad0 0x7ff74c009f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:37:18.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.875+0000 7ff7677fe640 1 -- 172.21.15.60:0/3295581084 >> v2:172.21.15.60:3300/0 conn(0x7ff7600d5230 msgr2=0x7ff74c00f620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:37:18.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.875+0000 7ff7677fe640 1 --2- 172.21.15.60:0/3295581084 >> v2:172.21.15.60:3300/0 conn(0x7ff7600d5230 0x7ff74c00f620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:37:18.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.875+0000 7ff767fff640 1 --2- 172.21.15.60:0/3295581084 >> v2:172.21.15.105:3300/0 conn(0x7ff74c00a630 0x7ff74c00caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:18.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.875+0000 7ff767fff640 1 -- 172.21.15.60:0/3295581084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff74c007ad0 msgr2=0x7ff74c009f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:18.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.876+0000 7ff767fff640 1 --2- 172.21.15.60:0/3295581084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff74c007ad0 0x7ff74c009f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:18.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.876+0000 7ff767fff640 1 -- 172.21.15.60:0/3295581084 >> v2:172.21.15.60:3300/0 conn(0x7ff7600d5230 msgr2=0x7ff74c00f620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:37:18.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.876+0000 7ff767fff640 1 --2- 172.21.15.60:0/3295581084 >> v2:172.21.15.60:3300/0 conn(0x7ff7600d5230 0x7ff74c00f620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:18.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.876+0000 7ff767fff640 1 -- 172.21.15.60:0/3295581084 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff760048360 con 0x7ff74c00a630 2024-09-12T02:37:18.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.877+0000 7ff767fff640 1 --2- 172.21.15.60:0/3295581084 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff74c00a630 0x7ff74c00caf0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff76000f6c0 tx=0x7ff75c02bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf9ce30d4b8cefda server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:18.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.877+0000 7ff766ffd640 1 -- 172.21.15.60:0/3295581084 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c032070 con 0x7ff74c00a630 2024-09-12T02:37:18.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.878+0000 7ff766ffd640 1 -- 172.21.15.60:0/3295581084 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff75c02c9f0 con 0x7ff74c00a630 2024-09-12T02:37:18.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.878+0000 7ff766ffd640 1 -- 172.21.15.60:0/3295581084 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c02cda0 con 0x7ff74c00a630 2024-09-12T02:37:18.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.879+0000 7ff76d243640 1 -- 172.21.15.60:0/3295581084 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff74c00a630 msgr2=0x7ff74c00caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:18.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.879+0000 7ff76d243640 1 --2- 172.21.15.60:0/3295581084 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff74c00a630 0x7ff74c00caf0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff76000f6c0 tx=0x7ff75c02bee0 comp rx=0 tx=0).stop 2024-09-12T02:37:18.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.879+0000 7ff76d243640 1 -- 172.21.15.60:0/3295581084 shutdown_connections 2024-09-12T02:37:18.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.879+0000 7ff76d243640 1 --2- 172.21.15.60:0/3295581084 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff74c00a630 0x7ff74c00caf0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:18.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.879+0000 7ff76d243640 1 --2- 172.21.15.60:0/3295581084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff74c007ad0 0x7ff74c009f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:18.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.879+0000 7ff76d243640 1 --2- 172.21.15.60:0/3295581084 >> v2:172.21.15.60:3300/0 conn(0x7ff7600d5230 0x7ff74c00f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:18.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.879+0000 7ff76d243640 1 -- 172.21.15.60:0/3295581084 >> 172.21.15.60:0/3295581084 conn(0x7ff76002f060 msgr2=0x7ff76002f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:18.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.879+0000 7ff76d243640 1 -- 172.21.15.60:0/3295581084 shutdown_connections 2024-09-12T02:37:18.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.879+0000 7ff76d243640 1 -- 172.21.15.60:0/3295581084 wait complete. 2024-09-12T02:37:18.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.881+0000 7ff76d243640 1 Processor -- start 2024-09-12T02:37:18.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.881+0000 7ff76d243640 1 -- start start 2024-09-12T02:37:18.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.882+0000 7ff76d243640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff74c007ad0 0x7ff760042400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:18.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.883+0000 7ff76d243640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff74c00a630 0x7ff7600db8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:18.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.883+0000 7ff76d243640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7600d5230 0x7ff7600d6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:18.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.883+0000 7ff76d243640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff7600d8630 con 0x7ff74c00a630 2024-09-12T02:37:18.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.883+0000 7ff76d243640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff7600d84b0 con 0x7ff74c007ad0 2024-09-12T02:37:18.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.883+0000 7ff76d243640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff760049ec0 con 0x7ff7600d5230 2024-09-12T02:37:18.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.883+0000 7ff7677fe640 1 -- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff74c00a630 msgr2=0x7ff7600db8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:37:18.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.883+0000 7ff7677fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff74c00a630 0x7ff7600db8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:37:18.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.883+0000 7ff76ca42640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7600d5230 0x7ff7600d6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:18.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.883+0000 7ff76ca42640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7600d5230 0x7ff7600d6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:39660/0 (socket says 172.21.15.60:39660) 2024-09-12T02:37:18.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.883+0000 7ff76ca42640 1 -- 172.21.15.60:0/2278719241 learned_addr learned my addr 172.21.15.60:0/2278719241 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:37:18.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.883+0000 7ff767fff640 1 --2- 172.21.15.60:0/2278719241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff74c007ad0 0x7ff760042400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:18.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.884+0000 7ff76ca42640 1 -- 172.21.15.60:0/2278719241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff74c007ad0 msgr2=0x7ff760042400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:18.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.884+0000 7ff76ca42640 1 --2- 172.21.15.60:0/2278719241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff74c007ad0 0x7ff760042400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:18.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.884+0000 7ff76ca42640 1 -- 172.21.15.60:0/2278719241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff74c00a630 msgr2=0x7ff7600db8a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:37:18.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.884+0000 7ff76ca42640 1 --2- 172.21.15.60:0/2278719241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff74c00a630 0x7ff7600db8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:18.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.884+0000 7ff76ca42640 1 -- 172.21.15.60:0/2278719241 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7600470e0 con 0x7ff7600d5230 2024-09-12T02:37:18.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.884+0000 7ff76ca42640 1 --2- 172.21.15.60:0/2278719241 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7600d5230 0x7ff7600d6b60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff76802dd50 tx=0x7ff768050240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:18.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.884+0000 7ff764ff9640 1 -- 172.21.15.60:0/2278719241 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff768076660 con 0x7ff7600d5230 2024-09-12T02:37:18.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.885+0000 7ff764ff9640 1 -- 172.21.15.60:0/2278719241 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7680741d0 con 0x7ff7600d5230 2024-09-12T02:37:18.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.885+0000 7ff76d243640 1 -- 172.21.15.60:0/2278719241 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff760047660 con 0x7ff7600d5230 2024-09-12T02:37:18.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.885+0000 7ff76d243640 1 -- 172.21.15.60:0/2278719241 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff760047380 con 0x7ff7600d5230 2024-09-12T02:37:18.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.885+0000 7ff764ff9640 1 -- 172.21.15.60:0/2278719241 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff768074600 con 0x7ff7600d5230 2024-09-12T02:37:18.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.887+0000 7ff76d243640 1 -- 172.21.15.60:0/2278719241 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff748005290 con 0x7ff7600d5230 2024-09-12T02:37:18.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.887+0000 7ff764ff9640 1 -- 172.21.15.60:0/2278719241 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff7680747a0 con 0x7ff7600d5230 2024-09-12T02:37:18.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.888+0000 7ff764ff9640 1 --2- 172.21.15.60:0/2278719241 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff74c070fd0 0x7ff74c073490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:18.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.888+0000 7ff764ff9640 1 -- 172.21.15.60:0/2278719241 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7ff7681072f0 con 0x7ff7600d5230 2024-09-12T02:37:18.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.889+0000 7ff767fff640 1 --2- 172.21.15.60:0/2278719241 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff74c070fd0 0x7ff74c073490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:18.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.889+0000 7ff767fff640 1 --2- 172.21.15.60:0/2278719241 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff74c070fd0 0x7ff74c073490 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff75c036000 tx=0x7ff75c032000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:18.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:18.896+0000 7ff764ff9640 1 -- 172.21.15.60:0/2278719241 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff7680d52a0 con 0x7ff7600d5230 2024-09-12T02:37:19.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.405+0000 7ff76d243640 1 -- 172.21.15.60:0/2278719241 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ff748005580 con 0x7ff7600d5230 2024-09-12T02:37:19.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.409+0000 7ff764ff9640 1 -- 172.21.15.60:0/2278719241 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1559 (secure 0 0 0) 0x7ff7680d95a0 con 0x7ff7600d5230 2024-09-12T02:37:19.410 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":138,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:37:19.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.413+0000 7ff7527fc640 1 -- 172.21.15.60:0/2278719241 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff74c070fd0 msgr2=0x7ff74c073490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:19.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.413+0000 7ff7527fc640 1 --2- 172.21.15.60:0/2278719241 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff74c070fd0 0x7ff74c073490 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff75c036000 tx=0x7ff75c032000 comp rx=0 tx=0).stop 2024-09-12T02:37:19.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.413+0000 7ff7527fc640 1 -- 172.21.15.60:0/2278719241 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7600d5230 msgr2=0x7ff7600d6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:19.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.413+0000 7ff7527fc640 1 --2- 172.21.15.60:0/2278719241 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7600d5230 0x7ff7600d6b60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff76802dd50 tx=0x7ff768050240 comp rx=0 tx=0).stop 2024-09-12T02:37:19.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.413+0000 7ff7527fc640 1 -- 172.21.15.60:0/2278719241 shutdown_connections 2024-09-12T02:37:19.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.413+0000 7ff7527fc640 1 --2- 172.21.15.60:0/2278719241 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff74c070fd0 0x7ff74c073490 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:19.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.413+0000 7ff7527fc640 1 --2- 172.21.15.60:0/2278719241 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7600d5230 0x7ff7600d6b60 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:19.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.413+0000 7ff7527fc640 1 --2- 172.21.15.60:0/2278719241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff74c00a630 0x7ff7600db8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:19.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.413+0000 7ff7527fc640 1 --2- 172.21.15.60:0/2278719241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff74c007ad0 0x7ff760042400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:19.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.413+0000 7ff7527fc640 1 -- 172.21.15.60:0/2278719241 >> 172.21.15.60:0/2278719241 conn(0x7ff76002f060 msgr2=0x7ff760005290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:19.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.415+0000 7ff7527fc640 1 -- 172.21.15.60:0/2278719241 shutdown_connections 2024-09-12T02:37:19.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.415+0000 7ff7527fc640 1 -- 172.21.15.60:0/2278719241 wait complete. 2024-09-12T02:37:19.438 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-12T02:37:19.438 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-12T02:37:19.438 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-12T02:37:19.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.648+0000 7f66c3fff640 1 Processor -- start 2024-09-12T02:37:19.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.648+0000 7f66c3fff640 1 -- start start 2024-09-12T02:37:19.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.649+0000 7f66c3fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f66bc04ad70 0x7f66bc046410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:19.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.649+0000 7f66c3fff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66bc047660 0x7f66bc046950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:19.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.649+0000 7f66c3fff640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66bc02ea60 con 0x7f66bc0d4230 2024-09-12T02:37:19.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.649+0000 7f66c3fff640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f66bc047440 con 0x7f66bc04ad70 2024-09-12T02:37:19.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.649+0000 7f66c3fff640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f66bc0d7420 con 0x7f66bc047660 2024-09-12T02:37:19.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.649+0000 7f66c2ffd640 1 -- >> v1:172.21.15.60:6789/0 conn(0x7f66bc0d4230 legacy=0x7f66bc006a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:37:19.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.650+0000 7f66c27fc640 1 -- >> v2:172.21.15.60:3300/0 conn(0x7f66bc04ad70 msgr2=0x7f66bc046410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:37:19.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.650+0000 7f66c27fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f66bc04ad70 0x7f66bc046410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:37:19.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.657+0000 7f66c37fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66bc047660 0x7f66bc046950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:19.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.657+0000 7f66c37fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66bc047660 0x7f66bc046950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:38816/0 (socket says 172.21.15.60:38816) 2024-09-12T02:37:19.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.657+0000 7f66c37fe640 1 -- 172.21.15.60:0/1985125573 learned_addr learned my addr 172.21.15.60:0/1985125573 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:37:19.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.660+0000 7f66c37fe640 1 -- 172.21.15.60:0/1985125573 >> v2:172.21.15.60:3300/0 conn(0x7f66bc04ad70 msgr2=0x7f66bc046410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:37:19.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.661+0000 7f66c37fe640 1 --2- 172.21.15.60:0/1985125573 >> v2:172.21.15.60:3300/0 conn(0x7f66bc04ad70 0x7f66bc046410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:19.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.661+0000 7f66c37fe640 1 -- 172.21.15.60:0/1985125573 >> v1:172.21.15.60:6789/0 conn(0x7f66bc0d4230 legacy=0x7f66bc006a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:37:19.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.661+0000 7f66c37fe640 1 -- 172.21.15.60:0/1985125573 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66bc0d7700 con 0x7f66bc047660 2024-09-12T02:37:19.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.663+0000 7f66c37fe640 1 --2- 172.21.15.60:0/1985125573 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66bc047660 0x7f66bc046950 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f66c407ca70 tx=0x7f66c40a6c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6ca50ac9dc7042c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:19.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.663+0000 7f66c1ffb640 1 -- 172.21.15.60:0/1985125573 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c40b4070 con 0x7f66bc047660 2024-09-12T02:37:19.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.663+0000 7f66c1ffb640 1 -- 172.21.15.60:0/1985125573 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66c40a7a20 con 0x7f66bc047660 2024-09-12T02:37:19.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.663+0000 7f66c1ffb640 1 -- 172.21.15.60:0/1985125573 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c40af440 con 0x7f66bc047660 2024-09-12T02:37:19.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.664+0000 7f66c3fff640 1 -- 172.21.15.60:0/1985125573 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66bc047660 msgr2=0x7f66bc046950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:19.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.664+0000 7f66c3fff640 1 --2- 172.21.15.60:0/1985125573 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66bc047660 0x7f66bc046950 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f66c407ca70 tx=0x7f66c40a6c10 comp rx=0 tx=0).stop 2024-09-12T02:37:19.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.667+0000 7f66c3fff640 1 -- 172.21.15.60:0/1985125573 shutdown_connections 2024-09-12T02:37:19.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.667+0000 7f66c3fff640 1 --2- 172.21.15.60:0/1985125573 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66bc047660 0x7f66bc046950 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:19.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.667+0000 7f66c3fff640 1 --2- 172.21.15.60:0/1985125573 >> v2:172.21.15.60:3300/0 conn(0x7f66bc04ad70 0x7f66bc046410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:19.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.667+0000 7f66c3fff640 1 -- 172.21.15.60:0/1985125573 >> 172.21.15.60:0/1985125573 conn(0x7f66bc047d10 msgr2=0x7f66bc048120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:19.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.667+0000 7f66c3fff640 1 -- 172.21.15.60:0/1985125573 shutdown_connections 2024-09-12T02:37:19.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.669+0000 7f66c3fff640 1 -- 172.21.15.60:0/1985125573 wait complete. 2024-09-12T02:37:19.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.672+0000 7f66c3fff640 1 Processor -- start 2024-09-12T02:37:19.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.673+0000 7f66c3fff640 1 -- start start 2024-09-12T02:37:19.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.674+0000 7f66c3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66bc047660 0x7f66bc0d0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:19.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.674+0000 7f66c2ffd640 1 -- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66bc047660 msgr2=0x7f66bc0d0bf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:37:19.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.674+0000 7f66c2ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66bc047660 0x7f66bc0d0bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:37:19.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.674+0000 7f66c3fff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66bc04ad70 0x7f66bc02bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:19.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.674+0000 7f66c3fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66bc0d4230 0x7f66bc0d4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:19.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.674+0000 7f66c3fff640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f66bc047130 con 0x7f66bc047660 2024-09-12T02:37:19.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.674+0000 7f66c3fff640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f66bc045ef0 con 0x7f66bc0d4230 2024-09-12T02:37:19.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.674+0000 7f66c3fff640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f66bc009a40 con 0x7f66bc04ad70 2024-09-12T02:37:19.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.674+0000 7f66c27fc640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66bc04ad70 0x7f66bc02bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:19.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.674+0000 7f66c27fc640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66bc04ad70 0x7f66bc02bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:38822/0 (socket says 172.21.15.60:38822) 2024-09-12T02:37:19.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.674+0000 7f66c27fc640 1 -- 172.21.15.60:0/2677602952 learned_addr learned my addr 172.21.15.60:0/2677602952 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:37:19.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.675+0000 7f66c37fe640 1 --2- 172.21.15.60:0/2677602952 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66bc0d4230 0x7f66bc0d4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:19.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.675+0000 7f66c27fc640 1 -- 172.21.15.60:0/2677602952 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66bc0d4230 msgr2=0x7f66bc0d4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:19.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.675+0000 7f66c27fc640 1 --2- 172.21.15.60:0/2677602952 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66bc0d4230 0x7f66bc0d4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:19.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.675+0000 7f66c27fc640 1 -- 172.21.15.60:0/2677602952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66bc047660 msgr2=0x7f66bc0d0bf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:37:19.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.675+0000 7f66c27fc640 1 --2- 172.21.15.60:0/2677602952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66bc047660 0x7f66bc0d0bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:19.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.675+0000 7f66c27fc640 1 -- 172.21.15.60:0/2677602952 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66bc16c110 con 0x7f66bc04ad70 2024-09-12T02:37:19.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.679+0000 7f66c27fc640 1 --2- 172.21.15.60:0/2677602952 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66bc04ad70 0x7f66bc02bc50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f66b800ffb0 tx=0x7f66b8012780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:19.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.682+0000 7f66ab7fe640 1 -- 172.21.15.60:0/2677602952 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b8016860 con 0x7f66bc04ad70 2024-09-12T02:37:19.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.682+0000 7f66ab7fe640 1 -- 172.21.15.60:0/2677602952 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66b8016a20 con 0x7f66bc04ad70 2024-09-12T02:37:19.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.682+0000 7f66c3fff640 1 -- 172.21.15.60:0/2677602952 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66bc16c3f0 con 0x7f66bc04ad70 2024-09-12T02:37:19.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.683+0000 7f66ab7fe640 1 -- 172.21.15.60:0/2677602952 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b8016e10 con 0x7f66bc04ad70 2024-09-12T02:37:19.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.683+0000 7f66c3fff640 1 -- 172.21.15.60:0/2677602952 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f66bc0cbed0 con 0x7f66bc04ad70 2024-09-12T02:37:19.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.684+0000 7f66a97fa640 1 --2- 172.21.15.60:0/2677602952 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66bc0d1130 0x7f66bc16eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:19.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.684+0000 7f66a97fa640 1 -- 172.21.15.60:0/2677602952 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f66bc006a10 con 0x7f66bc0d1130 2024-09-12T02:37:19.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.685+0000 7f66c2ffd640 1 --2- 172.21.15.60:0/2677602952 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66bc0d1130 0x7f66bc16eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:19.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.686+0000 7f66c2ffd640 1 -- 172.21.15.60:0/2677602952 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f66bc049e70 con 0x7f66bc0d1130 2024-09-12T02:37:19.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.686+0000 7f66c2ffd640 1 --2- 172.21.15.60:0/2677602952 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66bc0d1130 0x7f66bc16eb60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f66b4003980 tx=0x7f66b400b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:19.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.690+0000 7f66ab7fe640 1 -- 172.21.15.60:0/2677602952 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f66b8027440 con 0x7f66bc04ad70 2024-09-12T02:37:19.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.691+0000 7f66ab7fe640 1 --2- 172.21.15.60:0/2677602952 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f66b006be30 0x7f66b006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:19.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.692+0000 7f66ab7fe640 1 -- 172.21.15.60:0/2677602952 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b4016070 con 0x7f66bc0d1130 2024-09-12T02:37:19.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.693+0000 7f66ab7fe640 1 -- 172.21.15.60:0/2677602952 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f66b80941a0 con 0x7f66bc04ad70 2024-09-12T02:37:19.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.693+0000 7f66ab7fe640 1 -- 172.21.15.60:0/2677602952 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f66b4003dc0 con 0x7f66bc0d1130 2024-09-12T02:37:19.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.693+0000 7f66ab7fe640 1 -- 172.21.15.60:0/2677602952 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66bc0d1130 msgr2=0x7f66bc16eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:19.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.693+0000 7f66ab7fe640 1 --2- 172.21.15.60:0/2677602952 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66bc0d1130 0x7f66bc16eb60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f66b4003980 tx=0x7f66b400b8e0 comp rx=0 tx=0).stop 2024-09-12T02:37:19.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.693+0000 7f66ab7fe640 1 -- 172.21.15.60:0/2677602952 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66bc0d1130 msgr2=0x7f66bc16eb60 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:37:19.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.693+0000 7f66ab7fe640 1 --2- 172.21.15.60:0/2677602952 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66bc0d1130 0x7f66bc16eb60 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f66b4003980 tx=0x7f66b400b8e0 comp rx=0 tx=0).stop 2024-09-12T02:37:19.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.692+0000 7f66c37fe640 1 --2- 172.21.15.60:0/2677602952 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f66b006be30 0x7f66b006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:19.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.701+0000 7f66c37fe640 1 --2- 172.21.15.60:0/2677602952 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f66b006be30 0x7f66b006e2f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f66bc02ec30 tx=0x7f66c40ab000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:19.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.714+0000 7f66a97fa640 1 --2- 172.21.15.60:0/2677602952 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66bc041e10 0x7f66bc16f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:19.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.715+0000 7f66a97fa640 1 -- 172.21.15.60:0/2677602952 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f66bc16c5c0 con 0x7f66bc041e10 2024-09-12T02:37:19.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.718+0000 7f66c2ffd640 1 --2- 172.21.15.60:0/2677602952 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66bc041e10 0x7f66bc16f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:19.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.724+0000 7f66c2ffd640 1 -- 172.21.15.60:0/2677602952 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f66bc031210 con 0x7f66bc041e10 2024-09-12T02:37:19.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.727+0000 7f66c2ffd640 1 --2- 172.21.15.60:0/2677602952 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66bc041e10 0x7f66bc16f0a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f66b4003980 tx=0x7f66b40059d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:19.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.731+0000 7f66ab7fe640 1 -- 172.21.15.60:0/2677602952 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b4016040 con 0x7f66bc041e10 2024-09-12T02:37:19.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.731+0000 7f66ab7fe640 1 -- 172.21.15.60:0/2677602952 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4875 (secure 0 0 0) 0x7f66b401ab00 con 0x7f66bc041e10 2024-09-12T02:37:19.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.731+0000 7f66ab7fe640 1 -- 172.21.15.60:0/2677602952 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66bc041e10 msgr2=0x7f66bc16f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:19.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.731+0000 7f66ab7fe640 1 --2- 172.21.15.60:0/2677602952 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66bc041e10 0x7f66bc16f0a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f66b4003980 tx=0x7f66b40059d0 comp rx=0 tx=0).stop 2024-09-12T02:37:19.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.731+0000 7f66ab7fe640 1 -- 172.21.15.60:0/2677602952 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66bc041e10 msgr2=0x7f66bc16f0a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:37:19.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.731+0000 7f66ab7fe640 1 --2- 172.21.15.60:0/2677602952 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66bc041e10 0x7f66bc16f0a0 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f66b4003980 tx=0x7f66b40059d0 comp rx=0 tx=0).stop 2024-09-12T02:37:19.732 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:37:19.732 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:37:19.732 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:37:19.732 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:37:19.732 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 138, 2024-09-12T02:37:19.733 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 111308, 2024-09-12T02:37:19.733 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:37:19.733 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:37:19.733 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:37:19.733 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:19.733 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 1, 2024-09-12T02:37:19.733 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:37:19.733 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:37:19.733 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:37:19.733 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:37:19.733 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:37:19.733 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:37:19.733 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:37:19.734 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:37:19.734 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:37:19.734 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:37:19.734 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:37:19.734 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:37:19.734 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:37:19.734 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:37:19.734 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:19.734 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:37:19.734 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:37:19.734 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:37:19.734 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:37:19.735 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:37:19.735 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:37:19.735 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:37:19.735 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:37:19.735 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:37:19.735 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:37:19.735 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:37:19.735 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:37:19.735 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:37:19.735 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:19.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:19.735 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:37:19.736 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:37:19.736 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:37:19.736 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:37:19.736 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:37:19.736 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:37:19.736 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:37:19.736 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:37:19.736 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:37:19.736 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:37:19.736 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:37:19.736 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:37:19.736 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:37:19.736 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:37:19.737 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:37:19.737 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:37:19.737 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:37:19.737 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:37:19.737 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:37:19.737 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:37:19.737 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:37:19.737 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:37:19.737 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:37:19.737 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:37:19.737 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:37:19.737 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:37:19.737 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:37:19.738 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:37:19.738 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:19.738 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:37:19.738 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:19.738 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:37:19.738 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:19.738 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:37:19.738 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:37:19.738 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:37:19.738 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:37:19.738 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:19.738 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:37:19.738 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:37:19.738 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:19.738 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:19.739 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:19.739 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:37:19.739 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:37:19.739 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:19.739 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:19.739 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:19.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:19.739 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:37:19.739 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:37:19.739 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:37:19.739 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:37:19.739 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:37:19.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:19.740 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:19.740 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:37:19.740 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:37:19.740 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:37:19.740 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:37:19.740 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:19.740 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:37:19.740 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:37:19.740 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:19.740 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:19.740 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:19.740 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:37:19.740 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:37:19.740 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:19.741 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:19.741 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:19.741 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:19.741 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:37:19.741 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:37:19.741 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:37:19.741 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:37:19.741 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:37:19.741 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:19.741 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:19.741 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:37:19.741 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:37:19.741 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:37:19.741 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:37:19.742 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:19.742 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:37:19.742 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:37:19.742 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:19.742 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:19.742 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:19.742 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:37:19.742 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:37:19.742 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:19.742 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:19.742 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:19.742 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:19.742 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:37:19.742 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:37:19.743 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:37:19.743 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:37:19.743 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:37:19.743 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:19.743 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:19.743 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:19.743 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:37:19.743 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:37:19.743 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:19.743 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:37:19.743 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:37:19.743 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:37:19.743 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:19.744 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:19.744 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:37:19.744 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:19.744 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:37:19.744 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:37:19.744 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:37:19.744 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:19.744 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:19.744 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:37:19.744 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:19.744 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:37:19.744 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:37:19.744 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:37:19.745 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:19.745 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:19.745 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:37:19.745 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:19.745 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:37:19.745 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:37:19.745 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:37:19.745 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:19.745 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:19.745 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:19.745 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:37:19.745 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:37:19.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.732+0000 7f66c3fff640 1 -- 172.21.15.60:0/2677602952 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f66b006be30 msgr2=0x7f66b006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:19.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.732+0000 7f66c3fff640 1 --2- 172.21.15.60:0/2677602952 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f66b006be30 0x7f66b006e2f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f66bc02ec30 tx=0x7f66c40ab000 comp rx=0 tx=0).stop 2024-09-12T02:37:19.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.732+0000 7f66c3fff640 1 -- 172.21.15.60:0/2677602952 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66bc04ad70 msgr2=0x7f66bc02bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:19.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.732+0000 7f66c3fff640 1 --2- 172.21.15.60:0/2677602952 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66bc04ad70 0x7f66bc02bc50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f66b800ffb0 tx=0x7f66b8012780 comp rx=0 tx=0).stop 2024-09-12T02:37:19.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.732+0000 7f66c37fe640 1 -- 172.21.15.60:0/2677602952 reap_dead start 2024-09-12T02:37:19.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.732+0000 7f66c37fe640 1 -- 172.21.15.60:0/2677602952 reap_dead start 2024-09-12T02:37:19.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.732+0000 7f66c3fff640 1 -- 172.21.15.60:0/2677602952 shutdown_connections 2024-09-12T02:37:19.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.732+0000 7f66c3fff640 1 -- 172.21.15.60:0/2677602952 >> 172.21.15.60:0/2677602952 conn(0x7f66bc047d10 msgr2=0x7f66bc030410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:19.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.732+0000 7f66c3fff640 1 -- 172.21.15.60:0/2677602952 shutdown_connections 2024-09-12T02:37:19.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.733+0000 7f66c3fff640 1 -- 172.21.15.60:0/2677602952 wait complete. 2024-09-12T02:37:19.754 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-12T02:37:19.754 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-12T02:37:19.754 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-12T02:37:19.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.954+0000 7f35bd0af640 1 Processor -- start 2024-09-12T02:37:19.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.954+0000 7f35bd0af640 1 -- start start 2024-09-12T02:37:19.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.955+0000 7f35bd0af640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35b80c4070 0x7f35b81671e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:19.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.955+0000 7f35bd0af640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35b80c2520 con 0x7f35b806d750 2024-09-12T02:37:19.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.955+0000 7f35bd0af640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35b80c2800 con 0x7f35b80aaa80 2024-09-12T02:37:19.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.955+0000 7f35bd0af640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f35b80c2ae0 con 0x7f35b80c4070 2024-09-12T02:37:19.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.956+0000 7f35b7fff640 1 -- >> v1:172.21.15.60:6789/0 conn(0x7f35b806d750 legacy=0x7f35b80c6ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.60:6789/0 2024-09-12T02:37:19.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.956+0000 7f35b77fe640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f35b80aaa80 0x7f35b8166ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:38106/0 (socket says 172.21.15.60:38106) 2024-09-12T02:37:19.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.956+0000 7f35b77fe640 1 -- 172.21.15.60:0/1506039981 learned_addr learned my addr 172.21.15.60:0/1506039981 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:37:19.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.957+0000 7f35bc8ae640 1 --2- 172.21.15.60:0/1506039981 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35b80c4070 0x7f35b81671e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:19.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.958+0000 7f35b6ffd640 1 -- 172.21.15.60:0/1506039981 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4197792144 0 0) 0x7f35b80c2800 con 0x7f35b80aaa80 2024-09-12T02:37:19.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.958+0000 7f35b6ffd640 1 -- 172.21.15.60:0/1506039981 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35a0003520 con 0x7f35b80aaa80 2024-09-12T02:37:19.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.959+0000 7f35b6ffd640 1 -- 172.21.15.60:0/1506039981 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2203187858 0 0) 0x7f35a0003520 con 0x7f35b80aaa80 2024-09-12T02:37:19.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.959+0000 7f35b6ffd640 1 -- 172.21.15.60:0/1506039981 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35b80c4070 msgr2=0x7f35b81671e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:19.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.959+0000 7f35b6ffd640 1 --2- 172.21.15.60:0/1506039981 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35b80c4070 0x7f35b81671e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:19.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.959+0000 7f35b6ffd640 1 -- 172.21.15.60:0/1506039981 >> v1:172.21.15.60:6789/0 conn(0x7f35b806d750 legacy=0x7f35b80c6ae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:37:19.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.959+0000 7f35b6ffd640 1 -- 172.21.15.60:0/1506039981 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35b80c62e0 con 0x7f35b80aaa80 2024-09-12T02:37:19.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.959+0000 7f35b6ffd640 1 -- 172.21.15.60:0/1506039981 <== mon.1 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7f35b00019f0 con 0x7f35b80aaa80 2024-09-12T02:37:19.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.959+0000 7f35b6ffd640 1 -- 172.21.15.60:0/1506039981 >> v1:172.21.15.105:6789/0 conn(0x7f35b80aaa80 legacy=0x7f35b8166ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:19.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.959+0000 7f35b6ffd640 1 --2- 172.21.15.60:0/1506039981 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35a00039b0 0x7f35a0003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:19.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.959+0000 7f35b6ffd640 1 --2- 172.21.15.60:0/1506039981 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35a0004380 0x7f35a0004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:19.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.959+0000 7f35b6ffd640 1 --2- 172.21.15.60:0/1506039981 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35a0005090 0x7f35a000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:19.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.959+0000 7f35b6ffd640 1 -- 172.21.15.60:0/1506039981 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f35b80c2ae0 con 0x7f35a00039b0 2024-09-12T02:37:19.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.959+0000 7f35b6ffd640 1 -- 172.21.15.60:0/1506039981 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f35a000bf60 con 0x7f35a0004380 2024-09-12T02:37:19.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.959+0000 7f35b6ffd640 1 -- 172.21.15.60:0/1506039981 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f35a000c160 con 0x7f35a0005090 2024-09-12T02:37:19.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.959+0000 7f35b7fff640 1 -- 172.21.15.60:0/1506039981 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35a00039b0 msgr2=0x7f35a0003db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:37:19.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.959+0000 7f35b7fff640 1 --2- 172.21.15.60:0/1506039981 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35a00039b0 0x7f35a0003db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:37:19.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.959+0000 7f35b77fe640 1 --2- 172.21.15.60:0/1506039981 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35a0004380 0x7f35a0004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:19.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.960+0000 7f35b77fe640 1 -- 172.21.15.60:0/1506039981 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35a0005090 msgr2=0x7f35a000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:19.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.960+0000 7f35b77fe640 1 --2- 172.21.15.60:0/1506039981 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35a0005090 0x7f35a000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:19.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.960+0000 7f35b77fe640 1 -- 172.21.15.60:0/1506039981 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35a00039b0 msgr2=0x7f35a0003db0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:37:19.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.960+0000 7f35b77fe640 1 --2- 172.21.15.60:0/1506039981 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35a00039b0 0x7f35a0003db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:19.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.960+0000 7f35b77fe640 1 -- 172.21.15.60:0/1506039981 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35b80c62e0 con 0x7f35a0004380 2024-09-12T02:37:19.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.961+0000 7f35b77fe640 1 --2- 172.21.15.60:0/1506039981 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35a0004380 0x7f35a0004860 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f35b000a4a0 tx=0x7f35a0005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e14f6287c0618aea server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:19.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.961+0000 7f35b6ffd640 1 -- 172.21.15.60:0/1506039981 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b000a4e0 con 0x7f35a0004380 2024-09-12T02:37:19.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.961+0000 7f35b6ffd640 1 -- 172.21.15.60:0/1506039981 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35b0033070 con 0x7f35a0004380 2024-09-12T02:37:19.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.961+0000 7f35b6ffd640 1 -- 172.21.15.60:0/1506039981 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b00386b0 con 0x7f35a0004380 2024-09-12T02:37:19.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.962+0000 7f35bd0af640 1 -- 172.21.15.60:0/1506039981 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35a0004380 msgr2=0x7f35a0004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:19.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.962+0000 7f35bd0af640 1 --2- 172.21.15.60:0/1506039981 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35a0004380 0x7f35a0004860 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f35b000a4a0 tx=0x7f35a0005830 comp rx=0 tx=0).stop 2024-09-12T02:37:19.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.962+0000 7f35bc8ae640 1 -- 172.21.15.60:0/1506039981 reap_dead start 2024-09-12T02:37:19.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.963+0000 7f35bd0af640 1 -- 172.21.15.60:0/1506039981 shutdown_connections 2024-09-12T02:37:19.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.963+0000 7f35bd0af640 1 -- 172.21.15.60:0/1506039981 >> 172.21.15.60:0/1506039981 conn(0x7f35b80a9780 msgr2=0x7f35b80a9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:19.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.964+0000 7f35bd0af640 1 -- 172.21.15.60:0/1506039981 shutdown_connections 2024-09-12T02:37:19.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.964+0000 7f35bd0af640 1 -- 172.21.15.60:0/1506039981 wait complete. 2024-09-12T02:37:19.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.966+0000 7f35bd0af640 1 Processor -- start 2024-09-12T02:37:19.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.966+0000 7f35bd0af640 1 -- start start 2024-09-12T02:37:19.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.967+0000 7f35bd0af640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35a0004380 0x7f35b8074560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:19.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.967+0000 7f35bd0af640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35b820a300 0x7f35b8163f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:19.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.967+0000 7f35bd0af640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35b80ab4a0 0x7f35b80ab950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:19.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.967+0000 7f35bd0af640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f35b80c7370 con 0x7f35a0004380 2024-09-12T02:37:19.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.967+0000 7f35bd0af640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f35b80c71f0 con 0x7f35b80ab4a0 2024-09-12T02:37:19.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.967+0000 7f35bd0af640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f35b80a7390 con 0x7f35b820a300 2024-09-12T02:37:19.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.968+0000 7f35b7fff640 1 -- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35a0004380 msgr2=0x7f35b8074560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:3300/0 2024-09-12T02:37:19.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.968+0000 7f35b7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35a0004380 0x7f35b8074560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:37:19.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.968+0000 7f35b77fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35b820a300 0x7f35b8163f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:19.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.968+0000 7f35b77fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35b820a300 0x7f35b8163f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:38850/0 (socket says 172.21.15.60:38850) 2024-09-12T02:37:19.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.968+0000 7f35b77fe640 1 -- 172.21.15.60:0/1606375510 learned_addr learned my addr 172.21.15.60:0/1606375510 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:37:19.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.968+0000 7f35bc8ae640 1 --2- 172.21.15.60:0/1606375510 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35b80ab4a0 0x7f35b80ab950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:19.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.970+0000 7f35b77fe640 1 -- 172.21.15.60:0/1606375510 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35b80ab4a0 msgr2=0x7f35b80ab950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:19.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.970+0000 7f35b77fe640 1 --2- 172.21.15.60:0/1606375510 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35b80ab4a0 0x7f35b80ab950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:19.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.970+0000 7f35b77fe640 1 -- 172.21.15.60:0/1606375510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35a0004380 msgr2=0x7f35b8074560 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:37:19.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.970+0000 7f35b77fe640 1 --2- 172.21.15.60:0/1606375510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35a0004380 0x7f35b8074560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:19.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.970+0000 7f35b77fe640 1 -- 172.21.15.60:0/1606375510 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35b820d5b0 con 0x7f35b820a300 2024-09-12T02:37:19.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.971+0000 7f35b77fe640 1 --2- 172.21.15.60:0/1606375510 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35b820a300 0x7f35b8163f10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f35b002f9d0 tx=0x7f35b0001cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:19.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.972+0000 7f35b4ff9640 1 -- 172.21.15.60:0/1606375510 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b0045070 con 0x7f35b820a300 2024-09-12T02:37:19.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.972+0000 7f35bd0af640 1 -- 172.21.15.60:0/1606375510 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35b820d890 con 0x7f35b820a300 2024-09-12T02:37:19.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.972+0000 7f35bd0af640 1 -- 172.21.15.60:0/1606375510 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f35b8209b00 con 0x7f35b820a300 2024-09-12T02:37:19.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.972+0000 7f35b4ff9640 1 -- 172.21.15.60:0/1606375510 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35b00019c0 con 0x7f35b820a300 2024-09-12T02:37:19.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.972+0000 7f35b4ff9640 1 -- 172.21.15.60:0/1606375510 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b000a4e0 con 0x7f35b820a300 2024-09-12T02:37:19.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.975+0000 7f35b4ff9640 1 -- 172.21.15.60:0/1606375510 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f35b0038470 con 0x7f35b820a300 2024-09-12T02:37:19.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.975+0000 7f35b4ff9640 1 --2- 172.21.15.60:0/1606375510 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f35a006d730 0x7f35a006fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:19.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.976+0000 7f35b7fff640 1 --2- 172.21.15.60:0/1606375510 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f35a006d730 0x7f35a006fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:19.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.976+0000 7f35b4ff9640 1 -- 172.21.15.60:0/1606375510 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f35b00ab330 con 0x7f35b820a300 2024-09-12T02:37:19.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.978+0000 7f35bd0af640 1 --2- 172.21.15.60:0/1606375510 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3598002a70 0x7f3598004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:19.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.978+0000 7f35bd0af640 1 -- 172.21.15.60:0/1606375510 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3598007ec0 con 0x7f3598002a70 2024-09-12T02:37:19.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.978+0000 7f35bc8ae640 1 --2- 172.21.15.60:0/1606375510 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3598002a70 0x7f3598004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:19.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.979+0000 7f35bc8ae640 1 -- 172.21.15.60:0/1606375510 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f35980080c0 con 0x7f3598002a70 2024-09-12T02:37:19.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.982+0000 7f35bc8ae640 1 --2- 172.21.15.60:0/1606375510 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3598002a70 0x7f3598004f30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f35b80adcc0 tx=0x7f35ac003e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:19.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.983+0000 7f35b7fff640 1 --2- 172.21.15.60:0/1606375510 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f35a006d730 0x7f35a006fbf0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f35b81647f0 tx=0x7f35a8006d90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:19.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.983+0000 7f35b4ff9640 1 -- 172.21.15.60:0/1606375510 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35ac01a020 con 0x7f3598002a70 2024-09-12T02:37:19.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.986+0000 7f35b4ff9640 1 -- 172.21.15.60:0/1606375510 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f35ac00b890 con 0x7f3598002a70 2024-09-12T02:37:19.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.986+0000 7f35b4ff9640 1 -- 172.21.15.60:0/1606375510 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3598002a70 msgr2=0x7f3598004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:19.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.986+0000 7f35b4ff9640 1 --2- 172.21.15.60:0/1606375510 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3598002a70 0x7f3598004f30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f35b80adcc0 tx=0x7f35ac003e10 comp rx=0 tx=0).stop 2024-09-12T02:37:19.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.986+0000 7f35b4ff9640 1 -- 172.21.15.60:0/1606375510 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3598002a70 msgr2=0x7f3598004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:37:19.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:19.986+0000 7f35b4ff9640 1 --2- 172.21.15.60:0/1606375510 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3598002a70 0x7f3598004f30 secure :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f35b80adcc0 tx=0x7f35ac003e10 comp rx=0 tx=0).stop 2024-09-12T02:37:20.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:20.022+0000 7f35bd0af640 1 --2- 172.21.15.60:0/1606375510 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3598006eb0 0x7f3598007340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:20.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:20.022+0000 7f35bd0af640 1 -- 172.21.15.60:0/1606375510 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f359800a4a0 con 0x7f3598006eb0 2024-09-12T02:37:20.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:20.023+0000 7f35bc8ae640 1 --2- 172.21.15.60:0/1606375510 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3598006eb0 0x7f3598007340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:20.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:20.025+0000 7f35bc8ae640 1 -- 172.21.15.60:0/1606375510 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3598007880 con 0x7f3598006eb0 2024-09-12T02:37:20.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:20.025+0000 7f35bc8ae640 1 --2- 172.21.15.60:0/1606375510 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3598006eb0 0x7f3598007340 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3598008090 tx=0x7f35ac0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:20.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:20.026+0000 7f35b4ff9640 1 -- 172.21.15.60:0/1606375510 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35ac01a030 con 0x7f3598006eb0 2024-09-12T02:37:20.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:20.026+0000 7f35b4ff9640 1 -- 172.21.15.60:0/1606375510 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5040 (secure 0 0 0) 0x7f35ac021220 con 0x7f3598006eb0 2024-09-12T02:37:20.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:20.026+0000 7f35b4ff9640 1 -- 172.21.15.60:0/1606375510 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3598006eb0 msgr2=0x7f3598007340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:20.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:20.026+0000 7f35b4ff9640 1 --2- 172.21.15.60:0/1606375510 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3598006eb0 0x7f3598007340 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3598008090 tx=0x7f35ac0046c0 comp rx=0 tx=0).stop 2024-09-12T02:37:20.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:20.026+0000 7f35b4ff9640 1 -- 172.21.15.60:0/1606375510 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3598006eb0 msgr2=0x7f3598007340 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:37:20.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:20.026+0000 7f35b4ff9640 1 --2- 172.21.15.60:0/1606375510 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3598006eb0 0x7f3598007340 secure :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3598008090 tx=0x7f35ac0046c0 comp rx=0 tx=0).stop 2024-09-12T02:37:20.027 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:37:20.027 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:37:20.028 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:37:20.028 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:37:20.028 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 138, 2024-09-12T02:37:20.028 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 313780, 2024-09-12T02:37:20.028 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:37:20.028 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:37:20.028 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:37:20.028 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:20.029 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 1, 2024-09-12T02:37:20.029 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:37:20.029 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:37:20.029 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:37:20.029 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:37:20.029 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:37:20.029 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:37:20.029 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:37:20.029 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:37:20.029 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:37:20.029 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:37:20.029 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:37:20.030 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:37:20.030 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:37:20.030 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:37:20.030 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:20.030 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:37:20.030 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:37:20.030 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:37:20.030 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:37:20.030 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:37:20.030 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:37:20.030 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:37:20.030 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:37:20.030 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:37:20.030 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:37:20.031 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:37:20.031 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:37:20.031 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:37:20.031 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:20.031 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:20.031 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:37:20.031 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:37:20.031 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:37:20.031 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:37:20.031 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:37:20.031 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:37:20.031 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:37:20.031 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:37:20.032 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:37:20.032 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:37:20.032 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:37:20.032 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:37:20.032 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:37:20.032 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:37:20.032 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:37:20.032 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:37:20.032 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:37:20.032 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:37:20.032 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:37:20.032 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:37:20.032 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:37:20.032 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:37:20.033 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:37:20.033 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:37:20.033 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:37:20.033 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:37:20.033 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:37:20.033 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:37:20.033 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:20.033 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:37:20.033 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:20.033 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:37:20.033 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:20.033 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:37:20.033 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:37:20.034 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:37:20.034 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:37:20.034 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:20.034 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:37:20.034 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:37:20.034 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:20.034 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:20.034 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:20.034 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:37:20.034 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:37:20.034 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:20.034 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:20.034 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:20.035 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:20.035 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:37:20.035 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:37:20.035 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:37:20.035 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:37:20.035 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:37:20.035 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:20.035 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:20.035 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:37:20.035 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:37:20.035 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:37:20.035 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:37:20.036 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:20.036 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:37:20.036 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:37:20.036 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:20.036 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:20.036 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:20.036 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:37:20.036 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:37:20.036 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:20.036 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:20.036 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:20.036 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:20.036 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:37:20.037 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:37:20.037 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:37:20.037 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:37:20.037 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:37:20.037 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:20.037 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:20.037 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:37:20.037 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:37:20.037 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:37:20.037 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:37:20.037 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:20.037 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:37:20.037 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:37:20.038 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:20.038 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:20.038 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:20.038 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:37:20.038 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:37:20.038 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:20.038 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:20.038 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:20.038 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:20.038 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:37:20.038 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:37:20.038 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:37:20.039 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:37:20.039 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:37:20.039 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:20.039 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:20.039 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:20.039 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:37:20.039 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:37:20.039 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:20.039 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:37:20.039 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:37:20.039 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:37:20.039 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:20.039 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:20.040 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:37:20.040 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:20.040 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:37:20.040 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:37:20.040 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:37:20.040 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:20.040 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:20.040 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:37:20.040 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:20.040 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:37:20.040 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:37:20.040 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-09-12T02:37:20.041 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:20.041 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:20.041 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:37:20.041 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:20.041 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:37:20.041 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:37:20.041 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 8 2024-09-12T02:37:20.041 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:20.041 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:20.041 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:37:20.041 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:20.041 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:37:20.041 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:37:20.042 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:37:20.042 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:20.042 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:20.042 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:20.042 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:37:20.042 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:37:20.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:20.027+0000 7f359e7fc640 1 -- 172.21.15.60:0/1606375510 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f35a006d730 msgr2=0x7f35a006fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:20.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:20.027+0000 7f359e7fc640 1 --2- 172.21.15.60:0/1606375510 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f35a006d730 0x7f35a006fbf0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f35b81647f0 tx=0x7f35a8006d90 comp rx=0 tx=0).stop 2024-09-12T02:37:20.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:20.027+0000 7f35bc8ae640 1 -- 172.21.15.60:0/1606375510 reap_dead start 2024-09-12T02:37:20.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:20.027+0000 7f359e7fc640 1 -- 172.21.15.60:0/1606375510 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35b820a300 msgr2=0x7f35b8163f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:20.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:20.027+0000 7f359e7fc640 1 --2- 172.21.15.60:0/1606375510 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35b820a300 0x7f35b8163f10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f35b002f9d0 tx=0x7f35b0001cf0 comp rx=0 tx=0).stop 2024-09-12T02:37:20.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:20.031+0000 7f359e7fc640 1 -- 172.21.15.60:0/1606375510 shutdown_connections 2024-09-12T02:37:20.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:20.031+0000 7f359e7fc640 1 --2- 172.21.15.60:0/1606375510 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35b820a300 0x7f35b8163f10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:20.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:20.031+0000 7f359e7fc640 1 -- 172.21.15.60:0/1606375510 >> 172.21.15.60:0/1606375510 conn(0x7f35b80a9780 msgr2=0x7f35b80a9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:20.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:20.031+0000 7f359e7fc640 1 -- 172.21.15.60:0/1606375510 shutdown_connections 2024-09-12T02:37:20.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:20.031+0000 7f359e7fc640 1 -- 172.21.15.60:0/1606375510 wait complete. 2024-09-12T02:37:20.056 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-12T02:37:20.056 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-12T02:37:31.771 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:37:31.774 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:37:40.057 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-12T02:37:40.057 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-09-12T02:37:40.057 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T02:37:40.058 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T02:37:40.062 INFO:tasks.ceph.mon.a:Started 2024-09-12T02:37:40.062 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-12T02:37:40.062 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:37:40.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.252+0000 7faf85c47640 1 Processor -- start 2024-09-12T02:37:40.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.252+0000 7faf85c47640 1 -- start start 2024-09-12T02:37:40.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.254+0000 7faf85c47640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7faf80157190 0x7faf8015ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:40.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.254+0000 7faf85c47640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf80070590 con 0x7faf800c4680 2024-09-12T02:37:40.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.254+0000 7faf85c47640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf800a8220 con 0x7faf800acc30 2024-09-12T02:37:40.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.254+0000 7faf85c47640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7faf800c4ea0 con 0x7faf80157190 2024-09-12T02:37:40.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.255+0000 7faf7f7fe640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7faf800acc30 0x7faf800c3f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:55266/0 (socket says 172.21.15.60:55266) 2024-09-12T02:37:40.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.255+0000 7faf7f7fe640 1 -- 172.21.15.60:0/905690521 learned_addr learned my addr 172.21.15.60:0/905690521 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:37:40.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.256+0000 7faf7effd640 1 -- 172.21.15.60:0/905690521 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2516724213 0 0) 0x7faf800a8220 con 0x7faf800acc30 2024-09-12T02:37:40.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.256+0000 7faf7ffff640 1 --2- 172.21.15.60:0/905690521 >> v2:172.21.15.60:3300/0 conn(0x7faf80157190 0x7faf8015ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:40.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.256+0000 7faf7effd640 1 -- 172.21.15.60:0/905690521 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf6c003520 con 0x7faf800acc30 2024-09-12T02:37:40.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.257+0000 7faf7effd640 1 -- 172.21.15.60:0/905690521 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 259700574 0 0) 0x7faf6c003520 con 0x7faf800acc30 2024-09-12T02:37:40.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.257+0000 7faf7effd640 1 -- 172.21.15.60:0/905690521 >> v2:172.21.15.60:3300/0 conn(0x7faf80157190 msgr2=0x7faf8015ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:40.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.257+0000 7faf7effd640 1 --2- 172.21.15.60:0/905690521 >> v2:172.21.15.60:3300/0 conn(0x7faf80157190 0x7faf8015ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:40.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.257+0000 7faf7effd640 1 -- 172.21.15.60:0/905690521 >> v1:172.21.15.60:6789/0 conn(0x7faf800c4680 legacy=0x7faf80156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:40.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.257+0000 7faf7effd640 1 -- 172.21.15.60:0/905690521 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf800a84f0 con 0x7faf800acc30 2024-09-12T02:37:40.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.257+0000 7faf7effd640 1 -- 172.21.15.60:0/905690521 <== mon.1 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7faf68001670 con 0x7faf800acc30 2024-09-12T02:37:40.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.257+0000 7faf7effd640 1 -- 172.21.15.60:0/905690521 >> v1:172.21.15.105:6789/0 conn(0x7faf800acc30 legacy=0x7faf800c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:40.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.257+0000 7faf7effd640 1 --2- 172.21.15.60:0/905690521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf6c003a00 0x7faf6c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:40.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.257+0000 7faf7effd640 1 --2- 172.21.15.60:0/905690521 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf6c004800 0x7faf6c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:40.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.257+0000 7faf7effd640 1 --2- 172.21.15.60:0/905690521 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf6c005410 0x7faf6c00ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:40.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.257+0000 7faf7effd640 1 -- 172.21.15.60:0/905690521 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7faf6c00c320 con 0x7faf6c003a00 2024-09-12T02:37:40.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.257+0000 7faf7effd640 1 -- 172.21.15.60:0/905690521 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7faf6c00c4d0 con 0x7faf6c004800 2024-09-12T02:37:40.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.258+0000 7faf7effd640 1 -- 172.21.15.60:0/905690521 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7faf6c00c6d0 con 0x7faf6c005410 2024-09-12T02:37:40.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.260+0000 7faf7ffff640 1 --2- 172.21.15.60:0/905690521 >> v2:172.21.15.60:3300/0 conn(0x7faf80157190 0x7faf8015ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:37:40.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.260+0000 7faf76ffd640 1 --2- 172.21.15.60:0/905690521 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf6c004800 0x7faf6c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:40.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.261+0000 7faf7ffff640 1 --2- 172.21.15.60:0/905690521 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf6c005410 0x7faf6c00ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:40.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.261+0000 7faf76ffd640 1 -- 172.21.15.60:0/905690521 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf6c005410 msgr2=0x7faf6c00ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:40.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.261+0000 7faf76ffd640 1 --2- 172.21.15.60:0/905690521 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf6c005410 0x7faf6c00ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:40.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.261+0000 7faf76ffd640 1 -- 172.21.15.60:0/905690521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf6c003a00 msgr2=0x7faf6c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:40.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.261+0000 7faf76ffd640 1 --2- 172.21.15.60:0/905690521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf6c003a00 0x7faf6c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:40.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.261+0000 7faf76ffd640 1 -- 172.21.15.60:0/905690521 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf6c003520 con 0x7faf6c004800 2024-09-12T02:37:40.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.262+0000 7faf7ffff640 1 -- 172.21.15.60:0/905690521 reap_dead start 2024-09-12T02:37:40.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.263+0000 7faf76ffd640 1 --2- 172.21.15.60:0/905690521 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf6c004800 0x7faf6c004c80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7faf700044b0 tx=0x7faf6c005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1df8b570eebda60f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:40.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.263+0000 7faf7effd640 1 -- 172.21.15.60:0/905690521 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf70004080 con 0x7faf6c004800 2024-09-12T02:37:40.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.263+0000 7faf7effd640 1 -- 172.21.15.60:0/905690521 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf7002ada0 con 0x7faf6c004800 2024-09-12T02:37:40.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.263+0000 7faf7effd640 1 -- 172.21.15.60:0/905690521 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf70006d70 con 0x7faf6c004800 2024-09-12T02:37:40.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.264+0000 7faf85c47640 1 -- 172.21.15.60:0/905690521 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf6c004800 msgr2=0x7faf6c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:40.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.264+0000 7faf85c47640 1 --2- 172.21.15.60:0/905690521 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf6c004800 0x7faf6c004c80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7faf700044b0 tx=0x7faf6c005830 comp rx=0 tx=0).stop 2024-09-12T02:37:40.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.265+0000 7faf85c47640 1 -- 172.21.15.60:0/905690521 shutdown_connections 2024-09-12T02:37:40.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.265+0000 7faf85c47640 1 --2- 172.21.15.60:0/905690521 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf6c004800 0x7faf6c004c80 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:40.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.265+0000 7faf85c47640 1 -- 172.21.15.60:0/905690521 >> 172.21.15.60:0/905690521 conn(0x7faf800c5660 msgr2=0x7faf800c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:40.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.265+0000 7faf85c47640 1 -- 172.21.15.60:0/905690521 shutdown_connections 2024-09-12T02:37:40.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.266+0000 7faf85c47640 1 -- 172.21.15.60:0/905690521 wait complete. 2024-09-12T02:37:40.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.268+0000 7faf85c47640 1 Processor -- start 2024-09-12T02:37:40.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.269+0000 7faf85c47640 1 -- start start 2024-09-12T02:37:40.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.270+0000 7faf85c47640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf6c004800 0x7faf8006bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:40.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.270+0000 7faf85c47640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf801443e0 0x7faf8006cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:40.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.270+0000 7faf85c47640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf8006d9a0 0x7faf80148ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:40.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.270+0000 7faf76ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf801443e0 0x7faf8006cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:40.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.270+0000 7faf76ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf801443e0 0x7faf8006cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:52350/0 (socket says 172.21.15.60:52350) 2024-09-12T02:37:40.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.270+0000 7faf76ffd640 1 -- 172.21.15.60:0/228327594 learned_addr learned my addr 172.21.15.60:0/228327594 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:37:40.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.270+0000 7faf85c47640 1 -- 172.21.15.60:0/228327594 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7faf800c5330 con 0x7faf8006d9a0 2024-09-12T02:37:40.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.270+0000 7faf85c47640 1 -- 172.21.15.60:0/228327594 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7faf800702b0 con 0x7faf801443e0 2024-09-12T02:37:40.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.271+0000 7faf85c47640 1 -- 172.21.15.60:0/228327594 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7faf800c63f0 con 0x7faf6c004800 2024-09-12T02:37:40.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.273+0000 7faf76ffd640 1 -- 172.21.15.60:0/228327594 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf6c004800 msgr2=0x7faf8006bfc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:37:40.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.273+0000 7faf76ffd640 1 --2- 172.21.15.60:0/228327594 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf6c004800 0x7faf8006bfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:40.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.273+0000 7faf76ffd640 1 -- 172.21.15.60:0/228327594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf8006d9a0 msgr2=0x7faf80148ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:40.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.273+0000 7faf76ffd640 1 --2- 172.21.15.60:0/228327594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf8006d9a0 0x7faf80148ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:40.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.273+0000 7faf76ffd640 1 -- 172.21.15.60:0/228327594 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf80145410 con 0x7faf801443e0 2024-09-12T02:37:40.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.274+0000 7faf76ffd640 1 --2- 172.21.15.60:0/228327594 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf801443e0 0x7faf8006cd50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7faf70034040 tx=0x7faf70003a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:40.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.274+0000 7faf7cff9640 1 -- 172.21.15.60:0/228327594 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf70042020 con 0x7faf801443e0 2024-09-12T02:37:40.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.274+0000 7faf85c47640 1 -- 172.21.15.60:0/228327594 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf8014a840 con 0x7faf801443e0 2024-09-12T02:37:40.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.274+0000 7faf85c47640 1 -- 172.21.15.60:0/228327594 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf8006fd20 con 0x7faf801443e0 2024-09-12T02:37:40.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.274+0000 7faf7cff9640 1 -- 172.21.15.60:0/228327594 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf70032c50 con 0x7faf801443e0 2024-09-12T02:37:40.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.277+0000 7faf7cff9640 1 -- 172.21.15.60:0/228327594 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7003e470 con 0x7faf801443e0 2024-09-12T02:37:40.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.278+0000 7faf7cff9640 1 -- 172.21.15.60:0/228327594 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faf70045020 con 0x7faf801443e0 2024-09-12T02:37:40.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.278+0000 7faf85c47640 1 -- 172.21.15.60:0/228327594 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf64005290 con 0x7faf801443e0 2024-09-12T02:37:40.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.279+0000 7faf7cff9640 1 --2- 172.21.15.60:0/228327594 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7faf6006bf60 0x7faf6006e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:40.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.280+0000 7faf7f7fe640 1 --2- 172.21.15.60:0/228327594 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7faf6006bf60 0x7faf6006e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:40.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.280+0000 7faf7f7fe640 1 --2- 172.21.15.60:0/228327594 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7faf6006bf60 0x7faf6006e420 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7faf8006b790 tx=0x7faf68001430 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:40.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.281+0000 7faf7cff9640 1 -- 172.21.15.60:0/228327594 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7faf700abea0 con 0x7faf801443e0 2024-09-12T02:37:40.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.288+0000 7faf7cff9640 1 -- 172.21.15.60:0/228327594 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faf7004c030 con 0x7faf801443e0 2024-09-12T02:37:40.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.830+0000 7faf85c47640 1 -- 172.21.15.60:0/228327594 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7faf64005580 con 0x7faf801443e0 2024-09-12T02:37:40.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.833+0000 7faf7cff9640 1 -- 172.21.15.60:0/228327594 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1560 (secure 0 0 0) 0x7faf7007a5b0 con 0x7faf801443e0 2024-09-12T02:37:40.834 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":138,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":22,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:37:40.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.839+0000 7faf75ffb640 1 -- 172.21.15.60:0/228327594 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7faf6006bf60 msgr2=0x7faf6006e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:40.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.839+0000 7faf75ffb640 1 --2- 172.21.15.60:0/228327594 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7faf6006bf60 0x7faf6006e420 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7faf8006b790 tx=0x7faf68001430 comp rx=0 tx=0).stop 2024-09-12T02:37:40.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.839+0000 7faf75ffb640 1 -- 172.21.15.60:0/228327594 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf801443e0 msgr2=0x7faf8006cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:40.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.839+0000 7faf75ffb640 1 --2- 172.21.15.60:0/228327594 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf801443e0 0x7faf8006cd50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7faf70034040 tx=0x7faf70003a70 comp rx=0 tx=0).stop 2024-09-12T02:37:40.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.840+0000 7faf75ffb640 1 -- 172.21.15.60:0/228327594 shutdown_connections 2024-09-12T02:37:40.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.840+0000 7faf75ffb640 1 --2- 172.21.15.60:0/228327594 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7faf6006bf60 0x7faf6006e420 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:40.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.840+0000 7faf75ffb640 1 --2- 172.21.15.60:0/228327594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf8006d9a0 0x7faf80148ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:40.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.840+0000 7faf75ffb640 1 --2- 172.21.15.60:0/228327594 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf801443e0 0x7faf8006cd50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:40.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.840+0000 7faf75ffb640 1 --2- 172.21.15.60:0/228327594 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf6c004800 0x7faf8006bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:40.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.840+0000 7faf75ffb640 1 -- 172.21.15.60:0/228327594 >> 172.21.15.60:0/228327594 conn(0x7faf800c5660 msgr2=0x7faf80072fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:40.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.841+0000 7faf75ffb640 1 -- 172.21.15.60:0/228327594 shutdown_connections 2024-09-12T02:37:40.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:40.841+0000 7faf75ffb640 1 -- 172.21.15.60:0/228327594 wait complete. 2024-09-12T02:37:43.868 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:37:44.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.073+0000 7fb71d931640 1 Processor -- start 2024-09-12T02:37:44.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.073+0000 7fb71d931640 1 -- start start 2024-09-12T02:37:44.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.074+0000 7fb71d931640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb7181561f0 0x7fb718156640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:44.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.074+0000 7fb71d931640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7180c4c10 con 0x7fb7180c3990 2024-09-12T02:37:44.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.074+0000 7fb71d931640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7181597e0 con 0x7fb718153ad0 2024-09-12T02:37:44.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.074+0000 7fb71d931640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fb718153eb0 con 0x7fb7181561f0 2024-09-12T02:37:44.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.077+0000 7fb7177fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb7181561f0 0x7fb718156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:44.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.077+0000 7fb7177fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb7181561f0 0x7fb718156640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44732/0 (socket says 172.21.15.60:44732) 2024-09-12T02:37:44.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.077+0000 7fb7177fe640 1 -- 172.21.15.60:0/2160145293 learned_addr learned my addr 172.21.15.60:0/2160145293 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:37:44.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.077+0000 7fb7177fe640 1 -- 172.21.15.60:0/2160145293 >> v2:172.21.15.60:3300/0 conn(0x7fb7181561f0 msgr2=0x7fb718156640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:37:44.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.077+0000 7fb7177fe640 1 -- 172.21.15.60:0/2160145293 >> v2:172.21.15.60:3300/0 conn(0x7fb7181561f0 msgr2=0x7fb718156640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:37:44.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.077+0000 7fb7177fe640 1 --2- 172.21.15.60:0/2160145293 >> v2:172.21.15.60:3300/0 conn(0x7fb7181561f0 0x7fb718156640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:37:44.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.077+0000 7fb7177fe640 1 --2- 172.21.15.60:0/2160145293 >> v2:172.21.15.60:3300/0 conn(0x7fb7181561f0 0x7fb718156640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:37:44.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.078+0000 7fb715ffb640 1 -- 172.21.15.60:0/2160145293 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1641502690 0 0) 0x7fb7181597e0 con 0x7fb718153ad0 2024-09-12T02:37:44.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.078+0000 7fb715ffb640 1 -- 172.21.15.60:0/2160145293 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb700003520 con 0x7fb718153ad0 2024-09-12T02:37:44.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.084+0000 7fb715ffb640 1 -- 172.21.15.60:0/2160145293 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 603352887 0 0) 0x7fb700003520 con 0x7fb718153ad0 2024-09-12T02:37:44.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.084+0000 7fb715ffb640 1 -- 172.21.15.60:0/2160145293 >> v2:172.21.15.60:3300/0 conn(0x7fb7181561f0 msgr2=0x7fb718156640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:37:44.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.084+0000 7fb715ffb640 1 --2- 172.21.15.60:0/2160145293 >> v2:172.21.15.60:3300/0 conn(0x7fb7181561f0 0x7fb718156640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:44.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.084+0000 7fb715ffb640 1 -- 172.21.15.60:0/2160145293 >> v1:172.21.15.60:6789/0 conn(0x7fb7180c3990 legacy=0x7fb71806ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:44.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.084+0000 7fb715ffb640 1 -- 172.21.15.60:0/2160145293 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb718159ac0 con 0x7fb718153ad0 2024-09-12T02:37:44.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.084+0000 7fb715ffb640 1 -- 172.21.15.60:0/2160145293 <== mon.1 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7fb708001670 con 0x7fb718153ad0 2024-09-12T02:37:44.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.085+0000 7fb715ffb640 1 -- 172.21.15.60:0/2160145293 >> v1:172.21.15.105:6789/0 conn(0x7fb718153ad0 legacy=0x7fb7180c4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:44.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.085+0000 7fb715ffb640 1 --2- 172.21.15.60:0/2160145293 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7000039b0 0x7fb700003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:44.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.085+0000 7fb715ffb640 1 --2- 172.21.15.60:0/2160145293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb700004800 0x7fb700004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:44.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.085+0000 7fb715ffb640 1 --2- 172.21.15.60:0/2160145293 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb7000052e0 0x7fb7000141d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:44.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.085+0000 7fb715ffb640 1 -- 172.21.15.60:0/2160145293 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb718153eb0 con 0x7fb700004800 2024-09-12T02:37:44.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.085+0000 7fb715ffb640 1 -- 172.21.15.60:0/2160145293 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb7000149c0 con 0x7fb7000052e0 2024-09-12T02:37:44.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.085+0000 7fb715ffb640 1 -- 172.21.15.60:0/2160145293 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb700014bc0 con 0x7fb7000039b0 2024-09-12T02:37:44.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.085+0000 7fb7167fc640 1 --2- 172.21.15.60:0/2160145293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb700004800 0x7fb700004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:44.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.086+0000 7fb7167fc640 1 -- 172.21.15.60:0/2160145293 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7000039b0 msgr2=0x7fb700003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:44.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.086+0000 7fb7167fc640 1 --2- 172.21.15.60:0/2160145293 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7000039b0 0x7fb700003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:44.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.086+0000 7fb7167fc640 1 -- 172.21.15.60:0/2160145293 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb7000052e0 msgr2=0x7fb7000141d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:44.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.086+0000 7fb7167fc640 1 --2- 172.21.15.60:0/2160145293 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb7000052e0 0x7fb7000141d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:44.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.086+0000 7fb7167fc640 1 -- 172.21.15.60:0/2160145293 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb718159ac0 con 0x7fb700004800 2024-09-12T02:37:44.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.089+0000 7fb7177fe640 1 -- 172.21.15.60:0/2160145293 reap_dead start 2024-09-12T02:37:44.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.090+0000 7fb7167fc640 1 --2- 172.21.15.60:0/2160145293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb700004800 0x7fb700004c80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb70c001720 tx=0x7fb700005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c012d6c9a95e8841 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:44.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.091+0000 7fb715ffb640 1 -- 172.21.15.60:0/2160145293 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70c001370 con 0x7fb700004800 2024-09-12T02:37:44.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.091+0000 7fb715ffb640 1 -- 172.21.15.60:0/2160145293 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb70c0052f0 con 0x7fb700004800 2024-09-12T02:37:44.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.091+0000 7fb715ffb640 1 -- 172.21.15.60:0/2160145293 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70c02abc0 con 0x7fb700004800 2024-09-12T02:37:44.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.092+0000 7fb71d931640 1 -- 172.21.15.60:0/2160145293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb700004800 msgr2=0x7fb700004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:44.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.092+0000 7fb71d931640 1 --2- 172.21.15.60:0/2160145293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb700004800 0x7fb700004c80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb70c001720 tx=0x7fb700005830 comp rx=0 tx=0).stop 2024-09-12T02:37:44.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.100+0000 7fb71d931640 1 -- 172.21.15.60:0/2160145293 shutdown_connections 2024-09-12T02:37:44.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.100+0000 7fb71d931640 1 --2- 172.21.15.60:0/2160145293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb700004800 0x7fb700004c80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:44.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.100+0000 7fb71d931640 1 -- 172.21.15.60:0/2160145293 >> 172.21.15.60:0/2160145293 conn(0x7fb7180c7a40 msgr2=0x7fb7180c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:44.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.103+0000 7fb71d931640 1 -- 172.21.15.60:0/2160145293 shutdown_connections 2024-09-12T02:37:44.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.104+0000 7fb71d931640 1 -- 172.21.15.60:0/2160145293 wait complete. 2024-09-12T02:37:44.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.105+0000 7fb71d931640 1 Processor -- start 2024-09-12T02:37:44.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.106+0000 7fb71d931640 1 -- start start 2024-09-12T02:37:44.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.107+0000 7fb71d931640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb700004800 0x7fb7181509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:44.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.107+0000 7fb71d931640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb718150f20 0x7fb718157f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:44.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.107+0000 7fb71d931640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7181584c0 0x7fb718151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:44.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.107+0000 7fb71d931640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb71815a5a0 con 0x7fb718150f20 2024-09-12T02:37:44.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.107+0000 7fb71d931640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb71815a080 con 0x7fb700004800 2024-09-12T02:37:44.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.107+0000 7fb71d931640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb718148160 con 0x7fb7181584c0 2024-09-12T02:37:44.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.107+0000 7fb716ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb700004800 0x7fb7181509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:44.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.108+0000 7fb7177fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7181584c0 0x7fb718151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:44.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.108+0000 7fb7177fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7181584c0 0x7fb718151560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:51346/0 (socket says 172.21.15.60:51346) 2024-09-12T02:37:44.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.108+0000 7fb7177fe640 1 -- 172.21.15.60:0/3948220614 learned_addr learned my addr 172.21.15.60:0/3948220614 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:37:44.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.108+0000 7fb7167fc640 1 --2- 172.21.15.60:0/3948220614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb718150f20 0x7fb718157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:44.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.108+0000 7fb7177fe640 1 -- 172.21.15.60:0/3948220614 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb700004800 msgr2=0x7fb7181509e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:44.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.108+0000 7fb7177fe640 1 --2- 172.21.15.60:0/3948220614 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb700004800 0x7fb7181509e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:44.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.108+0000 7fb7177fe640 1 -- 172.21.15.60:0/3948220614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb718150f20 msgr2=0x7fb718157f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:44.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.108+0000 7fb7177fe640 1 --2- 172.21.15.60:0/3948220614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb718150f20 0x7fb718157f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:44.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.108+0000 7fb7177fe640 1 -- 172.21.15.60:0/3948220614 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb71814fd60 con 0x7fb7181584c0 2024-09-12T02:37:44.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.108+0000 7fb716ffd640 1 --2- 172.21.15.60:0/3948220614 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb700004800 0x7fb7181509e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:37:44.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.108+0000 7fb7177fe640 1 --2- 172.21.15.60:0/3948220614 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7181584c0 0x7fb718151560 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb7100096d0 tx=0x7fb710007e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:44.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.111+0000 7fb6fffff640 1 -- 172.21.15.60:0/3948220614 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb710003990 con 0x7fb7181584c0 2024-09-12T02:37:44.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.111+0000 7fb6fffff640 1 -- 172.21.15.60:0/3948220614 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb710003b30 con 0x7fb7181584c0 2024-09-12T02:37:44.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.111+0000 7fb6fffff640 1 -- 172.21.15.60:0/3948220614 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71000c880 con 0x7fb7181584c0 2024-09-12T02:37:44.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.111+0000 7fb71d931640 1 -- 172.21.15.60:0/3948220614 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7181577f0 con 0x7fb7181584c0 2024-09-12T02:37:44.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.111+0000 7fb71d931640 1 -- 172.21.15.60:0/3948220614 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb718151aa0 con 0x7fb7181584c0 2024-09-12T02:37:44.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.113+0000 7fb71d931640 1 -- 172.21.15.60:0/3948220614 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6f8005290 con 0x7fb7181584c0 2024-09-12T02:37:44.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.117+0000 7fb6fffff640 1 -- 172.21.15.60:0/3948220614 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb71001a020 con 0x7fb7181584c0 2024-09-12T02:37:44.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.117+0000 7fb6fffff640 1 --2- 172.21.15.60:0/3948220614 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb70406bf30 0x7fb70406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:44.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.118+0000 7fb6fffff640 1 -- 172.21.15.60:0/3948220614 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fb71008aec0 con 0x7fb7181584c0 2024-09-12T02:37:44.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.118+0000 7fb716ffd640 1 --2- 172.21.15.60:0/3948220614 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb70406bf30 0x7fb70406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:44.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.119+0000 7fb716ffd640 1 --2- 172.21.15.60:0/3948220614 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb70406bf30 0x7fb70406e3f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb71814deb0 tx=0x7fb708009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:44.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.123+0000 7fb6fffff640 1 -- 172.21.15.60:0/3948220614 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb710021070 con 0x7fb7181584c0 2024-09-12T02:37:44.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.655+0000 7fb71d931640 1 -- 172.21.15.60:0/3948220614 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb6f8005580 con 0x7fb7181584c0 2024-09-12T02:37:44.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.656+0000 7fb6fffff640 1 -- 172.21.15.60:0/3948220614 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1560 (secure 0 0 0) 0x7fb710059540 con 0x7fb7181584c0 2024-09-12T02:37:44.657 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":138,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":26,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:37:44.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.660+0000 7fb6fdffb640 1 -- 172.21.15.60:0/3948220614 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb70406bf30 msgr2=0x7fb70406e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:44.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.660+0000 7fb6fdffb640 1 --2- 172.21.15.60:0/3948220614 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb70406bf30 0x7fb70406e3f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb71814deb0 tx=0x7fb708009040 comp rx=0 tx=0).stop 2024-09-12T02:37:44.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.661+0000 7fb6fdffb640 1 -- 172.21.15.60:0/3948220614 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7181584c0 msgr2=0x7fb718151560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:44.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.661+0000 7fb6fdffb640 1 --2- 172.21.15.60:0/3948220614 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7181584c0 0x7fb718151560 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb7100096d0 tx=0x7fb710007e20 comp rx=0 tx=0).stop 2024-09-12T02:37:44.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.662+0000 7fb6fdffb640 1 -- 172.21.15.60:0/3948220614 shutdown_connections 2024-09-12T02:37:44.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.662+0000 7fb6fdffb640 1 --2- 172.21.15.60:0/3948220614 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb70406bf30 0x7fb70406e3f0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:44.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.662+0000 7fb6fdffb640 1 --2- 172.21.15.60:0/3948220614 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7181584c0 0x7fb718151560 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:44.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.662+0000 7fb6fdffb640 1 --2- 172.21.15.60:0/3948220614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb718150f20 0x7fb718157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:44.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.662+0000 7fb6fdffb640 1 --2- 172.21.15.60:0/3948220614 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb700004800 0x7fb7181509e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:44.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.662+0000 7fb6fdffb640 1 -- 172.21.15.60:0/3948220614 >> 172.21.15.60:0/3948220614 conn(0x7fb7180c7a40 msgr2=0x7fb71814adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:44.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.663+0000 7fb6fdffb640 1 -- 172.21.15.60:0/3948220614 shutdown_connections 2024-09-12T02:37:44.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:44.663+0000 7fb6fdffb640 1 -- 172.21.15.60:0/3948220614 wait complete. 2024-09-12T02:37:47.689 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:37:47.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:47.893+0000 7fc30ba1e640 1 Processor -- start 2024-09-12T02:37:47.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:47.893+0000 7fc30ba1e640 1 -- start start 2024-09-12T02:37:47.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:47.894+0000 7fc30ba1e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc3041564a0 0x7fc3040c2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:47.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:47.894+0000 7fc30ba1e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc304153240 0x7fc30406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:47.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:47.894+0000 7fc30ba1e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3040c6bc0 con 0x7fc3040c29e0 2024-09-12T02:37:47.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:47.894+0000 7fc30ba1e640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc3041569a0 con 0x7fc3041564a0 2024-09-12T02:37:47.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:47.894+0000 7fc30ba1e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc3040c6ea0 con 0x7fc304153240 2024-09-12T02:37:47.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:47.895+0000 7fc3097ba640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fc3040c29e0 0x7fc304152b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45446/0 (socket says 172.21.15.60:45446) 2024-09-12T02:37:47.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:47.895+0000 7fc3097ba640 1 -- 172.21.15.60:0/2870239112 learned_addr learned my addr 172.21.15.60:0/2870239112 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:37:47.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:47.895+0000 7fc308fb9640 1 --2- 172.21.15.60:0/2870239112 >> v2:172.21.15.105:3300/0 conn(0x7fc3041564a0 0x7fc3040c2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:47.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:47.895+0000 7fc308fb9640 1 -- 172.21.15.60:0/2870239112 >> v2:172.21.15.105:3300/0 conn(0x7fc3041564a0 msgr2=0x7fc3040c2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:37:47.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:47.895+0000 7fc308fb9640 1 -- 172.21.15.60:0/2870239112 >> v2:172.21.15.105:3300/0 conn(0x7fc3041564a0 msgr2=0x7fc3040c2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:37:47.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:47.895+0000 7fc308fb9640 1 --2- 172.21.15.60:0/2870239112 >> v2:172.21.15.105:3300/0 conn(0x7fc3041564a0 0x7fc3040c2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:37:47.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:47.895+0000 7fc308fb9640 1 --2- 172.21.15.60:0/2870239112 >> v2:172.21.15.105:3300/0 conn(0x7fc3041564a0 0x7fc3040c2dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:37:47.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:47.898+0000 7fc309fbb640 1 --2- 172.21.15.60:0/2870239112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc304153240 0x7fc30406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:47.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:47.899+0000 7fc309fbb640 1 -- 172.21.15.60:0/2870239112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc304153240 msgr2=0x7fc30406d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:37:47.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:47.899+0000 7fc309fbb640 1 -- 172.21.15.60:0/2870239112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc304153240 msgr2=0x7fc30406d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:37:47.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:47.899+0000 7fc309fbb640 1 --2- 172.21.15.60:0/2870239112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc304153240 0x7fc30406d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:37:47.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:47.899+0000 7fc309fbb640 1 --2- 172.21.15.60:0/2870239112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc304153240 0x7fc30406d2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:37:48.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:48.096+0000 7fc308fb9640 1 --2- 172.21.15.60:0/2870239112 >> v2:172.21.15.105:3300/0 conn(0x7fc3041564a0 0x7fc3040c2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:48.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:48.096+0000 7fc308fb9640 1 -- 172.21.15.60:0/2870239112 >> v2:172.21.15.105:3300/0 conn(0x7fc3041564a0 msgr2=0x7fc3040c2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:37:48.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:48.096+0000 7fc308fb9640 1 -- 172.21.15.60:0/2870239112 >> v2:172.21.15.105:3300/0 conn(0x7fc3041564a0 msgr2=0x7fc3040c2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:37:48.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:48.096+0000 7fc308fb9640 1 --2- 172.21.15.60:0/2870239112 >> v2:172.21.15.105:3300/0 conn(0x7fc3041564a0 0x7fc3040c2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:37:48.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:48.096+0000 7fc308fb9640 1 --2- 172.21.15.60:0/2870239112 >> v2:172.21.15.105:3300/0 conn(0x7fc3041564a0 0x7fc3040c2dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:37:48.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:48.102+0000 7fc309fbb640 1 --2- 172.21.15.60:0/2870239112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc304153240 0x7fc30406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:48.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:48.102+0000 7fc309fbb640 1 -- 172.21.15.60:0/2870239112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc304153240 msgr2=0x7fc30406d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:37:48.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:48.102+0000 7fc309fbb640 1 -- 172.21.15.60:0/2870239112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc304153240 msgr2=0x7fc30406d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:37:48.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:48.102+0000 7fc309fbb640 1 --2- 172.21.15.60:0/2870239112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc304153240 0x7fc30406d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:37:48.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:48.102+0000 7fc309fbb640 1 --2- 172.21.15.60:0/2870239112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc304153240 0x7fc30406d2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:37:48.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:48.497+0000 7fc308fb9640 1 --2- 172.21.15.60:0/2870239112 >> v2:172.21.15.105:3300/0 conn(0x7fc3041564a0 0x7fc3040c2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:48.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:48.497+0000 7fc308fb9640 1 -- 172.21.15.60:0/2870239112 >> v2:172.21.15.105:3300/0 conn(0x7fc3041564a0 msgr2=0x7fc3040c2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:37:48.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:48.497+0000 7fc308fb9640 1 -- 172.21.15.60:0/2870239112 >> v2:172.21.15.105:3300/0 conn(0x7fc3041564a0 msgr2=0x7fc3040c2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:37:48.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:48.497+0000 7fc308fb9640 1 --2- 172.21.15.60:0/2870239112 >> v2:172.21.15.105:3300/0 conn(0x7fc3041564a0 0x7fc3040c2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:37:48.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:48.497+0000 7fc308fb9640 1 --2- 172.21.15.60:0/2870239112 >> v2:172.21.15.105:3300/0 conn(0x7fc3041564a0 0x7fc3040c2dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:37:48.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:48.503+0000 7fc309fbb640 1 --2- 172.21.15.60:0/2870239112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc304153240 0x7fc30406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:48.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:48.503+0000 7fc309fbb640 1 -- 172.21.15.60:0/2870239112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc304153240 msgr2=0x7fc30406d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:37:48.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:48.503+0000 7fc309fbb640 1 -- 172.21.15.60:0/2870239112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc304153240 msgr2=0x7fc30406d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:37:48.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:48.503+0000 7fc309fbb640 1 --2- 172.21.15.60:0/2870239112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc304153240 0x7fc30406d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:37:48.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:48.503+0000 7fc309fbb640 1 --2- 172.21.15.60:0/2870239112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc304153240 0x7fc30406d2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:37:49.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:49.298+0000 7fc308fb9640 1 --2- 172.21.15.60:0/2870239112 >> v2:172.21.15.105:3300/0 conn(0x7fc3041564a0 0x7fc3040c2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:49.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:49.298+0000 7fc308fb9640 1 -- 172.21.15.60:0/2870239112 >> v2:172.21.15.105:3300/0 conn(0x7fc3041564a0 msgr2=0x7fc3040c2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:37:49.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:49.298+0000 7fc308fb9640 1 -- 172.21.15.60:0/2870239112 >> v2:172.21.15.105:3300/0 conn(0x7fc3041564a0 msgr2=0x7fc3040c2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:37:49.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:49.298+0000 7fc308fb9640 1 --2- 172.21.15.60:0/2870239112 >> v2:172.21.15.105:3300/0 conn(0x7fc3041564a0 0x7fc3040c2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:37:49.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:49.298+0000 7fc308fb9640 1 --2- 172.21.15.60:0/2870239112 >> v2:172.21.15.105:3300/0 conn(0x7fc3041564a0 0x7fc3040c2dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:37:49.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:49.311+0000 7fc309fbb640 1 --2- 172.21.15.60:0/2870239112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc304153240 0x7fc30406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:49.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:49.312+0000 7fc309fbb640 1 -- 172.21.15.60:0/2870239112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc304153240 msgr2=0x7fc30406d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:37:49.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:49.312+0000 7fc309fbb640 1 -- 172.21.15.60:0/2870239112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc304153240 msgr2=0x7fc30406d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:37:49.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:49.312+0000 7fc309fbb640 1 --2- 172.21.15.60:0/2870239112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc304153240 0x7fc30406d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:37:49.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:49.312+0000 7fc309fbb640 1 --2- 172.21.15.60:0/2870239112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc304153240 0x7fc30406d2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:37:50.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:50.240+0000 7fc3097ba640 1 -- 172.21.15.60:0/2870239112 >> v1:172.21.15.60:6789/0 conn(0x7fc3040c29e0 legacy=0x7fc304152b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-12T02:37:50.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:50.240+0000 7fc3097ba640 1 -- 172.21.15.60:0/2870239112 >> v1:172.21.15.60:6789/0 conn(0x7fc3040c29e0 legacy=0x7fc304152b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:37:50.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:50.240+0000 7fc3097ba640 1 --1- 172.21.15.60:0/2870239112 >> v1:172.21.15.60:6789/0 conn(0x7fc3040c29e0 0x7fc304152b30 :-1 s=OPENED pgs=27 cs=1 l=1).handle_message read tag failed 2024-09-12T02:37:50.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:50.240+0000 7fc3097ba640 1 --1- 172.21.15.60:0/2870239112 >> v1:172.21.15.60:6789/0 conn(0x7fc3040c29e0 0x7fc304152b30 :-1 s=OPENED pgs=27 cs=1 l=1).fault on lossy channel, failing 2024-09-12T02:37:50.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:50.895+0000 7fc2faffd640 1 -- 172.21.15.60:0/2870239112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc304153240 msgr2=0x7fc30406d2b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:37:50.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:50.895+0000 7fc2faffd640 1 --2- 172.21.15.60:0/2870239112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc304153240 0x7fc30406d2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:50.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:50.895+0000 7fc2faffd640 1 -- 172.21.15.60:0/2870239112 >> v2:172.21.15.105:3300/0 conn(0x7fc3041564a0 msgr2=0x7fc3040c2dc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:37:50.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:50.895+0000 7fc2faffd640 1 --2- 172.21.15.60:0/2870239112 >> v2:172.21.15.105:3300/0 conn(0x7fc3041564a0 0x7fc3040c2dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:50.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:50.895+0000 7fc2faffd640 1 -- 172.21.15.60:0/2870239112 >> v1:172.21.15.60:6789/0 conn(0x7fc3040c29e0 legacy=0x7fc304152b30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:37:50.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:50.895+0000 7fc2faffd640 1 --2- 172.21.15.60:0/2870239112 >> v2:172.21.15.60:3300/0 conn(0x7fc2e80035f0 0x7fc2e8005a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:50.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:50.895+0000 7fc2faffd640 1 -- 172.21.15.60:0/2870239112 --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc30406cd90 con 0x7fc2e8006160 2024-09-12T02:37:50.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:50.895+0000 7fc2faffd640 1 -- 172.21.15.60:0/2870239112 --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fc3041569a0 con 0x7fc2e80035f0 2024-09-12T02:37:50.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:50.895+0000 7fc3097ba640 1 --2- 172.21.15.60:0/2870239112 >> v2:172.21.15.60:3300/0 conn(0x7fc2e80035f0 0x7fc2e8005a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:50.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:50.896+0000 7fc3097ba640 1 -- 172.21.15.60:0/2870239112 >> v2:172.21.15.60:3300/0 conn(0x7fc2e80035f0 msgr2=0x7fc2e8005a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:37:50.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:50.896+0000 7fc3097ba640 1 -- 172.21.15.60:0/2870239112 >> v2:172.21.15.60:3300/0 conn(0x7fc2e80035f0 msgr2=0x7fc2e8005a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:37:50.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:50.896+0000 7fc3097ba640 1 --2- 172.21.15.60:0/2870239112 >> v2:172.21.15.60:3300/0 conn(0x7fc2e80035f0 0x7fc2e8005a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:37:50.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:50.896+0000 7fc3097ba640 1 --2- 172.21.15.60:0/2870239112 >> v2:172.21.15.60:3300/0 conn(0x7fc2e80035f0 0x7fc2e8005a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:37:51.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:51.097+0000 7fc3097ba640 1 --2- 172.21.15.60:0/2870239112 >> v2:172.21.15.60:3300/0 conn(0x7fc2e80035f0 0x7fc2e8005a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:51.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:51.097+0000 7fc3097ba640 1 -- 172.21.15.60:0/2870239112 >> v2:172.21.15.60:3300/0 conn(0x7fc2e80035f0 msgr2=0x7fc2e8005a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:37:51.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:51.097+0000 7fc3097ba640 1 -- 172.21.15.60:0/2870239112 >> v2:172.21.15.60:3300/0 conn(0x7fc2e80035f0 msgr2=0x7fc2e8005a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:37:51.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:51.097+0000 7fc3097ba640 1 --2- 172.21.15.60:0/2870239112 >> v2:172.21.15.60:3300/0 conn(0x7fc2e80035f0 0x7fc2e8005a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:37:51.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:51.097+0000 7fc3097ba640 1 --2- 172.21.15.60:0/2870239112 >> v2:172.21.15.60:3300/0 conn(0x7fc2e80035f0 0x7fc2e8005a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:37:51.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:51.498+0000 7fc3097ba640 1 --2- 172.21.15.60:0/2870239112 >> v2:172.21.15.60:3300/0 conn(0x7fc2e80035f0 0x7fc2e8005a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:51.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:51.498+0000 7fc3097ba640 1 -- 172.21.15.60:0/2870239112 >> v2:172.21.15.60:3300/0 conn(0x7fc2e80035f0 msgr2=0x7fc2e8005a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:37:51.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:51.498+0000 7fc3097ba640 1 -- 172.21.15.60:0/2870239112 >> v2:172.21.15.60:3300/0 conn(0x7fc2e80035f0 msgr2=0x7fc2e8005a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:37:51.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:51.498+0000 7fc3097ba640 1 --2- 172.21.15.60:0/2870239112 >> v2:172.21.15.60:3300/0 conn(0x7fc2e80035f0 0x7fc2e8005a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:37:51.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:51.498+0000 7fc3097ba640 1 --2- 172.21.15.60:0/2870239112 >> v2:172.21.15.60:3300/0 conn(0x7fc2e80035f0 0x7fc2e8005a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:37:52.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.300+0000 7fc3097ba640 1 --2- 172.21.15.60:0/2870239112 >> v2:172.21.15.60:3300/0 conn(0x7fc2e80035f0 0x7fc2e8005a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:52.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.300+0000 7fc3097ba640 1 -- 172.21.15.60:0/2870239112 >> v2:172.21.15.60:3300/0 conn(0x7fc2e80035f0 msgr2=0x7fc2e8005a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:37:52.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.300+0000 7fc3097ba640 1 -- 172.21.15.60:0/2870239112 >> v2:172.21.15.60:3300/0 conn(0x7fc2e80035f0 msgr2=0x7fc2e8005a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:37:52.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.300+0000 7fc3097ba640 1 --2- 172.21.15.60:0/2870239112 >> v2:172.21.15.60:3300/0 conn(0x7fc2e80035f0 0x7fc2e8005a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:37:52.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.300+0000 7fc3097ba640 1 --2- 172.21.15.60:0/2870239112 >> v2:172.21.15.60:3300/0 conn(0x7fc2e80035f0 0x7fc2e8005a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:37:52.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.892+0000 7fc2fbfff640 1 -- 172.21.15.60:0/2870239112 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1397927528 0 0) 0x7fc30406cd90 con 0x7fc2e8006160 2024-09-12T02:37:52.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.892+0000 7fc2fbfff640 1 -- 172.21.15.60:0/2870239112 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2f0003520 con 0x7fc2e8006160 2024-09-12T02:37:52.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.893+0000 7fc2fbfff640 1 -- 172.21.15.60:0/2870239112 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2678134198 0 0) 0x7fc2f0003520 con 0x7fc2e8006160 2024-09-12T02:37:52.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.893+0000 7fc2fbfff640 1 -- 172.21.15.60:0/2870239112 >> v2:172.21.15.60:3300/0 conn(0x7fc2e80035f0 msgr2=0x7fc2e8005a70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:37:52.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.893+0000 7fc2fbfff640 1 --2- 172.21.15.60:0/2870239112 >> v2:172.21.15.60:3300/0 conn(0x7fc2e80035f0 0x7fc2e8005a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:52.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.893+0000 7fc2fbfff640 1 -- 172.21.15.60:0/2870239112 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2e800af70 con 0x7fc2e8006160 2024-09-12T02:37:52.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.893+0000 7fc2fbfff640 1 -- 172.21.15.60:0/2870239112 <== mon.1 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7fc2fc009a00 con 0x7fc2e8006160 2024-09-12T02:37:52.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.893+0000 7fc2fbfff640 1 -- 172.21.15.60:0/2870239112 >> v1:172.21.15.105:6789/0 conn(0x7fc2e8006160 legacy=0x7fc2e8008620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:52.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.893+0000 7fc2fbfff640 1 --2- 172.21.15.60:0/2870239112 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2f00039b0 0x7fc2f0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:52.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.894+0000 7fc2fbfff640 1 --2- 172.21.15.60:0/2870239112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f0004800 0x7fc2f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:52.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.894+0000 7fc2fbfff640 1 --2- 172.21.15.60:0/2870239112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc304153240 0x7fc2f000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:52.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.894+0000 7fc3097ba640 1 --2- 172.21.15.60:0/2870239112 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2f00039b0 0x7fc2f0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:52.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.894+0000 7fc2fbfff640 1 -- 172.21.15.60:0/2870239112 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc3041569a0 con 0x7fc2f0004800 2024-09-12T02:37:52.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.894+0000 7fc2fbfff640 1 -- 172.21.15.60:0/2870239112 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f0005550 con 0x7fc2f00039b0 2024-09-12T02:37:52.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.894+0000 7fc2fbfff640 1 -- 172.21.15.60:0/2870239112 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc2f000bf00 con 0x7fc304153240 2024-09-12T02:37:52.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.895+0000 7fc308fb9640 1 --2- 172.21.15.60:0/2870239112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f0004800 0x7fc2f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:52.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.895+0000 7fc309fbb640 1 -- 172.21.15.60:0/2870239112 reap_dead start 2024-09-12T02:37:52.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.895+0000 7fc3097ba640 1 -- 172.21.15.60:0/2870239112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc304153240 msgr2=0x7fc2f000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:52.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.895+0000 7fc3097ba640 1 --2- 172.21.15.60:0/2870239112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc304153240 0x7fc2f000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:52.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.895+0000 7fc3097ba640 1 -- 172.21.15.60:0/2870239112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f0004800 msgr2=0x7fc2f0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:52.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.895+0000 7fc3097ba640 1 --2- 172.21.15.60:0/2870239112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f0004800 0x7fc2f0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:52.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.895+0000 7fc3097ba640 1 -- 172.21.15.60:0/2870239112 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2f0003520 con 0x7fc2f00039b0 2024-09-12T02:37:52.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.897+0000 7fc3097ba640 1 --2- 172.21.15.60:0/2870239112 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2f00039b0 0x7fc2f0003d90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc300007de0 tx=0x7fc2f0005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2f48af83dd0ce9f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:52.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.897+0000 7fc2fbfff640 1 -- 172.21.15.60:0/2870239112 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc300031070 con 0x7fc2f00039b0 2024-09-12T02:37:52.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.897+0000 7fc2fbfff640 1 -- 172.21.15.60:0/2870239112 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc30002b9e0 con 0x7fc2f00039b0 2024-09-12T02:37:52.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.897+0000 7fc2fbfff640 1 -- 172.21.15.60:0/2870239112 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc300005d00 con 0x7fc2f00039b0 2024-09-12T02:37:52.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.898+0000 7fc30ba1e640 1 -- 172.21.15.60:0/2870239112 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2f00039b0 msgr2=0x7fc2f0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:52.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.898+0000 7fc30ba1e640 1 --2- 172.21.15.60:0/2870239112 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2f00039b0 0x7fc2f0003d90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc300007de0 tx=0x7fc2f0005830 comp rx=0 tx=0).stop 2024-09-12T02:37:52.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.898+0000 7fc30ba1e640 1 -- 172.21.15.60:0/2870239112 shutdown_connections 2024-09-12T02:37:52.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.898+0000 7fc30ba1e640 1 --2- 172.21.15.60:0/2870239112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f0004800 0x7fc2f0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:52.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.898+0000 7fc30ba1e640 1 --2- 172.21.15.60:0/2870239112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc304153240 0x7fc2f000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:52.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.898+0000 7fc30ba1e640 1 --2- 172.21.15.60:0/2870239112 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2f00039b0 0x7fc2f0003d90 secure :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc300007de0 tx=0x7fc2f0005830 comp rx=0 tx=0).stop 2024-09-12T02:37:52.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.898+0000 7fc30ba1e640 1 -- 172.21.15.60:0/2870239112 >> 172.21.15.60:0/2870239112 conn(0x7fc3040a9680 msgr2=0x7fc3040a9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:52.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.898+0000 7fc30ba1e640 1 -- 172.21.15.60:0/2870239112 shutdown_connections 2024-09-12T02:37:52.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.898+0000 7fc30ba1e640 1 -- 172.21.15.60:0/2870239112 wait complete. 2024-09-12T02:37:52.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.900+0000 7fc30ba1e640 1 Processor -- start 2024-09-12T02:37:52.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.900+0000 7fc30ba1e640 1 -- start start 2024-09-12T02:37:52.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.902+0000 7fc30ba1e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f0004800 0x7fc3040a7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:52.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.902+0000 7fc30ba1e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc304153240 0x7fc30414ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:52.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.902+0000 7fc30ba1e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc30414f080 0x7fc304154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:52.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.902+0000 7fc30ba1e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc3040ad120 con 0x7fc2f0004800 2024-09-12T02:37:52.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.902+0000 7fc3097ba640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f0004800 0x7fc3040a7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:52.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.902+0000 7fc3097ba640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f0004800 0x7fc3040a7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58104/0 (socket says 172.21.15.60:58104) 2024-09-12T02:37:52.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.902+0000 7fc30ba1e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc3040aa3b0 con 0x7fc304153240 2024-09-12T02:37:52.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.902+0000 7fc3097ba640 1 -- 172.21.15.60:0/3624710855 learned_addr learned my addr 172.21.15.60:0/3624710855 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:37:52.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.902+0000 7fc30ba1e640 1 -- 172.21.15.60:0/3624710855 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc3040ad2a0 con 0x7fc30414f080 2024-09-12T02:37:52.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.902+0000 7fc309fbb640 1 --2- 172.21.15.60:0/3624710855 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc30414f080 0x7fc304154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:52.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.902+0000 7fc308fb9640 1 --2- 172.21.15.60:0/3624710855 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc304153240 0x7fc30414ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:52.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.902+0000 7fc3097ba640 1 -- 172.21.15.60:0/3624710855 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc30414f080 msgr2=0x7fc304154bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:52.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.902+0000 7fc3097ba640 1 --2- 172.21.15.60:0/3624710855 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc30414f080 0x7fc304154bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:52.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.902+0000 7fc3097ba640 1 -- 172.21.15.60:0/3624710855 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc304153240 msgr2=0x7fc30414ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:52.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.902+0000 7fc3097ba640 1 --2- 172.21.15.60:0/3624710855 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc304153240 0x7fc30414ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:52.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.902+0000 7fc3097ba640 1 -- 172.21.15.60:0/3624710855 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc30414f9f0 con 0x7fc2f0004800 2024-09-12T02:37:52.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.903+0000 7fc3097ba640 1 --2- 172.21.15.60:0/3624710855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f0004800 0x7fc3040a7420 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc30002b450 tx=0x7fc3000011d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:52.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.904+0000 7fc2f9ffb640 1 -- 172.21.15.60:0/3624710855 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc300044030 con 0x7fc2f0004800 2024-09-12T02:37:52.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.904+0000 7fc30ba1e640 1 -- 172.21.15.60:0/3624710855 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc30414fcd0 con 0x7fc2f0004800 2024-09-12T02:37:52.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.904+0000 7fc30ba1e640 1 -- 172.21.15.60:0/3624710855 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3041543d0 con 0x7fc2f0004800 2024-09-12T02:37:52.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.904+0000 7fc2f9ffb640 1 -- 172.21.15.60:0/3624710855 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc300005ce0 con 0x7fc2f0004800 2024-09-12T02:37:52.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.904+0000 7fc2f9ffb640 1 -- 172.21.15.60:0/3624710855 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc300040680 con 0x7fc2f0004800 2024-09-12T02:37:52.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.906+0000 7fc30ba1e640 1 -- 172.21.15.60:0/3624710855 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2e4005290 con 0x7fc2f0004800 2024-09-12T02:37:52.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.908+0000 7fc2f9ffb640 1 -- 172.21.15.60:0/3624710855 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc300047070 con 0x7fc2f0004800 2024-09-12T02:37:52.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.909+0000 7fc2f9ffb640 1 --2- 172.21.15.60:0/3624710855 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc2e806c9b0 0x7fc2e806ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:52.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.909+0000 7fc2f9ffb640 1 -- 172.21.15.60:0/3624710855 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fc3000ab9a0 con 0x7fc2f0004800 2024-09-12T02:37:52.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.909+0000 7fc308fb9640 1 --2- 172.21.15.60:0/3624710855 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc2e806c9b0 0x7fc2e806ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:52.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.910+0000 7fc308fb9640 1 --2- 172.21.15.60:0/3624710855 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc2e806c9b0 0x7fc2e806ee70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc3040a8fd0 tx=0x7fc2fc012040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:52.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:52.916+0000 7fc2f9ffb640 1 -- 172.21.15.60:0/3624710855 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc300051070 con 0x7fc2f0004800 2024-09-12T02:37:53.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.370+0000 7fc30ba1e640 1 -- 172.21.15.60:0/3624710855 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc2e4005580 con 0x7fc2f0004800 2024-09-12T02:37:53.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.371+0000 7fc2f9ffb640 1 -- 172.21.15.60:0/3624710855 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7fc30007a0e0 con 0x7fc2f0004800 2024-09-12T02:37:53.371 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":146,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:37:53.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.380+0000 7fc30ba1e640 1 -- 172.21.15.60:0/3624710855 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc2e806c9b0 msgr2=0x7fc2e806ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:53.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.380+0000 7fc30ba1e640 1 --2- 172.21.15.60:0/3624710855 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc2e806c9b0 0x7fc2e806ee70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc3040a8fd0 tx=0x7fc2fc012040 comp rx=0 tx=0).stop 2024-09-12T02:37:53.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.380+0000 7fc30ba1e640 1 -- 172.21.15.60:0/3624710855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f0004800 msgr2=0x7fc3040a7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:53.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.380+0000 7fc30ba1e640 1 --2- 172.21.15.60:0/3624710855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f0004800 0x7fc3040a7420 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc30002b450 tx=0x7fc3000011d0 comp rx=0 tx=0).stop 2024-09-12T02:37:53.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.380+0000 7fc30ba1e640 1 -- 172.21.15.60:0/3624710855 shutdown_connections 2024-09-12T02:37:53.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.380+0000 7fc30ba1e640 1 --2- 172.21.15.60:0/3624710855 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc2e806c9b0 0x7fc2e806ee70 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:53.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.380+0000 7fc30ba1e640 1 --2- 172.21.15.60:0/3624710855 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc30414f080 0x7fc304154bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:53.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.380+0000 7fc30ba1e640 1 --2- 172.21.15.60:0/3624710855 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc304153240 0x7fc30414ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:53.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.380+0000 7fc30ba1e640 1 --2- 172.21.15.60:0/3624710855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f0004800 0x7fc3040a7420 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:53.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.380+0000 7fc30ba1e640 1 -- 172.21.15.60:0/3624710855 >> 172.21.15.60:0/3624710855 conn(0x7fc3040a9680 msgr2=0x7fc3040abe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:53.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.380+0000 7fc30ba1e640 1 -- 172.21.15.60:0/3624710855 shutdown_connections 2024-09-12T02:37:53.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.380+0000 7fc30ba1e640 1 -- 172.21.15.60:0/3624710855 wait complete. 2024-09-12T02:37:53.397 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-12T02:37:53.397 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-12T02:37:53.397 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-12T02:37:53.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.560+0000 7f2ec042e640 1 Processor -- start 2024-09-12T02:37:53.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.560+0000 7f2ec042e640 1 -- start start 2024-09-12T02:37:53.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.561+0000 7f2ec042e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2eb806c650 0x7f2eb80c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:53.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.562+0000 7f2ebe9cb640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f2eb80ca1c0 0x7f2eb8160bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52084/0 (socket says 172.21.15.60:52084) 2024-09-12T02:37:53.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.562+0000 7f2ebe9cb640 1 -- 172.21.15.60:0/3180121586 learned_addr learned my addr 172.21.15.60:0/3180121586 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:37:53.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.562+0000 7f2ec042e640 1 -- 172.21.15.60:0/3180121586 --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2eb815a7c0 con 0x7f2eb80ca1c0 2024-09-12T02:37:53.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.562+0000 7f2ebd9c9640 1 --2- 172.21.15.60:0/3180121586 >> v2:172.21.15.60:3300/0 conn(0x7f2eb806c650 0x7f2eb80c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:53.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.562+0000 7f2ec042e640 1 -- 172.21.15.60:0/3180121586 --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2eb8159a00 con 0x7f2eb8150480 2024-09-12T02:37:53.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.562+0000 7f2ec042e640 1 -- 172.21.15.60:0/3180121586 --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f2eb806c240 con 0x7f2eb806c650 2024-09-12T02:37:53.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.562+0000 7f2ebd1c8640 1 -- 172.21.15.60:0/3180121586 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1799909833 0 0) 0x7f2eb815a7c0 con 0x7f2eb80ca1c0 2024-09-12T02:37:53.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.562+0000 7f2ebd1c8640 1 -- 172.21.15.60:0/3180121586 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ea4003520 con 0x7f2eb80ca1c0 2024-09-12T02:37:53.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.563+0000 7f2ebd1c8640 1 -- 172.21.15.60:0/3180121586 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2992265435 0 0) 0x7f2eb8159a00 con 0x7f2eb8150480 2024-09-12T02:37:53.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.563+0000 7f2ebd1c8640 1 -- 172.21.15.60:0/3180121586 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2eb815a7c0 con 0x7f2eb8150480 2024-09-12T02:37:53.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.563+0000 7f2ebd9c9640 1 -- 172.21.15.60:0/3180121586 >> v1:172.21.15.105:6789/0 conn(0x7f2eb8150480 legacy=0x7f2eb80c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:53.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.563+0000 7f2ebd9c9640 1 -- 172.21.15.60:0/3180121586 >> v1:172.21.15.60:6789/0 conn(0x7f2eb80ca1c0 legacy=0x7f2eb8160bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:53.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.563+0000 7f2ebd9c9640 1 -- 172.21.15.60:0/3180121586 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb8159ce0 con 0x7f2eb806c650 2024-09-12T02:37:53.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.564+0000 7f2ebd9c9640 1 --2- 172.21.15.60:0/3180121586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2eb806c650 0x7f2eb80c9c80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2ea80097a0 tx=0x7f2ea802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e348db99fb99397 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:53.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.564+0000 7f2ebd1c8640 1 -- 172.21.15.60:0/3180121586 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea8037070 con 0x7f2eb806c650 2024-09-12T02:37:53.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.564+0000 7f2ebd1c8640 1 -- 172.21.15.60:0/3180121586 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ea8032440 con 0x7f2eb806c650 2024-09-12T02:37:53.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.564+0000 7f2ebd1c8640 1 -- 172.21.15.60:0/3180121586 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea8037070 con 0x7f2eb806c650 2024-09-12T02:37:53.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.565+0000 7f2ec042e640 1 -- 172.21.15.60:0/3180121586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2eb806c650 msgr2=0x7f2eb80c9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:53.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.565+0000 7f2ec042e640 1 --2- 172.21.15.60:0/3180121586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2eb806c650 0x7f2eb80c9c80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2ea80097a0 tx=0x7f2ea802a1e0 comp rx=0 tx=0).stop 2024-09-12T02:37:53.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.566+0000 7f2ec042e640 1 -- 172.21.15.60:0/3180121586 shutdown_connections 2024-09-12T02:37:53.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.566+0000 7f2ec042e640 1 --2- 172.21.15.60:0/3180121586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2eb806c650 0x7f2eb80c9c80 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:53.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.566+0000 7f2ec042e640 1 -- 172.21.15.60:0/3180121586 >> 172.21.15.60:0/3180121586 conn(0x7f2eb8068030 msgr2=0x7f2eb8073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:53.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.566+0000 7f2ec042e640 1 -- 172.21.15.60:0/3180121586 shutdown_connections 2024-09-12T02:37:53.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.566+0000 7f2ec042e640 1 -- 172.21.15.60:0/3180121586 wait complete. 2024-09-12T02:37:53.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.568+0000 7f2ec042e640 1 Processor -- start 2024-09-12T02:37:53.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.568+0000 7f2ec042e640 1 -- start start 2024-09-12T02:37:53.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.573+0000 7f2ec042e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2eb806c650 0x7f2eb81ef8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:53.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.573+0000 7f2ec042e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2eb80ca1c0 0x7f2eb81efe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:53.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.573+0000 7f2ec042e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2eb8150480 0x7f2eb81e1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:53.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.573+0000 7f2ec042e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb806d270 con 0x7f2eb80ca1c0 2024-09-12T02:37:53.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.573+0000 7f2ec042e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb815a330 con 0x7f2eb8150480 2024-09-12T02:37:53.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.573+0000 7f2ec042e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2eb80ca5f0 con 0x7f2eb806c650 2024-09-12T02:37:53.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.574+0000 7f2ebe1ca640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2eb806c650 0x7f2eb81ef8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:53.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.574+0000 7f2ebe9cb640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2eb8150480 0x7f2eb81e1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:53.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.574+0000 7f2ebe1ca640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2eb806c650 0x7f2eb81ef8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:56456/0 (socket says 172.21.15.60:56456) 2024-09-12T02:37:53.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.574+0000 7f2ebe1ca640 1 -- 172.21.15.60:0/2785826444 learned_addr learned my addr 172.21.15.60:0/2785826444 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:37:53.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.575+0000 7f2ebd9c9640 1 --2- 172.21.15.60:0/2785826444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2eb80ca1c0 0x7f2eb81efe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:53.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.575+0000 7f2ebe9cb640 1 -- 172.21.15.60:0/2785826444 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2eb806c650 msgr2=0x7f2eb81ef8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:53.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.575+0000 7f2ebe9cb640 1 --2- 172.21.15.60:0/2785826444 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2eb806c650 0x7f2eb81ef8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:53.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.575+0000 7f2ebe9cb640 1 -- 172.21.15.60:0/2785826444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2eb80ca1c0 msgr2=0x7f2eb81efe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:53.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.575+0000 7f2ebe9cb640 1 --2- 172.21.15.60:0/2785826444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2eb80ca1c0 0x7f2eb81efe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:53.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.575+0000 7f2ebe9cb640 1 -- 172.21.15.60:0/2785826444 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb80c6100 con 0x7f2eb8150480 2024-09-12T02:37:53.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.575+0000 7f2ebd9c9640 1 --2- 172.21.15.60:0/2785826444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2eb80ca1c0 0x7f2eb81efe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:37:53.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.576+0000 7f2ebe9cb640 1 --2- 172.21.15.60:0/2785826444 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2eb8150480 0x7f2eb81e1720 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2eb000caa0 tx=0x7f2eb000cea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:53.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.576+0000 7f2eaeffd640 1 -- 172.21.15.60:0/2785826444 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb000ab40 con 0x7f2eb8150480 2024-09-12T02:37:53.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.576+0000 7f2eaeffd640 1 -- 172.21.15.60:0/2785826444 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eb000ad00 con 0x7f2eb8150480 2024-09-12T02:37:53.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.577+0000 7f2ec042e640 1 -- 172.21.15.60:0/2785826444 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2eb80afff0 con 0x7f2eb8150480 2024-09-12T02:37:53.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.577+0000 7f2ec042e640 1 -- 172.21.15.60:0/2785826444 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2eb80b05b0 con 0x7f2eb8150480 2024-09-12T02:37:53.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.577+0000 7f2eaeffd640 1 -- 172.21.15.60:0/2785826444 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb0012620 con 0x7f2eb8150480 2024-09-12T02:37:53.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.579+0000 7f2ec042e640 1 --2- 172.21.15.60:0/2785826444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2eb81dfd50 0x7f2eb81e1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:53.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.579+0000 7f2ec042e640 1 -- 172.21.15.60:0/2785826444 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb80697e0 con 0x7f2eb81dfd50 2024-09-12T02:37:53.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.579+0000 7f2ebe1ca640 1 --2- 172.21.15.60:0/2785826444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2eb81dfd50 0x7f2eb81e1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:53.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.580+0000 7f2eaeffd640 1 -- 172.21.15.60:0/2785826444 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2eb00127c0 con 0x7f2eb8150480 2024-09-12T02:37:53.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.580+0000 7f2ebe1ca640 1 -- 172.21.15.60:0/2785826444 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2eb814a8a0 con 0x7f2eb81dfd50 2024-09-12T02:37:53.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.580+0000 7f2ebe1ca640 1 --2- 172.21.15.60:0/2785826444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2eb81dfd50 0x7f2eb81e1c60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4000f60 tx=0x7f2eb400eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:53.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.580+0000 7f2eaeffd640 1 --2- 172.21.15.60:0/2785826444 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2e9c06be80 0x7f2e9c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:53.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.580+0000 7f2eaeffd640 1 -- 172.21.15.60:0/2785826444 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f2eb008b7c0 con 0x7f2eb8150480 2024-09-12T02:37:53.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.581+0000 7f2eaeffd640 1 -- 172.21.15.60:0/2785826444 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb40050d0 con 0x7f2eb81dfd50 2024-09-12T02:37:53.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.581+0000 7f2ebd9c9640 1 --2- 172.21.15.60:0/2785826444 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2e9c06be80 0x7f2e9c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:53.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.581+0000 7f2eaeffd640 1 -- 172.21.15.60:0/2785826444 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f2eb4018070 con 0x7f2eb81dfd50 2024-09-12T02:37:53.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.581+0000 7f2eaeffd640 1 -- 172.21.15.60:0/2785826444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2eb81dfd50 msgr2=0x7f2eb81e1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:53.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.581+0000 7f2eaeffd640 1 --2- 172.21.15.60:0/2785826444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2eb81dfd50 0x7f2eb81e1c60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4000f60 tx=0x7f2eb400eb90 comp rx=0 tx=0).stop 2024-09-12T02:37:53.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.581+0000 7f2eaeffd640 1 -- 172.21.15.60:0/2785826444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2eb81dfd50 msgr2=0x7f2eb81e1c60 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:37:53.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.581+0000 7f2eaeffd640 1 --2- 172.21.15.60:0/2785826444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2eb81dfd50 0x7f2eb81e1c60 secure :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4000f60 tx=0x7f2eb400eb90 comp rx=0 tx=0).stop 2024-09-12T02:37:53.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.581+0000 7f2ebd9c9640 1 --2- 172.21.15.60:0/2785826444 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2e9c06be80 0x7f2e9c06e340 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8034000 tx=0x7f2ea802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:53.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.595+0000 7f2ec042e640 1 --2- 172.21.15.60:0/2785826444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2eb80b07f0 0x7f2eb814abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:53.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.595+0000 7f2ec042e640 1 -- 172.21.15.60:0/2785826444 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb81e21a0 con 0x7f2eb80b07f0 2024-09-12T02:37:53.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.595+0000 7f2ebe1ca640 1 --2- 172.21.15.60:0/2785826444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2eb80b07f0 0x7f2eb814abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:53.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.595+0000 7f2ebe1ca640 1 -- 172.21.15.60:0/2785826444 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2eb8156270 con 0x7f2eb80b07f0 2024-09-12T02:37:53.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.596+0000 7f2ebe1ca640 1 --2- 172.21.15.60:0/2785826444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2eb80b07f0 0x7f2eb814abc0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4000f60 tx=0x7f2eb4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:53.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.596+0000 7f2eaeffd640 1 -- 172.21.15.60:0/2785826444 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb400c900 con 0x7f2eb80b07f0 2024-09-12T02:37:53.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.597+0000 7f2eaeffd640 1 -- 172.21.15.60:0/2785826444 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4718 (secure 0 0 0) 0x7f2eb400c900 con 0x7f2eb80b07f0 2024-09-12T02:37:53.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.597+0000 7f2eaeffd640 1 -- 172.21.15.60:0/2785826444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2eb80b07f0 msgr2=0x7f2eb814abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:53.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.597+0000 7f2eaeffd640 1 --2- 172.21.15.60:0/2785826444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2eb80b07f0 0x7f2eb814abc0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4000f60 tx=0x7f2eb4000ed0 comp rx=0 tx=0).stop 2024-09-12T02:37:53.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.597+0000 7f2eaeffd640 1 -- 172.21.15.60:0/2785826444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2eb80b07f0 msgr2=0x7f2eb814abc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:37:53.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.597+0000 7f2eaeffd640 1 --2- 172.21.15.60:0/2785826444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2eb80b07f0 0x7f2eb814abc0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:53.599 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:37:53.600 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:37:53.600 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:37:53.600 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:37:53.600 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 146, 2024-09-12T02:37:53.600 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 13369, 2024-09-12T02:37:53.600 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:37:53.600 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:37:53.600 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:37:53.600 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:37:53.600 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:53.600 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-09-12T02:37:53.600 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:37:53.600 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:37:53.601 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:37:53.601 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:37:53.601 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:37:53.601 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:37:53.601 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:37:53.601 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:37:53.601 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:37:53.601 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:37:53.601 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:37:53.601 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:37:53.601 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:37:53.601 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:37:53.601 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:53.602 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:37:53.602 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:37:53.602 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:37:53.602 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:37:53.602 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:37:53.602 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:37:53.602 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:37:53.602 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:37:53.602 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:37:53.602 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:37:53.602 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:37:53.602 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:37:53.602 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:37:53.602 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:53.603 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:53.603 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:37:53.603 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:37:53.603 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:37:53.603 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:37:53.603 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:37:53.603 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:37:53.603 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:37:53.603 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:37:53.603 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:37:53.603 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:37:53.603 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:37:53.603 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:37:53.604 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:37:53.604 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:37:53.604 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:37:53.604 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:37:53.604 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:37:53.604 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:37:53.604 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:37:53.604 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:37:53.604 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:37:53.604 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:37:53.604 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:37:53.604 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:37:53.604 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:37:53.604 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:37:53.605 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:37:53.605 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:37:53.605 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:53.605 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:37:53.605 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:53.605 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:37:53.605 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:53.605 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:37:53.605 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:37:53.605 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:37:53.605 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:37:53.605 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:53.605 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:37:53.606 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:37:53.606 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:53.606 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:53.606 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:53.606 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:37:53.606 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:37:53.606 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:53.606 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:53.606 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:53.606 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:53.606 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:37:53.606 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:37:53.606 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:37:53.606 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:37:53.607 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:37:53.607 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:53.607 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:53.607 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:37:53.607 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:37:53.607 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:37:53.607 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:37:53.607 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:53.607 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:37:53.607 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:37:53.607 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:53.607 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:53.607 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:53.608 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:37:53.608 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:37:53.608 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:53.608 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:53.608 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:53.608 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:53.608 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:37:53.608 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:37:53.608 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:37:53.608 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:37:53.608 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:37:53.608 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:53.608 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:53.609 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:37:53.609 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:37:53.609 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:37:53.609 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:37:53.609 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:53.609 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:37:53.609 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:37:53.609 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:53.609 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:53.609 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:53.609 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:37:53.609 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:37:53.609 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:53.610 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:53.610 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:53.610 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:53.610 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:37:53.610 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:37:53.610 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:37:53.610 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:37:53.610 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:37:53.610 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:53.610 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:53.610 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:53.610 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:37:53.610 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:37:53.610 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:53.611 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:37:53.611 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:37:53.611 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:37:53.611 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:53.611 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:53.611 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:37:53.611 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:53.611 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:37:53.611 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:37:53.611 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:37:53.611 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:53.611 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:53.611 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:37:53.611 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:53.611 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:37:53.612 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:37:53.612 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:37:53.612 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:53.612 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:53.612 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:53.612 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:37:53.612 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:37:53.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.600+0000 7f2ec042e640 1 -- 172.21.15.60:0/2785826444 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2e9c06be80 msgr2=0x7f2e9c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:53.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.600+0000 7f2ec042e640 1 --2- 172.21.15.60:0/2785826444 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2e9c06be80 0x7f2e9c06e340 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8034000 tx=0x7f2ea802e000 comp rx=0 tx=0).stop 2024-09-12T02:37:53.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.600+0000 7f2ec042e640 1 -- 172.21.15.60:0/2785826444 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2eb8150480 msgr2=0x7f2eb81e1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:53.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.600+0000 7f2ec042e640 1 --2- 172.21.15.60:0/2785826444 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2eb8150480 0x7f2eb81e1720 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2eb000caa0 tx=0x7f2eb000cea0 comp rx=0 tx=0).stop 2024-09-12T02:37:53.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.600+0000 7f2ebe9cb640 1 -- 172.21.15.60:0/2785826444 reap_dead start 2024-09-12T02:37:53.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.600+0000 7f2ebe9cb640 1 -- 172.21.15.60:0/2785826444 reap_dead start 2024-09-12T02:37:53.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.600+0000 7f2ec042e640 1 -- 172.21.15.60:0/2785826444 shutdown_connections 2024-09-12T02:37:53.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.600+0000 7f2ec042e640 1 -- 172.21.15.60:0/2785826444 >> 172.21.15.60:0/2785826444 conn(0x7f2eb8068030 msgr2=0x7f2eb8154af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:53.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.600+0000 7f2ec042e640 1 -- 172.21.15.60:0/2785826444 shutdown_connections 2024-09-12T02:37:53.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.600+0000 7f2ec042e640 1 -- 172.21.15.60:0/2785826444 wait complete. 2024-09-12T02:37:53.621 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:37:53.621 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-12T02:37:53.622 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-12T02:37:53.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.789+0000 7f8970e42640 1 Processor -- start 2024-09-12T02:37:53.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.789+0000 7f8970e42640 1 -- start start 2024-09-12T02:37:53.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.790+0000 7f8970e42640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f896c074230 0x7f896c0c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:53.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.791+0000 7f8970e42640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f896c0c59f0 0x7f896c0c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:53.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.791+0000 7f896a59c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f896c074230 0x7f896c0c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:53.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.791+0000 7f8970e42640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f896c0c34f0 con 0x7f896c0c41f0 2024-09-12T02:37:53.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.791+0000 7f8970e42640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f896c0bed90 con 0x7f896c074230 2024-09-12T02:37:53.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.791+0000 7f8970e42640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f896c0c3820 con 0x7f896c0c59f0 2024-09-12T02:37:53.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.791+0000 7f896a59c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f896c074230 0x7f896c0c54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58140/0 (socket says 172.21.15.60:58140) 2024-09-12T02:37:53.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.791+0000 7f896a59c640 1 -- 172.21.15.60:0/2387141465 learned_addr learned my addr 172.21.15.60:0/2387141465 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:37:53.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.791+0000 7f896a59c640 1 -- 172.21.15.60:0/2387141465 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f896c0c59f0 msgr2=0x7f896c0c3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:53.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.791+0000 7f896a59c640 1 --2- 172.21.15.60:0/2387141465 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f896c0c59f0 0x7f896c0c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:53.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.791+0000 7f896a59c640 1 -- 172.21.15.60:0/2387141465 >> v1:172.21.15.60:6789/0 conn(0x7f896c0c41f0 legacy=0x7f896c06bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:53.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.791+0000 7f896a59c640 1 -- 172.21.15.60:0/2387141465 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f896c0befe0 con 0x7f896c074230 2024-09-12T02:37:53.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.792+0000 7f896a59c640 1 --2- 172.21.15.60:0/2387141465 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f896c074230 0x7f896c0c54b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f895c009870 tx=0x7f895c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8273652dc223d901 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:53.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.792+0000 7f896959a640 1 -- 172.21.15.60:0/2387141465 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f895c037070 con 0x7f896c074230 2024-09-12T02:37:53.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.792+0000 7f896959a640 1 -- 172.21.15.60:0/2387141465 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f895c032440 con 0x7f896c074230 2024-09-12T02:37:53.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.792+0000 7f896959a640 1 -- 172.21.15.60:0/2387141465 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f895c032810 con 0x7f896c074230 2024-09-12T02:37:53.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.793+0000 7f8970e42640 1 -- 172.21.15.60:0/2387141465 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f896c074230 msgr2=0x7f896c0c54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:53.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.793+0000 7f8970e42640 1 --2- 172.21.15.60:0/2387141465 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f896c074230 0x7f896c0c54b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f895c009870 tx=0x7f895c02a1c0 comp rx=0 tx=0).stop 2024-09-12T02:37:53.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.794+0000 7f8970e42640 1 -- 172.21.15.60:0/2387141465 shutdown_connections 2024-09-12T02:37:53.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.794+0000 7f8970e42640 1 --2- 172.21.15.60:0/2387141465 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f896c0c59f0 0x7f896c0c3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:53.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.794+0000 7f8970e42640 1 --2- 172.21.15.60:0/2387141465 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f896c074230 0x7f896c0c54b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:53.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.794+0000 7f8970e42640 1 -- 172.21.15.60:0/2387141465 >> 172.21.15.60:0/2387141465 conn(0x7f896c0c8a50 msgr2=0x7f896c0c8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:53.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.794+0000 7f8970e42640 1 -- 172.21.15.60:0/2387141465 shutdown_connections 2024-09-12T02:37:53.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.794+0000 7f8970e42640 1 -- 172.21.15.60:0/2387141465 wait complete. 2024-09-12T02:37:53.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.795+0000 7f8970e42640 1 Processor -- start 2024-09-12T02:37:53.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.795+0000 7f8970e42640 1 -- start start 2024-09-12T02:37:53.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.796+0000 7f8970e42640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f896c074230 0x7f896c06f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:53.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.796+0000 7f8970e42640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f896c0c41f0 0x7f896c1e1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:53.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.797+0000 7f8970e42640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f896c0c59f0 0x7f896c1e15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:53.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.797+0000 7f8970e42640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f896c0c4620 con 0x7f896c0c41f0 2024-09-12T02:37:53.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.797+0000 7f8970e42640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f896c0bf5a0 con 0x7f896c0c59f0 2024-09-12T02:37:53.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.797+0000 7f8970e42640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f896c0c47a0 con 0x7f896c074230 2024-09-12T02:37:53.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.797+0000 7f8969d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f896c0c41f0 0x7f896c1e1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:53.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.797+0000 7f8969d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f896c0c41f0 0x7f896c1e1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58150/0 (socket says 172.21.15.60:58150) 2024-09-12T02:37:53.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.797+0000 7f8969d9b640 1 -- 172.21.15.60:0/2642254028 learned_addr learned my addr 172.21.15.60:0/2642254028 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:37:53.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.797+0000 7f896a59c640 1 --2- 172.21.15.60:0/2642254028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f896c074230 0x7f896c06f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:53.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.797+0000 7f896a59c640 1 -- 172.21.15.60:0/2642254028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f896c0c59f0 msgr2=0x7f896c1e15b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:37:53.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.797+0000 7f896a59c640 1 --2- 172.21.15.60:0/2642254028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f896c0c59f0 0x7f896c1e15b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:53.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.797+0000 7f896a59c640 1 -- 172.21.15.60:0/2642254028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f896c0c41f0 msgr2=0x7f896c1e1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:53.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.797+0000 7f896a59c640 1 --2- 172.21.15.60:0/2642254028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f896c0c41f0 0x7f896c1e1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:53.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.797+0000 7f896a59c640 1 -- 172.21.15.60:0/2642254028 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f896c1f09e0 con 0x7f896c074230 2024-09-12T02:37:53.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.797+0000 7f8969d9b640 1 --2- 172.21.15.60:0/2642254028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f896c0c41f0 0x7f896c1e1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:37:53.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.798+0000 7f896a59c640 1 --2- 172.21.15.60:0/2642254028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f896c074230 0x7f896c06f780 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f895c031000 tx=0x7f895c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:53.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.798+0000 7f895affd640 1 -- 172.21.15.60:0/2642254028 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f895c041020 con 0x7f896c074230 2024-09-12T02:37:53.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.798+0000 7f895affd640 1 -- 172.21.15.60:0/2642254028 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f895c030970 con 0x7f896c074230 2024-09-12T02:37:53.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.798+0000 7f895affd640 1 -- 172.21.15.60:0/2642254028 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f895c037040 con 0x7f896c074230 2024-09-12T02:37:53.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.798+0000 7f8970e42640 1 -- 172.21.15.60:0/2642254028 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f896c1f3f50 con 0x7f896c074230 2024-09-12T02:37:53.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.798+0000 7f8970e42640 1 -- 172.21.15.60:0/2642254028 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f896c1f4210 con 0x7f896c074230 2024-09-12T02:37:53.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.800+0000 7f8970e42640 1 --2- 172.21.15.60:0/2642254028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f896c1e2600 0x7f896c0c1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:53.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.800+0000 7f8970e42640 1 -- 172.21.15.60:0/2642254028 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f896c069a00 con 0x7f896c1e2600 2024-09-12T02:37:53.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.800+0000 7f8969d9b640 1 --2- 172.21.15.60:0/2642254028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f896c1e2600 0x7f896c0c1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:53.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.801+0000 7f8969d9b640 1 -- 172.21.15.60:0/2642254028 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f896c074610 con 0x7f896c1e2600 2024-09-12T02:37:53.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.801+0000 7f895affd640 1 -- 172.21.15.60:0/2642254028 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f895c044020 con 0x7f896c074230 2024-09-12T02:37:53.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.801+0000 7f8969d9b640 1 --2- 172.21.15.60:0/2642254028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f896c1e2600 0x7f896c0c1c00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f896c0700f0 tx=0x7f896000ef70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:53.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.801+0000 7f895affd640 1 --2- 172.21.15.60:0/2642254028 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f894c06be30 0x7f894c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:53.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.801+0000 7f895affd640 1 -- 172.21.15.60:0/2642254028 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f895c0abaa0 con 0x7f896c074230 2024-09-12T02:37:53.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.801+0000 7f896ad9d640 1 --2- 172.21.15.60:0/2642254028 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f894c06be30 0x7f894c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:53.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.802+0000 7f895affd640 1 -- 172.21.15.60:0/2642254028 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8960017070 con 0x7f896c1e2600 2024-09-12T02:37:53.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.802+0000 7f895affd640 1 -- 172.21.15.60:0/2642254028 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f896000cb10 con 0x7f896c1e2600 2024-09-12T02:37:53.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.802+0000 7f895affd640 1 -- 172.21.15.60:0/2642254028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f896c1e2600 msgr2=0x7f896c0c1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:53.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.802+0000 7f895affd640 1 --2- 172.21.15.60:0/2642254028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f896c1e2600 0x7f896c0c1c00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f896c0700f0 tx=0x7f896000ef70 comp rx=0 tx=0).stop 2024-09-12T02:37:53.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.802+0000 7f895affd640 1 -- 172.21.15.60:0/2642254028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f896c1e2600 msgr2=0x7f896c0c1c00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:37:53.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.802+0000 7f895affd640 1 --2- 172.21.15.60:0/2642254028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f896c1e2600 0x7f896c0c1c00 secure :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f896c0700f0 tx=0x7f896000ef70 comp rx=0 tx=0).stop 2024-09-12T02:37:53.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.802+0000 7f896ad9d640 1 --2- 172.21.15.60:0/2642254028 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f894c06be30 0x7f894c06e2f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f896c0c36c0 tx=0x7f8964007cd0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:53.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.816+0000 7f8970e42640 1 --2- 172.21.15.60:0/2642254028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f896c1f4450 0x7f896c0c2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:53.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.816+0000 7f8970e42640 1 -- 172.21.15.60:0/2642254028 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f896c0c6e30 con 0x7f896c1f4450 2024-09-12T02:37:53.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.816+0000 7f8969d9b640 1 --2- 172.21.15.60:0/2642254028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f896c1f4450 0x7f896c0c2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:53.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.817+0000 7f8969d9b640 1 -- 172.21.15.60:0/2642254028 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f896c15aa90 con 0x7f896c1f4450 2024-09-12T02:37:53.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.817+0000 7f8969d9b640 1 --2- 172.21.15.60:0/2642254028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f896c1f4450 0x7f896c0c2140 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f896c0700f0 tx=0x7f89600047d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:53.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.817+0000 7f895affd640 1 -- 172.21.15.60:0/2642254028 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8960017070 con 0x7f896c1f4450 2024-09-12T02:37:53.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.817+0000 7f895affd640 1 -- 172.21.15.60:0/2642254028 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4884 (secure 0 0 0) 0x7f89600067d0 con 0x7f896c1f4450 2024-09-12T02:37:53.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.817+0000 7f895affd640 1 -- 172.21.15.60:0/2642254028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f896c1f4450 msgr2=0x7f896c0c2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:53.819 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:37:53.819 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:37:53.819 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:37:53.819 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:37:53.819 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 146, 2024-09-12T02:37:53.819 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 145396, 2024-09-12T02:37:53.819 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:37:53.819 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:37:53.820 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:37:53.820 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:37:53.820 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:53.820 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-09-12T02:37:53.820 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:37:53.820 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:37:53.820 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:37:53.820 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:37:53.820 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:37:53.820 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:37:53.820 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:37:53.821 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:37:53.821 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:37:53.821 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:37:53.821 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:37:53.821 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:37:53.821 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:37:53.821 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:37:53.821 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:53.821 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:37:53.821 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:37:53.821 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:37:53.822 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:37:53.822 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:37:53.822 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:37:53.822 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:37:53.822 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:37:53.822 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:37:53.822 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:37:53.822 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:37:53.822 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:37:53.822 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:37:53.822 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:53.823 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:53.823 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:37:53.823 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:37:53.823 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:37:53.823 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:37:53.823 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:37:53.823 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:37:53.823 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:37:53.823 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:37:53.823 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:37:53.824 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:37:53.824 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:37:53.824 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:37:53.824 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:37:53.824 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:37:53.824 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:37:53.824 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:37:53.824 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:37:53.824 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:37:53.824 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:37:53.825 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:37:53.825 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:37:53.825 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:37:53.825 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:37:53.825 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:37:53.825 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:37:53.825 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:37:53.825 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:37:53.825 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:37:53.825 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:53.826 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:37:53.826 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:53.826 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:37:53.826 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:53.826 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:37:53.826 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:37:53.826 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:37:53.826 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:37:53.826 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:53.826 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:37:53.826 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:37:53.827 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:53.827 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:53.827 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:53.827 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:37:53.827 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:37:53.827 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:53.827 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:53.827 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:53.827 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:53.827 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:37:53.827 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:37:53.828 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:37:53.828 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:37:53.828 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:37:53.828 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:53.828 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:53.828 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:37:53.828 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:37:53.828 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:37:53.828 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:37:53.828 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:53.829 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:37:53.829 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:37:53.829 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:53.829 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:53.829 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:53.829 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:37:53.829 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:37:53.829 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:53.829 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:53.830 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:53.830 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:53.830 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:37:53.830 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:37:53.830 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:37:53.830 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:37:53.830 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:37:53.830 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:53.830 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:53.830 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:37:53.830 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:37:53.831 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:37:53.831 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:37:53.831 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:53.831 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:37:53.831 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:37:53.831 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:53.831 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:53.831 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:53.831 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:37:53.831 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:37:53.831 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:53.831 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:53.832 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:53.832 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:53.832 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:37:53.832 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:37:53.832 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:37:53.832 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:37:53.832 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:37:53.832 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:53.832 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:53.832 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:53.832 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:37:53.833 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:37:53.833 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:53.833 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:37:53.833 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:37:53.833 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:37:53.833 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:53.833 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:53.833 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:37:53.833 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:53.833 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:37:53.833 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:37:53.834 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:37:53.834 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:53.834 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:53.834 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:37:53.834 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:53.834 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:37:53.834 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:37:53.834 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:37:53.834 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:53.834 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:53.834 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:37:53.834 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:53.835 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:37:53.835 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:37:53.835 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:37:53.835 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:53.835 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:53.835 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:53.835 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:37:53.835 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:37:53.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.817+0000 7f895affd640 1 --2- 172.21.15.60:0/2642254028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f896c1f4450 0x7f896c0c2140 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f896c0700f0 tx=0x7f89600047d0 comp rx=0 tx=0).stop 2024-09-12T02:37:53.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.817+0000 7f895affd640 1 -- 172.21.15.60:0/2642254028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f896c1f4450 msgr2=0x7f896c0c2140 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:37:53.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.817+0000 7f895affd640 1 --2- 172.21.15.60:0/2642254028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f896c1f4450 0x7f896c0c2140 secure :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f896c0700f0 tx=0x7f89600047d0 comp rx=0 tx=0).stop 2024-09-12T02:37:53.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.818+0000 7f8970e42640 1 -- 172.21.15.60:0/2642254028 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f894c06be30 msgr2=0x7f894c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:53.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.818+0000 7f8970e42640 1 --2- 172.21.15.60:0/2642254028 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f894c06be30 0x7f894c06e2f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f896c0c36c0 tx=0x7f8964007cd0 comp rx=0 tx=0).stop 2024-09-12T02:37:53.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.818+0000 7f8970e42640 1 -- 172.21.15.60:0/2642254028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f896c074230 msgr2=0x7f896c06f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:53.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.818+0000 7f8970e42640 1 --2- 172.21.15.60:0/2642254028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f896c074230 0x7f896c06f780 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f895c031000 tx=0x7f895c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:37:53.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.818+0000 7f896ad9d640 1 -- 172.21.15.60:0/2642254028 reap_dead start 2024-09-12T02:37:53.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.818+0000 7f8970e42640 1 -- 172.21.15.60:0/2642254028 shutdown_connections 2024-09-12T02:37:53.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.818+0000 7f8970e42640 1 --2- 172.21.15.60:0/2642254028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f896c074230 0x7f896c06f780 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:53.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.818+0000 7f8970e42640 1 -- 172.21.15.60:0/2642254028 >> 172.21.15.60:0/2642254028 conn(0x7f896c0c8a50 msgr2=0x7f896c0c7f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:53.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.818+0000 7f8970e42640 1 -- 172.21.15.60:0/2642254028 shutdown_connections 2024-09-12T02:37:53.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:53.818+0000 7f8970e42640 1 -- 172.21.15.60:0/2642254028 wait complete. 2024-09-12T02:37:53.838 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:37:53.838 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-12T02:37:53.838 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-12T02:37:53.996 INFO:tasks.workunit.client.1.smithi105.stdout:Syncing()...1 sec 2024-09-12T02:37:53.996 INFO:tasks.workunit.client.1.smithi105.stdout:FFSB benchmark finished at: Thu Sep 12 02:37:53 2024 2024-09-12T02:37:53.996 INFO:tasks.workunit.client.1.smithi105.stdout: 2024-09-12T02:37:53.996 INFO:tasks.workunit.client.1.smithi105.stdout:Results: 2024-09-12T02:37:53.996 INFO:tasks.workunit.client.1.smithi105.stdout:Benchmark took 307.24 sec 2024-09-12T02:37:53.996 INFO:tasks.workunit.client.1.smithi105.stdout: 2024-09-12T02:37:53.996 INFO:tasks.workunit.client.1.smithi105.stdout:Total Results 2024-09-12T02:37:53.996 INFO:tasks.workunit.client.1.smithi105.stdout:=============== 2024-09-12T02:37:53.997 INFO:tasks.workunit.client.1.smithi105.stdout: Op Name Transactions Trans/sec % Trans % Op Weight Throughput 2024-09-12T02:37:53.997 INFO:tasks.workunit.client.1.smithi105.stdout: ======= ============ ========= ======= =========== ========== 2024-09-12T02:37:53.997 INFO:tasks.workunit.client.1.smithi105.stdout: write : 1740800 5665.85 100.000% 100.000% 22.1MB/sec 2024-09-12T02:37:53.997 INFO:tasks.workunit.client.1.smithi105.stdout:- 2024-09-12T02:37:53.997 INFO:tasks.workunit.client.1.smithi105.stdout:5665.85 Transactions per Second 2024-09-12T02:37:53.997 INFO:tasks.workunit.client.1.smithi105.stdout: 2024-09-12T02:37:53.997 INFO:tasks.workunit.client.1.smithi105.stdout:Throughput Results 2024-09-12T02:37:53.997 INFO:tasks.workunit.client.1.smithi105.stdout:=================== 2024-09-12T02:37:53.997 INFO:tasks.workunit.client.1.smithi105.stdout:Write Throughput: 22.1MB/sec 2024-09-12T02:37:54.001 INFO:tasks.workunit.client.1.smithi105.stdout: 2024-09-12T02:37:54.001 INFO:tasks.workunit.client.1.smithi105.stdout:System Call Latency statistics in millisecs 2024-09-12T02:37:54.001 INFO:tasks.workunit.client.1.smithi105.stdout:===== 2024-09-12T02:37:54.001 INFO:tasks.workunit.client.1.smithi105.stdout: Min Avg Max Total Calls 2024-09-12T02:37:54.002 INFO:tasks.workunit.client.1.smithi105.stdout: ======== ======== ======== ============ 2024-09-12T02:37:54.002 INFO:tasks.workunit.client.1.smithi105.stdout:[ open] 0.442000 39.412370 2909.269043 1360 2024-09-12T02:37:54.002 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-12T02:37:54.002 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[1] 2000.000000 - 5000.000000 : 5 2024-09-12T02:37:54.002 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[2] 1000.000000 - 2000.000000 : 8 2024-09-12T02:37:54.002 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[3] 500.000000 - 1000.000000 : 5 2024-09-12T02:37:54.002 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[4] 200.000000 - 500.000000 : 9 2024-09-12T02:37:54.002 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[5] 100.000000 - 200.000000 : 8 2024-09-12T02:37:54.002 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[6] 50.000000 - 100.000000 : 31 2024-09-12T02:37:54.002 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[7] 20.000000 - 50.000000 : 351 2024-09-12T02:37:54.002 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[8] 10.000000 - 20.000000 : 655 2024-09-12T02:37:54.002 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[9] 5.000000 - 10.000000 : 198 2024-09-12T02:37:54.002 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[10] 2.000000 - 5.000000 : 76 2024-09-12T02:37:54.003 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[11] 1.000000 - 2.000000 : 8 2024-09-12T02:37:54.003 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[12] 0.500000 - 1.000000 : 5 2024-09-12T02:37:54.003 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[13] 0.200000 - 0.500000 : 1 2024-09-12T02:37:54.003 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[14] 0.100000 - 0.200000 : 0 2024-09-12T02:37:54.003 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[15] 0.050000 - 0.100000 : 0 2024-09-12T02:37:54.003 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[16] 0.020000 - 0.050000 : 0 2024-09-12T02:37:54.003 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[17] 0.010000 - 0.020000 : 0 2024-09-12T02:37:54.003 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-09-12T02:37:54.003 INFO:tasks.workunit.client.1.smithi105.stdout: 2024-09-12T02:37:54.003 INFO:tasks.workunit.client.1.smithi105.stdout:[ write] 0.085000 5.543118 949.664978 1740800 2024-09-12T02:37:54.003 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-12T02:37:54.003 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-12T02:37:54.003 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-12T02:37:54.004 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[3] 500.000000 - 1000.000000 : 4 2024-09-12T02:37:54.004 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[4] 200.000000 - 500.000000 : 10 2024-09-12T02:37:54.004 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[5] 100.000000 - 200.000000 : 102 2024-09-12T02:37:54.004 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[6] 50.000000 - 100.000000 : 3838 2024-09-12T02:37:54.004 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[7] 20.000000 - 50.000000 : 71016 2024-09-12T02:37:54.004 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[8] 10.000000 - 20.000000 : 193838 2024-09-12T02:37:54.004 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[9] 5.000000 - 10.000000 : 358406 2024-09-12T02:37:54.004 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[10] 2.000000 - 5.000000 : 536786 2024-09-12T02:37:54.004 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[11] 1.000000 - 2.000000 : 179601 2024-09-12T02:37:54.004 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[12] 0.500000 - 1.000000 : 86411 2024-09-12T02:37:54.004 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[13] 0.200000 - 0.500000 : 175159 2024-09-12T02:37:54.004 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[14] 0.100000 - 0.200000 : 135146 2024-09-12T02:37:54.004 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[15] 0.050000 - 0.100000 : 483 2024-09-12T02:37:54.004 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[16] 0.020000 - 0.050000 : 0 2024-09-12T02:37:54.004 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[17] 0.010000 - 0.020000 : 0 2024-09-12T02:37:54.005 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-09-12T02:37:54.005 INFO:tasks.workunit.client.1.smithi105.stdout: 2024-09-12T02:37:54.005 INFO:tasks.workunit.client.1.smithi105.stdout:[ lseek] 0.000000 0.000860 3.194000 1740800 2024-09-12T02:37:54.005 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-12T02:37:54.005 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-12T02:37:54.005 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-12T02:37:54.005 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-09-12T02:37:54.005 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-09-12T02:37:54.005 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-09-12T02:37:54.005 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2024-09-12T02:37:54.005 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[7] 20.000000 - 50.000000 : 0 2024-09-12T02:37:54.005 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[8] 10.000000 - 20.000000 : 0 2024-09-12T02:37:54.006 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[9] 5.000000 - 10.000000 : 0 2024-09-12T02:37:54.006 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[10] 2.000000 - 5.000000 : 1 2024-09-12T02:37:54.006 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[11] 1.000000 - 2.000000 : 1 2024-09-12T02:37:54.006 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[12] 0.500000 - 1.000000 : 2 2024-09-12T02:37:54.006 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[13] 0.200000 - 0.500000 : 10 2024-09-12T02:37:54.006 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[14] 0.100000 - 0.200000 : 8 2024-09-12T02:37:54.006 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[15] 0.050000 - 0.100000 : 8 2024-09-12T02:37:54.006 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[16] 0.020000 - 0.050000 : 189 2024-09-12T02:37:54.006 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[17] 0.010000 - 0.020000 : 1029 2024-09-12T02:37:54.006 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[18] 0.000000 - 0.010000 : 1739552 2024-09-12T02:37:54.006 INFO:tasks.workunit.client.1.smithi105.stdout: 2024-09-12T02:37:54.006 INFO:tasks.workunit.client.1.smithi105.stdout:[ close] 0.019000 2.657746 68.782997 1360 2024-09-12T02:37:54.007 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-12T02:37:54.007 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-12T02:37:54.007 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-12T02:37:54.007 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-09-12T02:37:54.007 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-09-12T02:37:54.007 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-09-12T02:37:54.007 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[6] 50.000000 - 100.000000 : 1 2024-09-12T02:37:54.007 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[7] 20.000000 - 50.000000 : 30 2024-09-12T02:37:54.007 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[8] 10.000000 - 20.000000 : 71 2024-09-12T02:37:54.007 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[9] 5.000000 - 10.000000 : 108 2024-09-12T02:37:54.007 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[10] 2.000000 - 5.000000 : 188 2024-09-12T02:37:54.007 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[11] 1.000000 - 2.000000 : 186 2024-09-12T02:37:54.007 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[12] 0.500000 - 1.000000 : 104 2024-09-12T02:37:54.007 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[13] 0.200000 - 0.500000 : 103 2024-09-12T02:37:54.008 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[14] 0.100000 - 0.200000 : 133 2024-09-12T02:37:54.008 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[15] 0.050000 - 0.100000 : 104 2024-09-12T02:37:54.008 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[16] 0.020000 - 0.050000 : 331 2024-09-12T02:37:54.008 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[17] 0.010000 - 0.020000 : 1 2024-09-12T02:37:54.008 INFO:tasks.workunit.client.1.smithi105.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-09-12T02:37:54.008 INFO:tasks.workunit.client.1.smithi105.stdout: 2024-09-12T02:37:54.008 INFO:tasks.workunit.client.1.smithi105.stdout: 2024-09-12T02:37:54.008 INFO:tasks.workunit.client.1.smithi105.stdout: 2024-09-12T02:37:54.008 INFO:tasks.workunit.client.1.smithi105.stdout: 2024-09-12T02:37:54.008 INFO:tasks.workunit.client.1.smithi105.stdout:1.0% User Time 2024-09-12T02:37:54.008 INFO:tasks.workunit.client.1.smithi105.stdout:25.5% System Time 2024-09-12T02:37:54.008 INFO:tasks.workunit.client.1.smithi105.stdout:26.5% CPU Utilization 2024-09-12T02:37:54.009 INFO:tasks.workunit.client.1.smithi105.stderr:+ cd .. 2024-09-12T02:37:54.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.003+0000 7f0b89b91640 1 Processor -- start 2024-09-12T02:37:54.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.003+0000 7f0b89b91640 1 -- start start 2024-09-12T02:37:54.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.004+0000 7f0b89b91640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b84150480 0x7f0b840c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:54.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.004+0000 7f0b89b91640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0b8406c650 0x7f0b840c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:54.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.004+0000 7f0b89b91640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b8415a7c0 con 0x7f0b840c9c80 2024-09-12T02:37:54.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.004+0000 7f0b89b91640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f0b8406c240 con 0x7f0b8406c650 2024-09-12T02:37:54.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.004+0000 7f0b89b91640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0b8415a330 con 0x7f0b84150480 2024-09-12T02:37:54.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.004+0000 7f0b83fff640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f0b840c9c80 0x7f0b840ca130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:50218/0 (socket says 172.21.15.60:50218) 2024-09-12T02:37:54.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.004+0000 7f0b837fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b84150480 0x7f0b840c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:54.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.004+0000 7f0b83fff640 1 -- 172.21.15.60:0/1586630304 learned_addr learned my addr 172.21.15.60:0/1586630304 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:37:54.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.004+0000 7f0b82ffd640 1 --2- 172.21.15.60:0/1586630304 >> v2:172.21.15.105:3300/0 conn(0x7f0b8406c650 0x7f0b840c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:54.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.005+0000 7f0b827fc640 1 -- 172.21.15.60:0/1586630304 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2717683035 0 0) 0x7f0b8415a7c0 con 0x7f0b840c9c80 2024-09-12T02:37:54.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.005+0000 7f0b827fc640 1 -- 172.21.15.60:0/1586630304 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b6c003520 con 0x7f0b840c9c80 2024-09-12T02:37:54.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.005+0000 7f0b837fe640 1 -- 172.21.15.60:0/1586630304 >> v2:172.21.15.105:3300/0 conn(0x7f0b8406c650 msgr2=0x7f0b840c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:54.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.005+0000 7f0b837fe640 1 --2- 172.21.15.60:0/1586630304 >> v2:172.21.15.105:3300/0 conn(0x7f0b8406c650 0x7f0b840c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:54.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.005+0000 7f0b837fe640 1 -- 172.21.15.60:0/1586630304 >> v1:172.21.15.105:6789/0 conn(0x7f0b840c9c80 legacy=0x7f0b840ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:54.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.005+0000 7f0b837fe640 1 -- 172.21.15.60:0/1586630304 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b84159a00 con 0x7f0b84150480 2024-09-12T02:37:54.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.006+0000 7f0b837fe640 1 --2- 172.21.15.60:0/1586630304 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b84150480 0x7f0b840c7a90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0b740097a0 tx=0x7f0b7402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e4c7ad9e4fc43f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:54.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.006+0000 7f0b827fc640 1 -- 172.21.15.60:0/1586630304 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b74037070 con 0x7f0b84150480 2024-09-12T02:37:54.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.007+0000 7f0b827fc640 1 -- 172.21.15.60:0/1586630304 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b74032440 con 0x7f0b84150480 2024-09-12T02:37:54.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.007+0000 7f0b827fc640 1 -- 172.21.15.60:0/1586630304 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b74037070 con 0x7f0b84150480 2024-09-12T02:37:54.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.008+0000 7f0b89b91640 1 -- 172.21.15.60:0/1586630304 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b84150480 msgr2=0x7f0b840c7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:54.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.008+0000 7f0b89b91640 1 --2- 172.21.15.60:0/1586630304 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b84150480 0x7f0b840c7a90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0b740097a0 tx=0x7f0b7402a180 comp rx=0 tx=0).stop 2024-09-12T02:37:54.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.008+0000 7f0b89b91640 1 -- 172.21.15.60:0/1586630304 shutdown_connections 2024-09-12T02:37:54.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.008+0000 7f0b89b91640 1 --2- 172.21.15.60:0/1586630304 >> v2:172.21.15.105:3300/0 conn(0x7f0b8406c650 0x7f0b840c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:54.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.008+0000 7f0b89b91640 1 --2- 172.21.15.60:0/1586630304 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b84150480 0x7f0b840c7a90 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:54.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.008+0000 7f0b89b91640 1 -- 172.21.15.60:0/1586630304 >> 172.21.15.60:0/1586630304 conn(0x7f0b84068030 msgr2=0x7f0b84073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:54.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.009+0000 7f0b89b91640 1 -- 172.21.15.60:0/1586630304 shutdown_connections 2024-09-12T02:37:54.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.009+0000 7f0b89b91640 1 -- 172.21.15.60:0/1586630304 wait complete. 2024-09-12T02:37:54.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.011+0000 7f0b89b91640 1 Processor -- start 2024-09-12T02:37:54.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.011+0000 7f0b89b91640 1 -- start start 2024-09-12T02:37:54.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.012+0000 7f0b89b91640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b8406c650 0x7f0b841ef2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:54.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.012+0000 7f0b89b91640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b840c9c80 0x7f0b841e3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:54.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.012+0000 7f0b89b91640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b84150480 0x7f0b84158000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:54.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.012+0000 7f0b83fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b84150480 0x7f0b84158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:54.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.012+0000 7f0b83fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b84150480 0x7f0b84158000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58160/0 (socket says 172.21.15.60:58160) 2024-09-12T02:37:54.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.012+0000 7f0b83fff640 1 -- 172.21.15.60:0/3750934473 learned_addr learned my addr 172.21.15.60:0/3750934473 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:37:54.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.012+0000 7f0b82ffd640 1 --2- 172.21.15.60:0/3750934473 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b840c9c80 0x7f0b841e3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:54.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.012+0000 7f0b837fe640 1 --2- 172.21.15.60:0/3750934473 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b8406c650 0x7f0b841ef2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:54.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.012+0000 7f0b89b91640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0b8406d270 con 0x7f0b84150480 2024-09-12T02:37:54.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.012+0000 7f0b89b91640 1 -- 172.21.15.60:0/3750934473 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0b84159fc0 con 0x7f0b840c9c80 2024-09-12T02:37:54.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.012+0000 7f0b89b91640 1 -- 172.21.15.60:0/3750934473 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0b84156270 con 0x7f0b8406c650 2024-09-12T02:37:54.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.012+0000 7f0b83fff640 1 -- 172.21.15.60:0/3750934473 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b8406c650 msgr2=0x7f0b841ef2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:54.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.012+0000 7f0b83fff640 1 --2- 172.21.15.60:0/3750934473 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b8406c650 0x7f0b841ef2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:54.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.012+0000 7f0b83fff640 1 -- 172.21.15.60:0/3750934473 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b840c9c80 msgr2=0x7f0b841e3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:54.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.012+0000 7f0b83fff640 1 --2- 172.21.15.60:0/3750934473 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b840c9c80 0x7f0b841e3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:54.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.012+0000 7f0b83fff640 1 -- 172.21.15.60:0/3750934473 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b84151270 con 0x7f0b84150480 2024-09-12T02:37:54.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.012+0000 7f0b82ffd640 1 --2- 172.21.15.60:0/3750934473 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b840c9c80 0x7f0b841e3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:37:54.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.013+0000 7f0b83fff640 1 --2- 172.21.15.60:0/3750934473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b84150480 0x7f0b84158000 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c00ca50 tx=0x7f0b7c00cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:54.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.013+0000 7f0b6bfff640 1 -- 172.21.15.60:0/3750934473 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c017070 con 0x7f0b84150480 2024-09-12T02:37:54.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.013+0000 7f0b6bfff640 1 -- 172.21.15.60:0/3750934473 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b7c00abb0 con 0x7f0b84150480 2024-09-12T02:37:54.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.013+0000 7f0b6bfff640 1 -- 172.21.15.60:0/3750934473 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c012400 con 0x7f0b84150480 2024-09-12T02:37:54.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.013+0000 7f0b89b91640 1 -- 172.21.15.60:0/3750934473 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b84159010 con 0x7f0b84150480 2024-09-12T02:37:54.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.013+0000 7f0b89b91640 1 -- 172.21.15.60:0/3750934473 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b841595d0 con 0x7f0b84150480 2024-09-12T02:37:54.019 INFO:tasks.workunit.client.1.smithi105.stderr:+ rm -r tmp ffsb 2024-09-12T02:37:54.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.014+0000 7f0b89b91640 1 --2- 172.21.15.60:0/3750934473 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b84158540 0x7f0b8414f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:54.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.014+0000 7f0b89b91640 1 -- 172.21.15.60:0/3750934473 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0b840ca130 con 0x7f0b84158540 2024-09-12T02:37:54.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.015+0000 7f0b837fe640 1 --2- 172.21.15.60:0/3750934473 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b84158540 0x7f0b8414f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:54.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.017+0000 7f0b837fe640 1 -- 172.21.15.60:0/3750934473 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0b841597a0 con 0x7f0b84158540 2024-09-12T02:37:54.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.018+0000 7f0b6bfff640 1 -- 172.21.15.60:0/3750934473 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0b7c01a070 con 0x7f0b84150480 2024-09-12T02:37:54.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.018+0000 7f0b837fe640 1 --2- 172.21.15.60:0/3750934473 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b84158540 0x7f0b8414f150 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0b840c62d0 tx=0x7f0b740046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:54.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.019+0000 7f0b6bfff640 1 --2- 172.21.15.60:0/3750934473 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0b7006bf00 0x7f0b7006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:54.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.019+0000 7f0b6bfff640 1 -- 172.21.15.60:0/3750934473 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f0b7c08af00 con 0x7f0b84150480 2024-09-12T02:37:54.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.019+0000 7f0b82ffd640 1 --2- 172.21.15.60:0/3750934473 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0b7006bf00 0x7f0b7006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:54.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.019+0000 7f0b6bfff640 1 -- 172.21.15.60:0/3750934473 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b74042030 con 0x7f0b84158540 2024-09-12T02:37:54.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.020+0000 7f0b6bfff640 1 -- 172.21.15.60:0/3750934473 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f0b740093c0 con 0x7f0b84158540 2024-09-12T02:37:54.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.020+0000 7f0b6bfff640 1 -- 172.21.15.60:0/3750934473 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b84158540 msgr2=0x7f0b8414f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:54.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.020+0000 7f0b6bfff640 1 --2- 172.21.15.60:0/3750934473 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b84158540 0x7f0b8414f150 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0b840c62d0 tx=0x7f0b740046c0 comp rx=0 tx=0).stop 2024-09-12T02:37:54.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.020+0000 7f0b6bfff640 1 -- 172.21.15.60:0/3750934473 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b84158540 msgr2=0x7f0b8414f150 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:37:54.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.020+0000 7f0b6bfff640 1 --2- 172.21.15.60:0/3750934473 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b84158540 0x7f0b8414f150 secure :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0b840c62d0 tx=0x7f0b740046c0 comp rx=0 tx=0).stop 2024-09-12T02:37:54.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.020+0000 7f0b82ffd640 1 --2- 172.21.15.60:0/3750934473 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0b7006bf00 0x7f0b7006e3c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f0b84156aa0 tx=0x7f0b78009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:54.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.036+0000 7f0b89b91640 1 --2- 172.21.15.60:0/3750934473 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b840cb040 0x7f0b840afb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:54.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.036+0000 7f0b89b91640 1 -- 172.21.15.60:0/3750934473 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0b8406c430 con 0x7f0b840cb040 2024-09-12T02:37:54.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.037+0000 7f0b837fe640 1 --2- 172.21.15.60:0/3750934473 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b840cb040 0x7f0b840afb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:54.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.038+0000 7f0b837fe640 1 -- 172.21.15.60:0/3750934473 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0b841e2630 con 0x7f0b840cb040 2024-09-12T02:37:54.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.040+0000 7f0b837fe640 1 --2- 172.21.15.60:0/3750934473 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b840cb040 0x7f0b840afb30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0b740097a0 tx=0x7f0b74008030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:54.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.040+0000 7f0b6bfff640 1 -- 172.21.15.60:0/3750934473 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b74042030 con 0x7f0b840cb040 2024-09-12T02:37:54.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.040+0000 7f0b6bfff640 1 -- 172.21.15.60:0/3750934473 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5051 (secure 0 0 0) 0x7f0b74047660 con 0x7f0b840cb040 2024-09-12T02:37:54.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.040+0000 7f0b6bfff640 1 -- 172.21.15.60:0/3750934473 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b840cb040 msgr2=0x7f0b840afb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:54.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.040+0000 7f0b6bfff640 1 --2- 172.21.15.60:0/3750934473 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b840cb040 0x7f0b840afb30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0b740097a0 tx=0x7f0b74008030 comp rx=0 tx=0).stop 2024-09-12T02:37:54.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.041+0000 7f0b6bfff640 1 -- 172.21.15.60:0/3750934473 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b840cb040 msgr2=0x7f0b840afb30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:37:54.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.041+0000 7f0b6bfff640 1 --2- 172.21.15.60:0/3750934473 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b840cb040 0x7f0b840afb30 secure :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0b740097a0 tx=0x7f0b74008030 comp rx=0 tx=0).stop 2024-09-12T02:37:54.042 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:37:54.042 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:37:54.042 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:37:54.042 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:37:54.042 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 146, 2024-09-12T02:37:54.043 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 347795, 2024-09-12T02:37:54.043 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:37:54.043 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:37:54.043 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:37:54.043 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:37:54.043 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:54.043 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 1, 2024-09-12T02:37:54.043 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:37:54.043 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:37:54.043 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:37:54.043 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:37:54.043 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:37:54.043 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:37:54.043 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:37:54.044 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:37:54.044 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:37:54.044 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:37:54.044 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:37:54.044 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:37:54.044 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:37:54.044 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:37:54.044 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:54.044 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:37:54.044 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:37:54.044 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:37:54.044 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:37:54.044 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:37:54.044 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:37:54.044 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:37:54.045 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:37:54.045 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:37:54.045 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:37:54.045 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:37:54.045 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:37:54.045 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:37:54.045 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:54.045 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:54.045 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:37:54.045 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:37:54.045 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:37:54.045 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:37:54.046 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:37:54.046 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:37:54.046 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:37:54.046 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:37:54.046 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:37:54.046 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:37:54.046 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:37:54.046 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:37:54.046 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:37:54.046 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:37:54.046 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:37:54.046 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:37:54.046 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:37:54.047 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:37:54.047 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:37:54.047 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:37:54.047 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:37:54.047 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:37:54.047 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:37:54.047 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:37:54.047 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:37:54.047 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:37:54.047 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:37:54.047 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:37:54.047 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:54.047 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:37:54.047 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:54.048 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:37:54.048 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:54.048 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:37:54.048 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:37:54.048 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:37:54.048 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:37:54.048 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:54.048 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:37:54.048 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:37:54.048 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:54.048 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:54.048 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:54.048 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:37:54.048 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:37:54.049 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:54.049 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:54.049 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:54.049 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:54.049 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:37:54.049 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:37:54.049 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:37:54.049 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:37:54.049 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:37:54.049 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:54.049 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:54.049 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:37:54.049 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:37:54.050 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:37:54.050 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:37:54.050 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:54.050 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:37:54.050 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:37:54.050 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:54.050 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:54.050 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:54.050 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:37:54.050 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:37:54.050 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:54.050 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:54.050 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:54.050 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:54.051 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:37:54.051 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:37:54.051 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:37:54.051 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:37:54.051 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:37:54.051 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:54.051 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:54.051 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:37:54.051 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:37:54.051 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:37:54.051 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:37:54.051 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:54.052 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:37:54.052 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:37:54.052 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:54.052 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:54.052 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:54.052 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:37:54.052 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:37:54.052 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:37:54.052 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:54.052 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:54.052 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:54.052 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:37:54.052 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:37:54.053 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:37:54.053 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:37:54.053 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:37:54.053 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:54.053 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:54.053 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:54.053 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:37:54.053 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:37:54.053 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:54.053 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:37:54.053 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:37:54.053 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:37:54.053 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:54.054 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:54.054 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:37:54.054 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:54.054 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:37:54.054 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:37:54.054 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:37:54.054 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:54.054 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:54.054 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:37:54.054 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:54.054 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:37:54.054 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:37:54.055 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:37:54.055 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:54.055 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:54.055 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:37:54.055 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:54.055 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:37:54.055 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:37:54.055 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 7 2024-09-12T02:37:54.055 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:54.055 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:37:54.055 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:37:54.055 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:37:54.055 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:37:54.056 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:37:54.056 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:37:54.056 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:37:54.056 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:37:54.056 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:37:54.056 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:37:54.056 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:37:54.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.041+0000 7f0b69ffb640 1 -- 172.21.15.60:0/3750934473 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0b7006bf00 msgr2=0x7f0b7006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:54.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.041+0000 7f0b69ffb640 1 --2- 172.21.15.60:0/3750934473 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0b7006bf00 0x7f0b7006e3c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f0b84156aa0 tx=0x7f0b78009190 comp rx=0 tx=0).stop 2024-09-12T02:37:54.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.041+0000 7f0b83fff640 1 -- 172.21.15.60:0/3750934473 reap_dead start 2024-09-12T02:37:54.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.041+0000 7f0b69ffb640 1 -- 172.21.15.60:0/3750934473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b84150480 msgr2=0x7f0b84158000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:54.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.041+0000 7f0b69ffb640 1 --2- 172.21.15.60:0/3750934473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b84150480 0x7f0b84158000 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c00ca50 tx=0x7f0b7c00cf10 comp rx=0 tx=0).stop 2024-09-12T02:37:54.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.041+0000 7f0b69ffb640 1 -- 172.21.15.60:0/3750934473 shutdown_connections 2024-09-12T02:37:54.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.041+0000 7f0b69ffb640 1 --2- 172.21.15.60:0/3750934473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b84150480 0x7f0b84158000 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:54.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.041+0000 7f0b69ffb640 1 -- 172.21.15.60:0/3750934473 >> 172.21.15.60:0/3750934473 conn(0x7f0b84068030 msgr2=0x7f0b84073310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:54.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.042+0000 7f0b69ffb640 1 -- 172.21.15.60:0/3750934473 shutdown_connections 2024-09-12T02:37:54.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.042+0000 7f0b69ffb640 1 -- 172.21.15.60:0/3750934473 wait complete. 2024-09-12T02:37:54.059 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:37:54.059 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-12T02:37:54.059 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-12T02:37:54.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.229+0000 7f127dcae640 1 Processor -- start 2024-09-12T02:37:54.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.229+0000 7f127dcae640 1 -- start start 2024-09-12T02:37:54.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.230+0000 7f127dcae640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1278150480 0x7f12780c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:54.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.230+0000 7f127dcae640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f12780ca390 0x7f12780c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:54.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.231+0000 7f127dcae640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f127815a7c0 con 0x7f127806c650 2024-09-12T02:37:54.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.231+0000 7f127dcae640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f127806c240 con 0x7f12780ca390 2024-09-12T02:37:54.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.231+0000 7f127dcae640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f127815a330 con 0x7f1278150480 2024-09-12T02:37:54.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.232+0000 7f1277fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f12780ca390 0x7f12780c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:54.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.232+0000 7f1277fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f12780ca390 0x7f12780c7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58174/0 (socket says 172.21.15.60:58174) 2024-09-12T02:37:54.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.232+0000 7f1277fff640 1 -- 172.21.15.60:0/1127759448 learned_addr learned my addr 172.21.15.60:0/1127759448 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:37:54.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.232+0000 7f12777fe640 1 --2- 172.21.15.60:0/1127759448 >> v2:172.21.15.105:3300/0 conn(0x7f1278150480 0x7f12780c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:54.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.232+0000 7f1277fff640 1 -- 172.21.15.60:0/1127759448 >> v2:172.21.15.105:3300/0 conn(0x7f1278150480 msgr2=0x7f12780c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:54.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.232+0000 7f1277fff640 1 --2- 172.21.15.60:0/1127759448 >> v2:172.21.15.105:3300/0 conn(0x7f1278150480 0x7f12780c7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:54.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.232+0000 7f1277fff640 1 -- 172.21.15.60:0/1127759448 >> v1:172.21.15.105:6789/0 conn(0x7f127806c650 legacy=0x7f12780c9c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:37:54.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.232+0000 7f1277fff640 1 -- 172.21.15.60:0/1127759448 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1278159a00 con 0x7f12780ca390 2024-09-12T02:37:54.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.233+0000 7f1277fff640 1 --2- 172.21.15.60:0/1127759448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12780ca390 0x7f12780c7fd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f12780ccac0 tx=0x7f127002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d30d8105eaf0c6b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:54.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.234+0000 7f1276ffd640 1 -- 172.21.15.60:0/1127759448 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1270037070 con 0x7f12780ca390 2024-09-12T02:37:54.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.234+0000 7f1276ffd640 1 -- 172.21.15.60:0/1127759448 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1270032440 con 0x7f12780ca390 2024-09-12T02:37:54.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.234+0000 7f1276ffd640 1 -- 172.21.15.60:0/1127759448 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1270032810 con 0x7f12780ca390 2024-09-12T02:37:54.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.235+0000 7f127dcae640 1 -- 172.21.15.60:0/1127759448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12780ca390 msgr2=0x7f12780c7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:54.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.235+0000 7f127dcae640 1 --2- 172.21.15.60:0/1127759448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12780ca390 0x7f12780c7fd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f12780ccac0 tx=0x7f127002a230 comp rx=0 tx=0).stop 2024-09-12T02:37:54.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.235+0000 7f127dcae640 1 -- 172.21.15.60:0/1127759448 shutdown_connections 2024-09-12T02:37:54.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.235+0000 7f127dcae640 1 --2- 172.21.15.60:0/1127759448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12780ca390 0x7f12780c7fd0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:54.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.235+0000 7f127dcae640 1 --2- 172.21.15.60:0/1127759448 >> v2:172.21.15.105:3300/0 conn(0x7f1278150480 0x7f12780c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:54.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.235+0000 7f127dcae640 1 -- 172.21.15.60:0/1127759448 >> 172.21.15.60:0/1127759448 conn(0x7f1278068030 msgr2=0x7f1278073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:54.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.235+0000 7f127dcae640 1 -- 172.21.15.60:0/1127759448 shutdown_connections 2024-09-12T02:37:54.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.235+0000 7f127dcae640 1 -- 172.21.15.60:0/1127759448 wait complete. 2024-09-12T02:37:54.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.237+0000 7f127dcae640 1 Processor -- start 2024-09-12T02:37:54.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.238+0000 7f127dcae640 1 -- start start 2024-09-12T02:37:54.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.239+0000 7f127dcae640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f127806c650 0x7f12781f0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:54.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.239+0000 7f127dcae640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12780ca390 0x7f1278151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:54.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.239+0000 7f127dcae640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1278150480 0x7f127814f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:54.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.239+0000 7f127dcae640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f127806d270 con 0x7f1278150480 2024-09-12T02:37:54.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.239+0000 7f127dcae640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1278159fc0 con 0x7f127806c650 2024-09-12T02:37:54.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.239+0000 7f127dcae640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1278156270 con 0x7f12780ca390 2024-09-12T02:37:54.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.240+0000 7f126ffff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12780ca390 0x7f1278151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:54.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.240+0000 7f126ffff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12780ca390 0x7f1278151050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:56536/0 (socket says 172.21.15.60:56536) 2024-09-12T02:37:54.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.240+0000 7f126ffff640 1 -- 172.21.15.60:0/1188250336 learned_addr learned my addr 172.21.15.60:0/1188250336 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:37:54.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.240+0000 7f12777fe640 1 --2- 172.21.15.60:0/1188250336 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f127806c650 0x7f12781f0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:54.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.240+0000 7f1277fff640 1 --2- 172.21.15.60:0/1188250336 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1278150480 0x7f127814f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:54.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.240+0000 7f126ffff640 1 -- 172.21.15.60:0/1188250336 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f127806c650 msgr2=0x7f12781f0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:54.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.240+0000 7f126ffff640 1 --2- 172.21.15.60:0/1188250336 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f127806c650 0x7f12781f0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:54.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.240+0000 7f126ffff640 1 -- 172.21.15.60:0/1188250336 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1278150480 msgr2=0x7f127814f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:54.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.240+0000 7f126ffff640 1 --2- 172.21.15.60:0/1188250336 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1278150480 0x7f127814f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:54.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.241+0000 7f126ffff640 1 -- 172.21.15.60:0/1188250336 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1278151590 con 0x7f12780ca390 2024-09-12T02:37:54.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.241+0000 7f12777fe640 1 --2- 172.21.15.60:0/1188250336 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f127806c650 0x7f12781f0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:37:54.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.241+0000 7f1277fff640 1 --2- 172.21.15.60:0/1188250336 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1278150480 0x7f127814f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:37:54.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.241+0000 7f126ffff640 1 --2- 172.21.15.60:0/1188250336 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12780ca390 0x7f1278151050 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f126000b3e0 tx=0x7f126000b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:54.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.241+0000 7f1274ff9640 1 -- 172.21.15.60:0/1188250336 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1260015020 con 0x7f12780ca390 2024-09-12T02:37:54.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.241+0000 7f1274ff9640 1 -- 172.21.15.60:0/1188250336 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1260011850 con 0x7f12780ca390 2024-09-12T02:37:54.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.241+0000 7f1274ff9640 1 -- 172.21.15.60:0/1188250336 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1260011c40 con 0x7f12780ca390 2024-09-12T02:37:54.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.241+0000 7f127dcae640 1 -- 172.21.15.60:0/1188250336 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12781e14d0 con 0x7f12780ca390 2024-09-12T02:37:54.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.241+0000 7f127dcae640 1 -- 172.21.15.60:0/1188250336 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f12781e23a0 con 0x7f12780ca390 2024-09-12T02:37:54.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.243+0000 7f126dffb640 1 -- 172.21.15.60:0/1188250336 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12780c9c80 con 0x7f12780ca390 2024-09-12T02:37:54.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.246+0000 7f1274ff9640 1 -- 172.21.15.60:0/1188250336 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1260018020 con 0x7f12780ca390 2024-09-12T02:37:54.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.247+0000 7f1274ff9640 1 --2- 172.21.15.60:0/1188250336 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f125806be30 0x7f125806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:54.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.247+0000 7f1274ff9640 1 -- 172.21.15.60:0/1188250336 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f126008b310 con 0x7f12780ca390 2024-09-12T02:37:54.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.247+0000 7f12777fe640 1 --2- 172.21.15.60:0/1188250336 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f125806be30 0x7f125806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:54.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.248+0000 7f12777fe640 1 --2- 172.21.15.60:0/1188250336 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f125806be30 0x7f125806e2f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f1268007330 tx=0x7f126800b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:54.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.251+0000 7f1274ff9640 1 -- 172.21.15.60:0/1188250336 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f126001f030 con 0x7f12780ca390 2024-09-12T02:37:54.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.690+0000 7f126dffb640 1 -- 172.21.15.60:0/1188250336 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f127806c430 con 0x7f12780ca390 2024-09-12T02:37:54.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.693+0000 7f1274ff9640 1 -- 172.21.15.60:0/1188250336 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f1278151590 con 0x7f12780ca390 2024-09-12T02:37:54.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.697+0000 7f126dffb640 1 -- 172.21.15.60:0/1188250336 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f125806be30 msgr2=0x7f125806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:54.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.697+0000 7f126dffb640 1 --2- 172.21.15.60:0/1188250336 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f125806be30 0x7f125806e2f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f1268007330 tx=0x7f126800b040 comp rx=0 tx=0).stop 2024-09-12T02:37:54.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.697+0000 7f126dffb640 1 -- 172.21.15.60:0/1188250336 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12780ca390 msgr2=0x7f1278151050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:54.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.697+0000 7f126dffb640 1 --2- 172.21.15.60:0/1188250336 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12780ca390 0x7f1278151050 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f126000b3e0 tx=0x7f126000b8a0 comp rx=0 tx=0).stop 2024-09-12T02:37:54.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.697+0000 7f126dffb640 1 -- 172.21.15.60:0/1188250336 shutdown_connections 2024-09-12T02:37:54.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.697+0000 7f126dffb640 1 --2- 172.21.15.60:0/1188250336 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f125806be30 0x7f125806e2f0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:54.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.697+0000 7f126dffb640 1 --2- 172.21.15.60:0/1188250336 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1278150480 0x7f127814f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:54.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.697+0000 7f126dffb640 1 --2- 172.21.15.60:0/1188250336 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12780ca390 0x7f1278151050 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:54.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.697+0000 7f126dffb640 1 --2- 172.21.15.60:0/1188250336 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f127806c650 0x7f12781f0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:54.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.697+0000 7f126dffb640 1 -- 172.21.15.60:0/1188250336 >> 172.21.15.60:0/1188250336 conn(0x7f1278068030 msgr2=0x7f12780c8790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:54.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.700+0000 7f126dffb640 1 -- 172.21.15.60:0/1188250336 shutdown_connections 2024-09-12T02:37:54.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:37:54.700+0000 7f126dffb640 1 -- 172.21.15.60:0/1188250336 wait complete. 2024-09-12T02:37:54.719 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-12T02:38:01.930 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:38:01.933 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:38:02.431 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T02:38:02.431 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-09-12T02:38:02.477 INFO:tasks.workunit:Stopping ['suites/ffsb.sh'] on client.1... 2024-09-12T02:38:02.477 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-09-12T02:38:02.905 DEBUG:teuthology.parallel:result is None 2024-09-12T02:38:04.720 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-12T02:38:04.720 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:38:04.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.887+0000 7f05d359e640 1 Processor -- start 2024-09-12T02:38:04.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.887+0000 7f05d359e640 1 -- start start 2024-09-12T02:38:04.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.888+0000 7f05d359e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05d40c7f70 0x7f05d406e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:04.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.888+0000 7f05d359e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f05d41579d0 0x7f05d4157e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:04.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.888+0000 7f05d359e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f05d40c5b90 0x7f05d40c6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:04.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.888+0000 7f05d359e640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f05d406ea80 con 0x7f05d41579d0 2024-09-12T02:38:04.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.888+0000 7f05d359e640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f05d415aa40 con 0x7f05d40c5b90 2024-09-12T02:38:04.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.888+0000 7f05d359e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f05d415ad20 con 0x7f05d40c7f70 2024-09-12T02:38:04.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.889+0000 7f05d1d9b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f05d41579d0 0x7f05d4157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:04.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.889+0000 7f05d1d9b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f05d41579d0 0x7f05d4157e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37888/0 (socket says 172.21.15.60:37888) 2024-09-12T02:38:04.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.889+0000 7f05d1d9b640 1 -- 172.21.15.60:0/2812293882 learned_addr learned my addr 172.21.15.60:0/2812293882 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:38:04.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.889+0000 7f05d2d9d640 1 --2- 172.21.15.60:0/2812293882 >> v2:172.21.15.105:3300/0 conn(0x7f05d40c5b90 0x7f05d40c6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:04.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.890+0000 7f05d1d9b640 1 -- 172.21.15.60:0/2812293882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05d40c7f70 msgr2=0x7f05d406e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:04.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.890+0000 7f05d259c640 1 --2- 172.21.15.60:0/2812293882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05d40c7f70 0x7f05d406e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:04.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.891+0000 7f05d1d9b640 1 --2- 172.21.15.60:0/2812293882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05d40c7f70 0x7f05d406e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:04.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.891+0000 7f05d1d9b640 1 -- 172.21.15.60:0/2812293882 >> v2:172.21.15.105:3300/0 conn(0x7f05d40c5b90 msgr2=0x7f05d40c6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:04.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.891+0000 7f05d1d9b640 1 --2- 172.21.15.60:0/2812293882 >> v2:172.21.15.105:3300/0 conn(0x7f05d40c5b90 0x7f05d40c6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:04.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.891+0000 7f05d1d9b640 1 -- 172.21.15.60:0/2812293882 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05d415b000 con 0x7f05d41579d0 2024-09-12T02:38:04.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.892+0000 7f05d259c640 1 --2- 172.21.15.60:0/2812293882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05d40c7f70 0x7f05d406e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:38:04.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.892+0000 7f05d2d9d640 1 --2- 172.21.15.60:0/2812293882 >> v2:172.21.15.105:3300/0 conn(0x7f05d40c5b90 0x7f05d40c6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:38:04.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.893+0000 7f05d1d9b640 1 --2- 172.21.15.60:0/2812293882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05d41579d0 0x7f05d4157e10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f05d406e4c0 tx=0x7f05c804c170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b2ef410e27af2f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:04.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.894+0000 7f05d159a640 1 -- 172.21.15.60:0/2812293882 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c8059070 con 0x7f05d41579d0 2024-09-12T02:38:04.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.894+0000 7f05d159a640 1 -- 172.21.15.60:0/2812293882 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05c8054440 con 0x7f05d41579d0 2024-09-12T02:38:04.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.895+0000 7f05d359e640 1 -- 172.21.15.60:0/2812293882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05d41579d0 msgr2=0x7f05d4157e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:04.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.895+0000 7f05d359e640 1 --2- 172.21.15.60:0/2812293882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05d41579d0 0x7f05d4157e10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f05d406e4c0 tx=0x7f05c804c170 comp rx=0 tx=0).stop 2024-09-12T02:38:04.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.895+0000 7f05d359e640 1 -- 172.21.15.60:0/2812293882 shutdown_connections 2024-09-12T02:38:04.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.895+0000 7f05d359e640 1 --2- 172.21.15.60:0/2812293882 >> v2:172.21.15.105:3300/0 conn(0x7f05d40c5b90 0x7f05d40c6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:04.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.895+0000 7f05d359e640 1 --2- 172.21.15.60:0/2812293882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05d41579d0 0x7f05d4157e10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:04.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.895+0000 7f05d359e640 1 --2- 172.21.15.60:0/2812293882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05d40c7f70 0x7f05d406e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:04.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.895+0000 7f05d359e640 1 -- 172.21.15.60:0/2812293882 >> 172.21.15.60:0/2812293882 conn(0x7f05d406bbe0 msgr2=0x7f05d406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:04.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.898+0000 7f05d359e640 1 -- 172.21.15.60:0/2812293882 shutdown_connections 2024-09-12T02:38:04.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.898+0000 7f05d359e640 1 -- 172.21.15.60:0/2812293882 wait complete. 2024-09-12T02:38:04.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.900+0000 7f05d359e640 1 Processor -- start 2024-09-12T02:38:04.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.900+0000 7f05d359e640 1 -- start start 2024-09-12T02:38:04.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.901+0000 7f05d359e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05d40c5b90 0x7f05d40bce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:04.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.901+0000 7f05d359e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05d40c7f70 0x7f05d40707e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:04.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.901+0000 7f05d359e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05d41579d0 0x7f05d4072f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:04.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.901+0000 7f05d359e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f05d415a630 con 0x7f05d40c5b90 2024-09-12T02:38:04.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.901+0000 7f05d359e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f05d406f050 con 0x7f05d41579d0 2024-09-12T02:38:04.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.901+0000 7f05d359e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f05d415a7b0 con 0x7f05d40c7f70 2024-09-12T02:38:04.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.903+0000 7f05d2d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05d41579d0 0x7f05d4072f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:04.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.903+0000 7f05d259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05d40c5b90 0x7f05d40bce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:04.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.903+0000 7f05d259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05d40c5b90 0x7f05d40bce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37890/0 (socket says 172.21.15.60:37890) 2024-09-12T02:38:04.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.903+0000 7f05d259c640 1 -- 172.21.15.60:0/3706654708 learned_addr learned my addr 172.21.15.60:0/3706654708 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:38:04.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.903+0000 7f05d1d9b640 1 --2- 172.21.15.60:0/3706654708 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05d40c7f70 0x7f05d40707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:04.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.904+0000 7f05d259c640 1 -- 172.21.15.60:0/3706654708 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05d40c7f70 msgr2=0x7f05d40707e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:04.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.904+0000 7f05d259c640 1 --2- 172.21.15.60:0/3706654708 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05d40c7f70 0x7f05d40707e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:04.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.904+0000 7f05d259c640 1 -- 172.21.15.60:0/3706654708 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05d41579d0 msgr2=0x7f05d4072f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:04.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.904+0000 7f05d259c640 1 --2- 172.21.15.60:0/3706654708 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05d41579d0 0x7f05d4072f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:04.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.904+0000 7f05d259c640 1 -- 172.21.15.60:0/3706654708 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05d4072210 con 0x7f05d40c5b90 2024-09-12T02:38:04.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.905+0000 7f05d259c640 1 --2- 172.21.15.60:0/3706654708 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05d40c5b90 0x7f05d40bce50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f05c400cf10 tx=0x7f05c400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:04.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.906+0000 7f05c2ffd640 1 -- 172.21.15.60:0/3706654708 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c401a070 con 0x7f05d40c5b90 2024-09-12T02:38:04.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.906+0000 7f05d359e640 1 -- 172.21.15.60:0/3706654708 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05d40724b0 con 0x7f05d40c5b90 2024-09-12T02:38:04.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.906+0000 7f05d359e640 1 -- 172.21.15.60:0/3706654708 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05d4072a70 con 0x7f05d40c5b90 2024-09-12T02:38:04.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.907+0000 7f05c2ffd640 1 -- 172.21.15.60:0/3706654708 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05c400d840 con 0x7f05d40c5b90 2024-09-12T02:38:04.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.908+0000 7f05c2ffd640 1 -- 172.21.15.60:0/3706654708 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c400dc10 con 0x7f05d40c5b90 2024-09-12T02:38:04.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.909+0000 7f05d359e640 1 -- 172.21.15.60:0/3706654708 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05b8005290 con 0x7f05d40c5b90 2024-09-12T02:38:04.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.911+0000 7f05c2ffd640 1 -- 172.21.15.60:0/3706654708 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f05c401d070 con 0x7f05d40c5b90 2024-09-12T02:38:04.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.912+0000 7f05c2ffd640 1 --2- 172.21.15.60:0/3706654708 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f05b406bf30 0x7f05b406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:04.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.912+0000 7f05c2ffd640 1 -- 172.21.15.60:0/3706654708 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f05c408c0e0 con 0x7f05d40c5b90 2024-09-12T02:38:04.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.913+0000 7f05d1d9b640 1 --2- 172.21.15.60:0/3706654708 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f05b406bf30 0x7f05b406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:04.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.913+0000 7f05d1d9b640 1 --2- 172.21.15.60:0/3706654708 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f05b406bf30 0x7f05b406e3f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f05c8056000 tx=0x7f05c8050000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:04.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:04.922+0000 7f05c2ffd640 1 -- 172.21.15.60:0/3706654708 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f05c405a1d0 con 0x7f05d40c5b90 2024-09-12T02:38:05.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.428+0000 7f05d359e640 1 -- 172.21.15.60:0/3706654708 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f05b8005580 con 0x7f05d40c5b90 2024-09-12T02:38:05.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.429+0000 7f05c2ffd640 1 -- 172.21.15.60:0/3706654708 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1566 (secure 0 0 0) 0x7f05c405e4d0 con 0x7f05d40c5b90 2024-09-12T02:38:05.433 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":146,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:38:05.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.435+0000 7f05d359e640 1 -- 172.21.15.60:0/3706654708 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f05b406bf30 msgr2=0x7f05b406e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:05.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.435+0000 7f05d359e640 1 --2- 172.21.15.60:0/3706654708 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f05b406bf30 0x7f05b406e3f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f05c8056000 tx=0x7f05c8050000 comp rx=0 tx=0).stop 2024-09-12T02:38:05.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.435+0000 7f05d359e640 1 -- 172.21.15.60:0/3706654708 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05d40c5b90 msgr2=0x7f05d40bce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:05.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.435+0000 7f05d359e640 1 --2- 172.21.15.60:0/3706654708 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05d40c5b90 0x7f05d40bce50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f05c400cf10 tx=0x7f05c400a710 comp rx=0 tx=0).stop 2024-09-12T02:38:05.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.435+0000 7f05d359e640 1 -- 172.21.15.60:0/3706654708 shutdown_connections 2024-09-12T02:38:05.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.435+0000 7f05d359e640 1 --2- 172.21.15.60:0/3706654708 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f05b406bf30 0x7f05b406e3f0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.435+0000 7f05d359e640 1 --2- 172.21.15.60:0/3706654708 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05d41579d0 0x7f05d4072f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.435+0000 7f05d359e640 1 --2- 172.21.15.60:0/3706654708 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05d40c7f70 0x7f05d40707e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.435+0000 7f05d359e640 1 --2- 172.21.15.60:0/3706654708 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05d40c5b90 0x7f05d40bce50 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.435+0000 7f05d359e640 1 -- 172.21.15.60:0/3706654708 >> 172.21.15.60:0/3706654708 conn(0x7f05d406bbe0 msgr2=0x7f05d406bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:05.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.436+0000 7f05d359e640 1 -- 172.21.15.60:0/3706654708 shutdown_connections 2024-09-12T02:38:05.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.436+0000 7f05d359e640 1 -- 172.21.15.60:0/3706654708 wait complete. 2024-09-12T02:38:05.465 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-12T02:38:05.465 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-12T02:38:05.465 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-12T02:38:05.465 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-12T02:38:05.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.665+0000 7fef18282640 1 Processor -- start 2024-09-12T02:38:05.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.666+0000 7fef18282640 1 -- start start 2024-09-12T02:38:05.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.667+0000 7fef18282640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fef10150480 0x7fef100c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:05.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.667+0000 7fef18282640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef1006c650 0x7fef100c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:05.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.667+0000 7fef18282640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fef100c9c80 0x7fef100ca130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:05.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.667+0000 7fef18282640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fef1006c240 con 0x7fef10150480 2024-09-12T02:38:05.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.667+0000 7fef18282640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fef1015a330 con 0x7fef100c9c80 2024-09-12T02:38:05.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.667+0000 7fef18282640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fef1015a7c0 con 0x7fef1006c650 2024-09-12T02:38:05.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.668+0000 7fef1601e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fef10150480 0x7fef100c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:05.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.668+0000 7fef1601e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fef10150480 0x7fef100c7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37894/0 (socket says 172.21.15.60:37894) 2024-09-12T02:38:05.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.668+0000 7fef1601e640 1 -- 172.21.15.60:0/3357790731 learned_addr learned my addr 172.21.15.60:0/3357790731 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:38:05.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.668+0000 7fef1581d640 1 --2- 172.21.15.60:0/3357790731 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef1006c650 0x7fef100c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:05.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.669+0000 7fef1601e640 1 -- 172.21.15.60:0/3357790731 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef1006c650 msgr2=0x7fef100c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:05.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.669+0000 7fef1601e640 1 --2- 172.21.15.60:0/3357790731 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef1006c650 0x7fef100c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.669+0000 7fef1601e640 1 -- 172.21.15.60:0/3357790731 >> v2:172.21.15.105:3300/0 conn(0x7fef100c9c80 msgr2=0x7fef100ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:05.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.669+0000 7fef1601e640 1 --2- 172.21.15.60:0/3357790731 >> v2:172.21.15.105:3300/0 conn(0x7fef100c9c80 0x7fef100ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.669+0000 7fef1601e640 1 -- 172.21.15.60:0/3357790731 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef10159a00 con 0x7fef10150480 2024-09-12T02:38:05.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.673+0000 7fef1601e640 1 --2- 172.21.15.60:0/3357790731 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef10150480 0x7fef100c7a90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fef100c62d0 tx=0x7fef08032ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a445c09c2dbc36c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:05.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.674+0000 7fef1501c640 1 -- 172.21.15.60:0/3357790731 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef080339e0 con 0x7fef10150480 2024-09-12T02:38:05.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.674+0000 7fef1501c640 1 -- 172.21.15.60:0/3357790731 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef08033b80 con 0x7fef10150480 2024-09-12T02:38:05.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.674+0000 7fef1501c640 1 -- 172.21.15.60:0/3357790731 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef0803b3f0 con 0x7fef10150480 2024-09-12T02:38:05.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.675+0000 7fef18282640 1 -- 172.21.15.60:0/3357790731 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef10150480 msgr2=0x7fef100c7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:05.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.675+0000 7fef18282640 1 --2- 172.21.15.60:0/3357790731 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef10150480 0x7fef100c7a90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fef100c62d0 tx=0x7fef08032ea0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.680+0000 7fef18282640 1 -- 172.21.15.60:0/3357790731 shutdown_connections 2024-09-12T02:38:05.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.680+0000 7fef18282640 1 --2- 172.21.15.60:0/3357790731 >> v2:172.21.15.105:3300/0 conn(0x7fef100c9c80 0x7fef100ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.680+0000 7fef18282640 1 --2- 172.21.15.60:0/3357790731 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef1006c650 0x7fef100c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.680+0000 7fef18282640 1 --2- 172.21.15.60:0/3357790731 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef10150480 0x7fef100c7a90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.680+0000 7fef18282640 1 -- 172.21.15.60:0/3357790731 >> 172.21.15.60:0/3357790731 conn(0x7fef10068030 msgr2=0x7fef10073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:05.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.681+0000 7fef18282640 1 -- 172.21.15.60:0/3357790731 shutdown_connections 2024-09-12T02:38:05.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.681+0000 7fef18282640 1 -- 172.21.15.60:0/3357790731 wait complete. 2024-09-12T02:38:05.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.683+0000 7fef18282640 1 Processor -- start 2024-09-12T02:38:05.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.686+0000 7fef18282640 1 -- start start 2024-09-12T02:38:05.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.687+0000 7fef18282640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef1006c650 0x7fef100aff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:05.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.687+0000 7fef18282640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef100c9c80 0x7fef100aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:05.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.687+0000 7fef18282640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef10150480 0x7fef100ac670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:05.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.687+0000 7fef18282640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fef100ca670 con 0x7fef1006c650 2024-09-12T02:38:05.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.687+0000 7fef18282640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fef10159fc0 con 0x7fef10150480 2024-09-12T02:38:05.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.687+0000 7fef18282640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fef1006d270 con 0x7fef100c9c80 2024-09-12T02:38:05.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.687+0000 7fef1581d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef100c9c80 0x7fef100aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:05.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.687+0000 7fef1581d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef100c9c80 0x7fef100aeae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:45294/0 (socket says 172.21.15.60:45294) 2024-09-12T02:38:05.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.687+0000 7fef1581d640 1 -- 172.21.15.60:0/200762402 learned_addr learned my addr 172.21.15.60:0/200762402 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:38:05.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.688+0000 7fef1581d640 1 -- 172.21.15.60:0/200762402 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef10150480 msgr2=0x7fef100ac670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:05.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.688+0000 7fef1681f640 1 --2- 172.21.15.60:0/200762402 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef10150480 0x7fef100ac670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:05.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.688+0000 7fef1581d640 1 --2- 172.21.15.60:0/200762402 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef10150480 0x7fef100ac670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.688+0000 7fef1581d640 1 -- 172.21.15.60:0/200762402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef1006c650 msgr2=0x7fef100aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:05.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.688+0000 7fef1581d640 1 --2- 172.21.15.60:0/200762402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef1006c650 0x7fef100aff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.688+0000 7fef1581d640 1 -- 172.21.15.60:0/200762402 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef100b1240 con 0x7fef100c9c80 2024-09-12T02:38:05.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.692+0000 7fef1581d640 1 --2- 172.21.15.60:0/200762402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef100c9c80 0x7fef100aeae0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fef0c00d5f0 tx=0x7fef0c00dab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:05.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.694+0000 7fef06ffd640 1 -- 172.21.15.60:0/200762402 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef0c0125f0 con 0x7fef100c9c80 2024-09-12T02:38:05.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.694+0000 7fef18282640 1 -- 172.21.15.60:0/200762402 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef100af020 con 0x7fef100c9c80 2024-09-12T02:38:05.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.694+0000 7fef18282640 1 -- 172.21.15.60:0/200762402 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fef100b0bf0 con 0x7fef100c9c80 2024-09-12T02:38:05.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.695+0000 7fef06ffd640 1 -- 172.21.15.60:0/200762402 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef0c019070 con 0x7fef100c9c80 2024-09-12T02:38:05.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.695+0000 7fef06ffd640 1 -- 172.21.15.60:0/200762402 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef0c0129d0 con 0x7fef100c9c80 2024-09-12T02:38:05.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.697+0000 7fef18282640 1 --2- 172.21.15.60:0/200762402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feef8002a70 0x7feef8004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:05.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.697+0000 7fef06ffd640 1 -- 172.21.15.60:0/200762402 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fef0c012b70 con 0x7fef100c9c80 2024-09-12T02:38:05.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.698+0000 7fef1601e640 1 --2- 172.21.15.60:0/200762402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feef8002a70 0x7feef8004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:05.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.698+0000 7fef18282640 1 -- 172.21.15.60:0/200762402 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7feef8007ec0 con 0x7feef8002a70 2024-09-12T02:38:05.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.699+0000 7fef06ffd640 1 --2- 172.21.15.60:0/200762402 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7feef406bf30 0x7feef406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:05.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.699+0000 7fef1601e640 1 -- 172.21.15.60:0/200762402 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feef80080c0 con 0x7feef8002a70 2024-09-12T02:38:05.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.699+0000 7fef06ffd640 1 -- 172.21.15.60:0/200762402 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fef0c08b500 con 0x7fef100c9c80 2024-09-12T02:38:05.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.699+0000 7fef1681f640 1 --2- 172.21.15.60:0/200762402 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7feef406bf30 0x7feef406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:05.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.701+0000 7fef1601e640 1 --2- 172.21.15.60:0/200762402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feef8002a70 0x7feef8004f30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fef100ccac0 tx=0x7fef0803b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:05.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.702+0000 7fef1681f640 1 --2- 172.21.15.60:0/200762402 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7feef406bf30 0x7feef406e3f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fef0000a700 tx=0x7fef00008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:05.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.703+0000 7fef06ffd640 1 -- 172.21.15.60:0/200762402 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef0804a070 con 0x7feef8002a70 2024-09-12T02:38:05.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.703+0000 7fef06ffd640 1 -- 172.21.15.60:0/200762402 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fef08045450 con 0x7feef8002a70 2024-09-12T02:38:05.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.703+0000 7fef06ffd640 1 -- 172.21.15.60:0/200762402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feef8002a70 msgr2=0x7feef8004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:05.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.703+0000 7fef06ffd640 1 --2- 172.21.15.60:0/200762402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feef8002a70 0x7feef8004f30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fef100ccac0 tx=0x7fef0803b900 comp rx=0 tx=0).stop 2024-09-12T02:38:05.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.703+0000 7fef06ffd640 1 -- 172.21.15.60:0/200762402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feef8002a70 msgr2=0x7feef8004f30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:38:05.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.703+0000 7fef06ffd640 1 --2- 172.21.15.60:0/200762402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feef8002a70 0x7feef8004f30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.718+0000 7fef18282640 1 --2- 172.21.15.60:0/200762402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feef8006f30 0x7feef80073c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:05.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.718+0000 7fef18282640 1 -- 172.21.15.60:0/200762402 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7feef800a4a0 con 0x7feef8006f30 2024-09-12T02:38:05.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.718+0000 7fef1601e640 1 --2- 172.21.15.60:0/200762402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feef8006f30 0x7feef80073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:05.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.719+0000 7fef1601e640 1 -- 172.21.15.60:0/200762402 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7feef8007900 con 0x7feef8006f30 2024-09-12T02:38:05.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.719+0000 7fef1601e640 1 --2- 172.21.15.60:0/200762402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feef8006f30 0x7feef80073c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7feef8008090 tx=0x7fef08009000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:05.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.720+0000 7fef06ffd640 1 -- 172.21.15.60:0/200762402 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef0804f9b0 con 0x7feef8006f30 2024-09-12T02:38:05.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.720+0000 7fef06ffd640 1 -- 172.21.15.60:0/200762402 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4719 (secure 0 0 0) 0x7fef08045600 con 0x7feef8006f30 2024-09-12T02:38:05.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.720+0000 7fef06ffd640 1 -- 172.21.15.60:0/200762402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feef8006f30 msgr2=0x7feef80073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:05.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.720+0000 7fef06ffd640 1 --2- 172.21.15.60:0/200762402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feef8006f30 0x7feef80073c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7feef8008090 tx=0x7fef08009000 comp rx=0 tx=0).stop 2024-09-12T02:38:05.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.720+0000 7fef06ffd640 1 -- 172.21.15.60:0/200762402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feef8006f30 msgr2=0x7feef80073c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:38:05.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.720+0000 7fef06ffd640 1 --2- 172.21.15.60:0/200762402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feef8006f30 0x7feef80073c0 secure :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7feef8008090 tx=0x7fef08009000 comp rx=0 tx=0).stop 2024-09-12T02:38:05.722 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:38:05.722 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:38:05.723 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:38:05.723 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:38:05.723 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 146, 2024-09-12T02:38:05.723 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 25494, 2024-09-12T02:38:05.723 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:38:05.723 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:38:05.723 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:38:05.723 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:38:05.723 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:05.723 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 12, 2024-09-12T02:38:05.723 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:38:05.723 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:38:05.723 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:38:05.724 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:38:05.724 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:38:05.724 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:38:05.724 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:38:05.724 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:38:05.724 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:38:05.724 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:38:05.724 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:38:05.724 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:38:05.724 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:38:05.724 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:38:05.724 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:05.725 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:38:05.725 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:38:05.725 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:38:05.725 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:38:05.725 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:38:05.725 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:38:05.725 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:38:05.725 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:38:05.725 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:38:05.725 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:38:05.725 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:38:05.726 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:38:05.726 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:38:05.726 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:05.726 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:05.726 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:38:05.726 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:38:05.726 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:38:05.726 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:38:05.726 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:38:05.726 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:38:05.727 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:38:05.727 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:38:05.727 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:38:05.727 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:38:05.727 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:38:05.727 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:38:05.727 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:38:05.727 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:38:05.727 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:38:05.727 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:38:05.728 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:38:05.728 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:38:05.728 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:38:05.728 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:38:05.728 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:38:05.728 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:38:05.728 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:38:05.728 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:38:05.728 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:38:05.728 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:38:05.728 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:38:05.728 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:38:05.728 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:05.729 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:38:05.729 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:05.729 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:38:05.729 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:05.729 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:38:05.729 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:38:05.729 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:38:05.729 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:38:05.729 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:05.729 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:38:05.729 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:38:05.730 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:05.730 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:05.730 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:05.730 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:38:05.730 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:38:05.730 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:05.730 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:05.730 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:05.730 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:05.730 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:38:05.730 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:38:05.730 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:38:05.730 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:38:05.731 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:38:05.731 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:05.731 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:05.731 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:38:05.731 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:38:05.731 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:38:05.731 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:38:05.731 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:05.731 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:38:05.731 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:38:05.731 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:05.731 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:05.732 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:05.732 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:38:05.732 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:38:05.732 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:05.732 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:05.732 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:05.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:05.732 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:38:05.732 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:38:05.732 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:38:05.732 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:38:05.732 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:38:05.733 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:05.733 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:05.733 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:38:05.733 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:38:05.733 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:38:05.733 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:38:05.733 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:05.733 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:38:05.733 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:38:05.733 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:05.733 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:05.733 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:05.734 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:38:05.734 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:38:05.734 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:05.734 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:05.734 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:05.734 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:05.734 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:38:05.734 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:38:05.734 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:38:05.734 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:38:05.734 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:38:05.734 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:05.735 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:05.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:05.735 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:38:05.735 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:38:05.735 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:05.735 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:38:05.735 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:38:05.735 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:38:05.735 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:05.735 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:05.735 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:38:05.735 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:05.736 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:38:05.736 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:38:05.736 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:38:05.736 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:05.736 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:05.736 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:38:05.736 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:05.736 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:38:05.736 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:38:05.736 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:38:05.736 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:05.737 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:05.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:05.737 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:38:05.737 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:38:05.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.721+0000 7fef18282640 1 -- 172.21.15.60:0/200762402 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7feef406bf30 msgr2=0x7feef406e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:05.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.721+0000 7fef18282640 1 --2- 172.21.15.60:0/200762402 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7feef406bf30 0x7feef406e3f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fef0000a700 tx=0x7fef00008040 comp rx=0 tx=0).stop 2024-09-12T02:38:05.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.721+0000 7fef1681f640 1 -- 172.21.15.60:0/200762402 reap_dead start 2024-09-12T02:38:05.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.721+0000 7fef18282640 1 -- 172.21.15.60:0/200762402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef100c9c80 msgr2=0x7fef100aeae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:05.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.721+0000 7fef18282640 1 --2- 172.21.15.60:0/200762402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef100c9c80 0x7fef100aeae0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fef0c00d5f0 tx=0x7fef0c00dab0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.722+0000 7fef18282640 1 -- 172.21.15.60:0/200762402 shutdown_connections 2024-09-12T02:38:05.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.722+0000 7fef18282640 1 --2- 172.21.15.60:0/200762402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef100c9c80 0x7fef100aeae0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.722+0000 7fef18282640 1 -- 172.21.15.60:0/200762402 >> 172.21.15.60:0/200762402 conn(0x7fef10068030 msgr2=0x7fef100cbf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:05.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.722+0000 7fef18282640 1 -- 172.21.15.60:0/200762402 shutdown_connections 2024-09-12T02:38:05.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.722+0000 7fef18282640 1 -- 172.21.15.60:0/200762402 wait complete. 2024-09-12T02:38:05.742 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:38:05.743 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-12T02:38:05.743 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-12T02:38:05.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.957+0000 7f10cea5c640 1 Processor -- start 2024-09-12T02:38:05.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.957+0000 7f10cea5c640 1 -- start start 2024-09-12T02:38:05.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.958+0000 7f10cea5c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f10c8067bc0 0x7f10c8156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:05.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.959+0000 7f10c7fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f10c8067bc0 0x7f10c8156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:05.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.959+0000 7f10c7fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f10c8067bc0 0x7f10c8156cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37922/0 (socket says 172.21.15.60:37922) 2024-09-12T02:38:05.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.959+0000 7f10c7fff640 1 -- 172.21.15.60:0/2243184380 learned_addr learned my addr 172.21.15.60:0/2243184380 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:38:05.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.959+0000 7f10cea5c640 1 --2- 172.21.15.60:0/2243184380 >> v2:172.21.15.105:3300/0 conn(0x7f10c80c6190 0x7f10c8153640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:05.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.959+0000 7f10cea5c640 1 -- 172.21.15.60:0/2243184380 --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10c806d1c0 con 0x7f10c8153b80 2024-09-12T02:38:05.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.960+0000 7f10cea5c640 1 -- 172.21.15.60:0/2243184380 --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f10c806d460 con 0x7f10c8067bc0 2024-09-12T02:38:05.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.960+0000 7f10c77fe640 1 --2- 172.21.15.60:0/2243184380 >> v2:172.21.15.105:3300/0 conn(0x7f10c80c6190 0x7f10c8153640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:05.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.960+0000 7f10cea5c640 1 -- 172.21.15.60:0/2243184380 --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f10c806d740 con 0x7f10c80c6190 2024-09-12T02:38:05.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.960+0000 7f10c7fff640 1 -- 172.21.15.60:0/2243184380 >> v2:172.21.15.105:3300/0 conn(0x7f10c80c6190 msgr2=0x7f10c8153640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:05.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.960+0000 7f10c7fff640 1 --2- 172.21.15.60:0/2243184380 >> v2:172.21.15.105:3300/0 conn(0x7f10c80c6190 0x7f10c8153640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.960+0000 7f10c7fff640 1 -- 172.21.15.60:0/2243184380 >> v1:172.21.15.105:6789/0 conn(0x7f10c8153b80 legacy=0x7f10c80ca010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:05.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.960+0000 7f10c7fff640 1 -- 172.21.15.60:0/2243184380 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10c806da20 con 0x7f10c8067bc0 2024-09-12T02:38:05.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.962+0000 7f10c7fff640 1 --2- 172.21.15.60:0/2243184380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10c8067bc0 0x7f10c8156cc0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f10c80c98a0 tx=0x7f10c002a930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af1b9526bb4e916f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:05.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.963+0000 7f10c6ffd640 1 -- 172.21.15.60:0/2243184380 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c0030420 con 0x7f10c8067bc0 2024-09-12T02:38:05.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.963+0000 7f10c6ffd640 1 -- 172.21.15.60:0/2243184380 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10c0035070 con 0x7f10c8067bc0 2024-09-12T02:38:05.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.963+0000 7f10c6ffd640 1 -- 172.21.15.60:0/2243184380 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c00307e0 con 0x7f10c8067bc0 2024-09-12T02:38:05.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.964+0000 7f10cea5c640 1 -- 172.21.15.60:0/2243184380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10c8067bc0 msgr2=0x7f10c8156cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:05.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.964+0000 7f10cea5c640 1 --2- 172.21.15.60:0/2243184380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10c8067bc0 0x7f10c8156cc0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f10c80c98a0 tx=0x7f10c002a930 comp rx=0 tx=0).stop 2024-09-12T02:38:05.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.965+0000 7f10cea5c640 1 -- 172.21.15.60:0/2243184380 shutdown_connections 2024-09-12T02:38:05.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.965+0000 7f10cea5c640 1 --2- 172.21.15.60:0/2243184380 >> v2:172.21.15.105:3300/0 conn(0x7f10c80c6190 0x7f10c8153640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.965+0000 7f10cea5c640 1 --2- 172.21.15.60:0/2243184380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10c8067bc0 0x7f10c8156cc0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.965+0000 7f10cea5c640 1 -- 172.21.15.60:0/2243184380 >> 172.21.15.60:0/2243184380 conn(0x7f10c80c87f0 msgr2=0x7f10c80c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:05.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.965+0000 7f10cea5c640 1 -- 172.21.15.60:0/2243184380 shutdown_connections 2024-09-12T02:38:05.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.968+0000 7f10cea5c640 1 -- 172.21.15.60:0/2243184380 wait complete. 2024-09-12T02:38:05.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.970+0000 7f10cea5c640 1 Processor -- start 2024-09-12T02:38:05.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.971+0000 7f10cea5c640 1 -- start start 2024-09-12T02:38:05.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.972+0000 7f10cea5c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10c8067bc0 0x7f10c80afe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:05.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.972+0000 7f10cea5c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f10c80c6190 0x7f10c814e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:05.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.973+0000 7f10cea5c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10c8153b80 0x7f10c814e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:05.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.973+0000 7f10c77fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f10c80c6190 0x7f10c814e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:05.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.973+0000 7f10c77fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f10c80c6190 0x7f10c814e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:45296/0 (socket says 172.21.15.60:45296) 2024-09-12T02:38:05.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.973+0000 7f10c77fe640 1 -- 172.21.15.60:0/3514813605 learned_addr learned my addr 172.21.15.60:0/3514813605 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:38:05.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.973+0000 7f10cea5c640 1 -- 172.21.15.60:0/3514813605 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f10c8068120 con 0x7f10c8153b80 2024-09-12T02:38:05.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.973+0000 7f10c7fff640 1 --2- 172.21.15.60:0/3514813605 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10c8067bc0 0x7f10c80afe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:05.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.973+0000 7f10ccff9640 1 --2- 172.21.15.60:0/3514813605 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10c8153b80 0x7f10c814e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:05.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.973+0000 7f10cea5c640 1 -- 172.21.15.60:0/3514813605 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f10c8067fa0 con 0x7f10c8067bc0 2024-09-12T02:38:05.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.974+0000 7f10cea5c640 1 -- 172.21.15.60:0/3514813605 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f10c80ca720 con 0x7f10c80c6190 2024-09-12T02:38:05.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.975+0000 7f10c77fe640 1 -- 172.21.15.60:0/3514813605 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10c8067bc0 msgr2=0x7f10c80afe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:05.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.975+0000 7f10c77fe640 1 --2- 172.21.15.60:0/3514813605 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10c8067bc0 0x7f10c80afe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.975+0000 7f10c77fe640 1 -- 172.21.15.60:0/3514813605 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10c8153b80 msgr2=0x7f10c814e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:05.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.975+0000 7f10c77fe640 1 --2- 172.21.15.60:0/3514813605 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10c8153b80 0x7f10c814e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:05.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.975+0000 7f10c77fe640 1 -- 172.21.15.60:0/3514813605 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10c814ec20 con 0x7f10c80c6190 2024-09-12T02:38:05.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.975+0000 7f10c7fff640 1 --2- 172.21.15.60:0/3514813605 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10c8067bc0 0x7f10c80afe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:38:05.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.975+0000 7f10ccff9640 1 --2- 172.21.15.60:0/3514813605 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10c8153b80 0x7f10c814e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:38:05.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.976+0000 7f10c77fe640 1 --2- 172.21.15.60:0/3514813605 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f10c80c6190 0x7f10c814e1a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f10bc00e9b0 tx=0x7f10bc00ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:05.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.977+0000 7f10c4ff9640 1 -- 172.21.15.60:0/3514813605 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10bc017070 con 0x7f10c80c6190 2024-09-12T02:38:05.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.977+0000 7f10c4ff9640 1 -- 172.21.15.60:0/3514813605 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10bc00c9a0 con 0x7f10c80c6190 2024-09-12T02:38:05.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.977+0000 7f10c4ff9640 1 -- 172.21.15.60:0/3514813605 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10bc00cd70 con 0x7f10c80c6190 2024-09-12T02:38:05.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.977+0000 7f10cea5c640 1 -- 172.21.15.60:0/3514813605 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10c80b0ed0 con 0x7f10c80c6190 2024-09-12T02:38:05.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.978+0000 7f10cea5c640 1 -- 172.21.15.60:0/3514813605 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f10c81ec6c0 con 0x7f10c80c6190 2024-09-12T02:38:05.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.982+0000 7f10c4ff9640 1 -- 172.21.15.60:0/3514813605 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f10bc01a070 con 0x7f10c80c6190 2024-09-12T02:38:05.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.983+0000 7f10c4ff9640 1 --2- 172.21.15.60:0/3514813605 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f10b406bf30 0x7f10b406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:05.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.983+0000 7f10c4ff9640 1 -- 172.21.15.60:0/3514813605 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f10bc08b150 con 0x7f10c80c6190 2024-09-12T02:38:05.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.984+0000 7f10c7fff640 1 --2- 172.21.15.60:0/3514813605 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f10b406bf30 0x7f10b406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:05.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.984+0000 7f10cea5c640 1 --2- 172.21.15.60:0/3514813605 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10c80c1e20 0x7f10c8157910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:05.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.984+0000 7f10cea5c640 1 -- 172.21.15.60:0/3514813605 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f10c8157630 con 0x7f10c80c1e20 2024-09-12T02:38:05.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.984+0000 7f10ccff9640 1 --2- 172.21.15.60:0/3514813605 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10c80c1e20 0x7f10c8157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:05.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.984+0000 7f10c7fff640 1 --2- 172.21.15.60:0/3514813605 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f10b406bf30 0x7f10b406e3f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f10c0034000 tx=0x7f10c0009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:05.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.988+0000 7f10ccff9640 1 -- 172.21.15.60:0/3514813605 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f10c80cb700 con 0x7f10c80c1e20 2024-09-12T02:38:05.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.989+0000 7f10ccff9640 1 --2- 172.21.15.60:0/3514813605 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10c80c1e20 0x7f10c8157910 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f10b800d380 tx=0x7f10b800d840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:05.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.989+0000 7f10c4ff9640 1 -- 172.21.15.60:0/3514813605 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b8018070 con 0x7f10c80c1e20 2024-09-12T02:38:05.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.990+0000 7f10c4ff9640 1 -- 172.21.15.60:0/3514813605 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f10b8003610 con 0x7f10c80c1e20 2024-09-12T02:38:05.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.990+0000 7f10c4ff9640 1 -- 172.21.15.60:0/3514813605 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10c80c1e20 msgr2=0x7f10c8157910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:05.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.990+0000 7f10c4ff9640 1 --2- 172.21.15.60:0/3514813605 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10c80c1e20 0x7f10c8157910 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f10b800d380 tx=0x7f10b800d840 comp rx=0 tx=0).stop 2024-09-12T02:38:05.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.990+0000 7f10c4ff9640 1 -- 172.21.15.60:0/3514813605 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10c80c1e20 msgr2=0x7f10c8157910 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:38:05.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:05.990+0000 7f10c4ff9640 1 --2- 172.21.15.60:0/3514813605 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10c80c1e20 0x7f10c8157910 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.004+0000 7f10cea5c640 1 --2- 172.21.15.60:0/3514813605 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10c8157e50 0x7f10c8158260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:06.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.005+0000 7f10cea5c640 1 -- 172.21.15.60:0/3514813605 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f10c80764a0 con 0x7f10c8157e50 2024-09-12T02:38:06.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.005+0000 7f10ccff9640 1 --2- 172.21.15.60:0/3514813605 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10c8157e50 0x7f10c8158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:06.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.006+0000 7f10ccff9640 1 -- 172.21.15.60:0/3514813605 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f10c8152440 con 0x7f10c8157e50 2024-09-12T02:38:06.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.006+0000 7f10ccff9640 1 --2- 172.21.15.60:0/3514813605 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10c8157e50 0x7f10c8158260 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f10b8001eb0 tx=0x7f10b8000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:06.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.006+0000 7f10c4ff9640 1 -- 172.21.15.60:0/3514813605 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b8018040 con 0x7f10c8157e50 2024-09-12T02:38:06.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.007+0000 7f10c4ff9640 1 -- 172.21.15.60:0/3514813605 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4885 (secure 0 0 0) 0x7f10b8023450 con 0x7f10c8157e50 2024-09-12T02:38:06.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.007+0000 7f10c4ff9640 1 -- 172.21.15.60:0/3514813605 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10c8157e50 msgr2=0x7f10c8158260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:06.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.007+0000 7f10c4ff9640 1 --2- 172.21.15.60:0/3514813605 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10c8157e50 0x7f10c8158260 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f10b8001eb0 tx=0x7f10b8000ed0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.007+0000 7f10c4ff9640 1 -- 172.21.15.60:0/3514813605 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10c8157e50 msgr2=0x7f10c8158260 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:38:06.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.007+0000 7f10c4ff9640 1 --2- 172.21.15.60:0/3514813605 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10c8157e50 0x7f10c8158260 secure :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f10b8001eb0 tx=0x7f10b8000ed0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.009 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:38:06.010 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:38:06.010 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:38:06.010 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:38:06.010 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 146, 2024-09-12T02:38:06.010 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 157585, 2024-09-12T02:38:06.010 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:38:06.010 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:38:06.010 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:38:06.010 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:38:06.010 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:06.010 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 13, 2024-09-12T02:38:06.010 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:38:06.010 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:38:06.011 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:38:06.011 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:38:06.011 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:38:06.011 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:38:06.011 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:38:06.011 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:38:06.011 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:38:06.011 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:38:06.011 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:38:06.011 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:38:06.011 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:38:06.011 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:38:06.011 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:06.011 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:38:06.011 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:38:06.012 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:38:06.012 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:38:06.012 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:38:06.012 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:38:06.012 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:38:06.012 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:38:06.012 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:38:06.012 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:38:06.012 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:38:06.012 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:38:06.012 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:38:06.012 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:06.012 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:06.013 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:38:06.013 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:38:06.013 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:38:06.013 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:38:06.013 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:38:06.013 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:38:06.013 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:38:06.013 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:38:06.013 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:38:06.013 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:38:06.013 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:38:06.013 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:38:06.013 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:38:06.014 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:38:06.014 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:38:06.014 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:38:06.014 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:38:06.014 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:38:06.014 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:38:06.014 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:38:06.014 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:38:06.014 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:38:06.014 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:38:06.014 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:38:06.014 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:38:06.014 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:38:06.014 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:38:06.015 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:38:06.015 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:06.015 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:38:06.015 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:06.015 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:38:06.015 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:06.015 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:38:06.015 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:38:06.015 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:38:06.015 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:38:06.015 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:06.015 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:38:06.015 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:38:06.015 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:06.016 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:06.016 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:06.016 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:38:06.016 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:38:06.016 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:06.016 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:06.016 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:06.016 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:06.016 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:38:06.016 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:38:06.016 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:38:06.016 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:38:06.016 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:38:06.017 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:06.017 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:06.017 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:38:06.017 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:38:06.017 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:38:06.017 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:38:06.017 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:06.017 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:38:06.017 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:38:06.017 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:06.017 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:06.017 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:06.017 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:38:06.017 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:38:06.018 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:06.018 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:06.018 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:06.018 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:06.018 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:38:06.018 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:38:06.018 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:38:06.018 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:38:06.018 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:38:06.018 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:06.018 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:06.018 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:38:06.018 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:38:06.018 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:38:06.018 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:38:06.019 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:06.019 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:38:06.019 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:38:06.019 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:06.019 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:06.019 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:06.019 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:38:06.019 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:38:06.019 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:06.019 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:06.019 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:06.019 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:06.019 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:38:06.019 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:38:06.019 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:38:06.020 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:38:06.020 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:38:06.020 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:06.020 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:06.020 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:06.020 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:38:06.020 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:38:06.020 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:06.020 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:38:06.020 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:38:06.020 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:38:06.020 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:06.020 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:06.020 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:38:06.021 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:06.021 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:38:06.021 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:38:06.021 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:38:06.021 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:06.021 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:06.021 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:38:06.021 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:06.021 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:38:06.021 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:38:06.021 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:38:06.021 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:06.021 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:06.021 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:38:06.021 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:06.022 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:38:06.022 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:38:06.022 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:38:06.022 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:06.022 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:06.022 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:06.022 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:38:06.022 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:38:06.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.008+0000 7f10cea5c640 1 -- 172.21.15.60:0/3514813605 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f10b406bf30 msgr2=0x7f10b406e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:06.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.008+0000 7f10cea5c640 1 --2- 172.21.15.60:0/3514813605 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f10b406bf30 0x7f10b406e3f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f10c0034000 tx=0x7f10c0009000 comp rx=0 tx=0).stop 2024-09-12T02:38:06.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.008+0000 7f10ccff9640 1 -- 172.21.15.60:0/3514813605 reap_dead start 2024-09-12T02:38:06.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.008+0000 7f10cea5c640 1 -- 172.21.15.60:0/3514813605 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f10c80c6190 msgr2=0x7f10c814e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:06.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.008+0000 7f10cea5c640 1 --2- 172.21.15.60:0/3514813605 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f10c80c6190 0x7f10c814e1a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f10bc00e9b0 tx=0x7f10bc00ee70 comp rx=0 tx=0).stop 2024-09-12T02:38:06.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.008+0000 7f10cea5c640 1 -- 172.21.15.60:0/3514813605 shutdown_connections 2024-09-12T02:38:06.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.008+0000 7f10cea5c640 1 --2- 172.21.15.60:0/3514813605 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f10c80c6190 0x7f10c814e1a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.008+0000 7f10cea5c640 1 -- 172.21.15.60:0/3514813605 >> 172.21.15.60:0/3514813605 conn(0x7f10c80c87f0 msgr2=0x7f10c80c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:06.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.009+0000 7f10cea5c640 1 -- 172.21.15.60:0/3514813605 shutdown_connections 2024-09-12T02:38:06.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.009+0000 7f10cea5c640 1 -- 172.21.15.60:0/3514813605 wait complete. 2024-09-12T02:38:06.028 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:38:06.028 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-12T02:38:06.028 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-12T02:38:06.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.208+0000 7f551fe3c640 1 Processor -- start 2024-09-12T02:38:06.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.208+0000 7f551fe3c640 1 -- start start 2024-09-12T02:38:06.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.209+0000 7f551fe3c640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f5518150480 0x7f55180c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:06.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.209+0000 7f551fe3c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f551806c650 0x7f55180c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:06.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.209+0000 7f551fe3c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f55180c9c80 0x7f55180ca130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:06.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.209+0000 7f551fe3c640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f551806c240 con 0x7f55180c9c80 2024-09-12T02:38:06.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.209+0000 7f551fe3c640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f551815a330 con 0x7f5518150480 2024-09-12T02:38:06.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.209+0000 7f551fe3c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f551815a7c0 con 0x7f551806c650 2024-09-12T02:38:06.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.210+0000 7f551e3d9640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f55180c9c80 0x7f55180ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:06.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.210+0000 7f551e3d9640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f55180c9c80 0x7f55180ca130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37936/0 (socket says 172.21.15.60:37936) 2024-09-12T02:38:06.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.210+0000 7f551e3d9640 1 -- 172.21.15.60:0/811262989 learned_addr learned my addr 172.21.15.60:0/811262989 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:38:06.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.210+0000 7f551d3d7640 1 --2- 172.21.15.60:0/811262989 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f551806c650 0x7f55180c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:06.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.210+0000 7f551d3d7640 1 -- 172.21.15.60:0/811262989 >> v2:172.21.15.105:3300/0 conn(0x7f5518150480 msgr2=0x7f55180c7a90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:38:06.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.210+0000 7f551d3d7640 1 --2- 172.21.15.60:0/811262989 >> v2:172.21.15.105:3300/0 conn(0x7f5518150480 0x7f55180c7a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.210+0000 7f551d3d7640 1 -- 172.21.15.60:0/811262989 >> v2:172.21.15.60:3300/0 conn(0x7f55180c9c80 msgr2=0x7f55180ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:06.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.210+0000 7f551d3d7640 1 --2- 172.21.15.60:0/811262989 >> v2:172.21.15.60:3300/0 conn(0x7f55180c9c80 0x7f55180ca130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.210+0000 7f551d3d7640 1 -- 172.21.15.60:0/811262989 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5518159a00 con 0x7f551806c650 2024-09-12T02:38:06.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.212+0000 7f551d3d7640 1 --2- 172.21.15.60:0/811262989 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f551806c650 0x7f55180c7fd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f55180ccac0 tx=0x7f550804c130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bca9b1485ec8272b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:06.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.214+0000 7f551cbd6640 1 -- 172.21.15.60:0/811262989 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5508059070 con 0x7f551806c650 2024-09-12T02:38:06.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.214+0000 7f551cbd6640 1 -- 172.21.15.60:0/811262989 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5508054440 con 0x7f551806c650 2024-09-12T02:38:06.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.214+0000 7f551cbd6640 1 -- 172.21.15.60:0/811262989 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5508054810 con 0x7f551806c650 2024-09-12T02:38:06.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.215+0000 7f551fe3c640 1 -- 172.21.15.60:0/811262989 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f551806c650 msgr2=0x7f55180c7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:06.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.215+0000 7f551fe3c640 1 --2- 172.21.15.60:0/811262989 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f551806c650 0x7f55180c7fd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f55180ccac0 tx=0x7f550804c130 comp rx=0 tx=0).stop 2024-09-12T02:38:06.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.215+0000 7f551fe3c640 1 -- 172.21.15.60:0/811262989 shutdown_connections 2024-09-12T02:38:06.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.215+0000 7f551fe3c640 1 --2- 172.21.15.60:0/811262989 >> v2:172.21.15.60:3300/0 conn(0x7f55180c9c80 0x7f55180ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.215+0000 7f551fe3c640 1 --2- 172.21.15.60:0/811262989 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f551806c650 0x7f55180c7fd0 secure :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f55180ccac0 tx=0x7f550804c130 comp rx=0 tx=0).stop 2024-09-12T02:38:06.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.215+0000 7f551fe3c640 1 --2- 172.21.15.60:0/811262989 >> v2:172.21.15.105:3300/0 conn(0x7f5518150480 0x7f55180c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.215+0000 7f551fe3c640 1 -- 172.21.15.60:0/811262989 >> 172.21.15.60:0/811262989 conn(0x7f5518068030 msgr2=0x7f5518073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:06.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.216+0000 7f551fe3c640 1 -- 172.21.15.60:0/811262989 shutdown_connections 2024-09-12T02:38:06.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.217+0000 7f551fe3c640 1 -- 172.21.15.60:0/811262989 wait complete. 2024-09-12T02:38:06.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.218+0000 7f551fe3c640 1 Processor -- start 2024-09-12T02:38:06.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.219+0000 7f551fe3c640 1 -- start start 2024-09-12T02:38:06.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.220+0000 7f551fe3c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55180c9c80 0x7f55181587e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:06.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.220+0000 7f551fe3c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5518150480 0x7f55180aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:06.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.220+0000 7f551fe3c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55180af020 0x7f5518145720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:06.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.220+0000 7f551fe3c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f55180ca670 con 0x7f5518150480 2024-09-12T02:38:06.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.220+0000 7f551fe3c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5518159fc0 con 0x7f55180af020 2024-09-12T02:38:06.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.220+0000 7f551fe3c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f551806d270 con 0x7f55180c9c80 2024-09-12T02:38:06.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.221+0000 7f551dbd8640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55180c9c80 0x7f55181587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:06.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.221+0000 7f551e3d9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55180af020 0x7f5518145720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:06.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.221+0000 7f551dbd8640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55180c9c80 0x7f55181587e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:45316/0 (socket says 172.21.15.60:45316) 2024-09-12T02:38:06.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.221+0000 7f551dbd8640 1 -- 172.21.15.60:0/2932134471 learned_addr learned my addr 172.21.15.60:0/2932134471 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:38:06.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.221+0000 7f551d3d7640 1 --2- 172.21.15.60:0/2932134471 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5518150480 0x7f55180aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:06.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.221+0000 7f551dbd8640 1 -- 172.21.15.60:0/2932134471 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55180af020 msgr2=0x7f5518145720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:06.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.221+0000 7f551dbd8640 1 --2- 172.21.15.60:0/2932134471 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55180af020 0x7f5518145720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.221+0000 7f551dbd8640 1 -- 172.21.15.60:0/2932134471 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5518150480 msgr2=0x7f55180aeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:06.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.221+0000 7f551dbd8640 1 --2- 172.21.15.60:0/2932134471 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5518150480 0x7f55180aeae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.221+0000 7f551dbd8640 1 -- 172.21.15.60:0/2932134471 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55181447a0 con 0x7f55180c9c80 2024-09-12T02:38:06.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.222+0000 7f551d3d7640 1 --2- 172.21.15.60:0/2932134471 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5518150480 0x7f55180aeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:38:06.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.222+0000 7f551dbd8640 1 --2- 172.21.15.60:0/2932134471 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55180c9c80 0x7f55181587e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f551400b480 tx=0x7f551400b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:06.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.222+0000 7f551e3d9640 1 --2- 172.21.15.60:0/2932134471 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55180af020 0x7f5518145720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:38:06.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.222+0000 7f550e7fc640 1 -- 172.21.15.60:0/2932134471 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5514014070 con 0x7f55180c9c80 2024-09-12T02:38:06.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.223+0000 7f551fe3c640 1 -- 172.21.15.60:0/2932134471 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55180ac390 con 0x7f55180c9c80 2024-09-12T02:38:06.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.223+0000 7f551fe3c640 1 -- 172.21.15.60:0/2932134471 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f55180ac650 con 0x7f55180c9c80 2024-09-12T02:38:06.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.224+0000 7f550e7fc640 1 -- 172.21.15.60:0/2932134471 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5514010870 con 0x7f55180c9c80 2024-09-12T02:38:06.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.225+0000 7f550e7fc640 1 -- 172.21.15.60:0/2932134471 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5514010c60 con 0x7f55180c9c80 2024-09-12T02:38:06.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.227+0000 7f550e7fc640 1 -- 172.21.15.60:0/2932134471 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5514017070 con 0x7f55180c9c80 2024-09-12T02:38:06.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.228+0000 7f550e7fc640 1 --2- 172.21.15.60:0/2932134471 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f54fc06bf30 0x7f54fc06e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:06.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.228+0000 7f550e7fc640 1 -- 172.21.15.60:0/2932134471 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f551408b010 con 0x7f55180c9c80 2024-09-12T02:38:06.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.228+0000 7f551fe3c640 1 --2- 172.21.15.60:0/2932134471 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5500002a70 0x7f5500004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:06.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.228+0000 7f551fe3c640 1 -- 172.21.15.60:0/2932134471 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5500007ec0 con 0x7f5500002a70 2024-09-12T02:38:06.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.230+0000 7f551d3d7640 1 --2- 172.21.15.60:0/2932134471 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f54fc06bf30 0x7f54fc06e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:06.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.231+0000 7f551e3d9640 1 --2- 172.21.15.60:0/2932134471 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5500002a70 0x7f5500004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:06.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.232+0000 7f551d3d7640 1 --2- 172.21.15.60:0/2932134471 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f54fc06bf30 0x7f54fc06e3f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5508056000 tx=0x7f5508050000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:06.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.233+0000 7f551e3d9640 1 -- 172.21.15.60:0/2932134471 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f55000080c0 con 0x7f5500002a70 2024-09-12T02:38:06.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.236+0000 7f551e3d9640 1 --2- 172.21.15.60:0/2932134471 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5500002a70 0x7f5500004f30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5510007d30 tx=0x7f5510010590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:06.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.238+0000 7f550e7fc640 1 -- 172.21.15.60:0/2932134471 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f551001a030 con 0x7f5500002a70 2024-09-12T02:38:06.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.241+0000 7f550e7fc640 1 -- 172.21.15.60:0/2932134471 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5510010e20 con 0x7f5500002a70 2024-09-12T02:38:06.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.241+0000 7f550e7fc640 1 -- 172.21.15.60:0/2932134471 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5500002a70 msgr2=0x7f5500004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:06.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.241+0000 7f550e7fc640 1 --2- 172.21.15.60:0/2932134471 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5500002a70 0x7f5500004f30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5510007d30 tx=0x7f5510010590 comp rx=0 tx=0).stop 2024-09-12T02:38:06.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.241+0000 7f550e7fc640 1 -- 172.21.15.60:0/2932134471 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5500002a70 msgr2=0x7f5500004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:38:06.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.241+0000 7f550e7fc640 1 --2- 172.21.15.60:0/2932134471 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5500002a70 0x7f5500004f30 secure :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5510007d30 tx=0x7f5510010590 comp rx=0 tx=0).stop 2024-09-12T02:38:06.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.261+0000 7f551fe3c640 1 --2- 172.21.15.60:0/2932134471 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5500006eb0 0x7f5500007340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:06.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.261+0000 7f551fe3c640 1 -- 172.21.15.60:0/2932134471 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f550000a4a0 con 0x7f5500006eb0 2024-09-12T02:38:06.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.261+0000 7f551e3d9640 1 --2- 172.21.15.60:0/2932134471 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5500006eb0 0x7f5500007340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:06.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.262+0000 7f551e3d9640 1 -- 172.21.15.60:0/2932134471 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5500007880 con 0x7f5500006eb0 2024-09-12T02:38:06.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.262+0000 7f551e3d9640 1 --2- 172.21.15.60:0/2932134471 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5500006eb0 0x7f5500007340 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5510007d30 tx=0x7f5510004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:06.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.264+0000 7f550e7fc640 1 -- 172.21.15.60:0/2932134471 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5510003fd0 con 0x7f5500006eb0 2024-09-12T02:38:06.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.264+0000 7f550e7fc640 1 -- 172.21.15.60:0/2932134471 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5052 (secure 0 0 0) 0x7f5510004170 con 0x7f5500006eb0 2024-09-12T02:38:06.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.264+0000 7f550e7fc640 1 -- 172.21.15.60:0/2932134471 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5500006eb0 msgr2=0x7f5500007340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:06.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.264+0000 7f550e7fc640 1 --2- 172.21.15.60:0/2932134471 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5500006eb0 0x7f5500007340 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5510007d30 tx=0x7f5510004a40 comp rx=0 tx=0).stop 2024-09-12T02:38:06.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.264+0000 7f550e7fc640 1 -- 172.21.15.60:0/2932134471 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5500006eb0 msgr2=0x7f5500007340 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:38:06.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.264+0000 7f550e7fc640 1 --2- 172.21.15.60:0/2932134471 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5500006eb0 0x7f5500007340 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.268 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:38:06.268 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:38:06.268 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:38:06.268 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:38:06.268 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 146, 2024-09-12T02:38:06.268 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 360019, 2024-09-12T02:38:06.268 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:38:06.268 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:38:06.268 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:38:06.268 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:38:06.269 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:06.269 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 13, 2024-09-12T02:38:06.269 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:38:06.269 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:38:06.269 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:38:06.269 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:38:06.269 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:38:06.269 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:38:06.269 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:38:06.269 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:38:06.269 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:38:06.269 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:38:06.269 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:38:06.270 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:38:06.270 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:38:06.270 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:38:06.270 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:06.270 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:38:06.270 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:38:06.270 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:38:06.270 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:38:06.270 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:38:06.270 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:38:06.270 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:38:06.270 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:38:06.270 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:38:06.270 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:38:06.271 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:38:06.271 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:38:06.271 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:38:06.271 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:06.271 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:06.271 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:38:06.271 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:38:06.271 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:38:06.271 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:38:06.271 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:38:06.271 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:38:06.271 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:38:06.272 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:38:06.272 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:38:06.272 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:38:06.272 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:38:06.272 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:38:06.272 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:38:06.272 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:38:06.272 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:38:06.272 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:38:06.272 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:38:06.272 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:38:06.272 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:38:06.272 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:38:06.273 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:38:06.273 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:38:06.273 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:38:06.273 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:38:06.273 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:38:06.273 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:38:06.273 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:38:06.273 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:38:06.273 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:06.273 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:38:06.273 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:06.273 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:38:06.273 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:06.274 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:38:06.274 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:38:06.274 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:38:06.274 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:38:06.274 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:06.274 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:38:06.274 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:38:06.274 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:06.274 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:06.274 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:06.274 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:38:06.274 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:38:06.274 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:06.274 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:06.275 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:06.275 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:06.275 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:38:06.275 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:38:06.275 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:38:06.275 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:38:06.275 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:38:06.275 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:06.275 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:06.275 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:38:06.275 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:38:06.275 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:38:06.275 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:38:06.275 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:06.276 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:38:06.276 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:38:06.276 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:06.276 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:06.276 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:06.276 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:38:06.276 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:38:06.276 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:06.276 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:06.276 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:06.276 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:06.276 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:38:06.277 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:38:06.277 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:38:06.277 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:38:06.277 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:38:06.277 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:06.277 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:06.277 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:38:06.277 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:38:06.277 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:38:06.277 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:38:06.277 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:06.277 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:38:06.278 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:38:06.278 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:06.278 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:06.278 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:06.278 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:38:06.278 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:38:06.278 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:06.278 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:06.278 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:06.278 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:06.278 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:38:06.278 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:38:06.278 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:38:06.278 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:38:06.279 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:38:06.279 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:06.279 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:06.279 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:06.279 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:38:06.279 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:38:06.279 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:06.279 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:38:06.279 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:38:06.279 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:38:06.279 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:06.279 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:06.279 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:38:06.279 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:06.280 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:38:06.280 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:38:06.280 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:38:06.280 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:06.280 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:06.280 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:38:06.280 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:06.280 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:38:06.280 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:38:06.280 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:38:06.280 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:06.280 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:06.280 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:38:06.280 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:06.281 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:38:06.281 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:38:06.281 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 8 2024-09-12T02:38:06.281 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:06.281 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:06.281 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:38:06.281 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:06.281 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:38:06.281 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:38:06.281 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:38:06.281 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:06.281 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:06.281 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:06.281 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:38:06.282 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:38:06.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.267+0000 7f551fe3c640 1 -- 172.21.15.60:0/2932134471 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f54fc06bf30 msgr2=0x7f54fc06e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:06.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.267+0000 7f551fe3c640 1 --2- 172.21.15.60:0/2932134471 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f54fc06bf30 0x7f54fc06e3f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5508056000 tx=0x7f5508050000 comp rx=0 tx=0).stop 2024-09-12T02:38:06.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.267+0000 7f551fe3c640 1 -- 172.21.15.60:0/2932134471 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55180c9c80 msgr2=0x7f55181587e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:06.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.267+0000 7f551fe3c640 1 --2- 172.21.15.60:0/2932134471 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55180c9c80 0x7f55181587e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f551400b480 tx=0x7f551400b940 comp rx=0 tx=0).stop 2024-09-12T02:38:06.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.267+0000 7f551e3d9640 1 -- 172.21.15.60:0/2932134471 reap_dead start 2024-09-12T02:38:06.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.267+0000 7f551fe3c640 1 -- 172.21.15.60:0/2932134471 shutdown_connections 2024-09-12T02:38:06.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.267+0000 7f551fe3c640 1 -- 172.21.15.60:0/2932134471 >> 172.21.15.60:0/2932134471 conn(0x7f5518068030 msgr2=0x7f55181553f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:06.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.268+0000 7f551fe3c640 1 -- 172.21.15.60:0/2932134471 shutdown_connections 2024-09-12T02:38:06.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.268+0000 7f551fe3c640 1 -- 172.21.15.60:0/2932134471 wait complete. 2024-09-12T02:38:06.285 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:38:06.286 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-09-12T02:38:06.286 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-12T02:38:06.286 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-09-12T02:38:06.286 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-09-12T02:38:06.286 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T02:38:06.286 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:38:06.311 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T02:38:06.312 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-12T02:38:06.312 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:38:06.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.500+0000 7fdb58b44640 1 Processor -- start 2024-09-12T02:38:06.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.500+0000 7fdb58b44640 1 -- start start 2024-09-12T02:38:06.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.502+0000 7fdb58b44640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdb4c0d7420 0x7fdb4c006db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:06.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.502+0000 7fdb58b44640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fdb4c0072f0 0x7fdb4c00e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:06.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.502+0000 7fdb58b44640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb4c0d7800 con 0x7fdb4c04d520 2024-09-12T02:38:06.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.502+0000 7fdb58b44640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fdb4c0daae0 con 0x7fdb4c0d7420 2024-09-12T02:38:06.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.502+0000 7fdb58b44640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fdb4c010270 con 0x7fdb4c0072f0 2024-09-12T02:38:06.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.502+0000 7fdb53fff640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fdb4c04d520 0x7fdb4c00ef20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:60388/0 (socket says 172.21.15.60:60388) 2024-09-12T02:38:06.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.502+0000 7fdb53fff640 1 -- 172.21.15.60:0/3108797190 learned_addr learned my addr 172.21.15.60:0/3108797190 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:38:06.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.504+0000 7fdb52ffd640 1 --2- 172.21.15.60:0/3108797190 >> v2:172.21.15.105:3300/0 conn(0x7fdb4c0072f0 0x7fdb4c00e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:06.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.505+0000 7fdb527fc640 1 -- 172.21.15.60:0/3108797190 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1247768828 0 0) 0x7fdb4c0d7800 con 0x7fdb4c04d520 2024-09-12T02:38:06.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.505+0000 7fdb527fc640 1 -- 172.21.15.60:0/3108797190 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb44003520 con 0x7fdb4c04d520 2024-09-12T02:38:06.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.505+0000 7fdb52ffd640 1 -- 172.21.15.60:0/3108797190 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c0d7420 msgr2=0x7fdb4c006db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:06.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.505+0000 7fdb52ffd640 1 --2- 172.21.15.60:0/3108797190 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c0d7420 0x7fdb4c006db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.505+0000 7fdb52ffd640 1 -- 172.21.15.60:0/3108797190 >> v1:172.21.15.105:6789/0 conn(0x7fdb4c04d520 legacy=0x7fdb4c00ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:06.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.505+0000 7fdb52ffd640 1 -- 172.21.15.60:0/3108797190 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb4c0d9ed0 con 0x7fdb4c0072f0 2024-09-12T02:38:06.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.506+0000 7fdb52ffd640 1 --2- 172.21.15.60:0/3108797190 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb4c0072f0 0x7fdb4c00e9e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c035770 tx=0x7fdb4002a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16bf818012a047fc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:06.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.506+0000 7fdb527fc640 1 -- 172.21.15.60:0/3108797190 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb40037070 con 0x7fdb4c0072f0 2024-09-12T02:38:06.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.507+0000 7fdb527fc640 1 -- 172.21.15.60:0/3108797190 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb40032440 con 0x7fdb4c0072f0 2024-09-12T02:38:06.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.507+0000 7fdb527fc640 1 -- 172.21.15.60:0/3108797190 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb40032850 con 0x7fdb4c0072f0 2024-09-12T02:38:06.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.507+0000 7fdb58b44640 1 -- 172.21.15.60:0/3108797190 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb4c0072f0 msgr2=0x7fdb4c00e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:06.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.508+0000 7fdb58b44640 1 --2- 172.21.15.60:0/3108797190 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb4c0072f0 0x7fdb4c00e9e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c035770 tx=0x7fdb4002a130 comp rx=0 tx=0).stop 2024-09-12T02:38:06.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.508+0000 7fdb58b44640 1 -- 172.21.15.60:0/3108797190 shutdown_connections 2024-09-12T02:38:06.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.508+0000 7fdb58b44640 1 --2- 172.21.15.60:0/3108797190 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb4c0072f0 0x7fdb4c00e9e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.508+0000 7fdb58b44640 1 --2- 172.21.15.60:0/3108797190 >> v2:172.21.15.60:3300/0 conn(0x7fdb4c0d7420 0x7fdb4c006db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.508+0000 7fdb58b44640 1 -- 172.21.15.60:0/3108797190 >> 172.21.15.60:0/3108797190 conn(0x7fdb4c04c0a0 msgr2=0x7fdb4c04c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:06.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.508+0000 7fdb58b44640 1 -- 172.21.15.60:0/3108797190 shutdown_connections 2024-09-12T02:38:06.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.509+0000 7fdb58b44640 1 -- 172.21.15.60:0/3108797190 wait complete. 2024-09-12T02:38:06.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.511+0000 7fdb58b44640 1 Processor -- start 2024-09-12T02:38:06.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.511+0000 7fdb58b44640 1 -- start start 2024-09-12T02:38:06.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.512+0000 7fdb58b44640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb4c0072f0 0x7fdb4c0dda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:06.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.513+0000 7fdb58b44640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb4c04d520 0x7fdb4c0dc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:06.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.513+0000 7fdb58b44640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb4c0d7420 0x7fdb4c048b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:06.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.513+0000 7fdb52ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb4c04d520 0x7fdb4c0dc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:06.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.513+0000 7fdb537fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb4c0072f0 0x7fdb4c0dda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:06.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.513+0000 7fdb52ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb4c04d520 0x7fdb4c0dc8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38030/0 (socket says 172.21.15.60:38030) 2024-09-12T02:38:06.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.513+0000 7fdb537fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb4c0072f0 0x7fdb4c0dda20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:43574/0 (socket says 172.21.15.60:43574) 2024-09-12T02:38:06.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.513+0000 7fdb58b44640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdb4c0da770 con 0x7fdb4c04d520 2024-09-12T02:38:06.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.513+0000 7fdb58b44640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdb4c0da490 con 0x7fdb4c0072f0 2024-09-12T02:38:06.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.513+0000 7fdb58b44640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdb4c00f630 con 0x7fdb4c0d7420 2024-09-12T02:38:06.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.513+0000 7fdb53fff640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb4c0d7420 msgr2=0x7fdb4c048b80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:38:06.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.513+0000 7fdb53fff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb4c0d7420 0x7fdb4c048b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:38:06.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.513+0000 7fdb52ffd640 1 -- 172.21.15.60:0/2409794409 learned_addr learned my addr 172.21.15.60:0/2409794409 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:38:06.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.514+0000 7fdb52ffd640 1 -- 172.21.15.60:0/2409794409 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb4c0d7420 msgr2=0x7fdb4c048b80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:38:06.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.514+0000 7fdb52ffd640 1 --2- 172.21.15.60:0/2409794409 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb4c0d7420 0x7fdb4c048b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.514+0000 7fdb52ffd640 1 -- 172.21.15.60:0/2409794409 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb4c0072f0 msgr2=0x7fdb4c0dda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:06.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.514+0000 7fdb52ffd640 1 --2- 172.21.15.60:0/2409794409 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb4c0072f0 0x7fdb4c0dda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:06.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.514+0000 7fdb52ffd640 1 -- 172.21.15.60:0/2409794409 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb4c0d0be0 con 0x7fdb4c04d520 2024-09-12T02:38:06.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.514+0000 7fdb52ffd640 1 --2- 172.21.15.60:0/2409794409 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb4c04d520 0x7fdb4c0dc8f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdb40009860 tx=0x7fdb400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:06.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.515+0000 7fdb3ffff640 1 -- 172.21.15.60:0/2409794409 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb40037050 con 0x7fdb4c04d520 2024-09-12T02:38:06.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.515+0000 7fdb3ffff640 1 -- 172.21.15.60:0/2409794409 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb40043070 con 0x7fdb4c04d520 2024-09-12T02:38:06.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.516+0000 7fdb3ffff640 1 -- 172.21.15.60:0/2409794409 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb40030d10 con 0x7fdb4c04d520 2024-09-12T02:38:06.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.517+0000 7fdb58b44640 1 -- 172.21.15.60:0/2409794409 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb4c0d0720 con 0x7fdb4c04d520 2024-09-12T02:38:06.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.517+0000 7fdb58b44640 1 -- 172.21.15.60:0/2409794409 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb4c046330 con 0x7fdb4c04d520 2024-09-12T02:38:06.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.519+0000 7fdb58b44640 1 -- 172.21.15.60:0/2409794409 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb4c0dbe20 con 0x7fdb4c04d520 2024-09-12T02:38:06.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.521+0000 7fdb3ffff640 1 -- 172.21.15.60:0/2409794409 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdb40048460 con 0x7fdb4c04d520 2024-09-12T02:38:06.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.522+0000 7fdb3ffff640 1 --2- 172.21.15.60:0/2409794409 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fdb3806be30 0x7fdb3806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:06.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.522+0000 7fdb537fe640 1 --2- 172.21.15.60:0/2409794409 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fdb3806be30 0x7fdb3806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:06.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.522+0000 7fdb3ffff640 1 -- 172.21.15.60:0/2409794409 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fdb400acb80 con 0x7fdb4c04d520 2024-09-12T02:38:06.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.523+0000 7fdb537fe640 1 --2- 172.21.15.60:0/2409794409 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fdb3806be30 0x7fdb3806e2f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fdb480098e0 tx=0x7fdb48009060 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:06.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:06.528+0000 7fdb3ffff640 1 -- 172.21.15.60:0/2409794409 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdb4007b290 con 0x7fdb4c04d520 2024-09-12T02:38:07.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:07.029+0000 7fdb58b44640 1 -- 172.21.15.60:0/2409794409 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fdb4c00ffc0 con 0x7fdb4c04d520 2024-09-12T02:38:07.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:07.030+0000 7fdb3ffff640 1 -- 172.21.15.60:0/2409794409 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1566 (secure 0 0 0) 0x7fdb4007ab90 con 0x7fdb4c04d520 2024-09-12T02:38:07.033 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":146,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:38:07.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:07.037+0000 7fdb3dffb640 1 -- 172.21.15.60:0/2409794409 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fdb3806be30 msgr2=0x7fdb3806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:07.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:07.037+0000 7fdb3dffb640 1 --2- 172.21.15.60:0/2409794409 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fdb3806be30 0x7fdb3806e2f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fdb480098e0 tx=0x7fdb48009060 comp rx=0 tx=0).stop 2024-09-12T02:38:07.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:07.037+0000 7fdb3dffb640 1 -- 172.21.15.60:0/2409794409 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb4c04d520 msgr2=0x7fdb4c0dc8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:07.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:07.037+0000 7fdb3dffb640 1 --2- 172.21.15.60:0/2409794409 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb4c04d520 0x7fdb4c0dc8f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdb40009860 tx=0x7fdb400046c0 comp rx=0 tx=0).stop 2024-09-12T02:38:07.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:07.037+0000 7fdb3dffb640 1 -- 172.21.15.60:0/2409794409 shutdown_connections 2024-09-12T02:38:07.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:07.037+0000 7fdb3dffb640 1 --2- 172.21.15.60:0/2409794409 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fdb3806be30 0x7fdb3806e2f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:07.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:07.037+0000 7fdb3dffb640 1 --2- 172.21.15.60:0/2409794409 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb4c0d7420 0x7fdb4c048b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:07.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:07.037+0000 7fdb3dffb640 1 --2- 172.21.15.60:0/2409794409 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb4c04d520 0x7fdb4c0dc8f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:07.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:07.037+0000 7fdb3dffb640 1 --2- 172.21.15.60:0/2409794409 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb4c0072f0 0x7fdb4c0dda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:07.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:07.037+0000 7fdb3dffb640 1 -- 172.21.15.60:0/2409794409 >> 172.21.15.60:0/2409794409 conn(0x7fdb4c04c0a0 msgr2=0x7fdb4c04c480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:07.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:07.037+0000 7fdb3dffb640 1 -- 172.21.15.60:0/2409794409 shutdown_connections 2024-09-12T02:38:07.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:07.038+0000 7fdb3dffb640 1 -- 172.21.15.60:0/2409794409 wait complete. 2024-09-12T02:38:10.058 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:38:10.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.218+0000 7f3f8d544640 1 Processor -- start 2024-09-12T02:38:10.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.218+0000 7f3f8d544640 1 -- start start 2024-09-12T02:38:10.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.220+0000 7f3f8d544640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3f880c7f30 0x7f3f88072a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:10.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.220+0000 7f3f8d544640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f88151ae0 con 0x7f3f880a8e80 2024-09-12T02:38:10.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.220+0000 7f3f8d544640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f88154b10 con 0x7f3f880c4d60 2024-09-12T02:38:10.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.220+0000 7f3f8d544640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f3f881548c0 con 0x7f3f880c7f30 2024-09-12T02:38:10.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.220+0000 7f3f8cd43640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3f880c7f30 0x7f3f88072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:10.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.220+0000 7f3f87fff640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f3f880c4d60 0x7f3f880c92a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:35560/0 (socket says 172.21.15.60:35560) 2024-09-12T02:38:10.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.220+0000 7f3f87fff640 1 -- 172.21.15.60:0/1878445252 learned_addr learned my addr 172.21.15.60:0/1878445252 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:38:10.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.220+0000 7f3f8cd43640 1 -- 172.21.15.60:0/1878445252 >> v1:172.21.15.105:6789/0 conn(0x7f3f880c4d60 legacy=0x7f3f880c92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:10.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.220+0000 7f3f8cd43640 1 -- 172.21.15.60:0/1878445252 >> v1:172.21.15.60:6789/0 conn(0x7f3f880a8e80 legacy=0x7f3f8815c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:10.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.220+0000 7f3f8cd43640 1 -- 172.21.15.60:0/1878445252 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f8806ed10 con 0x7f3f880c7f30 2024-09-12T02:38:10.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.222+0000 7f3f8cd43640 1 --2- 172.21.15.60:0/1878445252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f880c7f30 0x7f3f88072a70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3f800097a0 tx=0x7f3f8002a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a75ffc9e804b53 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:10.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.222+0000 7f3f86ffd640 1 -- 172.21.15.60:0/1878445252 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f80037070 con 0x7f3f880c7f30 2024-09-12T02:38:10.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.222+0000 7f3f86ffd640 1 -- 172.21.15.60:0/1878445252 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f8002adc0 con 0x7f3f880c7f30 2024-09-12T02:38:10.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.222+0000 7f3f86ffd640 1 -- 172.21.15.60:0/1878445252 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f80032660 con 0x7f3f880c7f30 2024-09-12T02:38:10.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.223+0000 7f3f8d544640 1 -- 172.21.15.60:0/1878445252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f880c7f30 msgr2=0x7f3f88072a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:10.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.223+0000 7f3f8d544640 1 --2- 172.21.15.60:0/1878445252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f880c7f30 0x7f3f88072a70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3f800097a0 tx=0x7f3f8002a0b0 comp rx=0 tx=0).stop 2024-09-12T02:38:10.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.223+0000 7f3f8d544640 1 -- 172.21.15.60:0/1878445252 shutdown_connections 2024-09-12T02:38:10.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.223+0000 7f3f8d544640 1 --2- 172.21.15.60:0/1878445252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f880c7f30 0x7f3f88072a70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:10.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.223+0000 7f3f8d544640 1 -- 172.21.15.60:0/1878445252 >> 172.21.15.60:0/1878445252 conn(0x7f3f880ca1a0 msgr2=0x7f3f880ab920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:10.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.223+0000 7f3f8d544640 1 -- 172.21.15.60:0/1878445252 shutdown_connections 2024-09-12T02:38:10.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.223+0000 7f3f8d544640 1 -- 172.21.15.60:0/1878445252 wait complete. 2024-09-12T02:38:10.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.225+0000 7f3f8d544640 1 Processor -- start 2024-09-12T02:38:10.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.225+0000 7f3f8d544640 1 -- start start 2024-09-12T02:38:10.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.226+0000 7f3f8d544640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f880a8e80 0x7f3f880aee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:10.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.226+0000 7f3f8d544640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f880c4d60 0x7f3f880af390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:10.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.226+0000 7f3f87fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f880a8e80 0x7f3f880aee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:10.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.226+0000 7f3f87fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f880a8e80 0x7f3f880aee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:49040/0 (socket says 172.21.15.60:49040) 2024-09-12T02:38:10.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.226+0000 7f3f877fe640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f880c4d60 msgr2=0x7f3f880af390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:38:10.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.227+0000 7f3f877fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f880c4d60 0x7f3f880af390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:38:10.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.227+0000 7f3f8d544640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f880c7f30 0x7f3f881f3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:10.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.227+0000 7f3f87fff640 1 -- 172.21.15.60:0/659572034 learned_addr learned my addr 172.21.15.60:0/659572034 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:38:10.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.227+0000 7f3f8d544640 1 -- 172.21.15.60:0/659572034 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3f880c8e10 con 0x7f3f880c7f30 2024-09-12T02:38:10.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.227+0000 7f3f8d544640 1 -- 172.21.15.60:0/659572034 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3f88154df0 con 0x7f3f880a8e80 2024-09-12T02:38:10.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.227+0000 7f3f8d544640 1 -- 172.21.15.60:0/659572034 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3f880c99b0 con 0x7f3f880c4d60 2024-09-12T02:38:10.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.227+0000 7f3f8cd43640 1 --2- 172.21.15.60:0/659572034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f880c7f30 0x7f3f881f3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:10.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.228+0000 7f3f87fff640 1 -- 172.21.15.60:0/659572034 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f880c4d60 msgr2=0x7f3f880af390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:38:10.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.228+0000 7f3f87fff640 1 --2- 172.21.15.60:0/659572034 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f880c4d60 0x7f3f880af390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:10.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.228+0000 7f3f87fff640 1 -- 172.21.15.60:0/659572034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f880c7f30 msgr2=0x7f3f881f3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:10.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.228+0000 7f3f87fff640 1 --2- 172.21.15.60:0/659572034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f880c7f30 0x7f3f881f3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:10.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.228+0000 7f3f87fff640 1 -- 172.21.15.60:0/659572034 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f880a5e70 con 0x7f3f880a8e80 2024-09-12T02:38:10.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.229+0000 7f3f87fff640 1 --2- 172.21.15.60:0/659572034 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f880a8e80 0x7f3f880aee50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3f7800c4b0 tx=0x7f3f7800c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:10.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.230+0000 7f3f84ff9640 1 -- 172.21.15.60:0/659572034 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f78017070 con 0x7f3f880a8e80 2024-09-12T02:38:10.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.230+0000 7f3f84ff9640 1 -- 172.21.15.60:0/659572034 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f78005ce0 con 0x7f3f880a8e80 2024-09-12T02:38:10.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.230+0000 7f3f8d544640 1 -- 172.21.15.60:0/659572034 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f88157e20 con 0x7f3f880a8e80 2024-09-12T02:38:10.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.230+0000 7f3f84ff9640 1 -- 172.21.15.60:0/659572034 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f78007270 con 0x7f3f880a8e80 2024-09-12T02:38:10.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.230+0000 7f3f8d544640 1 -- 172.21.15.60:0/659572034 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f88154fa0 con 0x7f3f880a8e80 2024-09-12T02:38:10.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.231+0000 7f3f8d544640 1 -- 172.21.15.60:0/659572034 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f880c8aa0 con 0x7f3f880a8e80 2024-09-12T02:38:10.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.232+0000 7f3f84ff9640 1 -- 172.21.15.60:0/659572034 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3f7801a070 con 0x7f3f880a8e80 2024-09-12T02:38:10.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.233+0000 7f3f84ff9640 1 --2- 172.21.15.60:0/659572034 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3f6806bde0 0x7f3f6806e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:10.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.233+0000 7f3f84ff9640 1 -- 172.21.15.60:0/659572034 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f3f7808a4a0 con 0x7f3f880a8e80 2024-09-12T02:38:10.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.233+0000 7f3f877fe640 1 --2- 172.21.15.60:0/659572034 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3f6806bde0 0x7f3f6806e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:10.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.234+0000 7f3f877fe640 1 --2- 172.21.15.60:0/659572034 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3f6806bde0 0x7f3f6806e2a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3f881641a0 tx=0x7f3f70007d90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:10.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.240+0000 7f3f84ff9640 1 -- 172.21.15.60:0/659572034 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3f78058450 con 0x7f3f880a8e80 2024-09-12T02:38:10.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.706+0000 7f3f8d544640 1 -- 172.21.15.60:0/659572034 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3f880c7d10 con 0x7f3f880a8e80 2024-09-12T02:38:10.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.707+0000 7f3f84ff9640 1 -- 172.21.15.60:0/659572034 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1566 (secure 0 0 0) 0x7f3f7805c750 con 0x7f3f880a8e80 2024-09-12T02:38:10.708 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":146,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:38:10.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.710+0000 7f3f8d544640 1 -- 172.21.15.60:0/659572034 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3f6806bde0 msgr2=0x7f3f6806e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:10.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.711+0000 7f3f8d544640 1 --2- 172.21.15.60:0/659572034 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3f6806bde0 0x7f3f6806e2a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3f881641a0 tx=0x7f3f70007d90 comp rx=0 tx=0).stop 2024-09-12T02:38:10.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.711+0000 7f3f8d544640 1 -- 172.21.15.60:0/659572034 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f880a8e80 msgr2=0x7f3f880aee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:10.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.711+0000 7f3f8d544640 1 --2- 172.21.15.60:0/659572034 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f880a8e80 0x7f3f880aee50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3f7800c4b0 tx=0x7f3f7800c970 comp rx=0 tx=0).stop 2024-09-12T02:38:10.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.711+0000 7f3f8d544640 1 -- 172.21.15.60:0/659572034 shutdown_connections 2024-09-12T02:38:10.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.711+0000 7f3f8d544640 1 --2- 172.21.15.60:0/659572034 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3f6806bde0 0x7f3f6806e2a0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:10.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.711+0000 7f3f8d544640 1 --2- 172.21.15.60:0/659572034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f880c7f30 0x7f3f881f3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:10.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.711+0000 7f3f8d544640 1 --2- 172.21.15.60:0/659572034 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f880c4d60 0x7f3f880af390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:10.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.711+0000 7f3f8d544640 1 --2- 172.21.15.60:0/659572034 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f880a8e80 0x7f3f880aee50 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:10.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.711+0000 7f3f8d544640 1 -- 172.21.15.60:0/659572034 >> 172.21.15.60:0/659572034 conn(0x7f3f880ca1a0 msgr2=0x7f3f880aba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:10.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.711+0000 7f3f8d544640 1 -- 172.21.15.60:0/659572034 shutdown_connections 2024-09-12T02:38:10.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:10.711+0000 7f3f8d544640 1 -- 172.21.15.60:0/659572034 wait complete. 2024-09-12T02:38:13.729 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:38:13.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.893+0000 7f295a8d0640 1 Processor -- start 2024-09-12T02:38:13.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.893+0000 7f295a8d0640 1 -- start start 2024-09-12T02:38:13.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.894+0000 7f295a8d0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f295406e650 0x7f29541500a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:13.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.894+0000 7f295a8d0640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2954150930 0x7f29540c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:13.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.894+0000 7f295a8d0640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29540ad5c0 con 0x7f29540c3e00 2024-09-12T02:38:13.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.894+0000 7f295a8d0640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f295406ef50 con 0x7f2954150930 2024-09-12T02:38:13.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.894+0000 7f295a8d0640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f29540ad860 con 0x7f295406e650 2024-09-12T02:38:13.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.894+0000 7f2953fff640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f295406e650 msgr2=0x7f29541500a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:38:13.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.894+0000 7f2953fff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f295406e650 0x7f29541500a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:38:13.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.894+0000 7f294bfff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f29540c3e00 0x7f29540c3000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:58588/0 (socket says 172.21.15.60:58588) 2024-09-12T02:38:13.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.894+0000 7f294bfff640 1 -- 172.21.15.60:0/1332044184 learned_addr learned my addr 172.21.15.60:0/1332044184 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:38:13.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.895+0000 7f2958e6d640 1 --2- 172.21.15.60:0/1332044184 >> v2:172.21.15.60:3300/0 conn(0x7f2954150930 0x7f29540c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:13.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.895+0000 7f2958e6d640 1 -- 172.21.15.60:0/1332044184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f295406e650 msgr2=0x7f29541500a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:38:13.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.895+0000 7f2958e6d640 1 --2- 172.21.15.60:0/1332044184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f295406e650 0x7f29541500a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:13.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.895+0000 7f2958e6d640 1 -- 172.21.15.60:0/1332044184 >> v1:172.21.15.60:6789/0 conn(0x7f29540c3e00 legacy=0x7f29540c3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:13.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.895+0000 7f2958e6d640 1 -- 172.21.15.60:0/1332044184 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f295406ec70 con 0x7f2954150930 2024-09-12T02:38:13.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.897+0000 7f2958e6d640 1 --2- 172.21.15.60:0/1332044184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2954150930 0x7f29540c44c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f294c009d90 tx=0x7f294c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fff9f87ae882ecb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:13.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.897+0000 7f29537fe640 1 -- 172.21.15.60:0/1332044184 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f294c007740 con 0x7f2954150930 2024-09-12T02:38:13.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.897+0000 7f29537fe640 1 -- 172.21.15.60:0/1332044184 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f294c0078e0 con 0x7f2954150930 2024-09-12T02:38:13.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.897+0000 7f29537fe640 1 -- 172.21.15.60:0/1332044184 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f294c007cb0 con 0x7f2954150930 2024-09-12T02:38:13.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.898+0000 7f295a8d0640 1 -- 172.21.15.60:0/1332044184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2954150930 msgr2=0x7f29540c44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:13.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.898+0000 7f295a8d0640 1 --2- 172.21.15.60:0/1332044184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2954150930 0x7f29540c44c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f294c009d90 tx=0x7f294c02a5f0 comp rx=0 tx=0).stop 2024-09-12T02:38:13.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.899+0000 7f295a8d0640 1 -- 172.21.15.60:0/1332044184 shutdown_connections 2024-09-12T02:38:13.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.899+0000 7f295a8d0640 1 --2- 172.21.15.60:0/1332044184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2954150930 0x7f29540c44c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:13.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.899+0000 7f295a8d0640 1 --2- 172.21.15.60:0/1332044184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f295406e650 0x7f29541500a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:13.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.899+0000 7f295a8d0640 1 -- 172.21.15.60:0/1332044184 >> 172.21.15.60:0/1332044184 conn(0x7f29540c7a40 msgr2=0x7f29540c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:13.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.899+0000 7f295a8d0640 1 -- 172.21.15.60:0/1332044184 shutdown_connections 2024-09-12T02:38:13.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.899+0000 7f295a8d0640 1 -- 172.21.15.60:0/1332044184 wait complete. 2024-09-12T02:38:13.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.902+0000 7f295a8d0640 1 Processor -- start 2024-09-12T02:38:13.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.902+0000 7f295a8d0640 1 -- start start 2024-09-12T02:38:13.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.903+0000 7f295a8d0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f295406e650 0x7f29540a75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:13.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.903+0000 7f295a8d0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29540c3e00 0x7f2954144c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:13.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.903+0000 7f295a8d0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2954150930 0x7f2954145e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:13.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.903+0000 7f295a8d0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f29540adb10 con 0x7f2954150930 2024-09-12T02:38:13.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.903+0000 7f295a8d0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f29541505e0 con 0x7f29540c3e00 2024-09-12T02:38:13.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.903+0000 7f295a8d0640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2954150de0 con 0x7f295406e650 2024-09-12T02:38:13.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.903+0000 7f2953fff640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f295406e650 msgr2=0x7f29540a75d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:38:13.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.903+0000 7f2953fff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f295406e650 0x7f29540a75d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:38:13.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.903+0000 7f294bfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29540c3e00 0x7f2954144c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:13.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.903+0000 7f2958e6d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2954150930 0x7f2954145e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:13.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.903+0000 7f294bfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29540c3e00 0x7f2954144c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:49050/0 (socket says 172.21.15.60:49050) 2024-09-12T02:38:13.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.903+0000 7f294bfff640 1 -- 172.21.15.60:0/2686213451 learned_addr learned my addr 172.21.15.60:0/2686213451 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:38:13.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.904+0000 7f294bfff640 1 -- 172.21.15.60:0/2686213451 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f295406e650 msgr2=0x7f29540a75d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:38:13.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.904+0000 7f294bfff640 1 --2- 172.21.15.60:0/2686213451 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f295406e650 0x7f29540a75d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:13.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.904+0000 7f294bfff640 1 -- 172.21.15.60:0/2686213451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2954150930 msgr2=0x7f2954145e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:13.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.904+0000 7f294bfff640 1 --2- 172.21.15.60:0/2686213451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2954150930 0x7f2954145e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:13.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.904+0000 7f294bfff640 1 -- 172.21.15.60:0/2686213451 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2954145690 con 0x7f29540c3e00 2024-09-12T02:38:13.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.904+0000 7f294bfff640 1 --2- 172.21.15.60:0/2686213451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29540c3e00 0x7f2954144c40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f293c00c470 tx=0x7f293c00c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:13.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.904+0000 7f29517fa640 1 -- 172.21.15.60:0/2686213451 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f293c017070 con 0x7f29540c3e00 2024-09-12T02:38:13.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.904+0000 7f29517fa640 1 -- 172.21.15.60:0/2686213451 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f293c005ce0 con 0x7f29540c3e00 2024-09-12T02:38:13.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.904+0000 7f295a8d0640 1 -- 172.21.15.60:0/2686213451 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2954145970 con 0x7f29540c3e00 2024-09-12T02:38:13.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.904+0000 7f29517fa640 1 -- 172.21.15.60:0/2686213451 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f293c0072d0 con 0x7f29540c3e00 2024-09-12T02:38:13.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.904+0000 7f295a8d0640 1 -- 172.21.15.60:0/2686213451 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29541431d0 con 0x7f29540c3e00 2024-09-12T02:38:13.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.905+0000 7f295a8d0640 1 -- 172.21.15.60:0/2686213451 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29541500a0 con 0x7f29540c3e00 2024-09-12T02:38:13.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.906+0000 7f29517fa640 1 -- 172.21.15.60:0/2686213451 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f293c01a070 con 0x7f29540c3e00 2024-09-12T02:38:13.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.907+0000 7f29517fa640 1 --2- 172.21.15.60:0/2686213451 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f293406bde0 0x7f293406e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:13.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.907+0000 7f29517fa640 1 -- 172.21.15.60:0/2686213451 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f293c08a400 con 0x7f29540c3e00 2024-09-12T02:38:13.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.907+0000 7f2953fff640 1 --2- 172.21.15.60:0/2686213451 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f293406bde0 0x7f293406e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:13.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.907+0000 7f2953fff640 1 --2- 172.21.15.60:0/2686213451 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f293406bde0 0x7f293406e2a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2944006fd0 tx=0x7f2944006d80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:13.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:13.915+0000 7f29517fa640 1 -- 172.21.15.60:0/2686213451 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f293c0583b0 con 0x7f29540c3e00 2024-09-12T02:38:14.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:14.384+0000 7f295a8d0640 1 -- 172.21.15.60:0/2686213451 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f29540c34f0 con 0x7f29540c3e00 2024-09-12T02:38:14.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:14.386+0000 7f29517fa640 1 -- 172.21.15.60:0/2686213451 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1566 (secure 0 0 0) 0x7f293c05c6b0 con 0x7f29540c3e00 2024-09-12T02:38:14.387 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":146,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:38:14.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:14.390+0000 7f295a8d0640 1 -- 172.21.15.60:0/2686213451 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f293406bde0 msgr2=0x7f293406e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:14.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:14.390+0000 7f295a8d0640 1 --2- 172.21.15.60:0/2686213451 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f293406bde0 0x7f293406e2a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2944006fd0 tx=0x7f2944006d80 comp rx=0 tx=0).stop 2024-09-12T02:38:14.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:14.390+0000 7f295a8d0640 1 -- 172.21.15.60:0/2686213451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29540c3e00 msgr2=0x7f2954144c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:14.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:14.390+0000 7f295a8d0640 1 --2- 172.21.15.60:0/2686213451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29540c3e00 0x7f2954144c40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f293c00c470 tx=0x7f293c00c930 comp rx=0 tx=0).stop 2024-09-12T02:38:14.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:14.390+0000 7f295a8d0640 1 -- 172.21.15.60:0/2686213451 shutdown_connections 2024-09-12T02:38:14.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:14.390+0000 7f295a8d0640 1 --2- 172.21.15.60:0/2686213451 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f293406bde0 0x7f293406e2a0 secure :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2944006fd0 tx=0x7f2944006d80 comp rx=0 tx=0).stop 2024-09-12T02:38:14.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:14.391+0000 7f295a8d0640 1 --2- 172.21.15.60:0/2686213451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2954150930 0x7f2954145e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:14.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:14.391+0000 7f295a8d0640 1 --2- 172.21.15.60:0/2686213451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29540c3e00 0x7f2954144c40 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:14.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:14.391+0000 7f295a8d0640 1 --2- 172.21.15.60:0/2686213451 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f295406e650 0x7f29540a75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:14.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:14.391+0000 7f295a8d0640 1 -- 172.21.15.60:0/2686213451 >> 172.21.15.60:0/2686213451 conn(0x7f29540c7a40 msgr2=0x7f295413cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:14.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:14.391+0000 7f295a8d0640 1 -- 172.21.15.60:0/2686213451 shutdown_connections 2024-09-12T02:38:14.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:14.391+0000 7f295a8d0640 1 -- 172.21.15.60:0/2686213451 wait complete. 2024-09-12T02:38:17.409 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:38:17.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:17.573+0000 7fb1fae65640 1 Processor -- start 2024-09-12T02:38:17.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:17.573+0000 7fb1fae65640 1 -- start start 2024-09-12T02:38:17.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:17.574+0000 7fb1fae65640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb1f40c6010 0x7fb1f406dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:17.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:17.574+0000 7fb1fae65640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb1f40c5940 0x7fb1f406dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:17.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:17.574+0000 7fb1fae65640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1f415a970 con 0x7fb1f40a6c10 2024-09-12T02:38:17.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:17.574+0000 7fb1fae65640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fb1f415ac50 con 0x7fb1f40c5940 2024-09-12T02:38:17.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:17.574+0000 7fb1fae65640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fb1f415af30 con 0x7fb1f40c6010 2024-09-12T02:38:17.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:17.574+0000 7fb1f3fff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb1f40c6010 0x7fb1f406dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:17.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:17.574+0000 7fb1f3fff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb1f40c6010 0x7fb1f406dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:49066/0 (socket says 172.21.15.60:49066) 2024-09-12T02:38:17.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:17.574+0000 7fb1f3fff640 1 -- 172.21.15.60:0/72702360 learned_addr learned my addr 172.21.15.60:0/72702360 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:38:17.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:17.574+0000 7fb1f8c01640 1 --1- 172.21.15.60:0/72702360 >> v1:172.21.15.60:6789/0 conn(0x7fb1f40a6c10 0x7fb1f40c2440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:58590/0 (socket says 172.21.15.60:58590) 2024-09-12T02:38:17.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:17.574+0000 7fb1f9402640 1 --2- 172.21.15.60:0/72702360 >> v2:172.21.15.60:3300/0 conn(0x7fb1f40c5940 0x7fb1f406dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:17.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:17.574+0000 7fb1f3fff640 1 -- 172.21.15.60:0/72702360 >> v2:172.21.15.105:3300/0 conn(0x7fb1f40c6010 msgr2=0x7fb1f406dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:38:17.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:17.574+0000 7fb1f3fff640 1 -- 172.21.15.60:0/72702360 >> v2:172.21.15.105:3300/0 conn(0x7fb1f40c6010 msgr2=0x7fb1f406dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:38:17.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:17.574+0000 7fb1f3fff640 1 --2- 172.21.15.60:0/72702360 >> v2:172.21.15.105:3300/0 conn(0x7fb1f40c6010 0x7fb1f406dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:38:17.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:17.574+0000 7fb1f3fff640 1 --2- 172.21.15.60:0/72702360 >> v2:172.21.15.105:3300/0 conn(0x7fb1f40c6010 0x7fb1f406dab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:38:17.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:17.574+0000 7fb1f9402640 1 -- 172.21.15.60:0/72702360 >> v2:172.21.15.60:3300/0 conn(0x7fb1f40c5940 msgr2=0x7fb1f406dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:38:17.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:17.574+0000 7fb1f9402640 1 -- 172.21.15.60:0/72702360 >> v2:172.21.15.60:3300/0 conn(0x7fb1f40c5940 msgr2=0x7fb1f406dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:38:17.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:17.574+0000 7fb1f9402640 1 --2- 172.21.15.60:0/72702360 >> v2:172.21.15.60:3300/0 conn(0x7fb1f40c5940 0x7fb1f406dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:38:17.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:17.574+0000 7fb1f9402640 1 --2- 172.21.15.60:0/72702360 >> v2:172.21.15.60:3300/0 conn(0x7fb1f40c5940 0x7fb1f406dff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:38:17.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:17.775+0000 7fb1f9402640 1 --2- 172.21.15.60:0/72702360 >> v2:172.21.15.60:3300/0 conn(0x7fb1f40c5940 0x7fb1f406dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:17.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:17.775+0000 7fb1f9402640 1 -- 172.21.15.60:0/72702360 >> v2:172.21.15.60:3300/0 conn(0x7fb1f40c5940 msgr2=0x7fb1f406dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:38:17.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:17.775+0000 7fb1f9402640 1 -- 172.21.15.60:0/72702360 >> v2:172.21.15.60:3300/0 conn(0x7fb1f40c5940 msgr2=0x7fb1f406dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:38:17.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:17.775+0000 7fb1f9402640 1 --2- 172.21.15.60:0/72702360 >> v2:172.21.15.60:3300/0 conn(0x7fb1f40c5940 0x7fb1f406dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:38:17.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:17.775+0000 7fb1f3fff640 1 --2- 172.21.15.60:0/72702360 >> v2:172.21.15.105:3300/0 conn(0x7fb1f40c6010 0x7fb1f406dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:17.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:17.775+0000 7fb1f9402640 1 --2- 172.21.15.60:0/72702360 >> v2:172.21.15.60:3300/0 conn(0x7fb1f40c5940 0x7fb1f406dff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:38:17.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:17.775+0000 7fb1f3fff640 1 -- 172.21.15.60:0/72702360 >> v2:172.21.15.105:3300/0 conn(0x7fb1f40c6010 msgr2=0x7fb1f406dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:38:17.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:17.775+0000 7fb1f3fff640 1 -- 172.21.15.60:0/72702360 >> v2:172.21.15.105:3300/0 conn(0x7fb1f40c6010 msgr2=0x7fb1f406dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:38:17.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:17.775+0000 7fb1f3fff640 1 --2- 172.21.15.60:0/72702360 >> v2:172.21.15.105:3300/0 conn(0x7fb1f40c6010 0x7fb1f406dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:38:17.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:17.775+0000 7fb1f3fff640 1 --2- 172.21.15.60:0/72702360 >> v2:172.21.15.105:3300/0 conn(0x7fb1f40c6010 0x7fb1f406dab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:38:18.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:18.176+0000 7fb1f9402640 1 --2- 172.21.15.60:0/72702360 >> v2:172.21.15.60:3300/0 conn(0x7fb1f40c5940 0x7fb1f406dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:18.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:18.176+0000 7fb1f3fff640 1 --2- 172.21.15.60:0/72702360 >> v2:172.21.15.105:3300/0 conn(0x7fb1f40c6010 0x7fb1f406dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:18.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:18.176+0000 7fb1f3fff640 1 -- 172.21.15.60:0/72702360 >> v2:172.21.15.105:3300/0 conn(0x7fb1f40c6010 msgr2=0x7fb1f406dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:38:18.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:18.176+0000 7fb1f3fff640 1 -- 172.21.15.60:0/72702360 >> v2:172.21.15.105:3300/0 conn(0x7fb1f40c6010 msgr2=0x7fb1f406dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:38:18.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:18.176+0000 7fb1f3fff640 1 --2- 172.21.15.60:0/72702360 >> v2:172.21.15.105:3300/0 conn(0x7fb1f40c6010 0x7fb1f406dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:38:18.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:18.176+0000 7fb1f3fff640 1 --2- 172.21.15.60:0/72702360 >> v2:172.21.15.105:3300/0 conn(0x7fb1f40c6010 0x7fb1f406dab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:38:18.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:18.176+0000 7fb1f9402640 1 -- 172.21.15.60:0/72702360 >> v2:172.21.15.60:3300/0 conn(0x7fb1f40c5940 msgr2=0x7fb1f406dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:38:18.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:18.176+0000 7fb1f9402640 1 -- 172.21.15.60:0/72702360 >> v2:172.21.15.60:3300/0 conn(0x7fb1f40c5940 msgr2=0x7fb1f406dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:38:18.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:18.176+0000 7fb1f9402640 1 --2- 172.21.15.60:0/72702360 >> v2:172.21.15.60:3300/0 conn(0x7fb1f40c5940 0x7fb1f406dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:38:18.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:18.176+0000 7fb1f9402640 1 --2- 172.21.15.60:0/72702360 >> v2:172.21.15.60:3300/0 conn(0x7fb1f40c5940 0x7fb1f406dff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:38:18.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:18.977+0000 7fb1f9402640 1 --2- 172.21.15.60:0/72702360 >> v2:172.21.15.60:3300/0 conn(0x7fb1f40c5940 0x7fb1f406dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:18.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:18.977+0000 7fb1f3fff640 1 --2- 172.21.15.60:0/72702360 >> v2:172.21.15.105:3300/0 conn(0x7fb1f40c6010 0x7fb1f406dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:18.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:18.977+0000 7fb1f3fff640 1 -- 172.21.15.60:0/72702360 >> v2:172.21.15.105:3300/0 conn(0x7fb1f40c6010 msgr2=0x7fb1f406dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:38:18.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:18.977+0000 7fb1f3fff640 1 -- 172.21.15.60:0/72702360 >> v2:172.21.15.105:3300/0 conn(0x7fb1f40c6010 msgr2=0x7fb1f406dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:38:18.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:18.977+0000 7fb1f3fff640 1 --2- 172.21.15.60:0/72702360 >> v2:172.21.15.105:3300/0 conn(0x7fb1f40c6010 0x7fb1f406dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:38:18.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:18.977+0000 7fb1f3fff640 1 --2- 172.21.15.60:0/72702360 >> v2:172.21.15.105:3300/0 conn(0x7fb1f40c6010 0x7fb1f406dab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:38:18.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:18.977+0000 7fb1f9402640 1 -- 172.21.15.60:0/72702360 >> v2:172.21.15.60:3300/0 conn(0x7fb1f40c5940 msgr2=0x7fb1f406dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:38:18.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:18.977+0000 7fb1f9402640 1 -- 172.21.15.60:0/72702360 >> v2:172.21.15.60:3300/0 conn(0x7fb1f40c5940 msgr2=0x7fb1f406dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:38:18.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:18.977+0000 7fb1f9402640 1 --2- 172.21.15.60:0/72702360 >> v2:172.21.15.60:3300/0 conn(0x7fb1f40c5940 0x7fb1f406dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:38:18.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:18.977+0000 7fb1f9402640 1 --2- 172.21.15.60:0/72702360 >> v2:172.21.15.60:3300/0 conn(0x7fb1f40c5940 0x7fb1f406dff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:38:20.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:20.574+0000 7fb1f27fc640 1 -- 172.21.15.60:0/72702360 >> v2:172.21.15.105:3300/0 conn(0x7fb1f40c6010 msgr2=0x7fb1f406dab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:38:20.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:20.574+0000 7fb1f27fc640 1 --2- 172.21.15.60:0/72702360 >> v2:172.21.15.105:3300/0 conn(0x7fb1f40c6010 0x7fb1f406dab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:20.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:20.574+0000 7fb1f27fc640 1 -- 172.21.15.60:0/72702360 >> v2:172.21.15.60:3300/0 conn(0x7fb1f40c5940 msgr2=0x7fb1f406dff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:38:20.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:20.574+0000 7fb1f27fc640 1 --2- 172.21.15.60:0/72702360 >> v2:172.21.15.60:3300/0 conn(0x7fb1f40c5940 0x7fb1f406dff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:20.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:20.574+0000 7fb1f27fc640 1 -- 172.21.15.60:0/72702360 >> v1:172.21.15.60:6789/0 conn(0x7fb1f40a6c10 legacy=0x7fb1f40c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:20.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:20.574+0000 7fb1f27fc640 1 --2- 172.21.15.60:0/72702360 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1d8003690 0x7fb1d8005ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:20.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:20.574+0000 7fb1f27fc640 1 -- 172.21.15.60:0/72702360 --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1f415b210 con 0x7fb1d8006170 2024-09-12T02:38:20.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:20.574+0000 7fb1f27fc640 1 -- 172.21.15.60:0/72702360 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb1f415ac50 con 0x7fb1d8003690 2024-09-12T02:38:20.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:20.574+0000 7fb1f8c01640 1 -- 172.21.15.60:0/72702360 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1d8003690 msgr2=0x7fb1d8005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:38:20.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:20.574+0000 7fb1f8c01640 1 --2- 172.21.15.60:0/72702360 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1d8003690 0x7fb1d8005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:38:20.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:20.775+0000 7fb1f8c01640 1 -- 172.21.15.60:0/72702360 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1d8003690 msgr2=0x7fb1d8005ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:38:20.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:20.775+0000 7fb1f8c01640 1 --2- 172.21.15.60:0/72702360 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1d8003690 0x7fb1d8005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:38:21.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.003+0000 7fb1f37fe640 1 -- 172.21.15.60:0/72702360 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 236089198 0 0) 0x7fb1f415b210 con 0x7fb1d8006170 2024-09-12T02:38:21.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.003+0000 7fb1f37fe640 1 -- 172.21.15.60:0/72702360 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1e4003520 con 0x7fb1d8006170 2024-09-12T02:38:21.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.004+0000 7fb1f37fe640 1 -- 172.21.15.60:0/72702360 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1823981068 0 0) 0x7fb1e4003520 con 0x7fb1d8006170 2024-09-12T02:38:21.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.004+0000 7fb1f37fe640 1 -- 172.21.15.60:0/72702360 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1d8003690 msgr2=0x7fb1d8005ae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:38:21.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.004+0000 7fb1f37fe640 1 --2- 172.21.15.60:0/72702360 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1d8003690 0x7fb1d8005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:21.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.004+0000 7fb1f37fe640 1 -- 172.21.15.60:0/72702360 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1d800af70 con 0x7fb1d8006170 2024-09-12T02:38:21.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.004+0000 7fb1f37fe640 1 -- 172.21.15.60:0/72702360 <== mon.1 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7fb1e000f040 con 0x7fb1d8006170 2024-09-12T02:38:21.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.004+0000 7fb1f37fe640 1 -- 172.21.15.60:0/72702360 >> v1:172.21.15.105:6789/0 conn(0x7fb1d8006170 legacy=0x7fb1d8008630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:21.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.004+0000 7fb1f37fe640 1 --2- 172.21.15.60:0/72702360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1e40039b0 0x7fb1e4003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:21.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.004+0000 7fb1f37fe640 1 --2- 172.21.15.60:0/72702360 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1d8003690 0x7fb1e4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:21.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.004+0000 7fb1f37fe640 1 --2- 172.21.15.60:0/72702360 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1e4004d90 0x7fb1e4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:21.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.004+0000 7fb1f37fe640 1 -- 172.21.15.60:0/72702360 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f415ac50 con 0x7fb1e40039b0 2024-09-12T02:38:21.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.004+0000 7fb1f37fe640 1 -- 172.21.15.60:0/72702360 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e400bc40 con 0x7fb1e4004d90 2024-09-12T02:38:21.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.004+0000 7fb1f37fe640 1 -- 172.21.15.60:0/72702360 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb1e400be40 con 0x7fb1d8003690 2024-09-12T02:38:21.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.004+0000 7fb1f3fff640 1 -- 172.21.15.60:0/72702360 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1d8003690 msgr2=0x7fb1e4004800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:38:21.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.004+0000 7fb1f3fff640 1 --2- 172.21.15.60:0/72702360 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1d8003690 0x7fb1e4004800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:38:21.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.004+0000 7fb1f9402640 1 -- 172.21.15.60:0/72702360 reap_dead start 2024-09-12T02:38:21.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.004+0000 7fb1f8c01640 1 --2- 172.21.15.60:0/72702360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1e40039b0 0x7fb1e4003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:21.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.005+0000 7fb1f9402640 1 --2- 172.21.15.60:0/72702360 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1e4004d90 0x7fb1e4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:21.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.005+0000 7fb1f9402640 1 -- 172.21.15.60:0/72702360 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1d8003690 msgr2=0x7fb1e4004800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:38:21.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.005+0000 7fb1f9402640 1 --2- 172.21.15.60:0/72702360 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1d8003690 0x7fb1e4004800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:21.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.005+0000 7fb1f9402640 1 -- 172.21.15.60:0/72702360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1e40039b0 msgr2=0x7fb1e4003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:21.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.005+0000 7fb1f9402640 1 --2- 172.21.15.60:0/72702360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1e40039b0 0x7fb1e4003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:21.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.005+0000 7fb1f9402640 1 -- 172.21.15.60:0/72702360 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1d800af70 con 0x7fb1e4004d90 2024-09-12T02:38:21.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.006+0000 7fb1f8c01640 1 --2- 172.21.15.60:0/72702360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1e40039b0 0x7fb1e4003db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:38:21.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.008+0000 7fb1f9402640 1 --2- 172.21.15.60:0/72702360 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1e4004d90 0x7fb1e4005210 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb1f41581f0 tx=0x7fb1e4005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82ffa5a22faa18be server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:21.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.008+0000 7fb1f37fe640 1 -- 172.21.15.60:0/72702360 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec031070 con 0x7fb1e4004d90 2024-09-12T02:38:21.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.008+0000 7fb1f37fe640 1 -- 172.21.15.60:0/72702360 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1ec02b820 con 0x7fb1e4004d90 2024-09-12T02:38:21.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.008+0000 7fb1f37fe640 1 -- 172.21.15.60:0/72702360 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec003e30 con 0x7fb1e4004d90 2024-09-12T02:38:21.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.009+0000 7fb1fae65640 1 -- 172.21.15.60:0/72702360 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1e4004d90 msgr2=0x7fb1e4005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:21.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.009+0000 7fb1fae65640 1 --2- 172.21.15.60:0/72702360 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1e4004d90 0x7fb1e4005210 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb1f41581f0 tx=0x7fb1e4005830 comp rx=0 tx=0).stop 2024-09-12T02:38:21.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.009+0000 7fb1fae65640 1 -- 172.21.15.60:0/72702360 shutdown_connections 2024-09-12T02:38:21.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.009+0000 7fb1fae65640 1 --2- 172.21.15.60:0/72702360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1e40039b0 0x7fb1e4003db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:21.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.009+0000 7fb1fae65640 1 --2- 172.21.15.60:0/72702360 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1d8003690 0x7fb1e4004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:21.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.009+0000 7fb1fae65640 1 --2- 172.21.15.60:0/72702360 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1e4004d90 0x7fb1e4005210 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:21.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.009+0000 7fb1fae65640 1 -- 172.21.15.60:0/72702360 >> 172.21.15.60:0/72702360 conn(0x7fb1f40c7a40 msgr2=0x7fb1f40c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:21.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.009+0000 7fb1fae65640 1 -- 172.21.15.60:0/72702360 shutdown_connections 2024-09-12T02:38:21.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.009+0000 7fb1fae65640 1 -- 172.21.15.60:0/72702360 wait complete. 2024-09-12T02:38:21.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.011+0000 7fb1fae65640 1 Processor -- start 2024-09-12T02:38:21.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.011+0000 7fb1fae65640 1 -- start start 2024-09-12T02:38:21.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.012+0000 7fb1fae65640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1d8003690 0x7fb1f4153420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:21.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.012+0000 7fb1fae65640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1e40039b0 0x7fb1f414e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:21.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.012+0000 7fb1f8c01640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1d8003690 msgr2=0x7fb1f4153420 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:38:21.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.012+0000 7fb1f8c01640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1d8003690 0x7fb1f4153420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:38:21.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.012+0000 7fb1fae65640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1e4004d90 0x7fb1f414eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:21.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.013+0000 7fb1fae65640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f40a7520 con 0x7fb1e4004d90 2024-09-12T02:38:21.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.013+0000 7fb1fae65640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f40a73a0 con 0x7fb1e40039b0 2024-09-12T02:38:21.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.013+0000 7fb1f9402640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1e4004d90 0x7fb1f414eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:21.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.013+0000 7fb1f9402640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1e4004d90 0x7fb1f414eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55012/0 (socket says 172.21.15.60:55012) 2024-09-12T02:38:21.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.013+0000 7fb1f9402640 1 -- 172.21.15.60:0/349766292 learned_addr learned my addr 172.21.15.60:0/349766292 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:38:21.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.013+0000 7fb1f3fff640 1 --2- 172.21.15.60:0/349766292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1e40039b0 0x7fb1f414e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:21.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.013+0000 7fb1fae65640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb1f40c2440 con 0x7fb1d8003690 2024-09-12T02:38:21.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.013+0000 7fb1f3fff640 1 -- 172.21.15.60:0/349766292 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1d8003690 msgr2=0x7fb1f4153420 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:38:21.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.013+0000 7fb1f3fff640 1 --2- 172.21.15.60:0/349766292 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1d8003690 0x7fb1f4153420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:21.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.013+0000 7fb1f3fff640 1 -- 172.21.15.60:0/349766292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1e4004d90 msgr2=0x7fb1f414eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:21.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.013+0000 7fb1f3fff640 1 --2- 172.21.15.60:0/349766292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1e4004d90 0x7fb1f414eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:21.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.013+0000 7fb1f3fff640 1 -- 172.21.15.60:0/349766292 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1f414e510 con 0x7fb1e40039b0 2024-09-12T02:38:21.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.013+0000 7fb1f9402640 1 --2- 172.21.15.60:0/349766292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1e4004d90 0x7fb1f414eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:38:21.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.014+0000 7fb1f3fff640 1 --2- 172.21.15.60:0/349766292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1e40039b0 0x7fb1f414e970 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0013900 tx=0x7fb1e0013dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:21.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.014+0000 7fb1f17fa640 1 -- 172.21.15.60:0/349766292 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e001b070 con 0x7fb1e40039b0 2024-09-12T02:38:21.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.014+0000 7fb1f17fa640 1 -- 172.21.15.60:0/349766292 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1e0011b10 con 0x7fb1e40039b0 2024-09-12T02:38:21.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.014+0000 7fb1f17fa640 1 -- 172.21.15.60:0/349766292 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0016460 con 0x7fb1e40039b0 2024-09-12T02:38:21.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.014+0000 7fb1fae65640 1 -- 172.21.15.60:0/349766292 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1f4159040 con 0x7fb1e40039b0 2024-09-12T02:38:21.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.014+0000 7fb1fae65640 1 -- 172.21.15.60:0/349766292 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1f41576a0 con 0x7fb1e40039b0 2024-09-12T02:38:21.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.016+0000 7fb1fae65640 1 -- 172.21.15.60:0/349766292 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1f40c27d0 con 0x7fb1e40039b0 2024-09-12T02:38:21.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.017+0000 7fb1f17fa640 1 -- 172.21.15.60:0/349766292 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb1e001e070 con 0x7fb1e40039b0 2024-09-12T02:38:21.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.017+0000 7fb1f17fa640 1 --2- 172.21.15.60:0/349766292 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb1d806c940 0x7fb1d806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:21.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.017+0000 7fb1f17fa640 1 -- 172.21.15.60:0/349766292 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fb1e008ba50 con 0x7fb1e40039b0 2024-09-12T02:38:21.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.017+0000 7fb1f8c01640 1 --2- 172.21.15.60:0/349766292 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb1d806c940 0x7fb1d806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:21.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.018+0000 7fb1f8c01640 1 --2- 172.21.15.60:0/349766292 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb1d806c940 0x7fb1d806ee00 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb1e8001120 tx=0x7fb1e8001260 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:21.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.022+0000 7fb1f17fa640 1 -- 172.21.15.60:0/349766292 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb1e0059f40 con 0x7fb1e40039b0 2024-09-12T02:38:21.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.500+0000 7fb1fae65640 1 -- 172.21.15.60:0/349766292 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb1f4157f20 con 0x7fb1e40039b0 2024-09-12T02:38:21.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.501+0000 7fb1f17fa640 1 -- 172.21.15.60:0/349766292 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1559 (secure 0 0 0) 0x7fb1e0059840 con 0x7fb1e40039b0 2024-09-12T02:38:21.501 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":150,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:38:21.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.503+0000 7fb1fae65640 1 -- 172.21.15.60:0/349766292 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb1d806c940 msgr2=0x7fb1d806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:21.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.503+0000 7fb1fae65640 1 --2- 172.21.15.60:0/349766292 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb1d806c940 0x7fb1d806ee00 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb1e8001120 tx=0x7fb1e8001260 comp rx=0 tx=0).stop 2024-09-12T02:38:21.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.503+0000 7fb1fae65640 1 -- 172.21.15.60:0/349766292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1e40039b0 msgr2=0x7fb1f414e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:21.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.503+0000 7fb1fae65640 1 --2- 172.21.15.60:0/349766292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1e40039b0 0x7fb1f414e970 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0013900 tx=0x7fb1e0013dc0 comp rx=0 tx=0).stop 2024-09-12T02:38:21.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.504+0000 7fb1fae65640 1 -- 172.21.15.60:0/349766292 shutdown_connections 2024-09-12T02:38:21.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.504+0000 7fb1fae65640 1 --2- 172.21.15.60:0/349766292 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb1d806c940 0x7fb1d806ee00 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:21.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.504+0000 7fb1fae65640 1 --2- 172.21.15.60:0/349766292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1e4004d90 0x7fb1f414eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:21.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.504+0000 7fb1fae65640 1 --2- 172.21.15.60:0/349766292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1e40039b0 0x7fb1f414e970 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:21.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.504+0000 7fb1fae65640 1 --2- 172.21.15.60:0/349766292 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1d8003690 0x7fb1f4153420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:21.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.504+0000 7fb1fae65640 1 -- 172.21.15.60:0/349766292 >> 172.21.15.60:0/349766292 conn(0x7fb1f40c7a40 msgr2=0x7fb1f40a5a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:21.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.505+0000 7fb1fae65640 1 -- 172.21.15.60:0/349766292 shutdown_connections 2024-09-12T02:38:21.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.505+0000 7fb1fae65640 1 -- 172.21.15.60:0/349766292 wait complete. 2024-09-12T02:38:21.522 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-12T02:38:21.522 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-09-12T02:38:21.522 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-12T02:38:21.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.688+0000 7f83d236f640 1 Processor -- start 2024-09-12T02:38:21.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.688+0000 7f83d236f640 1 -- start start 2024-09-12T02:38:21.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.689+0000 7f83d236f640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f83cc0c4680 0x7f83cc156a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:21.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.690+0000 7f83d236f640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83cc070590 con 0x7f83cc0acc30 2024-09-12T02:38:21.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.690+0000 7f83cbfff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f83cc0acc30 0x7f83cc0c3f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:57676/0 (socket says 172.21.15.60:57676) 2024-09-12T02:38:21.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.690+0000 7f83cbfff640 1 -- 172.21.15.60:0/1335495946 learned_addr learned my addr 172.21.15.60:0/1335495946 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:38:21.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.690+0000 7f83d236f640 1 -- 172.21.15.60:0/1335495946 --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83cc0a8220 con 0x7f83cc156fc0 2024-09-12T02:38:21.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.690+0000 7f83d236f640 1 -- 172.21.15.60:0/1335495946 --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f83cc0c4ea0 con 0x7f83cc0c4680 2024-09-12T02:38:21.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.690+0000 7f83caffd640 1 -- 172.21.15.60:0/1335495946 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3103716000 0 0) 0x7f83cc0a8220 con 0x7f83cc156fc0 2024-09-12T02:38:21.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.690+0000 7f83cb7fe640 1 --2- 172.21.15.60:0/1335495946 >> v2:172.21.15.105:3300/0 conn(0x7f83cc0c4680 0x7f83cc156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:21.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.690+0000 7f83caffd640 1 -- 172.21.15.60:0/1335495946 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83b4005730 con 0x7f83cc156fc0 2024-09-12T02:38:21.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.690+0000 7f83caffd640 1 -- 172.21.15.60:0/1335495946 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1445965225 0 0) 0x7f83cc070590 con 0x7f83cc0acc30 2024-09-12T02:38:21.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.690+0000 7f83caffd640 1 -- 172.21.15.60:0/1335495946 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83cc0a8220 con 0x7f83cc0acc30 2024-09-12T02:38:21.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.691+0000 7f83caffd640 1 -- 172.21.15.60:0/1335495946 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1731713919 0 0) 0x7f83cc0a8220 con 0x7f83cc0acc30 2024-09-12T02:38:21.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.691+0000 7f83caffd640 1 -- 172.21.15.60:0/1335495946 >> v2:172.21.15.105:3300/0 conn(0x7f83cc0c4680 msgr2=0x7f83cc156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:21.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.691+0000 7f83caffd640 1 --2- 172.21.15.60:0/1335495946 >> v2:172.21.15.105:3300/0 conn(0x7f83cc0c4680 0x7f83cc156a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:21.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.691+0000 7f83caffd640 1 -- 172.21.15.60:0/1335495946 >> v1:172.21.15.105:6789/0 conn(0x7f83cc156fc0 legacy=0x7f83cc15dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:21.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.691+0000 7f83caffd640 1 -- 172.21.15.60:0/1335495946 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83cc0a84f0 con 0x7f83cc0acc30 2024-09-12T02:38:21.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.691+0000 7f83caffd640 1 -- 172.21.15.60:0/1335495946 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7f83bc001670 con 0x7f83cc0acc30 2024-09-12T02:38:21.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.691+0000 7f83caffd640 1 -- 172.21.15.60:0/1335495946 >> v1:172.21.15.60:6789/0 conn(0x7f83cc0acc30 legacy=0x7f83cc0c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:21.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.691+0000 7f83caffd640 1 --2- 172.21.15.60:0/1335495946 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83b4006db0 0x7f83b40071b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:21.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.691+0000 7f83caffd640 1 --2- 172.21.15.60:0/1335495946 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83b40059b0 0x7f83b4005e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:21.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.691+0000 7f83caffd640 1 --2- 172.21.15.60:0/1335495946 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83b4006370 0x7f83b400ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:21.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.691+0000 7f83caffd640 1 -- 172.21.15.60:0/1335495946 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f83b40106a0 con 0x7f83b4006370 2024-09-12T02:38:21.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.691+0000 7f83caffd640 1 -- 172.21.15.60:0/1335495946 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f83b4010850 con 0x7f83b40059b0 2024-09-12T02:38:21.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.691+0000 7f83caffd640 1 -- 172.21.15.60:0/1335495946 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f83b4010a50 con 0x7f83b4006db0 2024-09-12T02:38:21.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.691+0000 7f83cbfff640 1 -- 172.21.15.60:0/1335495946 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83b4006db0 msgr2=0x7f83b40071b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:38:21.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.691+0000 7f83cbfff640 1 --2- 172.21.15.60:0/1335495946 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83b4006db0 0x7f83b40071b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:38:21.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.691+0000 7f83d090c640 1 --2- 172.21.15.60:0/1335495946 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83b4006370 0x7f83b400ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:21.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.691+0000 7f83cb7fe640 1 --2- 172.21.15.60:0/1335495946 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83b40059b0 0x7f83b4005e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:21.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.692+0000 7f83d090c640 1 -- 172.21.15.60:0/1335495946 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83b4006db0 msgr2=0x7f83b40071b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:38:21.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.692+0000 7f83d090c640 1 --2- 172.21.15.60:0/1335495946 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83b4006db0 0x7f83b40071b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:21.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.692+0000 7f83d090c640 1 -- 172.21.15.60:0/1335495946 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83b40059b0 msgr2=0x7f83b4005e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:21.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.692+0000 7f83d090c640 1 --2- 172.21.15.60:0/1335495946 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83b40059b0 0x7f83b4005e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:21.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.692+0000 7f83d090c640 1 -- 172.21.15.60:0/1335495946 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83cc0a84f0 con 0x7f83b4006370 2024-09-12T02:38:21.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.692+0000 7f83cb7fe640 1 --2- 172.21.15.60:0/1335495946 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83b40059b0 0x7f83b4005e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:38:21.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.692+0000 7f83d090c640 1 -- 172.21.15.60:0/1335495946 reap_dead start 2024-09-12T02:38:21.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.693+0000 7f83d090c640 1 --2- 172.21.15.60:0/1335495946 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83b4006370 0x7f83b400ffd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f83c4002000 tx=0x7f83b4007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39aa6503dcf2fd9b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:21.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.693+0000 7f83caffd640 1 -- 172.21.15.60:0/1335495946 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c4001c20 con 0x7f83b4006370 2024-09-12T02:38:21.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.693+0000 7f83caffd640 1 -- 172.21.15.60:0/1335495946 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83c4003b70 con 0x7f83b4006370 2024-09-12T02:38:21.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.693+0000 7f83caffd640 1 -- 172.21.15.60:0/1335495946 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c4001c20 con 0x7f83b4006370 2024-09-12T02:38:21.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.694+0000 7f83d236f640 1 -- 172.21.15.60:0/1335495946 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83b4006370 msgr2=0x7f83b400ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:21.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.694+0000 7f83d236f640 1 --2- 172.21.15.60:0/1335495946 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83b4006370 0x7f83b400ffd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f83c4002000 tx=0x7f83b4007a40 comp rx=0 tx=0).stop 2024-09-12T02:38:21.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.694+0000 7f83d236f640 1 -- 172.21.15.60:0/1335495946 shutdown_connections 2024-09-12T02:38:21.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.694+0000 7f83d236f640 1 --2- 172.21.15.60:0/1335495946 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83b4006370 0x7f83b400ffd0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:21.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.694+0000 7f83d236f640 1 -- 172.21.15.60:0/1335495946 >> 172.21.15.60:0/1335495946 conn(0x7f83cc0c5660 msgr2=0x7f83cc0c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:21.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.694+0000 7f83d236f640 1 -- 172.21.15.60:0/1335495946 shutdown_connections 2024-09-12T02:38:21.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.694+0000 7f83d236f640 1 -- 172.21.15.60:0/1335495946 wait complete. 2024-09-12T02:38:21.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.696+0000 7f83d236f640 1 Processor -- start 2024-09-12T02:38:21.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.697+0000 7f83d236f640 1 -- start start 2024-09-12T02:38:21.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.698+0000 7f83d236f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83b4006370 0x7f83cc1dd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:21.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.698+0000 7f83d236f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83cc156030 0x7f83cc154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:21.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.698+0000 7f83d236f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83cc1553f0 0x7f83cc1e8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:21.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.698+0000 7f83cb7fe640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83cc156030 msgr2=0x7f83cc154eb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:38:21.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.698+0000 7f83d236f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f83cc0c5330 con 0x7f83b4006370 2024-09-12T02:38:21.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.698+0000 7f83d236f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f83cc0702b0 con 0x7f83cc1553f0 2024-09-12T02:38:21.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.698+0000 7f83d236f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f83cc0c63f0 con 0x7f83cc156030 2024-09-12T02:38:21.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.698+0000 7f83cb7fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83cc156030 0x7f83cc154eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:38:21.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.698+0000 7f83cbfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83b4006370 0x7f83cc1dd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:21.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.698+0000 7f83cbfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83b4006370 0x7f83cc1dd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55022/0 (socket says 172.21.15.60:55022) 2024-09-12T02:38:21.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.698+0000 7f83cbfff640 1 -- 172.21.15.60:0/854481934 learned_addr learned my addr 172.21.15.60:0/854481934 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:38:21.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.698+0000 7f83d090c640 1 --2- 172.21.15.60:0/854481934 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83cc1553f0 0x7f83cc1e8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:21.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.699+0000 7f83cbfff640 1 -- 172.21.15.60:0/854481934 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83cc156030 msgr2=0x7f83cc154eb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:38:21.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.699+0000 7f83cbfff640 1 --2- 172.21.15.60:0/854481934 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83cc156030 0x7f83cc154eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:21.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.699+0000 7f83cbfff640 1 -- 172.21.15.60:0/854481934 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83cc1553f0 msgr2=0x7f83cc1e8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:21.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.699+0000 7f83cbfff640 1 --2- 172.21.15.60:0/854481934 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83cc1553f0 0x7f83cc1e8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:21.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.699+0000 7f83cbfff640 1 -- 172.21.15.60:0/854481934 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83cc0c0260 con 0x7f83b4006370 2024-09-12T02:38:21.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.699+0000 7f83cbfff640 1 --2- 172.21.15.60:0/854481934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83b4006370 0x7f83cc1dd230 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f83bc00c7a0 tx=0x7f83bc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:21.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.700+0000 7f83c8ff9640 1 -- 172.21.15.60:0/854481934 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83bc018070 con 0x7f83b4006370 2024-09-12T02:38:21.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.700+0000 7f83c8ff9640 1 -- 172.21.15.60:0/854481934 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83bc00ce50 con 0x7f83b4006370 2024-09-12T02:38:21.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.700+0000 7f83c8ff9640 1 -- 172.21.15.60:0/854481934 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83bc0047e0 con 0x7f83b4006370 2024-09-12T02:38:21.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.700+0000 7f83d236f640 1 -- 172.21.15.60:0/854481934 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83cc155de0 con 0x7f83b4006370 2024-09-12T02:38:21.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.700+0000 7f83d236f640 1 -- 172.21.15.60:0/854481934 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83cc1eadd0 con 0x7f83b4006370 2024-09-12T02:38:21.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.703+0000 7f83c8ff9640 1 -- 172.21.15.60:0/854481934 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f83bc004980 con 0x7f83b4006370 2024-09-12T02:38:21.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.703+0000 7f83c8ff9640 1 --2- 172.21.15.60:0/854481934 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f83b806be10 0x7f83b806e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:21.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.704+0000 7f83c8ff9640 1 -- 172.21.15.60:0/854481934 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f83bc056550 con 0x7f83b4006370 2024-09-12T02:38:21.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.704+0000 7f83cb7fe640 1 --2- 172.21.15.60:0/854481934 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f83b806be10 0x7f83b806e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:21.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.705+0000 7f83d236f640 1 --2- 172.21.15.60:0/854481934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83cc1eafd0 0x7f83cc1e8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:21.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.706+0000 7f83d236f640 1 -- 172.21.15.60:0/854481934 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f83cc1e8ca0 con 0x7f83cc1eafd0 2024-09-12T02:38:21.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.706+0000 7f83d090c640 1 --2- 172.21.15.60:0/854481934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83cc1eafd0 0x7f83cc1e8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:21.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.706+0000 7f83cb7fe640 1 --2- 172.21.15.60:0/854481934 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f83b806be10 0x7f83b806e2d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f83cc0c8240 tx=0x7f83c0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:21.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.707+0000 7f83d090c640 1 -- 172.21.15.60:0/854481934 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f83cc0abc10 con 0x7f83cc1eafd0 2024-09-12T02:38:21.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.707+0000 7f83d090c640 1 --2- 172.21.15.60:0/854481934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83cc1eafd0 0x7f83cc1e8760 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f83cc0ac0d0 tx=0x7f83c4001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:21.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.708+0000 7f83c8ff9640 1 -- 172.21.15.60:0/854481934 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c4005810 con 0x7f83cc1eafd0 2024-09-12T02:38:21.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.708+0000 7f83c8ff9640 1 -- 172.21.15.60:0/854481934 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f83c4041070 con 0x7f83cc1eafd0 2024-09-12T02:38:21.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.708+0000 7f83c8ff9640 1 -- 172.21.15.60:0/854481934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83cc1eafd0 msgr2=0x7f83cc1e8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:21.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.708+0000 7f83c8ff9640 1 --2- 172.21.15.60:0/854481934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83cc1eafd0 0x7f83cc1e8760 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f83cc0ac0d0 tx=0x7f83c4001650 comp rx=0 tx=0).stop 2024-09-12T02:38:21.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.708+0000 7f83c8ff9640 1 -- 172.21.15.60:0/854481934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83cc1eafd0 msgr2=0x7f83cc1e8760 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:38:21.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.708+0000 7f83c8ff9640 1 --2- 172.21.15.60:0/854481934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83cc1eafd0 0x7f83cc1e8760 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:21.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.725+0000 7f83d236f640 1 --2- 172.21.15.60:0/854481934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83cc0bdb80 0x7f83cc0bdf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:21.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.725+0000 7f83d236f640 1 -- 172.21.15.60:0/854481934 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f83cc0bfaf0 con 0x7f83cc0bdb80 2024-09-12T02:38:21.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.726+0000 7f83d090c640 1 --2- 172.21.15.60:0/854481934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83cc0bdb80 0x7f83cc0bdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:21.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.727+0000 7f83d090c640 1 -- 172.21.15.60:0/854481934 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f83cc1dd770 con 0x7f83cc0bdb80 2024-09-12T02:38:21.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.727+0000 7f83d090c640 1 --2- 172.21.15.60:0/854481934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83cc0bdb80 0x7f83cc0bdf90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f83c403d000 tx=0x7f83c402f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:21.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.728+0000 7f83c8ff9640 1 -- 172.21.15.60:0/854481934 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c4005810 con 0x7f83cc0bdb80 2024-09-12T02:38:21.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.728+0000 7f83c8ff9640 1 -- 172.21.15.60:0/854481934 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5041 (secure 0 0 0) 0x7f83c403bc40 con 0x7f83cc0bdb80 2024-09-12T02:38:21.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.728+0000 7f83c8ff9640 1 -- 172.21.15.60:0/854481934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83cc0bdb80 msgr2=0x7f83cc0bdf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:21.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.728+0000 7f83c8ff9640 1 --2- 172.21.15.60:0/854481934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83cc0bdb80 0x7f83cc0bdf90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f83c403d000 tx=0x7f83c402f000 comp rx=0 tx=0).stop 2024-09-12T02:38:21.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.728+0000 7f83c8ff9640 1 -- 172.21.15.60:0/854481934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83cc0bdb80 msgr2=0x7f83cc0bdf90 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:38:21.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.728+0000 7f83c8ff9640 1 --2- 172.21.15.60:0/854481934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83cc0bdb80 0x7f83cc0bdf90 secure :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f83c403d000 tx=0x7f83c402f000 comp rx=0 tx=0).stop 2024-09-12T02:38:21.730 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:38:21.730 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:38:21.730 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:38:21.730 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:38:21.730 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 150, 2024-09-12T02:38:21.730 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 41501, 2024-09-12T02:38:21.730 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:38:21.730 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:38:21.730 INFO:teuthology.orchestra.run.smithi060.stdout: 1 2024-09-12T02:38:21.730 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:21.730 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-09-12T02:38:21.731 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:38:21.731 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:38:21.731 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:38:21.731 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:38:21.731 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:38:21.731 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:38:21.731 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:38:21.731 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:38:21.731 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:38:21.731 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:38:21.731 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:38:21.731 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:38:21.732 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:38:21.732 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:38:21.732 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:21.732 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:38:21.732 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:38:21.732 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:38:21.732 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:38:21.732 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:38:21.732 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:38:21.732 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:38:21.732 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:38:21.732 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:38:21.733 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:38:21.733 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:38:21.733 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:38:21.733 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:38:21.733 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:21.733 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:21.733 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:38:21.733 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:38:21.733 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:38:21.734 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:38:21.734 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:38:21.734 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:38:21.734 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:38:21.734 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:38:21.734 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:38:21.734 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:38:21.734 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:38:21.734 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:38:21.734 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:38:21.734 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:38:21.734 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:38:21.734 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:38:21.735 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:38:21.735 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:38:21.735 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:38:21.735 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:38:21.735 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:38:21.735 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:38:21.735 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:38:21.735 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:38:21.735 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:38:21.735 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:38:21.735 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:38:21.735 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:38:21.735 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:21.736 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:38:21.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:21.736 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:38:21.736 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:21.736 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:38:21.736 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:38:21.736 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:38:21.736 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:38:21.736 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:21.736 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:38:21.736 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:38:21.737 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:21.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:21.737 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:21.737 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:38:21.737 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:38:21.737 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:21.737 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:21.737 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:21.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:21.737 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:38:21.737 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:38:21.737 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:38:21.737 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:38:21.738 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:38:21.738 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:21.738 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:21.738 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:38:21.738 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:38:21.738 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:38:21.738 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:38:21.738 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:21.738 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:38:21.738 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:38:21.738 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:21.738 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:21.738 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:21.739 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:38:21.739 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:38:21.739 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:21.739 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:21.739 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:21.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:21.739 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:38:21.739 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:38:21.739 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:38:21.739 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:38:21.739 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:38:21.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:21.740 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:21.740 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:38:21.740 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:38:21.740 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:38:21.740 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:38:21.740 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:21.740 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:38:21.740 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:38:21.740 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:21.740 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:21.740 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:21.740 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:38:21.741 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:38:21.741 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:21.741 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:21.741 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:21.741 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:21.741 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:38:21.741 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:38:21.741 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:38:21.741 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:38:21.741 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:38:21.741 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:21.741 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:21.741 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:21.742 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:38:21.742 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:38:21.742 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:21.742 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:38:21.742 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:38:21.742 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:38:21.742 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:21.742 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:21.742 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:38:21.742 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:21.743 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:38:21.743 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:38:21.743 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:38:21.743 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:21.743 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:21.743 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:38:21.743 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:21.743 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:38:21.743 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:38:21.743 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:38:21.743 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:21.743 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:21.743 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:38:21.743 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:21.744 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:38:21.744 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:38:21.744 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-09-12T02:38:21.744 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:21.744 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:21.744 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:38:21.744 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:21.744 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:38:21.744 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:38:21.744 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:38:21.744 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:21.744 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:21.745 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:21.745 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:38:21.745 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:38:21.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.729+0000 7f83d236f640 1 -- 172.21.15.60:0/854481934 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f83b806be10 msgr2=0x7f83b806e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:21.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.729+0000 7f83d236f640 1 --2- 172.21.15.60:0/854481934 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f83b806be10 0x7f83b806e2d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f83cc0c8240 tx=0x7f83c0008040 comp rx=0 tx=0).stop 2024-09-12T02:38:21.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.729+0000 7f83d090c640 1 -- 172.21.15.60:0/854481934 reap_dead start 2024-09-12T02:38:21.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.729+0000 7f83d236f640 1 -- 172.21.15.60:0/854481934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83b4006370 msgr2=0x7f83cc1dd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:21.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.729+0000 7f83d236f640 1 --2- 172.21.15.60:0/854481934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83b4006370 0x7f83cc1dd230 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f83bc00c7a0 tx=0x7f83bc00cc60 comp rx=0 tx=0).stop 2024-09-12T02:38:21.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.729+0000 7f83d236f640 1 -- 172.21.15.60:0/854481934 shutdown_connections 2024-09-12T02:38:21.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.729+0000 7f83d236f640 1 --2- 172.21.15.60:0/854481934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83b4006370 0x7f83cc1dd230 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:21.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.729+0000 7f83d236f640 1 -- 172.21.15.60:0/854481934 >> 172.21.15.60:0/854481934 conn(0x7f83cc0c5660 msgr2=0x7f83cc0c74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:21.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.730+0000 7f83d236f640 1 -- 172.21.15.60:0/854481934 shutdown_connections 2024-09-12T02:38:21.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.730+0000 7f83d236f640 1 -- 172.21.15.60:0/854481934 wait complete. 2024-09-12T02:38:21.750 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-12T02:38:21.751 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-12T02:38:21.751 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-12T02:38:21.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.912+0000 7f8ac56f1640 1 Processor -- start 2024-09-12T02:38:21.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.912+0000 7f8ac56f1640 1 -- start start 2024-09-12T02:38:21.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.913+0000 7f8ac56f1640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8ac00a7de0 0x7f8ac015a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:21.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.913+0000 7f8ac56f1640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8ac0074590 0x7f8ac006cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:21.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.913+0000 7f8ac56f1640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ac0156dd0 con 0x7f8ac0153b10 2024-09-12T02:38:21.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.913+0000 7f8ac56f1640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f8ac0157350 con 0x7f8ac0074590 2024-09-12T02:38:21.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.913+0000 7f8ac56f1640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f8ac0159e50 con 0x7f8ac00a7de0 2024-09-12T02:38:21.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.913+0000 7f8abe7fc640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8ac00a7de0 0x7f8ac015a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:21.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.913+0000 7f8abe7fc640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8ac00a7de0 0x7f8ac015a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:45692/0 (socket says 172.21.15.60:45692) 2024-09-12T02:38:21.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.913+0000 7f8abe7fc640 1 -- 172.21.15.60:0/1822407919 learned_addr learned my addr 172.21.15.60:0/1822407919 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:38:21.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.913+0000 7f8abf7fe640 1 --2- 172.21.15.60:0/1822407919 >> v2:172.21.15.60:3300/0 conn(0x7f8ac0074590 0x7f8ac006cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:21.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.914+0000 7f8abe7fc640 1 -- 172.21.15.60:0/1822407919 >> v2:172.21.15.60:3300/0 conn(0x7f8ac0074590 msgr2=0x7f8ac006cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:21.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.914+0000 7f8abe7fc640 1 --2- 172.21.15.60:0/1822407919 >> v2:172.21.15.60:3300/0 conn(0x7f8ac0074590 0x7f8ac006cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:21.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.914+0000 7f8abe7fc640 1 -- 172.21.15.60:0/1822407919 >> v1:172.21.15.60:6789/0 conn(0x7f8ac0153b10 legacy=0x7f8ac00a9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:21.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.914+0000 7f8abe7fc640 1 -- 172.21.15.60:0/1822407919 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ac0157070 con 0x7f8ac00a7de0 2024-09-12T02:38:21.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.915+0000 7f8abe7fc640 1 --2- 172.21.15.60:0/1822407919 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ac00a7de0 0x7f8ac015a2e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8ac00a9480 tx=0x7f8ab402a150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=576d4aefb2f1d9a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:21.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.915+0000 7f8abdffb640 1 -- 172.21.15.60:0/1822407919 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4037070 con 0x7f8ac00a7de0 2024-09-12T02:38:21.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.915+0000 7f8abdffb640 1 -- 172.21.15.60:0/1822407919 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ab4032440 con 0x7f8ac00a7de0 2024-09-12T02:38:21.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.915+0000 7f8abdffb640 1 -- 172.21.15.60:0/1822407919 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4032810 con 0x7f8ac00a7de0 2024-09-12T02:38:21.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.916+0000 7f8ac56f1640 1 -- 172.21.15.60:0/1822407919 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ac00a7de0 msgr2=0x7f8ac015a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:21.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.916+0000 7f8ac56f1640 1 --2- 172.21.15.60:0/1822407919 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ac00a7de0 0x7f8ac015a2e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8ac00a9480 tx=0x7f8ab402a150 comp rx=0 tx=0).stop 2024-09-12T02:38:21.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.917+0000 7f8ac56f1640 1 -- 172.21.15.60:0/1822407919 shutdown_connections 2024-09-12T02:38:21.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.917+0000 7f8ac56f1640 1 --2- 172.21.15.60:0/1822407919 >> v2:172.21.15.60:3300/0 conn(0x7f8ac0074590 0x7f8ac006cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:21.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.917+0000 7f8ac56f1640 1 --2- 172.21.15.60:0/1822407919 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ac00a7de0 0x7f8ac015a2e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:21.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.917+0000 7f8ac56f1640 1 -- 172.21.15.60:0/1822407919 >> 172.21.15.60:0/1822407919 conn(0x7f8ac00c4fa0 msgr2=0x7f8ac00c5380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:21.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.917+0000 7f8ac56f1640 1 -- 172.21.15.60:0/1822407919 shutdown_connections 2024-09-12T02:38:21.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.918+0000 7f8ac56f1640 1 -- 172.21.15.60:0/1822407919 wait complete. 2024-09-12T02:38:21.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.920+0000 7f8ac56f1640 1 Processor -- start 2024-09-12T02:38:21.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.920+0000 7f8ac56f1640 1 -- start start 2024-09-12T02:38:21.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.921+0000 7f8ac56f1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ac0074590 0x7f8ac014c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:21.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.921+0000 7f8ac56f1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ac00a7de0 0x7f8ac01506f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:21.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.921+0000 7f8ac56f1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ac0153b10 0x7f8ac01e1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:21.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.922+0000 7f8ac56f1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac0153ef0 con 0x7f8ac0074590 2024-09-12T02:38:21.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.922+0000 7f8abe7fc640 1 -- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ac00a7de0 msgr2=0x7f8ac01506f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3301/0 2024-09-12T02:38:21.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.922+0000 7f8abeffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ac0074590 0x7f8ac014c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:21.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.922+0000 7f8abe7fc640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ac00a7de0 0x7f8ac01506f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:38:21.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.922+0000 7f8abeffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ac0074590 0x7f8ac014c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55068/0 (socket says 172.21.15.60:55068) 2024-09-12T02:38:21.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.922+0000 7f8abeffd640 1 -- 172.21.15.60:0/530614940 learned_addr learned my addr 172.21.15.60:0/530614940 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:38:21.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.922+0000 7f8ac56f1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac015a820 con 0x7f8ac0153b10 2024-09-12T02:38:21.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.922+0000 7f8abf7fe640 1 --2- 172.21.15.60:0/530614940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ac0153b10 0x7f8ac01e1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:21.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.922+0000 7f8ac56f1640 1 -- 172.21.15.60:0/530614940 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8ac006db80 con 0x7f8ac00a7de0 2024-09-12T02:38:21.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.923+0000 7f8abf7fe640 1 -- 172.21.15.60:0/530614940 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ac00a7de0 msgr2=0x7f8ac01506f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:38:21.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.923+0000 7f8abf7fe640 1 --2- 172.21.15.60:0/530614940 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ac00a7de0 0x7f8ac01506f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:21.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.923+0000 7f8abf7fe640 1 -- 172.21.15.60:0/530614940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ac0074590 msgr2=0x7f8ac014c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:21.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.923+0000 7f8abf7fe640 1 --2- 172.21.15.60:0/530614940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ac0074590 0x7f8ac014c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:21.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.923+0000 7f8abf7fe640 1 -- 172.21.15.60:0/530614940 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ac01ec8a0 con 0x7f8ac0153b10 2024-09-12T02:38:21.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.924+0000 7f8abf7fe640 1 --2- 172.21.15.60:0/530614940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ac0153b10 0x7f8ac01e1ed0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8ab800efc0 tx=0x7f8ab800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:21.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.924+0000 7f8aa77fe640 1 -- 172.21.15.60:0/530614940 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab8018020 con 0x7f8ac0153b10 2024-09-12T02:38:21.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.924+0000 7f8ac56f1640 1 -- 172.21.15.60:0/530614940 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ac014cdb0 con 0x7f8ac0153b10 2024-09-12T02:38:21.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.924+0000 7f8ac56f1640 1 -- 172.21.15.60:0/530614940 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ac01dff30 con 0x7f8ac0153b10 2024-09-12T02:38:21.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.924+0000 7f8aa77fe640 1 -- 172.21.15.60:0/530614940 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ab8014480 con 0x7f8ac0153b10 2024-09-12T02:38:21.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.924+0000 7f8aa77fe640 1 -- 172.21.15.60:0/530614940 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab8014870 con 0x7f8ac0153b10 2024-09-12T02:38:21.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.925+0000 7f8ac56f1640 1 --2- 172.21.15.60:0/530614940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8aa0002a70 0x7f8aa0004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:21.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.925+0000 7f8ac56f1640 1 -- 172.21.15.60:0/530614940 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa0007ec0 con 0x7f8aa0002a70 2024-09-12T02:38:21.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.926+0000 7f8abeffd640 1 --2- 172.21.15.60:0/530614940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8aa0002a70 0x7f8aa0004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:21.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.926+0000 7f8abeffd640 1 -- 172.21.15.60:0/530614940 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8aa00080c0 con 0x7f8aa0002a70 2024-09-12T02:38:21.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.927+0000 7f8aa77fe640 1 -- 172.21.15.60:0/530614940 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8ab8005d10 con 0x7f8ac0153b10 2024-09-12T02:38:21.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.927+0000 7f8abeffd640 1 --2- 172.21.15.60:0/530614940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8aa0002a70 0x7f8aa0004f30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8ac01592b0 tx=0x7f8ab000fc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:21.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.927+0000 7f8aa77fe640 1 --2- 172.21.15.60:0/530614940 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8aac06bde0 0x7f8aac06e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:21.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.927+0000 7f8aa77fe640 1 -- 172.21.15.60:0/530614940 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f8ab808bed0 con 0x7f8ac0153b10 2024-09-12T02:38:21.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.927+0000 7f8abe7fc640 1 --2- 172.21.15.60:0/530614940 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8aac06bde0 0x7f8aac06e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:21.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.928+0000 7f8aa77fe640 1 -- 172.21.15.60:0/530614940 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab00050d0 con 0x7f8aa0002a70 2024-09-12T02:38:21.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.928+0000 7f8aa77fe640 1 -- 172.21.15.60:0/530614940 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f8ab0018070 con 0x7f8aa0002a70 2024-09-12T02:38:21.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.928+0000 7f8aa77fe640 1 -- 172.21.15.60:0/530614940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8aa0002a70 msgr2=0x7f8aa0004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:21.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.928+0000 7f8aa77fe640 1 --2- 172.21.15.60:0/530614940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8aa0002a70 0x7f8aa0004f30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8ac01592b0 tx=0x7f8ab000fc00 comp rx=0 tx=0).stop 2024-09-12T02:38:21.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.928+0000 7f8aa77fe640 1 -- 172.21.15.60:0/530614940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8aa0002a70 msgr2=0x7f8aa0004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:38:21.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.928+0000 7f8aa77fe640 1 --2- 172.21.15.60:0/530614940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8aa0002a70 0x7f8aa0004f30 secure :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8ac01592b0 tx=0x7f8ab000fc00 comp rx=0 tx=0).stop 2024-09-12T02:38:21.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.929+0000 7f8abe7fc640 1 --2- 172.21.15.60:0/530614940 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8aac06bde0 0x7f8aac06e2a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4034000 tx=0x7f8ab402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:21.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.940+0000 7f8ac56f1640 1 --2- 172.21.15.60:0/530614940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8aa0006f00 0x7f8aa0007390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:21.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.940+0000 7f8ac56f1640 1 -- 172.21.15.60:0/530614940 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa000a4a0 con 0x7f8aa0006f00 2024-09-12T02:38:21.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.941+0000 7f8abeffd640 1 --2- 172.21.15.60:0/530614940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8aa0006f00 0x7f8aa0007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:21.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.941+0000 7f8abeffd640 1 -- 172.21.15.60:0/530614940 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8aa00078d0 con 0x7f8aa0006f00 2024-09-12T02:38:21.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.942+0000 7f8abeffd640 1 --2- 172.21.15.60:0/530614940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8aa0006f00 0x7f8aa0007390 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8ac01592b0 tx=0x7f8ab0001080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:21.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.942+0000 7f8aa77fe640 1 -- 172.21.15.60:0/530614940 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab000d720 con 0x7f8aa0006f00 2024-09-12T02:38:21.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.943+0000 7f8aa77fe640 1 -- 172.21.15.60:0/530614940 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5040 (secure 0 0 0) 0x7f8ab000d720 con 0x7f8aa0006f00 2024-09-12T02:38:21.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.943+0000 7f8aa77fe640 1 -- 172.21.15.60:0/530614940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8aa0006f00 msgr2=0x7f8aa0007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:21.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.943+0000 7f8aa77fe640 1 --2- 172.21.15.60:0/530614940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8aa0006f00 0x7f8aa0007390 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8ac01592b0 tx=0x7f8ab0001080 comp rx=0 tx=0).stop 2024-09-12T02:38:21.944 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:38:21.944 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:38:21.944 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:38:21.944 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:38:21.944 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 150, 2024-09-12T02:38:21.944 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 173521, 2024-09-12T02:38:21.944 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:38:21.944 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:38:21.945 INFO:teuthology.orchestra.run.smithi060.stdout: 1 2024-09-12T02:38:21.945 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:21.945 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 0, 2024-09-12T02:38:21.945 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:38:21.945 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:38:21.945 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:38:21.945 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:38:21.945 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:38:21.945 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:38:21.945 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:38:21.945 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:38:21.945 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:38:21.945 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:38:21.945 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:38:21.946 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:38:21.946 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:38:21.946 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:38:21.946 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:21.946 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:38:21.946 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:38:21.946 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:38:21.946 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:38:21.946 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:38:21.946 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:38:21.946 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:38:21.946 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:38:21.946 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:38:21.946 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:38:21.947 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:38:21.947 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:38:21.947 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:38:21.947 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:21.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:21.947 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:38:21.947 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:38:21.947 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:38:21.947 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:38:21.947 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:38:21.947 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:38:21.947 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:38:21.947 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:38:21.947 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:38:21.947 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:38:21.947 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:38:21.948 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:38:21.948 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:38:21.948 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:38:21.948 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:38:21.948 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:38:21.948 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:38:21.948 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:38:21.948 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:38:21.948 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:38:21.948 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:38:21.949 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:38:21.949 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:38:21.949 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:38:21.949 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:38:21.949 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:38:21.949 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:38:21.949 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:38:21.949 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:21.949 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:38:21.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:21.949 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:38:21.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:21.949 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:38:21.949 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:38:21.950 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:38:21.950 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:38:21.950 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:21.950 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:38:21.950 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:38:21.950 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:21.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:21.950 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:21.950 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:38:21.950 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:38:21.950 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:21.951 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:21.951 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:21.951 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:21.951 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:38:21.951 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:38:21.951 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:38:21.951 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:38:21.951 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:38:21.951 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:21.951 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:21.951 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:38:21.951 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:38:21.952 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:38:21.952 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:38:21.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:21.952 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:38:21.952 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:38:21.952 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:21.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:21.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:21.952 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:38:21.952 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:38:21.952 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:21.952 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:21.952 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:21.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:21.953 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:38:21.953 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:38:21.953 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:38:21.953 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:38:21.953 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:38:21.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:21.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:21.953 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:38:21.953 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:38:21.953 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:38:21.953 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:38:21.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:21.954 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:38:21.954 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:38:21.954 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:21.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:21.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:21.954 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:38:21.954 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:38:21.954 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:21.954 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:21.954 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:21.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:21.954 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:38:21.955 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:38:21.955 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:38:21.955 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:38:21.955 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:38:21.955 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:21.955 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:21.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:21.955 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:38:21.955 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:38:21.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:21.955 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:38:21.955 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:38:21.955 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:38:21.955 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:21.956 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:21.956 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:38:21.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:21.956 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:38:21.956 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:38:21.956 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:38:21.956 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:21.956 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:21.956 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:38:21.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:21.956 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:38:21.956 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:38:21.956 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-09-12T02:38:21.956 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:21.957 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:21.957 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:38:21.957 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:21.957 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:38:21.957 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:38:21.957 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:38:21.957 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:21.957 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:21.957 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:38:21.957 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:21.957 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:38:21.957 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:38:21.957 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:38:21.958 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:21.958 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:21.958 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:21.958 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:38:21.958 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:38:21.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.943+0000 7f8aa77fe640 1 -- 172.21.15.60:0/530614940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8aa0006f00 msgr2=0x7f8aa0007390 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:38:21.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.943+0000 7f8aa77fe640 1 --2- 172.21.15.60:0/530614940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8aa0006f00 0x7f8aa0007390 secure :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8ac01592b0 tx=0x7f8ab0001080 comp rx=0 tx=0).stop 2024-09-12T02:38:21.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.943+0000 7f8ac56f1640 1 -- 172.21.15.60:0/530614940 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8aac06bde0 msgr2=0x7f8aac06e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:21.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.943+0000 7f8ac56f1640 1 --2- 172.21.15.60:0/530614940 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8aac06bde0 0x7f8aac06e2a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4034000 tx=0x7f8ab402e000 comp rx=0 tx=0).stop 2024-09-12T02:38:21.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.943+0000 7f8ac56f1640 1 -- 172.21.15.60:0/530614940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ac0153b10 msgr2=0x7f8ac01e1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:21.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.943+0000 7f8ac56f1640 1 --2- 172.21.15.60:0/530614940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ac0153b10 0x7f8ac01e1ed0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8ab800efc0 tx=0x7f8ab800c490 comp rx=0 tx=0).stop 2024-09-12T02:38:21.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.943+0000 7f8abf7fe640 1 -- 172.21.15.60:0/530614940 reap_dead start 2024-09-12T02:38:21.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.943+0000 7f8abf7fe640 1 -- 172.21.15.60:0/530614940 reap_dead start 2024-09-12T02:38:21.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.943+0000 7f8ac56f1640 1 -- 172.21.15.60:0/530614940 shutdown_connections 2024-09-12T02:38:21.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.943+0000 7f8ac56f1640 1 -- 172.21.15.60:0/530614940 >> 172.21.15.60:0/530614940 conn(0x7f8ac00c4fa0 msgr2=0x7f8ac00c5380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:21.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.943+0000 7f8ac56f1640 1 -- 172.21.15.60:0/530614940 shutdown_connections 2024-09-12T02:38:21.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:21.943+0000 7f8ac56f1640 1 -- 172.21.15.60:0/530614940 wait complete. 2024-09-12T02:38:21.960 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-12T02:38:21.960 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-12T02:38:32.059 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:38:32.062 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:38:41.961 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-09-12T02:38:41.962 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-09-12T02:38:41.962 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T02:38:41.962 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T02:38:41.965 INFO:tasks.ceph.mon.c:Started 2024-09-12T02:38:41.965 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-12T02:38:41.965 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:38:42.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.132+0000 7ff3eeaba640 1 Processor -- start 2024-09-12T02:38:42.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.133+0000 7ff3eeaba640 1 -- start start 2024-09-12T02:38:42.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.135+0000 7ff3eeaba640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff3e80c7230 0x7ff3e81562d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:42.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.135+0000 7ff3eeaba640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3e80c2d60 con 0x7ff3e814f820 2024-09-12T02:38:42.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.135+0000 7ff3eeaba640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3e80c3040 con 0x7ff3e806edd0 2024-09-12T02:38:42.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.135+0000 7ff3eeaba640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff3e81532d0 con 0x7ff3e80c7230 2024-09-12T02:38:42.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.136+0000 7ff3ec856640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7ff3e806edd0 0x7ff3e8152bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:47576/0 (socket says 172.21.15.60:47576) 2024-09-12T02:38:42.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.136+0000 7ff3ec856640 1 -- 172.21.15.60:0/1905220532 learned_addr learned my addr 172.21.15.60:0/1905220532 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:38:42.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.137+0000 7ff3e7fff640 1 --2- 172.21.15.60:0/1905220532 >> v2:172.21.15.105:3300/0 conn(0x7ff3e80c7230 0x7ff3e81562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:42.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.137+0000 7ff3e77fe640 1 -- 172.21.15.60:0/1905220532 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4005235746 0 0) 0x7ff3e80c3040 con 0x7ff3e806edd0 2024-09-12T02:38:42.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.137+0000 7ff3e77fe640 1 -- 172.21.15.60:0/1905220532 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3d8003520 con 0x7ff3e806edd0 2024-09-12T02:38:42.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.137+0000 7ff3e77fe640 1 -- 172.21.15.60:0/1905220532 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2073506066 0 0) 0x7ff3e80c2d60 con 0x7ff3e814f820 2024-09-12T02:38:42.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.137+0000 7ff3e77fe640 1 -- 172.21.15.60:0/1905220532 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3e80c3040 con 0x7ff3e814f820 2024-09-12T02:38:42.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.138+0000 7ff3e7fff640 1 -- 172.21.15.60:0/1905220532 >> v1:172.21.15.105:6789/0 conn(0x7ff3e806edd0 legacy=0x7ff3e8152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:42.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.138+0000 7ff3e7fff640 1 -- 172.21.15.60:0/1905220532 >> v1:172.21.15.60:6789/0 conn(0x7ff3e814f820 legacy=0x7ff3e80c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:42.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.138+0000 7ff3e7fff640 1 -- 172.21.15.60:0/1905220532 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3e8159bf0 con 0x7ff3e80c7230 2024-09-12T02:38:42.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.140+0000 7ff3e7fff640 1 --2- 172.21.15.60:0/1905220532 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3e80c7230 0x7ff3e81562d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4009720 tx=0x7ff3d402a0d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c49b6c545d5f233 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:42.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.140+0000 7ff3e77fe640 1 -- 172.21.15.60:0/1905220532 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d4037070 con 0x7ff3e80c7230 2024-09-12T02:38:42.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.140+0000 7ff3e77fe640 1 -- 172.21.15.60:0/1905220532 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3d402ab60 con 0x7ff3e80c7230 2024-09-12T02:38:42.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.140+0000 7ff3e77fe640 1 -- 172.21.15.60:0/1905220532 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e0001990 con 0x7ff3e80c7230 2024-09-12T02:38:42.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.141+0000 7ff3eeaba640 1 -- 172.21.15.60:0/1905220532 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3e80c7230 msgr2=0x7ff3e81562d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:42.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.141+0000 7ff3eeaba640 1 --2- 172.21.15.60:0/1905220532 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3e80c7230 0x7ff3e81562d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4009720 tx=0x7ff3d402a0d0 comp rx=0 tx=0).stop 2024-09-12T02:38:42.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.141+0000 7ff3eeaba640 1 -- 172.21.15.60:0/1905220532 shutdown_connections 2024-09-12T02:38:42.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.141+0000 7ff3eeaba640 1 --2- 172.21.15.60:0/1905220532 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3e80c7230 0x7ff3e81562d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:42.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.141+0000 7ff3eeaba640 1 -- 172.21.15.60:0/1905220532 >> 172.21.15.60:0/1905220532 conn(0x7ff3e80c7a40 msgr2=0x7ff3e80c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:42.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.141+0000 7ff3eeaba640 1 -- 172.21.15.60:0/1905220532 shutdown_connections 2024-09-12T02:38:42.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.141+0000 7ff3eeaba640 1 -- 172.21.15.60:0/1905220532 wait complete. 2024-09-12T02:38:42.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.143+0000 7ff3eeaba640 1 Processor -- start 2024-09-12T02:38:42.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.143+0000 7ff3eeaba640 1 -- start start 2024-09-12T02:38:42.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.144+0000 7ff3eeaba640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3e806edd0 0x7ff3e80a8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:42.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.144+0000 7ff3eeaba640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3e80c7230 0x7ff3e814a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:42.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.144+0000 7ff3eeaba640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3e814f820 0x7ff3e814e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:42.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.144+0000 7ff3eeaba640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e8152350 con 0x7ff3e806edd0 2024-09-12T02:38:42.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.144+0000 7ff3eeaba640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e80adb30 con 0x7ff3e80c7230 2024-09-12T02:38:42.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.144+0000 7ff3eeaba640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff3e80c48f0 con 0x7ff3e814f820 2024-09-12T02:38:42.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.144+0000 7ff3e7fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3e80c7230 0x7ff3e814a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:42.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.144+0000 7ff3e7fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3e80c7230 0x7ff3e814a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:42636/0 (socket says 172.21.15.60:42636) 2024-09-12T02:38:42.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.144+0000 7ff3e7fff640 1 -- 172.21.15.60:0/2911940807 learned_addr learned my addr 172.21.15.60:0/2911940807 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:38:42.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.144+0000 7ff3ed057640 1 --2- 172.21.15.60:0/2911940807 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3e814f820 0x7ff3e814e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:42.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.145+0000 7ff3ec856640 1 --2- 172.21.15.60:0/2911940807 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3e806edd0 0x7ff3e80a8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:42.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.145+0000 7ff3ed057640 1 -- 172.21.15.60:0/2911940807 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3e814f820 msgr2=0x7ff3e814e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-12T02:38:42.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.145+0000 7ff3ed057640 1 -- 172.21.15.60:0/2911940807 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3e814f820 msgr2=0x7ff3e814e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:38:42.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.145+0000 7ff3ed057640 1 --2- 172.21.15.60:0/2911940807 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3e814f820 0x7ff3e814e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:38:42.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.145+0000 7ff3ed057640 1 --2- 172.21.15.60:0/2911940807 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3e814f820 0x7ff3e814e260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:38:42.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.145+0000 7ff3e7fff640 1 -- 172.21.15.60:0/2911940807 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3e814f820 msgr2=0x7ff3e814e260 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:38:42.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.145+0000 7ff3e7fff640 1 --2- 172.21.15.60:0/2911940807 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3e814f820 0x7ff3e814e260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:42.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.145+0000 7ff3e7fff640 1 -- 172.21.15.60:0/2911940807 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3e806edd0 msgr2=0x7ff3e80a8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:42.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.145+0000 7ff3e7fff640 1 --2- 172.21.15.60:0/2911940807 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3e806edd0 0x7ff3e80a8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:42.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.145+0000 7ff3e7fff640 1 -- 172.21.15.60:0/2911940807 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3e80a89c0 con 0x7ff3e80c7230 2024-09-12T02:38:42.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.145+0000 7ff3e7fff640 1 --2- 172.21.15.60:0/2911940807 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3e80c7230 0x7ff3e814a320 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4009890 tx=0x7ff3d40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:42.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.146+0000 7ff3e57fa640 1 -- 172.21.15.60:0/2911940807 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d4042020 con 0x7ff3e80c7230 2024-09-12T02:38:42.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.146+0000 7ff3eeaba640 1 -- 172.21.15.60:0/2911940807 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3e81e7ba0 con 0x7ff3e80c7230 2024-09-12T02:38:42.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.146+0000 7ff3e57fa640 1 -- 172.21.15.60:0/2911940807 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3d4003a70 con 0x7ff3e80c7230 2024-09-12T02:38:42.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.146+0000 7ff3e57fa640 1 -- 172.21.15.60:0/2911940807 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d4037040 con 0x7ff3e80c7230 2024-09-12T02:38:42.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.146+0000 7ff3eeaba640 1 -- 172.21.15.60:0/2911940807 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3e81e8160 con 0x7ff3e80c7230 2024-09-12T02:38:42.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.147+0000 7ff3eeaba640 1 -- 172.21.15.60:0/2911940807 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3e81562d0 con 0x7ff3e80c7230 2024-09-12T02:38:42.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.148+0000 7ff3e57fa640 1 -- 172.21.15.60:0/2911940807 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff3d4045020 con 0x7ff3e80c7230 2024-09-12T02:38:42.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.148+0000 7ff3e57fa640 1 --2- 172.21.15.60:0/2911940807 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff3cc06be30 0x7ff3cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:42.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.149+0000 7ff3e57fa640 1 -- 172.21.15.60:0/2911940807 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7ff3d40ab5a0 con 0x7ff3e80c7230 2024-09-12T02:38:42.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.149+0000 7ff3ec856640 1 --2- 172.21.15.60:0/2911940807 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff3cc06be30 0x7ff3cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:42.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.150+0000 7ff3ec856640 1 --2- 172.21.15.60:0/2911940807 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff3cc06be30 0x7ff3cc06e2f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc000f60 tx=0x7ff3dc0019a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:42.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.155+0000 7ff3e57fa640 1 -- 172.21.15.60:0/2911940807 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff3d404c030 con 0x7ff3e80c7230 2024-09-12T02:38:42.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.627+0000 7ff3eeaba640 1 -- 172.21.15.60:0/2911940807 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ff3e80a6d40 con 0x7ff3e80c7230 2024-09-12T02:38:42.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.629+0000 7ff3e57fa640 1 -- 172.21.15.60:0/2911940807 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1560 (secure 0 0 0) 0x7ff3d4079cc0 con 0x7ff3e80c7230 2024-09-12T02:38:42.630 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":150,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:38:42.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.632+0000 7ff3eeaba640 1 -- 172.21.15.60:0/2911940807 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff3cc06be30 msgr2=0x7ff3cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:42.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.632+0000 7ff3eeaba640 1 --2- 172.21.15.60:0/2911940807 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff3cc06be30 0x7ff3cc06e2f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc000f60 tx=0x7ff3dc0019a0 comp rx=0 tx=0).stop 2024-09-12T02:38:42.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.632+0000 7ff3eeaba640 1 -- 172.21.15.60:0/2911940807 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3e80c7230 msgr2=0x7ff3e814a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:42.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.632+0000 7ff3eeaba640 1 --2- 172.21.15.60:0/2911940807 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3e80c7230 0x7ff3e814a320 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4009890 tx=0x7ff3d40046c0 comp rx=0 tx=0).stop 2024-09-12T02:38:42.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.632+0000 7ff3eeaba640 1 -- 172.21.15.60:0/2911940807 shutdown_connections 2024-09-12T02:38:42.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.632+0000 7ff3eeaba640 1 --2- 172.21.15.60:0/2911940807 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff3cc06be30 0x7ff3cc06e2f0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:42.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.632+0000 7ff3eeaba640 1 --2- 172.21.15.60:0/2911940807 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3e814f820 0x7ff3e814e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:42.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.632+0000 7ff3eeaba640 1 --2- 172.21.15.60:0/2911940807 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3e80c7230 0x7ff3e814a320 secure :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4009890 tx=0x7ff3d40046c0 comp rx=0 tx=0).stop 2024-09-12T02:38:42.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.632+0000 7ff3eeaba640 1 --2- 172.21.15.60:0/2911940807 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3e806edd0 0x7ff3e80a8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:42.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.632+0000 7ff3eeaba640 1 -- 172.21.15.60:0/2911940807 >> 172.21.15.60:0/2911940807 conn(0x7ff3e80c7a40 msgr2=0x7ff3e80c41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:42.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.633+0000 7ff3eeaba640 1 -- 172.21.15.60:0/2911940807 shutdown_connections 2024-09-12T02:38:42.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:42.633+0000 7ff3eeaba640 1 -- 172.21.15.60:0/2911940807 wait complete. 2024-09-12T02:38:45.651 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:38:45.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.830+0000 7f0d8cb4b640 1 Processor -- start 2024-09-12T02:38:45.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.830+0000 7f0d8cb4b640 1 -- start start 2024-09-12T02:38:45.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.832+0000 7f0d8cb4b640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0d880c2dd0 0x7f0d880c3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:45.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.832+0000 7f0d8cb4b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d880ac020 0x7f0d880c3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:45.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.832+0000 7f0d8cb4b640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d880c3450 con 0x7f0d88073700 2024-09-12T02:38:45.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.832+0000 7f0d8cb4b640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f0d88073ae0 con 0x7f0d880c2dd0 2024-09-12T02:38:45.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.832+0000 7f0d8cb4b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0d880ab410 con 0x7f0d880ac020 2024-09-12T02:38:45.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.832+0000 7f0d8659c640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f0d88073700 0x7f0d880ab910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55334/0 (socket says 172.21.15.60:55334) 2024-09-12T02:38:45.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.832+0000 7f0d8659c640 1 -- 172.21.15.60:0/146880036 learned_addr learned my addr 172.21.15.60:0/146880036 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:38:45.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.832+0000 7f0d86d9d640 1 --2- 172.21.15.60:0/146880036 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d880ac020 0x7f0d880c3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:45.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.832+0000 7f0d86d9d640 1 -- 172.21.15.60:0/146880036 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d880ac020 msgr2=0x7f0d880c3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:38:45.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.832+0000 7f0d86d9d640 1 -- 172.21.15.60:0/146880036 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d880ac020 msgr2=0x7f0d880c3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:38:45.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.832+0000 7f0d86d9d640 1 --2- 172.21.15.60:0/146880036 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d880ac020 0x7f0d880c3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:38:45.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.832+0000 7f0d86d9d640 1 --2- 172.21.15.60:0/146880036 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d880ac020 0x7f0d880c3f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:38:45.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.832+0000 7f0d85d9b640 1 --2- 172.21.15.60:0/146880036 >> v2:172.21.15.105:3300/0 conn(0x7f0d880c2dd0 0x7f0d880c3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:45.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.832+0000 7f0d8559a640 1 -- 172.21.15.60:0/146880036 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2620351450 0 0) 0x7f0d880c3450 con 0x7f0d88073700 2024-09-12T02:38:45.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.832+0000 7f0d8559a640 1 -- 172.21.15.60:0/146880036 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d70003520 con 0x7f0d88073700 2024-09-12T02:38:45.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.833+0000 7f0d85d9b640 1 -- 172.21.15.60:0/146880036 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d880ac020 msgr2=0x7f0d880c3f80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:38:45.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.833+0000 7f0d85d9b640 1 --2- 172.21.15.60:0/146880036 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d880ac020 0x7f0d880c3f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:45.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.833+0000 7f0d85d9b640 1 -- 172.21.15.60:0/146880036 >> v1:172.21.15.60:6789/0 conn(0x7f0d88073700 legacy=0x7f0d880ab910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:45.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.833+0000 7f0d85d9b640 1 -- 172.21.15.60:0/146880036 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d881530b0 con 0x7f0d880c2dd0 2024-09-12T02:38:45.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.834+0000 7f0d85d9b640 1 --2- 172.21.15.60:0/146880036 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d880c2dd0 0x7f0d880c3a40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c00ba40 tx=0x7f0d7c02c720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59ff3b011efa35d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:45.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.834+0000 7f0d8559a640 1 -- 172.21.15.60:0/146880036 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c031710 con 0x7f0d880c2dd0 2024-09-12T02:38:45.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.834+0000 7f0d8559a640 1 -- 172.21.15.60:0/146880036 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d7c0318b0 con 0x7f0d880c2dd0 2024-09-12T02:38:45.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.834+0000 7f0d8559a640 1 -- 172.21.15.60:0/146880036 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c031c80 con 0x7f0d880c2dd0 2024-09-12T02:38:45.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.835+0000 7f0d8cb4b640 1 -- 172.21.15.60:0/146880036 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d880c2dd0 msgr2=0x7f0d880c3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:45.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.835+0000 7f0d8cb4b640 1 --2- 172.21.15.60:0/146880036 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d880c2dd0 0x7f0d880c3a40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c00ba40 tx=0x7f0d7c02c720 comp rx=0 tx=0).stop 2024-09-12T02:38:45.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.835+0000 7f0d8cb4b640 1 -- 172.21.15.60:0/146880036 shutdown_connections 2024-09-12T02:38:45.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.835+0000 7f0d8cb4b640 1 --2- 172.21.15.60:0/146880036 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d880ac020 0x7f0d880c3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:45.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.835+0000 7f0d8cb4b640 1 --2- 172.21.15.60:0/146880036 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d880c2dd0 0x7f0d880c3a40 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:45.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.835+0000 7f0d8cb4b640 1 -- 172.21.15.60:0/146880036 >> 172.21.15.60:0/146880036 conn(0x7f0d880c4c50 msgr2=0x7f0d880c5060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:45.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.835+0000 7f0d8cb4b640 1 -- 172.21.15.60:0/146880036 shutdown_connections 2024-09-12T02:38:45.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.835+0000 7f0d8cb4b640 1 -- 172.21.15.60:0/146880036 wait complete. 2024-09-12T02:38:45.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.837+0000 7f0d8cb4b640 1 Processor -- start 2024-09-12T02:38:45.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.837+0000 7f0d8cb4b640 1 -- start start 2024-09-12T02:38:45.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.838+0000 7f0d8cb4b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d88073700 0x7f0d880c1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:45.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.838+0000 7f0d8cb4b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d880ac020 0x7f0d881515c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:45.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.838+0000 7f0d8cb4b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d880c2dd0 0x7f0d881549f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:45.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.838+0000 7f0d8cb4b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8806e020 con 0x7f0d880ac020 2024-09-12T02:38:45.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.839+0000 7f0d8cb4b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8806dea0 con 0x7f0d88073700 2024-09-12T02:38:45.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.839+0000 7f0d8cb4b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0d880695d0 con 0x7f0d880c2dd0 2024-09-12T02:38:45.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.839+0000 7f0d85d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d880ac020 0x7f0d881515c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:45.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.839+0000 7f0d85d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d880ac020 0x7f0d881515c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45256/0 (socket says 172.21.15.60:45256) 2024-09-12T02:38:45.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.839+0000 7f0d85d9b640 1 -- 172.21.15.60:0/2941504694 learned_addr learned my addr 172.21.15.60:0/2941504694 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:38:45.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.839+0000 7f0d86d9d640 1 --2- 172.21.15.60:0/2941504694 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d880c2dd0 0x7f0d881549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:45.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.839+0000 7f0d8659c640 1 --2- 172.21.15.60:0/2941504694 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d88073700 0x7f0d880c1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:45.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.839+0000 7f0d86d9d640 1 -- 172.21.15.60:0/2941504694 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d880c2dd0 msgr2=0x7f0d881549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-12T02:38:45.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.839+0000 7f0d86d9d640 1 -- 172.21.15.60:0/2941504694 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d880c2dd0 msgr2=0x7f0d881549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:38:45.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.839+0000 7f0d86d9d640 1 --2- 172.21.15.60:0/2941504694 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d880c2dd0 0x7f0d881549f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:38:45.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.839+0000 7f0d86d9d640 1 --2- 172.21.15.60:0/2941504694 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d880c2dd0 0x7f0d881549f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:38:45.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.839+0000 7f0d8659c640 1 -- 172.21.15.60:0/2941504694 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d880c2dd0 msgr2=0x7f0d881549f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:38:45.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.839+0000 7f0d8659c640 1 --2- 172.21.15.60:0/2941504694 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d880c2dd0 0x7f0d881549f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:45.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.839+0000 7f0d8659c640 1 -- 172.21.15.60:0/2941504694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d880ac020 msgr2=0x7f0d881515c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:45.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.839+0000 7f0d8659c640 1 --2- 172.21.15.60:0/2941504694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d880ac020 0x7f0d881515c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:45.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.839+0000 7f0d8659c640 1 -- 172.21.15.60:0/2941504694 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d880bdfc0 con 0x7f0d88073700 2024-09-12T02:38:45.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.840+0000 7f0d8659c640 1 --2- 172.21.15.60:0/2941504694 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d88073700 0x7f0d880c1d50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0d7800c430 tx=0x7f0d7800c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:45.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.840+0000 7f0d76ffd640 1 -- 172.21.15.60:0/2941504694 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d78017070 con 0x7f0d88073700 2024-09-12T02:38:45.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.840+0000 7f0d76ffd640 1 -- 172.21.15.60:0/2941504694 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d78005ce0 con 0x7f0d88073700 2024-09-12T02:38:45.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.840+0000 7f0d76ffd640 1 -- 172.21.15.60:0/2941504694 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d780072f0 con 0x7f0d88073700 2024-09-12T02:38:45.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.842+0000 7f0d8cb4b640 1 -- 172.21.15.60:0/2941504694 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d880bd3a0 con 0x7f0d88073700 2024-09-12T02:38:45.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.842+0000 7f0d8cb4b640 1 -- 172.21.15.60:0/2941504694 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d88151b00 con 0x7f0d88073700 2024-09-12T02:38:45.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.843+0000 7f0d8cb4b640 1 -- 172.21.15.60:0/2941504694 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d880ab910 con 0x7f0d88073700 2024-09-12T02:38:45.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.844+0000 7f0d76ffd640 1 -- 172.21.15.60:0/2941504694 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0d7801a070 con 0x7f0d88073700 2024-09-12T02:38:45.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.845+0000 7f0d76ffd640 1 --2- 172.21.15.60:0/2941504694 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0d6806be30 0x7f0d6806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:45.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.845+0000 7f0d76ffd640 1 -- 172.21.15.60:0/2941504694 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f0d7808a520 con 0x7f0d88073700 2024-09-12T02:38:45.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.846+0000 7f0d85d9b640 1 --2- 172.21.15.60:0/2941504694 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0d6806be30 0x7f0d6806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:45.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.846+0000 7f0d85d9b640 1 --2- 172.21.15.60:0/2941504694 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0d6806be30 0x7f0d6806e2f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f0d881ee170 tx=0x7f0d7c035040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:45.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:45.851+0000 7f0d76ffd640 1 -- 172.21.15.60:0/2941504694 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0d780584d0 con 0x7f0d88073700 2024-09-12T02:38:46.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:46.312+0000 7f0d8cb4b640 1 -- 172.21.15.60:0/2941504694 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f0d880741d0 con 0x7f0d88073700 2024-09-12T02:38:46.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:46.312+0000 7f0d76ffd640 1 -- 172.21.15.60:0/2941504694 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1560 (secure 0 0 0) 0x7f0d7805c7d0 con 0x7f0d88073700 2024-09-12T02:38:46.313 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":150,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":25,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:38:46.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:46.316+0000 7f0d8cb4b640 1 -- 172.21.15.60:0/2941504694 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0d6806be30 msgr2=0x7f0d6806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:46.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:46.316+0000 7f0d8cb4b640 1 --2- 172.21.15.60:0/2941504694 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0d6806be30 0x7f0d6806e2f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f0d881ee170 tx=0x7f0d7c035040 comp rx=0 tx=0).stop 2024-09-12T02:38:46.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:46.316+0000 7f0d8cb4b640 1 -- 172.21.15.60:0/2941504694 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d88073700 msgr2=0x7f0d880c1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:46.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:46.316+0000 7f0d8cb4b640 1 --2- 172.21.15.60:0/2941504694 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d88073700 0x7f0d880c1d50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0d7800c430 tx=0x7f0d7800c8f0 comp rx=0 tx=0).stop 2024-09-12T02:38:46.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:46.316+0000 7f0d8cb4b640 1 -- 172.21.15.60:0/2941504694 shutdown_connections 2024-09-12T02:38:46.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:46.316+0000 7f0d8cb4b640 1 --2- 172.21.15.60:0/2941504694 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f0d6806be30 0x7f0d6806e2f0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:46.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:46.316+0000 7f0d8cb4b640 1 --2- 172.21.15.60:0/2941504694 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d880c2dd0 0x7f0d881549f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:46.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:46.316+0000 7f0d8cb4b640 1 --2- 172.21.15.60:0/2941504694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d880ac020 0x7f0d881515c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:46.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:46.316+0000 7f0d8cb4b640 1 --2- 172.21.15.60:0/2941504694 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d88073700 0x7f0d880c1d50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:46.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:46.316+0000 7f0d8cb4b640 1 -- 172.21.15.60:0/2941504694 >> 172.21.15.60:0/2941504694 conn(0x7f0d880c4c50 msgr2=0x7f0d8806ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:46.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:46.317+0000 7f0d8cb4b640 1 -- 172.21.15.60:0/2941504694 shutdown_connections 2024-09-12T02:38:46.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:46.317+0000 7f0d8cb4b640 1 -- 172.21.15.60:0/2941504694 wait complete. 2024-09-12T02:38:49.336 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:38:49.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.507+0000 7f3b8f594640 1 Processor -- start 2024-09-12T02:38:49.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.507+0000 7f3b8f594640 1 -- start start 2024-09-12T02:38:49.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.509+0000 7f3b8f594640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3b8004dc60 0x7f3b80005d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:49.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.509+0000 7f3b8f594640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3b80049fc0 0x7f3b8004a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:49.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.509+0000 7f3b8f594640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b800da8c0 con 0x7f3b800d7890 2024-09-12T02:38:49.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.509+0000 7f3b8f594640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f3b800daba0 con 0x7f3b8004dc60 2024-09-12T02:38:49.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.509+0000 7f3b8f594640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f3b8004e330 con 0x7f3b80049fc0 2024-09-12T02:38:49.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.509+0000 7f3b8dd91640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3b8004dc60 0x7f3b80005d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:49.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.509+0000 7f3b8dd91640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3b8004dc60 0x7f3b80005d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35036/0 (socket says 172.21.15.60:35036) 2024-09-12T02:38:49.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.509+0000 7f3b8dd91640 1 -- 172.21.15.60:0/407475004 learned_addr learned my addr 172.21.15.60:0/407475004 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:38:49.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.509+0000 7f3b8ed93640 1 --2- 172.21.15.60:0/407475004 >> v2:172.21.15.105:3300/0 conn(0x7f3b80049fc0 0x7f3b8004a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:49.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.510+0000 7f3b8dd91640 1 -- 172.21.15.60:0/407475004 >> v2:172.21.15.105:3300/0 conn(0x7f3b80049fc0 msgr2=0x7f3b8004a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:49.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.510+0000 7f3b8dd91640 1 --2- 172.21.15.60:0/407475004 >> v2:172.21.15.105:3300/0 conn(0x7f3b80049fc0 0x7f3b8004a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:49.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.510+0000 7f3b8d590640 1 -- 172.21.15.60:0/407475004 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3066010652 0 0) 0x7f3b800da8c0 con 0x7f3b800d7890 2024-09-12T02:38:49.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.510+0000 7f3b8dd91640 1 -- 172.21.15.60:0/407475004 >> v1:172.21.15.105:6789/0 conn(0x7f3b800d7890 legacy=0x7f3b8004ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:49.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.510+0000 7f3b8dd91640 1 -- 172.21.15.60:0/407475004 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b8004e610 con 0x7f3b8004dc60 2024-09-12T02:38:49.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.511+0000 7f3b8dd91640 1 --2- 172.21.15.60:0/407475004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b8004dc60 0x7f3b80005d30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3b8806b300 tx=0x7f3b880a6c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a50841b2ee153a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:49.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.512+0000 7f3b8d590640 1 -- 172.21.15.60:0/407475004 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b880b4070 con 0x7f3b8004dc60 2024-09-12T02:38:49.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.512+0000 7f3b8d590640 1 -- 172.21.15.60:0/407475004 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b880a7a30 con 0x7f3b8004dc60 2024-09-12T02:38:49.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.512+0000 7f3b8d590640 1 -- 172.21.15.60:0/407475004 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b880af440 con 0x7f3b8004dc60 2024-09-12T02:38:49.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.515+0000 7f3b8f594640 1 -- 172.21.15.60:0/407475004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b8004dc60 msgr2=0x7f3b80005d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:49.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.515+0000 7f3b8f594640 1 --2- 172.21.15.60:0/407475004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b8004dc60 0x7f3b80005d30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3b8806b300 tx=0x7f3b880a6c20 comp rx=0 tx=0).stop 2024-09-12T02:38:49.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.515+0000 7f3b8f594640 1 -- 172.21.15.60:0/407475004 shutdown_connections 2024-09-12T02:38:49.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.515+0000 7f3b8f594640 1 --2- 172.21.15.60:0/407475004 >> v2:172.21.15.105:3300/0 conn(0x7f3b80049fc0 0x7f3b8004a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:49.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.515+0000 7f3b8f594640 1 --2- 172.21.15.60:0/407475004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b8004dc60 0x7f3b80005d30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:49.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.515+0000 7f3b8f594640 1 -- 172.21.15.60:0/407475004 >> 172.21.15.60:0/407475004 conn(0x7f3b8004c0c0 msgr2=0x7f3b8004c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:49.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.515+0000 7f3b8f594640 1 -- 172.21.15.60:0/407475004 shutdown_connections 2024-09-12T02:38:49.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.515+0000 7f3b8f594640 1 -- 172.21.15.60:0/407475004 wait complete. 2024-09-12T02:38:49.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.517+0000 7f3b8f594640 1 Processor -- start 2024-09-12T02:38:49.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.517+0000 7f3b8f594640 1 -- start start 2024-09-12T02:38:49.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.518+0000 7f3b8f594640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b80049fc0 0x7f3b80048360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:49.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.518+0000 7f3b8f594640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b800d7890 0x7f3b8000ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:49.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.518+0000 7f3b8f594640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b800d9b60 0x7f3b80172ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:49.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.518+0000 7f3b8f594640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3b80042df0 con 0x7f3b80049fc0 2024-09-12T02:38:49.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.518+0000 7f3b8f594640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8004a950 con 0x7f3b800d9b60 2024-09-12T02:38:49.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.518+0000 7f3b8f594640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3b80042f70 con 0x7f3b800d7890 2024-09-12T02:38:49.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.518+0000 7f3b8dd91640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b800d7890 0x7f3b8000ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:49.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.518+0000 7f3b8dd91640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b800d7890 0x7f3b8000ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:53348/0 (socket says 172.21.15.60:53348) 2024-09-12T02:38:49.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.518+0000 7f3b8dd91640 1 -- 172.21.15.60:0/3043041213 learned_addr learned my addr 172.21.15.60:0/3043041213 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:38:49.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.519+0000 7f3b8e592640 1 --2- 172.21.15.60:0/3043041213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b80049fc0 0x7f3b80048360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:49.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.519+0000 7f3b8e592640 1 -- 172.21.15.60:0/3043041213 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b800d7890 msgr2=0x7f3b8000ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:49.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.519+0000 7f3b8e592640 1 --2- 172.21.15.60:0/3043041213 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b800d7890 0x7f3b8000ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:49.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.519+0000 7f3b8e592640 1 -- 172.21.15.60:0/3043041213 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b800d9b60 msgr2=0x7f3b80172ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:38:49.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.519+0000 7f3b8e592640 1 --2- 172.21.15.60:0/3043041213 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b800d9b60 0x7f3b80172ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:49.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.519+0000 7f3b8e592640 1 -- 172.21.15.60:0/3043041213 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b80046840 con 0x7f3b80049fc0 2024-09-12T02:38:49.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.520+0000 7f3b8e592640 1 --2- 172.21.15.60:0/3043041213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b80049fc0 0x7f3b80048360 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3b8400c3e0 tx=0x7f3b8400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:49.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.521+0000 7f3b7effd640 1 -- 172.21.15.60:0/3043041213 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b84017070 con 0x7f3b80049fc0 2024-09-12T02:38:49.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.521+0000 7f3b7effd640 1 -- 172.21.15.60:0/3043041213 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b840035f0 con 0x7f3b80049fc0 2024-09-12T02:38:49.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.521+0000 7f3b7effd640 1 -- 172.21.15.60:0/3043041213 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b840039e0 con 0x7f3b80049fc0 2024-09-12T02:38:49.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.521+0000 7f3b8f594640 1 -- 172.21.15.60:0/3043041213 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b80047810 con 0x7f3b80049fc0 2024-09-12T02:38:49.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.521+0000 7f3b8f594640 1 -- 172.21.15.60:0/3043041213 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b8000f4e0 con 0x7f3b80049fc0 2024-09-12T02:38:49.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.522+0000 7f3b8f594640 1 -- 172.21.15.60:0/3043041213 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b80047600 con 0x7f3b80049fc0 2024-09-12T02:38:49.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.524+0000 7f3b7effd640 1 -- 172.21.15.60:0/3043041213 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3b8401a070 con 0x7f3b80049fc0 2024-09-12T02:38:49.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.525+0000 7f3b7effd640 1 --2- 172.21.15.60:0/3043041213 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3b6c06bf00 0x7f3b6c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:49.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.525+0000 7f3b7effd640 1 -- 172.21.15.60:0/3043041213 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f3b8408a8f0 con 0x7f3b80049fc0 2024-09-12T02:38:49.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.525+0000 7f3b8dd91640 1 --2- 172.21.15.60:0/3043041213 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3b6c06bf00 0x7f3b6c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:49.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.526+0000 7f3b8dd91640 1 --2- 172.21.15.60:0/3043041213 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3b6c06bf00 0x7f3b6c06e3c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3b8806b8c0 tx=0x7f3b880ab000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:49.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:49.531+0000 7f3b7effd640 1 -- 172.21.15.60:0/3043041213 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3b84021020 con 0x7f3b80049fc0 2024-09-12T02:38:50.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.005+0000 7f3b8f594640 1 -- 172.21.15.60:0/3043041213 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3b8004a410 con 0x7f3b80049fc0 2024-09-12T02:38:50.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.005+0000 7f3b7effd640 1 -- 172.21.15.60:0/3043041213 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f3b84058920 con 0x7f3b80049fc0 2024-09-12T02:38:50.006 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":152,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:38:50.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.010+0000 7f3b8f594640 1 -- 172.21.15.60:0/3043041213 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3b6c06bf00 msgr2=0x7f3b6c06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:50.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.010+0000 7f3b8f594640 1 --2- 172.21.15.60:0/3043041213 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3b6c06bf00 0x7f3b6c06e3c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3b8806b8c0 tx=0x7f3b880ab000 comp rx=0 tx=0).stop 2024-09-12T02:38:50.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.010+0000 7f3b8f594640 1 -- 172.21.15.60:0/3043041213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b80049fc0 msgr2=0x7f3b80048360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:50.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.010+0000 7f3b8f594640 1 --2- 172.21.15.60:0/3043041213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b80049fc0 0x7f3b80048360 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3b8400c3e0 tx=0x7f3b8400c8a0 comp rx=0 tx=0).stop 2024-09-12T02:38:50.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.010+0000 7f3b8f594640 1 -- 172.21.15.60:0/3043041213 shutdown_connections 2024-09-12T02:38:50.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.010+0000 7f3b8f594640 1 --2- 172.21.15.60:0/3043041213 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3b6c06bf00 0x7f3b6c06e3c0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:50.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.010+0000 7f3b8f594640 1 --2- 172.21.15.60:0/3043041213 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b800d9b60 0x7f3b80172ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:50.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.010+0000 7f3b8f594640 1 --2- 172.21.15.60:0/3043041213 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b800d7890 0x7f3b8000ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:50.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.010+0000 7f3b8f594640 1 --2- 172.21.15.60:0/3043041213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b80049fc0 0x7f3b80048360 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:50.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.010+0000 7f3b8f594640 1 -- 172.21.15.60:0/3043041213 >> 172.21.15.60:0/3043041213 conn(0x7f3b8004c0c0 msgr2=0x7f3b800d0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:50.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.010+0000 7f3b8f594640 1 -- 172.21.15.60:0/3043041213 shutdown_connections 2024-09-12T02:38:50.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.010+0000 7f3b8f594640 1 -- 172.21.15.60:0/3043041213 wait complete. 2024-09-12T02:38:50.028 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-12T02:38:50.028 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-12T02:38:50.028 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-12T02:38:50.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.195+0000 7fe920e9b640 1 Processor -- start 2024-09-12T02:38:50.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.195+0000 7fe920e9b640 1 -- start start 2024-09-12T02:38:50.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.197+0000 7fe920e9b640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe91c0c55f0 0x7fe91c0ac470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:50.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.197+0000 7fe920e9b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe91c0c59d0 0x7fe91c157c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:50.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.197+0000 7fe920e9b640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe91c0c3e60 con 0x7fe91c0addf0 2024-09-12T02:38:50.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.197+0000 7fe920e9b640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fe91c0c8580 con 0x7fe91c0c55f0 2024-09-12T02:38:50.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.197+0000 7fe920e9b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe91c0c4120 con 0x7fe91c0c59d0 2024-09-12T02:38:50.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.197+0000 7fe91a59c640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe91c0c55f0 0x7fe91c0ac470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:50.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.197+0000 7fe91a59c640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe91c0c55f0 0x7fe91c0ac470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:53494/0 (socket says 172.21.15.60:53494) 2024-09-12T02:38:50.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.197+0000 7fe91a59c640 1 -- 172.21.15.60:0/1981340040 learned_addr learned my addr 172.21.15.60:0/1981340040 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:38:50.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.197+0000 7fe91ad9d640 1 --2- 172.21.15.60:0/1981340040 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe91c0c59d0 0x7fe91c157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:50.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.198+0000 7fe91a59c640 1 -- 172.21.15.60:0/1981340040 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe91c0c59d0 msgr2=0x7fe91c157c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:50.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.198+0000 7fe91a59c640 1 --2- 172.21.15.60:0/1981340040 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe91c0c59d0 0x7fe91c157c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:50.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.198+0000 7fe91a59c640 1 -- 172.21.15.60:0/1981340040 >> v1:172.21.15.105:6789/0 conn(0x7fe91c0addf0 legacy=0x7fe91c0ac9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:50.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.198+0000 7fe91a59c640 1 -- 172.21.15.60:0/1981340040 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe91c0c4400 con 0x7fe91c0c55f0 2024-09-12T02:38:50.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.199+0000 7fe91a59c640 1 --2- 172.21.15.60:0/1981340040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe91c0c55f0 0x7fe91c0ac470 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe90c009870 tx=0x7fe90c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99b68f455a1863ce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:50.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.199+0000 7fe91959a640 1 -- 172.21.15.60:0/1981340040 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe90c037070 con 0x7fe91c0c55f0 2024-09-12T02:38:50.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.199+0000 7fe91959a640 1 -- 172.21.15.60:0/1981340040 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe90c032440 con 0x7fe91c0c55f0 2024-09-12T02:38:50.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.199+0000 7fe91959a640 1 -- 172.21.15.60:0/1981340040 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe90c032810 con 0x7fe91c0c55f0 2024-09-12T02:38:50.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.200+0000 7fe920e9b640 1 -- 172.21.15.60:0/1981340040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe91c0c55f0 msgr2=0x7fe91c0ac470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:50.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.200+0000 7fe920e9b640 1 --2- 172.21.15.60:0/1981340040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe91c0c55f0 0x7fe91c0ac470 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe90c009870 tx=0x7fe90c02a180 comp rx=0 tx=0).stop 2024-09-12T02:38:50.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.201+0000 7fe920e9b640 1 -- 172.21.15.60:0/1981340040 shutdown_connections 2024-09-12T02:38:50.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.201+0000 7fe920e9b640 1 --2- 172.21.15.60:0/1981340040 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe91c0c59d0 0x7fe91c157c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:50.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.201+0000 7fe920e9b640 1 --2- 172.21.15.60:0/1981340040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe91c0c55f0 0x7fe91c0ac470 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:50.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.201+0000 7fe920e9b640 1 -- 172.21.15.60:0/1981340040 >> 172.21.15.60:0/1981340040 conn(0x7fe91c0c8a50 msgr2=0x7fe91c0c8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:50.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.201+0000 7fe920e9b640 1 -- 172.21.15.60:0/1981340040 shutdown_connections 2024-09-12T02:38:50.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.201+0000 7fe920e9b640 1 -- 172.21.15.60:0/1981340040 wait complete. 2024-09-12T02:38:50.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.203+0000 7fe920e9b640 1 Processor -- start 2024-09-12T02:38:50.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.204+0000 7fe920e9b640 1 -- start start 2024-09-12T02:38:50.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.205+0000 7fe920e9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe91c0addf0 0x7fe91c1eba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:50.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.205+0000 7fe920e9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe91c0c55f0 0x7fe91c150fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:50.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.205+0000 7fe91a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe91c0addf0 0x7fe91c1eba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:50.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.205+0000 7fe91a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe91c0addf0 0x7fe91c1eba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35060/0 (socket says 172.21.15.60:35060) 2024-09-12T02:38:50.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.206+0000 7fe920e9b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe91c0c59d0 0x7fe91c154190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:50.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.206+0000 7fe920e9b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe91c0c35d0 con 0x7fe91c0addf0 2024-09-12T02:38:50.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.206+0000 7fe91a59c640 1 -- 172.21.15.60:0/27665533 learned_addr learned my addr 172.21.15.60:0/27665533 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:38:50.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.206+0000 7fe920e9b640 1 -- 172.21.15.60:0/27665533 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe91c0c3450 con 0x7fe91c0c55f0 2024-09-12T02:38:50.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.206+0000 7fe920e9b640 1 -- 172.21.15.60:0/27665533 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe91c0abb00 con 0x7fe91c0c59d0 2024-09-12T02:38:50.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.206+0000 7fe919d9b640 1 --2- 172.21.15.60:0/27665533 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe91c0c55f0 0x7fe91c150fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:50.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.207+0000 7fe91a59c640 1 -- 172.21.15.60:0/27665533 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe91c0c59d0 msgr2=0x7fe91c154190 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:38:50.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.207+0000 7fe91a59c640 1 --2- 172.21.15.60:0/27665533 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe91c0c59d0 0x7fe91c154190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:50.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.207+0000 7fe91a59c640 1 -- 172.21.15.60:0/27665533 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe91c0c55f0 msgr2=0x7fe91c150fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:50.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.207+0000 7fe91a59c640 1 --2- 172.21.15.60:0/27665533 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe91c0c55f0 0x7fe91c150fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:50.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.207+0000 7fe91a59c640 1 -- 172.21.15.60:0/27665533 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe91c156e60 con 0x7fe91c0addf0 2024-09-12T02:38:50.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.207+0000 7fe919d9b640 1 --2- 172.21.15.60:0/27665533 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe91c0c55f0 0x7fe91c150fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:38:50.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.207+0000 7fe91a59c640 1 --2- 172.21.15.60:0/27665533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe91c0addf0 0x7fe91c1eba60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe90c009870 tx=0x7fe90c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:50.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.208+0000 7fe90affd640 1 -- 172.21.15.60:0/27665533 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe90c041070 con 0x7fe91c0addf0 2024-09-12T02:38:50.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.208+0000 7fe90affd640 1 -- 172.21.15.60:0/27665533 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe90c03c870 con 0x7fe91c0addf0 2024-09-12T02:38:50.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.208+0000 7fe90affd640 1 -- 172.21.15.60:0/27665533 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe90c037040 con 0x7fe91c0addf0 2024-09-12T02:38:50.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.208+0000 7fe920e9b640 1 -- 172.21.15.60:0/27665533 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe91c1533d0 con 0x7fe91c0addf0 2024-09-12T02:38:50.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.209+0000 7fe920e9b640 1 -- 172.21.15.60:0/27665533 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe91c153990 con 0x7fe91c0addf0 2024-09-12T02:38:50.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.210+0000 7fe920e9b640 1 --2- 172.21.15.60:0/27665533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe91c0a94a0 0x7fe91c1546d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:50.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.211+0000 7fe920e9b640 1 -- 172.21.15.60:0/27665533 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe91c069a00 con 0x7fe91c0a94a0 2024-09-12T02:38:50.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.211+0000 7fe919d9b640 1 --2- 172.21.15.60:0/27665533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe91c0a94a0 0x7fe91c1546d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:50.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.211+0000 7fe919d9b640 1 -- 172.21.15.60:0/27665533 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe91c153180 con 0x7fe91c0a94a0 2024-09-12T02:38:50.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.211+0000 7fe919d9b640 1 --2- 172.21.15.60:0/27665533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe91c0a94a0 0x7fe91c1546d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe91c151d80 tx=0x7fe91000e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:50.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.212+0000 7fe90affd640 1 -- 172.21.15.60:0/27665533 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe90c044070 con 0x7fe91c0addf0 2024-09-12T02:38:50.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.212+0000 7fe90affd640 1 --2- 172.21.15.60:0/27665533 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe8fc06be80 0x7fe8fc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:50.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.212+0000 7fe90affd640 1 -- 172.21.15.60:0/27665533 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fe90c0aba40 con 0x7fe91c0addf0 2024-09-12T02:38:50.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.212+0000 7fe90affd640 1 -- 172.21.15.60:0/27665533 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe910007020 con 0x7fe91c0a94a0 2024-09-12T02:38:50.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.213+0000 7fe90affd640 1 -- 172.21.15.60:0/27665533 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fe9100071c0 con 0x7fe91c0a94a0 2024-09-12T02:38:50.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.213+0000 7fe90affd640 1 -- 172.21.15.60:0/27665533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe91c0a94a0 msgr2=0x7fe91c1546d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:50.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.213+0000 7fe90affd640 1 --2- 172.21.15.60:0/27665533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe91c0a94a0 0x7fe91c1546d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe91c151d80 tx=0x7fe91000e960 comp rx=0 tx=0).stop 2024-09-12T02:38:50.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.213+0000 7fe90affd640 1 -- 172.21.15.60:0/27665533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe91c0a94a0 msgr2=0x7fe91c1546d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:38:50.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.213+0000 7fe90affd640 1 --2- 172.21.15.60:0/27665533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe91c0a94a0 0x7fe91c1546d0 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe91c151d80 tx=0x7fe91000e960 comp rx=0 tx=0).stop 2024-09-12T02:38:50.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.213+0000 7fe91ad9d640 1 --2- 172.21.15.60:0/27665533 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe8fc06be80 0x7fe8fc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:50.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.213+0000 7fe91ad9d640 1 --2- 172.21.15.60:0/27665533 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe8fc06be80 0x7fe8fc06e340 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe91c0c5e20 tx=0x7fe91400b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:50.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.231+0000 7fe920e9b640 1 --2- 172.21.15.60:0/27665533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe91c154e70 0x7fe91c1e4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:50.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.232+0000 7fe920e9b640 1 -- 172.21.15.60:0/27665533 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe91c153ce0 con 0x7fe91c154e70 2024-09-12T02:38:50.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.232+0000 7fe919d9b640 1 --2- 172.21.15.60:0/27665533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe91c154e70 0x7fe91c1e4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:50.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.232+0000 7fe919d9b640 1 -- 172.21.15.60:0/27665533 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe91c152d50 con 0x7fe91c154e70 2024-09-12T02:38:50.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.233+0000 7fe919d9b640 1 --2- 172.21.15.60:0/27665533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe91c154e70 0x7fe91c1e4ca0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe910018000 tx=0x7fe910003760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:50.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.233+0000 7fe90affd640 1 -- 172.21.15.60:0/27665533 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe910006e20 con 0x7fe91c154e70 2024-09-12T02:38:50.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.234+0000 7fe90affd640 1 -- 172.21.15.60:0/27665533 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5052 (secure 0 0 0) 0x7fe910006e20 con 0x7fe91c154e70 2024-09-12T02:38:50.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.234+0000 7fe90affd640 1 -- 172.21.15.60:0/27665533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe91c154e70 msgr2=0x7fe91c1e4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:50.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.234+0000 7fe90affd640 1 --2- 172.21.15.60:0/27665533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe91c154e70 0x7fe91c1e4ca0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe910018000 tx=0x7fe910003760 comp rx=0 tx=0).stop 2024-09-12T02:38:50.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.234+0000 7fe90affd640 1 -- 172.21.15.60:0/27665533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe91c154e70 msgr2=0x7fe91c1e4ca0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:38:50.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.234+0000 7fe90affd640 1 --2- 172.21.15.60:0/27665533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe91c154e70 0x7fe91c1e4ca0 secure :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe910018000 tx=0x7fe910003760 comp rx=0 tx=0).stop 2024-09-12T02:38:50.235 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:38:50.235 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:38:50.235 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:38:50.235 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:38:50.235 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 152, 2024-09-12T02:38:50.236 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 70007, 2024-09-12T02:38:50.236 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:38:50.236 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:38:50.236 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:38:50.236 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:38:50.236 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:50.236 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-09-12T02:38:50.236 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:38:50.236 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:38:50.236 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:38:50.236 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:38:50.236 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:38:50.237 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:38:50.237 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:38:50.237 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:38:50.237 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:38:50.237 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:38:50.237 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:38:50.237 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:38:50.237 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:38:50.237 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:38:50.237 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:50.237 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:38:50.237 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:38:50.237 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:38:50.238 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:38:50.238 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:38:50.238 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:38:50.238 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:38:50.238 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:38:50.238 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:38:50.238 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:38:50.238 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:38:50.238 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:38:50.238 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:38:50.238 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:50.238 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:50.238 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:38:50.238 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:38:50.239 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:38:50.239 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:38:50.239 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:38:50.239 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:38:50.239 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:38:50.239 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:38:50.239 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:38:50.239 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:38:50.239 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:38:50.239 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:38:50.239 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:38:50.239 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:38:50.240 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:38:50.240 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:38:50.240 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:38:50.240 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:38:50.240 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:38:50.240 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:38:50.240 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:38:50.240 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:38:50.240 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:38:50.240 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:38:50.240 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:38:50.240 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:38:50.240 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:38:50.241 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:38:50.241 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:50.241 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:38:50.241 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:50.241 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:38:50.241 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:50.241 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:38:50.241 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:38:50.241 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:38:50.241 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:38:50.241 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:50.241 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:38:50.241 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:38:50.242 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:50.242 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:50.242 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:50.242 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:38:50.242 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:38:50.242 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:50.242 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:50.242 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:50.242 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:50.242 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:38:50.242 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:38:50.242 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:38:50.242 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:38:50.243 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:38:50.243 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:50.243 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:50.243 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:38:50.243 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:38:50.243 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:38:50.243 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:38:50.243 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:50.243 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:38:50.243 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:38:50.243 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:50.243 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:50.243 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:50.244 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:38:50.244 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:38:50.244 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:50.244 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:50.244 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:50.244 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:50.244 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:38:50.244 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:38:50.244 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:38:50.244 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:38:50.244 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:38:50.244 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:50.244 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:50.245 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:38:50.245 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:38:50.245 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:38:50.245 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:38:50.245 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:50.245 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:38:50.245 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:38:50.246 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:50.246 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:50.246 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:50.246 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:38:50.246 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:38:50.246 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:50.246 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:50.246 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:50.246 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:50.246 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:38:50.246 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:38:50.246 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:38:50.246 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:38:50.247 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:38:50.247 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:50.247 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:50.247 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:50.247 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:38:50.247 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:38:50.247 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:50.247 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:38:50.247 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:38:50.247 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:38:50.247 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:50.247 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:50.247 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:38:50.248 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:50.248 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:38:50.248 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:38:50.248 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:38:50.248 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:50.248 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:50.248 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:38:50.248 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:50.248 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:38:50.248 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:38:50.248 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:38:50.248 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:50.248 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:50.249 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:38:50.249 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:50.249 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:38:50.249 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:38:50.249 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-09-12T02:38:50.249 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:50.249 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:50.249 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:38:50.249 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:50.249 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:38:50.249 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:38:50.249 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:38:50.250 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:50.250 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:50.250 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:50.250 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:38:50.250 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:38:50.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.234+0000 7fe920e9b640 1 -- 172.21.15.60:0/27665533 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe8fc06be80 msgr2=0x7fe8fc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:50.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.234+0000 7fe920e9b640 1 --2- 172.21.15.60:0/27665533 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe8fc06be80 0x7fe8fc06e340 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe91c0c5e20 tx=0x7fe91400b040 comp rx=0 tx=0).stop 2024-09-12T02:38:50.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.234+0000 7fe91ad9d640 1 -- 172.21.15.60:0/27665533 reap_dead start 2024-09-12T02:38:50.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.234+0000 7fe920e9b640 1 -- 172.21.15.60:0/27665533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe91c0addf0 msgr2=0x7fe91c1eba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:50.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.234+0000 7fe920e9b640 1 --2- 172.21.15.60:0/27665533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe91c0addf0 0x7fe91c1eba60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe90c009870 tx=0x7fe90c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:38:50.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.235+0000 7fe920e9b640 1 -- 172.21.15.60:0/27665533 shutdown_connections 2024-09-12T02:38:50.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.235+0000 7fe920e9b640 1 --2- 172.21.15.60:0/27665533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe91c0addf0 0x7fe91c1eba60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:50.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.235+0000 7fe920e9b640 1 -- 172.21.15.60:0/27665533 >> 172.21.15.60:0/27665533 conn(0x7fe91c0c8a50 msgr2=0x7fe91c152640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:50.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.235+0000 7fe920e9b640 1 -- 172.21.15.60:0/27665533 shutdown_connections 2024-09-12T02:38:50.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.235+0000 7fe920e9b640 1 -- 172.21.15.60:0/27665533 wait complete. 2024-09-12T02:38:50.252 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:38:50.252 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-12T02:38:50.252 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-12T02:38:50.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.418+0000 7f3835544640 1 Processor -- start 2024-09-12T02:38:50.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.418+0000 7f3835544640 1 -- start start 2024-09-12T02:38:50.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.419+0000 7f3835544640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f38280d1a60 0x7f3828049eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:50.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.419+0000 7f3835544640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3828040b30 0x7f382800c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:50.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.419+0000 7f3835544640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3828048030 con 0x7f382804a3f0 2024-09-12T02:38:50.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.420+0000 7f3835544640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f382804b3a0 con 0x7f3828040b30 2024-09-12T02:38:50.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.420+0000 7f3835544640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f382800be90 con 0x7f38280d1a60 2024-09-12T02:38:50.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.420+0000 7f3834d43640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f382804a3f0 0x7f382800c860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:57280/0 (socket says 172.21.15.60:57280) 2024-09-12T02:38:50.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.420+0000 7f3834d43640 1 -- 172.21.15.60:0/2678978357 learned_addr learned my addr 172.21.15.60:0/2678978357 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:38:50.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.420+0000 7f382ffff640 1 --2- 172.21.15.60:0/2678978357 >> v2:172.21.15.105:3300/0 conn(0x7f38280d1a60 0x7f3828049eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:50.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.420+0000 7f382f7fe640 1 --2- 172.21.15.60:0/2678978357 >> v2:172.21.15.60:3300/0 conn(0x7f3828040b30 0x7f382800c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:50.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.420+0000 7f382effd640 1 -- 172.21.15.60:0/2678978357 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4252837894 0 0) 0x7f3828048030 con 0x7f382804a3f0 2024-09-12T02:38:50.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.420+0000 7f382effd640 1 -- 172.21.15.60:0/2678978357 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3820003520 con 0x7f382804a3f0 2024-09-12T02:38:50.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.420+0000 7f382f7fe640 1 -- 172.21.15.60:0/2678978357 >> v2:172.21.15.105:3300/0 conn(0x7f38280d1a60 msgr2=0x7f3828049eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:50.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.420+0000 7f382f7fe640 1 --2- 172.21.15.60:0/2678978357 >> v2:172.21.15.105:3300/0 conn(0x7f38280d1a60 0x7f3828049eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:50.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.420+0000 7f382f7fe640 1 -- 172.21.15.60:0/2678978357 >> v1:172.21.15.60:6789/0 conn(0x7f382804a3f0 legacy=0x7f382800c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:50.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.420+0000 7f382f7fe640 1 -- 172.21.15.60:0/2678978357 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3828048310 con 0x7f3828040b30 2024-09-12T02:38:50.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.422+0000 7f382f7fe640 1 --2- 172.21.15.60:0/2678978357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3828040b30 0x7f382800c320 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f382800c010 tx=0x7f381c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aec2bc26aa94d714 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:50.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.422+0000 7f382effd640 1 -- 172.21.15.60:0/2678978357 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f381c037070 con 0x7f3828040b30 2024-09-12T02:38:50.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.423+0000 7f382effd640 1 -- 172.21.15.60:0/2678978357 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f381c032440 con 0x7f3828040b30 2024-09-12T02:38:50.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.423+0000 7f382effd640 1 -- 172.21.15.60:0/2678978357 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f381c037070 con 0x7f3828040b30 2024-09-12T02:38:50.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.423+0000 7f3835544640 1 -- 172.21.15.60:0/2678978357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3828040b30 msgr2=0x7f382800c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:50.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.423+0000 7f3835544640 1 --2- 172.21.15.60:0/2678978357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3828040b30 0x7f382800c320 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f382800c010 tx=0x7f381c02a1a0 comp rx=0 tx=0).stop 2024-09-12T02:38:50.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.424+0000 7f3835544640 1 -- 172.21.15.60:0/2678978357 shutdown_connections 2024-09-12T02:38:50.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.424+0000 7f3835544640 1 --2- 172.21.15.60:0/2678978357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3828040b30 0x7f382800c320 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:50.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.424+0000 7f3835544640 1 --2- 172.21.15.60:0/2678978357 >> v2:172.21.15.105:3300/0 conn(0x7f38280d1a60 0x7f3828049eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:50.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.424+0000 7f3835544640 1 -- 172.21.15.60:0/2678978357 >> 172.21.15.60:0/2678978357 conn(0x7f382802f030 msgr2=0x7f382802f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:50.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.424+0000 7f3835544640 1 -- 172.21.15.60:0/2678978357 shutdown_connections 2024-09-12T02:38:50.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.424+0000 7f3835544640 1 -- 172.21.15.60:0/2678978357 wait complete. 2024-09-12T02:38:50.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.426+0000 7f3835544640 1 Processor -- start 2024-09-12T02:38:50.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.426+0000 7f3835544640 1 -- start start 2024-09-12T02:38:50.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.427+0000 7f3835544640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3828040b30 0x7f38280cc430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:50.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.427+0000 7f3835544640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f382804a3f0 0x7f38280d9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:50.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.427+0000 7f3835544640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38280d1a60 0x7f38280da410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:50.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.427+0000 7f3835544640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f382800d580 con 0x7f382804a3f0 2024-09-12T02:38:50.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.428+0000 7f3835544640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f38280d1e40 con 0x7f3828040b30 2024-09-12T02:38:50.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.428+0000 7f3835544640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f382800d700 con 0x7f38280d1a60 2024-09-12T02:38:50.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.428+0000 7f382ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3828040b30 0x7f38280cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:50.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.428+0000 7f382ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3828040b30 0x7f38280cc430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:53532/0 (socket says 172.21.15.60:53532) 2024-09-12T02:38:50.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.428+0000 7f382ffff640 1 -- 172.21.15.60:0/1084093984 learned_addr learned my addr 172.21.15.60:0/1084093984 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:38:50.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.428+0000 7f3834d43640 1 --2- 172.21.15.60:0/1084093984 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38280d1a60 0x7f38280da410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:50.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.428+0000 7f382f7fe640 1 --2- 172.21.15.60:0/1084093984 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f382804a3f0 0x7f38280d9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:50.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.428+0000 7f382ffff640 1 -- 172.21.15.60:0/1084093984 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38280d1a60 msgr2=0x7f38280da410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:50.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.428+0000 7f382ffff640 1 --2- 172.21.15.60:0/1084093984 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38280d1a60 0x7f38280da410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:50.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.428+0000 7f382ffff640 1 -- 172.21.15.60:0/1084093984 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f382804a3f0 msgr2=0x7f38280d9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:50.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.428+0000 7f382ffff640 1 --2- 172.21.15.60:0/1084093984 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f382804a3f0 0x7f38280d9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:50.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.428+0000 7f382ffff640 1 -- 172.21.15.60:0/1084093984 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3828041e60 con 0x7f3828040b30 2024-09-12T02:38:50.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.428+0000 7f3834d43640 1 --2- 172.21.15.60:0/1084093984 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38280d1a60 0x7f38280da410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:38:50.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.428+0000 7f382f7fe640 1 --2- 172.21.15.60:0/1084093984 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f382804a3f0 0x7f38280d9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:38:50.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.429+0000 7f382ffff640 1 --2- 172.21.15.60:0/1084093984 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3828040b30 0x7f38280cc430 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f382400e870 tx=0x7f382400ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:50.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.429+0000 7f382cff9640 1 -- 172.21.15.60:0/1084093984 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3824017070 con 0x7f3828040b30 2024-09-12T02:38:50.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.429+0000 7f382cff9640 1 -- 172.21.15.60:0/1084093984 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f382400c940 con 0x7f3828040b30 2024-09-12T02:38:50.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.429+0000 7f382cff9640 1 -- 172.21.15.60:0/1084093984 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f382400cd10 con 0x7f3828040b30 2024-09-12T02:38:50.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.429+0000 7f3835544640 1 -- 172.21.15.60:0/1084093984 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3828042140 con 0x7f3828040b30 2024-09-12T02:38:50.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.429+0000 7f3835544640 1 -- 172.21.15.60:0/1084093984 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3828042700 con 0x7f3828040b30 2024-09-12T02:38:50.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.430+0000 7f3835544640 1 --2- 172.21.15.60:0/1084093984 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38280da950 0x7f3828172cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:50.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.431+0000 7f3835544640 1 -- 172.21.15.60:0/1084093984 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f38280d5610 con 0x7f38280da950 2024-09-12T02:38:50.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.431+0000 7f382f7fe640 1 --2- 172.21.15.60:0/1084093984 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38280da950 0x7f3828172cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:50.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.431+0000 7f382f7fe640 1 -- 172.21.15.60:0/1084093984 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f38280d84e0 con 0x7f38280da950 2024-09-12T02:38:50.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.432+0000 7f382f7fe640 1 --2- 172.21.15.60:0/1084093984 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38280da950 0x7f3828172cc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f382800f670 tx=0x7f381c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:50.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.432+0000 7f382cff9640 1 -- 172.21.15.60:0/1084093984 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f381c037070 con 0x7f38280da950 2024-09-12T02:38:50.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.432+0000 7f382cff9640 1 -- 172.21.15.60:0/1084093984 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f381c032440 con 0x7f38280da950 2024-09-12T02:38:50.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.432+0000 7f382cff9640 1 -- 172.21.15.60:0/1084093984 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38280da950 msgr2=0x7f3828172cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:50.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.432+0000 7f382cff9640 1 --2- 172.21.15.60:0/1084093984 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38280da950 0x7f3828172cc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f382800f670 tx=0x7f381c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:38:50.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.432+0000 7f382cff9640 1 -- 172.21.15.60:0/1084093984 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38280da950 msgr2=0x7f3828172cc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:38:50.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.432+0000 7f382cff9640 1 --2- 172.21.15.60:0/1084093984 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38280da950 0x7f3828172cc0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:50.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.433+0000 7f382cff9640 1 -- 172.21.15.60:0/1084093984 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f382401a070 con 0x7f3828040b30 2024-09-12T02:38:50.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.434+0000 7f382cff9640 1 --2- 172.21.15.60:0/1084093984 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f381406b8f0 0x7f381406ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:50.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.434+0000 7f382cff9640 1 -- 172.21.15.60:0/1084093984 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f382408b1c0 con 0x7f3828040b30 2024-09-12T02:38:50.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.434+0000 7f382f7fe640 1 --2- 172.21.15.60:0/1084093984 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f381406b8f0 0x7f381406ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:50.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.435+0000 7f382f7fe640 1 --2- 172.21.15.60:0/1084093984 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f381406b8f0 0x7f381406ddb0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f38280d5790 tx=0x7f381c048040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:50.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.444+0000 7f3835544640 1 --2- 172.21.15.60:0/1084093984 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3828173200 0x7f38281735e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:50.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.444+0000 7f3835544640 1 -- 172.21.15.60:0/1084093984 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f382800d360 con 0x7f3828173200 2024-09-12T02:38:50.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.444+0000 7f3834d43640 1 --2- 172.21.15.60:0/1084093984 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3828173200 0x7f38281735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:50.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.445+0000 7f3834d43640 1 -- 172.21.15.60:0/1084093984 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f382802eb20 con 0x7f3828173200 2024-09-12T02:38:50.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.445+0000 7f3834d43640 1 --2- 172.21.15.60:0/1084093984 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3828173200 0x7f38281735e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3830051220 tx=0x7f38300699a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:50.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.446+0000 7f382cff9640 1 -- 172.21.15.60:0/1084093984 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38300743f0 con 0x7f3828173200 2024-09-12T02:38:50.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.446+0000 7f382cff9640 1 -- 172.21.15.60:0/1084093984 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5051 (secure 0 0 0) 0x7f38300766a0 con 0x7f3828173200 2024-09-12T02:38:50.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.446+0000 7f382cff9640 1 -- 172.21.15.60:0/1084093984 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3828173200 msgr2=0x7f38281735e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:50.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.446+0000 7f382cff9640 1 --2- 172.21.15.60:0/1084093984 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3828173200 0x7f38281735e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3830051220 tx=0x7f38300699a0 comp rx=0 tx=0).stop 2024-09-12T02:38:50.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.446+0000 7f382cff9640 1 -- 172.21.15.60:0/1084093984 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3828173200 msgr2=0x7f38281735e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:38:50.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.446+0000 7f382cff9640 1 --2- 172.21.15.60:0/1084093984 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3828173200 0x7f38281735e0 secure :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3830051220 tx=0x7f38300699a0 comp rx=0 tx=0).stop 2024-09-12T02:38:50.447 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:38:50.447 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:38:50.447 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:38:50.448 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:38:50.448 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 152, 2024-09-12T02:38:50.448 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 202025, 2024-09-12T02:38:50.448 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:38:50.448 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:38:50.448 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:38:50.448 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:38:50.448 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:50.448 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-09-12T02:38:50.448 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:38:50.448 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:38:50.448 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:38:50.449 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:38:50.449 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:38:50.449 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:38:50.449 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:38:50.449 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:38:50.449 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:38:50.449 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:38:50.449 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:38:50.449 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:38:50.449 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:38:50.449 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:38:50.449 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:50.449 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:38:50.450 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:38:50.450 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:38:50.450 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:38:50.450 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:38:50.450 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:38:50.450 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:38:50.450 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:38:50.450 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:38:50.450 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:38:50.450 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:38:50.450 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:38:50.450 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:38:50.450 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:50.451 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:50.451 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:38:50.451 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:38:50.451 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:38:50.451 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:38:50.451 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:38:50.451 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:38:50.451 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:38:50.451 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:38:50.451 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:38:50.451 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:38:50.451 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:38:50.451 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:38:50.452 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:38:50.452 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:38:50.452 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:38:50.452 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:38:50.452 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:38:50.452 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:38:50.452 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:38:50.452 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:38:50.452 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:38:50.452 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:38:50.452 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:38:50.452 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:38:50.452 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:38:50.453 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:38:50.453 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:38:50.453 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:38:50.453 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:50.453 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:38:50.453 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:50.453 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:38:50.453 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:50.453 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:38:50.453 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:38:50.453 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:38:50.453 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:38:50.453 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:50.454 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:38:50.454 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:38:50.454 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:50.454 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:50.454 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:50.454 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:38:50.454 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:38:50.454 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:50.454 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:50.454 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:50.454 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:50.454 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:38:50.454 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:38:50.455 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:38:50.455 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:38:50.455 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:38:50.455 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:50.455 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:50.455 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:38:50.455 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:38:50.455 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:38:50.455 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:38:50.455 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:50.455 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:38:50.455 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:38:50.455 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:50.456 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:50.456 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:50.456 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:38:50.456 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:38:50.456 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:50.456 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:50.456 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:50.456 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:50.456 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:38:50.456 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:38:50.456 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:38:50.456 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:38:50.456 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:38:50.457 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:50.457 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:50.457 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:38:50.457 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:38:50.457 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:38:50.457 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:38:50.457 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:50.457 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:38:50.457 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:38:50.457 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:50.457 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:50.457 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:50.457 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:38:50.458 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:38:50.458 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:50.458 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:50.458 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:50.458 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:50.458 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:38:50.458 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:38:50.458 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:38:50.459 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:38:50.459 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:38:50.459 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:50.459 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:50.459 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:50.459 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:38:50.459 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:38:50.459 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:50.459 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:38:50.459 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:38:50.459 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:38:50.459 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:50.459 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:50.460 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:38:50.460 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:50.460 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:38:50.460 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:38:50.460 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:38:50.460 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:50.460 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:50.460 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:38:50.460 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:50.460 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:38:50.460 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:38:50.460 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-09-12T02:38:50.460 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:50.460 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:50.461 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:38:50.461 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:50.461 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:38:50.461 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:38:50.461 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:38:50.461 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:50.461 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:50.461 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:38:50.461 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:50.461 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:38:50.461 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:38:50.461 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:38:50.461 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:50.462 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:50.462 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:50.462 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:38:50.462 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:38:50.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.447+0000 7f381a7fc640 1 -- 172.21.15.60:0/1084093984 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f381406b8f0 msgr2=0x7f381406ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:50.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.447+0000 7f381a7fc640 1 --2- 172.21.15.60:0/1084093984 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f381406b8f0 0x7f381406ddb0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f38280d5790 tx=0x7f381c048040 comp rx=0 tx=0).stop 2024-09-12T02:38:50.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.447+0000 7f381a7fc640 1 -- 172.21.15.60:0/1084093984 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3828040b30 msgr2=0x7f38280cc430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:50.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.447+0000 7f381a7fc640 1 --2- 172.21.15.60:0/1084093984 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3828040b30 0x7f38280cc430 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f382400e870 tx=0x7f382400ed30 comp rx=0 tx=0).stop 2024-09-12T02:38:50.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.447+0000 7f3834d43640 1 -- 172.21.15.60:0/1084093984 reap_dead start 2024-09-12T02:38:50.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.447+0000 7f381a7fc640 1 -- 172.21.15.60:0/1084093984 shutdown_connections 2024-09-12T02:38:50.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.447+0000 7f381a7fc640 1 -- 172.21.15.60:0/1084093984 >> 172.21.15.60:0/1084093984 conn(0x7f382802f030 msgr2=0x7f382800c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:50.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.449+0000 7f381a7fc640 1 -- 172.21.15.60:0/1084093984 shutdown_connections 2024-09-12T02:38:50.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.450+0000 7f381a7fc640 1 -- 172.21.15.60:0/1084093984 wait complete. 2024-09-12T02:38:50.468 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:38:50.468 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-12T02:38:50.468 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-12T02:38:50.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.635+0000 7f034dd2a640 1 Processor -- start 2024-09-12T02:38:50.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.635+0000 7f034dd2a640 1 -- start start 2024-09-12T02:38:50.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.636+0000 7f034dd2a640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0348150480 0x7f03480c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:50.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.636+0000 7f034dd2a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f034806c650 0x7f03480c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:50.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.636+0000 7f034dd2a640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f034815a7c0 con 0x7f03480c9c80 2024-09-12T02:38:50.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.636+0000 7f034dd2a640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f034806c240 con 0x7f034806c650 2024-09-12T02:38:50.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.636+0000 7f034dd2a640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f034815a330 con 0x7f0348150480 2024-09-12T02:38:50.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.637+0000 7f03477fe640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0348150480 0x7f03480c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:50.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.637+0000 7f0347fff640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f03480c9c80 0x7f03480ca0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:47666/0 (socket says 172.21.15.60:47666) 2024-09-12T02:38:50.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.637+0000 7f0347fff640 1 -- 172.21.15.60:0/4251245750 learned_addr learned my addr 172.21.15.60:0/4251245750 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:38:50.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.637+0000 7f0346ffd640 1 --2- 172.21.15.60:0/4251245750 >> v2:172.21.15.60:3300/0 conn(0x7f034806c650 0x7f03480c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:50.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.637+0000 7f03477fe640 1 -- 172.21.15.60:0/4251245750 >> v2:172.21.15.60:3300/0 conn(0x7f034806c650 msgr2=0x7f03480c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:38:50.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.637+0000 7f03467fc640 1 -- 172.21.15.60:0/4251245750 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 518314658 0 0) 0x7f034815a7c0 con 0x7f03480c9c80 2024-09-12T02:38:50.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.637+0000 7f03477fe640 1 --2- 172.21.15.60:0/4251245750 >> v2:172.21.15.60:3300/0 conn(0x7f034806c650 0x7f03480c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:50.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.638+0000 7f03477fe640 1 -- 172.21.15.60:0/4251245750 >> v1:172.21.15.105:6789/0 conn(0x7f03480c9c80 legacy=0x7f03480ca0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:50.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.638+0000 7f03477fe640 1 -- 172.21.15.60:0/4251245750 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0348159a00 con 0x7f0348150480 2024-09-12T02:38:50.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.638+0000 7f0346ffd640 1 --2- 172.21.15.60:0/4251245750 >> v2:172.21.15.60:3300/0 conn(0x7f034806c650 0x7f03480c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:38:50.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.639+0000 7f03477fe640 1 --2- 172.21.15.60:0/4251245750 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0348150480 0x7f03480c7a90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f03480ccac0 tx=0x7f033802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35101bbd94dab701 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:50.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.639+0000 7f03467fc640 1 -- 172.21.15.60:0/4251245750 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0338037070 con 0x7f0348150480 2024-09-12T02:38:50.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.639+0000 7f03467fc640 1 -- 172.21.15.60:0/4251245750 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0338032440 con 0x7f0348150480 2024-09-12T02:38:50.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.639+0000 7f03467fc640 1 -- 172.21.15.60:0/4251245750 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0338032810 con 0x7f0348150480 2024-09-12T02:38:50.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.640+0000 7f034dd2a640 1 -- 172.21.15.60:0/4251245750 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0348150480 msgr2=0x7f03480c7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:50.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.640+0000 7f034dd2a640 1 --2- 172.21.15.60:0/4251245750 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0348150480 0x7f03480c7a90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f03480ccac0 tx=0x7f033802a1a0 comp rx=0 tx=0).stop 2024-09-12T02:38:50.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.641+0000 7f034dd2a640 1 -- 172.21.15.60:0/4251245750 shutdown_connections 2024-09-12T02:38:50.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.641+0000 7f034dd2a640 1 --2- 172.21.15.60:0/4251245750 >> v2:172.21.15.60:3300/0 conn(0x7f034806c650 0x7f03480c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:50.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.641+0000 7f034dd2a640 1 --2- 172.21.15.60:0/4251245750 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0348150480 0x7f03480c7a90 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:50.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.641+0000 7f034dd2a640 1 -- 172.21.15.60:0/4251245750 >> 172.21.15.60:0/4251245750 conn(0x7f0348068030 msgr2=0x7f0348073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:50.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.641+0000 7f034dd2a640 1 -- 172.21.15.60:0/4251245750 shutdown_connections 2024-09-12T02:38:50.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.641+0000 7f034dd2a640 1 -- 172.21.15.60:0/4251245750 wait complete. 2024-09-12T02:38:50.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.643+0000 7f034dd2a640 1 Processor -- start 2024-09-12T02:38:50.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.643+0000 7f034dd2a640 1 -- start start 2024-09-12T02:38:50.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.644+0000 7f034dd2a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f034806c650 0x7f03481518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:50.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.644+0000 7f034dd2a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03480c9c80 0x7f0348151e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:50.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.644+0000 7f034dd2a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0348150480 0x7f03481f0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:50.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.644+0000 7f034dd2a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f034806d270 con 0x7f03480c9c80 2024-09-12T02:38:50.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.644+0000 7f034dd2a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0348159fc0 con 0x7f034806c650 2024-09-12T02:38:50.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.644+0000 7f034dd2a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0348156270 con 0x7f0348150480 2024-09-12T02:38:50.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.644+0000 7f0346ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03480c9c80 0x7f0348151e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:50.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.644+0000 7f0346ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03480c9c80 0x7f0348151e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35112/0 (socket says 172.21.15.60:35112) 2024-09-12T02:38:50.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.644+0000 7f0346ffd640 1 -- 172.21.15.60:0/697794424 learned_addr learned my addr 172.21.15.60:0/697794424 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:38:50.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.644+0000 7f03477fe640 1 --2- 172.21.15.60:0/697794424 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f034806c650 0x7f03481518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:50.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.645+0000 7f03477fe640 1 -- 172.21.15.60:0/697794424 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0348150480 msgr2=0x7f03481f0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:50.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.645+0000 7f03477fe640 1 --2- 172.21.15.60:0/697794424 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0348150480 0x7f03481f0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:50.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.645+0000 7f03477fe640 1 -- 172.21.15.60:0/697794424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03480c9c80 msgr2=0x7f0348151e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:50.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.645+0000 7f03477fe640 1 --2- 172.21.15.60:0/697794424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03480c9c80 0x7f0348151e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:50.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.645+0000 7f03477fe640 1 -- 172.21.15.60:0/697794424 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0348153830 con 0x7f034806c650 2024-09-12T02:38:50.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.645+0000 7f03477fe640 1 --2- 172.21.15.60:0/697794424 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f034806c650 0x7f03481518e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0338031000 tx=0x7f03380046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:50.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.646+0000 7f033ffff640 1 -- 172.21.15.60:0/697794424 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0338032e60 con 0x7f034806c650 2024-09-12T02:38:50.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.646+0000 7f033ffff640 1 -- 172.21.15.60:0/697794424 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0338030770 con 0x7f034806c650 2024-09-12T02:38:50.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.646+0000 7f033ffff640 1 -- 172.21.15.60:0/697794424 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0338037040 con 0x7f034806c650 2024-09-12T02:38:50.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.646+0000 7f0346ffd640 1 --2- 172.21.15.60:0/697794424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03480c9c80 0x7f0348151e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:38:50.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.646+0000 7f034dd2a640 1 -- 172.21.15.60:0/697794424 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0348153b10 con 0x7f034806c650 2024-09-12T02:38:50.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.646+0000 7f034dd2a640 1 -- 172.21.15.60:0/697794424 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0348152ac0 con 0x7f034806c650 2024-09-12T02:38:50.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.648+0000 7f034dd2a640 1 --2- 172.21.15.60:0/697794424 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03481f40b0 0x7f03481f0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:50.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.648+0000 7f034dd2a640 1 -- 172.21.15.60:0/697794424 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0348152fe0 con 0x7f03481f40b0 2024-09-12T02:38:50.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.648+0000 7f0346ffd640 1 --2- 172.21.15.60:0/697794424 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03481f40b0 0x7f03481f0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:50.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.648+0000 7f0346ffd640 1 -- 172.21.15.60:0/697794424 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0348153ef0 con 0x7f03481f40b0 2024-09-12T02:38:50.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.649+0000 7f0346ffd640 1 --2- 172.21.15.60:0/697794424 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03481f40b0 0x7f03481f0670 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f03480ac9e0 tx=0x7f0330011f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:50.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.649+0000 7f033ffff640 1 -- 172.21.15.60:0/697794424 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f033000f040 con 0x7f03481f40b0 2024-09-12T02:38:50.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.649+0000 7f033ffff640 1 -- 172.21.15.60:0/697794424 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0338044020 con 0x7f034806c650 2024-09-12T02:38:50.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.650+0000 7f033ffff640 1 --2- 172.21.15.60:0/697794424 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f032806bd30 0x7f032806e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:50.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.650+0000 7f033ffff640 1 -- 172.21.15.60:0/697794424 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f033000fd70 con 0x7f03481f40b0 2024-09-12T02:38:50.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.650+0000 7f033ffff640 1 -- 172.21.15.60:0/697794424 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03481f40b0 msgr2=0x7f03481f0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:50.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.650+0000 7f033ffff640 1 --2- 172.21.15.60:0/697794424 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03481f40b0 0x7f03481f0670 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f03480ac9e0 tx=0x7f0330011f10 comp rx=0 tx=0).stop 2024-09-12T02:38:50.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.650+0000 7f033ffff640 1 -- 172.21.15.60:0/697794424 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03481f40b0 msgr2=0x7f03481f0670 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:38:50.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.650+0000 7f033ffff640 1 --2- 172.21.15.60:0/697794424 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03481f40b0 0x7f03481f0670 secure :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f03480ac9e0 tx=0x7f0330011f10 comp rx=0 tx=0).stop 2024-09-12T02:38:50.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.650+0000 7f033ffff640 1 -- 172.21.15.60:0/697794424 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f0338077420 con 0x7f034806c650 2024-09-12T02:38:50.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.651+0000 7f0347fff640 1 --2- 172.21.15.60:0/697794424 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f032806bd30 0x7f032806e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:50.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.652+0000 7f0347fff640 1 --2- 172.21.15.60:0/697794424 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f032806bd30 0x7f032806e1f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0340000f80 tx=0x7f0340007c80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:50.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.663+0000 7f034dd2a640 1 --2- 172.21.15.60:0/697794424 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03481ef120 0x7f03481ef500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:50.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.663+0000 7f034dd2a640 1 -- 172.21.15.60:0/697794424 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0348152d00 con 0x7f03481ef120 2024-09-12T02:38:50.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.664+0000 7f0346ffd640 1 --2- 172.21.15.60:0/697794424 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03481ef120 0x7f03481ef500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:50.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.664+0000 7f0346ffd640 1 -- 172.21.15.60:0/697794424 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f03480ca0f0 con 0x7f03481ef120 2024-09-12T02:38:50.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.665+0000 7f0346ffd640 1 --2- 172.21.15.60:0/697794424 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03481ef120 0x7f03481ef500 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f03480ac9e0 tx=0x7f03300046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:50.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.665+0000 7f033ffff640 1 -- 172.21.15.60:0/697794424 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0330015660 con 0x7f03481ef120 2024-09-12T02:38:50.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.666+0000 7f033ffff640 1 -- 172.21.15.60:0/697794424 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4548 (secure 0 0 0) 0x7f0330015800 con 0x7f03481ef120 2024-09-12T02:38:50.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.666+0000 7f033ffff640 1 -- 172.21.15.60:0/697794424 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03481ef120 msgr2=0x7f03481ef500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:50.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.666+0000 7f033ffff640 1 --2- 172.21.15.60:0/697794424 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03481ef120 0x7f03481ef500 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f03480ac9e0 tx=0x7f03300046c0 comp rx=0 tx=0).stop 2024-09-12T02:38:50.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.666+0000 7f033ffff640 1 -- 172.21.15.60:0/697794424 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03481ef120 msgr2=0x7f03481ef500 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:38:50.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.666+0000 7f033ffff640 1 --2- 172.21.15.60:0/697794424 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03481ef120 0x7f03481ef500 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f03480ac9e0 tx=0x7f03300046c0 comp rx=0 tx=0).stop 2024-09-12T02:38:50.669 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:38:50.669 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:38:50.669 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:38:50.669 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:38:50.669 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 152, 2024-09-12T02:38:50.669 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 8603, 2024-09-12T02:38:50.669 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:38:50.669 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:38:50.669 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:38:50.669 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:38:50.669 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:50.670 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-09-12T02:38:50.670 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:38:50.670 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:38:50.670 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:38:50.670 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:38:50.670 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:38:50.670 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:38:50.670 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:38:50.670 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:38:50.670 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:38:50.670 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:38:50.670 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:38:50.670 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:38:50.670 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:38:50.671 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:38:50.671 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:50.671 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:38:50.671 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:38:50.671 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:38:50.671 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:38:50.671 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:38:50.671 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:38:50.671 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:38:50.671 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:38:50.671 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:38:50.671 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:38:50.671 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:38:50.672 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:38:50.672 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:38:50.672 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:50.672 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:50.672 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:38:50.672 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:38:50.672 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:38:50.672 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:38:50.672 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:38:50.672 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:38:50.672 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:38:50.672 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:38:50.673 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:38:50.673 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:38:50.673 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:38:50.673 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:38:50.673 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:38:50.673 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:38:50.673 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:38:50.673 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:38:50.673 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:38:50.673 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:38:50.673 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:38:50.673 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:38:50.673 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:38:50.674 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:38:50.674 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:38:50.674 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:38:50.674 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:38:50.674 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:38:50.674 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:38:50.674 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:38:50.674 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:50.674 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:38:50.674 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:50.674 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:38:50.674 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:50.674 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:38:50.674 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:38:50.675 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:38:50.675 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:38:50.675 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:50.675 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:38:50.675 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:38:50.675 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:50.675 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:50.675 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:50.675 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:38:50.675 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:38:50.675 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:50.675 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:50.675 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:50.676 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:50.676 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:38:50.676 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:38:50.676 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:38:50.676 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:38:50.676 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:38:50.676 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:50.676 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:50.676 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:38:50.676 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:38:50.676 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:38:50.676 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:38:50.676 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:50.677 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:38:50.677 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:38:50.677 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:50.677 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:50.677 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:50.677 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:38:50.677 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:38:50.677 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:50.677 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:50.677 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:50.677 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:50.677 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:38:50.677 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:38:50.677 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:38:50.678 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:38:50.678 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:38:50.678 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:50.678 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:50.678 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:38:50.678 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:38:50.678 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:38:50.678 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:38:50.678 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:50.678 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:38:50.678 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:38:50.678 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:50.678 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:50.679 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:50.679 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:38:50.679 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:38:50.679 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:38:50.679 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:50.679 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:50.679 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:50.679 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:38:50.679 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:38:50.679 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:38:50.679 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:38:50.679 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:38:50.679 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:50.680 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:50.680 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:50.680 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:38:50.680 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:38:50.680 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:50.680 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:38:50.680 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:38:50.680 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:38:50.680 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:50.680 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:38:50.680 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:38:50.680 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:38:50.680 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:38:50.681 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:38:50.681 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:38:50.681 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:38:50.681 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:38:50.681 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:38:50.681 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:38:50.681 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:38:50.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.669+0000 7f034dd2a640 1 -- 172.21.15.60:0/697794424 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f032806bd30 msgr2=0x7f032806e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:50.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.669+0000 7f034dd2a640 1 --2- 172.21.15.60:0/697794424 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f032806bd30 0x7f032806e1f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0340000f80 tx=0x7f0340007c80 comp rx=0 tx=0).stop 2024-09-12T02:38:50.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.669+0000 7f034dd2a640 1 -- 172.21.15.60:0/697794424 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f034806c650 msgr2=0x7f03481518e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:50.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.669+0000 7f034dd2a640 1 --2- 172.21.15.60:0/697794424 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f034806c650 0x7f03481518e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0338031000 tx=0x7f03380046c0 comp rx=0 tx=0).stop 2024-09-12T02:38:50.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.669+0000 7f0347fff640 1 -- 172.21.15.60:0/697794424 reap_dead start 2024-09-12T02:38:50.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.669+0000 7f0347fff640 1 -- 172.21.15.60:0/697794424 reap_dead start 2024-09-12T02:38:50.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.669+0000 7f034dd2a640 1 -- 172.21.15.60:0/697794424 shutdown_connections 2024-09-12T02:38:50.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.669+0000 7f034dd2a640 1 -- 172.21.15.60:0/697794424 >> 172.21.15.60:0/697794424 conn(0x7f0348068030 msgr2=0x7f03480c7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:50.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.669+0000 7f034dd2a640 1 -- 172.21.15.60:0/697794424 shutdown_connections 2024-09-12T02:38:50.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.670+0000 7f034dd2a640 1 -- 172.21.15.60:0/697794424 wait complete. 2024-09-12T02:38:50.688 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:38:50.688 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-12T02:38:50.688 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-12T02:38:50.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.848+0000 7f858a677640 1 Processor -- start 2024-09-12T02:38:50.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.848+0000 7f858a677640 1 -- start start 2024-09-12T02:38:50.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.849+0000 7f858a677640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f858406c650 0x7f85840c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:50.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.849+0000 7f858a677640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f85840ca1c0 0x7f8584160bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:50.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.850+0000 7f8588c14640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f85840ca1c0 0x7f8584160bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:50.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.850+0000 7f8588c14640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f85840ca1c0 0x7f8584160bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35114/0 (socket says 172.21.15.60:35114) 2024-09-12T02:38:50.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.850+0000 7f8588c14640 1 -- 172.21.15.60:0/1077831610 learned_addr learned my addr 172.21.15.60:0/1077831610 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:38:50.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.850+0000 7f858a677640 1 -- 172.21.15.60:0/1077831610 --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f858415a7c0 con 0x7f8584150480 2024-09-12T02:38:50.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.850+0000 7f858a677640 1 -- 172.21.15.60:0/1077831610 --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f858406c240 con 0x7f85840ca1c0 2024-09-12T02:38:50.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.850+0000 7f858a677640 1 -- 172.21.15.60:0/1077831610 --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f858415a330 con 0x7f858406c650 2024-09-12T02:38:50.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.851+0000 7f8588c14640 1 -- 172.21.15.60:0/1077831610 >> v2:172.21.15.105:3300/0 conn(0x7f858406c650 msgr2=0x7f85840c9c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:38:50.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.851+0000 7f8588c14640 1 --2- 172.21.15.60:0/1077831610 >> v2:172.21.15.105:3300/0 conn(0x7f858406c650 0x7f85840c9c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:50.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.851+0000 7f8588c14640 1 -- 172.21.15.60:0/1077831610 >> v1:172.21.15.105:6789/0 conn(0x7f8584150480 legacy=0x7f85840c7a90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:38:50.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.851+0000 7f8588c14640 1 -- 172.21.15.60:0/1077831610 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8584159a00 con 0x7f85840ca1c0 2024-09-12T02:38:50.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.852+0000 7f8588c14640 1 --2- 172.21.15.60:0/1077831610 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85840ca1c0 0x7f8584160bf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f85840c6110 tx=0x7f857402a4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2d5188f3d2d4c9c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:50.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.853+0000 7f8582ffd640 1 -- 172.21.15.60:0/1077831610 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8574036070 con 0x7f85840ca1c0 2024-09-12T02:38:50.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.853+0000 7f8582ffd640 1 -- 172.21.15.60:0/1077831610 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8574031600 con 0x7f85840ca1c0 2024-09-12T02:38:50.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.853+0000 7f8582ffd640 1 -- 172.21.15.60:0/1077831610 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8574036070 con 0x7f85840ca1c0 2024-09-12T02:38:50.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.854+0000 7f858a677640 1 -- 172.21.15.60:0/1077831610 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85840ca1c0 msgr2=0x7f8584160bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:50.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.854+0000 7f858a677640 1 --2- 172.21.15.60:0/1077831610 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85840ca1c0 0x7f8584160bf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f85840c6110 tx=0x7f857402a4a0 comp rx=0 tx=0).stop 2024-09-12T02:38:50.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.854+0000 7f858a677640 1 -- 172.21.15.60:0/1077831610 shutdown_connections 2024-09-12T02:38:50.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.854+0000 7f858a677640 1 --2- 172.21.15.60:0/1077831610 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85840ca1c0 0x7f8584160bf0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:50.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.854+0000 7f858a677640 1 --2- 172.21.15.60:0/1077831610 >> v2:172.21.15.105:3300/0 conn(0x7f858406c650 0x7f85840c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:50.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.854+0000 7f858a677640 1 -- 172.21.15.60:0/1077831610 >> 172.21.15.60:0/1077831610 conn(0x7f8584068030 msgr2=0x7f8584073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:50.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.854+0000 7f858a677640 1 -- 172.21.15.60:0/1077831610 shutdown_connections 2024-09-12T02:38:50.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.854+0000 7f858a677640 1 -- 172.21.15.60:0/1077831610 wait complete. 2024-09-12T02:38:50.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.857+0000 7f858a677640 1 Processor -- start 2024-09-12T02:38:50.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.857+0000 7f858a677640 1 -- start start 2024-09-12T02:38:50.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.858+0000 7f858a677640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f858406c650 0x7f85841ef500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:50.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.858+0000 7f858a677640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85840ca1c0 0x7f85841e2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:50.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.858+0000 7f858a677640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8584150480 0x7f85841509f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:50.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.858+0000 7f858a677640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f858406d270 con 0x7f8584150480 2024-09-12T02:38:50.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.858+0000 7f858a677640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8584159fc0 con 0x7f858406c650 2024-09-12T02:38:50.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.858+0000 7f858a677640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f85840ca5f0 con 0x7f85840ca1c0 2024-09-12T02:38:50.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.858+0000 7f8588c14640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8584150480 0x7f85841509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:50.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.858+0000 7f8588c14640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8584150480 0x7f85841509f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35128/0 (socket says 172.21.15.60:35128) 2024-09-12T02:38:50.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.858+0000 7f8588c14640 1 -- 172.21.15.60:0/885642581 learned_addr learned my addr 172.21.15.60:0/885642581 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:38:50.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.859+0000 7f85837fe640 1 --2- 172.21.15.60:0/885642581 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85840ca1c0 0x7f85841e2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:50.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.859+0000 7f8583fff640 1 --2- 172.21.15.60:0/885642581 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f858406c650 0x7f85841ef500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:50.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.859+0000 7f8588c14640 1 -- 172.21.15.60:0/885642581 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85840ca1c0 msgr2=0x7f85841e2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:50.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.859+0000 7f8588c14640 1 --2- 172.21.15.60:0/885642581 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85840ca1c0 0x7f85841e2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:50.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.859+0000 7f8588c14640 1 -- 172.21.15.60:0/885642581 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f858406c650 msgr2=0x7f85841ef500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:50.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.859+0000 7f8588c14640 1 --2- 172.21.15.60:0/885642581 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f858406c650 0x7f85841ef500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:50.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.859+0000 7f8588c14640 1 -- 172.21.15.60:0/885642581 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8584153740 con 0x7f8584150480 2024-09-12T02:38:50.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.860+0000 7f8588c14640 1 --2- 172.21.15.60:0/885642581 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8584150480 0x7f85841509f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f857402a4e0 tx=0x7f85740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:50.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.860+0000 7f8580ff9640 1 -- 172.21.15.60:0/885642581 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8574036070 con 0x7f8584150480 2024-09-12T02:38:50.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.860+0000 7f858a677640 1 -- 172.21.15.60:0/885642581 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85840b0cf0 con 0x7f8584150480 2024-09-12T02:38:50.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.860+0000 7f858a677640 1 -- 172.21.15.60:0/885642581 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85841e3510 con 0x7f8584150480 2024-09-12T02:38:50.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.860+0000 7f8580ff9640 1 -- 172.21.15.60:0/885642581 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8574030aa0 con 0x7f8584150480 2024-09-12T02:38:50.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.860+0000 7f8580ff9640 1 -- 172.21.15.60:0/885642581 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857403b470 con 0x7f8584150480 2024-09-12T02:38:50.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.862+0000 7f858a677640 1 -- 172.21.15.60:0/885642581 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8564005290 con 0x7f8584150480 2024-09-12T02:38:50.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.863+0000 7f8580ff9640 1 -- 172.21.15.60:0/885642581 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f857403b610 con 0x7f8584150480 2024-09-12T02:38:50.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.863+0000 7f8580ff9640 1 --2- 172.21.15.60:0/885642581 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f857006be30 0x7f857006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:38:50.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.863+0000 7f8580ff9640 1 -- 172.21.15.60:0/885642581 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f85740abbc0 con 0x7f8584150480 2024-09-12T02:38:50.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.864+0000 7f8583fff640 1 --2- 172.21.15.60:0/885642581 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f857006be30 0x7f857006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:38:50.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.865+0000 7f8583fff640 1 --2- 172.21.15.60:0/885642581 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f857006be30 0x7f857006e2f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f8584155480 tx=0x7f857c009540 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:38:50.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:50.871+0000 7f8580ff9640 1 -- 172.21.15.60:0/885642581 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8574042020 con 0x7f8584150480 2024-09-12T02:38:51.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:51.339+0000 7f858a677640 1 -- 172.21.15.60:0/885642581 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f8564005cf0 con 0x7f8584150480 2024-09-12T02:38:51.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:51.340+0000 7f8580ff9640 1 -- 172.21.15.60:0/885642581 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f8574079c10 con 0x7f8584150480 2024-09-12T02:38:51.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:51.344+0000 7f858a677640 1 -- 172.21.15.60:0/885642581 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f857006be30 msgr2=0x7f857006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:51.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:51.344+0000 7f858a677640 1 --2- 172.21.15.60:0/885642581 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f857006be30 0x7f857006e2f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f8584155480 tx=0x7f857c009540 comp rx=0 tx=0).stop 2024-09-12T02:38:51.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:51.344+0000 7f858a677640 1 -- 172.21.15.60:0/885642581 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8584150480 msgr2=0x7f85841509f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:51.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:51.344+0000 7f858a677640 1 --2- 172.21.15.60:0/885642581 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8584150480 0x7f85841509f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f857402a4e0 tx=0x7f85740046c0 comp rx=0 tx=0).stop 2024-09-12T02:38:51.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:51.345+0000 7f858a677640 1 -- 172.21.15.60:0/885642581 shutdown_connections 2024-09-12T02:38:51.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:51.345+0000 7f858a677640 1 --2- 172.21.15.60:0/885642581 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f857006be30 0x7f857006e2f0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:51.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:51.345+0000 7f858a677640 1 --2- 172.21.15.60:0/885642581 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8584150480 0x7f85841509f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:51.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:51.345+0000 7f858a677640 1 --2- 172.21.15.60:0/885642581 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85840ca1c0 0x7f85841e2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:51.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:51.345+0000 7f858a677640 1 --2- 172.21.15.60:0/885642581 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f858406c650 0x7f85841ef500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:51.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:51.345+0000 7f858a677640 1 -- 172.21.15.60:0/885642581 >> 172.21.15.60:0/885642581 conn(0x7f8584068030 msgr2=0x7f8584154b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:51.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:51.345+0000 7f858a677640 1 -- 172.21.15.60:0/885642581 shutdown_connections 2024-09-12T02:38:51.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:38:51.345+0000 7f858a677640 1 -- 172.21.15.60:0/885642581 wait complete. 2024-09-12T02:38:51.364 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-12T02:39:01.366 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-12T02:39:01.366 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:39:01.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.535+0000 7f1521f11640 1 Processor -- start 2024-09-12T02:39:01.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.535+0000 7f1521f11640 1 -- start start 2024-09-12T02:39:01.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.536+0000 7f1521f11640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f151c0a6c10 0x7f151c0c2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:01.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.536+0000 7f1521f11640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f151c0c5940 0x7f151c06e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:01.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.536+0000 7f1521f11640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f151c15a970 con 0x7f151c0c6010 2024-09-12T02:39:01.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.536+0000 7f1521f11640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f151c15ac50 con 0x7f151c0c5940 2024-09-12T02:39:01.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.536+0000 7f1521f11640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f151c15af30 con 0x7f151c0a6c10 2024-09-12T02:39:01.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.536+0000 7f151b7fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f151c0a6c10 0x7f151c0c2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:01.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.536+0000 7f151b7fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f151c0a6c10 0x7f151c0c2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:37258/0 (socket says 172.21.15.60:37258) 2024-09-12T02:39:01.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.536+0000 7f151b7fe640 1 -- 172.21.15.60:0/3681572699 learned_addr learned my addr 172.21.15.60:0/3681572699 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:39:01.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.537+0000 7f151b7fe640 1 -- 172.21.15.60:0/3681572699 >> v2:172.21.15.60:3300/0 conn(0x7f151c0c5940 msgr2=0x7f151c06e1c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:39:01.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.537+0000 7f151a7fc640 1 -- 172.21.15.60:0/3681572699 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1914284512 0 0) 0x7f151c15a970 con 0x7f151c0c6010 2024-09-12T02:39:01.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.537+0000 7f151bfff640 1 --2- 172.21.15.60:0/3681572699 >> v2:172.21.15.60:3300/0 conn(0x7f151c0c5940 0x7f151c06e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:01.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.537+0000 7f151b7fe640 1 --2- 172.21.15.60:0/3681572699 >> v2:172.21.15.60:3300/0 conn(0x7f151c0c5940 0x7f151c06e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:01.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.537+0000 7f151b7fe640 1 -- 172.21.15.60:0/3681572699 >> v1:172.21.15.60:6789/0 conn(0x7f151c0c6010 legacy=0x7f151c06dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:01.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.537+0000 7f151b7fe640 1 -- 172.21.15.60:0/3681572699 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f151c15b210 con 0x7f151c0a6c10 2024-09-12T02:39:01.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.539+0000 7f151b7fe640 1 --2- 172.21.15.60:0/3681572699 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f151c0a6c10 0x7f151c0c2440 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1514009e50 tx=0x7f151402a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4429282cc37673e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:01.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.539+0000 7f151a7fc640 1 -- 172.21.15.60:0/3681572699 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1514036070 con 0x7f151c0a6c10 2024-09-12T02:39:01.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.539+0000 7f151a7fc640 1 -- 172.21.15.60:0/3681572699 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1514031600 con 0x7f151c0a6c10 2024-09-12T02:39:01.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.539+0000 7f151a7fc640 1 -- 172.21.15.60:0/3681572699 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15140319d0 con 0x7f151c0a6c10 2024-09-12T02:39:01.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.540+0000 7f1521f11640 1 -- 172.21.15.60:0/3681572699 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f151c0a6c10 msgr2=0x7f151c0c2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:01.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.540+0000 7f1521f11640 1 --2- 172.21.15.60:0/3681572699 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f151c0a6c10 0x7f151c0c2440 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1514009e50 tx=0x7f151402a680 comp rx=0 tx=0).stop 2024-09-12T02:39:01.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.541+0000 7f1521f11640 1 -- 172.21.15.60:0/3681572699 shutdown_connections 2024-09-12T02:39:01.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.541+0000 7f1521f11640 1 --2- 172.21.15.60:0/3681572699 >> v2:172.21.15.60:3300/0 conn(0x7f151c0c5940 0x7f151c06e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:01.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.541+0000 7f1521f11640 1 --2- 172.21.15.60:0/3681572699 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f151c0a6c10 0x7f151c0c2440 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:01.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.541+0000 7f1521f11640 1 -- 172.21.15.60:0/3681572699 >> 172.21.15.60:0/3681572699 conn(0x7f151c0c7a40 msgr2=0x7f151c0c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:01.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.541+0000 7f1521f11640 1 -- 172.21.15.60:0/3681572699 shutdown_connections 2024-09-12T02:39:01.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.541+0000 7f1521f11640 1 -- 172.21.15.60:0/3681572699 wait complete. 2024-09-12T02:39:01.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.543+0000 7f1521f11640 1 Processor -- start 2024-09-12T02:39:01.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.544+0000 7f1521f11640 1 -- start start 2024-09-12T02:39:01.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.545+0000 7f1521f11640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f151c0a6c10 0x7f151c0ad270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:01.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.545+0000 7f1521f11640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f151c0c5940 0x7f151c154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:01.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.545+0000 7f1521f11640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f151c0c6010 0x7f151c15d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:01.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.545+0000 7f1521f11640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f151c0a73a0 con 0x7f151c0a6c10 2024-09-12T02:39:01.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.545+0000 7f1521f11640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f151c15a620 con 0x7f151c0c6010 2024-09-12T02:39:01.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.545+0000 7f1521f11640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f151c0a7520 con 0x7f151c0c5940 2024-09-12T02:39:01.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.545+0000 7f151b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f151c0a6c10 0x7f151c0ad270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:01.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.545+0000 7f151b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f151c0a6c10 0x7f151c0ad270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60704/0 (socket says 172.21.15.60:60704) 2024-09-12T02:39:01.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.545+0000 7f151b7fe640 1 -- 172.21.15.60:0/2389632059 learned_addr learned my addr 172.21.15.60:0/2389632059 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:39:01.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.545+0000 7f151bfff640 1 --2- 172.21.15.60:0/2389632059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f151c0c6010 0x7f151c15d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:01.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.545+0000 7f151affd640 1 --2- 172.21.15.60:0/2389632059 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f151c0c5940 0x7f151c154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:01.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.546+0000 7f151b7fe640 1 -- 172.21.15.60:0/2389632059 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f151c0c5940 msgr2=0x7f151c154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:01.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.546+0000 7f151b7fe640 1 --2- 172.21.15.60:0/2389632059 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f151c0c5940 0x7f151c154ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:01.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.546+0000 7f151b7fe640 1 -- 172.21.15.60:0/2389632059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f151c0c6010 msgr2=0x7f151c15d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:01.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.546+0000 7f151b7fe640 1 --2- 172.21.15.60:0/2389632059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f151c0c6010 0x7f151c15d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:01.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.546+0000 7f151b7fe640 1 -- 172.21.15.60:0/2389632059 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f151c155530 con 0x7f151c0a6c10 2024-09-12T02:39:01.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.546+0000 7f151b7fe640 1 --2- 172.21.15.60:0/2389632059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f151c0a6c10 0x7f151c0ad270 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1514009e50 tx=0x7f1514004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:01.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.546+0000 7f1503fff640 1 -- 172.21.15.60:0/2389632059 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1514041030 con 0x7f151c0a6c10 2024-09-12T02:39:01.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.546+0000 7f1503fff640 1 -- 172.21.15.60:0/2389632059 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1514031400 con 0x7f151c0a6c10 2024-09-12T02:39:01.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.547+0000 7f1503fff640 1 -- 172.21.15.60:0/2389632059 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1514036040 con 0x7f151c0a6c10 2024-09-12T02:39:01.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.547+0000 7f1521f11640 1 -- 172.21.15.60:0/2389632059 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f151c0aae00 con 0x7f151c0a6c10 2024-09-12T02:39:01.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.547+0000 7f1521f11640 1 -- 172.21.15.60:0/2389632059 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f151c0aca50 con 0x7f151c0a6c10 2024-09-12T02:39:01.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.548+0000 7f1521f11640 1 -- 172.21.15.60:0/2389632059 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f151c0acc90 con 0x7f151c0a6c10 2024-09-12T02:39:01.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.549+0000 7f1503fff640 1 -- 172.21.15.60:0/2389632059 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1514044070 con 0x7f151c0a6c10 2024-09-12T02:39:01.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.550+0000 7f1503fff640 1 --2- 172.21.15.60:0/2389632059 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f150806be30 0x7f150806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:01.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.550+0000 7f1503fff640 1 -- 172.21.15.60:0/2389632059 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f15140abbf0 con 0x7f151c0a6c10 2024-09-12T02:39:01.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.552+0000 7f151affd640 1 --2- 172.21.15.60:0/2389632059 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f150806be30 0x7f150806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:01.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.553+0000 7f151affd640 1 --2- 172.21.15.60:0/2389632059 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f150806be30 0x7f150806e2f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f151c158180 tx=0x7f150c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:01.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:01.558+0000 7f1503fff640 1 -- 172.21.15.60:0/2389632059 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f151c0acc90 con 0x7f151c0a6c10 2024-09-12T02:39:02.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.025+0000 7f1521f11640 1 -- 172.21.15.60:0/2389632059 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f151c0c2440 con 0x7f151c0a6c10 2024-09-12T02:39:02.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.026+0000 7f1503fff640 1 -- 172.21.15.60:0/2389632059 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1566 (secure 0 0 0) 0x7f151404b070 con 0x7f151c0a6c10 2024-09-12T02:39:02.027 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":152,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:39:02.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.029+0000 7f1521f11640 1 -- 172.21.15.60:0/2389632059 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f150806be30 msgr2=0x7f150806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:02.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.029+0000 7f1521f11640 1 --2- 172.21.15.60:0/2389632059 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f150806be30 0x7f150806e2f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f151c158180 tx=0x7f150c009040 comp rx=0 tx=0).stop 2024-09-12T02:39:02.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.029+0000 7f1521f11640 1 -- 172.21.15.60:0/2389632059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f151c0a6c10 msgr2=0x7f151c0ad270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:02.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.029+0000 7f1521f11640 1 --2- 172.21.15.60:0/2389632059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f151c0a6c10 0x7f151c0ad270 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1514009e50 tx=0x7f1514004a40 comp rx=0 tx=0).stop 2024-09-12T02:39:02.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.030+0000 7f1521f11640 1 -- 172.21.15.60:0/2389632059 shutdown_connections 2024-09-12T02:39:02.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.030+0000 7f1521f11640 1 --2- 172.21.15.60:0/2389632059 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f150806be30 0x7f150806e2f0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:02.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.030+0000 7f1521f11640 1 --2- 172.21.15.60:0/2389632059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f151c0c6010 0x7f151c15d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:02.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.030+0000 7f1521f11640 1 --2- 172.21.15.60:0/2389632059 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f151c0c5940 0x7f151c154ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:02.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.030+0000 7f1521f11640 1 --2- 172.21.15.60:0/2389632059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f151c0a6c10 0x7f151c0ad270 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:02.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.030+0000 7f1521f11640 1 -- 172.21.15.60:0/2389632059 >> 172.21.15.60:0/2389632059 conn(0x7f151c0c7a40 msgr2=0x7f151c0c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:02.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.030+0000 7f1521f11640 1 -- 172.21.15.60:0/2389632059 shutdown_connections 2024-09-12T02:39:02.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.030+0000 7f1521f11640 1 -- 172.21.15.60:0/2389632059 wait complete. 2024-09-12T02:39:02.052 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-12T02:39:02.052 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-12T02:39:02.052 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-12T02:39:02.052 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-12T02:39:02.138 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:39:02.140 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:39:02.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.242+0000 7f575348c640 1 Processor -- start 2024-09-12T02:39:02.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.242+0000 7f575348c640 1 -- start start 2024-09-12T02:39:02.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.243+0000 7f575348c640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f574c06ce60 0x7f574c0c7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:02.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.244+0000 7f575348c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f574c0bdb10 0x7f574c073d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:02.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.244+0000 7f5751228640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f574c06ce60 0x7f574c0c7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:02.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.244+0000 7f5751228640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f574c06ce60 0x7f574c0c7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:60604/0 (socket says 172.21.15.60:60604) 2024-09-12T02:39:02.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.244+0000 7f5751228640 1 -- 172.21.15.60:0/4129070914 learned_addr learned my addr 172.21.15.60:0/4129070914 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:39:02.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.244+0000 7f575348c640 1 --2- 172.21.15.60:0/4129070914 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f574c074290 0x7f574c06ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:02.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.244+0000 7f575348c640 1 -- 172.21.15.60:0/4129070914 --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f574c0c88e0 con 0x7f574c0bdb10 2024-09-12T02:39:02.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.244+0000 7f575348c640 1 -- 172.21.15.60:0/4129070914 --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f574c06e750 con 0x7f574c06ce60 2024-09-12T02:39:02.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.244+0000 7f575348c640 1 -- 172.21.15.60:0/4129070914 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f574c074700 con 0x7f574c074290 2024-09-12T02:39:02.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.245+0000 7f5750a27640 1 --2- 172.21.15.60:0/4129070914 >> v2:172.21.15.60:3300/0 conn(0x7f574c0bdb10 0x7f574c073d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:02.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.245+0000 7f5751228640 1 -- 172.21.15.60:0/4129070914 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f574c074290 msgr2=0x7f574c06ebe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:39:02.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.245+0000 7f5751228640 1 --2- 172.21.15.60:0/4129070914 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f574c074290 0x7f574c06ebe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:02.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.245+0000 7f5751228640 1 -- 172.21.15.60:0/4129070914 >> v2:172.21.15.60:3300/0 conn(0x7f574c0bdb10 msgr2=0x7f574c073d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:02.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.245+0000 7f5751228640 1 --2- 172.21.15.60:0/4129070914 >> v2:172.21.15.60:3300/0 conn(0x7f574c0bdb10 0x7f574c073d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:02.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.245+0000 7f5751228640 1 -- 172.21.15.60:0/4129070914 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f574c0c8320 con 0x7f574c06ce60 2024-09-12T02:39:02.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.246+0000 7f5751228640 1 --2- 172.21.15.60:0/4129070914 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f574c06ce60 0x7f574c0c7d40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f574c076170 tx=0x7f574802a0e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12093e55f1925b03 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:02.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.247+0000 7f5743fff640 1 -- 172.21.15.60:0/4129070914 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5748037070 con 0x7f574c06ce60 2024-09-12T02:39:02.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.247+0000 7f5743fff640 1 -- 172.21.15.60:0/4129070914 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f574802ae30 con 0x7f574c06ce60 2024-09-12T02:39:02.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.247+0000 7f5743fff640 1 -- 172.21.15.60:0/4129070914 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5748032640 con 0x7f574c06ce60 2024-09-12T02:39:02.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.248+0000 7f575348c640 1 -- 172.21.15.60:0/4129070914 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f574c06ce60 msgr2=0x7f574c0c7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:02.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.248+0000 7f575348c640 1 --2- 172.21.15.60:0/4129070914 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f574c06ce60 0x7f574c0c7d40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f574c076170 tx=0x7f574802a0e0 comp rx=0 tx=0).stop 2024-09-12T02:39:02.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.248+0000 7f575348c640 1 -- 172.21.15.60:0/4129070914 shutdown_connections 2024-09-12T02:39:02.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.248+0000 7f575348c640 1 --2- 172.21.15.60:0/4129070914 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f574c074290 0x7f574c06ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:02.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.248+0000 7f575348c640 1 --2- 172.21.15.60:0/4129070914 >> v2:172.21.15.60:3300/0 conn(0x7f574c0bdb10 0x7f574c073d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:02.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.248+0000 7f575348c640 1 --2- 172.21.15.60:0/4129070914 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f574c06ce60 0x7f574c0c7d40 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:02.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.248+0000 7f575348c640 1 -- 172.21.15.60:0/4129070914 >> 172.21.15.60:0/4129070914 conn(0x7f574c0c55f0 msgr2=0x7f574c0c59d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:02.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.248+0000 7f575348c640 1 -- 172.21.15.60:0/4129070914 shutdown_connections 2024-09-12T02:39:02.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.248+0000 7f575348c640 1 -- 172.21.15.60:0/4129070914 wait complete. 2024-09-12T02:39:02.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.250+0000 7f575348c640 1 Processor -- start 2024-09-12T02:39:02.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.250+0000 7f575348c640 1 -- start start 2024-09-12T02:39:02.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.251+0000 7f575348c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f574c06ce60 0x7f574c0c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:02.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.252+0000 7f575348c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f574c074290 0x7f574c0c2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:02.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.252+0000 7f575348c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f574c0bdb10 0x7f574c0aca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:02.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.252+0000 7f5751228640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f574c06ce60 0x7f574c0c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:02.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.252+0000 7f5750a27640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f574c074290 0x7f574c0c2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:02.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.252+0000 7f5751228640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f574c06ce60 0x7f574c0c26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:37276/0 (socket says 172.21.15.60:37276) 2024-09-12T02:39:02.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.252+0000 7f5750a27640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f574c074290 0x7f574c0c2c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60714/0 (socket says 172.21.15.60:60714) 2024-09-12T02:39:02.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.252+0000 7f5751228640 1 -- 172.21.15.60:0/2731269506 learned_addr learned my addr 172.21.15.60:0/2731269506 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:39:02.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.252+0000 7f575348c640 1 -- 172.21.15.60:0/2731269506 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f574c0bee40 con 0x7f574c074290 2024-09-12T02:39:02.271 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:39:02.271 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:39:02.271 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:39:02.271 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:39:02.271 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 152, 2024-09-12T02:39:02.272 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 82044, 2024-09-12T02:39:02.272 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:39:02.272 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:39:02.272 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:39:02.272 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:39:02.272 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:02.272 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 15, 2024-09-12T02:39:02.272 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:39:02.272 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:39:02.272 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:39:02.272 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:39:02.272 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:39:02.273 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:39:02.273 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:39:02.273 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:39:02.273 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:39:02.273 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:39:02.273 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:39:02.273 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:39:02.273 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:39:02.273 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:39:02.273 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:02.273 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:39:02.274 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:39:02.274 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:39:02.274 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:39:02.274 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:39:02.274 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:39:02.274 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:39:02.274 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:39:02.274 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:39:02.274 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:39:02.274 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:39:02.274 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:39:02.274 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:39:02.274 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:02.275 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:02.275 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:39:02.275 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:39:02.275 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:39:02.275 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:39:02.275 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:39:02.275 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:39:02.275 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:39:02.275 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:39:02.275 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:39:02.275 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:39:02.275 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:39:02.275 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:39:02.275 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:39:02.276 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:39:02.276 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:39:02.276 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:39:02.276 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:39:02.276 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:39:02.276 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:39:02.276 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:39:02.276 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:39:02.276 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:39:02.276 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:39:02.276 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:39:02.276 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:39:02.277 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:39:02.277 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:39:02.277 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:39:02.277 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:02.277 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:39:02.277 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:02.277 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:39:02.277 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:02.277 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:39:02.277 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:39:02.277 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:39:02.277 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:39:02.278 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:02.278 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:39:02.278 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:39:02.278 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:02.278 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:02.278 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:02.278 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:39:02.278 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:39:02.278 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:02.278 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:02.278 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:02.278 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:02.278 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:39:02.278 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:39:02.279 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:39:02.279 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:39:02.279 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:39:02.279 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:02.279 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:02.279 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:39:02.279 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:39:02.279 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:39:02.279 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:39:02.279 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:02.279 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:39:02.279 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:39:02.279 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:02.279 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:02.280 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:02.280 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:39:02.280 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:39:02.280 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:02.280 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:02.280 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:02.281 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:02.281 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:39:02.281 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:39:02.281 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:39:02.281 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:39:02.281 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:39:02.281 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:02.281 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:02.281 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:39:02.281 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:39:02.281 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:39:02.282 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:39:02.282 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:02.282 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:39:02.282 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:39:02.282 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:02.282 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:02.282 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:02.282 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:39:02.282 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:39:02.282 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:02.282 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:02.282 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:02.283 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:02.283 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:39:02.283 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:39:02.283 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:39:02.283 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:39:02.283 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:39:02.283 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:02.283 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:02.283 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:02.283 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:39:02.283 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:39:02.283 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:02.283 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:39:02.284 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:39:02.284 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:39:02.284 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:02.284 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:02.284 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:39:02.284 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:02.284 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:39:02.284 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:39:02.284 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:39:02.284 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:02.284 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:02.284 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:39:02.284 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:02.284 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:39:02.285 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:39:02.285 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:39:02.285 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:02.285 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:02.285 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:39:02.285 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:02.285 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:39:02.285 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:39:02.285 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 5 2024-09-12T02:39:02.285 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:02.285 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:02.285 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:39:02.285 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:02.286 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:39:02.286 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:39:02.286 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:39:02.286 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:02.286 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:02.286 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:02.286 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:39:02.286 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:39:02.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.252+0000 7f5751a29640 1 --2- 172.21.15.60:0/2731269506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f574c0bdb10 0x7f574c0aca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:02.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.252+0000 7f575348c640 1 -- 172.21.15.60:0/2731269506 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f574c06e3e0 con 0x7f574c0bdb10 2024-09-12T02:39:02.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.252+0000 7f575348c640 1 -- 172.21.15.60:0/2731269506 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f574c0befc0 con 0x7f574c06ce60 2024-09-12T02:39:02.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.253+0000 7f5751a29640 1 -- 172.21.15.60:0/2731269506 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f574c06ce60 msgr2=0x7f574c0c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:02.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.253+0000 7f5751a29640 1 --2- 172.21.15.60:0/2731269506 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f574c06ce60 0x7f574c0c26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:02.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.253+0000 7f5751a29640 1 -- 172.21.15.60:0/2731269506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f574c074290 msgr2=0x7f574c0c2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:02.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.253+0000 7f5751a29640 1 --2- 172.21.15.60:0/2731269506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f574c074290 0x7f574c0c2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:02.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.253+0000 7f5751a29640 1 -- 172.21.15.60:0/2731269506 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f574c1dec50 con 0x7f574c0bdb10 2024-09-12T02:39:02.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.253+0000 7f5751a29640 1 --2- 172.21.15.60:0/2731269506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f574c0bdb10 0x7f574c0aca70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f574400be50 tx=0x7f574400bf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:02.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.256+0000 7f5741ffb640 1 -- 172.21.15.60:0/2731269506 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5744019070 con 0x7f574c0bdb10 2024-09-12T02:39:02.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.257+0000 7f5741ffb640 1 -- 172.21.15.60:0/2731269506 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5744014440 con 0x7f574c0bdb10 2024-09-12T02:39:02.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.257+0000 7f5741ffb640 1 -- 172.21.15.60:0/2731269506 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5744014830 con 0x7f574c0bdb10 2024-09-12T02:39:02.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.257+0000 7f575348c640 1 -- 172.21.15.60:0/2731269506 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f574c1df2a0 con 0x7f574c0bdb10 2024-09-12T02:39:02.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.258+0000 7f575348c640 1 -- 172.21.15.60:0/2731269506 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f574c1ed280 con 0x7f574c0bdb10 2024-09-12T02:39:02.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.259+0000 7f575348c640 1 --2- 172.21.15.60:0/2731269506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f574c0acfb0 0x7f574c0ad390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:02.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.259+0000 7f575348c640 1 -- 172.21.15.60:0/2731269506 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f574c1ed560 con 0x7f574c0acfb0 2024-09-12T02:39:02.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.260+0000 7f5751228640 1 --2- 172.21.15.60:0/2731269506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f574c0acfb0 0x7f574c0ad390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:02.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.261+0000 7f5751228640 1 -- 172.21.15.60:0/2731269506 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f574c0a9990 con 0x7f574c0acfb0 2024-09-12T02:39:02.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.261+0000 7f5751228640 1 --2- 172.21.15.60:0/2731269506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f574c0acfb0 0x7f574c0ad390 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f574c070420 tx=0x7f57480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:02.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.262+0000 7f5741ffb640 1 -- 172.21.15.60:0/2731269506 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5748065070 con 0x7f574c0acfb0 2024-09-12T02:39:02.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.262+0000 7f5741ffb640 1 -- 172.21.15.60:0/2731269506 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f574805e650 con 0x7f574c0acfb0 2024-09-12T02:39:02.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.262+0000 7f5741ffb640 1 -- 172.21.15.60:0/2731269506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f574c0acfb0 msgr2=0x7f574c0ad390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:02.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.262+0000 7f5741ffb640 1 --2- 172.21.15.60:0/2731269506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f574c0acfb0 0x7f574c0ad390 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f574c070420 tx=0x7f57480046c0 comp rx=0 tx=0).stop 2024-09-12T02:39:02.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.262+0000 7f5741ffb640 1 -- 172.21.15.60:0/2731269506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f574c0acfb0 msgr2=0x7f574c0ad390 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:39:02.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.262+0000 7f5741ffb640 1 --2- 172.21.15.60:0/2731269506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f574c0acfb0 0x7f574c0ad390 secure :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f574c070420 tx=0x7f57480046c0 comp rx=0 tx=0).stop 2024-09-12T02:39:02.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.262+0000 7f5741ffb640 1 -- 172.21.15.60:0/2731269506 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f574401c360 con 0x7f574c0bdb10 2024-09-12T02:39:02.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.263+0000 7f5741ffb640 1 --2- 172.21.15.60:0/2731269506 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f573006b990 0x7f573006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:02.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.263+0000 7f5741ffb640 1 -- 172.21.15.60:0/2731269506 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f574408ae80 con 0x7f574c0bdb10 2024-09-12T02:39:02.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.263+0000 7f5751228640 1 --2- 172.21.15.60:0/2731269506 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f573006b990 0x7f573006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:02.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.264+0000 7f5751228640 1 --2- 172.21.15.60:0/2731269506 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f573006b990 0x7f573006de50 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5748064000 tx=0x7f574806c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:02.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.269+0000 7f575348c640 1 --2- 172.21.15.60:0/2731269506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f574c1dcc90 0x7f574c1dd070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:02.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.269+0000 7f575348c640 1 -- 172.21.15.60:0/2731269506 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f574c151a50 con 0x7f574c1dcc90 2024-09-12T02:39:02.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.269+0000 7f5750a27640 1 --2- 172.21.15.60:0/2731269506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f574c1dcc90 0x7f574c1dd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:02.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.270+0000 7f5750a27640 1 -- 172.21.15.60:0/2731269506 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f574c06d3f0 con 0x7f574c1dcc90 2024-09-12T02:39:02.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.270+0000 7f5750a27640 1 --2- 172.21.15.60:0/2731269506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f574c1dcc90 0x7f574c1dd070 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f574c0c6d10 tx=0x7f573c011d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:02.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.270+0000 7f5741ffb640 1 -- 172.21.15.60:0/2731269506 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f573c019070 con 0x7f574c1dcc90 2024-09-12T02:39:02.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.270+0000 7f5741ffb640 1 -- 172.21.15.60:0/2731269506 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5053 (secure 0 0 0) 0x7f573c004300 con 0x7f574c1dcc90 2024-09-12T02:39:02.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.270+0000 7f5741ffb640 1 -- 172.21.15.60:0/2731269506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f574c1dcc90 msgr2=0x7f574c1dd070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:02.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.270+0000 7f5741ffb640 1 --2- 172.21.15.60:0/2731269506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f574c1dcc90 0x7f574c1dd070 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f574c0c6d10 tx=0x7f573c011d40 comp rx=0 tx=0).stop 2024-09-12T02:39:02.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.270+0000 7f5741ffb640 1 -- 172.21.15.60:0/2731269506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f574c1dcc90 msgr2=0x7f574c1dd070 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:39:02.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.270+0000 7f5741ffb640 1 --2- 172.21.15.60:0/2731269506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f574c1dcc90 0x7f574c1dd070 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:02.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.271+0000 7f572f7fe640 1 -- 172.21.15.60:0/2731269506 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f573006b990 msgr2=0x7f573006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:02.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.271+0000 7f572f7fe640 1 --2- 172.21.15.60:0/2731269506 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f573006b990 0x7f573006de50 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5748064000 tx=0x7f574806c040 comp rx=0 tx=0).stop 2024-09-12T02:39:02.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.271+0000 7f572f7fe640 1 -- 172.21.15.60:0/2731269506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f574c0bdb10 msgr2=0x7f574c0aca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:02.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.271+0000 7f572f7fe640 1 --2- 172.21.15.60:0/2731269506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f574c0bdb10 0x7f574c0aca70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f574400be50 tx=0x7f574400bf40 comp rx=0 tx=0).stop 2024-09-12T02:39:02.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.271+0000 7f5751a29640 1 -- 172.21.15.60:0/2731269506 reap_dead start 2024-09-12T02:39:02.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.271+0000 7f5751a29640 1 -- 172.21.15.60:0/2731269506 reap_dead start 2024-09-12T02:39:02.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.271+0000 7f572f7fe640 1 -- 172.21.15.60:0/2731269506 shutdown_connections 2024-09-12T02:39:02.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.271+0000 7f572f7fe640 1 -- 172.21.15.60:0/2731269506 >> 172.21.15.60:0/2731269506 conn(0x7f574c0c55f0 msgr2=0x7f574c0c59d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:02.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.271+0000 7f572f7fe640 1 -- 172.21.15.60:0/2731269506 shutdown_connections 2024-09-12T02:39:02.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.271+0000 7f572f7fe640 1 -- 172.21.15.60:0/2731269506 wait complete. 2024-09-12T02:39:02.297 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:39:02.297 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-12T02:39:02.297 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-12T02:39:02.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.465+0000 7f6834cd0640 1 Processor -- start 2024-09-12T02:39:02.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.465+0000 7f6834cd0640 1 -- start start 2024-09-12T02:39:02.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.467+0000 7f6834cd0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68300c7f80 0x7f68300c7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:02.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.467+0000 7f6834cd0640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6830153b40 0x7f68300a7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:02.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.467+0000 7f6834cd0640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6830153f70 con 0x7f68300adae0 2024-09-12T02:39:02.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.467+0000 7f6834cd0640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f6830154bb0 con 0x7f6830153b40 2024-09-12T02:39:02.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.467+0000 7f6834cd0640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f68300c8720 con 0x7f68300c7f80 2024-09-12T02:39:02.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.467+0000 7f682dd9b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68300c7f80 0x7f68300c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:02.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.467+0000 7f682dd9b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68300c7f80 0x7f68300c7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:37284/0 (socket says 172.21.15.60:37284) 2024-09-12T02:39:02.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.467+0000 7f682dd9b640 1 -- 172.21.15.60:0/4170090120 learned_addr learned my addr 172.21.15.60:0/4170090120 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:39:02.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.467+0000 7f682ed9d640 1 --2- 172.21.15.60:0/4170090120 >> v2:172.21.15.105:3300/0 conn(0x7f6830153b40 0x7f68300a7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:02.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.468+0000 7f682dd9b640 1 -- 172.21.15.60:0/4170090120 >> v2:172.21.15.105:3300/0 conn(0x7f6830153b40 msgr2=0x7f68300a7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:02.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.468+0000 7f682dd9b640 1 --2- 172.21.15.60:0/4170090120 >> v2:172.21.15.105:3300/0 conn(0x7f6830153b40 0x7f68300a7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:02.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.468+0000 7f682dd9b640 1 -- 172.21.15.60:0/4170090120 >> v1:172.21.15.60:6789/0 conn(0x7f68300adae0 legacy=0x7f68301544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:02.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.468+0000 7f682dd9b640 1 -- 172.21.15.60:0/4170090120 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68300c8440 con 0x7f68300c7f80 2024-09-12T02:39:02.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.468+0000 7f682ed9d640 1 --2- 172.21.15.60:0/4170090120 >> v2:172.21.15.105:3300/0 conn(0x7f6830153b40 0x7f68300a7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:39:02.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.469+0000 7f682dd9b640 1 --2- 172.21.15.60:0/4170090120 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68300c7f80 0x7f68300c7700 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6824009870 tx=0x7f682402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eaec06492f74ef35 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:02.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.469+0000 7f682d59a640 1 -- 172.21.15.60:0/4170090120 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6824037070 con 0x7f68300c7f80 2024-09-12T02:39:02.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.469+0000 7f682d59a640 1 -- 172.21.15.60:0/4170090120 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6824032440 con 0x7f68300c7f80 2024-09-12T02:39:02.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.469+0000 7f682d59a640 1 -- 172.21.15.60:0/4170090120 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6824032810 con 0x7f68300c7f80 2024-09-12T02:39:02.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.470+0000 7f6834cd0640 1 -- 172.21.15.60:0/4170090120 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68300c7f80 msgr2=0x7f68300c7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:02.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.470+0000 7f6834cd0640 1 --2- 172.21.15.60:0/4170090120 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68300c7f80 0x7f68300c7700 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6824009870 tx=0x7f682402a180 comp rx=0 tx=0).stop 2024-09-12T02:39:02.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.471+0000 7f6834cd0640 1 -- 172.21.15.60:0/4170090120 shutdown_connections 2024-09-12T02:39:02.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.471+0000 7f6834cd0640 1 --2- 172.21.15.60:0/4170090120 >> v2:172.21.15.105:3300/0 conn(0x7f6830153b40 0x7f68300a7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:02.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.471+0000 7f6834cd0640 1 --2- 172.21.15.60:0/4170090120 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68300c7f80 0x7f68300c7700 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:02.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.471+0000 7f6834cd0640 1 -- 172.21.15.60:0/4170090120 >> 172.21.15.60:0/4170090120 conn(0x7f68300c8bf0 msgr2=0x7f68300c8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:02.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.471+0000 7f6834cd0640 1 -- 172.21.15.60:0/4170090120 shutdown_connections 2024-09-12T02:39:02.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.471+0000 7f6834cd0640 1 -- 172.21.15.60:0/4170090120 wait complete. 2024-09-12T02:39:02.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.473+0000 7f6834cd0640 1 Processor -- start 2024-09-12T02:39:02.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.473+0000 7f6834cd0640 1 -- start start 2024-09-12T02:39:02.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.474+0000 7f6834cd0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68300adae0 0x7f68300c2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:02.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.474+0000 7f6834cd0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68300c7f80 0x7f683014f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:02.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.474+0000 7f6834cd0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6830153b40 0x7f683014fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:02.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.474+0000 7f6834cd0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f68300c71e0 con 0x7f68300adae0 2024-09-12T02:39:02.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.474+0000 7f6834cd0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f68300c6f00 con 0x7f6830153b40 2024-09-12T02:39:02.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.474+0000 7f6834cd0640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f68300abea0 con 0x7f68300c7f80 2024-09-12T02:39:02.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.476+0000 7f682ed9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6830153b40 0x7f683014fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:02.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.477+0000 7f682dd9b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68300c7f80 0x7f683014f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:02.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.477+0000 7f682ed9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6830153b40 0x7f683014fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:60624/0 (socket says 172.21.15.60:60624) 2024-09-12T02:39:02.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.477+0000 7f682ed9d640 1 -- 172.21.15.60:0/940831506 learned_addr learned my addr 172.21.15.60:0/940831506 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:39:02.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.477+0000 7f682e59c640 1 --2- 172.21.15.60:0/940831506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68300adae0 0x7f68300c2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:02.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.477+0000 7f682ed9d640 1 -- 172.21.15.60:0/940831506 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68300c7f80 msgr2=0x7f683014f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:02.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.477+0000 7f682ed9d640 1 --2- 172.21.15.60:0/940831506 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68300c7f80 0x7f683014f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:02.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.477+0000 7f682ed9d640 1 -- 172.21.15.60:0/940831506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68300adae0 msgr2=0x7f68300c2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:02.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.477+0000 7f682ed9d640 1 --2- 172.21.15.60:0/940831506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68300adae0 0x7f68300c2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:02.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.477+0000 7f682ed9d640 1 -- 172.21.15.60:0/940831506 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68301ec420 con 0x7f6830153b40 2024-09-12T02:39:02.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.478+0000 7f682e59c640 1 --2- 172.21.15.60:0/940831506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68300adae0 0x7f68300c2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:39:02.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.479+0000 7f682ed9d640 1 --2- 172.21.15.60:0/940831506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6830153b40 0x7f683014fb30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f682800efc0 tx=0x7f6828009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:02.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.479+0000 7f681effd640 1 -- 172.21.15.60:0/940831506 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6828018030 con 0x7f6830153b40 2024-09-12T02:39:02.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.480+0000 7f681effd640 1 -- 172.21.15.60:0/940831506 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f682800cde0 con 0x7f6830153b40 2024-09-12T02:39:02.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.480+0000 7f681effd640 1 -- 172.21.15.60:0/940831506 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6828003bb0 con 0x7f6830153b40 2024-09-12T02:39:02.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.480+0000 7f6834cd0640 1 -- 172.21.15.60:0/940831506 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68301ec6a0 con 0x7f6830153b40 2024-09-12T02:39:02.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.480+0000 7f6834cd0640 1 -- 172.21.15.60:0/940831506 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6830150720 con 0x7f6830153b40 2024-09-12T02:39:02.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.481+0000 7f6834cd0640 1 --2- 172.21.15.60:0/940831506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6830071b40 0x7f68301561d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:02.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.481+0000 7f6834cd0640 1 -- 172.21.15.60:0/940831506 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f68301ec980 con 0x7f6830071b40 2024-09-12T02:39:02.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.481+0000 7f682e59c640 1 --2- 172.21.15.60:0/940831506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6830071b40 0x7f68301561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:02.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.482+0000 7f682e59c640 1 -- 172.21.15.60:0/940831506 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f68300adec0 con 0x7f6830071b40 2024-09-12T02:39:02.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.482+0000 7f681effd640 1 -- 172.21.15.60:0/940831506 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6828005d10 con 0x7f6830153b40 2024-09-12T02:39:02.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.483+0000 7f682e59c640 1 --2- 172.21.15.60:0/940831506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6830071b40 0x7f68301561d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f682000c480 tx=0x7f682000c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:02.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.483+0000 7f681effd640 1 --2- 172.21.15.60:0/940831506 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f681006bf00 0x7f681006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:02.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.483+0000 7f681effd640 1 -- 172.21.15.60:0/940831506 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f682808bc00 con 0x7f6830153b40 2024-09-12T02:39:02.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.483+0000 7f682dd9b640 1 --2- 172.21.15.60:0/940831506 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f681006bf00 0x7f681006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:02.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.483+0000 7f681effd640 1 -- 172.21.15.60:0/940831506 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6820015070 con 0x7f6830071b40 2024-09-12T02:39:02.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.484+0000 7f681effd640 1 -- 172.21.15.60:0/940831506 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f6820011800 con 0x7f6830071b40 2024-09-12T02:39:02.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.484+0000 7f681effd640 1 -- 172.21.15.60:0/940831506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6830071b40 msgr2=0x7f68301561d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:02.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.484+0000 7f681effd640 1 --2- 172.21.15.60:0/940831506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6830071b40 0x7f68301561d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f682000c480 tx=0x7f682000c940 comp rx=0 tx=0).stop 2024-09-12T02:39:02.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.484+0000 7f681effd640 1 -- 172.21.15.60:0/940831506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6830071b40 msgr2=0x7f68301561d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:39:02.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.484+0000 7f681effd640 1 --2- 172.21.15.60:0/940831506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6830071b40 0x7f68301561d0 secure :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f682000c480 tx=0x7f682000c940 comp rx=0 tx=0).stop 2024-09-12T02:39:02.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.484+0000 7f682dd9b640 1 --2- 172.21.15.60:0/940831506 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f681006bf00 0x7f681006e3c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6824034000 tx=0x7f682402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:02.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.497+0000 7f6834cd0640 1 --2- 172.21.15.60:0/940831506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6830156710 0x7f68301eef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:02.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.497+0000 7f6834cd0640 1 -- 172.21.15.60:0/940831506 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f68300c6140 con 0x7f6830156710 2024-09-12T02:39:02.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.497+0000 7f682e59c640 1 --2- 172.21.15.60:0/940831506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6830156710 0x7f68301eef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:02.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.498+0000 7f682e59c640 1 -- 172.21.15.60:0/940831506 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6830150070 con 0x7f6830156710 2024-09-12T02:39:02.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.498+0000 7f682e59c640 1 --2- 172.21.15.60:0/940831506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6830156710 0x7f68301eef40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6820017000 tx=0x7f68200046b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:02.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.498+0000 7f681effd640 1 -- 172.21.15.60:0/940831506 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6820028020 con 0x7f6830156710 2024-09-12T02:39:02.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.499+0000 7f681effd640 1 -- 172.21.15.60:0/940831506 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5052 (secure 0 0 0) 0x7f682001ade0 con 0x7f6830156710 2024-09-12T02:39:02.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.499+0000 7f681effd640 1 -- 172.21.15.60:0/940831506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6830156710 msgr2=0x7f68301eef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:02.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.499+0000 7f681effd640 1 --2- 172.21.15.60:0/940831506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6830156710 0x7f68301eef40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6820017000 tx=0x7f68200046b0 comp rx=0 tx=0).stop 2024-09-12T02:39:02.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.499+0000 7f681effd640 1 -- 172.21.15.60:0/940831506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6830156710 msgr2=0x7f68301eef40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:39:02.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.499+0000 7f681effd640 1 --2- 172.21.15.60:0/940831506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6830156710 0x7f68301eef40 secure :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6820017000 tx=0x7f68200046b0 comp rx=0 tx=0).stop 2024-09-12T02:39:02.500 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:39:02.501 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:39:02.501 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:39:02.501 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:39:02.501 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 152, 2024-09-12T02:39:02.501 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 214077, 2024-09-12T02:39:02.501 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:39:02.501 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:39:02.501 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:39:02.501 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:39:02.501 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:02.501 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 15, 2024-09-12T02:39:02.502 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:39:02.502 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:39:02.502 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:39:02.502 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:39:02.502 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:39:02.502 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:39:02.502 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:39:02.502 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:39:02.502 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:39:02.502 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:39:02.503 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:39:02.503 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:39:02.503 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:39:02.503 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:39:02.503 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:02.503 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:39:02.503 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:39:02.503 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:39:02.503 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:39:02.504 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:39:02.504 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:39:02.504 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:39:02.504 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:39:02.504 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:39:02.504 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:39:02.504 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:39:02.504 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:39:02.504 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:39:02.504 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:02.504 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:02.504 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:39:02.505 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:39:02.505 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:39:02.505 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:39:02.505 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:39:02.505 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:39:02.505 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:39:02.505 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:39:02.505 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:39:02.505 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:39:02.506 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:39:02.506 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:39:02.506 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:39:02.506 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:39:02.506 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:39:02.506 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:39:02.506 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:39:02.506 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:39:02.506 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:39:02.507 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:39:02.507 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:39:02.507 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:39:02.507 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:39:02.507 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:39:02.507 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:39:02.507 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:39:02.507 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:39:02.507 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:39:02.507 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:02.507 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:39:02.508 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:02.508 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:39:02.508 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:02.508 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:39:02.508 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:39:02.508 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:39:02.508 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:39:02.508 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:02.508 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:39:02.508 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:39:02.508 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:02.509 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:02.509 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:02.509 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:39:02.509 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:39:02.509 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:02.509 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:02.509 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:02.509 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:02.509 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:39:02.509 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:39:02.509 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:39:02.510 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:39:02.510 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:39:02.510 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:02.510 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:02.510 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:39:02.510 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:39:02.510 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:39:02.510 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:39:02.510 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:02.510 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:39:02.510 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:39:02.511 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:02.511 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:02.511 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:02.511 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:39:02.511 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:39:02.511 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:02.511 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:02.511 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:02.511 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:02.511 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:39:02.511 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:39:02.512 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:39:02.512 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:39:02.512 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:39:02.512 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:02.512 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:02.512 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:39:02.512 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:39:02.512 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:39:02.512 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:39:02.512 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:02.513 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:39:02.513 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:39:02.513 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:02.513 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:02.513 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:02.513 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:39:02.513 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:39:02.513 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:02.513 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:02.514 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:02.514 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:02.514 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:39:02.514 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:39:02.514 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:39:02.514 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:39:02.514 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:39:02.514 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:02.514 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:02.514 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:02.515 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:39:02.515 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:39:02.515 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:02.515 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:39:02.515 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:39:02.515 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:39:02.515 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:02.515 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:02.515 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:39:02.515 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:02.516 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:39:02.516 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:39:02.516 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:39:02.516 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:02.516 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:02.516 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:39:02.516 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:02.516 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:39:02.517 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:39:02.517 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 6 2024-09-12T02:39:02.517 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:02.517 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:02.517 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:39:02.517 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:02.517 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:39:02.517 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:39:02.517 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:39:02.517 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:02.517 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:02.518 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:39:02.518 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:02.518 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:39:02.518 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:39:02.518 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:39:02.518 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:02.518 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:02.518 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:02.518 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:39:02.518 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:39:02.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.499+0000 7f6834cd0640 1 -- 172.21.15.60:0/940831506 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f681006bf00 msgr2=0x7f681006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:02.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.499+0000 7f6834cd0640 1 --2- 172.21.15.60:0/940831506 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f681006bf00 0x7f681006e3c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6824034000 tx=0x7f682402e000 comp rx=0 tx=0).stop 2024-09-12T02:39:02.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.499+0000 7f682ed9d640 1 -- 172.21.15.60:0/940831506 reap_dead start 2024-09-12T02:39:02.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.499+0000 7f6834cd0640 1 -- 172.21.15.60:0/940831506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6830153b40 msgr2=0x7f683014fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:02.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.499+0000 7f6834cd0640 1 --2- 172.21.15.60:0/940831506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6830153b40 0x7f683014fb30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f682800efc0 tx=0x7f6828009f90 comp rx=0 tx=0).stop 2024-09-12T02:39:02.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.500+0000 7f6834cd0640 1 -- 172.21.15.60:0/940831506 shutdown_connections 2024-09-12T02:39:02.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.500+0000 7f6834cd0640 1 --2- 172.21.15.60:0/940831506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6830153b40 0x7f683014fb30 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:02.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.500+0000 7f6834cd0640 1 -- 172.21.15.60:0/940831506 >> 172.21.15.60:0/940831506 conn(0x7f68300c8bf0 msgr2=0x7f68300a7cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:02.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.500+0000 7f6834cd0640 1 -- 172.21.15.60:0/940831506 shutdown_connections 2024-09-12T02:39:02.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.500+0000 7f6834cd0640 1 -- 172.21.15.60:0/940831506 wait complete. 2024-09-12T02:39:02.521 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:39:02.521 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-12T02:39:02.521 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-12T02:39:02.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.691+0000 7fca8359e640 1 Processor -- start 2024-09-12T02:39:02.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.691+0000 7fca8359e640 1 -- start start 2024-09-12T02:39:02.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.693+0000 7fca8359e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fca7c0d34e0 0x7fca7c0495e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:02.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.693+0000 7fca8359e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca7c00b0e0 0x7fca7c00b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:02.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.693+0000 7fca8359e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fca7c006000 0x7fca7c0064b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:02.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.693+0000 7fca8359e640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fca7c0d6bd0 con 0x7fca7c0d34e0 2024-09-12T02:39:02.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.693+0000 7fca8359e640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fca7c0d5d00 con 0x7fca7c006000 2024-09-12T02:39:02.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.693+0000 7fca8359e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fca7c0d5fc0 con 0x7fca7c00b0e0 2024-09-12T02:39:02.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.693+0000 7fca8259c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fca7c0d34e0 0x7fca7c0495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:02.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.693+0000 7fca8259c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fca7c0d34e0 0x7fca7c0495e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60756/0 (socket says 172.21.15.60:60756) 2024-09-12T02:39:02.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.693+0000 7fca8259c640 1 -- 172.21.15.60:0/2588384974 learned_addr learned my addr 172.21.15.60:0/2588384974 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:39:02.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.694+0000 7fca82d9d640 1 --2- 172.21.15.60:0/2588384974 >> v2:172.21.15.105:3300/0 conn(0x7fca7c006000 0x7fca7c0064b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:02.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.693+0000 7fca81d9b640 1 --2- 172.21.15.60:0/2588384974 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca7c00b0e0 0x7fca7c00b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:02.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.694+0000 7fca8259c640 1 -- 172.21.15.60:0/2588384974 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca7c00b0e0 msgr2=0x7fca7c00b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:02.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.694+0000 7fca8259c640 1 --2- 172.21.15.60:0/2588384974 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca7c00b0e0 0x7fca7c00b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:02.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.694+0000 7fca8259c640 1 -- 172.21.15.60:0/2588384974 >> v2:172.21.15.105:3300/0 conn(0x7fca7c006000 msgr2=0x7fca7c0064b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:02.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.694+0000 7fca8259c640 1 --2- 172.21.15.60:0/2588384974 >> v2:172.21.15.105:3300/0 conn(0x7fca7c006000 0x7fca7c0064b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:02.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.694+0000 7fca8259c640 1 -- 172.21.15.60:0/2588384974 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca7c0d62a0 con 0x7fca7c0d34e0 2024-09-12T02:39:02.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.696+0000 7fca8259c640 1 --2- 172.21.15.60:0/2588384974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca7c0d34e0 0x7fca7c0495e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fca7c02b060 tx=0x7fca7802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d111bed883df0cd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:02.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.696+0000 7fca8159a640 1 -- 172.21.15.60:0/2588384974 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca78037070 con 0x7fca7c0d34e0 2024-09-12T02:39:02.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.696+0000 7fca8159a640 1 -- 172.21.15.60:0/2588384974 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca78032440 con 0x7fca7c0d34e0 2024-09-12T02:39:02.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.696+0000 7fca8159a640 1 -- 172.21.15.60:0/2588384974 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca78032830 con 0x7fca7c0d34e0 2024-09-12T02:39:02.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.697+0000 7fca8359e640 1 -- 172.21.15.60:0/2588384974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca7c0d34e0 msgr2=0x7fca7c0495e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:02.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.697+0000 7fca8359e640 1 --2- 172.21.15.60:0/2588384974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca7c0d34e0 0x7fca7c0495e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fca7c02b060 tx=0x7fca7802a2a0 comp rx=0 tx=0).stop 2024-09-12T02:39:02.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.698+0000 7fca8359e640 1 -- 172.21.15.60:0/2588384974 shutdown_connections 2024-09-12T02:39:02.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.698+0000 7fca8359e640 1 --2- 172.21.15.60:0/2588384974 >> v2:172.21.15.105:3300/0 conn(0x7fca7c006000 0x7fca7c0064b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:02.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.698+0000 7fca8359e640 1 --2- 172.21.15.60:0/2588384974 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca7c00b0e0 0x7fca7c00b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:02.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.698+0000 7fca8359e640 1 --2- 172.21.15.60:0/2588384974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca7c0d34e0 0x7fca7c0495e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:02.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.698+0000 7fca8359e640 1 -- 172.21.15.60:0/2588384974 >> 172.21.15.60:0/2588384974 conn(0x7fca7c048160 msgr2=0x7fca7c048570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:02.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.698+0000 7fca8359e640 1 -- 172.21.15.60:0/2588384974 shutdown_connections 2024-09-12T02:39:02.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.698+0000 7fca8359e640 1 -- 172.21.15.60:0/2588384974 wait complete. 2024-09-12T02:39:02.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.700+0000 7fca8359e640 1 Processor -- start 2024-09-12T02:39:02.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.700+0000 7fca8359e640 1 -- start start 2024-09-12T02:39:02.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.702+0000 7fca8359e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca7c006000 0x7fca7c04a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:02.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.702+0000 7fca8359e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca7c00b0e0 0x7fca7c04aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:02.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.702+0000 7fca8359e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca7c0d0fd0 0x7fca7c0d1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:02.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.702+0000 7fca81d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca7c00b0e0 0x7fca7c04aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:02.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.702+0000 7fca8359e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fca7c007660 con 0x7fca7c00b0e0 2024-09-12T02:39:02.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.702+0000 7fca81d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca7c00b0e0 0x7fca7c04aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60762/0 (socket says 172.21.15.60:60762) 2024-09-12T02:39:02.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.702+0000 7fca81d9b640 1 -- 172.21.15.60:0/427800487 learned_addr learned my addr 172.21.15.60:0/427800487 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:39:02.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.702+0000 7fca8359e640 1 -- 172.21.15.60:0/427800487 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fca7c0d6860 con 0x7fca7c006000 2024-09-12T02:39:02.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.702+0000 7fca8359e640 1 -- 172.21.15.60:0/427800487 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fca7c0d38c0 con 0x7fca7c0d0fd0 2024-09-12T02:39:02.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.703+0000 7fca81d9b640 1 -- 172.21.15.60:0/427800487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca7c0d0fd0 msgr2=0x7fca7c0d1480 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:39:02.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.703+0000 7fca81d9b640 1 --2- 172.21.15.60:0/427800487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca7c0d0fd0 0x7fca7c0d1480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:02.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.703+0000 7fca81d9b640 1 -- 172.21.15.60:0/427800487 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca7c006000 msgr2=0x7fca7c04a4f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:39:02.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.703+0000 7fca81d9b640 1 --2- 172.21.15.60:0/427800487 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca7c006000 0x7fca7c04a4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:02.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.703+0000 7fca81d9b640 1 -- 172.21.15.60:0/427800487 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca7c04af70 con 0x7fca7c00b0e0 2024-09-12T02:39:02.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.704+0000 7fca81d9b640 1 --2- 172.21.15.60:0/427800487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca7c00b0e0 0x7fca7c04aa30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fca74007e90 tx=0x7fca7400dba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:02.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.704+0000 7fca72ffd640 1 -- 172.21.15.60:0/427800487 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca74004220 con 0x7fca7c00b0e0 2024-09-12T02:39:02.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.705+0000 7fca72ffd640 1 -- 172.21.15.60:0/427800487 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca740043c0 con 0x7fca7c00b0e0 2024-09-12T02:39:02.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.705+0000 7fca72ffd640 1 -- 172.21.15.60:0/427800487 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca74003810 con 0x7fca7c00b0e0 2024-09-12T02:39:02.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.705+0000 7fca8359e640 1 -- 172.21.15.60:0/427800487 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca7c16e9d0 con 0x7fca7c00b0e0 2024-09-12T02:39:02.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.708+0000 7fca72ffd640 1 -- 172.21.15.60:0/427800487 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fca740039b0 con 0x7fca7c00b0e0 2024-09-12T02:39:02.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.709+0000 7fca72ffd640 1 --2- 172.21.15.60:0/427800487 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fca6406be80 0x7fca6406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:02.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.709+0000 7fca8359e640 1 -- 172.21.15.60:0/427800487 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca7c0d24e0 con 0x7fca7c00b0e0 2024-09-12T02:39:02.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.709+0000 7fca8259c640 1 --2- 172.21.15.60:0/427800487 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fca6406be80 0x7fca6406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:02.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.710+0000 7fca8259c640 1 --2- 172.21.15.60:0/427800487 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fca6406be80 0x7fca6406e340 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fca78034000 tx=0x7fca7802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:02.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.710+0000 7fca72ffd640 1 -- 172.21.15.60:0/427800487 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fca7405a680 con 0x7fca7c00b0e0 2024-09-12T02:39:02.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.710+0000 7fca70ff9640 1 --2- 172.21.15.60:0/427800487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca7c0d26b0 0x7fca7c0c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:02.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.710+0000 7fca70ff9640 1 -- 172.21.15.60:0/427800487 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fca7c16e780 con 0x7fca7c0d26b0 2024-09-12T02:39:02.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.711+0000 7fca82d9d640 1 --2- 172.21.15.60:0/427800487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca7c0d26b0 0x7fca7c0c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:02.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.711+0000 7fca82d9d640 1 -- 172.21.15.60:0/427800487 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fca7c16ecb0 con 0x7fca7c0d26b0 2024-09-12T02:39:02.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.711+0000 7fca82d9d640 1 --2- 172.21.15.60:0/427800487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca7c0d26b0 0x7fca7c0c5c00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fca840504d0 tx=0x7fca840699a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:02.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.712+0000 7fca72ffd640 1 -- 172.21.15.60:0/427800487 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca84067b50 con 0x7fca7c0d26b0 2024-09-12T02:39:02.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.712+0000 7fca72ffd640 1 -- 172.21.15.60:0/427800487 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fca84067b50 con 0x7fca7c0d26b0 2024-09-12T02:39:02.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.712+0000 7fca72ffd640 1 -- 172.21.15.60:0/427800487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca7c0d26b0 msgr2=0x7fca7c0c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:02.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.712+0000 7fca72ffd640 1 --2- 172.21.15.60:0/427800487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca7c0d26b0 0x7fca7c0c5c00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fca840504d0 tx=0x7fca840699a0 comp rx=0 tx=0).stop 2024-09-12T02:39:02.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.712+0000 7fca72ffd640 1 -- 172.21.15.60:0/427800487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca7c0d26b0 msgr2=0x7fca7c0c5c00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:39:02.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.712+0000 7fca72ffd640 1 --2- 172.21.15.60:0/427800487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca7c0d26b0 0x7fca7c0c5c00 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:02.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.725+0000 7fca70ff9640 1 --2- 172.21.15.60:0/427800487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca7c0d19c0 0x7fca7c171270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:02.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.725+0000 7fca70ff9640 1 -- 172.21.15.60:0/427800487 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fca7c0de670 con 0x7fca7c0d19c0 2024-09-12T02:39:02.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.725+0000 7fca82d9d640 1 --2- 172.21.15.60:0/427800487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca7c0d19c0 0x7fca7c171270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:02.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.726+0000 7fca82d9d640 1 -- 172.21.15.60:0/427800487 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fca7c004b00 con 0x7fca7c0d19c0 2024-09-12T02:39:02.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.727+0000 7fca82d9d640 1 --2- 172.21.15.60:0/427800487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca7c0d19c0 0x7fca7c171270 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fca8407ca70 tx=0x7fca84069e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:02.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.727+0000 7fca72ffd640 1 -- 172.21.15.60:0/427800487 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8409b980 con 0x7fca7c0d19c0 2024-09-12T02:39:02.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.727+0000 7fca72ffd640 1 -- 172.21.15.60:0/427800487 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4550 (secure 0 0 0) 0x7fca840a5430 con 0x7fca7c0d19c0 2024-09-12T02:39:02.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.728+0000 7fca72ffd640 1 -- 172.21.15.60:0/427800487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca7c0d19c0 msgr2=0x7fca7c171270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:02.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.728+0000 7fca72ffd640 1 --2- 172.21.15.60:0/427800487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca7c0d19c0 0x7fca7c171270 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fca8407ca70 tx=0x7fca84069e30 comp rx=0 tx=0).stop 2024-09-12T02:39:02.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.728+0000 7fca72ffd640 1 -- 172.21.15.60:0/427800487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca7c0d19c0 msgr2=0x7fca7c171270 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:39:02.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.728+0000 7fca72ffd640 1 --2- 172.21.15.60:0/427800487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca7c0d19c0 0x7fca7c171270 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:02.729 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:39:02.729 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:39:02.729 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:39:02.729 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:39:02.729 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 152, 2024-09-12T02:39:02.729 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 20666, 2024-09-12T02:39:02.729 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:39:02.730 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:39:02.730 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:39:02.730 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:39:02.730 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:02.730 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 15, 2024-09-12T02:39:02.730 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:39:02.730 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:39:02.730 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:39:02.730 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:39:02.730 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:39:02.731 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:39:02.731 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:39:02.731 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:39:02.731 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:39:02.731 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:39:02.731 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:39:02.731 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:39:02.731 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:39:02.731 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:39:02.731 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:02.731 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:39:02.731 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:39:02.731 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:39:02.732 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:39:02.732 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:39:02.732 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:39:02.732 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:39:02.732 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:39:02.732 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:39:02.732 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:39:02.732 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:39:02.732 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:39:02.732 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:39:02.732 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:02.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:02.732 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:39:02.733 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:39:02.733 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:39:02.733 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:39:02.733 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:39:02.733 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:39:02.733 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:39:02.733 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:39:02.733 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:39:02.733 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:39:02.733 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:39:02.733 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:39:02.733 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:39:02.734 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:39:02.734 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:39:02.734 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:39:02.734 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:39:02.734 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:39:02.734 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:39:02.734 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:39:02.734 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:39:02.734 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:39:02.734 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:39:02.734 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:39:02.734 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:39:02.734 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:39:02.735 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:39:02.735 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:39:02.735 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:02.735 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:39:02.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:02.735 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:39:02.735 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:02.735 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:39:02.735 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:39:02.735 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:39:02.735 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:39:02.735 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:02.735 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:39:02.736 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:39:02.736 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:02.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:02.736 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:02.736 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:39:02.736 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:39:02.736 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:02.736 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:02.736 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:02.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:02.736 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:39:02.736 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:39:02.736 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:39:02.737 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:39:02.737 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:39:02.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:02.737 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:02.737 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:39:02.737 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:39:02.737 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:39:02.737 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:39:02.737 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:02.737 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:39:02.737 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:39:02.737 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:02.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:02.738 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:02.738 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:39:02.738 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:39:02.738 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:02.738 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:02.738 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:02.738 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:02.738 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:39:02.738 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:39:02.738 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:39:02.738 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:39:02.738 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:39:02.738 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:02.738 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:02.739 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:39:02.739 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:39:02.739 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:39:02.739 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:39:02.739 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:02.739 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:39:02.739 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:39:02.739 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:02.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:02.739 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:02.739 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:39:02.739 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:39:02.739 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:02.739 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:02.739 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:02.740 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:02.740 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:39:02.740 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:39:02.740 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:39:02.740 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:39:02.740 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:39:02.740 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:02.740 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:02.740 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:02.740 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:39:02.740 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:39:02.740 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:02.740 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:39:02.740 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:39:02.741 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:39:02.741 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:02.741 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:02.741 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:39:02.741 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:02.741 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:39:02.741 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:39:02.741 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:39:02.741 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:02.741 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:02.741 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:02.741 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:39:02.741 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:39:02.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.728+0000 7fca70ff9640 1 -- 172.21.15.60:0/427800487 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fca6406be80 msgr2=0x7fca6406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:02.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.728+0000 7fca70ff9640 1 --2- 172.21.15.60:0/427800487 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fca6406be80 0x7fca6406e340 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fca78034000 tx=0x7fca7802e000 comp rx=0 tx=0).stop 2024-09-12T02:39:02.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.728+0000 7fca70ff9640 1 -- 172.21.15.60:0/427800487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca7c00b0e0 msgr2=0x7fca7c04aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:02.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.728+0000 7fca70ff9640 1 --2- 172.21.15.60:0/427800487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca7c00b0e0 0x7fca7c04aa30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fca74007e90 tx=0x7fca7400dba0 comp rx=0 tx=0).stop 2024-09-12T02:39:02.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.728+0000 7fca82d9d640 1 -- 172.21.15.60:0/427800487 reap_dead start 2024-09-12T02:39:02.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.730+0000 7fca70ff9640 1 -- 172.21.15.60:0/427800487 shutdown_connections 2024-09-12T02:39:02.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.730+0000 7fca70ff9640 1 -- 172.21.15.60:0/427800487 >> 172.21.15.60:0/427800487 conn(0x7fca7c048160 msgr2=0x7fca7c0d3b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:02.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.730+0000 7fca70ff9640 1 -- 172.21.15.60:0/427800487 shutdown_connections 2024-09-12T02:39:02.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.730+0000 7fca70ff9640 1 -- 172.21.15.60:0/427800487 wait complete. 2024-09-12T02:39:02.747 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:39:02.747 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-09-12T02:39:02.747 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-12T02:39:02.747 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-09-12T02:39:02.748 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-09-12T02:39:02.748 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T02:39:02.748 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:39:02.764 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T02:39:02.764 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-12T02:39:02.764 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:39:02.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.928+0000 7f9a609f1640 1 Processor -- start 2024-09-12T02:39:02.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.928+0000 7f9a609f1640 1 -- start start 2024-09-12T02:39:02.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.929+0000 7f9a609f1640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9a5c0aba60 0x7f9a5c153390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:02.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.929+0000 7f9a609f1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a5c0c2e30 0x7f9a5c1567b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:02.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.930+0000 7f9a609f1640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a5c0c37a0 con 0x7f9a5c0c3d60 2024-09-12T02:39:02.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.930+0000 7f9a5a59c640 1 -- >> v2:172.21.15.105:3300/0 conn(0x7f9a5c0aba60 msgr2=0x7f9a5c153390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3300/0 2024-09-12T02:39:02.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.930+0000 7f9a59d9b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a5c0c2e30 0x7f9a5c1567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:02.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.930+0000 7f9a5a59c640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9a5c0aba60 0x7f9a5c153390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:39:02.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.930+0000 7f9a609f1640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f9a5c0c3a80 con 0x7f9a5c0aba60 2024-09-12T02:39:02.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.930+0000 7f9a609f1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9a5c155fb0 con 0x7f9a5c0c2e30 2024-09-12T02:39:02.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.930+0000 7f9a59d9b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a5c0c2e30 0x7f9a5c1567b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:37356/0 (socket says 172.21.15.60:37356) 2024-09-12T02:39:02.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.930+0000 7f9a59d9b640 1 -- 172.21.15.60:0/4004775821 learned_addr learned my addr 172.21.15.60:0/4004775821 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:39:02.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.931+0000 7f9a5959a640 1 -- 172.21.15.60:0/4004775821 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 268376066 0 0) 0x7f9a5c0c37a0 con 0x7f9a5c0c3d60 2024-09-12T02:39:02.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.931+0000 7f9a5959a640 1 -- 172.21.15.60:0/4004775821 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a44003520 con 0x7f9a5c0c3d60 2024-09-12T02:39:02.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.931+0000 7f9a5959a640 1 -- 172.21.15.60:0/4004775821 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 251486017 0 0) 0x7f9a44003520 con 0x7f9a5c0c3d60 2024-09-12T02:39:02.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.931+0000 7f9a5959a640 1 -- 172.21.15.60:0/4004775821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a5c0c2e30 msgr2=0x7f9a5c1567b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:02.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.931+0000 7f9a5959a640 1 --2- 172.21.15.60:0/4004775821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a5c0c2e30 0x7f9a5c1567b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:02.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.931+0000 7f9a5959a640 1 -- 172.21.15.60:0/4004775821 >> v2:172.21.15.105:3300/0 conn(0x7f9a5c0aba60 msgr2=0x7f9a5c153390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:39:02.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.931+0000 7f9a5959a640 1 --2- 172.21.15.60:0/4004775821 >> v2:172.21.15.105:3300/0 conn(0x7f9a5c0aba60 0x7f9a5c153390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:02.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.931+0000 7f9a5959a640 1 -- 172.21.15.60:0/4004775821 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a5c156290 con 0x7f9a5c0c3d60 2024-09-12T02:39:02.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.931+0000 7f9a5959a640 1 -- 172.21.15.60:0/4004775821 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7f9a540019f0 con 0x7f9a5c0c3d60 2024-09-12T02:39:02.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.932+0000 7f9a5959a640 1 -- 172.21.15.60:0/4004775821 >> v1:172.21.15.60:6789/0 conn(0x7f9a5c0c3d60 legacy=0x7f9a5c14fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:02.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.932+0000 7f9a5959a640 1 --2- 172.21.15.60:0/4004775821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a440039b0 0x7f9a44003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:02.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.932+0000 7f9a5959a640 1 --2- 172.21.15.60:0/4004775821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a44004800 0x7f9a44004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:02.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.932+0000 7f9a5959a640 1 --2- 172.21.15.60:0/4004775821 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a44005210 0x7f9a4400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:02.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.932+0000 7f9a5959a640 1 -- 172.21.15.60:0/4004775821 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9a5c0c3a80 con 0x7f9a440039b0 2024-09-12T02:39:02.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.932+0000 7f9a5959a640 1 -- 172.21.15.60:0/4004775821 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9a5c155fb0 con 0x7f9a44005210 2024-09-12T02:39:02.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.932+0000 7f9a5959a640 1 -- 172.21.15.60:0/4004775821 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9a4400c1c0 con 0x7f9a44004800 2024-09-12T02:39:02.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.932+0000 7f9a5ad9d640 1 -- 172.21.15.60:0/4004775821 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a44005210 msgr2=0x7f9a4400b9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3300/0 2024-09-12T02:39:02.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.932+0000 7f9a5ad9d640 1 --2- 172.21.15.60:0/4004775821 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a44005210 0x7f9a4400b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:39:02.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.932+0000 7f9a5a59c640 1 --2- 172.21.15.60:0/4004775821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a440039b0 0x7f9a44003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:02.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.932+0000 7f9a59d9b640 1 --2- 172.21.15.60:0/4004775821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a44004800 0x7f9a44004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:02.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.933+0000 7f9a5a59c640 1 -- 172.21.15.60:0/4004775821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a44004800 msgr2=0x7f9a44004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:02.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.933+0000 7f9a5a59c640 1 --2- 172.21.15.60:0/4004775821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a44004800 0x7f9a44004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:02.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.933+0000 7f9a5a59c640 1 -- 172.21.15.60:0/4004775821 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a44005210 msgr2=0x7f9a4400b9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:39:02.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.933+0000 7f9a5a59c640 1 --2- 172.21.15.60:0/4004775821 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a44005210 0x7f9a4400b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:02.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.933+0000 7f9a5a59c640 1 -- 172.21.15.60:0/4004775821 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a5c156290 con 0x7f9a440039b0 2024-09-12T02:39:02.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.934+0000 7f9a5a59c640 1 --2- 172.21.15.60:0/4004775821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a440039b0 0x7f9a44003dd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9a50009900 tx=0x7f9a44005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b8ee7e3d7f9744c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:02.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.934+0000 7f9a5959a640 1 -- 172.21.15.60:0/4004775821 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a50009500 con 0x7f9a440039b0 2024-09-12T02:39:02.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.934+0000 7f9a5959a640 1 -- 172.21.15.60:0/4004775821 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a5002e070 con 0x7f9a440039b0 2024-09-12T02:39:02.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.934+0000 7f9a5959a640 1 -- 172.21.15.60:0/4004775821 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a50003dd0 con 0x7f9a440039b0 2024-09-12T02:39:02.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.935+0000 7f9a609f1640 1 -- 172.21.15.60:0/4004775821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a440039b0 msgr2=0x7f9a44003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:02.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.935+0000 7f9a609f1640 1 --2- 172.21.15.60:0/4004775821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a440039b0 0x7f9a44003dd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9a50009900 tx=0x7f9a44005830 comp rx=0 tx=0).stop 2024-09-12T02:39:02.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.935+0000 7f9a5ad9d640 1 -- 172.21.15.60:0/4004775821 reap_dead start 2024-09-12T02:39:02.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.935+0000 7f9a609f1640 1 -- 172.21.15.60:0/4004775821 shutdown_connections 2024-09-12T02:39:02.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.935+0000 7f9a609f1640 1 -- 172.21.15.60:0/4004775821 >> 172.21.15.60:0/4004775821 conn(0x7f9a5c0c8430 msgr2=0x7f9a5c0c8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:02.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.935+0000 7f9a609f1640 1 -- 172.21.15.60:0/4004775821 shutdown_connections 2024-09-12T02:39:02.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.936+0000 7f9a609f1640 1 -- 172.21.15.60:0/4004775821 wait complete. 2024-09-12T02:39:02.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.937+0000 7f9a609f1640 1 Processor -- start 2024-09-12T02:39:02.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.937+0000 7f9a609f1640 1 -- start start 2024-09-12T02:39:02.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.938+0000 7f9a609f1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a440039b0 0x7f9a5c06c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:02.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.938+0000 7f9a609f1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a5c155560 0x7f9a5c144420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:02.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.938+0000 7f9a609f1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a5c144960 0x7f9a5c14e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:02.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.939+0000 7f9a5a59c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a440039b0 0x7f9a5c06c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:02.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.939+0000 7f9a5a59c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a440039b0 0x7f9a5c06c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:37368/0 (socket says 172.21.15.60:37368) 2024-09-12T02:39:02.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.939+0000 7f9a59d9b640 1 -- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a5c155560 msgr2=0x7f9a5c144420 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3300/0 2024-09-12T02:39:02.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.939+0000 7f9a59d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a5c155560 0x7f9a5c144420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:39:02.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.939+0000 7f9a5a59c640 1 -- 172.21.15.60:0/598649187 learned_addr learned my addr 172.21.15.60:0/598649187 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:39:02.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.939+0000 7f9a609f1640 1 -- 172.21.15.60:0/598649187 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9a5c150430 con 0x7f9a5c144960 2024-09-12T02:39:02.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.939+0000 7f9a609f1640 1 -- 172.21.15.60:0/598649187 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9a5c1502b0 con 0x7f9a5c155560 2024-09-12T02:39:02.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.939+0000 7f9a609f1640 1 -- 172.21.15.60:0/598649187 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9a5c1505b0 con 0x7f9a440039b0 2024-09-12T02:39:02.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.939+0000 7f9a5ad9d640 1 --2- 172.21.15.60:0/598649187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a5c144960 0x7f9a5c14e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:02.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.939+0000 7f9a5a59c640 1 -- 172.21.15.60:0/598649187 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a5c155560 msgr2=0x7f9a5c144420 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:39:02.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.939+0000 7f9a5a59c640 1 --2- 172.21.15.60:0/598649187 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a5c155560 0x7f9a5c144420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:02.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.939+0000 7f9a5a59c640 1 -- 172.21.15.60:0/598649187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a5c144960 msgr2=0x7f9a5c14e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:02.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.939+0000 7f9a5a59c640 1 --2- 172.21.15.60:0/598649187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a5c144960 0x7f9a5c14e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:02.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.939+0000 7f9a5a59c640 1 -- 172.21.15.60:0/598649187 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a5c143b10 con 0x7f9a440039b0 2024-09-12T02:39:02.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.940+0000 7f9a5a59c640 1 --2- 172.21.15.60:0/598649187 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a440039b0 0x7f9a5c06c4c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9a50000ea0 tx=0x7f9a50005a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:02.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.940+0000 7f9a4affd640 1 -- 172.21.15.60:0/598649187 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a50043070 con 0x7f9a440039b0 2024-09-12T02:39:02.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.940+0000 7f9a4affd640 1 -- 172.21.15.60:0/598649187 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a500039b0 con 0x7f9a440039b0 2024-09-12T02:39:02.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.940+0000 7f9a4affd640 1 -- 172.21.15.60:0/598649187 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a50003dd0 con 0x7f9a440039b0 2024-09-12T02:39:02.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.940+0000 7f9a609f1640 1 -- 172.21.15.60:0/598649187 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a5c144de0 con 0x7f9a440039b0 2024-09-12T02:39:02.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.940+0000 7f9a609f1640 1 -- 172.21.15.60:0/598649187 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a5c143270 con 0x7f9a440039b0 2024-09-12T02:39:02.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.941+0000 7f9a609f1640 1 -- 172.21.15.60:0/598649187 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a5c0c4170 con 0x7f9a440039b0 2024-09-12T02:39:02.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.942+0000 7f9a4affd640 1 -- 172.21.15.60:0/598649187 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9a50033470 con 0x7f9a440039b0 2024-09-12T02:39:02.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.943+0000 7f9a4affd640 1 --2- 172.21.15.60:0/598649187 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9a3c06bde0 0x7f9a3c06e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:02.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.943+0000 7f9a4affd640 1 -- 172.21.15.60:0/598649187 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f9a500aa770 con 0x7f9a440039b0 2024-09-12T02:39:02.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.943+0000 7f9a59d9b640 1 --2- 172.21.15.60:0/598649187 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9a3c06bde0 0x7f9a3c06e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:02.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.944+0000 7f9a59d9b640 1 --2- 172.21.15.60:0/598649187 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9a3c06bde0 0x7f9a3c06e2a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c0c8fd0 tx=0x7f9a4c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:02.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:02.951+0000 7f9a4affd640 1 -- 172.21.15.60:0/598649187 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9a50078720 con 0x7f9a440039b0 2024-09-12T02:39:03.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:03.400+0000 7f9a609f1640 1 -- 172.21.15.60:0/598649187 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9a5c152c60 con 0x7f9a440039b0 2024-09-12T02:39:03.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:03.401+0000 7f9a4affd640 1 -- 172.21.15.60:0/598649187 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1566 (secure 0 0 0) 0x7f9a5007ca20 con 0x7f9a440039b0 2024-09-12T02:39:03.402 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":152,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:39:03.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:03.404+0000 7f9a609f1640 1 -- 172.21.15.60:0/598649187 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9a3c06bde0 msgr2=0x7f9a3c06e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:03.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:03.404+0000 7f9a609f1640 1 --2- 172.21.15.60:0/598649187 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9a3c06bde0 0x7f9a3c06e2a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c0c8fd0 tx=0x7f9a4c008040 comp rx=0 tx=0).stop 2024-09-12T02:39:03.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:03.404+0000 7f9a609f1640 1 -- 172.21.15.60:0/598649187 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a440039b0 msgr2=0x7f9a5c06c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:03.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:03.404+0000 7f9a609f1640 1 --2- 172.21.15.60:0/598649187 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a440039b0 0x7f9a5c06c4c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9a50000ea0 tx=0x7f9a50005a80 comp rx=0 tx=0).stop 2024-09-12T02:39:03.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:03.406+0000 7f9a609f1640 1 -- 172.21.15.60:0/598649187 shutdown_connections 2024-09-12T02:39:03.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:03.406+0000 7f9a609f1640 1 --2- 172.21.15.60:0/598649187 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9a3c06bde0 0x7f9a3c06e2a0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:03.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:03.406+0000 7f9a609f1640 1 --2- 172.21.15.60:0/598649187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a5c144960 0x7f9a5c14e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:03.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:03.406+0000 7f9a609f1640 1 --2- 172.21.15.60:0/598649187 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a5c155560 0x7f9a5c144420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:03.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:03.406+0000 7f9a609f1640 1 --2- 172.21.15.60:0/598649187 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a440039b0 0x7f9a5c06c4c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:03.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:03.406+0000 7f9a609f1640 1 -- 172.21.15.60:0/598649187 >> 172.21.15.60:0/598649187 conn(0x7f9a5c0c8430 msgr2=0x7f9a5c14ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:03.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:03.406+0000 7f9a609f1640 1 -- 172.21.15.60:0/598649187 shutdown_connections 2024-09-12T02:39:03.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:03.406+0000 7f9a609f1640 1 -- 172.21.15.60:0/598649187 wait complete. 2024-09-12T02:39:06.424 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:39:06.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.591+0000 7f85f7c1e640 1 Processor -- start 2024-09-12T02:39:06.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.591+0000 7f85f7c1e640 1 -- start start 2024-09-12T02:39:06.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.592+0000 7f85f7c1e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85f00acd50 0x7f85f015af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:06.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.592+0000 7f85f7c1e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f85f00730d0 0x7f85f0165030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:06.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.592+0000 7f85f7c1e640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85f00c63f0 con 0x7f85f015b470 2024-09-12T02:39:06.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.592+0000 7f85f7c1e640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f85f0072270 con 0x7f85f00730d0 2024-09-12T02:39:06.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.592+0000 7f85f7c1e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f85f0074660 con 0x7f85f00acd50 2024-09-12T02:39:06.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.593+0000 7f85f51b9640 1 -- >> v1:172.21.15.105:6789/0 conn(0x7f85f015b470 legacy=0x7f85f00729c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.105:6789/0 2024-09-12T02:39:06.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.593+0000 7f85f59ba640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85f00acd50 0x7f85f015af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:06.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.593+0000 7f85f59ba640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85f00acd50 0x7f85f015af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:37380/0 (socket says 172.21.15.60:37380) 2024-09-12T02:39:06.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.593+0000 7f85f59ba640 1 -- 172.21.15.60:0/3187359137 learned_addr learned my addr 172.21.15.60:0/3187359137 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:39:06.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.593+0000 7f85f61bb640 1 -- 172.21.15.60:0/3187359137 >> v2:172.21.15.105:3300/0 conn(0x7f85f00730d0 msgr2=0x7f85f0165030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3300/0 2024-09-12T02:39:06.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.593+0000 7f85f61bb640 1 --2- 172.21.15.60:0/3187359137 >> v2:172.21.15.105:3300/0 conn(0x7f85f00730d0 0x7f85f0165030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:39:06.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.595+0000 7f85f59ba640 1 -- 172.21.15.60:0/3187359137 >> v2:172.21.15.105:3300/0 conn(0x7f85f00730d0 msgr2=0x7f85f0165030 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:39:06.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.595+0000 7f85f59ba640 1 --2- 172.21.15.60:0/3187359137 >> v2:172.21.15.105:3300/0 conn(0x7f85f00730d0 0x7f85f0165030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:06.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.595+0000 7f85f59ba640 1 -- 172.21.15.60:0/3187359137 >> v1:172.21.15.105:6789/0 conn(0x7f85f015b470 legacy=0x7f85f00729c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:39:06.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.595+0000 7f85f59ba640 1 -- 172.21.15.60:0/3187359137 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f015dda0 con 0x7f85f00acd50 2024-09-12T02:39:06.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.596+0000 7f85f59ba640 1 --2- 172.21.15.60:0/3187359137 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85f00acd50 0x7f85f015af30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f85e0009870 tx=0x7f85e002a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e71fdae79c3d7ca1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:06.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.597+0000 7f85f49b8640 1 -- 172.21.15.60:0/3187359137 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e0037070 con 0x7f85f00acd50 2024-09-12T02:39:06.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.597+0000 7f85f49b8640 1 -- 172.21.15.60:0/3187359137 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85e0032440 con 0x7f85f00acd50 2024-09-12T02:39:06.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.598+0000 7f85f7c1e640 1 -- 172.21.15.60:0/3187359137 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85f00acd50 msgr2=0x7f85f015af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:06.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.598+0000 7f85f49b8640 1 -- 172.21.15.60:0/3187359137 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e0037070 con 0x7f85f00acd50 2024-09-12T02:39:06.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.598+0000 7f85f7c1e640 1 --2- 172.21.15.60:0/3187359137 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85f00acd50 0x7f85f015af30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f85e0009870 tx=0x7f85e002a1a0 comp rx=0 tx=0).stop 2024-09-12T02:39:06.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.599+0000 7f85f7c1e640 1 -- 172.21.15.60:0/3187359137 shutdown_connections 2024-09-12T02:39:06.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.599+0000 7f85f7c1e640 1 --2- 172.21.15.60:0/3187359137 >> v2:172.21.15.105:3300/0 conn(0x7f85f00730d0 0x7f85f0165030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:06.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.599+0000 7f85f7c1e640 1 --2- 172.21.15.60:0/3187359137 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85f00acd50 0x7f85f015af30 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:06.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.599+0000 7f85f7c1e640 1 -- 172.21.15.60:0/3187359137 >> 172.21.15.60:0/3187359137 conn(0x7f85f00c5660 msgr2=0x7f85f00c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:06.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.601+0000 7f85f7c1e640 1 -- 172.21.15.60:0/3187359137 shutdown_connections 2024-09-12T02:39:06.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.602+0000 7f85f7c1e640 1 -- 172.21.15.60:0/3187359137 wait complete. 2024-09-12T02:39:06.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.603+0000 7f85f7c1e640 1 Processor -- start 2024-09-12T02:39:06.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.604+0000 7f85f7c1e640 1 -- start start 2024-09-12T02:39:06.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.605+0000 7f85f7c1e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85f00730d0 0x7f85f015d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:06.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.605+0000 7f85f7c1e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85f00acd50 0x7f85f01f3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:06.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.605+0000 7f85f7c1e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85f015b470 0x7f85f015c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:06.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.605+0000 7f85f59ba640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85f00730d0 0x7f85f015d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:06.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.605+0000 7f85f59ba640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85f00730d0 0x7f85f015d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:37388/0 (socket says 172.21.15.60:37388) 2024-09-12T02:39:06.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.606+0000 7f85f61bb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85f015b470 0x7f85f015c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:06.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.606+0000 7f85f51b9640 1 -- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85f00acd50 msgr2=0x7f85f01f3810 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3300/0 2024-09-12T02:39:06.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.606+0000 7f85f61bb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85f015b470 0x7f85f015c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60818/0 (socket says 172.21.15.60:60818) 2024-09-12T02:39:06.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.606+0000 7f85f51b9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85f00acd50 0x7f85f01f3810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:39:06.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.606+0000 7f85f59ba640 1 -- 172.21.15.60:0/328473543 learned_addr learned my addr 172.21.15.60:0/328473543 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:39:06.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.606+0000 7f85f7c1e640 1 -- 172.21.15.60:0/328473543 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f85f0071d40 con 0x7f85f015b470 2024-09-12T02:39:06.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.606+0000 7f85f7c1e640 1 -- 172.21.15.60:0/328473543 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f85f00748b0 con 0x7f85f00acd50 2024-09-12T02:39:06.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.606+0000 7f85f7c1e640 1 -- 172.21.15.60:0/328473543 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f85f0073560 con 0x7f85f00730d0 2024-09-12T02:39:06.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.607+0000 7f85f59ba640 1 -- 172.21.15.60:0/328473543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85f00acd50 msgr2=0x7f85f01f3810 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:39:06.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.607+0000 7f85f59ba640 1 --2- 172.21.15.60:0/328473543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85f00acd50 0x7f85f01f3810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:06.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.607+0000 7f85f59ba640 1 -- 172.21.15.60:0/328473543 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85f015b470 msgr2=0x7f85f015c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:06.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.607+0000 7f85f59ba640 1 --2- 172.21.15.60:0/328473543 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85f015b470 0x7f85f015c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:06.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.607+0000 7f85f59ba640 1 -- 172.21.15.60:0/328473543 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f01e63d0 con 0x7f85f00730d0 2024-09-12T02:39:06.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.609+0000 7f85f59ba640 1 --2- 172.21.15.60:0/328473543 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85f00730d0 0x7f85f015d350 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f85e002a1e0 tx=0x7f85e00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:06.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.610+0000 7f85e67fc640 1 -- 172.21.15.60:0/328473543 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e0041020 con 0x7f85f00730d0 2024-09-12T02:39:06.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.610+0000 7f85e67fc640 1 -- 172.21.15.60:0/328473543 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85e00325f0 con 0x7f85f00730d0 2024-09-12T02:39:06.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.610+0000 7f85e67fc640 1 -- 172.21.15.60:0/328473543 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e0037040 con 0x7f85f00730d0 2024-09-12T02:39:06.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.610+0000 7f85f7c1e640 1 -- 172.21.15.60:0/328473543 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85f01f4200 con 0x7f85f00730d0 2024-09-12T02:39:06.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.611+0000 7f85f7c1e640 1 -- 172.21.15.60:0/328473543 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f85f01f3d50 con 0x7f85f00730d0 2024-09-12T02:39:06.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.612+0000 7f85f7c1e640 1 -- 172.21.15.60:0/328473543 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85f00abc10 con 0x7f85f00730d0 2024-09-12T02:39:06.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.614+0000 7f85e67fc640 1 -- 172.21.15.60:0/328473543 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f85e0044020 con 0x7f85f00730d0 2024-09-12T02:39:06.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.615+0000 7f85e67fc640 1 --2- 172.21.15.60:0/328473543 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f85dc06bf80 0x7f85dc06e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:06.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.615+0000 7f85e67fc640 1 -- 172.21.15.60:0/328473543 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f85e00abf40 con 0x7f85f00730d0 2024-09-12T02:39:06.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.616+0000 7f85f51b9640 1 --2- 172.21.15.60:0/328473543 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f85dc06bf80 0x7f85dc06e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:06.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.616+0000 7f85f51b9640 1 --2- 172.21.15.60:0/328473543 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f85dc06bf80 0x7f85dc06e440 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f85ec006fd0 tx=0x7f85ec006d80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:06.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:06.619+0000 7f85e67fc640 1 -- 172.21.15.60:0/328473543 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f85e004b030 con 0x7f85f00730d0 2024-09-12T02:39:07.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:07.086+0000 7f85f7c1e640 1 -- 172.21.15.60:0/328473543 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f85f015a510 con 0x7f85f00730d0 2024-09-12T02:39:07.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:07.087+0000 7f85e67fc640 1 -- 172.21.15.60:0/328473543 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1566 (secure 0 0 0) 0x7f85e007a6e0 con 0x7f85f00730d0 2024-09-12T02:39:07.089 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":152,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:39:07.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:07.091+0000 7f85f7c1e640 1 -- 172.21.15.60:0/328473543 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f85dc06bf80 msgr2=0x7f85dc06e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:07.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:07.091+0000 7f85f7c1e640 1 --2- 172.21.15.60:0/328473543 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f85dc06bf80 0x7f85dc06e440 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f85ec006fd0 tx=0x7f85ec006d80 comp rx=0 tx=0).stop 2024-09-12T02:39:07.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:07.091+0000 7f85f7c1e640 1 -- 172.21.15.60:0/328473543 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85f00730d0 msgr2=0x7f85f015d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:07.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:07.091+0000 7f85f7c1e640 1 --2- 172.21.15.60:0/328473543 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85f00730d0 0x7f85f015d350 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f85e002a1e0 tx=0x7f85e00046c0 comp rx=0 tx=0).stop 2024-09-12T02:39:07.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:07.091+0000 7f85f7c1e640 1 -- 172.21.15.60:0/328473543 shutdown_connections 2024-09-12T02:39:07.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:07.091+0000 7f85f7c1e640 1 --2- 172.21.15.60:0/328473543 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f85dc06bf80 0x7f85dc06e440 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:07.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:07.091+0000 7f85f7c1e640 1 --2- 172.21.15.60:0/328473543 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85f015b470 0x7f85f015c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:07.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:07.091+0000 7f85f7c1e640 1 --2- 172.21.15.60:0/328473543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85f00acd50 0x7f85f01f3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:07.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:07.091+0000 7f85f7c1e640 1 --2- 172.21.15.60:0/328473543 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85f00730d0 0x7f85f015d350 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:07.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:07.091+0000 7f85f7c1e640 1 -- 172.21.15.60:0/328473543 >> 172.21.15.60:0/328473543 conn(0x7f85f00c5660 msgr2=0x7f85f00729c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:07.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:07.091+0000 7f85f7c1e640 1 -- 172.21.15.60:0/328473543 shutdown_connections 2024-09-12T02:39:07.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:07.091+0000 7f85f7c1e640 1 -- 172.21.15.60:0/328473543 wait complete. 2024-09-12T02:39:10.109 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:39:10.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.277+0000 7fb83359e640 1 Processor -- start 2024-09-12T02:39:10.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.277+0000 7fb83359e640 1 -- start start 2024-09-12T02:39:10.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.278+0000 7fb83359e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb82c0d7880 0x7fb82c005d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:10.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.278+0000 7fb83359e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb82c0da8b0 con 0x7fb82c04dc50 2024-09-12T02:39:10.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.278+0000 7fb83359e640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb82c0dab90 con 0x7fb82c049fb0 2024-09-12T02:39:10.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.278+0000 7fb83359e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb82c04e320 con 0x7fb82c0d7880 2024-09-12T02:39:10.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.278+0000 7fb832d9d640 1 -- >> v1:172.21.15.105:6789/0 conn(0x7fb82c049fb0 legacy=0x7fb82c04a460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.105:6789/0 2024-09-12T02:39:10.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.278+0000 7fb831d9b640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb82c04dc50 0x7fb82c04ee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50244/0 (socket says 172.21.15.60:50244) 2024-09-12T02:39:10.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.278+0000 7fb831d9b640 1 -- 172.21.15.60:0/3847994527 learned_addr learned my addr 172.21.15.60:0/3847994527 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:39:10.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.279+0000 7fb83259c640 1 --2- 172.21.15.60:0/3847994527 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb82c0d7880 0x7fb82c005d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:10.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.279+0000 7fb83259c640 1 -- 172.21.15.60:0/3847994527 >> v1:172.21.15.105:6789/0 conn(0x7fb82c049fb0 legacy=0x7fb82c04a460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:39:10.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.279+0000 7fb83259c640 1 -- 172.21.15.60:0/3847994527 >> v1:172.21.15.60:6789/0 conn(0x7fb82c04dc50 legacy=0x7fb82c04ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:10.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.279+0000 7fb83259c640 1 -- 172.21.15.60:0/3847994527 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb82c04e600 con 0x7fb82c0d7880 2024-09-12T02:39:10.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.280+0000 7fb83259c640 1 --2- 172.21.15.60:0/3847994527 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb82c0d7880 0x7fb82c005d20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb8240097d0 tx=0x7fb82402a140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b7049dee443dbda server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:10.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.281+0000 7fb83159a640 1 -- 172.21.15.60:0/3847994527 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb824037070 con 0x7fb82c0d7880 2024-09-12T02:39:10.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.281+0000 7fb83159a640 1 -- 172.21.15.60:0/3847994527 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb82402ae50 con 0x7fb82c0d7880 2024-09-12T02:39:10.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.281+0000 7fb83159a640 1 -- 172.21.15.60:0/3847994527 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb824032640 con 0x7fb82c0d7880 2024-09-12T02:39:10.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.282+0000 7fb83359e640 1 -- 172.21.15.60:0/3847994527 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb82c0d7880 msgr2=0x7fb82c005d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:10.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.282+0000 7fb83359e640 1 --2- 172.21.15.60:0/3847994527 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb82c0d7880 0x7fb82c005d20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb8240097d0 tx=0x7fb82402a140 comp rx=0 tx=0).stop 2024-09-12T02:39:10.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.282+0000 7fb83359e640 1 -- 172.21.15.60:0/3847994527 shutdown_connections 2024-09-12T02:39:10.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.282+0000 7fb83359e640 1 --2- 172.21.15.60:0/3847994527 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb82c0d7880 0x7fb82c005d20 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:10.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.282+0000 7fb83359e640 1 -- 172.21.15.60:0/3847994527 >> 172.21.15.60:0/3847994527 conn(0x7fb82c04c0b0 msgr2=0x7fb82c04c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:10.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.282+0000 7fb83359e640 1 -- 172.21.15.60:0/3847994527 shutdown_connections 2024-09-12T02:39:10.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.282+0000 7fb83359e640 1 -- 172.21.15.60:0/3847994527 wait complete. 2024-09-12T02:39:10.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.284+0000 7fb83359e640 1 Processor -- start 2024-09-12T02:39:10.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.285+0000 7fb83359e640 1 -- start start 2024-09-12T02:39:10.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.286+0000 7fb83359e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb82c049fb0 0x7fb82c0cd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:10.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.286+0000 7fb83359e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb82c04dc50 0x7fb82c172ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:10.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.286+0000 7fb83359e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb82c0d7880 0x7fb82c1731e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:10.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.286+0000 7fb831d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb82c04dc50 0x7fb82c172ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:10.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.286+0000 7fb83259c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb82c049fb0 0x7fb82c0cd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:10.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.286+0000 7fb831d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb82c04dc50 0x7fb82c172ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42722/0 (socket says 172.21.15.60:42722) 2024-09-12T02:39:10.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.286+0000 7fb831d9b640 1 -- 172.21.15.60:0/2339301689 learned_addr learned my addr 172.21.15.60:0/2339301689 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:39:10.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.286+0000 7fb83259c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb82c049fb0 0x7fb82c0cd3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:48426/0 (socket says 172.21.15.60:48426) 2024-09-12T02:39:10.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.286+0000 7fb832d9d640 1 -- 172.21.15.60:0/2339301689 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb82c0d7880 msgr2=0x7fb82c1731e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3300/0 2024-09-12T02:39:10.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.286+0000 7fb832d9d640 1 --2- 172.21.15.60:0/2339301689 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb82c0d7880 0x7fb82c1731e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:39:10.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.287+0000 7fb83359e640 1 -- 172.21.15.60:0/2339301689 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb82c042f60 con 0x7fb82c04dc50 2024-09-12T02:39:10.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.287+0000 7fb83359e640 1 -- 172.21.15.60:0/2339301689 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb82c042de0 con 0x7fb82c0d7880 2024-09-12T02:39:10.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.287+0000 7fb83359e640 1 -- 172.21.15.60:0/2339301689 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb82c0e56e0 con 0x7fb82c049fb0 2024-09-12T02:39:10.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.288+0000 7fb831d9b640 1 -- 172.21.15.60:0/2339301689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb82c049fb0 msgr2=0x7fb82c0cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:10.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.288+0000 7fb831d9b640 1 --2- 172.21.15.60:0/2339301689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb82c049fb0 0x7fb82c0cd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:10.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.288+0000 7fb831d9b640 1 -- 172.21.15.60:0/2339301689 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb82c0d7880 msgr2=0x7fb82c1731e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:39:10.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.288+0000 7fb831d9b640 1 --2- 172.21.15.60:0/2339301689 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb82c0d7880 0x7fb82c1731e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:10.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.288+0000 7fb831d9b640 1 -- 172.21.15.60:0/2339301689 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb82c173900 con 0x7fb82c04dc50 2024-09-12T02:39:10.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.288+0000 7fb83259c640 1 --2- 172.21.15.60:0/2339301689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb82c049fb0 0x7fb82c0cd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:39:10.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.288+0000 7fb831d9b640 1 --2- 172.21.15.60:0/2339301689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb82c04dc50 0x7fb82c172ca0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb83407ca70 tx=0x7fb8340699a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:10.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.289+0000 7fb822ffd640 1 -- 172.21.15.60:0/2339301689 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8340500f0 con 0x7fb82c04dc50 2024-09-12T02:39:10.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.289+0000 7fb822ffd640 1 -- 172.21.15.60:0/2339301689 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb834092020 con 0x7fb82c04dc50 2024-09-12T02:39:10.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.289+0000 7fb83359e640 1 -- 172.21.15.60:0/2339301689 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb82c045b50 con 0x7fb82c04dc50 2024-09-12T02:39:10.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.289+0000 7fb83359e640 1 -- 172.21.15.60:0/2339301689 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb82c0d9f00 con 0x7fb82c04dc50 2024-09-12T02:39:10.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.290+0000 7fb822ffd640 1 -- 172.21.15.60:0/2339301689 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8340741c0 con 0x7fb82c04dc50 2024-09-12T02:39:10.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.292+0000 7fb83359e640 1 -- 172.21.15.60:0/2339301689 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb82c005d20 con 0x7fb82c04dc50 2024-09-12T02:39:10.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.292+0000 7fb822ffd640 1 -- 172.21.15.60:0/2339301689 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb834074360 con 0x7fb82c04dc50 2024-09-12T02:39:10.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.293+0000 7fb822ffd640 1 --2- 172.21.15.60:0/2339301689 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb81406bfe0 0x7fb81406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:10.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.293+0000 7fb822ffd640 1 -- 172.21.15.60:0/2339301689 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fb834106fe0 con 0x7fb82c04dc50 2024-09-12T02:39:10.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.293+0000 7fb83259c640 1 --2- 172.21.15.60:0/2339301689 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb81406bfe0 0x7fb81406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:10.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.295+0000 7fb83259c640 1 --2- 172.21.15.60:0/2339301689 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb81406bfe0 0x7fb81406e4a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb824034000 tx=0x7fb82402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:10.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.300+0000 7fb822ffd640 1 -- 172.21.15.60:0/2339301689 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb83409c030 con 0x7fb82c04dc50 2024-09-12T02:39:10.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.780+0000 7fb83359e640 1 -- 172.21.15.60:0/2339301689 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb82c04d530 con 0x7fb82c04dc50 2024-09-12T02:39:10.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.781+0000 7fb822ffd640 1 -- 172.21.15.60:0/2339301689 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1566 (secure 0 0 0) 0x7fb8340d5600 con 0x7fb82c04dc50 2024-09-12T02:39:10.783 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":152,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:39:10.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.786+0000 7fb83359e640 1 -- 172.21.15.60:0/2339301689 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb81406bfe0 msgr2=0x7fb81406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:10.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.786+0000 7fb83359e640 1 --2- 172.21.15.60:0/2339301689 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb81406bfe0 0x7fb81406e4a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb824034000 tx=0x7fb82402e000 comp rx=0 tx=0).stop 2024-09-12T02:39:10.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.786+0000 7fb83359e640 1 -- 172.21.15.60:0/2339301689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb82c04dc50 msgr2=0x7fb82c172ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:10.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.786+0000 7fb83359e640 1 --2- 172.21.15.60:0/2339301689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb82c04dc50 0x7fb82c172ca0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb83407ca70 tx=0x7fb8340699a0 comp rx=0 tx=0).stop 2024-09-12T02:39:10.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.787+0000 7fb83359e640 1 -- 172.21.15.60:0/2339301689 shutdown_connections 2024-09-12T02:39:10.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.787+0000 7fb83359e640 1 --2- 172.21.15.60:0/2339301689 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb81406bfe0 0x7fb81406e4a0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:10.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.787+0000 7fb83359e640 1 --2- 172.21.15.60:0/2339301689 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb82c0d7880 0x7fb82c1731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:10.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.787+0000 7fb83359e640 1 --2- 172.21.15.60:0/2339301689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb82c04dc50 0x7fb82c172ca0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:10.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.787+0000 7fb83359e640 1 --2- 172.21.15.60:0/2339301689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb82c049fb0 0x7fb82c0cd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:10.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.787+0000 7fb83359e640 1 -- 172.21.15.60:0/2339301689 >> 172.21.15.60:0/2339301689 conn(0x7fb82c04c0b0 msgr2=0x7fb82c006410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:10.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.787+0000 7fb83359e640 1 -- 172.21.15.60:0/2339301689 shutdown_connections 2024-09-12T02:39:10.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:10.787+0000 7fb83359e640 1 -- 172.21.15.60:0/2339301689 wait complete. 2024-09-12T02:39:13.806 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:39:13.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:13.973+0000 7fab0465e640 1 Processor -- start 2024-09-12T02:39:13.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:13.973+0000 7fab0465e640 1 -- start start 2024-09-12T02:39:13.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:13.975+0000 7fab0465e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7faafc151840 0x7faafc0ace00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:13.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:13.975+0000 7fab0465e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faafc0ad340 0x7faafc0c32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:13.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:13.975+0000 7fab0465e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faafc154330 con 0x7faafc0c3830 2024-09-12T02:39:13.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:13.975+0000 7fab0465e640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7faafc1550f0 con 0x7faafc151840 2024-09-12T02:39:13.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:13.975+0000 7fab0465e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7faafc154610 con 0x7faafc0ad340 2024-09-12T02:39:13.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:13.975+0000 7fab01bf9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faafc0ad340 0x7faafc0c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:13.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:13.975+0000 7fab01bf9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faafc0ad340 0x7faafc0c32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:48434/0 (socket says 172.21.15.60:48434) 2024-09-12T02:39:13.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:13.975+0000 7fab01bf9640 1 -- 172.21.15.60:0/2793838041 learned_addr learned my addr 172.21.15.60:0/2793838041 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:39:13.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:13.975+0000 7fab023fa640 1 --2- 172.21.15.60:0/2793838041 >> v2:172.21.15.60:3300/0 conn(0x7faafc151840 0x7faafc0ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:13.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:13.976+0000 7fab01bf9640 1 -- 172.21.15.60:0/2793838041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faafc0ad340 msgr2=0x7faafc0c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:39:13.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:13.976+0000 7fab01bf9640 1 -- 172.21.15.60:0/2793838041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faafc0ad340 msgr2=0x7faafc0c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:39:13.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:13.976+0000 7fab01bf9640 1 --2- 172.21.15.60:0/2793838041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faafc0ad340 0x7faafc0c32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:39:13.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:13.976+0000 7fab01bf9640 1 --2- 172.21.15.60:0/2793838041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faafc0ad340 0x7faafc0c32f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:39:13.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:13.976+0000 7fab023fa640 1 -- 172.21.15.60:0/2793838041 >> v2:172.21.15.60:3300/0 conn(0x7faafc151840 msgr2=0x7faafc0ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:39:13.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:13.976+0000 7fab023fa640 1 -- 172.21.15.60:0/2793838041 >> v2:172.21.15.60:3300/0 conn(0x7faafc151840 msgr2=0x7faafc0ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:39:13.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:13.976+0000 7fab023fa640 1 --2- 172.21.15.60:0/2793838041 >> v2:172.21.15.60:3300/0 conn(0x7faafc151840 0x7faafc0ace00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:39:13.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:13.976+0000 7fab023fa640 1 --2- 172.21.15.60:0/2793838041 >> v2:172.21.15.60:3300/0 conn(0x7faafc151840 0x7faafc0ace00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:39:14.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:14.177+0000 7fab01bf9640 1 --2- 172.21.15.60:0/2793838041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faafc0ad340 0x7faafc0c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:14.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:14.177+0000 7fab023fa640 1 --2- 172.21.15.60:0/2793838041 >> v2:172.21.15.60:3300/0 conn(0x7faafc151840 0x7faafc0ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:14.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:14.177+0000 7fab01bf9640 1 -- 172.21.15.60:0/2793838041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faafc0ad340 msgr2=0x7faafc0c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:39:14.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:14.177+0000 7fab01bf9640 1 -- 172.21.15.60:0/2793838041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faafc0ad340 msgr2=0x7faafc0c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:39:14.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:14.177+0000 7fab01bf9640 1 --2- 172.21.15.60:0/2793838041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faafc0ad340 0x7faafc0c32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:39:14.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:14.177+0000 7fab01bf9640 1 --2- 172.21.15.60:0/2793838041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faafc0ad340 0x7faafc0c32f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:39:14.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:14.177+0000 7fab023fa640 1 -- 172.21.15.60:0/2793838041 >> v2:172.21.15.60:3300/0 conn(0x7faafc151840 msgr2=0x7faafc0ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:39:14.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:14.177+0000 7fab023fa640 1 -- 172.21.15.60:0/2793838041 >> v2:172.21.15.60:3300/0 conn(0x7faafc151840 msgr2=0x7faafc0ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:39:14.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:14.177+0000 7fab023fa640 1 --2- 172.21.15.60:0/2793838041 >> v2:172.21.15.60:3300/0 conn(0x7faafc151840 0x7faafc0ace00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:39:14.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:14.177+0000 7fab023fa640 1 --2- 172.21.15.60:0/2793838041 >> v2:172.21.15.60:3300/0 conn(0x7faafc151840 0x7faafc0ace00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:39:14.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:14.578+0000 7fab01bf9640 1 --2- 172.21.15.60:0/2793838041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faafc0ad340 0x7faafc0c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:14.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:14.578+0000 7fab01bf9640 1 -- 172.21.15.60:0/2793838041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faafc0ad340 msgr2=0x7faafc0c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:39:14.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:14.578+0000 7fab01bf9640 1 -- 172.21.15.60:0/2793838041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faafc0ad340 msgr2=0x7faafc0c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:39:14.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:14.578+0000 7fab01bf9640 1 --2- 172.21.15.60:0/2793838041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faafc0ad340 0x7faafc0c32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:39:14.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:14.578+0000 7fab01bf9640 1 --2- 172.21.15.60:0/2793838041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faafc0ad340 0x7faafc0c32f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:39:14.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:14.579+0000 7fab023fa640 1 --2- 172.21.15.60:0/2793838041 >> v2:172.21.15.60:3300/0 conn(0x7faafc151840 0x7faafc0ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:14.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:14.579+0000 7fab023fa640 1 -- 172.21.15.60:0/2793838041 >> v2:172.21.15.60:3300/0 conn(0x7faafc151840 msgr2=0x7faafc0ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:39:14.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:14.579+0000 7fab023fa640 1 -- 172.21.15.60:0/2793838041 >> v2:172.21.15.60:3300/0 conn(0x7faafc151840 msgr2=0x7faafc0ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:39:14.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:14.579+0000 7fab023fa640 1 --2- 172.21.15.60:0/2793838041 >> v2:172.21.15.60:3300/0 conn(0x7faafc151840 0x7faafc0ace00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:39:14.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:14.579+0000 7fab023fa640 1 --2- 172.21.15.60:0/2793838041 >> v2:172.21.15.60:3300/0 conn(0x7faafc151840 0x7faafc0ace00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:39:15.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:15.379+0000 7fab01bf9640 1 --2- 172.21.15.60:0/2793838041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faafc0ad340 0x7faafc0c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:15.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:15.379+0000 7fab01bf9640 1 -- 172.21.15.60:0/2793838041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faafc0ad340 msgr2=0x7faafc0c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:39:15.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:15.379+0000 7fab01bf9640 1 -- 172.21.15.60:0/2793838041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faafc0ad340 msgr2=0x7faafc0c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:39:15.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:15.379+0000 7fab01bf9640 1 --2- 172.21.15.60:0/2793838041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faafc0ad340 0x7faafc0c32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:39:15.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:15.379+0000 7fab01bf9640 1 --2- 172.21.15.60:0/2793838041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faafc0ad340 0x7faafc0c32f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:39:15.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:15.380+0000 7fab023fa640 1 --2- 172.21.15.60:0/2793838041 >> v2:172.21.15.60:3300/0 conn(0x7faafc151840 0x7faafc0ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:15.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:15.380+0000 7fab023fa640 1 -- 172.21.15.60:0/2793838041 >> v2:172.21.15.60:3300/0 conn(0x7faafc151840 msgr2=0x7faafc0ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:39:15.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:15.380+0000 7fab023fa640 1 -- 172.21.15.60:0/2793838041 >> v2:172.21.15.60:3300/0 conn(0x7faafc151840 msgr2=0x7faafc0ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:39:15.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:15.380+0000 7fab023fa640 1 --2- 172.21.15.60:0/2793838041 >> v2:172.21.15.60:3300/0 conn(0x7faafc151840 0x7faafc0ace00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:39:15.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:15.380+0000 7fab023fa640 1 --2- 172.21.15.60:0/2793838041 >> v2:172.21.15.60:3300/0 conn(0x7faafc151840 0x7faafc0ace00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:39:16.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:16.975+0000 7faaf3fff640 1 -- 172.21.15.60:0/2793838041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faafc0ad340 msgr2=0x7faafc0c32f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:39:16.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:16.975+0000 7faaf3fff640 1 --2- 172.21.15.60:0/2793838041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faafc0ad340 0x7faafc0c32f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:16.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:16.975+0000 7faaf3fff640 1 -- 172.21.15.60:0/2793838041 >> v2:172.21.15.60:3300/0 conn(0x7faafc151840 msgr2=0x7faafc0ace00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:39:16.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:16.975+0000 7faaf3fff640 1 --2- 172.21.15.60:0/2793838041 >> v2:172.21.15.60:3300/0 conn(0x7faafc151840 0x7faafc0ace00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:16.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:16.975+0000 7faaf3fff640 1 -- 172.21.15.60:0/2793838041 >> v1:172.21.15.60:6789/0 conn(0x7faafc0c3830 legacy=0x7faafc0c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:16.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:16.975+0000 7faaf3fff640 1 --2- 172.21.15.60:0/2793838041 >> v2:172.21.15.105:3300/0 conn(0x7faae00036c0 0x7faae0005b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:16.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:16.975+0000 7fab01bf9640 1 -- 172.21.15.60:0/2793838041 >> v1:172.21.15.105:6789/0 conn(0x7faae0006190 legacy=0x7faae0008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.105:6789/0 2024-09-12T02:39:16.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:16.975+0000 7faaf3fff640 1 -- 172.21.15.60:0/2793838041 --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faafc1548f0 con 0x7faae0006190 2024-09-12T02:39:16.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:16.975+0000 7faaf3fff640 1 -- 172.21.15.60:0/2793838041 --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7faafc154610 con 0x7faae00036c0 2024-09-12T02:39:16.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:16.976+0000 7fab023fa640 1 -- 172.21.15.60:0/2793838041 >> v2:172.21.15.105:3300/0 conn(0x7faae00036c0 msgr2=0x7faae0005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3300/0 2024-09-12T02:39:16.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:16.976+0000 7fab023fa640 1 --2- 172.21.15.60:0/2793838041 >> v2:172.21.15.105:3300/0 conn(0x7faae00036c0 0x7faae0005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:39:17.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:17.176+0000 7fab01bf9640 1 -- 172.21.15.60:0/2793838041 >> v1:172.21.15.105:6789/0 conn(0x7faae0006190 legacy=0x7faae0008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.105:6789/0 2024-09-12T02:39:17.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:17.177+0000 7fab023fa640 1 -- 172.21.15.60:0/2793838041 >> v2:172.21.15.105:3300/0 conn(0x7faae00036c0 msgr2=0x7faae0005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3300/0 2024-09-12T02:39:17.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:17.177+0000 7fab023fa640 1 --2- 172.21.15.60:0/2793838041 >> v2:172.21.15.105:3300/0 conn(0x7faae00036c0 0x7faae0005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:39:17.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:17.577+0000 7fab01bf9640 1 -- 172.21.15.60:0/2793838041 >> v1:172.21.15.105:6789/0 conn(0x7faae0006190 legacy=0x7faae0008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.105:6789/0 2024-09-12T02:39:17.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:17.578+0000 7fab023fa640 1 -- 172.21.15.60:0/2793838041 >> v2:172.21.15.105:3300/0 conn(0x7faae00036c0 msgr2=0x7faae0005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3300/0 2024-09-12T02:39:17.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:17.578+0000 7fab023fa640 1 --2- 172.21.15.60:0/2793838041 >> v2:172.21.15.105:3300/0 conn(0x7faae00036c0 0x7faae0005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:39:18.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:18.378+0000 7fab01bf9640 1 -- 172.21.15.60:0/2793838041 >> v1:172.21.15.105:6789/0 conn(0x7faae0006190 legacy=0x7faae0008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.105:6789/0 2024-09-12T02:39:18.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:18.379+0000 7fab023fa640 1 -- 172.21.15.60:0/2793838041 >> v2:172.21.15.105:3300/0 conn(0x7faae00036c0 msgr2=0x7faae0005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3300/0 2024-09-12T02:39:18.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:18.379+0000 7fab023fa640 1 --2- 172.21.15.60:0/2793838041 >> v2:172.21.15.105:3300/0 conn(0x7faae00036c0 0x7faae0005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:39:19.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.975+0000 7faaf3fff640 1 -- 172.21.15.60:0/2793838041 >> v2:172.21.15.105:3300/0 conn(0x7faae00036c0 msgr2=0x7faae0005b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:39:19.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.975+0000 7faaf3fff640 1 --2- 172.21.15.60:0/2793838041 >> v2:172.21.15.105:3300/0 conn(0x7faae00036c0 0x7faae0005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:19.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.975+0000 7faaf3fff640 1 -- 172.21.15.60:0/2793838041 >> v1:172.21.15.105:6789/0 conn(0x7faae0006190 legacy=0x7faae0008650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:39:19.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.976+0000 7faaf3fff640 1 --2- 172.21.15.60:0/2793838041 >> v2:172.21.15.60:3300/0 conn(0x7faafc151840 0x7faae0009ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:19.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.976+0000 7fab02bfb640 1 -- 172.21.15.60:0/2793838041 reap_dead start 2024-09-12T02:39:19.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.976+0000 7faaf3fff640 1 --2- 172.21.15.60:0/2793838041 >> v2:172.21.15.105:3300/0 conn(0x7faae0008d80 0x7faae0005b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:19.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.976+0000 7faaf3fff640 1 -- 172.21.15.60:0/2793838041 --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faae000af30 con 0x7faafc0c3830 2024-09-12T02:39:19.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.976+0000 7faaf3fff640 1 -- 172.21.15.60:0/2793838041 --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7faafc154610 con 0x7faafc151840 2024-09-12T02:39:19.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.976+0000 7faaf3fff640 1 -- 172.21.15.60:0/2793838041 --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7faae000aca0 con 0x7faae0008d80 2024-09-12T02:39:19.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.976+0000 7fab02bfb640 1 -- 172.21.15.60:0/2793838041 >> v2:172.21.15.105:3300/0 conn(0x7faae0008d80 msgr2=0x7faae0005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3300/0 2024-09-12T02:39:19.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.976+0000 7fab02bfb640 1 --2- 172.21.15.60:0/2793838041 >> v2:172.21.15.105:3300/0 conn(0x7faae0008d80 0x7faae0005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:39:19.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.976+0000 7fab023fa640 1 --2- 172.21.15.60:0/2793838041 >> v2:172.21.15.60:3300/0 conn(0x7faafc151840 0x7faae0009ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:19.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.977+0000 7fab013f8640 1 -- 172.21.15.60:0/2793838041 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1250927425 0 0) 0x7faae000af30 con 0x7faafc0c3830 2024-09-12T02:39:19.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.977+0000 7fab013f8640 1 -- 172.21.15.60:0/2793838041 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faae8003520 con 0x7faafc0c3830 2024-09-12T02:39:19.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.977+0000 7fab023fa640 1 -- 172.21.15.60:0/2793838041 >> v2:172.21.15.105:3300/0 conn(0x7faae0008d80 msgr2=0x7faae0005b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:39:19.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.977+0000 7fab023fa640 1 --2- 172.21.15.60:0/2793838041 >> v2:172.21.15.105:3300/0 conn(0x7faae0008d80 0x7faae0005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:19.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.977+0000 7fab023fa640 1 -- 172.21.15.60:0/2793838041 >> v1:172.21.15.60:6789/0 conn(0x7faafc0c3830 legacy=0x7faae000a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:19.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.977+0000 7fab023fa640 1 -- 172.21.15.60:0/2793838041 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faafc1548f0 con 0x7faafc151840 2024-09-12T02:39:19.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.978+0000 7fab023fa640 1 --2- 172.21.15.60:0/2793838041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faafc151840 0x7faae0009ee0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7faae0006160 tx=0x7faaf802ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ab02594ba272da2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:19.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.979+0000 7fab013f8640 1 -- 172.21.15.60:0/2793838041 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf8031070 con 0x7faafc151840 2024-09-12T02:39:19.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.979+0000 7fab013f8640 1 -- 172.21.15.60:0/2793838041 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaf802b8b0 con 0x7faafc151840 2024-09-12T02:39:19.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.979+0000 7fab013f8640 1 -- 172.21.15.60:0/2793838041 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf802bce0 con 0x7faafc151840 2024-09-12T02:39:19.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.980+0000 7fab0465e640 1 -- 172.21.15.60:0/2793838041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faafc151840 msgr2=0x7faae0009ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:19.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.980+0000 7fab0465e640 1 --2- 172.21.15.60:0/2793838041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faafc151840 0x7faae0009ee0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7faae0006160 tx=0x7faaf802ad50 comp rx=0 tx=0).stop 2024-09-12T02:39:19.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.980+0000 7fab0465e640 1 -- 172.21.15.60:0/2793838041 shutdown_connections 2024-09-12T02:39:19.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.980+0000 7fab0465e640 1 --2- 172.21.15.60:0/2793838041 >> v2:172.21.15.105:3300/0 conn(0x7faae0008d80 0x7faae0005b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:19.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.980+0000 7fab0465e640 1 --2- 172.21.15.60:0/2793838041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faafc151840 0x7faae0009ee0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:19.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.980+0000 7fab0465e640 1 -- 172.21.15.60:0/2793838041 >> 172.21.15.60:0/2793838041 conn(0x7faafc0c7a40 msgr2=0x7faafc0c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:19.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.980+0000 7fab0465e640 1 -- 172.21.15.60:0/2793838041 shutdown_connections 2024-09-12T02:39:19.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.980+0000 7fab0465e640 1 -- 172.21.15.60:0/2793838041 wait complete. 2024-09-12T02:39:19.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.982+0000 7fab0465e640 1 Processor -- start 2024-09-12T02:39:19.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.982+0000 7fab0465e640 1 -- start start 2024-09-12T02:39:19.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.984+0000 7fab0465e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faae0008d80 0x7faafc0ac580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:19.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.984+0000 7fab0465e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faafc0c3830 0x7faafc150570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:19.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.984+0000 7fab023fa640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faae0008d80 0x7faafc0ac580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:19.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.984+0000 7fab023fa640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faae0008d80 0x7faafc0ac580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46332/0 (socket says 172.21.15.60:46332) 2024-09-12T02:39:19.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.984+0000 7fab0465e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faafc151840 0x7faafc1eb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:19.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.984+0000 7fab0465e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7faafc06e030 con 0x7faae0008d80 2024-09-12T02:39:19.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.984+0000 7fab0465e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7faafc06dda0 con 0x7faafc151840 2024-09-12T02:39:19.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.984+0000 7fab0465e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7faafc06e1b0 con 0x7faafc0c3830 2024-09-12T02:39:19.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.984+0000 7fab023fa640 1 -- 172.21.15.60:0/1806695603 learned_addr learned my addr 172.21.15.60:0/1806695603 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:39:19.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.984+0000 7fab02bfb640 1 -- 172.21.15.60:0/1806695603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faafc151840 msgr2=0x7faafc1eb1b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3300/0 2024-09-12T02:39:19.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.984+0000 7fab02bfb640 1 --2- 172.21.15.60:0/1806695603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faafc151840 0x7faafc1eb1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:39:19.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.984+0000 7fab01bf9640 1 --2- 172.21.15.60:0/1806695603 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faafc0c3830 0x7faafc150570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:19.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.985+0000 7fab023fa640 1 -- 172.21.15.60:0/1806695603 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faafc0c3830 msgr2=0x7faafc150570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:19.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.985+0000 7fab023fa640 1 --2- 172.21.15.60:0/1806695603 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faafc0c3830 0x7faafc150570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:19.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.985+0000 7fab023fa640 1 -- 172.21.15.60:0/1806695603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faafc151840 msgr2=0x7faafc1eb1b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:39:19.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.985+0000 7fab023fa640 1 --2- 172.21.15.60:0/1806695603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faafc151840 0x7faafc1eb1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:19.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.985+0000 7fab023fa640 1 -- 172.21.15.60:0/1806695603 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faafc0750d0 con 0x7faae0008d80 2024-09-12T02:39:19.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.985+0000 7fab023fa640 1 --2- 172.21.15.60:0/1806695603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faae0008d80 0x7faafc0ac580 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7faaf8037040 tx=0x7faaf80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:19.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.985+0000 7faaf2ffd640 1 -- 172.21.15.60:0/1806695603 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf8043020 con 0x7faae0008d80 2024-09-12T02:39:19.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.985+0000 7faaf2ffd640 1 -- 172.21.15.60:0/1806695603 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaf8035a90 con 0x7faae0008d80 2024-09-12T02:39:19.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.985+0000 7faaf2ffd640 1 -- 172.21.15.60:0/1806695603 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf803e440 con 0x7faae0008d80 2024-09-12T02:39:19.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.986+0000 7fab0465e640 1 -- 172.21.15.60:0/1806695603 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faafc075370 con 0x7faae0008d80 2024-09-12T02:39:19.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.987+0000 7fab0465e640 1 -- 172.21.15.60:0/1806695603 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faafc1510a0 con 0x7faae0008d80 2024-09-12T02:39:19.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.991+0000 7faaf2ffd640 1 -- 172.21.15.60:0/1806695603 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faaf8046020 con 0x7faae0008d80 2024-09-12T02:39:19.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.992+0000 7fab0465e640 1 -- 172.21.15.60:0/1806695603 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faafc151c20 con 0x7faae0008d80 2024-09-12T02:39:19.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.992+0000 7faaf2ffd640 1 --2- 172.21.15.60:0/1806695603 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7faae006d040 0x7faae006f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:19.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.992+0000 7faaf2ffd640 1 -- 172.21.15.60:0/1806695603 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7faaf80ac080 con 0x7faae0008d80 2024-09-12T02:39:19.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:19.993+0000 7fab01bf9640 1 --2- 172.21.15.60:0/1806695603 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7faae006d040 0x7faae006f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:20.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.000+0000 7fab01bf9640 1 --2- 172.21.15.60:0/1806695603 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7faae006d040 0x7faae006f500 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7faafc069a20 tx=0x7faaec008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:20.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.001+0000 7faaf2ffd640 1 -- 172.21.15.60:0/1806695603 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faaf804d030 con 0x7faae0008d80 2024-09-12T02:39:20.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.480+0000 7fab0465e640 1 -- 172.21.15.60:0/1806695603 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7faafc0c7e20 con 0x7faae0008d80 2024-09-12T02:39:20.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.480+0000 7faaf2ffd640 1 -- 172.21.15.60:0/1806695603 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1559 (secure 0 0 0) 0x7faaf807a700 con 0x7faae0008d80 2024-09-12T02:39:20.482 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":156,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:39:20.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.484+0000 7fab0465e640 1 -- 172.21.15.60:0/1806695603 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7faae006d040 msgr2=0x7faae006f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:20.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.484+0000 7fab0465e640 1 --2- 172.21.15.60:0/1806695603 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7faae006d040 0x7faae006f500 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7faafc069a20 tx=0x7faaec008040 comp rx=0 tx=0).stop 2024-09-12T02:39:20.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.484+0000 7fab0465e640 1 -- 172.21.15.60:0/1806695603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faae0008d80 msgr2=0x7faafc0ac580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:20.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.484+0000 7fab0465e640 1 --2- 172.21.15.60:0/1806695603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faae0008d80 0x7faafc0ac580 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7faaf8037040 tx=0x7faaf80046c0 comp rx=0 tx=0).stop 2024-09-12T02:39:20.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.484+0000 7fab0465e640 1 -- 172.21.15.60:0/1806695603 shutdown_connections 2024-09-12T02:39:20.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.484+0000 7fab0465e640 1 --2- 172.21.15.60:0/1806695603 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7faae006d040 0x7faae006f500 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:20.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.484+0000 7fab0465e640 1 --2- 172.21.15.60:0/1806695603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faafc151840 0x7faafc1eb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:20.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.484+0000 7fab0465e640 1 --2- 172.21.15.60:0/1806695603 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faafc0c3830 0x7faafc150570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:20.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.484+0000 7fab0465e640 1 --2- 172.21.15.60:0/1806695603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faae0008d80 0x7faafc0ac580 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:20.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.484+0000 7fab0465e640 1 -- 172.21.15.60:0/1806695603 >> 172.21.15.60:0/1806695603 conn(0x7faafc0c7a40 msgr2=0x7faafc14e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:20.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.485+0000 7fab0465e640 1 -- 172.21.15.60:0/1806695603 shutdown_connections 2024-09-12T02:39:20.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.485+0000 7fab0465e640 1 -- 172.21.15.60:0/1806695603 wait complete. 2024-09-12T02:39:20.503 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-12T02:39:20.503 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-09-12T02:39:20.503 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-12T02:39:20.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.668+0000 7f3125d2c640 1 Processor -- start 2024-09-12T02:39:20.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.668+0000 7f3125d2c640 1 -- start start 2024-09-12T02:39:20.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.670+0000 7f3125d2c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f312006e640 0x7f312015b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:20.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.670+0000 7f3125d2c640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f312006ea20 0x7f31200c5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:20.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.670+0000 7f3125d2c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f312006ee60 0x7f31200c5650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:20.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.670+0000 7f3125d2c640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f31200ab4e0 con 0x7f312006ee60 2024-09-12T02:39:20.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.670+0000 7f3125d2c640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f31200ab7c0 con 0x7f312006ea20 2024-09-12T02:39:20.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.670+0000 7f3125d2c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3120067ea0 con 0x7f312006e640 2024-09-12T02:39:20.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.670+0000 7f3116ffd640 1 -- >> v2:172.21.15.105:3300/0 conn(0x7f312006ea20 msgr2=0x7f31200c5110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3300/0 2024-09-12T02:39:20.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.670+0000 7f3116ffd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f312006ea20 0x7f31200c5110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:39:20.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.670+0000 7f311f7fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f312006e640 0x7f312015b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:20.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.670+0000 7f311f7fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f312006e640 0x7f312015b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:52124/0 (socket says 172.21.15.60:52124) 2024-09-12T02:39:20.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.670+0000 7f311f7fe640 1 -- 172.21.15.60:0/3664834309 learned_addr learned my addr 172.21.15.60:0/3664834309 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:39:20.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.670+0000 7f311ffff640 1 --2- 172.21.15.60:0/3664834309 >> v2:172.21.15.60:3300/0 conn(0x7f312006ee60 0x7f31200c5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:20.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.671+0000 7f311f7fe640 1 -- 172.21.15.60:0/3664834309 >> v2:172.21.15.105:3300/0 conn(0x7f312006ea20 msgr2=0x7f31200c5110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:39:20.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.671+0000 7f311f7fe640 1 --2- 172.21.15.60:0/3664834309 >> v2:172.21.15.105:3300/0 conn(0x7f312006ea20 0x7f31200c5110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:20.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.671+0000 7f311f7fe640 1 -- 172.21.15.60:0/3664834309 >> v2:172.21.15.60:3300/0 conn(0x7f312006ee60 msgr2=0x7f31200c5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:20.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.671+0000 7f311f7fe640 1 --2- 172.21.15.60:0/3664834309 >> v2:172.21.15.60:3300/0 conn(0x7f312006ee60 0x7f31200c5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:20.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.671+0000 7f311f7fe640 1 -- 172.21.15.60:0/3664834309 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31200ad580 con 0x7f312006e640 2024-09-12T02:39:20.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.672+0000 7f311f7fe640 1 --2- 172.21.15.60:0/3664834309 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f312006e640 0x7f312015b270 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f31200c2af0 tx=0x7f310802a160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96d4dec9878be901 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:20.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.672+0000 7f311effd640 1 -- 172.21.15.60:0/3664834309 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3108037070 con 0x7f312006e640 2024-09-12T02:39:20.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.672+0000 7f311effd640 1 -- 172.21.15.60:0/3664834309 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3108032440 con 0x7f312006e640 2024-09-12T02:39:20.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.673+0000 7f311effd640 1 -- 172.21.15.60:0/3664834309 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3108037070 con 0x7f312006e640 2024-09-12T02:39:20.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.673+0000 7f3125d2c640 1 -- 172.21.15.60:0/3664834309 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f312006e640 msgr2=0x7f312015b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:20.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.673+0000 7f3125d2c640 1 --2- 172.21.15.60:0/3664834309 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f312006e640 0x7f312015b270 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f31200c2af0 tx=0x7f310802a160 comp rx=0 tx=0).stop 2024-09-12T02:39:20.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.674+0000 7f3125d2c640 1 -- 172.21.15.60:0/3664834309 shutdown_connections 2024-09-12T02:39:20.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.674+0000 7f3125d2c640 1 --2- 172.21.15.60:0/3664834309 >> v2:172.21.15.105:3300/0 conn(0x7f312006ea20 0x7f31200c5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:20.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.674+0000 7f3125d2c640 1 --2- 172.21.15.60:0/3664834309 >> v2:172.21.15.60:3300/0 conn(0x7f312006ee60 0x7f31200c5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:20.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.674+0000 7f3125d2c640 1 --2- 172.21.15.60:0/3664834309 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f312006e640 0x7f312015b270 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:20.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.674+0000 7f3125d2c640 1 -- 172.21.15.60:0/3664834309 >> 172.21.15.60:0/3664834309 conn(0x7f31200c8430 msgr2=0x7f31200c8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:20.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.674+0000 7f3125d2c640 1 -- 172.21.15.60:0/3664834309 shutdown_connections 2024-09-12T02:39:20.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.674+0000 7f3125d2c640 1 -- 172.21.15.60:0/3664834309 wait complete. 2024-09-12T02:39:20.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.676+0000 7f3125d2c640 1 Processor -- start 2024-09-12T02:39:20.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.676+0000 7f3125d2c640 1 -- start start 2024-09-12T02:39:20.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.677+0000 7f3125d2c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f312006e640 0x7f312015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:20.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.677+0000 7f3125d2c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f312006ea20 0x7f3120153700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:20.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.677+0000 7f3125d2c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f312006ee60 0x7f3120153c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:20.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.677+0000 7f3125d2c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f31200abc50 con 0x7f312006e640 2024-09-12T02:39:20.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.677+0000 7f3125d2c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f31200ad250 con 0x7f312006ee60 2024-09-12T02:39:20.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.677+0000 7f3125d2c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f31200716b0 con 0x7f312006ea20 2024-09-12T02:39:20.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.677+0000 7f311ffff640 1 -- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f312006ee60 msgr2=0x7f3120153c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3300/0 2024-09-12T02:39:20.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.677+0000 7f311ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f312006ee60 0x7f3120153c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:39:20.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.677+0000 7f311f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f312006e640 0x7f312015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:20.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.677+0000 7f311f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f312006e640 0x7f312015dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46352/0 (socket says 172.21.15.60:46352) 2024-09-12T02:39:20.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.677+0000 7f311f7fe640 1 -- 172.21.15.60:0/1762945940 learned_addr learned my addr 172.21.15.60:0/1762945940 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:39:20.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.677+0000 7f3116ffd640 1 --2- 172.21.15.60:0/1762945940 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f312006ea20 0x7f3120153700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:20.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.678+0000 7f311f7fe640 1 -- 172.21.15.60:0/1762945940 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f312006ea20 msgr2=0x7f3120153700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:20.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.678+0000 7f311f7fe640 1 --2- 172.21.15.60:0/1762945940 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f312006ea20 0x7f3120153700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:20.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.678+0000 7f311f7fe640 1 -- 172.21.15.60:0/1762945940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f312006ee60 msgr2=0x7f3120153c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:39:20.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.678+0000 7f311f7fe640 1 --2- 172.21.15.60:0/1762945940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f312006ee60 0x7f3120153c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:20.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.678+0000 7f311f7fe640 1 -- 172.21.15.60:0/1762945940 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3120071990 con 0x7f312006e640 2024-09-12T02:39:20.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.678+0000 7f311f7fe640 1 --2- 172.21.15.60:0/1762945940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f312006e640 0x7f312015dec0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3108000c00 tx=0x7f31080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:20.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.679+0000 7f311cff9640 1 -- 172.21.15.60:0/1762945940 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3108042070 con 0x7f312006e640 2024-09-12T02:39:20.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.679+0000 7f3125d2c640 1 -- 172.21.15.60:0/1762945940 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f312015d6c0 con 0x7f312006e640 2024-09-12T02:39:20.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.679+0000 7f311cff9640 1 -- 172.21.15.60:0/1762945940 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3108030650 con 0x7f312006e640 2024-09-12T02:39:20.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.679+0000 7f3125d2c640 1 -- 172.21.15.60:0/1762945940 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31200a53b0 con 0x7f312006e640 2024-09-12T02:39:20.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.679+0000 7f311cff9640 1 -- 172.21.15.60:0/1762945940 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3108037070 con 0x7f312006e640 2024-09-12T02:39:20.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.681+0000 7f3125d2c640 1 --2- 172.21.15.60:0/1762945940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f312015e400 0x7f31201f3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:20.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.681+0000 7f3125d2c640 1 -- 172.21.15.60:0/1762945940 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f31200abdd0 con 0x7f312015e400 2024-09-12T02:39:20.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.681+0000 7f311cff9640 1 -- 172.21.15.60:0/1762945940 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3108045070 con 0x7f312006e640 2024-09-12T02:39:20.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.682+0000 7f3116ffd640 1 --2- 172.21.15.60:0/1762945940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f312015e400 0x7f31201f3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:20.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.682+0000 7f311cff9640 1 --2- 172.21.15.60:0/1762945940 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f310006bfe0 0x7f310006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:20.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.682+0000 7f3116ffd640 1 -- 172.21.15.60:0/1762945940 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f312015dbe0 con 0x7f312015e400 2024-09-12T02:39:20.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.682+0000 7f311cff9640 1 -- 172.21.15.60:0/1762945940 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f3108030800 con 0x7f312006e640 2024-09-12T02:39:20.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.683+0000 7f3116ffd640 1 --2- 172.21.15.60:0/1762945940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f312015e400 0x7f31201f3590 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f31201588d0 tx=0x7f311000ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:20.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.683+0000 7f311cff9640 1 -- 172.21.15.60:0/1762945940 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f311001a070 con 0x7f312015e400 2024-09-12T02:39:20.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.683+0000 7f311ffff640 1 --2- 172.21.15.60:0/1762945940 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f310006bfe0 0x7f310006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:20.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.683+0000 7f311cff9640 1 -- 172.21.15.60:0/1762945940 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f3110007490 con 0x7f312015e400 2024-09-12T02:39:20.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.683+0000 7f311cff9640 1 -- 172.21.15.60:0/1762945940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f312015e400 msgr2=0x7f31201f3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:20.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.683+0000 7f311cff9640 1 --2- 172.21.15.60:0/1762945940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f312015e400 0x7f31201f3590 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f31201588d0 tx=0x7f311000ba70 comp rx=0 tx=0).stop 2024-09-12T02:39:20.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.683+0000 7f311cff9640 1 -- 172.21.15.60:0/1762945940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f312015e400 msgr2=0x7f31201f3590 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:39:20.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.683+0000 7f311cff9640 1 --2- 172.21.15.60:0/1762945940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f312015e400 0x7f31201f3590 secure :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f31201588d0 tx=0x7f311000ba70 comp rx=0 tx=0).stop 2024-09-12T02:39:20.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.684+0000 7f311ffff640 1 --2- 172.21.15.60:0/1762945940 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f310006bfe0 0x7f310006e4a0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f312006f290 tx=0x7f3118009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:20.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.700+0000 7f3125d2c640 1 --2- 172.21.15.60:0/1762945940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31201f1220 0x7f31201f3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:20.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.700+0000 7f3125d2c640 1 -- 172.21.15.60:0/1762945940 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f31201f4010 con 0x7f31201f1220 2024-09-12T02:39:20.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.701+0000 7f3116ffd640 1 --2- 172.21.15.60:0/1762945940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31201f1220 0x7f31201f3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:20.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.701+0000 7f3116ffd640 1 -- 172.21.15.60:0/1762945940 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f31200c7950 con 0x7f31201f1220 2024-09-12T02:39:20.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.702+0000 7f3116ffd640 1 --2- 172.21.15.60:0/1762945940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31201f1220 0x7f31201f3ad0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3110009fd0 tx=0x7f3110005d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:20.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.702+0000 7f311cff9640 1 -- 172.21.15.60:0/1762945940 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f311001a070 con 0x7f31201f1220 2024-09-12T02:39:20.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.705+0000 7f311cff9640 1 -- 172.21.15.60:0/1762945940 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5042 (secure 0 0 0) 0x7f3110026400 con 0x7f31201f1220 2024-09-12T02:39:20.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.705+0000 7f311cff9640 1 -- 172.21.15.60:0/1762945940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31201f1220 msgr2=0x7f31201f3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:20.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.705+0000 7f311cff9640 1 --2- 172.21.15.60:0/1762945940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31201f1220 0x7f31201f3ad0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3110009fd0 tx=0x7f3110005d40 comp rx=0 tx=0).stop 2024-09-12T02:39:20.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.705+0000 7f311cff9640 1 -- 172.21.15.60:0/1762945940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31201f1220 msgr2=0x7f31201f3ad0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:39:20.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.705+0000 7f311cff9640 1 --2- 172.21.15.60:0/1762945940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31201f1220 0x7f31201f3ad0 secure :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3110009fd0 tx=0x7f3110005d40 comp rx=0 tx=0).stop 2024-09-12T02:39:20.706 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:39:20.707 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:39:20.707 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:39:20.707 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:39:20.707 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 156, 2024-09-12T02:39:20.707 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 100476, 2024-09-12T02:39:20.707 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:39:20.707 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:39:20.707 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:39:20.707 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:20.707 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-09-12T02:39:20.707 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:39:20.708 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:39:20.708 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:39:20.708 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:39:20.708 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:39:20.708 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:39:20.708 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:39:20.708 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:39:20.708 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:39:20.709 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:39:20.709 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:39:20.709 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:39:20.709 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:39:20.709 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:39:20.709 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:20.709 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:39:20.709 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:39:20.709 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:39:20.709 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:39:20.710 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:39:20.710 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:39:20.710 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:39:20.710 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:39:20.710 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:39:20.710 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:39:20.710 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:39:20.710 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:39:20.710 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:39:20.710 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:20.711 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:20.711 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:39:20.711 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:39:20.711 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:39:20.711 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:39:20.711 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:39:20.711 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:39:20.711 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:39:20.711 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:39:20.711 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:39:20.711 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:39:20.711 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:39:20.712 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:39:20.712 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:39:20.712 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:39:20.712 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:39:20.712 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:39:20.712 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:39:20.712 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:39:20.712 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:39:20.712 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:39:20.712 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:39:20.712 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:39:20.712 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:39:20.712 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:39:20.713 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:39:20.713 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:39:20.713 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:39:20.713 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:39:20.713 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:20.713 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:39:20.713 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:20.713 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:39:20.713 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:20.714 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:39:20.714 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:39:20.714 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:39:20.714 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:39:20.714 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:20.714 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:39:20.714 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:39:20.714 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:20.714 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:20.714 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:20.714 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:39:20.714 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:39:20.714 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:20.715 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:20.715 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:20.715 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:20.715 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:39:20.715 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:39:20.715 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:39:20.715 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:39:20.715 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:39:20.715 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:20.715 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:20.715 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:39:20.715 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:39:20.715 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:39:20.716 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:39:20.716 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:20.716 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:39:20.716 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:39:20.716 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:20.716 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:20.716 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:20.716 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:39:20.716 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:39:20.716 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:20.716 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:20.716 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:20.717 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:20.717 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:39:20.717 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:39:20.717 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:39:20.717 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:39:20.717 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:39:20.717 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:20.717 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:20.717 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:39:20.717 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:39:20.717 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:39:20.717 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:39:20.717 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:20.718 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:39:20.718 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:39:20.718 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:20.718 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:20.718 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:20.718 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:39:20.718 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:39:20.718 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:20.718 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:20.718 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:20.718 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:20.718 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:39:20.718 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:39:20.718 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:39:20.719 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:39:20.719 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:39:20.719 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:20.719 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:20.719 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:20.719 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:39:20.719 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:39:20.719 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:20.719 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:39:20.719 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:39:20.719 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:39:20.719 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:20.719 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:20.719 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:39:20.720 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:20.720 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:39:20.720 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:39:20.720 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:39:20.720 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:20.720 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:20.720 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:39:20.720 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:20.720 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:39:20.720 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:39:20.720 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:39:20.720 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:20.721 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:20.721 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:39:20.721 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:20.721 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:39:20.721 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:39:20.721 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 8 2024-09-12T02:39:20.721 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:20.721 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:20.721 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:39:20.721 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:20.721 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:39:20.721 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:39:20.721 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:39:20.721 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:20.722 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:20.722 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:20.722 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:39:20.722 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:39:20.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.708+0000 7f3125d2c640 1 -- 172.21.15.60:0/1762945940 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f310006bfe0 msgr2=0x7f310006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:20.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.708+0000 7f3125d2c640 1 --2- 172.21.15.60:0/1762945940 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f310006bfe0 0x7f310006e4a0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f312006f290 tx=0x7f3118009190 comp rx=0 tx=0).stop 2024-09-12T02:39:20.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.708+0000 7f3125d2c640 1 -- 172.21.15.60:0/1762945940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f312006e640 msgr2=0x7f312015dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:20.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.708+0000 7f311ffff640 1 -- 172.21.15.60:0/1762945940 reap_dead start 2024-09-12T02:39:20.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.708+0000 7f3125d2c640 1 --2- 172.21.15.60:0/1762945940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f312006e640 0x7f312015dec0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3108000c00 tx=0x7f31080046c0 comp rx=0 tx=0).stop 2024-09-12T02:39:20.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.709+0000 7f3125d2c640 1 -- 172.21.15.60:0/1762945940 shutdown_connections 2024-09-12T02:39:20.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.709+0000 7f3125d2c640 1 --2- 172.21.15.60:0/1762945940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f312006e640 0x7f312015dec0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:20.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.709+0000 7f3125d2c640 1 -- 172.21.15.60:0/1762945940 >> 172.21.15.60:0/1762945940 conn(0x7f31200c8430 msgr2=0x7f3120159a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:20.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.710+0000 7f3125d2c640 1 -- 172.21.15.60:0/1762945940 shutdown_connections 2024-09-12T02:39:20.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.710+0000 7f3125d2c640 1 -- 172.21.15.60:0/1762945940 wait complete. 2024-09-12T02:39:20.728 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-12T02:39:20.728 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-12T02:39:20.729 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-12T02:39:20.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.901+0000 7f2a1f768640 1 Processor -- start 2024-09-12T02:39:20.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.901+0000 7f2a1f768640 1 -- start start 2024-09-12T02:39:20.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.903+0000 7f2a1f768640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2a1814f820 0x7f2a181562d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:20.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.903+0000 7f2a1f768640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2a180c7230 0x7f2a1814fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:20.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.903+0000 7f2a1f768640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a180c53f0 con 0x7f2a18152bc0 2024-09-12T02:39:20.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.903+0000 7f2a1d504640 1 -- >> v2:172.21.15.105:3300/0 conn(0x7f2a1814f820 msgr2=0x7f2a181562d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.105:3300/0 2024-09-12T02:39:20.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.903+0000 7f2a1d504640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2a1814f820 0x7f2a181562d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:39:20.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.903+0000 7f2a1dd05640 1 -- >> v1:172.21.15.105:6789/0 conn(0x7f2a18152bc0 legacy=0x7f2a180c41e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.105:6789/0 2024-09-12T02:39:20.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.903+0000 7f2a1f768640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f2a180c2d60 con 0x7f2a180c7230 2024-09-12T02:39:20.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.903+0000 7f2a1f768640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f2a180c3040 con 0x7f2a1814f820 2024-09-12T02:39:20.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.903+0000 7f2a1cd03640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2a180c7230 0x7f2a1814fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:20.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.904+0000 7f2a1cd03640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2a180c7230 0x7f2a1814fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46374/0 (socket says 172.21.15.60:46374) 2024-09-12T02:39:20.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.904+0000 7f2a1cd03640 1 -- 172.21.15.60:0/1540832253 learned_addr learned my addr 172.21.15.60:0/1540832253 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:39:20.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.904+0000 7f2a1cd03640 1 -- 172.21.15.60:0/1540832253 >> v2:172.21.15.105:3300/0 conn(0x7f2a1814f820 msgr2=0x7f2a181562d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:39:20.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.904+0000 7f2a1cd03640 1 --2- 172.21.15.60:0/1540832253 >> v2:172.21.15.105:3300/0 conn(0x7f2a1814f820 0x7f2a181562d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:20.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.904+0000 7f2a1cd03640 1 -- 172.21.15.60:0/1540832253 >> v1:172.21.15.105:6789/0 conn(0x7f2a18152bc0 legacy=0x7f2a180c41e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:39:20.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.904+0000 7f2a1cd03640 1 -- 172.21.15.60:0/1540832253 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a181526a0 con 0x7f2a180c7230 2024-09-12T02:39:20.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.905+0000 7f2a1cd03640 1 --2- 172.21.15.60:0/1540832253 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a180c7230 0x7f2a1814fc00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2a180c51f0 tx=0x7f2a0802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46c3a8fc14091c07 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:20.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.906+0000 7f2a0ffff640 1 -- 172.21.15.60:0/1540832253 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a08037070 con 0x7f2a180c7230 2024-09-12T02:39:20.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.906+0000 7f2a0ffff640 1 -- 172.21.15.60:0/1540832253 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a0802ae40 con 0x7f2a180c7230 2024-09-12T02:39:20.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.906+0000 7f2a0ffff640 1 -- 172.21.15.60:0/1540832253 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a08032660 con 0x7f2a180c7230 2024-09-12T02:39:20.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.907+0000 7f2a1f768640 1 -- 172.21.15.60:0/1540832253 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a180c7230 msgr2=0x7f2a1814fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:20.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.907+0000 7f2a1f768640 1 --2- 172.21.15.60:0/1540832253 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a180c7230 0x7f2a1814fc00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2a180c51f0 tx=0x7f2a0802a130 comp rx=0 tx=0).stop 2024-09-12T02:39:20.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.907+0000 7f2a1f768640 1 -- 172.21.15.60:0/1540832253 shutdown_connections 2024-09-12T02:39:20.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.907+0000 7f2a1f768640 1 --2- 172.21.15.60:0/1540832253 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a180c7230 0x7f2a1814fc00 secure :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2a180c51f0 tx=0x7f2a0802a130 comp rx=0 tx=0).stop 2024-09-12T02:39:20.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.907+0000 7f2a1f768640 1 --2- 172.21.15.60:0/1540832253 >> v2:172.21.15.105:3300/0 conn(0x7f2a1814f820 0x7f2a181562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:20.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.907+0000 7f2a1f768640 1 -- 172.21.15.60:0/1540832253 >> 172.21.15.60:0/1540832253 conn(0x7f2a180c7a40 msgr2=0x7f2a180c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:20.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.907+0000 7f2a1f768640 1 -- 172.21.15.60:0/1540832253 shutdown_connections 2024-09-12T02:39:20.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.907+0000 7f2a1f768640 1 -- 172.21.15.60:0/1540832253 wait complete. 2024-09-12T02:39:20.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.909+0000 7f2a1f768640 1 Processor -- start 2024-09-12T02:39:20.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.910+0000 7f2a1f768640 1 -- start start 2024-09-12T02:39:20.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.911+0000 7f2a1f768640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a1814f820 0x7f2a1813aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:20.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.911+0000 7f2a1f768640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a18152bc0 0x7f2a1813b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:20.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.911+0000 7f2a1f768640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a1813c6f0 0x7f2a1813b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:20.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.911+0000 7f2a1f768640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2a180c5d70 con 0x7f2a18152bc0 2024-09-12T02:39:20.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.911+0000 7f2a1f768640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2a180c5bf0 con 0x7f2a1813c6f0 2024-09-12T02:39:20.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.911+0000 7f2a1f768640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2a180c48f0 con 0x7f2a1814f820 2024-09-12T02:39:20.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.912+0000 7f2a1d504640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a1814f820 0x7f2a1813aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:20.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.912+0000 7f2a1d504640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a1814f820 0x7f2a1813aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:52140/0 (socket says 172.21.15.60:52140) 2024-09-12T02:39:20.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.912+0000 7f2a1d504640 1 -- 172.21.15.60:0/3527207799 learned_addr learned my addr 172.21.15.60:0/3527207799 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:39:20.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.913+0000 7f2a1dd05640 1 -- 172.21.15.60:0/3527207799 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a1813c6f0 msgr2=0x7f2a1813b550 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.105:3300/0 2024-09-12T02:39:20.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.913+0000 7f2a1dd05640 1 --2- 172.21.15.60:0/3527207799 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a1813c6f0 0x7f2a1813b550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:39:20.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.913+0000 7f2a1cd03640 1 --2- 172.21.15.60:0/3527207799 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a18152bc0 0x7f2a1813b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:20.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.914+0000 7f2a1cd03640 1 -- 172.21.15.60:0/3527207799 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a1814f820 msgr2=0x7f2a1813aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:20.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.914+0000 7f2a1cd03640 1 --2- 172.21.15.60:0/3527207799 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a1814f820 0x7f2a1813aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:20.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.914+0000 7f2a1cd03640 1 -- 172.21.15.60:0/3527207799 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a1813c6f0 msgr2=0x7f2a1813b550 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:39:20.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.914+0000 7f2a1cd03640 1 --2- 172.21.15.60:0/3527207799 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a1813c6f0 0x7f2a1813b550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:20.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.914+0000 7f2a1cd03640 1 -- 172.21.15.60:0/3527207799 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a18145ad0 con 0x7f2a18152bc0 2024-09-12T02:39:20.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.914+0000 7f2a1d504640 1 --2- 172.21.15.60:0/3527207799 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a1814f820 0x7f2a1813aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:39:20.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.914+0000 7f2a1cd03640 1 --2- 172.21.15.60:0/3527207799 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a18152bc0 0x7f2a1813b010 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2a180c5bc0 tx=0x7f2a080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:20.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.914+0000 7f2a0dffb640 1 -- 172.21.15.60:0/3527207799 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a08037040 con 0x7f2a18152bc0 2024-09-12T02:39:20.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.915+0000 7f2a0dffb640 1 -- 172.21.15.60:0/3527207799 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a08032e20 con 0x7f2a18152bc0 2024-09-12T02:39:20.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.915+0000 7f2a0dffb640 1 -- 172.21.15.60:0/3527207799 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a08004250 con 0x7f2a18152bc0 2024-09-12T02:39:20.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.915+0000 7f2a1f768640 1 -- 172.21.15.60:0/3527207799 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a18145db0 con 0x7f2a18152bc0 2024-09-12T02:39:20.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.916+0000 7f2a1f768640 1 -- 172.21.15.60:0/3527207799 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a181efac0 con 0x7f2a18152bc0 2024-09-12T02:39:20.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.917+0000 7f2a1f768640 1 --2- 172.21.15.60:0/3527207799 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a180aa450 0x7f2a180a5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:20.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.917+0000 7f2a1f768640 1 -- 172.21.15.60:0/3527207799 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2a181f0030 con 0x7f2a180aa450 2024-09-12T02:39:20.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.918+0000 7f2a1d504640 1 --2- 172.21.15.60:0/3527207799 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a180aa450 0x7f2a180a5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:20.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.918+0000 7f2a1d504640 1 -- 172.21.15.60:0/3527207799 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2a180008d0 con 0x7f2a180aa450 2024-09-12T02:39:20.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.918+0000 7f2a0dffb640 1 -- 172.21.15.60:0/3527207799 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2a0803a040 con 0x7f2a18152bc0 2024-09-12T02:39:20.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.918+0000 7f2a1d504640 1 --2- 172.21.15.60:0/3527207799 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a180aa450 0x7f2a180a5b20 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2a1400eaa0 tx=0x7f2a1400ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:20.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.919+0000 7f2a0dffb640 1 --2- 172.21.15.60:0/3527207799 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f29fc06be60 0x7f29fc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:20.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.919+0000 7f2a1dd05640 1 --2- 172.21.15.60:0/3527207799 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f29fc06be60 0x7f29fc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:20.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.919+0000 7f2a0dffb640 1 -- 172.21.15.60:0/3527207799 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f2a080ab480 con 0x7f2a18152bc0 2024-09-12T02:39:20.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.920+0000 7f2a0dffb640 1 -- 172.21.15.60:0/3527207799 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a14018420 con 0x7f2a180aa450 2024-09-12T02:39:20.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.920+0000 7f2a0dffb640 1 -- 172.21.15.60:0/3527207799 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f2a14013030 con 0x7f2a180aa450 2024-09-12T02:39:20.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.920+0000 7f2a0dffb640 1 -- 172.21.15.60:0/3527207799 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a180aa450 msgr2=0x7f2a180a5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:20.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.920+0000 7f2a0dffb640 1 --2- 172.21.15.60:0/3527207799 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a180aa450 0x7f2a180a5b20 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2a1400eaa0 tx=0x7f2a1400ef60 comp rx=0 tx=0).stop 2024-09-12T02:39:20.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.920+0000 7f2a0dffb640 1 -- 172.21.15.60:0/3527207799 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a180aa450 msgr2=0x7f2a180a5b20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:39:20.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.920+0000 7f2a0dffb640 1 --2- 172.21.15.60:0/3527207799 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a180aa450 0x7f2a180a5b20 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:20.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.921+0000 7f2a1dd05640 1 --2- 172.21.15.60:0/3527207799 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f29fc06be60 0x7f29fc06e320 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f2a10004d40 tx=0x7f2a10009250 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:20.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.933+0000 7f2a1f768640 1 --2- 172.21.15.60:0/3527207799 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a1806ed30 0x7f2a180a6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:20.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.933+0000 7f2a1f768640 1 -- 172.21.15.60:0/3527207799 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2a180c8530 con 0x7f2a1806ed30 2024-09-12T02:39:20.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.933+0000 7f2a1d504640 1 --2- 172.21.15.60:0/3527207799 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a1806ed30 0x7f2a180a6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:20.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.934+0000 7f2a1d504640 1 -- 172.21.15.60:0/3527207799 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2a180aa0b0 con 0x7f2a1806ed30 2024-09-12T02:39:20.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.934+0000 7f2a1d504640 1 --2- 172.21.15.60:0/3527207799 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a1806ed30 0x7f2a180a6060 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2a1400ea70 tx=0x7f2a14003980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:20.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.935+0000 7f2a0dffb640 1 -- 172.21.15.60:0/3527207799 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a14019e60 con 0x7f2a1806ed30 2024-09-12T02:39:20.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.935+0000 7f2a0dffb640 1 -- 172.21.15.60:0/3527207799 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4872 (secure 0 0 0) 0x7f2a14010ac0 con 0x7f2a1806ed30 2024-09-12T02:39:20.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.935+0000 7f2a0dffb640 1 -- 172.21.15.60:0/3527207799 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a1806ed30 msgr2=0x7f2a180a6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:20.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.935+0000 7f2a0dffb640 1 --2- 172.21.15.60:0/3527207799 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a1806ed30 0x7f2a180a6060 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2a1400ea70 tx=0x7f2a14003980 comp rx=0 tx=0).stop 2024-09-12T02:39:20.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.935+0000 7f2a0dffb640 1 -- 172.21.15.60:0/3527207799 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a1806ed30 msgr2=0x7f2a180a6060 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:39:20.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.935+0000 7f2a0dffb640 1 --2- 172.21.15.60:0/3527207799 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a1806ed30 0x7f2a180a6060 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:20.938 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:39:20.938 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:39:20.938 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:39:20.938 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:39:20.938 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 156, 2024-09-12T02:39:20.939 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 38873, 2024-09-12T02:39:20.939 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:39:20.939 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:39:20.939 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:39:20.939 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:20.939 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 3, 2024-09-12T02:39:20.939 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:39:20.940 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:39:20.940 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:39:20.940 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:39:20.940 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:39:20.940 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:39:20.940 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:39:20.940 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:39:20.940 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:39:20.940 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:39:20.940 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:39:20.941 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:39:20.941 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:39:20.941 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:39:20.941 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:20.941 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:39:20.941 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:39:20.941 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:39:20.941 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:39:20.941 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:39:20.941 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:39:20.942 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:39:20.942 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:39:20.942 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:39:20.942 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:39:20.942 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:39:20.942 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:39:20.942 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:39:20.942 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:20.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:20.942 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:39:20.943 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:39:20.943 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:39:20.943 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:39:20.943 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:39:20.943 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:39:20.943 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:39:20.943 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:39:20.943 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:39:20.943 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:39:20.943 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:39:20.943 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:39:20.943 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:39:20.943 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:39:20.944 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:39:20.944 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:39:20.944 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:39:20.944 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:39:20.944 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:39:20.944 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:39:20.944 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:39:20.944 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:39:20.944 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:39:20.944 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:39:20.944 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:39:20.944 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:39:20.944 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:39:20.944 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:39:20.945 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:20.945 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:39:20.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:20.945 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:39:20.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:20.945 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:39:20.945 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:39:20.945 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:39:20.945 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:39:20.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:20.945 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:39:20.945 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:39:20.945 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:20.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:20.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:20.946 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:39:20.946 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:39:20.946 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:20.946 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:20.946 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:20.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:20.946 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:39:20.946 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:39:20.946 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:39:20.946 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:39:20.946 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:39:20.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:20.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:20.947 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:39:20.947 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:39:20.947 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:39:20.947 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:39:20.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:20.947 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:39:20.947 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:39:20.947 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:20.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:20.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:20.947 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:39:20.947 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:39:20.948 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:20.948 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:20.948 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:20.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:20.948 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:39:20.948 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:39:20.948 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:39:20.948 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:39:20.948 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:39:20.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:20.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:20.948 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:39:20.948 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:39:20.949 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:39:20.949 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:39:20.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:20.949 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:39:20.949 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:39:20.949 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:20.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:20.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:20.949 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:39:20.949 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:39:20.949 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:20.950 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:20.950 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:20.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:20.950 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:39:20.951 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:39:20.951 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:39:20.951 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:39:20.951 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:39:20.951 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:20.951 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:20.951 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:20.951 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:39:20.951 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:39:20.951 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:20.952 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:39:20.952 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:39:20.952 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:39:20.952 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:20.952 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:20.952 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:39:20.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:20.952 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:39:20.953 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:39:20.953 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:39:20.953 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:20.953 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:20.953 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:39:20.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:20.953 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:39:20.953 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:39:20.953 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:39:20.953 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:20.953 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:20.954 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:39:20.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:20.954 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:39:20.954 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:39:20.954 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:39:20.954 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:20.954 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:20.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:20.954 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:39:20.954 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:39:20.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.938+0000 7f2a1f768640 1 -- 172.21.15.60:0/3527207799 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f29fc06be60 msgr2=0x7f29fc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:20.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.938+0000 7f2a1f768640 1 --2- 172.21.15.60:0/3527207799 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f29fc06be60 0x7f29fc06e320 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f2a10004d40 tx=0x7f2a10009250 comp rx=0 tx=0).stop 2024-09-12T02:39:20.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.938+0000 7f2a1f768640 1 -- 172.21.15.60:0/3527207799 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a18152bc0 msgr2=0x7f2a1813b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:20.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.938+0000 7f2a1f768640 1 --2- 172.21.15.60:0/3527207799 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a18152bc0 0x7f2a1813b010 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2a180c5bc0 tx=0x7f2a080046c0 comp rx=0 tx=0).stop 2024-09-12T02:39:20.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.939+0000 7f2a1dd05640 1 -- 172.21.15.60:0/3527207799 reap_dead start 2024-09-12T02:39:20.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.939+0000 7f2a1dd05640 1 -- 172.21.15.60:0/3527207799 reap_dead start 2024-09-12T02:39:20.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.939+0000 7f2a1f768640 1 -- 172.21.15.60:0/3527207799 shutdown_connections 2024-09-12T02:39:20.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.939+0000 7f2a1f768640 1 -- 172.21.15.60:0/3527207799 >> 172.21.15.60:0/3527207799 conn(0x7f2a180c7a40 msgr2=0x7f2a180c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:20.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.939+0000 7f2a1f768640 1 -- 172.21.15.60:0/3527207799 shutdown_connections 2024-09-12T02:39:20.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:20.939+0000 7f2a1f768640 1 -- 172.21.15.60:0/3527207799 wait complete. 2024-09-12T02:39:20.958 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-12T02:39:20.958 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-12T02:39:32.396 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:39:32.399 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:39:38.097 INFO:tasks.workunit.client.0.smithi060.stdout:Syncing()...6 sec 2024-09-12T02:39:38.097 INFO:tasks.workunit.client.0.smithi060.stdout:FFSB benchmark finished at: Thu Sep 12 02:39:38 2024 2024-09-12T02:39:38.097 INFO:tasks.workunit.client.0.smithi060.stdout: 2024-09-12T02:39:38.097 INFO:tasks.workunit.client.0.smithi060.stdout:Results: 2024-09-12T02:39:38.097 INFO:tasks.workunit.client.0.smithi060.stdout:Benchmark took 309.71 sec 2024-09-12T02:39:38.097 INFO:tasks.workunit.client.0.smithi060.stdout: 2024-09-12T02:39:38.097 INFO:tasks.workunit.client.0.smithi060.stdout:Total Results 2024-09-12T02:39:38.097 INFO:tasks.workunit.client.0.smithi060.stdout:=============== 2024-09-12T02:39:38.097 INFO:tasks.workunit.client.0.smithi060.stdout: Op Name Transactions Trans/sec % Trans % Op Weight Throughput 2024-09-12T02:39:38.097 INFO:tasks.workunit.client.0.smithi060.stdout: ======= ============ ========= ======= =========== ========== 2024-09-12T02:39:38.098 INFO:tasks.workunit.client.0.smithi060.stdout: write : 1548800 5000.82 100.000% 100.000% 19.5MB/sec 2024-09-12T02:39:38.098 INFO:tasks.workunit.client.0.smithi060.stdout:- 2024-09-12T02:39:38.098 INFO:tasks.workunit.client.0.smithi060.stdout:5000.82 Transactions per Second 2024-09-12T02:39:38.098 INFO:tasks.workunit.client.0.smithi060.stdout: 2024-09-12T02:39:38.098 INFO:tasks.workunit.client.0.smithi060.stdout:Throughput Results 2024-09-12T02:39:38.098 INFO:tasks.workunit.client.0.smithi060.stdout:=================== 2024-09-12T02:39:38.098 INFO:tasks.workunit.client.0.smithi060.stdout:Write Throughput: 19.5MB/sec 2024-09-12T02:39:38.105 INFO:tasks.workunit.client.0.smithi060.stdout: 2024-09-12T02:39:38.105 INFO:tasks.workunit.client.0.smithi060.stdout:System Call Latency statistics in millisecs 2024-09-12T02:39:38.105 INFO:tasks.workunit.client.0.smithi060.stdout:===== 2024-09-12T02:39:38.105 INFO:tasks.workunit.client.0.smithi060.stdout: Min Avg Max Total Calls 2024-09-12T02:39:38.105 INFO:tasks.workunit.client.0.smithi060.stdout: ======== ======== ======== ============ 2024-09-12T02:39:38.105 INFO:tasks.workunit.client.0.smithi060.stdout:[ open] 0.673000 38.985826 2750.446045 1210 2024-09-12T02:39:38.105 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-12T02:39:38.105 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[1] 2000.000000 - 5000.000000 : 3 2024-09-12T02:39:38.106 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[2] 1000.000000 - 2000.000000 : 8 2024-09-12T02:39:38.106 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[3] 500.000000 - 1000.000000 : 4 2024-09-12T02:39:38.106 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[4] 200.000000 - 500.000000 : 7 2024-09-12T02:39:38.106 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[5] 100.000000 - 200.000000 : 7 2024-09-12T02:39:38.106 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[6] 50.000000 - 100.000000 : 24 2024-09-12T02:39:38.106 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[7] 20.000000 - 50.000000 : 451 2024-09-12T02:39:38.106 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[8] 10.000000 - 20.000000 : 515 2024-09-12T02:39:38.106 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[9] 5.000000 - 10.000000 : 117 2024-09-12T02:39:38.106 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[10] 2.000000 - 5.000000 : 51 2024-09-12T02:39:38.106 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[11] 1.000000 - 2.000000 : 17 2024-09-12T02:39:38.106 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[12] 0.500000 - 1.000000 : 6 2024-09-12T02:39:38.106 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[13] 0.200000 - 0.500000 : 0 2024-09-12T02:39:38.106 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[14] 0.100000 - 0.200000 : 0 2024-09-12T02:39:38.106 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[15] 0.050000 - 0.100000 : 0 2024-09-12T02:39:38.106 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[16] 0.020000 - 0.050000 : 0 2024-09-12T02:39:38.107 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[17] 0.010000 - 0.020000 : 0 2024-09-12T02:39:38.107 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-09-12T02:39:38.107 INFO:tasks.workunit.client.0.smithi060.stdout: 2024-09-12T02:39:38.107 INFO:tasks.workunit.client.0.smithi060.stdout:[ write] 0.098000 6.190037 979.333984 1548800 2024-09-12T02:39:38.107 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-12T02:39:38.107 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-12T02:39:38.107 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-12T02:39:38.107 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[3] 500.000000 - 1000.000000 : 8 2024-09-12T02:39:38.107 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[4] 200.000000 - 500.000000 : 17 2024-09-12T02:39:38.107 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[5] 100.000000 - 200.000000 : 78 2024-09-12T02:39:38.107 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[6] 50.000000 - 100.000000 : 3762 2024-09-12T02:39:38.107 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[7] 20.000000 - 50.000000 : 82200 2024-09-12T02:39:38.107 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[8] 10.000000 - 20.000000 : 211224 2024-09-12T02:39:38.107 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[9] 5.000000 - 10.000000 : 347343 2024-09-12T02:39:38.108 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[10] 2.000000 - 5.000000 : 391248 2024-09-12T02:39:38.108 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[11] 1.000000 - 2.000000 : 124343 2024-09-12T02:39:38.108 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[12] 0.500000 - 1.000000 : 72932 2024-09-12T02:39:38.108 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[13] 0.200000 - 0.500000 : 196521 2024-09-12T02:39:38.108 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[14] 0.100000 - 0.200000 : 119107 2024-09-12T02:39:38.108 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[15] 0.050000 - 0.100000 : 17 2024-09-12T02:39:38.108 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[16] 0.020000 - 0.050000 : 0 2024-09-12T02:39:38.108 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[17] 0.010000 - 0.020000 : 0 2024-09-12T02:39:38.108 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-09-12T02:39:38.108 INFO:tasks.workunit.client.0.smithi060.stdout: 2024-09-12T02:39:38.108 INFO:tasks.workunit.client.0.smithi060.stdout:[ lseek] 0.000000 0.001122 1.372000 1548800 2024-09-12T02:39:38.108 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-12T02:39:38.108 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-12T02:39:38.108 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-12T02:39:38.108 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-09-12T02:39:38.109 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-09-12T02:39:38.109 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-09-12T02:39:38.109 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2024-09-12T02:39:38.109 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[7] 20.000000 - 50.000000 : 0 2024-09-12T02:39:38.109 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[8] 10.000000 - 20.000000 : 0 2024-09-12T02:39:38.109 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[9] 5.000000 - 10.000000 : 0 2024-09-12T02:39:38.109 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[10] 2.000000 - 5.000000 : 0 2024-09-12T02:39:38.109 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[11] 1.000000 - 2.000000 : 2 2024-09-12T02:39:38.109 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[12] 0.500000 - 1.000000 : 0 2024-09-12T02:39:38.109 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[13] 0.200000 - 0.500000 : 5 2024-09-12T02:39:38.109 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[14] 0.100000 - 0.200000 : 7 2024-09-12T02:39:38.109 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[15] 0.050000 - 0.100000 : 11 2024-09-12T02:39:38.109 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[16] 0.020000 - 0.050000 : 287 2024-09-12T02:39:38.109 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[17] 0.010000 - 0.020000 : 1249 2024-09-12T02:39:38.110 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[18] 0.000000 - 0.010000 : 1547239 2024-09-12T02:39:38.110 INFO:tasks.workunit.client.0.smithi060.stdout: 2024-09-12T02:39:38.110 INFO:tasks.workunit.client.0.smithi060.stdout:[ close] 0.020000 2.956883 52.674000 1210 2024-09-12T02:39:38.110 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-12T02:39:38.110 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-12T02:39:38.110 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-12T02:39:38.110 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-09-12T02:39:38.110 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-09-12T02:39:38.110 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-09-12T02:39:38.110 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[6] 50.000000 - 100.000000 : 2 2024-09-12T02:39:38.110 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[7] 20.000000 - 50.000000 : 32 2024-09-12T02:39:38.110 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[8] 10.000000 - 20.000000 : 75 2024-09-12T02:39:38.110 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[9] 5.000000 - 10.000000 : 90 2024-09-12T02:39:38.110 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[10] 2.000000 - 5.000000 : 192 2024-09-12T02:39:38.110 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[11] 1.000000 - 2.000000 : 134 2024-09-12T02:39:38.111 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[12] 0.500000 - 1.000000 : 59 2024-09-12T02:39:38.111 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[13] 0.200000 - 0.500000 : 79 2024-09-12T02:39:38.111 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[14] 0.100000 - 0.200000 : 107 2024-09-12T02:39:38.111 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[15] 0.050000 - 0.100000 : 105 2024-09-12T02:39:38.111 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[16] 0.020000 - 0.050000 : 335 2024-09-12T02:39:38.111 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[17] 0.010000 - 0.020000 : 0 2024-09-12T02:39:38.111 INFO:tasks.workunit.client.0.smithi060.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-09-12T02:39:38.111 INFO:tasks.workunit.client.0.smithi060.stdout: 2024-09-12T02:39:38.111 INFO:tasks.workunit.client.0.smithi060.stdout: 2024-09-12T02:39:38.111 INFO:tasks.workunit.client.0.smithi060.stdout: 2024-09-12T02:39:38.111 INFO:tasks.workunit.client.0.smithi060.stdout: 2024-09-12T02:39:38.111 INFO:tasks.workunit.client.0.smithi060.stdout:1.2% User Time 2024-09-12T02:39:38.111 INFO:tasks.workunit.client.0.smithi060.stdout:27.3% System Time 2024-09-12T02:39:38.112 INFO:tasks.workunit.client.0.smithi060.stdout:28.5% CPU Utilization 2024-09-12T02:39:38.119 INFO:tasks.workunit.client.0.smithi060.stderr:+ cd .. 2024-09-12T02:39:38.124 INFO:tasks.workunit.client.0.smithi060.stderr:+ rm -r tmp ffsb 2024-09-12T02:39:40.959 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-09-12T02:39:40.959 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-09-12T02:39:40.959 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T02:39:40.959 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T02:39:40.962 INFO:tasks.ceph.mon.b:Started 2024-09-12T02:39:40.962 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-12T02:39:40.962 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:39:41.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.066+0000 7f77a7de4640 1 Processor -- start 2024-09-12T02:39:41.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.066+0000 7f77a7de4640 1 -- start start 2024-09-12T02:39:41.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.067+0000 7f77a7de4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f77a015a3e0 0x7f77a0156d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:41.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.067+0000 7f77a7de4640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77a0157f10 con 0x7f77a00c7a90 2024-09-12T02:39:41.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.067+0000 7f77a7de4640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77a006c5b0 con 0x7f77a00cc2d0 2024-09-12T02:39:41.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.067+0000 7f77a7de4640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f77a006c890 con 0x7f77a015a3e0 2024-09-12T02:39:41.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.067+0000 7f77a537f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f77a015a3e0 0x7f77a0156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:41.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.067+0000 7f77a537f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f77a015a3e0 0x7f77a0156d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53024/0 (socket says 172.21.15.60:53024) 2024-09-12T02:39:41.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.067+0000 7f77a537f640 1 -- 172.21.15.60:0/1752520214 learned_addr learned my addr 172.21.15.60:0/1752520214 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:39:41.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.067+0000 7f77a537f640 1 -- 172.21.15.60:0/1752520214 >> v1:172.21.15.105:6789/0 conn(0x7f77a00cc2d0 legacy=0x7f77a0157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:41.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.067+0000 7f77a537f640 1 -- 172.21.15.60:0/1752520214 >> v1:172.21.15.60:6789/0 conn(0x7f77a00c7a90 legacy=0x7f77a0160c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:41.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.067+0000 7f77a537f640 1 -- 172.21.15.60:0/1752520214 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77a0159900 con 0x7f77a015a3e0 2024-09-12T02:39:41.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.068+0000 7f77a537f640 1 --2- 172.21.15.60:0/1752520214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77a015a3e0 0x7f77a0156d90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7794009870 tx=0x7f779402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cee4d790e88536c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:41.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.068+0000 7f77a4b7e640 1 -- 172.21.15.60:0/1752520214 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7794037070 con 0x7f77a015a3e0 2024-09-12T02:39:41.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.068+0000 7f77a4b7e640 1 -- 172.21.15.60:0/1752520214 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7794032440 con 0x7f77a015a3e0 2024-09-12T02:39:41.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.068+0000 7f77a4b7e640 1 -- 172.21.15.60:0/1752520214 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7794032810 con 0x7f77a015a3e0 2024-09-12T02:39:41.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.069+0000 7f77a7de4640 1 -- 172.21.15.60:0/1752520214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77a015a3e0 msgr2=0x7f77a0156d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:41.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.069+0000 7f77a7de4640 1 --2- 172.21.15.60:0/1752520214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77a015a3e0 0x7f77a0156d90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7794009870 tx=0x7f779402a2a0 comp rx=0 tx=0).stop 2024-09-12T02:39:41.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.069+0000 7f77a7de4640 1 -- 172.21.15.60:0/1752520214 shutdown_connections 2024-09-12T02:39:41.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.069+0000 7f77a7de4640 1 --2- 172.21.15.60:0/1752520214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77a015a3e0 0x7f77a0156d90 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:41.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.069+0000 7f77a7de4640 1 -- 172.21.15.60:0/1752520214 >> 172.21.15.60:0/1752520214 conn(0x7f77a0067fe0 msgr2=0x7f77a0073310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:41.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.069+0000 7f77a7de4640 1 -- 172.21.15.60:0/1752520214 shutdown_connections 2024-09-12T02:39:41.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.069+0000 7f77a7de4640 1 -- 172.21.15.60:0/1752520214 wait complete. 2024-09-12T02:39:41.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.070+0000 7f77a7de4640 1 Processor -- start 2024-09-12T02:39:41.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.070+0000 7f77a7de4640 1 -- start start 2024-09-12T02:39:41.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.071+0000 7f77a7de4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77a00c7a90 0x7f77a0155530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:41.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.071+0000 7f77a7de4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77a00cc2d0 0x7f77a014c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:41.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.071+0000 7f77a7de4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77a015a3e0 0x7f77a014c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:41.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.071+0000 7f77a7de4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f77a006d2c0 con 0x7f77a00c7a90 2024-09-12T02:39:41.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.071+0000 7f77a7de4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f77a0159ec0 con 0x7f77a015a3e0 2024-09-12T02:39:41.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.071+0000 7f77a7de4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f77a006c1d0 con 0x7f77a00cc2d0 2024-09-12T02:39:41.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.071+0000 7f77a5b80640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77a00c7a90 0x7f77a0155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:41.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.071+0000 7f77a5b80640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77a00c7a90 0x7f77a0155530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53030/0 (socket says 172.21.15.60:53030) 2024-09-12T02:39:41.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.071+0000 7f77a5b80640 1 -- 172.21.15.60:0/3986221714 learned_addr learned my addr 172.21.15.60:0/3986221714 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:39:41.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.071+0000 7f77a537f640 1 --2- 172.21.15.60:0/3986221714 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77a00cc2d0 0x7f77a014c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:41.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.071+0000 7f77a6381640 1 --2- 172.21.15.60:0/3986221714 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77a015a3e0 0x7f77a014c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:41.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.071+0000 7f77a6381640 1 -- 172.21.15.60:0/3986221714 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77a015a3e0 msgr2=0x7f77a014c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-12T02:39:41.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.071+0000 7f77a6381640 1 -- 172.21.15.60:0/3986221714 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77a015a3e0 msgr2=0x7f77a014c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:39:41.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.071+0000 7f77a6381640 1 --2- 172.21.15.60:0/3986221714 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77a015a3e0 0x7f77a014c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:39:41.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.071+0000 7f77a6381640 1 --2- 172.21.15.60:0/3986221714 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77a015a3e0 0x7f77a014c7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:39:41.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.071+0000 7f77a5b80640 1 -- 172.21.15.60:0/3986221714 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77a00cc2d0 msgr2=0x7f77a014c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:41.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.071+0000 7f77a5b80640 1 --2- 172.21.15.60:0/3986221714 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77a00cc2d0 0x7f77a014c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:41.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.071+0000 7f77a5b80640 1 -- 172.21.15.60:0/3986221714 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77a015a3e0 msgr2=0x7f77a014c7b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:39:41.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.071+0000 7f77a5b80640 1 --2- 172.21.15.60:0/3986221714 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77a015a3e0 0x7f77a014c7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:41.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.071+0000 7f77a5b80640 1 -- 172.21.15.60:0/3986221714 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77a01ed150 con 0x7f77a00c7a90 2024-09-12T02:39:41.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.071+0000 7f77a5b80640 1 --2- 172.21.15.60:0/3986221714 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77a00c7a90 0x7f77a0155530 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f779800c430 tx=0x7f779800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:41.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.071+0000 7f779e7fc640 1 -- 172.21.15.60:0/3986221714 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7798011790 con 0x7f77a00c7a90 2024-09-12T02:39:41.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.071+0000 7f779e7fc640 1 -- 172.21.15.60:0/3986221714 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7798017070 con 0x7f77a00c7a90 2024-09-12T02:39:41.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.072+0000 7f77a7de4640 1 -- 172.21.15.60:0/3986221714 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77a00c27b0 con 0x7f77a00c7a90 2024-09-12T02:39:41.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.072+0000 7f779e7fc640 1 -- 172.21.15.60:0/3986221714 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7798011bb0 con 0x7f77a00c7a90 2024-09-12T02:39:41.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.072+0000 7f77a7de4640 1 -- 172.21.15.60:0/3986221714 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77a01e24d0 con 0x7f77a00c7a90 2024-09-12T02:39:41.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.072+0000 7f77a7de4640 1 -- 172.21.15.60:0/3986221714 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77a00c7ee0 con 0x7f77a00c7a90 2024-09-12T02:39:41.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.073+0000 7f779e7fc640 1 -- 172.21.15.60:0/3986221714 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f779801c460 con 0x7f77a00c7a90 2024-09-12T02:39:41.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.074+0000 7f779e7fc640 1 --2- 172.21.15.60:0/3986221714 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f778c06be30 0x7f778c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:41.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.074+0000 7f779e7fc640 1 -- 172.21.15.60:0/3986221714 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f779808b050 con 0x7f77a00c7a90 2024-09-12T02:39:41.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.074+0000 7f77a537f640 1 --2- 172.21.15.60:0/3986221714 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f778c06be30 0x7f778c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:41.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.074+0000 7f77a537f640 1 --2- 172.21.15.60:0/3986221714 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f778c06be30 0x7f778c06e2f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7794034000 tx=0x7f779402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:41.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.078+0000 7f779e7fc640 1 -- 172.21.15.60:0/3986221714 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7798059660 con 0x7f77a00c7a90 2024-09-12T02:39:41.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.394+0000 7f77a7de4640 1 -- 172.21.15.60:0/3986221714 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f77a00b11f0 con 0x7f77a00c7a90 2024-09-12T02:39:41.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.395+0000 7f779e7fc640 1 -- 172.21.15.60:0/3986221714 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1560 (secure 0 0 0) 0x7f7798058f60 con 0x7f77a00c7a90 2024-09-12T02:39:41.396 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":156,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:39:41.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.398+0000 7f77a7de4640 1 -- 172.21.15.60:0/3986221714 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f778c06be30 msgr2=0x7f778c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:41.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.398+0000 7f77a7de4640 1 --2- 172.21.15.60:0/3986221714 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f778c06be30 0x7f778c06e2f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7794034000 tx=0x7f779402e000 comp rx=0 tx=0).stop 2024-09-12T02:39:41.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.398+0000 7f77a7de4640 1 -- 172.21.15.60:0/3986221714 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77a00c7a90 msgr2=0x7f77a0155530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:41.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.398+0000 7f77a7de4640 1 --2- 172.21.15.60:0/3986221714 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77a00c7a90 0x7f77a0155530 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f779800c430 tx=0x7f779800c8f0 comp rx=0 tx=0).stop 2024-09-12T02:39:41.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.398+0000 7f77a7de4640 1 -- 172.21.15.60:0/3986221714 shutdown_connections 2024-09-12T02:39:41.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.398+0000 7f77a7de4640 1 --2- 172.21.15.60:0/3986221714 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f778c06be30 0x7f778c06e2f0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:41.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.398+0000 7f77a7de4640 1 --2- 172.21.15.60:0/3986221714 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77a015a3e0 0x7f77a014c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:41.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.398+0000 7f77a7de4640 1 --2- 172.21.15.60:0/3986221714 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77a00cc2d0 0x7f77a014c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:41.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.398+0000 7f77a7de4640 1 --2- 172.21.15.60:0/3986221714 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77a00c7a90 0x7f77a0155530 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:41.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.398+0000 7f77a7de4640 1 -- 172.21.15.60:0/3986221714 >> 172.21.15.60:0/3986221714 conn(0x7f77a0067fe0 msgr2=0x7f77a00cb220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:41.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.399+0000 7f77a7de4640 1 -- 172.21.15.60:0/3986221714 shutdown_connections 2024-09-12T02:39:41.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:41.399+0000 7f77a7de4640 1 -- 172.21.15.60:0/3986221714 wait complete. 2024-09-12T02:39:44.418 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:39:44.419 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T02:39:44.419 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T02:39:44.520 INFO:tasks.workunit:Stopping ['suites/ffsb.sh'] on client.0... 2024-09-12T02:39:44.520 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T02:39:44.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.630+0000 7f9fbd53a640 1 Processor -- start 2024-09-12T02:39:44.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.635+0000 7f9fbd53a640 1 -- start start 2024-09-12T02:39:44.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.637+0000 7f9fbd53a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9fb000b0d0 0x7f9fb000b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:44.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.638+0000 7f9fb6ffd640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f9fb00d34d0 0x7f9fb00495d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52532/0 (socket says 172.21.15.60:52532) 2024-09-12T02:39:44.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.639+0000 7f9fbd53a640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fb00d5cf0 con 0x7f9fb00d34d0 2024-09-12T02:39:44.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.640+0000 7f9fb6ffd640 1 -- 172.21.15.60:0/539384490 learned_addr learned my addr 172.21.15.60:0/539384490 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:39:44.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.640+0000 7f9fbd53a640 1 -- 172.21.15.60:0/539384490 --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fb00d5fb0 con 0x7f9fb0005ff0 2024-09-12T02:39:44.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.640+0000 7f9fbd53a640 1 -- 172.21.15.60:0/539384490 --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f9fb00d6bc0 con 0x7f9fb000b0d0 2024-09-12T02:39:44.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.640+0000 7f9fb67fc640 1 --2- 172.21.15.60:0/539384490 >> v2:172.21.15.60:3300/0 conn(0x7f9fb000b0d0 0x7f9fb000b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:44.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.641+0000 7f9fb67fc640 1 -- 172.21.15.60:0/539384490 >> v1:172.21.15.105:6789/0 conn(0x7f9fb0005ff0 legacy=0x7f9fb0006420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:44.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.641+0000 7f9fb67fc640 1 -- 172.21.15.60:0/539384490 >> v1:172.21.15.60:6789/0 conn(0x7f9fb00d34d0 legacy=0x7f9fb00495d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:44.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.641+0000 7f9fb67fc640 1 -- 172.21.15.60:0/539384490 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fb00d6290 con 0x7f9fb000b0d0 2024-09-12T02:39:44.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.642+0000 7f9fb67fc640 1 --2- 172.21.15.60:0/539384490 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9fb000b0d0 0x7f9fb000b4d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9fb00d6d40 tx=0x7f9fb80a6c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce568fb2f09186e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:44.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.644+0000 7f9fb5ffb640 1 -- 172.21.15.60:0/539384490 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb80a8970 con 0x7f9fb000b0d0 2024-09-12T02:39:44.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.644+0000 7f9fb5ffb640 1 -- 172.21.15.60:0/539384490 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fb80a8b10 con 0x7f9fb000b0d0 2024-09-12T02:39:44.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.644+0000 7f9fb5ffb640 1 -- 172.21.15.60:0/539384490 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb80a9480 con 0x7f9fb000b0d0 2024-09-12T02:39:44.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.645+0000 7f9fbd53a640 1 -- 172.21.15.60:0/539384490 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9fb000b0d0 msgr2=0x7f9fb000b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:44.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.645+0000 7f9fbd53a640 1 --2- 172.21.15.60:0/539384490 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9fb000b0d0 0x7f9fb000b4d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9fb00d6d40 tx=0x7f9fb80a6c10 comp rx=0 tx=0).stop 2024-09-12T02:39:44.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.647+0000 7f9fbd53a640 1 -- 172.21.15.60:0/539384490 shutdown_connections 2024-09-12T02:39:44.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.647+0000 7f9fbd53a640 1 --2- 172.21.15.60:0/539384490 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9fb000b0d0 0x7f9fb000b4d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:44.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.647+0000 7f9fbd53a640 1 -- 172.21.15.60:0/539384490 >> 172.21.15.60:0/539384490 conn(0x7f9fb0048150 msgr2=0x7f9fb0048560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:44.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.647+0000 7f9fbd53a640 1 -- 172.21.15.60:0/539384490 shutdown_connections 2024-09-12T02:39:44.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.648+0000 7f9fbd53a640 1 -- 172.21.15.60:0/539384490 wait complete. 2024-09-12T02:39:44.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.650+0000 7f9fbd53a640 1 Processor -- start 2024-09-12T02:39:44.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.650+0000 7f9fbd53a640 1 -- start start 2024-09-12T02:39:44.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.652+0000 7f9fbd53a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9fb0005ff0 0x7f9fb00ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:44.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.652+0000 7f9fb6ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9fb0005ff0 0x7f9fb00ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:44.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.652+0000 7f9fb6ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9fb0005ff0 0x7f9fb00ceb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53052/0 (socket says 172.21.15.60:53052) 2024-09-12T02:39:44.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.652+0000 7f9fb6ffd640 1 -- 172.21.15.60:0/3335054519 learned_addr learned my addr 172.21.15.60:0/3335054519 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:39:44.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.652+0000 7f9fbd53a640 1 --2- 172.21.15.60:0/3335054519 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9fb000b0d0 0x7f9fb0040f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:44.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.653+0000 7f9fbd53a640 1 --2- 172.21.15.60:0/3335054519 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9fb00d34d0 0x7f9fb00414d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:44.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.653+0000 7f9fbd53a640 1 -- 172.21.15.60:0/3335054519 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb0007650 con 0x7f9fb0005ff0 2024-09-12T02:39:44.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.653+0000 7f9fbd53a640 1 -- 172.21.15.60:0/3335054519 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb00d6850 con 0x7f9fb00d34d0 2024-09-12T02:39:44.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.653+0000 7f9fb77fe640 1 --2- 172.21.15.60:0/3335054519 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9fb00d34d0 0x7f9fb00414d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:44.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.653+0000 7f9fbd53a640 1 -- 172.21.15.60:0/3335054519 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9fb00d38b0 con 0x7f9fb000b0d0 2024-09-12T02:39:44.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.654+0000 7f9fb6ffd640 1 -- 172.21.15.60:0/3335054519 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9fb000b0d0 msgr2=0x7f9fb0040f90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:39:44.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.654+0000 7f9fb6ffd640 1 --2- 172.21.15.60:0/3335054519 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9fb000b0d0 0x7f9fb0040f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:44.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.654+0000 7f9fb6ffd640 1 -- 172.21.15.60:0/3335054519 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9fb00d34d0 msgr2=0x7f9fb00414d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:44.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.654+0000 7f9fb6ffd640 1 --2- 172.21.15.60:0/3335054519 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9fb00d34d0 0x7f9fb00414d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:44.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.654+0000 7f9fb6ffd640 1 -- 172.21.15.60:0/3335054519 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fb00cf770 con 0x7f9fb0005ff0 2024-09-12T02:39:44.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.654+0000 7f9fb6ffd640 1 --2- 172.21.15.60:0/3335054519 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9fb0005ff0 0x7f9fb00ceb30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9fac00c5a0 tx=0x7f9fac00ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:44.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.655+0000 7f9f9f7fe640 1 -- 172.21.15.60:0/3335054519 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fac017070 con 0x7f9fb0005ff0 2024-09-12T02:39:44.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.655+0000 7f9fbd53a640 1 -- 172.21.15.60:0/3335054519 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fb0174720 con 0x7f9fb0005ff0 2024-09-12T02:39:44.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.655+0000 7f9fbd53a640 1 -- 172.21.15.60:0/3335054519 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fb0174ce0 con 0x7f9fb0005ff0 2024-09-12T02:39:44.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.658+0000 7f9f9f7fe640 1 -- 172.21.15.60:0/3335054519 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fac0074e0 con 0x7f9fb0005ff0 2024-09-12T02:39:44.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.659+0000 7f9f9f7fe640 1 -- 172.21.15.60:0/3335054519 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fac004a00 con 0x7f9fb0005ff0 2024-09-12T02:39:44.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.659+0000 7f9f9f7fe640 1 -- 172.21.15.60:0/3335054519 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9fac01a070 con 0x7f9fb0005ff0 2024-09-12T02:39:44.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.659+0000 7f9f9f7fe640 1 --2- 172.21.15.60:0/3335054519 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9fa406bf30 0x7f9fa406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:44.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.660+0000 7f9fb67fc640 1 --2- 172.21.15.60:0/3335054519 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9fa406bf30 0x7f9fa406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:44.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.661+0000 7f9f9f7fe640 1 -- 172.21.15.60:0/3335054519 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f9fac08a710 con 0x7f9fb0005ff0 2024-09-12T02:39:44.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.661+0000 7f9fb67fc640 1 --2- 172.21.15.60:0/3335054519 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9fa406bf30 0x7f9fa406e3f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9fb00d5ee0 tx=0x7f9fb806f030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:44.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.661+0000 7f9fbd53a640 1 -- 172.21.15.60:0/3335054519 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f98005290 con 0x7f9fb0005ff0 2024-09-12T02:39:44.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.671+0000 7f9f9f7fe640 1 -- 172.21.15.60:0/3335054519 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9fb00cf770 con 0x7f9fb0005ff0 2024-09-12T02:39:44.927 DEBUG:teuthology.parallel:result is None 2024-09-12T02:39:44.928 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T02:39:44.979 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T02:39:44.980 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-09-12T02:39:44.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.997+0000 7f9fbd53a640 1 -- 172.21.15.60:0/3335054519 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9f98005580 con 0x7f9fb0005ff0 2024-09-12T02:39:44.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:44.997+0000 7f9f9f7fe640 1 -- 172.21.15.60:0/3335054519 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f9fac058d90 con 0x7f9fb0005ff0 2024-09-12T02:39:44.999 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":158,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:39:45.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.000+0000 7f9fbd53a640 1 -- 172.21.15.60:0/3335054519 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9fa406bf30 msgr2=0x7f9fa406e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:45.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.000+0000 7f9fbd53a640 1 --2- 172.21.15.60:0/3335054519 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9fa406bf30 0x7f9fa406e3f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9fb00d5ee0 tx=0x7f9fb806f030 comp rx=0 tx=0).stop 2024-09-12T02:39:45.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.000+0000 7f9fbd53a640 1 -- 172.21.15.60:0/3335054519 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9fb0005ff0 msgr2=0x7f9fb00ceb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:45.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.000+0000 7f9fbd53a640 1 --2- 172.21.15.60:0/3335054519 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9fb0005ff0 0x7f9fb00ceb30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9fac00c5a0 tx=0x7f9fac00ca60 comp rx=0 tx=0).stop 2024-09-12T02:39:45.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.000+0000 7f9fbd53a640 1 -- 172.21.15.60:0/3335054519 shutdown_connections 2024-09-12T02:39:45.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.000+0000 7f9fbd53a640 1 --2- 172.21.15.60:0/3335054519 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9fa406bf30 0x7f9fa406e3f0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:45.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.000+0000 7f9fbd53a640 1 --2- 172.21.15.60:0/3335054519 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9fb00d34d0 0x7f9fb00414d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:45.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.000+0000 7f9fbd53a640 1 --2- 172.21.15.60:0/3335054519 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9fb000b0d0 0x7f9fb0040f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:45.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.000+0000 7f9fbd53a640 1 --2- 172.21.15.60:0/3335054519 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9fb0005ff0 0x7f9fb00ceb30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:45.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.000+0000 7f9fbd53a640 1 -- 172.21.15.60:0/3335054519 >> 172.21.15.60:0/3335054519 conn(0x7f9fb0048150 msgr2=0x7f9fb00d2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:45.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.000+0000 7f9fbd53a640 1 -- 172.21.15.60:0/3335054519 shutdown_connections 2024-09-12T02:39:45.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.000+0000 7f9fbd53a640 1 -- 172.21.15.60:0/3335054519 wait complete. 2024-09-12T02:39:45.009 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-09-12T02:39:45.009 DEBUG:teuthology.run_tasks:Unwinding manager mon_thrash 2024-09-12T02:39:45.020 INFO:tasks.mon_thrash:joining mon_thrasher 2024-09-12T02:39:45.021 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-12T02:39:45.021 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-12T02:39:45.021 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-12T02:39:45.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.182+0000 7fa3ec820640 1 Processor -- start 2024-09-12T02:39:45.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.184+0000 7fa3ec820640 1 -- start start 2024-09-12T02:39:45.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.185+0000 7fa3ec820640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa3e8157d40 0x7fa3e806ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:45.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.185+0000 7fa3ec820640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa3e806d4d0 0x7fa3e80c25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:45.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.185+0000 7fa3ec820640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3e80c3270 con 0x7fa3e80c7480 2024-09-12T02:39:45.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.185+0000 7fa3ec820640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fa3e80c5fe0 con 0x7fa3e8157d40 2024-09-12T02:39:45.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.185+0000 7fa3ec820640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fa3e80c42b0 con 0x7fa3e806d4d0 2024-09-12T02:39:45.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.185+0000 7fa3e77fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa3e8157d40 0x7fa3e806ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:45.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.185+0000 7fa3e77fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa3e8157d40 0x7fa3e806ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53054/0 (socket says 172.21.15.60:53054) 2024-09-12T02:39:45.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.185+0000 7fa3e77fe640 1 -- 172.21.15.60:0/1458461351 learned_addr learned my addr 172.21.15.60:0/1458461351 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:39:45.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.185+0000 7fa3e7fff640 1 --2- 172.21.15.60:0/1458461351 >> v2:172.21.15.105:3300/0 conn(0x7fa3e806d4d0 0x7fa3e80c25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:45.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.186+0000 7fa3e7fff640 1 -- 172.21.15.60:0/1458461351 >> v2:172.21.15.105:3300/0 conn(0x7fa3e806d4d0 msgr2=0x7fa3e80c25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T02:39:45.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.186+0000 7fa3e7fff640 1 -- 172.21.15.60:0/1458461351 >> v2:172.21.15.105:3300/0 conn(0x7fa3e806d4d0 msgr2=0x7fa3e80c25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:39:45.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.186+0000 7fa3e7fff640 1 --2- 172.21.15.60:0/1458461351 >> v2:172.21.15.105:3300/0 conn(0x7fa3e806d4d0 0x7fa3e80c25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:39:45.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.186+0000 7fa3e7fff640 1 --2- 172.21.15.60:0/1458461351 >> v2:172.21.15.105:3300/0 conn(0x7fa3e806d4d0 0x7fa3e80c25f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:39:45.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.187+0000 7fa3e77fe640 1 -- 172.21.15.60:0/1458461351 >> v2:172.21.15.105:3300/0 conn(0x7fa3e806d4d0 msgr2=0x7fa3e80c25f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:39:45.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.187+0000 7fa3e77fe640 1 --2- 172.21.15.60:0/1458461351 >> v2:172.21.15.105:3300/0 conn(0x7fa3e806d4d0 0x7fa3e80c25f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:45.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.187+0000 7fa3e77fe640 1 -- 172.21.15.60:0/1458461351 >> v1:172.21.15.105:6789/0 conn(0x7fa3e80c7480 legacy=0x7fa3e80c58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:45.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.187+0000 7fa3e77fe640 1 -- 172.21.15.60:0/1458461351 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3e815e660 con 0x7fa3e8157d40 2024-09-12T02:39:45.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.188+0000 7fa3e77fe640 1 --2- 172.21.15.60:0/1458461351 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3e8157d40 0x7fa3e806ced0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa3e80a9710 tx=0x7fa3dc02a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abd95506e357e67d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:45.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.188+0000 7fa3e67fc640 1 -- 172.21.15.60:0/1458461351 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc037070 con 0x7fa3e8157d40 2024-09-12T02:39:45.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.189+0000 7fa3e67fc640 1 -- 172.21.15.60:0/1458461351 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3dc032440 con 0x7fa3e8157d40 2024-09-12T02:39:45.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.189+0000 7fa3e67fc640 1 -- 172.21.15.60:0/1458461351 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc032810 con 0x7fa3e8157d40 2024-09-12T02:39:45.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.190+0000 7fa3ec820640 1 -- 172.21.15.60:0/1458461351 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3e8157d40 msgr2=0x7fa3e806ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:45.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.190+0000 7fa3ec820640 1 --2- 172.21.15.60:0/1458461351 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3e8157d40 0x7fa3e806ced0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa3e80a9710 tx=0x7fa3dc02a160 comp rx=0 tx=0).stop 2024-09-12T02:39:45.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.190+0000 7fa3ec820640 1 -- 172.21.15.60:0/1458461351 shutdown_connections 2024-09-12T02:39:45.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.190+0000 7fa3ec820640 1 --2- 172.21.15.60:0/1458461351 >> v2:172.21.15.105:3300/0 conn(0x7fa3e806d4d0 0x7fa3e80c25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:45.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.190+0000 7fa3ec820640 1 --2- 172.21.15.60:0/1458461351 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3e8157d40 0x7fa3e806ced0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:45.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.190+0000 7fa3ec820640 1 -- 172.21.15.60:0/1458461351 >> 172.21.15.60:0/1458461351 conn(0x7fa3e80a9780 msgr2=0x7fa3e80a9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:45.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.190+0000 7fa3ec820640 1 -- 172.21.15.60:0/1458461351 shutdown_connections 2024-09-12T02:39:45.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.190+0000 7fa3ec820640 1 -- 172.21.15.60:0/1458461351 wait complete. 2024-09-12T02:39:45.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.192+0000 7fa3ec820640 1 Processor -- start 2024-09-12T02:39:45.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.192+0000 7fa3ec820640 1 -- start start 2024-09-12T02:39:45.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.194+0000 7fa3ec820640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3e806d4d0 0x7fa3e80c6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:45.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.194+0000 7fa3ec820640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3e80c7480 0x7fa3e81f4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:45.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.194+0000 7fa3ec820640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3e8157d40 0x7fa3e814d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:45.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.194+0000 7fa3ec820640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e80c3fd0 con 0x7fa3e806d4d0 2024-09-12T02:39:45.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.194+0000 7fa3ec820640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e80c3cf0 con 0x7fa3e8157d40 2024-09-12T02:39:45.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.194+0000 7fa3ec820640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa3e806d920 con 0x7fa3e80c7480 2024-09-12T02:39:45.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.194+0000 7fa3e7fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3e8157d40 0x7fa3e814d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:45.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.194+0000 7fa3e77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3e806d4d0 0x7fa3e80c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:45.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.194+0000 7fa3e7fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3e8157d40 0x7fa3e814d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:39604/0 (socket says 172.21.15.60:39604) 2024-09-12T02:39:45.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.194+0000 7fa3e7fff640 1 -- 172.21.15.60:0/1641842478 learned_addr learned my addr 172.21.15.60:0/1641842478 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:39:45.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.194+0000 7fa3e6ffd640 1 --2- 172.21.15.60:0/1641842478 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3e80c7480 0x7fa3e81f4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:45.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.194+0000 7fa3e77fe640 1 -- 172.21.15.60:0/1641842478 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3e80c7480 msgr2=0x7fa3e81f4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:45.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.194+0000 7fa3e77fe640 1 --2- 172.21.15.60:0/1641842478 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3e80c7480 0x7fa3e81f4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:45.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.194+0000 7fa3e77fe640 1 -- 172.21.15.60:0/1641842478 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3e8157d40 msgr2=0x7fa3e814d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:45.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.194+0000 7fa3e77fe640 1 --2- 172.21.15.60:0/1641842478 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3e8157d40 0x7fa3e814d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:45.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.194+0000 7fa3e77fe640 1 -- 172.21.15.60:0/1641842478 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3e80aa870 con 0x7fa3e806d4d0 2024-09-12T02:39:45.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.194+0000 7fa3e6ffd640 1 --2- 172.21.15.60:0/1641842478 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3e80c7480 0x7fa3e81f4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:39:45.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.194+0000 7fa3e7fff640 1 --2- 172.21.15.60:0/1641842478 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3e8157d40 0x7fa3e814d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:39:45.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.195+0000 7fa3e77fe640 1 --2- 172.21.15.60:0/1641842478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3e806d4d0 0x7fa3e80c6970 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc031000 tx=0x7fa3dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:45.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.195+0000 7fa3cffff640 1 -- 172.21.15.60:0/1641842478 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc041020 con 0x7fa3e806d4d0 2024-09-12T02:39:45.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.195+0000 7fa3cffff640 1 -- 172.21.15.60:0/1641842478 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3dc0306c0 con 0x7fa3e806d4d0 2024-09-12T02:39:45.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.195+0000 7fa3ec820640 1 -- 172.21.15.60:0/1641842478 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3e80aab50 con 0x7fa3e806d4d0 2024-09-12T02:39:45.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.195+0000 7fa3cffff640 1 -- 172.21.15.60:0/1641842478 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc037040 con 0x7fa3e806d4d0 2024-09-12T02:39:45.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.195+0000 7fa3ec820640 1 -- 172.21.15.60:0/1641842478 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3e80ac1e0 con 0x7fa3e806d4d0 2024-09-12T02:39:45.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.196+0000 7fa3ec820640 1 --2- 172.21.15.60:0/1641842478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3e80ad110 0x7fa3e814df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:45.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.196+0000 7fa3ec820640 1 -- 172.21.15.60:0/1641842478 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e814e440 con 0x7fa3e80ad110 2024-09-12T02:39:45.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.197+0000 7fa3e6ffd640 1 --2- 172.21.15.60:0/1641842478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3e80ad110 0x7fa3e814df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:45.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.198+0000 7fa3e6ffd640 1 -- 172.21.15.60:0/1641842478 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa3e8158120 con 0x7fa3e80ad110 2024-09-12T02:39:45.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.198+0000 7fa3e6ffd640 1 --2- 172.21.15.60:0/1641842478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3e80ad110 0x7fa3e814df00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa3e80c71d0 tx=0x7fa3d800fd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:45.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.199+0000 7fa3cffff640 1 -- 172.21.15.60:0/1641842478 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa3dc044020 con 0x7fa3e806d4d0 2024-09-12T02:39:45.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.199+0000 7fa3cffff640 1 --2- 172.21.15.60:0/1641842478 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa3d406be30 0x7fa3d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:45.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.200+0000 7fa3cffff640 1 -- 172.21.15.60:0/1641842478 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d80052e0 con 0x7fa3e80ad110 2024-09-12T02:39:45.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.200+0000 7fa3e7fff640 1 --2- 172.21.15.60:0/1641842478 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa3d406be30 0x7fa3d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:45.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.200+0000 7fa3cffff640 1 -- 172.21.15.60:0/1641842478 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fa3dc0ab910 con 0x7fa3e806d4d0 2024-09-12T02:39:45.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.200+0000 7fa3cffff640 1 -- 172.21.15.60:0/1641842478 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fa3d80052e0 con 0x7fa3e80ad110 2024-09-12T02:39:45.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.200+0000 7fa3cffff640 1 -- 172.21.15.60:0/1641842478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3e80ad110 msgr2=0x7fa3e814df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:45.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.200+0000 7fa3cffff640 1 --2- 172.21.15.60:0/1641842478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3e80ad110 0x7fa3e814df00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa3e80c71d0 tx=0x7fa3d800fd60 comp rx=0 tx=0).stop 2024-09-12T02:39:45.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.201+0000 7fa3cffff640 1 -- 172.21.15.60:0/1641842478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3e80ad110 msgr2=0x7fa3e814df00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:39:45.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.201+0000 7fa3cffff640 1 --2- 172.21.15.60:0/1641842478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3e80ad110 0x7fa3e814df00 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:45.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.202+0000 7fa3e7fff640 1 --2- 172.21.15.60:0/1641842478 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa3d406be30 0x7fa3d406e2f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa3e00095e0 tx=0x7fa3e0009850 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:45.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.214+0000 7fa3ec820640 1 --2- 172.21.15.60:0/1641842478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3e81f0760 0x7fa3e815c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:45.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.215+0000 7fa3e6ffd640 1 --2- 172.21.15.60:0/1641842478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3e81f0760 0x7fa3e815c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:45.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.215+0000 7fa3ec820640 1 -- 172.21.15.60:0/1641842478 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e806e200 con 0x7fa3e81f0760 2024-09-12T02:39:45.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.215+0000 7fa3e6ffd640 1 -- 172.21.15.60:0/1641842478 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa3e80758a0 con 0x7fa3e81f0760 2024-09-12T02:39:45.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.216+0000 7fa3e6ffd640 1 --2- 172.21.15.60:0/1641842478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3e81f0760 0x7fa3e815c970 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa3e80c71d0 tx=0x7fa3d8001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:45.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.216+0000 7fa3cffff640 1 -- 172.21.15.60:0/1641842478 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8005490 con 0x7fa3e81f0760 2024-09-12T02:39:45.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.220+0000 7fa3cffff640 1 -- 172.21.15.60:0/1641842478 <== mon.0 v2:172.21.15.60:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5053 (secure 0 0 0) 0x7fa3d801c760 con 0x7fa3e81f0760 2024-09-12T02:39:45.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.220+0000 7fa3cffff640 1 -- 172.21.15.60:0/1641842478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3e81f0760 msgr2=0x7fa3e815c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:45.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.220+0000 7fa3cffff640 1 --2- 172.21.15.60:0/1641842478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3e81f0760 0x7fa3e815c970 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa3e80c71d0 tx=0x7fa3d8001080 comp rx=0 tx=0).stop 2024-09-12T02:39:45.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.220+0000 7fa3cffff640 1 -- 172.21.15.60:0/1641842478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3e81f0760 msgr2=0x7fa3e815c970 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:39:45.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.220+0000 7fa3cffff640 1 --2- 172.21.15.60:0/1641842478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3e81f0760 0x7fa3e815c970 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:45.223 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:39:45.223 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:39:45.223 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:39:45.223 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "leader", 2024-09-12T02:39:45.223 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 158, 2024-09-12T02:39:45.223 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 124990, 2024-09-12T02:39:45.223 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:39:45.223 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:39:45.224 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:39:45.224 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:39:45.224 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:45.224 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 1, 2024-09-12T02:39:45.224 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:39:45.224 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:39:45.224 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:39:45.224 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:39:45.224 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:39:45.224 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:39:45.224 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:39:45.224 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:39:45.225 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:39:45.225 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:39:45.225 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:39:45.225 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:39:45.225 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:39:45.225 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:39:45.225 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:45.225 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:39:45.225 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:39:45.225 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:39:45.225 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:39:45.225 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:39:45.226 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:39:45.226 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:39:45.226 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:39:45.226 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:39:45.226 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:39:45.226 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:39:45.228 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:39:45.228 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:39:45.228 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:45.228 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:45.228 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:39:45.228 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:39:45.228 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:39:45.228 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:39:45.228 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:39:45.228 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:39:45.228 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:39:45.228 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:39:45.228 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:39:45.229 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:39:45.229 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:39:45.229 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:39:45.229 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:39:45.229 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:39:45.229 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:39:45.229 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:39:45.229 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:39:45.229 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:39:45.229 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:39:45.229 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:39:45.229 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:39:45.229 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:39:45.229 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:39:45.230 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:39:45.230 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:39:45.230 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:39:45.230 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:39:45.230 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:39:45.230 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:45.230 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:39:45.230 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:45.230 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:39:45.230 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:45.230 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:39:45.230 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:39:45.230 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:39:45.231 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:39:45.231 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:45.231 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:39:45.231 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:39:45.231 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:45.231 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:45.231 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:45.231 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:39:45.231 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:39:45.231 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:45.231 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:45.231 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:45.231 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:45.231 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:39:45.232 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:39:45.232 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:39:45.232 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:39:45.232 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:39:45.232 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:45.232 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:45.232 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:39:45.232 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:39:45.232 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:39:45.232 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:39:45.232 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:45.232 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:39:45.232 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:39:45.233 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:45.233 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:45.233 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:45.233 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:39:45.233 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:39:45.233 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:45.233 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:45.233 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:45.233 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:45.233 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:39:45.233 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:39:45.233 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:39:45.233 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:39:45.234 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:39:45.234 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:45.234 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:45.234 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:39:45.234 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:39:45.234 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:39:45.234 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:39:45.234 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:45.234 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:39:45.234 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:39:45.234 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:45.234 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:45.234 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:45.235 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:39:45.235 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:39:45.235 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:45.235 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:45.235 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:45.235 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:45.235 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:39:45.235 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:39:45.235 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:39:45.235 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:39:45.235 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:39:45.235 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:45.235 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:45.236 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:45.236 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:39:45.236 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:39:45.236 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:45.236 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:39:45.236 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:39:45.236 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:39:45.236 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:45.236 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:45.236 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:39:45.236 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:45.237 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:39:45.237 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:39:45.237 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 3 2024-09-12T02:39:45.237 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:45.237 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:45.237 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:39:45.237 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:45.237 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:39:45.237 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:39:45.237 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:39:45.238 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:45.238 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:45.238 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:39:45.238 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:45.238 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:39:45.238 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:39:45.238 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 8 2024-09-12T02:39:45.238 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:45.238 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:45.238 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": [ 2024-09-12T02:39:45.239 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:45.239 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:39:45.239 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:39:45.239 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:39:45.239 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:45.239 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:45.239 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:45.239 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:39:45.239 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:39:45.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.222+0000 7fa3ec820640 1 -- 172.21.15.60:0/1641842478 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa3d406be30 msgr2=0x7fa3d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:45.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.222+0000 7fa3ec820640 1 --2- 172.21.15.60:0/1641842478 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa3d406be30 0x7fa3d406e2f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa3e00095e0 tx=0x7fa3e0009850 comp rx=0 tx=0).stop 2024-09-12T02:39:45.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.222+0000 7fa3ec820640 1 -- 172.21.15.60:0/1641842478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3e806d4d0 msgr2=0x7fa3e80c6970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:45.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.222+0000 7fa3ec820640 1 --2- 172.21.15.60:0/1641842478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3e806d4d0 0x7fa3e80c6970 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc031000 tx=0x7fa3dc0046c0 comp rx=0 tx=0).stop 2024-09-12T02:39:45.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.223+0000 7fa3e7fff640 1 -- 172.21.15.60:0/1641842478 reap_dead start 2024-09-12T02:39:45.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.223+0000 7fa3e7fff640 1 -- 172.21.15.60:0/1641842478 reap_dead start 2024-09-12T02:39:45.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.223+0000 7fa3ec820640 1 -- 172.21.15.60:0/1641842478 shutdown_connections 2024-09-12T02:39:45.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.223+0000 7fa3ec820640 1 -- 172.21.15.60:0/1641842478 >> 172.21.15.60:0/1641842478 conn(0x7fa3e80a9780 msgr2=0x7fa3e80a9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:45.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.224+0000 7fa3ec820640 1 -- 172.21.15.60:0/1641842478 shutdown_connections 2024-09-12T02:39:45.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.224+0000 7fa3ec820640 1 -- 172.21.15.60:0/1641842478 wait complete. 2024-09-12T02:39:45.247 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:39:45.247 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-12T02:39:45.248 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-12T02:39:45.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.399+0000 7fbd31552640 1 Processor -- start 2024-09-12T02:39:45.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.399+0000 7fbd31552640 1 -- start start 2024-09-12T02:39:45.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.400+0000 7fbd31552640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbd2c153b10 0x7fbd2c0a9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:45.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.400+0000 7fbd31552640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd2c074590 0x7fbd2c06cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:45.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.400+0000 7fbd31552640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd2c156dd0 con 0x7fbd2c0a7de0 2024-09-12T02:39:45.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.400+0000 7fbd31552640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fbd2c157350 con 0x7fbd2c153b10 2024-09-12T02:39:45.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.400+0000 7fbd31552640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbd2c159e50 con 0x7fbd2c074590 2024-09-12T02:39:45.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.400+0000 7fbd2affd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbd2c153b10 0x7fbd2c0a9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:45.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.400+0000 7fbd2b7fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd2c074590 0x7fbd2c06cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:45.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.400+0000 7fbd2affd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbd2c153b10 0x7fbd2c0a9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:39610/0 (socket says 172.21.15.60:39610) 2024-09-12T02:39:45.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.400+0000 7fbd2b7fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd2c074590 0x7fbd2c06cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:48596/0 (socket says 172.21.15.60:48596) 2024-09-12T02:39:45.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.400+0000 7fbd2affd640 1 -- 172.21.15.60:0/1447390770 learned_addr learned my addr 172.21.15.60:0/1447390770 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:39:45.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.400+0000 7fbd2affd640 1 -- 172.21.15.60:0/1447390770 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd2c074590 msgr2=0x7fbd2c06cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:45.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.400+0000 7fbd2affd640 1 --2- 172.21.15.60:0/1447390770 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd2c074590 0x7fbd2c06cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:45.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.400+0000 7fbd2affd640 1 -- 172.21.15.60:0/1447390770 >> v1:172.21.15.105:6789/0 conn(0x7fbd2c0a7de0 legacy=0x7fbd2c15a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:45.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.400+0000 7fbd2affd640 1 -- 172.21.15.60:0/1447390770 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd2c157070 con 0x7fbd2c153b10 2024-09-12T02:39:45.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.400+0000 7fbd2b7fe640 1 --2- 172.21.15.60:0/1447390770 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd2c074590 0x7fbd2c06cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:39:45.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.401+0000 7fbd2affd640 1 --2- 172.21.15.60:0/1447390770 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd2c153b10 0x7fbd2c0a9700 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c009870 tx=0x7fbd1c02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb941b2922b93629 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:45.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.401+0000 7fbd2a7fc640 1 -- 172.21.15.60:0/1447390770 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c037070 con 0x7fbd2c153b10 2024-09-12T02:39:45.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.401+0000 7fbd2a7fc640 1 -- 172.21.15.60:0/1447390770 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd1c032440 con 0x7fbd2c153b10 2024-09-12T02:39:45.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.401+0000 7fbd2a7fc640 1 -- 172.21.15.60:0/1447390770 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c032810 con 0x7fbd2c153b10 2024-09-12T02:39:45.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.402+0000 7fbd31552640 1 -- 172.21.15.60:0/1447390770 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd2c153b10 msgr2=0x7fbd2c0a9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:45.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.402+0000 7fbd31552640 1 --2- 172.21.15.60:0/1447390770 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd2c153b10 0x7fbd2c0a9700 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c009870 tx=0x7fbd1c02a270 comp rx=0 tx=0).stop 2024-09-12T02:39:45.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.402+0000 7fbd31552640 1 -- 172.21.15.60:0/1447390770 shutdown_connections 2024-09-12T02:39:45.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.402+0000 7fbd31552640 1 --2- 172.21.15.60:0/1447390770 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd2c074590 0x7fbd2c06cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:45.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.402+0000 7fbd31552640 1 --2- 172.21.15.60:0/1447390770 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd2c153b10 0x7fbd2c0a9700 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:45.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.402+0000 7fbd31552640 1 -- 172.21.15.60:0/1447390770 >> 172.21.15.60:0/1447390770 conn(0x7fbd2c0c4fa0 msgr2=0x7fbd2c0c5380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:45.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.402+0000 7fbd31552640 1 -- 172.21.15.60:0/1447390770 shutdown_connections 2024-09-12T02:39:45.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.402+0000 7fbd31552640 1 -- 172.21.15.60:0/1447390770 wait complete. 2024-09-12T02:39:45.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.403+0000 7fbd31552640 1 Processor -- start 2024-09-12T02:39:45.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.403+0000 7fbd31552640 1 -- start start 2024-09-12T02:39:45.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.404+0000 7fbd31552640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd2c074590 0x7fbd2c0c7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:45.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.404+0000 7fbd31552640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd2c0a7de0 0x7fbd2c1e18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:45.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.404+0000 7fbd31552640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd2c153b10 0x7fbd2c0c3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:45.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.404+0000 7fbd31552640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2c153ef0 con 0x7fbd2c0a7de0 2024-09-12T02:39:45.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.404+0000 7fbd31552640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2c0a9c40 con 0x7fbd2c153b10 2024-09-12T02:39:45.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.404+0000 7fbd31552640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbd2c06db80 con 0x7fbd2c074590 2024-09-12T02:39:45.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.404+0000 7fbd23fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd2c0a7de0 0x7fbd2c1e18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:45.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.404+0000 7fbd23fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd2c0a7de0 0x7fbd2c1e18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53104/0 (socket says 172.21.15.60:53104) 2024-09-12T02:39:45.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.404+0000 7fbd23fff640 1 -- 172.21.15.60:0/2807876401 learned_addr learned my addr 172.21.15.60:0/2807876401 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:39:45.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.404+0000 7fbd2affd640 1 --2- 172.21.15.60:0/2807876401 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd2c074590 0x7fbd2c0c7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:45.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.404+0000 7fbd2b7fe640 1 --2- 172.21.15.60:0/2807876401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd2c153b10 0x7fbd2c0c3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:45.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.404+0000 7fbd23fff640 1 -- 172.21.15.60:0/2807876401 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd2c074590 msgr2=0x7fbd2c0c7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:45.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.404+0000 7fbd23fff640 1 --2- 172.21.15.60:0/2807876401 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd2c074590 0x7fbd2c0c7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:45.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.404+0000 7fbd23fff640 1 -- 172.21.15.60:0/2807876401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd2c153b10 msgr2=0x7fbd2c0c3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:45.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.404+0000 7fbd23fff640 1 --2- 172.21.15.60:0/2807876401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd2c153b10 0x7fbd2c0c3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:45.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.404+0000 7fbd23fff640 1 -- 172.21.15.60:0/2807876401 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd2c1e2740 con 0x7fbd2c0a7de0 2024-09-12T02:39:45.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.404+0000 7fbd23fff640 1 --2- 172.21.15.60:0/2807876401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd2c0a7de0 0x7fbd2c1e18d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbd1400c430 tx=0x7fbd1400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:45.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.404+0000 7fbd237fe640 1 -- 172.21.15.60:0/2807876401 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd140052d0 con 0x7fbd2c0a7de0 2024-09-12T02:39:45.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.405+0000 7fbd237fe640 1 -- 172.21.15.60:0/2807876401 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd14005490 con 0x7fbd2c0a7de0 2024-09-12T02:39:45.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.405+0000 7fbd31552640 1 -- 172.21.15.60:0/2807876401 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd2c14d540 con 0x7fbd2c0a7de0 2024-09-12T02:39:45.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.405+0000 7fbd237fe640 1 -- 172.21.15.60:0/2807876401 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd14007260 con 0x7fbd2c0a7de0 2024-09-12T02:39:45.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.405+0000 7fbd31552640 1 -- 172.21.15.60:0/2807876401 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd2c14c450 con 0x7fbd2c0a7de0 2024-09-12T02:39:45.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.405+0000 7fbd31552640 1 --2- 172.21.15.60:0/2807876401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd2c0c6090 0x7fbd2c1ef5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:45.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.405+0000 7fbd31552640 1 -- 172.21.15.60:0/2807876401 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2c0c82a0 con 0x7fbd2c0c6090 2024-09-12T02:39:45.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.405+0000 7fbd2affd640 1 --2- 172.21.15.60:0/2807876401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd2c0c6090 0x7fbd2c1ef5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:45.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.406+0000 7fbd2affd640 1 -- 172.21.15.60:0/2807876401 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbd2c14caa0 con 0x7fbd2c0c6090 2024-09-12T02:39:45.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.406+0000 7fbd2affd640 1 --2- 172.21.15.60:0/2807876401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd2c0c6090 0x7fbd2c1ef5c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c0a9480 tx=0x7fbd1c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:45.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.406+0000 7fbd237fe640 1 -- 172.21.15.60:0/2807876401 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbd14007400 con 0x7fbd2c0a7de0 2024-09-12T02:39:45.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.406+0000 7fbd237fe640 1 --2- 172.21.15.60:0/2807876401 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbd0c06be30 0x7fbd0c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:45.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.407+0000 7fbd237fe640 1 -- 172.21.15.60:0/2807876401 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fbd1408a5f0 con 0x7fbd2c0a7de0 2024-09-12T02:39:45.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.407+0000 7fbd2b7fe640 1 --2- 172.21.15.60:0/2807876401 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbd0c06be30 0x7fbd0c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:45.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.407+0000 7fbd237fe640 1 -- 172.21.15.60:0/2807876401 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c037040 con 0x7fbd2c0c6090 2024-09-12T02:39:45.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.407+0000 7fbd237fe640 1 -- 172.21.15.60:0/2807876401 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fbd1c03c640 con 0x7fbd2c0c6090 2024-09-12T02:39:45.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.407+0000 7fbd237fe640 1 -- 172.21.15.60:0/2807876401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd2c0c6090 msgr2=0x7fbd2c1ef5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:45.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.407+0000 7fbd237fe640 1 --2- 172.21.15.60:0/2807876401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd2c0c6090 0x7fbd2c1ef5c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c0a9480 tx=0x7fbd1c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:39:45.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.407+0000 7fbd237fe640 1 -- 172.21.15.60:0/2807876401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd2c0c6090 msgr2=0x7fbd2c1ef5c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:39:45.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.407+0000 7fbd237fe640 1 --2- 172.21.15.60:0/2807876401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd2c0c6090 0x7fbd2c1ef5c0 secure :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c0a9480 tx=0x7fbd1c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:39:45.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.407+0000 7fbd2b7fe640 1 --2- 172.21.15.60:0/2807876401 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbd0c06be30 0x7fbd0c06e2f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fbd24009c10 tx=0x7fbd2400b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:45.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.413+0000 7fbd31552640 1 --2- 172.21.15.60:0/2807876401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd2c14d0e0 0x7fbd2c1efb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:45.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.413+0000 7fbd31552640 1 -- 172.21.15.60:0/2807876401 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2c0a9700 con 0x7fbd2c14d0e0 2024-09-12T02:39:45.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.413+0000 7fbd2affd640 1 --2- 172.21.15.60:0/2807876401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd2c14d0e0 0x7fbd2c1efb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:45.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.413+0000 7fbd2affd640 1 -- 172.21.15.60:0/2807876401 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbd2c1597f0 con 0x7fbd2c14d0e0 2024-09-12T02:39:45.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.414+0000 7fbd2affd640 1 --2- 172.21.15.60:0/2807876401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd2c14d0e0 0x7fbd2c1efb00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c0090b0 tx=0x7fbd1c008030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:45.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.414+0000 7fbd237fe640 1 -- 172.21.15.60:0/2807876401 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c037070 con 0x7fbd2c14d0e0 2024-09-12T02:39:45.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.414+0000 7fbd237fe640 1 -- 172.21.15.60:0/2807876401 <== mon.1 v2:172.21.15.105:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4548 (secure 0 0 0) 0x7fbd1c0487f0 con 0x7fbd2c14d0e0 2024-09-12T02:39:45.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.414+0000 7fbd237fe640 1 -- 172.21.15.60:0/2807876401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd2c14d0e0 msgr2=0x7fbd2c1efb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:45.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.414+0000 7fbd237fe640 1 --2- 172.21.15.60:0/2807876401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd2c14d0e0 0x7fbd2c1efb00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c0090b0 tx=0x7fbd1c008030 comp rx=0 tx=0).stop 2024-09-12T02:39:45.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.414+0000 7fbd237fe640 1 -- 172.21.15.60:0/2807876401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd2c14d0e0 msgr2=0x7fbd2c1efb00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:39:45.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.414+0000 7fbd237fe640 1 --2- 172.21.15.60:0/2807876401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd2c14d0e0 0x7fbd2c1efb00 secure :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c0090b0 tx=0x7fbd1c008030 comp rx=0 tx=0).stop 2024-09-12T02:39:45.417 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:39:45.417 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:39:45.417 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:39:45.417 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:39:45.417 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 158, 2024-09-12T02:39:45.417 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 4373, 2024-09-12T02:39:45.417 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:39:45.417 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:39:45.418 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:39:45.418 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:39:45.418 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:45.418 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 2, 2024-09-12T02:39:45.418 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:39:45.418 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:39:45.418 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:39:45.418 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:39:45.418 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:39:45.418 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:39:45.418 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:39:45.418 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:39:45.418 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:39:45.418 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:39:45.419 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:39:45.419 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:39:45.419 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:39:45.419 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:39:45.419 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:45.419 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:39:45.419 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:39:45.419 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:39:45.419 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:39:45.419 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:39:45.419 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:39:45.420 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:39:45.420 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:39:45.420 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:39:45.420 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:39:45.420 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:39:45.420 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:39:45.420 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:39:45.420 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:45.420 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:45.420 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:39:45.420 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:39:45.420 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:39:45.420 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:39:45.421 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:39:45.421 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:39:45.421 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:39:45.421 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:39:45.421 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:39:45.421 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:39:45.421 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:39:45.421 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:39:45.421 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:39:45.421 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:39:45.421 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:39:45.421 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:39:45.422 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:39:45.422 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:39:45.422 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:39:45.422 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:39:45.422 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:39:45.422 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:39:45.422 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:39:45.422 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:39:45.422 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:39:45.422 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:39:45.422 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:39:45.422 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:39:45.422 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:45.422 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:39:45.423 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:45.423 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:39:45.423 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:45.423 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:39:45.423 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:39:45.423 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:39:45.423 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:39:45.423 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:45.423 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:39:45.423 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:39:45.423 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:45.423 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:45.423 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:45.424 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:39:45.424 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:39:45.424 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:45.424 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:45.424 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:45.424 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:45.424 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:39:45.424 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:39:45.424 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:39:45.424 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:39:45.424 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:39:45.424 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:45.424 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:45.424 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:39:45.425 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:39:45.425 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:39:45.425 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:39:45.425 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:45.425 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:39:45.425 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:39:45.425 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:45.425 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:45.425 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:45.425 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:39:45.425 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:39:45.425 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:45.425 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:45.426 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:45.426 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:45.426 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:39:45.426 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:39:45.426 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:39:45.426 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:39:45.426 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:39:45.426 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:45.426 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:45.426 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:39:45.426 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:39:45.426 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:39:45.426 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:39:45.426 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:45.427 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:39:45.427 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:39:45.427 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:45.427 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:45.427 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:45.427 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:39:45.427 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:39:45.427 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:45.427 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:45.427 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:45.427 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:45.427 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:39:45.427 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:39:45.427 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:39:45.428 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:39:45.428 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:39:45.428 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:45.428 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:45.428 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:45.428 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:39:45.428 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:39:45.428 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:45.428 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:39:45.428 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:39:45.428 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:39:45.428 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:45.428 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:45.428 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:39:45.428 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:45.429 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:39:45.429 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:39:45.429 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:39:45.429 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:45.429 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:45.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:45.429 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:39:45.429 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:39:45.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.414+0000 7fbd31552640 1 -- 172.21.15.60:0/2807876401 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbd0c06be30 msgr2=0x7fbd0c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:45.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.414+0000 7fbd31552640 1 --2- 172.21.15.60:0/2807876401 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbd0c06be30 0x7fbd0c06e2f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fbd24009c10 tx=0x7fbd2400b040 comp rx=0 tx=0).stop 2024-09-12T02:39:45.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.414+0000 7fbd31552640 1 -- 172.21.15.60:0/2807876401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd2c0a7de0 msgr2=0x7fbd2c1e18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:45.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.414+0000 7fbd31552640 1 --2- 172.21.15.60:0/2807876401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd2c0a7de0 0x7fbd2c1e18d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbd1400c430 tx=0x7fbd1400c830 comp rx=0 tx=0).stop 2024-09-12T02:39:45.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.414+0000 7fbd2b7fe640 1 -- 172.21.15.60:0/2807876401 reap_dead start 2024-09-12T02:39:45.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.414+0000 7fbd31552640 1 -- 172.21.15.60:0/2807876401 shutdown_connections 2024-09-12T02:39:45.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.414+0000 7fbd31552640 1 --2- 172.21.15.60:0/2807876401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd2c0a7de0 0x7fbd2c1e18d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:45.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.414+0000 7fbd31552640 1 -- 172.21.15.60:0/2807876401 >> 172.21.15.60:0/2807876401 conn(0x7fbd2c0c4fa0 msgr2=0x7fbd2c151180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:45.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.414+0000 7fbd31552640 1 -- 172.21.15.60:0/2807876401 shutdown_connections 2024-09-12T02:39:45.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.414+0000 7fbd31552640 1 -- 172.21.15.60:0/2807876401 wait complete. 2024-09-12T02:39:45.433 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:39:45.433 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-12T02:39:45.433 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-12T02:39:45.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.539+0000 7f7fc8d76640 1 Processor -- start 2024-09-12T02:39:45.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.539+0000 7f7fc8d76640 1 -- start start 2024-09-12T02:39:45.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.540+0000 7f7fc8d76640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7fc406f1d0 0x7f7fc40c2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:45.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.540+0000 7f7fc8d76640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7fc40c5940 0x7f7fc4152a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:45.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.540+0000 7f7fc8d76640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fc40c7500 con 0x7f7fc414fa90 2024-09-12T02:39:45.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.540+0000 7f7fc8d76640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f7fc40c72b0 con 0x7f7fc406f1d0 2024-09-12T02:39:45.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.540+0000 7f7fc8d76640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7fc4152580 con 0x7f7fc40c5940 2024-09-12T02:39:45.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.541+0000 7f7fc1d9b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7fc406f1d0 0x7f7fc40c2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:45.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.541+0000 7f7fc1d9b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7fc406f1d0 0x7f7fc40c2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53108/0 (socket says 172.21.15.60:53108) 2024-09-12T02:39:45.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.541+0000 7f7fc1d9b640 1 -- 172.21.15.60:0/1914747542 learned_addr learned my addr 172.21.15.60:0/1914747542 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:39:45.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.542+0000 7f7fc1d9b640 1 -- 172.21.15.60:0/1914747542 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7fc40c5940 msgr2=0x7f7fc4152a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:45.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.542+0000 7f7fc1d9b640 1 --2- 172.21.15.60:0/1914747542 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7fc40c5940 0x7f7fc4152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:45.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.542+0000 7f7fc1d9b640 1 -- 172.21.15.60:0/1914747542 >> v1:172.21.15.105:6789/0 conn(0x7f7fc414fa90 legacy=0x7f7fc40c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:45.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.542+0000 7f7fc1d9b640 1 -- 172.21.15.60:0/1914747542 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc4156300 con 0x7f7fc406f1d0 2024-09-12T02:39:45.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.543+0000 7f7fc1d9b640 1 --2- 172.21.15.60:0/1914747542 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fc406f1d0 0x7f7fc40c2e50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4008870 tx=0x7f7fb402c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5626d38c457b6b15 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:45.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.544+0000 7f7fc159a640 1 -- 172.21.15.60:0/1914747542 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb403a070 con 0x7f7fc406f1d0 2024-09-12T02:39:45.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.544+0000 7f7fc159a640 1 -- 172.21.15.60:0/1914747542 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fb4032480 con 0x7f7fc406f1d0 2024-09-12T02:39:45.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.544+0000 7f7fc159a640 1 -- 172.21.15.60:0/1914747542 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb402ce60 con 0x7f7fc406f1d0 2024-09-12T02:39:45.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.546+0000 7f7fc8d76640 1 -- 172.21.15.60:0/1914747542 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fc406f1d0 msgr2=0x7f7fc40c2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:45.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.546+0000 7f7fc8d76640 1 --2- 172.21.15.60:0/1914747542 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fc406f1d0 0x7f7fc40c2e50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4008870 tx=0x7f7fb402c680 comp rx=0 tx=0).stop 2024-09-12T02:39:45.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.546+0000 7f7fc8d76640 1 -- 172.21.15.60:0/1914747542 shutdown_connections 2024-09-12T02:39:45.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.546+0000 7f7fc8d76640 1 --2- 172.21.15.60:0/1914747542 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7fc40c5940 0x7f7fc4152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:45.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.546+0000 7f7fc8d76640 1 --2- 172.21.15.60:0/1914747542 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fc406f1d0 0x7f7fc40c2e50 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:45.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.546+0000 7f7fc8d76640 1 -- 172.21.15.60:0/1914747542 >> 172.21.15.60:0/1914747542 conn(0x7f7fc40c7a40 msgr2=0x7f7fc40c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:45.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.546+0000 7f7fc8d76640 1 -- 172.21.15.60:0/1914747542 shutdown_connections 2024-09-12T02:39:45.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.546+0000 7f7fc8d76640 1 -- 172.21.15.60:0/1914747542 wait complete. 2024-09-12T02:39:45.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.548+0000 7f7fc8d76640 1 Processor -- start 2024-09-12T02:39:45.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.548+0000 7f7fc8d76640 1 -- start start 2024-09-12T02:39:45.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.550+0000 7f7fc8d76640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7fc406f1d0 0x7f7fc41e5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:45.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.550+0000 7f7fc8d76640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fc40c5940 0x7f7fc414e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:45.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.550+0000 7f7fc8d76640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fc414fa90 0x7f7fc414ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:45.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.550+0000 7f7fc8d76640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc414fe70 con 0x7f7fc414fa90 2024-09-12T02:39:45.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.550+0000 7f7fc8d76640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc40c2b10 con 0x7f7fc40c5940 2024-09-12T02:39:45.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.550+0000 7f7fc2d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fc414fa90 0x7f7fc414ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:45.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.550+0000 7f7fc8d76640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7fc40c4be0 con 0x7f7fc406f1d0 2024-09-12T02:39:45.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.550+0000 7f7fc2d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fc414fa90 0x7f7fc414ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53112/0 (socket says 172.21.15.60:53112) 2024-09-12T02:39:45.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.550+0000 7f7fc2d9d640 1 -- 172.21.15.60:0/1849898218 learned_addr learned my addr 172.21.15.60:0/1849898218 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:39:45.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.550+0000 7f7fc259c640 1 --2- 172.21.15.60:0/1849898218 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7fc406f1d0 0x7f7fc41e5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:45.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.550+0000 7f7fc1d9b640 1 --2- 172.21.15.60:0/1849898218 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fc40c5940 0x7f7fc414e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:45.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.551+0000 7f7fc259c640 1 -- 172.21.15.60:0/1849898218 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fc40c5940 msgr2=0x7f7fc414e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:45.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.551+0000 7f7fc259c640 1 --2- 172.21.15.60:0/1849898218 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fc40c5940 0x7f7fc414e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:45.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.551+0000 7f7fc259c640 1 -- 172.21.15.60:0/1849898218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fc414fa90 msgr2=0x7f7fc414ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:45.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.551+0000 7f7fc259c640 1 --2- 172.21.15.60:0/1849898218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fc414fa90 0x7f7fc414ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:45.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.551+0000 7f7fc259c640 1 -- 172.21.15.60:0/1849898218 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc41e6840 con 0x7f7fc406f1d0 2024-09-12T02:39:45.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.551+0000 7f7fc2d9d640 1 --2- 172.21.15.60:0/1849898218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fc414fa90 0x7f7fc414ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:39:45.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.551+0000 7f7fc259c640 1 --2- 172.21.15.60:0/1849898218 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7fc406f1d0 0x7f7fc41e5c50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7fb800b3e0 tx=0x7f7fb800b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:45.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.552+0000 7f7fb2ffd640 1 -- 172.21.15.60:0/1849898218 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb8015020 con 0x7f7fc406f1d0 2024-09-12T02:39:45.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.552+0000 7f7fb2ffd640 1 -- 172.21.15.60:0/1849898218 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fb8011830 con 0x7f7fc406f1d0 2024-09-12T02:39:45.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.552+0000 7f7fb2ffd640 1 -- 172.21.15.60:0/1849898218 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb8011c00 con 0x7f7fc406f1d0 2024-09-12T02:39:45.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.552+0000 7f7fc8d76640 1 -- 172.21.15.60:0/1849898218 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fc4151a60 con 0x7f7fc406f1d0 2024-09-12T02:39:45.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.553+0000 7f7fc8d76640 1 -- 172.21.15.60:0/1849898218 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fc4152020 con 0x7f7fc406f1d0 2024-09-12T02:39:45.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.554+0000 7f7fc8d76640 1 --2- 172.21.15.60:0/1849898218 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7fc4155610 0x7f7fc4153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:45.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.554+0000 7f7fc8d76640 1 -- 172.21.15.60:0/1849898218 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7fc40c8530 con 0x7f7fc4155610 2024-09-12T02:39:45.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.554+0000 7f7fc1d9b640 1 --2- 172.21.15.60:0/1849898218 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7fc4155610 0x7f7fc4153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:45.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.555+0000 7f7fc1d9b640 1 -- 172.21.15.60:0/1849898218 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7fc40a9370 con 0x7f7fc4155610 2024-09-12T02:39:45.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.555+0000 7f7fc1d9b640 1 --2- 172.21.15.60:0/1849898218 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7fc4155610 0x7f7fc4153330 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7fc40c5060 tx=0x7f7fb4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:45.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.556+0000 7f7fb2ffd640 1 -- 172.21.15.60:0/1849898218 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb4045030 con 0x7f7fc4155610 2024-09-12T02:39:45.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.556+0000 7f7fb2ffd640 1 -- 172.21.15.60:0/1849898218 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f7fb4032070 con 0x7f7fc4155610 2024-09-12T02:39:45.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.556+0000 7f7fb2ffd640 1 -- 172.21.15.60:0/1849898218 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7fc4155610 msgr2=0x7f7fc4153330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:45.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.556+0000 7f7fb2ffd640 1 --2- 172.21.15.60:0/1849898218 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7fc4155610 0x7f7fc4153330 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7fc40c5060 tx=0x7f7fb4004730 comp rx=0 tx=0).stop 2024-09-12T02:39:45.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.556+0000 7f7fb2ffd640 1 -- 172.21.15.60:0/1849898218 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7fc4155610 msgr2=0x7f7fc4153330 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:39:45.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.556+0000 7f7fb2ffd640 1 --2- 172.21.15.60:0/1849898218 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7fc4155610 0x7f7fc4153330 secure :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7fc40c5060 tx=0x7f7fb4004730 comp rx=0 tx=0).stop 2024-09-12T02:39:45.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.559+0000 7f7fb2ffd640 1 -- 172.21.15.60:0/1849898218 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7fb8018020 con 0x7f7fc406f1d0 2024-09-12T02:39:45.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.560+0000 7f7fb2ffd640 1 --2- 172.21.15.60:0/1849898218 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f7fa406ba80 0x7f7fa406df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:45.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.560+0000 7f7fb2ffd640 1 -- 172.21.15.60:0/1849898218 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f7fb808ae30 con 0x7f7fc406f1d0 2024-09-12T02:39:45.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.560+0000 7f7fc1d9b640 1 --2- 172.21.15.60:0/1849898218 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f7fa406ba80 0x7f7fa406df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:45.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.561+0000 7f7fc1d9b640 1 --2- 172.21.15.60:0/1849898218 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f7fa406ba80 0x7f7fa406df40 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7fc40c2e20 tx=0x7f7fb4041000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:45.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.567+0000 7f7fc8d76640 1 --2- 172.21.15.60:0/1849898218 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7fc41e6190 0x7f7fc41f3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:45.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.567+0000 7f7fc8d76640 1 -- 172.21.15.60:0/1849898218 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7fc41f3a50 con 0x7f7fc41e6190 2024-09-12T02:39:45.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.567+0000 7f7fc2d9d640 1 --2- 172.21.15.60:0/1849898218 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7fc41e6190 0x7f7fc41f3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:45.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.568+0000 7f7fc2d9d640 1 -- 172.21.15.60:0/1849898218 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7fc40764a0 con 0x7f7fc41e6190 2024-09-12T02:39:45.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.569+0000 7f7fc2d9d640 1 --2- 172.21.15.60:0/1849898218 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7fc41e6190 0x7f7fc41f3d70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc007dd0 tx=0x7f7fbc00e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:45.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.569+0000 7f7fb2ffd640 1 -- 172.21.15.60:0/1849898218 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc00ee40 con 0x7f7fc41e6190 2024-09-12T02:39:45.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.570+0000 7f7fb2ffd640 1 -- 172.21.15.60:0/1849898218 <== mon.2 v2:172.21.15.105:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4883 (secure 0 0 0) 0x7f7fbc00ee40 con 0x7f7fc41e6190 2024-09-12T02:39:45.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.570+0000 7f7fb2ffd640 1 -- 172.21.15.60:0/1849898218 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7fc41e6190 msgr2=0x7f7fc41f3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:45.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.570+0000 7f7fb2ffd640 1 --2- 172.21.15.60:0/1849898218 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7fc41e6190 0x7f7fc41f3d70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc007dd0 tx=0x7f7fbc00e4b0 comp rx=0 tx=0).stop 2024-09-12T02:39:45.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.570+0000 7f7fb2ffd640 1 -- 172.21.15.60:0/1849898218 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7fc41e6190 msgr2=0x7f7fc41f3d70 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:39:45.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.570+0000 7f7fb2ffd640 1 --2- 172.21.15.60:0/1849898218 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7fc41e6190 0x7f7fc41f3d70 secure :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc007dd0 tx=0x7f7fbc00e4b0 comp rx=0 tx=0).stop 2024-09-12T02:39:45.572 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:39:45.572 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:39:45.573 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:39:45.573 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "peon", 2024-09-12T02:39:45.573 INFO:teuthology.orchestra.run.smithi060.stdout: "election_epoch": 158, 2024-09-12T02:39:45.573 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 63508, 2024-09-12T02:39:45.573 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum": [ 2024-09-12T02:39:45.573 INFO:teuthology.orchestra.run.smithi060.stdout: 0, 2024-09-12T02:39:45.573 INFO:teuthology.orchestra.run.smithi060.stdout: 1, 2024-09-12T02:39:45.573 INFO:teuthology.orchestra.run.smithi060.stdout: 2 2024-09-12T02:39:45.573 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:45.573 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_age": 2, 2024-09-12T02:39:45.573 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:39:45.573 INFO:teuthology.orchestra.run.smithi060.stdout: "required_con": "2450521708007866372", 2024-09-12T02:39:45.573 INFO:teuthology.orchestra.run.smithi060.stdout: "required_mon": [ 2024-09-12T02:39:45.574 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:39:45.574 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:39:45.574 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:39:45.574 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:39:45.574 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:39:45.574 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:39:45.574 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:39:45.574 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:39:45.574 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:39:45.574 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:39:45.574 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:39:45.574 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:45.574 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_con": "4540701547738038271", 2024-09-12T02:39:45.575 INFO:teuthology.orchestra.run.smithi060.stdout: "quorum_mon": [ 2024-09-12T02:39:45.575 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:39:45.575 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:39:45.575 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:39:45.575 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:39:45.575 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:39:45.575 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:39:45.575 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:39:45.575 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:39:45.575 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:39:45.575 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:39:45.575 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:39:45.576 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:45.576 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:45.576 INFO:teuthology.orchestra.run.smithi060.stdout: "outside_quorum": [], 2024-09-12T02:39:45.576 INFO:teuthology.orchestra.run.smithi060.stdout: "extra_probe_peers": [], 2024-09-12T02:39:45.576 INFO:teuthology.orchestra.run.smithi060.stdout: "sync_provider": [], 2024-09-12T02:39:45.576 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": { 2024-09-12T02:39:45.576 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 1, 2024-09-12T02:39:45.576 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1", 2024-09-12T02:39:45.576 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:39:45.576 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-12T02:21:57.514264Z", 2024-09-12T02:39:45.576 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release": 19, 2024-09-12T02:39:45.576 INFO:teuthology.orchestra.run.smithi060.stdout: "min_mon_release_name": "squid", 2024-09-12T02:39:45.576 INFO:teuthology.orchestra.run.smithi060.stdout: "election_strategy": 1, 2024-09-12T02:39:45.577 INFO:teuthology.orchestra.run.smithi060.stdout: "disallowed_leaders: ": "", 2024-09-12T02:39:45.577 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false, 2024-09-12T02:39:45.577 INFO:teuthology.orchestra.run.smithi060.stdout: "tiebreaker_mon": "", 2024-09-12T02:39:45.577 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_ranks: ": "", 2024-09-12T02:39:45.577 INFO:teuthology.orchestra.run.smithi060.stdout: "features": { 2024-09-12T02:39:45.577 INFO:teuthology.orchestra.run.smithi060.stdout: "persistent": [ 2024-09-12T02:39:45.577 INFO:teuthology.orchestra.run.smithi060.stdout: "kraken", 2024-09-12T02:39:45.577 INFO:teuthology.orchestra.run.smithi060.stdout: "luminous", 2024-09-12T02:39:45.577 INFO:teuthology.orchestra.run.smithi060.stdout: "mimic", 2024-09-12T02:39:45.577 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap-prune", 2024-09-12T02:39:45.577 INFO:teuthology.orchestra.run.smithi060.stdout: "nautilus", 2024-09-12T02:39:45.577 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus", 2024-09-12T02:39:45.578 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific", 2024-09-12T02:39:45.578 INFO:teuthology.orchestra.run.smithi060.stdout: "elector-pinging", 2024-09-12T02:39:45.578 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy", 2024-09-12T02:39:45.578 INFO:teuthology.orchestra.run.smithi060.stdout: "reef", 2024-09-12T02:39:45.578 INFO:teuthology.orchestra.run.smithi060.stdout: "squid" 2024-09-12T02:39:45.578 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:45.578 INFO:teuthology.orchestra.run.smithi060.stdout: "optional": [] 2024-09-12T02:39:45.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:45.578 INFO:teuthology.orchestra.run.smithi060.stdout: "mons": [ 2024-09-12T02:39:45.578 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:45.578 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 0, 2024-09-12T02:39:45.578 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "a", 2024-09-12T02:39:45.579 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:39:45.579 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:39:45.579 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:45.579 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:39:45.579 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:3300", 2024-09-12T02:39:45.579 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:45.579 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:45.579 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:45.579 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:39:45.579 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789", 2024-09-12T02:39:45.579 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:45.579 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:45.579 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:45.579 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:45.579 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6789/0", 2024-09-12T02:39:45.580 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6789/0", 2024-09-12T02:39:45.580 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:39:45.580 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:39:45.580 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:39:45.580 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:45.580 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:45.580 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 1, 2024-09-12T02:39:45.580 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "b", 2024-09-12T02:39:45.580 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:39:45.580 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:39:45.580 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:45.580 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:39:45.580 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3300", 2024-09-12T02:39:45.580 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:45.581 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:45.581 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:45.581 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:39:45.581 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789", 2024-09-12T02:39:45.581 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:45.581 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:45.581 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:45.581 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:45.581 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6789/0", 2024-09-12T02:39:45.581 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6789/0", 2024-09-12T02:39:45.581 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:39:45.581 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:39:45.581 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:39:45.581 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:45.581 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:45.582 INFO:teuthology.orchestra.run.smithi060.stdout: "rank": 2, 2024-09-12T02:39:45.582 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "c", 2024-09-12T02:39:45.582 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-12T02:39:45.582 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T02:39:45.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:45.582 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T02:39:45.582 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:3301", 2024-09-12T02:39:45.582 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:45.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:45.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:45.582 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T02:39:45.582 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790", 2024-09-12T02:39:45.582 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 0 2024-09-12T02:39:45.582 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:45.583 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:45.583 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:45.583 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.105:6790/0", 2024-09-12T02:39:45.583 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.105:6790/0", 2024-09-12T02:39:45.583 INFO:teuthology.orchestra.run.smithi060.stdout: "priority": 0, 2024-09-12T02:39:45.583 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 0, 2024-09-12T02:39:45.583 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "{}" 2024-09-12T02:39:45.583 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:45.583 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:45.583 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:45.583 INFO:teuthology.orchestra.run.smithi060.stdout: "feature_map": { 2024-09-12T02:39:45.583 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": [ 2024-09-12T02:39:45.583 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:45.583 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:39:45.583 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:39:45.584 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:39:45.584 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:45.584 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:45.584 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": [ 2024-09-12T02:39:45.584 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:45.584 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:39:45.584 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:39:45.584 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 1 2024-09-12T02:39:45.584 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:45.584 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:45.584 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": [ 2024-09-12T02:39:45.584 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:45.585 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:39:45.585 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:39:45.585 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4 2024-09-12T02:39:45.585 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:45.585 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T02:39:45.585 INFO:teuthology.orchestra.run.smithi060.stdout: "client": [ 2024-09-12T02:39:45.585 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T02:39:45.585 INFO:teuthology.orchestra.run.smithi060.stdout: "features": "0x3f03cffffffdffff", 2024-09-12T02:39:45.585 INFO:teuthology.orchestra.run.smithi060.stdout: "release": "squid", 2024-09-12T02:39:45.585 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 2 2024-09-12T02:39:45.585 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T02:39:45.585 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T02:39:45.585 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T02:39:45.586 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": false 2024-09-12T02:39:45.586 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:39:45.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.570+0000 7f7fc8d76640 1 -- 172.21.15.60:0/1849898218 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f7fa406ba80 msgr2=0x7f7fa406df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:45.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.570+0000 7f7fc8d76640 1 --2- 172.21.15.60:0/1849898218 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f7fa406ba80 0x7f7fa406df40 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7fc40c2e20 tx=0x7f7fb4041000 comp rx=0 tx=0).stop 2024-09-12T02:39:45.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.570+0000 7f7fc2d9d640 1 -- 172.21.15.60:0/1849898218 reap_dead start 2024-09-12T02:39:45.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.570+0000 7f7fc8d76640 1 -- 172.21.15.60:0/1849898218 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7fc406f1d0 msgr2=0x7f7fc41e5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:45.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.570+0000 7f7fc8d76640 1 --2- 172.21.15.60:0/1849898218 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7fc406f1d0 0x7f7fc41e5c50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7fb800b3e0 tx=0x7f7fb800b8a0 comp rx=0 tx=0).stop 2024-09-12T02:39:45.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.571+0000 7f7fc8d76640 1 -- 172.21.15.60:0/1849898218 shutdown_connections 2024-09-12T02:39:45.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.571+0000 7f7fc8d76640 1 --2- 172.21.15.60:0/1849898218 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7fc406f1d0 0x7f7fc41e5c50 secure :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7fb800b3e0 tx=0x7f7fb800b8a0 comp rx=0 tx=0).stop 2024-09-12T02:39:45.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.571+0000 7f7fc8d76640 1 -- 172.21.15.60:0/1849898218 >> 172.21.15.60:0/1849898218 conn(0x7f7fc40c7a40 msgr2=0x7f7fc40a9b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:45.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.571+0000 7f7fc8d76640 1 -- 172.21.15.60:0/1849898218 shutdown_connections 2024-09-12T02:39:45.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.571+0000 7f7fc8d76640 1 -- 172.21.15.60:0/1849898218 wait complete. 2024-09-12T02:39:45.590 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-12T02:39:45.590 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-12T02:39:45.590 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-12T02:39:45.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.703+0000 7f27f8027640 1 Processor -- start 2024-09-12T02:39:45.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.703+0000 7f27f8027640 1 -- start start 2024-09-12T02:39:45.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.704+0000 7f27f8027640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f27f00ca390 0x7f27f0161c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:45.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.704+0000 7f27f8027640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27f015a7c0 con 0x7f27f006c650 2024-09-12T02:39:45.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.704+0000 7f27f8027640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27f0159a00 con 0x7f27f0150480 2024-09-12T02:39:45.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.704+0000 7f27f8027640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f27f006c240 con 0x7f27f00ca390 2024-09-12T02:39:45.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.704+0000 7f27f65c4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f27f00ca390 0x7f27f0161c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:45.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.704+0000 7f27f55c2640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f27f006c650 0x7f27f00c9c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52542/0 (socket says 172.21.15.60:52542) 2024-09-12T02:39:45.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.704+0000 7f27f55c2640 1 -- 172.21.15.60:0/1690554003 learned_addr learned my addr 172.21.15.60:0/1690554003 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:39:45.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.704+0000 7f27f65c4640 1 -- 172.21.15.60:0/1690554003 >> v1:172.21.15.105:6789/0 conn(0x7f27f0150480 legacy=0x7f27f00c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:45.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.704+0000 7f27f65c4640 1 -- 172.21.15.60:0/1690554003 >> v1:172.21.15.60:6789/0 conn(0x7f27f006c650 legacy=0x7f27f00c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:45.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.704+0000 7f27f65c4640 1 -- 172.21.15.60:0/1690554003 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27f0159ce0 con 0x7f27f00ca390 2024-09-12T02:39:45.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.704+0000 7f27f4dc1640 1 -- 172.21.15.60:0/1690554003 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1872701963 0 0) 0x7f27f015a7c0 con 0x7f27f006c650 2024-09-12T02:39:45.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.705+0000 7f27f65c4640 1 --2- 172.21.15.60:0/1690554003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27f00ca390 0x7f27f0161c00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f27e8009d90 tx=0x7f27e802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=505d59ee000221d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:45.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.705+0000 7f27f4dc1640 1 -- 172.21.15.60:0/1690554003 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e8007740 con 0x7f27f00ca390 2024-09-12T02:39:45.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.705+0000 7f27f4dc1640 1 -- 172.21.15.60:0/1690554003 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27e80078e0 con 0x7f27f00ca390 2024-09-12T02:39:45.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.705+0000 7f27f4dc1640 1 -- 172.21.15.60:0/1690554003 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e8007cb0 con 0x7f27f00ca390 2024-09-12T02:39:45.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.705+0000 7f27f8027640 1 -- 172.21.15.60:0/1690554003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27f00ca390 msgr2=0x7f27f0161c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:45.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.705+0000 7f27f8027640 1 --2- 172.21.15.60:0/1690554003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27f00ca390 0x7f27f0161c00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f27e8009d90 tx=0x7f27e802a6a0 comp rx=0 tx=0).stop 2024-09-12T02:39:45.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.706+0000 7f27f8027640 1 -- 172.21.15.60:0/1690554003 shutdown_connections 2024-09-12T02:39:45.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.706+0000 7f27f8027640 1 --2- 172.21.15.60:0/1690554003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27f00ca390 0x7f27f0161c00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:45.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.706+0000 7f27f8027640 1 -- 172.21.15.60:0/1690554003 >> 172.21.15.60:0/1690554003 conn(0x7f27f0068030 msgr2=0x7f27f0073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:45.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.706+0000 7f27f8027640 1 -- 172.21.15.60:0/1690554003 shutdown_connections 2024-09-12T02:39:45.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.706+0000 7f27f8027640 1 -- 172.21.15.60:0/1690554003 wait complete. 2024-09-12T02:39:45.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.707+0000 7f27f8027640 1 Processor -- start 2024-09-12T02:39:45.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.707+0000 7f27f8027640 1 -- start start 2024-09-12T02:39:45.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.707+0000 7f27f8027640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27f006c650 0x7f27f0151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:45.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.707+0000 7f27f8027640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27f00ca390 0x7f27f0150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:45.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.707+0000 7f27f8027640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27f0150480 0x7f27f0150da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:45.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.707+0000 7f27f8027640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f27f006d270 con 0x7f27f00ca390 2024-09-12T02:39:45.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.707+0000 7f27f8027640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f27f015a330 con 0x7f27f006c650 2024-09-12T02:39:45.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.707+0000 7f27f8027640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f27f00c81a0 con 0x7f27f0150480 2024-09-12T02:39:45.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.707+0000 7f27f55c2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27f00ca390 0x7f27f0150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:45.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.708+0000 7f27f55c2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27f00ca390 0x7f27f0150860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53130/0 (socket says 172.21.15.60:53130) 2024-09-12T02:39:45.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.708+0000 7f27f55c2640 1 -- 172.21.15.60:0/3884496335 learned_addr learned my addr 172.21.15.60:0/3884496335 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:39:45.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.708+0000 7f27f5dc3640 1 --2- 172.21.15.60:0/3884496335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27f006c650 0x7f27f0151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:45.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.708+0000 7f27f65c4640 1 --2- 172.21.15.60:0/3884496335 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27f0150480 0x7f27f0150da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:45.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.708+0000 7f27f55c2640 1 -- 172.21.15.60:0/3884496335 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27f0150480 msgr2=0x7f27f0150da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:45.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.708+0000 7f27f55c2640 1 --2- 172.21.15.60:0/3884496335 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27f0150480 0x7f27f0150da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:45.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.708+0000 7f27f55c2640 1 -- 172.21.15.60:0/3884496335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27f006c650 msgr2=0x7f27f0151fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:45.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.708+0000 7f27f55c2640 1 --2- 172.21.15.60:0/3884496335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27f006c650 0x7f27f0151fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:45.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.708+0000 7f27f55c2640 1 -- 172.21.15.60:0/3884496335 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27f01ebcb0 con 0x7f27f00ca390 2024-09-12T02:39:45.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.708+0000 7f27f55c2640 1 --2- 172.21.15.60:0/3884496335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27f00ca390 0x7f27f0150860 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f27e000c4d0 tx=0x7f27e000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:45.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.708+0000 7f27e67fc640 1 -- 172.21.15.60:0/3884496335 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e0018070 con 0x7f27f00ca390 2024-09-12T02:39:45.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.708+0000 7f27e67fc640 1 -- 172.21.15.60:0/3884496335 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27e0007500 con 0x7f27f00ca390 2024-09-12T02:39:45.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.708+0000 7f27f8027640 1 -- 172.21.15.60:0/3884496335 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27f01ebf50 con 0x7f27f00ca390 2024-09-12T02:39:45.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.708+0000 7f27e67fc640 1 -- 172.21.15.60:0/3884496335 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e0004a20 con 0x7f27f00ca390 2024-09-12T02:39:45.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.708+0000 7f27f8027640 1 -- 172.21.15.60:0/3884496335 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27f01ec510 con 0x7f27f00ca390 2024-09-12T02:39:45.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.709+0000 7f27f8027640 1 -- 172.21.15.60:0/3884496335 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27f0156270 con 0x7f27f00ca390 2024-09-12T02:39:45.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.709+0000 7f27e67fc640 1 -- 172.21.15.60:0/3884496335 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f27e001b070 con 0x7f27f00ca390 2024-09-12T02:39:45.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.710+0000 7f27e67fc640 1 --2- 172.21.15.60:0/3884496335 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f27d406be60 0x7f27d406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:45.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.710+0000 7f27f5dc3640 1 --2- 172.21.15.60:0/3884496335 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f27d406be60 0x7f27d406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:45.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.710+0000 7f27e67fc640 1 -- 172.21.15.60:0/3884496335 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f27e008a410 con 0x7f27f00ca390 2024-09-12T02:39:45.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.711+0000 7f27f5dc3640 1 --2- 172.21.15.60:0/3884496335 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f27d406be60 0x7f27d406e320 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f27ec006fd0 tx=0x7f27ec008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:45.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.715+0000 7f27e67fc640 1 -- 172.21.15.60:0/3884496335 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f27e0058ab0 con 0x7f27f00ca390 2024-09-12T02:39:45.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.996+0000 7f27f8027640 1 -- 172.21.15.60:0/3884496335 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f27f006c430 con 0x7f27f00ca390 2024-09-12T02:39:45.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.996+0000 7f27e67fc640 1 -- 172.21.15.60:0/3884496335 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f27e00583b0 con 0x7f27f00ca390 2024-09-12T02:39:46.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.998+0000 7f27f8027640 1 -- 172.21.15.60:0/3884496335 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f27d406be60 msgr2=0x7f27d406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:46.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.998+0000 7f27f8027640 1 --2- 172.21.15.60:0/3884496335 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f27d406be60 0x7f27d406e320 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f27ec006fd0 tx=0x7f27ec008040 comp rx=0 tx=0).stop 2024-09-12T02:39:46.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.998+0000 7f27f8027640 1 -- 172.21.15.60:0/3884496335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27f00ca390 msgr2=0x7f27f0150860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:46.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.998+0000 7f27f8027640 1 --2- 172.21.15.60:0/3884496335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27f00ca390 0x7f27f0150860 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f27e000c4d0 tx=0x7f27e000c990 comp rx=0 tx=0).stop 2024-09-12T02:39:46.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.998+0000 7f27f8027640 1 -- 172.21.15.60:0/3884496335 shutdown_connections 2024-09-12T02:39:46.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.998+0000 7f27f8027640 1 --2- 172.21.15.60:0/3884496335 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f27d406be60 0x7f27d406e320 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:46.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.998+0000 7f27f8027640 1 --2- 172.21.15.60:0/3884496335 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27f0150480 0x7f27f0150da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:46.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.998+0000 7f27f8027640 1 --2- 172.21.15.60:0/3884496335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27f00ca390 0x7f27f0150860 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:46.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.998+0000 7f27f8027640 1 --2- 172.21.15.60:0/3884496335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27f006c650 0x7f27f0151fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:46.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.998+0000 7f27f8027640 1 -- 172.21.15.60:0/3884496335 >> 172.21.15.60:0/3884496335 conn(0x7f27f0068030 msgr2=0x7f27f00ac080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:46.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.999+0000 7f27f8027640 1 -- 172.21.15.60:0/3884496335 shutdown_connections 2024-09-12T02:39:46.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:45.999+0000 7f27f8027640 1 -- 172.21.15.60:0/3884496335 wait complete. 2024-09-12T02:39:46.012 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-12T02:39:56.013 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:39:56.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.128+0000 7f833f32c640 1 Processor -- start 2024-09-12T02:39:56.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.128+0000 7f833f32c640 1 -- start start 2024-09-12T02:39:56.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.128+0000 7f833f32c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8338073ae0 0x7f8338153380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:56.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.128+0000 7f833f32c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8338156f50 0x7f83381538c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:56.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.128+0000 7f833f32c640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f833806dd50 con 0x7f83380733d0 2024-09-12T02:39:56.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.129+0000 7f833f32c640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f833806e030 con 0x7f8338156f50 2024-09-12T02:39:56.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.129+0000 7f833f32c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f833806e310 con 0x7f8338073ae0 2024-09-12T02:39:56.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.129+0000 7f833d8c9640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8338156f50 0x7f83381538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:56.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.129+0000 7f833d8c9640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8338156f50 0x7f83381538c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53700/0 (socket says 172.21.15.60:53700) 2024-09-12T02:39:56.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.129+0000 7f833d8c9640 1 -- 172.21.15.60:0/106578858 learned_addr learned my addr 172.21.15.60:0/106578858 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:39:56.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.129+0000 7f833d0c8640 1 --2- 172.21.15.60:0/106578858 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8338073ae0 0x7f8338153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:56.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.129+0000 7f833d8c9640 1 -- 172.21.15.60:0/106578858 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8338073ae0 msgr2=0x7f8338153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:56.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.129+0000 7f833d8c9640 1 --2- 172.21.15.60:0/106578858 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8338073ae0 0x7f8338153380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:56.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.129+0000 7f833d8c9640 1 -- 172.21.15.60:0/106578858 >> v1:172.21.15.105:6789/0 conn(0x7f83380733d0 legacy=0x7f8338156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:56.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.129+0000 7f833d8c9640 1 -- 172.21.15.60:0/106578858 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f833806e5f0 con 0x7f8338156f50 2024-09-12T02:39:56.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.129+0000 7f833d0c8640 1 --2- 172.21.15.60:0/106578858 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8338073ae0 0x7f8338153380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:39:56.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.130+0000 7f833d8c9640 1 --2- 172.21.15.60:0/106578858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8338156f50 0x7f83381538c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8330009e50 tx=0x7f833002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a4129ef4f5097a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:56.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.130+0000 7f832ffff640 1 -- 172.21.15.60:0/106578858 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8330036070 con 0x7f8338156f50 2024-09-12T02:39:56.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.130+0000 7f832ffff640 1 -- 172.21.15.60:0/106578858 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8330031600 con 0x7f8338156f50 2024-09-12T02:39:56.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.130+0000 7f832ffff640 1 -- 172.21.15.60:0/106578858 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83300319d0 con 0x7f8338156f50 2024-09-12T02:39:56.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.131+0000 7f833f32c640 1 -- 172.21.15.60:0/106578858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8338156f50 msgr2=0x7f83381538c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:56.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.131+0000 7f833f32c640 1 --2- 172.21.15.60:0/106578858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8338156f50 0x7f83381538c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8330009e50 tx=0x7f833002a710 comp rx=0 tx=0).stop 2024-09-12T02:39:56.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.131+0000 7f833f32c640 1 -- 172.21.15.60:0/106578858 shutdown_connections 2024-09-12T02:39:56.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.131+0000 7f833f32c640 1 --2- 172.21.15.60:0/106578858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8338156f50 0x7f83381538c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:56.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.131+0000 7f833f32c640 1 --2- 172.21.15.60:0/106578858 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8338073ae0 0x7f8338153380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:56.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.131+0000 7f833f32c640 1 -- 172.21.15.60:0/106578858 >> 172.21.15.60:0/106578858 conn(0x7f83380c9d80 msgr2=0x7f83380ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:56.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.131+0000 7f833f32c640 1 -- 172.21.15.60:0/106578858 shutdown_connections 2024-09-12T02:39:56.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.131+0000 7f833f32c640 1 -- 172.21.15.60:0/106578858 wait complete. 2024-09-12T02:39:56.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.133+0000 7f833f32c640 1 Processor -- start 2024-09-12T02:39:56.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.133+0000 7f833f32c640 1 -- start start 2024-09-12T02:39:56.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.134+0000 7f833f32c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83380733d0 0x7f83380c7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:56.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.134+0000 7f833f32c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8338073ae0 0x7f83381ec670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:56.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.134+0000 7f833f32c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8338156f50 0x7f83381ecbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:56.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.134+0000 7f833f32c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f833806edd0 con 0x7f8338073ae0 2024-09-12T02:39:56.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.134+0000 7f833f32c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f833806ec50 con 0x7f8338156f50 2024-09-12T02:39:56.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.134+0000 7f833f32c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8338073ec0 con 0x7f83380733d0 2024-09-12T02:39:56.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.134+0000 7f833c8c7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8338073ae0 0x7f83381ec670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:56.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.134+0000 7f833c8c7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8338073ae0 0x7f83381ec670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53704/0 (socket says 172.21.15.60:53704) 2024-09-12T02:39:56.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.134+0000 7f833c8c7640 1 -- 172.21.15.60:0/1679794942 learned_addr learned my addr 172.21.15.60:0/1679794942 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:39:56.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.134+0000 7f833d0c8640 1 --2- 172.21.15.60:0/1679794942 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83380733d0 0x7f83380c7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:56.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.134+0000 7f833d8c9640 1 --2- 172.21.15.60:0/1679794942 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8338156f50 0x7f83381ecbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:56.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.134+0000 7f833c8c7640 1 -- 172.21.15.60:0/1679794942 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83380733d0 msgr2=0x7f83380c7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:56.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.134+0000 7f833c8c7640 1 --2- 172.21.15.60:0/1679794942 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83380733d0 0x7f83380c7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:56.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.134+0000 7f833c8c7640 1 -- 172.21.15.60:0/1679794942 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8338156f50 msgr2=0x7f83381ecbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:56.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.134+0000 7f833c8c7640 1 --2- 172.21.15.60:0/1679794942 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8338156f50 0x7f83381ecbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:56.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.134+0000 7f833c8c7640 1 -- 172.21.15.60:0/1679794942 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83381efb80 con 0x7f8338073ae0 2024-09-12T02:39:56.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.134+0000 7f833c8c7640 1 --2- 172.21.15.60:0/1679794942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8338073ae0 0x7f83381ec670 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f832800c3a0 tx=0x7f832800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:56.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.134+0000 7f832dffb640 1 -- 172.21.15.60:0/1679794942 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83280052d0 con 0x7f8338073ae0 2024-09-12T02:39:56.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.134+0000 7f832dffb640 1 -- 172.21.15.60:0/1679794942 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8328005490 con 0x7f8338073ae0 2024-09-12T02:39:56.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.134+0000 7f833f32c640 1 -- 172.21.15.60:0/1679794942 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83381efe60 con 0x7f8338073ae0 2024-09-12T02:39:56.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.134+0000 7f832dffb640 1 -- 172.21.15.60:0/1679794942 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8328007260 con 0x7f8338073ae0 2024-09-12T02:39:56.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.134+0000 7f833f32c640 1 -- 172.21.15.60:0/1679794942 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83381f0700 con 0x7f8338073ae0 2024-09-12T02:39:56.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.136+0000 7f833f32c640 1 -- 172.21.15.60:0/1679794942 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83381f0250 con 0x7f8338073ae0 2024-09-12T02:39:56.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.136+0000 7f832dffb640 1 -- 172.21.15.60:0/1679794942 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8328007400 con 0x7f8338073ae0 2024-09-12T02:39:56.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.136+0000 7f832dffb640 1 --2- 172.21.15.60:0/1679794942 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f831c06be60 0x7f831c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:56.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.136+0000 7f833d0c8640 1 --2- 172.21.15.60:0/1679794942 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f831c06be60 0x7f831c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:56.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.136+0000 7f832dffb640 1 -- 172.21.15.60:0/1679794942 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f832808a590 con 0x7f8338073ae0 2024-09-12T02:39:56.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.136+0000 7f833d0c8640 1 --2- 172.21.15.60:0/1679794942 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f831c06be60 0x7f831c06e320 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f8334006fd0 tx=0x7f8334008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:56.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.140+0000 7f832dffb640 1 -- 172.21.15.60:0/1679794942 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f83280585e0 con 0x7f8338073ae0 2024-09-12T02:39:56.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.353+0000 7f833f32c640 1 -- 172.21.15.60:0/1679794942 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f83380695d0 con 0x7f8338073ae0 2024-09-12T02:39:56.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.353+0000 7f832dffb640 1 -- 172.21.15.60:0/1679794942 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+6524 (secure 0 0 0) 0x7f83380695d0 con 0x7f8338073ae0 2024-09-12T02:39:56.354 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:39:56.354 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":11,"btime":"2024-09-12T02:23:19:846521+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3208837169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3208837169},{"type":"v1","addr":"172.21.15.60:6836","nonce":3208837169}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/664538827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":664538827},{"type":"v1","addr":"172.21.15.60:6837","nonce":664538827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:23:04.113913+0000","modified":"2024-09-12T02:23:07.140885+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/2854563525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2854563525},{"type":"v1","addr":"172.21.15.105:6835","nonce":2854563525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1},{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:23:16.184151+0000","modified":"2024-09-12T02:23:19.195177+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"d","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6834/248466084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":248466084},{"type":"v1","addr":"172.21.15.105:6834","nonce":248466084}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":2}]} 2024-09-12T02:39:56.354 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 11 2024-09-12T02:39:56.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.355+0000 7f833f32c640 1 -- 172.21.15.60:0/1679794942 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f831c06be60 msgr2=0x7f831c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:56.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.355+0000 7f833f32c640 1 --2- 172.21.15.60:0/1679794942 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f831c06be60 0x7f831c06e320 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f8334006fd0 tx=0x7f8334008040 comp rx=0 tx=0).stop 2024-09-12T02:39:56.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.355+0000 7f833f32c640 1 -- 172.21.15.60:0/1679794942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8338073ae0 msgr2=0x7f83381ec670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:56.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.355+0000 7f833f32c640 1 --2- 172.21.15.60:0/1679794942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8338073ae0 0x7f83381ec670 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f832800c3a0 tx=0x7f832800c860 comp rx=0 tx=0).stop 2024-09-12T02:39:56.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.355+0000 7f833f32c640 1 -- 172.21.15.60:0/1679794942 shutdown_connections 2024-09-12T02:39:56.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.355+0000 7f833f32c640 1 --2- 172.21.15.60:0/1679794942 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f831c06be60 0x7f831c06e320 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:56.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.355+0000 7f833f32c640 1 --2- 172.21.15.60:0/1679794942 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8338156f50 0x7f83381ecbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:56.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.355+0000 7f833f32c640 1 --2- 172.21.15.60:0/1679794942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8338073ae0 0x7f83381ec670 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:56.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.355+0000 7f833f32c640 1 --2- 172.21.15.60:0/1679794942 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83380733d0 0x7f83380c7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:56.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.355+0000 7f833f32c640 1 -- 172.21.15.60:0/1679794942 >> 172.21.15.60:0/1679794942 conn(0x7f83380c9d80 msgr2=0x7f8338152580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:56.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.355+0000 7f833f32c640 1 -- 172.21.15.60:0/1679794942 shutdown_connections 2024-09-12T02:39:56.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.355+0000 7f833f32c640 1 -- 172.21.15.60:0/1679794942 wait complete. 2024-09-12T02:39:56.367 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-12T02:39:56.367 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-12T02:39:56.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.469+0000 7f3f78265640 1 Processor -- start 2024-09-12T02:39:56.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.470+0000 7f3f78265640 1 -- start start 2024-09-12T02:39:56.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.470+0000 7f3f78265640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f7015a3e0 0x7f3f70156d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:56.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.470+0000 7f3f78265640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f70157f10 con 0x7f3f700c7a90 2024-09-12T02:39:56.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.470+0000 7f3f78265640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f7006c5b0 con 0x7f3f700cc2d0 2024-09-12T02:39:56.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.470+0000 7f3f78265640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3f7006c890 con 0x7f3f7015a3e0 2024-09-12T02:39:56.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.471+0000 7f3f76802640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f3f700c7a90 0x7f3f70160c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:35732/0 (socket says 172.21.15.60:35732) 2024-09-12T02:39:56.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.471+0000 7f3f75800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f7015a3e0 0x7f3f70156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:56.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.471+0000 7f3f76802640 1 -- 172.21.15.60:0/2025389565 learned_addr learned my addr 172.21.15.60:0/2025389565 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:39:56.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.471+0000 7f3f74fff640 1 -- 172.21.15.60:0/2025389565 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3831657449 0 0) 0x7f3f70157f10 con 0x7f3f700c7a90 2024-09-12T02:39:56.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.471+0000 7f3f74fff640 1 -- 172.21.15.60:0/2025389565 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f58003520 con 0x7f3f700c7a90 2024-09-12T02:39:56.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.471+0000 7f3f75800640 1 -- 172.21.15.60:0/2025389565 >> v1:172.21.15.105:6789/0 conn(0x7f3f700cc2d0 legacy=0x7f3f70157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:56.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.471+0000 7f3f74fff640 1 -- 172.21.15.60:0/2025389565 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3155861491 0 0) 0x7f3f7006c5b0 con 0x7f3f700cc2d0 2024-09-12T02:39:56.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.471+0000 7f3f75800640 1 -- 172.21.15.60:0/2025389565 >> v1:172.21.15.60:6789/0 conn(0x7f3f700c7a90 legacy=0x7f3f70160c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:56.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.471+0000 7f3f75800640 1 -- 172.21.15.60:0/2025389565 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f70159900 con 0x7f3f7015a3e0 2024-09-12T02:39:56.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.472+0000 7f3f75800640 1 --2- 172.21.15.60:0/2025389565 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f7015a3e0 0x7f3f70156d90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3f640097d0 tx=0x7f3f6402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af93aa40d0d13b14 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:56.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.472+0000 7f3f74fff640 1 -- 172.21.15.60:0/2025389565 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f64037070 con 0x7f3f7015a3e0 2024-09-12T02:39:56.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.472+0000 7f3f74fff640 1 -- 172.21.15.60:0/2025389565 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f64032440 con 0x7f3f7015a3e0 2024-09-12T02:39:56.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.472+0000 7f3f74fff640 1 -- 172.21.15.60:0/2025389565 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f64032810 con 0x7f3f7015a3e0 2024-09-12T02:39:56.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.473+0000 7f3f78265640 1 -- 172.21.15.60:0/2025389565 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f7015a3e0 msgr2=0x7f3f70156d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:56.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.473+0000 7f3f78265640 1 --2- 172.21.15.60:0/2025389565 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f7015a3e0 0x7f3f70156d90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3f640097d0 tx=0x7f3f6402a210 comp rx=0 tx=0).stop 2024-09-12T02:39:56.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.473+0000 7f3f78265640 1 -- 172.21.15.60:0/2025389565 shutdown_connections 2024-09-12T02:39:56.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.473+0000 7f3f78265640 1 --2- 172.21.15.60:0/2025389565 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f7015a3e0 0x7f3f70156d90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:56.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.473+0000 7f3f78265640 1 -- 172.21.15.60:0/2025389565 >> 172.21.15.60:0/2025389565 conn(0x7f3f70067fe0 msgr2=0x7f3f70073310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:56.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.473+0000 7f3f78265640 1 -- 172.21.15.60:0/2025389565 shutdown_connections 2024-09-12T02:39:56.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.473+0000 7f3f78265640 1 -- 172.21.15.60:0/2025389565 wait complete. 2024-09-12T02:39:56.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.474+0000 7f3f78265640 1 Processor -- start 2024-09-12T02:39:56.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.474+0000 7f3f78265640 1 -- start start 2024-09-12T02:39:56.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.475+0000 7f3f78265640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f700c7a90 0x7f3f701e1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:56.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.475+0000 7f3f78265640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f700cc2d0 0x7f3f70155190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:56.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.475+0000 7f3f78265640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f7015a3e0 0x7f3f701e2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:56.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.475+0000 7f3f78265640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3f7006d2c0 con 0x7f3f7015a3e0 2024-09-12T02:39:56.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.475+0000 7f3f78265640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3f70159ec0 con 0x7f3f700c7a90 2024-09-12T02:39:56.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.475+0000 7f3f78265640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3f7006c1d0 con 0x7f3f700cc2d0 2024-09-12T02:39:56.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.475+0000 7f3f76802640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f7015a3e0 0x7f3f701e2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:56.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.475+0000 7f3f76802640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f7015a3e0 0x7f3f701e2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53706/0 (socket says 172.21.15.60:53706) 2024-09-12T02:39:56.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.475+0000 7f3f75800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f700cc2d0 0x7f3f70155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:56.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.475+0000 7f3f76802640 1 -- 172.21.15.60:0/3313665932 learned_addr learned my addr 172.21.15.60:0/3313665932 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:39:56.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.475+0000 7f3f76001640 1 --2- 172.21.15.60:0/3313665932 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f700c7a90 0x7f3f701e1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:56.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.475+0000 7f3f76802640 1 -- 172.21.15.60:0/3313665932 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f700cc2d0 msgr2=0x7f3f70155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:56.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.475+0000 7f3f76802640 1 --2- 172.21.15.60:0/3313665932 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f700cc2d0 0x7f3f70155190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:56.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.475+0000 7f3f76802640 1 -- 172.21.15.60:0/3313665932 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f700c7a90 msgr2=0x7f3f701e1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:56.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.475+0000 7f3f76802640 1 --2- 172.21.15.60:0/3313665932 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f700c7a90 0x7f3f701e1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:56.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.475+0000 7f3f76802640 1 -- 172.21.15.60:0/3313665932 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f701eb840 con 0x7f3f7015a3e0 2024-09-12T02:39:56.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.475+0000 7f3f76001640 1 --2- 172.21.15.60:0/3313665932 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f700c7a90 0x7f3f701e1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:39:56.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.475+0000 7f3f76802640 1 --2- 172.21.15.60:0/3313665932 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f7015a3e0 0x7f3f701e2470 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3f6000cb40 tx=0x7f3f6000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:56.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.476+0000 7f3f6e7fc640 1 -- 172.21.15.60:0/3313665932 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f60017070 con 0x7f3f7015a3e0 2024-09-12T02:39:56.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.476+0000 7f3f6e7fc640 1 -- 172.21.15.60:0/3313665932 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f6000aca0 con 0x7f3f7015a3e0 2024-09-12T02:39:56.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.476+0000 7f3f78265640 1 -- 172.21.15.60:0/3313665932 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f701ebb20 con 0x7f3f7015a3e0 2024-09-12T02:39:56.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.476+0000 7f3f6e7fc640 1 -- 172.21.15.60:0/3313665932 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f60012620 con 0x7f3f7015a3e0 2024-09-12T02:39:56.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.476+0000 7f3f78265640 1 -- 172.21.15.60:0/3313665932 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f701ec0e0 con 0x7f3f7015a3e0 2024-09-12T02:39:56.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.477+0000 7f3f78265640 1 -- 172.21.15.60:0/3313665932 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f700c7f20 con 0x7f3f7015a3e0 2024-09-12T02:39:56.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.477+0000 7f3f6e7fc640 1 -- 172.21.15.60:0/3313665932 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3f6001a070 con 0x7f3f7015a3e0 2024-09-12T02:39:56.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.477+0000 7f3f6e7fc640 1 --2- 172.21.15.60:0/3313665932 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3f5c06be30 0x7f3f5c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:56.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.478+0000 7f3f6e7fc640 1 -- 172.21.15.60:0/3313665932 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f3f6008afc0 con 0x7f3f7015a3e0 2024-09-12T02:39:56.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.478+0000 7f3f76001640 1 --2- 172.21.15.60:0/3313665932 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3f5c06be30 0x7f3f5c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:56.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.478+0000 7f3f76001640 1 --2- 172.21.15.60:0/3313665932 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3f5c06be30 0x7f3f5c06e2f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3f68000f60 tx=0x7f3f68009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:56.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.482+0000 7f3f6e7fc640 1 -- 172.21.15.60:0/3313665932 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3f60058f90 con 0x7f3f7015a3e0 2024-09-12T02:39:56.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.728+0000 7f3f78265640 1 -- 172.21.15.60:0/3313665932 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3f700b11f0 con 0x7f3f7015a3e0 2024-09-12T02:39:56.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.728+0000 7f3f6e7fc640 1 -- 172.21.15.60:0/3313665932 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1566 (secure 0 0 0) 0x7f3f6005d290 con 0x7f3f7015a3e0 2024-09-12T02:39:56.729 INFO:teuthology.orchestra.run.smithi060.stdout:{"election_epoch":158,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","modified":"2024-09-12T02:21:57.514264Z","created":"2024-09-12T02:21:57.514264Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3301","nonce":0},{"type":"v1","addr":"172.21.15.105:6790","nonce":0}]},"addr":"172.21.15.105:6790/0","public_addr":"172.21.15.105:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-12T02:39:56.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.730+0000 7f3f78265640 1 -- 172.21.15.60:0/3313665932 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3f5c06be30 msgr2=0x7f3f5c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:56.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.730+0000 7f3f78265640 1 --2- 172.21.15.60:0/3313665932 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3f5c06be30 0x7f3f5c06e2f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3f68000f60 tx=0x7f3f68009040 comp rx=0 tx=0).stop 2024-09-12T02:39:56.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.730+0000 7f3f78265640 1 -- 172.21.15.60:0/3313665932 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f7015a3e0 msgr2=0x7f3f701e2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:56.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.730+0000 7f3f78265640 1 --2- 172.21.15.60:0/3313665932 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f7015a3e0 0x7f3f701e2470 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3f6000cb40 tx=0x7f3f6000a060 comp rx=0 tx=0).stop 2024-09-12T02:39:56.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.731+0000 7f3f78265640 1 -- 172.21.15.60:0/3313665932 shutdown_connections 2024-09-12T02:39:56.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.731+0000 7f3f78265640 1 --2- 172.21.15.60:0/3313665932 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3f5c06be30 0x7f3f5c06e2f0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:56.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.731+0000 7f3f78265640 1 --2- 172.21.15.60:0/3313665932 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f7015a3e0 0x7f3f701e2470 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:56.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.731+0000 7f3f78265640 1 --2- 172.21.15.60:0/3313665932 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f700cc2d0 0x7f3f70155190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:56.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.731+0000 7f3f78265640 1 --2- 172.21.15.60:0/3313665932 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f700c7a90 0x7f3f701e1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:56.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.731+0000 7f3f78265640 1 -- 172.21.15.60:0/3313665932 >> 172.21.15.60:0/3313665932 conn(0x7f3f70067fe0 msgr2=0x7f3f70073310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:56.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.731+0000 7f3f78265640 1 -- 172.21.15.60:0/3313665932 shutdown_connections 2024-09-12T02:39:56.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.731+0000 7f3f78265640 1 -- 172.21.15.60:0/3313665932 wait complete. 2024-09-12T02:39:56.742 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-12T02:39:56.743 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-12T02:39:56.753 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-12T02:39:56.753 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T02:39:56.753 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:39:56.772 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T02:39:56.772 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:39:56.829 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:39:56.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.974+0000 7f14181d6640 1 Processor -- start 2024-09-12T02:39:56.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.974+0000 7f14181d6640 1 -- start start 2024-09-12T02:39:56.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.975+0000 7f14181d6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14100733d0 0x7f1410156840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:56.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.975+0000 7f14181d6640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f141006dd50 con 0x7f1410073ae0 2024-09-12T02:39:56.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.975+0000 7f14181d6640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f141006e030 con 0x7f141006d850 2024-09-12T02:39:56.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.975+0000 7f14181d6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f141006e310 con 0x7f14100733d0 2024-09-12T02:39:56.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.975+0000 7f1415f72640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f1410073ae0 0x7f1410153380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:35742/0 (socket says 172.21.15.60:35742) 2024-09-12T02:39:56.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.975+0000 7f1415f72640 1 -- 172.21.15.60:0/2851487873 learned_addr learned my addr 172.21.15.60:0/2851487873 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:39:56.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.975+0000 7f1415771640 1 --2- 172.21.15.60:0/2851487873 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14100733d0 0x7f1410156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:56.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.975+0000 7f1414f70640 1 -- 172.21.15.60:0/2851487873 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1387469139 0 0) 0x7f141006dd50 con 0x7f1410073ae0 2024-09-12T02:39:56.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.975+0000 7f1414f70640 1 -- 172.21.15.60:0/2851487873 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13f8003520 con 0x7f1410073ae0 2024-09-12T02:39:56.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.975+0000 7f1414f70640 1 -- 172.21.15.60:0/2851487873 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 426150988 0 0) 0x7f141006e030 con 0x7f141006d850 2024-09-12T02:39:56.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.975+0000 7f1414f70640 1 -- 172.21.15.60:0/2851487873 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f141006dd50 con 0x7f141006d850 2024-09-12T02:39:56.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.975+0000 7f1414f70640 1 -- 172.21.15.60:0/2851487873 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2064944148 0 0) 0x7f13f8003520 con 0x7f1410073ae0 2024-09-12T02:39:56.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.975+0000 7f1415771640 1 -- 172.21.15.60:0/2851487873 >> v1:172.21.15.105:6789/0 conn(0x7f141006d850 legacy=0x7f1410160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:56.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.975+0000 7f1415771640 1 -- 172.21.15.60:0/2851487873 >> v1:172.21.15.60:6789/0 conn(0x7f1410073ae0 legacy=0x7f1410153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:56.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.975+0000 7f1415771640 1 -- 172.21.15.60:0/2851487873 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f141006e5f0 con 0x7f14100733d0 2024-09-12T02:39:56.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.976+0000 7f1415771640 1 --2- 172.21.15.60:0/2851487873 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14100733d0 0x7f1410156840 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f14040097d0 tx=0x7f140402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da5779bce0985816 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:56.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.976+0000 7f1414f70640 1 -- 172.21.15.60:0/2851487873 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1404037070 con 0x7f14100733d0 2024-09-12T02:39:56.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.976+0000 7f1414f70640 1 -- 172.21.15.60:0/2851487873 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f140402ac30 con 0x7f14100733d0 2024-09-12T02:39:56.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.976+0000 7f1414f70640 1 -- 172.21.15.60:0/2851487873 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14000019f0 con 0x7f14100733d0 2024-09-12T02:39:56.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.977+0000 7f14181d6640 1 -- 172.21.15.60:0/2851487873 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14100733d0 msgr2=0x7f1410156840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:56.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.977+0000 7f14181d6640 1 --2- 172.21.15.60:0/2851487873 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14100733d0 0x7f1410156840 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f14040097d0 tx=0x7f140402a1a0 comp rx=0 tx=0).stop 2024-09-12T02:39:56.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.977+0000 7f14181d6640 1 -- 172.21.15.60:0/2851487873 shutdown_connections 2024-09-12T02:39:56.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.977+0000 7f14181d6640 1 --2- 172.21.15.60:0/2851487873 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14100733d0 0x7f1410156840 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:56.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.977+0000 7f14181d6640 1 -- 172.21.15.60:0/2851487873 >> 172.21.15.60:0/2851487873 conn(0x7f14100c9d80 msgr2=0x7f14100ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:56.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.977+0000 7f14181d6640 1 -- 172.21.15.60:0/2851487873 shutdown_connections 2024-09-12T02:39:56.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.977+0000 7f14181d6640 1 -- 172.21.15.60:0/2851487873 wait complete. 2024-09-12T02:39:56.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.978+0000 7f14181d6640 1 Processor -- start 2024-09-12T02:39:56.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.978+0000 7f14181d6640 1 -- start start 2024-09-12T02:39:56.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.979+0000 7f14181d6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f141006d850 0x7f1410141bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:56.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.979+0000 7f14181d6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14100733d0 0x7f1410154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:56.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.979+0000 7f14181d6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1410073ae0 0x7f1410155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:56.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.979+0000 7f14181d6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f141006edd0 con 0x7f1410073ae0 2024-09-12T02:39:56.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.979+0000 7f14181d6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f141006ec50 con 0x7f141006d850 2024-09-12T02:39:56.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.979+0000 7f14181d6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1410153a90 con 0x7f14100733d0 2024-09-12T02:39:56.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.979+0000 7f1416773640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1410073ae0 0x7f1410155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:56.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.979+0000 7f1416773640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1410073ae0 0x7f1410155400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53714/0 (socket says 172.21.15.60:53714) 2024-09-12T02:39:56.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.979+0000 7f1416773640 1 -- 172.21.15.60:0/1615064092 learned_addr learned my addr 172.21.15.60:0/1615064092 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:39:56.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.979+0000 7f1415771640 1 --2- 172.21.15.60:0/1615064092 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14100733d0 0x7f1410154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:56.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.979+0000 7f1415f72640 1 --2- 172.21.15.60:0/1615064092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f141006d850 0x7f1410141bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:56.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.979+0000 7f1416773640 1 -- 172.21.15.60:0/1615064092 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14100733d0 msgr2=0x7f1410154ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:56.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.979+0000 7f1416773640 1 --2- 172.21.15.60:0/1615064092 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14100733d0 0x7f1410154ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:56.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.979+0000 7f1416773640 1 -- 172.21.15.60:0/1615064092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f141006d850 msgr2=0x7f1410141bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:56.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.979+0000 7f1416773640 1 --2- 172.21.15.60:0/1615064092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f141006d850 0x7f1410141bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:56.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.979+0000 7f1416773640 1 -- 172.21.15.60:0/1615064092 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f141013c6e0 con 0x7f1410073ae0 2024-09-12T02:39:56.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.979+0000 7f1416773640 1 --2- 172.21.15.60:0/1615064092 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1410073ae0 0x7f1410155400 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f140800c400 tx=0x7f140800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:56.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.979+0000 7f140e7fc640 1 -- 172.21.15.60:0/1615064092 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1408017070 con 0x7f1410073ae0 2024-09-12T02:39:56.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.979+0000 7f140e7fc640 1 -- 172.21.15.60:0/1615064092 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14080052d0 con 0x7f1410073ae0 2024-09-12T02:39:56.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.979+0000 7f140e7fc640 1 -- 172.21.15.60:0/1615064092 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14080037f0 con 0x7f1410073ae0 2024-09-12T02:39:56.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.979+0000 7f14181d6640 1 -- 172.21.15.60:0/1615064092 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1410155a90 con 0x7f1410073ae0 2024-09-12T02:39:56.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.980+0000 7f14181d6640 1 -- 172.21.15.60:0/1615064092 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14101427a0 con 0x7f1410073ae0 2024-09-12T02:39:56.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.980+0000 7f14181d6640 1 -- 172.21.15.60:0/1615064092 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1410073ec0 con 0x7f1410073ae0 2024-09-12T02:39:56.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.981+0000 7f140e7fc640 1 -- 172.21.15.60:0/1615064092 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f140801a070 con 0x7f1410073ae0 2024-09-12T02:39:56.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.981+0000 7f140e7fc640 1 --2- 172.21.15.60:0/1615064092 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f13fc06be60 0x7f13fc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:56.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.981+0000 7f140e7fc640 1 -- 172.21.15.60:0/1615064092 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f140808a410 con 0x7f1410073ae0 2024-09-12T02:39:56.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.981+0000 7f1415f72640 1 --2- 172.21.15.60:0/1615064092 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f13fc06be60 0x7f13fc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:56.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.982+0000 7f1415f72640 1 --2- 172.21.15.60:0/1615064092 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f13fc06be60 0x7f13fc06e320 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1400001b60 tx=0x7f1400009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:56.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:56.986+0000 7f140e7fc640 1 -- 172.21.15.60:0/1615064092 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1408058460 con 0x7f1410073ae0 2024-09-12T02:39:57.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.174+0000 7f14181d6640 1 -- 172.21.15.60:0/1615064092 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f14100c4580 con 0x7f1410073ae0 2024-09-12T02:39:57.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.174+0000 7f140e7fc640 1 -- 172.21.15.60:0/1615064092 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7f140805c760 con 0x7f1410073ae0 2024-09-12T02:39:57.175 INFO:teuthology.orchestra.run.smithi060.stderr:listed 0 entries 2024-09-12T02:39:57.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.176+0000 7f14181d6640 1 -- 172.21.15.60:0/1615064092 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f13fc06be60 msgr2=0x7f13fc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:57.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.176+0000 7f14181d6640 1 --2- 172.21.15.60:0/1615064092 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f13fc06be60 0x7f13fc06e320 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1400001b60 tx=0x7f1400009040 comp rx=0 tx=0).stop 2024-09-12T02:39:57.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.176+0000 7f14181d6640 1 -- 172.21.15.60:0/1615064092 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1410073ae0 msgr2=0x7f1410155400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:57.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.176+0000 7f14181d6640 1 --2- 172.21.15.60:0/1615064092 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1410073ae0 0x7f1410155400 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f140800c400 tx=0x7f140800c8c0 comp rx=0 tx=0).stop 2024-09-12T02:39:57.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.177+0000 7f14181d6640 1 -- 172.21.15.60:0/1615064092 shutdown_connections 2024-09-12T02:39:57.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.177+0000 7f14181d6640 1 --2- 172.21.15.60:0/1615064092 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f13fc06be60 0x7f13fc06e320 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:57.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.177+0000 7f14181d6640 1 --2- 172.21.15.60:0/1615064092 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1410073ae0 0x7f1410155400 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:57.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.177+0000 7f14181d6640 1 --2- 172.21.15.60:0/1615064092 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14100733d0 0x7f1410154ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:57.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.177+0000 7f14181d6640 1 --2- 172.21.15.60:0/1615064092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f141006d850 0x7f1410141bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:57.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.177+0000 7f14181d6640 1 -- 172.21.15.60:0/1615064092 >> 172.21.15.60:0/1615064092 conn(0x7f14100c9d80 msgr2=0x7f14100c4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:57.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.177+0000 7f14181d6640 1 -- 172.21.15.60:0/1615064092 shutdown_connections 2024-09-12T02:39:57.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.177+0000 7f14181d6640 1 -- 172.21.15.60:0/1615064092 wait complete. 2024-09-12T02:39:57.188 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T02:39:57.188 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:39:57.205 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:39:57.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.346+0000 7f9df25e4640 1 Processor -- start 2024-09-12T02:39:57.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.346+0000 7f9df25e4640 1 -- start start 2024-09-12T02:39:57.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.347+0000 7f9df25e4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9dec0c9860 0x7f9dec0c8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:57.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.347+0000 7f9df25e4640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9dec157c90 0x7f9dec0c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:57.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.347+0000 7f9df25e4640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dec0741e0 con 0x7f9dec1578b0 2024-09-12T02:39:57.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.347+0000 7f9df25e4640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f9dec073f90 con 0x7f9dec0c9860 2024-09-12T02:39:57.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.347+0000 7f9df25e4640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f9dec158280 con 0x7f9dec157c90 2024-09-12T02:39:57.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.347+0000 7f9deb7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9dec0c9860 0x7f9dec0c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:57.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.347+0000 7f9deb7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9dec0c9860 0x7f9dec0c8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53730/0 (socket says 172.21.15.60:53730) 2024-09-12T02:39:57.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.347+0000 7f9deb7fe640 1 -- 172.21.15.60:0/3815236811 learned_addr learned my addr 172.21.15.60:0/3815236811 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:39:57.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.347+0000 7f9df0b81640 1 --2- 172.21.15.60:0/3815236811 >> v2:172.21.15.105:3300/0 conn(0x7f9dec157c90 0x7f9dec0c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:57.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.347+0000 7f9deb7fe640 1 -- 172.21.15.60:0/3815236811 >> v2:172.21.15.105:3300/0 conn(0x7f9dec157c90 msgr2=0x7f9dec0c8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:39:57.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.347+0000 7f9deb7fe640 1 --2- 172.21.15.60:0/3815236811 >> v2:172.21.15.105:3300/0 conn(0x7f9dec157c90 0x7f9dec0c8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:57.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.347+0000 7f9deb7fe640 1 -- 172.21.15.60:0/3815236811 >> v1:172.21.15.105:6789/0 conn(0x7f9dec1578b0 legacy=0x7f9dec1513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:57.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.347+0000 7f9deb7fe640 1 -- 172.21.15.60:0/3815236811 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dec0c4820 con 0x7f9dec0c9860 2024-09-12T02:39:57.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.348+0000 7f9deb7fe640 1 --2- 172.21.15.60:0/3815236811 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9dec0c9860 0x7f9dec0c8840 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9dec06cc80 tx=0x7f9de002a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df1527becf77af87 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:57.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.348+0000 7f9deaffd640 1 -- 172.21.15.60:0/3815236811 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de0037070 con 0x7f9dec0c9860 2024-09-12T02:39:57.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.348+0000 7f9deaffd640 1 -- 172.21.15.60:0/3815236811 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9de0032440 con 0x7f9dec0c9860 2024-09-12T02:39:57.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.348+0000 7f9deaffd640 1 -- 172.21.15.60:0/3815236811 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de0032810 con 0x7f9dec0c9860 2024-09-12T02:39:57.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.349+0000 7f9df25e4640 1 -- 172.21.15.60:0/3815236811 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9dec0c9860 msgr2=0x7f9dec0c8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:57.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.349+0000 7f9df25e4640 1 --2- 172.21.15.60:0/3815236811 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9dec0c9860 0x7f9dec0c8840 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9dec06cc80 tx=0x7f9de002a160 comp rx=0 tx=0).stop 2024-09-12T02:39:57.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.349+0000 7f9df25e4640 1 -- 172.21.15.60:0/3815236811 shutdown_connections 2024-09-12T02:39:57.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.349+0000 7f9df25e4640 1 --2- 172.21.15.60:0/3815236811 >> v2:172.21.15.105:3300/0 conn(0x7f9dec157c90 0x7f9dec0c8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:57.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.349+0000 7f9df25e4640 1 --2- 172.21.15.60:0/3815236811 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9dec0c9860 0x7f9dec0c8840 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:57.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.349+0000 7f9df25e4640 1 -- 172.21.15.60:0/3815236811 >> 172.21.15.60:0/3815236811 conn(0x7f9dec0c6880 msgr2=0x7f9dec0c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:57.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.349+0000 7f9df25e4640 1 -- 172.21.15.60:0/3815236811 shutdown_connections 2024-09-12T02:39:57.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.349+0000 7f9df25e4640 1 -- 172.21.15.60:0/3815236811 wait complete. 2024-09-12T02:39:57.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.350+0000 7f9df25e4640 1 Processor -- start 2024-09-12T02:39:57.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.350+0000 7f9df25e4640 1 -- start start 2024-09-12T02:39:57.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.351+0000 7f9df25e4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9dec0c9860 0x7f9dec14cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:57.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.351+0000 7f9df25e4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9dec1578b0 0x7f9dec143650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:57.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.351+0000 7f9df25e4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9dec157c90 0x7f9dec143b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:57.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.351+0000 7f9df25e4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9dec0afeb0 con 0x7f9dec157c90 2024-09-12T02:39:57.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.351+0000 7f9df25e4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9dec0afd30 con 0x7f9dec1578b0 2024-09-12T02:39:57.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.351+0000 7f9df25e4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9dec0c7550 con 0x7f9dec0c9860 2024-09-12T02:39:57.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.351+0000 7f9df0b81640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9dec157c90 0x7f9dec143b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:57.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.351+0000 7f9df0b81640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9dec157c90 0x7f9dec143b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53740/0 (socket says 172.21.15.60:53740) 2024-09-12T02:39:57.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.351+0000 7f9df0b81640 1 -- 172.21.15.60:0/1581237181 learned_addr learned my addr 172.21.15.60:0/1581237181 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:39:57.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.351+0000 7f9deb7fe640 1 --2- 172.21.15.60:0/1581237181 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9dec1578b0 0x7f9dec143650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:57.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.351+0000 7f9debfff640 1 --2- 172.21.15.60:0/1581237181 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9dec0c9860 0x7f9dec14cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:57.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.351+0000 7f9df0b81640 1 -- 172.21.15.60:0/1581237181 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9dec0c9860 msgr2=0x7f9dec14cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:57.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.351+0000 7f9df0b81640 1 --2- 172.21.15.60:0/1581237181 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9dec0c9860 0x7f9dec14cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:57.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.351+0000 7f9df0b81640 1 -- 172.21.15.60:0/1581237181 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9dec1578b0 msgr2=0x7f9dec143650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:57.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.351+0000 7f9df0b81640 1 --2- 172.21.15.60:0/1581237181 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9dec1578b0 0x7f9dec143650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:57.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.351+0000 7f9df0b81640 1 -- 172.21.15.60:0/1581237181 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dec1ee2b0 con 0x7f9dec157c90 2024-09-12T02:39:57.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.352+0000 7f9df0b81640 1 --2- 172.21.15.60:0/1581237181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9dec157c90 0x7f9dec143b90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9de4007e90 tx=0x7f9de400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:57.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.352+0000 7f9de8ff9640 1 -- 172.21.15.60:0/1581237181 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de4014420 con 0x7f9dec157c90 2024-09-12T02:39:57.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.352+0000 7f9de8ff9640 1 -- 172.21.15.60:0/1581237181 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9de4019070 con 0x7f9dec157c90 2024-09-12T02:39:57.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.352+0000 7f9df25e4640 1 -- 172.21.15.60:0/1581237181 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dec0af4a0 con 0x7f9dec157c90 2024-09-12T02:39:57.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.352+0000 7f9de8ff9640 1 -- 172.21.15.60:0/1581237181 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de4014800 con 0x7f9dec157c90 2024-09-12T02:39:57.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.352+0000 7f9df25e4640 1 -- 172.21.15.60:0/1581237181 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dec0acc40 con 0x7f9dec157c90 2024-09-12T02:39:57.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.353+0000 7f9df25e4640 1 -- 172.21.15.60:0/1581237181 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dec0b0110 con 0x7f9dec157c90 2024-09-12T02:39:57.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.353+0000 7f9de8ff9640 1 -- 172.21.15.60:0/1581237181 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9de40149a0 con 0x7f9dec157c90 2024-09-12T02:39:57.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.354+0000 7f9de8ff9640 1 --2- 172.21.15.60:0/1581237181 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9dd806be30 0x7f9dd806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:39:57.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.354+0000 7f9debfff640 1 --2- 172.21.15.60:0/1581237181 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9dd806be30 0x7f9dd806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:39:57.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.354+0000 7f9de8ff9640 1 -- 172.21.15.60:0/1581237181 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f9de408b890 con 0x7f9dec157c90 2024-09-12T02:39:57.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.354+0000 7f9debfff640 1 --2- 172.21.15.60:0/1581237181 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9dd806be30 0x7f9dd806e2f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc001780 tx=0x7f9ddc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:39:57.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.358+0000 7f9de8ff9640 1 -- 172.21.15.60:0/1581237181 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9dec0b0110 con 0x7f9dec157c90 2024-09-12T02:39:57.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.546+0000 7f9df25e4640 1 -- 172.21.15.60:0/1581237181 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9dec0ace40 con 0x7f9dec157c90 2024-09-12T02:39:57.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.546+0000 7f9de8ff9640 1 -- 172.21.15.60:0/1581237181 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7f9dec0ace40 con 0x7f9dec157c90 2024-09-12T02:39:57.547 INFO:teuthology.orchestra.run.smithi060.stderr:listed 0 entries 2024-09-12T02:39:57.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.548+0000 7f9df25e4640 1 -- 172.21.15.60:0/1581237181 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9dd806be30 msgr2=0x7f9dd806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:57.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.548+0000 7f9df25e4640 1 --2- 172.21.15.60:0/1581237181 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9dd806be30 0x7f9dd806e2f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc001780 tx=0x7f9ddc009040 comp rx=0 tx=0).stop 2024-09-12T02:39:57.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.548+0000 7f9df25e4640 1 -- 172.21.15.60:0/1581237181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9dec157c90 msgr2=0x7f9dec143b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:39:57.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.548+0000 7f9df25e4640 1 --2- 172.21.15.60:0/1581237181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9dec157c90 0x7f9dec143b90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9de4007e90 tx=0x7f9de400e4b0 comp rx=0 tx=0).stop 2024-09-12T02:39:57.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.548+0000 7f9df25e4640 1 -- 172.21.15.60:0/1581237181 shutdown_connections 2024-09-12T02:39:57.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.548+0000 7f9df25e4640 1 --2- 172.21.15.60:0/1581237181 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9dd806be30 0x7f9dd806e2f0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:57.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.548+0000 7f9df25e4640 1 --2- 172.21.15.60:0/1581237181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9dec157c90 0x7f9dec143b90 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:57.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.548+0000 7f9df25e4640 1 --2- 172.21.15.60:0/1581237181 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9dec1578b0 0x7f9dec143650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:57.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.548+0000 7f9df25e4640 1 --2- 172.21.15.60:0/1581237181 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9dec0c9860 0x7f9dec14cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:39:57.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.548+0000 7f9df25e4640 1 -- 172.21.15.60:0/1581237181 >> 172.21.15.60:0/1581237181 conn(0x7f9dec0c6880 msgr2=0x7f9dec0c4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:39:57.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.548+0000 7f9df25e4640 1 -- 172.21.15.60:0/1581237181 shutdown_connections 2024-09-12T02:39:57.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:39:57.548+0000 7f9df25e4640 1 -- 172.21.15.60:0/1581237181 wait complete. 2024-09-12T02:39:57.560 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi060.front.sepia.ceph.com... 2024-09-12T02:39:57.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:39:57.560 DEBUG:teuthology.orchestra.run.smithi060:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-12T02:39:57.596 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:39:57.601 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi060.stderr:ceph-fuse[45340]: fuse finished with error 0 and tester_r 0 2024-09-12T02:40:02.679 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:40:02.683 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:40:03.697 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi060.front.sepia.ceph.com 2024-09-12T02:40:03.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:40:03.698 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:40:03.718 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T02:40:03.718 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:40:03.744 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T02:40:03.744 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:40:03.804 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:40:03.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.919+0000 7f9624386640 1 Processor -- start 2024-09-12T02:40:03.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.919+0000 7f9624386640 1 -- start start 2024-09-12T02:40:03.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.920+0000 7f9624386640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f961c153d60 0x7f961c0c5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:03.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.920+0000 7f9624386640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f961c0c5aa0 0x7f961c0709d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:03.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.920+0000 7f9624386640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f961c0c4320 con 0x7f961c0c5660 2024-09-12T02:40:03.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.920+0000 7f9624386640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f961c0c4c90 con 0x7f961c0c5aa0 2024-09-12T02:40:03.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.920+0000 7f9624386640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f961c156f20 con 0x7f961c153d60 2024-09-12T02:40:03.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.921+0000 7f9621921640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f961c0c5660 0x7f961c0702c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41908/0 (socket says 172.21.15.60:41908) 2024-09-12T02:40:03.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.921+0000 7f9621921640 1 -- 172.21.15.60:0/2759400597 learned_addr learned my addr 172.21.15.60:0/2759400597 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:40:03.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.921+0000 7f9622122640 1 --2- 172.21.15.60:0/2759400597 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f961c153d60 0x7f961c0c5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:03.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.921+0000 7f9622923640 1 --2- 172.21.15.60:0/2759400597 >> v2:172.21.15.105:3300/0 conn(0x7f961c0c5aa0 0x7f961c0709d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:03.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.921+0000 7f9621120640 1 -- 172.21.15.60:0/2759400597 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2629632693 0 0) 0x7f960c001110 con 0x7f961c0c5660 2024-09-12T02:40:03.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.921+0000 7f9621120640 1 -- 172.21.15.60:0/2759400597 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9608003520 con 0x7f961c0c5660 2024-09-12T02:40:03.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.921+0000 7f9622122640 1 -- 172.21.15.60:0/2759400597 >> v2:172.21.15.105:3300/0 conn(0x7f961c0c5aa0 msgr2=0x7f961c0709d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:03.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.921+0000 7f9621120640 1 -- 172.21.15.60:0/2759400597 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3696503985 0 0) 0x7f9608003520 con 0x7f961c0c5660 2024-09-12T02:40:03.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.921+0000 7f9622122640 1 --2- 172.21.15.60:0/2759400597 >> v2:172.21.15.105:3300/0 conn(0x7f961c0c5aa0 0x7f961c0709d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:03.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.921+0000 7f9622122640 1 -- 172.21.15.60:0/2759400597 >> v1:172.21.15.60:6789/0 conn(0x7f961c0c5660 legacy=0x7f961c0702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:03.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.921+0000 7f9622122640 1 -- 172.21.15.60:0/2759400597 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f961c157200 con 0x7f961c153d60 2024-09-12T02:40:03.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.921+0000 7f9622923640 1 --2- 172.21.15.60:0/2759400597 >> v2:172.21.15.105:3300/0 conn(0x7f961c0c5aa0 0x7f961c0709d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:40:03.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.922+0000 7f9622122640 1 --2- 172.21.15.60:0/2759400597 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f961c153d60 0x7f961c0c5120 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f96180097a0 tx=0x7f961802a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee9f8cfc9f47bd64 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:03.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.922+0000 7f9621120640 1 -- 172.21.15.60:0/2759400597 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9618037070 con 0x7f961c153d60 2024-09-12T02:40:03.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.922+0000 7f9621120640 1 -- 172.21.15.60:0/2759400597 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f961802aba0 con 0x7f961c153d60 2024-09-12T02:40:03.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.922+0000 7f9621120640 1 -- 172.21.15.60:0/2759400597 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f960c001840 con 0x7f961c153d60 2024-09-12T02:40:03.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.923+0000 7f9624386640 1 -- 172.21.15.60:0/2759400597 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f961c153d60 msgr2=0x7f961c0c5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:03.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.923+0000 7f9624386640 1 --2- 172.21.15.60:0/2759400597 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f961c153d60 0x7f961c0c5120 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f96180097a0 tx=0x7f961802a110 comp rx=0 tx=0).stop 2024-09-12T02:40:03.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.923+0000 7f9624386640 1 -- 172.21.15.60:0/2759400597 shutdown_connections 2024-09-12T02:40:03.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.923+0000 7f9624386640 1 --2- 172.21.15.60:0/2759400597 >> v2:172.21.15.105:3300/0 conn(0x7f961c0c5aa0 0x7f961c0709d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:03.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.923+0000 7f9624386640 1 --2- 172.21.15.60:0/2759400597 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f961c153d60 0x7f961c0c5120 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:03.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.923+0000 7f9624386640 1 -- 172.21.15.60:0/2759400597 >> 172.21.15.60:0/2759400597 conn(0x7f961c0c6980 msgr2=0x7f961c0c6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:03.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.923+0000 7f9624386640 1 -- 172.21.15.60:0/2759400597 shutdown_connections 2024-09-12T02:40:03.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.923+0000 7f9624386640 1 -- 172.21.15.60:0/2759400597 wait complete. 2024-09-12T02:40:03.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.924+0000 7f9624386640 1 Processor -- start 2024-09-12T02:40:03.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.924+0000 7f9624386640 1 -- start start 2024-09-12T02:40:03.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.925+0000 7f9624386640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f961c0c5660 0x7f961c0c9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:03.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.925+0000 7f9624386640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f961c0c5aa0 0x7f961c1efd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:03.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.925+0000 7f9624386640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f961c153d60 0x7f961c1f0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:03.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.925+0000 7f9624386640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f961c073ca0 con 0x7f961c0c5aa0 2024-09-12T02:40:03.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.925+0000 7f9624386640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f961c070f10 con 0x7f961c0c5660 2024-09-12T02:40:03.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.925+0000 7f9624386640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f961c073e20 con 0x7f961c153d60 2024-09-12T02:40:03.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.925+0000 7f9621921640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f961c0c5aa0 0x7f961c1efd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:03.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.925+0000 7f9621921640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f961c0c5aa0 0x7f961c1efd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41618/0 (socket says 172.21.15.60:41618) 2024-09-12T02:40:03.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.925+0000 7f9621921640 1 -- 172.21.15.60:0/1921001598 learned_addr learned my addr 172.21.15.60:0/1921001598 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:03.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.925+0000 7f9622923640 1 --2- 172.21.15.60:0/1921001598 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f961c153d60 0x7f961c1f0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:03.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.925+0000 7f9622122640 1 --2- 172.21.15.60:0/1921001598 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f961c0c5660 0x7f961c0c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:03.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.926+0000 7f9621921640 1 -- 172.21.15.60:0/1921001598 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f961c153d60 msgr2=0x7f961c1f0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:03.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.926+0000 7f9621921640 1 --2- 172.21.15.60:0/1921001598 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f961c153d60 0x7f961c1f0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:03.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.926+0000 7f9621921640 1 -- 172.21.15.60:0/1921001598 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f961c0c5660 msgr2=0x7f961c0c9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:03.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.926+0000 7f9621921640 1 --2- 172.21.15.60:0/1921001598 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f961c0c5660 0x7f961c0c9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:03.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.926+0000 7f9621921640 1 -- 172.21.15.60:0/1921001598 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f961c155760 con 0x7f961c0c5aa0 2024-09-12T02:40:03.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.926+0000 7f9621921640 1 --2- 172.21.15.60:0/1921001598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f961c0c5aa0 0x7f961c1efd00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f960c00c780 tx=0x7f960c00cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:03.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.926+0000 7f9612ffd640 1 -- 172.21.15.60:0/1921001598 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f960c017070 con 0x7f961c0c5aa0 2024-09-12T02:40:03.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.926+0000 7f9612ffd640 1 -- 172.21.15.60:0/1921001598 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f960c005ad0 con 0x7f961c0c5aa0 2024-09-12T02:40:03.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.926+0000 7f9624386640 1 -- 172.21.15.60:0/1921001598 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f961c1e2450 con 0x7f961c0c5aa0 2024-09-12T02:40:03.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.926+0000 7f9612ffd640 1 -- 172.21.15.60:0/1921001598 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f960c007070 con 0x7f961c0c5aa0 2024-09-12T02:40:03.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.926+0000 7f9624386640 1 -- 172.21.15.60:0/1921001598 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f961c0c95b0 con 0x7f961c0c5aa0 2024-09-12T02:40:03.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.927+0000 7f9624386640 1 -- 172.21.15.60:0/1921001598 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f961c1ef9d0 con 0x7f961c0c5aa0 2024-09-12T02:40:03.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.928+0000 7f9612ffd640 1 -- 172.21.15.60:0/1921001598 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f960c01a070 con 0x7f961c0c5aa0 2024-09-12T02:40:03.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.928+0000 7f9612ffd640 1 --2- 172.21.15.60:0/1921001598 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f960006be30 0x7f960006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:03.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.928+0000 7f9612ffd640 1 -- 172.21.15.60:0/1921001598 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f960c08a490 con 0x7f961c0c5aa0 2024-09-12T02:40:03.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.928+0000 7f9622122640 1 --2- 172.21.15.60:0/1921001598 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f960006be30 0x7f960006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:03.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.929+0000 7f9622122640 1 --2- 172.21.15.60:0/1921001598 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f960006be30 0x7f960006e2f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f9618034000 tx=0x7f961802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:03.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:03.933+0000 7f9612ffd640 1 -- 172.21.15.60:0/1921001598 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f961c0c4320 con 0x7f961c0c5aa0 2024-09-12T02:40:04.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.123+0000 7f9624386640 1 -- 172.21.15.60:0/1921001598 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f961c0c7690 con 0x7f961c0c5aa0 2024-09-12T02:40:04.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.123+0000 7f9612ffd640 1 -- 172.21.15.60:0/1921001598 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7f960c058460 con 0x7f961c0c5aa0 2024-09-12T02:40:04.124 INFO:teuthology.orchestra.run.smithi060.stderr:listed 0 entries 2024-09-12T02:40:04.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.125+0000 7f9624386640 1 -- 172.21.15.60:0/1921001598 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f960006be30 msgr2=0x7f960006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:04.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.125+0000 7f9624386640 1 --2- 172.21.15.60:0/1921001598 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f960006be30 0x7f960006e2f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f9618034000 tx=0x7f961802e000 comp rx=0 tx=0).stop 2024-09-12T02:40:04.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.125+0000 7f9624386640 1 -- 172.21.15.60:0/1921001598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f961c0c5aa0 msgr2=0x7f961c1efd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:04.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.125+0000 7f9624386640 1 --2- 172.21.15.60:0/1921001598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f961c0c5aa0 0x7f961c1efd00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f960c00c780 tx=0x7f960c00cb80 comp rx=0 tx=0).stop 2024-09-12T02:40:04.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.125+0000 7f9624386640 1 -- 172.21.15.60:0/1921001598 shutdown_connections 2024-09-12T02:40:04.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.125+0000 7f9624386640 1 --2- 172.21.15.60:0/1921001598 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f960006be30 0x7f960006e2f0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.125+0000 7f9624386640 1 --2- 172.21.15.60:0/1921001598 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f961c153d60 0x7f961c1f0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.125+0000 7f9624386640 1 --2- 172.21.15.60:0/1921001598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f961c0c5aa0 0x7f961c1efd00 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.125+0000 7f9624386640 1 --2- 172.21.15.60:0/1921001598 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f961c0c5660 0x7f961c0c9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.125+0000 7f9624386640 1 -- 172.21.15.60:0/1921001598 >> 172.21.15.60:0/1921001598 conn(0x7f961c0c6980 msgr2=0x7f961c14d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:04.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.125+0000 7f9624386640 1 -- 172.21.15.60:0/1921001598 shutdown_connections 2024-09-12T02:40:04.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.125+0000 7f9624386640 1 -- 172.21.15.60:0/1921001598 wait complete. 2024-09-12T02:40:04.137 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T02:40:04.138 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:40:04.157 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:40:04.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.260+0000 7fc34f223640 1 Processor -- start 2024-09-12T02:40:04.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.260+0000 7fc34f223640 1 -- start start 2024-09-12T02:40:04.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.261+0000 7fc34f223640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc3480caff0 0x7fc3480cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:04.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.261+0000 7fc34f223640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc348156ce0 0x7fc3480ca040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:04.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.261+0000 7fc34f223640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc348150690 con 0x7fc34806c610 2024-09-12T02:40:04.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.261+0000 7fc34f223640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc3481571e0 con 0x7fc3480caff0 2024-09-12T02:40:04.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.261+0000 7fc34f223640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc3480cbb20 con 0x7fc348156ce0 2024-09-12T02:40:04.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.261+0000 7fc34d7c0640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fc34806c610 0x7fc3480ca580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41922/0 (socket says 172.21.15.60:41922) 2024-09-12T02:40:04.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.261+0000 7fc34d7c0640 1 -- 172.21.15.60:0/2171252345 learned_addr learned my addr 172.21.15.60:0/2171252345 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:40:04.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.261+0000 7fc347fff640 1 --2- 172.21.15.60:0/2171252345 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc348156ce0 0x7fc3480ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:04.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.261+0000 7fc34cfbf640 1 --2- 172.21.15.60:0/2171252345 >> v2:172.21.15.105:3300/0 conn(0x7fc3480caff0 0x7fc3480cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:04.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.262+0000 7fc3477fe640 1 -- 172.21.15.60:0/2171252345 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2210206616 0 0) 0x7fc348150690 con 0x7fc34806c610 2024-09-12T02:40:04.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.262+0000 7fc3477fe640 1 -- 172.21.15.60:0/2171252345 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc334003520 con 0x7fc34806c610 2024-09-12T02:40:04.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.262+0000 7fc3477fe640 1 -- 172.21.15.60:0/2171252345 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1677879689 0 0) 0x7fc334003520 con 0x7fc34806c610 2024-09-12T02:40:04.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.262+0000 7fc3477fe640 1 -- 172.21.15.60:0/2171252345 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc348156ce0 msgr2=0x7fc3480ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:04.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.262+0000 7fc3477fe640 1 --2- 172.21.15.60:0/2171252345 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc348156ce0 0x7fc3480ca040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.262+0000 7fc3477fe640 1 -- 172.21.15.60:0/2171252345 >> v2:172.21.15.105:3300/0 conn(0x7fc3480caff0 msgr2=0x7fc3480cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:04.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.262+0000 7fc3477fe640 1 --2- 172.21.15.60:0/2171252345 >> v2:172.21.15.105:3300/0 conn(0x7fc3480caff0 0x7fc3480cb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.262+0000 7fc3477fe640 1 -- 172.21.15.60:0/2171252345 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3480cbdc0 con 0x7fc34806c610 2024-09-12T02:40:04.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.262+0000 7fc3477fe640 1 -- 172.21.15.60:0/2171252345 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7fc340001670 con 0x7fc34806c610 2024-09-12T02:40:04.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.262+0000 7fc3477fe640 1 -- 172.21.15.60:0/2171252345 >> v1:172.21.15.60:6789/0 conn(0x7fc34806c610 legacy=0x7fc3480ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:04.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.262+0000 7fc3477fe640 1 --2- 172.21.15.60:0/2171252345 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc348156ce0 0x7fc3340039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:04.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.262+0000 7fc3477fe640 1 --2- 172.21.15.60:0/2171252345 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc334003f30 0x7fc334004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:04.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.262+0000 7fc3477fe640 1 --2- 172.21.15.60:0/2171252345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc334004d40 0x7fc3340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:04.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.262+0000 7fc3477fe640 1 -- 172.21.15.60:0/2171252345 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc3481571e0 con 0x7fc334004d40 2024-09-12T02:40:04.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.262+0000 7fc3477fe640 1 -- 172.21.15.60:0/2171252345 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc3480cbb20 con 0x7fc334003f30 2024-09-12T02:40:04.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.262+0000 7fc3477fe640 1 -- 172.21.15.60:0/2171252345 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc33400ba10 con 0x7fc348156ce0 2024-09-12T02:40:04.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.262+0000 7fc34d7c0640 1 --2- 172.21.15.60:0/2171252345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc334004d40 0x7fc3340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:04.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.262+0000 7fc34cfbf640 1 --2- 172.21.15.60:0/2171252345 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc348156ce0 0x7fc3340039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:04.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.262+0000 7fc347fff640 1 --2- 172.21.15.60:0/2171252345 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc334003f30 0x7fc334004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:04.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.262+0000 7fc34d7c0640 1 -- 172.21.15.60:0/2171252345 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc348156ce0 msgr2=0x7fc3340039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:04.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.262+0000 7fc34d7c0640 1 --2- 172.21.15.60:0/2171252345 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc348156ce0 0x7fc3340039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.262+0000 7fc34d7c0640 1 -- 172.21.15.60:0/2171252345 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc334003f30 msgr2=0x7fc334004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:04.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.262+0000 7fc34d7c0640 1 --2- 172.21.15.60:0/2171252345 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc334003f30 0x7fc334004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.262+0000 7fc34d7c0640 1 -- 172.21.15.60:0/2171252345 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc334003520 con 0x7fc334004d40 2024-09-12T02:40:04.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.263+0000 7fc34d7c0640 1 --2- 172.21.15.60:0/2171252345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc334004d40 0x7fc3340051c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc34000c290 tx=0x7fc334005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7e343cbb3666ae8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:04.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.263+0000 7fc3477fe640 1 -- 172.21.15.60:0/2171252345 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc340007d50 con 0x7fc334004d40 2024-09-12T02:40:04.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.263+0000 7fc3477fe640 1 -- 172.21.15.60:0/2171252345 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc340005ad0 con 0x7fc334004d40 2024-09-12T02:40:04.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.263+0000 7fc3477fe640 1 -- 172.21.15.60:0/2171252345 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc340007070 con 0x7fc334004d40 2024-09-12T02:40:04.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.264+0000 7fc34f223640 1 -- 172.21.15.60:0/2171252345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc334004d40 msgr2=0x7fc3340051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:04.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.264+0000 7fc34f223640 1 --2- 172.21.15.60:0/2171252345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc334004d40 0x7fc3340051c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc34000c290 tx=0x7fc334005830 comp rx=0 tx=0).stop 2024-09-12T02:40:04.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.264+0000 7fc34d7c0640 1 -- 172.21.15.60:0/2171252345 reap_dead start 2024-09-12T02:40:04.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.264+0000 7fc34f223640 1 -- 172.21.15.60:0/2171252345 shutdown_connections 2024-09-12T02:40:04.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.264+0000 7fc34f223640 1 -- 172.21.15.60:0/2171252345 >> 172.21.15.60:0/2171252345 conn(0x7fc348068010 msgr2=0x7fc348073310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:04.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.264+0000 7fc34f223640 1 -- 172.21.15.60:0/2171252345 shutdown_connections 2024-09-12T02:40:04.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.264+0000 7fc34f223640 1 -- 172.21.15.60:0/2171252345 wait complete. 2024-09-12T02:40:04.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.265+0000 7fc34f223640 1 Processor -- start 2024-09-12T02:40:04.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.265+0000 7fc34f223640 1 -- start start 2024-09-12T02:40:04.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.266+0000 7fc34f223640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc334004d40 0x7fc3481e1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:04.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.266+0000 7fc34f223640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3481ef1b0 0x7fc3481ef630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:04.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.266+0000 7fc34f223640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3481efb70 0x7fc3481528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:04.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.266+0000 7fc34f223640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc3480cac90 con 0x7fc334004d40 2024-09-12T02:40:04.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.266+0000 7fc34f223640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc3480cc380 con 0x7fc3481ef1b0 2024-09-12T02:40:04.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.266+0000 7fc34f223640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc34806bbe0 con 0x7fc3481efb70 2024-09-12T02:40:04.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.266+0000 7fc34cfbf640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc334004d40 0x7fc3481e1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:04.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.266+0000 7fc34cfbf640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc334004d40 0x7fc3481e1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41638/0 (socket says 172.21.15.60:41638) 2024-09-12T02:40:04.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.266+0000 7fc34cfbf640 1 -- 172.21.15.60:0/2958619429 learned_addr learned my addr 172.21.15.60:0/2958619429 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:04.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.266+0000 7fc347fff640 1 --2- 172.21.15.60:0/2958619429 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3481ef1b0 0x7fc3481ef630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:04.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.266+0000 7fc34d7c0640 1 --2- 172.21.15.60:0/2958619429 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3481efb70 0x7fc3481528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:04.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.266+0000 7fc34cfbf640 1 -- 172.21.15.60:0/2958619429 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3481efb70 msgr2=0x7fc3481528f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:04.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.266+0000 7fc34cfbf640 1 --2- 172.21.15.60:0/2958619429 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3481efb70 0x7fc3481528f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.266+0000 7fc34cfbf640 1 -- 172.21.15.60:0/2958619429 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3481ef1b0 msgr2=0x7fc3481ef630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:04.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.266+0000 7fc34cfbf640 1 --2- 172.21.15.60:0/2958619429 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3481ef1b0 0x7fc3481ef630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.266+0000 7fc34cfbf640 1 -- 172.21.15.60:0/2958619429 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc348150730 con 0x7fc334004d40 2024-09-12T02:40:04.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.266+0000 7fc347fff640 1 --2- 172.21.15.60:0/2958619429 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3481ef1b0 0x7fc3481ef630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:40:04.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.266+0000 7fc34cfbf640 1 --2- 172.21.15.60:0/2958619429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc334004d40 0x7fc3481e1b40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc338011a70 tx=0x7fc338011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:04.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.266+0000 7fc3457fa640 1 -- 172.21.15.60:0/2958619429 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33800fb50 con 0x7fc334004d40 2024-09-12T02:40:04.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.267+0000 7fc3457fa640 1 -- 172.21.15.60:0/2958619429 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc33800fcf0 con 0x7fc334004d40 2024-09-12T02:40:04.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.267+0000 7fc34f223640 1 -- 172.21.15.60:0/2958619429 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc348150a10 con 0x7fc334004d40 2024-09-12T02:40:04.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.267+0000 7fc3457fa640 1 -- 172.21.15.60:0/2958619429 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33800fea0 con 0x7fc334004d40 2024-09-12T02:40:04.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.267+0000 7fc34f223640 1 -- 172.21.15.60:0/2958619429 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc348150fd0 con 0x7fc334004d40 2024-09-12T02:40:04.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.268+0000 7fc34f223640 1 -- 172.21.15.60:0/2958619429 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3480cb3d0 con 0x7fc334004d40 2024-09-12T02:40:04.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.268+0000 7fc3457fa640 1 -- 172.21.15.60:0/2958619429 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc338012040 con 0x7fc334004d40 2024-09-12T02:40:04.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.269+0000 7fc3457fa640 1 --2- 172.21.15.60:0/2958619429 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc32806be60 0x7fc32806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:04.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.269+0000 7fc347fff640 1 --2- 172.21.15.60:0/2958619429 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc32806be60 0x7fc32806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:04.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.269+0000 7fc3457fa640 1 -- 172.21.15.60:0/2958619429 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fc33808ba20 con 0x7fc334004d40 2024-09-12T02:40:04.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.269+0000 7fc347fff640 1 --2- 172.21.15.60:0/2958619429 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc32806be60 0x7fc32806e320 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc3480c8fa0 tx=0x7fc33000b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:04.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.273+0000 7fc3457fa640 1 -- 172.21.15.60:0/2958619429 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc338019030 con 0x7fc334004d40 2024-09-12T02:40:04.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.461+0000 7fc34f223640 1 -- 172.21.15.60:0/2958619429 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc34806c3f0 con 0x7fc334004d40 2024-09-12T02:40:04.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.461+0000 7fc3457fa640 1 -- 172.21.15.60:0/2958619429 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7fc338059f90 con 0x7fc334004d40 2024-09-12T02:40:04.462 INFO:teuthology.orchestra.run.smithi060.stderr:listed 0 entries 2024-09-12T02:40:04.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.463+0000 7fc34f223640 1 -- 172.21.15.60:0/2958619429 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc32806be60 msgr2=0x7fc32806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:04.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.463+0000 7fc34f223640 1 --2- 172.21.15.60:0/2958619429 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc32806be60 0x7fc32806e320 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc3480c8fa0 tx=0x7fc33000b040 comp rx=0 tx=0).stop 2024-09-12T02:40:04.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.463+0000 7fc34f223640 1 -- 172.21.15.60:0/2958619429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc334004d40 msgr2=0x7fc3481e1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:04.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.463+0000 7fc34f223640 1 --2- 172.21.15.60:0/2958619429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc334004d40 0x7fc3481e1b40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc338011a70 tx=0x7fc338011f30 comp rx=0 tx=0).stop 2024-09-12T02:40:04.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.463+0000 7fc34f223640 1 -- 172.21.15.60:0/2958619429 shutdown_connections 2024-09-12T02:40:04.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.463+0000 7fc34f223640 1 --2- 172.21.15.60:0/2958619429 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fc32806be60 0x7fc32806e320 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.463+0000 7fc34f223640 1 --2- 172.21.15.60:0/2958619429 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3481efb70 0x7fc3481528f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.463+0000 7fc34f223640 1 --2- 172.21.15.60:0/2958619429 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3481ef1b0 0x7fc3481ef630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.463+0000 7fc34f223640 1 --2- 172.21.15.60:0/2958619429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc334004d40 0x7fc3481e1b40 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:04.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.463+0000 7fc34f223640 1 -- 172.21.15.60:0/2958619429 >> 172.21.15.60:0/2958619429 conn(0x7fc348068010 msgr2=0x7fc3480c8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:04.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.463+0000 7fc34f223640 1 -- 172.21.15.60:0/2958619429 shutdown_connections 2024-09-12T02:40:04.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:04.463+0000 7fc34f223640 1 -- 172.21.15.60:0/2958619429 wait complete. 2024-09-12T02:40:04.475 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi105.front.sepia.ceph.com... 2024-09-12T02:40:04.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:40:04.475 DEBUG:teuthology.orchestra.run.smithi105:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-12T02:40:04.515 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:40:04.519 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi105.stderr:ceph-fuse[42685]: fuse finished with error 0 and tester_r 0 2024-09-12T02:40:10.617 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi105.front.sepia.ceph.com 2024-09-12T02:40:10.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:40:10.617 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-12T02:40:10.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:40:10.637 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2024-09-12T02:40:10.678 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:40:10.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:40:10.678 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:40:10.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:40:10.750 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link delete ceph-brx 2024-09-12T02:40:10.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:40:10.843 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2024-09-12T02:40:10.964 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-12T02:40:10.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:40:10.965 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T02:40:10.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:40:10.995 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link delete ceph-brx 2024-09-12T02:40:11.096 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T02:40:11.107 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T02:40:11.107 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:40:11.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.221+0000 7f288f96d640 1 Processor -- start 2024-09-12T02:40:11.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.221+0000 7f288f96d640 1 -- start start 2024-09-12T02:40:11.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.222+0000 7f288f96d640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f28880c3e00 0x7f288806dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:11.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.222+0000 7f288f96d640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28880ad5c0 con 0x7f288806e650 2024-09-12T02:40:11.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.222+0000 7f288f96d640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f288806ef50 con 0x7f28881500a0 2024-09-12T02:40:11.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.222+0000 7f288f96d640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f28880ad860 con 0x7f28880c3e00 2024-09-12T02:40:11.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.222+0000 7f288cf08640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f288806e650 0x7f2888150930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:42784/0 (socket says 172.21.15.60:42784) 2024-09-12T02:40:11.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.222+0000 7f288cf08640 1 -- 172.21.15.60:0/759654895 learned_addr learned my addr 172.21.15.60:0/759654895 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:40:11.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.223+0000 7f288df0a640 1 --2- 172.21.15.60:0/759654895 >> v2:172.21.15.105:3300/0 conn(0x7f28880c3e00 0x7f288806dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:11.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.223+0000 7f287ffff640 1 -- 172.21.15.60:0/759654895 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1688064419 0 0) 0x7f28880ad5c0 con 0x7f288806e650 2024-09-12T02:40:11.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.223+0000 7f287ffff640 1 -- 172.21.15.60:0/759654895 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2874003520 con 0x7f288806e650 2024-09-12T02:40:11.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.223+0000 7f287ffff640 1 -- 172.21.15.60:0/759654895 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1493535453 0 0) 0x7f2874003520 con 0x7f288806e650 2024-09-12T02:40:11.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.223+0000 7f287ffff640 1 -- 172.21.15.60:0/759654895 >> v2:172.21.15.105:3300/0 conn(0x7f28880c3e00 msgr2=0x7f288806dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:11.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.223+0000 7f287ffff640 1 --2- 172.21.15.60:0/759654895 >> v2:172.21.15.105:3300/0 conn(0x7f28880c3e00 0x7f288806dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.223+0000 7f287ffff640 1 -- 172.21.15.60:0/759654895 >> v1:172.21.15.105:6789/0 conn(0x7f28881500a0 legacy=0x7f28880c3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:11.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.223+0000 7f287ffff640 1 -- 172.21.15.60:0/759654895 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f288806ec70 con 0x7f288806e650 2024-09-12T02:40:11.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.223+0000 7f287ffff640 1 -- 172.21.15.60:0/759654895 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7f2878001670 con 0x7f288806e650 2024-09-12T02:40:11.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.223+0000 7f288df0a640 1 --2- 172.21.15.60:0/759654895 >> v2:172.21.15.105:3300/0 conn(0x7f28880c3e00 0x7f288806dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:40:11.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.223+0000 7f287ffff640 1 -- 172.21.15.60:0/759654895 >> v1:172.21.15.60:6789/0 conn(0x7f288806e650 legacy=0x7f2888150930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:11.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.223+0000 7f287ffff640 1 --2- 172.21.15.60:0/759654895 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28740039b0 0x7f2874003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:11.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.223+0000 7f287ffff640 1 --2- 172.21.15.60:0/759654895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2874004800 0x7f2874004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:11.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.223+0000 7f287ffff640 1 --2- 172.21.15.60:0/759654895 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28740051c0 0x7f287400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:11.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.223+0000 7f287ffff640 1 -- 172.21.15.60:0/759654895 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f28880ad860 con 0x7f2874004800 2024-09-12T02:40:11.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.223+0000 7f287ffff640 1 -- 172.21.15.60:0/759654895 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f287400c160 con 0x7f28740051c0 2024-09-12T02:40:11.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.223+0000 7f287ffff640 1 -- 172.21.15.60:0/759654895 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f287400c360 con 0x7f28740039b0 2024-09-12T02:40:11.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.223+0000 7f288cf08640 1 --2- 172.21.15.60:0/759654895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2874004800 0x7f2874004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:11.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.223+0000 7f288df0a640 1 --2- 172.21.15.60:0/759654895 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28740051c0 0x7f287400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:11.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.223+0000 7f288d709640 1 --2- 172.21.15.60:0/759654895 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28740039b0 0x7f2874003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:11.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.224+0000 7f288cf08640 1 -- 172.21.15.60:0/759654895 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28740039b0 msgr2=0x7f2874003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:11.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.224+0000 7f288cf08640 1 --2- 172.21.15.60:0/759654895 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28740039b0 0x7f2874003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.224+0000 7f288cf08640 1 -- 172.21.15.60:0/759654895 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28740051c0 msgr2=0x7f287400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:11.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.224+0000 7f288cf08640 1 --2- 172.21.15.60:0/759654895 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28740051c0 0x7f287400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.224+0000 7f288cf08640 1 -- 172.21.15.60:0/759654895 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2874003520 con 0x7f2874004800 2024-09-12T02:40:11.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.224+0000 7f288df0a640 1 -- 172.21.15.60:0/759654895 reap_dead start 2024-09-12T02:40:11.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.224+0000 7f288cf08640 1 --2- 172.21.15.60:0/759654895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2874004800 0x7f2874004c80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f287800c210 tx=0x7f2874005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f42fdecd1501c6a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:11.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.224+0000 7f287ffff640 1 -- 172.21.15.60:0/759654895 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2878007d30 con 0x7f2874004800 2024-09-12T02:40:11.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.224+0000 7f287ffff640 1 -- 172.21.15.60:0/759654895 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2878005ad0 con 0x7f2874004800 2024-09-12T02:40:11.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.224+0000 7f287ffff640 1 -- 172.21.15.60:0/759654895 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2878007070 con 0x7f2874004800 2024-09-12T02:40:11.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.225+0000 7f288f96d640 1 -- 172.21.15.60:0/759654895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2874004800 msgr2=0x7f2874004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:11.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.225+0000 7f288f96d640 1 --2- 172.21.15.60:0/759654895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2874004800 0x7f2874004c80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f287800c210 tx=0x7f2874005830 comp rx=0 tx=0).stop 2024-09-12T02:40:11.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.225+0000 7f288f96d640 1 -- 172.21.15.60:0/759654895 shutdown_connections 2024-09-12T02:40:11.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.225+0000 7f288f96d640 1 --2- 172.21.15.60:0/759654895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2874004800 0x7f2874004c80 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.225+0000 7f288f96d640 1 -- 172.21.15.60:0/759654895 >> 172.21.15.60:0/759654895 conn(0x7f28880c7a40 msgr2=0x7f28880c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:11.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.225+0000 7f288f96d640 1 -- 172.21.15.60:0/759654895 shutdown_connections 2024-09-12T02:40:11.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.225+0000 7f288f96d640 1 -- 172.21.15.60:0/759654895 wait complete. 2024-09-12T02:40:11.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.226+0000 7f288f96d640 1 Processor -- start 2024-09-12T02:40:11.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.226+0000 7f288f96d640 1 -- start start 2024-09-12T02:40:11.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.227+0000 7f288f96d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2874004800 0x7f28881ed6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:11.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.227+0000 7f288f96d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2888147210 0x7f2888146630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:11.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.227+0000 7f288f96d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28880a9a50 0x7f28881e9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:11.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.227+0000 7f288f96d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2888150480 con 0x7f2874004800 2024-09-12T02:40:11.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.227+0000 7f288f96d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f28880adb10 con 0x7f28880a9a50 2024-09-12T02:40:11.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.227+0000 7f288f96d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2888150600 con 0x7f2888147210 2024-09-12T02:40:11.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.227+0000 7f288d709640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2874004800 0x7f28881ed6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:11.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.227+0000 7f288d709640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2874004800 0x7f28881ed6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40368/0 (socket says 172.21.15.60:40368) 2024-09-12T02:40:11.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.227+0000 7f288d709640 1 -- 172.21.15.60:0/2538966679 learned_addr learned my addr 172.21.15.60:0/2538966679 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:11.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.227+0000 7f288cf08640 1 --2- 172.21.15.60:0/2538966679 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2888147210 0x7f2888146630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:11.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.227+0000 7f288df0a640 1 --2- 172.21.15.60:0/2538966679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28880a9a50 0x7f28881e9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:11.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.227+0000 7f288d709640 1 -- 172.21.15.60:0/2538966679 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2888147210 msgr2=0x7f2888146630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:11.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.227+0000 7f288d709640 1 --2- 172.21.15.60:0/2538966679 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2888147210 0x7f2888146630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.227+0000 7f288d709640 1 -- 172.21.15.60:0/2538966679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28880a9a50 msgr2=0x7f28881e9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:11.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.227+0000 7f288d709640 1 --2- 172.21.15.60:0/2538966679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28880a9a50 0x7f28881e9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.227+0000 7f288d709640 1 -- 172.21.15.60:0/2538966679 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28881edbf0 con 0x7f2874004800 2024-09-12T02:40:11.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.228+0000 7f288d709640 1 --2- 172.21.15.60:0/2538966679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2874004800 0x7f28881ed6b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f288400f620 tx=0x7f288400fa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:11.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.228+0000 7f287dffb640 1 -- 172.21.15.60:0/2538966679 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28840052e0 con 0x7f2874004800 2024-09-12T02:40:11.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.228+0000 7f287dffb640 1 -- 172.21.15.60:0/2538966679 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2884018070 con 0x7f2874004800 2024-09-12T02:40:11.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.228+0000 7f288f96d640 1 -- 172.21.15.60:0/2538966679 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2888146b70 con 0x7f2874004800 2024-09-12T02:40:11.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.228+0000 7f287dffb640 1 -- 172.21.15.60:0/2538966679 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2884003810 con 0x7f2874004800 2024-09-12T02:40:11.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.228+0000 7f288f96d640 1 -- 172.21.15.60:0/2538966679 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28881567e0 con 0x7f2874004800 2024-09-12T02:40:11.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.229+0000 7f288f96d640 1 -- 172.21.15.60:0/2538966679 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28880c3000 con 0x7f2874004800 2024-09-12T02:40:11.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.229+0000 7f287dffb640 1 -- 172.21.15.60:0/2538966679 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f28840039b0 con 0x7f2874004800 2024-09-12T02:40:11.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.230+0000 7f287dffb640 1 --2- 172.21.15.60:0/2538966679 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f286c06be30 0x7f286c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:11.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.230+0000 7f287dffb640 1 -- 172.21.15.60:0/2538966679 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f288408ae00 con 0x7f2874004800 2024-09-12T02:40:11.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.230+0000 7f288cf08640 1 --2- 172.21.15.60:0/2538966679 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f286c06be30 0x7f286c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:11.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.230+0000 7f288cf08640 1 --2- 172.21.15.60:0/2538966679 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f286c06be30 0x7f286c06e2f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f2878032000 tx=0x7f287802d000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:11.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.234+0000 7f287dffb640 1 -- 172.21.15.60:0/2538966679 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f28840594a0 con 0x7f2874004800 2024-09-12T02:40:11.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.408+0000 7f288f96d640 1 -- 172.21.15.60:0/2538966679 --> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f28880c2770 con 0x7f286c06be30 2024-09-12T02:40:11.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.420+0000 7f287dffb640 1 -- 172.21.15.60:0/2538966679 <== mgr.4098 v2:172.21.15.60:6800/3549430091 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+493732 (secure 0 0 0) 0x7f28880c2770 con 0x7f286c06be30 2024-09-12T02:40:11.427 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:40:11.431 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T02:40:11.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.424+0000 7f288f96d640 1 -- 172.21.15.60:0/2538966679 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f286c06be30 msgr2=0x7f286c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:11.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.424+0000 7f288f96d640 1 --2- 172.21.15.60:0/2538966679 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f286c06be30 0x7f286c06e2f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f2878032000 tx=0x7f287802d000 comp rx=0 tx=0).stop 2024-09-12T02:40:11.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.424+0000 7f288f96d640 1 -- 172.21.15.60:0/2538966679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2874004800 msgr2=0x7f28881ed6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:11.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.424+0000 7f288f96d640 1 --2- 172.21.15.60:0/2538966679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2874004800 0x7f28881ed6b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f288400f620 tx=0x7f288400fa20 comp rx=0 tx=0).stop 2024-09-12T02:40:11.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.424+0000 7f288f96d640 1 -- 172.21.15.60:0/2538966679 shutdown_connections 2024-09-12T02:40:11.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.424+0000 7f288f96d640 1 --2- 172.21.15.60:0/2538966679 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f286c06be30 0x7f286c06e2f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.424+0000 7f288f96d640 1 --2- 172.21.15.60:0/2538966679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28880a9a50 0x7f28881e9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.424+0000 7f288f96d640 1 --2- 172.21.15.60:0/2538966679 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2888147210 0x7f2888146630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.424+0000 7f288f96d640 1 --2- 172.21.15.60:0/2538966679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2874004800 0x7f28881ed6b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.424+0000 7f288f96d640 1 -- 172.21.15.60:0/2538966679 >> 172.21.15.60:0/2538966679 conn(0x7f28880c7a40 msgr2=0x7f28880c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:11.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.425+0000 7f288f96d640 1 -- 172.21.15.60:0/2538966679 shutdown_connections 2024-09-12T02:40:11.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.425+0000 7f288f96d640 1 -- 172.21.15.60:0/2538966679 wait complete. 2024-09-12T02:40:11.437 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":540,"stamp":"2024-09-12T02:40:10.400083+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":37063407,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":235,"num_read_kb":350,"num_write":3281435,"num_write_kb":39377193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":634645,"ondisk_log_size":634645,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8349288,"kb_used_data":74792,"kb_used_omap":12,"kb_used_meta":8274355,"kb_avail":746625432,"statfs":{"total":773094113280,"available":764544442368,"internally_reserved":0,"allocated":76587008,"data_stored":75073414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":8472940080},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":57,"apply_latency_ms":57,"commit_latency_ns":57000000,"apply_latency_ns":57000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":498,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003973"},"pg_stats":[{"pgid":"5.18","version":"28'5064","reported_seq":5086,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.622362+0000","last_change":"2024-09-12T02:23:16.851521+0000","last_active":"2024-09-12T02:40:04.622362+0000","last_peered":"2024-09-12T02:40:04.622362+0000","last_clean":"2024-09-12T02:40:04.622362+0000","last_became_active":"2024-09-12T02:23:16.851220+0000","last_became_peered":"2024-09-12T02:23:16.851220+0000","last_unstale":"2024-09-12T02:40:04.622362+0000","last_undegraded":"2024-09-12T02:40:04.622362+0000","last_fullsized":"2024-09-12T02:40:04.622362+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5064,"log_dups_size":0,"ondisk_log_size":5064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:28.680072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26423,"num_write_kb":306733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"28'710","reported_seq":744,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:38.617912+0000","last_change":"2024-09-12T02:23:03.757848+0000","last_active":"2024-09-12T02:39:38.617912+0000","last_peered":"2024-09-12T02:39:38.617912+0000","last_clean":"2024-09-12T02:39:38.617912+0000","last_became_active":"2024-09-12T02:23:03.757544+0000","last_became_peered":"2024-09-12T02:23:03.757544+0000","last_unstale":"2024-09-12T02:39:38.617912+0000","last_undegraded":"2024-09-12T02:39:38.617912+0000","last_fullsized":"2024-09-12T02:39:38.617912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:43.576128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":4498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"28'5154","reported_seq":5186,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.755971+0000","last_change":"2024-09-12T02:23:04.790549+0000","last_active":"2024-09-12T02:39:57.755971+0000","last_peered":"2024-09-12T02:39:57.755971+0000","last_clean":"2024-09-12T02:39:57.755971+0000","last_became_active":"2024-09-12T02:23:04.790187+0000","last_became_peered":"2024-09-12T02:23:04.790187+0000","last_unstale":"2024-09-12T02:39:57.755971+0000","last_undegraded":"2024-09-12T02:39:57.755971+0000","last_fullsized":"2024-09-12T02:39:57.755971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5154,"log_dups_size":0,"ondisk_log_size":5154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:49.656395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26676,"num_write_kb":324046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"28'3","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:37:47.991333+0000","last_change":"2024-09-12T02:23:15.829383+0000","last_active":"2024-09-12T02:37:47.991333+0000","last_peered":"2024-09-12T02:37:47.991333+0000","last_clean":"2024-09-12T02:37:47.991333+0000","last_became_active":"2024-09-12T02:23:15.828295+0000","last_became_peered":"2024-09-12T02:23:15.828295+0000","last_unstale":"2024-09-12T02:37:47.991333+0000","last_undegraded":"2024-09-12T02:37:47.991333+0000","last_fullsized":"2024-09-12T02:37:47.991333+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:13.217846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"28'6025","reported_seq":6047,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.706763+0000","last_change":"2024-09-12T02:23:16.853675+0000","last_active":"2024-09-12T02:40:04.706763+0000","last_peered":"2024-09-12T02:40:04.706763+0000","last_clean":"2024-09-12T02:40:04.706763+0000","last_became_active":"2024-09-12T02:23:16.853371+0000","last_became_peered":"2024-09-12T02:23:16.853371+0000","last_unstale":"2024-09-12T02:40:04.706763+0000","last_undegraded":"2024-09-12T02:40:04.706763+0000","last_fullsized":"2024-09-12T02:40:04.706763+0000","mapping_epoch":24,"log_start":"28'200","ondisk_log_start":"28'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5825,"log_dups_size":0,"ondisk_log_size":5825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:10.323501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30759,"num_write_kb":360986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"28'8","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.607786+0000","last_change":"2024-09-12T02:23:03.767076+0000","last_active":"2024-09-12T02:39:47.607786+0000","last_peered":"2024-09-12T02:39:47.607786+0000","last_clean":"2024-09-12T02:39:47.607786+0000","last_became_active":"2024-09-12T02:23:03.766686+0000","last_became_peered":"2024-09-12T02:23:03.766686+0000","last_unstale":"2024-09-12T02:39:47.607786+0000","last_undegraded":"2024-09-12T02:39:47.607786+0000","last_fullsized":"2024-09-12T02:39:47.607786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:45.706208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"28'5910","reported_seq":5942,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.822665+0000","last_change":"2024-09-12T02:23:04.782108+0000","last_active":"2024-09-12T02:39:57.822665+0000","last_peered":"2024-09-12T02:39:57.822665+0000","last_clean":"2024-09-12T02:39:57.822665+0000","last_became_active":"2024-09-12T02:23:04.781829+0000","last_became_peered":"2024-09-12T02:23:04.781829+0000","last_unstale":"2024-09-12T02:39:57.822665+0000","last_undegraded":"2024-09-12T02:39:57.822665+0000","last_fullsized":"2024-09-12T02:39:57.822665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5910,"log_dups_size":0,"ondisk_log_size":5910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:07:33.165742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31102,"num_write_kb":370468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"28'3","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:37:57.710002+0000","last_change":"2024-09-12T02:23:15.828697+0000","last_active":"2024-09-12T02:37:57.710002+0000","last_peered":"2024-09-12T02:37:57.710002+0000","last_clean":"2024-09-12T02:37:57.710002+0000","last_became_active":"2024-09-12T02:23:15.828317+0000","last_became_peered":"2024-09-12T02:23:15.828317+0000","last_unstale":"2024-09-12T02:37:57.710002+0000","last_undegraded":"2024-09-12T02:37:57.710002+0000","last_fullsized":"2024-09-12T02:37:57.710002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:55.347515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"28'4662","reported_seq":4684,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.720244+0000","last_change":"2024-09-12T02:23:16.856209+0000","last_active":"2024-09-12T02:40:04.720244+0000","last_peered":"2024-09-12T02:40:04.720244+0000","last_clean":"2024-09-12T02:40:04.720244+0000","last_became_active":"2024-09-12T02:23:16.855874+0000","last_became_peered":"2024-09-12T02:23:16.855874+0000","last_unstale":"2024-09-12T02:40:04.720244+0000","last_undegraded":"2024-09-12T02:40:04.720244+0000","last_fullsized":"2024-09-12T02:40:04.720244+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4662,"log_dups_size":0,"ondisk_log_size":4662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:44.299638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23657,"num_write_kb":270894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"28'11","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.620404+0000","last_change":"2024-09-12T02:23:03.767875+0000","last_active":"2024-09-12T02:39:47.620404+0000","last_peered":"2024-09-12T02:39:47.620404+0000","last_clean":"2024-09-12T02:39:47.620404+0000","last_became_active":"2024-09-12T02:23:03.767596+0000","last_became_peered":"2024-09-12T02:23:03.767596+0000","last_unstale":"2024-09-12T02:39:47.620404+0000","last_undegraded":"2024-09-12T02:39:47.620404+0000","last_fullsized":"2024-09-12T02:39:47.620404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:22.605725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'3398","reported_seq":3428,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.832289+0000","last_change":"2024-09-12T02:23:04.791903+0000","last_active":"2024-09-12T02:39:57.832289+0000","last_peered":"2024-09-12T02:39:57.832289+0000","last_clean":"2024-09-12T02:39:57.832289+0000","last_became_active":"2024-09-12T02:23:04.791635+0000","last_became_peered":"2024-09-12T02:23:04.791635+0000","last_unstale":"2024-09-12T02:39:57.832289+0000","last_undegraded":"2024-09-12T02:39:57.832289+0000","last_fullsized":"2024-09-12T02:39:57.832289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":3398,"log_dups_size":0,"ondisk_log_size":3398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:08.192088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16708,"num_write_kb":214393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"28'616","reported_seq":640,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.618731+0000","last_change":"2024-09-12T02:23:15.833369+0000","last_active":"2024-09-12T02:38:07.618731+0000","last_peered":"2024-09-12T02:38:07.618731+0000","last_clean":"2024-09-12T02:38:07.618731+0000","last_became_active":"2024-09-12T02:23:15.833010+0000","last_became_peered":"2024-09-12T02:23:15.833010+0000","last_unstale":"2024-09-12T02:38:07.618731+0000","last_undegraded":"2024-09-12T02:38:07.618731+0000","last_fullsized":"2024-09-12T02:38:07.618731+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:51.465462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":614,"num_write_kb":4230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"28'4163","reported_seq":4185,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.700869+0000","last_change":"2024-09-12T02:23:16.853013+0000","last_active":"2024-09-12T02:40:04.700869+0000","last_peered":"2024-09-12T02:40:04.700869+0000","last_clean":"2024-09-12T02:40:04.700869+0000","last_became_active":"2024-09-12T02:23:16.852698+0000","last_became_peered":"2024-09-12T02:23:16.852698+0000","last_unstale":"2024-09-12T02:40:04.700869+0000","last_undegraded":"2024-09-12T02:40:04.700869+0000","last_fullsized":"2024-09-12T02:40:04.700869+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4163,"log_dups_size":0,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:11.709531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21165,"num_write_kb":244679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"28'3","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:04.409618+0000","last_change":"2024-09-12T02:23:03.763480+0000","last_active":"2024-09-12T02:38:04.409618+0000","last_peered":"2024-09-12T02:38:04.409618+0000","last_clean":"2024-09-12T02:38:04.409618+0000","last_became_active":"2024-09-12T02:23:03.762464+0000","last_became_peered":"2024-09-12T02:23:03.762464+0000","last_unstale":"2024-09-12T02:38:04.409618+0000","last_undegraded":"2024-09-12T02:38:04.409618+0000","last_fullsized":"2024-09-12T02:38:04.409618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:24.308289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"28'5838","reported_seq":5868,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.851601+0000","last_change":"2024-09-12T02:23:04.791109+0000","last_active":"2024-09-12T02:39:57.851601+0000","last_peered":"2024-09-12T02:39:57.851601+0000","last_clean":"2024-09-12T02:39:57.851601+0000","last_became_active":"2024-09-12T02:23:04.790201+0000","last_became_peered":"2024-09-12T02:23:04.790201+0000","last_unstale":"2024-09-12T02:39:57.851601+0000","last_undegraded":"2024-09-12T02:39:57.851601+0000","last_fullsized":"2024-09-12T02:39:57.851601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5838,"log_dups_size":0,"ondisk_log_size":5838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:13.166139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30329,"num_write_kb":367409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"28'95","reported_seq":119,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.522715+0000","last_change":"2024-09-12T02:23:15.834261+0000","last_active":"2024-09-12T02:40:04.522715+0000","last_peered":"2024-09-12T02:40:04.522715+0000","last_clean":"2024-09-12T02:40:04.522715+0000","last_became_active":"2024-09-12T02:23:15.833982+0000","last_became_peered":"2024-09-12T02:23:15.833982+0000","last_unstale":"2024-09-12T02:40:04.522715+0000","last_undegraded":"2024-09-12T02:40:04.522715+0000","last_fullsized":"2024-09-12T02:40:04.522715+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:04.987961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1406481,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":1433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"28'5650","reported_seq":5673,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.655262+0000","last_change":"2024-09-12T02:23:16.861432+0000","last_active":"2024-09-12T02:40:04.655262+0000","last_peered":"2024-09-12T02:40:04.655262+0000","last_clean":"2024-09-12T02:40:04.655262+0000","last_became_active":"2024-09-12T02:23:16.861003+0000","last_became_peered":"2024-09-12T02:23:16.861003+0000","last_unstale":"2024-09-12T02:40:04.655262+0000","last_undegraded":"2024-09-12T02:40:04.655262+0000","last_fullsized":"2024-09-12T02:40:04.655262+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5650,"log_dups_size":0,"ondisk_log_size":5650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:01.777500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29234,"num_write_kb":330189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"28'4187","reported_seq":4218,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.703320+0000","last_change":"2024-09-12T02:23:04.788754+0000","last_active":"2024-09-12T02:39:57.703320+0000","last_peered":"2024-09-12T02:39:57.703320+0000","last_clean":"2024-09-12T02:39:57.703320+0000","last_became_active":"2024-09-12T02:23:04.788350+0000","last_became_peered":"2024-09-12T02:23:04.788350+0000","last_unstale":"2024-09-12T02:39:57.703320+0000","last_undegraded":"2024-09-12T02:39:57.703320+0000","last_fullsized":"2024-09-12T02:39:57.703320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4187,"log_dups_size":0,"ondisk_log_size":4187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:08.192088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21964,"num_write_kb":272310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"28'1149","reported_seq":1182,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.632597+0000","last_change":"2024-09-12T02:23:03.763423+0000","last_active":"2024-09-12T02:39:47.632597+0000","last_peered":"2024-09-12T02:39:47.632597+0000","last_clean":"2024-09-12T02:39:47.632597+0000","last_became_active":"2024-09-12T02:23:03.762627+0000","last_became_peered":"2024-09-12T02:23:03.762627+0000","last_unstale":"2024-09-12T02:39:47.632597+0000","last_undegraded":"2024-09-12T02:39:47.632597+0000","last_fullsized":"2024-09-12T02:39:47.632597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1149,"log_dups_size":0,"ondisk_log_size":1149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:18.090657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1140,"num_write_kb":4413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"28'2","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.604710+0000","last_change":"2024-09-12T02:23:15.831604+0000","last_active":"2024-09-12T02:38:07.604710+0000","last_peered":"2024-09-12T02:38:07.604710+0000","last_clean":"2024-09-12T02:38:07.604710+0000","last_became_active":"2024-09-12T02:23:15.831292+0000","last_became_peered":"2024-09-12T02:23:15.831292+0000","last_unstale":"2024-09-12T02:38:07.604710+0000","last_undegraded":"2024-09-12T02:38:07.604710+0000","last_fullsized":"2024-09-12T02:38:07.604710+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:30.234721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"28'5482","reported_seq":5505,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.695136+0000","last_change":"2024-09-12T02:23:16.842506+0000","last_active":"2024-09-12T02:40:04.695136+0000","last_peered":"2024-09-12T02:40:04.695136+0000","last_clean":"2024-09-12T02:40:04.695136+0000","last_became_active":"2024-09-12T02:23:16.842210+0000","last_became_peered":"2024-09-12T02:23:16.842210+0000","last_unstale":"2024-09-12T02:40:04.695136+0000","last_undegraded":"2024-09-12T02:40:04.695136+0000","last_fullsized":"2024-09-12T02:40:04.695136+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5482,"log_dups_size":0,"ondisk_log_size":5482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:52.806704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28431,"num_write_kb":318903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"28'3892","reported_seq":3923,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.750186+0000","last_change":"2024-09-12T02:23:04.782769+0000","last_active":"2024-09-12T02:39:57.750186+0000","last_peered":"2024-09-12T02:39:57.750186+0000","last_clean":"2024-09-12T02:39:57.750186+0000","last_became_active":"2024-09-12T02:23:04.782472+0000","last_became_peered":"2024-09-12T02:23:04.782472+0000","last_unstale":"2024-09-12T02:39:57.750186+0000","last_undegraded":"2024-09-12T02:39:57.750186+0000","last_fullsized":"2024-09-12T02:39:57.750186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":3892,"log_dups_size":0,"ondisk_log_size":3892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:46.144471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18989,"num_write_kb":247993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'4","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.622890+0000","last_change":"2024-09-12T02:23:03.771468+0000","last_active":"2024-09-12T02:39:47.622890+0000","last_peered":"2024-09-12T02:39:47.622890+0000","last_clean":"2024-09-12T02:39:47.622890+0000","last_became_active":"2024-09-12T02:23:03.769619+0000","last_became_peered":"2024-09-12T02:23:03.769619+0000","last_unstale":"2024-09-12T02:39:47.622890+0000","last_undegraded":"2024-09-12T02:39:47.622890+0000","last_fullsized":"2024-09-12T02:39:47.622890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:38.422369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"28'2","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.610915+0000","last_change":"2024-09-12T02:23:15.833359+0000","last_active":"2024-09-12T02:38:07.610915+0000","last_peered":"2024-09-12T02:38:07.610915+0000","last_clean":"2024-09-12T02:38:07.610915+0000","last_became_active":"2024-09-12T02:23:15.832995+0000","last_became_peered":"2024-09-12T02:23:15.832995+0000","last_unstale":"2024-09-12T02:38:07.610915+0000","last_undegraded":"2024-09-12T02:38:07.610915+0000","last_fullsized":"2024-09-12T02:38:07.610915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:57.922845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"28'4854","reported_seq":4877,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.689490+0000","last_change":"2024-09-12T02:23:16.856439+0000","last_active":"2024-09-12T02:40:04.689490+0000","last_peered":"2024-09-12T02:40:04.689490+0000","last_clean":"2024-09-12T02:40:04.689490+0000","last_became_active":"2024-09-12T02:23:16.856166+0000","last_became_peered":"2024-09-12T02:23:16.856166+0000","last_unstale":"2024-09-12T02:40:04.689490+0000","last_undegraded":"2024-09-12T02:40:04.689490+0000","last_fullsized":"2024-09-12T02:40:04.689490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4854,"log_dups_size":0,"ondisk_log_size":4854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:42:56.534517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24657,"num_write_kb":295553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"28'4675","reported_seq":4706,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.744628+0000","last_change":"2024-09-12T02:23:04.783991+0000","last_active":"2024-09-12T02:39:57.744628+0000","last_peered":"2024-09-12T02:39:57.744628+0000","last_clean":"2024-09-12T02:39:57.744628+0000","last_became_active":"2024-09-12T02:23:04.783143+0000","last_became_peered":"2024-09-12T02:23:04.783143+0000","last_unstale":"2024-09-12T02:39:57.744628+0000","last_undegraded":"2024-09-12T02:39:57.744628+0000","last_fullsized":"2024-09-12T02:39:57.744628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4675,"log_dups_size":0,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:53.940843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24578,"num_write_kb":303391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'3","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.602532+0000","last_change":"2024-09-12T02:23:03.770581+0000","last_active":"2024-09-12T02:39:47.602532+0000","last_peered":"2024-09-12T02:39:47.602532+0000","last_clean":"2024-09-12T02:39:47.602532+0000","last_became_active":"2024-09-12T02:23:03.769406+0000","last_became_peered":"2024-09-12T02:23:03.769406+0000","last_unstale":"2024-09-12T02:39:47.602532+0000","last_undegraded":"2024-09-12T02:39:47.602532+0000","last_fullsized":"2024-09-12T02:39:47.602532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:20.963819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"28'5","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.723938+0000","last_change":"2024-09-12T02:23:15.835033+0000","last_active":"2024-09-12T02:38:07.723938+0000","last_peered":"2024-09-12T02:38:07.723938+0000","last_clean":"2024-09-12T02:38:07.723938+0000","last_became_active":"2024-09-12T02:23:15.834753+0000","last_became_peered":"2024-09-12T02:23:15.834753+0000","last_unstale":"2024-09-12T02:38:07.723938+0000","last_undegraded":"2024-09-12T02:38:07.723938+0000","last_fullsized":"2024-09-12T02:38:07.723938+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:57.434162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"28'5924","reported_seq":5947,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.730977+0000","last_change":"2024-09-12T02:23:16.860867+0000","last_active":"2024-09-12T02:40:04.730977+0000","last_peered":"2024-09-12T02:40:04.730977+0000","last_clean":"2024-09-12T02:40:04.730977+0000","last_became_active":"2024-09-12T02:23:16.860656+0000","last_became_peered":"2024-09-12T02:23:16.860656+0000","last_unstale":"2024-09-12T02:40:04.730977+0000","last_undegraded":"2024-09-12T02:40:04.730977+0000","last_fullsized":"2024-09-12T02:40:04.730977+0000","mapping_epoch":24,"log_start":"28'100","ondisk_log_start":"28'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5824,"log_dups_size":0,"ondisk_log_size":5824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:11.375287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30048,"num_write_kb":358073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"28'4362","reported_seq":4393,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.669337+0000","last_change":"2024-09-12T02:23:04.780821+0000","last_active":"2024-09-12T02:39:57.669337+0000","last_peered":"2024-09-12T02:39:57.669337+0000","last_clean":"2024-09-12T02:39:57.669337+0000","last_became_active":"2024-09-12T02:23:04.779984+0000","last_became_peered":"2024-09-12T02:23:04.779984+0000","last_unstale":"2024-09-12T02:39:57.669337+0000","last_undegraded":"2024-09-12T02:39:57.669337+0000","last_fullsized":"2024-09-12T02:39:57.669337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4362,"log_dups_size":0,"ondisk_log_size":4362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:25.724116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22346,"num_write_kb":282099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"28'3","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.590737+0000","last_change":"2024-09-12T02:23:03.764530+0000","last_active":"2024-09-12T02:39:47.590737+0000","last_peered":"2024-09-12T02:39:47.590737+0000","last_clean":"2024-09-12T02:39:47.590737+0000","last_became_active":"2024-09-12T02:23:03.764218+0000","last_became_peered":"2024-09-12T02:23:03.764218+0000","last_unstale":"2024-09-12T02:39:47.590737+0000","last_undegraded":"2024-09-12T02:39:47.590737+0000","last_fullsized":"2024-09-12T02:39:47.590737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:55.445619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"28'6","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.689963+0000","last_change":"2024-09-12T02:23:15.831621+0000","last_active":"2024-09-12T02:38:07.689963+0000","last_peered":"2024-09-12T02:38:07.689963+0000","last_clean":"2024-09-12T02:38:07.689963+0000","last_became_active":"2024-09-12T02:23:15.831331+0000","last_became_peered":"2024-09-12T02:23:15.831331+0000","last_unstale":"2024-09-12T02:38:07.689963+0000","last_undegraded":"2024-09-12T02:38:07.689963+0000","last_fullsized":"2024-09-12T02:38:07.689963+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:06.494392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"28'4897","reported_seq":4921,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.656642+0000","last_change":"2024-09-12T02:23:16.847556+0000","last_active":"2024-09-12T02:40:04.656642+0000","last_peered":"2024-09-12T02:40:04.656642+0000","last_clean":"2024-09-12T02:40:04.656642+0000","last_became_active":"2024-09-12T02:23:16.845749+0000","last_became_peered":"2024-09-12T02:23:16.845749+0000","last_unstale":"2024-09-12T02:40:04.656642+0000","last_undegraded":"2024-09-12T02:40:04.656642+0000","last_fullsized":"2024-09-12T02:40:04.656642+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4897,"log_dups_size":0,"ondisk_log_size":4897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:39.542842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25893,"num_write_kb":296532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"28'3849","reported_seq":3880,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.731126+0000","last_change":"2024-09-12T02:23:04.786895+0000","last_active":"2024-09-12T02:39:57.731126+0000","last_peered":"2024-09-12T02:39:57.731126+0000","last_clean":"2024-09-12T02:39:57.731126+0000","last_became_active":"2024-09-12T02:23:04.786591+0000","last_became_peered":"2024-09-12T02:23:04.786591+0000","last_unstale":"2024-09-12T02:39:57.731126+0000","last_undegraded":"2024-09-12T02:39:57.731126+0000","last_fullsized":"2024-09-12T02:39:57.731126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":3849,"log_dups_size":0,"ondisk_log_size":3849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:14.751707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19665,"num_write_kb":250729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'5","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.627847+0000","last_change":"2024-09-12T02:23:03.771259+0000","last_active":"2024-09-12T02:39:47.627847+0000","last_peered":"2024-09-12T02:39:47.627847+0000","last_clean":"2024-09-12T02:39:47.627847+0000","last_became_active":"2024-09-12T02:23:03.770687+0000","last_became_peered":"2024-09-12T02:23:03.770687+0000","last_unstale":"2024-09-12T02:39:47.627847+0000","last_undegraded":"2024-09-12T02:39:47.627847+0000","last_fullsized":"2024-09-12T02:39:47.627847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:38.516959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"28'59","reported_seq":142,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:51.334318+0000","last_change":"2024-09-12T02:23:15.829406+0000","last_active":"2024-09-12T02:39:51.334318+0000","last_peered":"2024-09-12T02:39:51.334318+0000","last_clean":"2024-09-12T02:39:51.334318+0000","last_became_active":"2024-09-12T02:23:15.829135+0000","last_became_peered":"2024-09-12T02:23:15.829135+0000","last_unstale":"2024-09-12T02:39:51.334318+0000","last_undegraded":"2024-09-12T02:39:51.334318+0000","last_fullsized":"2024-09-12T02:39:51.334318+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:22.365804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":57,"num_read_kb":123,"num_write":57,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"28'5530","reported_seq":5554,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.659180+0000","last_change":"2024-09-12T02:23:16.857016+0000","last_active":"2024-09-12T02:40:04.659180+0000","last_peered":"2024-09-12T02:40:04.659180+0000","last_clean":"2024-09-12T02:40:04.659180+0000","last_became_active":"2024-09-12T02:23:16.856705+0000","last_became_peered":"2024-09-12T02:23:16.856705+0000","last_unstale":"2024-09-12T02:40:04.659180+0000","last_undegraded":"2024-09-12T02:40:04.659180+0000","last_fullsized":"2024-09-12T02:40:04.659180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5530,"log_dups_size":0,"ondisk_log_size":5530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:03.672668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29256,"num_write_kb":314000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"28'4419","reported_seq":4450,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.721713+0000","last_change":"2024-09-12T02:23:04.786424+0000","last_active":"2024-09-12T02:39:57.721713+0000","last_peered":"2024-09-12T02:39:57.721713+0000","last_clean":"2024-09-12T02:39:57.721713+0000","last_became_active":"2024-09-12T02:23:04.786136+0000","last_became_peered":"2024-09-12T02:23:04.786136+0000","last_unstale":"2024-09-12T02:39:57.721713+0000","last_undegraded":"2024-09-12T02:39:57.721713+0000","last_fullsized":"2024-09-12T02:39:57.721713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4419,"log_dups_size":0,"ondisk_log_size":4419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:31.214894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22653,"num_write_kb":291447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'597","reported_seq":630,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:48.951757+0000","last_change":"2024-09-12T02:23:03.769745+0000","last_active":"2024-09-12T02:39:48.951757+0000","last_peered":"2024-09-12T02:39:48.951757+0000","last_clean":"2024-09-12T02:39:48.951757+0000","last_became_active":"2024-09-12T02:23:03.769410+0000","last_became_peered":"2024-09-12T02:23:03.769410+0000","last_unstale":"2024-09-12T02:39:48.951757+0000","last_undegraded":"2024-09-12T02:39:48.951757+0000","last_fullsized":"2024-09-12T02:39:48.951757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:00.414459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1455,"num_write_kb":462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"28'5","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.701763+0000","last_change":"2024-09-12T02:23:15.827211+0000","last_active":"2024-09-12T02:38:07.701763+0000","last_peered":"2024-09-12T02:38:07.701763+0000","last_clean":"2024-09-12T02:38:07.701763+0000","last_became_active":"2024-09-12T02:23:15.826564+0000","last_became_peered":"2024-09-12T02:23:15.826564+0000","last_unstale":"2024-09-12T02:38:07.701763+0000","last_undegraded":"2024-09-12T02:38:07.701763+0000","last_fullsized":"2024-09-12T02:38:07.701763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:32.389443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"28'5561","reported_seq":5585,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.639456+0000","last_change":"2024-09-12T02:23:16.837434+0000","last_active":"2024-09-12T02:40:04.639456+0000","last_peered":"2024-09-12T02:40:04.639456+0000","last_clean":"2024-09-12T02:40:04.639456+0000","last_became_active":"2024-09-12T02:23:16.837162+0000","last_became_peered":"2024-09-12T02:23:16.837162+0000","last_unstale":"2024-09-12T02:40:04.639456+0000","last_undegraded":"2024-09-12T02:40:04.639456+0000","last_fullsized":"2024-09-12T02:40:04.639456+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5561,"log_dups_size":0,"ondisk_log_size":5561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:09.146064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28597,"num_write_kb":327668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"28'4780","reported_seq":4812,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.728845+0000","last_change":"2024-09-12T02:23:04.775876+0000","last_active":"2024-09-12T02:39:57.728845+0000","last_peered":"2024-09-12T02:39:57.728845+0000","last_clean":"2024-09-12T02:39:57.728845+0000","last_became_active":"2024-09-12T02:23:04.775571+0000","last_became_peered":"2024-09-12T02:23:04.775571+0000","last_unstale":"2024-09-12T02:39:57.728845+0000","last_undegraded":"2024-09-12T02:39:57.728845+0000","last_fullsized":"2024-09-12T02:39:57.728845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4780,"log_dups_size":0,"ondisk_log_size":4780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:05.070528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24981,"num_write_kb":308974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"28'4","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.626390+0000","last_change":"2024-09-12T02:23:03.764093+0000","last_active":"2024-09-12T02:39:47.626390+0000","last_peered":"2024-09-12T02:39:47.626390+0000","last_clean":"2024-09-12T02:39:47.626390+0000","last_became_active":"2024-09-12T02:23:03.763147+0000","last_became_peered":"2024-09-12T02:23:03.763147+0000","last_unstale":"2024-09-12T02:39:47.626390+0000","last_undegraded":"2024-09-12T02:39:47.626390+0000","last_fullsized":"2024-09-12T02:39:47.626390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:13.317894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"28'1","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:37:53.624097+0000","last_change":"2024-09-12T02:23:15.832461+0000","last_active":"2024-09-12T02:37:53.624097+0000","last_peered":"2024-09-12T02:37:53.624097+0000","last_clean":"2024-09-12T02:37:53.624097+0000","last_became_active":"2024-09-12T02:23:15.831637+0000","last_became_peered":"2024-09-12T02:23:15.831637+0000","last_unstale":"2024-09-12T02:37:53.624097+0000","last_undegraded":"2024-09-12T02:37:53.624097+0000","last_fullsized":"2024-09-12T02:37:53.624097+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:30.909927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"28'5517","reported_seq":5541,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.717568+0000","last_change":"2024-09-12T02:23:16.835824+0000","last_active":"2024-09-12T02:40:04.717568+0000","last_peered":"2024-09-12T02:40:04.717568+0000","last_clean":"2024-09-12T02:40:04.717568+0000","last_became_active":"2024-09-12T02:23:16.835520+0000","last_became_peered":"2024-09-12T02:23:16.835520+0000","last_unstale":"2024-09-12T02:40:04.717568+0000","last_undegraded":"2024-09-12T02:40:04.717568+0000","last_fullsized":"2024-09-12T02:40:04.717568+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5517,"log_dups_size":0,"ondisk_log_size":5517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:32.797100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29476,"num_write_kb":310838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"28'3821","reported_seq":3853,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.839882+0000","last_change":"2024-09-12T02:23:04.787557+0000","last_active":"2024-09-12T02:39:57.839882+0000","last_peered":"2024-09-12T02:39:57.839882+0000","last_clean":"2024-09-12T02:39:57.839882+0000","last_became_active":"2024-09-12T02:23:04.786527+0000","last_became_peered":"2024-09-12T02:23:04.786527+0000","last_unstale":"2024-09-12T02:39:57.839882+0000","last_undegraded":"2024-09-12T02:39:57.839882+0000","last_fullsized":"2024-09-12T02:39:57.839882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":3821,"log_dups_size":0,"ondisk_log_size":3821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:23.273457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19788,"num_write_kb":259568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"28'5","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.626953+0000","last_change":"2024-09-12T02:23:03.769913+0000","last_active":"2024-09-12T02:39:47.626953+0000","last_peered":"2024-09-12T02:39:47.626953+0000","last_clean":"2024-09-12T02:39:47.626953+0000","last_became_active":"2024-09-12T02:23:03.769444+0000","last_became_peered":"2024-09-12T02:23:03.769444+0000","last_unstale":"2024-09-12T02:39:47.626953+0000","last_undegraded":"2024-09-12T02:39:47.626953+0000","last_fullsized":"2024-09-12T02:39:47.626953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:21.243182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"28'5","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.710687+0000","last_change":"2024-09-12T02:23:15.829080+0000","last_active":"2024-09-12T02:38:07.710687+0000","last_peered":"2024-09-12T02:38:07.710687+0000","last_clean":"2024-09-12T02:38:07.710687+0000","last_became_active":"2024-09-12T02:23:15.828256+0000","last_became_peered":"2024-09-12T02:23:15.828256+0000","last_unstale":"2024-09-12T02:38:07.710687+0000","last_undegraded":"2024-09-12T02:38:07.710687+0000","last_fullsized":"2024-09-12T02:38:07.710687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:07.743952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"28'4600","reported_seq":4624,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.595161+0000","last_change":"2024-09-12T02:23:16.845710+0000","last_active":"2024-09-12T02:40:04.595161+0000","last_peered":"2024-09-12T02:40:04.595161+0000","last_clean":"2024-09-12T02:40:04.595161+0000","last_became_active":"2024-09-12T02:23:16.845379+0000","last_became_peered":"2024-09-12T02:23:16.845379+0000","last_unstale":"2024-09-12T02:40:04.595161+0000","last_undegraded":"2024-09-12T02:40:04.595161+0000","last_fullsized":"2024-09-12T02:40:04.595161+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4600,"log_dups_size":0,"ondisk_log_size":4600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:16.769410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24241,"num_write_kb":277536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"28'4371","reported_seq":4403,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.747023+0000","last_change":"2024-09-12T02:23:04.790723+0000","last_active":"2024-09-12T02:39:57.747023+0000","last_peered":"2024-09-12T02:39:57.747023+0000","last_clean":"2024-09-12T02:39:57.747023+0000","last_became_active":"2024-09-12T02:23:04.786877+0000","last_became_peered":"2024-09-12T02:23:04.786877+0000","last_unstale":"2024-09-12T02:39:57.747023+0000","last_undegraded":"2024-09-12T02:39:57.747023+0000","last_fullsized":"2024-09-12T02:39:57.747023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4371,"log_dups_size":0,"ondisk_log_size":4371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:48.516002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23204,"num_write_kb":285450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"28'5","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.620925+0000","last_change":"2024-09-12T02:23:03.771518+0000","last_active":"2024-09-12T02:39:47.620925+0000","last_peered":"2024-09-12T02:39:47.620925+0000","last_clean":"2024-09-12T02:39:47.620925+0000","last_became_active":"2024-09-12T02:23:03.771063+0000","last_became_peered":"2024-09-12T02:23:03.771063+0000","last_unstale":"2024-09-12T02:39:47.620925+0000","last_undegraded":"2024-09-12T02:39:47.620925+0000","last_fullsized":"2024-09-12T02:39:47.620925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:43.974555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"28'5","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.679539+0000","last_change":"2024-09-12T02:23:15.827028+0000","last_active":"2024-09-12T02:38:07.679539+0000","last_peered":"2024-09-12T02:38:07.679539+0000","last_clean":"2024-09-12T02:38:07.679539+0000","last_became_active":"2024-09-12T02:23:15.826708+0000","last_became_peered":"2024-09-12T02:23:15.826708+0000","last_unstale":"2024-09-12T02:38:07.679539+0000","last_undegraded":"2024-09-12T02:38:07.679539+0000","last_fullsized":"2024-09-12T02:38:07.679539+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:34.642396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'4748","reported_seq":4771,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.730697+0000","last_change":"2024-09-12T02:23:16.849429+0000","last_active":"2024-09-12T02:40:04.730697+0000","last_peered":"2024-09-12T02:40:04.730697+0000","last_clean":"2024-09-12T02:40:04.730697+0000","last_became_active":"2024-09-12T02:23:16.849119+0000","last_became_peered":"2024-09-12T02:23:16.849119+0000","last_unstale":"2024-09-12T02:40:04.730697+0000","last_undegraded":"2024-09-12T02:40:04.730697+0000","last_fullsized":"2024-09-12T02:40:04.730697+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4748,"log_dups_size":0,"ondisk_log_size":4748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:10.688619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23965,"num_write_kb":268065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"28'4258","reported_seq":4290,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.730029+0000","last_change":"2024-09-12T02:23:04.773745+0000","last_active":"2024-09-12T02:39:57.730029+0000","last_peered":"2024-09-12T02:39:57.730029+0000","last_clean":"2024-09-12T02:39:57.730029+0000","last_became_active":"2024-09-12T02:23:04.773360+0000","last_became_peered":"2024-09-12T02:23:04.773360+0000","last_unstale":"2024-09-12T02:39:57.730029+0000","last_undegraded":"2024-09-12T02:39:57.730029+0000","last_fullsized":"2024-09-12T02:39:57.730029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4258,"log_dups_size":0,"ondisk_log_size":4258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:33.097774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22673,"num_write_kb":283464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'64","reported_seq":160,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.311429+0000","last_change":"2024-09-12T02:23:03.760700+0000","last_active":"2024-09-12T02:39:47.311429+0000","last_peered":"2024-09-12T02:39:47.311429+0000","last_clean":"2024-09-12T02:39:47.311429+0000","last_became_active":"2024-09-12T02:23:03.760397+0000","last_became_peered":"2024-09-12T02:23:03.760397+0000","last_unstale":"2024-09-12T02:39:47.311429+0000","last_undegraded":"2024-09-12T02:39:47.311429+0000","last_fullsized":"2024-09-12T02:39:47.311429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:36.788864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":127,"num_write":62,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"28'4","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.673049+0000","last_change":"2024-09-12T02:23:15.828714+0000","last_active":"2024-09-12T02:38:07.673049+0000","last_peered":"2024-09-12T02:38:07.673049+0000","last_clean":"2024-09-12T02:38:07.673049+0000","last_became_active":"2024-09-12T02:23:15.827458+0000","last_became_peered":"2024-09-12T02:23:15.827458+0000","last_unstale":"2024-09-12T02:38:07.673049+0000","last_undegraded":"2024-09-12T02:38:07.673049+0000","last_fullsized":"2024-09-12T02:38:07.673049+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:12.581897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"28'4979","reported_seq":5002,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.723394+0000","last_change":"2024-09-12T02:23:16.855212+0000","last_active":"2024-09-12T02:40:04.723394+0000","last_peered":"2024-09-12T02:40:04.723394+0000","last_clean":"2024-09-12T02:40:04.723394+0000","last_became_active":"2024-09-12T02:23:16.854938+0000","last_became_peered":"2024-09-12T02:23:16.854938+0000","last_unstale":"2024-09-12T02:40:04.723394+0000","last_undegraded":"2024-09-12T02:40:04.723394+0000","last_fullsized":"2024-09-12T02:40:04.723394+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4979,"log_dups_size":0,"ondisk_log_size":4979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:02.944057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25537,"num_write_kb":303027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"28'4415","reported_seq":4447,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.768572+0000","last_change":"2024-09-12T02:23:04.787820+0000","last_active":"2024-09-12T02:39:57.768572+0000","last_peered":"2024-09-12T02:39:57.768572+0000","last_clean":"2024-09-12T02:39:57.768572+0000","last_became_active":"2024-09-12T02:23:04.787523+0000","last_became_peered":"2024-09-12T02:23:04.787523+0000","last_unstale":"2024-09-12T02:39:57.768572+0000","last_undegraded":"2024-09-12T02:39:57.768572+0000","last_fullsized":"2024-09-12T02:39:57.768572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4415,"log_dups_size":0,"ondisk_log_size":4415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:52.784171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23022,"num_write_kb":288900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'5","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.629413+0000","last_change":"2024-09-12T02:23:03.771625+0000","last_active":"2024-09-12T02:39:47.629413+0000","last_peered":"2024-09-12T02:39:47.629413+0000","last_clean":"2024-09-12T02:39:47.629413+0000","last_became_active":"2024-09-12T02:23:03.771163+0000","last_became_peered":"2024-09-12T02:23:03.771163+0000","last_unstale":"2024-09-12T02:39:47.629413+0000","last_undegraded":"2024-09-12T02:39:47.629413+0000","last_fullsized":"2024-09-12T02:39:47.629413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:32.772569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"28'615","reported_seq":640,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:49.038042+0000","last_change":"2024-09-12T02:23:15.833889+0000","last_active":"2024-09-12T02:39:49.038042+0000","last_peered":"2024-09-12T02:39:49.038042+0000","last_clean":"2024-09-12T02:39:49.038042+0000","last_became_active":"2024-09-12T02:23:15.833587+0000","last_became_peered":"2024-09-12T02:23:15.833587+0000","last_unstale":"2024-09-12T02:39:49.038042+0000","last_undegraded":"2024-09-12T02:39:49.038042+0000","last_fullsized":"2024-09-12T02:39:49.038042+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:32.787861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1484,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"28'5400","reported_seq":5424,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.730531+0000","last_change":"2024-09-12T02:23:16.848864+0000","last_active":"2024-09-12T02:40:04.730531+0000","last_peered":"2024-09-12T02:40:04.730531+0000","last_clean":"2024-09-12T02:40:04.730531+0000","last_became_active":"2024-09-12T02:23:16.848385+0000","last_became_peered":"2024-09-12T02:23:16.848385+0000","last_unstale":"2024-09-12T02:40:04.730531+0000","last_undegraded":"2024-09-12T02:40:04.730531+0000","last_fullsized":"2024-09-12T02:40:04.730531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5400,"log_dups_size":0,"ondisk_log_size":5400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:03.656397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28350,"num_write_kb":322666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"28'5040","reported_seq":5072,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.783368+0000","last_change":"2024-09-12T02:23:04.781839+0000","last_active":"2024-09-12T02:39:57.783368+0000","last_peered":"2024-09-12T02:39:57.783368+0000","last_clean":"2024-09-12T02:39:57.783368+0000","last_became_active":"2024-09-12T02:23:04.780984+0000","last_became_peered":"2024-09-12T02:23:04.780984+0000","last_unstale":"2024-09-12T02:39:57.783368+0000","last_undegraded":"2024-09-12T02:39:57.783368+0000","last_fullsized":"2024-09-12T02:39:57.783368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5040,"log_dups_size":0,"ondisk_log_size":5040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:07.692791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25643,"num_write_kb":315836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'1","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:37:39.936369+0000","last_change":"2024-09-12T02:23:03.765100+0000","last_active":"2024-09-12T02:37:39.936369+0000","last_peered":"2024-09-12T02:37:39.936369+0000","last_clean":"2024-09-12T02:37:39.936369+0000","last_became_active":"2024-09-12T02:23:03.764801+0000","last_became_peered":"2024-09-12T02:23:03.764801+0000","last_unstale":"2024-09-12T02:37:39.936369+0000","last_undegraded":"2024-09-12T02:37:39.936369+0000","last_fullsized":"2024-09-12T02:37:39.936369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:06.891040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":190,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:36:54.619226+0000","last_change":"2024-09-12T02:22:55.143869+0000","last_active":"2024-09-12T02:36:54.619226+0000","last_peered":"2024-09-12T02:36:54.619226+0000","last_clean":"2024-09-12T02:36:54.619226+0000","last_became_active":"2024-09-12T02:22:55.142784+0000","last_became_peered":"2024-09-12T02:22:55.142784+0000","last_unstale":"2024-09-12T02:36:54.619226+0000","last_undegraded":"2024-09-12T02:36:54.619226+0000","last_fullsized":"2024-09-12T02:36:54.619226+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:22:52.457979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:22:52.457979+0000","last_clean_scrub_stamp":"2024-09-12T02:22:52.457979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:46.152602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"28'4","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.661864+0000","last_change":"2024-09-12T02:23:15.831362+0000","last_active":"2024-09-12T02:38:07.661864+0000","last_peered":"2024-09-12T02:38:07.661864+0000","last_clean":"2024-09-12T02:38:07.661864+0000","last_became_active":"2024-09-12T02:23:15.831084+0000","last_became_peered":"2024-09-12T02:23:15.831084+0000","last_unstale":"2024-09-12T02:38:07.661864+0000","last_undegraded":"2024-09-12T02:38:07.661864+0000","last_fullsized":"2024-09-12T02:38:07.661864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:17.754173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"28'4521","reported_seq":4544,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.674856+0000","last_change":"2024-09-12T02:23:16.838831+0000","last_active":"2024-09-12T02:40:04.674856+0000","last_peered":"2024-09-12T02:40:04.674856+0000","last_clean":"2024-09-12T02:40:04.674856+0000","last_became_active":"2024-09-12T02:23:16.838523+0000","last_became_peered":"2024-09-12T02:23:16.838523+0000","last_unstale":"2024-09-12T02:40:04.674856+0000","last_undegraded":"2024-09-12T02:40:04.674856+0000","last_fullsized":"2024-09-12T02:40:04.674856+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4521,"log_dups_size":0,"ondisk_log_size":4521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:35:42.088332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22817,"num_write_kb":263525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"28'4994","reported_seq":5025,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.798342+0000","last_change":"2024-09-12T02:23:04.783483+0000","last_active":"2024-09-12T02:39:57.798342+0000","last_peered":"2024-09-12T02:39:57.798342+0000","last_clean":"2024-09-12T02:39:57.798342+0000","last_became_active":"2024-09-12T02:23:04.782878+0000","last_became_peered":"2024-09-12T02:23:04.782878+0000","last_unstale":"2024-09-12T02:39:57.798342+0000","last_undegraded":"2024-09-12T02:39:57.798342+0000","last_fullsized":"2024-09-12T02:39:57.798342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4994,"log_dups_size":0,"ondisk_log_size":4994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:52.335065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25629,"num_write_kb":307571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'2","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:48.439127+0000","last_change":"2024-09-12T02:23:03.762507+0000","last_active":"2024-09-12T02:38:48.439127+0000","last_peered":"2024-09-12T02:38:48.439127+0000","last_clean":"2024-09-12T02:38:48.439127+0000","last_became_active":"2024-09-12T02:23:03.762164+0000","last_became_peered":"2024-09-12T02:23:03.762164+0000","last_unstale":"2024-09-12T02:38:48.439127+0000","last_undegraded":"2024-09-12T02:38:48.439127+0000","last_fullsized":"2024-09-12T02:38:48.439127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:34.569630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"28'4","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.725569+0000","last_change":"2024-09-12T02:23:15.830783+0000","last_active":"2024-09-12T02:38:07.725569+0000","last_peered":"2024-09-12T02:38:07.725569+0000","last_clean":"2024-09-12T02:38:07.725569+0000","last_became_active":"2024-09-12T02:23:15.830471+0000","last_became_peered":"2024-09-12T02:23:15.830471+0000","last_unstale":"2024-09-12T02:38:07.725569+0000","last_undegraded":"2024-09-12T02:38:07.725569+0000","last_fullsized":"2024-09-12T02:38:07.725569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:22.927201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"28'4580","reported_seq":4603,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.664325+0000","last_change":"2024-09-12T02:23:16.856328+0000","last_active":"2024-09-12T02:40:04.664325+0000","last_peered":"2024-09-12T02:40:04.664325+0000","last_clean":"2024-09-12T02:40:04.664325+0000","last_became_active":"2024-09-12T02:23:16.855992+0000","last_became_peered":"2024-09-12T02:23:16.855992+0000","last_unstale":"2024-09-12T02:40:04.664325+0000","last_undegraded":"2024-09-12T02:40:04.664325+0000","last_fullsized":"2024-09-12T02:40:04.664325+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4580,"log_dups_size":0,"ondisk_log_size":4580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:47.682103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24326,"num_write_kb":281766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"28'4821","reported_seq":4852,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.817348+0000","last_change":"2024-09-12T02:23:04.784318+0000","last_active":"2024-09-12T02:39:57.817348+0000","last_peered":"2024-09-12T02:39:57.817348+0000","last_clean":"2024-09-12T02:39:57.817348+0000","last_became_active":"2024-09-12T02:23:04.784012+0000","last_became_peered":"2024-09-12T02:23:04.784012+0000","last_unstale":"2024-09-12T02:39:57.817348+0000","last_undegraded":"2024-09-12T02:39:57.817348+0000","last_fullsized":"2024-09-12T02:39:57.817348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4821,"log_dups_size":0,"ondisk_log_size":4821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:51.352859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24805,"num_write_kb":312357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"28'2","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:52.827222+0000","last_change":"2024-09-12T02:23:03.766034+0000","last_active":"2024-09-12T02:38:52.827222+0000","last_peered":"2024-09-12T02:38:52.827222+0000","last_clean":"2024-09-12T02:38:52.827222+0000","last_became_active":"2024-09-12T02:23:03.765735+0000","last_became_peered":"2024-09-12T02:23:03.765735+0000","last_unstale":"2024-09-12T02:38:52.827222+0000","last_undegraded":"2024-09-12T02:38:52.827222+0000","last_fullsized":"2024-09-12T02:38:52.827222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:19.691229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"28'1085","reported_seq":1110,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.716303+0000","last_change":"2024-09-12T02:23:15.832527+0000","last_active":"2024-09-12T02:38:07.716303+0000","last_peered":"2024-09-12T02:38:07.716303+0000","last_clean":"2024-09-12T02:38:07.716303+0000","last_became_active":"2024-09-12T02:23:15.832184+0000","last_became_peered":"2024-09-12T02:23:15.832184+0000","last_unstale":"2024-09-12T02:38:07.716303+0000","last_undegraded":"2024-09-12T02:38:07.716303+0000","last_fullsized":"2024-09-12T02:38:07.716303+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":1085,"log_dups_size":0,"ondisk_log_size":1085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:29.131198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1076,"num_write_kb":4403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"28'4868","reported_seq":4891,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.629771+0000","last_change":"2024-09-12T02:23:16.849357+0000","last_active":"2024-09-12T02:40:04.629771+0000","last_peered":"2024-09-12T02:40:04.629771+0000","last_clean":"2024-09-12T02:40:04.629771+0000","last_became_active":"2024-09-12T02:23:16.849067+0000","last_became_peered":"2024-09-12T02:23:16.849067+0000","last_unstale":"2024-09-12T02:40:04.629771+0000","last_undegraded":"2024-09-12T02:40:04.629771+0000","last_fullsized":"2024-09-12T02:40:04.629771+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4868,"log_dups_size":0,"ondisk_log_size":4868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:06.887523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24798,"num_write_kb":291891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"28'5524","reported_seq":5555,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.830006+0000","last_change":"2024-09-12T02:23:04.791152+0000","last_active":"2024-09-12T02:39:57.830006+0000","last_peered":"2024-09-12T02:39:57.830006+0000","last_clean":"2024-09-12T02:39:57.830006+0000","last_became_active":"2024-09-12T02:23:04.790707+0000","last_became_peered":"2024-09-12T02:23:04.790707+0000","last_unstale":"2024-09-12T02:39:57.830006+0000","last_undegraded":"2024-09-12T02:39:57.830006+0000","last_fullsized":"2024-09-12T02:39:57.830006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5524,"log_dups_size":0,"ondisk_log_size":5524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:42.798507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27879,"num_write_kb":349281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"28'6","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.625090+0000","last_change":"2024-09-12T02:23:03.763327+0000","last_active":"2024-09-12T02:39:47.625090+0000","last_peered":"2024-09-12T02:39:47.625090+0000","last_clean":"2024-09-12T02:39:47.625090+0000","last_became_active":"2024-09-12T02:23:03.763005+0000","last_became_peered":"2024-09-12T02:23:03.763005+0000","last_unstale":"2024-09-12T02:39:47.625090+0000","last_undegraded":"2024-09-12T02:39:47.625090+0000","last_fullsized":"2024-09-12T02:39:47.625090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:09.500459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"28'3","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.672423+0000","last_change":"2024-09-12T02:23:15.819644+0000","last_active":"2024-09-12T02:38:07.672423+0000","last_peered":"2024-09-12T02:38:07.672423+0000","last_clean":"2024-09-12T02:38:07.672423+0000","last_became_active":"2024-09-12T02:23:15.819370+0000","last_became_peered":"2024-09-12T02:23:15.819370+0000","last_unstale":"2024-09-12T02:38:07.672423+0000","last_undegraded":"2024-09-12T02:38:07.672423+0000","last_fullsized":"2024-09-12T02:38:07.672423+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:56.384531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"28'5323","reported_seq":5346,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.659057+0000","last_change":"2024-09-12T02:23:16.838234+0000","last_active":"2024-09-12T02:40:04.659057+0000","last_peered":"2024-09-12T02:40:04.659057+0000","last_clean":"2024-09-12T02:40:04.659057+0000","last_became_active":"2024-09-12T02:23:16.837942+0000","last_became_peered":"2024-09-12T02:23:16.837942+0000","last_unstale":"2024-09-12T02:40:04.659057+0000","last_undegraded":"2024-09-12T02:40:04.659057+0000","last_fullsized":"2024-09-12T02:40:04.659057+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5323,"log_dups_size":0,"ondisk_log_size":5323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:41.842931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28212,"num_write_kb":317995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"28'4432","reported_seq":4463,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.735779+0000","last_change":"2024-09-12T02:23:04.781196+0000","last_active":"2024-09-12T02:39:57.735779+0000","last_peered":"2024-09-12T02:39:57.735779+0000","last_clean":"2024-09-12T02:39:57.735779+0000","last_became_active":"2024-09-12T02:23:04.780893+0000","last_became_peered":"2024-09-12T02:23:04.780893+0000","last_unstale":"2024-09-12T02:39:57.735779+0000","last_undegraded":"2024-09-12T02:39:57.735779+0000","last_fullsized":"2024-09-12T02:39:57.735779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4432,"log_dups_size":0,"ondisk_log_size":4432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:26.527539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22251,"num_write_kb":285885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'5","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.626407+0000","last_change":"2024-09-12T02:23:03.769541+0000","last_active":"2024-09-12T02:39:47.626407+0000","last_peered":"2024-09-12T02:39:47.626407+0000","last_clean":"2024-09-12T02:39:47.626407+0000","last_became_active":"2024-09-12T02:23:03.765281+0000","last_became_peered":"2024-09-12T02:23:03.765281+0000","last_unstale":"2024-09-12T02:39:47.626407+0000","last_undegraded":"2024-09-12T02:39:47.626407+0000","last_fullsized":"2024-09-12T02:39:47.626407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:53.409370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"28'3","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.670913+0000","last_change":"2024-09-12T02:23:15.841592+0000","last_active":"2024-09-12T02:38:07.670913+0000","last_peered":"2024-09-12T02:38:07.670913+0000","last_clean":"2024-09-12T02:38:07.670913+0000","last_became_active":"2024-09-12T02:23:15.841380+0000","last_became_peered":"2024-09-12T02:23:15.841380+0000","last_unstale":"2024-09-12T02:38:07.670913+0000","last_undegraded":"2024-09-12T02:38:07.670913+0000","last_fullsized":"2024-09-12T02:38:07.670913+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:38.396332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"28'4540","reported_seq":4562,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.682011+0000","last_change":"2024-09-12T02:23:16.846596+0000","last_active":"2024-09-12T02:40:04.682011+0000","last_peered":"2024-09-12T02:40:04.682011+0000","last_clean":"2024-09-12T02:40:04.682011+0000","last_became_active":"2024-09-12T02:23:16.846273+0000","last_became_peered":"2024-09-12T02:23:16.846273+0000","last_unstale":"2024-09-12T02:40:04.682011+0000","last_undegraded":"2024-09-12T02:40:04.682011+0000","last_fullsized":"2024-09-12T02:40:04.682011+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4540,"log_dups_size":0,"ondisk_log_size":4540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:03.628494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23721,"num_write_kb":271171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"28'4758","reported_seq":4789,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.728981+0000","last_change":"2024-09-12T02:23:04.781856+0000","last_active":"2024-09-12T02:39:57.728981+0000","last_peered":"2024-09-12T02:39:57.728981+0000","last_clean":"2024-09-12T02:39:57.728981+0000","last_became_active":"2024-09-12T02:23:04.781575+0000","last_became_peered":"2024-09-12T02:23:04.781575+0000","last_unstale":"2024-09-12T02:39:57.728981+0000","last_undegraded":"2024-09-12T02:39:57.728981+0000","last_fullsized":"2024-09-12T02:39:57.728981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4758,"log_dups_size":0,"ondisk_log_size":4758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:26.630558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24728,"num_write_kb":299876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"28'11","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.597678+0000","last_change":"2024-09-12T02:23:03.771368+0000","last_active":"2024-09-12T02:39:47.597678+0000","last_peered":"2024-09-12T02:39:47.597678+0000","last_clean":"2024-09-12T02:39:47.597678+0000","last_became_active":"2024-09-12T02:23:03.771061+0000","last_became_peered":"2024-09-12T02:23:03.771061+0000","last_unstale":"2024-09-12T02:39:47.597678+0000","last_undegraded":"2024-09-12T02:39:47.597678+0000","last_fullsized":"2024-09-12T02:39:47.597678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:57.476458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"28'2","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.683446+0000","last_change":"2024-09-12T02:23:15.833158+0000","last_active":"2024-09-12T02:38:07.683446+0000","last_peered":"2024-09-12T02:38:07.683446+0000","last_clean":"2024-09-12T02:38:07.683446+0000","last_became_active":"2024-09-12T02:23:15.831707+0000","last_became_peered":"2024-09-12T02:23:15.831707+0000","last_unstale":"2024-09-12T02:38:07.683446+0000","last_undegraded":"2024-09-12T02:38:07.683446+0000","last_fullsized":"2024-09-12T02:38:07.683446+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:30.000066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"28'5063","reported_seq":5085,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.735985+0000","last_change":"2024-09-12T02:23:16.858757+0000","last_active":"2024-09-12T02:40:04.735985+0000","last_peered":"2024-09-12T02:40:04.735985+0000","last_clean":"2024-09-12T02:40:04.735985+0000","last_became_active":"2024-09-12T02:23:16.858469+0000","last_became_peered":"2024-09-12T02:23:16.858469+0000","last_unstale":"2024-09-12T02:40:04.735985+0000","last_undegraded":"2024-09-12T02:40:04.735985+0000","last_fullsized":"2024-09-12T02:40:04.735985+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5063,"log_dups_size":0,"ondisk_log_size":5063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:22.288143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25554,"num_write_kb":307334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"28'4968","reported_seq":4999,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.765114+0000","last_change":"2024-09-12T02:23:04.785248+0000","last_active":"2024-09-12T02:39:57.765114+0000","last_peered":"2024-09-12T02:39:57.765114+0000","last_clean":"2024-09-12T02:39:57.765114+0000","last_became_active":"2024-09-12T02:23:04.784977+0000","last_became_peered":"2024-09-12T02:23:04.784977+0000","last_unstale":"2024-09-12T02:39:57.765114+0000","last_undegraded":"2024-09-12T02:39:57.765114+0000","last_fullsized":"2024-09-12T02:39:57.765114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4968,"log_dups_size":0,"ondisk_log_size":4968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:23.273457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25338,"num_write_kb":318642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"28'6","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.616586+0000","last_change":"2024-09-12T02:23:03.767842+0000","last_active":"2024-09-12T02:39:47.616586+0000","last_peered":"2024-09-12T02:39:47.616586+0000","last_clean":"2024-09-12T02:39:47.616586+0000","last_became_active":"2024-09-12T02:23:03.767066+0000","last_became_peered":"2024-09-12T02:23:03.767066+0000","last_unstale":"2024-09-12T02:39:47.616586+0000","last_undegraded":"2024-09-12T02:39:47.616586+0000","last_fullsized":"2024-09-12T02:39:47.616586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:50.800749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"28'2","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:37:48.019306+0000","last_change":"2024-09-12T02:23:15.826104+0000","last_active":"2024-09-12T02:37:48.019306+0000","last_peered":"2024-09-12T02:37:48.019306+0000","last_clean":"2024-09-12T02:37:48.019306+0000","last_became_active":"2024-09-12T02:23:15.825779+0000","last_became_peered":"2024-09-12T02:23:15.825779+0000","last_unstale":"2024-09-12T02:37:48.019306+0000","last_undegraded":"2024-09-12T02:37:48.019306+0000","last_fullsized":"2024-09-12T02:37:48.019306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:32.661083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"28'5278","reported_seq":5300,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.698094+0000","last_change":"2024-09-12T02:23:16.856543+0000","last_active":"2024-09-12T02:40:04.698094+0000","last_peered":"2024-09-12T02:40:04.698094+0000","last_clean":"2024-09-12T02:40:04.698094+0000","last_became_active":"2024-09-12T02:23:16.855538+0000","last_became_peered":"2024-09-12T02:23:16.855538+0000","last_unstale":"2024-09-12T02:40:04.698094+0000","last_undegraded":"2024-09-12T02:40:04.698094+0000","last_fullsized":"2024-09-12T02:40:04.698094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5278,"log_dups_size":0,"ondisk_log_size":5278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:05.857593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27222,"num_write_kb":301662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'5225","reported_seq":5256,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.832151+0000","last_change":"2024-09-12T02:23:04.783671+0000","last_active":"2024-09-12T02:39:57.832151+0000","last_peered":"2024-09-12T02:39:57.832151+0000","last_clean":"2024-09-12T02:39:57.832151+0000","last_became_active":"2024-09-12T02:23:04.783399+0000","last_became_peered":"2024-09-12T02:23:04.783399+0000","last_unstale":"2024-09-12T02:39:57.832151+0000","last_undegraded":"2024-09-12T02:39:57.832151+0000","last_fullsized":"2024-09-12T02:39:57.832151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5225,"log_dups_size":0,"ondisk_log_size":5225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:04.321789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26678,"num_write_kb":336266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'5","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.634447+0000","last_change":"2024-09-12T02:23:03.767217+0000","last_active":"2024-09-12T02:39:47.634447+0000","last_peered":"2024-09-12T02:39:47.634447+0000","last_clean":"2024-09-12T02:39:47.634447+0000","last_became_active":"2024-09-12T02:23:03.766551+0000","last_became_peered":"2024-09-12T02:23:03.766551+0000","last_unstale":"2024-09-12T02:39:47.634447+0000","last_undegraded":"2024-09-12T02:39:47.634447+0000","last_fullsized":"2024-09-12T02:39:47.634447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:09.963450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"28'299","reported_seq":324,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:48.637750+0000","last_change":"2024-09-12T02:23:15.832638+0000","last_active":"2024-09-12T02:39:48.637750+0000","last_peered":"2024-09-12T02:39:48.637750+0000","last_clean":"2024-09-12T02:39:48.637750+0000","last_became_active":"2024-09-12T02:23:15.832152+0000","last_became_peered":"2024-09-12T02:23:15.832152+0000","last_unstale":"2024-09-12T02:39:48.637750+0000","last_undegraded":"2024-09-12T02:39:48.637750+0000","last_fullsized":"2024-09-12T02:39:48.637750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:06.820636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295,"num_write_kb":4246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"28'6304","reported_seq":6327,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.731388+0000","last_change":"2024-09-12T02:23:16.846920+0000","last_active":"2024-09-12T02:40:04.731388+0000","last_peered":"2024-09-12T02:40:04.731388+0000","last_clean":"2024-09-12T02:40:04.731388+0000","last_became_active":"2024-09-12T02:23:16.846454+0000","last_became_peered":"2024-09-12T02:23:16.846454+0000","last_unstale":"2024-09-12T02:40:04.731388+0000","last_undegraded":"2024-09-12T02:40:04.731388+0000","last_fullsized":"2024-09-12T02:40:04.731388+0000","mapping_epoch":24,"log_start":"28'1100","ondisk_log_start":"28'1100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5204,"log_dups_size":0,"ondisk_log_size":5204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:51.782998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31934,"num_write_kb":398820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"28'4402","reported_seq":4433,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.754331+0000","last_change":"2024-09-12T02:23:04.784379+0000","last_active":"2024-09-12T02:39:57.754331+0000","last_peered":"2024-09-12T02:39:57.754331+0000","last_clean":"2024-09-12T02:39:57.754331+0000","last_became_active":"2024-09-12T02:23:04.784094+0000","last_became_peered":"2024-09-12T02:23:04.784094+0000","last_unstale":"2024-09-12T02:39:57.754331+0000","last_undegraded":"2024-09-12T02:39:57.754331+0000","last_fullsized":"2024-09-12T02:39:57.754331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4402,"log_dups_size":0,"ondisk_log_size":4402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:22.103008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22399,"num_write_kb":282193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"28'8","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.616748+0000","last_change":"2024-09-12T02:23:03.762859+0000","last_active":"2024-09-12T02:39:47.616748+0000","last_peered":"2024-09-12T02:39:47.616748+0000","last_clean":"2024-09-12T02:39:47.616748+0000","last_became_active":"2024-09-12T02:23:03.762557+0000","last_became_peered":"2024-09-12T02:23:03.762557+0000","last_unstale":"2024-09-12T02:39:47.616748+0000","last_undegraded":"2024-09-12T02:39:47.616748+0000","last_fullsized":"2024-09-12T02:39:47.616748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:34.863435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"28'34","reported_seq":58,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:08.425336+0000","last_change":"2024-09-12T02:23:15.823090+0000","last_active":"2024-09-12T02:38:08.425336+0000","last_peered":"2024-09-12T02:38:08.425336+0000","last_clean":"2024-09-12T02:38:08.425336+0000","last_became_active":"2024-09-12T02:23:15.822441+0000","last_became_peered":"2024-09-12T02:23:15.822441+0000","last_unstale":"2024-09-12T02:38:08.425336+0000","last_undegraded":"2024-09-12T02:38:08.425336+0000","last_fullsized":"2024-09-12T02:38:08.425336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:35.125478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"28'5704","reported_seq":5727,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.711812+0000","last_change":"2024-09-12T02:23:16.839875+0000","last_active":"2024-09-12T02:40:04.711812+0000","last_peered":"2024-09-12T02:40:04.711812+0000","last_clean":"2024-09-12T02:40:04.711812+0000","last_became_active":"2024-09-12T02:23:16.838277+0000","last_became_peered":"2024-09-12T02:23:16.838277+0000","last_unstale":"2024-09-12T02:40:04.711812+0000","last_undegraded":"2024-09-12T02:40:04.711812+0000","last_fullsized":"2024-09-12T02:40:04.711812+0000","mapping_epoch":24,"log_start":"28'500","ondisk_log_start":"28'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5204,"log_dups_size":0,"ondisk_log_size":5204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:09.370310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29050,"num_write_kb":345934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"28'4440","reported_seq":4471,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.749780+0000","last_change":"2024-09-12T02:23:04.780843+0000","last_active":"2024-09-12T02:39:57.749780+0000","last_peered":"2024-09-12T02:39:57.749780+0000","last_clean":"2024-09-12T02:39:57.749780+0000","last_became_active":"2024-09-12T02:23:04.780475+0000","last_became_peered":"2024-09-12T02:23:04.780475+0000","last_unstale":"2024-09-12T02:39:57.749780+0000","last_undegraded":"2024-09-12T02:39:57.749780+0000","last_fullsized":"2024-09-12T02:39:57.749780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4440,"log_dups_size":0,"ondisk_log_size":4440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:38.074872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22736,"num_write_kb":283554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'340","reported_seq":373,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.633548+0000","last_change":"2024-09-12T02:23:03.768425+0000","last_active":"2024-09-12T02:39:47.633548+0000","last_peered":"2024-09-12T02:39:47.633548+0000","last_clean":"2024-09-12T02:39:47.633548+0000","last_became_active":"2024-09-12T02:23:03.768092+0000","last_became_peered":"2024-09-12T02:23:03.768092+0000","last_unstale":"2024-09-12T02:39:47.633548+0000","last_undegraded":"2024-09-12T02:39:47.633548+0000","last_fullsized":"2024-09-12T02:39:47.633548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":340,"log_dups_size":0,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:18.572070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"28'5","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.725314+0000","last_change":"2024-09-12T02:23:15.829364+0000","last_active":"2024-09-12T02:38:07.725314+0000","last_peered":"2024-09-12T02:38:07.725314+0000","last_clean":"2024-09-12T02:38:07.725314+0000","last_became_active":"2024-09-12T02:23:15.827936+0000","last_became_peered":"2024-09-12T02:23:15.827936+0000","last_unstale":"2024-09-12T02:38:07.725314+0000","last_undegraded":"2024-09-12T02:38:07.725314+0000","last_fullsized":"2024-09-12T02:38:07.725314+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:04.973202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"28'4960","reported_seq":4983,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.685069+0000","last_change":"2024-09-12T02:23:16.854209+0000","last_active":"2024-09-12T02:40:04.685069+0000","last_peered":"2024-09-12T02:40:04.685069+0000","last_clean":"2024-09-12T02:40:04.685069+0000","last_became_active":"2024-09-12T02:23:16.853900+0000","last_became_peered":"2024-09-12T02:23:16.853900+0000","last_unstale":"2024-09-12T02:40:04.685069+0000","last_undegraded":"2024-09-12T02:40:04.685069+0000","last_fullsized":"2024-09-12T02:40:04.685069+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4960,"log_dups_size":0,"ondisk_log_size":4960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:52.831434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25526,"num_write_kb":294821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'6032","reported_seq":6063,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.811025+0000","last_change":"2024-09-12T02:23:04.777953+0000","last_active":"2024-09-12T02:39:57.811025+0000","last_peered":"2024-09-12T02:39:57.811025+0000","last_clean":"2024-09-12T02:39:57.811025+0000","last_became_active":"2024-09-12T02:23:04.777081+0000","last_became_peered":"2024-09-12T02:23:04.777081+0000","last_unstale":"2024-09-12T02:39:57.811025+0000","last_undegraded":"2024-09-12T02:39:57.811025+0000","last_fullsized":"2024-09-12T02:39:57.811025+0000","mapping_epoch":20,"log_start":"28'500","ondisk_log_start":"28'500","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5532,"log_dups_size":0,"ondisk_log_size":5532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:14.103378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30497,"num_write_kb":392872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'35","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:48.251039+0000","last_change":"2024-09-12T02:23:03.771271+0000","last_active":"2024-09-12T02:39:48.251039+0000","last_peered":"2024-09-12T02:39:48.251039+0000","last_clean":"2024-09-12T02:39:48.251039+0000","last_became_active":"2024-09-12T02:23:03.769601+0000","last_became_peered":"2024-09-12T02:23:03.769601+0000","last_unstale":"2024-09-12T02:39:48.251039+0000","last_undegraded":"2024-09-12T02:39:48.251039+0000","last_fullsized":"2024-09-12T02:39:48.251039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:22.910072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"28'8","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.680681+0000","last_change":"2024-09-12T02:23:15.831522+0000","last_active":"2024-09-12T02:38:07.680681+0000","last_peered":"2024-09-12T02:38:07.680681+0000","last_clean":"2024-09-12T02:38:07.680681+0000","last_became_active":"2024-09-12T02:23:15.831220+0000","last_became_peered":"2024-09-12T02:23:15.831220+0000","last_unstale":"2024-09-12T02:38:07.680681+0000","last_undegraded":"2024-09-12T02:38:07.680681+0000","last_fullsized":"2024-09-12T02:38:07.680681+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:54.337051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"28'5159","reported_seq":5182,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.721952+0000","last_change":"2024-09-12T02:23:16.858361+0000","last_active":"2024-09-12T02:40:04.721952+0000","last_peered":"2024-09-12T02:40:04.721952+0000","last_clean":"2024-09-12T02:40:04.721952+0000","last_became_active":"2024-09-12T02:23:16.858075+0000","last_became_peered":"2024-09-12T02:23:16.858075+0000","last_unstale":"2024-09-12T02:40:04.721952+0000","last_undegraded":"2024-09-12T02:40:04.721952+0000","last_fullsized":"2024-09-12T02:40:04.721952+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5159,"log_dups_size":0,"ondisk_log_size":5159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:35.038604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27123,"num_write_kb":309496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"28'3733","reported_seq":3764,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.822654+0000","last_change":"2024-09-12T02:23:04.779171+0000","last_active":"2024-09-12T02:39:57.822654+0000","last_peered":"2024-09-12T02:39:57.822654+0000","last_clean":"2024-09-12T02:39:57.822654+0000","last_became_active":"2024-09-12T02:23:04.778850+0000","last_became_peered":"2024-09-12T02:23:04.778850+0000","last_unstale":"2024-09-12T02:39:57.822654+0000","last_undegraded":"2024-09-12T02:39:57.822654+0000","last_fullsized":"2024-09-12T02:39:57.822654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":3733,"log_dups_size":0,"ondisk_log_size":3733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:21.746490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19250,"num_write_kb":253251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'2","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.636633+0000","last_change":"2024-09-12T02:23:03.769710+0000","last_active":"2024-09-12T02:39:47.636633+0000","last_peered":"2024-09-12T02:39:47.636633+0000","last_clean":"2024-09-12T02:39:47.636633+0000","last_became_active":"2024-09-12T02:23:03.769436+0000","last_became_peered":"2024-09-12T02:23:03.769436+0000","last_unstale":"2024-09-12T02:39:47.636633+0000","last_undegraded":"2024-09-12T02:39:47.636633+0000","last_fullsized":"2024-09-12T02:39:47.636633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:11.194147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"28'12","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:38.057899+0000","last_change":"2024-09-12T02:23:15.833196+0000","last_active":"2024-09-12T02:39:38.057899+0000","last_peered":"2024-09-12T02:39:38.057899+0000","last_clean":"2024-09-12T02:39:38.057899+0000","last_became_active":"2024-09-12T02:23:15.832873+0000","last_became_peered":"2024-09-12T02:23:15.832873+0000","last_unstale":"2024-09-12T02:39:38.057899+0000","last_undegraded":"2024-09-12T02:39:38.057899+0000","last_fullsized":"2024-09-12T02:39:38.057899+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:15.238046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"28'5308","reported_seq":5331,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.733481+0000","last_change":"2024-09-12T02:23:16.856735+0000","last_active":"2024-09-12T02:40:04.733481+0000","last_peered":"2024-09-12T02:40:04.733481+0000","last_clean":"2024-09-12T02:40:04.733481+0000","last_became_active":"2024-09-12T02:23:16.856455+0000","last_became_peered":"2024-09-12T02:23:16.856455+0000","last_unstale":"2024-09-12T02:40:04.733481+0000","last_undegraded":"2024-09-12T02:40:04.733481+0000","last_fullsized":"2024-09-12T02:40:04.733481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5308,"log_dups_size":0,"ondisk_log_size":5308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:55.376194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27382,"num_write_kb":326846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"28'4524","reported_seq":4555,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.792729+0000","last_change":"2024-09-12T02:23:04.786100+0000","last_active":"2024-09-12T02:39:57.792729+0000","last_peered":"2024-09-12T02:39:57.792729+0000","last_clean":"2024-09-12T02:39:57.792729+0000","last_became_active":"2024-09-12T02:23:04.785795+0000","last_became_peered":"2024-09-12T02:23:04.785795+0000","last_unstale":"2024-09-12T02:39:57.792729+0000","last_undegraded":"2024-09-12T02:39:57.792729+0000","last_fullsized":"2024-09-12T02:39:57.792729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4524,"log_dups_size":0,"ondisk_log_size":4524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:58.597807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22689,"num_write_kb":295834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"28'2","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.620142+0000","last_change":"2024-09-12T02:23:03.770668+0000","last_active":"2024-09-12T02:39:47.620142+0000","last_peered":"2024-09-12T02:39:47.620142+0000","last_clean":"2024-09-12T02:39:47.620142+0000","last_became_active":"2024-09-12T02:23:03.769302+0000","last_became_peered":"2024-09-12T02:23:03.769302+0000","last_unstale":"2024-09-12T02:39:47.620142+0000","last_undegraded":"2024-09-12T02:39:47.620142+0000","last_fullsized":"2024-09-12T02:39:47.620142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:18.948922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"28'6","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.703401+0000","last_change":"2024-09-12T02:23:15.825585+0000","last_active":"2024-09-12T02:38:07.703401+0000","last_peered":"2024-09-12T02:38:07.703401+0000","last_clean":"2024-09-12T02:38:07.703401+0000","last_became_active":"2024-09-12T02:23:15.825305+0000","last_became_peered":"2024-09-12T02:23:15.825305+0000","last_unstale":"2024-09-12T02:38:07.703401+0000","last_undegraded":"2024-09-12T02:38:07.703401+0000","last_fullsized":"2024-09-12T02:38:07.703401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:43.818922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"28'6585","reported_seq":6609,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.697301+0000","last_change":"2024-09-12T02:23:16.852415+0000","last_active":"2024-09-12T02:40:04.697301+0000","last_peered":"2024-09-12T02:40:04.697301+0000","last_clean":"2024-09-12T02:40:04.697301+0000","last_became_active":"2024-09-12T02:23:16.852061+0000","last_became_peered":"2024-09-12T02:23:16.852061+0000","last_unstale":"2024-09-12T02:40:04.697301+0000","last_undegraded":"2024-09-12T02:40:04.697301+0000","last_fullsized":"2024-09-12T02:40:04.697301+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":6585,"log_dups_size":0,"ondisk_log_size":6585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:30:49.720576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34694,"num_write_kb":385000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"28'8","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.695201+0000","last_change":"2024-09-12T02:23:15.833414+0000","last_active":"2024-09-12T02:38:07.695201+0000","last_peered":"2024-09-12T02:38:07.695201+0000","last_clean":"2024-09-12T02:38:07.695201+0000","last_became_active":"2024-09-12T02:23:15.832837+0000","last_became_peered":"2024-09-12T02:23:15.832837+0000","last_unstale":"2024-09-12T02:38:07.695201+0000","last_undegraded":"2024-09-12T02:38:07.695201+0000","last_fullsized":"2024-09-12T02:38:07.695201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:31.510160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"28'5783","reported_seq":5814,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.762578+0000","last_change":"2024-09-12T02:23:04.776572+0000","last_active":"2024-09-12T02:39:57.762578+0000","last_peered":"2024-09-12T02:39:57.762578+0000","last_clean":"2024-09-12T02:39:57.762578+0000","last_became_active":"2024-09-12T02:23:04.776270+0000","last_became_peered":"2024-09-12T02:23:04.776270+0000","last_unstale":"2024-09-12T02:39:57.762578+0000","last_undegraded":"2024-09-12T02:39:57.762578+0000","last_fullsized":"2024-09-12T02:39:57.762578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5783,"log_dups_size":0,"ondisk_log_size":5783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:12.807907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29721,"num_write_kb":356762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'3","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.633254+0000","last_change":"2024-09-12T02:23:03.762450+0000","last_active":"2024-09-12T02:39:47.633254+0000","last_peered":"2024-09-12T02:39:47.633254+0000","last_clean":"2024-09-12T02:39:47.633254+0000","last_became_active":"2024-09-12T02:23:03.762161+0000","last_became_peered":"2024-09-12T02:23:03.762161+0000","last_unstale":"2024-09-12T02:39:47.633254+0000","last_undegraded":"2024-09-12T02:39:47.633254+0000","last_fullsized":"2024-09-12T02:39:47.633254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:42.256395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"28'5706","reported_seq":5730,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.668944+0000","last_change":"2024-09-12T02:23:16.844537+0000","last_active":"2024-09-12T02:40:04.668944+0000","last_peered":"2024-09-12T02:40:04.668944+0000","last_clean":"2024-09-12T02:40:04.668944+0000","last_became_active":"2024-09-12T02:23:16.844248+0000","last_became_peered":"2024-09-12T02:23:16.844248+0000","last_unstale":"2024-09-12T02:40:04.668944+0000","last_undegraded":"2024-09-12T02:40:04.668944+0000","last_fullsized":"2024-09-12T02:40:04.668944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5706,"log_dups_size":0,"ondisk_log_size":5706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:45.801324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29959,"num_write_kb":337330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"28'719","reported_seq":745,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:37:54.833834+0000","last_change":"2024-09-12T02:23:15.826010+0000","last_active":"2024-09-12T02:37:54.833834+0000","last_peered":"2024-09-12T02:37:54.833834+0000","last_clean":"2024-09-12T02:37:54.833834+0000","last_became_active":"2024-09-12T02:23:15.825730+0000","last_became_peered":"2024-09-12T02:23:15.825730+0000","last_unstale":"2024-09-12T02:37:54.833834+0000","last_undegraded":"2024-09-12T02:37:54.833834+0000","last_fullsized":"2024-09-12T02:37:54.833834+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":719,"log_dups_size":0,"ondisk_log_size":719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:17.920975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":717,"num_write_kb":4509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"28'4333","reported_seq":4364,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.775122+0000","last_change":"2024-09-12T02:23:04.783317+0000","last_active":"2024-09-12T02:39:57.775122+0000","last_peered":"2024-09-12T02:39:57.775122+0000","last_clean":"2024-09-12T02:39:57.775122+0000","last_became_active":"2024-09-12T02:23:04.783039+0000","last_became_peered":"2024-09-12T02:23:04.783039+0000","last_unstale":"2024-09-12T02:39:57.775122+0000","last_undegraded":"2024-09-12T02:39:57.775122+0000","last_fullsized":"2024-09-12T02:39:57.775122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4333,"log_dups_size":0,"ondisk_log_size":4333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:17.577991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22422,"num_write_kb":290509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'3","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.593428+0000","last_change":"2024-09-12T02:23:03.768361+0000","last_active":"2024-09-12T02:39:47.593428+0000","last_peered":"2024-09-12T02:39:47.593428+0000","last_clean":"2024-09-12T02:39:47.593428+0000","last_became_active":"2024-09-12T02:23:03.768137+0000","last_became_peered":"2024-09-12T02:23:03.768137+0000","last_unstale":"2024-09-12T02:39:47.593428+0000","last_undegraded":"2024-09-12T02:39:47.593428+0000","last_fullsized":"2024-09-12T02:39:47.593428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:29.721363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"28'6357","reported_seq":6379,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.744225+0000","last_change":"2024-09-12T02:23:16.861251+0000","last_active":"2024-09-12T02:40:04.744225+0000","last_peered":"2024-09-12T02:40:04.744225+0000","last_clean":"2024-09-12T02:40:04.744225+0000","last_became_active":"2024-09-12T02:23:16.860980+0000","last_became_peered":"2024-09-12T02:23:16.860980+0000","last_unstale":"2024-09-12T02:40:04.744225+0000","last_undegraded":"2024-09-12T02:40:04.744225+0000","last_fullsized":"2024-09-12T02:40:04.744225+0000","mapping_epoch":24,"log_start":"28'500","ondisk_log_start":"28'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5857,"log_dups_size":0,"ondisk_log_size":5857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:16.177179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32865,"num_write_kb":377625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"28'95","reported_seq":127,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.604503+0000","last_change":"2024-09-12T02:23:03.768186+0000","last_active":"2024-09-12T02:39:57.604503+0000","last_peered":"2024-09-12T02:39:57.604503+0000","last_clean":"2024-09-12T02:39:57.604503+0000","last_became_active":"2024-09-12T02:23:03.767916+0000","last_became_peered":"2024-09-12T02:23:03.767916+0000","last_unstale":"2024-09-12T02:39:57.604503+0000","last_undegraded":"2024-09-12T02:39:57.604503+0000","last_fullsized":"2024-09-12T02:39:57.604503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:04.424540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1333026,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"28'3601","reported_seq":3631,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.791002+0000","last_change":"2024-09-12T02:23:04.793412+0000","last_active":"2024-09-12T02:39:57.791002+0000","last_peered":"2024-09-12T02:39:57.791002+0000","last_clean":"2024-09-12T02:39:57.791002+0000","last_became_active":"2024-09-12T02:23:04.793100+0000","last_became_peered":"2024-09-12T02:23:04.793100+0000","last_unstale":"2024-09-12T02:39:57.791002+0000","last_undegraded":"2024-09-12T02:39:57.791002+0000","last_fullsized":"2024-09-12T02:39:57.791002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":3601,"log_dups_size":0,"ondisk_log_size":3601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:50.446212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18077,"num_write_kb":232187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"28'3","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.714174+0000","last_change":"2024-09-12T02:23:15.830776+0000","last_active":"2024-09-12T02:38:07.714174+0000","last_peered":"2024-09-12T02:38:07.714174+0000","last_clean":"2024-09-12T02:38:07.714174+0000","last_became_active":"2024-09-12T02:23:15.830492+0000","last_became_peered":"2024-09-12T02:23:15.830492+0000","last_unstale":"2024-09-12T02:38:07.714174+0000","last_undegraded":"2024-09-12T02:38:07.714174+0000","last_fullsized":"2024-09-12T02:38:07.714174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:40.517292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"28'3975","reported_seq":3997,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.678952+0000","last_change":"2024-09-12T02:23:16.851953+0000","last_active":"2024-09-12T02:40:04.678952+0000","last_peered":"2024-09-12T02:40:04.678952+0000","last_clean":"2024-09-12T02:40:04.678952+0000","last_became_active":"2024-09-12T02:23:16.851558+0000","last_became_peered":"2024-09-12T02:23:16.851558+0000","last_unstale":"2024-09-12T02:40:04.678952+0000","last_undegraded":"2024-09-12T02:40:04.678952+0000","last_fullsized":"2024-09-12T02:40:04.678952+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":3975,"log_dups_size":0,"ondisk_log_size":3975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:29.852193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20293,"num_write_kb":228813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'576","reported_seq":608,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:08.021504+0000","last_change":"2024-09-12T02:23:03.764310+0000","last_active":"2024-09-12T02:38:08.021504+0000","last_peered":"2024-09-12T02:38:08.021504+0000","last_clean":"2024-09-12T02:38:08.021504+0000","last_became_active":"2024-09-12T02:23:03.764020+0000","last_became_peered":"2024-09-12T02:23:03.764020+0000","last_unstale":"2024-09-12T02:38:08.021504+0000","last_undegraded":"2024-09-12T02:38:08.021504+0000","last_fullsized":"2024-09-12T02:38:08.021504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:25.892874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":574,"num_write_kb":4226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"28'4110","reported_seq":4140,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.726393+0000","last_change":"2024-09-12T02:23:04.771579+0000","last_active":"2024-09-12T02:39:57.726393+0000","last_peered":"2024-09-12T02:39:57.726393+0000","last_clean":"2024-09-12T02:39:57.726393+0000","last_became_active":"2024-09-12T02:23:04.771310+0000","last_became_peered":"2024-09-12T02:23:04.771310+0000","last_unstale":"2024-09-12T02:39:57.726393+0000","last_undegraded":"2024-09-12T02:39:57.726393+0000","last_fullsized":"2024-09-12T02:39:57.726393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4110,"log_dups_size":0,"ondisk_log_size":4110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:05.115474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20660,"num_write_kb":258850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"28'11","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.725985+0000","last_change":"2024-09-12T02:23:15.832757+0000","last_active":"2024-09-12T02:38:07.725985+0000","last_peered":"2024-09-12T02:38:07.725985+0000","last_clean":"2024-09-12T02:38:07.725985+0000","last_became_active":"2024-09-12T02:23:15.832478+0000","last_became_peered":"2024-09-12T02:23:15.832478+0000","last_unstale":"2024-09-12T02:38:07.725985+0000","last_undegraded":"2024-09-12T02:38:07.725985+0000","last_fullsized":"2024-09-12T02:38:07.725985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:29.301251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"28'4897","reported_seq":4920,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.741619+0000","last_change":"2024-09-12T02:23:16.848437+0000","last_active":"2024-09-12T02:40:04.741619+0000","last_peered":"2024-09-12T02:40:04.741619+0000","last_clean":"2024-09-12T02:40:04.741619+0000","last_became_active":"2024-09-12T02:23:16.847063+0000","last_became_peered":"2024-09-12T02:23:16.847063+0000","last_unstale":"2024-09-12T02:40:04.741619+0000","last_undegraded":"2024-09-12T02:40:04.741619+0000","last_fullsized":"2024-09-12T02:40:04.741619+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4897,"log_dups_size":0,"ondisk_log_size":4897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:49.979448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25246,"num_write_kb":285992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"28'6383","reported_seq":6415,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.776503+0000","last_change":"2024-09-12T02:23:04.788489+0000","last_active":"2024-09-12T02:39:57.776503+0000","last_peered":"2024-09-12T02:39:57.776503+0000","last_clean":"2024-09-12T02:39:57.776503+0000","last_became_active":"2024-09-12T02:23:04.788195+0000","last_became_peered":"2024-09-12T02:23:04.788195+0000","last_unstale":"2024-09-12T02:39:57.776503+0000","last_undegraded":"2024-09-12T02:39:57.776503+0000","last_fullsized":"2024-09-12T02:39:57.776503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":6383,"log_dups_size":0,"ondisk_log_size":6383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:51.352859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32308,"num_write_kb":383454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"28'5756","reported_seq":5779,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.673986+0000","last_change":"2024-09-12T02:23:16.843805+0000","last_active":"2024-09-12T02:40:04.673986+0000","last_peered":"2024-09-12T02:40:04.673986+0000","last_clean":"2024-09-12T02:40:04.673986+0000","last_became_active":"2024-09-12T02:23:16.843517+0000","last_became_peered":"2024-09-12T02:23:16.843517+0000","last_unstale":"2024-09-12T02:40:04.673986+0000","last_undegraded":"2024-09-12T02:40:04.673986+0000","last_fullsized":"2024-09-12T02:40:04.673986+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5756,"log_dups_size":0,"ondisk_log_size":5756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:30.873311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29883,"num_write_kb":357322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"28'5059","reported_seq":5091,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.717218+0000","last_change":"2024-09-12T02:23:04.780662+0000","last_active":"2024-09-12T02:39:57.717218+0000","last_peered":"2024-09-12T02:39:57.717218+0000","last_clean":"2024-09-12T02:39:57.717218+0000","last_became_active":"2024-09-12T02:23:04.780402+0000","last_became_peered":"2024-09-12T02:23:04.780402+0000","last_unstale":"2024-09-12T02:39:57.717218+0000","last_undegraded":"2024-09-12T02:39:57.717218+0000","last_fullsized":"2024-09-12T02:39:57.717218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5059,"log_dups_size":0,"ondisk_log_size":5059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:23:00.556487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26551,"num_write_kb":323518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"28'4560","reported_seq":4583,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.699722+0000","last_change":"2024-09-12T02:23:16.852992+0000","last_active":"2024-09-12T02:40:04.699722+0000","last_peered":"2024-09-12T02:40:04.699722+0000","last_clean":"2024-09-12T02:40:04.699722+0000","last_became_active":"2024-09-12T02:23:16.852706+0000","last_became_peered":"2024-09-12T02:23:16.852706+0000","last_unstale":"2024-09-12T02:40:04.699722+0000","last_undegraded":"2024-09-12T02:40:04.699722+0000","last_fullsized":"2024-09-12T02:40:04.699722+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4560,"log_dups_size":0,"ondisk_log_size":4560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:56.896457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23787,"num_write_kb":279744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"28'5935","reported_seq":5967,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.781864+0000","last_change":"2024-09-12T02:23:04.785920+0000","last_active":"2024-09-12T02:39:57.781864+0000","last_peered":"2024-09-12T02:39:57.781864+0000","last_clean":"2024-09-12T02:39:57.781864+0000","last_became_active":"2024-09-12T02:23:04.785422+0000","last_became_peered":"2024-09-12T02:23:04.785422+0000","last_unstale":"2024-09-12T02:39:57.781864+0000","last_undegraded":"2024-09-12T02:39:57.781864+0000","last_fullsized":"2024-09-12T02:39:57.781864+0000","mapping_epoch":20,"log_start":"28'100","ondisk_log_start":"28'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5835,"log_dups_size":0,"ondisk_log_size":5835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:55.106703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30608,"num_write_kb":368510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"28'5374","reported_seq":5397,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.741332+0000","last_change":"2024-09-12T02:23:16.861939+0000","last_active":"2024-09-12T02:40:04.741332+0000","last_peered":"2024-09-12T02:40:04.741332+0000","last_clean":"2024-09-12T02:40:04.741332+0000","last_became_active":"2024-09-12T02:23:16.861658+0000","last_became_peered":"2024-09-12T02:23:16.861658+0000","last_unstale":"2024-09-12T02:40:04.741332+0000","last_undegraded":"2024-09-12T02:40:04.741332+0000","last_fullsized":"2024-09-12T02:40:04.741332+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5374,"log_dups_size":0,"ondisk_log_size":5374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:06.755715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28055,"num_write_kb":329573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"28'4234","reported_seq":4266,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.777821+0000","last_change":"2024-09-12T02:23:04.777018+0000","last_active":"2024-09-12T02:39:57.777821+0000","last_peered":"2024-09-12T02:39:57.777821+0000","last_clean":"2024-09-12T02:39:57.777821+0000","last_became_active":"2024-09-12T02:23:04.776736+0000","last_became_peered":"2024-09-12T02:23:04.776736+0000","last_unstale":"2024-09-12T02:39:57.777821+0000","last_undegraded":"2024-09-12T02:39:57.777821+0000","last_fullsized":"2024-09-12T02:39:57.777821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4234,"log_dups_size":0,"ondisk_log_size":4234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:08.668990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21439,"num_write_kb":262018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"28'6314","reported_seq":6338,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.717796+0000","last_change":"2024-09-12T02:23:16.847615+0000","last_active":"2024-09-12T02:40:04.717796+0000","last_peered":"2024-09-12T02:40:04.717796+0000","last_clean":"2024-09-12T02:40:04.717796+0000","last_became_active":"2024-09-12T02:23:16.847260+0000","last_became_peered":"2024-09-12T02:23:16.847260+0000","last_unstale":"2024-09-12T02:40:04.717796+0000","last_undegraded":"2024-09-12T02:40:04.717796+0000","last_fullsized":"2024-09-12T02:40:04.717796+0000","mapping_epoch":24,"log_start":"28'500","ondisk_log_start":"28'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5814,"log_dups_size":0,"ondisk_log_size":5814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:48.920477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32869,"num_write_kb":377542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"28'4066","reported_seq":4097,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.768701+0000","last_change":"2024-09-12T02:23:04.789372+0000","last_active":"2024-09-12T02:39:57.768701+0000","last_peered":"2024-09-12T02:39:57.768701+0000","last_clean":"2024-09-12T02:39:57.768701+0000","last_became_active":"2024-09-12T02:23:04.789090+0000","last_became_peered":"2024-09-12T02:23:04.789090+0000","last_unstale":"2024-09-12T02:39:57.768701+0000","last_undegraded":"2024-09-12T02:39:57.768701+0000","last_fullsized":"2024-09-12T02:39:57.768701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4066,"log_dups_size":0,"ondisk_log_size":4066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:49.533491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20728,"num_write_kb":267380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"28'3925","reported_seq":3949,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.706991+0000","last_change":"2024-09-12T02:23:16.859000+0000","last_active":"2024-09-12T02:40:04.706991+0000","last_peered":"2024-09-12T02:40:04.706991+0000","last_clean":"2024-09-12T02:40:04.706991+0000","last_became_active":"2024-09-12T02:23:16.858637+0000","last_became_peered":"2024-09-12T02:23:16.858637+0000","last_unstale":"2024-09-12T02:40:04.706991+0000","last_undegraded":"2024-09-12T02:40:04.706991+0000","last_fullsized":"2024-09-12T02:40:04.706991+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":3925,"log_dups_size":0,"ondisk_log_size":3925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:47.915947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20092,"num_write_kb":256658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"28'5046","reported_seq":5077,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.720926+0000","last_change":"2024-09-12T02:23:04.776435+0000","last_active":"2024-09-12T02:39:57.720926+0000","last_peered":"2024-09-12T02:39:57.720926+0000","last_clean":"2024-09-12T02:39:57.720926+0000","last_became_active":"2024-09-12T02:23:04.776120+0000","last_became_peered":"2024-09-12T02:23:04.776120+0000","last_unstale":"2024-09-12T02:39:57.720926+0000","last_undegraded":"2024-09-12T02:39:57.720926+0000","last_fullsized":"2024-09-12T02:39:57.720926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5046,"log_dups_size":0,"ondisk_log_size":5046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:27.985094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26791,"num_write_kb":324401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"28'6719","reported_seq":6743,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.749518+0000","last_change":"2024-09-12T02:23:16.856477+0000","last_active":"2024-09-12T02:40:04.749518+0000","last_peered":"2024-09-12T02:40:04.749518+0000","last_clean":"2024-09-12T02:40:04.749518+0000","last_became_active":"2024-09-12T02:23:16.855839+0000","last_became_peered":"2024-09-12T02:23:16.855839+0000","last_unstale":"2024-09-12T02:40:04.749518+0000","last_undegraded":"2024-09-12T02:40:04.749518+0000","last_fullsized":"2024-09-12T02:40:04.749518+0000","mapping_epoch":24,"log_start":"28'900","ondisk_log_start":"28'900","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5819,"log_dups_size":0,"ondisk_log_size":5819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:42.510184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34627,"num_write_kb":392862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"28'4165","reported_seq":4196,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.847028+0000","last_change":"2024-09-12T02:23:04.788827+0000","last_active":"2024-09-12T02:39:57.847028+0000","last_peered":"2024-09-12T02:39:57.847028+0000","last_clean":"2024-09-12T02:39:57.847028+0000","last_became_active":"2024-09-12T02:23:04.788521+0000","last_became_peered":"2024-09-12T02:23:04.788521+0000","last_unstale":"2024-09-12T02:39:57.847028+0000","last_undegraded":"2024-09-12T02:39:57.847028+0000","last_fullsized":"2024-09-12T02:39:57.847028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4165,"log_dups_size":0,"ondisk_log_size":4165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:24.470245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21249,"num_write_kb":269852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"28'5811","reported_seq":5835,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.723792+0000","last_change":"2024-09-12T02:23:16.838421+0000","last_active":"2024-09-12T02:40:04.723792+0000","last_peered":"2024-09-12T02:40:04.723792+0000","last_clean":"2024-09-12T02:40:04.723792+0000","last_became_active":"2024-09-12T02:23:16.837606+0000","last_became_peered":"2024-09-12T02:23:16.837606+0000","last_unstale":"2024-09-12T02:40:04.723792+0000","last_undegraded":"2024-09-12T02:40:04.723792+0000","last_fullsized":"2024-09-12T02:40:04.723792+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5811,"log_dups_size":0,"ondisk_log_size":5811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:09.704007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30267,"num_write_kb":338418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"28'5427","reported_seq":5444,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.679950+0000","last_change":"2024-09-12T02:23:56.564278+0000","last_active":"2024-09-12T02:39:57.679950+0000","last_peered":"2024-09-12T02:39:57.679950+0000","last_clean":"2024-09-12T02:39:57.679950+0000","last_became_active":"2024-09-12T02:23:56.563943+0000","last_became_peered":"2024-09-12T02:23:56.563943+0000","last_unstale":"2024-09-12T02:39:57.679950+0000","last_undegraded":"2024-09-12T02:39:57.679950+0000","last_fullsized":"2024-09-12T02:39:57.679950+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5427,"log_dups_size":0,"ondisk_log_size":5427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:40.787770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27382,"num_write_kb":347330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"28'4215","reported_seq":4238,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.744076+0000","last_change":"2024-09-12T02:23:16.845296+0000","last_active":"2024-09-12T02:40:04.744076+0000","last_peered":"2024-09-12T02:40:04.744076+0000","last_clean":"2024-09-12T02:40:04.744076+0000","last_became_active":"2024-09-12T02:23:16.844939+0000","last_became_peered":"2024-09-12T02:23:16.844939+0000","last_unstale":"2024-09-12T02:40:04.744076+0000","last_undegraded":"2024-09-12T02:40:04.744076+0000","last_fullsized":"2024-09-12T02:40:04.744076+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4215,"log_dups_size":0,"ondisk_log_size":4215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:16.790822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21581,"num_write_kb":250408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'4161","reported_seq":4178,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.750998+0000","last_change":"2024-09-12T02:23:56.674421+0000","last_active":"2024-09-12T02:39:57.750998+0000","last_peered":"2024-09-12T02:39:57.750998+0000","last_clean":"2024-09-12T02:39:57.750998+0000","last_became_active":"2024-09-12T02:23:56.674143+0000","last_became_peered":"2024-09-12T02:23:56.674143+0000","last_unstale":"2024-09-12T02:39:57.750998+0000","last_undegraded":"2024-09-12T02:39:57.750998+0000","last_fullsized":"2024-09-12T02:39:57.750998+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4161,"log_dups_size":0,"ondisk_log_size":4161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:01.375384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21422,"num_write_kb":266111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2f","version":"28'6100","reported_seq":6123,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.684901+0000","last_change":"2024-09-12T02:23:16.849846+0000","last_active":"2024-09-12T02:40:04.684901+0000","last_peered":"2024-09-12T02:40:04.684901+0000","last_clean":"2024-09-12T02:40:04.684901+0000","last_became_active":"2024-09-12T02:23:16.849585+0000","last_became_peered":"2024-09-12T02:23:16.849585+0000","last_unstale":"2024-09-12T02:40:04.684901+0000","last_undegraded":"2024-09-12T02:40:04.684901+0000","last_fullsized":"2024-09-12T02:40:04.684901+0000","mapping_epoch":24,"log_start":"28'300","ondisk_log_start":"28'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5800,"log_dups_size":0,"ondisk_log_size":5800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:58.775679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30891,"num_write_kb":369602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"28'4576","reported_seq":4607,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.769180+0000","last_change":"2024-09-12T02:23:04.788624+0000","last_active":"2024-09-12T02:39:57.769180+0000","last_peered":"2024-09-12T02:39:57.769180+0000","last_clean":"2024-09-12T02:39:57.769180+0000","last_became_active":"2024-09-12T02:23:04.788352+0000","last_became_peered":"2024-09-12T02:23:04.788352+0000","last_unstale":"2024-09-12T02:39:57.769180+0000","last_undegraded":"2024-09-12T02:39:57.769180+0000","last_fullsized":"2024-09-12T02:39:57.769180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4576,"log_dups_size":0,"ondisk_log_size":4576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:13.961110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23775,"num_write_kb":295982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"28'5142","reported_seq":5165,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.686350+0000","last_change":"2024-09-12T02:23:16.850112+0000","last_active":"2024-09-12T02:40:04.686350+0000","last_peered":"2024-09-12T02:40:04.686350+0000","last_clean":"2024-09-12T02:40:04.686350+0000","last_became_active":"2024-09-12T02:23:16.849831+0000","last_became_peered":"2024-09-12T02:23:16.849831+0000","last_unstale":"2024-09-12T02:40:04.686350+0000","last_undegraded":"2024-09-12T02:40:04.686350+0000","last_fullsized":"2024-09-12T02:40:04.686350+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5142,"log_dups_size":0,"ondisk_log_size":5142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:42.625762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26862,"num_write_kb":308481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"28'4731","reported_seq":4762,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.835535+0000","last_change":"2024-09-12T02:23:04.785685+0000","last_active":"2024-09-12T02:39:57.835535+0000","last_peered":"2024-09-12T02:39:57.835535+0000","last_clean":"2024-09-12T02:39:57.835535+0000","last_became_active":"2024-09-12T02:23:04.784945+0000","last_became_peered":"2024-09-12T02:23:04.784945+0000","last_unstale":"2024-09-12T02:39:57.835535+0000","last_undegraded":"2024-09-12T02:39:57.835535+0000","last_fullsized":"2024-09-12T02:39:57.835535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4731,"log_dups_size":0,"ondisk_log_size":4731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:36.658436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24557,"num_write_kb":319695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"28'4794","reported_seq":4817,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.688321+0000","last_change":"2024-09-12T02:23:16.846108+0000","last_active":"2024-09-12T02:40:04.688321+0000","last_peered":"2024-09-12T02:40:04.688321+0000","last_clean":"2024-09-12T02:40:04.688321+0000","last_became_active":"2024-09-12T02:23:16.845793+0000","last_became_peered":"2024-09-12T02:23:16.845793+0000","last_unstale":"2024-09-12T02:40:04.688321+0000","last_undegraded":"2024-09-12T02:40:04.688321+0000","last_fullsized":"2024-09-12T02:40:04.688321+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4794,"log_dups_size":0,"ondisk_log_size":4794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:36.274858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23926,"num_write_kb":300628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"28'4561","reported_seq":4592,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.804691+0000","last_change":"2024-09-12T02:23:04.785849+0000","last_active":"2024-09-12T02:39:57.804691+0000","last_peered":"2024-09-12T02:39:57.804691+0000","last_clean":"2024-09-12T02:39:57.804691+0000","last_became_active":"2024-09-12T02:23:04.785511+0000","last_became_peered":"2024-09-12T02:23:04.785511+0000","last_unstale":"2024-09-12T02:39:57.804691+0000","last_undegraded":"2024-09-12T02:39:57.804691+0000","last_fullsized":"2024-09-12T02:39:57.804691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4561,"log_dups_size":0,"ondisk_log_size":4561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:28.670102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23484,"num_write_kb":303052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"28'5809","reported_seq":5832,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.701362+0000","last_change":"2024-09-12T02:23:16.855615+0000","last_active":"2024-09-12T02:40:04.701362+0000","last_peered":"2024-09-12T02:40:04.701362+0000","last_clean":"2024-09-12T02:40:04.701362+0000","last_became_active":"2024-09-12T02:23:16.855278+0000","last_became_peered":"2024-09-12T02:23:16.855278+0000","last_unstale":"2024-09-12T02:40:04.701362+0000","last_undegraded":"2024-09-12T02:40:04.701362+0000","last_fullsized":"2024-09-12T02:40:04.701362+0000","mapping_epoch":24,"log_start":"28'300","ondisk_log_start":"28'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5509,"log_dups_size":0,"ondisk_log_size":5509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:34.214175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30461,"num_write_kb":343399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"28'4620","reported_seq":4651,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.744548+0000","last_change":"2024-09-12T02:23:04.789575+0000","last_active":"2024-09-12T02:39:57.744548+0000","last_peered":"2024-09-12T02:39:57.744548+0000","last_clean":"2024-09-12T02:39:57.744548+0000","last_became_active":"2024-09-12T02:23:04.789296+0000","last_became_peered":"2024-09-12T02:23:04.789296+0000","last_unstale":"2024-09-12T02:39:57.744548+0000","last_undegraded":"2024-09-12T02:39:57.744548+0000","last_fullsized":"2024-09-12T02:39:57.744548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4620,"log_dups_size":0,"ondisk_log_size":4620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:13.166139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23568,"num_write_kb":295197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"28'5012","reported_seq":5035,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.717856+0000","last_change":"2024-09-12T02:23:16.858045+0000","last_active":"2024-09-12T02:40:04.717856+0000","last_peered":"2024-09-12T02:40:04.717856+0000","last_clean":"2024-09-12T02:40:04.717856+0000","last_became_active":"2024-09-12T02:23:16.857772+0000","last_became_peered":"2024-09-12T02:23:16.857772+0000","last_unstale":"2024-09-12T02:40:04.717856+0000","last_undegraded":"2024-09-12T02:40:04.717856+0000","last_fullsized":"2024-09-12T02:40:04.717856+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5012,"log_dups_size":0,"ondisk_log_size":5012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:35.598279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25770,"num_write_kb":312200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"28'4649","reported_seq":4680,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.749517+0000","last_change":"2024-09-12T02:23:04.777450+0000","last_active":"2024-09-12T02:39:57.749517+0000","last_peered":"2024-09-12T02:39:57.749517+0000","last_clean":"2024-09-12T02:39:57.749517+0000","last_became_active":"2024-09-12T02:23:04.776825+0000","last_became_peered":"2024-09-12T02:23:04.776825+0000","last_unstale":"2024-09-12T02:39:57.749517+0000","last_undegraded":"2024-09-12T02:39:57.749517+0000","last_fullsized":"2024-09-12T02:39:57.749517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4649,"log_dups_size":0,"ondisk_log_size":4649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:40.315075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22974,"num_write_kb":296824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"28'4733","reported_seq":4756,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.663806+0000","last_change":"2024-09-12T02:23:16.846032+0000","last_active":"2024-09-12T02:40:04.663806+0000","last_peered":"2024-09-12T02:40:04.663806+0000","last_clean":"2024-09-12T02:40:04.663806+0000","last_became_active":"2024-09-12T02:23:16.845492+0000","last_became_peered":"2024-09-12T02:23:16.845492+0000","last_unstale":"2024-09-12T02:40:04.663806+0000","last_undegraded":"2024-09-12T02:40:04.663806+0000","last_fullsized":"2024-09-12T02:40:04.663806+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4733,"log_dups_size":0,"ondisk_log_size":4733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:18.785798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24040,"num_write_kb":276615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"28'3733","reported_seq":3764,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.754418+0000","last_change":"2024-09-12T02:23:04.791378+0000","last_active":"2024-09-12T02:39:57.754418+0000","last_peered":"2024-09-12T02:39:57.754418+0000","last_clean":"2024-09-12T02:39:57.754418+0000","last_became_active":"2024-09-12T02:23:04.790926+0000","last_became_peered":"2024-09-12T02:23:04.790926+0000","last_unstale":"2024-09-12T02:39:57.754418+0000","last_undegraded":"2024-09-12T02:39:57.754418+0000","last_fullsized":"2024-09-12T02:39:57.754418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":3733,"log_dups_size":0,"ondisk_log_size":3733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:34.764210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18622,"num_write_kb":238300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"28'5122","reported_seq":5145,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.676752+0000","last_change":"2024-09-12T02:23:16.851099+0000","last_active":"2024-09-12T02:40:04.676752+0000","last_peered":"2024-09-12T02:40:04.676752+0000","last_clean":"2024-09-12T02:40:04.676752+0000","last_became_active":"2024-09-12T02:23:16.850747+0000","last_became_peered":"2024-09-12T02:23:16.850747+0000","last_unstale":"2024-09-12T02:40:04.676752+0000","last_undegraded":"2024-09-12T02:40:04.676752+0000","last_fullsized":"2024-09-12T02:40:04.676752+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5122,"log_dups_size":0,"ondisk_log_size":5122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:01:31.445590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26303,"num_write_kb":306134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"28'5815","reported_seq":5846,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.831090+0000","last_change":"2024-09-12T02:23:04.789439+0000","last_active":"2024-09-12T02:39:57.831090+0000","last_peered":"2024-09-12T02:39:57.831090+0000","last_clean":"2024-09-12T02:39:57.831090+0000","last_became_active":"2024-09-12T02:23:04.787421+0000","last_became_peered":"2024-09-12T02:23:04.787421+0000","last_unstale":"2024-09-12T02:39:57.831090+0000","last_undegraded":"2024-09-12T02:39:57.831090+0000","last_fullsized":"2024-09-12T02:39:57.831090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5815,"log_dups_size":0,"ondisk_log_size":5815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:44.295056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29660,"num_write_kb":364722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"28'5421","reported_seq":5443,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.709758+0000","last_change":"2024-09-12T02:23:16.850923+0000","last_active":"2024-09-12T02:40:04.709758+0000","last_peered":"2024-09-12T02:40:04.709758+0000","last_clean":"2024-09-12T02:40:04.709758+0000","last_became_active":"2024-09-12T02:23:16.850609+0000","last_became_peered":"2024-09-12T02:23:16.850609+0000","last_unstale":"2024-09-12T02:40:04.709758+0000","last_undegraded":"2024-09-12T02:40:04.709758+0000","last_fullsized":"2024-09-12T02:40:04.709758+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5421,"log_dups_size":0,"ondisk_log_size":5421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:52.110438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28803,"num_write_kb":344817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"28'4311","reported_seq":4342,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.771185+0000","last_change":"2024-09-12T02:23:04.790532+0000","last_active":"2024-09-12T02:39:57.771185+0000","last_peered":"2024-09-12T02:39:57.771185+0000","last_clean":"2024-09-12T02:39:57.771185+0000","last_became_active":"2024-09-12T02:23:04.789229+0000","last_became_peered":"2024-09-12T02:23:04.789229+0000","last_unstale":"2024-09-12T02:39:57.771185+0000","last_undegraded":"2024-09-12T02:39:57.771185+0000","last_fullsized":"2024-09-12T02:39:57.771185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4311,"log_dups_size":0,"ondisk_log_size":4311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:59.901665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22556,"num_write_kb":270677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"28'6535","reported_seq":6557,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.676395+0000","last_change":"2024-09-12T02:23:16.856612+0000","last_active":"2024-09-12T02:40:04.676395+0000","last_peered":"2024-09-12T02:40:04.676395+0000","last_clean":"2024-09-12T02:40:04.676395+0000","last_became_active":"2024-09-12T02:23:16.856290+0000","last_became_peered":"2024-09-12T02:23:16.856290+0000","last_unstale":"2024-09-12T02:40:04.676395+0000","last_undegraded":"2024-09-12T02:40:04.676395+0000","last_fullsized":"2024-09-12T02:40:04.676395+0000","mapping_epoch":24,"log_start":"28'1000","ondisk_log_start":"28'1000","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5535,"log_dups_size":0,"ondisk_log_size":5535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:14.846281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35147,"num_write_kb":386723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"28'4664","reported_seq":4695,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.756776+0000","last_change":"2024-09-12T02:23:04.782490+0000","last_active":"2024-09-12T02:39:57.756776+0000","last_peered":"2024-09-12T02:39:57.756776+0000","last_clean":"2024-09-12T02:39:57.756776+0000","last_became_active":"2024-09-12T02:23:04.782183+0000","last_became_peered":"2024-09-12T02:23:04.782183+0000","last_unstale":"2024-09-12T02:39:57.756776+0000","last_undegraded":"2024-09-12T02:39:57.756776+0000","last_fullsized":"2024-09-12T02:39:57.756776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4664,"log_dups_size":0,"ondisk_log_size":4664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:28.699880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23511,"num_write_kb":303118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"28'4146","reported_seq":4168,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.701442+0000","last_change":"2024-09-12T02:23:16.858100+0000","last_active":"2024-09-12T02:40:04.701442+0000","last_peered":"2024-09-12T02:40:04.701442+0000","last_clean":"2024-09-12T02:40:04.701442+0000","last_became_active":"2024-09-12T02:23:16.857818+0000","last_became_peered":"2024-09-12T02:23:16.857818+0000","last_unstale":"2024-09-12T02:40:04.701442+0000","last_undegraded":"2024-09-12T02:40:04.701442+0000","last_fullsized":"2024-09-12T02:40:04.701442+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4146,"log_dups_size":0,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:45.991170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21288,"num_write_kb":257331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"28'4600","reported_seq":4631,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.732332+0000","last_change":"2024-09-12T02:23:04.787140+0000","last_active":"2024-09-12T02:39:57.732332+0000","last_peered":"2024-09-12T02:39:57.732332+0000","last_clean":"2024-09-12T02:39:57.732332+0000","last_became_active":"2024-09-12T02:23:04.786799+0000","last_became_peered":"2024-09-12T02:23:04.786799+0000","last_unstale":"2024-09-12T02:39:57.732332+0000","last_undegraded":"2024-09-12T02:39:57.732332+0000","last_fullsized":"2024-09-12T02:39:57.732332+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4600,"log_dups_size":0,"ondisk_log_size":4600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:31.639605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23822,"num_write_kb":304357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"28'5170","reported_seq":5192,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.691998+0000","last_change":"2024-09-12T02:23:16.846100+0000","last_active":"2024-09-12T02:40:04.691998+0000","last_peered":"2024-09-12T02:40:04.691998+0000","last_clean":"2024-09-12T02:40:04.691998+0000","last_became_active":"2024-09-12T02:23:16.845749+0000","last_became_peered":"2024-09-12T02:23:16.845749+0000","last_unstale":"2024-09-12T02:40:04.691998+0000","last_undegraded":"2024-09-12T02:40:04.691998+0000","last_fullsized":"2024-09-12T02:40:04.691998+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5170,"log_dups_size":0,"ondisk_log_size":5170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:42.783366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26244,"num_write_kb":301879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"28'3980","reported_seq":4011,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.731214+0000","last_change":"2024-09-12T02:23:04.782128+0000","last_active":"2024-09-12T02:39:57.731214+0000","last_peered":"2024-09-12T02:39:57.731214+0000","last_clean":"2024-09-12T02:39:57.731214+0000","last_became_active":"2024-09-12T02:23:04.781101+0000","last_became_peered":"2024-09-12T02:23:04.781101+0000","last_unstale":"2024-09-12T02:39:57.731214+0000","last_undegraded":"2024-09-12T02:39:57.731214+0000","last_fullsized":"2024-09-12T02:39:57.731214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":3980,"log_dups_size":0,"ondisk_log_size":3980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:49.421147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20651,"num_write_kb":267035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"28'5235","reported_seq":5258,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.711216+0000","last_change":"2024-09-12T02:23:16.836968+0000","last_active":"2024-09-12T02:40:04.711216+0000","last_peered":"2024-09-12T02:40:04.711216+0000","last_clean":"2024-09-12T02:40:04.711216+0000","last_became_active":"2024-09-12T02:23:16.836561+0000","last_became_peered":"2024-09-12T02:23:16.836561+0000","last_unstale":"2024-09-12T02:40:04.711216+0000","last_undegraded":"2024-09-12T02:40:04.711216+0000","last_fullsized":"2024-09-12T02:40:04.711216+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5235,"log_dups_size":0,"ondisk_log_size":5235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:08.765569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26710,"num_write_kb":316033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"28'3967","reported_seq":3998,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.791291+0000","last_change":"2024-09-12T02:23:04.787034+0000","last_active":"2024-09-12T02:39:57.791291+0000","last_peered":"2024-09-12T02:39:57.791291+0000","last_clean":"2024-09-12T02:39:57.791291+0000","last_became_active":"2024-09-12T02:23:04.786044+0000","last_became_peered":"2024-09-12T02:23:04.786044+0000","last_unstale":"2024-09-12T02:39:57.791291+0000","last_undegraded":"2024-09-12T02:39:57.791291+0000","last_fullsized":"2024-09-12T02:39:57.791291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":3967,"log_dups_size":0,"ondisk_log_size":3967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:07.183028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20368,"num_write_kb":253735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"28'4409","reported_seq":4431,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.657803+0000","last_change":"2024-09-12T02:23:16.846114+0000","last_active":"2024-09-12T02:40:04.657803+0000","last_peered":"2024-09-12T02:40:04.657803+0000","last_clean":"2024-09-12T02:40:04.657803+0000","last_became_active":"2024-09-12T02:23:16.845757+0000","last_became_peered":"2024-09-12T02:23:16.845757+0000","last_unstale":"2024-09-12T02:40:04.657803+0000","last_undegraded":"2024-09-12T02:40:04.657803+0000","last_fullsized":"2024-09-12T02:40:04.657803+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4409,"log_dups_size":0,"ondisk_log_size":4409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:17:52.019813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22900,"num_write_kb":275935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"28'4251","reported_seq":4282,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.798750+0000","last_change":"2024-09-12T02:23:04.785662+0000","last_active":"2024-09-12T02:39:57.798750+0000","last_peered":"2024-09-12T02:39:57.798750+0000","last_clean":"2024-09-12T02:39:57.798750+0000","last_became_active":"2024-09-12T02:23:04.785375+0000","last_became_peered":"2024-09-12T02:23:04.785375+0000","last_unstale":"2024-09-12T02:39:57.798750+0000","last_undegraded":"2024-09-12T02:39:57.798750+0000","last_fullsized":"2024-09-12T02:39:57.798750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4251,"log_dups_size":0,"ondisk_log_size":4251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:44.295056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21731,"num_write_kb":283663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"28'4658","reported_seq":4681,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.746879+0000","last_change":"2024-09-12T02:23:16.858175+0000","last_active":"2024-09-12T02:40:04.746879+0000","last_peered":"2024-09-12T02:40:04.746879+0000","last_clean":"2024-09-12T02:40:04.746879+0000","last_became_active":"2024-09-12T02:23:16.857873+0000","last_became_peered":"2024-09-12T02:23:16.857873+0000","last_unstale":"2024-09-12T02:40:04.746879+0000","last_undegraded":"2024-09-12T02:40:04.746879+0000","last_fullsized":"2024-09-12T02:40:04.746879+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4658,"log_dups_size":0,"ondisk_log_size":4658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:54.535867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24616,"num_write_kb":279029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"28'5811","reported_seq":5842,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.850760+0000","last_change":"2024-09-12T02:23:04.791929+0000","last_active":"2024-09-12T02:39:57.850760+0000","last_peered":"2024-09-12T02:39:57.850760+0000","last_clean":"2024-09-12T02:39:57.850760+0000","last_became_active":"2024-09-12T02:23:04.791622+0000","last_became_peered":"2024-09-12T02:23:04.791622+0000","last_unstale":"2024-09-12T02:39:57.850760+0000","last_undegraded":"2024-09-12T02:39:57.850760+0000","last_fullsized":"2024-09-12T02:39:57.850760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5811,"log_dups_size":0,"ondisk_log_size":5811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:35.012685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30224,"num_write_kb":350457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"28'5106","reported_seq":5129,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.667862+0000","last_change":"2024-09-12T02:23:16.849985+0000","last_active":"2024-09-12T02:40:04.667862+0000","last_peered":"2024-09-12T02:40:04.667862+0000","last_clean":"2024-09-12T02:40:04.667862+0000","last_became_active":"2024-09-12T02:23:16.849641+0000","last_became_peered":"2024-09-12T02:23:16.849641+0000","last_unstale":"2024-09-12T02:40:04.667862+0000","last_undegraded":"2024-09-12T02:40:04.667862+0000","last_fullsized":"2024-09-12T02:40:04.667862+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5106,"log_dups_size":0,"ondisk_log_size":5106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:28.373543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25610,"num_write_kb":311590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"28'5712","reported_seq":5748,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.829068+0000","last_change":"2024-09-12T02:23:56.084447+0000","last_active":"2024-09-12T02:39:57.829068+0000","last_peered":"2024-09-12T02:39:57.829068+0000","last_clean":"2024-09-12T02:39:57.829068+0000","last_became_active":"2024-09-12T02:23:56.084173+0000","last_became_peered":"2024-09-12T02:23:56.084173+0000","last_unstale":"2024-09-12T02:39:57.829068+0000","last_undegraded":"2024-09-12T02:39:57.829068+0000","last_fullsized":"2024-09-12T02:39:57.829068+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5712,"log_dups_size":0,"ondisk_log_size":5712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:38.004804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30266,"num_write_kb":367055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"28'6924","reported_seq":6948,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.724208+0000","last_change":"2024-09-12T02:23:16.840250+0000","last_active":"2024-09-12T02:40:04.724208+0000","last_peered":"2024-09-12T02:40:04.724208+0000","last_clean":"2024-09-12T02:40:04.724208+0000","last_became_active":"2024-09-12T02:23:16.839914+0000","last_became_peered":"2024-09-12T02:23:16.839914+0000","last_unstale":"2024-09-12T02:40:04.724208+0000","last_undegraded":"2024-09-12T02:40:04.724208+0000","last_fullsized":"2024-09-12T02:40:04.724208+0000","mapping_epoch":24,"log_start":"28'1700","ondisk_log_start":"28'1700","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5224,"log_dups_size":0,"ondisk_log_size":5224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:04.798197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36307,"num_write_kb":403764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"28'4960","reported_seq":4990,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.771890+0000","last_change":"2024-09-12T02:23:04.779648+0000","last_active":"2024-09-12T02:39:57.771890+0000","last_peered":"2024-09-12T02:39:57.771890+0000","last_clean":"2024-09-12T02:39:57.771890+0000","last_became_active":"2024-09-12T02:23:04.779384+0000","last_became_peered":"2024-09-12T02:23:04.779384+0000","last_unstale":"2024-09-12T02:39:57.771890+0000","last_undegraded":"2024-09-12T02:39:57.771890+0000","last_fullsized":"2024-09-12T02:39:57.771890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4960,"log_dups_size":0,"ondisk_log_size":4960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:41.491471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24704,"num_write_kb":320180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"28'4652","reported_seq":4676,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.706923+0000","last_change":"2024-09-12T02:23:16.850060+0000","last_active":"2024-09-12T02:40:04.706923+0000","last_peered":"2024-09-12T02:40:04.706923+0000","last_clean":"2024-09-12T02:40:04.706923+0000","last_became_active":"2024-09-12T02:23:16.849744+0000","last_became_peered":"2024-09-12T02:23:16.849744+0000","last_unstale":"2024-09-12T02:40:04.706923+0000","last_undegraded":"2024-09-12T02:40:04.706923+0000","last_fullsized":"2024-09-12T02:40:04.706923+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4652,"log_dups_size":0,"ondisk_log_size":4652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:34.130685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24125,"num_write_kb":272841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"28'4717","reported_seq":4733,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.732879+0000","last_change":"2024-09-12T02:23:55.991674+0000","last_active":"2024-09-12T02:39:57.732879+0000","last_peered":"2024-09-12T02:39:57.732879+0000","last_clean":"2024-09-12T02:39:57.732879+0000","last_became_active":"2024-09-12T02:23:55.991300+0000","last_became_peered":"2024-09-12T02:23:55.991300+0000","last_unstale":"2024-09-12T02:39:57.732879+0000","last_undegraded":"2024-09-12T02:39:57.732879+0000","last_fullsized":"2024-09-12T02:39:57.732879+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4717,"log_dups_size":0,"ondisk_log_size":4717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:23.613509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24759,"num_write_kb":295935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3c","version":"28'4790","reported_seq":4814,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.669505+0000","last_change":"2024-09-12T02:23:16.862034+0000","last_active":"2024-09-12T02:40:04.669505+0000","last_peered":"2024-09-12T02:40:04.669505+0000","last_clean":"2024-09-12T02:40:04.669505+0000","last_became_active":"2024-09-12T02:23:16.861441+0000","last_became_peered":"2024-09-12T02:23:16.861441+0000","last_unstale":"2024-09-12T02:40:04.669505+0000","last_undegraded":"2024-09-12T02:40:04.669505+0000","last_fullsized":"2024-09-12T02:40:04.669505+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4790,"log_dups_size":0,"ondisk_log_size":4790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:24.332614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25639,"num_write_kb":287197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"28'4345","reported_seq":4375,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.826467+0000","last_change":"2024-09-12T02:23:04.788890+0000","last_active":"2024-09-12T02:39:57.826467+0000","last_peered":"2024-09-12T02:39:57.826467+0000","last_clean":"2024-09-12T02:39:57.826467+0000","last_became_active":"2024-09-12T02:23:04.788617+0000","last_became_peered":"2024-09-12T02:23:04.788617+0000","last_unstale":"2024-09-12T02:39:57.826467+0000","last_undegraded":"2024-09-12T02:39:57.826467+0000","last_fullsized":"2024-09-12T02:39:57.826467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4345,"log_dups_size":0,"ondisk_log_size":4345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:24.194151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22438,"num_write_kb":266069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"28'5149","reported_seq":5173,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.705526+0000","last_change":"2024-09-12T02:23:16.855853+0000","last_active":"2024-09-12T02:40:04.705526+0000","last_peered":"2024-09-12T02:40:04.705526+0000","last_clean":"2024-09-12T02:40:04.705526+0000","last_became_active":"2024-09-12T02:23:16.855437+0000","last_became_peered":"2024-09-12T02:23:16.855437+0000","last_unstale":"2024-09-12T02:40:04.705526+0000","last_undegraded":"2024-09-12T02:40:04.705526+0000","last_fullsized":"2024-09-12T02:40:04.705526+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5149,"log_dups_size":0,"ondisk_log_size":5149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:27.557862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26098,"num_write_kb":313495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'5428","reported_seq":5458,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.753841+0000","last_change":"2024-09-12T02:23:04.777165+0000","last_active":"2024-09-12T02:39:57.753841+0000","last_peered":"2024-09-12T02:39:57.753841+0000","last_clean":"2024-09-12T02:39:57.753841+0000","last_became_active":"2024-09-12T02:23:04.776857+0000","last_became_peered":"2024-09-12T02:23:04.776857+0000","last_unstale":"2024-09-12T02:39:57.753841+0000","last_undegraded":"2024-09-12T02:39:57.753841+0000","last_fullsized":"2024-09-12T02:39:57.753841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5428,"log_dups_size":0,"ondisk_log_size":5428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:28.309591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27088,"num_write_kb":350175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"28'4355","reported_seq":4377,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.719330+0000","last_change":"2024-09-12T02:23:16.849235+0000","last_active":"2024-09-12T02:40:04.719330+0000","last_peered":"2024-09-12T02:40:04.719330+0000","last_clean":"2024-09-12T02:40:04.719330+0000","last_became_active":"2024-09-12T02:23:16.848936+0000","last_became_peered":"2024-09-12T02:23:16.848936+0000","last_unstale":"2024-09-12T02:40:04.719330+0000","last_undegraded":"2024-09-12T02:40:04.719330+0000","last_fullsized":"2024-09-12T02:40:04.719330+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4355,"log_dups_size":0,"ondisk_log_size":4355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:32.415375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22650,"num_write_kb":266857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"28'3929","reported_seq":3961,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.823217+0000","last_change":"2024-09-12T02:23:04.786772+0000","last_active":"2024-09-12T02:39:57.823217+0000","last_peered":"2024-09-12T02:39:57.823217+0000","last_clean":"2024-09-12T02:39:57.823217+0000","last_became_active":"2024-09-12T02:23:04.786509+0000","last_became_peered":"2024-09-12T02:23:04.786509+0000","last_unstale":"2024-09-12T02:39:57.823217+0000","last_undegraded":"2024-09-12T02:39:57.823217+0000","last_fullsized":"2024-09-12T02:39:57.823217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":3929,"log_dups_size":0,"ondisk_log_size":3929,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:01.755827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20681,"num_write_kb":267297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"28'6034","reported_seq":6056,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.676402+0000","last_change":"2024-09-12T02:23:16.834788+0000","last_active":"2024-09-12T02:40:04.676402+0000","last_peered":"2024-09-12T02:40:04.676402+0000","last_clean":"2024-09-12T02:40:04.676402+0000","last_became_active":"2024-09-12T02:23:16.834483+0000","last_became_peered":"2024-09-12T02:23:16.834483+0000","last_unstale":"2024-09-12T02:40:04.676402+0000","last_undegraded":"2024-09-12T02:40:04.676402+0000","last_fullsized":"2024-09-12T02:40:04.676402+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":6034,"log_dups_size":0,"ondisk_log_size":6034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:23.441282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30335,"num_write_kb":363259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"28'4664","reported_seq":4696,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.730630+0000","last_change":"2024-09-12T02:23:04.778772+0000","last_active":"2024-09-12T02:39:57.730630+0000","last_peered":"2024-09-12T02:39:57.730630+0000","last_clean":"2024-09-12T02:39:57.730630+0000","last_became_active":"2024-09-12T02:23:04.778445+0000","last_became_peered":"2024-09-12T02:23:04.778445+0000","last_unstale":"2024-09-12T02:39:57.730630+0000","last_undegraded":"2024-09-12T02:39:57.730630+0000","last_fullsized":"2024-09-12T02:39:57.730630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4664,"log_dups_size":0,"ondisk_log_size":4664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:58.292023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23827,"num_write_kb":304439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"28'5564","reported_seq":5586,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.750707+0000","last_change":"2024-09-12T02:23:16.844170+0000","last_active":"2024-09-12T02:40:04.750707+0000","last_peered":"2024-09-12T02:40:04.750707+0000","last_clean":"2024-09-12T02:40:04.750707+0000","last_became_active":"2024-09-12T02:23:16.843880+0000","last_became_peered":"2024-09-12T02:23:16.843880+0000","last_unstale":"2024-09-12T02:40:04.750707+0000","last_undegraded":"2024-09-12T02:40:04.750707+0000","last_fullsized":"2024-09-12T02:40:04.750707+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5564,"log_dups_size":0,"ondisk_log_size":5564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:59.283416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28051,"num_write_kb":333672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"28'5549","reported_seq":5581,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.720949+0000","last_change":"2024-09-12T02:23:04.785821+0000","last_active":"2024-09-12T02:39:57.720949+0000","last_peered":"2024-09-12T02:39:57.720949+0000","last_clean":"2024-09-12T02:39:57.720949+0000","last_became_active":"2024-09-12T02:23:04.785516+0000","last_became_peered":"2024-09-12T02:23:04.785516+0000","last_unstale":"2024-09-12T02:39:57.720949+0000","last_undegraded":"2024-09-12T02:39:57.720949+0000","last_fullsized":"2024-09-12T02:39:57.720949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5549,"log_dups_size":0,"ondisk_log_size":5549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:42.400040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28712,"num_write_kb":373148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"28'5101","reported_seq":5123,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.723690+0000","last_change":"2024-09-12T02:23:16.844145+0000","last_active":"2024-09-12T02:40:04.723690+0000","last_peered":"2024-09-12T02:40:04.723690+0000","last_clean":"2024-09-12T02:40:04.723690+0000","last_became_active":"2024-09-12T02:23:16.843815+0000","last_became_peered":"2024-09-12T02:23:16.843815+0000","last_unstale":"2024-09-12T02:40:04.723690+0000","last_undegraded":"2024-09-12T02:40:04.723690+0000","last_fullsized":"2024-09-12T02:40:04.723690+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5101,"log_dups_size":0,"ondisk_log_size":5101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:31.789317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26856,"num_write_kb":304403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"28'3999","reported_seq":4031,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.797803+0000","last_change":"2024-09-12T02:23:04.791204+0000","last_active":"2024-09-12T02:39:57.797803+0000","last_peered":"2024-09-12T02:39:57.797803+0000","last_clean":"2024-09-12T02:39:57.797803+0000","last_became_active":"2024-09-12T02:23:04.790906+0000","last_became_peered":"2024-09-12T02:23:04.790906+0000","last_unstale":"2024-09-12T02:39:57.797803+0000","last_undegraded":"2024-09-12T02:39:57.797803+0000","last_fullsized":"2024-09-12T02:39:57.797803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":3999,"log_dups_size":0,"ondisk_log_size":3999,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:16.336873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20671,"num_write_kb":258921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1731204,"num_write_kb":20050774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":327719,"ondisk_log_size":327719,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":18273247,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":57,"num_read_kb":123,"num_write":4416,"num_write_kb":19551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36610048,"data_stored":36546494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3634,"ondisk_log_size":3634,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1541207,"num_write_kb":19284974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":299497,"ondisk_log_size":299497,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":18199792,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":62,"num_read_kb":127,"num_write":4449,"num_write_kb":19478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36462592,"data_stored":36399584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3678,"ondisk_log_size":3678,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476947,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1212344,"kb_used_data":13160,"kb_used_omap":1,"kb_used_meta":1199166,"kb_avail":93159496,"statfs":{"total":96636764160,"available":95395323904,"internally_reserved":0,"allocated":13475840,"data_stored":13292277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":1227946442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476949,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":757460,"kb_used_data":9796,"kb_used_omap":1,"kb_used_meta":747646,"kb_avail":93614380,"statfs":{"total":96636764160,"available":95861125120,"internally_reserved":0,"allocated":10031104,"data_stored":9841247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":765589958},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476948,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1147152,"kb_used_data":4480,"kb_used_omap":1,"kb_used_meta":1142654,"kb_avail":93224688,"statfs":{"total":96636764160,"available":95462080512,"internally_reserved":0,"allocated":4587520,"data_stored":4401471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1170078149},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509650,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1232784,"kb_used_data":11264,"kb_used_omap":1,"kb_used_meta":1221502,"kb_avail":93139056,"statfs":{"total":96636764160,"available":95374393344,"internally_reserved":0,"allocated":11534336,"data_stored":11334750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1250818501},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509649,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":757512,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":757118,"kb_avail":93614328,"statfs":{"total":96636764160,"available":95861071872,"internally_reserved":0,"allocated":385024,"data_stored":206475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":775289285},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509652,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1005564,"kb_used_data":9068,"kb_used_omap":1,"kb_used_meta":996478,"kb_avail":93366276,"statfs":{"total":96636764160,"available":95607066624,"internally_reserved":0,"allocated":9285632,"data_stored":9097939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1020393925},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542355,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1235704,"kb_used_data":18152,"kb_used_omap":1,"kb_used_meta":1217534,"kb_avail":93136136,"statfs":{"total":96636764160,"available":95371403264,"internally_reserved":0,"allocated":18587648,"data_stored":18391468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":1246755271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542354,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1000768,"kb_used_data":8496,"kb_used_omap":1,"kb_used_meta":992254,"kb_avail":93371072,"statfs":{"total":96636764160,"available":95611977728,"internally_reserved":0,"allocated":8699904,"data_stored":8507787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1016068549},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4206592,"data_stored":4194942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":88080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8486912,"data_stored":8477360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5541888,"data_stored":5527456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5537792,"data_stored":5528002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12583494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9809920,"data_stored":9795783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5701632,"data_stored":5688969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4292608,"data_stored":4283056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:40:11.497 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:40:11.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.600+0000 7f189d99f640 1 Processor -- start 2024-09-12T02:40:11.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.600+0000 7f189d99f640 1 -- start start 2024-09-12T02:40:11.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.601+0000 7f189d99f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f18981505f0 0x7f1898153910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:11.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.601+0000 7f189d99f640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f18980c42b0 0x7f18980c4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:11.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.601+0000 7f189d99f640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18980c5940 con 0x7f18980c69c0 2024-09-12T02:40:11.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.601+0000 7f189d99f640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f18980c7860 con 0x7f18981505f0 2024-09-12T02:40:11.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.601+0000 7f189d99f640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f18980c5c00 con 0x7f18980c42b0 2024-09-12T02:40:11.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.601+0000 7f1896ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f18981505f0 0x7f1898153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:11.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.601+0000 7f1896ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f18981505f0 0x7f1898153910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40370/0 (socket says 172.21.15.60:40370) 2024-09-12T02:40:11.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.601+0000 7f188ffff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f18980c69c0 0x7f18980c2440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:42790/0 (socket says 172.21.15.60:42790) 2024-09-12T02:40:11.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.601+0000 7f1896ffd640 1 -- 172.21.15.60:0/2459789923 learned_addr learned my addr 172.21.15.60:0/2459789923 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:11.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.601+0000 7f18977fe640 1 --2- 172.21.15.60:0/2459789923 >> v2:172.21.15.105:3300/0 conn(0x7f18980c42b0 0x7f18980c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:11.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.601+0000 7f1896ffd640 1 -- 172.21.15.60:0/2459789923 >> v2:172.21.15.105:3300/0 conn(0x7f18980c42b0 msgr2=0x7f18980c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:11.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.601+0000 7f1896ffd640 1 --2- 172.21.15.60:0/2459789923 >> v2:172.21.15.105:3300/0 conn(0x7f18980c42b0 0x7f18980c4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.601+0000 7f1896ffd640 1 -- 172.21.15.60:0/2459789923 >> v1:172.21.15.60:6789/0 conn(0x7f18980c69c0 legacy=0x7f18980c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:11.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.601+0000 7f1896ffd640 1 -- 172.21.15.60:0/2459789923 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18980c5ee0 con 0x7f18981505f0 2024-09-12T02:40:11.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.601+0000 7f18977fe640 1 --2- 172.21.15.60:0/2459789923 >> v2:172.21.15.105:3300/0 conn(0x7f18980c42b0 0x7f18980c4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:40:11.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.602+0000 7f1896ffd640 1 --2- 172.21.15.60:0/2459789923 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18981505f0 0x7f1898153910 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f18980ab190 tx=0x7f188802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba8158d899dd863a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:11.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.602+0000 7f18967fc640 1 -- 172.21.15.60:0/2459789923 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1888037070 con 0x7f18981505f0 2024-09-12T02:40:11.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.602+0000 7f18967fc640 1 -- 172.21.15.60:0/2459789923 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1888032440 con 0x7f18981505f0 2024-09-12T02:40:11.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.602+0000 7f18967fc640 1 -- 172.21.15.60:0/2459789923 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1888032810 con 0x7f18981505f0 2024-09-12T02:40:11.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.602+0000 7f189d99f640 1 -- 172.21.15.60:0/2459789923 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18981505f0 msgr2=0x7f1898153910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:11.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.602+0000 7f189d99f640 1 --2- 172.21.15.60:0/2459789923 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18981505f0 0x7f1898153910 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f18980ab190 tx=0x7f188802a1e0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.603+0000 7f189d99f640 1 -- 172.21.15.60:0/2459789923 shutdown_connections 2024-09-12T02:40:11.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.603+0000 7f189d99f640 1 --2- 172.21.15.60:0/2459789923 >> v2:172.21.15.105:3300/0 conn(0x7f18980c42b0 0x7f18980c4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.603+0000 7f189d99f640 1 --2- 172.21.15.60:0/2459789923 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18981505f0 0x7f1898153910 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.603+0000 7f189d99f640 1 -- 172.21.15.60:0/2459789923 >> 172.21.15.60:0/2459789923 conn(0x7f18980c7a40 msgr2=0x7f18980c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:11.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.603+0000 7f189d99f640 1 -- 172.21.15.60:0/2459789923 shutdown_connections 2024-09-12T02:40:11.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.603+0000 7f189d99f640 1 -- 172.21.15.60:0/2459789923 wait complete. 2024-09-12T02:40:11.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.604+0000 7f189d99f640 1 Processor -- start 2024-09-12T02:40:11.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.604+0000 7f189d99f640 1 -- start start 2024-09-12T02:40:11.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.604+0000 7f189d99f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18980c42b0 0x7f18980ace10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:11.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.604+0000 7f189d99f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18981505f0 0x7f1898148b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:11.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.604+0000 7f189d99f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1898149830 0x7f18981490d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:11.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.604+0000 7f189d99f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f18981509d0 con 0x7f18981505f0 2024-09-12T02:40:11.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.604+0000 7f189d99f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f18980c64a0 con 0x7f18980c42b0 2024-09-12T02:40:11.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.604+0000 7f189d99f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1898150b50 con 0x7f1898149830 2024-09-12T02:40:11.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.605+0000 7f188ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18981505f0 0x7f1898148b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:11.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.605+0000 7f188ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18981505f0 0x7f1898148b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40378/0 (socket says 172.21.15.60:40378) 2024-09-12T02:40:11.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.605+0000 7f188ffff640 1 -- 172.21.15.60:0/2696527351 learned_addr learned my addr 172.21.15.60:0/2696527351 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:11.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.605+0000 7f1896ffd640 1 --2- 172.21.15.60:0/2696527351 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18980c42b0 0x7f18980ace10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:11.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.605+0000 7f18977fe640 1 --2- 172.21.15.60:0/2696527351 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1898149830 0x7f18981490d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:11.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.605+0000 7f188ffff640 1 -- 172.21.15.60:0/2696527351 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1898149830 msgr2=0x7f18981490d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:11.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.605+0000 7f188ffff640 1 --2- 172.21.15.60:0/2696527351 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1898149830 0x7f18981490d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.605+0000 7f188ffff640 1 -- 172.21.15.60:0/2696527351 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18980c42b0 msgr2=0x7f18980ace10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:11.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.605+0000 7f188ffff640 1 --2- 172.21.15.60:0/2696527351 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18980c42b0 0x7f18980ace10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.605+0000 7f188ffff640 1 -- 172.21.15.60:0/2696527351 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1898152960 con 0x7f18981505f0 2024-09-12T02:40:11.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.605+0000 7f18977fe640 1 --2- 172.21.15.60:0/2696527351 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1898149830 0x7f18981490d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:40:11.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.605+0000 7f188ffff640 1 --2- 172.21.15.60:0/2696527351 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18981505f0 0x7f1898148b90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f188000c430 tx=0x7f188000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:11.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.605+0000 7f1894ff9640 1 -- 172.21.15.60:0/2696527351 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18800074e0 con 0x7f18981505f0 2024-09-12T02:40:11.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.605+0000 7f1894ff9640 1 -- 172.21.15.60:0/2696527351 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1880007680 con 0x7f18981505f0 2024-09-12T02:40:11.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.605+0000 7f189d99f640 1 -- 172.21.15.60:0/2696527351 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1898152680 con 0x7f18981505f0 2024-09-12T02:40:11.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.605+0000 7f1894ff9640 1 -- 172.21.15.60:0/2696527351 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1880004a00 con 0x7f18981505f0 2024-09-12T02:40:11.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.605+0000 7f189d99f640 1 -- 172.21.15.60:0/2696527351 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1898151a90 con 0x7f18981505f0 2024-09-12T02:40:11.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.606+0000 7f189d99f640 1 -- 172.21.15.60:0/2696527351 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1898069840 con 0x7f18981505f0 2024-09-12T02:40:11.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.607+0000 7f1894ff9640 1 -- 172.21.15.60:0/2696527351 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f188001a020 con 0x7f18981505f0 2024-09-12T02:40:11.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.607+0000 7f1894ff9640 1 --2- 172.21.15.60:0/2696527351 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f187806be30 0x7f187806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:11.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.608+0000 7f1896ffd640 1 --2- 172.21.15.60:0/2696527351 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f187806be30 0x7f187806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:11.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.608+0000 7f1894ff9640 1 -- 172.21.15.60:0/2696527351 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f188008a980 con 0x7f18981505f0 2024-09-12T02:40:11.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.608+0000 7f1896ffd640 1 --2- 172.21.15.60:0/2696527351 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f187806be30 0x7f187806e2f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f1888034000 tx=0x7f188802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:11.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.612+0000 7f1894ff9640 1 -- 172.21.15.60:0/2696527351 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1898069840 con 0x7f18981505f0 2024-09-12T02:40:11.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.782+0000 7f189d99f640 1 -- 172.21.15.60:0/2696527351 --> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1898153910 con 0x7f187806be30 2024-09-12T02:40:11.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.794+0000 7f1894ff9640 1 -- 172.21.15.60:0/2696527351 <== mgr.4098 v2:172.21.15.60:6800/3549430091 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+493732 (secure 0 0 0) 0x7f1898153910 con 0x7f187806be30 2024-09-12T02:40:11.800 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:40:11.804 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T02:40:11.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.798+0000 7f189d99f640 1 -- 172.21.15.60:0/2696527351 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f187806be30 msgr2=0x7f187806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:11.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.798+0000 7f189d99f640 1 --2- 172.21.15.60:0/2696527351 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f187806be30 0x7f187806e2f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f1888034000 tx=0x7f188802e000 comp rx=0 tx=0).stop 2024-09-12T02:40:11.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.798+0000 7f189d99f640 1 -- 172.21.15.60:0/2696527351 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18981505f0 msgr2=0x7f1898148b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:11.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.798+0000 7f189d99f640 1 --2- 172.21.15.60:0/2696527351 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18981505f0 0x7f1898148b90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f188000c430 tx=0x7f188000c8f0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.798+0000 7f189d99f640 1 -- 172.21.15.60:0/2696527351 shutdown_connections 2024-09-12T02:40:11.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.798+0000 7f189d99f640 1 --2- 172.21.15.60:0/2696527351 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f187806be30 0x7f187806e2f0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.798+0000 7f189d99f640 1 --2- 172.21.15.60:0/2696527351 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1898149830 0x7f18981490d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.798+0000 7f189d99f640 1 --2- 172.21.15.60:0/2696527351 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18981505f0 0x7f1898148b90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.798+0000 7f189d99f640 1 --2- 172.21.15.60:0/2696527351 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18980c42b0 0x7f18980ace10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.798+0000 7f189d99f640 1 -- 172.21.15.60:0/2696527351 >> 172.21.15.60:0/2696527351 conn(0x7f18980c7a40 msgr2=0x7f18980a8940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:11.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.798+0000 7f189d99f640 1 -- 172.21.15.60:0/2696527351 shutdown_connections 2024-09-12T02:40:11.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.799+0000 7f189d99f640 1 -- 172.21.15.60:0/2696527351 wait complete. 2024-09-12T02:40:11.810 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":540,"stamp":"2024-09-12T02:40:10.400083+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":37063407,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":235,"num_read_kb":350,"num_write":3281435,"num_write_kb":39377193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":634645,"ondisk_log_size":634645,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8349288,"kb_used_data":74792,"kb_used_omap":12,"kb_used_meta":8274355,"kb_avail":746625432,"statfs":{"total":773094113280,"available":764544442368,"internally_reserved":0,"allocated":76587008,"data_stored":75073414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":8472940080},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":57,"apply_latency_ms":57,"commit_latency_ns":57000000,"apply_latency_ns":57000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":498,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003973"},"pg_stats":[{"pgid":"5.18","version":"28'5064","reported_seq":5086,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.622362+0000","last_change":"2024-09-12T02:23:16.851521+0000","last_active":"2024-09-12T02:40:04.622362+0000","last_peered":"2024-09-12T02:40:04.622362+0000","last_clean":"2024-09-12T02:40:04.622362+0000","last_became_active":"2024-09-12T02:23:16.851220+0000","last_became_peered":"2024-09-12T02:23:16.851220+0000","last_unstale":"2024-09-12T02:40:04.622362+0000","last_undegraded":"2024-09-12T02:40:04.622362+0000","last_fullsized":"2024-09-12T02:40:04.622362+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5064,"log_dups_size":0,"ondisk_log_size":5064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:28.680072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26423,"num_write_kb":306733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"28'710","reported_seq":744,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:38.617912+0000","last_change":"2024-09-12T02:23:03.757848+0000","last_active":"2024-09-12T02:39:38.617912+0000","last_peered":"2024-09-12T02:39:38.617912+0000","last_clean":"2024-09-12T02:39:38.617912+0000","last_became_active":"2024-09-12T02:23:03.757544+0000","last_became_peered":"2024-09-12T02:23:03.757544+0000","last_unstale":"2024-09-12T02:39:38.617912+0000","last_undegraded":"2024-09-12T02:39:38.617912+0000","last_fullsized":"2024-09-12T02:39:38.617912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:43.576128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":4498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"28'5154","reported_seq":5186,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.755971+0000","last_change":"2024-09-12T02:23:04.790549+0000","last_active":"2024-09-12T02:39:57.755971+0000","last_peered":"2024-09-12T02:39:57.755971+0000","last_clean":"2024-09-12T02:39:57.755971+0000","last_became_active":"2024-09-12T02:23:04.790187+0000","last_became_peered":"2024-09-12T02:23:04.790187+0000","last_unstale":"2024-09-12T02:39:57.755971+0000","last_undegraded":"2024-09-12T02:39:57.755971+0000","last_fullsized":"2024-09-12T02:39:57.755971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5154,"log_dups_size":0,"ondisk_log_size":5154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:49.656395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26676,"num_write_kb":324046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"28'3","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:37:47.991333+0000","last_change":"2024-09-12T02:23:15.829383+0000","last_active":"2024-09-12T02:37:47.991333+0000","last_peered":"2024-09-12T02:37:47.991333+0000","last_clean":"2024-09-12T02:37:47.991333+0000","last_became_active":"2024-09-12T02:23:15.828295+0000","last_became_peered":"2024-09-12T02:23:15.828295+0000","last_unstale":"2024-09-12T02:37:47.991333+0000","last_undegraded":"2024-09-12T02:37:47.991333+0000","last_fullsized":"2024-09-12T02:37:47.991333+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:13.217846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"28'6025","reported_seq":6047,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.706763+0000","last_change":"2024-09-12T02:23:16.853675+0000","last_active":"2024-09-12T02:40:04.706763+0000","last_peered":"2024-09-12T02:40:04.706763+0000","last_clean":"2024-09-12T02:40:04.706763+0000","last_became_active":"2024-09-12T02:23:16.853371+0000","last_became_peered":"2024-09-12T02:23:16.853371+0000","last_unstale":"2024-09-12T02:40:04.706763+0000","last_undegraded":"2024-09-12T02:40:04.706763+0000","last_fullsized":"2024-09-12T02:40:04.706763+0000","mapping_epoch":24,"log_start":"28'200","ondisk_log_start":"28'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5825,"log_dups_size":0,"ondisk_log_size":5825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:10.323501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30759,"num_write_kb":360986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"28'8","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.607786+0000","last_change":"2024-09-12T02:23:03.767076+0000","last_active":"2024-09-12T02:39:47.607786+0000","last_peered":"2024-09-12T02:39:47.607786+0000","last_clean":"2024-09-12T02:39:47.607786+0000","last_became_active":"2024-09-12T02:23:03.766686+0000","last_became_peered":"2024-09-12T02:23:03.766686+0000","last_unstale":"2024-09-12T02:39:47.607786+0000","last_undegraded":"2024-09-12T02:39:47.607786+0000","last_fullsized":"2024-09-12T02:39:47.607786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:45.706208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"28'5910","reported_seq":5942,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.822665+0000","last_change":"2024-09-12T02:23:04.782108+0000","last_active":"2024-09-12T02:39:57.822665+0000","last_peered":"2024-09-12T02:39:57.822665+0000","last_clean":"2024-09-12T02:39:57.822665+0000","last_became_active":"2024-09-12T02:23:04.781829+0000","last_became_peered":"2024-09-12T02:23:04.781829+0000","last_unstale":"2024-09-12T02:39:57.822665+0000","last_undegraded":"2024-09-12T02:39:57.822665+0000","last_fullsized":"2024-09-12T02:39:57.822665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5910,"log_dups_size":0,"ondisk_log_size":5910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:07:33.165742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31102,"num_write_kb":370468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"28'3","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:37:57.710002+0000","last_change":"2024-09-12T02:23:15.828697+0000","last_active":"2024-09-12T02:37:57.710002+0000","last_peered":"2024-09-12T02:37:57.710002+0000","last_clean":"2024-09-12T02:37:57.710002+0000","last_became_active":"2024-09-12T02:23:15.828317+0000","last_became_peered":"2024-09-12T02:23:15.828317+0000","last_unstale":"2024-09-12T02:37:57.710002+0000","last_undegraded":"2024-09-12T02:37:57.710002+0000","last_fullsized":"2024-09-12T02:37:57.710002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:55.347515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"28'4662","reported_seq":4684,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.720244+0000","last_change":"2024-09-12T02:23:16.856209+0000","last_active":"2024-09-12T02:40:04.720244+0000","last_peered":"2024-09-12T02:40:04.720244+0000","last_clean":"2024-09-12T02:40:04.720244+0000","last_became_active":"2024-09-12T02:23:16.855874+0000","last_became_peered":"2024-09-12T02:23:16.855874+0000","last_unstale":"2024-09-12T02:40:04.720244+0000","last_undegraded":"2024-09-12T02:40:04.720244+0000","last_fullsized":"2024-09-12T02:40:04.720244+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4662,"log_dups_size":0,"ondisk_log_size":4662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:44.299638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23657,"num_write_kb":270894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"28'11","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.620404+0000","last_change":"2024-09-12T02:23:03.767875+0000","last_active":"2024-09-12T02:39:47.620404+0000","last_peered":"2024-09-12T02:39:47.620404+0000","last_clean":"2024-09-12T02:39:47.620404+0000","last_became_active":"2024-09-12T02:23:03.767596+0000","last_became_peered":"2024-09-12T02:23:03.767596+0000","last_unstale":"2024-09-12T02:39:47.620404+0000","last_undegraded":"2024-09-12T02:39:47.620404+0000","last_fullsized":"2024-09-12T02:39:47.620404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:22.605725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'3398","reported_seq":3428,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.832289+0000","last_change":"2024-09-12T02:23:04.791903+0000","last_active":"2024-09-12T02:39:57.832289+0000","last_peered":"2024-09-12T02:39:57.832289+0000","last_clean":"2024-09-12T02:39:57.832289+0000","last_became_active":"2024-09-12T02:23:04.791635+0000","last_became_peered":"2024-09-12T02:23:04.791635+0000","last_unstale":"2024-09-12T02:39:57.832289+0000","last_undegraded":"2024-09-12T02:39:57.832289+0000","last_fullsized":"2024-09-12T02:39:57.832289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":3398,"log_dups_size":0,"ondisk_log_size":3398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:08.192088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16708,"num_write_kb":214393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"28'616","reported_seq":640,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.618731+0000","last_change":"2024-09-12T02:23:15.833369+0000","last_active":"2024-09-12T02:38:07.618731+0000","last_peered":"2024-09-12T02:38:07.618731+0000","last_clean":"2024-09-12T02:38:07.618731+0000","last_became_active":"2024-09-12T02:23:15.833010+0000","last_became_peered":"2024-09-12T02:23:15.833010+0000","last_unstale":"2024-09-12T02:38:07.618731+0000","last_undegraded":"2024-09-12T02:38:07.618731+0000","last_fullsized":"2024-09-12T02:38:07.618731+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:51.465462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":614,"num_write_kb":4230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"28'4163","reported_seq":4185,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.700869+0000","last_change":"2024-09-12T02:23:16.853013+0000","last_active":"2024-09-12T02:40:04.700869+0000","last_peered":"2024-09-12T02:40:04.700869+0000","last_clean":"2024-09-12T02:40:04.700869+0000","last_became_active":"2024-09-12T02:23:16.852698+0000","last_became_peered":"2024-09-12T02:23:16.852698+0000","last_unstale":"2024-09-12T02:40:04.700869+0000","last_undegraded":"2024-09-12T02:40:04.700869+0000","last_fullsized":"2024-09-12T02:40:04.700869+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4163,"log_dups_size":0,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:11.709531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21165,"num_write_kb":244679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"28'3","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:04.409618+0000","last_change":"2024-09-12T02:23:03.763480+0000","last_active":"2024-09-12T02:38:04.409618+0000","last_peered":"2024-09-12T02:38:04.409618+0000","last_clean":"2024-09-12T02:38:04.409618+0000","last_became_active":"2024-09-12T02:23:03.762464+0000","last_became_peered":"2024-09-12T02:23:03.762464+0000","last_unstale":"2024-09-12T02:38:04.409618+0000","last_undegraded":"2024-09-12T02:38:04.409618+0000","last_fullsized":"2024-09-12T02:38:04.409618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:24.308289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"28'5838","reported_seq":5868,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.851601+0000","last_change":"2024-09-12T02:23:04.791109+0000","last_active":"2024-09-12T02:39:57.851601+0000","last_peered":"2024-09-12T02:39:57.851601+0000","last_clean":"2024-09-12T02:39:57.851601+0000","last_became_active":"2024-09-12T02:23:04.790201+0000","last_became_peered":"2024-09-12T02:23:04.790201+0000","last_unstale":"2024-09-12T02:39:57.851601+0000","last_undegraded":"2024-09-12T02:39:57.851601+0000","last_fullsized":"2024-09-12T02:39:57.851601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5838,"log_dups_size":0,"ondisk_log_size":5838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:13.166139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30329,"num_write_kb":367409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"28'95","reported_seq":119,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.522715+0000","last_change":"2024-09-12T02:23:15.834261+0000","last_active":"2024-09-12T02:40:04.522715+0000","last_peered":"2024-09-12T02:40:04.522715+0000","last_clean":"2024-09-12T02:40:04.522715+0000","last_became_active":"2024-09-12T02:23:15.833982+0000","last_became_peered":"2024-09-12T02:23:15.833982+0000","last_unstale":"2024-09-12T02:40:04.522715+0000","last_undegraded":"2024-09-12T02:40:04.522715+0000","last_fullsized":"2024-09-12T02:40:04.522715+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:04.987961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1406481,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":1433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"28'5650","reported_seq":5673,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.655262+0000","last_change":"2024-09-12T02:23:16.861432+0000","last_active":"2024-09-12T02:40:04.655262+0000","last_peered":"2024-09-12T02:40:04.655262+0000","last_clean":"2024-09-12T02:40:04.655262+0000","last_became_active":"2024-09-12T02:23:16.861003+0000","last_became_peered":"2024-09-12T02:23:16.861003+0000","last_unstale":"2024-09-12T02:40:04.655262+0000","last_undegraded":"2024-09-12T02:40:04.655262+0000","last_fullsized":"2024-09-12T02:40:04.655262+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5650,"log_dups_size":0,"ondisk_log_size":5650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:01.777500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29234,"num_write_kb":330189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"28'4187","reported_seq":4218,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.703320+0000","last_change":"2024-09-12T02:23:04.788754+0000","last_active":"2024-09-12T02:39:57.703320+0000","last_peered":"2024-09-12T02:39:57.703320+0000","last_clean":"2024-09-12T02:39:57.703320+0000","last_became_active":"2024-09-12T02:23:04.788350+0000","last_became_peered":"2024-09-12T02:23:04.788350+0000","last_unstale":"2024-09-12T02:39:57.703320+0000","last_undegraded":"2024-09-12T02:39:57.703320+0000","last_fullsized":"2024-09-12T02:39:57.703320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4187,"log_dups_size":0,"ondisk_log_size":4187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:08.192088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21964,"num_write_kb":272310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"28'1149","reported_seq":1182,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.632597+0000","last_change":"2024-09-12T02:23:03.763423+0000","last_active":"2024-09-12T02:39:47.632597+0000","last_peered":"2024-09-12T02:39:47.632597+0000","last_clean":"2024-09-12T02:39:47.632597+0000","last_became_active":"2024-09-12T02:23:03.762627+0000","last_became_peered":"2024-09-12T02:23:03.762627+0000","last_unstale":"2024-09-12T02:39:47.632597+0000","last_undegraded":"2024-09-12T02:39:47.632597+0000","last_fullsized":"2024-09-12T02:39:47.632597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1149,"log_dups_size":0,"ondisk_log_size":1149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:18.090657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1140,"num_write_kb":4413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"28'2","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.604710+0000","last_change":"2024-09-12T02:23:15.831604+0000","last_active":"2024-09-12T02:38:07.604710+0000","last_peered":"2024-09-12T02:38:07.604710+0000","last_clean":"2024-09-12T02:38:07.604710+0000","last_became_active":"2024-09-12T02:23:15.831292+0000","last_became_peered":"2024-09-12T02:23:15.831292+0000","last_unstale":"2024-09-12T02:38:07.604710+0000","last_undegraded":"2024-09-12T02:38:07.604710+0000","last_fullsized":"2024-09-12T02:38:07.604710+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:30.234721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"28'5482","reported_seq":5505,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.695136+0000","last_change":"2024-09-12T02:23:16.842506+0000","last_active":"2024-09-12T02:40:04.695136+0000","last_peered":"2024-09-12T02:40:04.695136+0000","last_clean":"2024-09-12T02:40:04.695136+0000","last_became_active":"2024-09-12T02:23:16.842210+0000","last_became_peered":"2024-09-12T02:23:16.842210+0000","last_unstale":"2024-09-12T02:40:04.695136+0000","last_undegraded":"2024-09-12T02:40:04.695136+0000","last_fullsized":"2024-09-12T02:40:04.695136+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5482,"log_dups_size":0,"ondisk_log_size":5482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:52.806704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28431,"num_write_kb":318903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"28'3892","reported_seq":3923,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.750186+0000","last_change":"2024-09-12T02:23:04.782769+0000","last_active":"2024-09-12T02:39:57.750186+0000","last_peered":"2024-09-12T02:39:57.750186+0000","last_clean":"2024-09-12T02:39:57.750186+0000","last_became_active":"2024-09-12T02:23:04.782472+0000","last_became_peered":"2024-09-12T02:23:04.782472+0000","last_unstale":"2024-09-12T02:39:57.750186+0000","last_undegraded":"2024-09-12T02:39:57.750186+0000","last_fullsized":"2024-09-12T02:39:57.750186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":3892,"log_dups_size":0,"ondisk_log_size":3892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:46.144471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18989,"num_write_kb":247993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'4","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.622890+0000","last_change":"2024-09-12T02:23:03.771468+0000","last_active":"2024-09-12T02:39:47.622890+0000","last_peered":"2024-09-12T02:39:47.622890+0000","last_clean":"2024-09-12T02:39:47.622890+0000","last_became_active":"2024-09-12T02:23:03.769619+0000","last_became_peered":"2024-09-12T02:23:03.769619+0000","last_unstale":"2024-09-12T02:39:47.622890+0000","last_undegraded":"2024-09-12T02:39:47.622890+0000","last_fullsized":"2024-09-12T02:39:47.622890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:38.422369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"28'2","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.610915+0000","last_change":"2024-09-12T02:23:15.833359+0000","last_active":"2024-09-12T02:38:07.610915+0000","last_peered":"2024-09-12T02:38:07.610915+0000","last_clean":"2024-09-12T02:38:07.610915+0000","last_became_active":"2024-09-12T02:23:15.832995+0000","last_became_peered":"2024-09-12T02:23:15.832995+0000","last_unstale":"2024-09-12T02:38:07.610915+0000","last_undegraded":"2024-09-12T02:38:07.610915+0000","last_fullsized":"2024-09-12T02:38:07.610915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:57.922845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"28'4854","reported_seq":4877,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.689490+0000","last_change":"2024-09-12T02:23:16.856439+0000","last_active":"2024-09-12T02:40:04.689490+0000","last_peered":"2024-09-12T02:40:04.689490+0000","last_clean":"2024-09-12T02:40:04.689490+0000","last_became_active":"2024-09-12T02:23:16.856166+0000","last_became_peered":"2024-09-12T02:23:16.856166+0000","last_unstale":"2024-09-12T02:40:04.689490+0000","last_undegraded":"2024-09-12T02:40:04.689490+0000","last_fullsized":"2024-09-12T02:40:04.689490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4854,"log_dups_size":0,"ondisk_log_size":4854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:42:56.534517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24657,"num_write_kb":295553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"28'4675","reported_seq":4706,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.744628+0000","last_change":"2024-09-12T02:23:04.783991+0000","last_active":"2024-09-12T02:39:57.744628+0000","last_peered":"2024-09-12T02:39:57.744628+0000","last_clean":"2024-09-12T02:39:57.744628+0000","last_became_active":"2024-09-12T02:23:04.783143+0000","last_became_peered":"2024-09-12T02:23:04.783143+0000","last_unstale":"2024-09-12T02:39:57.744628+0000","last_undegraded":"2024-09-12T02:39:57.744628+0000","last_fullsized":"2024-09-12T02:39:57.744628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4675,"log_dups_size":0,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:53.940843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24578,"num_write_kb":303391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'3","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.602532+0000","last_change":"2024-09-12T02:23:03.770581+0000","last_active":"2024-09-12T02:39:47.602532+0000","last_peered":"2024-09-12T02:39:47.602532+0000","last_clean":"2024-09-12T02:39:47.602532+0000","last_became_active":"2024-09-12T02:23:03.769406+0000","last_became_peered":"2024-09-12T02:23:03.769406+0000","last_unstale":"2024-09-12T02:39:47.602532+0000","last_undegraded":"2024-09-12T02:39:47.602532+0000","last_fullsized":"2024-09-12T02:39:47.602532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:20.963819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"28'5","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.723938+0000","last_change":"2024-09-12T02:23:15.835033+0000","last_active":"2024-09-12T02:38:07.723938+0000","last_peered":"2024-09-12T02:38:07.723938+0000","last_clean":"2024-09-12T02:38:07.723938+0000","last_became_active":"2024-09-12T02:23:15.834753+0000","last_became_peered":"2024-09-12T02:23:15.834753+0000","last_unstale":"2024-09-12T02:38:07.723938+0000","last_undegraded":"2024-09-12T02:38:07.723938+0000","last_fullsized":"2024-09-12T02:38:07.723938+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:57.434162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"28'5924","reported_seq":5947,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.730977+0000","last_change":"2024-09-12T02:23:16.860867+0000","last_active":"2024-09-12T02:40:04.730977+0000","last_peered":"2024-09-12T02:40:04.730977+0000","last_clean":"2024-09-12T02:40:04.730977+0000","last_became_active":"2024-09-12T02:23:16.860656+0000","last_became_peered":"2024-09-12T02:23:16.860656+0000","last_unstale":"2024-09-12T02:40:04.730977+0000","last_undegraded":"2024-09-12T02:40:04.730977+0000","last_fullsized":"2024-09-12T02:40:04.730977+0000","mapping_epoch":24,"log_start":"28'100","ondisk_log_start":"28'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5824,"log_dups_size":0,"ondisk_log_size":5824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:11.375287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30048,"num_write_kb":358073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"28'4362","reported_seq":4393,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.669337+0000","last_change":"2024-09-12T02:23:04.780821+0000","last_active":"2024-09-12T02:39:57.669337+0000","last_peered":"2024-09-12T02:39:57.669337+0000","last_clean":"2024-09-12T02:39:57.669337+0000","last_became_active":"2024-09-12T02:23:04.779984+0000","last_became_peered":"2024-09-12T02:23:04.779984+0000","last_unstale":"2024-09-12T02:39:57.669337+0000","last_undegraded":"2024-09-12T02:39:57.669337+0000","last_fullsized":"2024-09-12T02:39:57.669337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4362,"log_dups_size":0,"ondisk_log_size":4362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:25.724116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22346,"num_write_kb":282099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"28'3","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.590737+0000","last_change":"2024-09-12T02:23:03.764530+0000","last_active":"2024-09-12T02:39:47.590737+0000","last_peered":"2024-09-12T02:39:47.590737+0000","last_clean":"2024-09-12T02:39:47.590737+0000","last_became_active":"2024-09-12T02:23:03.764218+0000","last_became_peered":"2024-09-12T02:23:03.764218+0000","last_unstale":"2024-09-12T02:39:47.590737+0000","last_undegraded":"2024-09-12T02:39:47.590737+0000","last_fullsized":"2024-09-12T02:39:47.590737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:55.445619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"28'6","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.689963+0000","last_change":"2024-09-12T02:23:15.831621+0000","last_active":"2024-09-12T02:38:07.689963+0000","last_peered":"2024-09-12T02:38:07.689963+0000","last_clean":"2024-09-12T02:38:07.689963+0000","last_became_active":"2024-09-12T02:23:15.831331+0000","last_became_peered":"2024-09-12T02:23:15.831331+0000","last_unstale":"2024-09-12T02:38:07.689963+0000","last_undegraded":"2024-09-12T02:38:07.689963+0000","last_fullsized":"2024-09-12T02:38:07.689963+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:06.494392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"28'4897","reported_seq":4921,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.656642+0000","last_change":"2024-09-12T02:23:16.847556+0000","last_active":"2024-09-12T02:40:04.656642+0000","last_peered":"2024-09-12T02:40:04.656642+0000","last_clean":"2024-09-12T02:40:04.656642+0000","last_became_active":"2024-09-12T02:23:16.845749+0000","last_became_peered":"2024-09-12T02:23:16.845749+0000","last_unstale":"2024-09-12T02:40:04.656642+0000","last_undegraded":"2024-09-12T02:40:04.656642+0000","last_fullsized":"2024-09-12T02:40:04.656642+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4897,"log_dups_size":0,"ondisk_log_size":4897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:39.542842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25893,"num_write_kb":296532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"28'3849","reported_seq":3880,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.731126+0000","last_change":"2024-09-12T02:23:04.786895+0000","last_active":"2024-09-12T02:39:57.731126+0000","last_peered":"2024-09-12T02:39:57.731126+0000","last_clean":"2024-09-12T02:39:57.731126+0000","last_became_active":"2024-09-12T02:23:04.786591+0000","last_became_peered":"2024-09-12T02:23:04.786591+0000","last_unstale":"2024-09-12T02:39:57.731126+0000","last_undegraded":"2024-09-12T02:39:57.731126+0000","last_fullsized":"2024-09-12T02:39:57.731126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":3849,"log_dups_size":0,"ondisk_log_size":3849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:14.751707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19665,"num_write_kb":250729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'5","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.627847+0000","last_change":"2024-09-12T02:23:03.771259+0000","last_active":"2024-09-12T02:39:47.627847+0000","last_peered":"2024-09-12T02:39:47.627847+0000","last_clean":"2024-09-12T02:39:47.627847+0000","last_became_active":"2024-09-12T02:23:03.770687+0000","last_became_peered":"2024-09-12T02:23:03.770687+0000","last_unstale":"2024-09-12T02:39:47.627847+0000","last_undegraded":"2024-09-12T02:39:47.627847+0000","last_fullsized":"2024-09-12T02:39:47.627847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:38.516959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"28'59","reported_seq":142,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:51.334318+0000","last_change":"2024-09-12T02:23:15.829406+0000","last_active":"2024-09-12T02:39:51.334318+0000","last_peered":"2024-09-12T02:39:51.334318+0000","last_clean":"2024-09-12T02:39:51.334318+0000","last_became_active":"2024-09-12T02:23:15.829135+0000","last_became_peered":"2024-09-12T02:23:15.829135+0000","last_unstale":"2024-09-12T02:39:51.334318+0000","last_undegraded":"2024-09-12T02:39:51.334318+0000","last_fullsized":"2024-09-12T02:39:51.334318+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:22.365804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":57,"num_read_kb":123,"num_write":57,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"28'5530","reported_seq":5554,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.659180+0000","last_change":"2024-09-12T02:23:16.857016+0000","last_active":"2024-09-12T02:40:04.659180+0000","last_peered":"2024-09-12T02:40:04.659180+0000","last_clean":"2024-09-12T02:40:04.659180+0000","last_became_active":"2024-09-12T02:23:16.856705+0000","last_became_peered":"2024-09-12T02:23:16.856705+0000","last_unstale":"2024-09-12T02:40:04.659180+0000","last_undegraded":"2024-09-12T02:40:04.659180+0000","last_fullsized":"2024-09-12T02:40:04.659180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5530,"log_dups_size":0,"ondisk_log_size":5530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:03.672668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29256,"num_write_kb":314000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"28'4419","reported_seq":4450,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.721713+0000","last_change":"2024-09-12T02:23:04.786424+0000","last_active":"2024-09-12T02:39:57.721713+0000","last_peered":"2024-09-12T02:39:57.721713+0000","last_clean":"2024-09-12T02:39:57.721713+0000","last_became_active":"2024-09-12T02:23:04.786136+0000","last_became_peered":"2024-09-12T02:23:04.786136+0000","last_unstale":"2024-09-12T02:39:57.721713+0000","last_undegraded":"2024-09-12T02:39:57.721713+0000","last_fullsized":"2024-09-12T02:39:57.721713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4419,"log_dups_size":0,"ondisk_log_size":4419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:31.214894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22653,"num_write_kb":291447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'597","reported_seq":630,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:48.951757+0000","last_change":"2024-09-12T02:23:03.769745+0000","last_active":"2024-09-12T02:39:48.951757+0000","last_peered":"2024-09-12T02:39:48.951757+0000","last_clean":"2024-09-12T02:39:48.951757+0000","last_became_active":"2024-09-12T02:23:03.769410+0000","last_became_peered":"2024-09-12T02:23:03.769410+0000","last_unstale":"2024-09-12T02:39:48.951757+0000","last_undegraded":"2024-09-12T02:39:48.951757+0000","last_fullsized":"2024-09-12T02:39:48.951757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:00.414459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1455,"num_write_kb":462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"28'5","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.701763+0000","last_change":"2024-09-12T02:23:15.827211+0000","last_active":"2024-09-12T02:38:07.701763+0000","last_peered":"2024-09-12T02:38:07.701763+0000","last_clean":"2024-09-12T02:38:07.701763+0000","last_became_active":"2024-09-12T02:23:15.826564+0000","last_became_peered":"2024-09-12T02:23:15.826564+0000","last_unstale":"2024-09-12T02:38:07.701763+0000","last_undegraded":"2024-09-12T02:38:07.701763+0000","last_fullsized":"2024-09-12T02:38:07.701763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:32.389443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"28'5561","reported_seq":5585,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.639456+0000","last_change":"2024-09-12T02:23:16.837434+0000","last_active":"2024-09-12T02:40:04.639456+0000","last_peered":"2024-09-12T02:40:04.639456+0000","last_clean":"2024-09-12T02:40:04.639456+0000","last_became_active":"2024-09-12T02:23:16.837162+0000","last_became_peered":"2024-09-12T02:23:16.837162+0000","last_unstale":"2024-09-12T02:40:04.639456+0000","last_undegraded":"2024-09-12T02:40:04.639456+0000","last_fullsized":"2024-09-12T02:40:04.639456+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5561,"log_dups_size":0,"ondisk_log_size":5561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:09.146064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28597,"num_write_kb":327668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"28'4780","reported_seq":4812,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.728845+0000","last_change":"2024-09-12T02:23:04.775876+0000","last_active":"2024-09-12T02:39:57.728845+0000","last_peered":"2024-09-12T02:39:57.728845+0000","last_clean":"2024-09-12T02:39:57.728845+0000","last_became_active":"2024-09-12T02:23:04.775571+0000","last_became_peered":"2024-09-12T02:23:04.775571+0000","last_unstale":"2024-09-12T02:39:57.728845+0000","last_undegraded":"2024-09-12T02:39:57.728845+0000","last_fullsized":"2024-09-12T02:39:57.728845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4780,"log_dups_size":0,"ondisk_log_size":4780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:05.070528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24981,"num_write_kb":308974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"28'4","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.626390+0000","last_change":"2024-09-12T02:23:03.764093+0000","last_active":"2024-09-12T02:39:47.626390+0000","last_peered":"2024-09-12T02:39:47.626390+0000","last_clean":"2024-09-12T02:39:47.626390+0000","last_became_active":"2024-09-12T02:23:03.763147+0000","last_became_peered":"2024-09-12T02:23:03.763147+0000","last_unstale":"2024-09-12T02:39:47.626390+0000","last_undegraded":"2024-09-12T02:39:47.626390+0000","last_fullsized":"2024-09-12T02:39:47.626390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:13.317894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"28'1","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:37:53.624097+0000","last_change":"2024-09-12T02:23:15.832461+0000","last_active":"2024-09-12T02:37:53.624097+0000","last_peered":"2024-09-12T02:37:53.624097+0000","last_clean":"2024-09-12T02:37:53.624097+0000","last_became_active":"2024-09-12T02:23:15.831637+0000","last_became_peered":"2024-09-12T02:23:15.831637+0000","last_unstale":"2024-09-12T02:37:53.624097+0000","last_undegraded":"2024-09-12T02:37:53.624097+0000","last_fullsized":"2024-09-12T02:37:53.624097+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:30.909927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"28'5517","reported_seq":5541,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.717568+0000","last_change":"2024-09-12T02:23:16.835824+0000","last_active":"2024-09-12T02:40:04.717568+0000","last_peered":"2024-09-12T02:40:04.717568+0000","last_clean":"2024-09-12T02:40:04.717568+0000","last_became_active":"2024-09-12T02:23:16.835520+0000","last_became_peered":"2024-09-12T02:23:16.835520+0000","last_unstale":"2024-09-12T02:40:04.717568+0000","last_undegraded":"2024-09-12T02:40:04.717568+0000","last_fullsized":"2024-09-12T02:40:04.717568+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5517,"log_dups_size":0,"ondisk_log_size":5517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:32.797100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29476,"num_write_kb":310838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"28'3821","reported_seq":3853,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.839882+0000","last_change":"2024-09-12T02:23:04.787557+0000","last_active":"2024-09-12T02:39:57.839882+0000","last_peered":"2024-09-12T02:39:57.839882+0000","last_clean":"2024-09-12T02:39:57.839882+0000","last_became_active":"2024-09-12T02:23:04.786527+0000","last_became_peered":"2024-09-12T02:23:04.786527+0000","last_unstale":"2024-09-12T02:39:57.839882+0000","last_undegraded":"2024-09-12T02:39:57.839882+0000","last_fullsized":"2024-09-12T02:39:57.839882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":3821,"log_dups_size":0,"ondisk_log_size":3821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:23.273457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19788,"num_write_kb":259568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"28'5","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.626953+0000","last_change":"2024-09-12T02:23:03.769913+0000","last_active":"2024-09-12T02:39:47.626953+0000","last_peered":"2024-09-12T02:39:47.626953+0000","last_clean":"2024-09-12T02:39:47.626953+0000","last_became_active":"2024-09-12T02:23:03.769444+0000","last_became_peered":"2024-09-12T02:23:03.769444+0000","last_unstale":"2024-09-12T02:39:47.626953+0000","last_undegraded":"2024-09-12T02:39:47.626953+0000","last_fullsized":"2024-09-12T02:39:47.626953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:21.243182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"28'5","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.710687+0000","last_change":"2024-09-12T02:23:15.829080+0000","last_active":"2024-09-12T02:38:07.710687+0000","last_peered":"2024-09-12T02:38:07.710687+0000","last_clean":"2024-09-12T02:38:07.710687+0000","last_became_active":"2024-09-12T02:23:15.828256+0000","last_became_peered":"2024-09-12T02:23:15.828256+0000","last_unstale":"2024-09-12T02:38:07.710687+0000","last_undegraded":"2024-09-12T02:38:07.710687+0000","last_fullsized":"2024-09-12T02:38:07.710687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:07.743952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"28'4600","reported_seq":4624,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.595161+0000","last_change":"2024-09-12T02:23:16.845710+0000","last_active":"2024-09-12T02:40:04.595161+0000","last_peered":"2024-09-12T02:40:04.595161+0000","last_clean":"2024-09-12T02:40:04.595161+0000","last_became_active":"2024-09-12T02:23:16.845379+0000","last_became_peered":"2024-09-12T02:23:16.845379+0000","last_unstale":"2024-09-12T02:40:04.595161+0000","last_undegraded":"2024-09-12T02:40:04.595161+0000","last_fullsized":"2024-09-12T02:40:04.595161+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4600,"log_dups_size":0,"ondisk_log_size":4600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:16.769410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24241,"num_write_kb":277536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"28'4371","reported_seq":4403,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.747023+0000","last_change":"2024-09-12T02:23:04.790723+0000","last_active":"2024-09-12T02:39:57.747023+0000","last_peered":"2024-09-12T02:39:57.747023+0000","last_clean":"2024-09-12T02:39:57.747023+0000","last_became_active":"2024-09-12T02:23:04.786877+0000","last_became_peered":"2024-09-12T02:23:04.786877+0000","last_unstale":"2024-09-12T02:39:57.747023+0000","last_undegraded":"2024-09-12T02:39:57.747023+0000","last_fullsized":"2024-09-12T02:39:57.747023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4371,"log_dups_size":0,"ondisk_log_size":4371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:48.516002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23204,"num_write_kb":285450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"28'5","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.620925+0000","last_change":"2024-09-12T02:23:03.771518+0000","last_active":"2024-09-12T02:39:47.620925+0000","last_peered":"2024-09-12T02:39:47.620925+0000","last_clean":"2024-09-12T02:39:47.620925+0000","last_became_active":"2024-09-12T02:23:03.771063+0000","last_became_peered":"2024-09-12T02:23:03.771063+0000","last_unstale":"2024-09-12T02:39:47.620925+0000","last_undegraded":"2024-09-12T02:39:47.620925+0000","last_fullsized":"2024-09-12T02:39:47.620925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:43.974555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"28'5","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.679539+0000","last_change":"2024-09-12T02:23:15.827028+0000","last_active":"2024-09-12T02:38:07.679539+0000","last_peered":"2024-09-12T02:38:07.679539+0000","last_clean":"2024-09-12T02:38:07.679539+0000","last_became_active":"2024-09-12T02:23:15.826708+0000","last_became_peered":"2024-09-12T02:23:15.826708+0000","last_unstale":"2024-09-12T02:38:07.679539+0000","last_undegraded":"2024-09-12T02:38:07.679539+0000","last_fullsized":"2024-09-12T02:38:07.679539+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:34.642396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'4748","reported_seq":4771,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.730697+0000","last_change":"2024-09-12T02:23:16.849429+0000","last_active":"2024-09-12T02:40:04.730697+0000","last_peered":"2024-09-12T02:40:04.730697+0000","last_clean":"2024-09-12T02:40:04.730697+0000","last_became_active":"2024-09-12T02:23:16.849119+0000","last_became_peered":"2024-09-12T02:23:16.849119+0000","last_unstale":"2024-09-12T02:40:04.730697+0000","last_undegraded":"2024-09-12T02:40:04.730697+0000","last_fullsized":"2024-09-12T02:40:04.730697+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4748,"log_dups_size":0,"ondisk_log_size":4748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:10.688619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23965,"num_write_kb":268065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"28'4258","reported_seq":4290,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.730029+0000","last_change":"2024-09-12T02:23:04.773745+0000","last_active":"2024-09-12T02:39:57.730029+0000","last_peered":"2024-09-12T02:39:57.730029+0000","last_clean":"2024-09-12T02:39:57.730029+0000","last_became_active":"2024-09-12T02:23:04.773360+0000","last_became_peered":"2024-09-12T02:23:04.773360+0000","last_unstale":"2024-09-12T02:39:57.730029+0000","last_undegraded":"2024-09-12T02:39:57.730029+0000","last_fullsized":"2024-09-12T02:39:57.730029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4258,"log_dups_size":0,"ondisk_log_size":4258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:33.097774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22673,"num_write_kb":283464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'64","reported_seq":160,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.311429+0000","last_change":"2024-09-12T02:23:03.760700+0000","last_active":"2024-09-12T02:39:47.311429+0000","last_peered":"2024-09-12T02:39:47.311429+0000","last_clean":"2024-09-12T02:39:47.311429+0000","last_became_active":"2024-09-12T02:23:03.760397+0000","last_became_peered":"2024-09-12T02:23:03.760397+0000","last_unstale":"2024-09-12T02:39:47.311429+0000","last_undegraded":"2024-09-12T02:39:47.311429+0000","last_fullsized":"2024-09-12T02:39:47.311429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:36.788864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":127,"num_write":62,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"28'4","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.673049+0000","last_change":"2024-09-12T02:23:15.828714+0000","last_active":"2024-09-12T02:38:07.673049+0000","last_peered":"2024-09-12T02:38:07.673049+0000","last_clean":"2024-09-12T02:38:07.673049+0000","last_became_active":"2024-09-12T02:23:15.827458+0000","last_became_peered":"2024-09-12T02:23:15.827458+0000","last_unstale":"2024-09-12T02:38:07.673049+0000","last_undegraded":"2024-09-12T02:38:07.673049+0000","last_fullsized":"2024-09-12T02:38:07.673049+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:12.581897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"28'4979","reported_seq":5002,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.723394+0000","last_change":"2024-09-12T02:23:16.855212+0000","last_active":"2024-09-12T02:40:04.723394+0000","last_peered":"2024-09-12T02:40:04.723394+0000","last_clean":"2024-09-12T02:40:04.723394+0000","last_became_active":"2024-09-12T02:23:16.854938+0000","last_became_peered":"2024-09-12T02:23:16.854938+0000","last_unstale":"2024-09-12T02:40:04.723394+0000","last_undegraded":"2024-09-12T02:40:04.723394+0000","last_fullsized":"2024-09-12T02:40:04.723394+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4979,"log_dups_size":0,"ondisk_log_size":4979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:02.944057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25537,"num_write_kb":303027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"28'4415","reported_seq":4447,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.768572+0000","last_change":"2024-09-12T02:23:04.787820+0000","last_active":"2024-09-12T02:39:57.768572+0000","last_peered":"2024-09-12T02:39:57.768572+0000","last_clean":"2024-09-12T02:39:57.768572+0000","last_became_active":"2024-09-12T02:23:04.787523+0000","last_became_peered":"2024-09-12T02:23:04.787523+0000","last_unstale":"2024-09-12T02:39:57.768572+0000","last_undegraded":"2024-09-12T02:39:57.768572+0000","last_fullsized":"2024-09-12T02:39:57.768572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4415,"log_dups_size":0,"ondisk_log_size":4415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:52.784171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23022,"num_write_kb":288900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'5","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.629413+0000","last_change":"2024-09-12T02:23:03.771625+0000","last_active":"2024-09-12T02:39:47.629413+0000","last_peered":"2024-09-12T02:39:47.629413+0000","last_clean":"2024-09-12T02:39:47.629413+0000","last_became_active":"2024-09-12T02:23:03.771163+0000","last_became_peered":"2024-09-12T02:23:03.771163+0000","last_unstale":"2024-09-12T02:39:47.629413+0000","last_undegraded":"2024-09-12T02:39:47.629413+0000","last_fullsized":"2024-09-12T02:39:47.629413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:32.772569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"28'615","reported_seq":640,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:49.038042+0000","last_change":"2024-09-12T02:23:15.833889+0000","last_active":"2024-09-12T02:39:49.038042+0000","last_peered":"2024-09-12T02:39:49.038042+0000","last_clean":"2024-09-12T02:39:49.038042+0000","last_became_active":"2024-09-12T02:23:15.833587+0000","last_became_peered":"2024-09-12T02:23:15.833587+0000","last_unstale":"2024-09-12T02:39:49.038042+0000","last_undegraded":"2024-09-12T02:39:49.038042+0000","last_fullsized":"2024-09-12T02:39:49.038042+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:32.787861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1484,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"28'5400","reported_seq":5424,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.730531+0000","last_change":"2024-09-12T02:23:16.848864+0000","last_active":"2024-09-12T02:40:04.730531+0000","last_peered":"2024-09-12T02:40:04.730531+0000","last_clean":"2024-09-12T02:40:04.730531+0000","last_became_active":"2024-09-12T02:23:16.848385+0000","last_became_peered":"2024-09-12T02:23:16.848385+0000","last_unstale":"2024-09-12T02:40:04.730531+0000","last_undegraded":"2024-09-12T02:40:04.730531+0000","last_fullsized":"2024-09-12T02:40:04.730531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5400,"log_dups_size":0,"ondisk_log_size":5400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:03.656397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28350,"num_write_kb":322666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"28'5040","reported_seq":5072,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.783368+0000","last_change":"2024-09-12T02:23:04.781839+0000","last_active":"2024-09-12T02:39:57.783368+0000","last_peered":"2024-09-12T02:39:57.783368+0000","last_clean":"2024-09-12T02:39:57.783368+0000","last_became_active":"2024-09-12T02:23:04.780984+0000","last_became_peered":"2024-09-12T02:23:04.780984+0000","last_unstale":"2024-09-12T02:39:57.783368+0000","last_undegraded":"2024-09-12T02:39:57.783368+0000","last_fullsized":"2024-09-12T02:39:57.783368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5040,"log_dups_size":0,"ondisk_log_size":5040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:07.692791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25643,"num_write_kb":315836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'1","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:37:39.936369+0000","last_change":"2024-09-12T02:23:03.765100+0000","last_active":"2024-09-12T02:37:39.936369+0000","last_peered":"2024-09-12T02:37:39.936369+0000","last_clean":"2024-09-12T02:37:39.936369+0000","last_became_active":"2024-09-12T02:23:03.764801+0000","last_became_peered":"2024-09-12T02:23:03.764801+0000","last_unstale":"2024-09-12T02:37:39.936369+0000","last_undegraded":"2024-09-12T02:37:39.936369+0000","last_fullsized":"2024-09-12T02:37:39.936369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:06.891040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":190,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:36:54.619226+0000","last_change":"2024-09-12T02:22:55.143869+0000","last_active":"2024-09-12T02:36:54.619226+0000","last_peered":"2024-09-12T02:36:54.619226+0000","last_clean":"2024-09-12T02:36:54.619226+0000","last_became_active":"2024-09-12T02:22:55.142784+0000","last_became_peered":"2024-09-12T02:22:55.142784+0000","last_unstale":"2024-09-12T02:36:54.619226+0000","last_undegraded":"2024-09-12T02:36:54.619226+0000","last_fullsized":"2024-09-12T02:36:54.619226+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:22:52.457979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:22:52.457979+0000","last_clean_scrub_stamp":"2024-09-12T02:22:52.457979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:46.152602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"28'4","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.661864+0000","last_change":"2024-09-12T02:23:15.831362+0000","last_active":"2024-09-12T02:38:07.661864+0000","last_peered":"2024-09-12T02:38:07.661864+0000","last_clean":"2024-09-12T02:38:07.661864+0000","last_became_active":"2024-09-12T02:23:15.831084+0000","last_became_peered":"2024-09-12T02:23:15.831084+0000","last_unstale":"2024-09-12T02:38:07.661864+0000","last_undegraded":"2024-09-12T02:38:07.661864+0000","last_fullsized":"2024-09-12T02:38:07.661864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:17.754173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"28'4521","reported_seq":4544,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.674856+0000","last_change":"2024-09-12T02:23:16.838831+0000","last_active":"2024-09-12T02:40:04.674856+0000","last_peered":"2024-09-12T02:40:04.674856+0000","last_clean":"2024-09-12T02:40:04.674856+0000","last_became_active":"2024-09-12T02:23:16.838523+0000","last_became_peered":"2024-09-12T02:23:16.838523+0000","last_unstale":"2024-09-12T02:40:04.674856+0000","last_undegraded":"2024-09-12T02:40:04.674856+0000","last_fullsized":"2024-09-12T02:40:04.674856+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4521,"log_dups_size":0,"ondisk_log_size":4521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:35:42.088332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22817,"num_write_kb":263525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"28'4994","reported_seq":5025,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.798342+0000","last_change":"2024-09-12T02:23:04.783483+0000","last_active":"2024-09-12T02:39:57.798342+0000","last_peered":"2024-09-12T02:39:57.798342+0000","last_clean":"2024-09-12T02:39:57.798342+0000","last_became_active":"2024-09-12T02:23:04.782878+0000","last_became_peered":"2024-09-12T02:23:04.782878+0000","last_unstale":"2024-09-12T02:39:57.798342+0000","last_undegraded":"2024-09-12T02:39:57.798342+0000","last_fullsized":"2024-09-12T02:39:57.798342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4994,"log_dups_size":0,"ondisk_log_size":4994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:52.335065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25629,"num_write_kb":307571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'2","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:48.439127+0000","last_change":"2024-09-12T02:23:03.762507+0000","last_active":"2024-09-12T02:38:48.439127+0000","last_peered":"2024-09-12T02:38:48.439127+0000","last_clean":"2024-09-12T02:38:48.439127+0000","last_became_active":"2024-09-12T02:23:03.762164+0000","last_became_peered":"2024-09-12T02:23:03.762164+0000","last_unstale":"2024-09-12T02:38:48.439127+0000","last_undegraded":"2024-09-12T02:38:48.439127+0000","last_fullsized":"2024-09-12T02:38:48.439127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:34.569630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"28'4","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.725569+0000","last_change":"2024-09-12T02:23:15.830783+0000","last_active":"2024-09-12T02:38:07.725569+0000","last_peered":"2024-09-12T02:38:07.725569+0000","last_clean":"2024-09-12T02:38:07.725569+0000","last_became_active":"2024-09-12T02:23:15.830471+0000","last_became_peered":"2024-09-12T02:23:15.830471+0000","last_unstale":"2024-09-12T02:38:07.725569+0000","last_undegraded":"2024-09-12T02:38:07.725569+0000","last_fullsized":"2024-09-12T02:38:07.725569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:22.927201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"28'4580","reported_seq":4603,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.664325+0000","last_change":"2024-09-12T02:23:16.856328+0000","last_active":"2024-09-12T02:40:04.664325+0000","last_peered":"2024-09-12T02:40:04.664325+0000","last_clean":"2024-09-12T02:40:04.664325+0000","last_became_active":"2024-09-12T02:23:16.855992+0000","last_became_peered":"2024-09-12T02:23:16.855992+0000","last_unstale":"2024-09-12T02:40:04.664325+0000","last_undegraded":"2024-09-12T02:40:04.664325+0000","last_fullsized":"2024-09-12T02:40:04.664325+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4580,"log_dups_size":0,"ondisk_log_size":4580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:47.682103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24326,"num_write_kb":281766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"28'4821","reported_seq":4852,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.817348+0000","last_change":"2024-09-12T02:23:04.784318+0000","last_active":"2024-09-12T02:39:57.817348+0000","last_peered":"2024-09-12T02:39:57.817348+0000","last_clean":"2024-09-12T02:39:57.817348+0000","last_became_active":"2024-09-12T02:23:04.784012+0000","last_became_peered":"2024-09-12T02:23:04.784012+0000","last_unstale":"2024-09-12T02:39:57.817348+0000","last_undegraded":"2024-09-12T02:39:57.817348+0000","last_fullsized":"2024-09-12T02:39:57.817348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4821,"log_dups_size":0,"ondisk_log_size":4821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:51.352859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24805,"num_write_kb":312357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"28'2","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:52.827222+0000","last_change":"2024-09-12T02:23:03.766034+0000","last_active":"2024-09-12T02:38:52.827222+0000","last_peered":"2024-09-12T02:38:52.827222+0000","last_clean":"2024-09-12T02:38:52.827222+0000","last_became_active":"2024-09-12T02:23:03.765735+0000","last_became_peered":"2024-09-12T02:23:03.765735+0000","last_unstale":"2024-09-12T02:38:52.827222+0000","last_undegraded":"2024-09-12T02:38:52.827222+0000","last_fullsized":"2024-09-12T02:38:52.827222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:19.691229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"28'1085","reported_seq":1110,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.716303+0000","last_change":"2024-09-12T02:23:15.832527+0000","last_active":"2024-09-12T02:38:07.716303+0000","last_peered":"2024-09-12T02:38:07.716303+0000","last_clean":"2024-09-12T02:38:07.716303+0000","last_became_active":"2024-09-12T02:23:15.832184+0000","last_became_peered":"2024-09-12T02:23:15.832184+0000","last_unstale":"2024-09-12T02:38:07.716303+0000","last_undegraded":"2024-09-12T02:38:07.716303+0000","last_fullsized":"2024-09-12T02:38:07.716303+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":1085,"log_dups_size":0,"ondisk_log_size":1085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:29.131198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1076,"num_write_kb":4403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"28'4868","reported_seq":4891,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.629771+0000","last_change":"2024-09-12T02:23:16.849357+0000","last_active":"2024-09-12T02:40:04.629771+0000","last_peered":"2024-09-12T02:40:04.629771+0000","last_clean":"2024-09-12T02:40:04.629771+0000","last_became_active":"2024-09-12T02:23:16.849067+0000","last_became_peered":"2024-09-12T02:23:16.849067+0000","last_unstale":"2024-09-12T02:40:04.629771+0000","last_undegraded":"2024-09-12T02:40:04.629771+0000","last_fullsized":"2024-09-12T02:40:04.629771+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4868,"log_dups_size":0,"ondisk_log_size":4868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:06.887523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24798,"num_write_kb":291891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"28'5524","reported_seq":5555,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.830006+0000","last_change":"2024-09-12T02:23:04.791152+0000","last_active":"2024-09-12T02:39:57.830006+0000","last_peered":"2024-09-12T02:39:57.830006+0000","last_clean":"2024-09-12T02:39:57.830006+0000","last_became_active":"2024-09-12T02:23:04.790707+0000","last_became_peered":"2024-09-12T02:23:04.790707+0000","last_unstale":"2024-09-12T02:39:57.830006+0000","last_undegraded":"2024-09-12T02:39:57.830006+0000","last_fullsized":"2024-09-12T02:39:57.830006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5524,"log_dups_size":0,"ondisk_log_size":5524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:42.798507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27879,"num_write_kb":349281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"28'6","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.625090+0000","last_change":"2024-09-12T02:23:03.763327+0000","last_active":"2024-09-12T02:39:47.625090+0000","last_peered":"2024-09-12T02:39:47.625090+0000","last_clean":"2024-09-12T02:39:47.625090+0000","last_became_active":"2024-09-12T02:23:03.763005+0000","last_became_peered":"2024-09-12T02:23:03.763005+0000","last_unstale":"2024-09-12T02:39:47.625090+0000","last_undegraded":"2024-09-12T02:39:47.625090+0000","last_fullsized":"2024-09-12T02:39:47.625090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:09.500459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"28'3","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.672423+0000","last_change":"2024-09-12T02:23:15.819644+0000","last_active":"2024-09-12T02:38:07.672423+0000","last_peered":"2024-09-12T02:38:07.672423+0000","last_clean":"2024-09-12T02:38:07.672423+0000","last_became_active":"2024-09-12T02:23:15.819370+0000","last_became_peered":"2024-09-12T02:23:15.819370+0000","last_unstale":"2024-09-12T02:38:07.672423+0000","last_undegraded":"2024-09-12T02:38:07.672423+0000","last_fullsized":"2024-09-12T02:38:07.672423+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:56.384531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"28'5323","reported_seq":5346,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.659057+0000","last_change":"2024-09-12T02:23:16.838234+0000","last_active":"2024-09-12T02:40:04.659057+0000","last_peered":"2024-09-12T02:40:04.659057+0000","last_clean":"2024-09-12T02:40:04.659057+0000","last_became_active":"2024-09-12T02:23:16.837942+0000","last_became_peered":"2024-09-12T02:23:16.837942+0000","last_unstale":"2024-09-12T02:40:04.659057+0000","last_undegraded":"2024-09-12T02:40:04.659057+0000","last_fullsized":"2024-09-12T02:40:04.659057+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5323,"log_dups_size":0,"ondisk_log_size":5323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:41.842931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28212,"num_write_kb":317995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"28'4432","reported_seq":4463,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.735779+0000","last_change":"2024-09-12T02:23:04.781196+0000","last_active":"2024-09-12T02:39:57.735779+0000","last_peered":"2024-09-12T02:39:57.735779+0000","last_clean":"2024-09-12T02:39:57.735779+0000","last_became_active":"2024-09-12T02:23:04.780893+0000","last_became_peered":"2024-09-12T02:23:04.780893+0000","last_unstale":"2024-09-12T02:39:57.735779+0000","last_undegraded":"2024-09-12T02:39:57.735779+0000","last_fullsized":"2024-09-12T02:39:57.735779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4432,"log_dups_size":0,"ondisk_log_size":4432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:26.527539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22251,"num_write_kb":285885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'5","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.626407+0000","last_change":"2024-09-12T02:23:03.769541+0000","last_active":"2024-09-12T02:39:47.626407+0000","last_peered":"2024-09-12T02:39:47.626407+0000","last_clean":"2024-09-12T02:39:47.626407+0000","last_became_active":"2024-09-12T02:23:03.765281+0000","last_became_peered":"2024-09-12T02:23:03.765281+0000","last_unstale":"2024-09-12T02:39:47.626407+0000","last_undegraded":"2024-09-12T02:39:47.626407+0000","last_fullsized":"2024-09-12T02:39:47.626407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:53.409370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"28'3","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.670913+0000","last_change":"2024-09-12T02:23:15.841592+0000","last_active":"2024-09-12T02:38:07.670913+0000","last_peered":"2024-09-12T02:38:07.670913+0000","last_clean":"2024-09-12T02:38:07.670913+0000","last_became_active":"2024-09-12T02:23:15.841380+0000","last_became_peered":"2024-09-12T02:23:15.841380+0000","last_unstale":"2024-09-12T02:38:07.670913+0000","last_undegraded":"2024-09-12T02:38:07.670913+0000","last_fullsized":"2024-09-12T02:38:07.670913+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:38.396332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"28'4540","reported_seq":4562,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.682011+0000","last_change":"2024-09-12T02:23:16.846596+0000","last_active":"2024-09-12T02:40:04.682011+0000","last_peered":"2024-09-12T02:40:04.682011+0000","last_clean":"2024-09-12T02:40:04.682011+0000","last_became_active":"2024-09-12T02:23:16.846273+0000","last_became_peered":"2024-09-12T02:23:16.846273+0000","last_unstale":"2024-09-12T02:40:04.682011+0000","last_undegraded":"2024-09-12T02:40:04.682011+0000","last_fullsized":"2024-09-12T02:40:04.682011+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4540,"log_dups_size":0,"ondisk_log_size":4540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:03.628494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23721,"num_write_kb":271171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"28'4758","reported_seq":4789,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.728981+0000","last_change":"2024-09-12T02:23:04.781856+0000","last_active":"2024-09-12T02:39:57.728981+0000","last_peered":"2024-09-12T02:39:57.728981+0000","last_clean":"2024-09-12T02:39:57.728981+0000","last_became_active":"2024-09-12T02:23:04.781575+0000","last_became_peered":"2024-09-12T02:23:04.781575+0000","last_unstale":"2024-09-12T02:39:57.728981+0000","last_undegraded":"2024-09-12T02:39:57.728981+0000","last_fullsized":"2024-09-12T02:39:57.728981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4758,"log_dups_size":0,"ondisk_log_size":4758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:26.630558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24728,"num_write_kb":299876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"28'11","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.597678+0000","last_change":"2024-09-12T02:23:03.771368+0000","last_active":"2024-09-12T02:39:47.597678+0000","last_peered":"2024-09-12T02:39:47.597678+0000","last_clean":"2024-09-12T02:39:47.597678+0000","last_became_active":"2024-09-12T02:23:03.771061+0000","last_became_peered":"2024-09-12T02:23:03.771061+0000","last_unstale":"2024-09-12T02:39:47.597678+0000","last_undegraded":"2024-09-12T02:39:47.597678+0000","last_fullsized":"2024-09-12T02:39:47.597678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:57.476458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"28'2","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.683446+0000","last_change":"2024-09-12T02:23:15.833158+0000","last_active":"2024-09-12T02:38:07.683446+0000","last_peered":"2024-09-12T02:38:07.683446+0000","last_clean":"2024-09-12T02:38:07.683446+0000","last_became_active":"2024-09-12T02:23:15.831707+0000","last_became_peered":"2024-09-12T02:23:15.831707+0000","last_unstale":"2024-09-12T02:38:07.683446+0000","last_undegraded":"2024-09-12T02:38:07.683446+0000","last_fullsized":"2024-09-12T02:38:07.683446+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:30.000066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"28'5063","reported_seq":5085,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.735985+0000","last_change":"2024-09-12T02:23:16.858757+0000","last_active":"2024-09-12T02:40:04.735985+0000","last_peered":"2024-09-12T02:40:04.735985+0000","last_clean":"2024-09-12T02:40:04.735985+0000","last_became_active":"2024-09-12T02:23:16.858469+0000","last_became_peered":"2024-09-12T02:23:16.858469+0000","last_unstale":"2024-09-12T02:40:04.735985+0000","last_undegraded":"2024-09-12T02:40:04.735985+0000","last_fullsized":"2024-09-12T02:40:04.735985+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5063,"log_dups_size":0,"ondisk_log_size":5063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:22.288143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25554,"num_write_kb":307334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"28'4968","reported_seq":4999,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.765114+0000","last_change":"2024-09-12T02:23:04.785248+0000","last_active":"2024-09-12T02:39:57.765114+0000","last_peered":"2024-09-12T02:39:57.765114+0000","last_clean":"2024-09-12T02:39:57.765114+0000","last_became_active":"2024-09-12T02:23:04.784977+0000","last_became_peered":"2024-09-12T02:23:04.784977+0000","last_unstale":"2024-09-12T02:39:57.765114+0000","last_undegraded":"2024-09-12T02:39:57.765114+0000","last_fullsized":"2024-09-12T02:39:57.765114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4968,"log_dups_size":0,"ondisk_log_size":4968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:23.273457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25338,"num_write_kb":318642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"28'6","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.616586+0000","last_change":"2024-09-12T02:23:03.767842+0000","last_active":"2024-09-12T02:39:47.616586+0000","last_peered":"2024-09-12T02:39:47.616586+0000","last_clean":"2024-09-12T02:39:47.616586+0000","last_became_active":"2024-09-12T02:23:03.767066+0000","last_became_peered":"2024-09-12T02:23:03.767066+0000","last_unstale":"2024-09-12T02:39:47.616586+0000","last_undegraded":"2024-09-12T02:39:47.616586+0000","last_fullsized":"2024-09-12T02:39:47.616586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:50.800749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"28'2","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:37:48.019306+0000","last_change":"2024-09-12T02:23:15.826104+0000","last_active":"2024-09-12T02:37:48.019306+0000","last_peered":"2024-09-12T02:37:48.019306+0000","last_clean":"2024-09-12T02:37:48.019306+0000","last_became_active":"2024-09-12T02:23:15.825779+0000","last_became_peered":"2024-09-12T02:23:15.825779+0000","last_unstale":"2024-09-12T02:37:48.019306+0000","last_undegraded":"2024-09-12T02:37:48.019306+0000","last_fullsized":"2024-09-12T02:37:48.019306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:32.661083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"28'5278","reported_seq":5300,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.698094+0000","last_change":"2024-09-12T02:23:16.856543+0000","last_active":"2024-09-12T02:40:04.698094+0000","last_peered":"2024-09-12T02:40:04.698094+0000","last_clean":"2024-09-12T02:40:04.698094+0000","last_became_active":"2024-09-12T02:23:16.855538+0000","last_became_peered":"2024-09-12T02:23:16.855538+0000","last_unstale":"2024-09-12T02:40:04.698094+0000","last_undegraded":"2024-09-12T02:40:04.698094+0000","last_fullsized":"2024-09-12T02:40:04.698094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5278,"log_dups_size":0,"ondisk_log_size":5278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:05.857593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27222,"num_write_kb":301662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'5225","reported_seq":5256,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.832151+0000","last_change":"2024-09-12T02:23:04.783671+0000","last_active":"2024-09-12T02:39:57.832151+0000","last_peered":"2024-09-12T02:39:57.832151+0000","last_clean":"2024-09-12T02:39:57.832151+0000","last_became_active":"2024-09-12T02:23:04.783399+0000","last_became_peered":"2024-09-12T02:23:04.783399+0000","last_unstale":"2024-09-12T02:39:57.832151+0000","last_undegraded":"2024-09-12T02:39:57.832151+0000","last_fullsized":"2024-09-12T02:39:57.832151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5225,"log_dups_size":0,"ondisk_log_size":5225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:04.321789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26678,"num_write_kb":336266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'5","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.634447+0000","last_change":"2024-09-12T02:23:03.767217+0000","last_active":"2024-09-12T02:39:47.634447+0000","last_peered":"2024-09-12T02:39:47.634447+0000","last_clean":"2024-09-12T02:39:47.634447+0000","last_became_active":"2024-09-12T02:23:03.766551+0000","last_became_peered":"2024-09-12T02:23:03.766551+0000","last_unstale":"2024-09-12T02:39:47.634447+0000","last_undegraded":"2024-09-12T02:39:47.634447+0000","last_fullsized":"2024-09-12T02:39:47.634447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:09.963450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"28'299","reported_seq":324,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:48.637750+0000","last_change":"2024-09-12T02:23:15.832638+0000","last_active":"2024-09-12T02:39:48.637750+0000","last_peered":"2024-09-12T02:39:48.637750+0000","last_clean":"2024-09-12T02:39:48.637750+0000","last_became_active":"2024-09-12T02:23:15.832152+0000","last_became_peered":"2024-09-12T02:23:15.832152+0000","last_unstale":"2024-09-12T02:39:48.637750+0000","last_undegraded":"2024-09-12T02:39:48.637750+0000","last_fullsized":"2024-09-12T02:39:48.637750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:06.820636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295,"num_write_kb":4246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"28'6304","reported_seq":6327,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.731388+0000","last_change":"2024-09-12T02:23:16.846920+0000","last_active":"2024-09-12T02:40:04.731388+0000","last_peered":"2024-09-12T02:40:04.731388+0000","last_clean":"2024-09-12T02:40:04.731388+0000","last_became_active":"2024-09-12T02:23:16.846454+0000","last_became_peered":"2024-09-12T02:23:16.846454+0000","last_unstale":"2024-09-12T02:40:04.731388+0000","last_undegraded":"2024-09-12T02:40:04.731388+0000","last_fullsized":"2024-09-12T02:40:04.731388+0000","mapping_epoch":24,"log_start":"28'1100","ondisk_log_start":"28'1100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5204,"log_dups_size":0,"ondisk_log_size":5204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:51.782998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31934,"num_write_kb":398820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"28'4402","reported_seq":4433,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.754331+0000","last_change":"2024-09-12T02:23:04.784379+0000","last_active":"2024-09-12T02:39:57.754331+0000","last_peered":"2024-09-12T02:39:57.754331+0000","last_clean":"2024-09-12T02:39:57.754331+0000","last_became_active":"2024-09-12T02:23:04.784094+0000","last_became_peered":"2024-09-12T02:23:04.784094+0000","last_unstale":"2024-09-12T02:39:57.754331+0000","last_undegraded":"2024-09-12T02:39:57.754331+0000","last_fullsized":"2024-09-12T02:39:57.754331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4402,"log_dups_size":0,"ondisk_log_size":4402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:22.103008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22399,"num_write_kb":282193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"28'8","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.616748+0000","last_change":"2024-09-12T02:23:03.762859+0000","last_active":"2024-09-12T02:39:47.616748+0000","last_peered":"2024-09-12T02:39:47.616748+0000","last_clean":"2024-09-12T02:39:47.616748+0000","last_became_active":"2024-09-12T02:23:03.762557+0000","last_became_peered":"2024-09-12T02:23:03.762557+0000","last_unstale":"2024-09-12T02:39:47.616748+0000","last_undegraded":"2024-09-12T02:39:47.616748+0000","last_fullsized":"2024-09-12T02:39:47.616748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:34.863435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"28'34","reported_seq":58,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:08.425336+0000","last_change":"2024-09-12T02:23:15.823090+0000","last_active":"2024-09-12T02:38:08.425336+0000","last_peered":"2024-09-12T02:38:08.425336+0000","last_clean":"2024-09-12T02:38:08.425336+0000","last_became_active":"2024-09-12T02:23:15.822441+0000","last_became_peered":"2024-09-12T02:23:15.822441+0000","last_unstale":"2024-09-12T02:38:08.425336+0000","last_undegraded":"2024-09-12T02:38:08.425336+0000","last_fullsized":"2024-09-12T02:38:08.425336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:35.125478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"28'5704","reported_seq":5727,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.711812+0000","last_change":"2024-09-12T02:23:16.839875+0000","last_active":"2024-09-12T02:40:04.711812+0000","last_peered":"2024-09-12T02:40:04.711812+0000","last_clean":"2024-09-12T02:40:04.711812+0000","last_became_active":"2024-09-12T02:23:16.838277+0000","last_became_peered":"2024-09-12T02:23:16.838277+0000","last_unstale":"2024-09-12T02:40:04.711812+0000","last_undegraded":"2024-09-12T02:40:04.711812+0000","last_fullsized":"2024-09-12T02:40:04.711812+0000","mapping_epoch":24,"log_start":"28'500","ondisk_log_start":"28'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5204,"log_dups_size":0,"ondisk_log_size":5204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:09.370310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29050,"num_write_kb":345934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"28'4440","reported_seq":4471,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.749780+0000","last_change":"2024-09-12T02:23:04.780843+0000","last_active":"2024-09-12T02:39:57.749780+0000","last_peered":"2024-09-12T02:39:57.749780+0000","last_clean":"2024-09-12T02:39:57.749780+0000","last_became_active":"2024-09-12T02:23:04.780475+0000","last_became_peered":"2024-09-12T02:23:04.780475+0000","last_unstale":"2024-09-12T02:39:57.749780+0000","last_undegraded":"2024-09-12T02:39:57.749780+0000","last_fullsized":"2024-09-12T02:39:57.749780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4440,"log_dups_size":0,"ondisk_log_size":4440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:38.074872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22736,"num_write_kb":283554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'340","reported_seq":373,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.633548+0000","last_change":"2024-09-12T02:23:03.768425+0000","last_active":"2024-09-12T02:39:47.633548+0000","last_peered":"2024-09-12T02:39:47.633548+0000","last_clean":"2024-09-12T02:39:47.633548+0000","last_became_active":"2024-09-12T02:23:03.768092+0000","last_became_peered":"2024-09-12T02:23:03.768092+0000","last_unstale":"2024-09-12T02:39:47.633548+0000","last_undegraded":"2024-09-12T02:39:47.633548+0000","last_fullsized":"2024-09-12T02:39:47.633548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":340,"log_dups_size":0,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:18.572070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"28'5","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.725314+0000","last_change":"2024-09-12T02:23:15.829364+0000","last_active":"2024-09-12T02:38:07.725314+0000","last_peered":"2024-09-12T02:38:07.725314+0000","last_clean":"2024-09-12T02:38:07.725314+0000","last_became_active":"2024-09-12T02:23:15.827936+0000","last_became_peered":"2024-09-12T02:23:15.827936+0000","last_unstale":"2024-09-12T02:38:07.725314+0000","last_undegraded":"2024-09-12T02:38:07.725314+0000","last_fullsized":"2024-09-12T02:38:07.725314+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:04.973202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"28'4960","reported_seq":4983,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.685069+0000","last_change":"2024-09-12T02:23:16.854209+0000","last_active":"2024-09-12T02:40:04.685069+0000","last_peered":"2024-09-12T02:40:04.685069+0000","last_clean":"2024-09-12T02:40:04.685069+0000","last_became_active":"2024-09-12T02:23:16.853900+0000","last_became_peered":"2024-09-12T02:23:16.853900+0000","last_unstale":"2024-09-12T02:40:04.685069+0000","last_undegraded":"2024-09-12T02:40:04.685069+0000","last_fullsized":"2024-09-12T02:40:04.685069+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4960,"log_dups_size":0,"ondisk_log_size":4960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:52.831434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25526,"num_write_kb":294821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'6032","reported_seq":6063,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.811025+0000","last_change":"2024-09-12T02:23:04.777953+0000","last_active":"2024-09-12T02:39:57.811025+0000","last_peered":"2024-09-12T02:39:57.811025+0000","last_clean":"2024-09-12T02:39:57.811025+0000","last_became_active":"2024-09-12T02:23:04.777081+0000","last_became_peered":"2024-09-12T02:23:04.777081+0000","last_unstale":"2024-09-12T02:39:57.811025+0000","last_undegraded":"2024-09-12T02:39:57.811025+0000","last_fullsized":"2024-09-12T02:39:57.811025+0000","mapping_epoch":20,"log_start":"28'500","ondisk_log_start":"28'500","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5532,"log_dups_size":0,"ondisk_log_size":5532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:14.103378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30497,"num_write_kb":392872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'35","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:48.251039+0000","last_change":"2024-09-12T02:23:03.771271+0000","last_active":"2024-09-12T02:39:48.251039+0000","last_peered":"2024-09-12T02:39:48.251039+0000","last_clean":"2024-09-12T02:39:48.251039+0000","last_became_active":"2024-09-12T02:23:03.769601+0000","last_became_peered":"2024-09-12T02:23:03.769601+0000","last_unstale":"2024-09-12T02:39:48.251039+0000","last_undegraded":"2024-09-12T02:39:48.251039+0000","last_fullsized":"2024-09-12T02:39:48.251039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:22.910072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"28'8","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.680681+0000","last_change":"2024-09-12T02:23:15.831522+0000","last_active":"2024-09-12T02:38:07.680681+0000","last_peered":"2024-09-12T02:38:07.680681+0000","last_clean":"2024-09-12T02:38:07.680681+0000","last_became_active":"2024-09-12T02:23:15.831220+0000","last_became_peered":"2024-09-12T02:23:15.831220+0000","last_unstale":"2024-09-12T02:38:07.680681+0000","last_undegraded":"2024-09-12T02:38:07.680681+0000","last_fullsized":"2024-09-12T02:38:07.680681+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:54.337051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"28'5159","reported_seq":5182,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.721952+0000","last_change":"2024-09-12T02:23:16.858361+0000","last_active":"2024-09-12T02:40:04.721952+0000","last_peered":"2024-09-12T02:40:04.721952+0000","last_clean":"2024-09-12T02:40:04.721952+0000","last_became_active":"2024-09-12T02:23:16.858075+0000","last_became_peered":"2024-09-12T02:23:16.858075+0000","last_unstale":"2024-09-12T02:40:04.721952+0000","last_undegraded":"2024-09-12T02:40:04.721952+0000","last_fullsized":"2024-09-12T02:40:04.721952+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5159,"log_dups_size":0,"ondisk_log_size":5159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:35.038604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27123,"num_write_kb":309496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"28'3733","reported_seq":3764,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.822654+0000","last_change":"2024-09-12T02:23:04.779171+0000","last_active":"2024-09-12T02:39:57.822654+0000","last_peered":"2024-09-12T02:39:57.822654+0000","last_clean":"2024-09-12T02:39:57.822654+0000","last_became_active":"2024-09-12T02:23:04.778850+0000","last_became_peered":"2024-09-12T02:23:04.778850+0000","last_unstale":"2024-09-12T02:39:57.822654+0000","last_undegraded":"2024-09-12T02:39:57.822654+0000","last_fullsized":"2024-09-12T02:39:57.822654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":3733,"log_dups_size":0,"ondisk_log_size":3733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:21.746490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19250,"num_write_kb":253251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'2","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.636633+0000","last_change":"2024-09-12T02:23:03.769710+0000","last_active":"2024-09-12T02:39:47.636633+0000","last_peered":"2024-09-12T02:39:47.636633+0000","last_clean":"2024-09-12T02:39:47.636633+0000","last_became_active":"2024-09-12T02:23:03.769436+0000","last_became_peered":"2024-09-12T02:23:03.769436+0000","last_unstale":"2024-09-12T02:39:47.636633+0000","last_undegraded":"2024-09-12T02:39:47.636633+0000","last_fullsized":"2024-09-12T02:39:47.636633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:11.194147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"28'12","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:38.057899+0000","last_change":"2024-09-12T02:23:15.833196+0000","last_active":"2024-09-12T02:39:38.057899+0000","last_peered":"2024-09-12T02:39:38.057899+0000","last_clean":"2024-09-12T02:39:38.057899+0000","last_became_active":"2024-09-12T02:23:15.832873+0000","last_became_peered":"2024-09-12T02:23:15.832873+0000","last_unstale":"2024-09-12T02:39:38.057899+0000","last_undegraded":"2024-09-12T02:39:38.057899+0000","last_fullsized":"2024-09-12T02:39:38.057899+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:15.238046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"28'5308","reported_seq":5331,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.733481+0000","last_change":"2024-09-12T02:23:16.856735+0000","last_active":"2024-09-12T02:40:04.733481+0000","last_peered":"2024-09-12T02:40:04.733481+0000","last_clean":"2024-09-12T02:40:04.733481+0000","last_became_active":"2024-09-12T02:23:16.856455+0000","last_became_peered":"2024-09-12T02:23:16.856455+0000","last_unstale":"2024-09-12T02:40:04.733481+0000","last_undegraded":"2024-09-12T02:40:04.733481+0000","last_fullsized":"2024-09-12T02:40:04.733481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5308,"log_dups_size":0,"ondisk_log_size":5308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:55.376194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27382,"num_write_kb":326846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"28'4524","reported_seq":4555,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.792729+0000","last_change":"2024-09-12T02:23:04.786100+0000","last_active":"2024-09-12T02:39:57.792729+0000","last_peered":"2024-09-12T02:39:57.792729+0000","last_clean":"2024-09-12T02:39:57.792729+0000","last_became_active":"2024-09-12T02:23:04.785795+0000","last_became_peered":"2024-09-12T02:23:04.785795+0000","last_unstale":"2024-09-12T02:39:57.792729+0000","last_undegraded":"2024-09-12T02:39:57.792729+0000","last_fullsized":"2024-09-12T02:39:57.792729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4524,"log_dups_size":0,"ondisk_log_size":4524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:58.597807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22689,"num_write_kb":295834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"28'2","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.620142+0000","last_change":"2024-09-12T02:23:03.770668+0000","last_active":"2024-09-12T02:39:47.620142+0000","last_peered":"2024-09-12T02:39:47.620142+0000","last_clean":"2024-09-12T02:39:47.620142+0000","last_became_active":"2024-09-12T02:23:03.769302+0000","last_became_peered":"2024-09-12T02:23:03.769302+0000","last_unstale":"2024-09-12T02:39:47.620142+0000","last_undegraded":"2024-09-12T02:39:47.620142+0000","last_fullsized":"2024-09-12T02:39:47.620142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:18.948922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"28'6","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.703401+0000","last_change":"2024-09-12T02:23:15.825585+0000","last_active":"2024-09-12T02:38:07.703401+0000","last_peered":"2024-09-12T02:38:07.703401+0000","last_clean":"2024-09-12T02:38:07.703401+0000","last_became_active":"2024-09-12T02:23:15.825305+0000","last_became_peered":"2024-09-12T02:23:15.825305+0000","last_unstale":"2024-09-12T02:38:07.703401+0000","last_undegraded":"2024-09-12T02:38:07.703401+0000","last_fullsized":"2024-09-12T02:38:07.703401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:43.818922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"28'6585","reported_seq":6609,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.697301+0000","last_change":"2024-09-12T02:23:16.852415+0000","last_active":"2024-09-12T02:40:04.697301+0000","last_peered":"2024-09-12T02:40:04.697301+0000","last_clean":"2024-09-12T02:40:04.697301+0000","last_became_active":"2024-09-12T02:23:16.852061+0000","last_became_peered":"2024-09-12T02:23:16.852061+0000","last_unstale":"2024-09-12T02:40:04.697301+0000","last_undegraded":"2024-09-12T02:40:04.697301+0000","last_fullsized":"2024-09-12T02:40:04.697301+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":6585,"log_dups_size":0,"ondisk_log_size":6585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:30:49.720576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34694,"num_write_kb":385000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"28'8","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.695201+0000","last_change":"2024-09-12T02:23:15.833414+0000","last_active":"2024-09-12T02:38:07.695201+0000","last_peered":"2024-09-12T02:38:07.695201+0000","last_clean":"2024-09-12T02:38:07.695201+0000","last_became_active":"2024-09-12T02:23:15.832837+0000","last_became_peered":"2024-09-12T02:23:15.832837+0000","last_unstale":"2024-09-12T02:38:07.695201+0000","last_undegraded":"2024-09-12T02:38:07.695201+0000","last_fullsized":"2024-09-12T02:38:07.695201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:31.510160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"28'5783","reported_seq":5814,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.762578+0000","last_change":"2024-09-12T02:23:04.776572+0000","last_active":"2024-09-12T02:39:57.762578+0000","last_peered":"2024-09-12T02:39:57.762578+0000","last_clean":"2024-09-12T02:39:57.762578+0000","last_became_active":"2024-09-12T02:23:04.776270+0000","last_became_peered":"2024-09-12T02:23:04.776270+0000","last_unstale":"2024-09-12T02:39:57.762578+0000","last_undegraded":"2024-09-12T02:39:57.762578+0000","last_fullsized":"2024-09-12T02:39:57.762578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5783,"log_dups_size":0,"ondisk_log_size":5783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:12.807907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29721,"num_write_kb":356762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'3","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.633254+0000","last_change":"2024-09-12T02:23:03.762450+0000","last_active":"2024-09-12T02:39:47.633254+0000","last_peered":"2024-09-12T02:39:47.633254+0000","last_clean":"2024-09-12T02:39:47.633254+0000","last_became_active":"2024-09-12T02:23:03.762161+0000","last_became_peered":"2024-09-12T02:23:03.762161+0000","last_unstale":"2024-09-12T02:39:47.633254+0000","last_undegraded":"2024-09-12T02:39:47.633254+0000","last_fullsized":"2024-09-12T02:39:47.633254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:42.256395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"28'5706","reported_seq":5730,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.668944+0000","last_change":"2024-09-12T02:23:16.844537+0000","last_active":"2024-09-12T02:40:04.668944+0000","last_peered":"2024-09-12T02:40:04.668944+0000","last_clean":"2024-09-12T02:40:04.668944+0000","last_became_active":"2024-09-12T02:23:16.844248+0000","last_became_peered":"2024-09-12T02:23:16.844248+0000","last_unstale":"2024-09-12T02:40:04.668944+0000","last_undegraded":"2024-09-12T02:40:04.668944+0000","last_fullsized":"2024-09-12T02:40:04.668944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5706,"log_dups_size":0,"ondisk_log_size":5706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:45.801324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29959,"num_write_kb":337330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"28'719","reported_seq":745,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:37:54.833834+0000","last_change":"2024-09-12T02:23:15.826010+0000","last_active":"2024-09-12T02:37:54.833834+0000","last_peered":"2024-09-12T02:37:54.833834+0000","last_clean":"2024-09-12T02:37:54.833834+0000","last_became_active":"2024-09-12T02:23:15.825730+0000","last_became_peered":"2024-09-12T02:23:15.825730+0000","last_unstale":"2024-09-12T02:37:54.833834+0000","last_undegraded":"2024-09-12T02:37:54.833834+0000","last_fullsized":"2024-09-12T02:37:54.833834+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":719,"log_dups_size":0,"ondisk_log_size":719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:17.920975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":717,"num_write_kb":4509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"28'4333","reported_seq":4364,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.775122+0000","last_change":"2024-09-12T02:23:04.783317+0000","last_active":"2024-09-12T02:39:57.775122+0000","last_peered":"2024-09-12T02:39:57.775122+0000","last_clean":"2024-09-12T02:39:57.775122+0000","last_became_active":"2024-09-12T02:23:04.783039+0000","last_became_peered":"2024-09-12T02:23:04.783039+0000","last_unstale":"2024-09-12T02:39:57.775122+0000","last_undegraded":"2024-09-12T02:39:57.775122+0000","last_fullsized":"2024-09-12T02:39:57.775122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4333,"log_dups_size":0,"ondisk_log_size":4333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:17.577991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22422,"num_write_kb":290509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'3","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.593428+0000","last_change":"2024-09-12T02:23:03.768361+0000","last_active":"2024-09-12T02:39:47.593428+0000","last_peered":"2024-09-12T02:39:47.593428+0000","last_clean":"2024-09-12T02:39:47.593428+0000","last_became_active":"2024-09-12T02:23:03.768137+0000","last_became_peered":"2024-09-12T02:23:03.768137+0000","last_unstale":"2024-09-12T02:39:47.593428+0000","last_undegraded":"2024-09-12T02:39:47.593428+0000","last_fullsized":"2024-09-12T02:39:47.593428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:29.721363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"28'6357","reported_seq":6379,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.744225+0000","last_change":"2024-09-12T02:23:16.861251+0000","last_active":"2024-09-12T02:40:04.744225+0000","last_peered":"2024-09-12T02:40:04.744225+0000","last_clean":"2024-09-12T02:40:04.744225+0000","last_became_active":"2024-09-12T02:23:16.860980+0000","last_became_peered":"2024-09-12T02:23:16.860980+0000","last_unstale":"2024-09-12T02:40:04.744225+0000","last_undegraded":"2024-09-12T02:40:04.744225+0000","last_fullsized":"2024-09-12T02:40:04.744225+0000","mapping_epoch":24,"log_start":"28'500","ondisk_log_start":"28'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5857,"log_dups_size":0,"ondisk_log_size":5857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:16.177179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32865,"num_write_kb":377625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"28'95","reported_seq":127,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.604503+0000","last_change":"2024-09-12T02:23:03.768186+0000","last_active":"2024-09-12T02:39:57.604503+0000","last_peered":"2024-09-12T02:39:57.604503+0000","last_clean":"2024-09-12T02:39:57.604503+0000","last_became_active":"2024-09-12T02:23:03.767916+0000","last_became_peered":"2024-09-12T02:23:03.767916+0000","last_unstale":"2024-09-12T02:39:57.604503+0000","last_undegraded":"2024-09-12T02:39:57.604503+0000","last_fullsized":"2024-09-12T02:39:57.604503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:04.424540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1333026,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"28'3601","reported_seq":3631,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.791002+0000","last_change":"2024-09-12T02:23:04.793412+0000","last_active":"2024-09-12T02:39:57.791002+0000","last_peered":"2024-09-12T02:39:57.791002+0000","last_clean":"2024-09-12T02:39:57.791002+0000","last_became_active":"2024-09-12T02:23:04.793100+0000","last_became_peered":"2024-09-12T02:23:04.793100+0000","last_unstale":"2024-09-12T02:39:57.791002+0000","last_undegraded":"2024-09-12T02:39:57.791002+0000","last_fullsized":"2024-09-12T02:39:57.791002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":3601,"log_dups_size":0,"ondisk_log_size":3601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:50.446212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18077,"num_write_kb":232187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"28'3","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.714174+0000","last_change":"2024-09-12T02:23:15.830776+0000","last_active":"2024-09-12T02:38:07.714174+0000","last_peered":"2024-09-12T02:38:07.714174+0000","last_clean":"2024-09-12T02:38:07.714174+0000","last_became_active":"2024-09-12T02:23:15.830492+0000","last_became_peered":"2024-09-12T02:23:15.830492+0000","last_unstale":"2024-09-12T02:38:07.714174+0000","last_undegraded":"2024-09-12T02:38:07.714174+0000","last_fullsized":"2024-09-12T02:38:07.714174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:40.517292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"28'3975","reported_seq":3997,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.678952+0000","last_change":"2024-09-12T02:23:16.851953+0000","last_active":"2024-09-12T02:40:04.678952+0000","last_peered":"2024-09-12T02:40:04.678952+0000","last_clean":"2024-09-12T02:40:04.678952+0000","last_became_active":"2024-09-12T02:23:16.851558+0000","last_became_peered":"2024-09-12T02:23:16.851558+0000","last_unstale":"2024-09-12T02:40:04.678952+0000","last_undegraded":"2024-09-12T02:40:04.678952+0000","last_fullsized":"2024-09-12T02:40:04.678952+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":3975,"log_dups_size":0,"ondisk_log_size":3975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:29.852193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20293,"num_write_kb":228813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'576","reported_seq":608,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:08.021504+0000","last_change":"2024-09-12T02:23:03.764310+0000","last_active":"2024-09-12T02:38:08.021504+0000","last_peered":"2024-09-12T02:38:08.021504+0000","last_clean":"2024-09-12T02:38:08.021504+0000","last_became_active":"2024-09-12T02:23:03.764020+0000","last_became_peered":"2024-09-12T02:23:03.764020+0000","last_unstale":"2024-09-12T02:38:08.021504+0000","last_undegraded":"2024-09-12T02:38:08.021504+0000","last_fullsized":"2024-09-12T02:38:08.021504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:25.892874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":574,"num_write_kb":4226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"28'4110","reported_seq":4140,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.726393+0000","last_change":"2024-09-12T02:23:04.771579+0000","last_active":"2024-09-12T02:39:57.726393+0000","last_peered":"2024-09-12T02:39:57.726393+0000","last_clean":"2024-09-12T02:39:57.726393+0000","last_became_active":"2024-09-12T02:23:04.771310+0000","last_became_peered":"2024-09-12T02:23:04.771310+0000","last_unstale":"2024-09-12T02:39:57.726393+0000","last_undegraded":"2024-09-12T02:39:57.726393+0000","last_fullsized":"2024-09-12T02:39:57.726393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4110,"log_dups_size":0,"ondisk_log_size":4110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:05.115474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20660,"num_write_kb":258850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"28'11","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.725985+0000","last_change":"2024-09-12T02:23:15.832757+0000","last_active":"2024-09-12T02:38:07.725985+0000","last_peered":"2024-09-12T02:38:07.725985+0000","last_clean":"2024-09-12T02:38:07.725985+0000","last_became_active":"2024-09-12T02:23:15.832478+0000","last_became_peered":"2024-09-12T02:23:15.832478+0000","last_unstale":"2024-09-12T02:38:07.725985+0000","last_undegraded":"2024-09-12T02:38:07.725985+0000","last_fullsized":"2024-09-12T02:38:07.725985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:29.301251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"28'4897","reported_seq":4920,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.741619+0000","last_change":"2024-09-12T02:23:16.848437+0000","last_active":"2024-09-12T02:40:04.741619+0000","last_peered":"2024-09-12T02:40:04.741619+0000","last_clean":"2024-09-12T02:40:04.741619+0000","last_became_active":"2024-09-12T02:23:16.847063+0000","last_became_peered":"2024-09-12T02:23:16.847063+0000","last_unstale":"2024-09-12T02:40:04.741619+0000","last_undegraded":"2024-09-12T02:40:04.741619+0000","last_fullsized":"2024-09-12T02:40:04.741619+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4897,"log_dups_size":0,"ondisk_log_size":4897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:49.979448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25246,"num_write_kb":285992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"28'6383","reported_seq":6415,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.776503+0000","last_change":"2024-09-12T02:23:04.788489+0000","last_active":"2024-09-12T02:39:57.776503+0000","last_peered":"2024-09-12T02:39:57.776503+0000","last_clean":"2024-09-12T02:39:57.776503+0000","last_became_active":"2024-09-12T02:23:04.788195+0000","last_became_peered":"2024-09-12T02:23:04.788195+0000","last_unstale":"2024-09-12T02:39:57.776503+0000","last_undegraded":"2024-09-12T02:39:57.776503+0000","last_fullsized":"2024-09-12T02:39:57.776503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":6383,"log_dups_size":0,"ondisk_log_size":6383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:51.352859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32308,"num_write_kb":383454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"28'5756","reported_seq":5779,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.673986+0000","last_change":"2024-09-12T02:23:16.843805+0000","last_active":"2024-09-12T02:40:04.673986+0000","last_peered":"2024-09-12T02:40:04.673986+0000","last_clean":"2024-09-12T02:40:04.673986+0000","last_became_active":"2024-09-12T02:23:16.843517+0000","last_became_peered":"2024-09-12T02:23:16.843517+0000","last_unstale":"2024-09-12T02:40:04.673986+0000","last_undegraded":"2024-09-12T02:40:04.673986+0000","last_fullsized":"2024-09-12T02:40:04.673986+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5756,"log_dups_size":0,"ondisk_log_size":5756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:30.873311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29883,"num_write_kb":357322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"28'5059","reported_seq":5091,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.717218+0000","last_change":"2024-09-12T02:23:04.780662+0000","last_active":"2024-09-12T02:39:57.717218+0000","last_peered":"2024-09-12T02:39:57.717218+0000","last_clean":"2024-09-12T02:39:57.717218+0000","last_became_active":"2024-09-12T02:23:04.780402+0000","last_became_peered":"2024-09-12T02:23:04.780402+0000","last_unstale":"2024-09-12T02:39:57.717218+0000","last_undegraded":"2024-09-12T02:39:57.717218+0000","last_fullsized":"2024-09-12T02:39:57.717218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5059,"log_dups_size":0,"ondisk_log_size":5059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:23:00.556487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26551,"num_write_kb":323518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"28'4560","reported_seq":4583,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.699722+0000","last_change":"2024-09-12T02:23:16.852992+0000","last_active":"2024-09-12T02:40:04.699722+0000","last_peered":"2024-09-12T02:40:04.699722+0000","last_clean":"2024-09-12T02:40:04.699722+0000","last_became_active":"2024-09-12T02:23:16.852706+0000","last_became_peered":"2024-09-12T02:23:16.852706+0000","last_unstale":"2024-09-12T02:40:04.699722+0000","last_undegraded":"2024-09-12T02:40:04.699722+0000","last_fullsized":"2024-09-12T02:40:04.699722+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4560,"log_dups_size":0,"ondisk_log_size":4560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:56.896457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23787,"num_write_kb":279744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"28'5935","reported_seq":5967,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.781864+0000","last_change":"2024-09-12T02:23:04.785920+0000","last_active":"2024-09-12T02:39:57.781864+0000","last_peered":"2024-09-12T02:39:57.781864+0000","last_clean":"2024-09-12T02:39:57.781864+0000","last_became_active":"2024-09-12T02:23:04.785422+0000","last_became_peered":"2024-09-12T02:23:04.785422+0000","last_unstale":"2024-09-12T02:39:57.781864+0000","last_undegraded":"2024-09-12T02:39:57.781864+0000","last_fullsized":"2024-09-12T02:39:57.781864+0000","mapping_epoch":20,"log_start":"28'100","ondisk_log_start":"28'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5835,"log_dups_size":0,"ondisk_log_size":5835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:55.106703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30608,"num_write_kb":368510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"28'5374","reported_seq":5397,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.741332+0000","last_change":"2024-09-12T02:23:16.861939+0000","last_active":"2024-09-12T02:40:04.741332+0000","last_peered":"2024-09-12T02:40:04.741332+0000","last_clean":"2024-09-12T02:40:04.741332+0000","last_became_active":"2024-09-12T02:23:16.861658+0000","last_became_peered":"2024-09-12T02:23:16.861658+0000","last_unstale":"2024-09-12T02:40:04.741332+0000","last_undegraded":"2024-09-12T02:40:04.741332+0000","last_fullsized":"2024-09-12T02:40:04.741332+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5374,"log_dups_size":0,"ondisk_log_size":5374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:06.755715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28055,"num_write_kb":329573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"28'4234","reported_seq":4266,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.777821+0000","last_change":"2024-09-12T02:23:04.777018+0000","last_active":"2024-09-12T02:39:57.777821+0000","last_peered":"2024-09-12T02:39:57.777821+0000","last_clean":"2024-09-12T02:39:57.777821+0000","last_became_active":"2024-09-12T02:23:04.776736+0000","last_became_peered":"2024-09-12T02:23:04.776736+0000","last_unstale":"2024-09-12T02:39:57.777821+0000","last_undegraded":"2024-09-12T02:39:57.777821+0000","last_fullsized":"2024-09-12T02:39:57.777821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4234,"log_dups_size":0,"ondisk_log_size":4234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:08.668990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21439,"num_write_kb":262018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"28'6314","reported_seq":6338,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.717796+0000","last_change":"2024-09-12T02:23:16.847615+0000","last_active":"2024-09-12T02:40:04.717796+0000","last_peered":"2024-09-12T02:40:04.717796+0000","last_clean":"2024-09-12T02:40:04.717796+0000","last_became_active":"2024-09-12T02:23:16.847260+0000","last_became_peered":"2024-09-12T02:23:16.847260+0000","last_unstale":"2024-09-12T02:40:04.717796+0000","last_undegraded":"2024-09-12T02:40:04.717796+0000","last_fullsized":"2024-09-12T02:40:04.717796+0000","mapping_epoch":24,"log_start":"28'500","ondisk_log_start":"28'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5814,"log_dups_size":0,"ondisk_log_size":5814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:48.920477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32869,"num_write_kb":377542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"28'4066","reported_seq":4097,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.768701+0000","last_change":"2024-09-12T02:23:04.789372+0000","last_active":"2024-09-12T02:39:57.768701+0000","last_peered":"2024-09-12T02:39:57.768701+0000","last_clean":"2024-09-12T02:39:57.768701+0000","last_became_active":"2024-09-12T02:23:04.789090+0000","last_became_peered":"2024-09-12T02:23:04.789090+0000","last_unstale":"2024-09-12T02:39:57.768701+0000","last_undegraded":"2024-09-12T02:39:57.768701+0000","last_fullsized":"2024-09-12T02:39:57.768701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4066,"log_dups_size":0,"ondisk_log_size":4066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:49.533491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20728,"num_write_kb":267380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"28'3925","reported_seq":3949,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.706991+0000","last_change":"2024-09-12T02:23:16.859000+0000","last_active":"2024-09-12T02:40:04.706991+0000","last_peered":"2024-09-12T02:40:04.706991+0000","last_clean":"2024-09-12T02:40:04.706991+0000","last_became_active":"2024-09-12T02:23:16.858637+0000","last_became_peered":"2024-09-12T02:23:16.858637+0000","last_unstale":"2024-09-12T02:40:04.706991+0000","last_undegraded":"2024-09-12T02:40:04.706991+0000","last_fullsized":"2024-09-12T02:40:04.706991+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":3925,"log_dups_size":0,"ondisk_log_size":3925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:47.915947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20092,"num_write_kb":256658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"28'5046","reported_seq":5077,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.720926+0000","last_change":"2024-09-12T02:23:04.776435+0000","last_active":"2024-09-12T02:39:57.720926+0000","last_peered":"2024-09-12T02:39:57.720926+0000","last_clean":"2024-09-12T02:39:57.720926+0000","last_became_active":"2024-09-12T02:23:04.776120+0000","last_became_peered":"2024-09-12T02:23:04.776120+0000","last_unstale":"2024-09-12T02:39:57.720926+0000","last_undegraded":"2024-09-12T02:39:57.720926+0000","last_fullsized":"2024-09-12T02:39:57.720926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5046,"log_dups_size":0,"ondisk_log_size":5046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:27.985094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26791,"num_write_kb":324401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"28'6719","reported_seq":6743,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.749518+0000","last_change":"2024-09-12T02:23:16.856477+0000","last_active":"2024-09-12T02:40:04.749518+0000","last_peered":"2024-09-12T02:40:04.749518+0000","last_clean":"2024-09-12T02:40:04.749518+0000","last_became_active":"2024-09-12T02:23:16.855839+0000","last_became_peered":"2024-09-12T02:23:16.855839+0000","last_unstale":"2024-09-12T02:40:04.749518+0000","last_undegraded":"2024-09-12T02:40:04.749518+0000","last_fullsized":"2024-09-12T02:40:04.749518+0000","mapping_epoch":24,"log_start":"28'900","ondisk_log_start":"28'900","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5819,"log_dups_size":0,"ondisk_log_size":5819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:42.510184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34627,"num_write_kb":392862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"28'4165","reported_seq":4196,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.847028+0000","last_change":"2024-09-12T02:23:04.788827+0000","last_active":"2024-09-12T02:39:57.847028+0000","last_peered":"2024-09-12T02:39:57.847028+0000","last_clean":"2024-09-12T02:39:57.847028+0000","last_became_active":"2024-09-12T02:23:04.788521+0000","last_became_peered":"2024-09-12T02:23:04.788521+0000","last_unstale":"2024-09-12T02:39:57.847028+0000","last_undegraded":"2024-09-12T02:39:57.847028+0000","last_fullsized":"2024-09-12T02:39:57.847028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4165,"log_dups_size":0,"ondisk_log_size":4165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:24.470245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21249,"num_write_kb":269852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"28'5811","reported_seq":5835,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.723792+0000","last_change":"2024-09-12T02:23:16.838421+0000","last_active":"2024-09-12T02:40:04.723792+0000","last_peered":"2024-09-12T02:40:04.723792+0000","last_clean":"2024-09-12T02:40:04.723792+0000","last_became_active":"2024-09-12T02:23:16.837606+0000","last_became_peered":"2024-09-12T02:23:16.837606+0000","last_unstale":"2024-09-12T02:40:04.723792+0000","last_undegraded":"2024-09-12T02:40:04.723792+0000","last_fullsized":"2024-09-12T02:40:04.723792+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5811,"log_dups_size":0,"ondisk_log_size":5811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:09.704007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30267,"num_write_kb":338418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"28'5427","reported_seq":5444,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.679950+0000","last_change":"2024-09-12T02:23:56.564278+0000","last_active":"2024-09-12T02:39:57.679950+0000","last_peered":"2024-09-12T02:39:57.679950+0000","last_clean":"2024-09-12T02:39:57.679950+0000","last_became_active":"2024-09-12T02:23:56.563943+0000","last_became_peered":"2024-09-12T02:23:56.563943+0000","last_unstale":"2024-09-12T02:39:57.679950+0000","last_undegraded":"2024-09-12T02:39:57.679950+0000","last_fullsized":"2024-09-12T02:39:57.679950+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5427,"log_dups_size":0,"ondisk_log_size":5427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:40.787770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27382,"num_write_kb":347330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"28'4215","reported_seq":4238,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.744076+0000","last_change":"2024-09-12T02:23:16.845296+0000","last_active":"2024-09-12T02:40:04.744076+0000","last_peered":"2024-09-12T02:40:04.744076+0000","last_clean":"2024-09-12T02:40:04.744076+0000","last_became_active":"2024-09-12T02:23:16.844939+0000","last_became_peered":"2024-09-12T02:23:16.844939+0000","last_unstale":"2024-09-12T02:40:04.744076+0000","last_undegraded":"2024-09-12T02:40:04.744076+0000","last_fullsized":"2024-09-12T02:40:04.744076+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4215,"log_dups_size":0,"ondisk_log_size":4215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:16.790822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21581,"num_write_kb":250408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'4161","reported_seq":4178,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.750998+0000","last_change":"2024-09-12T02:23:56.674421+0000","last_active":"2024-09-12T02:39:57.750998+0000","last_peered":"2024-09-12T02:39:57.750998+0000","last_clean":"2024-09-12T02:39:57.750998+0000","last_became_active":"2024-09-12T02:23:56.674143+0000","last_became_peered":"2024-09-12T02:23:56.674143+0000","last_unstale":"2024-09-12T02:39:57.750998+0000","last_undegraded":"2024-09-12T02:39:57.750998+0000","last_fullsized":"2024-09-12T02:39:57.750998+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4161,"log_dups_size":0,"ondisk_log_size":4161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:01.375384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21422,"num_write_kb":266111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2f","version":"28'6100","reported_seq":6123,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.684901+0000","last_change":"2024-09-12T02:23:16.849846+0000","last_active":"2024-09-12T02:40:04.684901+0000","last_peered":"2024-09-12T02:40:04.684901+0000","last_clean":"2024-09-12T02:40:04.684901+0000","last_became_active":"2024-09-12T02:23:16.849585+0000","last_became_peered":"2024-09-12T02:23:16.849585+0000","last_unstale":"2024-09-12T02:40:04.684901+0000","last_undegraded":"2024-09-12T02:40:04.684901+0000","last_fullsized":"2024-09-12T02:40:04.684901+0000","mapping_epoch":24,"log_start":"28'300","ondisk_log_start":"28'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5800,"log_dups_size":0,"ondisk_log_size":5800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:58.775679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30891,"num_write_kb":369602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"28'4576","reported_seq":4607,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.769180+0000","last_change":"2024-09-12T02:23:04.788624+0000","last_active":"2024-09-12T02:39:57.769180+0000","last_peered":"2024-09-12T02:39:57.769180+0000","last_clean":"2024-09-12T02:39:57.769180+0000","last_became_active":"2024-09-12T02:23:04.788352+0000","last_became_peered":"2024-09-12T02:23:04.788352+0000","last_unstale":"2024-09-12T02:39:57.769180+0000","last_undegraded":"2024-09-12T02:39:57.769180+0000","last_fullsized":"2024-09-12T02:39:57.769180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4576,"log_dups_size":0,"ondisk_log_size":4576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:13.961110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23775,"num_write_kb":295982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"28'5142","reported_seq":5165,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.686350+0000","last_change":"2024-09-12T02:23:16.850112+0000","last_active":"2024-09-12T02:40:04.686350+0000","last_peered":"2024-09-12T02:40:04.686350+0000","last_clean":"2024-09-12T02:40:04.686350+0000","last_became_active":"2024-09-12T02:23:16.849831+0000","last_became_peered":"2024-09-12T02:23:16.849831+0000","last_unstale":"2024-09-12T02:40:04.686350+0000","last_undegraded":"2024-09-12T02:40:04.686350+0000","last_fullsized":"2024-09-12T02:40:04.686350+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5142,"log_dups_size":0,"ondisk_log_size":5142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:42.625762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26862,"num_write_kb":308481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"28'4731","reported_seq":4762,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.835535+0000","last_change":"2024-09-12T02:23:04.785685+0000","last_active":"2024-09-12T02:39:57.835535+0000","last_peered":"2024-09-12T02:39:57.835535+0000","last_clean":"2024-09-12T02:39:57.835535+0000","last_became_active":"2024-09-12T02:23:04.784945+0000","last_became_peered":"2024-09-12T02:23:04.784945+0000","last_unstale":"2024-09-12T02:39:57.835535+0000","last_undegraded":"2024-09-12T02:39:57.835535+0000","last_fullsized":"2024-09-12T02:39:57.835535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4731,"log_dups_size":0,"ondisk_log_size":4731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:36.658436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24557,"num_write_kb":319695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"28'4794","reported_seq":4817,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.688321+0000","last_change":"2024-09-12T02:23:16.846108+0000","last_active":"2024-09-12T02:40:04.688321+0000","last_peered":"2024-09-12T02:40:04.688321+0000","last_clean":"2024-09-12T02:40:04.688321+0000","last_became_active":"2024-09-12T02:23:16.845793+0000","last_became_peered":"2024-09-12T02:23:16.845793+0000","last_unstale":"2024-09-12T02:40:04.688321+0000","last_undegraded":"2024-09-12T02:40:04.688321+0000","last_fullsized":"2024-09-12T02:40:04.688321+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4794,"log_dups_size":0,"ondisk_log_size":4794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:36.274858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23926,"num_write_kb":300628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"28'4561","reported_seq":4592,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.804691+0000","last_change":"2024-09-12T02:23:04.785849+0000","last_active":"2024-09-12T02:39:57.804691+0000","last_peered":"2024-09-12T02:39:57.804691+0000","last_clean":"2024-09-12T02:39:57.804691+0000","last_became_active":"2024-09-12T02:23:04.785511+0000","last_became_peered":"2024-09-12T02:23:04.785511+0000","last_unstale":"2024-09-12T02:39:57.804691+0000","last_undegraded":"2024-09-12T02:39:57.804691+0000","last_fullsized":"2024-09-12T02:39:57.804691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4561,"log_dups_size":0,"ondisk_log_size":4561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:28.670102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23484,"num_write_kb":303052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"28'5809","reported_seq":5832,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.701362+0000","last_change":"2024-09-12T02:23:16.855615+0000","last_active":"2024-09-12T02:40:04.701362+0000","last_peered":"2024-09-12T02:40:04.701362+0000","last_clean":"2024-09-12T02:40:04.701362+0000","last_became_active":"2024-09-12T02:23:16.855278+0000","last_became_peered":"2024-09-12T02:23:16.855278+0000","last_unstale":"2024-09-12T02:40:04.701362+0000","last_undegraded":"2024-09-12T02:40:04.701362+0000","last_fullsized":"2024-09-12T02:40:04.701362+0000","mapping_epoch":24,"log_start":"28'300","ondisk_log_start":"28'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5509,"log_dups_size":0,"ondisk_log_size":5509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:34.214175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30461,"num_write_kb":343399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"28'4620","reported_seq":4651,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.744548+0000","last_change":"2024-09-12T02:23:04.789575+0000","last_active":"2024-09-12T02:39:57.744548+0000","last_peered":"2024-09-12T02:39:57.744548+0000","last_clean":"2024-09-12T02:39:57.744548+0000","last_became_active":"2024-09-12T02:23:04.789296+0000","last_became_peered":"2024-09-12T02:23:04.789296+0000","last_unstale":"2024-09-12T02:39:57.744548+0000","last_undegraded":"2024-09-12T02:39:57.744548+0000","last_fullsized":"2024-09-12T02:39:57.744548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4620,"log_dups_size":0,"ondisk_log_size":4620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:13.166139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23568,"num_write_kb":295197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"28'5012","reported_seq":5035,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.717856+0000","last_change":"2024-09-12T02:23:16.858045+0000","last_active":"2024-09-12T02:40:04.717856+0000","last_peered":"2024-09-12T02:40:04.717856+0000","last_clean":"2024-09-12T02:40:04.717856+0000","last_became_active":"2024-09-12T02:23:16.857772+0000","last_became_peered":"2024-09-12T02:23:16.857772+0000","last_unstale":"2024-09-12T02:40:04.717856+0000","last_undegraded":"2024-09-12T02:40:04.717856+0000","last_fullsized":"2024-09-12T02:40:04.717856+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5012,"log_dups_size":0,"ondisk_log_size":5012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:35.598279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25770,"num_write_kb":312200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"28'4649","reported_seq":4680,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.749517+0000","last_change":"2024-09-12T02:23:04.777450+0000","last_active":"2024-09-12T02:39:57.749517+0000","last_peered":"2024-09-12T02:39:57.749517+0000","last_clean":"2024-09-12T02:39:57.749517+0000","last_became_active":"2024-09-12T02:23:04.776825+0000","last_became_peered":"2024-09-12T02:23:04.776825+0000","last_unstale":"2024-09-12T02:39:57.749517+0000","last_undegraded":"2024-09-12T02:39:57.749517+0000","last_fullsized":"2024-09-12T02:39:57.749517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4649,"log_dups_size":0,"ondisk_log_size":4649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:40.315075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22974,"num_write_kb":296824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"28'4733","reported_seq":4756,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.663806+0000","last_change":"2024-09-12T02:23:16.846032+0000","last_active":"2024-09-12T02:40:04.663806+0000","last_peered":"2024-09-12T02:40:04.663806+0000","last_clean":"2024-09-12T02:40:04.663806+0000","last_became_active":"2024-09-12T02:23:16.845492+0000","last_became_peered":"2024-09-12T02:23:16.845492+0000","last_unstale":"2024-09-12T02:40:04.663806+0000","last_undegraded":"2024-09-12T02:40:04.663806+0000","last_fullsized":"2024-09-12T02:40:04.663806+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4733,"log_dups_size":0,"ondisk_log_size":4733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:18.785798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24040,"num_write_kb":276615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"28'3733","reported_seq":3764,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.754418+0000","last_change":"2024-09-12T02:23:04.791378+0000","last_active":"2024-09-12T02:39:57.754418+0000","last_peered":"2024-09-12T02:39:57.754418+0000","last_clean":"2024-09-12T02:39:57.754418+0000","last_became_active":"2024-09-12T02:23:04.790926+0000","last_became_peered":"2024-09-12T02:23:04.790926+0000","last_unstale":"2024-09-12T02:39:57.754418+0000","last_undegraded":"2024-09-12T02:39:57.754418+0000","last_fullsized":"2024-09-12T02:39:57.754418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":3733,"log_dups_size":0,"ondisk_log_size":3733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:34.764210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18622,"num_write_kb":238300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"28'5122","reported_seq":5145,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.676752+0000","last_change":"2024-09-12T02:23:16.851099+0000","last_active":"2024-09-12T02:40:04.676752+0000","last_peered":"2024-09-12T02:40:04.676752+0000","last_clean":"2024-09-12T02:40:04.676752+0000","last_became_active":"2024-09-12T02:23:16.850747+0000","last_became_peered":"2024-09-12T02:23:16.850747+0000","last_unstale":"2024-09-12T02:40:04.676752+0000","last_undegraded":"2024-09-12T02:40:04.676752+0000","last_fullsized":"2024-09-12T02:40:04.676752+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5122,"log_dups_size":0,"ondisk_log_size":5122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:01:31.445590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26303,"num_write_kb":306134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"28'5815","reported_seq":5846,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.831090+0000","last_change":"2024-09-12T02:23:04.789439+0000","last_active":"2024-09-12T02:39:57.831090+0000","last_peered":"2024-09-12T02:39:57.831090+0000","last_clean":"2024-09-12T02:39:57.831090+0000","last_became_active":"2024-09-12T02:23:04.787421+0000","last_became_peered":"2024-09-12T02:23:04.787421+0000","last_unstale":"2024-09-12T02:39:57.831090+0000","last_undegraded":"2024-09-12T02:39:57.831090+0000","last_fullsized":"2024-09-12T02:39:57.831090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5815,"log_dups_size":0,"ondisk_log_size":5815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:44.295056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29660,"num_write_kb":364722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"28'5421","reported_seq":5443,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.709758+0000","last_change":"2024-09-12T02:23:16.850923+0000","last_active":"2024-09-12T02:40:04.709758+0000","last_peered":"2024-09-12T02:40:04.709758+0000","last_clean":"2024-09-12T02:40:04.709758+0000","last_became_active":"2024-09-12T02:23:16.850609+0000","last_became_peered":"2024-09-12T02:23:16.850609+0000","last_unstale":"2024-09-12T02:40:04.709758+0000","last_undegraded":"2024-09-12T02:40:04.709758+0000","last_fullsized":"2024-09-12T02:40:04.709758+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5421,"log_dups_size":0,"ondisk_log_size":5421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:52.110438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28803,"num_write_kb":344817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"28'4311","reported_seq":4342,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.771185+0000","last_change":"2024-09-12T02:23:04.790532+0000","last_active":"2024-09-12T02:39:57.771185+0000","last_peered":"2024-09-12T02:39:57.771185+0000","last_clean":"2024-09-12T02:39:57.771185+0000","last_became_active":"2024-09-12T02:23:04.789229+0000","last_became_peered":"2024-09-12T02:23:04.789229+0000","last_unstale":"2024-09-12T02:39:57.771185+0000","last_undegraded":"2024-09-12T02:39:57.771185+0000","last_fullsized":"2024-09-12T02:39:57.771185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4311,"log_dups_size":0,"ondisk_log_size":4311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:59.901665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22556,"num_write_kb":270677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"28'6535","reported_seq":6557,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.676395+0000","last_change":"2024-09-12T02:23:16.856612+0000","last_active":"2024-09-12T02:40:04.676395+0000","last_peered":"2024-09-12T02:40:04.676395+0000","last_clean":"2024-09-12T02:40:04.676395+0000","last_became_active":"2024-09-12T02:23:16.856290+0000","last_became_peered":"2024-09-12T02:23:16.856290+0000","last_unstale":"2024-09-12T02:40:04.676395+0000","last_undegraded":"2024-09-12T02:40:04.676395+0000","last_fullsized":"2024-09-12T02:40:04.676395+0000","mapping_epoch":24,"log_start":"28'1000","ondisk_log_start":"28'1000","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5535,"log_dups_size":0,"ondisk_log_size":5535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:14.846281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35147,"num_write_kb":386723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"28'4664","reported_seq":4695,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.756776+0000","last_change":"2024-09-12T02:23:04.782490+0000","last_active":"2024-09-12T02:39:57.756776+0000","last_peered":"2024-09-12T02:39:57.756776+0000","last_clean":"2024-09-12T02:39:57.756776+0000","last_became_active":"2024-09-12T02:23:04.782183+0000","last_became_peered":"2024-09-12T02:23:04.782183+0000","last_unstale":"2024-09-12T02:39:57.756776+0000","last_undegraded":"2024-09-12T02:39:57.756776+0000","last_fullsized":"2024-09-12T02:39:57.756776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4664,"log_dups_size":0,"ondisk_log_size":4664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:28.699880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23511,"num_write_kb":303118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"28'4146","reported_seq":4168,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.701442+0000","last_change":"2024-09-12T02:23:16.858100+0000","last_active":"2024-09-12T02:40:04.701442+0000","last_peered":"2024-09-12T02:40:04.701442+0000","last_clean":"2024-09-12T02:40:04.701442+0000","last_became_active":"2024-09-12T02:23:16.857818+0000","last_became_peered":"2024-09-12T02:23:16.857818+0000","last_unstale":"2024-09-12T02:40:04.701442+0000","last_undegraded":"2024-09-12T02:40:04.701442+0000","last_fullsized":"2024-09-12T02:40:04.701442+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4146,"log_dups_size":0,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:45.991170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21288,"num_write_kb":257331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"28'4600","reported_seq":4631,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.732332+0000","last_change":"2024-09-12T02:23:04.787140+0000","last_active":"2024-09-12T02:39:57.732332+0000","last_peered":"2024-09-12T02:39:57.732332+0000","last_clean":"2024-09-12T02:39:57.732332+0000","last_became_active":"2024-09-12T02:23:04.786799+0000","last_became_peered":"2024-09-12T02:23:04.786799+0000","last_unstale":"2024-09-12T02:39:57.732332+0000","last_undegraded":"2024-09-12T02:39:57.732332+0000","last_fullsized":"2024-09-12T02:39:57.732332+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4600,"log_dups_size":0,"ondisk_log_size":4600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:31.639605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23822,"num_write_kb":304357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"28'5170","reported_seq":5192,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.691998+0000","last_change":"2024-09-12T02:23:16.846100+0000","last_active":"2024-09-12T02:40:04.691998+0000","last_peered":"2024-09-12T02:40:04.691998+0000","last_clean":"2024-09-12T02:40:04.691998+0000","last_became_active":"2024-09-12T02:23:16.845749+0000","last_became_peered":"2024-09-12T02:23:16.845749+0000","last_unstale":"2024-09-12T02:40:04.691998+0000","last_undegraded":"2024-09-12T02:40:04.691998+0000","last_fullsized":"2024-09-12T02:40:04.691998+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5170,"log_dups_size":0,"ondisk_log_size":5170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:42.783366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26244,"num_write_kb":301879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"28'3980","reported_seq":4011,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.731214+0000","last_change":"2024-09-12T02:23:04.782128+0000","last_active":"2024-09-12T02:39:57.731214+0000","last_peered":"2024-09-12T02:39:57.731214+0000","last_clean":"2024-09-12T02:39:57.731214+0000","last_became_active":"2024-09-12T02:23:04.781101+0000","last_became_peered":"2024-09-12T02:23:04.781101+0000","last_unstale":"2024-09-12T02:39:57.731214+0000","last_undegraded":"2024-09-12T02:39:57.731214+0000","last_fullsized":"2024-09-12T02:39:57.731214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":3980,"log_dups_size":0,"ondisk_log_size":3980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:49.421147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20651,"num_write_kb":267035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"28'5235","reported_seq":5258,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.711216+0000","last_change":"2024-09-12T02:23:16.836968+0000","last_active":"2024-09-12T02:40:04.711216+0000","last_peered":"2024-09-12T02:40:04.711216+0000","last_clean":"2024-09-12T02:40:04.711216+0000","last_became_active":"2024-09-12T02:23:16.836561+0000","last_became_peered":"2024-09-12T02:23:16.836561+0000","last_unstale":"2024-09-12T02:40:04.711216+0000","last_undegraded":"2024-09-12T02:40:04.711216+0000","last_fullsized":"2024-09-12T02:40:04.711216+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5235,"log_dups_size":0,"ondisk_log_size":5235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:08.765569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26710,"num_write_kb":316033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"28'3967","reported_seq":3998,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.791291+0000","last_change":"2024-09-12T02:23:04.787034+0000","last_active":"2024-09-12T02:39:57.791291+0000","last_peered":"2024-09-12T02:39:57.791291+0000","last_clean":"2024-09-12T02:39:57.791291+0000","last_became_active":"2024-09-12T02:23:04.786044+0000","last_became_peered":"2024-09-12T02:23:04.786044+0000","last_unstale":"2024-09-12T02:39:57.791291+0000","last_undegraded":"2024-09-12T02:39:57.791291+0000","last_fullsized":"2024-09-12T02:39:57.791291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":3967,"log_dups_size":0,"ondisk_log_size":3967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:07.183028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20368,"num_write_kb":253735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"28'4409","reported_seq":4431,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.657803+0000","last_change":"2024-09-12T02:23:16.846114+0000","last_active":"2024-09-12T02:40:04.657803+0000","last_peered":"2024-09-12T02:40:04.657803+0000","last_clean":"2024-09-12T02:40:04.657803+0000","last_became_active":"2024-09-12T02:23:16.845757+0000","last_became_peered":"2024-09-12T02:23:16.845757+0000","last_unstale":"2024-09-12T02:40:04.657803+0000","last_undegraded":"2024-09-12T02:40:04.657803+0000","last_fullsized":"2024-09-12T02:40:04.657803+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4409,"log_dups_size":0,"ondisk_log_size":4409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:17:52.019813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22900,"num_write_kb":275935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"28'4251","reported_seq":4282,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.798750+0000","last_change":"2024-09-12T02:23:04.785662+0000","last_active":"2024-09-12T02:39:57.798750+0000","last_peered":"2024-09-12T02:39:57.798750+0000","last_clean":"2024-09-12T02:39:57.798750+0000","last_became_active":"2024-09-12T02:23:04.785375+0000","last_became_peered":"2024-09-12T02:23:04.785375+0000","last_unstale":"2024-09-12T02:39:57.798750+0000","last_undegraded":"2024-09-12T02:39:57.798750+0000","last_fullsized":"2024-09-12T02:39:57.798750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4251,"log_dups_size":0,"ondisk_log_size":4251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:44.295056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21731,"num_write_kb":283663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"28'4658","reported_seq":4681,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.746879+0000","last_change":"2024-09-12T02:23:16.858175+0000","last_active":"2024-09-12T02:40:04.746879+0000","last_peered":"2024-09-12T02:40:04.746879+0000","last_clean":"2024-09-12T02:40:04.746879+0000","last_became_active":"2024-09-12T02:23:16.857873+0000","last_became_peered":"2024-09-12T02:23:16.857873+0000","last_unstale":"2024-09-12T02:40:04.746879+0000","last_undegraded":"2024-09-12T02:40:04.746879+0000","last_fullsized":"2024-09-12T02:40:04.746879+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4658,"log_dups_size":0,"ondisk_log_size":4658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:54.535867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24616,"num_write_kb":279029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"28'5811","reported_seq":5842,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.850760+0000","last_change":"2024-09-12T02:23:04.791929+0000","last_active":"2024-09-12T02:39:57.850760+0000","last_peered":"2024-09-12T02:39:57.850760+0000","last_clean":"2024-09-12T02:39:57.850760+0000","last_became_active":"2024-09-12T02:23:04.791622+0000","last_became_peered":"2024-09-12T02:23:04.791622+0000","last_unstale":"2024-09-12T02:39:57.850760+0000","last_undegraded":"2024-09-12T02:39:57.850760+0000","last_fullsized":"2024-09-12T02:39:57.850760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5811,"log_dups_size":0,"ondisk_log_size":5811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:35.012685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30224,"num_write_kb":350457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"28'5106","reported_seq":5129,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.667862+0000","last_change":"2024-09-12T02:23:16.849985+0000","last_active":"2024-09-12T02:40:04.667862+0000","last_peered":"2024-09-12T02:40:04.667862+0000","last_clean":"2024-09-12T02:40:04.667862+0000","last_became_active":"2024-09-12T02:23:16.849641+0000","last_became_peered":"2024-09-12T02:23:16.849641+0000","last_unstale":"2024-09-12T02:40:04.667862+0000","last_undegraded":"2024-09-12T02:40:04.667862+0000","last_fullsized":"2024-09-12T02:40:04.667862+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5106,"log_dups_size":0,"ondisk_log_size":5106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:28.373543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25610,"num_write_kb":311590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"28'5712","reported_seq":5748,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.829068+0000","last_change":"2024-09-12T02:23:56.084447+0000","last_active":"2024-09-12T02:39:57.829068+0000","last_peered":"2024-09-12T02:39:57.829068+0000","last_clean":"2024-09-12T02:39:57.829068+0000","last_became_active":"2024-09-12T02:23:56.084173+0000","last_became_peered":"2024-09-12T02:23:56.084173+0000","last_unstale":"2024-09-12T02:39:57.829068+0000","last_undegraded":"2024-09-12T02:39:57.829068+0000","last_fullsized":"2024-09-12T02:39:57.829068+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5712,"log_dups_size":0,"ondisk_log_size":5712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:38.004804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30266,"num_write_kb":367055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"28'6924","reported_seq":6948,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.724208+0000","last_change":"2024-09-12T02:23:16.840250+0000","last_active":"2024-09-12T02:40:04.724208+0000","last_peered":"2024-09-12T02:40:04.724208+0000","last_clean":"2024-09-12T02:40:04.724208+0000","last_became_active":"2024-09-12T02:23:16.839914+0000","last_became_peered":"2024-09-12T02:23:16.839914+0000","last_unstale":"2024-09-12T02:40:04.724208+0000","last_undegraded":"2024-09-12T02:40:04.724208+0000","last_fullsized":"2024-09-12T02:40:04.724208+0000","mapping_epoch":24,"log_start":"28'1700","ondisk_log_start":"28'1700","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5224,"log_dups_size":0,"ondisk_log_size":5224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:04.798197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36307,"num_write_kb":403764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"28'4960","reported_seq":4990,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.771890+0000","last_change":"2024-09-12T02:23:04.779648+0000","last_active":"2024-09-12T02:39:57.771890+0000","last_peered":"2024-09-12T02:39:57.771890+0000","last_clean":"2024-09-12T02:39:57.771890+0000","last_became_active":"2024-09-12T02:23:04.779384+0000","last_became_peered":"2024-09-12T02:23:04.779384+0000","last_unstale":"2024-09-12T02:39:57.771890+0000","last_undegraded":"2024-09-12T02:39:57.771890+0000","last_fullsized":"2024-09-12T02:39:57.771890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4960,"log_dups_size":0,"ondisk_log_size":4960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:41.491471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24704,"num_write_kb":320180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"28'4652","reported_seq":4676,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.706923+0000","last_change":"2024-09-12T02:23:16.850060+0000","last_active":"2024-09-12T02:40:04.706923+0000","last_peered":"2024-09-12T02:40:04.706923+0000","last_clean":"2024-09-12T02:40:04.706923+0000","last_became_active":"2024-09-12T02:23:16.849744+0000","last_became_peered":"2024-09-12T02:23:16.849744+0000","last_unstale":"2024-09-12T02:40:04.706923+0000","last_undegraded":"2024-09-12T02:40:04.706923+0000","last_fullsized":"2024-09-12T02:40:04.706923+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4652,"log_dups_size":0,"ondisk_log_size":4652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:34.130685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24125,"num_write_kb":272841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"28'4717","reported_seq":4733,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.732879+0000","last_change":"2024-09-12T02:23:55.991674+0000","last_active":"2024-09-12T02:39:57.732879+0000","last_peered":"2024-09-12T02:39:57.732879+0000","last_clean":"2024-09-12T02:39:57.732879+0000","last_became_active":"2024-09-12T02:23:55.991300+0000","last_became_peered":"2024-09-12T02:23:55.991300+0000","last_unstale":"2024-09-12T02:39:57.732879+0000","last_undegraded":"2024-09-12T02:39:57.732879+0000","last_fullsized":"2024-09-12T02:39:57.732879+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4717,"log_dups_size":0,"ondisk_log_size":4717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:23.613509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24759,"num_write_kb":295935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3c","version":"28'4790","reported_seq":4814,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.669505+0000","last_change":"2024-09-12T02:23:16.862034+0000","last_active":"2024-09-12T02:40:04.669505+0000","last_peered":"2024-09-12T02:40:04.669505+0000","last_clean":"2024-09-12T02:40:04.669505+0000","last_became_active":"2024-09-12T02:23:16.861441+0000","last_became_peered":"2024-09-12T02:23:16.861441+0000","last_unstale":"2024-09-12T02:40:04.669505+0000","last_undegraded":"2024-09-12T02:40:04.669505+0000","last_fullsized":"2024-09-12T02:40:04.669505+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4790,"log_dups_size":0,"ondisk_log_size":4790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:24.332614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25639,"num_write_kb":287197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"28'4345","reported_seq":4375,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.826467+0000","last_change":"2024-09-12T02:23:04.788890+0000","last_active":"2024-09-12T02:39:57.826467+0000","last_peered":"2024-09-12T02:39:57.826467+0000","last_clean":"2024-09-12T02:39:57.826467+0000","last_became_active":"2024-09-12T02:23:04.788617+0000","last_became_peered":"2024-09-12T02:23:04.788617+0000","last_unstale":"2024-09-12T02:39:57.826467+0000","last_undegraded":"2024-09-12T02:39:57.826467+0000","last_fullsized":"2024-09-12T02:39:57.826467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4345,"log_dups_size":0,"ondisk_log_size":4345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:24.194151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22438,"num_write_kb":266069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"28'5149","reported_seq":5173,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.705526+0000","last_change":"2024-09-12T02:23:16.855853+0000","last_active":"2024-09-12T02:40:04.705526+0000","last_peered":"2024-09-12T02:40:04.705526+0000","last_clean":"2024-09-12T02:40:04.705526+0000","last_became_active":"2024-09-12T02:23:16.855437+0000","last_became_peered":"2024-09-12T02:23:16.855437+0000","last_unstale":"2024-09-12T02:40:04.705526+0000","last_undegraded":"2024-09-12T02:40:04.705526+0000","last_fullsized":"2024-09-12T02:40:04.705526+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5149,"log_dups_size":0,"ondisk_log_size":5149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:27.557862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26098,"num_write_kb":313495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'5428","reported_seq":5458,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.753841+0000","last_change":"2024-09-12T02:23:04.777165+0000","last_active":"2024-09-12T02:39:57.753841+0000","last_peered":"2024-09-12T02:39:57.753841+0000","last_clean":"2024-09-12T02:39:57.753841+0000","last_became_active":"2024-09-12T02:23:04.776857+0000","last_became_peered":"2024-09-12T02:23:04.776857+0000","last_unstale":"2024-09-12T02:39:57.753841+0000","last_undegraded":"2024-09-12T02:39:57.753841+0000","last_fullsized":"2024-09-12T02:39:57.753841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5428,"log_dups_size":0,"ondisk_log_size":5428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:28.309591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27088,"num_write_kb":350175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"28'4355","reported_seq":4377,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.719330+0000","last_change":"2024-09-12T02:23:16.849235+0000","last_active":"2024-09-12T02:40:04.719330+0000","last_peered":"2024-09-12T02:40:04.719330+0000","last_clean":"2024-09-12T02:40:04.719330+0000","last_became_active":"2024-09-12T02:23:16.848936+0000","last_became_peered":"2024-09-12T02:23:16.848936+0000","last_unstale":"2024-09-12T02:40:04.719330+0000","last_undegraded":"2024-09-12T02:40:04.719330+0000","last_fullsized":"2024-09-12T02:40:04.719330+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4355,"log_dups_size":0,"ondisk_log_size":4355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:32.415375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22650,"num_write_kb":266857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"28'3929","reported_seq":3961,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.823217+0000","last_change":"2024-09-12T02:23:04.786772+0000","last_active":"2024-09-12T02:39:57.823217+0000","last_peered":"2024-09-12T02:39:57.823217+0000","last_clean":"2024-09-12T02:39:57.823217+0000","last_became_active":"2024-09-12T02:23:04.786509+0000","last_became_peered":"2024-09-12T02:23:04.786509+0000","last_unstale":"2024-09-12T02:39:57.823217+0000","last_undegraded":"2024-09-12T02:39:57.823217+0000","last_fullsized":"2024-09-12T02:39:57.823217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":3929,"log_dups_size":0,"ondisk_log_size":3929,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:01.755827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20681,"num_write_kb":267297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"28'6034","reported_seq":6056,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.676402+0000","last_change":"2024-09-12T02:23:16.834788+0000","last_active":"2024-09-12T02:40:04.676402+0000","last_peered":"2024-09-12T02:40:04.676402+0000","last_clean":"2024-09-12T02:40:04.676402+0000","last_became_active":"2024-09-12T02:23:16.834483+0000","last_became_peered":"2024-09-12T02:23:16.834483+0000","last_unstale":"2024-09-12T02:40:04.676402+0000","last_undegraded":"2024-09-12T02:40:04.676402+0000","last_fullsized":"2024-09-12T02:40:04.676402+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":6034,"log_dups_size":0,"ondisk_log_size":6034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:23.441282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30335,"num_write_kb":363259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"28'4664","reported_seq":4696,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.730630+0000","last_change":"2024-09-12T02:23:04.778772+0000","last_active":"2024-09-12T02:39:57.730630+0000","last_peered":"2024-09-12T02:39:57.730630+0000","last_clean":"2024-09-12T02:39:57.730630+0000","last_became_active":"2024-09-12T02:23:04.778445+0000","last_became_peered":"2024-09-12T02:23:04.778445+0000","last_unstale":"2024-09-12T02:39:57.730630+0000","last_undegraded":"2024-09-12T02:39:57.730630+0000","last_fullsized":"2024-09-12T02:39:57.730630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4664,"log_dups_size":0,"ondisk_log_size":4664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:58.292023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23827,"num_write_kb":304439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"28'5564","reported_seq":5586,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.750707+0000","last_change":"2024-09-12T02:23:16.844170+0000","last_active":"2024-09-12T02:40:04.750707+0000","last_peered":"2024-09-12T02:40:04.750707+0000","last_clean":"2024-09-12T02:40:04.750707+0000","last_became_active":"2024-09-12T02:23:16.843880+0000","last_became_peered":"2024-09-12T02:23:16.843880+0000","last_unstale":"2024-09-12T02:40:04.750707+0000","last_undegraded":"2024-09-12T02:40:04.750707+0000","last_fullsized":"2024-09-12T02:40:04.750707+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5564,"log_dups_size":0,"ondisk_log_size":5564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:59.283416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28051,"num_write_kb":333672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"28'5549","reported_seq":5581,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.720949+0000","last_change":"2024-09-12T02:23:04.785821+0000","last_active":"2024-09-12T02:39:57.720949+0000","last_peered":"2024-09-12T02:39:57.720949+0000","last_clean":"2024-09-12T02:39:57.720949+0000","last_became_active":"2024-09-12T02:23:04.785516+0000","last_became_peered":"2024-09-12T02:23:04.785516+0000","last_unstale":"2024-09-12T02:39:57.720949+0000","last_undegraded":"2024-09-12T02:39:57.720949+0000","last_fullsized":"2024-09-12T02:39:57.720949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5549,"log_dups_size":0,"ondisk_log_size":5549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:42.400040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28712,"num_write_kb":373148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"28'5101","reported_seq":5123,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.723690+0000","last_change":"2024-09-12T02:23:16.844145+0000","last_active":"2024-09-12T02:40:04.723690+0000","last_peered":"2024-09-12T02:40:04.723690+0000","last_clean":"2024-09-12T02:40:04.723690+0000","last_became_active":"2024-09-12T02:23:16.843815+0000","last_became_peered":"2024-09-12T02:23:16.843815+0000","last_unstale":"2024-09-12T02:40:04.723690+0000","last_undegraded":"2024-09-12T02:40:04.723690+0000","last_fullsized":"2024-09-12T02:40:04.723690+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5101,"log_dups_size":0,"ondisk_log_size":5101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:31.789317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26856,"num_write_kb":304403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"28'3999","reported_seq":4031,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.797803+0000","last_change":"2024-09-12T02:23:04.791204+0000","last_active":"2024-09-12T02:39:57.797803+0000","last_peered":"2024-09-12T02:39:57.797803+0000","last_clean":"2024-09-12T02:39:57.797803+0000","last_became_active":"2024-09-12T02:23:04.790906+0000","last_became_peered":"2024-09-12T02:23:04.790906+0000","last_unstale":"2024-09-12T02:39:57.797803+0000","last_undegraded":"2024-09-12T02:39:57.797803+0000","last_fullsized":"2024-09-12T02:39:57.797803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":3999,"log_dups_size":0,"ondisk_log_size":3999,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:16.336873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20671,"num_write_kb":258921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1731204,"num_write_kb":20050774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":327719,"ondisk_log_size":327719,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":18273247,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":57,"num_read_kb":123,"num_write":4416,"num_write_kb":19551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36610048,"data_stored":36546494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3634,"ondisk_log_size":3634,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1541207,"num_write_kb":19284974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":299497,"ondisk_log_size":299497,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":18199792,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":62,"num_read_kb":127,"num_write":4449,"num_write_kb":19478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36462592,"data_stored":36399584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3678,"ondisk_log_size":3678,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476947,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1212344,"kb_used_data":13160,"kb_used_omap":1,"kb_used_meta":1199166,"kb_avail":93159496,"statfs":{"total":96636764160,"available":95395323904,"internally_reserved":0,"allocated":13475840,"data_stored":13292277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":1227946442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476949,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":757460,"kb_used_data":9796,"kb_used_omap":1,"kb_used_meta":747646,"kb_avail":93614380,"statfs":{"total":96636764160,"available":95861125120,"internally_reserved":0,"allocated":10031104,"data_stored":9841247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":765589958},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476948,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1147152,"kb_used_data":4480,"kb_used_omap":1,"kb_used_meta":1142654,"kb_avail":93224688,"statfs":{"total":96636764160,"available":95462080512,"internally_reserved":0,"allocated":4587520,"data_stored":4401471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1170078149},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509650,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1232784,"kb_used_data":11264,"kb_used_omap":1,"kb_used_meta":1221502,"kb_avail":93139056,"statfs":{"total":96636764160,"available":95374393344,"internally_reserved":0,"allocated":11534336,"data_stored":11334750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1250818501},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509649,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":757512,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":757118,"kb_avail":93614328,"statfs":{"total":96636764160,"available":95861071872,"internally_reserved":0,"allocated":385024,"data_stored":206475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":775289285},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509652,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1005564,"kb_used_data":9068,"kb_used_omap":1,"kb_used_meta":996478,"kb_avail":93366276,"statfs":{"total":96636764160,"available":95607066624,"internally_reserved":0,"allocated":9285632,"data_stored":9097939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1020393925},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542355,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1235704,"kb_used_data":18152,"kb_used_omap":1,"kb_used_meta":1217534,"kb_avail":93136136,"statfs":{"total":96636764160,"available":95371403264,"internally_reserved":0,"allocated":18587648,"data_stored":18391468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":1246755271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542354,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1000768,"kb_used_data":8496,"kb_used_omap":1,"kb_used_meta":992254,"kb_avail":93371072,"statfs":{"total":96636764160,"available":95611977728,"internally_reserved":0,"allocated":8699904,"data_stored":8507787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1016068549},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4206592,"data_stored":4194942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":88080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8486912,"data_stored":8477360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5541888,"data_stored":5527456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5537792,"data_stored":5528002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12583494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9809920,"data_stored":9795783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5701632,"data_stored":5688969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4292608,"data_stored":4283056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:40:11.817 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T02:40:11.817 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:40:11.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.954+0000 7f942942e640 1 Processor -- start 2024-09-12T02:40:11.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.954+0000 7f942942e640 1 -- start start 2024-09-12T02:40:11.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.955+0000 7f942942e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94240c3560 0x7f94240c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:11.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.955+0000 7f942942e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f94240c7fb0 0x7f9424160bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:11.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.955+0000 7f942942e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94240c8460 con 0x7f9424153be0 2024-09-12T02:40:11.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.955+0000 7f942942e640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f9424156db0 con 0x7f94240c7fb0 2024-09-12T02:40:11.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.955+0000 7f942942e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9424153fc0 con 0x7f94240c3560 2024-09-12T02:40:11.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.955+0000 7f9422ffd640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f9424153be0 0x7f94240ac720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:42800/0 (socket says 172.21.15.60:42800) 2024-09-12T02:40:11.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.955+0000 7f9422ffd640 1 -- 172.21.15.60:0/1181234220 learned_addr learned my addr 172.21.15.60:0/1181234220 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:40:11.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.955+0000 7f94237fe640 1 --2- 172.21.15.60:0/1181234220 >> v2:172.21.15.105:3300/0 conn(0x7f94240c7fb0 0x7f9424160bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:11.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.955+0000 7f94227fc640 1 --2- 172.21.15.60:0/1181234220 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94240c3560 0x7f94240c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:11.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.956+0000 7f9421ffb640 1 -- 172.21.15.60:0/1181234220 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3515286636 0 0) 0x7f94240c8460 con 0x7f9424153be0 2024-09-12T02:40:11.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.956+0000 7f9421ffb640 1 -- 172.21.15.60:0/1181234220 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9410003520 con 0x7f9424153be0 2024-09-12T02:40:11.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.956+0000 7f94237fe640 1 -- 172.21.15.60:0/1181234220 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94240c3560 msgr2=0x7f94240c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:11.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.956+0000 7f94237fe640 1 --2- 172.21.15.60:0/1181234220 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94240c3560 0x7f94240c7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.956+0000 7f94237fe640 1 -- 172.21.15.60:0/1181234220 >> v1:172.21.15.60:6789/0 conn(0x7f9424153be0 legacy=0x7f94240ac720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:11.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.956+0000 7f94237fe640 1 -- 172.21.15.60:0/1181234220 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94240a8030 con 0x7f94240c7fb0 2024-09-12T02:40:11.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.956+0000 7f94227fc640 1 --2- 172.21.15.60:0/1181234220 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94240c3560 0x7f94240c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:40:11.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.957+0000 7f94237fe640 1 --2- 172.21.15.60:0/1181234220 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94240c7fb0 0x7f9424160bd0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f941c0097a0 tx=0x7f941c02a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79b7deff4644f974 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:11.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.957+0000 7f9421ffb640 1 -- 172.21.15.60:0/1181234220 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f941c037070 con 0x7f94240c7fb0 2024-09-12T02:40:11.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.957+0000 7f9421ffb640 1 -- 172.21.15.60:0/1181234220 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f941c02adb0 con 0x7f94240c7fb0 2024-09-12T02:40:11.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.957+0000 7f9421ffb640 1 -- 172.21.15.60:0/1181234220 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f941c032640 con 0x7f94240c7fb0 2024-09-12T02:40:11.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.957+0000 7f942942e640 1 -- 172.21.15.60:0/1181234220 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94240c7fb0 msgr2=0x7f9424160bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:11.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.957+0000 7f942942e640 1 --2- 172.21.15.60:0/1181234220 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94240c7fb0 0x7f9424160bd0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f941c0097a0 tx=0x7f941c02a060 comp rx=0 tx=0).stop 2024-09-12T02:40:11.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.957+0000 7f942942e640 1 -- 172.21.15.60:0/1181234220 shutdown_connections 2024-09-12T02:40:11.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.957+0000 7f942942e640 1 --2- 172.21.15.60:0/1181234220 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94240c7fb0 0x7f9424160bd0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.957+0000 7f942942e640 1 --2- 172.21.15.60:0/1181234220 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94240c3560 0x7f94240c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.957+0000 7f942942e640 1 -- 172.21.15.60:0/1181234220 >> 172.21.15.60:0/1181234220 conn(0x7f94240c5660 msgr2=0x7f94240c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:11.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.958+0000 7f942942e640 1 -- 172.21.15.60:0/1181234220 shutdown_connections 2024-09-12T02:40:11.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.958+0000 7f942942e640 1 -- 172.21.15.60:0/1181234220 wait complete. 2024-09-12T02:40:11.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.959+0000 7f942942e640 1 Processor -- start 2024-09-12T02:40:11.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.959+0000 7f942942e640 1 -- start start 2024-09-12T02:40:11.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.960+0000 7f942942e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94240c3560 0x7f94241ec7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:11.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.960+0000 7f942942e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94240c7fb0 0x7f942414f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:11.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.960+0000 7f942942e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9424153be0 0x7f94241e10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:11.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.960+0000 7f942942e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f94240a83e0 con 0x7f9424153be0 2024-09-12T02:40:11.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.960+0000 7f942942e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9424157240 con 0x7f94240c7fb0 2024-09-12T02:40:11.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.960+0000 7f942942e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f94240ac370 con 0x7f94240c3560 2024-09-12T02:40:11.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.960+0000 7f94237fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9424153be0 0x7f94241e10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:11.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.960+0000 7f94237fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9424153be0 0x7f94241e10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40388/0 (socket says 172.21.15.60:40388) 2024-09-12T02:40:11.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.960+0000 7f94237fe640 1 -- 172.21.15.60:0/1889115862 learned_addr learned my addr 172.21.15.60:0/1889115862 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:11.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.960+0000 7f9422ffd640 1 --2- 172.21.15.60:0/1889115862 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94240c3560 0x7f94241ec7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:11.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.960+0000 7f94227fc640 1 --2- 172.21.15.60:0/1889115862 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94240c7fb0 0x7f942414f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:11.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.960+0000 7f94237fe640 1 -- 172.21.15.60:0/1889115862 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94240c3560 msgr2=0x7f94241ec7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:11.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.960+0000 7f94237fe640 1 --2- 172.21.15.60:0/1889115862 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94240c3560 0x7f94241ec7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.960+0000 7f94237fe640 1 -- 172.21.15.60:0/1889115862 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94240c7fb0 msgr2=0x7f942414f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:11.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.960+0000 7f94237fe640 1 --2- 172.21.15.60:0/1889115862 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94240c7fb0 0x7f942414f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:11.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.960+0000 7f94237fe640 1 -- 172.21.15.60:0/1889115862 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94241545e0 con 0x7f9424153be0 2024-09-12T02:40:11.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.960+0000 7f94237fe640 1 --2- 172.21.15.60:0/1889115862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9424153be0 0x7f94241e10d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f941c0097a0 tx=0x7f941c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:11.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.960+0000 7f941b7fe640 1 -- 172.21.15.60:0/1889115862 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f941c042070 con 0x7f9424153be0 2024-09-12T02:40:11.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.961+0000 7f941b7fe640 1 -- 172.21.15.60:0/1889115862 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f941c03e660 con 0x7f9424153be0 2024-09-12T02:40:11.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.961+0000 7f942942e640 1 -- 172.21.15.60:0/1889115862 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9424155ed0 con 0x7f9424153be0 2024-09-12T02:40:11.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.961+0000 7f941b7fe640 1 -- 172.21.15.60:0/1889115862 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f941c037040 con 0x7f9424153be0 2024-09-12T02:40:11.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.961+0000 7f942942e640 1 -- 172.21.15.60:0/1889115862 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9424156490 con 0x7f9424153be0 2024-09-12T02:40:11.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.962+0000 7f942942e640 1 -- 172.21.15.60:0/1889115862 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94240c63f0 con 0x7f9424153be0 2024-09-12T02:40:11.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.962+0000 7f941b7fe640 1 -- 172.21.15.60:0/1889115862 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f941c045070 con 0x7f9424153be0 2024-09-12T02:40:11.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.963+0000 7f941b7fe640 1 --2- 172.21.15.60:0/1889115862 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f940406be30 0x7f940406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:11.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.963+0000 7f941b7fe640 1 -- 172.21.15.60:0/1889115862 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f941c0ab730 con 0x7f9424153be0 2024-09-12T02:40:11.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.963+0000 7f9422ffd640 1 --2- 172.21.15.60:0/1889115862 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f940406be30 0x7f940406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:11.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.963+0000 7f9422ffd640 1 --2- 172.21.15.60:0/1889115862 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f940406be30 0x7f940406e2f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9414005c00 tx=0x7f9414009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:11.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:11.967+0000 7f941b7fe640 1 -- 172.21.15.60:0/1889115862 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f941c079780 con 0x7f9424153be0 2024-09-12T02:40:12.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.143+0000 7f942942e640 1 -- 172.21.15.60:0/1889115862 --> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f942406fff0 con 0x7f940406be30 2024-09-12T02:40:12.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.154+0000 7f941b7fe640 1 -- 172.21.15.60:0/1889115862 <== mgr.4098 v2:172.21.15.60:6800/3549430091 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+493732 (secure 0 0 0) 0x7f942406fff0 con 0x7f940406be30 2024-09-12T02:40:12.160 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:40:12.163 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T02:40:12.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.159+0000 7f942942e640 1 -- 172.21.15.60:0/1889115862 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f940406be30 msgr2=0x7f940406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:12.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.159+0000 7f942942e640 1 --2- 172.21.15.60:0/1889115862 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f940406be30 0x7f940406e2f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9414005c00 tx=0x7f9414009040 comp rx=0 tx=0).stop 2024-09-12T02:40:12.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.159+0000 7f942942e640 1 -- 172.21.15.60:0/1889115862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9424153be0 msgr2=0x7f94241e10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:12.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.159+0000 7f942942e640 1 --2- 172.21.15.60:0/1889115862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9424153be0 0x7f94241e10d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f941c0097a0 tx=0x7f941c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:40:12.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.159+0000 7f942942e640 1 -- 172.21.15.60:0/1889115862 shutdown_connections 2024-09-12T02:40:12.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.159+0000 7f942942e640 1 --2- 172.21.15.60:0/1889115862 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f940406be30 0x7f940406e2f0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:12.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.159+0000 7f942942e640 1 --2- 172.21.15.60:0/1889115862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9424153be0 0x7f94241e10d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:12.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.159+0000 7f942942e640 1 --2- 172.21.15.60:0/1889115862 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94240c7fb0 0x7f942414f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:12.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.159+0000 7f942942e640 1 --2- 172.21.15.60:0/1889115862 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94240c3560 0x7f94241ec7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:12.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.159+0000 7f942942e640 1 -- 172.21.15.60:0/1889115862 >> 172.21.15.60:0/1889115862 conn(0x7f94240c5660 msgr2=0x7f94240ac720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:12.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.159+0000 7f942942e640 1 -- 172.21.15.60:0/1889115862 shutdown_connections 2024-09-12T02:40:12.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.159+0000 7f942942e640 1 -- 172.21.15.60:0/1889115862 wait complete. 2024-09-12T02:40:12.171 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":540,"stamp":"2024-09-12T02:40:10.400083+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":37063407,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":235,"num_read_kb":350,"num_write":3281435,"num_write_kb":39377193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":634645,"ondisk_log_size":634645,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8349288,"kb_used_data":74792,"kb_used_omap":12,"kb_used_meta":8274355,"kb_avail":746625432,"statfs":{"total":773094113280,"available":764544442368,"internally_reserved":0,"allocated":76587008,"data_stored":75073414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":8472940080},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":57,"apply_latency_ms":57,"commit_latency_ns":57000000,"apply_latency_ns":57000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":498,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003973"},"pg_stats":[{"pgid":"5.18","version":"28'5064","reported_seq":5086,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.622362+0000","last_change":"2024-09-12T02:23:16.851521+0000","last_active":"2024-09-12T02:40:04.622362+0000","last_peered":"2024-09-12T02:40:04.622362+0000","last_clean":"2024-09-12T02:40:04.622362+0000","last_became_active":"2024-09-12T02:23:16.851220+0000","last_became_peered":"2024-09-12T02:23:16.851220+0000","last_unstale":"2024-09-12T02:40:04.622362+0000","last_undegraded":"2024-09-12T02:40:04.622362+0000","last_fullsized":"2024-09-12T02:40:04.622362+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5064,"log_dups_size":0,"ondisk_log_size":5064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:28.680072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26423,"num_write_kb":306733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"28'710","reported_seq":744,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:38.617912+0000","last_change":"2024-09-12T02:23:03.757848+0000","last_active":"2024-09-12T02:39:38.617912+0000","last_peered":"2024-09-12T02:39:38.617912+0000","last_clean":"2024-09-12T02:39:38.617912+0000","last_became_active":"2024-09-12T02:23:03.757544+0000","last_became_peered":"2024-09-12T02:23:03.757544+0000","last_unstale":"2024-09-12T02:39:38.617912+0000","last_undegraded":"2024-09-12T02:39:38.617912+0000","last_fullsized":"2024-09-12T02:39:38.617912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:43.576128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":4498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"28'5154","reported_seq":5186,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.755971+0000","last_change":"2024-09-12T02:23:04.790549+0000","last_active":"2024-09-12T02:39:57.755971+0000","last_peered":"2024-09-12T02:39:57.755971+0000","last_clean":"2024-09-12T02:39:57.755971+0000","last_became_active":"2024-09-12T02:23:04.790187+0000","last_became_peered":"2024-09-12T02:23:04.790187+0000","last_unstale":"2024-09-12T02:39:57.755971+0000","last_undegraded":"2024-09-12T02:39:57.755971+0000","last_fullsized":"2024-09-12T02:39:57.755971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5154,"log_dups_size":0,"ondisk_log_size":5154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:49.656395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26676,"num_write_kb":324046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"28'3","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:37:47.991333+0000","last_change":"2024-09-12T02:23:15.829383+0000","last_active":"2024-09-12T02:37:47.991333+0000","last_peered":"2024-09-12T02:37:47.991333+0000","last_clean":"2024-09-12T02:37:47.991333+0000","last_became_active":"2024-09-12T02:23:15.828295+0000","last_became_peered":"2024-09-12T02:23:15.828295+0000","last_unstale":"2024-09-12T02:37:47.991333+0000","last_undegraded":"2024-09-12T02:37:47.991333+0000","last_fullsized":"2024-09-12T02:37:47.991333+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:13.217846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"28'6025","reported_seq":6047,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.706763+0000","last_change":"2024-09-12T02:23:16.853675+0000","last_active":"2024-09-12T02:40:04.706763+0000","last_peered":"2024-09-12T02:40:04.706763+0000","last_clean":"2024-09-12T02:40:04.706763+0000","last_became_active":"2024-09-12T02:23:16.853371+0000","last_became_peered":"2024-09-12T02:23:16.853371+0000","last_unstale":"2024-09-12T02:40:04.706763+0000","last_undegraded":"2024-09-12T02:40:04.706763+0000","last_fullsized":"2024-09-12T02:40:04.706763+0000","mapping_epoch":24,"log_start":"28'200","ondisk_log_start":"28'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5825,"log_dups_size":0,"ondisk_log_size":5825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:10.323501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30759,"num_write_kb":360986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"28'8","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.607786+0000","last_change":"2024-09-12T02:23:03.767076+0000","last_active":"2024-09-12T02:39:47.607786+0000","last_peered":"2024-09-12T02:39:47.607786+0000","last_clean":"2024-09-12T02:39:47.607786+0000","last_became_active":"2024-09-12T02:23:03.766686+0000","last_became_peered":"2024-09-12T02:23:03.766686+0000","last_unstale":"2024-09-12T02:39:47.607786+0000","last_undegraded":"2024-09-12T02:39:47.607786+0000","last_fullsized":"2024-09-12T02:39:47.607786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:45.706208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"28'5910","reported_seq":5942,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.822665+0000","last_change":"2024-09-12T02:23:04.782108+0000","last_active":"2024-09-12T02:39:57.822665+0000","last_peered":"2024-09-12T02:39:57.822665+0000","last_clean":"2024-09-12T02:39:57.822665+0000","last_became_active":"2024-09-12T02:23:04.781829+0000","last_became_peered":"2024-09-12T02:23:04.781829+0000","last_unstale":"2024-09-12T02:39:57.822665+0000","last_undegraded":"2024-09-12T02:39:57.822665+0000","last_fullsized":"2024-09-12T02:39:57.822665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5910,"log_dups_size":0,"ondisk_log_size":5910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:07:33.165742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31102,"num_write_kb":370468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"28'3","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:37:57.710002+0000","last_change":"2024-09-12T02:23:15.828697+0000","last_active":"2024-09-12T02:37:57.710002+0000","last_peered":"2024-09-12T02:37:57.710002+0000","last_clean":"2024-09-12T02:37:57.710002+0000","last_became_active":"2024-09-12T02:23:15.828317+0000","last_became_peered":"2024-09-12T02:23:15.828317+0000","last_unstale":"2024-09-12T02:37:57.710002+0000","last_undegraded":"2024-09-12T02:37:57.710002+0000","last_fullsized":"2024-09-12T02:37:57.710002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:55.347515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"28'4662","reported_seq":4684,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.720244+0000","last_change":"2024-09-12T02:23:16.856209+0000","last_active":"2024-09-12T02:40:04.720244+0000","last_peered":"2024-09-12T02:40:04.720244+0000","last_clean":"2024-09-12T02:40:04.720244+0000","last_became_active":"2024-09-12T02:23:16.855874+0000","last_became_peered":"2024-09-12T02:23:16.855874+0000","last_unstale":"2024-09-12T02:40:04.720244+0000","last_undegraded":"2024-09-12T02:40:04.720244+0000","last_fullsized":"2024-09-12T02:40:04.720244+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4662,"log_dups_size":0,"ondisk_log_size":4662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:44.299638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23657,"num_write_kb":270894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"28'11","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.620404+0000","last_change":"2024-09-12T02:23:03.767875+0000","last_active":"2024-09-12T02:39:47.620404+0000","last_peered":"2024-09-12T02:39:47.620404+0000","last_clean":"2024-09-12T02:39:47.620404+0000","last_became_active":"2024-09-12T02:23:03.767596+0000","last_became_peered":"2024-09-12T02:23:03.767596+0000","last_unstale":"2024-09-12T02:39:47.620404+0000","last_undegraded":"2024-09-12T02:39:47.620404+0000","last_fullsized":"2024-09-12T02:39:47.620404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:22.605725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'3398","reported_seq":3428,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.832289+0000","last_change":"2024-09-12T02:23:04.791903+0000","last_active":"2024-09-12T02:39:57.832289+0000","last_peered":"2024-09-12T02:39:57.832289+0000","last_clean":"2024-09-12T02:39:57.832289+0000","last_became_active":"2024-09-12T02:23:04.791635+0000","last_became_peered":"2024-09-12T02:23:04.791635+0000","last_unstale":"2024-09-12T02:39:57.832289+0000","last_undegraded":"2024-09-12T02:39:57.832289+0000","last_fullsized":"2024-09-12T02:39:57.832289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":3398,"log_dups_size":0,"ondisk_log_size":3398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:08.192088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16708,"num_write_kb":214393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"28'616","reported_seq":640,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.618731+0000","last_change":"2024-09-12T02:23:15.833369+0000","last_active":"2024-09-12T02:38:07.618731+0000","last_peered":"2024-09-12T02:38:07.618731+0000","last_clean":"2024-09-12T02:38:07.618731+0000","last_became_active":"2024-09-12T02:23:15.833010+0000","last_became_peered":"2024-09-12T02:23:15.833010+0000","last_unstale":"2024-09-12T02:38:07.618731+0000","last_undegraded":"2024-09-12T02:38:07.618731+0000","last_fullsized":"2024-09-12T02:38:07.618731+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:51.465462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":614,"num_write_kb":4230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"28'4163","reported_seq":4185,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.700869+0000","last_change":"2024-09-12T02:23:16.853013+0000","last_active":"2024-09-12T02:40:04.700869+0000","last_peered":"2024-09-12T02:40:04.700869+0000","last_clean":"2024-09-12T02:40:04.700869+0000","last_became_active":"2024-09-12T02:23:16.852698+0000","last_became_peered":"2024-09-12T02:23:16.852698+0000","last_unstale":"2024-09-12T02:40:04.700869+0000","last_undegraded":"2024-09-12T02:40:04.700869+0000","last_fullsized":"2024-09-12T02:40:04.700869+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4163,"log_dups_size":0,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:11.709531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21165,"num_write_kb":244679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"28'3","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:04.409618+0000","last_change":"2024-09-12T02:23:03.763480+0000","last_active":"2024-09-12T02:38:04.409618+0000","last_peered":"2024-09-12T02:38:04.409618+0000","last_clean":"2024-09-12T02:38:04.409618+0000","last_became_active":"2024-09-12T02:23:03.762464+0000","last_became_peered":"2024-09-12T02:23:03.762464+0000","last_unstale":"2024-09-12T02:38:04.409618+0000","last_undegraded":"2024-09-12T02:38:04.409618+0000","last_fullsized":"2024-09-12T02:38:04.409618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:24.308289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"28'5838","reported_seq":5868,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.851601+0000","last_change":"2024-09-12T02:23:04.791109+0000","last_active":"2024-09-12T02:39:57.851601+0000","last_peered":"2024-09-12T02:39:57.851601+0000","last_clean":"2024-09-12T02:39:57.851601+0000","last_became_active":"2024-09-12T02:23:04.790201+0000","last_became_peered":"2024-09-12T02:23:04.790201+0000","last_unstale":"2024-09-12T02:39:57.851601+0000","last_undegraded":"2024-09-12T02:39:57.851601+0000","last_fullsized":"2024-09-12T02:39:57.851601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5838,"log_dups_size":0,"ondisk_log_size":5838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:13.166139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30329,"num_write_kb":367409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"28'95","reported_seq":119,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.522715+0000","last_change":"2024-09-12T02:23:15.834261+0000","last_active":"2024-09-12T02:40:04.522715+0000","last_peered":"2024-09-12T02:40:04.522715+0000","last_clean":"2024-09-12T02:40:04.522715+0000","last_became_active":"2024-09-12T02:23:15.833982+0000","last_became_peered":"2024-09-12T02:23:15.833982+0000","last_unstale":"2024-09-12T02:40:04.522715+0000","last_undegraded":"2024-09-12T02:40:04.522715+0000","last_fullsized":"2024-09-12T02:40:04.522715+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:04.987961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1406481,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":1433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"28'5650","reported_seq":5673,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.655262+0000","last_change":"2024-09-12T02:23:16.861432+0000","last_active":"2024-09-12T02:40:04.655262+0000","last_peered":"2024-09-12T02:40:04.655262+0000","last_clean":"2024-09-12T02:40:04.655262+0000","last_became_active":"2024-09-12T02:23:16.861003+0000","last_became_peered":"2024-09-12T02:23:16.861003+0000","last_unstale":"2024-09-12T02:40:04.655262+0000","last_undegraded":"2024-09-12T02:40:04.655262+0000","last_fullsized":"2024-09-12T02:40:04.655262+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5650,"log_dups_size":0,"ondisk_log_size":5650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:01.777500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29234,"num_write_kb":330189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"28'4187","reported_seq":4218,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.703320+0000","last_change":"2024-09-12T02:23:04.788754+0000","last_active":"2024-09-12T02:39:57.703320+0000","last_peered":"2024-09-12T02:39:57.703320+0000","last_clean":"2024-09-12T02:39:57.703320+0000","last_became_active":"2024-09-12T02:23:04.788350+0000","last_became_peered":"2024-09-12T02:23:04.788350+0000","last_unstale":"2024-09-12T02:39:57.703320+0000","last_undegraded":"2024-09-12T02:39:57.703320+0000","last_fullsized":"2024-09-12T02:39:57.703320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4187,"log_dups_size":0,"ondisk_log_size":4187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:08.192088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21964,"num_write_kb":272310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"28'1149","reported_seq":1182,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.632597+0000","last_change":"2024-09-12T02:23:03.763423+0000","last_active":"2024-09-12T02:39:47.632597+0000","last_peered":"2024-09-12T02:39:47.632597+0000","last_clean":"2024-09-12T02:39:47.632597+0000","last_became_active":"2024-09-12T02:23:03.762627+0000","last_became_peered":"2024-09-12T02:23:03.762627+0000","last_unstale":"2024-09-12T02:39:47.632597+0000","last_undegraded":"2024-09-12T02:39:47.632597+0000","last_fullsized":"2024-09-12T02:39:47.632597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1149,"log_dups_size":0,"ondisk_log_size":1149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:18.090657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1140,"num_write_kb":4413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"28'2","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.604710+0000","last_change":"2024-09-12T02:23:15.831604+0000","last_active":"2024-09-12T02:38:07.604710+0000","last_peered":"2024-09-12T02:38:07.604710+0000","last_clean":"2024-09-12T02:38:07.604710+0000","last_became_active":"2024-09-12T02:23:15.831292+0000","last_became_peered":"2024-09-12T02:23:15.831292+0000","last_unstale":"2024-09-12T02:38:07.604710+0000","last_undegraded":"2024-09-12T02:38:07.604710+0000","last_fullsized":"2024-09-12T02:38:07.604710+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:30.234721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"28'5482","reported_seq":5505,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.695136+0000","last_change":"2024-09-12T02:23:16.842506+0000","last_active":"2024-09-12T02:40:04.695136+0000","last_peered":"2024-09-12T02:40:04.695136+0000","last_clean":"2024-09-12T02:40:04.695136+0000","last_became_active":"2024-09-12T02:23:16.842210+0000","last_became_peered":"2024-09-12T02:23:16.842210+0000","last_unstale":"2024-09-12T02:40:04.695136+0000","last_undegraded":"2024-09-12T02:40:04.695136+0000","last_fullsized":"2024-09-12T02:40:04.695136+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5482,"log_dups_size":0,"ondisk_log_size":5482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:52.806704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28431,"num_write_kb":318903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"28'3892","reported_seq":3923,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.750186+0000","last_change":"2024-09-12T02:23:04.782769+0000","last_active":"2024-09-12T02:39:57.750186+0000","last_peered":"2024-09-12T02:39:57.750186+0000","last_clean":"2024-09-12T02:39:57.750186+0000","last_became_active":"2024-09-12T02:23:04.782472+0000","last_became_peered":"2024-09-12T02:23:04.782472+0000","last_unstale":"2024-09-12T02:39:57.750186+0000","last_undegraded":"2024-09-12T02:39:57.750186+0000","last_fullsized":"2024-09-12T02:39:57.750186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":3892,"log_dups_size":0,"ondisk_log_size":3892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:46.144471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18989,"num_write_kb":247993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'4","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.622890+0000","last_change":"2024-09-12T02:23:03.771468+0000","last_active":"2024-09-12T02:39:47.622890+0000","last_peered":"2024-09-12T02:39:47.622890+0000","last_clean":"2024-09-12T02:39:47.622890+0000","last_became_active":"2024-09-12T02:23:03.769619+0000","last_became_peered":"2024-09-12T02:23:03.769619+0000","last_unstale":"2024-09-12T02:39:47.622890+0000","last_undegraded":"2024-09-12T02:39:47.622890+0000","last_fullsized":"2024-09-12T02:39:47.622890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:38.422369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"28'2","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.610915+0000","last_change":"2024-09-12T02:23:15.833359+0000","last_active":"2024-09-12T02:38:07.610915+0000","last_peered":"2024-09-12T02:38:07.610915+0000","last_clean":"2024-09-12T02:38:07.610915+0000","last_became_active":"2024-09-12T02:23:15.832995+0000","last_became_peered":"2024-09-12T02:23:15.832995+0000","last_unstale":"2024-09-12T02:38:07.610915+0000","last_undegraded":"2024-09-12T02:38:07.610915+0000","last_fullsized":"2024-09-12T02:38:07.610915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:57.922845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"28'4854","reported_seq":4877,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.689490+0000","last_change":"2024-09-12T02:23:16.856439+0000","last_active":"2024-09-12T02:40:04.689490+0000","last_peered":"2024-09-12T02:40:04.689490+0000","last_clean":"2024-09-12T02:40:04.689490+0000","last_became_active":"2024-09-12T02:23:16.856166+0000","last_became_peered":"2024-09-12T02:23:16.856166+0000","last_unstale":"2024-09-12T02:40:04.689490+0000","last_undegraded":"2024-09-12T02:40:04.689490+0000","last_fullsized":"2024-09-12T02:40:04.689490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4854,"log_dups_size":0,"ondisk_log_size":4854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:42:56.534517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24657,"num_write_kb":295553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"28'4675","reported_seq":4706,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.744628+0000","last_change":"2024-09-12T02:23:04.783991+0000","last_active":"2024-09-12T02:39:57.744628+0000","last_peered":"2024-09-12T02:39:57.744628+0000","last_clean":"2024-09-12T02:39:57.744628+0000","last_became_active":"2024-09-12T02:23:04.783143+0000","last_became_peered":"2024-09-12T02:23:04.783143+0000","last_unstale":"2024-09-12T02:39:57.744628+0000","last_undegraded":"2024-09-12T02:39:57.744628+0000","last_fullsized":"2024-09-12T02:39:57.744628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4675,"log_dups_size":0,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:53.940843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24578,"num_write_kb":303391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'3","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.602532+0000","last_change":"2024-09-12T02:23:03.770581+0000","last_active":"2024-09-12T02:39:47.602532+0000","last_peered":"2024-09-12T02:39:47.602532+0000","last_clean":"2024-09-12T02:39:47.602532+0000","last_became_active":"2024-09-12T02:23:03.769406+0000","last_became_peered":"2024-09-12T02:23:03.769406+0000","last_unstale":"2024-09-12T02:39:47.602532+0000","last_undegraded":"2024-09-12T02:39:47.602532+0000","last_fullsized":"2024-09-12T02:39:47.602532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:20.963819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"28'5","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.723938+0000","last_change":"2024-09-12T02:23:15.835033+0000","last_active":"2024-09-12T02:38:07.723938+0000","last_peered":"2024-09-12T02:38:07.723938+0000","last_clean":"2024-09-12T02:38:07.723938+0000","last_became_active":"2024-09-12T02:23:15.834753+0000","last_became_peered":"2024-09-12T02:23:15.834753+0000","last_unstale":"2024-09-12T02:38:07.723938+0000","last_undegraded":"2024-09-12T02:38:07.723938+0000","last_fullsized":"2024-09-12T02:38:07.723938+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:57.434162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"28'5924","reported_seq":5947,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.730977+0000","last_change":"2024-09-12T02:23:16.860867+0000","last_active":"2024-09-12T02:40:04.730977+0000","last_peered":"2024-09-12T02:40:04.730977+0000","last_clean":"2024-09-12T02:40:04.730977+0000","last_became_active":"2024-09-12T02:23:16.860656+0000","last_became_peered":"2024-09-12T02:23:16.860656+0000","last_unstale":"2024-09-12T02:40:04.730977+0000","last_undegraded":"2024-09-12T02:40:04.730977+0000","last_fullsized":"2024-09-12T02:40:04.730977+0000","mapping_epoch":24,"log_start":"28'100","ondisk_log_start":"28'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5824,"log_dups_size":0,"ondisk_log_size":5824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:11.375287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30048,"num_write_kb":358073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"28'4362","reported_seq":4393,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.669337+0000","last_change":"2024-09-12T02:23:04.780821+0000","last_active":"2024-09-12T02:39:57.669337+0000","last_peered":"2024-09-12T02:39:57.669337+0000","last_clean":"2024-09-12T02:39:57.669337+0000","last_became_active":"2024-09-12T02:23:04.779984+0000","last_became_peered":"2024-09-12T02:23:04.779984+0000","last_unstale":"2024-09-12T02:39:57.669337+0000","last_undegraded":"2024-09-12T02:39:57.669337+0000","last_fullsized":"2024-09-12T02:39:57.669337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4362,"log_dups_size":0,"ondisk_log_size":4362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:25.724116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22346,"num_write_kb":282099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"28'3","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.590737+0000","last_change":"2024-09-12T02:23:03.764530+0000","last_active":"2024-09-12T02:39:47.590737+0000","last_peered":"2024-09-12T02:39:47.590737+0000","last_clean":"2024-09-12T02:39:47.590737+0000","last_became_active":"2024-09-12T02:23:03.764218+0000","last_became_peered":"2024-09-12T02:23:03.764218+0000","last_unstale":"2024-09-12T02:39:47.590737+0000","last_undegraded":"2024-09-12T02:39:47.590737+0000","last_fullsized":"2024-09-12T02:39:47.590737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:55.445619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"28'6","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.689963+0000","last_change":"2024-09-12T02:23:15.831621+0000","last_active":"2024-09-12T02:38:07.689963+0000","last_peered":"2024-09-12T02:38:07.689963+0000","last_clean":"2024-09-12T02:38:07.689963+0000","last_became_active":"2024-09-12T02:23:15.831331+0000","last_became_peered":"2024-09-12T02:23:15.831331+0000","last_unstale":"2024-09-12T02:38:07.689963+0000","last_undegraded":"2024-09-12T02:38:07.689963+0000","last_fullsized":"2024-09-12T02:38:07.689963+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:06.494392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"28'4897","reported_seq":4921,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.656642+0000","last_change":"2024-09-12T02:23:16.847556+0000","last_active":"2024-09-12T02:40:04.656642+0000","last_peered":"2024-09-12T02:40:04.656642+0000","last_clean":"2024-09-12T02:40:04.656642+0000","last_became_active":"2024-09-12T02:23:16.845749+0000","last_became_peered":"2024-09-12T02:23:16.845749+0000","last_unstale":"2024-09-12T02:40:04.656642+0000","last_undegraded":"2024-09-12T02:40:04.656642+0000","last_fullsized":"2024-09-12T02:40:04.656642+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4897,"log_dups_size":0,"ondisk_log_size":4897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:39.542842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25893,"num_write_kb":296532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"28'3849","reported_seq":3880,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.731126+0000","last_change":"2024-09-12T02:23:04.786895+0000","last_active":"2024-09-12T02:39:57.731126+0000","last_peered":"2024-09-12T02:39:57.731126+0000","last_clean":"2024-09-12T02:39:57.731126+0000","last_became_active":"2024-09-12T02:23:04.786591+0000","last_became_peered":"2024-09-12T02:23:04.786591+0000","last_unstale":"2024-09-12T02:39:57.731126+0000","last_undegraded":"2024-09-12T02:39:57.731126+0000","last_fullsized":"2024-09-12T02:39:57.731126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":3849,"log_dups_size":0,"ondisk_log_size":3849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:14.751707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19665,"num_write_kb":250729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'5","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.627847+0000","last_change":"2024-09-12T02:23:03.771259+0000","last_active":"2024-09-12T02:39:47.627847+0000","last_peered":"2024-09-12T02:39:47.627847+0000","last_clean":"2024-09-12T02:39:47.627847+0000","last_became_active":"2024-09-12T02:23:03.770687+0000","last_became_peered":"2024-09-12T02:23:03.770687+0000","last_unstale":"2024-09-12T02:39:47.627847+0000","last_undegraded":"2024-09-12T02:39:47.627847+0000","last_fullsized":"2024-09-12T02:39:47.627847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:38.516959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"28'59","reported_seq":142,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:51.334318+0000","last_change":"2024-09-12T02:23:15.829406+0000","last_active":"2024-09-12T02:39:51.334318+0000","last_peered":"2024-09-12T02:39:51.334318+0000","last_clean":"2024-09-12T02:39:51.334318+0000","last_became_active":"2024-09-12T02:23:15.829135+0000","last_became_peered":"2024-09-12T02:23:15.829135+0000","last_unstale":"2024-09-12T02:39:51.334318+0000","last_undegraded":"2024-09-12T02:39:51.334318+0000","last_fullsized":"2024-09-12T02:39:51.334318+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:22.365804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":57,"num_read_kb":123,"num_write":57,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"28'5530","reported_seq":5554,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.659180+0000","last_change":"2024-09-12T02:23:16.857016+0000","last_active":"2024-09-12T02:40:04.659180+0000","last_peered":"2024-09-12T02:40:04.659180+0000","last_clean":"2024-09-12T02:40:04.659180+0000","last_became_active":"2024-09-12T02:23:16.856705+0000","last_became_peered":"2024-09-12T02:23:16.856705+0000","last_unstale":"2024-09-12T02:40:04.659180+0000","last_undegraded":"2024-09-12T02:40:04.659180+0000","last_fullsized":"2024-09-12T02:40:04.659180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5530,"log_dups_size":0,"ondisk_log_size":5530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:03.672668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29256,"num_write_kb":314000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"28'4419","reported_seq":4450,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.721713+0000","last_change":"2024-09-12T02:23:04.786424+0000","last_active":"2024-09-12T02:39:57.721713+0000","last_peered":"2024-09-12T02:39:57.721713+0000","last_clean":"2024-09-12T02:39:57.721713+0000","last_became_active":"2024-09-12T02:23:04.786136+0000","last_became_peered":"2024-09-12T02:23:04.786136+0000","last_unstale":"2024-09-12T02:39:57.721713+0000","last_undegraded":"2024-09-12T02:39:57.721713+0000","last_fullsized":"2024-09-12T02:39:57.721713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4419,"log_dups_size":0,"ondisk_log_size":4419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:31.214894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22653,"num_write_kb":291447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'597","reported_seq":630,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:48.951757+0000","last_change":"2024-09-12T02:23:03.769745+0000","last_active":"2024-09-12T02:39:48.951757+0000","last_peered":"2024-09-12T02:39:48.951757+0000","last_clean":"2024-09-12T02:39:48.951757+0000","last_became_active":"2024-09-12T02:23:03.769410+0000","last_became_peered":"2024-09-12T02:23:03.769410+0000","last_unstale":"2024-09-12T02:39:48.951757+0000","last_undegraded":"2024-09-12T02:39:48.951757+0000","last_fullsized":"2024-09-12T02:39:48.951757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:00.414459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1455,"num_write_kb":462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"28'5","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.701763+0000","last_change":"2024-09-12T02:23:15.827211+0000","last_active":"2024-09-12T02:38:07.701763+0000","last_peered":"2024-09-12T02:38:07.701763+0000","last_clean":"2024-09-12T02:38:07.701763+0000","last_became_active":"2024-09-12T02:23:15.826564+0000","last_became_peered":"2024-09-12T02:23:15.826564+0000","last_unstale":"2024-09-12T02:38:07.701763+0000","last_undegraded":"2024-09-12T02:38:07.701763+0000","last_fullsized":"2024-09-12T02:38:07.701763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:32.389443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"28'5561","reported_seq":5585,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.639456+0000","last_change":"2024-09-12T02:23:16.837434+0000","last_active":"2024-09-12T02:40:04.639456+0000","last_peered":"2024-09-12T02:40:04.639456+0000","last_clean":"2024-09-12T02:40:04.639456+0000","last_became_active":"2024-09-12T02:23:16.837162+0000","last_became_peered":"2024-09-12T02:23:16.837162+0000","last_unstale":"2024-09-12T02:40:04.639456+0000","last_undegraded":"2024-09-12T02:40:04.639456+0000","last_fullsized":"2024-09-12T02:40:04.639456+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5561,"log_dups_size":0,"ondisk_log_size":5561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:09.146064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28597,"num_write_kb":327668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"28'4780","reported_seq":4812,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.728845+0000","last_change":"2024-09-12T02:23:04.775876+0000","last_active":"2024-09-12T02:39:57.728845+0000","last_peered":"2024-09-12T02:39:57.728845+0000","last_clean":"2024-09-12T02:39:57.728845+0000","last_became_active":"2024-09-12T02:23:04.775571+0000","last_became_peered":"2024-09-12T02:23:04.775571+0000","last_unstale":"2024-09-12T02:39:57.728845+0000","last_undegraded":"2024-09-12T02:39:57.728845+0000","last_fullsized":"2024-09-12T02:39:57.728845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4780,"log_dups_size":0,"ondisk_log_size":4780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:05.070528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24981,"num_write_kb":308974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"28'4","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.626390+0000","last_change":"2024-09-12T02:23:03.764093+0000","last_active":"2024-09-12T02:39:47.626390+0000","last_peered":"2024-09-12T02:39:47.626390+0000","last_clean":"2024-09-12T02:39:47.626390+0000","last_became_active":"2024-09-12T02:23:03.763147+0000","last_became_peered":"2024-09-12T02:23:03.763147+0000","last_unstale":"2024-09-12T02:39:47.626390+0000","last_undegraded":"2024-09-12T02:39:47.626390+0000","last_fullsized":"2024-09-12T02:39:47.626390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:13.317894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"28'1","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:37:53.624097+0000","last_change":"2024-09-12T02:23:15.832461+0000","last_active":"2024-09-12T02:37:53.624097+0000","last_peered":"2024-09-12T02:37:53.624097+0000","last_clean":"2024-09-12T02:37:53.624097+0000","last_became_active":"2024-09-12T02:23:15.831637+0000","last_became_peered":"2024-09-12T02:23:15.831637+0000","last_unstale":"2024-09-12T02:37:53.624097+0000","last_undegraded":"2024-09-12T02:37:53.624097+0000","last_fullsized":"2024-09-12T02:37:53.624097+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:30.909927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"28'5517","reported_seq":5541,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.717568+0000","last_change":"2024-09-12T02:23:16.835824+0000","last_active":"2024-09-12T02:40:04.717568+0000","last_peered":"2024-09-12T02:40:04.717568+0000","last_clean":"2024-09-12T02:40:04.717568+0000","last_became_active":"2024-09-12T02:23:16.835520+0000","last_became_peered":"2024-09-12T02:23:16.835520+0000","last_unstale":"2024-09-12T02:40:04.717568+0000","last_undegraded":"2024-09-12T02:40:04.717568+0000","last_fullsized":"2024-09-12T02:40:04.717568+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5517,"log_dups_size":0,"ondisk_log_size":5517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:32.797100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29476,"num_write_kb":310838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"28'3821","reported_seq":3853,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.839882+0000","last_change":"2024-09-12T02:23:04.787557+0000","last_active":"2024-09-12T02:39:57.839882+0000","last_peered":"2024-09-12T02:39:57.839882+0000","last_clean":"2024-09-12T02:39:57.839882+0000","last_became_active":"2024-09-12T02:23:04.786527+0000","last_became_peered":"2024-09-12T02:23:04.786527+0000","last_unstale":"2024-09-12T02:39:57.839882+0000","last_undegraded":"2024-09-12T02:39:57.839882+0000","last_fullsized":"2024-09-12T02:39:57.839882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":3821,"log_dups_size":0,"ondisk_log_size":3821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:23.273457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19788,"num_write_kb":259568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"28'5","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.626953+0000","last_change":"2024-09-12T02:23:03.769913+0000","last_active":"2024-09-12T02:39:47.626953+0000","last_peered":"2024-09-12T02:39:47.626953+0000","last_clean":"2024-09-12T02:39:47.626953+0000","last_became_active":"2024-09-12T02:23:03.769444+0000","last_became_peered":"2024-09-12T02:23:03.769444+0000","last_unstale":"2024-09-12T02:39:47.626953+0000","last_undegraded":"2024-09-12T02:39:47.626953+0000","last_fullsized":"2024-09-12T02:39:47.626953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:21.243182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"28'5","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.710687+0000","last_change":"2024-09-12T02:23:15.829080+0000","last_active":"2024-09-12T02:38:07.710687+0000","last_peered":"2024-09-12T02:38:07.710687+0000","last_clean":"2024-09-12T02:38:07.710687+0000","last_became_active":"2024-09-12T02:23:15.828256+0000","last_became_peered":"2024-09-12T02:23:15.828256+0000","last_unstale":"2024-09-12T02:38:07.710687+0000","last_undegraded":"2024-09-12T02:38:07.710687+0000","last_fullsized":"2024-09-12T02:38:07.710687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:07.743952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"28'4600","reported_seq":4624,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.595161+0000","last_change":"2024-09-12T02:23:16.845710+0000","last_active":"2024-09-12T02:40:04.595161+0000","last_peered":"2024-09-12T02:40:04.595161+0000","last_clean":"2024-09-12T02:40:04.595161+0000","last_became_active":"2024-09-12T02:23:16.845379+0000","last_became_peered":"2024-09-12T02:23:16.845379+0000","last_unstale":"2024-09-12T02:40:04.595161+0000","last_undegraded":"2024-09-12T02:40:04.595161+0000","last_fullsized":"2024-09-12T02:40:04.595161+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4600,"log_dups_size":0,"ondisk_log_size":4600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:16.769410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24241,"num_write_kb":277536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"28'4371","reported_seq":4403,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.747023+0000","last_change":"2024-09-12T02:23:04.790723+0000","last_active":"2024-09-12T02:39:57.747023+0000","last_peered":"2024-09-12T02:39:57.747023+0000","last_clean":"2024-09-12T02:39:57.747023+0000","last_became_active":"2024-09-12T02:23:04.786877+0000","last_became_peered":"2024-09-12T02:23:04.786877+0000","last_unstale":"2024-09-12T02:39:57.747023+0000","last_undegraded":"2024-09-12T02:39:57.747023+0000","last_fullsized":"2024-09-12T02:39:57.747023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4371,"log_dups_size":0,"ondisk_log_size":4371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:48.516002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23204,"num_write_kb":285450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"28'5","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.620925+0000","last_change":"2024-09-12T02:23:03.771518+0000","last_active":"2024-09-12T02:39:47.620925+0000","last_peered":"2024-09-12T02:39:47.620925+0000","last_clean":"2024-09-12T02:39:47.620925+0000","last_became_active":"2024-09-12T02:23:03.771063+0000","last_became_peered":"2024-09-12T02:23:03.771063+0000","last_unstale":"2024-09-12T02:39:47.620925+0000","last_undegraded":"2024-09-12T02:39:47.620925+0000","last_fullsized":"2024-09-12T02:39:47.620925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:43.974555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"28'5","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.679539+0000","last_change":"2024-09-12T02:23:15.827028+0000","last_active":"2024-09-12T02:38:07.679539+0000","last_peered":"2024-09-12T02:38:07.679539+0000","last_clean":"2024-09-12T02:38:07.679539+0000","last_became_active":"2024-09-12T02:23:15.826708+0000","last_became_peered":"2024-09-12T02:23:15.826708+0000","last_unstale":"2024-09-12T02:38:07.679539+0000","last_undegraded":"2024-09-12T02:38:07.679539+0000","last_fullsized":"2024-09-12T02:38:07.679539+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:34.642396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'4748","reported_seq":4771,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.730697+0000","last_change":"2024-09-12T02:23:16.849429+0000","last_active":"2024-09-12T02:40:04.730697+0000","last_peered":"2024-09-12T02:40:04.730697+0000","last_clean":"2024-09-12T02:40:04.730697+0000","last_became_active":"2024-09-12T02:23:16.849119+0000","last_became_peered":"2024-09-12T02:23:16.849119+0000","last_unstale":"2024-09-12T02:40:04.730697+0000","last_undegraded":"2024-09-12T02:40:04.730697+0000","last_fullsized":"2024-09-12T02:40:04.730697+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4748,"log_dups_size":0,"ondisk_log_size":4748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:10.688619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23965,"num_write_kb":268065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"28'4258","reported_seq":4290,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.730029+0000","last_change":"2024-09-12T02:23:04.773745+0000","last_active":"2024-09-12T02:39:57.730029+0000","last_peered":"2024-09-12T02:39:57.730029+0000","last_clean":"2024-09-12T02:39:57.730029+0000","last_became_active":"2024-09-12T02:23:04.773360+0000","last_became_peered":"2024-09-12T02:23:04.773360+0000","last_unstale":"2024-09-12T02:39:57.730029+0000","last_undegraded":"2024-09-12T02:39:57.730029+0000","last_fullsized":"2024-09-12T02:39:57.730029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4258,"log_dups_size":0,"ondisk_log_size":4258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:33.097774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22673,"num_write_kb":283464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'64","reported_seq":160,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.311429+0000","last_change":"2024-09-12T02:23:03.760700+0000","last_active":"2024-09-12T02:39:47.311429+0000","last_peered":"2024-09-12T02:39:47.311429+0000","last_clean":"2024-09-12T02:39:47.311429+0000","last_became_active":"2024-09-12T02:23:03.760397+0000","last_became_peered":"2024-09-12T02:23:03.760397+0000","last_unstale":"2024-09-12T02:39:47.311429+0000","last_undegraded":"2024-09-12T02:39:47.311429+0000","last_fullsized":"2024-09-12T02:39:47.311429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:36.788864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":127,"num_write":62,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"28'4","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.673049+0000","last_change":"2024-09-12T02:23:15.828714+0000","last_active":"2024-09-12T02:38:07.673049+0000","last_peered":"2024-09-12T02:38:07.673049+0000","last_clean":"2024-09-12T02:38:07.673049+0000","last_became_active":"2024-09-12T02:23:15.827458+0000","last_became_peered":"2024-09-12T02:23:15.827458+0000","last_unstale":"2024-09-12T02:38:07.673049+0000","last_undegraded":"2024-09-12T02:38:07.673049+0000","last_fullsized":"2024-09-12T02:38:07.673049+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:12.581897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"28'4979","reported_seq":5002,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.723394+0000","last_change":"2024-09-12T02:23:16.855212+0000","last_active":"2024-09-12T02:40:04.723394+0000","last_peered":"2024-09-12T02:40:04.723394+0000","last_clean":"2024-09-12T02:40:04.723394+0000","last_became_active":"2024-09-12T02:23:16.854938+0000","last_became_peered":"2024-09-12T02:23:16.854938+0000","last_unstale":"2024-09-12T02:40:04.723394+0000","last_undegraded":"2024-09-12T02:40:04.723394+0000","last_fullsized":"2024-09-12T02:40:04.723394+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4979,"log_dups_size":0,"ondisk_log_size":4979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:02.944057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25537,"num_write_kb":303027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"28'4415","reported_seq":4447,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.768572+0000","last_change":"2024-09-12T02:23:04.787820+0000","last_active":"2024-09-12T02:39:57.768572+0000","last_peered":"2024-09-12T02:39:57.768572+0000","last_clean":"2024-09-12T02:39:57.768572+0000","last_became_active":"2024-09-12T02:23:04.787523+0000","last_became_peered":"2024-09-12T02:23:04.787523+0000","last_unstale":"2024-09-12T02:39:57.768572+0000","last_undegraded":"2024-09-12T02:39:57.768572+0000","last_fullsized":"2024-09-12T02:39:57.768572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4415,"log_dups_size":0,"ondisk_log_size":4415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:52.784171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23022,"num_write_kb":288900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'5","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.629413+0000","last_change":"2024-09-12T02:23:03.771625+0000","last_active":"2024-09-12T02:39:47.629413+0000","last_peered":"2024-09-12T02:39:47.629413+0000","last_clean":"2024-09-12T02:39:47.629413+0000","last_became_active":"2024-09-12T02:23:03.771163+0000","last_became_peered":"2024-09-12T02:23:03.771163+0000","last_unstale":"2024-09-12T02:39:47.629413+0000","last_undegraded":"2024-09-12T02:39:47.629413+0000","last_fullsized":"2024-09-12T02:39:47.629413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:32.772569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"28'615","reported_seq":640,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:49.038042+0000","last_change":"2024-09-12T02:23:15.833889+0000","last_active":"2024-09-12T02:39:49.038042+0000","last_peered":"2024-09-12T02:39:49.038042+0000","last_clean":"2024-09-12T02:39:49.038042+0000","last_became_active":"2024-09-12T02:23:15.833587+0000","last_became_peered":"2024-09-12T02:23:15.833587+0000","last_unstale":"2024-09-12T02:39:49.038042+0000","last_undegraded":"2024-09-12T02:39:49.038042+0000","last_fullsized":"2024-09-12T02:39:49.038042+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:32.787861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1484,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"28'5400","reported_seq":5424,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.730531+0000","last_change":"2024-09-12T02:23:16.848864+0000","last_active":"2024-09-12T02:40:04.730531+0000","last_peered":"2024-09-12T02:40:04.730531+0000","last_clean":"2024-09-12T02:40:04.730531+0000","last_became_active":"2024-09-12T02:23:16.848385+0000","last_became_peered":"2024-09-12T02:23:16.848385+0000","last_unstale":"2024-09-12T02:40:04.730531+0000","last_undegraded":"2024-09-12T02:40:04.730531+0000","last_fullsized":"2024-09-12T02:40:04.730531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5400,"log_dups_size":0,"ondisk_log_size":5400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:03.656397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28350,"num_write_kb":322666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"28'5040","reported_seq":5072,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.783368+0000","last_change":"2024-09-12T02:23:04.781839+0000","last_active":"2024-09-12T02:39:57.783368+0000","last_peered":"2024-09-12T02:39:57.783368+0000","last_clean":"2024-09-12T02:39:57.783368+0000","last_became_active":"2024-09-12T02:23:04.780984+0000","last_became_peered":"2024-09-12T02:23:04.780984+0000","last_unstale":"2024-09-12T02:39:57.783368+0000","last_undegraded":"2024-09-12T02:39:57.783368+0000","last_fullsized":"2024-09-12T02:39:57.783368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5040,"log_dups_size":0,"ondisk_log_size":5040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:07.692791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25643,"num_write_kb":315836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'1","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:37:39.936369+0000","last_change":"2024-09-12T02:23:03.765100+0000","last_active":"2024-09-12T02:37:39.936369+0000","last_peered":"2024-09-12T02:37:39.936369+0000","last_clean":"2024-09-12T02:37:39.936369+0000","last_became_active":"2024-09-12T02:23:03.764801+0000","last_became_peered":"2024-09-12T02:23:03.764801+0000","last_unstale":"2024-09-12T02:37:39.936369+0000","last_undegraded":"2024-09-12T02:37:39.936369+0000","last_fullsized":"2024-09-12T02:37:39.936369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:06.891040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":190,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:36:54.619226+0000","last_change":"2024-09-12T02:22:55.143869+0000","last_active":"2024-09-12T02:36:54.619226+0000","last_peered":"2024-09-12T02:36:54.619226+0000","last_clean":"2024-09-12T02:36:54.619226+0000","last_became_active":"2024-09-12T02:22:55.142784+0000","last_became_peered":"2024-09-12T02:22:55.142784+0000","last_unstale":"2024-09-12T02:36:54.619226+0000","last_undegraded":"2024-09-12T02:36:54.619226+0000","last_fullsized":"2024-09-12T02:36:54.619226+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:22:52.457979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:22:52.457979+0000","last_clean_scrub_stamp":"2024-09-12T02:22:52.457979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:46.152602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"28'4","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.661864+0000","last_change":"2024-09-12T02:23:15.831362+0000","last_active":"2024-09-12T02:38:07.661864+0000","last_peered":"2024-09-12T02:38:07.661864+0000","last_clean":"2024-09-12T02:38:07.661864+0000","last_became_active":"2024-09-12T02:23:15.831084+0000","last_became_peered":"2024-09-12T02:23:15.831084+0000","last_unstale":"2024-09-12T02:38:07.661864+0000","last_undegraded":"2024-09-12T02:38:07.661864+0000","last_fullsized":"2024-09-12T02:38:07.661864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:17.754173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"28'4521","reported_seq":4544,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.674856+0000","last_change":"2024-09-12T02:23:16.838831+0000","last_active":"2024-09-12T02:40:04.674856+0000","last_peered":"2024-09-12T02:40:04.674856+0000","last_clean":"2024-09-12T02:40:04.674856+0000","last_became_active":"2024-09-12T02:23:16.838523+0000","last_became_peered":"2024-09-12T02:23:16.838523+0000","last_unstale":"2024-09-12T02:40:04.674856+0000","last_undegraded":"2024-09-12T02:40:04.674856+0000","last_fullsized":"2024-09-12T02:40:04.674856+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4521,"log_dups_size":0,"ondisk_log_size":4521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:35:42.088332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22817,"num_write_kb":263525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"28'4994","reported_seq":5025,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.798342+0000","last_change":"2024-09-12T02:23:04.783483+0000","last_active":"2024-09-12T02:39:57.798342+0000","last_peered":"2024-09-12T02:39:57.798342+0000","last_clean":"2024-09-12T02:39:57.798342+0000","last_became_active":"2024-09-12T02:23:04.782878+0000","last_became_peered":"2024-09-12T02:23:04.782878+0000","last_unstale":"2024-09-12T02:39:57.798342+0000","last_undegraded":"2024-09-12T02:39:57.798342+0000","last_fullsized":"2024-09-12T02:39:57.798342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4994,"log_dups_size":0,"ondisk_log_size":4994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:52.335065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25629,"num_write_kb":307571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'2","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:48.439127+0000","last_change":"2024-09-12T02:23:03.762507+0000","last_active":"2024-09-12T02:38:48.439127+0000","last_peered":"2024-09-12T02:38:48.439127+0000","last_clean":"2024-09-12T02:38:48.439127+0000","last_became_active":"2024-09-12T02:23:03.762164+0000","last_became_peered":"2024-09-12T02:23:03.762164+0000","last_unstale":"2024-09-12T02:38:48.439127+0000","last_undegraded":"2024-09-12T02:38:48.439127+0000","last_fullsized":"2024-09-12T02:38:48.439127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:34.569630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"28'4","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.725569+0000","last_change":"2024-09-12T02:23:15.830783+0000","last_active":"2024-09-12T02:38:07.725569+0000","last_peered":"2024-09-12T02:38:07.725569+0000","last_clean":"2024-09-12T02:38:07.725569+0000","last_became_active":"2024-09-12T02:23:15.830471+0000","last_became_peered":"2024-09-12T02:23:15.830471+0000","last_unstale":"2024-09-12T02:38:07.725569+0000","last_undegraded":"2024-09-12T02:38:07.725569+0000","last_fullsized":"2024-09-12T02:38:07.725569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:22.927201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"28'4580","reported_seq":4603,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.664325+0000","last_change":"2024-09-12T02:23:16.856328+0000","last_active":"2024-09-12T02:40:04.664325+0000","last_peered":"2024-09-12T02:40:04.664325+0000","last_clean":"2024-09-12T02:40:04.664325+0000","last_became_active":"2024-09-12T02:23:16.855992+0000","last_became_peered":"2024-09-12T02:23:16.855992+0000","last_unstale":"2024-09-12T02:40:04.664325+0000","last_undegraded":"2024-09-12T02:40:04.664325+0000","last_fullsized":"2024-09-12T02:40:04.664325+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4580,"log_dups_size":0,"ondisk_log_size":4580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:47.682103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24326,"num_write_kb":281766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"28'4821","reported_seq":4852,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.817348+0000","last_change":"2024-09-12T02:23:04.784318+0000","last_active":"2024-09-12T02:39:57.817348+0000","last_peered":"2024-09-12T02:39:57.817348+0000","last_clean":"2024-09-12T02:39:57.817348+0000","last_became_active":"2024-09-12T02:23:04.784012+0000","last_became_peered":"2024-09-12T02:23:04.784012+0000","last_unstale":"2024-09-12T02:39:57.817348+0000","last_undegraded":"2024-09-12T02:39:57.817348+0000","last_fullsized":"2024-09-12T02:39:57.817348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4821,"log_dups_size":0,"ondisk_log_size":4821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:51.352859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24805,"num_write_kb":312357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"28'2","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:52.827222+0000","last_change":"2024-09-12T02:23:03.766034+0000","last_active":"2024-09-12T02:38:52.827222+0000","last_peered":"2024-09-12T02:38:52.827222+0000","last_clean":"2024-09-12T02:38:52.827222+0000","last_became_active":"2024-09-12T02:23:03.765735+0000","last_became_peered":"2024-09-12T02:23:03.765735+0000","last_unstale":"2024-09-12T02:38:52.827222+0000","last_undegraded":"2024-09-12T02:38:52.827222+0000","last_fullsized":"2024-09-12T02:38:52.827222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:19.691229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"28'1085","reported_seq":1110,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.716303+0000","last_change":"2024-09-12T02:23:15.832527+0000","last_active":"2024-09-12T02:38:07.716303+0000","last_peered":"2024-09-12T02:38:07.716303+0000","last_clean":"2024-09-12T02:38:07.716303+0000","last_became_active":"2024-09-12T02:23:15.832184+0000","last_became_peered":"2024-09-12T02:23:15.832184+0000","last_unstale":"2024-09-12T02:38:07.716303+0000","last_undegraded":"2024-09-12T02:38:07.716303+0000","last_fullsized":"2024-09-12T02:38:07.716303+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":1085,"log_dups_size":0,"ondisk_log_size":1085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:29.131198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1076,"num_write_kb":4403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"28'4868","reported_seq":4891,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.629771+0000","last_change":"2024-09-12T02:23:16.849357+0000","last_active":"2024-09-12T02:40:04.629771+0000","last_peered":"2024-09-12T02:40:04.629771+0000","last_clean":"2024-09-12T02:40:04.629771+0000","last_became_active":"2024-09-12T02:23:16.849067+0000","last_became_peered":"2024-09-12T02:23:16.849067+0000","last_unstale":"2024-09-12T02:40:04.629771+0000","last_undegraded":"2024-09-12T02:40:04.629771+0000","last_fullsized":"2024-09-12T02:40:04.629771+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4868,"log_dups_size":0,"ondisk_log_size":4868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:06.887523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24798,"num_write_kb":291891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"28'5524","reported_seq":5555,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.830006+0000","last_change":"2024-09-12T02:23:04.791152+0000","last_active":"2024-09-12T02:39:57.830006+0000","last_peered":"2024-09-12T02:39:57.830006+0000","last_clean":"2024-09-12T02:39:57.830006+0000","last_became_active":"2024-09-12T02:23:04.790707+0000","last_became_peered":"2024-09-12T02:23:04.790707+0000","last_unstale":"2024-09-12T02:39:57.830006+0000","last_undegraded":"2024-09-12T02:39:57.830006+0000","last_fullsized":"2024-09-12T02:39:57.830006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5524,"log_dups_size":0,"ondisk_log_size":5524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:42.798507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27879,"num_write_kb":349281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"28'6","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.625090+0000","last_change":"2024-09-12T02:23:03.763327+0000","last_active":"2024-09-12T02:39:47.625090+0000","last_peered":"2024-09-12T02:39:47.625090+0000","last_clean":"2024-09-12T02:39:47.625090+0000","last_became_active":"2024-09-12T02:23:03.763005+0000","last_became_peered":"2024-09-12T02:23:03.763005+0000","last_unstale":"2024-09-12T02:39:47.625090+0000","last_undegraded":"2024-09-12T02:39:47.625090+0000","last_fullsized":"2024-09-12T02:39:47.625090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:09.500459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"28'3","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.672423+0000","last_change":"2024-09-12T02:23:15.819644+0000","last_active":"2024-09-12T02:38:07.672423+0000","last_peered":"2024-09-12T02:38:07.672423+0000","last_clean":"2024-09-12T02:38:07.672423+0000","last_became_active":"2024-09-12T02:23:15.819370+0000","last_became_peered":"2024-09-12T02:23:15.819370+0000","last_unstale":"2024-09-12T02:38:07.672423+0000","last_undegraded":"2024-09-12T02:38:07.672423+0000","last_fullsized":"2024-09-12T02:38:07.672423+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:56.384531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"28'5323","reported_seq":5346,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.659057+0000","last_change":"2024-09-12T02:23:16.838234+0000","last_active":"2024-09-12T02:40:04.659057+0000","last_peered":"2024-09-12T02:40:04.659057+0000","last_clean":"2024-09-12T02:40:04.659057+0000","last_became_active":"2024-09-12T02:23:16.837942+0000","last_became_peered":"2024-09-12T02:23:16.837942+0000","last_unstale":"2024-09-12T02:40:04.659057+0000","last_undegraded":"2024-09-12T02:40:04.659057+0000","last_fullsized":"2024-09-12T02:40:04.659057+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5323,"log_dups_size":0,"ondisk_log_size":5323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:41.842931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28212,"num_write_kb":317995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"28'4432","reported_seq":4463,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.735779+0000","last_change":"2024-09-12T02:23:04.781196+0000","last_active":"2024-09-12T02:39:57.735779+0000","last_peered":"2024-09-12T02:39:57.735779+0000","last_clean":"2024-09-12T02:39:57.735779+0000","last_became_active":"2024-09-12T02:23:04.780893+0000","last_became_peered":"2024-09-12T02:23:04.780893+0000","last_unstale":"2024-09-12T02:39:57.735779+0000","last_undegraded":"2024-09-12T02:39:57.735779+0000","last_fullsized":"2024-09-12T02:39:57.735779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4432,"log_dups_size":0,"ondisk_log_size":4432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:26.527539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22251,"num_write_kb":285885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'5","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.626407+0000","last_change":"2024-09-12T02:23:03.769541+0000","last_active":"2024-09-12T02:39:47.626407+0000","last_peered":"2024-09-12T02:39:47.626407+0000","last_clean":"2024-09-12T02:39:47.626407+0000","last_became_active":"2024-09-12T02:23:03.765281+0000","last_became_peered":"2024-09-12T02:23:03.765281+0000","last_unstale":"2024-09-12T02:39:47.626407+0000","last_undegraded":"2024-09-12T02:39:47.626407+0000","last_fullsized":"2024-09-12T02:39:47.626407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:53.409370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"28'3","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.670913+0000","last_change":"2024-09-12T02:23:15.841592+0000","last_active":"2024-09-12T02:38:07.670913+0000","last_peered":"2024-09-12T02:38:07.670913+0000","last_clean":"2024-09-12T02:38:07.670913+0000","last_became_active":"2024-09-12T02:23:15.841380+0000","last_became_peered":"2024-09-12T02:23:15.841380+0000","last_unstale":"2024-09-12T02:38:07.670913+0000","last_undegraded":"2024-09-12T02:38:07.670913+0000","last_fullsized":"2024-09-12T02:38:07.670913+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:38.396332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"28'4540","reported_seq":4562,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.682011+0000","last_change":"2024-09-12T02:23:16.846596+0000","last_active":"2024-09-12T02:40:04.682011+0000","last_peered":"2024-09-12T02:40:04.682011+0000","last_clean":"2024-09-12T02:40:04.682011+0000","last_became_active":"2024-09-12T02:23:16.846273+0000","last_became_peered":"2024-09-12T02:23:16.846273+0000","last_unstale":"2024-09-12T02:40:04.682011+0000","last_undegraded":"2024-09-12T02:40:04.682011+0000","last_fullsized":"2024-09-12T02:40:04.682011+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4540,"log_dups_size":0,"ondisk_log_size":4540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:03.628494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23721,"num_write_kb":271171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"28'4758","reported_seq":4789,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.728981+0000","last_change":"2024-09-12T02:23:04.781856+0000","last_active":"2024-09-12T02:39:57.728981+0000","last_peered":"2024-09-12T02:39:57.728981+0000","last_clean":"2024-09-12T02:39:57.728981+0000","last_became_active":"2024-09-12T02:23:04.781575+0000","last_became_peered":"2024-09-12T02:23:04.781575+0000","last_unstale":"2024-09-12T02:39:57.728981+0000","last_undegraded":"2024-09-12T02:39:57.728981+0000","last_fullsized":"2024-09-12T02:39:57.728981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4758,"log_dups_size":0,"ondisk_log_size":4758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:26.630558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24728,"num_write_kb":299876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"28'11","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.597678+0000","last_change":"2024-09-12T02:23:03.771368+0000","last_active":"2024-09-12T02:39:47.597678+0000","last_peered":"2024-09-12T02:39:47.597678+0000","last_clean":"2024-09-12T02:39:47.597678+0000","last_became_active":"2024-09-12T02:23:03.771061+0000","last_became_peered":"2024-09-12T02:23:03.771061+0000","last_unstale":"2024-09-12T02:39:47.597678+0000","last_undegraded":"2024-09-12T02:39:47.597678+0000","last_fullsized":"2024-09-12T02:39:47.597678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:57.476458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"28'2","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.683446+0000","last_change":"2024-09-12T02:23:15.833158+0000","last_active":"2024-09-12T02:38:07.683446+0000","last_peered":"2024-09-12T02:38:07.683446+0000","last_clean":"2024-09-12T02:38:07.683446+0000","last_became_active":"2024-09-12T02:23:15.831707+0000","last_became_peered":"2024-09-12T02:23:15.831707+0000","last_unstale":"2024-09-12T02:38:07.683446+0000","last_undegraded":"2024-09-12T02:38:07.683446+0000","last_fullsized":"2024-09-12T02:38:07.683446+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:30.000066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"28'5063","reported_seq":5085,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.735985+0000","last_change":"2024-09-12T02:23:16.858757+0000","last_active":"2024-09-12T02:40:04.735985+0000","last_peered":"2024-09-12T02:40:04.735985+0000","last_clean":"2024-09-12T02:40:04.735985+0000","last_became_active":"2024-09-12T02:23:16.858469+0000","last_became_peered":"2024-09-12T02:23:16.858469+0000","last_unstale":"2024-09-12T02:40:04.735985+0000","last_undegraded":"2024-09-12T02:40:04.735985+0000","last_fullsized":"2024-09-12T02:40:04.735985+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5063,"log_dups_size":0,"ondisk_log_size":5063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:22.288143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25554,"num_write_kb":307334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"28'4968","reported_seq":4999,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.765114+0000","last_change":"2024-09-12T02:23:04.785248+0000","last_active":"2024-09-12T02:39:57.765114+0000","last_peered":"2024-09-12T02:39:57.765114+0000","last_clean":"2024-09-12T02:39:57.765114+0000","last_became_active":"2024-09-12T02:23:04.784977+0000","last_became_peered":"2024-09-12T02:23:04.784977+0000","last_unstale":"2024-09-12T02:39:57.765114+0000","last_undegraded":"2024-09-12T02:39:57.765114+0000","last_fullsized":"2024-09-12T02:39:57.765114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4968,"log_dups_size":0,"ondisk_log_size":4968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:23.273457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25338,"num_write_kb":318642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"28'6","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.616586+0000","last_change":"2024-09-12T02:23:03.767842+0000","last_active":"2024-09-12T02:39:47.616586+0000","last_peered":"2024-09-12T02:39:47.616586+0000","last_clean":"2024-09-12T02:39:47.616586+0000","last_became_active":"2024-09-12T02:23:03.767066+0000","last_became_peered":"2024-09-12T02:23:03.767066+0000","last_unstale":"2024-09-12T02:39:47.616586+0000","last_undegraded":"2024-09-12T02:39:47.616586+0000","last_fullsized":"2024-09-12T02:39:47.616586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:50.800749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"28'2","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:37:48.019306+0000","last_change":"2024-09-12T02:23:15.826104+0000","last_active":"2024-09-12T02:37:48.019306+0000","last_peered":"2024-09-12T02:37:48.019306+0000","last_clean":"2024-09-12T02:37:48.019306+0000","last_became_active":"2024-09-12T02:23:15.825779+0000","last_became_peered":"2024-09-12T02:23:15.825779+0000","last_unstale":"2024-09-12T02:37:48.019306+0000","last_undegraded":"2024-09-12T02:37:48.019306+0000","last_fullsized":"2024-09-12T02:37:48.019306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:32.661083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"28'5278","reported_seq":5300,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.698094+0000","last_change":"2024-09-12T02:23:16.856543+0000","last_active":"2024-09-12T02:40:04.698094+0000","last_peered":"2024-09-12T02:40:04.698094+0000","last_clean":"2024-09-12T02:40:04.698094+0000","last_became_active":"2024-09-12T02:23:16.855538+0000","last_became_peered":"2024-09-12T02:23:16.855538+0000","last_unstale":"2024-09-12T02:40:04.698094+0000","last_undegraded":"2024-09-12T02:40:04.698094+0000","last_fullsized":"2024-09-12T02:40:04.698094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5278,"log_dups_size":0,"ondisk_log_size":5278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:05.857593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27222,"num_write_kb":301662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'5225","reported_seq":5256,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.832151+0000","last_change":"2024-09-12T02:23:04.783671+0000","last_active":"2024-09-12T02:39:57.832151+0000","last_peered":"2024-09-12T02:39:57.832151+0000","last_clean":"2024-09-12T02:39:57.832151+0000","last_became_active":"2024-09-12T02:23:04.783399+0000","last_became_peered":"2024-09-12T02:23:04.783399+0000","last_unstale":"2024-09-12T02:39:57.832151+0000","last_undegraded":"2024-09-12T02:39:57.832151+0000","last_fullsized":"2024-09-12T02:39:57.832151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5225,"log_dups_size":0,"ondisk_log_size":5225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:04.321789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26678,"num_write_kb":336266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'5","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.634447+0000","last_change":"2024-09-12T02:23:03.767217+0000","last_active":"2024-09-12T02:39:47.634447+0000","last_peered":"2024-09-12T02:39:47.634447+0000","last_clean":"2024-09-12T02:39:47.634447+0000","last_became_active":"2024-09-12T02:23:03.766551+0000","last_became_peered":"2024-09-12T02:23:03.766551+0000","last_unstale":"2024-09-12T02:39:47.634447+0000","last_undegraded":"2024-09-12T02:39:47.634447+0000","last_fullsized":"2024-09-12T02:39:47.634447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:09.963450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"28'299","reported_seq":324,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:48.637750+0000","last_change":"2024-09-12T02:23:15.832638+0000","last_active":"2024-09-12T02:39:48.637750+0000","last_peered":"2024-09-12T02:39:48.637750+0000","last_clean":"2024-09-12T02:39:48.637750+0000","last_became_active":"2024-09-12T02:23:15.832152+0000","last_became_peered":"2024-09-12T02:23:15.832152+0000","last_unstale":"2024-09-12T02:39:48.637750+0000","last_undegraded":"2024-09-12T02:39:48.637750+0000","last_fullsized":"2024-09-12T02:39:48.637750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:06.820636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295,"num_write_kb":4246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"28'6304","reported_seq":6327,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.731388+0000","last_change":"2024-09-12T02:23:16.846920+0000","last_active":"2024-09-12T02:40:04.731388+0000","last_peered":"2024-09-12T02:40:04.731388+0000","last_clean":"2024-09-12T02:40:04.731388+0000","last_became_active":"2024-09-12T02:23:16.846454+0000","last_became_peered":"2024-09-12T02:23:16.846454+0000","last_unstale":"2024-09-12T02:40:04.731388+0000","last_undegraded":"2024-09-12T02:40:04.731388+0000","last_fullsized":"2024-09-12T02:40:04.731388+0000","mapping_epoch":24,"log_start":"28'1100","ondisk_log_start":"28'1100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5204,"log_dups_size":0,"ondisk_log_size":5204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:51.782998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31934,"num_write_kb":398820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"28'4402","reported_seq":4433,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.754331+0000","last_change":"2024-09-12T02:23:04.784379+0000","last_active":"2024-09-12T02:39:57.754331+0000","last_peered":"2024-09-12T02:39:57.754331+0000","last_clean":"2024-09-12T02:39:57.754331+0000","last_became_active":"2024-09-12T02:23:04.784094+0000","last_became_peered":"2024-09-12T02:23:04.784094+0000","last_unstale":"2024-09-12T02:39:57.754331+0000","last_undegraded":"2024-09-12T02:39:57.754331+0000","last_fullsized":"2024-09-12T02:39:57.754331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4402,"log_dups_size":0,"ondisk_log_size":4402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:22.103008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22399,"num_write_kb":282193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"28'8","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.616748+0000","last_change":"2024-09-12T02:23:03.762859+0000","last_active":"2024-09-12T02:39:47.616748+0000","last_peered":"2024-09-12T02:39:47.616748+0000","last_clean":"2024-09-12T02:39:47.616748+0000","last_became_active":"2024-09-12T02:23:03.762557+0000","last_became_peered":"2024-09-12T02:23:03.762557+0000","last_unstale":"2024-09-12T02:39:47.616748+0000","last_undegraded":"2024-09-12T02:39:47.616748+0000","last_fullsized":"2024-09-12T02:39:47.616748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:34.863435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"28'34","reported_seq":58,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:08.425336+0000","last_change":"2024-09-12T02:23:15.823090+0000","last_active":"2024-09-12T02:38:08.425336+0000","last_peered":"2024-09-12T02:38:08.425336+0000","last_clean":"2024-09-12T02:38:08.425336+0000","last_became_active":"2024-09-12T02:23:15.822441+0000","last_became_peered":"2024-09-12T02:23:15.822441+0000","last_unstale":"2024-09-12T02:38:08.425336+0000","last_undegraded":"2024-09-12T02:38:08.425336+0000","last_fullsized":"2024-09-12T02:38:08.425336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:35.125478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"28'5704","reported_seq":5727,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.711812+0000","last_change":"2024-09-12T02:23:16.839875+0000","last_active":"2024-09-12T02:40:04.711812+0000","last_peered":"2024-09-12T02:40:04.711812+0000","last_clean":"2024-09-12T02:40:04.711812+0000","last_became_active":"2024-09-12T02:23:16.838277+0000","last_became_peered":"2024-09-12T02:23:16.838277+0000","last_unstale":"2024-09-12T02:40:04.711812+0000","last_undegraded":"2024-09-12T02:40:04.711812+0000","last_fullsized":"2024-09-12T02:40:04.711812+0000","mapping_epoch":24,"log_start":"28'500","ondisk_log_start":"28'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5204,"log_dups_size":0,"ondisk_log_size":5204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:09.370310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29050,"num_write_kb":345934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"28'4440","reported_seq":4471,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.749780+0000","last_change":"2024-09-12T02:23:04.780843+0000","last_active":"2024-09-12T02:39:57.749780+0000","last_peered":"2024-09-12T02:39:57.749780+0000","last_clean":"2024-09-12T02:39:57.749780+0000","last_became_active":"2024-09-12T02:23:04.780475+0000","last_became_peered":"2024-09-12T02:23:04.780475+0000","last_unstale":"2024-09-12T02:39:57.749780+0000","last_undegraded":"2024-09-12T02:39:57.749780+0000","last_fullsized":"2024-09-12T02:39:57.749780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4440,"log_dups_size":0,"ondisk_log_size":4440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:38.074872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22736,"num_write_kb":283554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'340","reported_seq":373,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.633548+0000","last_change":"2024-09-12T02:23:03.768425+0000","last_active":"2024-09-12T02:39:47.633548+0000","last_peered":"2024-09-12T02:39:47.633548+0000","last_clean":"2024-09-12T02:39:47.633548+0000","last_became_active":"2024-09-12T02:23:03.768092+0000","last_became_peered":"2024-09-12T02:23:03.768092+0000","last_unstale":"2024-09-12T02:39:47.633548+0000","last_undegraded":"2024-09-12T02:39:47.633548+0000","last_fullsized":"2024-09-12T02:39:47.633548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":340,"log_dups_size":0,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:18.572070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"28'5","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.725314+0000","last_change":"2024-09-12T02:23:15.829364+0000","last_active":"2024-09-12T02:38:07.725314+0000","last_peered":"2024-09-12T02:38:07.725314+0000","last_clean":"2024-09-12T02:38:07.725314+0000","last_became_active":"2024-09-12T02:23:15.827936+0000","last_became_peered":"2024-09-12T02:23:15.827936+0000","last_unstale":"2024-09-12T02:38:07.725314+0000","last_undegraded":"2024-09-12T02:38:07.725314+0000","last_fullsized":"2024-09-12T02:38:07.725314+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:04.973202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"28'4960","reported_seq":4983,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.685069+0000","last_change":"2024-09-12T02:23:16.854209+0000","last_active":"2024-09-12T02:40:04.685069+0000","last_peered":"2024-09-12T02:40:04.685069+0000","last_clean":"2024-09-12T02:40:04.685069+0000","last_became_active":"2024-09-12T02:23:16.853900+0000","last_became_peered":"2024-09-12T02:23:16.853900+0000","last_unstale":"2024-09-12T02:40:04.685069+0000","last_undegraded":"2024-09-12T02:40:04.685069+0000","last_fullsized":"2024-09-12T02:40:04.685069+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4960,"log_dups_size":0,"ondisk_log_size":4960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:52.831434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25526,"num_write_kb":294821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'6032","reported_seq":6063,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.811025+0000","last_change":"2024-09-12T02:23:04.777953+0000","last_active":"2024-09-12T02:39:57.811025+0000","last_peered":"2024-09-12T02:39:57.811025+0000","last_clean":"2024-09-12T02:39:57.811025+0000","last_became_active":"2024-09-12T02:23:04.777081+0000","last_became_peered":"2024-09-12T02:23:04.777081+0000","last_unstale":"2024-09-12T02:39:57.811025+0000","last_undegraded":"2024-09-12T02:39:57.811025+0000","last_fullsized":"2024-09-12T02:39:57.811025+0000","mapping_epoch":20,"log_start":"28'500","ondisk_log_start":"28'500","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5532,"log_dups_size":0,"ondisk_log_size":5532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:14.103378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30497,"num_write_kb":392872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'35","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:48.251039+0000","last_change":"2024-09-12T02:23:03.771271+0000","last_active":"2024-09-12T02:39:48.251039+0000","last_peered":"2024-09-12T02:39:48.251039+0000","last_clean":"2024-09-12T02:39:48.251039+0000","last_became_active":"2024-09-12T02:23:03.769601+0000","last_became_peered":"2024-09-12T02:23:03.769601+0000","last_unstale":"2024-09-12T02:39:48.251039+0000","last_undegraded":"2024-09-12T02:39:48.251039+0000","last_fullsized":"2024-09-12T02:39:48.251039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:22.910072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"28'8","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.680681+0000","last_change":"2024-09-12T02:23:15.831522+0000","last_active":"2024-09-12T02:38:07.680681+0000","last_peered":"2024-09-12T02:38:07.680681+0000","last_clean":"2024-09-12T02:38:07.680681+0000","last_became_active":"2024-09-12T02:23:15.831220+0000","last_became_peered":"2024-09-12T02:23:15.831220+0000","last_unstale":"2024-09-12T02:38:07.680681+0000","last_undegraded":"2024-09-12T02:38:07.680681+0000","last_fullsized":"2024-09-12T02:38:07.680681+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:54.337051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"28'5159","reported_seq":5182,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.721952+0000","last_change":"2024-09-12T02:23:16.858361+0000","last_active":"2024-09-12T02:40:04.721952+0000","last_peered":"2024-09-12T02:40:04.721952+0000","last_clean":"2024-09-12T02:40:04.721952+0000","last_became_active":"2024-09-12T02:23:16.858075+0000","last_became_peered":"2024-09-12T02:23:16.858075+0000","last_unstale":"2024-09-12T02:40:04.721952+0000","last_undegraded":"2024-09-12T02:40:04.721952+0000","last_fullsized":"2024-09-12T02:40:04.721952+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5159,"log_dups_size":0,"ondisk_log_size":5159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:35.038604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27123,"num_write_kb":309496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"28'3733","reported_seq":3764,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.822654+0000","last_change":"2024-09-12T02:23:04.779171+0000","last_active":"2024-09-12T02:39:57.822654+0000","last_peered":"2024-09-12T02:39:57.822654+0000","last_clean":"2024-09-12T02:39:57.822654+0000","last_became_active":"2024-09-12T02:23:04.778850+0000","last_became_peered":"2024-09-12T02:23:04.778850+0000","last_unstale":"2024-09-12T02:39:57.822654+0000","last_undegraded":"2024-09-12T02:39:57.822654+0000","last_fullsized":"2024-09-12T02:39:57.822654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":3733,"log_dups_size":0,"ondisk_log_size":3733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:21.746490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19250,"num_write_kb":253251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'2","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.636633+0000","last_change":"2024-09-12T02:23:03.769710+0000","last_active":"2024-09-12T02:39:47.636633+0000","last_peered":"2024-09-12T02:39:47.636633+0000","last_clean":"2024-09-12T02:39:47.636633+0000","last_became_active":"2024-09-12T02:23:03.769436+0000","last_became_peered":"2024-09-12T02:23:03.769436+0000","last_unstale":"2024-09-12T02:39:47.636633+0000","last_undegraded":"2024-09-12T02:39:47.636633+0000","last_fullsized":"2024-09-12T02:39:47.636633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:11.194147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"28'12","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:38.057899+0000","last_change":"2024-09-12T02:23:15.833196+0000","last_active":"2024-09-12T02:39:38.057899+0000","last_peered":"2024-09-12T02:39:38.057899+0000","last_clean":"2024-09-12T02:39:38.057899+0000","last_became_active":"2024-09-12T02:23:15.832873+0000","last_became_peered":"2024-09-12T02:23:15.832873+0000","last_unstale":"2024-09-12T02:39:38.057899+0000","last_undegraded":"2024-09-12T02:39:38.057899+0000","last_fullsized":"2024-09-12T02:39:38.057899+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:15.238046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"28'5308","reported_seq":5331,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.733481+0000","last_change":"2024-09-12T02:23:16.856735+0000","last_active":"2024-09-12T02:40:04.733481+0000","last_peered":"2024-09-12T02:40:04.733481+0000","last_clean":"2024-09-12T02:40:04.733481+0000","last_became_active":"2024-09-12T02:23:16.856455+0000","last_became_peered":"2024-09-12T02:23:16.856455+0000","last_unstale":"2024-09-12T02:40:04.733481+0000","last_undegraded":"2024-09-12T02:40:04.733481+0000","last_fullsized":"2024-09-12T02:40:04.733481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5308,"log_dups_size":0,"ondisk_log_size":5308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:55.376194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27382,"num_write_kb":326846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"28'4524","reported_seq":4555,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.792729+0000","last_change":"2024-09-12T02:23:04.786100+0000","last_active":"2024-09-12T02:39:57.792729+0000","last_peered":"2024-09-12T02:39:57.792729+0000","last_clean":"2024-09-12T02:39:57.792729+0000","last_became_active":"2024-09-12T02:23:04.785795+0000","last_became_peered":"2024-09-12T02:23:04.785795+0000","last_unstale":"2024-09-12T02:39:57.792729+0000","last_undegraded":"2024-09-12T02:39:57.792729+0000","last_fullsized":"2024-09-12T02:39:57.792729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4524,"log_dups_size":0,"ondisk_log_size":4524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:58.597807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22689,"num_write_kb":295834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"28'2","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.620142+0000","last_change":"2024-09-12T02:23:03.770668+0000","last_active":"2024-09-12T02:39:47.620142+0000","last_peered":"2024-09-12T02:39:47.620142+0000","last_clean":"2024-09-12T02:39:47.620142+0000","last_became_active":"2024-09-12T02:23:03.769302+0000","last_became_peered":"2024-09-12T02:23:03.769302+0000","last_unstale":"2024-09-12T02:39:47.620142+0000","last_undegraded":"2024-09-12T02:39:47.620142+0000","last_fullsized":"2024-09-12T02:39:47.620142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:18.948922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"28'6","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.703401+0000","last_change":"2024-09-12T02:23:15.825585+0000","last_active":"2024-09-12T02:38:07.703401+0000","last_peered":"2024-09-12T02:38:07.703401+0000","last_clean":"2024-09-12T02:38:07.703401+0000","last_became_active":"2024-09-12T02:23:15.825305+0000","last_became_peered":"2024-09-12T02:23:15.825305+0000","last_unstale":"2024-09-12T02:38:07.703401+0000","last_undegraded":"2024-09-12T02:38:07.703401+0000","last_fullsized":"2024-09-12T02:38:07.703401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:43.818922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"28'6585","reported_seq":6609,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.697301+0000","last_change":"2024-09-12T02:23:16.852415+0000","last_active":"2024-09-12T02:40:04.697301+0000","last_peered":"2024-09-12T02:40:04.697301+0000","last_clean":"2024-09-12T02:40:04.697301+0000","last_became_active":"2024-09-12T02:23:16.852061+0000","last_became_peered":"2024-09-12T02:23:16.852061+0000","last_unstale":"2024-09-12T02:40:04.697301+0000","last_undegraded":"2024-09-12T02:40:04.697301+0000","last_fullsized":"2024-09-12T02:40:04.697301+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":6585,"log_dups_size":0,"ondisk_log_size":6585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:30:49.720576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34694,"num_write_kb":385000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"28'8","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.695201+0000","last_change":"2024-09-12T02:23:15.833414+0000","last_active":"2024-09-12T02:38:07.695201+0000","last_peered":"2024-09-12T02:38:07.695201+0000","last_clean":"2024-09-12T02:38:07.695201+0000","last_became_active":"2024-09-12T02:23:15.832837+0000","last_became_peered":"2024-09-12T02:23:15.832837+0000","last_unstale":"2024-09-12T02:38:07.695201+0000","last_undegraded":"2024-09-12T02:38:07.695201+0000","last_fullsized":"2024-09-12T02:38:07.695201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:31.510160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"28'5783","reported_seq":5814,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.762578+0000","last_change":"2024-09-12T02:23:04.776572+0000","last_active":"2024-09-12T02:39:57.762578+0000","last_peered":"2024-09-12T02:39:57.762578+0000","last_clean":"2024-09-12T02:39:57.762578+0000","last_became_active":"2024-09-12T02:23:04.776270+0000","last_became_peered":"2024-09-12T02:23:04.776270+0000","last_unstale":"2024-09-12T02:39:57.762578+0000","last_undegraded":"2024-09-12T02:39:57.762578+0000","last_fullsized":"2024-09-12T02:39:57.762578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5783,"log_dups_size":0,"ondisk_log_size":5783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:12.807907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29721,"num_write_kb":356762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'3","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.633254+0000","last_change":"2024-09-12T02:23:03.762450+0000","last_active":"2024-09-12T02:39:47.633254+0000","last_peered":"2024-09-12T02:39:47.633254+0000","last_clean":"2024-09-12T02:39:47.633254+0000","last_became_active":"2024-09-12T02:23:03.762161+0000","last_became_peered":"2024-09-12T02:23:03.762161+0000","last_unstale":"2024-09-12T02:39:47.633254+0000","last_undegraded":"2024-09-12T02:39:47.633254+0000","last_fullsized":"2024-09-12T02:39:47.633254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:42.256395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"28'5706","reported_seq":5730,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.668944+0000","last_change":"2024-09-12T02:23:16.844537+0000","last_active":"2024-09-12T02:40:04.668944+0000","last_peered":"2024-09-12T02:40:04.668944+0000","last_clean":"2024-09-12T02:40:04.668944+0000","last_became_active":"2024-09-12T02:23:16.844248+0000","last_became_peered":"2024-09-12T02:23:16.844248+0000","last_unstale":"2024-09-12T02:40:04.668944+0000","last_undegraded":"2024-09-12T02:40:04.668944+0000","last_fullsized":"2024-09-12T02:40:04.668944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5706,"log_dups_size":0,"ondisk_log_size":5706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:45.801324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29959,"num_write_kb":337330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"28'719","reported_seq":745,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:37:54.833834+0000","last_change":"2024-09-12T02:23:15.826010+0000","last_active":"2024-09-12T02:37:54.833834+0000","last_peered":"2024-09-12T02:37:54.833834+0000","last_clean":"2024-09-12T02:37:54.833834+0000","last_became_active":"2024-09-12T02:23:15.825730+0000","last_became_peered":"2024-09-12T02:23:15.825730+0000","last_unstale":"2024-09-12T02:37:54.833834+0000","last_undegraded":"2024-09-12T02:37:54.833834+0000","last_fullsized":"2024-09-12T02:37:54.833834+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":719,"log_dups_size":0,"ondisk_log_size":719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:17.920975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":717,"num_write_kb":4509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"28'4333","reported_seq":4364,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.775122+0000","last_change":"2024-09-12T02:23:04.783317+0000","last_active":"2024-09-12T02:39:57.775122+0000","last_peered":"2024-09-12T02:39:57.775122+0000","last_clean":"2024-09-12T02:39:57.775122+0000","last_became_active":"2024-09-12T02:23:04.783039+0000","last_became_peered":"2024-09-12T02:23:04.783039+0000","last_unstale":"2024-09-12T02:39:57.775122+0000","last_undegraded":"2024-09-12T02:39:57.775122+0000","last_fullsized":"2024-09-12T02:39:57.775122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4333,"log_dups_size":0,"ondisk_log_size":4333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:17.577991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22422,"num_write_kb":290509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'3","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.593428+0000","last_change":"2024-09-12T02:23:03.768361+0000","last_active":"2024-09-12T02:39:47.593428+0000","last_peered":"2024-09-12T02:39:47.593428+0000","last_clean":"2024-09-12T02:39:47.593428+0000","last_became_active":"2024-09-12T02:23:03.768137+0000","last_became_peered":"2024-09-12T02:23:03.768137+0000","last_unstale":"2024-09-12T02:39:47.593428+0000","last_undegraded":"2024-09-12T02:39:47.593428+0000","last_fullsized":"2024-09-12T02:39:47.593428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:29.721363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"28'6357","reported_seq":6379,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.744225+0000","last_change":"2024-09-12T02:23:16.861251+0000","last_active":"2024-09-12T02:40:04.744225+0000","last_peered":"2024-09-12T02:40:04.744225+0000","last_clean":"2024-09-12T02:40:04.744225+0000","last_became_active":"2024-09-12T02:23:16.860980+0000","last_became_peered":"2024-09-12T02:23:16.860980+0000","last_unstale":"2024-09-12T02:40:04.744225+0000","last_undegraded":"2024-09-12T02:40:04.744225+0000","last_fullsized":"2024-09-12T02:40:04.744225+0000","mapping_epoch":24,"log_start":"28'500","ondisk_log_start":"28'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5857,"log_dups_size":0,"ondisk_log_size":5857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:16.177179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32865,"num_write_kb":377625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"28'95","reported_seq":127,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.604503+0000","last_change":"2024-09-12T02:23:03.768186+0000","last_active":"2024-09-12T02:39:57.604503+0000","last_peered":"2024-09-12T02:39:57.604503+0000","last_clean":"2024-09-12T02:39:57.604503+0000","last_became_active":"2024-09-12T02:23:03.767916+0000","last_became_peered":"2024-09-12T02:23:03.767916+0000","last_unstale":"2024-09-12T02:39:57.604503+0000","last_undegraded":"2024-09-12T02:39:57.604503+0000","last_fullsized":"2024-09-12T02:39:57.604503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:04.424540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1333026,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"28'3601","reported_seq":3631,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.791002+0000","last_change":"2024-09-12T02:23:04.793412+0000","last_active":"2024-09-12T02:39:57.791002+0000","last_peered":"2024-09-12T02:39:57.791002+0000","last_clean":"2024-09-12T02:39:57.791002+0000","last_became_active":"2024-09-12T02:23:04.793100+0000","last_became_peered":"2024-09-12T02:23:04.793100+0000","last_unstale":"2024-09-12T02:39:57.791002+0000","last_undegraded":"2024-09-12T02:39:57.791002+0000","last_fullsized":"2024-09-12T02:39:57.791002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":3601,"log_dups_size":0,"ondisk_log_size":3601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:50.446212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18077,"num_write_kb":232187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"28'3","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.714174+0000","last_change":"2024-09-12T02:23:15.830776+0000","last_active":"2024-09-12T02:38:07.714174+0000","last_peered":"2024-09-12T02:38:07.714174+0000","last_clean":"2024-09-12T02:38:07.714174+0000","last_became_active":"2024-09-12T02:23:15.830492+0000","last_became_peered":"2024-09-12T02:23:15.830492+0000","last_unstale":"2024-09-12T02:38:07.714174+0000","last_undegraded":"2024-09-12T02:38:07.714174+0000","last_fullsized":"2024-09-12T02:38:07.714174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:40.517292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"28'3975","reported_seq":3997,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.678952+0000","last_change":"2024-09-12T02:23:16.851953+0000","last_active":"2024-09-12T02:40:04.678952+0000","last_peered":"2024-09-12T02:40:04.678952+0000","last_clean":"2024-09-12T02:40:04.678952+0000","last_became_active":"2024-09-12T02:23:16.851558+0000","last_became_peered":"2024-09-12T02:23:16.851558+0000","last_unstale":"2024-09-12T02:40:04.678952+0000","last_undegraded":"2024-09-12T02:40:04.678952+0000","last_fullsized":"2024-09-12T02:40:04.678952+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":3975,"log_dups_size":0,"ondisk_log_size":3975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:29.852193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20293,"num_write_kb":228813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'576","reported_seq":608,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:08.021504+0000","last_change":"2024-09-12T02:23:03.764310+0000","last_active":"2024-09-12T02:38:08.021504+0000","last_peered":"2024-09-12T02:38:08.021504+0000","last_clean":"2024-09-12T02:38:08.021504+0000","last_became_active":"2024-09-12T02:23:03.764020+0000","last_became_peered":"2024-09-12T02:23:03.764020+0000","last_unstale":"2024-09-12T02:38:08.021504+0000","last_undegraded":"2024-09-12T02:38:08.021504+0000","last_fullsized":"2024-09-12T02:38:08.021504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:25.892874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":574,"num_write_kb":4226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"28'4110","reported_seq":4140,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.726393+0000","last_change":"2024-09-12T02:23:04.771579+0000","last_active":"2024-09-12T02:39:57.726393+0000","last_peered":"2024-09-12T02:39:57.726393+0000","last_clean":"2024-09-12T02:39:57.726393+0000","last_became_active":"2024-09-12T02:23:04.771310+0000","last_became_peered":"2024-09-12T02:23:04.771310+0000","last_unstale":"2024-09-12T02:39:57.726393+0000","last_undegraded":"2024-09-12T02:39:57.726393+0000","last_fullsized":"2024-09-12T02:39:57.726393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4110,"log_dups_size":0,"ondisk_log_size":4110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:05.115474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20660,"num_write_kb":258850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"28'11","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.725985+0000","last_change":"2024-09-12T02:23:15.832757+0000","last_active":"2024-09-12T02:38:07.725985+0000","last_peered":"2024-09-12T02:38:07.725985+0000","last_clean":"2024-09-12T02:38:07.725985+0000","last_became_active":"2024-09-12T02:23:15.832478+0000","last_became_peered":"2024-09-12T02:23:15.832478+0000","last_unstale":"2024-09-12T02:38:07.725985+0000","last_undegraded":"2024-09-12T02:38:07.725985+0000","last_fullsized":"2024-09-12T02:38:07.725985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:29.301251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"28'4897","reported_seq":4920,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.741619+0000","last_change":"2024-09-12T02:23:16.848437+0000","last_active":"2024-09-12T02:40:04.741619+0000","last_peered":"2024-09-12T02:40:04.741619+0000","last_clean":"2024-09-12T02:40:04.741619+0000","last_became_active":"2024-09-12T02:23:16.847063+0000","last_became_peered":"2024-09-12T02:23:16.847063+0000","last_unstale":"2024-09-12T02:40:04.741619+0000","last_undegraded":"2024-09-12T02:40:04.741619+0000","last_fullsized":"2024-09-12T02:40:04.741619+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4897,"log_dups_size":0,"ondisk_log_size":4897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:49.979448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25246,"num_write_kb":285992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"28'6383","reported_seq":6415,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.776503+0000","last_change":"2024-09-12T02:23:04.788489+0000","last_active":"2024-09-12T02:39:57.776503+0000","last_peered":"2024-09-12T02:39:57.776503+0000","last_clean":"2024-09-12T02:39:57.776503+0000","last_became_active":"2024-09-12T02:23:04.788195+0000","last_became_peered":"2024-09-12T02:23:04.788195+0000","last_unstale":"2024-09-12T02:39:57.776503+0000","last_undegraded":"2024-09-12T02:39:57.776503+0000","last_fullsized":"2024-09-12T02:39:57.776503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":6383,"log_dups_size":0,"ondisk_log_size":6383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:51.352859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32308,"num_write_kb":383454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"28'5756","reported_seq":5779,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.673986+0000","last_change":"2024-09-12T02:23:16.843805+0000","last_active":"2024-09-12T02:40:04.673986+0000","last_peered":"2024-09-12T02:40:04.673986+0000","last_clean":"2024-09-12T02:40:04.673986+0000","last_became_active":"2024-09-12T02:23:16.843517+0000","last_became_peered":"2024-09-12T02:23:16.843517+0000","last_unstale":"2024-09-12T02:40:04.673986+0000","last_undegraded":"2024-09-12T02:40:04.673986+0000","last_fullsized":"2024-09-12T02:40:04.673986+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5756,"log_dups_size":0,"ondisk_log_size":5756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:30.873311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29883,"num_write_kb":357322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"28'5059","reported_seq":5091,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.717218+0000","last_change":"2024-09-12T02:23:04.780662+0000","last_active":"2024-09-12T02:39:57.717218+0000","last_peered":"2024-09-12T02:39:57.717218+0000","last_clean":"2024-09-12T02:39:57.717218+0000","last_became_active":"2024-09-12T02:23:04.780402+0000","last_became_peered":"2024-09-12T02:23:04.780402+0000","last_unstale":"2024-09-12T02:39:57.717218+0000","last_undegraded":"2024-09-12T02:39:57.717218+0000","last_fullsized":"2024-09-12T02:39:57.717218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5059,"log_dups_size":0,"ondisk_log_size":5059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:23:00.556487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26551,"num_write_kb":323518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"28'4560","reported_seq":4583,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.699722+0000","last_change":"2024-09-12T02:23:16.852992+0000","last_active":"2024-09-12T02:40:04.699722+0000","last_peered":"2024-09-12T02:40:04.699722+0000","last_clean":"2024-09-12T02:40:04.699722+0000","last_became_active":"2024-09-12T02:23:16.852706+0000","last_became_peered":"2024-09-12T02:23:16.852706+0000","last_unstale":"2024-09-12T02:40:04.699722+0000","last_undegraded":"2024-09-12T02:40:04.699722+0000","last_fullsized":"2024-09-12T02:40:04.699722+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4560,"log_dups_size":0,"ondisk_log_size":4560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:56.896457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23787,"num_write_kb":279744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"28'5935","reported_seq":5967,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.781864+0000","last_change":"2024-09-12T02:23:04.785920+0000","last_active":"2024-09-12T02:39:57.781864+0000","last_peered":"2024-09-12T02:39:57.781864+0000","last_clean":"2024-09-12T02:39:57.781864+0000","last_became_active":"2024-09-12T02:23:04.785422+0000","last_became_peered":"2024-09-12T02:23:04.785422+0000","last_unstale":"2024-09-12T02:39:57.781864+0000","last_undegraded":"2024-09-12T02:39:57.781864+0000","last_fullsized":"2024-09-12T02:39:57.781864+0000","mapping_epoch":20,"log_start":"28'100","ondisk_log_start":"28'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5835,"log_dups_size":0,"ondisk_log_size":5835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:55.106703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30608,"num_write_kb":368510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"28'5374","reported_seq":5397,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.741332+0000","last_change":"2024-09-12T02:23:16.861939+0000","last_active":"2024-09-12T02:40:04.741332+0000","last_peered":"2024-09-12T02:40:04.741332+0000","last_clean":"2024-09-12T02:40:04.741332+0000","last_became_active":"2024-09-12T02:23:16.861658+0000","last_became_peered":"2024-09-12T02:23:16.861658+0000","last_unstale":"2024-09-12T02:40:04.741332+0000","last_undegraded":"2024-09-12T02:40:04.741332+0000","last_fullsized":"2024-09-12T02:40:04.741332+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5374,"log_dups_size":0,"ondisk_log_size":5374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:06.755715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28055,"num_write_kb":329573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"28'4234","reported_seq":4266,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.777821+0000","last_change":"2024-09-12T02:23:04.777018+0000","last_active":"2024-09-12T02:39:57.777821+0000","last_peered":"2024-09-12T02:39:57.777821+0000","last_clean":"2024-09-12T02:39:57.777821+0000","last_became_active":"2024-09-12T02:23:04.776736+0000","last_became_peered":"2024-09-12T02:23:04.776736+0000","last_unstale":"2024-09-12T02:39:57.777821+0000","last_undegraded":"2024-09-12T02:39:57.777821+0000","last_fullsized":"2024-09-12T02:39:57.777821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4234,"log_dups_size":0,"ondisk_log_size":4234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:08.668990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21439,"num_write_kb":262018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"28'6314","reported_seq":6338,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.717796+0000","last_change":"2024-09-12T02:23:16.847615+0000","last_active":"2024-09-12T02:40:04.717796+0000","last_peered":"2024-09-12T02:40:04.717796+0000","last_clean":"2024-09-12T02:40:04.717796+0000","last_became_active":"2024-09-12T02:23:16.847260+0000","last_became_peered":"2024-09-12T02:23:16.847260+0000","last_unstale":"2024-09-12T02:40:04.717796+0000","last_undegraded":"2024-09-12T02:40:04.717796+0000","last_fullsized":"2024-09-12T02:40:04.717796+0000","mapping_epoch":24,"log_start":"28'500","ondisk_log_start":"28'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5814,"log_dups_size":0,"ondisk_log_size":5814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:48.920477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32869,"num_write_kb":377542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"28'4066","reported_seq":4097,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.768701+0000","last_change":"2024-09-12T02:23:04.789372+0000","last_active":"2024-09-12T02:39:57.768701+0000","last_peered":"2024-09-12T02:39:57.768701+0000","last_clean":"2024-09-12T02:39:57.768701+0000","last_became_active":"2024-09-12T02:23:04.789090+0000","last_became_peered":"2024-09-12T02:23:04.789090+0000","last_unstale":"2024-09-12T02:39:57.768701+0000","last_undegraded":"2024-09-12T02:39:57.768701+0000","last_fullsized":"2024-09-12T02:39:57.768701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4066,"log_dups_size":0,"ondisk_log_size":4066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:49.533491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20728,"num_write_kb":267380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"28'3925","reported_seq":3949,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.706991+0000","last_change":"2024-09-12T02:23:16.859000+0000","last_active":"2024-09-12T02:40:04.706991+0000","last_peered":"2024-09-12T02:40:04.706991+0000","last_clean":"2024-09-12T02:40:04.706991+0000","last_became_active":"2024-09-12T02:23:16.858637+0000","last_became_peered":"2024-09-12T02:23:16.858637+0000","last_unstale":"2024-09-12T02:40:04.706991+0000","last_undegraded":"2024-09-12T02:40:04.706991+0000","last_fullsized":"2024-09-12T02:40:04.706991+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":3925,"log_dups_size":0,"ondisk_log_size":3925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:47.915947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20092,"num_write_kb":256658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"28'5046","reported_seq":5077,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.720926+0000","last_change":"2024-09-12T02:23:04.776435+0000","last_active":"2024-09-12T02:39:57.720926+0000","last_peered":"2024-09-12T02:39:57.720926+0000","last_clean":"2024-09-12T02:39:57.720926+0000","last_became_active":"2024-09-12T02:23:04.776120+0000","last_became_peered":"2024-09-12T02:23:04.776120+0000","last_unstale":"2024-09-12T02:39:57.720926+0000","last_undegraded":"2024-09-12T02:39:57.720926+0000","last_fullsized":"2024-09-12T02:39:57.720926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5046,"log_dups_size":0,"ondisk_log_size":5046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:27.985094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26791,"num_write_kb":324401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"28'6719","reported_seq":6743,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.749518+0000","last_change":"2024-09-12T02:23:16.856477+0000","last_active":"2024-09-12T02:40:04.749518+0000","last_peered":"2024-09-12T02:40:04.749518+0000","last_clean":"2024-09-12T02:40:04.749518+0000","last_became_active":"2024-09-12T02:23:16.855839+0000","last_became_peered":"2024-09-12T02:23:16.855839+0000","last_unstale":"2024-09-12T02:40:04.749518+0000","last_undegraded":"2024-09-12T02:40:04.749518+0000","last_fullsized":"2024-09-12T02:40:04.749518+0000","mapping_epoch":24,"log_start":"28'900","ondisk_log_start":"28'900","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5819,"log_dups_size":0,"ondisk_log_size":5819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:42.510184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34627,"num_write_kb":392862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"28'4165","reported_seq":4196,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.847028+0000","last_change":"2024-09-12T02:23:04.788827+0000","last_active":"2024-09-12T02:39:57.847028+0000","last_peered":"2024-09-12T02:39:57.847028+0000","last_clean":"2024-09-12T02:39:57.847028+0000","last_became_active":"2024-09-12T02:23:04.788521+0000","last_became_peered":"2024-09-12T02:23:04.788521+0000","last_unstale":"2024-09-12T02:39:57.847028+0000","last_undegraded":"2024-09-12T02:39:57.847028+0000","last_fullsized":"2024-09-12T02:39:57.847028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4165,"log_dups_size":0,"ondisk_log_size":4165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:24.470245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21249,"num_write_kb":269852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"28'5811","reported_seq":5835,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.723792+0000","last_change":"2024-09-12T02:23:16.838421+0000","last_active":"2024-09-12T02:40:04.723792+0000","last_peered":"2024-09-12T02:40:04.723792+0000","last_clean":"2024-09-12T02:40:04.723792+0000","last_became_active":"2024-09-12T02:23:16.837606+0000","last_became_peered":"2024-09-12T02:23:16.837606+0000","last_unstale":"2024-09-12T02:40:04.723792+0000","last_undegraded":"2024-09-12T02:40:04.723792+0000","last_fullsized":"2024-09-12T02:40:04.723792+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5811,"log_dups_size":0,"ondisk_log_size":5811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:09.704007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30267,"num_write_kb":338418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"28'5427","reported_seq":5444,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.679950+0000","last_change":"2024-09-12T02:23:56.564278+0000","last_active":"2024-09-12T02:39:57.679950+0000","last_peered":"2024-09-12T02:39:57.679950+0000","last_clean":"2024-09-12T02:39:57.679950+0000","last_became_active":"2024-09-12T02:23:56.563943+0000","last_became_peered":"2024-09-12T02:23:56.563943+0000","last_unstale":"2024-09-12T02:39:57.679950+0000","last_undegraded":"2024-09-12T02:39:57.679950+0000","last_fullsized":"2024-09-12T02:39:57.679950+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5427,"log_dups_size":0,"ondisk_log_size":5427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:40.787770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27382,"num_write_kb":347330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"28'4215","reported_seq":4238,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.744076+0000","last_change":"2024-09-12T02:23:16.845296+0000","last_active":"2024-09-12T02:40:04.744076+0000","last_peered":"2024-09-12T02:40:04.744076+0000","last_clean":"2024-09-12T02:40:04.744076+0000","last_became_active":"2024-09-12T02:23:16.844939+0000","last_became_peered":"2024-09-12T02:23:16.844939+0000","last_unstale":"2024-09-12T02:40:04.744076+0000","last_undegraded":"2024-09-12T02:40:04.744076+0000","last_fullsized":"2024-09-12T02:40:04.744076+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4215,"log_dups_size":0,"ondisk_log_size":4215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:16.790822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21581,"num_write_kb":250408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'4161","reported_seq":4178,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.750998+0000","last_change":"2024-09-12T02:23:56.674421+0000","last_active":"2024-09-12T02:39:57.750998+0000","last_peered":"2024-09-12T02:39:57.750998+0000","last_clean":"2024-09-12T02:39:57.750998+0000","last_became_active":"2024-09-12T02:23:56.674143+0000","last_became_peered":"2024-09-12T02:23:56.674143+0000","last_unstale":"2024-09-12T02:39:57.750998+0000","last_undegraded":"2024-09-12T02:39:57.750998+0000","last_fullsized":"2024-09-12T02:39:57.750998+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4161,"log_dups_size":0,"ondisk_log_size":4161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:01.375384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21422,"num_write_kb":266111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2f","version":"28'6100","reported_seq":6123,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.684901+0000","last_change":"2024-09-12T02:23:16.849846+0000","last_active":"2024-09-12T02:40:04.684901+0000","last_peered":"2024-09-12T02:40:04.684901+0000","last_clean":"2024-09-12T02:40:04.684901+0000","last_became_active":"2024-09-12T02:23:16.849585+0000","last_became_peered":"2024-09-12T02:23:16.849585+0000","last_unstale":"2024-09-12T02:40:04.684901+0000","last_undegraded":"2024-09-12T02:40:04.684901+0000","last_fullsized":"2024-09-12T02:40:04.684901+0000","mapping_epoch":24,"log_start":"28'300","ondisk_log_start":"28'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5800,"log_dups_size":0,"ondisk_log_size":5800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:58.775679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30891,"num_write_kb":369602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"28'4576","reported_seq":4607,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.769180+0000","last_change":"2024-09-12T02:23:04.788624+0000","last_active":"2024-09-12T02:39:57.769180+0000","last_peered":"2024-09-12T02:39:57.769180+0000","last_clean":"2024-09-12T02:39:57.769180+0000","last_became_active":"2024-09-12T02:23:04.788352+0000","last_became_peered":"2024-09-12T02:23:04.788352+0000","last_unstale":"2024-09-12T02:39:57.769180+0000","last_undegraded":"2024-09-12T02:39:57.769180+0000","last_fullsized":"2024-09-12T02:39:57.769180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4576,"log_dups_size":0,"ondisk_log_size":4576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:13.961110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23775,"num_write_kb":295982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"28'5142","reported_seq":5165,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.686350+0000","last_change":"2024-09-12T02:23:16.850112+0000","last_active":"2024-09-12T02:40:04.686350+0000","last_peered":"2024-09-12T02:40:04.686350+0000","last_clean":"2024-09-12T02:40:04.686350+0000","last_became_active":"2024-09-12T02:23:16.849831+0000","last_became_peered":"2024-09-12T02:23:16.849831+0000","last_unstale":"2024-09-12T02:40:04.686350+0000","last_undegraded":"2024-09-12T02:40:04.686350+0000","last_fullsized":"2024-09-12T02:40:04.686350+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5142,"log_dups_size":0,"ondisk_log_size":5142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:42.625762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26862,"num_write_kb":308481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"28'4731","reported_seq":4762,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.835535+0000","last_change":"2024-09-12T02:23:04.785685+0000","last_active":"2024-09-12T02:39:57.835535+0000","last_peered":"2024-09-12T02:39:57.835535+0000","last_clean":"2024-09-12T02:39:57.835535+0000","last_became_active":"2024-09-12T02:23:04.784945+0000","last_became_peered":"2024-09-12T02:23:04.784945+0000","last_unstale":"2024-09-12T02:39:57.835535+0000","last_undegraded":"2024-09-12T02:39:57.835535+0000","last_fullsized":"2024-09-12T02:39:57.835535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4731,"log_dups_size":0,"ondisk_log_size":4731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:36.658436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24557,"num_write_kb":319695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"28'4794","reported_seq":4817,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.688321+0000","last_change":"2024-09-12T02:23:16.846108+0000","last_active":"2024-09-12T02:40:04.688321+0000","last_peered":"2024-09-12T02:40:04.688321+0000","last_clean":"2024-09-12T02:40:04.688321+0000","last_became_active":"2024-09-12T02:23:16.845793+0000","last_became_peered":"2024-09-12T02:23:16.845793+0000","last_unstale":"2024-09-12T02:40:04.688321+0000","last_undegraded":"2024-09-12T02:40:04.688321+0000","last_fullsized":"2024-09-12T02:40:04.688321+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4794,"log_dups_size":0,"ondisk_log_size":4794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:36.274858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23926,"num_write_kb":300628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"28'4561","reported_seq":4592,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.804691+0000","last_change":"2024-09-12T02:23:04.785849+0000","last_active":"2024-09-12T02:39:57.804691+0000","last_peered":"2024-09-12T02:39:57.804691+0000","last_clean":"2024-09-12T02:39:57.804691+0000","last_became_active":"2024-09-12T02:23:04.785511+0000","last_became_peered":"2024-09-12T02:23:04.785511+0000","last_unstale":"2024-09-12T02:39:57.804691+0000","last_undegraded":"2024-09-12T02:39:57.804691+0000","last_fullsized":"2024-09-12T02:39:57.804691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4561,"log_dups_size":0,"ondisk_log_size":4561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:28.670102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23484,"num_write_kb":303052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"28'5809","reported_seq":5832,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.701362+0000","last_change":"2024-09-12T02:23:16.855615+0000","last_active":"2024-09-12T02:40:04.701362+0000","last_peered":"2024-09-12T02:40:04.701362+0000","last_clean":"2024-09-12T02:40:04.701362+0000","last_became_active":"2024-09-12T02:23:16.855278+0000","last_became_peered":"2024-09-12T02:23:16.855278+0000","last_unstale":"2024-09-12T02:40:04.701362+0000","last_undegraded":"2024-09-12T02:40:04.701362+0000","last_fullsized":"2024-09-12T02:40:04.701362+0000","mapping_epoch":24,"log_start":"28'300","ondisk_log_start":"28'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5509,"log_dups_size":0,"ondisk_log_size":5509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:34.214175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30461,"num_write_kb":343399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"28'4620","reported_seq":4651,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.744548+0000","last_change":"2024-09-12T02:23:04.789575+0000","last_active":"2024-09-12T02:39:57.744548+0000","last_peered":"2024-09-12T02:39:57.744548+0000","last_clean":"2024-09-12T02:39:57.744548+0000","last_became_active":"2024-09-12T02:23:04.789296+0000","last_became_peered":"2024-09-12T02:23:04.789296+0000","last_unstale":"2024-09-12T02:39:57.744548+0000","last_undegraded":"2024-09-12T02:39:57.744548+0000","last_fullsized":"2024-09-12T02:39:57.744548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4620,"log_dups_size":0,"ondisk_log_size":4620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:13.166139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23568,"num_write_kb":295197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"28'5012","reported_seq":5035,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.717856+0000","last_change":"2024-09-12T02:23:16.858045+0000","last_active":"2024-09-12T02:40:04.717856+0000","last_peered":"2024-09-12T02:40:04.717856+0000","last_clean":"2024-09-12T02:40:04.717856+0000","last_became_active":"2024-09-12T02:23:16.857772+0000","last_became_peered":"2024-09-12T02:23:16.857772+0000","last_unstale":"2024-09-12T02:40:04.717856+0000","last_undegraded":"2024-09-12T02:40:04.717856+0000","last_fullsized":"2024-09-12T02:40:04.717856+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5012,"log_dups_size":0,"ondisk_log_size":5012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:35.598279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25770,"num_write_kb":312200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"28'4649","reported_seq":4680,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.749517+0000","last_change":"2024-09-12T02:23:04.777450+0000","last_active":"2024-09-12T02:39:57.749517+0000","last_peered":"2024-09-12T02:39:57.749517+0000","last_clean":"2024-09-12T02:39:57.749517+0000","last_became_active":"2024-09-12T02:23:04.776825+0000","last_became_peered":"2024-09-12T02:23:04.776825+0000","last_unstale":"2024-09-12T02:39:57.749517+0000","last_undegraded":"2024-09-12T02:39:57.749517+0000","last_fullsized":"2024-09-12T02:39:57.749517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4649,"log_dups_size":0,"ondisk_log_size":4649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:40.315075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22974,"num_write_kb":296824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"28'4733","reported_seq":4756,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.663806+0000","last_change":"2024-09-12T02:23:16.846032+0000","last_active":"2024-09-12T02:40:04.663806+0000","last_peered":"2024-09-12T02:40:04.663806+0000","last_clean":"2024-09-12T02:40:04.663806+0000","last_became_active":"2024-09-12T02:23:16.845492+0000","last_became_peered":"2024-09-12T02:23:16.845492+0000","last_unstale":"2024-09-12T02:40:04.663806+0000","last_undegraded":"2024-09-12T02:40:04.663806+0000","last_fullsized":"2024-09-12T02:40:04.663806+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4733,"log_dups_size":0,"ondisk_log_size":4733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:18.785798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24040,"num_write_kb":276615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"28'3733","reported_seq":3764,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.754418+0000","last_change":"2024-09-12T02:23:04.791378+0000","last_active":"2024-09-12T02:39:57.754418+0000","last_peered":"2024-09-12T02:39:57.754418+0000","last_clean":"2024-09-12T02:39:57.754418+0000","last_became_active":"2024-09-12T02:23:04.790926+0000","last_became_peered":"2024-09-12T02:23:04.790926+0000","last_unstale":"2024-09-12T02:39:57.754418+0000","last_undegraded":"2024-09-12T02:39:57.754418+0000","last_fullsized":"2024-09-12T02:39:57.754418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":3733,"log_dups_size":0,"ondisk_log_size":3733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:34.764210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18622,"num_write_kb":238300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"28'5122","reported_seq":5145,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.676752+0000","last_change":"2024-09-12T02:23:16.851099+0000","last_active":"2024-09-12T02:40:04.676752+0000","last_peered":"2024-09-12T02:40:04.676752+0000","last_clean":"2024-09-12T02:40:04.676752+0000","last_became_active":"2024-09-12T02:23:16.850747+0000","last_became_peered":"2024-09-12T02:23:16.850747+0000","last_unstale":"2024-09-12T02:40:04.676752+0000","last_undegraded":"2024-09-12T02:40:04.676752+0000","last_fullsized":"2024-09-12T02:40:04.676752+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5122,"log_dups_size":0,"ondisk_log_size":5122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:01:31.445590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26303,"num_write_kb":306134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"28'5815","reported_seq":5846,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.831090+0000","last_change":"2024-09-12T02:23:04.789439+0000","last_active":"2024-09-12T02:39:57.831090+0000","last_peered":"2024-09-12T02:39:57.831090+0000","last_clean":"2024-09-12T02:39:57.831090+0000","last_became_active":"2024-09-12T02:23:04.787421+0000","last_became_peered":"2024-09-12T02:23:04.787421+0000","last_unstale":"2024-09-12T02:39:57.831090+0000","last_undegraded":"2024-09-12T02:39:57.831090+0000","last_fullsized":"2024-09-12T02:39:57.831090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5815,"log_dups_size":0,"ondisk_log_size":5815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:44.295056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29660,"num_write_kb":364722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"28'5421","reported_seq":5443,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.709758+0000","last_change":"2024-09-12T02:23:16.850923+0000","last_active":"2024-09-12T02:40:04.709758+0000","last_peered":"2024-09-12T02:40:04.709758+0000","last_clean":"2024-09-12T02:40:04.709758+0000","last_became_active":"2024-09-12T02:23:16.850609+0000","last_became_peered":"2024-09-12T02:23:16.850609+0000","last_unstale":"2024-09-12T02:40:04.709758+0000","last_undegraded":"2024-09-12T02:40:04.709758+0000","last_fullsized":"2024-09-12T02:40:04.709758+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5421,"log_dups_size":0,"ondisk_log_size":5421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:52.110438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28803,"num_write_kb":344817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"28'4311","reported_seq":4342,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.771185+0000","last_change":"2024-09-12T02:23:04.790532+0000","last_active":"2024-09-12T02:39:57.771185+0000","last_peered":"2024-09-12T02:39:57.771185+0000","last_clean":"2024-09-12T02:39:57.771185+0000","last_became_active":"2024-09-12T02:23:04.789229+0000","last_became_peered":"2024-09-12T02:23:04.789229+0000","last_unstale":"2024-09-12T02:39:57.771185+0000","last_undegraded":"2024-09-12T02:39:57.771185+0000","last_fullsized":"2024-09-12T02:39:57.771185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4311,"log_dups_size":0,"ondisk_log_size":4311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:59.901665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22556,"num_write_kb":270677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"28'6535","reported_seq":6557,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.676395+0000","last_change":"2024-09-12T02:23:16.856612+0000","last_active":"2024-09-12T02:40:04.676395+0000","last_peered":"2024-09-12T02:40:04.676395+0000","last_clean":"2024-09-12T02:40:04.676395+0000","last_became_active":"2024-09-12T02:23:16.856290+0000","last_became_peered":"2024-09-12T02:23:16.856290+0000","last_unstale":"2024-09-12T02:40:04.676395+0000","last_undegraded":"2024-09-12T02:40:04.676395+0000","last_fullsized":"2024-09-12T02:40:04.676395+0000","mapping_epoch":24,"log_start":"28'1000","ondisk_log_start":"28'1000","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5535,"log_dups_size":0,"ondisk_log_size":5535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:14.846281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35147,"num_write_kb":386723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"28'4664","reported_seq":4695,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.756776+0000","last_change":"2024-09-12T02:23:04.782490+0000","last_active":"2024-09-12T02:39:57.756776+0000","last_peered":"2024-09-12T02:39:57.756776+0000","last_clean":"2024-09-12T02:39:57.756776+0000","last_became_active":"2024-09-12T02:23:04.782183+0000","last_became_peered":"2024-09-12T02:23:04.782183+0000","last_unstale":"2024-09-12T02:39:57.756776+0000","last_undegraded":"2024-09-12T02:39:57.756776+0000","last_fullsized":"2024-09-12T02:39:57.756776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4664,"log_dups_size":0,"ondisk_log_size":4664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:28.699880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23511,"num_write_kb":303118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"28'4146","reported_seq":4168,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.701442+0000","last_change":"2024-09-12T02:23:16.858100+0000","last_active":"2024-09-12T02:40:04.701442+0000","last_peered":"2024-09-12T02:40:04.701442+0000","last_clean":"2024-09-12T02:40:04.701442+0000","last_became_active":"2024-09-12T02:23:16.857818+0000","last_became_peered":"2024-09-12T02:23:16.857818+0000","last_unstale":"2024-09-12T02:40:04.701442+0000","last_undegraded":"2024-09-12T02:40:04.701442+0000","last_fullsized":"2024-09-12T02:40:04.701442+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4146,"log_dups_size":0,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:45.991170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21288,"num_write_kb":257331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"28'4600","reported_seq":4631,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.732332+0000","last_change":"2024-09-12T02:23:04.787140+0000","last_active":"2024-09-12T02:39:57.732332+0000","last_peered":"2024-09-12T02:39:57.732332+0000","last_clean":"2024-09-12T02:39:57.732332+0000","last_became_active":"2024-09-12T02:23:04.786799+0000","last_became_peered":"2024-09-12T02:23:04.786799+0000","last_unstale":"2024-09-12T02:39:57.732332+0000","last_undegraded":"2024-09-12T02:39:57.732332+0000","last_fullsized":"2024-09-12T02:39:57.732332+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4600,"log_dups_size":0,"ondisk_log_size":4600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:31.639605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23822,"num_write_kb":304357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"28'5170","reported_seq":5192,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.691998+0000","last_change":"2024-09-12T02:23:16.846100+0000","last_active":"2024-09-12T02:40:04.691998+0000","last_peered":"2024-09-12T02:40:04.691998+0000","last_clean":"2024-09-12T02:40:04.691998+0000","last_became_active":"2024-09-12T02:23:16.845749+0000","last_became_peered":"2024-09-12T02:23:16.845749+0000","last_unstale":"2024-09-12T02:40:04.691998+0000","last_undegraded":"2024-09-12T02:40:04.691998+0000","last_fullsized":"2024-09-12T02:40:04.691998+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5170,"log_dups_size":0,"ondisk_log_size":5170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:42.783366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26244,"num_write_kb":301879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"28'3980","reported_seq":4011,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.731214+0000","last_change":"2024-09-12T02:23:04.782128+0000","last_active":"2024-09-12T02:39:57.731214+0000","last_peered":"2024-09-12T02:39:57.731214+0000","last_clean":"2024-09-12T02:39:57.731214+0000","last_became_active":"2024-09-12T02:23:04.781101+0000","last_became_peered":"2024-09-12T02:23:04.781101+0000","last_unstale":"2024-09-12T02:39:57.731214+0000","last_undegraded":"2024-09-12T02:39:57.731214+0000","last_fullsized":"2024-09-12T02:39:57.731214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":3980,"log_dups_size":0,"ondisk_log_size":3980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:49.421147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20651,"num_write_kb":267035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"28'5235","reported_seq":5258,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.711216+0000","last_change":"2024-09-12T02:23:16.836968+0000","last_active":"2024-09-12T02:40:04.711216+0000","last_peered":"2024-09-12T02:40:04.711216+0000","last_clean":"2024-09-12T02:40:04.711216+0000","last_became_active":"2024-09-12T02:23:16.836561+0000","last_became_peered":"2024-09-12T02:23:16.836561+0000","last_unstale":"2024-09-12T02:40:04.711216+0000","last_undegraded":"2024-09-12T02:40:04.711216+0000","last_fullsized":"2024-09-12T02:40:04.711216+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5235,"log_dups_size":0,"ondisk_log_size":5235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:08.765569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26710,"num_write_kb":316033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"28'3967","reported_seq":3998,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.791291+0000","last_change":"2024-09-12T02:23:04.787034+0000","last_active":"2024-09-12T02:39:57.791291+0000","last_peered":"2024-09-12T02:39:57.791291+0000","last_clean":"2024-09-12T02:39:57.791291+0000","last_became_active":"2024-09-12T02:23:04.786044+0000","last_became_peered":"2024-09-12T02:23:04.786044+0000","last_unstale":"2024-09-12T02:39:57.791291+0000","last_undegraded":"2024-09-12T02:39:57.791291+0000","last_fullsized":"2024-09-12T02:39:57.791291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":3967,"log_dups_size":0,"ondisk_log_size":3967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:07.183028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20368,"num_write_kb":253735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"28'4409","reported_seq":4431,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.657803+0000","last_change":"2024-09-12T02:23:16.846114+0000","last_active":"2024-09-12T02:40:04.657803+0000","last_peered":"2024-09-12T02:40:04.657803+0000","last_clean":"2024-09-12T02:40:04.657803+0000","last_became_active":"2024-09-12T02:23:16.845757+0000","last_became_peered":"2024-09-12T02:23:16.845757+0000","last_unstale":"2024-09-12T02:40:04.657803+0000","last_undegraded":"2024-09-12T02:40:04.657803+0000","last_fullsized":"2024-09-12T02:40:04.657803+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4409,"log_dups_size":0,"ondisk_log_size":4409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:17:52.019813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22900,"num_write_kb":275935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"28'4251","reported_seq":4282,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.798750+0000","last_change":"2024-09-12T02:23:04.785662+0000","last_active":"2024-09-12T02:39:57.798750+0000","last_peered":"2024-09-12T02:39:57.798750+0000","last_clean":"2024-09-12T02:39:57.798750+0000","last_became_active":"2024-09-12T02:23:04.785375+0000","last_became_peered":"2024-09-12T02:23:04.785375+0000","last_unstale":"2024-09-12T02:39:57.798750+0000","last_undegraded":"2024-09-12T02:39:57.798750+0000","last_fullsized":"2024-09-12T02:39:57.798750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4251,"log_dups_size":0,"ondisk_log_size":4251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:44.295056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21731,"num_write_kb":283663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"28'4658","reported_seq":4681,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.746879+0000","last_change":"2024-09-12T02:23:16.858175+0000","last_active":"2024-09-12T02:40:04.746879+0000","last_peered":"2024-09-12T02:40:04.746879+0000","last_clean":"2024-09-12T02:40:04.746879+0000","last_became_active":"2024-09-12T02:23:16.857873+0000","last_became_peered":"2024-09-12T02:23:16.857873+0000","last_unstale":"2024-09-12T02:40:04.746879+0000","last_undegraded":"2024-09-12T02:40:04.746879+0000","last_fullsized":"2024-09-12T02:40:04.746879+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4658,"log_dups_size":0,"ondisk_log_size":4658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:54.535867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24616,"num_write_kb":279029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"28'5811","reported_seq":5842,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.850760+0000","last_change":"2024-09-12T02:23:04.791929+0000","last_active":"2024-09-12T02:39:57.850760+0000","last_peered":"2024-09-12T02:39:57.850760+0000","last_clean":"2024-09-12T02:39:57.850760+0000","last_became_active":"2024-09-12T02:23:04.791622+0000","last_became_peered":"2024-09-12T02:23:04.791622+0000","last_unstale":"2024-09-12T02:39:57.850760+0000","last_undegraded":"2024-09-12T02:39:57.850760+0000","last_fullsized":"2024-09-12T02:39:57.850760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5811,"log_dups_size":0,"ondisk_log_size":5811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:35.012685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30224,"num_write_kb":350457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"28'5106","reported_seq":5129,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.667862+0000","last_change":"2024-09-12T02:23:16.849985+0000","last_active":"2024-09-12T02:40:04.667862+0000","last_peered":"2024-09-12T02:40:04.667862+0000","last_clean":"2024-09-12T02:40:04.667862+0000","last_became_active":"2024-09-12T02:23:16.849641+0000","last_became_peered":"2024-09-12T02:23:16.849641+0000","last_unstale":"2024-09-12T02:40:04.667862+0000","last_undegraded":"2024-09-12T02:40:04.667862+0000","last_fullsized":"2024-09-12T02:40:04.667862+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5106,"log_dups_size":0,"ondisk_log_size":5106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:28.373543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25610,"num_write_kb":311590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"28'5712","reported_seq":5748,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.829068+0000","last_change":"2024-09-12T02:23:56.084447+0000","last_active":"2024-09-12T02:39:57.829068+0000","last_peered":"2024-09-12T02:39:57.829068+0000","last_clean":"2024-09-12T02:39:57.829068+0000","last_became_active":"2024-09-12T02:23:56.084173+0000","last_became_peered":"2024-09-12T02:23:56.084173+0000","last_unstale":"2024-09-12T02:39:57.829068+0000","last_undegraded":"2024-09-12T02:39:57.829068+0000","last_fullsized":"2024-09-12T02:39:57.829068+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5712,"log_dups_size":0,"ondisk_log_size":5712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:38.004804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30266,"num_write_kb":367055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"28'6924","reported_seq":6948,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.724208+0000","last_change":"2024-09-12T02:23:16.840250+0000","last_active":"2024-09-12T02:40:04.724208+0000","last_peered":"2024-09-12T02:40:04.724208+0000","last_clean":"2024-09-12T02:40:04.724208+0000","last_became_active":"2024-09-12T02:23:16.839914+0000","last_became_peered":"2024-09-12T02:23:16.839914+0000","last_unstale":"2024-09-12T02:40:04.724208+0000","last_undegraded":"2024-09-12T02:40:04.724208+0000","last_fullsized":"2024-09-12T02:40:04.724208+0000","mapping_epoch":24,"log_start":"28'1700","ondisk_log_start":"28'1700","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5224,"log_dups_size":0,"ondisk_log_size":5224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:04.798197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36307,"num_write_kb":403764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"28'4960","reported_seq":4990,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.771890+0000","last_change":"2024-09-12T02:23:04.779648+0000","last_active":"2024-09-12T02:39:57.771890+0000","last_peered":"2024-09-12T02:39:57.771890+0000","last_clean":"2024-09-12T02:39:57.771890+0000","last_became_active":"2024-09-12T02:23:04.779384+0000","last_became_peered":"2024-09-12T02:23:04.779384+0000","last_unstale":"2024-09-12T02:39:57.771890+0000","last_undegraded":"2024-09-12T02:39:57.771890+0000","last_fullsized":"2024-09-12T02:39:57.771890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4960,"log_dups_size":0,"ondisk_log_size":4960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:41.491471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24704,"num_write_kb":320180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"28'4652","reported_seq":4676,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.706923+0000","last_change":"2024-09-12T02:23:16.850060+0000","last_active":"2024-09-12T02:40:04.706923+0000","last_peered":"2024-09-12T02:40:04.706923+0000","last_clean":"2024-09-12T02:40:04.706923+0000","last_became_active":"2024-09-12T02:23:16.849744+0000","last_became_peered":"2024-09-12T02:23:16.849744+0000","last_unstale":"2024-09-12T02:40:04.706923+0000","last_undegraded":"2024-09-12T02:40:04.706923+0000","last_fullsized":"2024-09-12T02:40:04.706923+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4652,"log_dups_size":0,"ondisk_log_size":4652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:34.130685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24125,"num_write_kb":272841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"28'4717","reported_seq":4733,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.732879+0000","last_change":"2024-09-12T02:23:55.991674+0000","last_active":"2024-09-12T02:39:57.732879+0000","last_peered":"2024-09-12T02:39:57.732879+0000","last_clean":"2024-09-12T02:39:57.732879+0000","last_became_active":"2024-09-12T02:23:55.991300+0000","last_became_peered":"2024-09-12T02:23:55.991300+0000","last_unstale":"2024-09-12T02:39:57.732879+0000","last_undegraded":"2024-09-12T02:39:57.732879+0000","last_fullsized":"2024-09-12T02:39:57.732879+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4717,"log_dups_size":0,"ondisk_log_size":4717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:23.613509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24759,"num_write_kb":295935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3c","version":"28'4790","reported_seq":4814,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.669505+0000","last_change":"2024-09-12T02:23:16.862034+0000","last_active":"2024-09-12T02:40:04.669505+0000","last_peered":"2024-09-12T02:40:04.669505+0000","last_clean":"2024-09-12T02:40:04.669505+0000","last_became_active":"2024-09-12T02:23:16.861441+0000","last_became_peered":"2024-09-12T02:23:16.861441+0000","last_unstale":"2024-09-12T02:40:04.669505+0000","last_undegraded":"2024-09-12T02:40:04.669505+0000","last_fullsized":"2024-09-12T02:40:04.669505+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4790,"log_dups_size":0,"ondisk_log_size":4790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:24.332614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25639,"num_write_kb":287197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"28'4345","reported_seq":4375,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.826467+0000","last_change":"2024-09-12T02:23:04.788890+0000","last_active":"2024-09-12T02:39:57.826467+0000","last_peered":"2024-09-12T02:39:57.826467+0000","last_clean":"2024-09-12T02:39:57.826467+0000","last_became_active":"2024-09-12T02:23:04.788617+0000","last_became_peered":"2024-09-12T02:23:04.788617+0000","last_unstale":"2024-09-12T02:39:57.826467+0000","last_undegraded":"2024-09-12T02:39:57.826467+0000","last_fullsized":"2024-09-12T02:39:57.826467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4345,"log_dups_size":0,"ondisk_log_size":4345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:24.194151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22438,"num_write_kb":266069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"28'5149","reported_seq":5173,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.705526+0000","last_change":"2024-09-12T02:23:16.855853+0000","last_active":"2024-09-12T02:40:04.705526+0000","last_peered":"2024-09-12T02:40:04.705526+0000","last_clean":"2024-09-12T02:40:04.705526+0000","last_became_active":"2024-09-12T02:23:16.855437+0000","last_became_peered":"2024-09-12T02:23:16.855437+0000","last_unstale":"2024-09-12T02:40:04.705526+0000","last_undegraded":"2024-09-12T02:40:04.705526+0000","last_fullsized":"2024-09-12T02:40:04.705526+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5149,"log_dups_size":0,"ondisk_log_size":5149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:27.557862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26098,"num_write_kb":313495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'5428","reported_seq":5458,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.753841+0000","last_change":"2024-09-12T02:23:04.777165+0000","last_active":"2024-09-12T02:39:57.753841+0000","last_peered":"2024-09-12T02:39:57.753841+0000","last_clean":"2024-09-12T02:39:57.753841+0000","last_became_active":"2024-09-12T02:23:04.776857+0000","last_became_peered":"2024-09-12T02:23:04.776857+0000","last_unstale":"2024-09-12T02:39:57.753841+0000","last_undegraded":"2024-09-12T02:39:57.753841+0000","last_fullsized":"2024-09-12T02:39:57.753841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5428,"log_dups_size":0,"ondisk_log_size":5428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:28.309591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27088,"num_write_kb":350175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"28'4355","reported_seq":4377,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.719330+0000","last_change":"2024-09-12T02:23:16.849235+0000","last_active":"2024-09-12T02:40:04.719330+0000","last_peered":"2024-09-12T02:40:04.719330+0000","last_clean":"2024-09-12T02:40:04.719330+0000","last_became_active":"2024-09-12T02:23:16.848936+0000","last_became_peered":"2024-09-12T02:23:16.848936+0000","last_unstale":"2024-09-12T02:40:04.719330+0000","last_undegraded":"2024-09-12T02:40:04.719330+0000","last_fullsized":"2024-09-12T02:40:04.719330+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4355,"log_dups_size":0,"ondisk_log_size":4355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:32.415375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22650,"num_write_kb":266857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"28'3929","reported_seq":3961,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.823217+0000","last_change":"2024-09-12T02:23:04.786772+0000","last_active":"2024-09-12T02:39:57.823217+0000","last_peered":"2024-09-12T02:39:57.823217+0000","last_clean":"2024-09-12T02:39:57.823217+0000","last_became_active":"2024-09-12T02:23:04.786509+0000","last_became_peered":"2024-09-12T02:23:04.786509+0000","last_unstale":"2024-09-12T02:39:57.823217+0000","last_undegraded":"2024-09-12T02:39:57.823217+0000","last_fullsized":"2024-09-12T02:39:57.823217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":3929,"log_dups_size":0,"ondisk_log_size":3929,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:01.755827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20681,"num_write_kb":267297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"28'6034","reported_seq":6056,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.676402+0000","last_change":"2024-09-12T02:23:16.834788+0000","last_active":"2024-09-12T02:40:04.676402+0000","last_peered":"2024-09-12T02:40:04.676402+0000","last_clean":"2024-09-12T02:40:04.676402+0000","last_became_active":"2024-09-12T02:23:16.834483+0000","last_became_peered":"2024-09-12T02:23:16.834483+0000","last_unstale":"2024-09-12T02:40:04.676402+0000","last_undegraded":"2024-09-12T02:40:04.676402+0000","last_fullsized":"2024-09-12T02:40:04.676402+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":6034,"log_dups_size":0,"ondisk_log_size":6034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:23.441282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30335,"num_write_kb":363259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"28'4664","reported_seq":4696,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.730630+0000","last_change":"2024-09-12T02:23:04.778772+0000","last_active":"2024-09-12T02:39:57.730630+0000","last_peered":"2024-09-12T02:39:57.730630+0000","last_clean":"2024-09-12T02:39:57.730630+0000","last_became_active":"2024-09-12T02:23:04.778445+0000","last_became_peered":"2024-09-12T02:23:04.778445+0000","last_unstale":"2024-09-12T02:39:57.730630+0000","last_undegraded":"2024-09-12T02:39:57.730630+0000","last_fullsized":"2024-09-12T02:39:57.730630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4664,"log_dups_size":0,"ondisk_log_size":4664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:58.292023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23827,"num_write_kb":304439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"28'5564","reported_seq":5586,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.750707+0000","last_change":"2024-09-12T02:23:16.844170+0000","last_active":"2024-09-12T02:40:04.750707+0000","last_peered":"2024-09-12T02:40:04.750707+0000","last_clean":"2024-09-12T02:40:04.750707+0000","last_became_active":"2024-09-12T02:23:16.843880+0000","last_became_peered":"2024-09-12T02:23:16.843880+0000","last_unstale":"2024-09-12T02:40:04.750707+0000","last_undegraded":"2024-09-12T02:40:04.750707+0000","last_fullsized":"2024-09-12T02:40:04.750707+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5564,"log_dups_size":0,"ondisk_log_size":5564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:59.283416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28051,"num_write_kb":333672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"28'5549","reported_seq":5581,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.720949+0000","last_change":"2024-09-12T02:23:04.785821+0000","last_active":"2024-09-12T02:39:57.720949+0000","last_peered":"2024-09-12T02:39:57.720949+0000","last_clean":"2024-09-12T02:39:57.720949+0000","last_became_active":"2024-09-12T02:23:04.785516+0000","last_became_peered":"2024-09-12T02:23:04.785516+0000","last_unstale":"2024-09-12T02:39:57.720949+0000","last_undegraded":"2024-09-12T02:39:57.720949+0000","last_fullsized":"2024-09-12T02:39:57.720949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5549,"log_dups_size":0,"ondisk_log_size":5549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:42.400040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28712,"num_write_kb":373148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"28'5101","reported_seq":5123,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.723690+0000","last_change":"2024-09-12T02:23:16.844145+0000","last_active":"2024-09-12T02:40:04.723690+0000","last_peered":"2024-09-12T02:40:04.723690+0000","last_clean":"2024-09-12T02:40:04.723690+0000","last_became_active":"2024-09-12T02:23:16.843815+0000","last_became_peered":"2024-09-12T02:23:16.843815+0000","last_unstale":"2024-09-12T02:40:04.723690+0000","last_undegraded":"2024-09-12T02:40:04.723690+0000","last_fullsized":"2024-09-12T02:40:04.723690+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5101,"log_dups_size":0,"ondisk_log_size":5101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:31.789317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26856,"num_write_kb":304403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"28'3999","reported_seq":4031,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.797803+0000","last_change":"2024-09-12T02:23:04.791204+0000","last_active":"2024-09-12T02:39:57.797803+0000","last_peered":"2024-09-12T02:39:57.797803+0000","last_clean":"2024-09-12T02:39:57.797803+0000","last_became_active":"2024-09-12T02:23:04.790906+0000","last_became_peered":"2024-09-12T02:23:04.790906+0000","last_unstale":"2024-09-12T02:39:57.797803+0000","last_undegraded":"2024-09-12T02:39:57.797803+0000","last_fullsized":"2024-09-12T02:39:57.797803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":3999,"log_dups_size":0,"ondisk_log_size":3999,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:16.336873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20671,"num_write_kb":258921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1731204,"num_write_kb":20050774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":327719,"ondisk_log_size":327719,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":18273247,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":57,"num_read_kb":123,"num_write":4416,"num_write_kb":19551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36610048,"data_stored":36546494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3634,"ondisk_log_size":3634,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1541207,"num_write_kb":19284974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":299497,"ondisk_log_size":299497,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":18199792,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":62,"num_read_kb":127,"num_write":4449,"num_write_kb":19478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36462592,"data_stored":36399584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3678,"ondisk_log_size":3678,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476947,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1212344,"kb_used_data":13160,"kb_used_omap":1,"kb_used_meta":1199166,"kb_avail":93159496,"statfs":{"total":96636764160,"available":95395323904,"internally_reserved":0,"allocated":13475840,"data_stored":13292277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":1227946442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476949,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":757460,"kb_used_data":9796,"kb_used_omap":1,"kb_used_meta":747646,"kb_avail":93614380,"statfs":{"total":96636764160,"available":95861125120,"internally_reserved":0,"allocated":10031104,"data_stored":9841247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":765589958},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476948,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1147152,"kb_used_data":4480,"kb_used_omap":1,"kb_used_meta":1142654,"kb_avail":93224688,"statfs":{"total":96636764160,"available":95462080512,"internally_reserved":0,"allocated":4587520,"data_stored":4401471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1170078149},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509650,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1232784,"kb_used_data":11264,"kb_used_omap":1,"kb_used_meta":1221502,"kb_avail":93139056,"statfs":{"total":96636764160,"available":95374393344,"internally_reserved":0,"allocated":11534336,"data_stored":11334750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1250818501},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509649,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":757512,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":757118,"kb_avail":93614328,"statfs":{"total":96636764160,"available":95861071872,"internally_reserved":0,"allocated":385024,"data_stored":206475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":775289285},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509652,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1005564,"kb_used_data":9068,"kb_used_omap":1,"kb_used_meta":996478,"kb_avail":93366276,"statfs":{"total":96636764160,"available":95607066624,"internally_reserved":0,"allocated":9285632,"data_stored":9097939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1020393925},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542355,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1235704,"kb_used_data":18152,"kb_used_omap":1,"kb_used_meta":1217534,"kb_avail":93136136,"statfs":{"total":96636764160,"available":95371403264,"internally_reserved":0,"allocated":18587648,"data_stored":18391468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":1246755271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542354,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1000768,"kb_used_data":8496,"kb_used_omap":1,"kb_used_meta":992254,"kb_avail":93371072,"statfs":{"total":96636764160,"available":95611977728,"internally_reserved":0,"allocated":8699904,"data_stored":8507787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1016068549},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4206592,"data_stored":4194942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":88080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8486912,"data_stored":8477360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5541888,"data_stored":5527456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5537792,"data_stored":5528002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12583494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9809920,"data_stored":9795783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5701632,"data_stored":5688969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4292608,"data_stored":4283056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:40:12.177 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:40:12.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.314+0000 7f2944986640 1 Processor -- start 2024-09-12T02:40:12.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.314+0000 7f2944986640 1 -- start start 2024-09-12T02:40:12.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.315+0000 7f2944986640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f29400c4680 0x7f2940156a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:12.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.315+0000 7f2944986640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2940156fc0 0x7f2940157410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:12.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.315+0000 7f2944986640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2940070590 con 0x7f29400acc30 2024-09-12T02:40:12.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.315+0000 7f2944986640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f29400c4ea0 con 0x7f29400c4680 2024-09-12T02:40:12.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.315+0000 7f2944986640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f29400a8220 con 0x7f2940156fc0 2024-09-12T02:40:12.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.315+0000 7f293dd9b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f29400c4680 0x7f2940156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:12.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.315+0000 7f293dd9b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f29400c4680 0x7f2940156a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40392/0 (socket says 172.21.15.60:40392) 2024-09-12T02:40:12.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.315+0000 7f293dd9b640 1 -- 172.21.15.60:0/1832420390 learned_addr learned my addr 172.21.15.60:0/1832420390 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:12.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.315+0000 7f293ed9d640 1 --2- 172.21.15.60:0/1832420390 >> v2:172.21.15.105:3300/0 conn(0x7f2940156fc0 0x7f2940157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:12.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.316+0000 7f293dd9b640 1 -- 172.21.15.60:0/1832420390 >> v2:172.21.15.105:3300/0 conn(0x7f2940156fc0 msgr2=0x7f2940157410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:12.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.316+0000 7f293dd9b640 1 --2- 172.21.15.60:0/1832420390 >> v2:172.21.15.105:3300/0 conn(0x7f2940156fc0 0x7f2940157410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:12.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.316+0000 7f293dd9b640 1 -- 172.21.15.60:0/1832420390 >> v1:172.21.15.105:6789/0 conn(0x7f29400acc30 legacy=0x7f29400c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:12.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.316+0000 7f293dd9b640 1 -- 172.21.15.60:0/1832420390 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29400a84f0 con 0x7f29400c4680 2024-09-12T02:40:12.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.316+0000 7f293dd9b640 1 --2- 172.21.15.60:0/1832420390 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29400c4680 0x7f2940156a80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f29400c6340 tx=0x7f293402c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abba9dc822b1b127 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:12.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.316+0000 7f293d59a640 1 -- 172.21.15.60:0/1832420390 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2934032710 con 0x7f29400c4680 2024-09-12T02:40:12.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.317+0000 7f293d59a640 1 -- 172.21.15.60:0/1832420390 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29340328b0 con 0x7f29400c4680 2024-09-12T02:40:12.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.317+0000 7f293d59a640 1 -- 172.21.15.60:0/1832420390 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2934032ca0 con 0x7f29400c4680 2024-09-12T02:40:12.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.317+0000 7f2944986640 1 -- 172.21.15.60:0/1832420390 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29400c4680 msgr2=0x7f2940156a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:12.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.317+0000 7f2944986640 1 --2- 172.21.15.60:0/1832420390 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29400c4680 0x7f2940156a80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f29400c6340 tx=0x7f293402c810 comp rx=0 tx=0).stop 2024-09-12T02:40:12.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.317+0000 7f2944986640 1 -- 172.21.15.60:0/1832420390 shutdown_connections 2024-09-12T02:40:12.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.317+0000 7f2944986640 1 --2- 172.21.15.60:0/1832420390 >> v2:172.21.15.105:3300/0 conn(0x7f2940156fc0 0x7f2940157410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:12.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.317+0000 7f2944986640 1 --2- 172.21.15.60:0/1832420390 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29400c4680 0x7f2940156a80 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:12.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.317+0000 7f2944986640 1 -- 172.21.15.60:0/1832420390 >> 172.21.15.60:0/1832420390 conn(0x7f29400c5660 msgr2=0x7f29400c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:12.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.317+0000 7f2944986640 1 -- 172.21.15.60:0/1832420390 shutdown_connections 2024-09-12T02:40:12.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.317+0000 7f2944986640 1 -- 172.21.15.60:0/1832420390 wait complete. 2024-09-12T02:40:12.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.319+0000 7f2944986640 1 Processor -- start 2024-09-12T02:40:12.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.319+0000 7f2944986640 1 -- start start 2024-09-12T02:40:12.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.319+0000 7f2944986640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29400acc30 0x7f294006e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:12.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.319+0000 7f2944986640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29400c4680 0x7f29401ec4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:12.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.319+0000 7f2944986640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2940156fc0 0x7f294006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:12.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.319+0000 7f2944986640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f29400c5330 con 0x7f2940156fc0 2024-09-12T02:40:12.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.319+0000 7f2944986640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f29400702b0 con 0x7f29400acc30 2024-09-12T02:40:12.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.319+0000 7f2944986640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f29400c63f0 con 0x7f29400c4680 2024-09-12T02:40:12.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.319+0000 7f293ed9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2940156fc0 0x7f294006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:12.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.319+0000 7f293ed9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2940156fc0 0x7f294006cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40398/0 (socket says 172.21.15.60:40398) 2024-09-12T02:40:12.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.319+0000 7f293ed9d640 1 -- 172.21.15.60:0/1966842642 learned_addr learned my addr 172.21.15.60:0/1966842642 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:12.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.320+0000 7f293e59c640 1 --2- 172.21.15.60:0/1966842642 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29400acc30 0x7f294006e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:12.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.320+0000 7f293dd9b640 1 --2- 172.21.15.60:0/1966842642 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29400c4680 0x7f29401ec4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:12.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.320+0000 7f293ed9d640 1 -- 172.21.15.60:0/1966842642 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29400c4680 msgr2=0x7f29401ec4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:12.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.320+0000 7f293ed9d640 1 --2- 172.21.15.60:0/1966842642 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29400c4680 0x7f29401ec4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:12.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.320+0000 7f293ed9d640 1 -- 172.21.15.60:0/1966842642 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29400acc30 msgr2=0x7f294006e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:12.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.320+0000 7f293ed9d640 1 --2- 172.21.15.60:0/1966842642 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29400acc30 0x7f294006e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:12.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.320+0000 7f293ed9d640 1 -- 172.21.15.60:0/1966842642 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f294009d970 con 0x7f2940156fc0 2024-09-12T02:40:12.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.320+0000 7f293ed9d640 1 --2- 172.21.15.60:0/1966842642 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2940156fc0 0x7f294006cff0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f293800efc0 tx=0x7f293800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:12.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.320+0000 7f292effd640 1 -- 172.21.15.60:0/1966842642 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2938018020 con 0x7f2940156fc0 2024-09-12T02:40:12.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.320+0000 7f292effd640 1 -- 172.21.15.60:0/1966842642 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2938014480 con 0x7f2940156fc0 2024-09-12T02:40:12.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.320+0000 7f2944986640 1 -- 172.21.15.60:0/1966842642 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29401eca00 con 0x7f2940156fc0 2024-09-12T02:40:12.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.320+0000 7f292effd640 1 -- 172.21.15.60:0/1966842642 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2938014870 con 0x7f2940156fc0 2024-09-12T02:40:12.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.320+0000 7f2944986640 1 -- 172.21.15.60:0/1966842642 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29400c2450 con 0x7f2940156fc0 2024-09-12T02:40:12.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.321+0000 7f2944986640 1 -- 172.21.15.60:0/1966842642 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29400abc10 con 0x7f2940156fc0 2024-09-12T02:40:12.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.322+0000 7f292effd640 1 -- 172.21.15.60:0/1966842642 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2938005d10 con 0x7f2940156fc0 2024-09-12T02:40:12.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.322+0000 7f292effd640 1 --2- 172.21.15.60:0/1966842642 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f292006be30 0x7f292006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:12.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.322+0000 7f292effd640 1 -- 172.21.15.60:0/1966842642 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f293808bc30 con 0x7f2940156fc0 2024-09-12T02:40:12.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.322+0000 7f293e59c640 1 --2- 172.21.15.60:0/1966842642 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f292006be30 0x7f292006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:12.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.323+0000 7f293e59c640 1 --2- 172.21.15.60:0/1966842642 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f292006be30 0x7f292006e2f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f2930007fd0 tx=0x7f2930009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:12.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.327+0000 7f292effd640 1 -- 172.21.15.60:0/1966842642 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2938022070 con 0x7f2940156fc0 2024-09-12T02:40:12.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.503+0000 7f2944986640 1 -- 172.21.15.60:0/1966842642 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f29400745d0 con 0x7f2940156fc0 2024-09-12T02:40:12.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.505+0000 7f292effd640 1 -- 172.21.15.60:0/1966842642 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+20689 (secure 0 0 0) 0x7f2938010040 con 0x7f2940156fc0 2024-09-12T02:40:12.506 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:40:12.506 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":28,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","created":"2024-09-12T02:22:39.869862+0000","modified":"2024-09-12T02:23:55.914182+0000","last_up_change":"2024-09-12T02:22:53.459371+0000","last_in_change":"2024-09-12T02:22:42.817076+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:22:52.130579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-09-12T02:23:01.854763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-09-12T02:23:03.104847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-09-12T02:23:14.175168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-09-12T02:23:15.166293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0f0c7386-002f-47e2-a7a3-6c8a70264cc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6819","nonce":1789465659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6821","nonce":1789465659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6825","nonce":1789465659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6823","nonce":1789465659}]},"public_addr":"172.21.15.60:6819/1789465659","cluster_addr":"172.21.15.60:6821/1789465659","heartbeat_back_addr":"172.21.15.60:6825/1789465659","heartbeat_front_addr":"172.21.15.60:6823/1789465659","state":["exists","up"]},{"osd":1,"uuid":"64be7b84-36fc-43c0-9e70-a617e5b68941","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6811","nonce":1109822408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6813","nonce":1109822408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6817","nonce":1109822408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6815","nonce":1109822408}]},"public_addr":"172.21.15.60:6811/1109822408","cluster_addr":"172.21.15.60:6813/1109822408","heartbeat_back_addr":"172.21.15.60:6817/1109822408","heartbeat_front_addr":"172.21.15.60:6815/1109822408","state":["exists","up"]},{"osd":2,"uuid":"df00caa1-d45e-4b87-ac1e-8bc098d509d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6827","nonce":278470077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6829","nonce":278470077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6833","nonce":278470077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6831","nonce":278470077}]},"public_addr":"172.21.15.60:6827/278470077","cluster_addr":"172.21.15.60:6829/278470077","heartbeat_back_addr":"172.21.15.60:6833/278470077","heartbeat_front_addr":"172.21.15.60:6831/278470077","state":["exists","up"]},{"osd":3,"uuid":"f6453471-893a-490b-b0c7-f196a0f574e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6803","nonce":3606424156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6805","nonce":3606424156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6809","nonce":3606424156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6807","nonce":3606424156}]},"public_addr":"172.21.15.60:6803/3606424156","cluster_addr":"172.21.15.60:6805/3606424156","heartbeat_back_addr":"172.21.15.60:6809/3606424156","heartbeat_front_addr":"172.21.15.60:6807/3606424156","state":["exists","up"]},{"osd":4,"uuid":"96e908b6-ce3e-466c-b02d-08fc71a1dba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6809","nonce":1581641129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6811","nonce":1581641129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6815","nonce":1581641129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6813","nonce":1581641129}]},"public_addr":"172.21.15.105:6809/1581641129","cluster_addr":"172.21.15.105:6811/1581641129","heartbeat_back_addr":"172.21.15.105:6815/1581641129","heartbeat_front_addr":"172.21.15.105:6813/1581641129","state":["exists","up"]},{"osd":5,"uuid":"7ebc26f0-a462-4364-9303-7351f7cba21f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6825","nonce":1392337793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6827","nonce":1392337793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6831","nonce":1392337793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6829","nonce":1392337793}]},"public_addr":"172.21.15.105:6825/1392337793","cluster_addr":"172.21.15.105:6827/1392337793","heartbeat_back_addr":"172.21.15.105:6831/1392337793","heartbeat_front_addr":"172.21.15.105:6829/1392337793","state":["exists","up"]},{"osd":6,"uuid":"49487ea1-9c6d-4090-bbcc-f28b33040eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6801","nonce":50951309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6803","nonce":50951309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6807","nonce":50951309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6805","nonce":50951309}]},"public_addr":"172.21.15.105:6801/50951309","cluster_addr":"172.21.15.105:6803/50951309","heartbeat_back_addr":"172.21.15.105:6807/50951309","heartbeat_front_addr":"172.21.15.105:6805/50951309","state":["exists","up"]},{"osd":7,"uuid":"1e3a0aa9-7e29-4785-8506-6b5d3be2be35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6817","nonce":3745331251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6819","nonce":3745331251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6823","nonce":3745331251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6821","nonce":3745331251}]},"public_addr":"172.21.15.105:6817/3745331251","cluster_addr":"172.21.15.105:6819/3745331251","heartbeat_back_addr":"172.21.15.105:6823/3745331251","heartbeat_front_addr":"172.21.15.105:6821/3745331251","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:50.112629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.307689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.542851+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.334773+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:50.096967+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:50.259633+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.888988+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.917421+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.27","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:40:12.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.507+0000 7f2944986640 1 -- 172.21.15.60:0/1966842642 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f292006be30 msgr2=0x7f292006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:12.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.507+0000 7f2944986640 1 --2- 172.21.15.60:0/1966842642 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f292006be30 0x7f292006e2f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f2930007fd0 tx=0x7f2930009040 comp rx=0 tx=0).stop 2024-09-12T02:40:12.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.507+0000 7f2944986640 1 -- 172.21.15.60:0/1966842642 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2940156fc0 msgr2=0x7f294006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:12.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.507+0000 7f2944986640 1 --2- 172.21.15.60:0/1966842642 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2940156fc0 0x7f294006cff0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f293800efc0 tx=0x7f293800c490 comp rx=0 tx=0).stop 2024-09-12T02:40:12.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.507+0000 7f2944986640 1 -- 172.21.15.60:0/1966842642 shutdown_connections 2024-09-12T02:40:12.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.507+0000 7f2944986640 1 --2- 172.21.15.60:0/1966842642 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f292006be30 0x7f292006e2f0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:12.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.507+0000 7f2944986640 1 --2- 172.21.15.60:0/1966842642 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2940156fc0 0x7f294006cff0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:12.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.507+0000 7f2944986640 1 --2- 172.21.15.60:0/1966842642 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29400c4680 0x7f29401ec4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:12.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.507+0000 7f2944986640 1 --2- 172.21.15.60:0/1966842642 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29400acc30 0x7f294006e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:12.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.507+0000 7f2944986640 1 -- 172.21.15.60:0/1966842642 >> 172.21.15.60:0/1966842642 conn(0x7f29400c5660 msgr2=0x7f29400c78c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:12.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.507+0000 7f2944986640 1 -- 172.21.15.60:0/1966842642 shutdown_connections 2024-09-12T02:40:12.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:12.507+0000 7f2944986640 1 -- 172.21.15.60:0/1966842642 wait complete. 2024-09-12T02:40:13.520 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T02:40:13.520 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:40:13.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.629+0000 7f57e7e9b640 1 Processor -- start 2024-09-12T02:40:13.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.629+0000 7f57e7e9b640 1 -- start start 2024-09-12T02:40:13.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.630+0000 7f57e7e9b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f57e0157970 0x7f57e0157de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:13.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.630+0000 7f57e7e9b640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f57e015cc90 0x7f57e015f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:13.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.630+0000 7f57e7e9b640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57e0158320 con 0x7f57e006da80 2024-09-12T02:40:13.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.630+0000 7f57e7e9b640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f57e00aec20 con 0x7f57e0157970 2024-09-12T02:40:13.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.630+0000 7f57e7e9b640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f57e00bf710 con 0x7f57e015cc90 2024-09-12T02:40:13.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.630+0000 7f57e5436640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f57e0157970 0x7f57e0157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:13.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.630+0000 7f57e5436640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f57e0157970 0x7f57e0157de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40402/0 (socket says 172.21.15.60:40402) 2024-09-12T02:40:13.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.630+0000 7f57e5436640 1 -- 172.21.15.60:0/2282853636 learned_addr learned my addr 172.21.15.60:0/2282853636 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:13.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.630+0000 7f57e6438640 1 --2- 172.21.15.60:0/2282853636 >> v2:172.21.15.105:3300/0 conn(0x7f57e015cc90 0x7f57e015f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:13.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.630+0000 7f57e5436640 1 -- 172.21.15.60:0/2282853636 >> v2:172.21.15.105:3300/0 conn(0x7f57e015cc90 msgr2=0x7f57e015f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:13.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.630+0000 7f57e5436640 1 --2- 172.21.15.60:0/2282853636 >> v2:172.21.15.105:3300/0 conn(0x7f57e015cc90 0x7f57e015f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:13.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.630+0000 7f57e5436640 1 -- 172.21.15.60:0/2282853636 >> v1:172.21.15.105:6789/0 conn(0x7f57e006da80 legacy=0x7f57e0151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:13.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.630+0000 7f57e5436640 1 -- 172.21.15.60:0/2282853636 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57e00c53e0 con 0x7f57e0157970 2024-09-12T02:40:13.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.630+0000 7f57e6438640 1 --2- 172.21.15.60:0/2282853636 >> v2:172.21.15.105:3300/0 conn(0x7f57e015cc90 0x7f57e015f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:40:13.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.631+0000 7f57e5436640 1 --2- 172.21.15.60:0/2282853636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57e0157970 0x7f57e0157de0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f57e0074740 tx=0x7f57d402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cfbcd1c5abf912e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:13.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.631+0000 7f57e4c35640 1 -- 172.21.15.60:0/2282853636 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d4037070 con 0x7f57e0157970 2024-09-12T02:40:13.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.631+0000 7f57e4c35640 1 -- 172.21.15.60:0/2282853636 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57d402ae20 con 0x7f57e0157970 2024-09-12T02:40:13.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.631+0000 7f57e4c35640 1 -- 172.21.15.60:0/2282853636 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d4032660 con 0x7f57e0157970 2024-09-12T02:40:13.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.632+0000 7f57e7e9b640 1 -- 172.21.15.60:0/2282853636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57e0157970 msgr2=0x7f57e0157de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:13.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.632+0000 7f57e7e9b640 1 --2- 172.21.15.60:0/2282853636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57e0157970 0x7f57e0157de0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f57e0074740 tx=0x7f57d402a110 comp rx=0 tx=0).stop 2024-09-12T02:40:13.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.632+0000 7f57e7e9b640 1 -- 172.21.15.60:0/2282853636 shutdown_connections 2024-09-12T02:40:13.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.632+0000 7f57e7e9b640 1 --2- 172.21.15.60:0/2282853636 >> v2:172.21.15.105:3300/0 conn(0x7f57e015cc90 0x7f57e015f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:13.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.632+0000 7f57e7e9b640 1 --2- 172.21.15.60:0/2282853636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57e0157970 0x7f57e0157de0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:13.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.632+0000 7f57e7e9b640 1 -- 172.21.15.60:0/2282853636 >> 172.21.15.60:0/2282853636 conn(0x7f57e006ccf0 msgr2=0x7f57e006d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:13.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.632+0000 7f57e7e9b640 1 -- 172.21.15.60:0/2282853636 shutdown_connections 2024-09-12T02:40:13.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.632+0000 7f57e7e9b640 1 -- 172.21.15.60:0/2282853636 wait complete. 2024-09-12T02:40:13.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.634+0000 7f57e7e9b640 1 Processor -- start 2024-09-12T02:40:13.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.634+0000 7f57e7e9b640 1 -- start start 2024-09-12T02:40:13.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.635+0000 7f57e7e9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f57e006da80 0x7f57e00c19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:13.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.635+0000 7f57e7e9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57e0157970 0x7f57e014cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:13.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.635+0000 7f57e7e9b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f57e015cc90 0x7f57e014d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:13.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.635+0000 7f57e7e9b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f57e00c5100 con 0x7f57e0157970 2024-09-12T02:40:13.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.635+0000 7f57e7e9b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f57e00c4e20 con 0x7f57e006da80 2024-09-12T02:40:13.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.635+0000 7f57e7e9b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f57e00bfba0 con 0x7f57e015cc90 2024-09-12T02:40:13.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.635+0000 7f57e5436640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57e0157970 0x7f57e014cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:13.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.635+0000 7f57e5436640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57e0157970 0x7f57e014cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40410/0 (socket says 172.21.15.60:40410) 2024-09-12T02:40:13.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.635+0000 7f57e5436640 1 -- 172.21.15.60:0/1760514125 learned_addr learned my addr 172.21.15.60:0/1760514125 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:13.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.636+0000 7f57e5c37640 1 --2- 172.21.15.60:0/1760514125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f57e006da80 0x7f57e00c19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:13.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.636+0000 7f57e6438640 1 --2- 172.21.15.60:0/1760514125 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f57e015cc90 0x7f57e014d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:13.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.636+0000 7f57e5436640 1 -- 172.21.15.60:0/1760514125 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f57e015cc90 msgr2=0x7f57e014d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:13.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.636+0000 7f57e5436640 1 --2- 172.21.15.60:0/1760514125 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f57e015cc90 0x7f57e014d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:13.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.636+0000 7f57e5436640 1 -- 172.21.15.60:0/1760514125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f57e006da80 msgr2=0x7f57e00c19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:13.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.636+0000 7f57e5436640 1 --2- 172.21.15.60:0/1760514125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f57e006da80 0x7f57e00c19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:13.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.636+0000 7f57e5436640 1 -- 172.21.15.60:0/1760514125 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57e014d7c0 con 0x7f57e0157970 2024-09-12T02:40:13.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.636+0000 7f57e5c37640 1 --2- 172.21.15.60:0/1760514125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f57e006da80 0x7f57e00c19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:40:13.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.636+0000 7f57e5436640 1 --2- 172.21.15.60:0/1760514125 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57e0157970 0x7f57e014cd40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f57d402a150 tx=0x7f57d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:13.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.636+0000 7f57de7fc640 1 -- 172.21.15.60:0/1760514125 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d4041070 con 0x7f57e0157970 2024-09-12T02:40:13.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.636+0000 7f57de7fc640 1 -- 172.21.15.60:0/1760514125 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57d403c670 con 0x7f57e0157970 2024-09-12T02:40:13.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.636+0000 7f57e7e9b640 1 -- 172.21.15.60:0/1760514125 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57e0157400 con 0x7f57e0157970 2024-09-12T02:40:13.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.636+0000 7f57de7fc640 1 -- 172.21.15.60:0/1760514125 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d4037040 con 0x7f57e0157970 2024-09-12T02:40:13.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.636+0000 7f57e7e9b640 1 -- 172.21.15.60:0/1760514125 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57e01edda0 con 0x7f57e0157970 2024-09-12T02:40:13.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.637+0000 7f57e7e9b640 1 -- 172.21.15.60:0/1760514125 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f57e0070480 con 0x7f57e0157970 2024-09-12T02:40:13.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.638+0000 7f57de7fc640 1 -- 172.21.15.60:0/1760514125 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f57d4044070 con 0x7f57e0157970 2024-09-12T02:40:13.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.638+0000 7f57de7fc640 1 --2- 172.21.15.60:0/1760514125 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f57cc06be30 0x7f57cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:13.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.639+0000 7f57e5c37640 1 --2- 172.21.15.60:0/1760514125 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f57cc06be30 0x7f57cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:13.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.639+0000 7f57de7fc640 1 -- 172.21.15.60:0/1760514125 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f57d40ab800 con 0x7f57e0157970 2024-09-12T02:40:13.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.639+0000 7f57de7fc640 1 --2- 172.21.15.60:0/1760514125 >> [v2:172.21.15.60:6818/1789465659,v1:172.21.15.60:6819/1789465659] conn(0x7f57cc0767d0 0x7f57cc078c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:13.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.639+0000 7f57de7fc640 1 -- 172.21.15.60:0/1760514125 --> [v2:172.21.15.60:6818/1789465659,v1:172.21.15.60:6819/1789465659] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f57d402be50 con 0x7f57cc0767d0 2024-09-12T02:40:13.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.639+0000 7f57de7fc640 1 -- 172.21.15.60:0/1760514125 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f57d40b02c0 con 0x7f57e0157970 2024-09-12T02:40:13.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.639+0000 7f57e6438640 1 --2- 172.21.15.60:0/1760514125 >> [v2:172.21.15.60:6818/1789465659,v1:172.21.15.60:6819/1789465659] conn(0x7f57cc0767d0 0x7f57cc078c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:13.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.639+0000 7f57e5c37640 1 --2- 172.21.15.60:0/1760514125 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f57cc06be30 0x7f57cc06e2f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f57d800a810 tx=0x7f57d8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:13.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.639+0000 7f57e6438640 1 --2- 172.21.15.60:0/1760514125 >> [v2:172.21.15.60:6818/1789465659,v1:172.21.15.60:6819/1789465659] conn(0x7f57cc0767d0 0x7f57cc078c50 crc :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:13.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.640+0000 7f57de7fc640 1 -- 172.21.15.60:0/1760514125 <== osd.0 v2:172.21.15.60:6818/1789465659 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f57d402be50 con 0x7f57cc0767d0 2024-09-12T02:40:13.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.653+0000 7f57e7e9b640 1 -- 172.21.15.60:0/1760514125 --> [v2:172.21.15.60:6818/1789465659,v1:172.21.15.60:6819/1789465659] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f57e0075d30 con 0x7f57cc0767d0 2024-09-12T02:40:13.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.653+0000 7f57de7fc640 1 -- 172.21.15.60:0/1760514125 <== osd.0 v2:172.21.15.60:6818/1789465659 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f57e0075d30 con 0x7f57cc0767d0 2024-09-12T02:40:13.654 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:40:13.654 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T02:40:13.654 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:40:13.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.653+0000 7f57e7e9b640 1 -- 172.21.15.60:0/1760514125 >> [v2:172.21.15.60:6818/1789465659,v1:172.21.15.60:6819/1789465659] conn(0x7f57cc0767d0 msgr2=0x7f57cc078c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:13.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.653+0000 7f57e7e9b640 1 --2- 172.21.15.60:0/1760514125 >> [v2:172.21.15.60:6818/1789465659,v1:172.21.15.60:6819/1789465659] conn(0x7f57cc0767d0 0x7f57cc078c50 crc :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:13.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.653+0000 7f57e7e9b640 1 -- 172.21.15.60:0/1760514125 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f57cc06be30 msgr2=0x7f57cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:13.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.653+0000 7f57e7e9b640 1 --2- 172.21.15.60:0/1760514125 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f57cc06be30 0x7f57cc06e2f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f57d800a810 tx=0x7f57d8008040 comp rx=0 tx=0).stop 2024-09-12T02:40:13.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.653+0000 7f57e7e9b640 1 -- 172.21.15.60:0/1760514125 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57e0157970 msgr2=0x7f57e014cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:13.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.653+0000 7f57e7e9b640 1 --2- 172.21.15.60:0/1760514125 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57e0157970 0x7f57e014cd40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f57d402a150 tx=0x7f57d40046c0 comp rx=0 tx=0).stop 2024-09-12T02:40:13.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.653+0000 7f57e6438640 1 -- 172.21.15.60:0/1760514125 reap_dead start 2024-09-12T02:40:13.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.653+0000 7f57e7e9b640 1 -- 172.21.15.60:0/1760514125 shutdown_connections 2024-09-12T02:40:13.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.653+0000 7f57e7e9b640 1 -- 172.21.15.60:0/1760514125 >> 172.21.15.60:0/1760514125 conn(0x7f57e006ccf0 msgr2=0x7f57e006d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:13.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.654+0000 7f57e7e9b640 1 -- 172.21.15.60:0/1760514125 shutdown_connections 2024-09-12T02:40:13.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.654+0000 7f57e7e9b640 1 -- 172.21.15.60:0/1760514125 wait complete. 2024-09-12T02:40:13.665 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T02:40:13.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.767+0000 7ff1206e6640 1 Processor -- start 2024-09-12T02:40:13.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.767+0000 7ff1206e6640 1 -- start start 2024-09-12T02:40:13.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.768+0000 7ff1206e6640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff1180c5030 0x7ff11806e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:13.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.768+0000 7ff1206e6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff11806e580 0x7ff118153730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:13.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.768+0000 7ff1206e6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff1180c2d30 0x7ff118159850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:13.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.768+0000 7ff1206e6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7ff118067ae0 con 0x7ff1180c2d30 2024-09-12T02:40:13.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.768+0000 7ff1206e6640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff118068010 con 0x7ff1180c5030 2024-09-12T02:40:13.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.768+0000 7ff1206e6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff118074890 con 0x7ff11806e580 2024-09-12T02:40:13.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.768+0000 7ff11ec83640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff1180c2d30 0x7ff118159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:13.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.768+0000 7ff11ec83640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff1180c2d30 0x7ff118159850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40422/0 (socket says 172.21.15.60:40422) 2024-09-12T02:40:13.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.768+0000 7ff11ec83640 1 -- 172.21.15.60:0/2633663225 learned_addr learned my addr 172.21.15.60:0/2633663225 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:13.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.769+0000 7ff11dc81640 1 --2- 172.21.15.60:0/2633663225 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff11806e580 0x7ff118153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:13.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.769+0000 7ff11e482640 1 --2- 172.21.15.60:0/2633663225 >> v2:172.21.15.105:3300/0 conn(0x7ff1180c5030 0x7ff11806e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:13.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.769+0000 7ff11ec83640 1 -- 172.21.15.60:0/2633663225 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff11806e580 msgr2=0x7ff118153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:13.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.769+0000 7ff11ec83640 1 --2- 172.21.15.60:0/2633663225 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff11806e580 0x7ff118153730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:13.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.769+0000 7ff11ec83640 1 -- 172.21.15.60:0/2633663225 >> v2:172.21.15.105:3300/0 conn(0x7ff1180c5030 msgr2=0x7ff11806e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:13.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.769+0000 7ff11ec83640 1 --2- 172.21.15.60:0/2633663225 >> v2:172.21.15.105:3300/0 conn(0x7ff1180c5030 0x7ff11806e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:13.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.769+0000 7ff11ec83640 1 -- 172.21.15.60:0/2633663225 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff118067d30 con 0x7ff1180c2d30 2024-09-12T02:40:13.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.769+0000 7ff11dc81640 1 --2- 172.21.15.60:0/2633663225 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff11806e580 0x7ff118153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:40:13.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.769+0000 7ff11e482640 1 --2- 172.21.15.60:0/2633663225 >> v2:172.21.15.105:3300/0 conn(0x7ff1180c5030 0x7ff11806e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:40:13.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.770+0000 7ff11ec83640 1 --2- 172.21.15.60:0/2633663225 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1180c2d30 0x7ff118159850 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff118067a70 tx=0x7ff11002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd9325a198cd967a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:13.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.770+0000 7ff11d480640 1 -- 172.21.15.60:0/2633663225 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff110036070 con 0x7ff1180c2d30 2024-09-12T02:40:13.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.770+0000 7ff11d480640 1 -- 172.21.15.60:0/2633663225 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff110031600 con 0x7ff1180c2d30 2024-09-12T02:40:13.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.770+0000 7ff11d480640 1 -- 172.21.15.60:0/2633663225 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1100319d0 con 0x7ff1180c2d30 2024-09-12T02:40:13.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.771+0000 7ff1206e6640 1 -- 172.21.15.60:0/2633663225 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1180c2d30 msgr2=0x7ff118159850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:13.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.771+0000 7ff1206e6640 1 --2- 172.21.15.60:0/2633663225 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1180c2d30 0x7ff118159850 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff118067a70 tx=0x7ff11002a610 comp rx=0 tx=0).stop 2024-09-12T02:40:13.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.771+0000 7ff1206e6640 1 -- 172.21.15.60:0/2633663225 shutdown_connections 2024-09-12T02:40:13.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.771+0000 7ff1206e6640 1 --2- 172.21.15.60:0/2633663225 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1180c2d30 0x7ff118159850 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:13.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.771+0000 7ff1206e6640 1 --2- 172.21.15.60:0/2633663225 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff11806e580 0x7ff118153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:13.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.771+0000 7ff1206e6640 1 --2- 172.21.15.60:0/2633663225 >> v2:172.21.15.105:3300/0 conn(0x7ff1180c5030 0x7ff11806e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:13.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.771+0000 7ff1206e6640 1 -- 172.21.15.60:0/2633663225 >> 172.21.15.60:0/2633663225 conn(0x7ff11806bbe0 msgr2=0x7ff11806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:13.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.771+0000 7ff1206e6640 1 -- 172.21.15.60:0/2633663225 shutdown_connections 2024-09-12T02:40:13.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.771+0000 7ff1206e6640 1 -- 172.21.15.60:0/2633663225 wait complete. 2024-09-12T02:40:13.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.772+0000 7ff1206e6640 1 Processor -- start 2024-09-12T02:40:13.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.772+0000 7ff1206e6640 1 -- start start 2024-09-12T02:40:13.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.773+0000 7ff1206e6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff11806e580 0x7ff1180c71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:13.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.773+0000 7ff1206e6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1180c2d30 0x7ff11814ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:13.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.773+0000 7ff1206e6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1180c5030 0x7ff11814b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:13.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.773+0000 7ff1206e6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff118156a20 con 0x7ff1180c5030 2024-09-12T02:40:13.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.773+0000 7ff1206e6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff118156740 con 0x7ff1180c2d30 2024-09-12T02:40:13.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.773+0000 7ff1206e6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff1180c5410 con 0x7ff11806e580 2024-09-12T02:40:13.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.773+0000 7ff11ec83640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1180c5030 0x7ff11814b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:13.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.773+0000 7ff11ec83640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1180c5030 0x7ff11814b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40428/0 (socket says 172.21.15.60:40428) 2024-09-12T02:40:13.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.773+0000 7ff11ec83640 1 -- 172.21.15.60:0/426346213 learned_addr learned my addr 172.21.15.60:0/426346213 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:13.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.773+0000 7ff11dc81640 1 --2- 172.21.15.60:0/426346213 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1180c2d30 0x7ff11814ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:13.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.773+0000 7ff11e482640 1 --2- 172.21.15.60:0/426346213 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff11806e580 0x7ff1180c71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:13.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.773+0000 7ff11ec83640 1 -- 172.21.15.60:0/426346213 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff11806e580 msgr2=0x7ff1180c71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:13.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.773+0000 7ff11ec83640 1 --2- 172.21.15.60:0/426346213 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff11806e580 0x7ff1180c71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:13.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.773+0000 7ff11ec83640 1 -- 172.21.15.60:0/426346213 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1180c2d30 msgr2=0x7ff11814ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:13.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.773+0000 7ff11ec83640 1 --2- 172.21.15.60:0/426346213 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1180c2d30 0x7ff11814ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:13.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.773+0000 7ff11ec83640 1 -- 172.21.15.60:0/426346213 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff11814b940 con 0x7ff1180c5030 2024-09-12T02:40:13.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.773+0000 7ff11ec83640 1 --2- 172.21.15.60:0/426346213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1180c5030 0x7ff11814b090 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff11002ac00 tx=0x7ff110004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:13.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.774+0000 7ff10affd640 1 -- 172.21.15.60:0/426346213 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11003f020 con 0x7ff1180c5030 2024-09-12T02:40:13.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.774+0000 7ff10affd640 1 -- 172.21.15.60:0/426346213 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff110037040 con 0x7ff1180c5030 2024-09-12T02:40:13.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.774+0000 7ff1206e6640 1 -- 172.21.15.60:0/426346213 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1181efc80 con 0x7ff1180c5030 2024-09-12T02:40:13.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.774+0000 7ff10affd640 1 -- 172.21.15.60:0/426346213 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff110036070 con 0x7ff1180c5030 2024-09-12T02:40:13.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.774+0000 7ff1206e6640 1 -- 172.21.15.60:0/426346213 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1180c7720 con 0x7ff1180c5030 2024-09-12T02:40:13.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.775+0000 7ff1206e6640 1 -- 172.21.15.60:0/426346213 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff118152460 con 0x7ff1180c5030 2024-09-12T02:40:13.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.776+0000 7ff10affd640 1 -- 172.21.15.60:0/426346213 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff110042020 con 0x7ff1180c5030 2024-09-12T02:40:13.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.776+0000 7ff10affd640 1 --2- 172.21.15.60:0/426346213 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff0fc06be30 0x7ff0fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:13.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.776+0000 7ff10affd640 1 -- 172.21.15.60:0/426346213 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7ff1100ab8c0 con 0x7ff1180c5030 2024-09-12T02:40:13.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.776+0000 7ff11e482640 1 --2- 172.21.15.60:0/426346213 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff0fc06be30 0x7ff0fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:13.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.777+0000 7ff11e482640 1 --2- 172.21.15.60:0/426346213 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff0fc06be30 0x7ff0fc06e2f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff1180aace0 tx=0x7ff114008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:13.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.780+0000 7ff10affd640 1 -- 172.21.15.60:0/426346213 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff118152460 con 0x7ff1180c5030 2024-09-12T02:40:13.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.958+0000 7ff1206e6640 1 -- 172.21.15.60:0/426346213 --> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7ff1180c3210 con 0x7ff0fc06be30 2024-09-12T02:40:13.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.958+0000 7ff10affd640 1 -- 172.21.15.60:0/426346213 <== mgr.4098 v2:172.21.15.60:6800/3549430091 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff1180c3210 con 0x7ff0fc06be30 2024-09-12T02:40:13.959 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T02:40:13.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.960+0000 7ff1206e6640 1 -- 172.21.15.60:0/426346213 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff0fc06be30 msgr2=0x7ff0fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:13.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.960+0000 7ff1206e6640 1 --2- 172.21.15.60:0/426346213 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff0fc06be30 0x7ff0fc06e2f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff1180aace0 tx=0x7ff114008040 comp rx=0 tx=0).stop 2024-09-12T02:40:13.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.960+0000 7ff1206e6640 1 -- 172.21.15.60:0/426346213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1180c5030 msgr2=0x7ff11814b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:13.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.960+0000 7ff1206e6640 1 --2- 172.21.15.60:0/426346213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1180c5030 0x7ff11814b090 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff11002ac00 tx=0x7ff110004a40 comp rx=0 tx=0).stop 2024-09-12T02:40:13.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.961+0000 7ff1206e6640 1 -- 172.21.15.60:0/426346213 shutdown_connections 2024-09-12T02:40:13.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.961+0000 7ff1206e6640 1 --2- 172.21.15.60:0/426346213 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7ff0fc06be30 0x7ff0fc06e2f0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:13.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.961+0000 7ff1206e6640 1 --2- 172.21.15.60:0/426346213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1180c5030 0x7ff11814b090 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:13.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.961+0000 7ff1206e6640 1 --2- 172.21.15.60:0/426346213 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1180c2d30 0x7ff11814ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:13.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.961+0000 7ff1206e6640 1 --2- 172.21.15.60:0/426346213 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff11806e580 0x7ff1180c71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:13.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.961+0000 7ff1206e6640 1 -- 172.21.15.60:0/426346213 >> 172.21.15.60:0/426346213 conn(0x7ff11806bbe0 msgr2=0x7ff118151d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:13.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.961+0000 7ff1206e6640 1 -- 172.21.15.60:0/426346213 shutdown_connections 2024-09-12T02:40:13.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:13.961+0000 7ff1206e6640 1 -- 172.21.15.60:0/426346213 wait complete. 2024-09-12T02:40:13.972 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T02:40:13.973 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:40:14.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.079+0000 7fbed0166640 1 Processor -- start 2024-09-12T02:40:14.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.079+0000 7fbed0166640 1 -- start start 2024-09-12T02:40:14.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.080+0000 7fbed0166640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbec8155c60 0x7fbec8156040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:14.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.080+0000 7fbed0166640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec8159960 0x7fbec806bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:14.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.080+0000 7fbed0166640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbec80c2fb0 con 0x7fbec806c120 2024-09-12T02:40:14.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.080+0000 7fbed0166640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fbec81569b0 con 0x7fbec8155c60 2024-09-12T02:40:14.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.080+0000 7fbed0166640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbec8156c90 con 0x7fbec8159960 2024-09-12T02:40:14.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.080+0000 7fbecdf02640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbec8155c60 0x7fbec8156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:14.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.080+0000 7fbecdf02640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbec8155c60 0x7fbec8156040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40444/0 (socket says 172.21.15.60:40444) 2024-09-12T02:40:14.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.080+0000 7fbecdf02640 1 -- 172.21.15.60:0/3725643461 learned_addr learned my addr 172.21.15.60:0/3725643461 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:14.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.080+0000 7fbecd701640 1 --2- 172.21.15.60:0/3725643461 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec8159960 0x7fbec806bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:14.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.080+0000 7fbecdf02640 1 -- 172.21.15.60:0/3725643461 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec8159960 msgr2=0x7fbec806bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:14.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.080+0000 7fbecdf02640 1 --2- 172.21.15.60:0/3725643461 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec8159960 0x7fbec806bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:14.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.080+0000 7fbecdf02640 1 -- 172.21.15.60:0/3725643461 >> v1:172.21.15.105:6789/0 conn(0x7fbec806c120 legacy=0x7fbec80c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:14.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.080+0000 7fbeccf00640 1 -- 172.21.15.60:0/3725643461 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1887544611 0 0) 0x7fbec80c2fb0 con 0x7fbec806c120 2024-09-12T02:40:14.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.080+0000 7fbecdf02640 1 -- 172.21.15.60:0/3725643461 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec8156f70 con 0x7fbec8155c60 2024-09-12T02:40:14.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.081+0000 7fbecdf02640 1 --2- 172.21.15.60:0/3725643461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbec8155c60 0x7fbec8156040 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbec40098a0 tx=0x7fbec402a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=170f9e25287140a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:14.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.081+0000 7fbeccf00640 1 -- 172.21.15.60:0/3725643461 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec4037070 con 0x7fbec8155c60 2024-09-12T02:40:14.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.081+0000 7fbeccf00640 1 -- 172.21.15.60:0/3725643461 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbec4032440 con 0x7fbec8155c60 2024-09-12T02:40:14.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.081+0000 7fbeccf00640 1 -- 172.21.15.60:0/3725643461 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec4032810 con 0x7fbec8155c60 2024-09-12T02:40:14.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.082+0000 7fbed0166640 1 -- 172.21.15.60:0/3725643461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbec8155c60 msgr2=0x7fbec8156040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:14.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.082+0000 7fbed0166640 1 --2- 172.21.15.60:0/3725643461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbec8155c60 0x7fbec8156040 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbec40098a0 tx=0x7fbec402a1f0 comp rx=0 tx=0).stop 2024-09-12T02:40:14.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.082+0000 7fbed0166640 1 -- 172.21.15.60:0/3725643461 shutdown_connections 2024-09-12T02:40:14.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.082+0000 7fbed0166640 1 --2- 172.21.15.60:0/3725643461 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec8159960 0x7fbec806bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:14.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.082+0000 7fbed0166640 1 --2- 172.21.15.60:0/3725643461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbec8155c60 0x7fbec8156040 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:14.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.082+0000 7fbed0166640 1 -- 172.21.15.60:0/3725643461 >> 172.21.15.60:0/3725643461 conn(0x7fbec80c8790 msgr2=0x7fbec80c8b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:14.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.082+0000 7fbed0166640 1 -- 172.21.15.60:0/3725643461 shutdown_connections 2024-09-12T02:40:14.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.082+0000 7fbed0166640 1 -- 172.21.15.60:0/3725643461 wait complete. 2024-09-12T02:40:14.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.083+0000 7fbed0166640 1 Processor -- start 2024-09-12T02:40:14.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.083+0000 7fbed0166640 1 -- start start 2024-09-12T02:40:14.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.084+0000 7fbed0166640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec806c120 0x7fbec80741b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:14.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.084+0000 7fbed0166640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbec8155c60 0x7fbec81e1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:14.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.084+0000 7fbed0166640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbec8159960 0x7fbec81dfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:14.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.084+0000 7fbed0166640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbec8156580 con 0x7fbec8155c60 2024-09-12T02:40:14.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.084+0000 7fbed0166640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbec80ab1b0 con 0x7fbec8159960 2024-09-12T02:40:14.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.084+0000 7fbed0166640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbec8156700 con 0x7fbec806c120 2024-09-12T02:40:14.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.084+0000 7fbecd701640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbec8155c60 0x7fbec81e1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:14.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.084+0000 7fbecd701640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbec8155c60 0x7fbec81e1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40454/0 (socket says 172.21.15.60:40454) 2024-09-12T02:40:14.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.084+0000 7fbecd701640 1 -- 172.21.15.60:0/856081208 learned_addr learned my addr 172.21.15.60:0/856081208 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:14.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.084+0000 7fbecdf02640 1 --2- 172.21.15.60:0/856081208 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec806c120 0x7fbec80741b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:14.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.084+0000 7fbece703640 1 --2- 172.21.15.60:0/856081208 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbec8159960 0x7fbec81dfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:14.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.084+0000 7fbecd701640 1 -- 172.21.15.60:0/856081208 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec806c120 msgr2=0x7fbec80741b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:14.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.084+0000 7fbecd701640 1 --2- 172.21.15.60:0/856081208 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec806c120 0x7fbec80741b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:14.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.084+0000 7fbecd701640 1 -- 172.21.15.60:0/856081208 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbec8159960 msgr2=0x7fbec81dfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:14.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.084+0000 7fbecd701640 1 --2- 172.21.15.60:0/856081208 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbec8159960 0x7fbec81dfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:14.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.084+0000 7fbecd701640 1 -- 172.21.15.60:0/856081208 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec8151db0 con 0x7fbec8155c60 2024-09-12T02:40:14.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.084+0000 7fbecdf02640 1 --2- 172.21.15.60:0/856081208 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbec806c120 0x7fbec80741b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:40:14.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.084+0000 7fbecd701640 1 --2- 172.21.15.60:0/856081208 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbec8155c60 0x7fbec81e1930 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbeb800e980 tx=0x7fbeb800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:14.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.084+0000 7fbebe7fc640 1 -- 172.21.15.60:0/856081208 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb8017070 con 0x7fbec8155c60 2024-09-12T02:40:14.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.085+0000 7fbebe7fc640 1 -- 172.21.15.60:0/856081208 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbeb800ca00 con 0x7fbec8155c60 2024-09-12T02:40:14.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.085+0000 7fbed0166640 1 -- 172.21.15.60:0/856081208 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbec8073320 con 0x7fbec8155c60 2024-09-12T02:40:14.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.085+0000 7fbebe7fc640 1 -- 172.21.15.60:0/856081208 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb800cdd0 con 0x7fbec8155c60 2024-09-12T02:40:14.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.085+0000 7fbed0166640 1 -- 172.21.15.60:0/856081208 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbec80ad550 con 0x7fbec8155c60 2024-09-12T02:40:14.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.085+0000 7fbed0166640 1 -- 172.21.15.60:0/856081208 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbec8073700 con 0x7fbec8155c60 2024-09-12T02:40:14.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.086+0000 7fbebe7fc640 1 -- 172.21.15.60:0/856081208 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbeb801a070 con 0x7fbec8155c60 2024-09-12T02:40:14.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.087+0000 7fbebe7fc640 1 --2- 172.21.15.60:0/856081208 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbeac06be30 0x7fbeac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:14.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.087+0000 7fbebe7fc640 1 -- 172.21.15.60:0/856081208 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fbeb808b5c0 con 0x7fbec8155c60 2024-09-12T02:40:14.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.087+0000 7fbecdf02640 1 --2- 172.21.15.60:0/856081208 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbeac06be30 0x7fbeac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:14.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.087+0000 7fbebe7fc640 1 --2- 172.21.15.60:0/856081208 >> [v2:172.21.15.60:6810/1109822408,v1:172.21.15.60:6811/1109822408] conn(0x7fbeac0767c0 0x7fbeac078c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:14.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.087+0000 7fbebe7fc640 1 -- 172.21.15.60:0/856081208 --> [v2:172.21.15.60:6810/1109822408,v1:172.21.15.60:6811/1109822408] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbeac079310 con 0x7fbeac0767c0 2024-09-12T02:40:14.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.087+0000 7fbebe7fc640 1 -- 172.21.15.60:0/856081208 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbeb808b970 con 0x7fbec8155c60 2024-09-12T02:40:14.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.087+0000 7fbece703640 1 --2- 172.21.15.60:0/856081208 >> [v2:172.21.15.60:6810/1109822408,v1:172.21.15.60:6811/1109822408] conn(0x7fbeac0767c0 0x7fbeac078c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:14.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.087+0000 7fbecdf02640 1 --2- 172.21.15.60:0/856081208 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbeac06be30 0x7fbeac06e2f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fbec4034000 tx=0x7fbec402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:14.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.088+0000 7fbece703640 1 --2- 172.21.15.60:0/856081208 >> [v2:172.21.15.60:6810/1109822408,v1:172.21.15.60:6811/1109822408] conn(0x7fbeac0767c0 0x7fbeac078c40 crc :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:14.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.088+0000 7fbebe7fc640 1 -- 172.21.15.60:0/856081208 <== osd.1 v2:172.21.15.60:6810/1109822408 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbeac079310 con 0x7fbeac0767c0 2024-09-12T02:40:14.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.101+0000 7fbed0166640 1 -- 172.21.15.60:0/856081208 --> [v2:172.21.15.60:6810/1109822408,v1:172.21.15.60:6811/1109822408] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbec8156040 con 0x7fbeac0767c0 2024-09-12T02:40:14.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.101+0000 7fbebe7fc640 1 -- 172.21.15.60:0/856081208 <== osd.1 v2:172.21.15.60:6810/1109822408 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbec8156040 con 0x7fbeac0767c0 2024-09-12T02:40:14.102 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:40:14.102 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T02:40:14.102 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:40:14.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.101+0000 7fbed0166640 1 -- 172.21.15.60:0/856081208 >> [v2:172.21.15.60:6810/1109822408,v1:172.21.15.60:6811/1109822408] conn(0x7fbeac0767c0 msgr2=0x7fbeac078c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:14.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.101+0000 7fbed0166640 1 --2- 172.21.15.60:0/856081208 >> [v2:172.21.15.60:6810/1109822408,v1:172.21.15.60:6811/1109822408] conn(0x7fbeac0767c0 0x7fbeac078c40 crc :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:14.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.101+0000 7fbed0166640 1 -- 172.21.15.60:0/856081208 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbeac06be30 msgr2=0x7fbeac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:14.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.101+0000 7fbed0166640 1 --2- 172.21.15.60:0/856081208 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbeac06be30 0x7fbeac06e2f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fbec4034000 tx=0x7fbec402e000 comp rx=0 tx=0).stop 2024-09-12T02:40:14.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.101+0000 7fbed0166640 1 -- 172.21.15.60:0/856081208 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbec8155c60 msgr2=0x7fbec81e1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:14.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.101+0000 7fbed0166640 1 --2- 172.21.15.60:0/856081208 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbec8155c60 0x7fbec81e1930 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbeb800e980 tx=0x7fbeb800ee40 comp rx=0 tx=0).stop 2024-09-12T02:40:14.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.101+0000 7fbece703640 1 -- 172.21.15.60:0/856081208 reap_dead start 2024-09-12T02:40:14.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.101+0000 7fbed0166640 1 -- 172.21.15.60:0/856081208 shutdown_connections 2024-09-12T02:40:14.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.101+0000 7fbed0166640 1 -- 172.21.15.60:0/856081208 >> 172.21.15.60:0/856081208 conn(0x7fbec80c8790 msgr2=0x7fbec8157b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:14.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.102+0000 7fbed0166640 1 -- 172.21.15.60:0/856081208 shutdown_connections 2024-09-12T02:40:14.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.102+0000 7fbed0166640 1 -- 172.21.15.60:0/856081208 wait complete. 2024-09-12T02:40:14.113 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T02:40:14.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.216+0000 7fcffa1fd640 1 Processor -- start 2024-09-12T02:40:14.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.216+0000 7fcffa1fd640 1 -- start start 2024-09-12T02:40:14.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.217+0000 7fcffa1fd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcff406c650 0x7fcff40c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:14.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.217+0000 7fcffa1fd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fcff40ca1c0 0x7fcff4160bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:14.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.217+0000 7fcffa1fd640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcff415a7c0 con 0x7fcff4150480 2024-09-12T02:40:14.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.217+0000 7fcffa1fd640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fcff406c240 con 0x7fcff40ca1c0 2024-09-12T02:40:14.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.217+0000 7fcffa1fd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcff415a330 con 0x7fcff406c650 2024-09-12T02:40:14.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.217+0000 7fcff37fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fcff4150480 0x7fcff40c7a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:42806/0 (socket says 172.21.15.60:42806) 2024-09-12T02:40:14.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.217+0000 7fcff37fe640 1 -- 172.21.15.60:0/2443760717 learned_addr learned my addr 172.21.15.60:0/2443760717 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:40:14.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.218+0000 7fcff27fc640 1 -- 172.21.15.60:0/2443760717 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2814713985 0 0) 0x7fcff415a7c0 con 0x7fcff4150480 2024-09-12T02:40:14.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.218+0000 7fcff2ffd640 1 --2- 172.21.15.60:0/2443760717 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcff406c650 0x7fcff40c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:14.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.218+0000 7fcff3fff640 1 --2- 172.21.15.60:0/2443760717 >> v2:172.21.15.105:3300/0 conn(0x7fcff40ca1c0 0x7fcff4160bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:14.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.218+0000 7fcff27fc640 1 -- 172.21.15.60:0/2443760717 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcfdc003520 con 0x7fcff4150480 2024-09-12T02:40:14.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.218+0000 7fcff27fc640 1 -- 172.21.15.60:0/2443760717 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3557011322 0 0) 0x7fcfdc003520 con 0x7fcff4150480 2024-09-12T02:40:14.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.218+0000 7fcff27fc640 1 -- 172.21.15.60:0/2443760717 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcff406c650 msgr2=0x7fcff40c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:14.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.218+0000 7fcff27fc640 1 --2- 172.21.15.60:0/2443760717 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcff406c650 0x7fcff40c9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:14.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.218+0000 7fcff27fc640 1 -- 172.21.15.60:0/2443760717 >> v2:172.21.15.105:3300/0 conn(0x7fcff40ca1c0 msgr2=0x7fcff4160bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:14.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.218+0000 7fcff27fc640 1 --2- 172.21.15.60:0/2443760717 >> v2:172.21.15.105:3300/0 conn(0x7fcff40ca1c0 0x7fcff4160bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:14.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.218+0000 7fcff27fc640 1 -- 172.21.15.60:0/2443760717 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcff4159a00 con 0x7fcff4150480 2024-09-12T02:40:14.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.218+0000 7fcff27fc640 1 -- 172.21.15.60:0/2443760717 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7fcfe4001670 con 0x7fcff4150480 2024-09-12T02:40:14.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.218+0000 7fcff27fc640 1 -- 172.21.15.60:0/2443760717 >> v1:172.21.15.60:6789/0 conn(0x7fcff4150480 legacy=0x7fcff40c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:14.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.218+0000 7fcff27fc640 1 --2- 172.21.15.60:0/2443760717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfdc0039b0 0x7fcfdc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:14.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.218+0000 7fcff27fc640 1 --2- 172.21.15.60:0/2443760717 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcff406c650 0x7fcfdc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:14.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.218+0000 7fcff27fc640 1 --2- 172.21.15.60:0/2443760717 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfdc004d40 0x7fcfdc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:14.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.218+0000 7fcff27fc640 1 -- 172.21.15.60:0/2443760717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcff415a330 con 0x7fcfdc0039b0 2024-09-12T02:40:14.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.218+0000 7fcff27fc640 1 -- 172.21.15.60:0/2443760717 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcfdc00b9c0 con 0x7fcfdc004d40 2024-09-12T02:40:14.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.218+0000 7fcff27fc640 1 -- 172.21.15.60:0/2443760717 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcfdc00bb40 con 0x7fcff406c650 2024-09-12T02:40:14.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.218+0000 7fcff37fe640 1 --2- 172.21.15.60:0/2443760717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfdc0039b0 0x7fcfdc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:14.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.218+0000 7fcff2ffd640 1 --2- 172.21.15.60:0/2443760717 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcff406c650 0x7fcfdc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:14.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.218+0000 7fcff3fff640 1 --2- 172.21.15.60:0/2443760717 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfdc004d40 0x7fcfdc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:14.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.218+0000 7fcff37fe640 1 -- 172.21.15.60:0/2443760717 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcff406c650 msgr2=0x7fcfdc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:14.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.218+0000 7fcff37fe640 1 --2- 172.21.15.60:0/2443760717 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcff406c650 0x7fcfdc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:14.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.218+0000 7fcff37fe640 1 -- 172.21.15.60:0/2443760717 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfdc004d40 msgr2=0x7fcfdc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:14.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.218+0000 7fcff37fe640 1 --2- 172.21.15.60:0/2443760717 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfdc004d40 0x7fcfdc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:14.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.218+0000 7fcff37fe640 1 -- 172.21.15.60:0/2443760717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfdc003520 con 0x7fcfdc0039b0 2024-09-12T02:40:14.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.219+0000 7fcff37fe640 1 --2- 172.21.15.60:0/2443760717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfdc0039b0 0x7fcfdc003dd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4001050 tx=0x7fcfdc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1ba3aeb0bff029b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:14.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.219+0000 7fcff27fc640 1 -- 172.21.15.60:0/2443760717 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe402e070 con 0x7fcfdc0039b0 2024-09-12T02:40:14.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.219+0000 7fcff27fc640 1 -- 172.21.15.60:0/2443760717 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfe4005af0 con 0x7fcfdc0039b0 2024-09-12T02:40:14.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.219+0000 7fcff27fc640 1 -- 172.21.15.60:0/2443760717 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe4007d70 con 0x7fcfdc0039b0 2024-09-12T02:40:14.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.220+0000 7fcffa1fd640 1 -- 172.21.15.60:0/2443760717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfdc0039b0 msgr2=0x7fcfdc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:14.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.220+0000 7fcffa1fd640 1 --2- 172.21.15.60:0/2443760717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfdc0039b0 0x7fcfdc003dd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4001050 tx=0x7fcfdc005830 comp rx=0 tx=0).stop 2024-09-12T02:40:14.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.220+0000 7fcff3fff640 1 -- 172.21.15.60:0/2443760717 reap_dead start 2024-09-12T02:40:14.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.220+0000 7fcffa1fd640 1 -- 172.21.15.60:0/2443760717 shutdown_connections 2024-09-12T02:40:14.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.220+0000 7fcffa1fd640 1 -- 172.21.15.60:0/2443760717 >> 172.21.15.60:0/2443760717 conn(0x7fcff4068030 msgr2=0x7fcff4073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:14.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.220+0000 7fcffa1fd640 1 -- 172.21.15.60:0/2443760717 shutdown_connections 2024-09-12T02:40:14.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.220+0000 7fcffa1fd640 1 -- 172.21.15.60:0/2443760717 wait complete. 2024-09-12T02:40:14.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.221+0000 7fcffa1fd640 1 Processor -- start 2024-09-12T02:40:14.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.221+0000 7fcffa1fd640 1 -- start start 2024-09-12T02:40:14.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.222+0000 7fcffa1fd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcff414dbf0 0x7fcff4152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:14.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.222+0000 7fcffa1fd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcff414dfd0 0x7fcff4153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:14.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.222+0000 7fcffa1fd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcff4157430 0x7fcff41eba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:14.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.222+0000 7fcffa1fd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcff40ca670 con 0x7fcff414dbf0 2024-09-12T02:40:14.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.222+0000 7fcffa1fd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcff4159fc0 con 0x7fcff414dfd0 2024-09-12T02:40:14.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.222+0000 7fcffa1fd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcff406d270 con 0x7fcff4157430 2024-09-12T02:40:14.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.222+0000 7fcff37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcff414dbf0 0x7fcff4152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:14.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.222+0000 7fcff37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcff414dbf0 0x7fcff4152e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40470/0 (socket says 172.21.15.60:40470) 2024-09-12T02:40:14.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.222+0000 7fcff37fe640 1 -- 172.21.15.60:0/1293366225 learned_addr learned my addr 172.21.15.60:0/1293366225 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:14.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.222+0000 7fcff2ffd640 1 --2- 172.21.15.60:0/1293366225 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcff414dfd0 0x7fcff4153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:14.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.222+0000 7fcff3fff640 1 --2- 172.21.15.60:0/1293366225 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcff4157430 0x7fcff41eba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:14.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.222+0000 7fcff37fe640 1 -- 172.21.15.60:0/1293366225 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcff4157430 msgr2=0x7fcff41eba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:14.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.222+0000 7fcff37fe640 1 --2- 172.21.15.60:0/1293366225 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcff4157430 0x7fcff41eba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:14.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.222+0000 7fcff37fe640 1 -- 172.21.15.60:0/1293366225 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcff414dfd0 msgr2=0x7fcff4153340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:14.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.222+0000 7fcff37fe640 1 --2- 172.21.15.60:0/1293366225 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcff414dfd0 0x7fcff4153340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:14.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.222+0000 7fcff37fe640 1 -- 172.21.15.60:0/1293366225 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcff414bdc0 con 0x7fcff414dbf0 2024-09-12T02:40:14.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.222+0000 7fcff3fff640 1 --2- 172.21.15.60:0/1293366225 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcff4157430 0x7fcff41eba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:40:14.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.223+0000 7fcff37fe640 1 --2- 172.21.15.60:0/1293366225 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcff414dbf0 0x7fcff4152e00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4034040 tx=0x7fcfe4000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:14.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.223+0000 7fcfdbfff640 1 -- 172.21.15.60:0/1293366225 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe4042070 con 0x7fcff414dbf0 2024-09-12T02:40:14.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.223+0000 7fcfdbfff640 1 -- 172.21.15.60:0/1293366225 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfe40074a0 con 0x7fcff414dbf0 2024-09-12T02:40:14.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.223+0000 7fcffa1fd640 1 -- 172.21.15.60:0/1293366225 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcff40aec60 con 0x7fcff414dbf0 2024-09-12T02:40:14.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.223+0000 7fcfdbfff640 1 -- 172.21.15.60:0/1293366225 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe4007d50 con 0x7fcff414dbf0 2024-09-12T02:40:14.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.223+0000 7fcffa1fd640 1 -- 172.21.15.60:0/1293366225 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcff414e650 con 0x7fcff414dbf0 2024-09-12T02:40:14.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.224+0000 7fcffa1fd640 1 -- 172.21.15.60:0/1293366225 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcff4156270 con 0x7fcff414dbf0 2024-09-12T02:40:14.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.224+0000 7fcfdbfff640 1 -- 172.21.15.60:0/1293366225 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcfe4045070 con 0x7fcff414dbf0 2024-09-12T02:40:14.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.225+0000 7fcfdbfff640 1 --2- 172.21.15.60:0/1293366225 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcfe006be30 0x7fcfe006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:14.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.225+0000 7fcfdbfff640 1 -- 172.21.15.60:0/1293366225 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fcfe40abbc0 con 0x7fcff414dbf0 2024-09-12T02:40:14.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.225+0000 7fcff2ffd640 1 --2- 172.21.15.60:0/1293366225 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcfe006be30 0x7fcfe006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:14.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.225+0000 7fcff2ffd640 1 --2- 172.21.15.60:0/1293366225 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcfe006be30 0x7fcfe006e2f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fcff414e3f0 tx=0x7fcfe8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:14.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.229+0000 7fcfdbfff640 1 -- 172.21.15.60:0/1293366225 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcfe407a260 con 0x7fcff414dbf0 2024-09-12T02:40:14.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.404+0000 7fcffa1fd640 1 -- 172.21.15.60:0/1293366225 --> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fcff406c430 con 0x7fcfe006be30 2024-09-12T02:40:14.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.404+0000 7fcfdbfff640 1 -- 172.21.15.60:0/1293366225 <== mgr.4098 v2:172.21.15.60:6800/3549430091 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fcff406c430 con 0x7fcfe006be30 2024-09-12T02:40:14.405 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T02:40:14.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.407+0000 7fcffa1fd640 1 -- 172.21.15.60:0/1293366225 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcfe006be30 msgr2=0x7fcfe006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:14.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.407+0000 7fcffa1fd640 1 --2- 172.21.15.60:0/1293366225 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcfe006be30 0x7fcfe006e2f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fcff414e3f0 tx=0x7fcfe8008040 comp rx=0 tx=0).stop 2024-09-12T02:40:14.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.407+0000 7fcffa1fd640 1 -- 172.21.15.60:0/1293366225 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcff414dbf0 msgr2=0x7fcff4152e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:14.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.407+0000 7fcffa1fd640 1 --2- 172.21.15.60:0/1293366225 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcff414dbf0 0x7fcff4152e00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4034040 tx=0x7fcfe4000fe0 comp rx=0 tx=0).stop 2024-09-12T02:40:14.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.407+0000 7fcffa1fd640 1 -- 172.21.15.60:0/1293366225 shutdown_connections 2024-09-12T02:40:14.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.407+0000 7fcffa1fd640 1 --2- 172.21.15.60:0/1293366225 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcfe006be30 0x7fcfe006e2f0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:14.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.407+0000 7fcffa1fd640 1 --2- 172.21.15.60:0/1293366225 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcff4157430 0x7fcff41eba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:14.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.407+0000 7fcffa1fd640 1 --2- 172.21.15.60:0/1293366225 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcff414dfd0 0x7fcff4153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:14.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.407+0000 7fcffa1fd640 1 --2- 172.21.15.60:0/1293366225 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcff414dbf0 0x7fcff4152e00 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:14.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.407+0000 7fcffa1fd640 1 -- 172.21.15.60:0/1293366225 >> 172.21.15.60:0/1293366225 conn(0x7fcff4068030 msgr2=0x7fcff4075030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:14.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.407+0000 7fcffa1fd640 1 -- 172.21.15.60:0/1293366225 shutdown_connections 2024-09-12T02:40:14.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.407+0000 7fcffa1fd640 1 -- 172.21.15.60:0/1293366225 wait complete. 2024-09-12T02:40:14.419 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T02:40:14.419 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:40:14.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.525+0000 7f9d7e3d6640 1 Processor -- start 2024-09-12T02:40:14.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.525+0000 7f9d7e3d6640 1 -- start start 2024-09-12T02:40:14.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.526+0000 7f9d7e3d6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9d780c8b10 0x7f9d7815a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:14.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.526+0000 7f9d7e3d6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d7806cd80 0x7f9d781534d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:14.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.526+0000 7f9d7e3d6640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d780c7070 con 0x7f9d78153a10 2024-09-12T02:40:14.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.526+0000 7f9d7e3d6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f9d7806d210 con 0x7f9d780c8b10 2024-09-12T02:40:14.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.526+0000 7f9d7e3d6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9d780c69b0 con 0x7f9d7806cd80 2024-09-12T02:40:14.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.526+0000 7f9d77fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9d780c8b10 0x7f9d7815a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:14.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.526+0000 7f9d77fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9d780c8b10 0x7f9d7815a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40474/0 (socket says 172.21.15.60:40474) 2024-09-12T02:40:14.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.526+0000 7f9d77fff640 1 -- 172.21.15.60:0/3546032551 learned_addr learned my addr 172.21.15.60:0/3546032551 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:14.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.526+0000 7f9d7c973640 1 --1- 172.21.15.60:0/3546032551 >> v1:172.21.15.60:6789/0 conn(0x7f9d78153a10 0x7f9d78156660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:42814/0 (socket says 172.21.15.60:42814) 2024-09-12T02:40:14.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.527+0000 7f9d777fe640 1 --2- 172.21.15.60:0/3546032551 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d7806cd80 0x7f9d781534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:14.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.527+0000 7f9d77fff640 1 -- 172.21.15.60:0/3546032551 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d7806cd80 msgr2=0x7f9d781534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:14.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.527+0000 7f9d77fff640 1 --2- 172.21.15.60:0/3546032551 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d7806cd80 0x7f9d781534d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:14.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.527+0000 7f9d77fff640 1 -- 172.21.15.60:0/3546032551 >> v1:172.21.15.60:6789/0 conn(0x7f9d78153a10 legacy=0x7f9d78156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:14.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.527+0000 7f9d77fff640 1 -- 172.21.15.60:0/3546032551 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d780c6c90 con 0x7f9d780c8b10 2024-09-12T02:40:14.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.527+0000 7f9d76ffd640 1 -- 172.21.15.60:0/3546032551 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 72120455 0 0) 0x7f9d780c7070 con 0x7f9d78153a10 2024-09-12T02:40:14.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.527+0000 7f9d777fe640 1 --2- 172.21.15.60:0/3546032551 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d7806cd80 0x7f9d781534d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:40:14.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.527+0000 7f9d77fff640 1 --2- 172.21.15.60:0/3546032551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d780c8b10 0x7f9d7815a4a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9d68009870 tx=0x7f9d6802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb798bf6e3c5ae7c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:14.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.528+0000 7f9d76ffd640 1 -- 172.21.15.60:0/3546032551 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d68037070 con 0x7f9d780c8b10 2024-09-12T02:40:14.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.528+0000 7f9d76ffd640 1 -- 172.21.15.60:0/3546032551 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d68032440 con 0x7f9d780c8b10 2024-09-12T02:40:14.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.528+0000 7f9d76ffd640 1 -- 172.21.15.60:0/3546032551 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d68032810 con 0x7f9d780c8b10 2024-09-12T02:40:14.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.528+0000 7f9d7e3d6640 1 -- 172.21.15.60:0/3546032551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d780c8b10 msgr2=0x7f9d7815a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:14.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.528+0000 7f9d7e3d6640 1 --2- 172.21.15.60:0/3546032551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d780c8b10 0x7f9d7815a4a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9d68009870 tx=0x7f9d6802a1c0 comp rx=0 tx=0).stop 2024-09-12T02:40:14.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.528+0000 7f9d7e3d6640 1 -- 172.21.15.60:0/3546032551 shutdown_connections 2024-09-12T02:40:14.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.528+0000 7f9d7e3d6640 1 --2- 172.21.15.60:0/3546032551 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d7806cd80 0x7f9d781534d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:14.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.528+0000 7f9d7e3d6640 1 --2- 172.21.15.60:0/3546032551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d780c8b10 0x7f9d7815a4a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:14.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.528+0000 7f9d7e3d6640 1 -- 172.21.15.60:0/3546032551 >> 172.21.15.60:0/3546032551 conn(0x7f9d780adb80 msgr2=0x7f9d780adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:14.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.528+0000 7f9d7e3d6640 1 -- 172.21.15.60:0/3546032551 shutdown_connections 2024-09-12T02:40:14.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.528+0000 7f9d7e3d6640 1 -- 172.21.15.60:0/3546032551 wait complete. 2024-09-12T02:40:14.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.529+0000 7f9d7e3d6640 1 Processor -- start 2024-09-12T02:40:14.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.530+0000 7f9d7e3d6640 1 -- start start 2024-09-12T02:40:14.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.530+0000 7f9d7e3d6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d780c8b10 0x7f9d781eba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:14.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.530+0000 7f9d7e3d6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d78153a10 0x7f9d78148cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:14.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.530+0000 7f9d7e3d6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d781df9b0 0x7f9d781e0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:14.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.530+0000 7f9d7e3d6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9d78154020 con 0x7f9d781df9b0 2024-09-12T02:40:14.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.530+0000 7f9d7e3d6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9d78153ea0 con 0x7f9d78153a10 2024-09-12T02:40:14.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.530+0000 7f9d7e3d6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9d780c8ef0 con 0x7f9d780c8b10 2024-09-12T02:40:14.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.530+0000 7f9d7c973640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d781df9b0 0x7f9d781e0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:14.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.530+0000 7f9d7c973640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d781df9b0 0x7f9d781e0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40490/0 (socket says 172.21.15.60:40490) 2024-09-12T02:40:14.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.530+0000 7f9d7c973640 1 -- 172.21.15.60:0/3557043328 learned_addr learned my addr 172.21.15.60:0/3557043328 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:14.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.531+0000 7f9d77fff640 1 --2- 172.21.15.60:0/3557043328 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d780c8b10 0x7f9d781eba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:14.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.531+0000 7f9d777fe640 1 --2- 172.21.15.60:0/3557043328 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d78153a10 0x7f9d78148cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:14.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.531+0000 7f9d7c973640 1 -- 172.21.15.60:0/3557043328 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d780c8b10 msgr2=0x7f9d781eba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:14.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.531+0000 7f9d7c973640 1 --2- 172.21.15.60:0/3557043328 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d780c8b10 0x7f9d781eba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:14.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.531+0000 7f9d7c973640 1 -- 172.21.15.60:0/3557043328 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d78153a10 msgr2=0x7f9d78148cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:14.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.531+0000 7f9d7c973640 1 --2- 172.21.15.60:0/3557043328 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d78153a10 0x7f9d78148cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:14.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.531+0000 7f9d7c973640 1 -- 172.21.15.60:0/3557043328 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d7814dfd0 con 0x7f9d781df9b0 2024-09-12T02:40:14.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.531+0000 7f9d7c973640 1 --2- 172.21.15.60:0/3557043328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d781df9b0 0x7f9d781e0a40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9d7000c7e0 tx=0x7f9d7000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:14.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.531+0000 7f9d74ff9640 1 -- 172.21.15.60:0/3557043328 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d70018070 con 0x7f9d781df9b0 2024-09-12T02:40:14.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.531+0000 7f9d74ff9640 1 -- 172.21.15.60:0/3557043328 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d7000a640 con 0x7f9d781df9b0 2024-09-12T02:40:14.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.531+0000 7f9d74ff9640 1 -- 172.21.15.60:0/3557043328 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d7000aa30 con 0x7f9d781df9b0 2024-09-12T02:40:14.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.531+0000 7f9d7e3d6640 1 -- 172.21.15.60:0/3557043328 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d781e0280 con 0x7f9d781df9b0 2024-09-12T02:40:14.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.531+0000 7f9d7e3d6640 1 -- 172.21.15.60:0/3557043328 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d780ad560 con 0x7f9d781df9b0 2024-09-12T02:40:14.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.532+0000 7f9d7e3d6640 1 -- 172.21.15.60:0/3557043328 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9d781534d0 con 0x7f9d781df9b0 2024-09-12T02:40:14.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.533+0000 7f9d74ff9640 1 -- 172.21.15.60:0/3557043328 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9d7001b070 con 0x7f9d781df9b0 2024-09-12T02:40:14.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.533+0000 7f9d74ff9640 1 --2- 172.21.15.60:0/3557043328 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9d6406be60 0x7f9d6406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:14.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.533+0000 7f9d74ff9640 1 -- 172.21.15.60:0/3557043328 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f9d7008a750 con 0x7f9d781df9b0 2024-09-12T02:40:14.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.533+0000 7f9d77fff640 1 --2- 172.21.15.60:0/3557043328 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9d6406be60 0x7f9d6406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:14.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.533+0000 7f9d74ff9640 1 --2- 172.21.15.60:0/3557043328 >> [v2:172.21.15.60:6826/278470077,v1:172.21.15.60:6827/278470077] conn(0x7f9d640767f0 0x7f9d64078c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:14.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.533+0000 7f9d74ff9640 1 -- 172.21.15.60:0/3557043328 --> [v2:172.21.15.60:6826/278470077,v1:172.21.15.60:6827/278470077] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9d64079340 con 0x7f9d640767f0 2024-09-12T02:40:14.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.533+0000 7f9d74ff9640 1 -- 172.21.15.60:0/3557043328 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9d70091050 con 0x7f9d781df9b0 2024-09-12T02:40:14.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.533+0000 7f9d777fe640 1 --2- 172.21.15.60:0/3557043328 >> [v2:172.21.15.60:6826/278470077,v1:172.21.15.60:6827/278470077] conn(0x7f9d640767f0 0x7f9d64078c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:14.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.534+0000 7f9d77fff640 1 --2- 172.21.15.60:0/3557043328 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9d6406be60 0x7f9d6406e320 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f9d68034000 tx=0x7f9d6802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:14.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.534+0000 7f9d777fe640 1 --2- 172.21.15.60:0/3557043328 >> [v2:172.21.15.60:6826/278470077,v1:172.21.15.60:6827/278470077] conn(0x7f9d640767f0 0x7f9d64078c70 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:14.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.534+0000 7f9d74ff9640 1 -- 172.21.15.60:0/3557043328 <== osd.2 v2:172.21.15.60:6826/278470077 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9d64079340 con 0x7f9d640767f0 2024-09-12T02:40:14.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.547+0000 7f9d7e3d6640 1 -- 172.21.15.60:0/3557043328 --> [v2:172.21.15.60:6826/278470077,v1:172.21.15.60:6827/278470077] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9d7814d1d0 con 0x7f9d640767f0 2024-09-12T02:40:14.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.547+0000 7f9d74ff9640 1 -- 172.21.15.60:0/3557043328 <== osd.2 v2:172.21.15.60:6826/278470077 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9d7814d1d0 con 0x7f9d640767f0 2024-09-12T02:40:14.548 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:40:14.548 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T02:40:14.548 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:40:14.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.547+0000 7f9d7e3d6640 1 -- 172.21.15.60:0/3557043328 >> [v2:172.21.15.60:6826/278470077,v1:172.21.15.60:6827/278470077] conn(0x7f9d640767f0 msgr2=0x7f9d64078c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:14.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.547+0000 7f9d7e3d6640 1 --2- 172.21.15.60:0/3557043328 >> [v2:172.21.15.60:6826/278470077,v1:172.21.15.60:6827/278470077] conn(0x7f9d640767f0 0x7f9d64078c70 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:14.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.548+0000 7f9d7e3d6640 1 -- 172.21.15.60:0/3557043328 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9d6406be60 msgr2=0x7f9d6406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:14.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.548+0000 7f9d7e3d6640 1 --2- 172.21.15.60:0/3557043328 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9d6406be60 0x7f9d6406e320 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f9d68034000 tx=0x7f9d6802e000 comp rx=0 tx=0).stop 2024-09-12T02:40:14.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.548+0000 7f9d7e3d6640 1 -- 172.21.15.60:0/3557043328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d781df9b0 msgr2=0x7f9d781e0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:14.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.548+0000 7f9d7e3d6640 1 --2- 172.21.15.60:0/3557043328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d781df9b0 0x7f9d781e0a40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9d7000c7e0 tx=0x7f9d7000cca0 comp rx=0 tx=0).stop 2024-09-12T02:40:14.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.548+0000 7f9d7c973640 1 -- 172.21.15.60:0/3557043328 reap_dead start 2024-09-12T02:40:14.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.548+0000 7f9d7e3d6640 1 -- 172.21.15.60:0/3557043328 shutdown_connections 2024-09-12T02:40:14.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.548+0000 7f9d7e3d6640 1 -- 172.21.15.60:0/3557043328 >> 172.21.15.60:0/3557043328 conn(0x7f9d780adb80 msgr2=0x7f9d780adf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:14.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.548+0000 7f9d7e3d6640 1 -- 172.21.15.60:0/3557043328 shutdown_connections 2024-09-12T02:40:14.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.548+0000 7f9d7e3d6640 1 -- 172.21.15.60:0/3557043328 wait complete. 2024-09-12T02:40:14.559 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T02:40:14.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.662+0000 7fa0e4dfd640 1 Processor -- start 2024-09-12T02:40:14.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.662+0000 7fa0e4dfd640 1 -- start start 2024-09-12T02:40:14.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.663+0000 7fa0e4dfd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa0e006bbe0 0x7fa0e006c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:14.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.663+0000 7fa0e4dfd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0e01598c0 0x7fa0e0159d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:14.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.663+0000 7fa0e4dfd640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0e00c6b20 con 0x7fa0e0153de0 2024-09-12T02:40:14.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.663+0000 7fa0e4dfd640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fa0e00c9480 con 0x7fa0e006bbe0 2024-09-12T02:40:14.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.663+0000 7fa0e4dfd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa0e00cb620 con 0x7fa0e01598c0 2024-09-12T02:40:14.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.664+0000 7fa0ddd9b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa0e006bbe0 0x7fa0e006c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:14.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.664+0000 7fa0de59c640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa0e0153de0 0x7fa0e00ca640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:42830/0 (socket says 172.21.15.60:42830) 2024-09-12T02:40:14.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.664+0000 7fa0ddd9b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa0e006bbe0 0x7fa0e006c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40500/0 (socket says 172.21.15.60:40500) 2024-09-12T02:40:14.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.664+0000 7fa0de59c640 1 -- 172.21.15.60:0/4182678208 learned_addr learned my addr 172.21.15.60:0/4182678208 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:40:14.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.664+0000 7fa0ded9d640 1 --2- 172.21.15.60:0/4182678208 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0e01598c0 0x7fa0e0159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:14.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.664+0000 7fa0dd59a640 1 -- 172.21.15.60:0/4182678208 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3438991988 0 0) 0x7fa0e00c6b20 con 0x7fa0e0153de0 2024-09-12T02:40:14.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.664+0000 7fa0dd59a640 1 -- 172.21.15.60:0/4182678208 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0c8003520 con 0x7fa0e0153de0 2024-09-12T02:40:14.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.664+0000 7fa0ddd9b640 1 -- 172.21.15.60:0/4182678208 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0e01598c0 msgr2=0x7fa0e0159d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:14.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.664+0000 7fa0ddd9b640 1 --2- 172.21.15.60:0/4182678208 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0e01598c0 0x7fa0e0159d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:14.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.664+0000 7fa0ddd9b640 1 -- 172.21.15.60:0/4182678208 >> v1:172.21.15.60:6789/0 conn(0x7fa0e0153de0 legacy=0x7fa0e00ca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:14.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.664+0000 7fa0ddd9b640 1 -- 172.21.15.60:0/4182678208 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0e00c6e00 con 0x7fa0e006bbe0 2024-09-12T02:40:14.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.665+0000 7fa0ddd9b640 1 --2- 172.21.15.60:0/4182678208 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0e006bbe0 0x7fa0e006c020 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa0d40097a0 tx=0x7fa0d402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd78aebb464fe85d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:14.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.665+0000 7fa0dd59a640 1 -- 172.21.15.60:0/4182678208 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d4037070 con 0x7fa0e006bbe0 2024-09-12T02:40:14.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.665+0000 7fa0dd59a640 1 -- 172.21.15.60:0/4182678208 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0d4032440 con 0x7fa0e006bbe0 2024-09-12T02:40:14.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.665+0000 7fa0dd59a640 1 -- 172.21.15.60:0/4182678208 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d4032810 con 0x7fa0e006bbe0 2024-09-12T02:40:14.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.665+0000 7fa0e4dfd640 1 -- 172.21.15.60:0/4182678208 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0e006bbe0 msgr2=0x7fa0e006c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:14.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.665+0000 7fa0e4dfd640 1 --2- 172.21.15.60:0/4182678208 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0e006bbe0 0x7fa0e006c020 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa0d40097a0 tx=0x7fa0d402a180 comp rx=0 tx=0).stop 2024-09-12T02:40:14.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.665+0000 7fa0e4dfd640 1 -- 172.21.15.60:0/4182678208 shutdown_connections 2024-09-12T02:40:14.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.665+0000 7fa0e4dfd640 1 --2- 172.21.15.60:0/4182678208 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0e01598c0 0x7fa0e0159d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:14.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.665+0000 7fa0e4dfd640 1 --2- 172.21.15.60:0/4182678208 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0e006bbe0 0x7fa0e006c020 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:14.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.665+0000 7fa0e4dfd640 1 -- 172.21.15.60:0/4182678208 >> 172.21.15.60:0/4182678208 conn(0x7fa0e00c8800 msgr2=0x7fa0e00c8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:14.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.665+0000 7fa0e4dfd640 1 -- 172.21.15.60:0/4182678208 shutdown_connections 2024-09-12T02:40:14.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.665+0000 7fa0e4dfd640 1 -- 172.21.15.60:0/4182678208 wait complete. 2024-09-12T02:40:14.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.667+0000 7fa0e4dfd640 1 Processor -- start 2024-09-12T02:40:14.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.667+0000 7fa0e4dfd640 1 -- start start 2024-09-12T02:40:14.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.667+0000 7fa0e4dfd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0e006bbe0 0x7fa0e0158730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:14.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.667+0000 7fa0e4dfd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0e0153de0 0x7fa0e014b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:14.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.667+0000 7fa0e4dfd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0e01598c0 0x7fa0e014bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:14.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.667+0000 7fa0e4dfd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e00cbab0 con 0x7fa0e006bbe0 2024-09-12T02:40:14.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.667+0000 7fa0e4dfd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e006c560 con 0x7fa0e0153de0 2024-09-12T02:40:14.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.668+0000 7fa0e4dfd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa0e015a290 con 0x7fa0e01598c0 2024-09-12T02:40:14.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.668+0000 7fa0de59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0e006bbe0 0x7fa0e0158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:14.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.668+0000 7fa0de59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0e006bbe0 0x7fa0e0158730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40506/0 (socket says 172.21.15.60:40506) 2024-09-12T02:40:14.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.668+0000 7fa0de59c640 1 -- 172.21.15.60:0/2038266131 learned_addr learned my addr 172.21.15.60:0/2038266131 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:14.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.668+0000 7fa0ded9d640 1 --2- 172.21.15.60:0/2038266131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0e01598c0 0x7fa0e014bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:14.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.668+0000 7fa0ddd9b640 1 --2- 172.21.15.60:0/2038266131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0e0153de0 0x7fa0e014b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:14.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.668+0000 7fa0de59c640 1 -- 172.21.15.60:0/2038266131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0e01598c0 msgr2=0x7fa0e014bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:14.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.668+0000 7fa0de59c640 1 --2- 172.21.15.60:0/2038266131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0e01598c0 0x7fa0e014bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:14.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.668+0000 7fa0de59c640 1 -- 172.21.15.60:0/2038266131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0e0153de0 msgr2=0x7fa0e014b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:14.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.668+0000 7fa0de59c640 1 --2- 172.21.15.60:0/2038266131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0e0153de0 0x7fa0e014b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:14.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.668+0000 7fa0de59c640 1 -- 172.21.15.60:0/2038266131 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0e01f0350 con 0x7fa0e006bbe0 2024-09-12T02:40:14.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.668+0000 7fa0ded9d640 1 --2- 172.21.15.60:0/2038266131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0e01598c0 0x7fa0e014bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:40:14.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.668+0000 7fa0de59c640 1 --2- 172.21.15.60:0/2038266131 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0e006bbe0 0x7fa0e0158730 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa0d000c430 tx=0x7fa0d000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:14.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.668+0000 7fa0ceffd640 1 -- 172.21.15.60:0/2038266131 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d0017070 con 0x7fa0e006bbe0 2024-09-12T02:40:14.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.668+0000 7fa0ceffd640 1 -- 172.21.15.60:0/2038266131 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0d0005ce0 con 0x7fa0e006bbe0 2024-09-12T02:40:14.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.668+0000 7fa0e4dfd640 1 -- 172.21.15.60:0/2038266131 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0e00b1410 con 0x7fa0e006bbe0 2024-09-12T02:40:14.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.668+0000 7fa0ceffd640 1 -- 172.21.15.60:0/2038266131 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d00072f0 con 0x7fa0e006bbe0 2024-09-12T02:40:14.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.668+0000 7fa0e4dfd640 1 -- 172.21.15.60:0/2038266131 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0e00b19d0 con 0x7fa0e006bbe0 2024-09-12T02:40:14.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.669+0000 7fa0e4dfd640 1 -- 172.21.15.60:0/2038266131 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0e00c9600 con 0x7fa0e006bbe0 2024-09-12T02:40:14.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.670+0000 7fa0ceffd640 1 -- 172.21.15.60:0/2038266131 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa0d001a070 con 0x7fa0e006bbe0 2024-09-12T02:40:14.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.670+0000 7fa0ceffd640 1 --2- 172.21.15.60:0/2038266131 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa0c006be30 0x7fa0c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:14.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.671+0000 7fa0ddd9b640 1 --2- 172.21.15.60:0/2038266131 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa0c006be30 0x7fa0c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:14.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.671+0000 7fa0ceffd640 1 -- 172.21.15.60:0/2038266131 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fa0d008a640 con 0x7fa0e006bbe0 2024-09-12T02:40:14.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.671+0000 7fa0ddd9b640 1 --2- 172.21.15.60:0/2038266131 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa0c006be30 0x7fa0c006e2f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4034000 tx=0x7fa0d402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:14.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.675+0000 7fa0ceffd640 1 -- 172.21.15.60:0/2038266131 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa0d0058ce0 con 0x7fa0e006bbe0 2024-09-12T02:40:14.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.850+0000 7fa0e4dfd640 1 -- 172.21.15.60:0/2038266131 --> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fa0e00b1010 con 0x7fa0c006be30 2024-09-12T02:40:14.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.850+0000 7fa0ceffd640 1 -- 172.21.15.60:0/2038266131 <== mgr.4098 v2:172.21.15.60:6800/3549430091 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa0e00b1010 con 0x7fa0c006be30 2024-09-12T02:40:14.851 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T02:40:14.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.852+0000 7fa0e4dfd640 1 -- 172.21.15.60:0/2038266131 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa0c006be30 msgr2=0x7fa0c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:14.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.852+0000 7fa0e4dfd640 1 --2- 172.21.15.60:0/2038266131 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa0c006be30 0x7fa0c006e2f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4034000 tx=0x7fa0d402e000 comp rx=0 tx=0).stop 2024-09-12T02:40:14.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.852+0000 7fa0e4dfd640 1 -- 172.21.15.60:0/2038266131 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0e006bbe0 msgr2=0x7fa0e0158730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:14.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.852+0000 7fa0e4dfd640 1 --2- 172.21.15.60:0/2038266131 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0e006bbe0 0x7fa0e0158730 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa0d000c430 tx=0x7fa0d000c8f0 comp rx=0 tx=0).stop 2024-09-12T02:40:14.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.852+0000 7fa0e4dfd640 1 -- 172.21.15.60:0/2038266131 shutdown_connections 2024-09-12T02:40:14.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.852+0000 7fa0e4dfd640 1 --2- 172.21.15.60:0/2038266131 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa0c006be30 0x7fa0c006e2f0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:14.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.852+0000 7fa0e4dfd640 1 --2- 172.21.15.60:0/2038266131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0e01598c0 0x7fa0e014bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:14.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.852+0000 7fa0e4dfd640 1 --2- 172.21.15.60:0/2038266131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0e0153de0 0x7fa0e014b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:14.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.852+0000 7fa0e4dfd640 1 --2- 172.21.15.60:0/2038266131 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0e006bbe0 0x7fa0e0158730 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:14.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.852+0000 7fa0e4dfd640 1 -- 172.21.15.60:0/2038266131 >> 172.21.15.60:0/2038266131 conn(0x7fa0e00c8800 msgr2=0x7fa0e00ac160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:14.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.852+0000 7fa0e4dfd640 1 -- 172.21.15.60:0/2038266131 shutdown_connections 2024-09-12T02:40:14.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.852+0000 7fa0e4dfd640 1 -- 172.21.15.60:0/2038266131 wait complete. 2024-09-12T02:40:14.865 INFO:tasks.ceph:Scrubbing osd.3 2024-09-12T02:40:14.865 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:40:14.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.971+0000 7f7eb2166640 1 Processor -- start 2024-09-12T02:40:14.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.971+0000 7f7eb2166640 1 -- start start 2024-09-12T02:40:14.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.972+0000 7f7eb2166640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7eac153a40 0x7f7eac06c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:14.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.972+0000 7f7eb2166640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7eac156310 0x7f7eac1567c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:14.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.972+0000 7f7eb2166640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7eac159900 con 0x7f7eac06cbe0 2024-09-12T02:40:14.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.972+0000 7f7eb2166640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f7eac159be0 con 0x7f7eac156310 2024-09-12T02:40:14.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.972+0000 7f7eb2166640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7eac159ec0 con 0x7f7eac153a40 2024-09-12T02:40:14.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.972+0000 7f7eabfff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7eac156310 0x7f7eac1567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:14.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.972+0000 7f7eaaffd640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f7eac06cbe0 0x7f7eac0c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:42840/0 (socket says 172.21.15.60:42840) 2024-09-12T02:40:14.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.972+0000 7f7eabfff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7eac156310 0x7f7eac1567c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40522/0 (socket says 172.21.15.60:40522) 2024-09-12T02:40:14.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.972+0000 7f7eaaffd640 1 -- 172.21.15.60:0/3018721810 learned_addr learned my addr 172.21.15.60:0/3018721810 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:40:14.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.973+0000 7f7eab7fe640 1 --2- 172.21.15.60:0/3018721810 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7eac153a40 0x7f7eac06c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:14.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.973+0000 7f7eabfff640 1 -- 172.21.15.60:0/3018721810 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7eac153a40 msgr2=0x7f7eac06c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:14.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.973+0000 7f7eabfff640 1 --2- 172.21.15.60:0/3018721810 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7eac153a40 0x7f7eac06c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:14.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.973+0000 7f7eabfff640 1 -- 172.21.15.60:0/3018721810 >> v1:172.21.15.60:6789/0 conn(0x7f7eac06cbe0 legacy=0x7f7eac0c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:14.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.973+0000 7f7eabfff640 1 -- 172.21.15.60:0/3018721810 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eac15a1a0 con 0x7f7eac156310 2024-09-12T02:40:14.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.973+0000 7f7eaa7fc640 1 -- 172.21.15.60:0/3018721810 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3720295007 0 0) 0x7f7eac159900 con 0x7f7eac06cbe0 2024-09-12T02:40:14.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.973+0000 7f7eab7fe640 1 --2- 172.21.15.60:0/3018721810 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7eac153a40 0x7f7eac06c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:40:14.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.973+0000 7f7eabfff640 1 --2- 172.21.15.60:0/3018721810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7eac156310 0x7f7eac1567c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4009d90 tx=0x7f7ea402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4d3253dd11a4498 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:14.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.974+0000 7f7eaa7fc640 1 -- 172.21.15.60:0/3018721810 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea4007740 con 0x7f7eac156310 2024-09-12T02:40:14.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.974+0000 7f7eaa7fc640 1 -- 172.21.15.60:0/3018721810 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ea40078e0 con 0x7f7eac156310 2024-09-12T02:40:14.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.974+0000 7f7eaa7fc640 1 -- 172.21.15.60:0/3018721810 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea4007cb0 con 0x7f7eac156310 2024-09-12T02:40:14.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.974+0000 7f7eb2166640 1 -- 172.21.15.60:0/3018721810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7eac156310 msgr2=0x7f7eac1567c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:14.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.974+0000 7f7eb2166640 1 --2- 172.21.15.60:0/3018721810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7eac156310 0x7f7eac1567c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4009d90 tx=0x7f7ea402a660 comp rx=0 tx=0).stop 2024-09-12T02:40:14.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.974+0000 7f7eb2166640 1 -- 172.21.15.60:0/3018721810 shutdown_connections 2024-09-12T02:40:14.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.974+0000 7f7eb2166640 1 --2- 172.21.15.60:0/3018721810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7eac156310 0x7f7eac1567c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:14.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.974+0000 7f7eb2166640 1 --2- 172.21.15.60:0/3018721810 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7eac153a40 0x7f7eac06c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:14.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.974+0000 7f7eb2166640 1 -- 172.21.15.60:0/3018721810 >> 172.21.15.60:0/3018721810 conn(0x7f7eac073310 msgr2=0x7f7eac0736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:14.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.974+0000 7f7eb2166640 1 -- 172.21.15.60:0/3018721810 shutdown_connections 2024-09-12T02:40:14.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.974+0000 7f7eb2166640 1 -- 172.21.15.60:0/3018721810 wait complete. 2024-09-12T02:40:14.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.975+0000 7f7eb2166640 1 Processor -- start 2024-09-12T02:40:14.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.976+0000 7f7eb2166640 1 -- start start 2024-09-12T02:40:14.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.976+0000 7f7eb2166640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7eac06cbe0 0x7f7eac0accb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:14.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.976+0000 7f7eb2166640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7eac153a40 0x7f7eac0aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:14.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.976+0000 7f7eb2166640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7eac156310 0x7f7eac0af060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:14.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.976+0000 7f7eb2166640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7eac153e20 con 0x7f7eac06cbe0 2024-09-12T02:40:14.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.976+0000 7f7eb2166640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7eac0c9270 con 0x7f7eac156310 2024-09-12T02:40:14.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.976+0000 7f7eb2166640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7eac153fa0 con 0x7f7eac153a40 2024-09-12T02:40:14.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.976+0000 7f7eab7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7eac06cbe0 0x7f7eac0accb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:14.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.976+0000 7f7eab7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7eac06cbe0 0x7f7eac0accb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40532/0 (socket says 172.21.15.60:40532) 2024-09-12T02:40:14.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.976+0000 7f7eab7fe640 1 -- 172.21.15.60:0/2699462213 learned_addr learned my addr 172.21.15.60:0/2699462213 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:14.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.977+0000 7f7eaaffd640 1 --2- 172.21.15.60:0/2699462213 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7eac153a40 0x7f7eac0aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:14.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.977+0000 7f7eabfff640 1 --2- 172.21.15.60:0/2699462213 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7eac156310 0x7f7eac0af060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:14.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.977+0000 7f7eab7fe640 1 -- 172.21.15.60:0/2699462213 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7eac153a40 msgr2=0x7f7eac0aeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:14.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.977+0000 7f7eab7fe640 1 --2- 172.21.15.60:0/2699462213 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7eac153a40 0x7f7eac0aeb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:14.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.977+0000 7f7eab7fe640 1 -- 172.21.15.60:0/2699462213 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7eac156310 msgr2=0x7f7eac0af060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:14.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.977+0000 7f7eab7fe640 1 --2- 172.21.15.60:0/2699462213 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7eac156310 0x7f7eac0af060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:14.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.977+0000 7f7eab7fe640 1 -- 172.21.15.60:0/2699462213 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eac159760 con 0x7f7eac06cbe0 2024-09-12T02:40:14.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.977+0000 7f7eab7fe640 1 --2- 172.21.15.60:0/2699462213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7eac06cbe0 0x7f7eac0accb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c00d7d0 tx=0x7f7e9c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:14.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.977+0000 7f7e93fff640 1 -- 172.21.15.60:0/2699462213 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c004030 con 0x7f7eac06cbe0 2024-09-12T02:40:14.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.977+0000 7f7e93fff640 1 -- 172.21.15.60:0/2699462213 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e9c0041d0 con 0x7f7eac06cbe0 2024-09-12T02:40:14.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.977+0000 7f7eb2166640 1 -- 172.21.15.60:0/2699462213 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7eac0b0d10 con 0x7f7eac06cbe0 2024-09-12T02:40:14.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.977+0000 7f7e93fff640 1 -- 172.21.15.60:0/2699462213 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c0096a0 con 0x7f7eac06cbe0 2024-09-12T02:40:14.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.977+0000 7f7eb2166640 1 -- 172.21.15.60:0/2699462213 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7eac0c5bb0 con 0x7f7eac06cbe0 2024-09-12T02:40:14.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.978+0000 7f7eb2166640 1 -- 172.21.15.60:0/2699462213 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7eac06c6a0 con 0x7f7eac06cbe0 2024-09-12T02:40:14.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.979+0000 7f7e93fff640 1 -- 172.21.15.60:0/2699462213 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7e9c009840 con 0x7f7eac06cbe0 2024-09-12T02:40:14.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.979+0000 7f7e93fff640 1 --2- 172.21.15.60:0/2699462213 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f7e9806be30 0x7f7e9806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:14.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.979+0000 7f7e93fff640 1 -- 172.21.15.60:0/2699462213 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f7e9c08b400 con 0x7f7eac06cbe0 2024-09-12T02:40:14.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.979+0000 7f7eaaffd640 1 --2- 172.21.15.60:0/2699462213 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f7e9806be30 0x7f7e9806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:14.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.979+0000 7f7e93fff640 1 --2- 172.21.15.60:0/2699462213 >> [v2:172.21.15.60:6802/3606424156,v1:172.21.15.60:6803/3606424156] conn(0x7f7e980767d0 0x7f7e98078c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:14.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.979+0000 7f7e93fff640 1 -- 172.21.15.60:0/2699462213 --> [v2:172.21.15.60:6802/3606424156,v1:172.21.15.60:6803/3606424156] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7e9c01de50 con 0x7f7e980767d0 2024-09-12T02:40:14.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.979+0000 7f7e93fff640 1 -- 172.21.15.60:0/2699462213 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7e9c092050 con 0x7f7eac06cbe0 2024-09-12T02:40:14.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.980+0000 7f7eabfff640 1 --2- 172.21.15.60:0/2699462213 >> [v2:172.21.15.60:6802/3606424156,v1:172.21.15.60:6803/3606424156] conn(0x7f7e980767d0 0x7f7e98078c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:14.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.980+0000 7f7eaaffd640 1 --2- 172.21.15.60:0/2699462213 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f7e9806be30 0x7f7e9806e2f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f7eac14ffc0 tx=0x7f7ea0007c00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:14.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.980+0000 7f7eabfff640 1 --2- 172.21.15.60:0/2699462213 >> [v2:172.21.15.60:6802/3606424156,v1:172.21.15.60:6803/3606424156] conn(0x7f7e980767d0 0x7f7e98078c50 crc :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:14.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.981+0000 7f7e93fff640 1 -- 172.21.15.60:0/2699462213 <== osd.3 v2:172.21.15.60:6802/3606424156 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7e9c01de50 con 0x7f7e980767d0 2024-09-12T02:40:14.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.993+0000 7f7eb2166640 1 -- 172.21.15.60:0/2699462213 --> [v2:172.21.15.60:6802/3606424156,v1:172.21.15.60:6803/3606424156] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7eac1ec090 con 0x7f7e980767d0 2024-09-12T02:40:14.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.994+0000 7f7e93fff640 1 -- 172.21.15.60:0/2699462213 <== osd.3 v2:172.21.15.60:6802/3606424156 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7eac1ec090 con 0x7f7e980767d0 2024-09-12T02:40:14.994 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:40:14.995 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T02:40:14.995 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:40:14.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.994+0000 7f7eb2166640 1 -- 172.21.15.60:0/2699462213 >> [v2:172.21.15.60:6802/3606424156,v1:172.21.15.60:6803/3606424156] conn(0x7f7e980767d0 msgr2=0x7f7e98078c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:14.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.994+0000 7f7eb2166640 1 --2- 172.21.15.60:0/2699462213 >> [v2:172.21.15.60:6802/3606424156,v1:172.21.15.60:6803/3606424156] conn(0x7f7e980767d0 0x7f7e98078c50 crc :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:14.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.994+0000 7f7eb2166640 1 -- 172.21.15.60:0/2699462213 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f7e9806be30 msgr2=0x7f7e9806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:14.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.994+0000 7f7eb2166640 1 --2- 172.21.15.60:0/2699462213 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f7e9806be30 0x7f7e9806e2f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f7eac14ffc0 tx=0x7f7ea0007c00 comp rx=0 tx=0).stop 2024-09-12T02:40:14.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.994+0000 7f7eb2166640 1 -- 172.21.15.60:0/2699462213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7eac06cbe0 msgr2=0x7f7eac0accb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:14.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.994+0000 7f7eb2166640 1 --2- 172.21.15.60:0/2699462213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7eac06cbe0 0x7f7eac0accb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c00d7d0 tx=0x7f7e9c00dc90 comp rx=0 tx=0).stop 2024-09-12T02:40:14.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.994+0000 7f7eabfff640 1 -- 172.21.15.60:0/2699462213 reap_dead start 2024-09-12T02:40:14.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.994+0000 7f7eb2166640 1 -- 172.21.15.60:0/2699462213 shutdown_connections 2024-09-12T02:40:14.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.994+0000 7f7eb2166640 1 -- 172.21.15.60:0/2699462213 >> 172.21.15.60:0/2699462213 conn(0x7f7eac073310 msgr2=0x7f7eac150230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:14.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.994+0000 7f7eb2166640 1 -- 172.21.15.60:0/2699462213 shutdown_connections 2024-09-12T02:40:14.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:14.994+0000 7f7eb2166640 1 -- 172.21.15.60:0/2699462213 wait complete. 2024-09-12T02:40:15.005 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-12T02:40:15.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.108+0000 7fa4b49b7640 1 Processor -- start 2024-09-12T02:40:15.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.108+0000 7fa4b49b7640 1 -- start start 2024-09-12T02:40:15.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.109+0000 7fa4b49b7640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa4b006bbe0 0x7fa4b006c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:15.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.109+0000 7fa4b49b7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4b01598c0 0x7fa4b0159d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:15.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.109+0000 7fa4b49b7640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4b00c6b20 con 0x7fa4b0153de0 2024-09-12T02:40:15.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.109+0000 7fa4b49b7640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fa4b00c9480 con 0x7fa4b006bbe0 2024-09-12T02:40:15.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.109+0000 7fa4b49b7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa4b00cb620 con 0x7fa4b01598c0 2024-09-12T02:40:15.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.109+0000 7fa4ae59c640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa4b0153de0 0x7fa4b00ca640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:42842/0 (socket says 172.21.15.60:42842) 2024-09-12T02:40:15.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.109+0000 7fa4ae59c640 1 -- 172.21.15.60:0/4171342061 learned_addr learned my addr 172.21.15.60:0/4171342061 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:40:15.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.110+0000 7fa4aed9d640 1 --2- 172.21.15.60:0/4171342061 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4b01598c0 0x7fa4b0159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:15.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.110+0000 7fa4add9b640 1 --2- 172.21.15.60:0/4171342061 >> v2:172.21.15.105:3300/0 conn(0x7fa4b006bbe0 0x7fa4b006c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:15.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.110+0000 7fa4ad59a640 1 -- 172.21.15.60:0/4171342061 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 942399949 0 0) 0x7fa4b00c6b20 con 0x7fa4b0153de0 2024-09-12T02:40:15.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.110+0000 7fa4ad59a640 1 -- 172.21.15.60:0/4171342061 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa49c003520 con 0x7fa4b0153de0 2024-09-12T02:40:15.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.110+0000 7fa4ad59a640 1 -- 172.21.15.60:0/4171342061 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1352139014 0 0) 0x7fa49c003520 con 0x7fa4b0153de0 2024-09-12T02:40:15.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.110+0000 7fa4ad59a640 1 -- 172.21.15.60:0/4171342061 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4b01598c0 msgr2=0x7fa4b0159d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:15.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.110+0000 7fa4ad59a640 1 --2- 172.21.15.60:0/4171342061 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4b01598c0 0x7fa4b0159d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:15.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.110+0000 7fa4ad59a640 1 -- 172.21.15.60:0/4171342061 >> v2:172.21.15.105:3300/0 conn(0x7fa4b006bbe0 msgr2=0x7fa4b006c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:15.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.110+0000 7fa4ad59a640 1 --2- 172.21.15.60:0/4171342061 >> v2:172.21.15.105:3300/0 conn(0x7fa4b006bbe0 0x7fa4b006c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:15.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.110+0000 7fa4ad59a640 1 -- 172.21.15.60:0/4171342061 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4b00c6e00 con 0x7fa4b0153de0 2024-09-12T02:40:15.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.110+0000 7fa4ad59a640 1 -- 172.21.15.60:0/4171342061 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7fa4a00019f0 con 0x7fa4b0153de0 2024-09-12T02:40:15.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.110+0000 7fa4ad59a640 1 -- 172.21.15.60:0/4171342061 >> v1:172.21.15.60:6789/0 conn(0x7fa4b0153de0 legacy=0x7fa4b00ca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:15.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.110+0000 7fa4ad59a640 1 --2- 172.21.15.60:0/4171342061 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4b01598c0 0x7fa49c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:15.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.110+0000 7fa4ad59a640 1 --2- 172.21.15.60:0/4171342061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa49c003f30 0x7fa49c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:15.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.110+0000 7fa4ad59a640 1 --2- 172.21.15.60:0/4171342061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa49c004d40 0x7fa49c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:15.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.110+0000 7fa4ad59a640 1 -- 172.21.15.60:0/4171342061 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b00c9480 con 0x7fa49c003f30 2024-09-12T02:40:15.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.110+0000 7fa4ad59a640 1 -- 172.21.15.60:0/4171342061 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b00cb620 con 0x7fa49c004d40 2024-09-12T02:40:15.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.110+0000 7fa4ad59a640 1 -- 172.21.15.60:0/4171342061 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa49c00b9c0 con 0x7fa4b01598c0 2024-09-12T02:40:15.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.110+0000 7fa4add9b640 1 --2- 172.21.15.60:0/4171342061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa49c003f30 0x7fa49c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:15.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.110+0000 7fa4ae59c640 1 --2- 172.21.15.60:0/4171342061 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4b01598c0 0x7fa49c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:15.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.110+0000 7fa4aed9d640 1 --2- 172.21.15.60:0/4171342061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa49c004d40 0x7fa49c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:15.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.110+0000 7fa4add9b640 1 -- 172.21.15.60:0/4171342061 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4b01598c0 msgr2=0x7fa49c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:15.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.110+0000 7fa4add9b640 1 --2- 172.21.15.60:0/4171342061 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4b01598c0 0x7fa49c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:15.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.110+0000 7fa4add9b640 1 -- 172.21.15.60:0/4171342061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa49c004d40 msgr2=0x7fa49c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:15.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.111+0000 7fa4add9b640 1 --2- 172.21.15.60:0/4171342061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa49c004d40 0x7fa49c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:15.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.111+0000 7fa4add9b640 1 -- 172.21.15.60:0/4171342061 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa49c003520 con 0x7fa49c003f30 2024-09-12T02:40:15.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.111+0000 7fa4ae59c640 1 --2- 172.21.15.60:0/4171342061 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4b01598c0 0x7fa49c0039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:40:15.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.111+0000 7fa4add9b640 1 --2- 172.21.15.60:0/4171342061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa49c003f30 0x7fa49c004800 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa498009ac0 tx=0x7fa49c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2141f00cdae66e86 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:15.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.111+0000 7fa4ad59a640 1 -- 172.21.15.60:0/4171342061 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa498036070 con 0x7fa49c003f30 2024-09-12T02:40:15.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.111+0000 7fa4ad59a640 1 -- 172.21.15.60:0/4171342061 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa498031400 con 0x7fa49c003f30 2024-09-12T02:40:15.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.111+0000 7fa4ad59a640 1 -- 172.21.15.60:0/4171342061 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa498009690 con 0x7fa49c003f30 2024-09-12T02:40:15.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.112+0000 7fa4b49b7640 1 -- 172.21.15.60:0/4171342061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa49c003f30 msgr2=0x7fa49c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:15.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.112+0000 7fa4b49b7640 1 --2- 172.21.15.60:0/4171342061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa49c003f30 0x7fa49c004800 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa498009ac0 tx=0x7fa49c005830 comp rx=0 tx=0).stop 2024-09-12T02:40:15.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.112+0000 7fa4aed9d640 1 -- 172.21.15.60:0/4171342061 reap_dead start 2024-09-12T02:40:15.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.112+0000 7fa4b49b7640 1 -- 172.21.15.60:0/4171342061 shutdown_connections 2024-09-12T02:40:15.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.112+0000 7fa4b49b7640 1 -- 172.21.15.60:0/4171342061 >> 172.21.15.60:0/4171342061 conn(0x7fa4b00c8800 msgr2=0x7fa4b00c8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:15.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.112+0000 7fa4b49b7640 1 -- 172.21.15.60:0/4171342061 shutdown_connections 2024-09-12T02:40:15.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.112+0000 7fa4b49b7640 1 -- 172.21.15.60:0/4171342061 wait complete. 2024-09-12T02:40:15.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.113+0000 7fa4b49b7640 1 Processor -- start 2024-09-12T02:40:15.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.113+0000 7fa4b49b7640 1 -- start start 2024-09-12T02:40:15.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.114+0000 7fa4b49b7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa49c003f30 0x7fa4b01475e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:15.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.114+0000 7fa4b49b7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4b01e21b0 0x7fa4b01e00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:15.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.114+0000 7fa4b49b7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4b0151af0 0x7fa4b0151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:15.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.114+0000 7fa4b49b7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b00cbab0 con 0x7fa4b0151af0 2024-09-12T02:40:15.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.114+0000 7fa4b49b7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b006c560 con 0x7fa4b01e21b0 2024-09-12T02:40:15.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.114+0000 7fa4b49b7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa4b0159d50 con 0x7fa49c003f30 2024-09-12T02:40:15.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.114+0000 7fa4aed9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4b0151af0 0x7fa4b0151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:15.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.114+0000 7fa4aed9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4b0151af0 0x7fa4b0151f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40554/0 (socket says 172.21.15.60:40554) 2024-09-12T02:40:15.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.114+0000 7fa4aed9d640 1 -- 172.21.15.60:0/3695353316 learned_addr learned my addr 172.21.15.60:0/3695353316 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:15.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.114+0000 7fa4add9b640 1 --2- 172.21.15.60:0/3695353316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4b01e21b0 0x7fa4b01e00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:15.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.114+0000 7fa4ae59c640 1 --2- 172.21.15.60:0/3695353316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa49c003f30 0x7fa4b01475e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:15.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.114+0000 7fa4aed9d640 1 -- 172.21.15.60:0/3695353316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa49c003f30 msgr2=0x7fa4b01475e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:15.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.114+0000 7fa4aed9d640 1 --2- 172.21.15.60:0/3695353316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa49c003f30 0x7fa4b01475e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:15.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.114+0000 7fa4aed9d640 1 -- 172.21.15.60:0/3695353316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4b01e21b0 msgr2=0x7fa4b01e00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:15.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.114+0000 7fa4aed9d640 1 --2- 172.21.15.60:0/3695353316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4b01e21b0 0x7fa4b01e00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:15.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.115+0000 7fa4aed9d640 1 -- 172.21.15.60:0/3695353316 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4b01535f0 con 0x7fa4b0151af0 2024-09-12T02:40:15.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.115+0000 7fa4aed9d640 1 --2- 172.21.15.60:0/3695353316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4b0151af0 0x7fa4b0151f70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa4b00cb7a0 tx=0x7fa4a8011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:15.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.115+0000 7fa4a6ffd640 1 -- 172.21.15.60:0/3695353316 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a8019020 con 0x7fa4b0151af0 2024-09-12T02:40:15.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.115+0000 7fa4a6ffd640 1 -- 172.21.15.60:0/3695353316 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4a8004240 con 0x7fa4b0151af0 2024-09-12T02:40:15.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.115+0000 7fa4b49b7640 1 -- 172.21.15.60:0/3695353316 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4b01dfa60 con 0x7fa4b0151af0 2024-09-12T02:40:15.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.115+0000 7fa4a6ffd640 1 -- 172.21.15.60:0/3695353316 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a000a4c0 con 0x7fa4b0151af0 2024-09-12T02:40:15.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.115+0000 7fa4b49b7640 1 -- 172.21.15.60:0/3695353316 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4b01595d0 con 0x7fa4b0151af0 2024-09-12T02:40:15.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.116+0000 7fa4b49b7640 1 -- 172.21.15.60:0/3695353316 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4b00ac810 con 0x7fa4b0151af0 2024-09-12T02:40:15.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.116+0000 7fa4a6ffd640 1 -- 172.21.15.60:0/3695353316 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa4a801c020 con 0x7fa4b0151af0 2024-09-12T02:40:15.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.117+0000 7fa4a6ffd640 1 --2- 172.21.15.60:0/3695353316 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa49006be30 0x7fa49006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:15.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.117+0000 7fa4ae59c640 1 --2- 172.21.15.60:0/3695353316 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa49006be30 0x7fa49006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:15.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.117+0000 7fa4a6ffd640 1 -- 172.21.15.60:0/3695353316 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fa4a808b200 con 0x7fa4b0151af0 2024-09-12T02:40:15.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.117+0000 7fa4ae59c640 1 --2- 172.21.15.60:0/3695353316 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa49006be30 0x7fa49006e2f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0001330 tx=0x7fa4a0006040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:15.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.121+0000 7fa4a6ffd640 1 -- 172.21.15.60:0/3695353316 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa4b00ac810 con 0x7fa4b0151af0 2024-09-12T02:40:15.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.295+0000 7fa4b49b7640 1 -- 172.21.15.60:0/3695353316 --> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fa4b0152de0 con 0x7fa49006be30 2024-09-12T02:40:15.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.296+0000 7fa4a6ffd640 1 -- 172.21.15.60:0/3695353316 <== mgr.4098 v2:172.21.15.60:6800/3549430091 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa4b0152de0 con 0x7fa49006be30 2024-09-12T02:40:15.297 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 3 to deep-scrub 2024-09-12T02:40:15.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.298+0000 7fa4b49b7640 1 -- 172.21.15.60:0/3695353316 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa49006be30 msgr2=0x7fa49006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:15.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.298+0000 7fa4b49b7640 1 --2- 172.21.15.60:0/3695353316 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa49006be30 0x7fa49006e2f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0001330 tx=0x7fa4a0006040 comp rx=0 tx=0).stop 2024-09-12T02:40:15.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.298+0000 7fa4b49b7640 1 -- 172.21.15.60:0/3695353316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4b0151af0 msgr2=0x7fa4b0151f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:15.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.298+0000 7fa4b49b7640 1 --2- 172.21.15.60:0/3695353316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4b0151af0 0x7fa4b0151f70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa4b00cb7a0 tx=0x7fa4a8011cf0 comp rx=0 tx=0).stop 2024-09-12T02:40:15.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.298+0000 7fa4b49b7640 1 -- 172.21.15.60:0/3695353316 shutdown_connections 2024-09-12T02:40:15.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.298+0000 7fa4b49b7640 1 --2- 172.21.15.60:0/3695353316 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa49006be30 0x7fa49006e2f0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:15.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.298+0000 7fa4b49b7640 1 --2- 172.21.15.60:0/3695353316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4b0151af0 0x7fa4b0151f70 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:15.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.298+0000 7fa4b49b7640 1 --2- 172.21.15.60:0/3695353316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4b01e21b0 0x7fa4b01e00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:15.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.298+0000 7fa4b49b7640 1 --2- 172.21.15.60:0/3695353316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa49c003f30 0x7fa4b01475e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:15.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.298+0000 7fa4b49b7640 1 -- 172.21.15.60:0/3695353316 >> 172.21.15.60:0/3695353316 conn(0x7fa4b00c8800 msgr2=0x7fa4b014eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:15.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.299+0000 7fa4b49b7640 1 -- 172.21.15.60:0/3695353316 shutdown_connections 2024-09-12T02:40:15.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.299+0000 7fa4b49b7640 1 -- 172.21.15.60:0/3695353316 wait complete. 2024-09-12T02:40:15.310 INFO:tasks.ceph:Scrubbing osd.4 2024-09-12T02:40:15.310 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:40:15.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.417+0000 7fbb70398640 1 Processor -- start 2024-09-12T02:40:15.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.417+0000 7fbb70398640 1 -- start start 2024-09-12T02:40:15.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.418+0000 7fbb70398640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbb680684f0 0x7fbb681536d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:15.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.418+0000 7fbb70398640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbb68153c10 0x7fbb68156290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:15.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.418+0000 7fbb70398640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb6806c480 con 0x7fbb680c6960 2024-09-12T02:40:15.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.418+0000 7fbb70398640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fbb6806c230 con 0x7fbb68153c10 2024-09-12T02:40:15.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.418+0000 7fbb70398640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fbb6806cdb0 con 0x7fbb680684f0 2024-09-12T02:40:15.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.418+0000 7fbb6e935640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbb68153c10 0x7fbb68156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:15.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.418+0000 7fbb6e134640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fbb680c6960 0x7fbb680c9c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:42850/0 (socket says 172.21.15.60:42850) 2024-09-12T02:40:15.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.418+0000 7fbb6e935640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbb68153c10 0x7fbb68156290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40570/0 (socket says 172.21.15.60:40570) 2024-09-12T02:40:15.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.418+0000 7fbb6e134640 1 -- 172.21.15.60:0/1950988521 learned_addr learned my addr 172.21.15.60:0/1950988521 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:40:15.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.418+0000 7fbb6d933640 1 --2- 172.21.15.60:0/1950988521 >> v2:172.21.15.105:3300/0 conn(0x7fbb680684f0 0x7fbb681536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:15.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.419+0000 7fbb6e935640 1 -- 172.21.15.60:0/1950988521 >> v2:172.21.15.105:3300/0 conn(0x7fbb680684f0 msgr2=0x7fbb681536d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:15.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.419+0000 7fbb6e935640 1 --2- 172.21.15.60:0/1950988521 >> v2:172.21.15.105:3300/0 conn(0x7fbb680684f0 0x7fbb681536d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:15.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.419+0000 7fbb6e935640 1 -- 172.21.15.60:0/1950988521 >> v1:172.21.15.60:6789/0 conn(0x7fbb680c6960 legacy=0x7fbb680c9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:15.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.419+0000 7fbb6e935640 1 -- 172.21.15.60:0/1950988521 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb6806c760 con 0x7fbb68153c10 2024-09-12T02:40:15.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.419+0000 7fbb6d132640 1 -- 172.21.15.60:0/1950988521 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3813981519 0 0) 0x7fbb6806c480 con 0x7fbb680c6960 2024-09-12T02:40:15.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.419+0000 7fbb6e935640 1 --2- 172.21.15.60:0/1950988521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb68153c10 0x7fbb68156290 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbb680b2060 tx=0x7fbb5802a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be5d1cd7acafaee5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:15.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.420+0000 7fbb6d132640 1 -- 172.21.15.60:0/1950988521 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb58007740 con 0x7fbb68153c10 2024-09-12T02:40:15.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.420+0000 7fbb6d132640 1 -- 172.21.15.60:0/1950988521 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb580078e0 con 0x7fbb68153c10 2024-09-12T02:40:15.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.420+0000 7fbb6d132640 1 -- 172.21.15.60:0/1950988521 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb58007cb0 con 0x7fbb68153c10 2024-09-12T02:40:15.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.420+0000 7fbb70398640 1 -- 172.21.15.60:0/1950988521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb68153c10 msgr2=0x7fbb68156290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:15.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.420+0000 7fbb70398640 1 --2- 172.21.15.60:0/1950988521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb68153c10 0x7fbb68156290 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbb680b2060 tx=0x7fbb5802a560 comp rx=0 tx=0).stop 2024-09-12T02:40:15.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.420+0000 7fbb70398640 1 -- 172.21.15.60:0/1950988521 shutdown_connections 2024-09-12T02:40:15.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.420+0000 7fbb70398640 1 --2- 172.21.15.60:0/1950988521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb68153c10 0x7fbb68156290 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:15.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.420+0000 7fbb70398640 1 --2- 172.21.15.60:0/1950988521 >> v2:172.21.15.105:3300/0 conn(0x7fbb680684f0 0x7fbb681536d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:15.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.420+0000 7fbb70398640 1 -- 172.21.15.60:0/1950988521 >> 172.21.15.60:0/1950988521 conn(0x7fbb680c87f0 msgr2=0x7fbb680c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:15.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.420+0000 7fbb70398640 1 -- 172.21.15.60:0/1950988521 shutdown_connections 2024-09-12T02:40:15.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.420+0000 7fbb70398640 1 -- 172.21.15.60:0/1950988521 wait complete. 2024-09-12T02:40:15.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.421+0000 7fbb70398640 1 Processor -- start 2024-09-12T02:40:15.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.422+0000 7fbb70398640 1 -- start start 2024-09-12T02:40:15.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.422+0000 7fbb70398640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb680684f0 0x7fbb6814aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:15.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.422+0000 7fbb70398640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb680c6960 0x7fbb68155340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:15.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.422+0000 7fbb70398640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb68153c10 0x7fbb68145530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:15.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.422+0000 7fbb70398640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbb680c6ec0 con 0x7fbb68153c10 2024-09-12T02:40:15.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.422+0000 7fbb70398640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbb680c6d40 con 0x7fbb680c6960 2024-09-12T02:40:15.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.422+0000 7fbb70398640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbb681567d0 con 0x7fbb680684f0 2024-09-12T02:40:15.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.422+0000 7fbb6e935640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb68153c10 0x7fbb68145530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:15.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.422+0000 7fbb6e935640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb68153c10 0x7fbb68145530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40572/0 (socket says 172.21.15.60:40572) 2024-09-12T02:40:15.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.422+0000 7fbb6e935640 1 -- 172.21.15.60:0/3072065207 learned_addr learned my addr 172.21.15.60:0/3072065207 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:15.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.422+0000 7fbb6e134640 1 --2- 172.21.15.60:0/3072065207 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb680684f0 0x7fbb6814aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:15.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.422+0000 7fbb6d933640 1 --2- 172.21.15.60:0/3072065207 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb680c6960 0x7fbb68155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:15.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.423+0000 7fbb6e935640 1 -- 172.21.15.60:0/3072065207 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb680684f0 msgr2=0x7fbb6814aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:15.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.423+0000 7fbb6e935640 1 --2- 172.21.15.60:0/3072065207 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb680684f0 0x7fbb6814aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:15.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.423+0000 7fbb6e935640 1 -- 172.21.15.60:0/3072065207 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb680c6960 msgr2=0x7fbb68155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:15.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.423+0000 7fbb6e935640 1 --2- 172.21.15.60:0/3072065207 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb680c6960 0x7fbb68155340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:15.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.423+0000 7fbb6e935640 1 -- 172.21.15.60:0/3072065207 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb6814b400 con 0x7fbb68153c10 2024-09-12T02:40:15.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.423+0000 7fbb6e935640 1 --2- 172.21.15.60:0/3072065207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb68153c10 0x7fbb68145530 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbb58009e80 tx=0x7fbb58004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:15.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.423+0000 7fbb66ffd640 1 -- 172.21.15.60:0/3072065207 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5803f070 con 0x7fbb68153c10 2024-09-12T02:40:15.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.423+0000 7fbb66ffd640 1 -- 172.21.15.60:0/3072065207 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb58031c40 con 0x7fbb68153c10 2024-09-12T02:40:15.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.423+0000 7fbb66ffd640 1 -- 172.21.15.60:0/3072065207 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb58009450 con 0x7fbb68153c10 2024-09-12T02:40:15.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.423+0000 7fbb70398640 1 -- 172.21.15.60:0/3072065207 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb681eebd0 con 0x7fbb68153c10 2024-09-12T02:40:15.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.423+0000 7fbb70398640 1 -- 172.21.15.60:0/3072065207 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb681ef190 con 0x7fbb68153c10 2024-09-12T02:40:15.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.424+0000 7fbb70398640 1 -- 172.21.15.60:0/3072065207 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbb68156bc0 con 0x7fbb68153c10 2024-09-12T02:40:15.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.425+0000 7fbb66ffd640 1 -- 172.21.15.60:0/3072065207 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbb58003990 con 0x7fbb68153c10 2024-09-12T02:40:15.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.425+0000 7fbb66ffd640 1 --2- 172.21.15.60:0/3072065207 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbb5406be30 0x7fbb5406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:15.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.425+0000 7fbb66ffd640 1 -- 172.21.15.60:0/3072065207 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fbb580ac270 con 0x7fbb68153c10 2024-09-12T02:40:15.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.425+0000 7fbb6e134640 1 --2- 172.21.15.60:0/3072065207 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbb5406be30 0x7fbb5406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:15.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.425+0000 7fbb66ffd640 1 --2- 172.21.15.60:0/3072065207 >> [v2:172.21.15.105:6808/1581641129,v1:172.21.15.105:6809/1581641129] conn(0x7fbb540767c0 0x7fbb54078c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:15.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.425+0000 7fbb66ffd640 1 -- 172.21.15.60:0/3072065207 --> [v2:172.21.15.105:6808/1581641129,v1:172.21.15.105:6809/1581641129] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbb58032e50 con 0x7fbb540767c0 2024-09-12T02:40:15.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.425+0000 7fbb66ffd640 1 -- 172.21.15.60:0/3072065207 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbb580b3050 con 0x7fbb68153c10 2024-09-12T02:40:15.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.425+0000 7fbb6d933640 1 --2- 172.21.15.60:0/3072065207 >> [v2:172.21.15.105:6808/1581641129,v1:172.21.15.105:6809/1581641129] conn(0x7fbb540767c0 0x7fbb54078c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:15.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.426+0000 7fbb6e134640 1 --2- 172.21.15.60:0/3072065207 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbb5406be30 0x7fbb5406e2f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fbb60000f60 tx=0x7fbb60009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:15.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.426+0000 7fbb6d933640 1 --2- 172.21.15.60:0/3072065207 >> [v2:172.21.15.105:6808/1581641129,v1:172.21.15.105:6809/1581641129] conn(0x7fbb540767c0 0x7fbb54078c40 crc :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:15.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.427+0000 7fbb66ffd640 1 -- 172.21.15.60:0/3072065207 <== osd.4 v2:172.21.15.105:6808/1581641129 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbb58032e50 con 0x7fbb540767c0 2024-09-12T02:40:15.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.439+0000 7fbb70398640 1 -- 172.21.15.60:0/3072065207 --> [v2:172.21.15.105:6808/1581641129,v1:172.21.15.105:6809/1581641129] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbb680c95f0 con 0x7fbb540767c0 2024-09-12T02:40:15.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.440+0000 7fbb66ffd640 1 -- 172.21.15.60:0/3072065207 <== osd.4 v2:172.21.15.105:6808/1581641129 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbb680c95f0 con 0x7fbb540767c0 2024-09-12T02:40:15.441 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:40:15.441 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T02:40:15.441 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:40:15.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.440+0000 7fbb70398640 1 -- 172.21.15.60:0/3072065207 >> [v2:172.21.15.105:6808/1581641129,v1:172.21.15.105:6809/1581641129] conn(0x7fbb540767c0 msgr2=0x7fbb54078c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:15.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.440+0000 7fbb70398640 1 --2- 172.21.15.60:0/3072065207 >> [v2:172.21.15.105:6808/1581641129,v1:172.21.15.105:6809/1581641129] conn(0x7fbb540767c0 0x7fbb54078c40 crc :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:15.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.440+0000 7fbb70398640 1 -- 172.21.15.60:0/3072065207 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbb5406be30 msgr2=0x7fbb5406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:15.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.440+0000 7fbb70398640 1 --2- 172.21.15.60:0/3072065207 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbb5406be30 0x7fbb5406e2f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fbb60000f60 tx=0x7fbb60009040 comp rx=0 tx=0).stop 2024-09-12T02:40:15.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.441+0000 7fbb70398640 1 -- 172.21.15.60:0/3072065207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb68153c10 msgr2=0x7fbb68145530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:15.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.441+0000 7fbb70398640 1 --2- 172.21.15.60:0/3072065207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb68153c10 0x7fbb68145530 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbb58009e80 tx=0x7fbb58004a40 comp rx=0 tx=0).stop 2024-09-12T02:40:15.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.441+0000 7fbb6e935640 1 -- 172.21.15.60:0/3072065207 reap_dead start 2024-09-12T02:40:15.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.441+0000 7fbb70398640 1 -- 172.21.15.60:0/3072065207 shutdown_connections 2024-09-12T02:40:15.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.441+0000 7fbb70398640 1 -- 172.21.15.60:0/3072065207 >> 172.21.15.60:0/3072065207 conn(0x7fbb680c87f0 msgr2=0x7fbb68151b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:15.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.441+0000 7fbb70398640 1 -- 172.21.15.60:0/3072065207 shutdown_connections 2024-09-12T02:40:15.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.441+0000 7fbb70398640 1 -- 172.21.15.60:0/3072065207 wait complete. 2024-09-12T02:40:15.452 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-12T02:40:15.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.554+0000 7f3b4abd8640 1 Processor -- start 2024-09-12T02:40:15.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.554+0000 7f3b4abd8640 1 -- start start 2024-09-12T02:40:15.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.555+0000 7f3b4abd8640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3b44150480 0x7f3b440c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:15.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.555+0000 7f3b4abd8640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3b440ca390 0x7f3b440c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:15.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.555+0000 7f3b4abd8640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b4415a7c0 con 0x7f3b4406c650 2024-09-12T02:40:15.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.555+0000 7f3b4abd8640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f3b4406c240 con 0x7f3b440ca390 2024-09-12T02:40:15.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.555+0000 7f3b4abd8640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f3b4415a330 con 0x7f3b44150480 2024-09-12T02:40:15.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.555+0000 7f3b49175640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3b440ca390 0x7f3b440c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:15.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.555+0000 7f3b49175640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3b440ca390 0x7f3b440c7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40576/0 (socket says 172.21.15.60:40576) 2024-09-12T02:40:15.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.555+0000 7f3b49175640 1 -- 172.21.15.60:0/682349162 learned_addr learned my addr 172.21.15.60:0/682349162 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:15.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.555+0000 7f3b48974640 1 --2- 172.21.15.60:0/682349162 >> v2:172.21.15.105:3300/0 conn(0x7f3b44150480 0x7f3b440c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:15.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.556+0000 7f3b49175640 1 -- 172.21.15.60:0/682349162 >> v2:172.21.15.105:3300/0 conn(0x7f3b44150480 msgr2=0x7f3b440c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:15.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.556+0000 7f3b49175640 1 --2- 172.21.15.60:0/682349162 >> v2:172.21.15.105:3300/0 conn(0x7f3b44150480 0x7f3b440c7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:15.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.556+0000 7f3b49175640 1 -- 172.21.15.60:0/682349162 >> v1:172.21.15.105:6789/0 conn(0x7f3b4406c650 legacy=0x7f3b440c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:15.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.556+0000 7f3b49175640 1 -- 172.21.15.60:0/682349162 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b44159a00 con 0x7f3b440ca390 2024-09-12T02:40:15.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.556+0000 7f3b49175640 1 --2- 172.21.15.60:0/682349162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b440ca390 0x7f3b440c7fd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3b440ccac0 tx=0x7f3b3c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcd6a8b7ee65bc14 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:15.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.557+0000 7f3b437fe640 1 -- 172.21.15.60:0/682349162 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c036070 con 0x7f3b440ca390 2024-09-12T02:40:15.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.557+0000 7f3b437fe640 1 -- 172.21.15.60:0/682349162 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b3c031600 con 0x7f3b440ca390 2024-09-12T02:40:15.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.557+0000 7f3b437fe640 1 -- 172.21.15.60:0/682349162 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c0319d0 con 0x7f3b440ca390 2024-09-12T02:40:15.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.557+0000 7f3b4abd8640 1 -- 172.21.15.60:0/682349162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b440ca390 msgr2=0x7f3b440c7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:15.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.557+0000 7f3b4abd8640 1 --2- 172.21.15.60:0/682349162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b440ca390 0x7f3b440c7fd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3b440ccac0 tx=0x7f3b3c02a730 comp rx=0 tx=0).stop 2024-09-12T02:40:15.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.557+0000 7f3b4abd8640 1 -- 172.21.15.60:0/682349162 shutdown_connections 2024-09-12T02:40:15.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.557+0000 7f3b4abd8640 1 --2- 172.21.15.60:0/682349162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b440ca390 0x7f3b440c7fd0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:15.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.557+0000 7f3b4abd8640 1 --2- 172.21.15.60:0/682349162 >> v2:172.21.15.105:3300/0 conn(0x7f3b44150480 0x7f3b440c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:15.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.557+0000 7f3b4abd8640 1 -- 172.21.15.60:0/682349162 >> 172.21.15.60:0/682349162 conn(0x7f3b44068030 msgr2=0x7f3b44073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:15.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.557+0000 7f3b4abd8640 1 -- 172.21.15.60:0/682349162 shutdown_connections 2024-09-12T02:40:15.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.557+0000 7f3b4abd8640 1 -- 172.21.15.60:0/682349162 wait complete. 2024-09-12T02:40:15.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.558+0000 7f3b4abd8640 1 Processor -- start 2024-09-12T02:40:15.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.558+0000 7f3b4abd8640 1 -- start start 2024-09-12T02:40:15.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.559+0000 7f3b4abd8640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b4406c650 0x7f3b44158c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:15.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.559+0000 7f3b4abd8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b440ca390 0x7f3b4414f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:15.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.559+0000 7f3b4abd8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b44150480 0x7f3b4414f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:15.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.559+0000 7f3b4abd8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4406d270 con 0x7f3b44150480 2024-09-12T02:40:15.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.559+0000 7f3b4abd8640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3b44159fc0 con 0x7f3b440ca390 2024-09-12T02:40:15.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.559+0000 7f3b4abd8640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3b44156270 con 0x7f3b4406c650 2024-09-12T02:40:15.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.559+0000 7f3b49175640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b44150480 0x7f3b4414f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:15.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.559+0000 7f3b49175640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b44150480 0x7f3b4414f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40592/0 (socket says 172.21.15.60:40592) 2024-09-12T02:40:15.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.559+0000 7f3b49175640 1 -- 172.21.15.60:0/3917109854 learned_addr learned my addr 172.21.15.60:0/3917109854 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:15.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.560+0000 7f3b43fff640 1 --2- 172.21.15.60:0/3917109854 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b440ca390 0x7f3b4414f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:15.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.560+0000 7f3b48974640 1 --2- 172.21.15.60:0/3917109854 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b4406c650 0x7f3b44158c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:15.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.560+0000 7f3b49175640 1 -- 172.21.15.60:0/3917109854 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b4406c650 msgr2=0x7f3b44158c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:15.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.560+0000 7f3b49175640 1 --2- 172.21.15.60:0/3917109854 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b4406c650 0x7f3b44158c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:15.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.560+0000 7f3b49175640 1 -- 172.21.15.60:0/3917109854 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b440ca390 msgr2=0x7f3b4414f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:15.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.560+0000 7f3b49175640 1 --2- 172.21.15.60:0/3917109854 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b440ca390 0x7f3b4414f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:15.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.560+0000 7f3b49175640 1 -- 172.21.15.60:0/3917109854 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b441e2410 con 0x7f3b44150480 2024-09-12T02:40:15.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.560+0000 7f3b43fff640 1 --2- 172.21.15.60:0/3917109854 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b440ca390 0x7f3b4414f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:40:15.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.560+0000 7f3b49175640 1 --2- 172.21.15.60:0/3917109854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b44150480 0x7f3b4414f690 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c009f40 tx=0x7f3b3c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:15.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.560+0000 7f3b417fa640 1 -- 172.21.15.60:0/3917109854 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c03f020 con 0x7f3b44150480 2024-09-12T02:40:15.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.560+0000 7f3b417fa640 1 -- 172.21.15.60:0/3917109854 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b3c037040 con 0x7f3b44150480 2024-09-12T02:40:15.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.560+0000 7f3b4abd8640 1 -- 172.21.15.60:0/3917109854 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b441512a0 con 0x7f3b44150480 2024-09-12T02:40:15.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.560+0000 7f3b417fa640 1 -- 172.21.15.60:0/3917109854 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c036070 con 0x7f3b44150480 2024-09-12T02:40:15.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.560+0000 7f3b4abd8640 1 -- 172.21.15.60:0/3917109854 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b441e26f0 con 0x7f3b44150480 2024-09-12T02:40:15.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.561+0000 7f3b4abd8640 1 -- 172.21.15.60:0/3917109854 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b4406bd30 con 0x7f3b44150480 2024-09-12T02:40:15.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.561+0000 7f3b417fa640 1 -- 172.21.15.60:0/3917109854 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3b3c042020 con 0x7f3b44150480 2024-09-12T02:40:15.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.562+0000 7f3b417fa640 1 --2- 172.21.15.60:0/3917109854 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3b3006be30 0x7f3b3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:15.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.562+0000 7f3b417fa640 1 -- 172.21.15.60:0/3917109854 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f3b3c0ab4e0 con 0x7f3b44150480 2024-09-12T02:40:15.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.562+0000 7f3b48974640 1 --2- 172.21.15.60:0/3917109854 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3b3006be30 0x7f3b3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:15.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.562+0000 7f3b48974640 1 --2- 172.21.15.60:0/3917109854 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3b3006be30 0x7f3b3006e2f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3b441f0920 tx=0x7f3b34008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:15.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.566+0000 7f3b417fa640 1 -- 172.21.15.60:0/3917109854 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3b4406bd30 con 0x7f3b44150480 2024-09-12T02:40:15.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.745+0000 7f3b4abd8640 1 -- 172.21.15.60:0/3917109854 --> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f3b44155070 con 0x7f3b3006be30 2024-09-12T02:40:15.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.746+0000 7f3b417fa640 1 -- 172.21.15.60:0/3917109854 <== mgr.4098 v2:172.21.15.60:6800/3549430091 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f3b34010870 con 0x7f3b3006be30 2024-09-12T02:40:15.747 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 4 to deep-scrub 2024-09-12T02:40:15.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.748+0000 7f3b4abd8640 1 -- 172.21.15.60:0/3917109854 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3b3006be30 msgr2=0x7f3b3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:15.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.748+0000 7f3b4abd8640 1 --2- 172.21.15.60:0/3917109854 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3b3006be30 0x7f3b3006e2f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3b441f0920 tx=0x7f3b34008040 comp rx=0 tx=0).stop 2024-09-12T02:40:15.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.748+0000 7f3b4abd8640 1 -- 172.21.15.60:0/3917109854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b44150480 msgr2=0x7f3b4414f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:15.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.748+0000 7f3b4abd8640 1 --2- 172.21.15.60:0/3917109854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b44150480 0x7f3b4414f690 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c009f40 tx=0x7f3b3c004a40 comp rx=0 tx=0).stop 2024-09-12T02:40:15.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.748+0000 7f3b4abd8640 1 -- 172.21.15.60:0/3917109854 shutdown_connections 2024-09-12T02:40:15.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.748+0000 7f3b4abd8640 1 --2- 172.21.15.60:0/3917109854 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3b3006be30 0x7f3b3006e2f0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:15.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.748+0000 7f3b4abd8640 1 --2- 172.21.15.60:0/3917109854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b44150480 0x7f3b4414f690 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:15.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.748+0000 7f3b4abd8640 1 --2- 172.21.15.60:0/3917109854 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b440ca390 0x7f3b4414f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:15.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.748+0000 7f3b4abd8640 1 --2- 172.21.15.60:0/3917109854 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b4406c650 0x7f3b44158c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:15.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.748+0000 7f3b4abd8640 1 -- 172.21.15.60:0/3917109854 >> 172.21.15.60:0/3917109854 conn(0x7f3b44068030 msgr2=0x7f3b440c7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:15.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.748+0000 7f3b4abd8640 1 -- 172.21.15.60:0/3917109854 shutdown_connections 2024-09-12T02:40:15.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.748+0000 7f3b4abd8640 1 -- 172.21.15.60:0/3917109854 wait complete. 2024-09-12T02:40:15.760 INFO:tasks.ceph:Scrubbing osd.5 2024-09-12T02:40:15.760 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:40:15.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.867+0000 7f1207ec0640 1 Processor -- start 2024-09-12T02:40:15.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.867+0000 7f1207ec0640 1 -- start start 2024-09-12T02:40:15.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.867+0000 7f1207ec0640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f120006cd80 0x7f1200153be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:15.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.868+0000 7f1207ec0640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f120015a4a0 0x7f1200156660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:15.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.868+0000 7f1207ec0640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12000c7070 con 0x7f12000c8b10 2024-09-12T02:40:15.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.868+0000 7f1207ec0640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f120006d210 con 0x7f120006cd80 2024-09-12T02:40:15.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.868+0000 7f1207ec0640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f12000c69b0 con 0x7f120015a4a0 2024-09-12T02:40:15.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.868+0000 7f120545b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f120006cd80 0x7f1200153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:15.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.868+0000 7f120545b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f120006cd80 0x7f1200153be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40608/0 (socket says 172.21.15.60:40608) 2024-09-12T02:40:15.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.868+0000 7f120545b640 1 -- 172.21.15.60:0/3615606812 learned_addr learned my addr 172.21.15.60:0/3615606812 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:15.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.868+0000 7f120645d640 1 --2- 172.21.15.60:0/3615606812 >> v2:172.21.15.105:3300/0 conn(0x7f120015a4a0 0x7f1200156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:15.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.868+0000 7f120545b640 1 -- 172.21.15.60:0/3615606812 >> v2:172.21.15.105:3300/0 conn(0x7f120015a4a0 msgr2=0x7f1200156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:15.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.868+0000 7f120545b640 1 --2- 172.21.15.60:0/3615606812 >> v2:172.21.15.105:3300/0 conn(0x7f120015a4a0 0x7f1200156660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:15.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.868+0000 7f120545b640 1 -- 172.21.15.60:0/3615606812 >> v1:172.21.15.105:6789/0 conn(0x7f12000c8b10 legacy=0x7f12001534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:15.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.868+0000 7f120545b640 1 -- 172.21.15.60:0/3615606812 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12000c6c90 con 0x7f120006cd80 2024-09-12T02:40:15.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.869+0000 7f120545b640 1 --2- 172.21.15.60:0/3615606812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f120006cd80 0x7f1200153be0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f120008e2c0 tx=0x7f11f002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e11fe948e79d4183 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:15.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.869+0000 7f1204c5a640 1 -- 172.21.15.60:0/3615606812 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f0037070 con 0x7f120006cd80 2024-09-12T02:40:15.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.869+0000 7f1204c5a640 1 -- 172.21.15.60:0/3615606812 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11f0032440 con 0x7f120006cd80 2024-09-12T02:40:15.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.869+0000 7f1204c5a640 1 -- 172.21.15.60:0/3615606812 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f0032810 con 0x7f120006cd80 2024-09-12T02:40:15.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.869+0000 7f1207ec0640 1 -- 172.21.15.60:0/3615606812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f120006cd80 msgr2=0x7f1200153be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:15.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.869+0000 7f1207ec0640 1 --2- 172.21.15.60:0/3615606812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f120006cd80 0x7f1200153be0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f120008e2c0 tx=0x7f11f002a1a0 comp rx=0 tx=0).stop 2024-09-12T02:40:15.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.869+0000 7f1207ec0640 1 -- 172.21.15.60:0/3615606812 shutdown_connections 2024-09-12T02:40:15.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.869+0000 7f1207ec0640 1 --2- 172.21.15.60:0/3615606812 >> v2:172.21.15.105:3300/0 conn(0x7f120015a4a0 0x7f1200156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:15.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.869+0000 7f1207ec0640 1 --2- 172.21.15.60:0/3615606812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f120006cd80 0x7f1200153be0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:15.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.869+0000 7f1207ec0640 1 -- 172.21.15.60:0/3615606812 >> 172.21.15.60:0/3615606812 conn(0x7f12000adb80 msgr2=0x7f12000adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:15.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.870+0000 7f1207ec0640 1 -- 172.21.15.60:0/3615606812 shutdown_connections 2024-09-12T02:40:15.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.870+0000 7f1207ec0640 1 -- 172.21.15.60:0/3615606812 wait complete. 2024-09-12T02:40:15.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.871+0000 7f1207ec0640 1 Processor -- start 2024-09-12T02:40:15.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.871+0000 7f1207ec0640 1 -- start start 2024-09-12T02:40:15.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.871+0000 7f1207ec0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12000c8b10 0x7f1200157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:15.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.871+0000 7f1207ec0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f120015a4a0 0x7f12001ef620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:15.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.871+0000 7f1207ec0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12001e25e0 0x7f12001efb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:15.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.871+0000 7f1207ec0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f12000c9070 con 0x7f12001e25e0 2024-09-12T02:40:15.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.871+0000 7f1207ec0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f12000c8ef0 con 0x7f120015a4a0 2024-09-12T02:40:15.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.871+0000 7f1207ec0640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1200156ba0 con 0x7f12000c8b10 2024-09-12T02:40:15.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.872+0000 7f120645d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12001e25e0 0x7f12001efb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:15.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.872+0000 7f120645d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12001e25e0 0x7f12001efb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40616/0 (socket says 172.21.15.60:40616) 2024-09-12T02:40:15.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.872+0000 7f120645d640 1 -- 172.21.15.60:0/1241642832 learned_addr learned my addr 172.21.15.60:0/1241642832 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:15.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.872+0000 7f1205c5c640 1 --2- 172.21.15.60:0/1241642832 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12000c8b10 0x7f1200157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:15.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.872+0000 7f120545b640 1 --2- 172.21.15.60:0/1241642832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f120015a4a0 0x7f12001ef620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:15.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.872+0000 7f120645d640 1 -- 172.21.15.60:0/1241642832 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12000c8b10 msgr2=0x7f1200157a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:15.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.872+0000 7f120645d640 1 --2- 172.21.15.60:0/1241642832 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12000c8b10 0x7f1200157a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:15.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.872+0000 7f120645d640 1 -- 172.21.15.60:0/1241642832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f120015a4a0 msgr2=0x7f12001ef620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:15.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.872+0000 7f120645d640 1 --2- 172.21.15.60:0/1241642832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f120015a4a0 0x7f12001ef620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:15.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.872+0000 7f120645d640 1 -- 172.21.15.60:0/1241642832 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12001e1c10 con 0x7f12001e25e0 2024-09-12T02:40:15.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.872+0000 7f120645d640 1 --2- 172.21.15.60:0/1241642832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12001e25e0 0x7f12001efb60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f11f800cc30 tx=0x7f11f800a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:15.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.872+0000 7f11f67fc640 1 -- 172.21.15.60:0/1241642832 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f800ce40 con 0x7f12001e25e0 2024-09-12T02:40:15.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.872+0000 7f11f67fc640 1 -- 172.21.15.60:0/1241642832 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11f8003990 con 0x7f12001e25e0 2024-09-12T02:40:15.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.872+0000 7f11f67fc640 1 -- 172.21.15.60:0/1241642832 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f8003d40 con 0x7f12001e25e0 2024-09-12T02:40:15.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.872+0000 7f1207ec0640 1 -- 172.21.15.60:0/1241642832 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12001e03c0 con 0x7f12001e25e0 2024-09-12T02:40:15.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.872+0000 7f1207ec0640 1 -- 172.21.15.60:0/1241642832 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12001e0680 con 0x7f12001e25e0 2024-09-12T02:40:15.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.873+0000 7f1207ec0640 1 -- 172.21.15.60:0/1241642832 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1200156660 con 0x7f12001e25e0 2024-09-12T02:40:15.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.874+0000 7f11f67fc640 1 -- 172.21.15.60:0/1241642832 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f11f8003ee0 con 0x7f12001e25e0 2024-09-12T02:40:15.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.874+0000 7f11f67fc640 1 --2- 172.21.15.60:0/1241642832 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f11e406be30 0x7f11e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:15.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.874+0000 7f11f67fc640 1 -- 172.21.15.60:0/1241642832 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f11f808b6b0 con 0x7f12001e25e0 2024-09-12T02:40:15.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.874+0000 7f1205c5c640 1 --2- 172.21.15.60:0/1241642832 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f11e406be30 0x7f11e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:15.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.874+0000 7f11f67fc640 1 --2- 172.21.15.60:0/1241642832 >> [v2:172.21.15.105:6824/1392337793,v1:172.21.15.105:6825/1392337793] conn(0x7f11e40767c0 0x7f11e4078c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:15.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.875+0000 7f11f67fc640 1 -- 172.21.15.60:0/1241642832 --> [v2:172.21.15.105:6824/1392337793,v1:172.21.15.105:6825/1392337793] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f11f800de50 con 0x7f11e40767c0 2024-09-12T02:40:15.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.875+0000 7f11f67fc640 1 -- 172.21.15.60:0/1241642832 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f11f8092050 con 0x7f12001e25e0 2024-09-12T02:40:15.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.875+0000 7f1205c5c640 1 --2- 172.21.15.60:0/1241642832 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f11e406be30 0x7f11e406e2f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f11fc0015d0 tx=0x7f11fc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:15.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.875+0000 7f120545b640 1 --2- 172.21.15.60:0/1241642832 >> [v2:172.21.15.105:6824/1392337793,v1:172.21.15.105:6825/1392337793] conn(0x7f11e40767c0 0x7f11e4078c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:15.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.875+0000 7f120545b640 1 --2- 172.21.15.60:0/1241642832 >> [v2:172.21.15.105:6824/1392337793,v1:172.21.15.105:6825/1392337793] conn(0x7f11e40767c0 0x7f11e4078c40 crc :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:15.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.876+0000 7f11f67fc640 1 -- 172.21.15.60:0/1241642832 <== osd.5 v2:172.21.15.105:6824/1392337793 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f11f800de50 con 0x7f11e40767c0 2024-09-12T02:40:15.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.889+0000 7f1207ec0640 1 -- 172.21.15.60:0/1241642832 --> [v2:172.21.15.105:6824/1392337793,v1:172.21.15.105:6825/1392337793] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1200153c00 con 0x7f11e40767c0 2024-09-12T02:40:15.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.889+0000 7f11f67fc640 1 -- 172.21.15.60:0/1241642832 <== osd.5 v2:172.21.15.105:6824/1392337793 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1200153c00 con 0x7f11e40767c0 2024-09-12T02:40:15.890 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:40:15.890 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T02:40:15.890 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:40:15.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.889+0000 7f1207ec0640 1 -- 172.21.15.60:0/1241642832 >> [v2:172.21.15.105:6824/1392337793,v1:172.21.15.105:6825/1392337793] conn(0x7f11e40767c0 msgr2=0x7f11e4078c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:15.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.890+0000 7f1207ec0640 1 --2- 172.21.15.60:0/1241642832 >> [v2:172.21.15.105:6824/1392337793,v1:172.21.15.105:6825/1392337793] conn(0x7f11e40767c0 0x7f11e4078c40 crc :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:15.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.890+0000 7f1207ec0640 1 -- 172.21.15.60:0/1241642832 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f11e406be30 msgr2=0x7f11e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:15.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.890+0000 7f1207ec0640 1 --2- 172.21.15.60:0/1241642832 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f11e406be30 0x7f11e406e2f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f11fc0015d0 tx=0x7f11fc009040 comp rx=0 tx=0).stop 2024-09-12T02:40:15.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.890+0000 7f1207ec0640 1 -- 172.21.15.60:0/1241642832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12001e25e0 msgr2=0x7f12001efb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:15.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.890+0000 7f1207ec0640 1 --2- 172.21.15.60:0/1241642832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12001e25e0 0x7f12001efb60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f11f800cc30 tx=0x7f11f800a5c0 comp rx=0 tx=0).stop 2024-09-12T02:40:15.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.890+0000 7f120645d640 1 -- 172.21.15.60:0/1241642832 reap_dead start 2024-09-12T02:40:15.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.890+0000 7f1207ec0640 1 -- 172.21.15.60:0/1241642832 shutdown_connections 2024-09-12T02:40:15.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.890+0000 7f1207ec0640 1 -- 172.21.15.60:0/1241642832 >> 172.21.15.60:0/1241642832 conn(0x7f12000adb80 msgr2=0x7f12000adf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:15.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.890+0000 7f1207ec0640 1 -- 172.21.15.60:0/1241642832 shutdown_connections 2024-09-12T02:40:15.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:15.890+0000 7f1207ec0640 1 -- 172.21.15.60:0/1241642832 wait complete. 2024-09-12T02:40:15.901 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-12T02:40:16.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.005+0000 7f63cd58d640 1 Processor -- start 2024-09-12T02:40:16.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.006+0000 7f63cd58d640 1 -- start start 2024-09-12T02:40:16.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.006+0000 7f63cd58d640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f63c80703b0 0x7f63c815fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:16.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.006+0000 7f63cd58d640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63c8154ff0 con 0x7f63c8151780 2024-09-12T02:40:16.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.006+0000 7f63cd58d640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63c806f5f0 con 0x7f63c8154ac0 2024-09-12T02:40:16.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.006+0000 7f63cd58d640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f63c806f8d0 con 0x7f63c80703b0 2024-09-12T02:40:16.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.006+0000 7f63c6ffd640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f63c8151780 0x7f63c8155560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:42864/0 (socket says 172.21.15.60:42864) 2024-09-12T02:40:16.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.006+0000 7f63c6ffd640 1 -- 172.21.15.60:0/3182728449 learned_addr learned my addr 172.21.15.60:0/3182728449 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:40:16.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.007+0000 7f63c77fe640 1 --2- 172.21.15.60:0/3182728449 >> v2:172.21.15.105:3300/0 conn(0x7f63c80703b0 0x7f63c815fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:16.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.007+0000 7f63c5ffb640 1 -- 172.21.15.60:0/3182728449 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2120164275 0 0) 0x7f63c8154ff0 con 0x7f63c8151780 2024-09-12T02:40:16.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.007+0000 7f63c5ffb640 1 -- 172.21.15.60:0/3182728449 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63b0003520 con 0x7f63c8151780 2024-09-12T02:40:16.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.007+0000 7f63c5ffb640 1 -- 172.21.15.60:0/3182728449 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2661525053 0 0) 0x7f63c806f5f0 con 0x7f63c8154ac0 2024-09-12T02:40:16.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.007+0000 7f63c5ffb640 1 -- 172.21.15.60:0/3182728449 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63c8154ff0 con 0x7f63c8154ac0 2024-09-12T02:40:16.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.007+0000 7f63c77fe640 1 -- 172.21.15.60:0/3182728449 >> v1:172.21.15.105:6789/0 conn(0x7f63c8154ac0 legacy=0x7f63c80708a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:16.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.007+0000 7f63c77fe640 1 -- 172.21.15.60:0/3182728449 >> v1:172.21.15.60:6789/0 conn(0x7f63c8151780 legacy=0x7f63c8155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:16.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.007+0000 7f63c5ffb640 1 -- 172.21.15.60:0/3182728449 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 756746078 0 0) 0x7f63b0003520 con 0x7f63c8151780 2024-09-12T02:40:16.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.007+0000 7f63c77fe640 1 -- 172.21.15.60:0/3182728449 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63c806fbb0 con 0x7f63c80703b0 2024-09-12T02:40:16.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.008+0000 7f63c77fe640 1 --2- 172.21.15.60:0/3182728449 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63c80703b0 0x7f63c815fa00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f63c0009d90 tx=0x7f63c002a560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1980a4923391775 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:16.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.008+0000 7f63c5ffb640 1 -- 172.21.15.60:0/3182728449 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63b8001670 con 0x7f63c80703b0 2024-09-12T02:40:16.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.008+0000 7f63c5ffb640 1 -- 172.21.15.60:0/3182728449 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63c0007540 con 0x7f63c80703b0 2024-09-12T02:40:16.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.008+0000 7f63c5ffb640 1 -- 172.21.15.60:0/3182728449 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c00078f0 con 0x7f63c80703b0 2024-09-12T02:40:16.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.008+0000 7f63cd58d640 1 -- 172.21.15.60:0/3182728449 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63c80703b0 msgr2=0x7f63c815fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:16.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.008+0000 7f63cd58d640 1 --2- 172.21.15.60:0/3182728449 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63c80703b0 0x7f63c815fa00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f63c0009d90 tx=0x7f63c002a560 comp rx=0 tx=0).stop 2024-09-12T02:40:16.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.009+0000 7f63cd58d640 1 -- 172.21.15.60:0/3182728449 shutdown_connections 2024-09-12T02:40:16.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.009+0000 7f63cd58d640 1 --2- 172.21.15.60:0/3182728449 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63c80703b0 0x7f63c815fa00 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:16.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.009+0000 7f63cd58d640 1 -- 172.21.15.60:0/3182728449 >> 172.21.15.60:0/3182728449 conn(0x7f63c80c6980 msgr2=0x7f63c80c6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:16.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.009+0000 7f63cd58d640 1 -- 172.21.15.60:0/3182728449 shutdown_connections 2024-09-12T02:40:16.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.009+0000 7f63cd58d640 1 -- 172.21.15.60:0/3182728449 wait complete. 2024-09-12T02:40:16.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.010+0000 7f63cd58d640 1 Processor -- start 2024-09-12T02:40:16.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.010+0000 7f63cd58d640 1 -- start start 2024-09-12T02:40:16.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.011+0000 7f63cd58d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63c80703b0 0x7f63c81ed000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:16.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.011+0000 7f63cd58d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f63c8151780 0x7f63c814a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:16.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.011+0000 7f63cd58d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63c8154ac0 0x7f63c814ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:16.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.011+0000 7f63cd58d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f63c8155c70 con 0x7f63c8154ac0 2024-09-12T02:40:16.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.011+0000 7f63cd58d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f63c8070fb0 con 0x7f63c80703b0 2024-09-12T02:40:16.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.011+0000 7f63cd58d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f63c814b0b0 con 0x7f63c8151780 2024-09-12T02:40:16.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.011+0000 7f63c77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63c8154ac0 0x7f63c814ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:16.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.011+0000 7f63c77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63c8154ac0 0x7f63c814ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40624/0 (socket says 172.21.15.60:40624) 2024-09-12T02:40:16.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.011+0000 7f63c77fe640 1 -- 172.21.15.60:0/1891161947 learned_addr learned my addr 172.21.15.60:0/1891161947 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:16.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.011+0000 7f63c6ffd640 1 --2- 172.21.15.60:0/1891161947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63c80703b0 0x7f63c81ed000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:16.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.011+0000 7f63c67fc640 1 --2- 172.21.15.60:0/1891161947 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f63c8151780 0x7f63c814a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:16.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.011+0000 7f63c77fe640 1 -- 172.21.15.60:0/1891161947 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f63c8151780 msgr2=0x7f63c814a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:16.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.011+0000 7f63c77fe640 1 --2- 172.21.15.60:0/1891161947 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f63c8151780 0x7f63c814a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:16.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.011+0000 7f63c77fe640 1 -- 172.21.15.60:0/1891161947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63c80703b0 msgr2=0x7f63c81ed000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:16.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.011+0000 7f63c77fe640 1 --2- 172.21.15.60:0/1891161947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63c80703b0 0x7f63c81ed000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:16.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.011+0000 7f63c77fe640 1 -- 172.21.15.60:0/1891161947 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63c81ed8d0 con 0x7f63c8154ac0 2024-09-12T02:40:16.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.011+0000 7f63c77fe640 1 --2- 172.21.15.60:0/1891161947 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63c8154ac0 0x7f63c814ab70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f63c0009eb0 tx=0x7f63c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:16.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.011+0000 7f63af7fe640 1 -- 172.21.15.60:0/1891161947 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c0040070 con 0x7f63c8154ac0 2024-09-12T02:40:16.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.011+0000 7f63af7fe640 1 -- 172.21.15.60:0/1891161947 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63c0031c40 con 0x7f63c8154ac0 2024-09-12T02:40:16.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.011+0000 7f63af7fe640 1 -- 172.21.15.60:0/1891161947 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c0009450 con 0x7f63c8154ac0 2024-09-12T02:40:16.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.011+0000 7f63cd58d640 1 -- 172.21.15.60:0/1891161947 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63c81edbb0 con 0x7f63c8154ac0 2024-09-12T02:40:16.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.012+0000 7f63cd58d640 1 -- 172.21.15.60:0/1891161947 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63c80c8f10 con 0x7f63c8154ac0 2024-09-12T02:40:16.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.013+0000 7f63cd58d640 1 -- 172.21.15.60:0/1891161947 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63c8073f30 con 0x7f63c8154ac0 2024-09-12T02:40:16.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.013+0000 7f63af7fe640 1 -- 172.21.15.60:0/1891161947 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f63c0039040 con 0x7f63c8154ac0 2024-09-12T02:40:16.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.013+0000 7f63af7fe640 1 --2- 172.21.15.60:0/1891161947 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f63b406be30 0x7f63b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:16.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.013+0000 7f63af7fe640 1 -- 172.21.15.60:0/1891161947 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f63c00ac3f0 con 0x7f63c8154ac0 2024-09-12T02:40:16.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.014+0000 7f63c6ffd640 1 --2- 172.21.15.60:0/1891161947 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f63b406be30 0x7f63b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:16.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.014+0000 7f63c6ffd640 1 --2- 172.21.15.60:0/1891161947 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f63b406be30 0x7f63b406e2f0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f63b80017e0 tx=0x7f63b8001610 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:16.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.018+0000 7f63af7fe640 1 -- 172.21.15.60:0/1891161947 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f63c007a440 con 0x7f63c8154ac0 2024-09-12T02:40:16.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.193+0000 7f63cd58d640 1 -- 172.21.15.60:0/1891161947 --> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f63c8073ca0 con 0x7f63b406be30 2024-09-12T02:40:16.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.193+0000 7f63af7fe640 1 -- 172.21.15.60:0/1891161947 <== mgr.4098 v2:172.21.15.60:6800/3549430091 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f63c8073ca0 con 0x7f63b406be30 2024-09-12T02:40:16.194 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 5 to deep-scrub 2024-09-12T02:40:16.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.195+0000 7f63cd58d640 1 -- 172.21.15.60:0/1891161947 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f63b406be30 msgr2=0x7f63b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:16.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.195+0000 7f63cd58d640 1 --2- 172.21.15.60:0/1891161947 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f63b406be30 0x7f63b406e2f0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f63b80017e0 tx=0x7f63b8001610 comp rx=0 tx=0).stop 2024-09-12T02:40:16.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.195+0000 7f63cd58d640 1 -- 172.21.15.60:0/1891161947 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63c8154ac0 msgr2=0x7f63c814ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:16.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.195+0000 7f63cd58d640 1 --2- 172.21.15.60:0/1891161947 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63c8154ac0 0x7f63c814ab70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f63c0009eb0 tx=0x7f63c0004a40 comp rx=0 tx=0).stop 2024-09-12T02:40:16.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.195+0000 7f63cd58d640 1 -- 172.21.15.60:0/1891161947 shutdown_connections 2024-09-12T02:40:16.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.195+0000 7f63cd58d640 1 --2- 172.21.15.60:0/1891161947 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f63b406be30 0x7f63b406e2f0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:16.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.195+0000 7f63cd58d640 1 --2- 172.21.15.60:0/1891161947 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63c8154ac0 0x7f63c814ab70 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:16.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.195+0000 7f63cd58d640 1 --2- 172.21.15.60:0/1891161947 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f63c8151780 0x7f63c814a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:16.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.195+0000 7f63cd58d640 1 --2- 172.21.15.60:0/1891161947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63c80703b0 0x7f63c81ed000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:16.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.195+0000 7f63cd58d640 1 -- 172.21.15.60:0/1891161947 >> 172.21.15.60:0/1891161947 conn(0x7f63c80c6980 msgr2=0x7f63c80c6ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:16.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.195+0000 7f63cd58d640 1 -- 172.21.15.60:0/1891161947 shutdown_connections 2024-09-12T02:40:16.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.195+0000 7f63cd58d640 1 -- 172.21.15.60:0/1891161947 wait complete. 2024-09-12T02:40:16.207 INFO:tasks.ceph:Scrubbing osd.6 2024-09-12T02:40:16.207 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:40:16.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.313+0000 7f19d8bf6640 1 Processor -- start 2024-09-12T02:40:16.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.313+0000 7f19d8bf6640 1 -- start start 2024-09-12T02:40:16.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.314+0000 7f19d8bf6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19d40ca220 0x7f19d40c3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:16.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.314+0000 7f19d8bf6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f19d4072b30 0x7f19d4151610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:16.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.314+0000 7f19d8bf6640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19d4070800 con 0x7f19d40a9230 2024-09-12T02:40:16.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.314+0000 7f19d8bf6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f19d40c99b0 con 0x7f19d4072b30 2024-09-12T02:40:16.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.314+0000 7f19d8bf6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f19d40c93f0 con 0x7f19d40ca220 2024-09-12T02:40:16.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.314+0000 7f19d2d9d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f19d4072b30 0x7f19d4151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:16.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.314+0000 7f19d2d9d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f19d4072b30 0x7f19d4151610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40634/0 (socket says 172.21.15.60:40634) 2024-09-12T02:40:16.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.314+0000 7f19d2d9d640 1 -- 172.21.15.60:0/1818678486 learned_addr learned my addr 172.21.15.60:0/1818678486 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:16.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.315+0000 7f19d259c640 1 --2- 172.21.15.60:0/1818678486 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19d40ca220 0x7f19d40c3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:16.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.315+0000 7f19d2d9d640 1 -- 172.21.15.60:0/1818678486 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19d40ca220 msgr2=0x7f19d40c3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:16.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.315+0000 7f19d2d9d640 1 --2- 172.21.15.60:0/1818678486 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19d40ca220 0x7f19d40c3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:16.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.315+0000 7f19d2d9d640 1 -- 172.21.15.60:0/1818678486 >> v1:172.21.15.105:6789/0 conn(0x7f19d40a9230 legacy=0x7f19d4154b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:16.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.315+0000 7f19d2d9d640 1 -- 172.21.15.60:0/1818678486 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19d40c96d0 con 0x7f19d4072b30 2024-09-12T02:40:16.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.315+0000 7f19d2d9d640 1 --2- 172.21.15.60:0/1818678486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19d4072b30 0x7f19d4151610 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f19cc009e50 tx=0x7f19cc02a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c244390e10edffce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:16.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.316+0000 7f19d1d9b640 1 -- 172.21.15.60:0/1818678486 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19cc036070 con 0x7f19d4072b30 2024-09-12T02:40:16.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.316+0000 7f19d1d9b640 1 -- 172.21.15.60:0/1818678486 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19cc031600 con 0x7f19d4072b30 2024-09-12T02:40:16.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.316+0000 7f19d1d9b640 1 -- 172.21.15.60:0/1818678486 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19cc0319d0 con 0x7f19d4072b30 2024-09-12T02:40:16.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.316+0000 7f19d8bf6640 1 -- 172.21.15.60:0/1818678486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19d4072b30 msgr2=0x7f19d4151610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:16.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.316+0000 7f19d8bf6640 1 --2- 172.21.15.60:0/1818678486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19d4072b30 0x7f19d4151610 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f19cc009e50 tx=0x7f19cc02a630 comp rx=0 tx=0).stop 2024-09-12T02:40:16.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.316+0000 7f19d8bf6640 1 -- 172.21.15.60:0/1818678486 shutdown_connections 2024-09-12T02:40:16.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.316+0000 7f19d8bf6640 1 --2- 172.21.15.60:0/1818678486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19d4072b30 0x7f19d4151610 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:16.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.316+0000 7f19d8bf6640 1 --2- 172.21.15.60:0/1818678486 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19d40ca220 0x7f19d40c3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:16.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.316+0000 7f19d8bf6640 1 -- 172.21.15.60:0/1818678486 >> 172.21.15.60:0/1818678486 conn(0x7f19d4067b30 msgr2=0x7f19d4067f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:16.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.316+0000 7f19d8bf6640 1 -- 172.21.15.60:0/1818678486 shutdown_connections 2024-09-12T02:40:16.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.316+0000 7f19d8bf6640 1 -- 172.21.15.60:0/1818678486 wait complete. 2024-09-12T02:40:16.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.318+0000 7f19d8bf6640 1 Processor -- start 2024-09-12T02:40:16.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.318+0000 7f19d8bf6640 1 -- start start 2024-09-12T02:40:16.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.318+0000 7f19d8bf6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19d4072b30 0x7f19d40733d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:16.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.318+0000 7f19d8bf6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19d40a9230 0x7f19d40ad850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:16.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.318+0000 7f19d8bf6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19d40ca220 0x7f19d4143ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:16.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.318+0000 7f19d8bf6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f19d4072fe0 con 0x7f19d40ca220 2024-09-12T02:40:16.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.318+0000 7f19d8bf6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f19d4154660 con 0x7f19d4072b30 2024-09-12T02:40:16.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.318+0000 7f19d8bf6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f19d40ca600 con 0x7f19d40a9230 2024-09-12T02:40:16.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.318+0000 7f19d2d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19d40ca220 0x7f19d4143ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:16.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.318+0000 7f19d2d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19d40ca220 0x7f19d4143ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40640/0 (socket says 172.21.15.60:40640) 2024-09-12T02:40:16.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.318+0000 7f19d2d9d640 1 -- 172.21.15.60:0/1728146055 learned_addr learned my addr 172.21.15.60:0/1728146055 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:16.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.319+0000 7f19d259c640 1 --2- 172.21.15.60:0/1728146055 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19d4072b30 0x7f19d40733d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:16.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.319+0000 7f19d2d9d640 1 -- 172.21.15.60:0/1728146055 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19d40a9230 msgr2=0x7f19d40ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:16.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.319+0000 7f19d2d9d640 1 --2- 172.21.15.60:0/1728146055 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19d40a9230 0x7f19d40ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:16.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.319+0000 7f19d2d9d640 1 -- 172.21.15.60:0/1728146055 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19d4072b30 msgr2=0x7f19d40733d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:16.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.319+0000 7f19d2d9d640 1 --2- 172.21.15.60:0/1728146055 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19d4072b30 0x7f19d40733d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:16.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.319+0000 7f19d2d9d640 1 -- 172.21.15.60:0/1728146055 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19d41ed0b0 con 0x7f19d40ca220 2024-09-12T02:40:16.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.319+0000 7f19d2d9d640 1 --2- 172.21.15.60:0/1728146055 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19d40ca220 0x7f19d4143ce0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f19cc034040 tx=0x7f19cc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:16.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.319+0000 7f19caffd640 1 -- 172.21.15.60:0/1728146055 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19cc03f020 con 0x7f19d40ca220 2024-09-12T02:40:16.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.319+0000 7f19caffd640 1 -- 172.21.15.60:0/1728146055 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19cc037040 con 0x7f19d40ca220 2024-09-12T02:40:16.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.319+0000 7f19caffd640 1 -- 172.21.15.60:0/1728146055 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19cc036070 con 0x7f19d40ca220 2024-09-12T02:40:16.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.319+0000 7f19d8bf6640 1 -- 172.21.15.60:0/1728146055 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19d41ed390 con 0x7f19d40ca220 2024-09-12T02:40:16.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.319+0000 7f19d8bf6640 1 -- 172.21.15.60:0/1728146055 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19d41ed950 con 0x7f19d40ca220 2024-09-12T02:40:16.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.320+0000 7f19d8bf6640 1 -- 172.21.15.60:0/1728146055 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f19d40c3f10 con 0x7f19d40ca220 2024-09-12T02:40:16.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.321+0000 7f19caffd640 1 -- 172.21.15.60:0/1728146055 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f19cc042020 con 0x7f19d40ca220 2024-09-12T02:40:16.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.321+0000 7f19caffd640 1 --2- 172.21.15.60:0/1728146055 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f19b406be30 0x7f19b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:16.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.321+0000 7f19caffd640 1 -- 172.21.15.60:0/1728146055 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f19cc0ab6e0 con 0x7f19d40ca220 2024-09-12T02:40:16.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.321+0000 7f19d259c640 1 --2- 172.21.15.60:0/1728146055 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f19b406be30 0x7f19b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:16.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.321+0000 7f19caffd640 1 --2- 172.21.15.60:0/1728146055 >> [v2:172.21.15.105:6800/50951309,v1:172.21.15.105:6801/50951309] conn(0x7f19b40767c0 0x7f19b4078c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:16.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.321+0000 7f19caffd640 1 -- 172.21.15.60:0/1728146055 --> [v2:172.21.15.105:6800/50951309,v1:172.21.15.105:6801/50951309] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f19b4079310 con 0x7f19b40767c0 2024-09-12T02:40:16.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.321+0000 7f19caffd640 1 -- 172.21.15.60:0/1728146055 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f19cc0b2050 con 0x7f19d40ca220 2024-09-12T02:40:16.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.322+0000 7f19d259c640 1 --2- 172.21.15.60:0/1728146055 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f19b406be30 0x7f19b406e2f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f19c4006fd0 tx=0x7f19c4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:16.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.322+0000 7f19cbfff640 1 --2- 172.21.15.60:0/1728146055 >> [v2:172.21.15.105:6800/50951309,v1:172.21.15.105:6801/50951309] conn(0x7f19b40767c0 0x7f19b4078c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:16.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.322+0000 7f19cbfff640 1 --2- 172.21.15.60:0/1728146055 >> [v2:172.21.15.105:6800/50951309,v1:172.21.15.105:6801/50951309] conn(0x7f19b40767c0 0x7f19b4078c40 crc :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:16.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.323+0000 7f19caffd640 1 -- 172.21.15.60:0/1728146055 <== osd.6 v2:172.21.15.105:6800/50951309 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f19b4079310 con 0x7f19b40767c0 2024-09-12T02:40:16.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.336+0000 7f19d8bf6640 1 -- 172.21.15.60:0/1728146055 --> [v2:172.21.15.105:6800/50951309,v1:172.21.15.105:6801/50951309] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f19d4068020 con 0x7f19b40767c0 2024-09-12T02:40:16.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.336+0000 7f19caffd640 1 -- 172.21.15.60:0/1728146055 <== osd.6 v2:172.21.15.105:6800/50951309 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f19d4068020 con 0x7f19b40767c0 2024-09-12T02:40:16.337 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:40:16.337 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T02:40:16.337 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:40:16.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.336+0000 7f19d8bf6640 1 -- 172.21.15.60:0/1728146055 >> [v2:172.21.15.105:6800/50951309,v1:172.21.15.105:6801/50951309] conn(0x7f19b40767c0 msgr2=0x7f19b4078c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:16.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.336+0000 7f19d8bf6640 1 --2- 172.21.15.60:0/1728146055 >> [v2:172.21.15.105:6800/50951309,v1:172.21.15.105:6801/50951309] conn(0x7f19b40767c0 0x7f19b4078c40 crc :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:16.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.336+0000 7f19d8bf6640 1 -- 172.21.15.60:0/1728146055 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f19b406be30 msgr2=0x7f19b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:16.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.336+0000 7f19d8bf6640 1 --2- 172.21.15.60:0/1728146055 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f19b406be30 0x7f19b406e2f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f19c4006fd0 tx=0x7f19c4008040 comp rx=0 tx=0).stop 2024-09-12T02:40:16.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.336+0000 7f19d8bf6640 1 -- 172.21.15.60:0/1728146055 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19d40ca220 msgr2=0x7f19d4143ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:16.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.336+0000 7f19d8bf6640 1 --2- 172.21.15.60:0/1728146055 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19d40ca220 0x7f19d4143ce0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f19cc034040 tx=0x7f19cc004a40 comp rx=0 tx=0).stop 2024-09-12T02:40:16.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.336+0000 7f19d2d9d640 1 -- 172.21.15.60:0/1728146055 reap_dead start 2024-09-12T02:40:16.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.337+0000 7f19d8bf6640 1 -- 172.21.15.60:0/1728146055 shutdown_connections 2024-09-12T02:40:16.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.337+0000 7f19d8bf6640 1 -- 172.21.15.60:0/1728146055 >> 172.21.15.60:0/1728146055 conn(0x7f19d4067b30 msgr2=0x7f19d414a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:16.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.337+0000 7f19d8bf6640 1 -- 172.21.15.60:0/1728146055 shutdown_connections 2024-09-12T02:40:16.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.337+0000 7f19d8bf6640 1 -- 172.21.15.60:0/1728146055 wait complete. 2024-09-12T02:40:16.348 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-12T02:40:16.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.451+0000 7f3151d52640 1 Processor -- start 2024-09-12T02:40:16.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.451+0000 7f3151d52640 1 -- start start 2024-09-12T02:40:16.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.451+0000 7f3151d52640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f314c06c650 0x7f314c0c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:16.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.452+0000 7f3151d52640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f314c0ca1c0 0x7f314c160bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:16.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.452+0000 7f3151d52640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f314c15a7c0 con 0x7f314c150480 2024-09-12T02:40:16.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.452+0000 7f3151d52640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f314c06c240 con 0x7f314c06c650 2024-09-12T02:40:16.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.452+0000 7f3151d52640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f314c15a330 con 0x7f314c0ca1c0 2024-09-12T02:40:16.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.452+0000 7f314affd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f314c06c650 0x7f314c0c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:16.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.452+0000 7f314affd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f314c06c650 0x7f314c0c9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40650/0 (socket says 172.21.15.60:40650) 2024-09-12T02:40:16.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.452+0000 7f314affd640 1 -- 172.21.15.60:0/2025371728 learned_addr learned my addr 172.21.15.60:0/2025371728 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:16.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.452+0000 7f314affd640 1 -- 172.21.15.60:0/2025371728 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f314c0ca1c0 msgr2=0x7f314c160bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:16.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.452+0000 7f314affd640 1 --2- 172.21.15.60:0/2025371728 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f314c0ca1c0 0x7f314c160bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:16.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.452+0000 7f314affd640 1 -- 172.21.15.60:0/2025371728 >> v1:172.21.15.105:6789/0 conn(0x7f314c150480 legacy=0x7f314c0c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:16.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.452+0000 7f314affd640 1 -- 172.21.15.60:0/2025371728 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f314c159a00 con 0x7f314c06c650 2024-09-12T02:40:16.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.453+0000 7f314affd640 1 --2- 172.21.15.60:0/2025371728 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f314c06c650 0x7f314c0c9c80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3134009870 tx=0x7f313402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69743e737790dc4d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:16.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.453+0000 7f314a7fc640 1 -- 172.21.15.60:0/2025371728 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3134037070 con 0x7f314c06c650 2024-09-12T02:40:16.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.453+0000 7f314a7fc640 1 -- 172.21.15.60:0/2025371728 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3134032440 con 0x7f314c06c650 2024-09-12T02:40:16.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.453+0000 7f314a7fc640 1 -- 172.21.15.60:0/2025371728 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3134032810 con 0x7f314c06c650 2024-09-12T02:40:16.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.453+0000 7f3151d52640 1 -- 172.21.15.60:0/2025371728 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f314c06c650 msgr2=0x7f314c0c9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:16.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.453+0000 7f3151d52640 1 --2- 172.21.15.60:0/2025371728 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f314c06c650 0x7f314c0c9c80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3134009870 tx=0x7f313402a210 comp rx=0 tx=0).stop 2024-09-12T02:40:16.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.453+0000 7f3151d52640 1 -- 172.21.15.60:0/2025371728 shutdown_connections 2024-09-12T02:40:16.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.453+0000 7f3151d52640 1 --2- 172.21.15.60:0/2025371728 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f314c0ca1c0 0x7f314c160bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:16.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.453+0000 7f3151d52640 1 --2- 172.21.15.60:0/2025371728 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f314c06c650 0x7f314c0c9c80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:16.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.453+0000 7f3151d52640 1 -- 172.21.15.60:0/2025371728 >> 172.21.15.60:0/2025371728 conn(0x7f314c068030 msgr2=0x7f314c073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:16.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.453+0000 7f3151d52640 1 -- 172.21.15.60:0/2025371728 shutdown_connections 2024-09-12T02:40:16.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.454+0000 7f3151d52640 1 -- 172.21.15.60:0/2025371728 wait complete. 2024-09-12T02:40:16.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.455+0000 7f3151d52640 1 Processor -- start 2024-09-12T02:40:16.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.455+0000 7f3151d52640 1 -- start start 2024-09-12T02:40:16.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.455+0000 7f3151d52640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f314c06c650 0x7f314c151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:16.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.455+0000 7f3151d52640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f314c0ca1c0 0x7f314c0c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:16.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.455+0000 7f3151d52640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f314c150480 0x7f314c1508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:16.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.456+0000 7f3151d52640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f314c0ca630 con 0x7f314c0ca1c0 2024-09-12T02:40:16.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.456+0000 7f3151d52640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f314c159fc0 con 0x7f314c06c650 2024-09-12T02:40:16.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.456+0000 7f3151d52640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f314c06d270 con 0x7f314c150480 2024-09-12T02:40:16.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.456+0000 7f314affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f314c0ca1c0 0x7f314c0c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:16.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.456+0000 7f314affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f314c0ca1c0 0x7f314c0c8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40654/0 (socket says 172.21.15.60:40654) 2024-09-12T02:40:16.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.456+0000 7f314affd640 1 -- 172.21.15.60:0/3285436872 learned_addr learned my addr 172.21.15.60:0/3285436872 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:16.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.456+0000 7f314bfff640 1 --2- 172.21.15.60:0/3285436872 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f314c150480 0x7f314c1508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:16.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.456+0000 7f314b7fe640 1 --2- 172.21.15.60:0/3285436872 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f314c06c650 0x7f314c151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:16.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.456+0000 7f314affd640 1 -- 172.21.15.60:0/3285436872 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f314c150480 msgr2=0x7f314c1508f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:16.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.456+0000 7f314affd640 1 --2- 172.21.15.60:0/3285436872 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f314c150480 0x7f314c1508f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:16.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.456+0000 7f314affd640 1 -- 172.21.15.60:0/3285436872 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f314c06c650 msgr2=0x7f314c151300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:16.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.456+0000 7f314affd640 1 --2- 172.21.15.60:0/3285436872 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f314c06c650 0x7f314c151300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:16.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.456+0000 7f314affd640 1 -- 172.21.15.60:0/3285436872 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f314c1526f0 con 0x7f314c0ca1c0 2024-09-12T02:40:16.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.456+0000 7f314affd640 1 --2- 172.21.15.60:0/3285436872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f314c0ca1c0 0x7f314c0c8fa0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3134009870 tx=0x7f31340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:16.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.456+0000 7f3143fff640 1 -- 172.21.15.60:0/3285436872 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3134041070 con 0x7f314c0ca1c0 2024-09-12T02:40:16.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.456+0000 7f3143fff640 1 -- 172.21.15.60:0/3285436872 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f313403c870 con 0x7f314c0ca1c0 2024-09-12T02:40:16.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.456+0000 7f3143fff640 1 -- 172.21.15.60:0/3285436872 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3134037040 con 0x7f314c0ca1c0 2024-09-12T02:40:16.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.456+0000 7f3151d52640 1 -- 172.21.15.60:0/3285436872 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f314c1f0020 con 0x7f314c0ca1c0 2024-09-12T02:40:16.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.456+0000 7f3151d52640 1 -- 172.21.15.60:0/3285436872 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f314c1f02e0 con 0x7f314c0ca1c0 2024-09-12T02:40:16.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.457+0000 7f3151d52640 1 -- 172.21.15.60:0/3285436872 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f314c0697e0 con 0x7f314c0ca1c0 2024-09-12T02:40:16.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.458+0000 7f3143fff640 1 -- 172.21.15.60:0/3285436872 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3134044070 con 0x7f314c0ca1c0 2024-09-12T02:40:16.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.458+0000 7f3143fff640 1 --2- 172.21.15.60:0/3285436872 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f312c06be60 0x7f312c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:16.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.458+0000 7f3143fff640 1 -- 172.21.15.60:0/3285436872 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f31340abcc0 con 0x7f314c0ca1c0 2024-09-12T02:40:16.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.458+0000 7f314b7fe640 1 --2- 172.21.15.60:0/3285436872 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f312c06be60 0x7f312c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:16.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.459+0000 7f314b7fe640 1 --2- 172.21.15.60:0/3285436872 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f312c06be60 0x7f312c06e320 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f313c003d90 tx=0x7f313c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:16.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.462+0000 7f3143fff640 1 -- 172.21.15.60:0/3285436872 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f314c0697e0 con 0x7f314c0ca1c0 2024-09-12T02:40:16.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.639+0000 7f3151d52640 1 -- 172.21.15.60:0/3285436872 --> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f314c155730 con 0x7f312c06be60 2024-09-12T02:40:16.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.639+0000 7f3143fff640 1 -- 172.21.15.60:0/3285436872 <== mgr.4098 v2:172.21.15.60:6800/3549430091 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f314c155730 con 0x7f312c06be60 2024-09-12T02:40:16.640 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 6 to deep-scrub 2024-09-12T02:40:16.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.642+0000 7f3151d52640 1 -- 172.21.15.60:0/3285436872 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f312c06be60 msgr2=0x7f312c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:16.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.642+0000 7f3151d52640 1 --2- 172.21.15.60:0/3285436872 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f312c06be60 0x7f312c06e320 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f313c003d90 tx=0x7f313c009040 comp rx=0 tx=0).stop 2024-09-12T02:40:16.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.642+0000 7f3151d52640 1 -- 172.21.15.60:0/3285436872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f314c0ca1c0 msgr2=0x7f314c0c8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:16.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.642+0000 7f3151d52640 1 --2- 172.21.15.60:0/3285436872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f314c0ca1c0 0x7f314c0c8fa0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3134009870 tx=0x7f31340046c0 comp rx=0 tx=0).stop 2024-09-12T02:40:16.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.642+0000 7f3151d52640 1 -- 172.21.15.60:0/3285436872 shutdown_connections 2024-09-12T02:40:16.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.642+0000 7f3151d52640 1 --2- 172.21.15.60:0/3285436872 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f312c06be60 0x7f312c06e320 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:16.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.642+0000 7f3151d52640 1 --2- 172.21.15.60:0/3285436872 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f314c150480 0x7f314c1508f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:16.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.642+0000 7f3151d52640 1 --2- 172.21.15.60:0/3285436872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f314c0ca1c0 0x7f314c0c8fa0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:16.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.642+0000 7f3151d52640 1 --2- 172.21.15.60:0/3285436872 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f314c06c650 0x7f314c151300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:16.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.642+0000 7f3151d52640 1 -- 172.21.15.60:0/3285436872 >> 172.21.15.60:0/3285436872 conn(0x7f314c068030 msgr2=0x7f314c0ca7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:16.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.642+0000 7f3151d52640 1 -- 172.21.15.60:0/3285436872 shutdown_connections 2024-09-12T02:40:16.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.642+0000 7f3151d52640 1 -- 172.21.15.60:0/3285436872 wait complete. 2024-09-12T02:40:16.653 INFO:tasks.ceph:Scrubbing osd.7 2024-09-12T02:40:16.654 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:40:16.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.763+0000 7f670bfff640 1 Processor -- start 2024-09-12T02:40:16.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.763+0000 7f670bfff640 1 -- start start 2024-09-12T02:40:16.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.764+0000 7f670bfff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f670c156eb0 0x7f670c154940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:16.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.764+0000 7f670bfff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f670c0c69a0 0x7f670c0c6de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:16.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.764+0000 7f670bfff640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f670c06bfb0 con 0x7f670c06ee10 2024-09-12T02:40:16.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.764+0000 7f670bfff640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f670c1553b0 con 0x7f670c0c69a0 2024-09-12T02:40:16.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.764+0000 7f670bfff640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f670c157290 con 0x7f670c156eb0 2024-09-12T02:40:16.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.764+0000 7f670a7fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f670c0c69a0 0x7f670c0c6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:16.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.764+0000 7f670a7fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f670c0c69a0 0x7f670c0c6de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40662/0 (socket says 172.21.15.60:40662) 2024-09-12T02:40:16.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.764+0000 7f670a7fc640 1 -- 172.21.15.60:0/155987804 learned_addr learned my addr 172.21.15.60:0/155987804 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:16.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.765+0000 7f670affd640 1 --2- 172.21.15.60:0/155987804 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f670c156eb0 0x7f670c154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:16.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.765+0000 7f670a7fc640 1 -- 172.21.15.60:0/155987804 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f670c156eb0 msgr2=0x7f670c154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:16.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.765+0000 7f670a7fc640 1 --2- 172.21.15.60:0/155987804 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f670c156eb0 0x7f670c154940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:16.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.765+0000 7f670a7fc640 1 -- 172.21.15.60:0/155987804 >> v1:172.21.15.105:6789/0 conn(0x7f670c06ee10 legacy=0x7f670c06f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:16.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.765+0000 7f670a7fc640 1 -- 172.21.15.60:0/155987804 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f670c0c8b90 con 0x7f670c0c69a0 2024-09-12T02:40:16.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.765+0000 7f670affd640 1 --2- 172.21.15.60:0/155987804 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f670c156eb0 0x7f670c154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:40:16.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.765+0000 7f670a7fc640 1 --2- 172.21.15.60:0/155987804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f670c0c69a0 0x7f670c0c6de0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6700009870 tx=0x7f670002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b3e101a222f9b5a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:16.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.766+0000 7f6709ffb640 1 -- 172.21.15.60:0/155987804 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6700037070 con 0x7f670c0c69a0 2024-09-12T02:40:16.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.766+0000 7f6709ffb640 1 -- 172.21.15.60:0/155987804 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f670002ae10 con 0x7f670c0c69a0 2024-09-12T02:40:16.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.766+0000 7f6709ffb640 1 -- 172.21.15.60:0/155987804 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6700032660 con 0x7f670c0c69a0 2024-09-12T02:40:16.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.766+0000 7f670bfff640 1 -- 172.21.15.60:0/155987804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f670c0c69a0 msgr2=0x7f670c0c6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:16.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.766+0000 7f670bfff640 1 --2- 172.21.15.60:0/155987804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f670c0c69a0 0x7f670c0c6de0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6700009870 tx=0x7f670002a100 comp rx=0 tx=0).stop 2024-09-12T02:40:16.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.766+0000 7f670bfff640 1 -- 172.21.15.60:0/155987804 shutdown_connections 2024-09-12T02:40:16.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.766+0000 7f670bfff640 1 --2- 172.21.15.60:0/155987804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f670c0c69a0 0x7f670c0c6de0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:16.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.766+0000 7f670bfff640 1 --2- 172.21.15.60:0/155987804 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f670c156eb0 0x7f670c154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:16.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.766+0000 7f670bfff640 1 -- 172.21.15.60:0/155987804 >> 172.21.15.60:0/155987804 conn(0x7f670c06cf00 msgr2=0x7f670c06d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:16.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.766+0000 7f670bfff640 1 -- 172.21.15.60:0/155987804 shutdown_connections 2024-09-12T02:40:16.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.766+0000 7f670bfff640 1 -- 172.21.15.60:0/155987804 wait complete. 2024-09-12T02:40:16.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.767+0000 7f670bfff640 1 Processor -- start 2024-09-12T02:40:16.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.767+0000 7f670bfff640 1 -- start start 2024-09-12T02:40:16.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.768+0000 7f670bfff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f670c06ee10 0x7f670c1e14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:16.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.768+0000 7f670bfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f670c0c69a0 0x7f670c1ec530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:16.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.768+0000 7f670bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f670c156eb0 0x7f670c1eca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:16.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.768+0000 7f670bfff640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f670c06f9d0 con 0x7f670c156eb0 2024-09-12T02:40:16.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.768+0000 7f670bfff640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f670c06e980 con 0x7f670c0c69a0 2024-09-12T02:40:16.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.768+0000 7f670bfff640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f670c0c9150 con 0x7f670c06ee10 2024-09-12T02:40:16.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.768+0000 7f670b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f670c156eb0 0x7f670c1eca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:16.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.768+0000 7f670b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f670c156eb0 0x7f670c1eca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40668/0 (socket says 172.21.15.60:40668) 2024-09-12T02:40:16.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.768+0000 7f670b7fe640 1 -- 172.21.15.60:0/2885922696 learned_addr learned my addr 172.21.15.60:0/2885922696 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:16.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.769+0000 7f670affd640 1 --2- 172.21.15.60:0/2885922696 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f670c06ee10 0x7f670c1e14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:16.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.769+0000 7f670a7fc640 1 --2- 172.21.15.60:0/2885922696 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f670c0c69a0 0x7f670c1ec530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:16.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.769+0000 7f670b7fe640 1 -- 172.21.15.60:0/2885922696 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f670c06ee10 msgr2=0x7f670c1e14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:16.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.769+0000 7f670b7fe640 1 --2- 172.21.15.60:0/2885922696 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f670c06ee10 0x7f670c1e14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:16.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.769+0000 7f670b7fe640 1 -- 172.21.15.60:0/2885922696 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f670c0c69a0 msgr2=0x7f670c1ec530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:16.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.769+0000 7f670b7fe640 1 --2- 172.21.15.60:0/2885922696 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f670c0c69a0 0x7f670c1ec530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:16.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.769+0000 7f670b7fe640 1 -- 172.21.15.60:0/2885922696 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f670c0c3480 con 0x7f670c156eb0 2024-09-12T02:40:16.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.769+0000 7f670a7fc640 1 --2- 172.21.15.60:0/2885922696 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f670c0c69a0 0x7f670c1ec530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:40:16.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.769+0000 7f670b7fe640 1 --2- 172.21.15.60:0/2885922696 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f670c156eb0 0x7f670c1eca70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f670400c780 tx=0x7f670400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:16.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.769+0000 7f66f37fe640 1 -- 172.21.15.60:0/2885922696 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6704004b60 con 0x7f670c156eb0 2024-09-12T02:40:16.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.769+0000 7f66f37fe640 1 -- 172.21.15.60:0/2885922696 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6704004d00 con 0x7f670c156eb0 2024-09-12T02:40:16.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.769+0000 7f670bfff640 1 -- 172.21.15.60:0/2885922696 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f670c0c3760 con 0x7f670c156eb0 2024-09-12T02:40:16.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.769+0000 7f66f37fe640 1 -- 172.21.15.60:0/2885922696 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f670400aa90 con 0x7f670c156eb0 2024-09-12T02:40:16.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.769+0000 7f670bfff640 1 -- 172.21.15.60:0/2885922696 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f670c0a7c20 con 0x7f670c156eb0 2024-09-12T02:40:16.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.770+0000 7f670bfff640 1 -- 172.21.15.60:0/2885922696 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f670c0c9430 con 0x7f670c156eb0 2024-09-12T02:40:16.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.771+0000 7f66f37fe640 1 -- 172.21.15.60:0/2885922696 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f670400ac30 con 0x7f670c156eb0 2024-09-12T02:40:16.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.771+0000 7f66f37fe640 1 --2- 172.21.15.60:0/2885922696 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f66f806be30 0x7f66f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:16.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.771+0000 7f670affd640 1 --2- 172.21.15.60:0/2885922696 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f66f806be30 0x7f66f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:16.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.771+0000 7f66f37fe640 1 -- 172.21.15.60:0/2885922696 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f670408b500 con 0x7f670c156eb0 2024-09-12T02:40:16.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.771+0000 7f66f37fe640 1 --2- 172.21.15.60:0/2885922696 >> [v2:172.21.15.105:6816/3745331251,v1:172.21.15.105:6817/3745331251] conn(0x7f66f80767d0 0x7f66f8078c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:16.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.771+0000 7f66f37fe640 1 -- 172.21.15.60:0/2885922696 --> [v2:172.21.15.105:6816/3745331251,v1:172.21.15.105:6817/3745331251] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6704016ec0 con 0x7f66f80767d0 2024-09-12T02:40:16.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.771+0000 7f66f37fe640 1 -- 172.21.15.60:0/2885922696 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6704092050 con 0x7f670c156eb0 2024-09-12T02:40:16.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.772+0000 7f670affd640 1 --2- 172.21.15.60:0/2885922696 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f66f806be30 0x7f66f806e2f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f66fc00a950 tx=0x7f66fc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:16.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.772+0000 7f670a7fc640 1 --2- 172.21.15.60:0/2885922696 >> [v2:172.21.15.105:6816/3745331251,v1:172.21.15.105:6817/3745331251] conn(0x7f66f80767d0 0x7f66f8078c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:16.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.772+0000 7f670a7fc640 1 --2- 172.21.15.60:0/2885922696 >> [v2:172.21.15.105:6816/3745331251,v1:172.21.15.105:6817/3745331251] conn(0x7f66f80767d0 0x7f66f8078c50 crc :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:16.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.773+0000 7f66f37fe640 1 -- 172.21.15.60:0/2885922696 <== osd.7 v2:172.21.15.105:6816/3745331251 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6704016ec0 con 0x7f66f80767d0 2024-09-12T02:40:16.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.785+0000 7f670bfff640 1 -- 172.21.15.60:0/2885922696 --> [v2:172.21.15.105:6816/3745331251,v1:172.21.15.105:6817/3745331251] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f670c0c2b50 con 0x7f66f80767d0 2024-09-12T02:40:16.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.786+0000 7f66f37fe640 1 -- 172.21.15.60:0/2885922696 <== osd.7 v2:172.21.15.105:6816/3745331251 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f670c0c2b50 con 0x7f66f80767d0 2024-09-12T02:40:16.787 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T02:40:16.787 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T02:40:16.787 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T02:40:16.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.786+0000 7f670bfff640 1 -- 172.21.15.60:0/2885922696 >> [v2:172.21.15.105:6816/3745331251,v1:172.21.15.105:6817/3745331251] conn(0x7f66f80767d0 msgr2=0x7f66f8078c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:16.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.786+0000 7f670bfff640 1 --2- 172.21.15.60:0/2885922696 >> [v2:172.21.15.105:6816/3745331251,v1:172.21.15.105:6817/3745331251] conn(0x7f66f80767d0 0x7f66f8078c50 crc :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:16.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.786+0000 7f670bfff640 1 -- 172.21.15.60:0/2885922696 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f66f806be30 msgr2=0x7f66f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:16.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.786+0000 7f670bfff640 1 --2- 172.21.15.60:0/2885922696 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f66f806be30 0x7f66f806e2f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f66fc00a950 tx=0x7f66fc008040 comp rx=0 tx=0).stop 2024-09-12T02:40:16.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.786+0000 7f670bfff640 1 -- 172.21.15.60:0/2885922696 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f670c156eb0 msgr2=0x7f670c1eca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:16.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.786+0000 7f670bfff640 1 --2- 172.21.15.60:0/2885922696 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f670c156eb0 0x7f670c1eca70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f670400c780 tx=0x7f670400cc40 comp rx=0 tx=0).stop 2024-09-12T02:40:16.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.786+0000 7f670b7fe640 1 -- 172.21.15.60:0/2885922696 reap_dead start 2024-09-12T02:40:16.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.786+0000 7f670bfff640 1 -- 172.21.15.60:0/2885922696 shutdown_connections 2024-09-12T02:40:16.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.786+0000 7f670bfff640 1 -- 172.21.15.60:0/2885922696 >> 172.21.15.60:0/2885922696 conn(0x7f670c06cf00 msgr2=0x7f670c0aa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:16.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.786+0000 7f670bfff640 1 -- 172.21.15.60:0/2885922696 shutdown_connections 2024-09-12T02:40:16.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.786+0000 7f670bfff640 1 -- 172.21.15.60:0/2885922696 wait complete. 2024-09-12T02:40:16.798 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-12T02:40:16.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.908+0000 7fb8d8015640 1 Processor -- start 2024-09-12T02:40:16.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.908+0000 7fb8d8015640 1 -- start start 2024-09-12T02:40:16.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.908+0000 7fb8d8015640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb8d0073ae0 0x7fb8d0153380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:16.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.909+0000 7fb8d8015640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8d00733d0 0x7fb8d01538c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:16.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.909+0000 7fb8d8015640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8d006dd50 con 0x7fb8d006d850 2024-09-12T02:40:16.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.909+0000 7fb8d8015640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fb8d006e030 con 0x7fb8d0073ae0 2024-09-12T02:40:16.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.909+0000 7fb8d8015640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb8d006e310 con 0x7fb8d00733d0 2024-09-12T02:40:16.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.909+0000 7fb8d5db1640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb8d0073ae0 0x7fb8d0153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:16.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.909+0000 7fb8d65b2640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb8d006d850 0x7fb8d0156840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:42876/0 (socket says 172.21.15.60:42876) 2024-09-12T02:40:16.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.909+0000 7fb8d65b2640 1 -- 172.21.15.60:0/243991162 learned_addr learned my addr 172.21.15.60:0/243991162 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:40:16.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.909+0000 7fb8d55b0640 1 --2- 172.21.15.60:0/243991162 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8d00733d0 0x7fb8d01538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:16.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.909+0000 7fb8d5db1640 1 -- 172.21.15.60:0/243991162 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8d00733d0 msgr2=0x7fb8d01538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:16.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.909+0000 7fb8d5db1640 1 --2- 172.21.15.60:0/243991162 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8d00733d0 0x7fb8d01538c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:16.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.909+0000 7fb8d5db1640 1 -- 172.21.15.60:0/243991162 >> v1:172.21.15.60:6789/0 conn(0x7fb8d006d850 legacy=0x7fb8d0156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:16.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.909+0000 7fb8d5db1640 1 -- 172.21.15.60:0/243991162 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d006e5f0 con 0x7fb8d0073ae0 2024-09-12T02:40:16.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.909+0000 7fb8d55b0640 1 --2- 172.21.15.60:0/243991162 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8d00733d0 0x7fb8d01538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:40:16.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.910+0000 7fb8d5db1640 1 --2- 172.21.15.60:0/243991162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8d0073ae0 0x7fb8d0153380 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0009d90 tx=0x7fb8c002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4f6b6bf8ed89f43 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:16.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.910+0000 7fb8d4daf640 1 -- 172.21.15.60:0/243991162 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c0007740 con 0x7fb8d0073ae0 2024-09-12T02:40:16.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.910+0000 7fb8d4daf640 1 -- 172.21.15.60:0/243991162 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8c00078e0 con 0x7fb8d0073ae0 2024-09-12T02:40:16.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.910+0000 7fb8d4daf640 1 -- 172.21.15.60:0/243991162 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c0007cb0 con 0x7fb8d0073ae0 2024-09-12T02:40:16.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.910+0000 7fb8d8015640 1 -- 172.21.15.60:0/243991162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8d0073ae0 msgr2=0x7fb8d0153380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:16.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.910+0000 7fb8d8015640 1 --2- 172.21.15.60:0/243991162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8d0073ae0 0x7fb8d0153380 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0009d90 tx=0x7fb8c002a660 comp rx=0 tx=0).stop 2024-09-12T02:40:16.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.911+0000 7fb8d8015640 1 -- 172.21.15.60:0/243991162 shutdown_connections 2024-09-12T02:40:16.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.911+0000 7fb8d8015640 1 --2- 172.21.15.60:0/243991162 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8d00733d0 0x7fb8d01538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:16.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.911+0000 7fb8d8015640 1 --2- 172.21.15.60:0/243991162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8d0073ae0 0x7fb8d0153380 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:16.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.911+0000 7fb8d8015640 1 -- 172.21.15.60:0/243991162 >> 172.21.15.60:0/243991162 conn(0x7fb8d00c9d80 msgr2=0x7fb8d00ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:16.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.911+0000 7fb8d8015640 1 -- 172.21.15.60:0/243991162 shutdown_connections 2024-09-12T02:40:16.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.911+0000 7fb8d8015640 1 -- 172.21.15.60:0/243991162 wait complete. 2024-09-12T02:40:16.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.912+0000 7fb8d8015640 1 Processor -- start 2024-09-12T02:40:16.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.912+0000 7fb8d8015640 1 -- start start 2024-09-12T02:40:16.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.912+0000 7fb8d8015640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8d006d850 0x7fb8d01e2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:16.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.912+0000 7fb8d8015640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8d00733d0 0x7fb8d0146b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:16.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.912+0000 7fb8d8015640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8d0073ae0 0x7fb8d01470a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:16.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.912+0000 7fb8d8015640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d006edd0 con 0x7fb8d0073ae0 2024-09-12T02:40:16.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.912+0000 7fb8d8015640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d006ec50 con 0x7fb8d006d850 2024-09-12T02:40:16.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.912+0000 7fb8d8015640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb8d0073ec0 con 0x7fb8d00733d0 2024-09-12T02:40:16.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.913+0000 7fb8d65b2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8d0073ae0 0x7fb8d01470a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:16.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.913+0000 7fb8d65b2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8d0073ae0 0x7fb8d01470a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40682/0 (socket says 172.21.15.60:40682) 2024-09-12T02:40:16.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.913+0000 7fb8d65b2640 1 -- 172.21.15.60:0/1713099115 learned_addr learned my addr 172.21.15.60:0/1713099115 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:16.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.913+0000 7fb8d55b0640 1 --2- 172.21.15.60:0/1713099115 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8d00733d0 0x7fb8d0146b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:16.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.913+0000 7fb8d65b2640 1 -- 172.21.15.60:0/1713099115 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8d00733d0 msgr2=0x7fb8d0146b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:16.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.913+0000 7fb8d65b2640 1 --2- 172.21.15.60:0/1713099115 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8d00733d0 0x7fb8d0146b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:16.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.913+0000 7fb8d65b2640 1 -- 172.21.15.60:0/1713099115 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8d006d850 msgr2=0x7fb8d01e2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:16.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.913+0000 7fb8d65b2640 1 --2- 172.21.15.60:0/1713099115 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8d006d850 0x7fb8d01e2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:16.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.913+0000 7fb8d65b2640 1 -- 172.21.15.60:0/1713099115 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d0149b40 con 0x7fb8d0073ae0 2024-09-12T02:40:16.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.913+0000 7fb8d65b2640 1 --2- 172.21.15.60:0/1713099115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8d0073ae0 0x7fb8d01470a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb8c800c340 tx=0x7fb8c800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:16.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.913+0000 7fb8ce7fc640 1 -- 172.21.15.60:0/1713099115 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8017070 con 0x7fb8d0073ae0 2024-09-12T02:40:16.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.913+0000 7fb8ce7fc640 1 -- 172.21.15.60:0/1713099115 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8c8005ce0 con 0x7fb8d0073ae0 2024-09-12T02:40:16.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.913+0000 7fb8d8015640 1 -- 172.21.15.60:0/1713099115 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8d0149e20 con 0x7fb8d0073ae0 2024-09-12T02:40:16.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.913+0000 7fb8ce7fc640 1 -- 172.21.15.60:0/1713099115 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c80072d0 con 0x7fb8d0073ae0 2024-09-12T02:40:16.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.913+0000 7fb8d8015640 1 -- 172.21.15.60:0/1713099115 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8d014a3e0 con 0x7fb8d0073ae0 2024-09-12T02:40:16.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.914+0000 7fb8d8015640 1 -- 172.21.15.60:0/1713099115 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8d006e8b0 con 0x7fb8d0073ae0 2024-09-12T02:40:16.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.915+0000 7fb8ce7fc640 1 -- 172.21.15.60:0/1713099115 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb8c801a070 con 0x7fb8d0073ae0 2024-09-12T02:40:16.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.915+0000 7fb8ce7fc640 1 --2- 172.21.15.60:0/1713099115 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb8bc06be30 0x7fb8bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:16.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.915+0000 7fb8ce7fc640 1 -- 172.21.15.60:0/1713099115 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fb8c808a390 con 0x7fb8d0073ae0 2024-09-12T02:40:16.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.915+0000 7fb8d5db1640 1 --2- 172.21.15.60:0/1713099115 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb8bc06be30 0x7fb8bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:16.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.916+0000 7fb8d5db1640 1 --2- 172.21.15.60:0/1713099115 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb8bc06be30 0x7fb8bc06e2f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0034000 tx=0x7fb8c002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:16.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:16.919+0000 7fb8ce7fc640 1 -- 172.21.15.60:0/1713099115 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb8d006e8b0 con 0x7fb8d0073ae0 2024-09-12T02:40:17.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.096+0000 7fb8d8015640 1 -- 172.21.15.60:0/1713099115 --> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fb8d0072c50 con 0x7fb8bc06be30 2024-09-12T02:40:17.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.096+0000 7fb8ce7fc640 1 -- 172.21.15.60:0/1713099115 <== mgr.4098 v2:172.21.15.60:6800/3549430091 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb8d0072c50 con 0x7fb8bc06be30 2024-09-12T02:40:17.097 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 7 to deep-scrub 2024-09-12T02:40:17.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.098+0000 7fb8d8015640 1 -- 172.21.15.60:0/1713099115 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb8bc06be30 msgr2=0x7fb8bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:17.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.098+0000 7fb8d8015640 1 --2- 172.21.15.60:0/1713099115 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb8bc06be30 0x7fb8bc06e2f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0034000 tx=0x7fb8c002e000 comp rx=0 tx=0).stop 2024-09-12T02:40:17.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.098+0000 7fb8d8015640 1 -- 172.21.15.60:0/1713099115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8d0073ae0 msgr2=0x7fb8d01470a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:17.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.098+0000 7fb8d8015640 1 --2- 172.21.15.60:0/1713099115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8d0073ae0 0x7fb8d01470a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb8c800c340 tx=0x7fb8c800c800 comp rx=0 tx=0).stop 2024-09-12T02:40:17.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.098+0000 7fb8d8015640 1 -- 172.21.15.60:0/1713099115 shutdown_connections 2024-09-12T02:40:17.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.098+0000 7fb8d8015640 1 --2- 172.21.15.60:0/1713099115 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fb8bc06be30 0x7fb8bc06e2f0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:17.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.098+0000 7fb8d8015640 1 --2- 172.21.15.60:0/1713099115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8d0073ae0 0x7fb8d01470a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:17.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.098+0000 7fb8d8015640 1 --2- 172.21.15.60:0/1713099115 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8d00733d0 0x7fb8d0146b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:17.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.098+0000 7fb8d8015640 1 --2- 172.21.15.60:0/1713099115 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8d006d850 0x7fb8d01e2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:17.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.098+0000 7fb8d8015640 1 -- 172.21.15.60:0/1713099115 >> 172.21.15.60:0/1713099115 conn(0x7fb8d00c9d80 msgr2=0x7fb8d00c4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:17.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.098+0000 7fb8d8015640 1 -- 172.21.15.60:0/1713099115 shutdown_connections 2024-09-12T02:40:17.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.098+0000 7fb8d8015640 1 -- 172.21.15.60:0/1713099115 wait complete. 2024-09-12T02:40:17.110 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:40:17.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.211+0000 7fbbab776640 1 Processor -- start 2024-09-12T02:40:17.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.211+0000 7fbbab776640 1 -- start start 2024-09-12T02:40:17.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.212+0000 7fbbab776640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbba406ede0 0x7fbba4161ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:17.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.212+0000 7fbbab776640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbba415a830 con 0x7fbba40c84e0 2024-09-12T02:40:17.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.212+0000 7fbbab776640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbba40c7490 con 0x7fbba415a450 2024-09-12T02:40:17.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.212+0000 7fbbab776640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fbba406e240 con 0x7fbba406ede0 2024-09-12T02:40:17.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.212+0000 7fbba8d11640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fbba40c84e0 0x7fbba406e6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:42886/0 (socket says 172.21.15.60:42886) 2024-09-12T02:40:17.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.212+0000 7fbba8d11640 1 -- 172.21.15.60:0/2674601559 learned_addr learned my addr 172.21.15.60:0/2674601559 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:40:17.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.212+0000 7fbba9d13640 1 --2- 172.21.15.60:0/2674601559 >> v2:172.21.15.105:3300/0 conn(0x7fbba406ede0 0x7fbba4161ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:17.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.212+0000 7fbb9bfff640 1 -- 172.21.15.60:0/2674601559 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1773731066 0 0) 0x7fbba415a830 con 0x7fbba40c84e0 2024-09-12T02:40:17.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.212+0000 7fbb9bfff640 1 -- 172.21.15.60:0/2674601559 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb90003520 con 0x7fbba40c84e0 2024-09-12T02:40:17.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.213+0000 7fbb9bfff640 1 -- 172.21.15.60:0/2674601559 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 488807061 0 0) 0x7fbb90003520 con 0x7fbba40c84e0 2024-09-12T02:40:17.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.213+0000 7fbb9bfff640 1 -- 172.21.15.60:0/2674601559 >> v2:172.21.15.105:3300/0 conn(0x7fbba406ede0 msgr2=0x7fbba4161ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:17.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.213+0000 7fbb9bfff640 1 --2- 172.21.15.60:0/2674601559 >> v2:172.21.15.105:3300/0 conn(0x7fbba406ede0 0x7fbba4161ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:17.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.213+0000 7fbb9bfff640 1 -- 172.21.15.60:0/2674601559 >> v1:172.21.15.105:6789/0 conn(0x7fbba415a450 legacy=0x7fbba40c3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:17.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.213+0000 7fbb9bfff640 1 -- 172.21.15.60:0/2674601559 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbba40c7770 con 0x7fbba40c84e0 2024-09-12T02:40:17.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.213+0000 7fbb9bfff640 1 -- 172.21.15.60:0/2674601559 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7fbb94001670 con 0x7fbba40c84e0 2024-09-12T02:40:17.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.213+0000 7fbb9bfff640 1 -- 172.21.15.60:0/2674601559 >> v1:172.21.15.60:6789/0 conn(0x7fbba40c84e0 legacy=0x7fbba406e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:17.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.213+0000 7fbb9bfff640 1 --2- 172.21.15.60:0/2674601559 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb900039e0 0x7fbb90003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:17.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.213+0000 7fbb9bfff640 1 --2- 172.21.15.60:0/2674601559 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb90004800 0x7fbb90004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:17.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.213+0000 7fbb9bfff640 1 --2- 172.21.15.60:0/2674601559 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb900051c0 0x7fbb9000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:17.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.213+0000 7fbb9bfff640 1 -- 172.21.15.60:0/2674601559 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbba406e240 con 0x7fbb90004800 2024-09-12T02:40:17.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.213+0000 7fbb9bfff640 1 -- 172.21.15.60:0/2674601559 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbb9000c070 con 0x7fbb900039e0 2024-09-12T02:40:17.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.213+0000 7fbb9bfff640 1 -- 172.21.15.60:0/2674601559 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbb9000c270 con 0x7fbb900051c0 2024-09-12T02:40:17.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.213+0000 7fbba8d11640 1 --2- 172.21.15.60:0/2674601559 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb90004800 0x7fbb90004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:17.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.213+0000 7fbba9512640 1 --2- 172.21.15.60:0/2674601559 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb900039e0 0x7fbb90003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:17.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.213+0000 7fbba9d13640 1 --2- 172.21.15.60:0/2674601559 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb900051c0 0x7fbb9000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:17.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.213+0000 7fbba8d11640 1 -- 172.21.15.60:0/2674601559 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb900051c0 msgr2=0x7fbb9000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:17.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.213+0000 7fbba8d11640 1 --2- 172.21.15.60:0/2674601559 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb900051c0 0x7fbb9000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:17.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.213+0000 7fbba8d11640 1 -- 172.21.15.60:0/2674601559 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb900039e0 msgr2=0x7fbb90003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:17.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.213+0000 7fbba8d11640 1 --2- 172.21.15.60:0/2674601559 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb900039e0 0x7fbb90003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:17.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.213+0000 7fbba9d13640 1 -- 172.21.15.60:0/2674601559 reap_dead start 2024-09-12T02:40:17.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.213+0000 7fbba8d11640 1 -- 172.21.15.60:0/2674601559 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb90003520 con 0x7fbb90004800 2024-09-12T02:40:17.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.214+0000 7fbba8d11640 1 --2- 172.21.15.60:0/2674601559 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb90004800 0x7fbb90004c80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbb9400c210 tx=0x7fbb90005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a550fb4c3a19cfd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:17.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.214+0000 7fbb9bfff640 1 -- 172.21.15.60:0/2674601559 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb94007d10 con 0x7fbb90004800 2024-09-12T02:40:17.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.214+0000 7fbb9bfff640 1 -- 172.21.15.60:0/2674601559 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb94005af0 con 0x7fbb90004800 2024-09-12T02:40:17.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.214+0000 7fbb9bfff640 1 -- 172.21.15.60:0/2674601559 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb94007070 con 0x7fbb90004800 2024-09-12T02:40:17.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.215+0000 7fbbab776640 1 -- 172.21.15.60:0/2674601559 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb90004800 msgr2=0x7fbb90004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:17.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.215+0000 7fbbab776640 1 --2- 172.21.15.60:0/2674601559 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb90004800 0x7fbb90004c80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbb9400c210 tx=0x7fbb90005830 comp rx=0 tx=0).stop 2024-09-12T02:40:17.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.215+0000 7fbbab776640 1 -- 172.21.15.60:0/2674601559 shutdown_connections 2024-09-12T02:40:17.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.215+0000 7fbbab776640 1 --2- 172.21.15.60:0/2674601559 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb90004800 0x7fbb90004c80 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:17.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.215+0000 7fbbab776640 1 -- 172.21.15.60:0/2674601559 >> 172.21.15.60:0/2674601559 conn(0x7fbba40c5660 msgr2=0x7fbba40c5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:17.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.215+0000 7fbbab776640 1 -- 172.21.15.60:0/2674601559 shutdown_connections 2024-09-12T02:40:17.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.215+0000 7fbbab776640 1 -- 172.21.15.60:0/2674601559 wait complete. 2024-09-12T02:40:17.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.216+0000 7fbbab776640 1 Processor -- start 2024-09-12T02:40:17.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.216+0000 7fbbab776640 1 -- start start 2024-09-12T02:40:17.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.217+0000 7fbbab776640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb90004800 0x7fbba4073780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:17.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.217+0000 7fbbab776640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbba41e3180 0x7fbba40acb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:17.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.217+0000 7fbbab776640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbba41ef460 0x7fbba41ef8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:17.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.217+0000 7fbbab776640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbba406f270 con 0x7fbba41e3180 2024-09-12T02:40:17.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.217+0000 7fbbab776640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbba40c7d30 con 0x7fbb90004800 2024-09-12T02:40:17.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.217+0000 7fbbab776640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbba409d310 con 0x7fbba41ef460 2024-09-12T02:40:17.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.217+0000 7fbba8d11640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbba41e3180 0x7fbba40acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:17.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.217+0000 7fbba8d11640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbba41e3180 0x7fbba40acb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40694/0 (socket says 172.21.15.60:40694) 2024-09-12T02:40:17.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.217+0000 7fbba8d11640 1 -- 172.21.15.60:0/901673902 learned_addr learned my addr 172.21.15.60:0/901673902 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:17.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.217+0000 7fbba9d13640 1 --2- 172.21.15.60:0/901673902 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbba41ef460 0x7fbba41ef8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:17.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.217+0000 7fbba9512640 1 --2- 172.21.15.60:0/901673902 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb90004800 0x7fbba4073780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:17.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.217+0000 7fbba8d11640 1 -- 172.21.15.60:0/901673902 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbba41ef460 msgr2=0x7fbba41ef8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:17.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.217+0000 7fbba8d11640 1 --2- 172.21.15.60:0/901673902 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbba41ef460 0x7fbba41ef8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:17.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.217+0000 7fbba8d11640 1 -- 172.21.15.60:0/901673902 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb90004800 msgr2=0x7fbba4073780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:17.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.217+0000 7fbba8d11640 1 --2- 172.21.15.60:0/901673902 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb90004800 0x7fbba4073780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:17.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.217+0000 7fbba8d11640 1 -- 172.21.15.60:0/901673902 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbba40ac330 con 0x7fbba41e3180 2024-09-12T02:40:17.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.217+0000 7fbba8d11640 1 --2- 172.21.15.60:0/901673902 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbba41e3180 0x7fbba40acb00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbb9402ad80 tx=0x7fbba40c7660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:17.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.217+0000 7fbb99ffb640 1 -- 172.21.15.60:0/901673902 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb94037040 con 0x7fbba41e3180 2024-09-12T02:40:17.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.217+0000 7fbb99ffb640 1 -- 172.21.15.60:0/901673902 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb94001530 con 0x7fbba41e3180 2024-09-12T02:40:17.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.217+0000 7fbbab776640 1 -- 172.21.15.60:0/901673902 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbba40ac610 con 0x7fbba41e3180 2024-09-12T02:40:17.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.217+0000 7fbb99ffb640 1 -- 172.21.15.60:0/901673902 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb940047e0 con 0x7fbba41e3180 2024-09-12T02:40:17.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.218+0000 7fbbab776640 1 -- 172.21.15.60:0/901673902 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbba40abe80 con 0x7fbba41e3180 2024-09-12T02:40:17.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.218+0000 7fbbab776640 1 -- 172.21.15.60:0/901673902 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbba40697e0 con 0x7fbba41e3180 2024-09-12T02:40:17.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.219+0000 7fbb99ffb640 1 -- 172.21.15.60:0/901673902 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbb94043020 con 0x7fbba41e3180 2024-09-12T02:40:17.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.219+0000 7fbb99ffb640 1 --2- 172.21.15.60:0/901673902 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbb8806be30 0x7fbb8806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:17.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.219+0000 7fbb99ffb640 1 -- 172.21.15.60:0/901673902 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fbb940aa6f0 con 0x7fbba41e3180 2024-09-12T02:40:17.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.219+0000 7fbba9512640 1 --2- 172.21.15.60:0/901673902 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbb8806be30 0x7fbb8806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:17.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.220+0000 7fbba9512640 1 --2- 172.21.15.60:0/901673902 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbb8806be30 0x7fbb8806e2f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fbba0000c00 tx=0x7fbba0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:17.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.224+0000 7fbb99ffb640 1 -- 172.21.15.60:0/901673902 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbba40697e0 con 0x7fbba41e3180 2024-09-12T02:40:17.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.395+0000 7fbbab776640 1 -- 172.21.15.60:0/901673902 --> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbba40c3250 con 0x7fbb8806be30 2024-09-12T02:40:17.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.407+0000 7fbb99ffb640 1 -- 172.21.15.60:0/901673902 <== mgr.4098 v2:172.21.15.60:6800/3549430091 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+493624 (secure 0 0 0) 0x7fbba40c3250 con 0x7fbb8806be30 2024-09-12T02:40:17.413 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:40:17.416 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T02:40:17.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.411+0000 7fbbab776640 1 -- 172.21.15.60:0/901673902 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbb8806be30 msgr2=0x7fbb8806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:17.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.411+0000 7fbbab776640 1 --2- 172.21.15.60:0/901673902 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbb8806be30 0x7fbb8806e2f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fbba0000c00 tx=0x7fbba0009040 comp rx=0 tx=0).stop 2024-09-12T02:40:17.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.411+0000 7fbbab776640 1 -- 172.21.15.60:0/901673902 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbba41e3180 msgr2=0x7fbba40acb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:17.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.411+0000 7fbbab776640 1 --2- 172.21.15.60:0/901673902 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbba41e3180 0x7fbba40acb00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbb9402ad80 tx=0x7fbba40c7660 comp rx=0 tx=0).stop 2024-09-12T02:40:17.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.411+0000 7fbbab776640 1 -- 172.21.15.60:0/901673902 shutdown_connections 2024-09-12T02:40:17.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.411+0000 7fbbab776640 1 --2- 172.21.15.60:0/901673902 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbb8806be30 0x7fbb8806e2f0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:17.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.411+0000 7fbbab776640 1 --2- 172.21.15.60:0/901673902 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbba41ef460 0x7fbba41ef8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:17.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.411+0000 7fbbab776640 1 --2- 172.21.15.60:0/901673902 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbba41e3180 0x7fbba40acb00 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:17.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.411+0000 7fbbab776640 1 --2- 172.21.15.60:0/901673902 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb90004800 0x7fbba4073780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:17.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.411+0000 7fbbab776640 1 -- 172.21.15.60:0/901673902 >> 172.21.15.60:0/901673902 conn(0x7fbba40c5660 msgr2=0x7fbba4158ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:17.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.412+0000 7fbbab776640 1 -- 172.21.15.60:0/901673902 shutdown_connections 2024-09-12T02:40:17.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:17.412+0000 7fbbab776640 1 -- 172.21.15.60:0/901673902 wait complete. 2024-09-12T02:40:17.424 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":543,"stamp":"2024-09-12T02:40:16.401660+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":37063407,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":235,"num_read_kb":350,"num_write":3281435,"num_write_kb":39377193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":634645,"ondisk_log_size":634645,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8349288,"kb_used_data":74792,"kb_used_omap":12,"kb_used_meta":8274355,"kb_avail":746625432,"statfs":{"total":773094113280,"available":764544442368,"internally_reserved":0,"allocated":76587008,"data_stored":75073414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":8472940080},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":249,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003582"},"pg_stats":[{"pgid":"5.18","version":"28'5064","reported_seq":5087,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.645306+0000","last_change":"2024-09-12T02:23:16.851521+0000","last_active":"2024-09-12T02:40:04.645306+0000","last_peered":"2024-09-12T02:40:04.645306+0000","last_clean":"2024-09-12T02:40:04.645306+0000","last_became_active":"2024-09-12T02:23:16.851220+0000","last_became_peered":"2024-09-12T02:23:16.851220+0000","last_unstale":"2024-09-12T02:40:04.645306+0000","last_undegraded":"2024-09-12T02:40:04.645306+0000","last_fullsized":"2024-09-12T02:40:04.645306+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5064,"log_dups_size":0,"ondisk_log_size":5064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:28.680072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26423,"num_write_kb":306733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"28'710","reported_seq":744,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:38.617912+0000","last_change":"2024-09-12T02:23:03.757848+0000","last_active":"2024-09-12T02:39:38.617912+0000","last_peered":"2024-09-12T02:39:38.617912+0000","last_clean":"2024-09-12T02:39:38.617912+0000","last_became_active":"2024-09-12T02:23:03.757544+0000","last_became_peered":"2024-09-12T02:23:03.757544+0000","last_unstale":"2024-09-12T02:39:38.617912+0000","last_undegraded":"2024-09-12T02:39:38.617912+0000","last_fullsized":"2024-09-12T02:39:38.617912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:43.576128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":4498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"28'5154","reported_seq":5186,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.755971+0000","last_change":"2024-09-12T02:23:04.790549+0000","last_active":"2024-09-12T02:39:57.755971+0000","last_peered":"2024-09-12T02:39:57.755971+0000","last_clean":"2024-09-12T02:39:57.755971+0000","last_became_active":"2024-09-12T02:23:04.790187+0000","last_became_peered":"2024-09-12T02:23:04.790187+0000","last_unstale":"2024-09-12T02:39:57.755971+0000","last_undegraded":"2024-09-12T02:39:57.755971+0000","last_fullsized":"2024-09-12T02:39:57.755971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5154,"log_dups_size":0,"ondisk_log_size":5154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:49.656395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26676,"num_write_kb":324046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"28'3","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.595089+0000","last_change":"2024-09-12T02:23:15.829383+0000","last_active":"2024-09-12T02:38:07.595089+0000","last_peered":"2024-09-12T02:38:07.595089+0000","last_clean":"2024-09-12T02:38:07.595089+0000","last_became_active":"2024-09-12T02:23:15.828295+0000","last_became_peered":"2024-09-12T02:23:15.828295+0000","last_unstale":"2024-09-12T02:38:07.595089+0000","last_undegraded":"2024-09-12T02:38:07.595089+0000","last_fullsized":"2024-09-12T02:38:07.595089+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:13.217846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"28'6025","reported_seq":6048,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.716226+0000","last_change":"2024-09-12T02:23:16.853675+0000","last_active":"2024-09-12T02:40:04.716226+0000","last_peered":"2024-09-12T02:40:04.716226+0000","last_clean":"2024-09-12T02:40:04.716226+0000","last_became_active":"2024-09-12T02:23:16.853371+0000","last_became_peered":"2024-09-12T02:23:16.853371+0000","last_unstale":"2024-09-12T02:40:04.716226+0000","last_undegraded":"2024-09-12T02:40:04.716226+0000","last_fullsized":"2024-09-12T02:40:04.716226+0000","mapping_epoch":24,"log_start":"28'200","ondisk_log_start":"28'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5825,"log_dups_size":0,"ondisk_log_size":5825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:10.323501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30759,"num_write_kb":360986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"28'8","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.607786+0000","last_change":"2024-09-12T02:23:03.767076+0000","last_active":"2024-09-12T02:39:47.607786+0000","last_peered":"2024-09-12T02:39:47.607786+0000","last_clean":"2024-09-12T02:39:47.607786+0000","last_became_active":"2024-09-12T02:23:03.766686+0000","last_became_peered":"2024-09-12T02:23:03.766686+0000","last_unstale":"2024-09-12T02:39:47.607786+0000","last_undegraded":"2024-09-12T02:39:47.607786+0000","last_fullsized":"2024-09-12T02:39:47.607786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:45.706208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"28'5910","reported_seq":5942,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.822665+0000","last_change":"2024-09-12T02:23:04.782108+0000","last_active":"2024-09-12T02:39:57.822665+0000","last_peered":"2024-09-12T02:39:57.822665+0000","last_clean":"2024-09-12T02:39:57.822665+0000","last_became_active":"2024-09-12T02:23:04.781829+0000","last_became_peered":"2024-09-12T02:23:04.781829+0000","last_unstale":"2024-09-12T02:39:57.822665+0000","last_undegraded":"2024-09-12T02:39:57.822665+0000","last_fullsized":"2024-09-12T02:39:57.822665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5910,"log_dups_size":0,"ondisk_log_size":5910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:07:33.165742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31102,"num_write_kb":370468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"28'3","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.673740+0000","last_change":"2024-09-12T02:23:15.828697+0000","last_active":"2024-09-12T02:38:07.673740+0000","last_peered":"2024-09-12T02:38:07.673740+0000","last_clean":"2024-09-12T02:38:07.673740+0000","last_became_active":"2024-09-12T02:23:15.828317+0000","last_became_peered":"2024-09-12T02:23:15.828317+0000","last_unstale":"2024-09-12T02:38:07.673740+0000","last_undegraded":"2024-09-12T02:38:07.673740+0000","last_fullsized":"2024-09-12T02:38:07.673740+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:55.347515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"28'4662","reported_seq":4684,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.720244+0000","last_change":"2024-09-12T02:23:16.856209+0000","last_active":"2024-09-12T02:40:04.720244+0000","last_peered":"2024-09-12T02:40:04.720244+0000","last_clean":"2024-09-12T02:40:04.720244+0000","last_became_active":"2024-09-12T02:23:16.855874+0000","last_became_peered":"2024-09-12T02:23:16.855874+0000","last_unstale":"2024-09-12T02:40:04.720244+0000","last_undegraded":"2024-09-12T02:40:04.720244+0000","last_fullsized":"2024-09-12T02:40:04.720244+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4662,"log_dups_size":0,"ondisk_log_size":4662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:44.299638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23657,"num_write_kb":270894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"28'11","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.620404+0000","last_change":"2024-09-12T02:23:03.767875+0000","last_active":"2024-09-12T02:39:47.620404+0000","last_peered":"2024-09-12T02:39:47.620404+0000","last_clean":"2024-09-12T02:39:47.620404+0000","last_became_active":"2024-09-12T02:23:03.767596+0000","last_became_peered":"2024-09-12T02:23:03.767596+0000","last_unstale":"2024-09-12T02:39:47.620404+0000","last_undegraded":"2024-09-12T02:39:47.620404+0000","last_fullsized":"2024-09-12T02:39:47.620404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:22.605725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'3398","reported_seq":3428,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.832289+0000","last_change":"2024-09-12T02:23:04.791903+0000","last_active":"2024-09-12T02:39:57.832289+0000","last_peered":"2024-09-12T02:39:57.832289+0000","last_clean":"2024-09-12T02:39:57.832289+0000","last_became_active":"2024-09-12T02:23:04.791635+0000","last_became_peered":"2024-09-12T02:23:04.791635+0000","last_unstale":"2024-09-12T02:39:57.832289+0000","last_undegraded":"2024-09-12T02:39:57.832289+0000","last_fullsized":"2024-09-12T02:39:57.832289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":3398,"log_dups_size":0,"ondisk_log_size":3398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:08.192088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16708,"num_write_kb":214393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"28'616","reported_seq":640,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.618731+0000","last_change":"2024-09-12T02:23:15.833369+0000","last_active":"2024-09-12T02:38:07.618731+0000","last_peered":"2024-09-12T02:38:07.618731+0000","last_clean":"2024-09-12T02:38:07.618731+0000","last_became_active":"2024-09-12T02:23:15.833010+0000","last_became_peered":"2024-09-12T02:23:15.833010+0000","last_unstale":"2024-09-12T02:38:07.618731+0000","last_undegraded":"2024-09-12T02:38:07.618731+0000","last_fullsized":"2024-09-12T02:38:07.618731+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:51.465462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":614,"num_write_kb":4230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"28'4163","reported_seq":4185,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.700869+0000","last_change":"2024-09-12T02:23:16.853013+0000","last_active":"2024-09-12T02:40:04.700869+0000","last_peered":"2024-09-12T02:40:04.700869+0000","last_clean":"2024-09-12T02:40:04.700869+0000","last_became_active":"2024-09-12T02:23:16.852698+0000","last_became_peered":"2024-09-12T02:23:16.852698+0000","last_unstale":"2024-09-12T02:40:04.700869+0000","last_undegraded":"2024-09-12T02:40:04.700869+0000","last_fullsized":"2024-09-12T02:40:04.700869+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4163,"log_dups_size":0,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:11.709531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21165,"num_write_kb":244679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"28'3","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:04.409618+0000","last_change":"2024-09-12T02:23:03.763480+0000","last_active":"2024-09-12T02:38:04.409618+0000","last_peered":"2024-09-12T02:38:04.409618+0000","last_clean":"2024-09-12T02:38:04.409618+0000","last_became_active":"2024-09-12T02:23:03.762464+0000","last_became_peered":"2024-09-12T02:23:03.762464+0000","last_unstale":"2024-09-12T02:38:04.409618+0000","last_undegraded":"2024-09-12T02:38:04.409618+0000","last_fullsized":"2024-09-12T02:38:04.409618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:24.308289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"28'5838","reported_seq":5868,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.851601+0000","last_change":"2024-09-12T02:23:04.791109+0000","last_active":"2024-09-12T02:39:57.851601+0000","last_peered":"2024-09-12T02:39:57.851601+0000","last_clean":"2024-09-12T02:39:57.851601+0000","last_became_active":"2024-09-12T02:23:04.790201+0000","last_became_peered":"2024-09-12T02:23:04.790201+0000","last_unstale":"2024-09-12T02:39:57.851601+0000","last_undegraded":"2024-09-12T02:39:57.851601+0000","last_fullsized":"2024-09-12T02:39:57.851601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5838,"log_dups_size":0,"ondisk_log_size":5838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:13.166139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30329,"num_write_kb":367409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"28'95","reported_seq":119,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.522715+0000","last_change":"2024-09-12T02:23:15.834261+0000","last_active":"2024-09-12T02:40:04.522715+0000","last_peered":"2024-09-12T02:40:04.522715+0000","last_clean":"2024-09-12T02:40:04.522715+0000","last_became_active":"2024-09-12T02:23:15.833982+0000","last_became_peered":"2024-09-12T02:23:15.833982+0000","last_unstale":"2024-09-12T02:40:04.522715+0000","last_undegraded":"2024-09-12T02:40:04.522715+0000","last_fullsized":"2024-09-12T02:40:04.522715+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:04.987961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1406481,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":1433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"28'5650","reported_seq":5673,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.655262+0000","last_change":"2024-09-12T02:23:16.861432+0000","last_active":"2024-09-12T02:40:04.655262+0000","last_peered":"2024-09-12T02:40:04.655262+0000","last_clean":"2024-09-12T02:40:04.655262+0000","last_became_active":"2024-09-12T02:23:16.861003+0000","last_became_peered":"2024-09-12T02:23:16.861003+0000","last_unstale":"2024-09-12T02:40:04.655262+0000","last_undegraded":"2024-09-12T02:40:04.655262+0000","last_fullsized":"2024-09-12T02:40:04.655262+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5650,"log_dups_size":0,"ondisk_log_size":5650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:01.777500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29234,"num_write_kb":330189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"28'4187","reported_seq":4218,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.703320+0000","last_change":"2024-09-12T02:23:04.788754+0000","last_active":"2024-09-12T02:39:57.703320+0000","last_peered":"2024-09-12T02:39:57.703320+0000","last_clean":"2024-09-12T02:39:57.703320+0000","last_became_active":"2024-09-12T02:23:04.788350+0000","last_became_peered":"2024-09-12T02:23:04.788350+0000","last_unstale":"2024-09-12T02:39:57.703320+0000","last_undegraded":"2024-09-12T02:39:57.703320+0000","last_fullsized":"2024-09-12T02:39:57.703320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4187,"log_dups_size":0,"ondisk_log_size":4187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:08.192088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21964,"num_write_kb":272310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"28'1149","reported_seq":1182,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.632597+0000","last_change":"2024-09-12T02:23:03.763423+0000","last_active":"2024-09-12T02:39:47.632597+0000","last_peered":"2024-09-12T02:39:47.632597+0000","last_clean":"2024-09-12T02:39:47.632597+0000","last_became_active":"2024-09-12T02:23:03.762627+0000","last_became_peered":"2024-09-12T02:23:03.762627+0000","last_unstale":"2024-09-12T02:39:47.632597+0000","last_undegraded":"2024-09-12T02:39:47.632597+0000","last_fullsized":"2024-09-12T02:39:47.632597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1149,"log_dups_size":0,"ondisk_log_size":1149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:18.090657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1140,"num_write_kb":4413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"28'2","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.604710+0000","last_change":"2024-09-12T02:23:15.831604+0000","last_active":"2024-09-12T02:38:07.604710+0000","last_peered":"2024-09-12T02:38:07.604710+0000","last_clean":"2024-09-12T02:38:07.604710+0000","last_became_active":"2024-09-12T02:23:15.831292+0000","last_became_peered":"2024-09-12T02:23:15.831292+0000","last_unstale":"2024-09-12T02:38:07.604710+0000","last_undegraded":"2024-09-12T02:38:07.604710+0000","last_fullsized":"2024-09-12T02:38:07.604710+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:30.234721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"28'5482","reported_seq":5505,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.695136+0000","last_change":"2024-09-12T02:23:16.842506+0000","last_active":"2024-09-12T02:40:04.695136+0000","last_peered":"2024-09-12T02:40:04.695136+0000","last_clean":"2024-09-12T02:40:04.695136+0000","last_became_active":"2024-09-12T02:23:16.842210+0000","last_became_peered":"2024-09-12T02:23:16.842210+0000","last_unstale":"2024-09-12T02:40:04.695136+0000","last_undegraded":"2024-09-12T02:40:04.695136+0000","last_fullsized":"2024-09-12T02:40:04.695136+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5482,"log_dups_size":0,"ondisk_log_size":5482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:52.806704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28431,"num_write_kb":318903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"28'3892","reported_seq":3923,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.750186+0000","last_change":"2024-09-12T02:23:04.782769+0000","last_active":"2024-09-12T02:39:57.750186+0000","last_peered":"2024-09-12T02:39:57.750186+0000","last_clean":"2024-09-12T02:39:57.750186+0000","last_became_active":"2024-09-12T02:23:04.782472+0000","last_became_peered":"2024-09-12T02:23:04.782472+0000","last_unstale":"2024-09-12T02:39:57.750186+0000","last_undegraded":"2024-09-12T02:39:57.750186+0000","last_fullsized":"2024-09-12T02:39:57.750186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":3892,"log_dups_size":0,"ondisk_log_size":3892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:46.144471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18989,"num_write_kb":247993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'4","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.622890+0000","last_change":"2024-09-12T02:23:03.771468+0000","last_active":"2024-09-12T02:39:47.622890+0000","last_peered":"2024-09-12T02:39:47.622890+0000","last_clean":"2024-09-12T02:39:47.622890+0000","last_became_active":"2024-09-12T02:23:03.769619+0000","last_became_peered":"2024-09-12T02:23:03.769619+0000","last_unstale":"2024-09-12T02:39:47.622890+0000","last_undegraded":"2024-09-12T02:39:47.622890+0000","last_fullsized":"2024-09-12T02:39:47.622890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:38.422369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"28'2","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.610915+0000","last_change":"2024-09-12T02:23:15.833359+0000","last_active":"2024-09-12T02:38:07.610915+0000","last_peered":"2024-09-12T02:38:07.610915+0000","last_clean":"2024-09-12T02:38:07.610915+0000","last_became_active":"2024-09-12T02:23:15.832995+0000","last_became_peered":"2024-09-12T02:23:15.832995+0000","last_unstale":"2024-09-12T02:38:07.610915+0000","last_undegraded":"2024-09-12T02:38:07.610915+0000","last_fullsized":"2024-09-12T02:38:07.610915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:57.922845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"28'4854","reported_seq":4877,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.689490+0000","last_change":"2024-09-12T02:23:16.856439+0000","last_active":"2024-09-12T02:40:04.689490+0000","last_peered":"2024-09-12T02:40:04.689490+0000","last_clean":"2024-09-12T02:40:04.689490+0000","last_became_active":"2024-09-12T02:23:16.856166+0000","last_became_peered":"2024-09-12T02:23:16.856166+0000","last_unstale":"2024-09-12T02:40:04.689490+0000","last_undegraded":"2024-09-12T02:40:04.689490+0000","last_fullsized":"2024-09-12T02:40:04.689490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4854,"log_dups_size":0,"ondisk_log_size":4854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:42:56.534517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24657,"num_write_kb":295553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"28'4675","reported_seq":4706,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.744628+0000","last_change":"2024-09-12T02:23:04.783991+0000","last_active":"2024-09-12T02:39:57.744628+0000","last_peered":"2024-09-12T02:39:57.744628+0000","last_clean":"2024-09-12T02:39:57.744628+0000","last_became_active":"2024-09-12T02:23:04.783143+0000","last_became_peered":"2024-09-12T02:23:04.783143+0000","last_unstale":"2024-09-12T02:39:57.744628+0000","last_undegraded":"2024-09-12T02:39:57.744628+0000","last_fullsized":"2024-09-12T02:39:57.744628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4675,"log_dups_size":0,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:53.940843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24578,"num_write_kb":303391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'3","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.602532+0000","last_change":"2024-09-12T02:23:03.770581+0000","last_active":"2024-09-12T02:39:47.602532+0000","last_peered":"2024-09-12T02:39:47.602532+0000","last_clean":"2024-09-12T02:39:47.602532+0000","last_became_active":"2024-09-12T02:23:03.769406+0000","last_became_peered":"2024-09-12T02:23:03.769406+0000","last_unstale":"2024-09-12T02:39:47.602532+0000","last_undegraded":"2024-09-12T02:39:47.602532+0000","last_fullsized":"2024-09-12T02:39:47.602532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:20.963819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"28'5","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.723938+0000","last_change":"2024-09-12T02:23:15.835033+0000","last_active":"2024-09-12T02:38:07.723938+0000","last_peered":"2024-09-12T02:38:07.723938+0000","last_clean":"2024-09-12T02:38:07.723938+0000","last_became_active":"2024-09-12T02:23:15.834753+0000","last_became_peered":"2024-09-12T02:23:15.834753+0000","last_unstale":"2024-09-12T02:38:07.723938+0000","last_undegraded":"2024-09-12T02:38:07.723938+0000","last_fullsized":"2024-09-12T02:38:07.723938+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:57.434162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"28'5924","reported_seq":5947,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.730977+0000","last_change":"2024-09-12T02:23:16.860867+0000","last_active":"2024-09-12T02:40:04.730977+0000","last_peered":"2024-09-12T02:40:04.730977+0000","last_clean":"2024-09-12T02:40:04.730977+0000","last_became_active":"2024-09-12T02:23:16.860656+0000","last_became_peered":"2024-09-12T02:23:16.860656+0000","last_unstale":"2024-09-12T02:40:04.730977+0000","last_undegraded":"2024-09-12T02:40:04.730977+0000","last_fullsized":"2024-09-12T02:40:04.730977+0000","mapping_epoch":24,"log_start":"28'100","ondisk_log_start":"28'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5824,"log_dups_size":0,"ondisk_log_size":5824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:11.375287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30048,"num_write_kb":358073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"28'4362","reported_seq":4393,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.669337+0000","last_change":"2024-09-12T02:23:04.780821+0000","last_active":"2024-09-12T02:39:57.669337+0000","last_peered":"2024-09-12T02:39:57.669337+0000","last_clean":"2024-09-12T02:39:57.669337+0000","last_became_active":"2024-09-12T02:23:04.779984+0000","last_became_peered":"2024-09-12T02:23:04.779984+0000","last_unstale":"2024-09-12T02:39:57.669337+0000","last_undegraded":"2024-09-12T02:39:57.669337+0000","last_fullsized":"2024-09-12T02:39:57.669337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4362,"log_dups_size":0,"ondisk_log_size":4362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:25.724116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22346,"num_write_kb":282099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"28'3","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.590737+0000","last_change":"2024-09-12T02:23:03.764530+0000","last_active":"2024-09-12T02:39:47.590737+0000","last_peered":"2024-09-12T02:39:47.590737+0000","last_clean":"2024-09-12T02:39:47.590737+0000","last_became_active":"2024-09-12T02:23:03.764218+0000","last_became_peered":"2024-09-12T02:23:03.764218+0000","last_unstale":"2024-09-12T02:39:47.590737+0000","last_undegraded":"2024-09-12T02:39:47.590737+0000","last_fullsized":"2024-09-12T02:39:47.590737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:55.445619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"28'6","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.689963+0000","last_change":"2024-09-12T02:23:15.831621+0000","last_active":"2024-09-12T02:38:07.689963+0000","last_peered":"2024-09-12T02:38:07.689963+0000","last_clean":"2024-09-12T02:38:07.689963+0000","last_became_active":"2024-09-12T02:23:15.831331+0000","last_became_peered":"2024-09-12T02:23:15.831331+0000","last_unstale":"2024-09-12T02:38:07.689963+0000","last_undegraded":"2024-09-12T02:38:07.689963+0000","last_fullsized":"2024-09-12T02:38:07.689963+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:06.494392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"28'4897","reported_seq":4921,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.656642+0000","last_change":"2024-09-12T02:23:16.847556+0000","last_active":"2024-09-12T02:40:04.656642+0000","last_peered":"2024-09-12T02:40:04.656642+0000","last_clean":"2024-09-12T02:40:04.656642+0000","last_became_active":"2024-09-12T02:23:16.845749+0000","last_became_peered":"2024-09-12T02:23:16.845749+0000","last_unstale":"2024-09-12T02:40:04.656642+0000","last_undegraded":"2024-09-12T02:40:04.656642+0000","last_fullsized":"2024-09-12T02:40:04.656642+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4897,"log_dups_size":0,"ondisk_log_size":4897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:39.542842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25893,"num_write_kb":296532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"28'3849","reported_seq":3880,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.731126+0000","last_change":"2024-09-12T02:23:04.786895+0000","last_active":"2024-09-12T02:39:57.731126+0000","last_peered":"2024-09-12T02:39:57.731126+0000","last_clean":"2024-09-12T02:39:57.731126+0000","last_became_active":"2024-09-12T02:23:04.786591+0000","last_became_peered":"2024-09-12T02:23:04.786591+0000","last_unstale":"2024-09-12T02:39:57.731126+0000","last_undegraded":"2024-09-12T02:39:57.731126+0000","last_fullsized":"2024-09-12T02:39:57.731126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":3849,"log_dups_size":0,"ondisk_log_size":3849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:14.751707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19665,"num_write_kb":250729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'5","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.627847+0000","last_change":"2024-09-12T02:23:03.771259+0000","last_active":"2024-09-12T02:39:47.627847+0000","last_peered":"2024-09-12T02:39:47.627847+0000","last_clean":"2024-09-12T02:39:47.627847+0000","last_became_active":"2024-09-12T02:23:03.770687+0000","last_became_peered":"2024-09-12T02:23:03.770687+0000","last_unstale":"2024-09-12T02:39:47.627847+0000","last_undegraded":"2024-09-12T02:39:47.627847+0000","last_fullsized":"2024-09-12T02:39:47.627847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:38.516959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"28'59","reported_seq":142,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:51.334318+0000","last_change":"2024-09-12T02:23:15.829406+0000","last_active":"2024-09-12T02:39:51.334318+0000","last_peered":"2024-09-12T02:39:51.334318+0000","last_clean":"2024-09-12T02:39:51.334318+0000","last_became_active":"2024-09-12T02:23:15.829135+0000","last_became_peered":"2024-09-12T02:23:15.829135+0000","last_unstale":"2024-09-12T02:39:51.334318+0000","last_undegraded":"2024-09-12T02:39:51.334318+0000","last_fullsized":"2024-09-12T02:39:51.334318+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:22.365804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":57,"num_read_kb":123,"num_write":57,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"28'5530","reported_seq":5554,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.659180+0000","last_change":"2024-09-12T02:23:16.857016+0000","last_active":"2024-09-12T02:40:04.659180+0000","last_peered":"2024-09-12T02:40:04.659180+0000","last_clean":"2024-09-12T02:40:04.659180+0000","last_became_active":"2024-09-12T02:23:16.856705+0000","last_became_peered":"2024-09-12T02:23:16.856705+0000","last_unstale":"2024-09-12T02:40:04.659180+0000","last_undegraded":"2024-09-12T02:40:04.659180+0000","last_fullsized":"2024-09-12T02:40:04.659180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5530,"log_dups_size":0,"ondisk_log_size":5530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:03.672668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29256,"num_write_kb":314000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"28'4419","reported_seq":4450,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.721713+0000","last_change":"2024-09-12T02:23:04.786424+0000","last_active":"2024-09-12T02:39:57.721713+0000","last_peered":"2024-09-12T02:39:57.721713+0000","last_clean":"2024-09-12T02:39:57.721713+0000","last_became_active":"2024-09-12T02:23:04.786136+0000","last_became_peered":"2024-09-12T02:23:04.786136+0000","last_unstale":"2024-09-12T02:39:57.721713+0000","last_undegraded":"2024-09-12T02:39:57.721713+0000","last_fullsized":"2024-09-12T02:39:57.721713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4419,"log_dups_size":0,"ondisk_log_size":4419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:31.214894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22653,"num_write_kb":291447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'597","reported_seq":630,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:48.951757+0000","last_change":"2024-09-12T02:23:03.769745+0000","last_active":"2024-09-12T02:39:48.951757+0000","last_peered":"2024-09-12T02:39:48.951757+0000","last_clean":"2024-09-12T02:39:48.951757+0000","last_became_active":"2024-09-12T02:23:03.769410+0000","last_became_peered":"2024-09-12T02:23:03.769410+0000","last_unstale":"2024-09-12T02:39:48.951757+0000","last_undegraded":"2024-09-12T02:39:48.951757+0000","last_fullsized":"2024-09-12T02:39:48.951757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:00.414459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1455,"num_write_kb":462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"28'5","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.701763+0000","last_change":"2024-09-12T02:23:15.827211+0000","last_active":"2024-09-12T02:38:07.701763+0000","last_peered":"2024-09-12T02:38:07.701763+0000","last_clean":"2024-09-12T02:38:07.701763+0000","last_became_active":"2024-09-12T02:23:15.826564+0000","last_became_peered":"2024-09-12T02:23:15.826564+0000","last_unstale":"2024-09-12T02:38:07.701763+0000","last_undegraded":"2024-09-12T02:38:07.701763+0000","last_fullsized":"2024-09-12T02:38:07.701763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:32.389443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"28'5561","reported_seq":5585,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.639456+0000","last_change":"2024-09-12T02:23:16.837434+0000","last_active":"2024-09-12T02:40:04.639456+0000","last_peered":"2024-09-12T02:40:04.639456+0000","last_clean":"2024-09-12T02:40:04.639456+0000","last_became_active":"2024-09-12T02:23:16.837162+0000","last_became_peered":"2024-09-12T02:23:16.837162+0000","last_unstale":"2024-09-12T02:40:04.639456+0000","last_undegraded":"2024-09-12T02:40:04.639456+0000","last_fullsized":"2024-09-12T02:40:04.639456+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5561,"log_dups_size":0,"ondisk_log_size":5561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:09.146064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28597,"num_write_kb":327668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"28'4780","reported_seq":4812,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.728845+0000","last_change":"2024-09-12T02:23:04.775876+0000","last_active":"2024-09-12T02:39:57.728845+0000","last_peered":"2024-09-12T02:39:57.728845+0000","last_clean":"2024-09-12T02:39:57.728845+0000","last_became_active":"2024-09-12T02:23:04.775571+0000","last_became_peered":"2024-09-12T02:23:04.775571+0000","last_unstale":"2024-09-12T02:39:57.728845+0000","last_undegraded":"2024-09-12T02:39:57.728845+0000","last_fullsized":"2024-09-12T02:39:57.728845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4780,"log_dups_size":0,"ondisk_log_size":4780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:05.070528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24981,"num_write_kb":308974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"28'4","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.626390+0000","last_change":"2024-09-12T02:23:03.764093+0000","last_active":"2024-09-12T02:39:47.626390+0000","last_peered":"2024-09-12T02:39:47.626390+0000","last_clean":"2024-09-12T02:39:47.626390+0000","last_became_active":"2024-09-12T02:23:03.763147+0000","last_became_peered":"2024-09-12T02:23:03.763147+0000","last_unstale":"2024-09-12T02:39:47.626390+0000","last_undegraded":"2024-09-12T02:39:47.626390+0000","last_fullsized":"2024-09-12T02:39:47.626390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:13.317894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"28'1","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:37:53.624097+0000","last_change":"2024-09-12T02:23:15.832461+0000","last_active":"2024-09-12T02:37:53.624097+0000","last_peered":"2024-09-12T02:37:53.624097+0000","last_clean":"2024-09-12T02:37:53.624097+0000","last_became_active":"2024-09-12T02:23:15.831637+0000","last_became_peered":"2024-09-12T02:23:15.831637+0000","last_unstale":"2024-09-12T02:37:53.624097+0000","last_undegraded":"2024-09-12T02:37:53.624097+0000","last_fullsized":"2024-09-12T02:37:53.624097+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:30.909927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"28'5517","reported_seq":5541,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.717568+0000","last_change":"2024-09-12T02:23:16.835824+0000","last_active":"2024-09-12T02:40:04.717568+0000","last_peered":"2024-09-12T02:40:04.717568+0000","last_clean":"2024-09-12T02:40:04.717568+0000","last_became_active":"2024-09-12T02:23:16.835520+0000","last_became_peered":"2024-09-12T02:23:16.835520+0000","last_unstale":"2024-09-12T02:40:04.717568+0000","last_undegraded":"2024-09-12T02:40:04.717568+0000","last_fullsized":"2024-09-12T02:40:04.717568+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5517,"log_dups_size":0,"ondisk_log_size":5517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:32.797100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29476,"num_write_kb":310838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"28'3821","reported_seq":3853,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.839882+0000","last_change":"2024-09-12T02:23:04.787557+0000","last_active":"2024-09-12T02:39:57.839882+0000","last_peered":"2024-09-12T02:39:57.839882+0000","last_clean":"2024-09-12T02:39:57.839882+0000","last_became_active":"2024-09-12T02:23:04.786527+0000","last_became_peered":"2024-09-12T02:23:04.786527+0000","last_unstale":"2024-09-12T02:39:57.839882+0000","last_undegraded":"2024-09-12T02:39:57.839882+0000","last_fullsized":"2024-09-12T02:39:57.839882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":3821,"log_dups_size":0,"ondisk_log_size":3821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:23.273457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19788,"num_write_kb":259568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"28'5","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.626953+0000","last_change":"2024-09-12T02:23:03.769913+0000","last_active":"2024-09-12T02:39:47.626953+0000","last_peered":"2024-09-12T02:39:47.626953+0000","last_clean":"2024-09-12T02:39:47.626953+0000","last_became_active":"2024-09-12T02:23:03.769444+0000","last_became_peered":"2024-09-12T02:23:03.769444+0000","last_unstale":"2024-09-12T02:39:47.626953+0000","last_undegraded":"2024-09-12T02:39:47.626953+0000","last_fullsized":"2024-09-12T02:39:47.626953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:21.243182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"28'5","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.710687+0000","last_change":"2024-09-12T02:23:15.829080+0000","last_active":"2024-09-12T02:38:07.710687+0000","last_peered":"2024-09-12T02:38:07.710687+0000","last_clean":"2024-09-12T02:38:07.710687+0000","last_became_active":"2024-09-12T02:23:15.828256+0000","last_became_peered":"2024-09-12T02:23:15.828256+0000","last_unstale":"2024-09-12T02:38:07.710687+0000","last_undegraded":"2024-09-12T02:38:07.710687+0000","last_fullsized":"2024-09-12T02:38:07.710687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:07.743952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"28'4600","reported_seq":4624,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.595161+0000","last_change":"2024-09-12T02:23:16.845710+0000","last_active":"2024-09-12T02:40:04.595161+0000","last_peered":"2024-09-12T02:40:04.595161+0000","last_clean":"2024-09-12T02:40:04.595161+0000","last_became_active":"2024-09-12T02:23:16.845379+0000","last_became_peered":"2024-09-12T02:23:16.845379+0000","last_unstale":"2024-09-12T02:40:04.595161+0000","last_undegraded":"2024-09-12T02:40:04.595161+0000","last_fullsized":"2024-09-12T02:40:04.595161+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4600,"log_dups_size":0,"ondisk_log_size":4600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:16.769410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24241,"num_write_kb":277536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"28'4371","reported_seq":4403,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.747023+0000","last_change":"2024-09-12T02:23:04.790723+0000","last_active":"2024-09-12T02:39:57.747023+0000","last_peered":"2024-09-12T02:39:57.747023+0000","last_clean":"2024-09-12T02:39:57.747023+0000","last_became_active":"2024-09-12T02:23:04.786877+0000","last_became_peered":"2024-09-12T02:23:04.786877+0000","last_unstale":"2024-09-12T02:39:57.747023+0000","last_undegraded":"2024-09-12T02:39:57.747023+0000","last_fullsized":"2024-09-12T02:39:57.747023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4371,"log_dups_size":0,"ondisk_log_size":4371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:48.516002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23204,"num_write_kb":285450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"28'5","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.620925+0000","last_change":"2024-09-12T02:23:03.771518+0000","last_active":"2024-09-12T02:39:47.620925+0000","last_peered":"2024-09-12T02:39:47.620925+0000","last_clean":"2024-09-12T02:39:47.620925+0000","last_became_active":"2024-09-12T02:23:03.771063+0000","last_became_peered":"2024-09-12T02:23:03.771063+0000","last_unstale":"2024-09-12T02:39:47.620925+0000","last_undegraded":"2024-09-12T02:39:47.620925+0000","last_fullsized":"2024-09-12T02:39:47.620925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:43.974555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"28'5","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.679539+0000","last_change":"2024-09-12T02:23:15.827028+0000","last_active":"2024-09-12T02:38:07.679539+0000","last_peered":"2024-09-12T02:38:07.679539+0000","last_clean":"2024-09-12T02:38:07.679539+0000","last_became_active":"2024-09-12T02:23:15.826708+0000","last_became_peered":"2024-09-12T02:23:15.826708+0000","last_unstale":"2024-09-12T02:38:07.679539+0000","last_undegraded":"2024-09-12T02:38:07.679539+0000","last_fullsized":"2024-09-12T02:38:07.679539+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:34.642396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'4748","reported_seq":4771,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.730697+0000","last_change":"2024-09-12T02:23:16.849429+0000","last_active":"2024-09-12T02:40:04.730697+0000","last_peered":"2024-09-12T02:40:04.730697+0000","last_clean":"2024-09-12T02:40:04.730697+0000","last_became_active":"2024-09-12T02:23:16.849119+0000","last_became_peered":"2024-09-12T02:23:16.849119+0000","last_unstale":"2024-09-12T02:40:04.730697+0000","last_undegraded":"2024-09-12T02:40:04.730697+0000","last_fullsized":"2024-09-12T02:40:04.730697+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4748,"log_dups_size":0,"ondisk_log_size":4748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:10.688619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23965,"num_write_kb":268065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"28'4258","reported_seq":4290,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.730029+0000","last_change":"2024-09-12T02:23:04.773745+0000","last_active":"2024-09-12T02:39:57.730029+0000","last_peered":"2024-09-12T02:39:57.730029+0000","last_clean":"2024-09-12T02:39:57.730029+0000","last_became_active":"2024-09-12T02:23:04.773360+0000","last_became_peered":"2024-09-12T02:23:04.773360+0000","last_unstale":"2024-09-12T02:39:57.730029+0000","last_undegraded":"2024-09-12T02:39:57.730029+0000","last_fullsized":"2024-09-12T02:39:57.730029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4258,"log_dups_size":0,"ondisk_log_size":4258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:33.097774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22673,"num_write_kb":283464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'64","reported_seq":160,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.311429+0000","last_change":"2024-09-12T02:23:03.760700+0000","last_active":"2024-09-12T02:39:47.311429+0000","last_peered":"2024-09-12T02:39:47.311429+0000","last_clean":"2024-09-12T02:39:47.311429+0000","last_became_active":"2024-09-12T02:23:03.760397+0000","last_became_peered":"2024-09-12T02:23:03.760397+0000","last_unstale":"2024-09-12T02:39:47.311429+0000","last_undegraded":"2024-09-12T02:39:47.311429+0000","last_fullsized":"2024-09-12T02:39:47.311429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:36.788864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":127,"num_write":62,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"28'4","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.673049+0000","last_change":"2024-09-12T02:23:15.828714+0000","last_active":"2024-09-12T02:38:07.673049+0000","last_peered":"2024-09-12T02:38:07.673049+0000","last_clean":"2024-09-12T02:38:07.673049+0000","last_became_active":"2024-09-12T02:23:15.827458+0000","last_became_peered":"2024-09-12T02:23:15.827458+0000","last_unstale":"2024-09-12T02:38:07.673049+0000","last_undegraded":"2024-09-12T02:38:07.673049+0000","last_fullsized":"2024-09-12T02:38:07.673049+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:12.581897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"28'4979","reported_seq":5002,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.723394+0000","last_change":"2024-09-12T02:23:16.855212+0000","last_active":"2024-09-12T02:40:04.723394+0000","last_peered":"2024-09-12T02:40:04.723394+0000","last_clean":"2024-09-12T02:40:04.723394+0000","last_became_active":"2024-09-12T02:23:16.854938+0000","last_became_peered":"2024-09-12T02:23:16.854938+0000","last_unstale":"2024-09-12T02:40:04.723394+0000","last_undegraded":"2024-09-12T02:40:04.723394+0000","last_fullsized":"2024-09-12T02:40:04.723394+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4979,"log_dups_size":0,"ondisk_log_size":4979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:02.944057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25537,"num_write_kb":303027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"28'4415","reported_seq":4447,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.768572+0000","last_change":"2024-09-12T02:23:04.787820+0000","last_active":"2024-09-12T02:39:57.768572+0000","last_peered":"2024-09-12T02:39:57.768572+0000","last_clean":"2024-09-12T02:39:57.768572+0000","last_became_active":"2024-09-12T02:23:04.787523+0000","last_became_peered":"2024-09-12T02:23:04.787523+0000","last_unstale":"2024-09-12T02:39:57.768572+0000","last_undegraded":"2024-09-12T02:39:57.768572+0000","last_fullsized":"2024-09-12T02:39:57.768572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4415,"log_dups_size":0,"ondisk_log_size":4415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:52.784171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23022,"num_write_kb":288900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'5","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.629413+0000","last_change":"2024-09-12T02:23:03.771625+0000","last_active":"2024-09-12T02:39:47.629413+0000","last_peered":"2024-09-12T02:39:47.629413+0000","last_clean":"2024-09-12T02:39:47.629413+0000","last_became_active":"2024-09-12T02:23:03.771163+0000","last_became_peered":"2024-09-12T02:23:03.771163+0000","last_unstale":"2024-09-12T02:39:47.629413+0000","last_undegraded":"2024-09-12T02:39:47.629413+0000","last_fullsized":"2024-09-12T02:39:47.629413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:32.772569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"28'615","reported_seq":640,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:49.038042+0000","last_change":"2024-09-12T02:23:15.833889+0000","last_active":"2024-09-12T02:39:49.038042+0000","last_peered":"2024-09-12T02:39:49.038042+0000","last_clean":"2024-09-12T02:39:49.038042+0000","last_became_active":"2024-09-12T02:23:15.833587+0000","last_became_peered":"2024-09-12T02:23:15.833587+0000","last_unstale":"2024-09-12T02:39:49.038042+0000","last_undegraded":"2024-09-12T02:39:49.038042+0000","last_fullsized":"2024-09-12T02:39:49.038042+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:32.787861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1484,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"28'5400","reported_seq":5424,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.730531+0000","last_change":"2024-09-12T02:23:16.848864+0000","last_active":"2024-09-12T02:40:04.730531+0000","last_peered":"2024-09-12T02:40:04.730531+0000","last_clean":"2024-09-12T02:40:04.730531+0000","last_became_active":"2024-09-12T02:23:16.848385+0000","last_became_peered":"2024-09-12T02:23:16.848385+0000","last_unstale":"2024-09-12T02:40:04.730531+0000","last_undegraded":"2024-09-12T02:40:04.730531+0000","last_fullsized":"2024-09-12T02:40:04.730531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5400,"log_dups_size":0,"ondisk_log_size":5400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:03.656397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28350,"num_write_kb":322666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"28'5040","reported_seq":5072,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.783368+0000","last_change":"2024-09-12T02:23:04.781839+0000","last_active":"2024-09-12T02:39:57.783368+0000","last_peered":"2024-09-12T02:39:57.783368+0000","last_clean":"2024-09-12T02:39:57.783368+0000","last_became_active":"2024-09-12T02:23:04.780984+0000","last_became_peered":"2024-09-12T02:23:04.780984+0000","last_unstale":"2024-09-12T02:39:57.783368+0000","last_undegraded":"2024-09-12T02:39:57.783368+0000","last_fullsized":"2024-09-12T02:39:57.783368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5040,"log_dups_size":0,"ondisk_log_size":5040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:07.692791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25643,"num_write_kb":315836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'1","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:37:39.936369+0000","last_change":"2024-09-12T02:23:03.765100+0000","last_active":"2024-09-12T02:37:39.936369+0000","last_peered":"2024-09-12T02:37:39.936369+0000","last_clean":"2024-09-12T02:37:39.936369+0000","last_became_active":"2024-09-12T02:23:03.764801+0000","last_became_peered":"2024-09-12T02:23:03.764801+0000","last_unstale":"2024-09-12T02:37:39.936369+0000","last_undegraded":"2024-09-12T02:37:39.936369+0000","last_fullsized":"2024-09-12T02:37:39.936369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:06.891040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":190,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:36:54.619226+0000","last_change":"2024-09-12T02:22:55.143869+0000","last_active":"2024-09-12T02:36:54.619226+0000","last_peered":"2024-09-12T02:36:54.619226+0000","last_clean":"2024-09-12T02:36:54.619226+0000","last_became_active":"2024-09-12T02:22:55.142784+0000","last_became_peered":"2024-09-12T02:22:55.142784+0000","last_unstale":"2024-09-12T02:36:54.619226+0000","last_undegraded":"2024-09-12T02:36:54.619226+0000","last_fullsized":"2024-09-12T02:36:54.619226+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:22:52.457979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:22:52.457979+0000","last_clean_scrub_stamp":"2024-09-12T02:22:52.457979+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:46.152602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"28'4","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.661864+0000","last_change":"2024-09-12T02:23:15.831362+0000","last_active":"2024-09-12T02:38:07.661864+0000","last_peered":"2024-09-12T02:38:07.661864+0000","last_clean":"2024-09-12T02:38:07.661864+0000","last_became_active":"2024-09-12T02:23:15.831084+0000","last_became_peered":"2024-09-12T02:23:15.831084+0000","last_unstale":"2024-09-12T02:38:07.661864+0000","last_undegraded":"2024-09-12T02:38:07.661864+0000","last_fullsized":"2024-09-12T02:38:07.661864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:17.754173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"28'4521","reported_seq":4544,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.674856+0000","last_change":"2024-09-12T02:23:16.838831+0000","last_active":"2024-09-12T02:40:04.674856+0000","last_peered":"2024-09-12T02:40:04.674856+0000","last_clean":"2024-09-12T02:40:04.674856+0000","last_became_active":"2024-09-12T02:23:16.838523+0000","last_became_peered":"2024-09-12T02:23:16.838523+0000","last_unstale":"2024-09-12T02:40:04.674856+0000","last_undegraded":"2024-09-12T02:40:04.674856+0000","last_fullsized":"2024-09-12T02:40:04.674856+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4521,"log_dups_size":0,"ondisk_log_size":4521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:35:42.088332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22817,"num_write_kb":263525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"28'4994","reported_seq":5025,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.798342+0000","last_change":"2024-09-12T02:23:04.783483+0000","last_active":"2024-09-12T02:39:57.798342+0000","last_peered":"2024-09-12T02:39:57.798342+0000","last_clean":"2024-09-12T02:39:57.798342+0000","last_became_active":"2024-09-12T02:23:04.782878+0000","last_became_peered":"2024-09-12T02:23:04.782878+0000","last_unstale":"2024-09-12T02:39:57.798342+0000","last_undegraded":"2024-09-12T02:39:57.798342+0000","last_fullsized":"2024-09-12T02:39:57.798342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4994,"log_dups_size":0,"ondisk_log_size":4994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:52.335065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25629,"num_write_kb":307571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'2","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:48.439127+0000","last_change":"2024-09-12T02:23:03.762507+0000","last_active":"2024-09-12T02:38:48.439127+0000","last_peered":"2024-09-12T02:38:48.439127+0000","last_clean":"2024-09-12T02:38:48.439127+0000","last_became_active":"2024-09-12T02:23:03.762164+0000","last_became_peered":"2024-09-12T02:23:03.762164+0000","last_unstale":"2024-09-12T02:38:48.439127+0000","last_undegraded":"2024-09-12T02:38:48.439127+0000","last_fullsized":"2024-09-12T02:38:48.439127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:34.569630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"28'4","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.725569+0000","last_change":"2024-09-12T02:23:15.830783+0000","last_active":"2024-09-12T02:38:07.725569+0000","last_peered":"2024-09-12T02:38:07.725569+0000","last_clean":"2024-09-12T02:38:07.725569+0000","last_became_active":"2024-09-12T02:23:15.830471+0000","last_became_peered":"2024-09-12T02:23:15.830471+0000","last_unstale":"2024-09-12T02:38:07.725569+0000","last_undegraded":"2024-09-12T02:38:07.725569+0000","last_fullsized":"2024-09-12T02:38:07.725569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:22.927201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"28'4580","reported_seq":4603,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.664325+0000","last_change":"2024-09-12T02:23:16.856328+0000","last_active":"2024-09-12T02:40:04.664325+0000","last_peered":"2024-09-12T02:40:04.664325+0000","last_clean":"2024-09-12T02:40:04.664325+0000","last_became_active":"2024-09-12T02:23:16.855992+0000","last_became_peered":"2024-09-12T02:23:16.855992+0000","last_unstale":"2024-09-12T02:40:04.664325+0000","last_undegraded":"2024-09-12T02:40:04.664325+0000","last_fullsized":"2024-09-12T02:40:04.664325+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4580,"log_dups_size":0,"ondisk_log_size":4580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:47.682103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24326,"num_write_kb":281766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"28'4821","reported_seq":4852,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.817348+0000","last_change":"2024-09-12T02:23:04.784318+0000","last_active":"2024-09-12T02:39:57.817348+0000","last_peered":"2024-09-12T02:39:57.817348+0000","last_clean":"2024-09-12T02:39:57.817348+0000","last_became_active":"2024-09-12T02:23:04.784012+0000","last_became_peered":"2024-09-12T02:23:04.784012+0000","last_unstale":"2024-09-12T02:39:57.817348+0000","last_undegraded":"2024-09-12T02:39:57.817348+0000","last_fullsized":"2024-09-12T02:39:57.817348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4821,"log_dups_size":0,"ondisk_log_size":4821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:51.352859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24805,"num_write_kb":312357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"28'2","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:52.827222+0000","last_change":"2024-09-12T02:23:03.766034+0000","last_active":"2024-09-12T02:38:52.827222+0000","last_peered":"2024-09-12T02:38:52.827222+0000","last_clean":"2024-09-12T02:38:52.827222+0000","last_became_active":"2024-09-12T02:23:03.765735+0000","last_became_peered":"2024-09-12T02:23:03.765735+0000","last_unstale":"2024-09-12T02:38:52.827222+0000","last_undegraded":"2024-09-12T02:38:52.827222+0000","last_fullsized":"2024-09-12T02:38:52.827222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:19.691229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"28'1085","reported_seq":1110,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.716303+0000","last_change":"2024-09-12T02:23:15.832527+0000","last_active":"2024-09-12T02:38:07.716303+0000","last_peered":"2024-09-12T02:38:07.716303+0000","last_clean":"2024-09-12T02:38:07.716303+0000","last_became_active":"2024-09-12T02:23:15.832184+0000","last_became_peered":"2024-09-12T02:23:15.832184+0000","last_unstale":"2024-09-12T02:38:07.716303+0000","last_undegraded":"2024-09-12T02:38:07.716303+0000","last_fullsized":"2024-09-12T02:38:07.716303+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":1085,"log_dups_size":0,"ondisk_log_size":1085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:29.131198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1076,"num_write_kb":4403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"28'4868","reported_seq":4891,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.629771+0000","last_change":"2024-09-12T02:23:16.849357+0000","last_active":"2024-09-12T02:40:04.629771+0000","last_peered":"2024-09-12T02:40:04.629771+0000","last_clean":"2024-09-12T02:40:04.629771+0000","last_became_active":"2024-09-12T02:23:16.849067+0000","last_became_peered":"2024-09-12T02:23:16.849067+0000","last_unstale":"2024-09-12T02:40:04.629771+0000","last_undegraded":"2024-09-12T02:40:04.629771+0000","last_fullsized":"2024-09-12T02:40:04.629771+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4868,"log_dups_size":0,"ondisk_log_size":4868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:06.887523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24798,"num_write_kb":291891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"28'5524","reported_seq":5555,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.830006+0000","last_change":"2024-09-12T02:23:04.791152+0000","last_active":"2024-09-12T02:39:57.830006+0000","last_peered":"2024-09-12T02:39:57.830006+0000","last_clean":"2024-09-12T02:39:57.830006+0000","last_became_active":"2024-09-12T02:23:04.790707+0000","last_became_peered":"2024-09-12T02:23:04.790707+0000","last_unstale":"2024-09-12T02:39:57.830006+0000","last_undegraded":"2024-09-12T02:39:57.830006+0000","last_fullsized":"2024-09-12T02:39:57.830006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5524,"log_dups_size":0,"ondisk_log_size":5524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:42.798507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27879,"num_write_kb":349281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"28'6","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.625090+0000","last_change":"2024-09-12T02:23:03.763327+0000","last_active":"2024-09-12T02:39:47.625090+0000","last_peered":"2024-09-12T02:39:47.625090+0000","last_clean":"2024-09-12T02:39:47.625090+0000","last_became_active":"2024-09-12T02:23:03.763005+0000","last_became_peered":"2024-09-12T02:23:03.763005+0000","last_unstale":"2024-09-12T02:39:47.625090+0000","last_undegraded":"2024-09-12T02:39:47.625090+0000","last_fullsized":"2024-09-12T02:39:47.625090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:09.500459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"28'3","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.672423+0000","last_change":"2024-09-12T02:23:15.819644+0000","last_active":"2024-09-12T02:38:07.672423+0000","last_peered":"2024-09-12T02:38:07.672423+0000","last_clean":"2024-09-12T02:38:07.672423+0000","last_became_active":"2024-09-12T02:23:15.819370+0000","last_became_peered":"2024-09-12T02:23:15.819370+0000","last_unstale":"2024-09-12T02:38:07.672423+0000","last_undegraded":"2024-09-12T02:38:07.672423+0000","last_fullsized":"2024-09-12T02:38:07.672423+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:56.384531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"28'5323","reported_seq":5346,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.659057+0000","last_change":"2024-09-12T02:23:16.838234+0000","last_active":"2024-09-12T02:40:04.659057+0000","last_peered":"2024-09-12T02:40:04.659057+0000","last_clean":"2024-09-12T02:40:04.659057+0000","last_became_active":"2024-09-12T02:23:16.837942+0000","last_became_peered":"2024-09-12T02:23:16.837942+0000","last_unstale":"2024-09-12T02:40:04.659057+0000","last_undegraded":"2024-09-12T02:40:04.659057+0000","last_fullsized":"2024-09-12T02:40:04.659057+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5323,"log_dups_size":0,"ondisk_log_size":5323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:41.842931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28212,"num_write_kb":317995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"28'4432","reported_seq":4463,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.735779+0000","last_change":"2024-09-12T02:23:04.781196+0000","last_active":"2024-09-12T02:39:57.735779+0000","last_peered":"2024-09-12T02:39:57.735779+0000","last_clean":"2024-09-12T02:39:57.735779+0000","last_became_active":"2024-09-12T02:23:04.780893+0000","last_became_peered":"2024-09-12T02:23:04.780893+0000","last_unstale":"2024-09-12T02:39:57.735779+0000","last_undegraded":"2024-09-12T02:39:57.735779+0000","last_fullsized":"2024-09-12T02:39:57.735779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4432,"log_dups_size":0,"ondisk_log_size":4432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:26.527539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22251,"num_write_kb":285885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'5","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.626407+0000","last_change":"2024-09-12T02:23:03.769541+0000","last_active":"2024-09-12T02:39:47.626407+0000","last_peered":"2024-09-12T02:39:47.626407+0000","last_clean":"2024-09-12T02:39:47.626407+0000","last_became_active":"2024-09-12T02:23:03.765281+0000","last_became_peered":"2024-09-12T02:23:03.765281+0000","last_unstale":"2024-09-12T02:39:47.626407+0000","last_undegraded":"2024-09-12T02:39:47.626407+0000","last_fullsized":"2024-09-12T02:39:47.626407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:53.409370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"28'3","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.670913+0000","last_change":"2024-09-12T02:23:15.841592+0000","last_active":"2024-09-12T02:38:07.670913+0000","last_peered":"2024-09-12T02:38:07.670913+0000","last_clean":"2024-09-12T02:38:07.670913+0000","last_became_active":"2024-09-12T02:23:15.841380+0000","last_became_peered":"2024-09-12T02:23:15.841380+0000","last_unstale":"2024-09-12T02:38:07.670913+0000","last_undegraded":"2024-09-12T02:38:07.670913+0000","last_fullsized":"2024-09-12T02:38:07.670913+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:38.396332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"28'4540","reported_seq":4563,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.682121+0000","last_change":"2024-09-12T02:23:16.846596+0000","last_active":"2024-09-12T02:40:04.682121+0000","last_peered":"2024-09-12T02:40:04.682121+0000","last_clean":"2024-09-12T02:40:04.682121+0000","last_became_active":"2024-09-12T02:23:16.846273+0000","last_became_peered":"2024-09-12T02:23:16.846273+0000","last_unstale":"2024-09-12T02:40:04.682121+0000","last_undegraded":"2024-09-12T02:40:04.682121+0000","last_fullsized":"2024-09-12T02:40:04.682121+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4540,"log_dups_size":0,"ondisk_log_size":4540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:03.628494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23721,"num_write_kb":271171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"28'4758","reported_seq":4789,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.728981+0000","last_change":"2024-09-12T02:23:04.781856+0000","last_active":"2024-09-12T02:39:57.728981+0000","last_peered":"2024-09-12T02:39:57.728981+0000","last_clean":"2024-09-12T02:39:57.728981+0000","last_became_active":"2024-09-12T02:23:04.781575+0000","last_became_peered":"2024-09-12T02:23:04.781575+0000","last_unstale":"2024-09-12T02:39:57.728981+0000","last_undegraded":"2024-09-12T02:39:57.728981+0000","last_fullsized":"2024-09-12T02:39:57.728981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4758,"log_dups_size":0,"ondisk_log_size":4758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:26.630558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24728,"num_write_kb":299876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"28'11","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.597678+0000","last_change":"2024-09-12T02:23:03.771368+0000","last_active":"2024-09-12T02:39:47.597678+0000","last_peered":"2024-09-12T02:39:47.597678+0000","last_clean":"2024-09-12T02:39:47.597678+0000","last_became_active":"2024-09-12T02:23:03.771061+0000","last_became_peered":"2024-09-12T02:23:03.771061+0000","last_unstale":"2024-09-12T02:39:47.597678+0000","last_undegraded":"2024-09-12T02:39:47.597678+0000","last_fullsized":"2024-09-12T02:39:47.597678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:57.476458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"28'2","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.688801+0000","last_change":"2024-09-12T02:23:15.833158+0000","last_active":"2024-09-12T02:38:07.688801+0000","last_peered":"2024-09-12T02:38:07.688801+0000","last_clean":"2024-09-12T02:38:07.688801+0000","last_became_active":"2024-09-12T02:23:15.831707+0000","last_became_peered":"2024-09-12T02:23:15.831707+0000","last_unstale":"2024-09-12T02:38:07.688801+0000","last_undegraded":"2024-09-12T02:38:07.688801+0000","last_fullsized":"2024-09-12T02:38:07.688801+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:30.000066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"28'5063","reported_seq":5086,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.736723+0000","last_change":"2024-09-12T02:23:16.858757+0000","last_active":"2024-09-12T02:40:04.736723+0000","last_peered":"2024-09-12T02:40:04.736723+0000","last_clean":"2024-09-12T02:40:04.736723+0000","last_became_active":"2024-09-12T02:23:16.858469+0000","last_became_peered":"2024-09-12T02:23:16.858469+0000","last_unstale":"2024-09-12T02:40:04.736723+0000","last_undegraded":"2024-09-12T02:40:04.736723+0000","last_fullsized":"2024-09-12T02:40:04.736723+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5063,"log_dups_size":0,"ondisk_log_size":5063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:22.288143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25554,"num_write_kb":307334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"28'4968","reported_seq":4999,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.765114+0000","last_change":"2024-09-12T02:23:04.785248+0000","last_active":"2024-09-12T02:39:57.765114+0000","last_peered":"2024-09-12T02:39:57.765114+0000","last_clean":"2024-09-12T02:39:57.765114+0000","last_became_active":"2024-09-12T02:23:04.784977+0000","last_became_peered":"2024-09-12T02:23:04.784977+0000","last_unstale":"2024-09-12T02:39:57.765114+0000","last_undegraded":"2024-09-12T02:39:57.765114+0000","last_fullsized":"2024-09-12T02:39:57.765114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4968,"log_dups_size":0,"ondisk_log_size":4968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:23.273457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25338,"num_write_kb":318642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"28'6","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.616586+0000","last_change":"2024-09-12T02:23:03.767842+0000","last_active":"2024-09-12T02:39:47.616586+0000","last_peered":"2024-09-12T02:39:47.616586+0000","last_clean":"2024-09-12T02:39:47.616586+0000","last_became_active":"2024-09-12T02:23:03.767066+0000","last_became_peered":"2024-09-12T02:23:03.767066+0000","last_unstale":"2024-09-12T02:39:47.616586+0000","last_undegraded":"2024-09-12T02:39:47.616586+0000","last_fullsized":"2024-09-12T02:39:47.616586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:50.800749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"28'2","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.705981+0000","last_change":"2024-09-12T02:23:15.826104+0000","last_active":"2024-09-12T02:38:07.705981+0000","last_peered":"2024-09-12T02:38:07.705981+0000","last_clean":"2024-09-12T02:38:07.705981+0000","last_became_active":"2024-09-12T02:23:15.825779+0000","last_became_peered":"2024-09-12T02:23:15.825779+0000","last_unstale":"2024-09-12T02:38:07.705981+0000","last_undegraded":"2024-09-12T02:38:07.705981+0000","last_fullsized":"2024-09-12T02:38:07.705981+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:32.661083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"28'5278","reported_seq":5301,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.705421+0000","last_change":"2024-09-12T02:23:16.856543+0000","last_active":"2024-09-12T02:40:04.705421+0000","last_peered":"2024-09-12T02:40:04.705421+0000","last_clean":"2024-09-12T02:40:04.705421+0000","last_became_active":"2024-09-12T02:23:16.855538+0000","last_became_peered":"2024-09-12T02:23:16.855538+0000","last_unstale":"2024-09-12T02:40:04.705421+0000","last_undegraded":"2024-09-12T02:40:04.705421+0000","last_fullsized":"2024-09-12T02:40:04.705421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5278,"log_dups_size":0,"ondisk_log_size":5278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:05.857593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27222,"num_write_kb":301662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'5225","reported_seq":5256,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.832151+0000","last_change":"2024-09-12T02:23:04.783671+0000","last_active":"2024-09-12T02:39:57.832151+0000","last_peered":"2024-09-12T02:39:57.832151+0000","last_clean":"2024-09-12T02:39:57.832151+0000","last_became_active":"2024-09-12T02:23:04.783399+0000","last_became_peered":"2024-09-12T02:23:04.783399+0000","last_unstale":"2024-09-12T02:39:57.832151+0000","last_undegraded":"2024-09-12T02:39:57.832151+0000","last_fullsized":"2024-09-12T02:39:57.832151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5225,"log_dups_size":0,"ondisk_log_size":5225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:04.321789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26678,"num_write_kb":336266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'5","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.634447+0000","last_change":"2024-09-12T02:23:03.767217+0000","last_active":"2024-09-12T02:39:47.634447+0000","last_peered":"2024-09-12T02:39:47.634447+0000","last_clean":"2024-09-12T02:39:47.634447+0000","last_became_active":"2024-09-12T02:23:03.766551+0000","last_became_peered":"2024-09-12T02:23:03.766551+0000","last_unstale":"2024-09-12T02:39:47.634447+0000","last_undegraded":"2024-09-12T02:39:47.634447+0000","last_fullsized":"2024-09-12T02:39:47.634447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:09.963450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"28'299","reported_seq":324,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:48.637750+0000","last_change":"2024-09-12T02:23:15.832638+0000","last_active":"2024-09-12T02:39:48.637750+0000","last_peered":"2024-09-12T02:39:48.637750+0000","last_clean":"2024-09-12T02:39:48.637750+0000","last_became_active":"2024-09-12T02:23:15.832152+0000","last_became_peered":"2024-09-12T02:23:15.832152+0000","last_unstale":"2024-09-12T02:39:48.637750+0000","last_undegraded":"2024-09-12T02:39:48.637750+0000","last_fullsized":"2024-09-12T02:39:48.637750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:06.820636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295,"num_write_kb":4246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"28'6304","reported_seq":6327,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.731388+0000","last_change":"2024-09-12T02:23:16.846920+0000","last_active":"2024-09-12T02:40:04.731388+0000","last_peered":"2024-09-12T02:40:04.731388+0000","last_clean":"2024-09-12T02:40:04.731388+0000","last_became_active":"2024-09-12T02:23:16.846454+0000","last_became_peered":"2024-09-12T02:23:16.846454+0000","last_unstale":"2024-09-12T02:40:04.731388+0000","last_undegraded":"2024-09-12T02:40:04.731388+0000","last_fullsized":"2024-09-12T02:40:04.731388+0000","mapping_epoch":24,"log_start":"28'1100","ondisk_log_start":"28'1100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5204,"log_dups_size":0,"ondisk_log_size":5204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:51.782998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31934,"num_write_kb":398820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"28'4402","reported_seq":4433,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.754331+0000","last_change":"2024-09-12T02:23:04.784379+0000","last_active":"2024-09-12T02:39:57.754331+0000","last_peered":"2024-09-12T02:39:57.754331+0000","last_clean":"2024-09-12T02:39:57.754331+0000","last_became_active":"2024-09-12T02:23:04.784094+0000","last_became_peered":"2024-09-12T02:23:04.784094+0000","last_unstale":"2024-09-12T02:39:57.754331+0000","last_undegraded":"2024-09-12T02:39:57.754331+0000","last_fullsized":"2024-09-12T02:39:57.754331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4402,"log_dups_size":0,"ondisk_log_size":4402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:22.103008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22399,"num_write_kb":282193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"28'8","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.616748+0000","last_change":"2024-09-12T02:23:03.762859+0000","last_active":"2024-09-12T02:39:47.616748+0000","last_peered":"2024-09-12T02:39:47.616748+0000","last_clean":"2024-09-12T02:39:47.616748+0000","last_became_active":"2024-09-12T02:23:03.762557+0000","last_became_peered":"2024-09-12T02:23:03.762557+0000","last_unstale":"2024-09-12T02:39:47.616748+0000","last_undegraded":"2024-09-12T02:39:47.616748+0000","last_fullsized":"2024-09-12T02:39:47.616748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:34.863435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"28'34","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:51.337918+0000","last_change":"2024-09-12T02:23:15.823090+0000","last_active":"2024-09-12T02:39:51.337918+0000","last_peered":"2024-09-12T02:39:51.337918+0000","last_clean":"2024-09-12T02:39:51.337918+0000","last_became_active":"2024-09-12T02:23:15.822441+0000","last_became_peered":"2024-09-12T02:23:15.822441+0000","last_unstale":"2024-09-12T02:39:51.337918+0000","last_undegraded":"2024-09-12T02:39:51.337918+0000","last_fullsized":"2024-09-12T02:39:51.337918+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:35.125478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"28'5704","reported_seq":5727,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.711812+0000","last_change":"2024-09-12T02:23:16.839875+0000","last_active":"2024-09-12T02:40:04.711812+0000","last_peered":"2024-09-12T02:40:04.711812+0000","last_clean":"2024-09-12T02:40:04.711812+0000","last_became_active":"2024-09-12T02:23:16.838277+0000","last_became_peered":"2024-09-12T02:23:16.838277+0000","last_unstale":"2024-09-12T02:40:04.711812+0000","last_undegraded":"2024-09-12T02:40:04.711812+0000","last_fullsized":"2024-09-12T02:40:04.711812+0000","mapping_epoch":24,"log_start":"28'500","ondisk_log_start":"28'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5204,"log_dups_size":0,"ondisk_log_size":5204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:09.370310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29050,"num_write_kb":345934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"28'4440","reported_seq":4471,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.749780+0000","last_change":"2024-09-12T02:23:04.780843+0000","last_active":"2024-09-12T02:39:57.749780+0000","last_peered":"2024-09-12T02:39:57.749780+0000","last_clean":"2024-09-12T02:39:57.749780+0000","last_became_active":"2024-09-12T02:23:04.780475+0000","last_became_peered":"2024-09-12T02:23:04.780475+0000","last_unstale":"2024-09-12T02:39:57.749780+0000","last_undegraded":"2024-09-12T02:39:57.749780+0000","last_fullsized":"2024-09-12T02:39:57.749780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4440,"log_dups_size":0,"ondisk_log_size":4440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:38.074872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22736,"num_write_kb":283554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'340","reported_seq":373,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.633548+0000","last_change":"2024-09-12T02:23:03.768425+0000","last_active":"2024-09-12T02:39:47.633548+0000","last_peered":"2024-09-12T02:39:47.633548+0000","last_clean":"2024-09-12T02:39:47.633548+0000","last_became_active":"2024-09-12T02:23:03.768092+0000","last_became_peered":"2024-09-12T02:23:03.768092+0000","last_unstale":"2024-09-12T02:39:47.633548+0000","last_undegraded":"2024-09-12T02:39:47.633548+0000","last_fullsized":"2024-09-12T02:39:47.633548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":340,"log_dups_size":0,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:18.572070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"28'5","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.725314+0000","last_change":"2024-09-12T02:23:15.829364+0000","last_active":"2024-09-12T02:38:07.725314+0000","last_peered":"2024-09-12T02:38:07.725314+0000","last_clean":"2024-09-12T02:38:07.725314+0000","last_became_active":"2024-09-12T02:23:15.827936+0000","last_became_peered":"2024-09-12T02:23:15.827936+0000","last_unstale":"2024-09-12T02:38:07.725314+0000","last_undegraded":"2024-09-12T02:38:07.725314+0000","last_fullsized":"2024-09-12T02:38:07.725314+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:04.973202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"28'4960","reported_seq":4983,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.685069+0000","last_change":"2024-09-12T02:23:16.854209+0000","last_active":"2024-09-12T02:40:04.685069+0000","last_peered":"2024-09-12T02:40:04.685069+0000","last_clean":"2024-09-12T02:40:04.685069+0000","last_became_active":"2024-09-12T02:23:16.853900+0000","last_became_peered":"2024-09-12T02:23:16.853900+0000","last_unstale":"2024-09-12T02:40:04.685069+0000","last_undegraded":"2024-09-12T02:40:04.685069+0000","last_fullsized":"2024-09-12T02:40:04.685069+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4960,"log_dups_size":0,"ondisk_log_size":4960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:52.831434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25526,"num_write_kb":294821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'6032","reported_seq":6063,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.811025+0000","last_change":"2024-09-12T02:23:04.777953+0000","last_active":"2024-09-12T02:39:57.811025+0000","last_peered":"2024-09-12T02:39:57.811025+0000","last_clean":"2024-09-12T02:39:57.811025+0000","last_became_active":"2024-09-12T02:23:04.777081+0000","last_became_peered":"2024-09-12T02:23:04.777081+0000","last_unstale":"2024-09-12T02:39:57.811025+0000","last_undegraded":"2024-09-12T02:39:57.811025+0000","last_fullsized":"2024-09-12T02:39:57.811025+0000","mapping_epoch":20,"log_start":"28'500","ondisk_log_start":"28'500","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5532,"log_dups_size":0,"ondisk_log_size":5532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:14.103378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30497,"num_write_kb":392872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'35","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:48.251039+0000","last_change":"2024-09-12T02:23:03.771271+0000","last_active":"2024-09-12T02:39:48.251039+0000","last_peered":"2024-09-12T02:39:48.251039+0000","last_clean":"2024-09-12T02:39:48.251039+0000","last_became_active":"2024-09-12T02:23:03.769601+0000","last_became_peered":"2024-09-12T02:23:03.769601+0000","last_unstale":"2024-09-12T02:39:48.251039+0000","last_undegraded":"2024-09-12T02:39:48.251039+0000","last_fullsized":"2024-09-12T02:39:48.251039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:22.910072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"28'8","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.680681+0000","last_change":"2024-09-12T02:23:15.831522+0000","last_active":"2024-09-12T02:38:07.680681+0000","last_peered":"2024-09-12T02:38:07.680681+0000","last_clean":"2024-09-12T02:38:07.680681+0000","last_became_active":"2024-09-12T02:23:15.831220+0000","last_became_peered":"2024-09-12T02:23:15.831220+0000","last_unstale":"2024-09-12T02:38:07.680681+0000","last_undegraded":"2024-09-12T02:38:07.680681+0000","last_fullsized":"2024-09-12T02:38:07.680681+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:54.337051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"28'5159","reported_seq":5182,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.721952+0000","last_change":"2024-09-12T02:23:16.858361+0000","last_active":"2024-09-12T02:40:04.721952+0000","last_peered":"2024-09-12T02:40:04.721952+0000","last_clean":"2024-09-12T02:40:04.721952+0000","last_became_active":"2024-09-12T02:23:16.858075+0000","last_became_peered":"2024-09-12T02:23:16.858075+0000","last_unstale":"2024-09-12T02:40:04.721952+0000","last_undegraded":"2024-09-12T02:40:04.721952+0000","last_fullsized":"2024-09-12T02:40:04.721952+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5159,"log_dups_size":0,"ondisk_log_size":5159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:35.038604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27123,"num_write_kb":309496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"28'3733","reported_seq":3764,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.822654+0000","last_change":"2024-09-12T02:23:04.779171+0000","last_active":"2024-09-12T02:39:57.822654+0000","last_peered":"2024-09-12T02:39:57.822654+0000","last_clean":"2024-09-12T02:39:57.822654+0000","last_became_active":"2024-09-12T02:23:04.778850+0000","last_became_peered":"2024-09-12T02:23:04.778850+0000","last_unstale":"2024-09-12T02:39:57.822654+0000","last_undegraded":"2024-09-12T02:39:57.822654+0000","last_fullsized":"2024-09-12T02:39:57.822654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":3733,"log_dups_size":0,"ondisk_log_size":3733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:21.746490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19250,"num_write_kb":253251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'2","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.636633+0000","last_change":"2024-09-12T02:23:03.769710+0000","last_active":"2024-09-12T02:39:47.636633+0000","last_peered":"2024-09-12T02:39:47.636633+0000","last_clean":"2024-09-12T02:39:47.636633+0000","last_became_active":"2024-09-12T02:23:03.769436+0000","last_became_peered":"2024-09-12T02:23:03.769436+0000","last_unstale":"2024-09-12T02:39:47.636633+0000","last_undegraded":"2024-09-12T02:39:47.636633+0000","last_fullsized":"2024-09-12T02:39:47.636633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:11.194147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"28'12","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:38.057899+0000","last_change":"2024-09-12T02:23:15.833196+0000","last_active":"2024-09-12T02:39:38.057899+0000","last_peered":"2024-09-12T02:39:38.057899+0000","last_clean":"2024-09-12T02:39:38.057899+0000","last_became_active":"2024-09-12T02:23:15.832873+0000","last_became_peered":"2024-09-12T02:23:15.832873+0000","last_unstale":"2024-09-12T02:39:38.057899+0000","last_undegraded":"2024-09-12T02:39:38.057899+0000","last_fullsized":"2024-09-12T02:39:38.057899+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:15.238046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"28'5308","reported_seq":5331,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.733481+0000","last_change":"2024-09-12T02:23:16.856735+0000","last_active":"2024-09-12T02:40:04.733481+0000","last_peered":"2024-09-12T02:40:04.733481+0000","last_clean":"2024-09-12T02:40:04.733481+0000","last_became_active":"2024-09-12T02:23:16.856455+0000","last_became_peered":"2024-09-12T02:23:16.856455+0000","last_unstale":"2024-09-12T02:40:04.733481+0000","last_undegraded":"2024-09-12T02:40:04.733481+0000","last_fullsized":"2024-09-12T02:40:04.733481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5308,"log_dups_size":0,"ondisk_log_size":5308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:55.376194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27382,"num_write_kb":326846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"28'4524","reported_seq":4555,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.792729+0000","last_change":"2024-09-12T02:23:04.786100+0000","last_active":"2024-09-12T02:39:57.792729+0000","last_peered":"2024-09-12T02:39:57.792729+0000","last_clean":"2024-09-12T02:39:57.792729+0000","last_became_active":"2024-09-12T02:23:04.785795+0000","last_became_peered":"2024-09-12T02:23:04.785795+0000","last_unstale":"2024-09-12T02:39:57.792729+0000","last_undegraded":"2024-09-12T02:39:57.792729+0000","last_fullsized":"2024-09-12T02:39:57.792729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4524,"log_dups_size":0,"ondisk_log_size":4524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:58.597807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22689,"num_write_kb":295834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"28'2","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.620142+0000","last_change":"2024-09-12T02:23:03.770668+0000","last_active":"2024-09-12T02:39:47.620142+0000","last_peered":"2024-09-12T02:39:47.620142+0000","last_clean":"2024-09-12T02:39:47.620142+0000","last_became_active":"2024-09-12T02:23:03.769302+0000","last_became_peered":"2024-09-12T02:23:03.769302+0000","last_unstale":"2024-09-12T02:39:47.620142+0000","last_undegraded":"2024-09-12T02:39:47.620142+0000","last_fullsized":"2024-09-12T02:39:47.620142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:18.948922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"28'6","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.703401+0000","last_change":"2024-09-12T02:23:15.825585+0000","last_active":"2024-09-12T02:38:07.703401+0000","last_peered":"2024-09-12T02:38:07.703401+0000","last_clean":"2024-09-12T02:38:07.703401+0000","last_became_active":"2024-09-12T02:23:15.825305+0000","last_became_peered":"2024-09-12T02:23:15.825305+0000","last_unstale":"2024-09-12T02:38:07.703401+0000","last_undegraded":"2024-09-12T02:38:07.703401+0000","last_fullsized":"2024-09-12T02:38:07.703401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:43.818922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"28'6585","reported_seq":6609,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.697301+0000","last_change":"2024-09-12T02:23:16.852415+0000","last_active":"2024-09-12T02:40:04.697301+0000","last_peered":"2024-09-12T02:40:04.697301+0000","last_clean":"2024-09-12T02:40:04.697301+0000","last_became_active":"2024-09-12T02:23:16.852061+0000","last_became_peered":"2024-09-12T02:23:16.852061+0000","last_unstale":"2024-09-12T02:40:04.697301+0000","last_undegraded":"2024-09-12T02:40:04.697301+0000","last_fullsized":"2024-09-12T02:40:04.697301+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":6585,"log_dups_size":0,"ondisk_log_size":6585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:30:49.720576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34694,"num_write_kb":385000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"28'8","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.695201+0000","last_change":"2024-09-12T02:23:15.833414+0000","last_active":"2024-09-12T02:38:07.695201+0000","last_peered":"2024-09-12T02:38:07.695201+0000","last_clean":"2024-09-12T02:38:07.695201+0000","last_became_active":"2024-09-12T02:23:15.832837+0000","last_became_peered":"2024-09-12T02:23:15.832837+0000","last_unstale":"2024-09-12T02:38:07.695201+0000","last_undegraded":"2024-09-12T02:38:07.695201+0000","last_fullsized":"2024-09-12T02:38:07.695201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:31.510160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"28'5783","reported_seq":5814,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.762578+0000","last_change":"2024-09-12T02:23:04.776572+0000","last_active":"2024-09-12T02:39:57.762578+0000","last_peered":"2024-09-12T02:39:57.762578+0000","last_clean":"2024-09-12T02:39:57.762578+0000","last_became_active":"2024-09-12T02:23:04.776270+0000","last_became_peered":"2024-09-12T02:23:04.776270+0000","last_unstale":"2024-09-12T02:39:57.762578+0000","last_undegraded":"2024-09-12T02:39:57.762578+0000","last_fullsized":"2024-09-12T02:39:57.762578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5783,"log_dups_size":0,"ondisk_log_size":5783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:12.807907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29721,"num_write_kb":356762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'3","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.633254+0000","last_change":"2024-09-12T02:23:03.762450+0000","last_active":"2024-09-12T02:39:47.633254+0000","last_peered":"2024-09-12T02:39:47.633254+0000","last_clean":"2024-09-12T02:39:47.633254+0000","last_became_active":"2024-09-12T02:23:03.762161+0000","last_became_peered":"2024-09-12T02:23:03.762161+0000","last_unstale":"2024-09-12T02:39:47.633254+0000","last_undegraded":"2024-09-12T02:39:47.633254+0000","last_fullsized":"2024-09-12T02:39:47.633254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:42.256395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"28'5706","reported_seq":5730,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.668944+0000","last_change":"2024-09-12T02:23:16.844537+0000","last_active":"2024-09-12T02:40:04.668944+0000","last_peered":"2024-09-12T02:40:04.668944+0000","last_clean":"2024-09-12T02:40:04.668944+0000","last_became_active":"2024-09-12T02:23:16.844248+0000","last_became_peered":"2024-09-12T02:23:16.844248+0000","last_unstale":"2024-09-12T02:40:04.668944+0000","last_undegraded":"2024-09-12T02:40:04.668944+0000","last_fullsized":"2024-09-12T02:40:04.668944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5706,"log_dups_size":0,"ondisk_log_size":5706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:45.801324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29959,"num_write_kb":337330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"28'719","reported_seq":745,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:37:54.833834+0000","last_change":"2024-09-12T02:23:15.826010+0000","last_active":"2024-09-12T02:37:54.833834+0000","last_peered":"2024-09-12T02:37:54.833834+0000","last_clean":"2024-09-12T02:37:54.833834+0000","last_became_active":"2024-09-12T02:23:15.825730+0000","last_became_peered":"2024-09-12T02:23:15.825730+0000","last_unstale":"2024-09-12T02:37:54.833834+0000","last_undegraded":"2024-09-12T02:37:54.833834+0000","last_fullsized":"2024-09-12T02:37:54.833834+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":719,"log_dups_size":0,"ondisk_log_size":719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:17.920975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":717,"num_write_kb":4509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"28'4333","reported_seq":4364,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.775122+0000","last_change":"2024-09-12T02:23:04.783317+0000","last_active":"2024-09-12T02:39:57.775122+0000","last_peered":"2024-09-12T02:39:57.775122+0000","last_clean":"2024-09-12T02:39:57.775122+0000","last_became_active":"2024-09-12T02:23:04.783039+0000","last_became_peered":"2024-09-12T02:23:04.783039+0000","last_unstale":"2024-09-12T02:39:57.775122+0000","last_undegraded":"2024-09-12T02:39:57.775122+0000","last_fullsized":"2024-09-12T02:39:57.775122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4333,"log_dups_size":0,"ondisk_log_size":4333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:17.577991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22422,"num_write_kb":290509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'3","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.593428+0000","last_change":"2024-09-12T02:23:03.768361+0000","last_active":"2024-09-12T02:39:47.593428+0000","last_peered":"2024-09-12T02:39:47.593428+0000","last_clean":"2024-09-12T02:39:47.593428+0000","last_became_active":"2024-09-12T02:23:03.768137+0000","last_became_peered":"2024-09-12T02:23:03.768137+0000","last_unstale":"2024-09-12T02:39:47.593428+0000","last_undegraded":"2024-09-12T02:39:47.593428+0000","last_fullsized":"2024-09-12T02:39:47.593428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:29.721363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"28'6357","reported_seq":6379,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.744225+0000","last_change":"2024-09-12T02:23:16.861251+0000","last_active":"2024-09-12T02:40:04.744225+0000","last_peered":"2024-09-12T02:40:04.744225+0000","last_clean":"2024-09-12T02:40:04.744225+0000","last_became_active":"2024-09-12T02:23:16.860980+0000","last_became_peered":"2024-09-12T02:23:16.860980+0000","last_unstale":"2024-09-12T02:40:04.744225+0000","last_undegraded":"2024-09-12T02:40:04.744225+0000","last_fullsized":"2024-09-12T02:40:04.744225+0000","mapping_epoch":24,"log_start":"28'500","ondisk_log_start":"28'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5857,"log_dups_size":0,"ondisk_log_size":5857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:16.177179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32865,"num_write_kb":377625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"28'95","reported_seq":127,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.604503+0000","last_change":"2024-09-12T02:23:03.768186+0000","last_active":"2024-09-12T02:39:57.604503+0000","last_peered":"2024-09-12T02:39:57.604503+0000","last_clean":"2024-09-12T02:39:57.604503+0000","last_became_active":"2024-09-12T02:23:03.767916+0000","last_became_peered":"2024-09-12T02:23:03.767916+0000","last_unstale":"2024-09-12T02:39:57.604503+0000","last_undegraded":"2024-09-12T02:39:57.604503+0000","last_fullsized":"2024-09-12T02:39:57.604503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:04.424540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1333026,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"28'3601","reported_seq":3631,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.791002+0000","last_change":"2024-09-12T02:23:04.793412+0000","last_active":"2024-09-12T02:39:57.791002+0000","last_peered":"2024-09-12T02:39:57.791002+0000","last_clean":"2024-09-12T02:39:57.791002+0000","last_became_active":"2024-09-12T02:23:04.793100+0000","last_became_peered":"2024-09-12T02:23:04.793100+0000","last_unstale":"2024-09-12T02:39:57.791002+0000","last_undegraded":"2024-09-12T02:39:57.791002+0000","last_fullsized":"2024-09-12T02:39:57.791002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":3601,"log_dups_size":0,"ondisk_log_size":3601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:50.446212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18077,"num_write_kb":232187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"28'3","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.714174+0000","last_change":"2024-09-12T02:23:15.830776+0000","last_active":"2024-09-12T02:38:07.714174+0000","last_peered":"2024-09-12T02:38:07.714174+0000","last_clean":"2024-09-12T02:38:07.714174+0000","last_became_active":"2024-09-12T02:23:15.830492+0000","last_became_peered":"2024-09-12T02:23:15.830492+0000","last_unstale":"2024-09-12T02:38:07.714174+0000","last_undegraded":"2024-09-12T02:38:07.714174+0000","last_fullsized":"2024-09-12T02:38:07.714174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:40.517292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"28'3975","reported_seq":3997,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.678952+0000","last_change":"2024-09-12T02:23:16.851953+0000","last_active":"2024-09-12T02:40:04.678952+0000","last_peered":"2024-09-12T02:40:04.678952+0000","last_clean":"2024-09-12T02:40:04.678952+0000","last_became_active":"2024-09-12T02:23:16.851558+0000","last_became_peered":"2024-09-12T02:23:16.851558+0000","last_unstale":"2024-09-12T02:40:04.678952+0000","last_undegraded":"2024-09-12T02:40:04.678952+0000","last_fullsized":"2024-09-12T02:40:04.678952+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":3975,"log_dups_size":0,"ondisk_log_size":3975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:29.852193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20293,"num_write_kb":228813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'576","reported_seq":608,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:08.021504+0000","last_change":"2024-09-12T02:23:03.764310+0000","last_active":"2024-09-12T02:38:08.021504+0000","last_peered":"2024-09-12T02:38:08.021504+0000","last_clean":"2024-09-12T02:38:08.021504+0000","last_became_active":"2024-09-12T02:23:03.764020+0000","last_became_peered":"2024-09-12T02:23:03.764020+0000","last_unstale":"2024-09-12T02:38:08.021504+0000","last_undegraded":"2024-09-12T02:38:08.021504+0000","last_fullsized":"2024-09-12T02:38:08.021504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:25.892874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":574,"num_write_kb":4226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"28'4110","reported_seq":4140,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.726393+0000","last_change":"2024-09-12T02:23:04.771579+0000","last_active":"2024-09-12T02:39:57.726393+0000","last_peered":"2024-09-12T02:39:57.726393+0000","last_clean":"2024-09-12T02:39:57.726393+0000","last_became_active":"2024-09-12T02:23:04.771310+0000","last_became_peered":"2024-09-12T02:23:04.771310+0000","last_unstale":"2024-09-12T02:39:57.726393+0000","last_undegraded":"2024-09-12T02:39:57.726393+0000","last_fullsized":"2024-09-12T02:39:57.726393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4110,"log_dups_size":0,"ondisk_log_size":4110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:05.115474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20660,"num_write_kb":258850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"28'11","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:38:07.725985+0000","last_change":"2024-09-12T02:23:15.832757+0000","last_active":"2024-09-12T02:38:07.725985+0000","last_peered":"2024-09-12T02:38:07.725985+0000","last_clean":"2024-09-12T02:38:07.725985+0000","last_became_active":"2024-09-12T02:23:15.832478+0000","last_became_peered":"2024-09-12T02:23:15.832478+0000","last_unstale":"2024-09-12T02:38:07.725985+0000","last_undegraded":"2024-09-12T02:38:07.725985+0000","last_fullsized":"2024-09-12T02:38:07.725985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:14.800611+0000","last_clean_scrub_stamp":"2024-09-12T02:23:14.800611+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:29.301251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"28'4897","reported_seq":4920,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.741619+0000","last_change":"2024-09-12T02:23:16.848437+0000","last_active":"2024-09-12T02:40:04.741619+0000","last_peered":"2024-09-12T02:40:04.741619+0000","last_clean":"2024-09-12T02:40:04.741619+0000","last_became_active":"2024-09-12T02:23:16.847063+0000","last_became_peered":"2024-09-12T02:23:16.847063+0000","last_unstale":"2024-09-12T02:40:04.741619+0000","last_undegraded":"2024-09-12T02:40:04.741619+0000","last_fullsized":"2024-09-12T02:40:04.741619+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4897,"log_dups_size":0,"ondisk_log_size":4897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:49.979448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25246,"num_write_kb":285992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"28'6383","reported_seq":6415,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.776503+0000","last_change":"2024-09-12T02:23:04.788489+0000","last_active":"2024-09-12T02:39:57.776503+0000","last_peered":"2024-09-12T02:39:57.776503+0000","last_clean":"2024-09-12T02:39:57.776503+0000","last_became_active":"2024-09-12T02:23:04.788195+0000","last_became_peered":"2024-09-12T02:23:04.788195+0000","last_unstale":"2024-09-12T02:39:57.776503+0000","last_undegraded":"2024-09-12T02:39:57.776503+0000","last_fullsized":"2024-09-12T02:39:57.776503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":6383,"log_dups_size":0,"ondisk_log_size":6383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:51.352859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32308,"num_write_kb":383454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"28'5756","reported_seq":5779,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.673986+0000","last_change":"2024-09-12T02:23:16.843805+0000","last_active":"2024-09-12T02:40:04.673986+0000","last_peered":"2024-09-12T02:40:04.673986+0000","last_clean":"2024-09-12T02:40:04.673986+0000","last_became_active":"2024-09-12T02:23:16.843517+0000","last_became_peered":"2024-09-12T02:23:16.843517+0000","last_unstale":"2024-09-12T02:40:04.673986+0000","last_undegraded":"2024-09-12T02:40:04.673986+0000","last_fullsized":"2024-09-12T02:40:04.673986+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5756,"log_dups_size":0,"ondisk_log_size":5756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:30.873311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29883,"num_write_kb":357322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"28'5059","reported_seq":5091,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.717218+0000","last_change":"2024-09-12T02:23:04.780662+0000","last_active":"2024-09-12T02:39:57.717218+0000","last_peered":"2024-09-12T02:39:57.717218+0000","last_clean":"2024-09-12T02:39:57.717218+0000","last_became_active":"2024-09-12T02:23:04.780402+0000","last_became_peered":"2024-09-12T02:23:04.780402+0000","last_unstale":"2024-09-12T02:39:57.717218+0000","last_undegraded":"2024-09-12T02:39:57.717218+0000","last_fullsized":"2024-09-12T02:39:57.717218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5059,"log_dups_size":0,"ondisk_log_size":5059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:23:00.556487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26551,"num_write_kb":323518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"28'4560","reported_seq":4583,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.699722+0000","last_change":"2024-09-12T02:23:16.852992+0000","last_active":"2024-09-12T02:40:04.699722+0000","last_peered":"2024-09-12T02:40:04.699722+0000","last_clean":"2024-09-12T02:40:04.699722+0000","last_became_active":"2024-09-12T02:23:16.852706+0000","last_became_peered":"2024-09-12T02:23:16.852706+0000","last_unstale":"2024-09-12T02:40:04.699722+0000","last_undegraded":"2024-09-12T02:40:04.699722+0000","last_fullsized":"2024-09-12T02:40:04.699722+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4560,"log_dups_size":0,"ondisk_log_size":4560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:56.896457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23787,"num_write_kb":279744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"28'5935","reported_seq":5967,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.781864+0000","last_change":"2024-09-12T02:23:04.785920+0000","last_active":"2024-09-12T02:39:57.781864+0000","last_peered":"2024-09-12T02:39:57.781864+0000","last_clean":"2024-09-12T02:39:57.781864+0000","last_became_active":"2024-09-12T02:23:04.785422+0000","last_became_peered":"2024-09-12T02:23:04.785422+0000","last_unstale":"2024-09-12T02:39:57.781864+0000","last_undegraded":"2024-09-12T02:39:57.781864+0000","last_fullsized":"2024-09-12T02:39:57.781864+0000","mapping_epoch":20,"log_start":"28'100","ondisk_log_start":"28'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5835,"log_dups_size":0,"ondisk_log_size":5835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:55.106703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30608,"num_write_kb":368510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"28'5374","reported_seq":5397,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.741332+0000","last_change":"2024-09-12T02:23:16.861939+0000","last_active":"2024-09-12T02:40:04.741332+0000","last_peered":"2024-09-12T02:40:04.741332+0000","last_clean":"2024-09-12T02:40:04.741332+0000","last_became_active":"2024-09-12T02:23:16.861658+0000","last_became_peered":"2024-09-12T02:23:16.861658+0000","last_unstale":"2024-09-12T02:40:04.741332+0000","last_undegraded":"2024-09-12T02:40:04.741332+0000","last_fullsized":"2024-09-12T02:40:04.741332+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5374,"log_dups_size":0,"ondisk_log_size":5374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:06.755715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28055,"num_write_kb":329573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"28'4234","reported_seq":4266,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.777821+0000","last_change":"2024-09-12T02:23:04.777018+0000","last_active":"2024-09-12T02:39:57.777821+0000","last_peered":"2024-09-12T02:39:57.777821+0000","last_clean":"2024-09-12T02:39:57.777821+0000","last_became_active":"2024-09-12T02:23:04.776736+0000","last_became_peered":"2024-09-12T02:23:04.776736+0000","last_unstale":"2024-09-12T02:39:57.777821+0000","last_undegraded":"2024-09-12T02:39:57.777821+0000","last_fullsized":"2024-09-12T02:39:57.777821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4234,"log_dups_size":0,"ondisk_log_size":4234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:08.668990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21439,"num_write_kb":262018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"28'6314","reported_seq":6338,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.717796+0000","last_change":"2024-09-12T02:23:16.847615+0000","last_active":"2024-09-12T02:40:04.717796+0000","last_peered":"2024-09-12T02:40:04.717796+0000","last_clean":"2024-09-12T02:40:04.717796+0000","last_became_active":"2024-09-12T02:23:16.847260+0000","last_became_peered":"2024-09-12T02:23:16.847260+0000","last_unstale":"2024-09-12T02:40:04.717796+0000","last_undegraded":"2024-09-12T02:40:04.717796+0000","last_fullsized":"2024-09-12T02:40:04.717796+0000","mapping_epoch":24,"log_start":"28'500","ondisk_log_start":"28'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5814,"log_dups_size":0,"ondisk_log_size":5814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:48.920477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32869,"num_write_kb":377542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"28'4066","reported_seq":4097,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.768701+0000","last_change":"2024-09-12T02:23:04.789372+0000","last_active":"2024-09-12T02:39:57.768701+0000","last_peered":"2024-09-12T02:39:57.768701+0000","last_clean":"2024-09-12T02:39:57.768701+0000","last_became_active":"2024-09-12T02:23:04.789090+0000","last_became_peered":"2024-09-12T02:23:04.789090+0000","last_unstale":"2024-09-12T02:39:57.768701+0000","last_undegraded":"2024-09-12T02:39:57.768701+0000","last_fullsized":"2024-09-12T02:39:57.768701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4066,"log_dups_size":0,"ondisk_log_size":4066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:49.533491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20728,"num_write_kb":267380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"28'3925","reported_seq":3949,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.706991+0000","last_change":"2024-09-12T02:23:16.859000+0000","last_active":"2024-09-12T02:40:04.706991+0000","last_peered":"2024-09-12T02:40:04.706991+0000","last_clean":"2024-09-12T02:40:04.706991+0000","last_became_active":"2024-09-12T02:23:16.858637+0000","last_became_peered":"2024-09-12T02:23:16.858637+0000","last_unstale":"2024-09-12T02:40:04.706991+0000","last_undegraded":"2024-09-12T02:40:04.706991+0000","last_fullsized":"2024-09-12T02:40:04.706991+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":3925,"log_dups_size":0,"ondisk_log_size":3925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:47.915947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20092,"num_write_kb":256658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"28'5046","reported_seq":5077,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.720926+0000","last_change":"2024-09-12T02:23:04.776435+0000","last_active":"2024-09-12T02:39:57.720926+0000","last_peered":"2024-09-12T02:39:57.720926+0000","last_clean":"2024-09-12T02:39:57.720926+0000","last_became_active":"2024-09-12T02:23:04.776120+0000","last_became_peered":"2024-09-12T02:23:04.776120+0000","last_unstale":"2024-09-12T02:39:57.720926+0000","last_undegraded":"2024-09-12T02:39:57.720926+0000","last_fullsized":"2024-09-12T02:39:57.720926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5046,"log_dups_size":0,"ondisk_log_size":5046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:27.985094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26791,"num_write_kb":324401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"28'6719","reported_seq":6743,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.749518+0000","last_change":"2024-09-12T02:23:16.856477+0000","last_active":"2024-09-12T02:40:04.749518+0000","last_peered":"2024-09-12T02:40:04.749518+0000","last_clean":"2024-09-12T02:40:04.749518+0000","last_became_active":"2024-09-12T02:23:16.855839+0000","last_became_peered":"2024-09-12T02:23:16.855839+0000","last_unstale":"2024-09-12T02:40:04.749518+0000","last_undegraded":"2024-09-12T02:40:04.749518+0000","last_fullsized":"2024-09-12T02:40:04.749518+0000","mapping_epoch":24,"log_start":"28'900","ondisk_log_start":"28'900","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5819,"log_dups_size":0,"ondisk_log_size":5819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:42.510184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34627,"num_write_kb":392862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"28'4165","reported_seq":4196,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.847028+0000","last_change":"2024-09-12T02:23:04.788827+0000","last_active":"2024-09-12T02:39:57.847028+0000","last_peered":"2024-09-12T02:39:57.847028+0000","last_clean":"2024-09-12T02:39:57.847028+0000","last_became_active":"2024-09-12T02:23:04.788521+0000","last_became_peered":"2024-09-12T02:23:04.788521+0000","last_unstale":"2024-09-12T02:39:57.847028+0000","last_undegraded":"2024-09-12T02:39:57.847028+0000","last_fullsized":"2024-09-12T02:39:57.847028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4165,"log_dups_size":0,"ondisk_log_size":4165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:24.470245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21249,"num_write_kb":269852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"28'5811","reported_seq":5835,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.723792+0000","last_change":"2024-09-12T02:23:16.838421+0000","last_active":"2024-09-12T02:40:04.723792+0000","last_peered":"2024-09-12T02:40:04.723792+0000","last_clean":"2024-09-12T02:40:04.723792+0000","last_became_active":"2024-09-12T02:23:16.837606+0000","last_became_peered":"2024-09-12T02:23:16.837606+0000","last_unstale":"2024-09-12T02:40:04.723792+0000","last_undegraded":"2024-09-12T02:40:04.723792+0000","last_fullsized":"2024-09-12T02:40:04.723792+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5811,"log_dups_size":0,"ondisk_log_size":5811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:09.704007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30267,"num_write_kb":338418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"28'5427","reported_seq":5444,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.679950+0000","last_change":"2024-09-12T02:23:56.564278+0000","last_active":"2024-09-12T02:39:57.679950+0000","last_peered":"2024-09-12T02:39:57.679950+0000","last_clean":"2024-09-12T02:39:57.679950+0000","last_became_active":"2024-09-12T02:23:56.563943+0000","last_became_peered":"2024-09-12T02:23:56.563943+0000","last_unstale":"2024-09-12T02:39:57.679950+0000","last_undegraded":"2024-09-12T02:39:57.679950+0000","last_fullsized":"2024-09-12T02:39:57.679950+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5427,"log_dups_size":0,"ondisk_log_size":5427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:40.787770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27382,"num_write_kb":347330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"28'4215","reported_seq":4238,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.744076+0000","last_change":"2024-09-12T02:23:16.845296+0000","last_active":"2024-09-12T02:40:04.744076+0000","last_peered":"2024-09-12T02:40:04.744076+0000","last_clean":"2024-09-12T02:40:04.744076+0000","last_became_active":"2024-09-12T02:23:16.844939+0000","last_became_peered":"2024-09-12T02:23:16.844939+0000","last_unstale":"2024-09-12T02:40:04.744076+0000","last_undegraded":"2024-09-12T02:40:04.744076+0000","last_fullsized":"2024-09-12T02:40:04.744076+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4215,"log_dups_size":0,"ondisk_log_size":4215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:16.790822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21581,"num_write_kb":250408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'4161","reported_seq":4178,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.750998+0000","last_change":"2024-09-12T02:23:56.674421+0000","last_active":"2024-09-12T02:39:57.750998+0000","last_peered":"2024-09-12T02:39:57.750998+0000","last_clean":"2024-09-12T02:39:57.750998+0000","last_became_active":"2024-09-12T02:23:56.674143+0000","last_became_peered":"2024-09-12T02:23:56.674143+0000","last_unstale":"2024-09-12T02:39:57.750998+0000","last_undegraded":"2024-09-12T02:39:57.750998+0000","last_fullsized":"2024-09-12T02:39:57.750998+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4161,"log_dups_size":0,"ondisk_log_size":4161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:01.375384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21422,"num_write_kb":266111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2f","version":"28'6100","reported_seq":6123,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.684901+0000","last_change":"2024-09-12T02:23:16.849846+0000","last_active":"2024-09-12T02:40:04.684901+0000","last_peered":"2024-09-12T02:40:04.684901+0000","last_clean":"2024-09-12T02:40:04.684901+0000","last_became_active":"2024-09-12T02:23:16.849585+0000","last_became_peered":"2024-09-12T02:23:16.849585+0000","last_unstale":"2024-09-12T02:40:04.684901+0000","last_undegraded":"2024-09-12T02:40:04.684901+0000","last_fullsized":"2024-09-12T02:40:04.684901+0000","mapping_epoch":24,"log_start":"28'300","ondisk_log_start":"28'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5800,"log_dups_size":0,"ondisk_log_size":5800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:58.775679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30891,"num_write_kb":369602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"28'4576","reported_seq":4607,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.769180+0000","last_change":"2024-09-12T02:23:04.788624+0000","last_active":"2024-09-12T02:39:57.769180+0000","last_peered":"2024-09-12T02:39:57.769180+0000","last_clean":"2024-09-12T02:39:57.769180+0000","last_became_active":"2024-09-12T02:23:04.788352+0000","last_became_peered":"2024-09-12T02:23:04.788352+0000","last_unstale":"2024-09-12T02:39:57.769180+0000","last_undegraded":"2024-09-12T02:39:57.769180+0000","last_fullsized":"2024-09-12T02:39:57.769180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4576,"log_dups_size":0,"ondisk_log_size":4576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:13.961110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23775,"num_write_kb":295982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"28'5142","reported_seq":5165,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.686350+0000","last_change":"2024-09-12T02:23:16.850112+0000","last_active":"2024-09-12T02:40:04.686350+0000","last_peered":"2024-09-12T02:40:04.686350+0000","last_clean":"2024-09-12T02:40:04.686350+0000","last_became_active":"2024-09-12T02:23:16.849831+0000","last_became_peered":"2024-09-12T02:23:16.849831+0000","last_unstale":"2024-09-12T02:40:04.686350+0000","last_undegraded":"2024-09-12T02:40:04.686350+0000","last_fullsized":"2024-09-12T02:40:04.686350+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5142,"log_dups_size":0,"ondisk_log_size":5142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:42.625762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26862,"num_write_kb":308481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"28'4731","reported_seq":4762,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.835535+0000","last_change":"2024-09-12T02:23:04.785685+0000","last_active":"2024-09-12T02:39:57.835535+0000","last_peered":"2024-09-12T02:39:57.835535+0000","last_clean":"2024-09-12T02:39:57.835535+0000","last_became_active":"2024-09-12T02:23:04.784945+0000","last_became_peered":"2024-09-12T02:23:04.784945+0000","last_unstale":"2024-09-12T02:39:57.835535+0000","last_undegraded":"2024-09-12T02:39:57.835535+0000","last_fullsized":"2024-09-12T02:39:57.835535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4731,"log_dups_size":0,"ondisk_log_size":4731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:36.658436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24557,"num_write_kb":319695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"28'4794","reported_seq":4817,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.688321+0000","last_change":"2024-09-12T02:23:16.846108+0000","last_active":"2024-09-12T02:40:04.688321+0000","last_peered":"2024-09-12T02:40:04.688321+0000","last_clean":"2024-09-12T02:40:04.688321+0000","last_became_active":"2024-09-12T02:23:16.845793+0000","last_became_peered":"2024-09-12T02:23:16.845793+0000","last_unstale":"2024-09-12T02:40:04.688321+0000","last_undegraded":"2024-09-12T02:40:04.688321+0000","last_fullsized":"2024-09-12T02:40:04.688321+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4794,"log_dups_size":0,"ondisk_log_size":4794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:36.274858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23926,"num_write_kb":300628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"28'4561","reported_seq":4592,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.804691+0000","last_change":"2024-09-12T02:23:04.785849+0000","last_active":"2024-09-12T02:39:57.804691+0000","last_peered":"2024-09-12T02:39:57.804691+0000","last_clean":"2024-09-12T02:39:57.804691+0000","last_became_active":"2024-09-12T02:23:04.785511+0000","last_became_peered":"2024-09-12T02:23:04.785511+0000","last_unstale":"2024-09-12T02:39:57.804691+0000","last_undegraded":"2024-09-12T02:39:57.804691+0000","last_fullsized":"2024-09-12T02:39:57.804691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4561,"log_dups_size":0,"ondisk_log_size":4561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:28.670102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23484,"num_write_kb":303052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"28'5809","reported_seq":5832,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.701362+0000","last_change":"2024-09-12T02:23:16.855615+0000","last_active":"2024-09-12T02:40:04.701362+0000","last_peered":"2024-09-12T02:40:04.701362+0000","last_clean":"2024-09-12T02:40:04.701362+0000","last_became_active":"2024-09-12T02:23:16.855278+0000","last_became_peered":"2024-09-12T02:23:16.855278+0000","last_unstale":"2024-09-12T02:40:04.701362+0000","last_undegraded":"2024-09-12T02:40:04.701362+0000","last_fullsized":"2024-09-12T02:40:04.701362+0000","mapping_epoch":24,"log_start":"28'300","ondisk_log_start":"28'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5509,"log_dups_size":0,"ondisk_log_size":5509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:34.214175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30461,"num_write_kb":343399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"28'4620","reported_seq":4651,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.744548+0000","last_change":"2024-09-12T02:23:04.789575+0000","last_active":"2024-09-12T02:39:57.744548+0000","last_peered":"2024-09-12T02:39:57.744548+0000","last_clean":"2024-09-12T02:39:57.744548+0000","last_became_active":"2024-09-12T02:23:04.789296+0000","last_became_peered":"2024-09-12T02:23:04.789296+0000","last_unstale":"2024-09-12T02:39:57.744548+0000","last_undegraded":"2024-09-12T02:39:57.744548+0000","last_fullsized":"2024-09-12T02:39:57.744548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4620,"log_dups_size":0,"ondisk_log_size":4620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:13.166139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23568,"num_write_kb":295197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"28'5012","reported_seq":5035,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.717856+0000","last_change":"2024-09-12T02:23:16.858045+0000","last_active":"2024-09-12T02:40:04.717856+0000","last_peered":"2024-09-12T02:40:04.717856+0000","last_clean":"2024-09-12T02:40:04.717856+0000","last_became_active":"2024-09-12T02:23:16.857772+0000","last_became_peered":"2024-09-12T02:23:16.857772+0000","last_unstale":"2024-09-12T02:40:04.717856+0000","last_undegraded":"2024-09-12T02:40:04.717856+0000","last_fullsized":"2024-09-12T02:40:04.717856+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5012,"log_dups_size":0,"ondisk_log_size":5012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:35.598279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25770,"num_write_kb":312200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"28'4649","reported_seq":4680,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.749517+0000","last_change":"2024-09-12T02:23:04.777450+0000","last_active":"2024-09-12T02:39:57.749517+0000","last_peered":"2024-09-12T02:39:57.749517+0000","last_clean":"2024-09-12T02:39:57.749517+0000","last_became_active":"2024-09-12T02:23:04.776825+0000","last_became_peered":"2024-09-12T02:23:04.776825+0000","last_unstale":"2024-09-12T02:39:57.749517+0000","last_undegraded":"2024-09-12T02:39:57.749517+0000","last_fullsized":"2024-09-12T02:39:57.749517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4649,"log_dups_size":0,"ondisk_log_size":4649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:40.315075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22974,"num_write_kb":296824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"28'4733","reported_seq":4756,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.663806+0000","last_change":"2024-09-12T02:23:16.846032+0000","last_active":"2024-09-12T02:40:04.663806+0000","last_peered":"2024-09-12T02:40:04.663806+0000","last_clean":"2024-09-12T02:40:04.663806+0000","last_became_active":"2024-09-12T02:23:16.845492+0000","last_became_peered":"2024-09-12T02:23:16.845492+0000","last_unstale":"2024-09-12T02:40:04.663806+0000","last_undegraded":"2024-09-12T02:40:04.663806+0000","last_fullsized":"2024-09-12T02:40:04.663806+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4733,"log_dups_size":0,"ondisk_log_size":4733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:18.785798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24040,"num_write_kb":276615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"28'3733","reported_seq":3764,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.754418+0000","last_change":"2024-09-12T02:23:04.791378+0000","last_active":"2024-09-12T02:39:57.754418+0000","last_peered":"2024-09-12T02:39:57.754418+0000","last_clean":"2024-09-12T02:39:57.754418+0000","last_became_active":"2024-09-12T02:23:04.790926+0000","last_became_peered":"2024-09-12T02:23:04.790926+0000","last_unstale":"2024-09-12T02:39:57.754418+0000","last_undegraded":"2024-09-12T02:39:57.754418+0000","last_fullsized":"2024-09-12T02:39:57.754418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":3733,"log_dups_size":0,"ondisk_log_size":3733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:34.764210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18622,"num_write_kb":238300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"28'5122","reported_seq":5145,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.676752+0000","last_change":"2024-09-12T02:23:16.851099+0000","last_active":"2024-09-12T02:40:04.676752+0000","last_peered":"2024-09-12T02:40:04.676752+0000","last_clean":"2024-09-12T02:40:04.676752+0000","last_became_active":"2024-09-12T02:23:16.850747+0000","last_became_peered":"2024-09-12T02:23:16.850747+0000","last_unstale":"2024-09-12T02:40:04.676752+0000","last_undegraded":"2024-09-12T02:40:04.676752+0000","last_fullsized":"2024-09-12T02:40:04.676752+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5122,"log_dups_size":0,"ondisk_log_size":5122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:01:31.445590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26303,"num_write_kb":306134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"28'5815","reported_seq":5846,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.831090+0000","last_change":"2024-09-12T02:23:04.789439+0000","last_active":"2024-09-12T02:39:57.831090+0000","last_peered":"2024-09-12T02:39:57.831090+0000","last_clean":"2024-09-12T02:39:57.831090+0000","last_became_active":"2024-09-12T02:23:04.787421+0000","last_became_peered":"2024-09-12T02:23:04.787421+0000","last_unstale":"2024-09-12T02:39:57.831090+0000","last_undegraded":"2024-09-12T02:39:57.831090+0000","last_fullsized":"2024-09-12T02:39:57.831090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5815,"log_dups_size":0,"ondisk_log_size":5815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:44.295056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29660,"num_write_kb":364722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"28'5421","reported_seq":5444,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.710444+0000","last_change":"2024-09-12T02:23:16.850923+0000","last_active":"2024-09-12T02:40:04.710444+0000","last_peered":"2024-09-12T02:40:04.710444+0000","last_clean":"2024-09-12T02:40:04.710444+0000","last_became_active":"2024-09-12T02:23:16.850609+0000","last_became_peered":"2024-09-12T02:23:16.850609+0000","last_unstale":"2024-09-12T02:40:04.710444+0000","last_undegraded":"2024-09-12T02:40:04.710444+0000","last_fullsized":"2024-09-12T02:40:04.710444+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5421,"log_dups_size":0,"ondisk_log_size":5421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:52.110438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28803,"num_write_kb":344817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"28'4311","reported_seq":4342,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.771185+0000","last_change":"2024-09-12T02:23:04.790532+0000","last_active":"2024-09-12T02:39:57.771185+0000","last_peered":"2024-09-12T02:39:57.771185+0000","last_clean":"2024-09-12T02:39:57.771185+0000","last_became_active":"2024-09-12T02:23:04.789229+0000","last_became_peered":"2024-09-12T02:23:04.789229+0000","last_unstale":"2024-09-12T02:39:57.771185+0000","last_undegraded":"2024-09-12T02:39:57.771185+0000","last_fullsized":"2024-09-12T02:39:57.771185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4311,"log_dups_size":0,"ondisk_log_size":4311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:59.901665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22556,"num_write_kb":270677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"28'6535","reported_seq":6558,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.676494+0000","last_change":"2024-09-12T02:23:16.856612+0000","last_active":"2024-09-12T02:40:04.676494+0000","last_peered":"2024-09-12T02:40:04.676494+0000","last_clean":"2024-09-12T02:40:04.676494+0000","last_became_active":"2024-09-12T02:23:16.856290+0000","last_became_peered":"2024-09-12T02:23:16.856290+0000","last_unstale":"2024-09-12T02:40:04.676494+0000","last_undegraded":"2024-09-12T02:40:04.676494+0000","last_fullsized":"2024-09-12T02:40:04.676494+0000","mapping_epoch":24,"log_start":"28'1000","ondisk_log_start":"28'1000","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5535,"log_dups_size":0,"ondisk_log_size":5535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:14.846281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35147,"num_write_kb":386723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"28'4664","reported_seq":4695,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.756776+0000","last_change":"2024-09-12T02:23:04.782490+0000","last_active":"2024-09-12T02:39:57.756776+0000","last_peered":"2024-09-12T02:39:57.756776+0000","last_clean":"2024-09-12T02:39:57.756776+0000","last_became_active":"2024-09-12T02:23:04.782183+0000","last_became_peered":"2024-09-12T02:23:04.782183+0000","last_unstale":"2024-09-12T02:39:57.756776+0000","last_undegraded":"2024-09-12T02:39:57.756776+0000","last_fullsized":"2024-09-12T02:39:57.756776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4664,"log_dups_size":0,"ondisk_log_size":4664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:28.699880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23511,"num_write_kb":303118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"28'4146","reported_seq":4169,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.701595+0000","last_change":"2024-09-12T02:23:16.858100+0000","last_active":"2024-09-12T02:40:04.701595+0000","last_peered":"2024-09-12T02:40:04.701595+0000","last_clean":"2024-09-12T02:40:04.701595+0000","last_became_active":"2024-09-12T02:23:16.857818+0000","last_became_peered":"2024-09-12T02:23:16.857818+0000","last_unstale":"2024-09-12T02:40:04.701595+0000","last_undegraded":"2024-09-12T02:40:04.701595+0000","last_fullsized":"2024-09-12T02:40:04.701595+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4146,"log_dups_size":0,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:45.991170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21288,"num_write_kb":257331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"28'4600","reported_seq":4631,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.732332+0000","last_change":"2024-09-12T02:23:04.787140+0000","last_active":"2024-09-12T02:39:57.732332+0000","last_peered":"2024-09-12T02:39:57.732332+0000","last_clean":"2024-09-12T02:39:57.732332+0000","last_became_active":"2024-09-12T02:23:04.786799+0000","last_became_peered":"2024-09-12T02:23:04.786799+0000","last_unstale":"2024-09-12T02:39:57.732332+0000","last_undegraded":"2024-09-12T02:39:57.732332+0000","last_fullsized":"2024-09-12T02:39:57.732332+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4600,"log_dups_size":0,"ondisk_log_size":4600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:31.639605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23822,"num_write_kb":304357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"28'5170","reported_seq":5193,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.700674+0000","last_change":"2024-09-12T02:23:16.846100+0000","last_active":"2024-09-12T02:40:04.700674+0000","last_peered":"2024-09-12T02:40:04.700674+0000","last_clean":"2024-09-12T02:40:04.700674+0000","last_became_active":"2024-09-12T02:23:16.845749+0000","last_became_peered":"2024-09-12T02:23:16.845749+0000","last_unstale":"2024-09-12T02:40:04.700674+0000","last_undegraded":"2024-09-12T02:40:04.700674+0000","last_fullsized":"2024-09-12T02:40:04.700674+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5170,"log_dups_size":0,"ondisk_log_size":5170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:42.783366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26244,"num_write_kb":301879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"28'3980","reported_seq":4011,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.731214+0000","last_change":"2024-09-12T02:23:04.782128+0000","last_active":"2024-09-12T02:39:57.731214+0000","last_peered":"2024-09-12T02:39:57.731214+0000","last_clean":"2024-09-12T02:39:57.731214+0000","last_became_active":"2024-09-12T02:23:04.781101+0000","last_became_peered":"2024-09-12T02:23:04.781101+0000","last_unstale":"2024-09-12T02:39:57.731214+0000","last_undegraded":"2024-09-12T02:39:57.731214+0000","last_fullsized":"2024-09-12T02:39:57.731214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":3980,"log_dups_size":0,"ondisk_log_size":3980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:49.421147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20651,"num_write_kb":267035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"28'5235","reported_seq":5258,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.711216+0000","last_change":"2024-09-12T02:23:16.836968+0000","last_active":"2024-09-12T02:40:04.711216+0000","last_peered":"2024-09-12T02:40:04.711216+0000","last_clean":"2024-09-12T02:40:04.711216+0000","last_became_active":"2024-09-12T02:23:16.836561+0000","last_became_peered":"2024-09-12T02:23:16.836561+0000","last_unstale":"2024-09-12T02:40:04.711216+0000","last_undegraded":"2024-09-12T02:40:04.711216+0000","last_fullsized":"2024-09-12T02:40:04.711216+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5235,"log_dups_size":0,"ondisk_log_size":5235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:08.765569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26710,"num_write_kb":316033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"28'3967","reported_seq":3998,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.791291+0000","last_change":"2024-09-12T02:23:04.787034+0000","last_active":"2024-09-12T02:39:57.791291+0000","last_peered":"2024-09-12T02:39:57.791291+0000","last_clean":"2024-09-12T02:39:57.791291+0000","last_became_active":"2024-09-12T02:23:04.786044+0000","last_became_peered":"2024-09-12T02:23:04.786044+0000","last_unstale":"2024-09-12T02:39:57.791291+0000","last_undegraded":"2024-09-12T02:39:57.791291+0000","last_fullsized":"2024-09-12T02:39:57.791291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":3967,"log_dups_size":0,"ondisk_log_size":3967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:07.183028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20368,"num_write_kb":253735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"28'4409","reported_seq":4432,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.663587+0000","last_change":"2024-09-12T02:23:16.846114+0000","last_active":"2024-09-12T02:40:04.663587+0000","last_peered":"2024-09-12T02:40:04.663587+0000","last_clean":"2024-09-12T02:40:04.663587+0000","last_became_active":"2024-09-12T02:23:16.845757+0000","last_became_peered":"2024-09-12T02:23:16.845757+0000","last_unstale":"2024-09-12T02:40:04.663587+0000","last_undegraded":"2024-09-12T02:40:04.663587+0000","last_fullsized":"2024-09-12T02:40:04.663587+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4409,"log_dups_size":0,"ondisk_log_size":4409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:17:52.019813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22900,"num_write_kb":275935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"28'4251","reported_seq":4282,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.798750+0000","last_change":"2024-09-12T02:23:04.785662+0000","last_active":"2024-09-12T02:39:57.798750+0000","last_peered":"2024-09-12T02:39:57.798750+0000","last_clean":"2024-09-12T02:39:57.798750+0000","last_became_active":"2024-09-12T02:23:04.785375+0000","last_became_peered":"2024-09-12T02:23:04.785375+0000","last_unstale":"2024-09-12T02:39:57.798750+0000","last_undegraded":"2024-09-12T02:39:57.798750+0000","last_fullsized":"2024-09-12T02:39:57.798750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4251,"log_dups_size":0,"ondisk_log_size":4251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:44.295056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21731,"num_write_kb":283663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"28'4658","reported_seq":4681,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.746879+0000","last_change":"2024-09-12T02:23:16.858175+0000","last_active":"2024-09-12T02:40:04.746879+0000","last_peered":"2024-09-12T02:40:04.746879+0000","last_clean":"2024-09-12T02:40:04.746879+0000","last_became_active":"2024-09-12T02:23:16.857873+0000","last_became_peered":"2024-09-12T02:23:16.857873+0000","last_unstale":"2024-09-12T02:40:04.746879+0000","last_undegraded":"2024-09-12T02:40:04.746879+0000","last_fullsized":"2024-09-12T02:40:04.746879+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4658,"log_dups_size":0,"ondisk_log_size":4658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:54.535867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24616,"num_write_kb":279029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"28'5811","reported_seq":5842,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.850760+0000","last_change":"2024-09-12T02:23:04.791929+0000","last_active":"2024-09-12T02:39:57.850760+0000","last_peered":"2024-09-12T02:39:57.850760+0000","last_clean":"2024-09-12T02:39:57.850760+0000","last_became_active":"2024-09-12T02:23:04.791622+0000","last_became_peered":"2024-09-12T02:23:04.791622+0000","last_unstale":"2024-09-12T02:39:57.850760+0000","last_undegraded":"2024-09-12T02:39:57.850760+0000","last_fullsized":"2024-09-12T02:39:57.850760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5811,"log_dups_size":0,"ondisk_log_size":5811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:35.012685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30224,"num_write_kb":350457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"28'5106","reported_seq":5129,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.667862+0000","last_change":"2024-09-12T02:23:16.849985+0000","last_active":"2024-09-12T02:40:04.667862+0000","last_peered":"2024-09-12T02:40:04.667862+0000","last_clean":"2024-09-12T02:40:04.667862+0000","last_became_active":"2024-09-12T02:23:16.849641+0000","last_became_peered":"2024-09-12T02:23:16.849641+0000","last_unstale":"2024-09-12T02:40:04.667862+0000","last_undegraded":"2024-09-12T02:40:04.667862+0000","last_fullsized":"2024-09-12T02:40:04.667862+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5106,"log_dups_size":0,"ondisk_log_size":5106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:28.373543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25610,"num_write_kb":311590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"28'5712","reported_seq":5748,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.829068+0000","last_change":"2024-09-12T02:23:56.084447+0000","last_active":"2024-09-12T02:39:57.829068+0000","last_peered":"2024-09-12T02:39:57.829068+0000","last_clean":"2024-09-12T02:39:57.829068+0000","last_became_active":"2024-09-12T02:23:56.084173+0000","last_became_peered":"2024-09-12T02:23:56.084173+0000","last_unstale":"2024-09-12T02:39:57.829068+0000","last_undegraded":"2024-09-12T02:39:57.829068+0000","last_fullsized":"2024-09-12T02:39:57.829068+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5712,"log_dups_size":0,"ondisk_log_size":5712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:38.004804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30266,"num_write_kb":367055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"28'6924","reported_seq":6948,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.724208+0000","last_change":"2024-09-12T02:23:16.840250+0000","last_active":"2024-09-12T02:40:04.724208+0000","last_peered":"2024-09-12T02:40:04.724208+0000","last_clean":"2024-09-12T02:40:04.724208+0000","last_became_active":"2024-09-12T02:23:16.839914+0000","last_became_peered":"2024-09-12T02:23:16.839914+0000","last_unstale":"2024-09-12T02:40:04.724208+0000","last_undegraded":"2024-09-12T02:40:04.724208+0000","last_fullsized":"2024-09-12T02:40:04.724208+0000","mapping_epoch":24,"log_start":"28'1700","ondisk_log_start":"28'1700","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5224,"log_dups_size":0,"ondisk_log_size":5224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:04.798197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36307,"num_write_kb":403764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"28'4960","reported_seq":4990,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.771890+0000","last_change":"2024-09-12T02:23:04.779648+0000","last_active":"2024-09-12T02:39:57.771890+0000","last_peered":"2024-09-12T02:39:57.771890+0000","last_clean":"2024-09-12T02:39:57.771890+0000","last_became_active":"2024-09-12T02:23:04.779384+0000","last_became_peered":"2024-09-12T02:23:04.779384+0000","last_unstale":"2024-09-12T02:39:57.771890+0000","last_undegraded":"2024-09-12T02:39:57.771890+0000","last_fullsized":"2024-09-12T02:39:57.771890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4960,"log_dups_size":0,"ondisk_log_size":4960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:41.491471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24704,"num_write_kb":320180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"28'4652","reported_seq":4676,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.706923+0000","last_change":"2024-09-12T02:23:16.850060+0000","last_active":"2024-09-12T02:40:04.706923+0000","last_peered":"2024-09-12T02:40:04.706923+0000","last_clean":"2024-09-12T02:40:04.706923+0000","last_became_active":"2024-09-12T02:23:16.849744+0000","last_became_peered":"2024-09-12T02:23:16.849744+0000","last_unstale":"2024-09-12T02:40:04.706923+0000","last_undegraded":"2024-09-12T02:40:04.706923+0000","last_fullsized":"2024-09-12T02:40:04.706923+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4652,"log_dups_size":0,"ondisk_log_size":4652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:34.130685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24125,"num_write_kb":272841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"28'4717","reported_seq":4733,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.732879+0000","last_change":"2024-09-12T02:23:55.991674+0000","last_active":"2024-09-12T02:39:57.732879+0000","last_peered":"2024-09-12T02:39:57.732879+0000","last_clean":"2024-09-12T02:39:57.732879+0000","last_became_active":"2024-09-12T02:23:55.991300+0000","last_became_peered":"2024-09-12T02:23:55.991300+0000","last_unstale":"2024-09-12T02:39:57.732879+0000","last_undegraded":"2024-09-12T02:39:57.732879+0000","last_fullsized":"2024-09-12T02:39:57.732879+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4717,"log_dups_size":0,"ondisk_log_size":4717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:23.613509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24759,"num_write_kb":295935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3c","version":"28'4790","reported_seq":4814,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.669505+0000","last_change":"2024-09-12T02:23:16.862034+0000","last_active":"2024-09-12T02:40:04.669505+0000","last_peered":"2024-09-12T02:40:04.669505+0000","last_clean":"2024-09-12T02:40:04.669505+0000","last_became_active":"2024-09-12T02:23:16.861441+0000","last_became_peered":"2024-09-12T02:23:16.861441+0000","last_unstale":"2024-09-12T02:40:04.669505+0000","last_undegraded":"2024-09-12T02:40:04.669505+0000","last_fullsized":"2024-09-12T02:40:04.669505+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4790,"log_dups_size":0,"ondisk_log_size":4790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:24.332614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25639,"num_write_kb":287197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"28'4345","reported_seq":4375,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.826467+0000","last_change":"2024-09-12T02:23:04.788890+0000","last_active":"2024-09-12T02:39:57.826467+0000","last_peered":"2024-09-12T02:39:57.826467+0000","last_clean":"2024-09-12T02:39:57.826467+0000","last_became_active":"2024-09-12T02:23:04.788617+0000","last_became_peered":"2024-09-12T02:23:04.788617+0000","last_unstale":"2024-09-12T02:39:57.826467+0000","last_undegraded":"2024-09-12T02:39:57.826467+0000","last_fullsized":"2024-09-12T02:39:57.826467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4345,"log_dups_size":0,"ondisk_log_size":4345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:24.194151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22438,"num_write_kb":266069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"28'5149","reported_seq":5173,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.705526+0000","last_change":"2024-09-12T02:23:16.855853+0000","last_active":"2024-09-12T02:40:04.705526+0000","last_peered":"2024-09-12T02:40:04.705526+0000","last_clean":"2024-09-12T02:40:04.705526+0000","last_became_active":"2024-09-12T02:23:16.855437+0000","last_became_peered":"2024-09-12T02:23:16.855437+0000","last_unstale":"2024-09-12T02:40:04.705526+0000","last_undegraded":"2024-09-12T02:40:04.705526+0000","last_fullsized":"2024-09-12T02:40:04.705526+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5149,"log_dups_size":0,"ondisk_log_size":5149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:27.557862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26098,"num_write_kb":313495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'5428","reported_seq":5458,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.753841+0000","last_change":"2024-09-12T02:23:04.777165+0000","last_active":"2024-09-12T02:39:57.753841+0000","last_peered":"2024-09-12T02:39:57.753841+0000","last_clean":"2024-09-12T02:39:57.753841+0000","last_became_active":"2024-09-12T02:23:04.776857+0000","last_became_peered":"2024-09-12T02:23:04.776857+0000","last_unstale":"2024-09-12T02:39:57.753841+0000","last_undegraded":"2024-09-12T02:39:57.753841+0000","last_fullsized":"2024-09-12T02:39:57.753841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5428,"log_dups_size":0,"ondisk_log_size":5428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:28.309591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27088,"num_write_kb":350175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"28'4355","reported_seq":4377,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.719330+0000","last_change":"2024-09-12T02:23:16.849235+0000","last_active":"2024-09-12T02:40:04.719330+0000","last_peered":"2024-09-12T02:40:04.719330+0000","last_clean":"2024-09-12T02:40:04.719330+0000","last_became_active":"2024-09-12T02:23:16.848936+0000","last_became_peered":"2024-09-12T02:23:16.848936+0000","last_unstale":"2024-09-12T02:40:04.719330+0000","last_undegraded":"2024-09-12T02:40:04.719330+0000","last_fullsized":"2024-09-12T02:40:04.719330+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4355,"log_dups_size":0,"ondisk_log_size":4355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:32.415375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22650,"num_write_kb":266857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"28'3929","reported_seq":3961,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.823217+0000","last_change":"2024-09-12T02:23:04.786772+0000","last_active":"2024-09-12T02:39:57.823217+0000","last_peered":"2024-09-12T02:39:57.823217+0000","last_clean":"2024-09-12T02:39:57.823217+0000","last_became_active":"2024-09-12T02:23:04.786509+0000","last_became_peered":"2024-09-12T02:23:04.786509+0000","last_unstale":"2024-09-12T02:39:57.823217+0000","last_undegraded":"2024-09-12T02:39:57.823217+0000","last_fullsized":"2024-09-12T02:39:57.823217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":3929,"log_dups_size":0,"ondisk_log_size":3929,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:01.755827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20681,"num_write_kb":267297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"28'6034","reported_seq":6056,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.676402+0000","last_change":"2024-09-12T02:23:16.834788+0000","last_active":"2024-09-12T02:40:04.676402+0000","last_peered":"2024-09-12T02:40:04.676402+0000","last_clean":"2024-09-12T02:40:04.676402+0000","last_became_active":"2024-09-12T02:23:16.834483+0000","last_became_peered":"2024-09-12T02:23:16.834483+0000","last_unstale":"2024-09-12T02:40:04.676402+0000","last_undegraded":"2024-09-12T02:40:04.676402+0000","last_fullsized":"2024-09-12T02:40:04.676402+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":6034,"log_dups_size":0,"ondisk_log_size":6034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:23.441282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30335,"num_write_kb":363259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"28'4664","reported_seq":4696,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.730630+0000","last_change":"2024-09-12T02:23:04.778772+0000","last_active":"2024-09-12T02:39:57.730630+0000","last_peered":"2024-09-12T02:39:57.730630+0000","last_clean":"2024-09-12T02:39:57.730630+0000","last_became_active":"2024-09-12T02:23:04.778445+0000","last_became_peered":"2024-09-12T02:23:04.778445+0000","last_unstale":"2024-09-12T02:39:57.730630+0000","last_undegraded":"2024-09-12T02:39:57.730630+0000","last_fullsized":"2024-09-12T02:39:57.730630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4664,"log_dups_size":0,"ondisk_log_size":4664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:58.292023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23827,"num_write_kb":304439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"28'5564","reported_seq":5586,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.750707+0000","last_change":"2024-09-12T02:23:16.844170+0000","last_active":"2024-09-12T02:40:04.750707+0000","last_peered":"2024-09-12T02:40:04.750707+0000","last_clean":"2024-09-12T02:40:04.750707+0000","last_became_active":"2024-09-12T02:23:16.843880+0000","last_became_peered":"2024-09-12T02:23:16.843880+0000","last_unstale":"2024-09-12T02:40:04.750707+0000","last_undegraded":"2024-09-12T02:40:04.750707+0000","last_fullsized":"2024-09-12T02:40:04.750707+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5564,"log_dups_size":0,"ondisk_log_size":5564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:59.283416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28051,"num_write_kb":333672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"28'5549","reported_seq":5581,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.720949+0000","last_change":"2024-09-12T02:23:04.785821+0000","last_active":"2024-09-12T02:39:57.720949+0000","last_peered":"2024-09-12T02:39:57.720949+0000","last_clean":"2024-09-12T02:39:57.720949+0000","last_became_active":"2024-09-12T02:23:04.785516+0000","last_became_peered":"2024-09-12T02:23:04.785516+0000","last_unstale":"2024-09-12T02:39:57.720949+0000","last_undegraded":"2024-09-12T02:39:57.720949+0000","last_fullsized":"2024-09-12T02:39:57.720949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5549,"log_dups_size":0,"ondisk_log_size":5549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:42.400040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28712,"num_write_kb":373148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"28'5101","reported_seq":5123,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.723690+0000","last_change":"2024-09-12T02:23:16.844145+0000","last_active":"2024-09-12T02:40:04.723690+0000","last_peered":"2024-09-12T02:40:04.723690+0000","last_clean":"2024-09-12T02:40:04.723690+0000","last_became_active":"2024-09-12T02:23:16.843815+0000","last_became_peered":"2024-09-12T02:23:16.843815+0000","last_unstale":"2024-09-12T02:40:04.723690+0000","last_undegraded":"2024-09-12T02:40:04.723690+0000","last_fullsized":"2024-09-12T02:40:04.723690+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5101,"log_dups_size":0,"ondisk_log_size":5101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:31.789317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26856,"num_write_kb":304403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"28'3999","reported_seq":4031,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.797803+0000","last_change":"2024-09-12T02:23:04.791204+0000","last_active":"2024-09-12T02:39:57.797803+0000","last_peered":"2024-09-12T02:39:57.797803+0000","last_clean":"2024-09-12T02:39:57.797803+0000","last_became_active":"2024-09-12T02:23:04.790906+0000","last_became_peered":"2024-09-12T02:23:04.790906+0000","last_unstale":"2024-09-12T02:39:57.797803+0000","last_undegraded":"2024-09-12T02:39:57.797803+0000","last_fullsized":"2024-09-12T02:39:57.797803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":3999,"log_dups_size":0,"ondisk_log_size":3999,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:16.336873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20671,"num_write_kb":258921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1731204,"num_write_kb":20050774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":327719,"ondisk_log_size":327719,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":18273247,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":57,"num_read_kb":123,"num_write":4416,"num_write_kb":19551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36610048,"data_stored":36546494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3634,"ondisk_log_size":3634,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1541207,"num_write_kb":19284974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":299497,"ondisk_log_size":299497,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":18199792,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":62,"num_read_kb":127,"num_write":4449,"num_write_kb":19478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36462592,"data_stored":36399584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3678,"ondisk_log_size":3678,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476948,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1212344,"kb_used_data":13160,"kb_used_omap":1,"kb_used_meta":1199166,"kb_avail":93159496,"statfs":{"total":96636764160,"available":95395323904,"internally_reserved":0,"allocated":13475840,"data_stored":13292277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":1227946442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476950,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":757460,"kb_used_data":9796,"kb_used_omap":1,"kb_used_meta":747646,"kb_avail":93614380,"statfs":{"total":96636764160,"available":95861125120,"internally_reserved":0,"allocated":10031104,"data_stored":9841247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":765589958},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476949,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1147152,"kb_used_data":4480,"kb_used_omap":1,"kb_used_meta":1142654,"kb_avail":93224688,"statfs":{"total":96636764160,"available":95462080512,"internally_reserved":0,"allocated":4587520,"data_stored":4401471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1170078149},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509651,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1232784,"kb_used_data":11264,"kb_used_omap":1,"kb_used_meta":1221502,"kb_avail":93139056,"statfs":{"total":96636764160,"available":95374393344,"internally_reserved":0,"allocated":11534336,"data_stored":11334750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1250818501},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509650,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":757512,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":757118,"kb_avail":93614328,"statfs":{"total":96636764160,"available":95861071872,"internally_reserved":0,"allocated":385024,"data_stored":206475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":775289285},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509653,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1005564,"kb_used_data":9068,"kb_used_omap":1,"kb_used_meta":996478,"kb_avail":93366276,"statfs":{"total":96636764160,"available":95607066624,"internally_reserved":0,"allocated":9285632,"data_stored":9097939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1020393925},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542356,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1235704,"kb_used_data":18152,"kb_used_omap":1,"kb_used_meta":1217534,"kb_avail":93136136,"statfs":{"total":96636764160,"available":95371403264,"internally_reserved":0,"allocated":18587648,"data_stored":18391468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":1246755271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542355,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1000768,"kb_used_data":8496,"kb_used_omap":1,"kb_used_meta":992254,"kb_avail":93371072,"statfs":{"total":96636764160,"available":95611977728,"internally_reserved":0,"allocated":8699904,"data_stored":8507787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1016068549},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4206592,"data_stored":4194942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":88080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8486912,"data_stored":8477360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5541888,"data_stored":5527456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5537792,"data_stored":5528002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12583494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9809920,"data_stored":9795783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5701632,"data_stored":5688969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4292608,"data_stored":4283056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:40:17.433 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.433 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-09-12T02:23:02.739281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.433 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.433 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T02:23:14.800611+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.433 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.434 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-09-12T02:23:02.739281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.434 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.434 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T02:23:14.800611+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.434 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.434 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-09-12T02:23:02.739281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.434 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.434 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T02:23:14.800611+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.434 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.434 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-09-12T02:23:02.739281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.435 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.435 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T02:23:14.800611+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.435 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.435 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.435 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-09-12T02:23:02.739281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.435 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T02:23:14.800611+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.435 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.435 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.435 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-09-12T02:23:02.739281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.435 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-12T02:23:14.800611+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.436 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.436 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.436 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-09-12T02:23:02.739281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.436 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-12T02:23:14.800611+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.436 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.436 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.436 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-09-12T02:23:02.739281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.436 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T02:23:14.800611+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.436 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.437 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.437 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-12T02:23:02.739281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.437 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-12T02:23:14.800611+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.437 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.437 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.437 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-12T02:23:02.739281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.437 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T02:23:14.800611+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.437 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.437 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.437 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T02:23:02.739281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.438 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-12T02:23:14.800611+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.438 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.438 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.438 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-12T02:23:02.739281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.438 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-12T02:23:14.800611+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.438 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.438 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.438 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-12T02:23:02.739281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.438 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-12T02:23:14.800611+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.439 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.439 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.439 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-12T02:23:02.739281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.439 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T02:23:14.800611+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.439 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.439 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.439 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-12T02:23:02.739281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.439 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T02:23:14.800611+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.439 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.439 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.440 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T02:23:02.739281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.440 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T02:22:52.457979+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=22, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.440 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T02:23:14.800611+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.440 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.440 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.440 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-09-12T02:23:02.739281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.440 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-12T02:23:14.800611+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.440 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.441 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.441 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-09-12T02:23:02.739281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.441 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T02:23:14.800611+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.441 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.441 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.441 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-09-12T02:23:02.739281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.441 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T02:23:14.800611+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.441 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.441 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.442 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-09-12T02:23:02.739281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.442 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-12T02:23:14.800611+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.442 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.442 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.442 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-09-12T02:23:02.739281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.442 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T02:23:14.800611+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.442 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.442 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.442 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-09-12T02:23:02.739281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.442 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T02:23:14.800611+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.443 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.443 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.443 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-09-12T02:23:02.739281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.443 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T02:23:14.800611+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.443 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.443 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.443 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-09-12T02:23:02.739281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.443 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T02:23:14.800611+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.443 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.443 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.444 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-09-12T02:23:02.739281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.444 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T02:23:14.800611+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.444 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.444 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.444 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-09-12T02:23:02.739281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.444 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T02:23:14.800611+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.444 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.444 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.444 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-09-12T02:23:02.739281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.445 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T02:23:14.800611+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.445 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.445 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.445 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-09-12T02:23:02.739281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.445 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T02:23:14.800611+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.445 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.445 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T02:23:14.800611+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.445 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.445 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-09-12T02:23:02.739281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.446 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.446 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T02:23:14.800611+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.446 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.446 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-09-12T02:23:02.739281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.446 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.446 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-09-12T02:23:02.739281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.446 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.446 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T02:23:14.800611+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.446 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.447 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-09-12T02:23:02.739281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.447 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.447 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T02:23:14.800611+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=14, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.447 INFO:tasks.ceph:pgid 5.26 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.447 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.447 INFO:tasks.ceph:pgid 5.27 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.447 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.447 INFO:tasks.ceph:pgid 5.24 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.447 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.447 INFO:tasks.ceph:pgid 5.25 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.448 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.448 INFO:tasks.ceph:pgid 5.22 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.448 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.448 INFO:tasks.ceph:pgid 5.23 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.448 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.448 INFO:tasks.ceph:pgid 5.20 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.448 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.448 INFO:tasks.ceph:pgid 5.21 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.449 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.449 INFO:tasks.ceph:pgid 5.2e last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.449 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.449 INFO:tasks.ceph:pgid 5.2f last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.449 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.449 INFO:tasks.ceph:pgid 5.2c last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.449 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.449 INFO:tasks.ceph:pgid 5.2d last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.449 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.450 INFO:tasks.ceph:pgid 5.2a last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.450 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.450 INFO:tasks.ceph:pgid 5.2b last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.450 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.450 INFO:tasks.ceph:pgid 5.28 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.450 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.450 INFO:tasks.ceph:pgid 5.29 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.450 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.450 INFO:tasks.ceph:pgid 5.36 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.451 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.451 INFO:tasks.ceph:pgid 5.37 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.451 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.451 INFO:tasks.ceph:pgid 5.34 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.451 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.451 INFO:tasks.ceph:pgid 5.35 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.451 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.451 INFO:tasks.ceph:pgid 5.32 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.451 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.451 INFO:tasks.ceph:pgid 5.33 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.452 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.452 INFO:tasks.ceph:pgid 5.30 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.452 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.452 INFO:tasks.ceph:pgid 5.31 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.452 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.452 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.452 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.452 INFO:tasks.ceph:pgid 5.3f last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.452 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.453 INFO:tasks.ceph:pgid 5.3c last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.453 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.453 INFO:tasks.ceph:pgid 5.3d last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.453 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.453 INFO:tasks.ceph:pgid 5.3a last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.453 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.453 INFO:tasks.ceph:pgid 5.3b last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.453 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.454 INFO:tasks.ceph:pgid 5.38 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.454 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.454 INFO:tasks.ceph:pgid 5.39 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.454 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:17.454 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T02:40:33.153 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:40:33.157 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:40:37.455 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:40:37.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.571+0000 7fca5ed86640 1 Processor -- start 2024-09-12T02:40:37.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.571+0000 7fca5ed86640 1 -- start start 2024-09-12T02:40:37.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.572+0000 7fca5ed86640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fca5806c650 0x7fca580c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:37.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.572+0000 7fca5ed86640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fca580ca1c0 0x7fca58160bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:37.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.572+0000 7fca5ed86640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca5815a7c0 con 0x7fca58150480 2024-09-12T02:40:37.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.572+0000 7fca5ed86640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fca5806c240 con 0x7fca580ca1c0 2024-09-12T02:40:37.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.572+0000 7fca5ed86640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fca5815a330 con 0x7fca5806c650 2024-09-12T02:40:37.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.573+0000 7fca5d323640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fca580ca1c0 0x7fca58160bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:37.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.573+0000 7fca5d323640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fca580ca1c0 0x7fca58160bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38702/0 (socket says 172.21.15.60:38702) 2024-09-12T02:40:37.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.573+0000 7fca5d323640 1 -- 172.21.15.60:0/4211575877 learned_addr learned my addr 172.21.15.60:0/4211575877 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:37.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.573+0000 7fca57fff640 1 --2- 172.21.15.60:0/4211575877 >> v2:172.21.15.105:3300/0 conn(0x7fca5806c650 0x7fca580c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:37.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.573+0000 7fca5d323640 1 -- 172.21.15.60:0/4211575877 >> v2:172.21.15.105:3300/0 conn(0x7fca5806c650 msgr2=0x7fca580c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:37.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.573+0000 7fca5d323640 1 --2- 172.21.15.60:0/4211575877 >> v2:172.21.15.105:3300/0 conn(0x7fca5806c650 0x7fca580c9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:37.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.573+0000 7fca5d323640 1 -- 172.21.15.60:0/4211575877 >> v1:172.21.15.105:6789/0 conn(0x7fca58150480 legacy=0x7fca580c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:37.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.573+0000 7fca5d323640 1 -- 172.21.15.60:0/4211575877 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca58159a00 con 0x7fca580ca1c0 2024-09-12T02:40:37.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.574+0000 7fca5d323640 1 --2- 172.21.15.60:0/4211575877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca580ca1c0 0x7fca58160bf0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fca580c6110 tx=0x7fca4802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2871a505d87e326 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:37.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.574+0000 7fca577fe640 1 -- 172.21.15.60:0/4211575877 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca48037070 con 0x7fca580ca1c0 2024-09-12T02:40:37.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.574+0000 7fca577fe640 1 -- 172.21.15.60:0/4211575877 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca48032440 con 0x7fca580ca1c0 2024-09-12T02:40:37.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.574+0000 7fca577fe640 1 -- 172.21.15.60:0/4211575877 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca48032810 con 0x7fca580ca1c0 2024-09-12T02:40:37.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.574+0000 7fca5ed86640 1 -- 172.21.15.60:0/4211575877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca580ca1c0 msgr2=0x7fca58160bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:37.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.574+0000 7fca5ed86640 1 --2- 172.21.15.60:0/4211575877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca580ca1c0 0x7fca58160bf0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fca580c6110 tx=0x7fca4802a270 comp rx=0 tx=0).stop 2024-09-12T02:40:37.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.574+0000 7fca5ed86640 1 -- 172.21.15.60:0/4211575877 shutdown_connections 2024-09-12T02:40:37.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.574+0000 7fca5ed86640 1 --2- 172.21.15.60:0/4211575877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca580ca1c0 0x7fca58160bf0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:37.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.574+0000 7fca5ed86640 1 --2- 172.21.15.60:0/4211575877 >> v2:172.21.15.105:3300/0 conn(0x7fca5806c650 0x7fca580c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:37.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.574+0000 7fca5ed86640 1 -- 172.21.15.60:0/4211575877 >> 172.21.15.60:0/4211575877 conn(0x7fca58068030 msgr2=0x7fca58073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:37.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.575+0000 7fca5ed86640 1 -- 172.21.15.60:0/4211575877 shutdown_connections 2024-09-12T02:40:37.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.575+0000 7fca5ed86640 1 -- 172.21.15.60:0/4211575877 wait complete. 2024-09-12T02:40:37.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.576+0000 7fca5ed86640 1 Processor -- start 2024-09-12T02:40:37.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.576+0000 7fca5ed86640 1 -- start start 2024-09-12T02:40:37.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.577+0000 7fca5ed86640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca5806c650 0x7fca5814f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:37.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.577+0000 7fca5ed86640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca580ca1c0 0x7fca58159250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:37.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.577+0000 7fca5ed86640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca58150480 0x7fca58151b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:37.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.577+0000 7fca5ed86640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fca5806d270 con 0x7fca5806c650 2024-09-12T02:40:37.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.577+0000 7fca5ed86640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fca58159fc0 con 0x7fca58150480 2024-09-12T02:40:37.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.577+0000 7fca5ed86640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fca580ca5f0 con 0x7fca580ca1c0 2024-09-12T02:40:37.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.577+0000 7fca5cb22640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca5806c650 0x7fca5814f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:37.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.577+0000 7fca5cb22640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca5806c650 0x7fca5814f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38710/0 (socket says 172.21.15.60:38710) 2024-09-12T02:40:37.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.577+0000 7fca5cb22640 1 -- 172.21.15.60:0/381728298 learned_addr learned my addr 172.21.15.60:0/381728298 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:37.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.577+0000 7fca57fff640 1 --2- 172.21.15.60:0/381728298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca580ca1c0 0x7fca58159250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:37.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.577+0000 7fca5d323640 1 --2- 172.21.15.60:0/381728298 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca58150480 0x7fca58151b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:37.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.577+0000 7fca5cb22640 1 -- 172.21.15.60:0/381728298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca580ca1c0 msgr2=0x7fca58159250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:37.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.577+0000 7fca5cb22640 1 --2- 172.21.15.60:0/381728298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca580ca1c0 0x7fca58159250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:37.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.577+0000 7fca5cb22640 1 -- 172.21.15.60:0/381728298 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca58150480 msgr2=0x7fca58151b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:37.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.577+0000 7fca5cb22640 1 --2- 172.21.15.60:0/381728298 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca58150480 0x7fca58151b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:37.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.577+0000 7fca5cb22640 1 -- 172.21.15.60:0/381728298 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca58152b90 con 0x7fca5806c650 2024-09-12T02:40:37.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.577+0000 7fca57fff640 1 --2- 172.21.15.60:0/381728298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca580ca1c0 0x7fca58159250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:40:37.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.577+0000 7fca5cb22640 1 --2- 172.21.15.60:0/381728298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca5806c650 0x7fca5814f750 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fca5000c790 tx=0x7fca5000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:37.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.577+0000 7fca557fa640 1 -- 172.21.15.60:0/381728298 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca50016020 con 0x7fca5806c650 2024-09-12T02:40:37.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.577+0000 7fca557fa640 1 -- 172.21.15.60:0/381728298 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca50006d50 con 0x7fca5806c650 2024-09-12T02:40:37.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.577+0000 7fca5ed86640 1 -- 172.21.15.60:0/381728298 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca58152e70 con 0x7fca5806c650 2024-09-12T02:40:37.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.578+0000 7fca557fa640 1 -- 172.21.15.60:0/381728298 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca50003bb0 con 0x7fca5806c650 2024-09-12T02:40:37.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.578+0000 7fca5ed86640 1 -- 172.21.15.60:0/381728298 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca58153430 con 0x7fca5806c650 2024-09-12T02:40:37.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.579+0000 7fca5ed86640 1 -- 172.21.15.60:0/381728298 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca58156270 con 0x7fca5806c650 2024-09-12T02:40:37.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.579+0000 7fca557fa640 1 -- 172.21.15.60:0/381728298 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fca5000a850 con 0x7fca5806c650 2024-09-12T02:40:37.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.580+0000 7fca557fa640 1 --2- 172.21.15.60:0/381728298 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fca4406be30 0x7fca4406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:37.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.580+0000 7fca57fff640 1 --2- 172.21.15.60:0/381728298 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fca4406be30 0x7fca4406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:37.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.580+0000 7fca557fa640 1 -- 172.21.15.60:0/381728298 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fca5008aef0 con 0x7fca5806c650 2024-09-12T02:40:37.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.580+0000 7fca57fff640 1 --2- 172.21.15.60:0/381728298 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fca4406be30 0x7fca4406e2f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fca580b0eb0 tx=0x7fca4c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:37.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.584+0000 7fca557fa640 1 -- 172.21.15.60:0/381728298 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fca50020020 con 0x7fca5806c650 2024-09-12T02:40:37.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.758+0000 7fca5ed86640 1 -- 172.21.15.60:0/381728298 --> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fca58073830 con 0x7fca4406be30 2024-09-12T02:40:37.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.770+0000 7fca557fa640 1 -- 172.21.15.60:0/381728298 <== mgr.4098 v2:172.21.15.60:6800/3549430091 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+492842 (secure 0 0 0) 0x7fca58073830 con 0x7fca4406be30 2024-09-12T02:40:37.776 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:40:37.779 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T02:40:37.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.774+0000 7fca5ed86640 1 -- 172.21.15.60:0/381728298 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fca4406be30 msgr2=0x7fca4406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:37.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.774+0000 7fca5ed86640 1 --2- 172.21.15.60:0/381728298 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fca4406be30 0x7fca4406e2f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fca580b0eb0 tx=0x7fca4c008040 comp rx=0 tx=0).stop 2024-09-12T02:40:37.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.774+0000 7fca5ed86640 1 -- 172.21.15.60:0/381728298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca5806c650 msgr2=0x7fca5814f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:37.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.774+0000 7fca5ed86640 1 --2- 172.21.15.60:0/381728298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca5806c650 0x7fca5814f750 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fca5000c790 tx=0x7fca5000cc50 comp rx=0 tx=0).stop 2024-09-12T02:40:37.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.774+0000 7fca5ed86640 1 -- 172.21.15.60:0/381728298 shutdown_connections 2024-09-12T02:40:37.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.774+0000 7fca5ed86640 1 --2- 172.21.15.60:0/381728298 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fca4406be30 0x7fca4406e2f0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:37.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.774+0000 7fca5ed86640 1 --2- 172.21.15.60:0/381728298 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca58150480 0x7fca58151b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:37.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.774+0000 7fca5ed86640 1 --2- 172.21.15.60:0/381728298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca580ca1c0 0x7fca58159250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:37.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.774+0000 7fca5ed86640 1 --2- 172.21.15.60:0/381728298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca5806c650 0x7fca5814f750 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:37.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.774+0000 7fca5ed86640 1 -- 172.21.15.60:0/381728298 >> 172.21.15.60:0/381728298 conn(0x7fca58068030 msgr2=0x7fca580cb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:37.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.774+0000 7fca5ed86640 1 -- 172.21.15.60:0/381728298 shutdown_connections 2024-09-12T02:40:37.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:37.774+0000 7fca5ed86640 1 -- 172.21.15.60:0/381728298 wait complete. 2024-09-12T02:40:37.786 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":553,"stamp":"2024-09-12T02:40:36.408224+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":37063407,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":235,"num_read_kb":350,"num_write":3281435,"num_write_kb":39377193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":634696,"ondisk_log_size":634696,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8353448,"kb_used_data":74792,"kb_used_omap":12,"kb_used_meta":8278515,"kb_avail":746621272,"statfs":{"total":773094113280,"available":764540182528,"internally_reserved":0,"allocated":76587008,"data_stored":75073414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":8477199920},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003988"},"pg_stats":[{"pgid":"5.18","version":"28'5064","reported_seq":5096,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:30.936679+0000","last_change":"2024-09-12T02:40:30.936704+0000","last_active":"2024-09-12T02:40:30.936679+0000","last_peered":"2024-09-12T02:40:30.936679+0000","last_clean":"2024-09-12T02:40:30.936679+0000","last_became_active":"2024-09-12T02:23:16.851220+0000","last_became_peered":"2024-09-12T02:23:16.851220+0000","last_unstale":"2024-09-12T02:40:30.936679+0000","last_undegraded":"2024-09-12T02:40:30.936679+0000","last_fullsized":"2024-09-12T02:40:30.936679+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5064","last_scrub_stamp":"2024-09-12T02:40:30.936589+0000","last_deep_scrub":"28'5064","last_deep_scrub_stamp":"2024-09-12T02:40:30.936589+0000","last_clean_scrub_stamp":"2024-09-12T02:40:30.936589+0000","objects_scrubbed":0,"log_size":5064,"log_dups_size":0,"ondisk_log_size":5064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:00.973087+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26423,"num_write_kb":306733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"28'713","reported_seq":756,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:19.731843+0000","last_change":"2024-09-12T02:40:19.731893+0000","last_active":"2024-09-12T02:40:19.731843+0000","last_peered":"2024-09-12T02:40:19.731843+0000","last_clean":"2024-09-12T02:40:19.731843+0000","last_became_active":"2024-09-12T02:23:03.757544+0000","last_became_peered":"2024-09-12T02:23:03.757544+0000","last_unstale":"2024-09-12T02:40:19.731843+0000","last_undegraded":"2024-09-12T02:40:19.731843+0000","last_fullsized":"2024-09-12T02:40:19.731843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'713","last_scrub_stamp":"2024-09-12T02:40:19.731752+0000","last_deep_scrub":"28'713","last_deep_scrub_stamp":"2024-09-12T02:40:19.731752+0000","last_clean_scrub_stamp":"2024-09-12T02:40:19.731752+0000","objects_scrubbed":3,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:29.987759+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":4498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"28'5154","reported_seq":5195,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:20.916693+0000","last_change":"2024-09-12T02:40:20.916717+0000","last_active":"2024-09-12T02:40:20.916693+0000","last_peered":"2024-09-12T02:40:20.916693+0000","last_clean":"2024-09-12T02:40:20.916693+0000","last_became_active":"2024-09-12T02:23:04.790187+0000","last_became_peered":"2024-09-12T02:23:04.790187+0000","last_unstale":"2024-09-12T02:40:20.916693+0000","last_undegraded":"2024-09-12T02:40:20.916693+0000","last_fullsized":"2024-09-12T02:40:20.916693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5154","last_scrub_stamp":"2024-09-12T02:40:20.916606+0000","last_deep_scrub":"28'5154","last_deep_scrub_stamp":"2024-09-12T02:40:20.916606+0000","last_clean_scrub_stamp":"2024-09-12T02:40:20.916606+0000","objects_scrubbed":0,"log_size":5154,"log_dups_size":0,"ondisk_log_size":5154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:34:41.131746+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26676,"num_write_kb":324046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"28'3","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:17.881557+0000","last_change":"2024-09-12T02:40:17.881579+0000","last_active":"2024-09-12T02:40:17.881557+0000","last_peered":"2024-09-12T02:40:17.881557+0000","last_clean":"2024-09-12T02:40:17.881557+0000","last_became_active":"2024-09-12T02:23:15.828295+0000","last_became_peered":"2024-09-12T02:23:15.828295+0000","last_unstale":"2024-09-12T02:40:17.881557+0000","last_undegraded":"2024-09-12T02:40:17.881557+0000","last_fullsized":"2024-09-12T02:40:17.881557+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-09-12T02:40:17.881480+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-09-12T02:40:17.881480+0000","last_clean_scrub_stamp":"2024-09-12T02:40:17.881480+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:23.234361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"28'6025","reported_seq":6049,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:12.854040+0000","last_change":"2024-09-12T02:23:16.853675+0000","last_active":"2024-09-12T02:40:12.854040+0000","last_peered":"2024-09-12T02:40:12.854040+0000","last_clean":"2024-09-12T02:40:12.854040+0000","last_became_active":"2024-09-12T02:23:16.853371+0000","last_became_peered":"2024-09-12T02:23:16.853371+0000","last_unstale":"2024-09-12T02:40:12.854040+0000","last_undegraded":"2024-09-12T02:40:12.854040+0000","last_fullsized":"2024-09-12T02:40:12.854040+0000","mapping_epoch":24,"log_start":"28'200","ondisk_log_start":"28'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5825,"log_dups_size":0,"ondisk_log_size":5825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30759,"num_write_kb":360986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"28'8","reported_seq":51,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:30.726245+0000","last_change":"2024-09-12T02:40:30.726269+0000","last_active":"2024-09-12T02:40:30.726245+0000","last_peered":"2024-09-12T02:40:30.726245+0000","last_clean":"2024-09-12T02:40:30.726245+0000","last_became_active":"2024-09-12T02:23:03.766686+0000","last_became_peered":"2024-09-12T02:23:03.766686+0000","last_unstale":"2024-09-12T02:40:30.726245+0000","last_undegraded":"2024-09-12T02:40:30.726245+0000","last_fullsized":"2024-09-12T02:40:30.726245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-09-12T02:40:30.726150+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-09-12T02:40:30.726150+0000","last_clean_scrub_stamp":"2024-09-12T02:40:30.726150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:35.564201+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"28'5910","reported_seq":5951,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:24.670426+0000","last_change":"2024-09-12T02:40:24.670453+0000","last_active":"2024-09-12T02:40:24.670426+0000","last_peered":"2024-09-12T02:40:24.670426+0000","last_clean":"2024-09-12T02:40:24.670426+0000","last_became_active":"2024-09-12T02:23:04.781829+0000","last_became_peered":"2024-09-12T02:23:04.781829+0000","last_unstale":"2024-09-12T02:40:24.670426+0000","last_undegraded":"2024-09-12T02:40:24.670426+0000","last_fullsized":"2024-09-12T02:40:24.670426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5910","last_scrub_stamp":"2024-09-12T02:40:24.670324+0000","last_deep_scrub":"28'5910","last_deep_scrub_stamp":"2024-09-12T02:40:24.670324+0000","last_clean_scrub_stamp":"2024-09-12T02:40:24.670324+0000","objects_scrubbed":0,"log_size":5910,"log_dups_size":0,"ondisk_log_size":5910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:13.624050+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31102,"num_write_kb":370468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"28'3","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:28.996359+0000","last_change":"2024-09-12T02:40:28.996384+0000","last_active":"2024-09-12T02:40:28.996359+0000","last_peered":"2024-09-12T02:40:28.996359+0000","last_clean":"2024-09-12T02:40:28.996359+0000","last_became_active":"2024-09-12T02:23:15.828317+0000","last_became_peered":"2024-09-12T02:23:15.828317+0000","last_unstale":"2024-09-12T02:40:28.996359+0000","last_undegraded":"2024-09-12T02:40:28.996359+0000","last_fullsized":"2024-09-12T02:40:28.996359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-09-12T02:40:28.996254+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-09-12T02:40:28.996254+0000","last_clean_scrub_stamp":"2024-09-12T02:40:28.996254+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:13.699518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"28'4662","reported_seq":4685,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.720375+0000","last_change":"2024-09-12T02:23:16.856209+0000","last_active":"2024-09-12T02:40:04.720375+0000","last_peered":"2024-09-12T02:40:04.720375+0000","last_clean":"2024-09-12T02:40:04.720375+0000","last_became_active":"2024-09-12T02:23:16.855874+0000","last_became_peered":"2024-09-12T02:23:16.855874+0000","last_unstale":"2024-09-12T02:40:04.720375+0000","last_undegraded":"2024-09-12T02:40:04.720375+0000","last_fullsized":"2024-09-12T02:40:04.720375+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4662,"log_dups_size":0,"ondisk_log_size":4662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23657,"num_write_kb":270894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"28'11","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:17.097961+0000","last_change":"2024-09-12T02:23:03.767875+0000","last_active":"2024-09-12T02:40:17.097961+0000","last_peered":"2024-09-12T02:40:17.097961+0000","last_clean":"2024-09-12T02:40:17.097961+0000","last_became_active":"2024-09-12T02:23:03.767596+0000","last_became_peered":"2024-09-12T02:23:03.767596+0000","last_unstale":"2024-09-12T02:40:17.097961+0000","last_undegraded":"2024-09-12T02:40:17.097961+0000","last_fullsized":"2024-09-12T02:40:17.097961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'3398","reported_seq":3438,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:18.410304+0000","last_change":"2024-09-12T02:40:18.410304+0000","last_active":"2024-09-12T02:40:18.410304+0000","last_peered":"2024-09-12T02:40:18.410304+0000","last_clean":"2024-09-12T02:40:18.410304+0000","last_became_active":"2024-09-12T02:23:04.791635+0000","last_became_peered":"2024-09-12T02:23:04.791635+0000","last_unstale":"2024-09-12T02:40:18.410304+0000","last_undegraded":"2024-09-12T02:40:18.410304+0000","last_fullsized":"2024-09-12T02:40:18.410304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3398","last_scrub_stamp":"2024-09-12T02:40:18.410128+0000","last_deep_scrub":"28'3398","last_deep_scrub_stamp":"2024-09-12T02:40:18.410128+0000","last_clean_scrub_stamp":"2024-09-12T02:40:18.410128+0000","objects_scrubbed":0,"log_size":3398,"log_dups_size":0,"ondisk_log_size":3398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:26.401861+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16708,"num_write_kb":214393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"28'617","reported_seq":650,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:16.011403+0000","last_change":"2024-09-12T02:40:16.011449+0000","last_active":"2024-09-12T02:40:16.011403+0000","last_peered":"2024-09-12T02:40:16.011403+0000","last_clean":"2024-09-12T02:40:16.011403+0000","last_became_active":"2024-09-12T02:23:15.833010+0000","last_became_peered":"2024-09-12T02:23:15.833010+0000","last_unstale":"2024-09-12T02:40:16.011403+0000","last_undegraded":"2024-09-12T02:40:16.011403+0000","last_fullsized":"2024-09-12T02:40:16.011403+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'617","last_scrub_stamp":"2024-09-12T02:40:16.011287+0000","last_deep_scrub":"28'617","last_deep_scrub_stamp":"2024-09-12T02:40:16.011287+0000","last_clean_scrub_stamp":"2024-09-12T02:40:16.011287+0000","objects_scrubbed":1,"log_size":617,"log_dups_size":0,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:54.252463+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":614,"num_write_kb":4230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"28'4163","reported_seq":4186,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.705048+0000","last_change":"2024-09-12T02:23:16.853013+0000","last_active":"2024-09-12T02:40:04.705048+0000","last_peered":"2024-09-12T02:40:04.705048+0000","last_clean":"2024-09-12T02:40:04.705048+0000","last_became_active":"2024-09-12T02:23:16.852698+0000","last_became_peered":"2024-09-12T02:23:16.852698+0000","last_unstale":"2024-09-12T02:40:04.705048+0000","last_undegraded":"2024-09-12T02:40:04.705048+0000","last_fullsized":"2024-09-12T02:40:04.705048+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4163,"log_dups_size":0,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21165,"num_write_kb":244679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"28'4","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:31.857646+0000","last_change":"2024-09-12T02:40:31.857646+0000","last_active":"2024-09-12T02:40:31.857646+0000","last_peered":"2024-09-12T02:40:31.857646+0000","last_clean":"2024-09-12T02:40:31.857646+0000","last_became_active":"2024-09-12T02:23:03.762464+0000","last_became_peered":"2024-09-12T02:23:03.762464+0000","last_unstale":"2024-09-12T02:40:31.857646+0000","last_undegraded":"2024-09-12T02:40:31.857646+0000","last_fullsized":"2024-09-12T02:40:31.857646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-09-12T02:40:31.857523+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-09-12T02:40:31.857523+0000","last_clean_scrub_stamp":"2024-09-12T02:40:31.857523+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:35.714715+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"28'5838","reported_seq":5878,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:16.340060+0000","last_change":"2024-09-12T02:40:16.340060+0000","last_active":"2024-09-12T02:40:16.340060+0000","last_peered":"2024-09-12T02:40:16.340060+0000","last_clean":"2024-09-12T02:40:16.340060+0000","last_became_active":"2024-09-12T02:23:04.790201+0000","last_became_peered":"2024-09-12T02:23:04.790201+0000","last_unstale":"2024-09-12T02:40:16.340060+0000","last_undegraded":"2024-09-12T02:40:16.340060+0000","last_fullsized":"2024-09-12T02:40:16.340060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5838","last_scrub_stamp":"2024-09-12T02:40:16.339929+0000","last_deep_scrub":"28'5838","last_deep_scrub_stamp":"2024-09-12T02:40:16.339929+0000","last_clean_scrub_stamp":"2024-09-12T02:40:16.339929+0000","objects_scrubbed":0,"log_size":5838,"log_dups_size":0,"ondisk_log_size":5838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:45.443505+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30329,"num_write_kb":367409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"28'95","reported_seq":128,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:18.949765+0000","last_change":"2024-09-12T02:40:18.949793+0000","last_active":"2024-09-12T02:40:18.949765+0000","last_peered":"2024-09-12T02:40:18.949765+0000","last_clean":"2024-09-12T02:40:18.949765+0000","last_became_active":"2024-09-12T02:23:15.833982+0000","last_became_peered":"2024-09-12T02:23:15.833982+0000","last_unstale":"2024-09-12T02:40:18.949765+0000","last_undegraded":"2024-09-12T02:40:18.949765+0000","last_fullsized":"2024-09-12T02:40:18.949765+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'95","last_scrub_stamp":"2024-09-12T02:40:18.949676+0000","last_deep_scrub":"28'95","last_deep_scrub_stamp":"2024-09-12T02:40:18.949676+0000","last_clean_scrub_stamp":"2024-09-12T02:40:18.949676+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:51.516050+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1406481,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":1433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"28'5650","reported_seq":5674,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.670999+0000","last_change":"2024-09-12T02:23:16.861432+0000","last_active":"2024-09-12T02:40:04.670999+0000","last_peered":"2024-09-12T02:40:04.670999+0000","last_clean":"2024-09-12T02:40:04.670999+0000","last_became_active":"2024-09-12T02:23:16.861003+0000","last_became_peered":"2024-09-12T02:23:16.861003+0000","last_unstale":"2024-09-12T02:40:04.670999+0000","last_undegraded":"2024-09-12T02:40:04.670999+0000","last_fullsized":"2024-09-12T02:40:04.670999+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5650,"log_dups_size":0,"ondisk_log_size":5650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29234,"num_write_kb":330189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"28'4187","reported_seq":4228,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:20.016657+0000","last_change":"2024-09-12T02:40:20.016657+0000","last_active":"2024-09-12T02:40:20.016657+0000","last_peered":"2024-09-12T02:40:20.016657+0000","last_clean":"2024-09-12T02:40:20.016657+0000","last_became_active":"2024-09-12T02:23:04.788350+0000","last_became_peered":"2024-09-12T02:23:04.788350+0000","last_unstale":"2024-09-12T02:40:20.016657+0000","last_undegraded":"2024-09-12T02:40:20.016657+0000","last_fullsized":"2024-09-12T02:40:20.016657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4187","last_scrub_stamp":"2024-09-12T02:40:20.016544+0000","last_deep_scrub":"28'4187","last_deep_scrub_stamp":"2024-09-12T02:40:20.016544+0000","last_clean_scrub_stamp":"2024-09-12T02:40:20.016544+0000","objects_scrubbed":0,"log_size":4187,"log_dups_size":0,"ondisk_log_size":4187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:36.704978+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21964,"num_write_kb":272310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"28'1151","reported_seq":1193,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:30.901424+0000","last_change":"2024-09-12T02:40:30.901464+0000","last_active":"2024-09-12T02:40:30.901424+0000","last_peered":"2024-09-12T02:40:30.901424+0000","last_clean":"2024-09-12T02:40:30.901424+0000","last_became_active":"2024-09-12T02:23:03.762627+0000","last_became_peered":"2024-09-12T02:23:03.762627+0000","last_unstale":"2024-09-12T02:40:30.901424+0000","last_undegraded":"2024-09-12T02:40:30.901424+0000","last_fullsized":"2024-09-12T02:40:30.901424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1151","last_scrub_stamp":"2024-09-12T02:40:30.901320+0000","last_deep_scrub":"28'1151","last_deep_scrub_stamp":"2024-09-12T02:40:30.901320+0000","last_clean_scrub_stamp":"2024-09-12T02:40:30.901320+0000","objects_scrubbed":2,"log_size":1151,"log_dups_size":0,"ondisk_log_size":1151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:26.710599+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1140,"num_write_kb":4413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"28'3","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:19.994389+0000","last_change":"2024-09-12T02:40:19.994438+0000","last_active":"2024-09-12T02:40:19.994389+0000","last_peered":"2024-09-12T02:40:19.994389+0000","last_clean":"2024-09-12T02:40:19.994389+0000","last_became_active":"2024-09-12T02:23:15.831292+0000","last_became_peered":"2024-09-12T02:23:15.831292+0000","last_unstale":"2024-09-12T02:40:19.994389+0000","last_undegraded":"2024-09-12T02:40:19.994389+0000","last_fullsized":"2024-09-12T02:40:19.994389+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-09-12T02:40:19.994284+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-09-12T02:40:19.994284+0000","last_clean_scrub_stamp":"2024-09-12T02:40:19.994284+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:24.583324+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"28'5482","reported_seq":5514,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:25.702392+0000","last_change":"2024-09-12T02:40:25.702421+0000","last_active":"2024-09-12T02:40:25.702392+0000","last_peered":"2024-09-12T02:40:25.702392+0000","last_clean":"2024-09-12T02:40:25.702392+0000","last_became_active":"2024-09-12T02:23:16.842210+0000","last_became_peered":"2024-09-12T02:23:16.842210+0000","last_unstale":"2024-09-12T02:40:25.702392+0000","last_undegraded":"2024-09-12T02:40:25.702392+0000","last_fullsized":"2024-09-12T02:40:25.702392+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5482","last_scrub_stamp":"2024-09-12T02:40:25.702308+0000","last_deep_scrub":"28'5482","last_deep_scrub_stamp":"2024-09-12T02:40:25.702308+0000","last_clean_scrub_stamp":"2024-09-12T02:40:25.702308+0000","objects_scrubbed":0,"log_size":5482,"log_dups_size":0,"ondisk_log_size":5482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:41.539919+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28431,"num_write_kb":318903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"28'3892","reported_seq":3924,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.750279+0000","last_change":"2024-09-12T02:23:04.782769+0000","last_active":"2024-09-12T02:39:57.750279+0000","last_peered":"2024-09-12T02:39:57.750279+0000","last_clean":"2024-09-12T02:39:57.750279+0000","last_became_active":"2024-09-12T02:23:04.782472+0000","last_became_peered":"2024-09-12T02:23:04.782472+0000","last_unstale":"2024-09-12T02:39:57.750279+0000","last_undegraded":"2024-09-12T02:39:57.750279+0000","last_fullsized":"2024-09-12T02:39:57.750279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":3892,"log_dups_size":0,"ondisk_log_size":3892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18989,"num_write_kb":247993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'4","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:28.728698+0000","last_change":"2024-09-12T02:40:28.728728+0000","last_active":"2024-09-12T02:40:28.728698+0000","last_peered":"2024-09-12T02:40:28.728698+0000","last_clean":"2024-09-12T02:40:28.728698+0000","last_became_active":"2024-09-12T02:23:03.769619+0000","last_became_peered":"2024-09-12T02:23:03.769619+0000","last_unstale":"2024-09-12T02:40:28.728698+0000","last_undegraded":"2024-09-12T02:40:28.728698+0000","last_fullsized":"2024-09-12T02:40:28.728698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-09-12T02:40:28.728597+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-09-12T02:40:28.728597+0000","last_clean_scrub_stamp":"2024-09-12T02:40:28.728597+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:53:59.612583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"28'2","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:16.987753+0000","last_change":"2024-09-12T02:40:16.987776+0000","last_active":"2024-09-12T02:40:16.987753+0000","last_peered":"2024-09-12T02:40:16.987753+0000","last_clean":"2024-09-12T02:40:16.987753+0000","last_became_active":"2024-09-12T02:23:15.832995+0000","last_became_peered":"2024-09-12T02:23:15.832995+0000","last_unstale":"2024-09-12T02:40:16.987753+0000","last_undegraded":"2024-09-12T02:40:16.987753+0000","last_fullsized":"2024-09-12T02:40:16.987753+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2024-09-12T02:40:16.987665+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2024-09-12T02:40:16.987665+0000","last_clean_scrub_stamp":"2024-09-12T02:40:16.987665+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:20.081690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"28'4854","reported_seq":4886,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:33.898203+0000","last_change":"2024-09-12T02:40:33.898247+0000","last_active":"2024-09-12T02:40:33.898203+0000","last_peered":"2024-09-12T02:40:33.898203+0000","last_clean":"2024-09-12T02:40:33.898203+0000","last_became_active":"2024-09-12T02:23:16.856166+0000","last_became_peered":"2024-09-12T02:23:16.856166+0000","last_unstale":"2024-09-12T02:40:33.898203+0000","last_undegraded":"2024-09-12T02:40:33.898203+0000","last_fullsized":"2024-09-12T02:40:33.898203+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4854","last_scrub_stamp":"2024-09-12T02:40:33.898100+0000","last_deep_scrub":"28'4854","last_deep_scrub_stamp":"2024-09-12T02:40:33.898100+0000","last_clean_scrub_stamp":"2024-09-12T02:40:33.898100+0000","objects_scrubbed":0,"log_size":4854,"log_dups_size":0,"ondisk_log_size":4854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:21.951148+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24657,"num_write_kb":295553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"28'4675","reported_seq":4716,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:28.798684+0000","last_change":"2024-09-12T02:40:28.798732+0000","last_active":"2024-09-12T02:40:28.798684+0000","last_peered":"2024-09-12T02:40:28.798684+0000","last_clean":"2024-09-12T02:40:28.798684+0000","last_became_active":"2024-09-12T02:23:04.783143+0000","last_became_peered":"2024-09-12T02:23:04.783143+0000","last_unstale":"2024-09-12T02:40:28.798684+0000","last_undegraded":"2024-09-12T02:40:28.798684+0000","last_fullsized":"2024-09-12T02:40:28.798684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4675","last_scrub_stamp":"2024-09-12T02:40:28.798565+0000","last_deep_scrub":"28'4675","last_deep_scrub_stamp":"2024-09-12T02:40:28.798565+0000","last_clean_scrub_stamp":"2024-09-12T02:40:28.798565+0000","objects_scrubbed":0,"log_size":4675,"log_dups_size":0,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:52.357475+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24578,"num_write_kb":303391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'3","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:25.760934+0000","last_change":"2024-09-12T02:40:25.760934+0000","last_active":"2024-09-12T02:40:25.760934+0000","last_peered":"2024-09-12T02:40:25.760934+0000","last_clean":"2024-09-12T02:40:25.760934+0000","last_became_active":"2024-09-12T02:23:03.769406+0000","last_became_peered":"2024-09-12T02:23:03.769406+0000","last_unstale":"2024-09-12T02:40:25.760934+0000","last_undegraded":"2024-09-12T02:40:25.760934+0000","last_fullsized":"2024-09-12T02:40:25.760934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-09-12T02:40:25.760806+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-09-12T02:40:25.760806+0000","last_clean_scrub_stamp":"2024-09-12T02:40:25.760806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:50.077752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"28'6","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:21.875145+0000","last_change":"2024-09-12T02:40:21.875199+0000","last_active":"2024-09-12T02:40:21.875145+0000","last_peered":"2024-09-12T02:40:21.875145+0000","last_clean":"2024-09-12T02:40:21.875145+0000","last_became_active":"2024-09-12T02:23:15.834753+0000","last_became_peered":"2024-09-12T02:23:15.834753+0000","last_unstale":"2024-09-12T02:40:21.875145+0000","last_undegraded":"2024-09-12T02:40:21.875145+0000","last_fullsized":"2024-09-12T02:40:21.875145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-09-12T02:40:21.875045+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-09-12T02:40:21.875045+0000","last_clean_scrub_stamp":"2024-09-12T02:40:21.875045+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:20:45.548152+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"28'5924","reported_seq":5948,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.731072+0000","last_change":"2024-09-12T02:23:16.860867+0000","last_active":"2024-09-12T02:40:04.731072+0000","last_peered":"2024-09-12T02:40:04.731072+0000","last_clean":"2024-09-12T02:40:04.731072+0000","last_became_active":"2024-09-12T02:23:16.860656+0000","last_became_peered":"2024-09-12T02:23:16.860656+0000","last_unstale":"2024-09-12T02:40:04.731072+0000","last_undegraded":"2024-09-12T02:40:04.731072+0000","last_fullsized":"2024-09-12T02:40:04.731072+0000","mapping_epoch":24,"log_start":"28'100","ondisk_log_start":"28'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5824,"log_dups_size":0,"ondisk_log_size":5824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30048,"num_write_kb":358073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"28'4362","reported_seq":4403,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:25.920301+0000","last_change":"2024-09-12T02:40:25.920301+0000","last_active":"2024-09-12T02:40:25.920301+0000","last_peered":"2024-09-12T02:40:25.920301+0000","last_clean":"2024-09-12T02:40:25.920301+0000","last_became_active":"2024-09-12T02:23:04.779984+0000","last_became_peered":"2024-09-12T02:23:04.779984+0000","last_unstale":"2024-09-12T02:40:25.920301+0000","last_undegraded":"2024-09-12T02:40:25.920301+0000","last_fullsized":"2024-09-12T02:40:25.920301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4362","last_scrub_stamp":"2024-09-12T02:40:25.920153+0000","last_deep_scrub":"28'4362","last_deep_scrub_stamp":"2024-09-12T02:40:25.920153+0000","last_clean_scrub_stamp":"2024-09-12T02:40:25.920153+0000","objects_scrubbed":0,"log_size":4362,"log_dups_size":0,"ondisk_log_size":4362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:54.516440+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22346,"num_write_kb":282099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"28'3","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:33.886146+0000","last_change":"2024-09-12T02:40:33.886173+0000","last_active":"2024-09-12T02:40:33.886146+0000","last_peered":"2024-09-12T02:40:33.886146+0000","last_clean":"2024-09-12T02:40:33.886146+0000","last_became_active":"2024-09-12T02:23:03.764218+0000","last_became_peered":"2024-09-12T02:23:03.764218+0000","last_unstale":"2024-09-12T02:40:33.886146+0000","last_undegraded":"2024-09-12T02:40:33.886146+0000","last_fullsized":"2024-09-12T02:40:33.886146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-09-12T02:40:33.886057+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-09-12T02:40:33.886057+0000","last_clean_scrub_stamp":"2024-09-12T02:40:33.886057+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:25.152808+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"28'7","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:17.971178+0000","last_change":"2024-09-12T02:40:17.971205+0000","last_active":"2024-09-12T02:40:17.971178+0000","last_peered":"2024-09-12T02:40:17.971178+0000","last_clean":"2024-09-12T02:40:17.971178+0000","last_became_active":"2024-09-12T02:23:15.831331+0000","last_became_peered":"2024-09-12T02:23:15.831331+0000","last_unstale":"2024-09-12T02:40:17.971178+0000","last_undegraded":"2024-09-12T02:40:17.971178+0000","last_fullsized":"2024-09-12T02:40:17.971178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-09-12T02:40:17.971087+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-09-12T02:40:17.971087+0000","last_clean_scrub_stamp":"2024-09-12T02:40:17.971087+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:49.270134+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"28'4897","reported_seq":4922,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.667126+0000","last_change":"2024-09-12T02:23:16.847556+0000","last_active":"2024-09-12T02:40:04.667126+0000","last_peered":"2024-09-12T02:40:04.667126+0000","last_clean":"2024-09-12T02:40:04.667126+0000","last_became_active":"2024-09-12T02:23:16.845749+0000","last_became_peered":"2024-09-12T02:23:16.845749+0000","last_unstale":"2024-09-12T02:40:04.667126+0000","last_undegraded":"2024-09-12T02:40:04.667126+0000","last_fullsized":"2024-09-12T02:40:04.667126+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4897,"log_dups_size":0,"ondisk_log_size":4897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25893,"num_write_kb":296532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"28'3849","reported_seq":3890,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:18.713697+0000","last_change":"2024-09-12T02:40:18.713697+0000","last_active":"2024-09-12T02:40:18.713697+0000","last_peered":"2024-09-12T02:40:18.713697+0000","last_clean":"2024-09-12T02:40:18.713697+0000","last_became_active":"2024-09-12T02:23:04.786591+0000","last_became_peered":"2024-09-12T02:23:04.786591+0000","last_unstale":"2024-09-12T02:40:18.713697+0000","last_undegraded":"2024-09-12T02:40:18.713697+0000","last_fullsized":"2024-09-12T02:40:18.713697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3849","last_scrub_stamp":"2024-09-12T02:40:18.713497+0000","last_deep_scrub":"28'3849","last_deep_scrub_stamp":"2024-09-12T02:40:18.713497+0000","last_clean_scrub_stamp":"2024-09-12T02:40:18.713497+0000","objects_scrubbed":0,"log_size":3849,"log_dups_size":0,"ondisk_log_size":3849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:49.707703+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19665,"num_write_kb":250729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'6","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:24.956292+0000","last_change":"2024-09-12T02:40:24.956317+0000","last_active":"2024-09-12T02:40:24.956292+0000","last_peered":"2024-09-12T02:40:24.956292+0000","last_clean":"2024-09-12T02:40:24.956292+0000","last_became_active":"2024-09-12T02:23:03.770687+0000","last_became_peered":"2024-09-12T02:23:03.770687+0000","last_unstale":"2024-09-12T02:40:24.956292+0000","last_undegraded":"2024-09-12T02:40:24.956292+0000","last_fullsized":"2024-09-12T02:40:24.956292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-09-12T02:40:24.956213+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-09-12T02:40:24.956213+0000","last_clean_scrub_stamp":"2024-09-12T02:40:24.956213+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:52.565555+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"28'60","reported_seq":152,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:29.953518+0000","last_change":"2024-09-12T02:40:29.953563+0000","last_active":"2024-09-12T02:40:29.953518+0000","last_peered":"2024-09-12T02:40:29.953518+0000","last_clean":"2024-09-12T02:40:29.953518+0000","last_became_active":"2024-09-12T02:23:15.829135+0000","last_became_peered":"2024-09-12T02:23:15.829135+0000","last_unstale":"2024-09-12T02:40:29.953518+0000","last_undegraded":"2024-09-12T02:40:29.953518+0000","last_fullsized":"2024-09-12T02:40:29.953518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'60","last_scrub_stamp":"2024-09-12T02:40:29.953405+0000","last_deep_scrub":"28'60","last_deep_scrub_stamp":"2024-09-12T02:40:29.953405+0000","last_clean_scrub_stamp":"2024-09-12T02:40:29.953405+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:27.639407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":57,"num_read_kb":123,"num_write":57,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"28'5530","reported_seq":5555,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.669630+0000","last_change":"2024-09-12T02:23:16.857016+0000","last_active":"2024-09-12T02:40:04.669630+0000","last_peered":"2024-09-12T02:40:04.669630+0000","last_clean":"2024-09-12T02:40:04.669630+0000","last_became_active":"2024-09-12T02:23:16.856705+0000","last_became_peered":"2024-09-12T02:23:16.856705+0000","last_unstale":"2024-09-12T02:40:04.669630+0000","last_undegraded":"2024-09-12T02:40:04.669630+0000","last_fullsized":"2024-09-12T02:40:04.669630+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5530,"log_dups_size":0,"ondisk_log_size":5530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29256,"num_write_kb":314000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"28'4419","reported_seq":4460,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:26.855919+0000","last_change":"2024-09-12T02:40:26.855919+0000","last_active":"2024-09-12T02:40:26.855919+0000","last_peered":"2024-09-12T02:40:26.855919+0000","last_clean":"2024-09-12T02:40:26.855919+0000","last_became_active":"2024-09-12T02:23:04.786136+0000","last_became_peered":"2024-09-12T02:23:04.786136+0000","last_unstale":"2024-09-12T02:40:26.855919+0000","last_undegraded":"2024-09-12T02:40:26.855919+0000","last_fullsized":"2024-09-12T02:40:26.855919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4419","last_scrub_stamp":"2024-09-12T02:40:26.855787+0000","last_deep_scrub":"28'4419","last_deep_scrub_stamp":"2024-09-12T02:40:26.855787+0000","last_clean_scrub_stamp":"2024-09-12T02:40:26.855787+0000","objects_scrubbed":0,"log_size":4419,"log_dups_size":0,"ondisk_log_size":4419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:39.527316+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22653,"num_write_kb":291447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'598","reported_seq":641,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:24.804048+0000","last_change":"2024-09-12T02:40:24.804048+0000","last_active":"2024-09-12T02:40:24.804048+0000","last_peered":"2024-09-12T02:40:24.804048+0000","last_clean":"2024-09-12T02:40:24.804048+0000","last_became_active":"2024-09-12T02:23:03.769410+0000","last_became_peered":"2024-09-12T02:23:03.769410+0000","last_unstale":"2024-09-12T02:40:24.804048+0000","last_undegraded":"2024-09-12T02:40:24.804048+0000","last_fullsized":"2024-09-12T02:40:24.804048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'598","last_scrub_stamp":"2024-09-12T02:40:24.803897+0000","last_deep_scrub":"28'598","last_deep_scrub_stamp":"2024-09-12T02:40:24.803897+0000","last_clean_scrub_stamp":"2024-09-12T02:40:24.803897+0000","objects_scrubbed":1,"log_size":598,"log_dups_size":0,"ondisk_log_size":598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:33.918486+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1455,"num_write_kb":462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"28'5","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:15.918706+0000","last_change":"2024-09-12T02:40:15.918728+0000","last_active":"2024-09-12T02:40:15.918706+0000","last_peered":"2024-09-12T02:40:15.918706+0000","last_clean":"2024-09-12T02:40:15.918706+0000","last_became_active":"2024-09-12T02:23:15.826564+0000","last_became_peered":"2024-09-12T02:23:15.826564+0000","last_unstale":"2024-09-12T02:40:15.918706+0000","last_undegraded":"2024-09-12T02:40:15.918706+0000","last_fullsized":"2024-09-12T02:40:15.918706+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-09-12T02:40:15.918631+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-09-12T02:40:15.918631+0000","last_clean_scrub_stamp":"2024-09-12T02:40:15.918631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:36.543698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"28'5561","reported_seq":5594,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:31.879485+0000","last_change":"2024-09-12T02:40:31.879528+0000","last_active":"2024-09-12T02:40:31.879485+0000","last_peered":"2024-09-12T02:40:31.879485+0000","last_clean":"2024-09-12T02:40:31.879485+0000","last_became_active":"2024-09-12T02:23:16.837162+0000","last_became_peered":"2024-09-12T02:23:16.837162+0000","last_unstale":"2024-09-12T02:40:31.879485+0000","last_undegraded":"2024-09-12T02:40:31.879485+0000","last_fullsized":"2024-09-12T02:40:31.879485+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5561","last_scrub_stamp":"2024-09-12T02:40:31.879372+0000","last_deep_scrub":"28'5561","last_deep_scrub_stamp":"2024-09-12T02:40:31.879372+0000","last_clean_scrub_stamp":"2024-09-12T02:40:31.879372+0000","objects_scrubbed":0,"log_size":5561,"log_dups_size":0,"ondisk_log_size":5561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:57.293741+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28597,"num_write_kb":327668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"28'4780","reported_seq":4821,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:30.743281+0000","last_change":"2024-09-12T02:40:30.743327+0000","last_active":"2024-09-12T02:40:30.743281+0000","last_peered":"2024-09-12T02:40:30.743281+0000","last_clean":"2024-09-12T02:40:30.743281+0000","last_became_active":"2024-09-12T02:23:04.775571+0000","last_became_peered":"2024-09-12T02:23:04.775571+0000","last_unstale":"2024-09-12T02:40:30.743281+0000","last_undegraded":"2024-09-12T02:40:30.743281+0000","last_fullsized":"2024-09-12T02:40:30.743281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4780","last_scrub_stamp":"2024-09-12T02:40:30.743146+0000","last_deep_scrub":"28'4780","last_deep_scrub_stamp":"2024-09-12T02:40:30.743146+0000","last_clean_scrub_stamp":"2024-09-12T02:40:30.743146+0000","objects_scrubbed":0,"log_size":4780,"log_dups_size":0,"ondisk_log_size":4780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:14.168076+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24981,"num_write_kb":308974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"28'4","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:32.879444+0000","last_change":"2024-09-12T02:40:32.879467+0000","last_active":"2024-09-12T02:40:32.879444+0000","last_peered":"2024-09-12T02:40:32.879444+0000","last_clean":"2024-09-12T02:40:32.879444+0000","last_became_active":"2024-09-12T02:23:03.763147+0000","last_became_peered":"2024-09-12T02:23:03.763147+0000","last_unstale":"2024-09-12T02:40:32.879444+0000","last_undegraded":"2024-09-12T02:40:32.879444+0000","last_fullsized":"2024-09-12T02:40:32.879444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-09-12T02:40:32.879345+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-09-12T02:40:32.879345+0000","last_clean_scrub_stamp":"2024-09-12T02:40:32.879345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:45.921507+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"28'1","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:17.740401+0000","last_change":"2024-09-12T02:40:17.740479+0000","last_active":"2024-09-12T02:40:17.740401+0000","last_peered":"2024-09-12T02:40:17.740401+0000","last_clean":"2024-09-12T02:40:17.740401+0000","last_became_active":"2024-09-12T02:23:15.831637+0000","last_became_peered":"2024-09-12T02:23:15.831637+0000","last_unstale":"2024-09-12T02:40:17.740401+0000","last_undegraded":"2024-09-12T02:40:17.740401+0000","last_fullsized":"2024-09-12T02:40:17.740401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1","last_scrub_stamp":"2024-09-12T02:40:17.740261+0000","last_deep_scrub":"28'1","last_deep_scrub_stamp":"2024-09-12T02:40:17.740261+0000","last_clean_scrub_stamp":"2024-09-12T02:40:17.740261+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:46.467057+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"28'5517","reported_seq":5550,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:31.727813+0000","last_change":"2024-09-12T02:40:31.727843+0000","last_active":"2024-09-12T02:40:31.727813+0000","last_peered":"2024-09-12T02:40:31.727813+0000","last_clean":"2024-09-12T02:40:31.727813+0000","last_became_active":"2024-09-12T02:23:16.835520+0000","last_became_peered":"2024-09-12T02:23:16.835520+0000","last_unstale":"2024-09-12T02:40:31.727813+0000","last_undegraded":"2024-09-12T02:40:31.727813+0000","last_fullsized":"2024-09-12T02:40:31.727813+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5517","last_scrub_stamp":"2024-09-12T02:40:31.727715+0000","last_deep_scrub":"28'5517","last_deep_scrub_stamp":"2024-09-12T02:40:31.727715+0000","last_clean_scrub_stamp":"2024-09-12T02:40:31.727715+0000","objects_scrubbed":0,"log_size":5517,"log_dups_size":0,"ondisk_log_size":5517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:44.732297+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29476,"num_write_kb":310838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"28'3821","reported_seq":3862,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:23.504812+0000","last_change":"2024-09-12T02:40:23.504852+0000","last_active":"2024-09-12T02:40:23.504812+0000","last_peered":"2024-09-12T02:40:23.504812+0000","last_clean":"2024-09-12T02:40:23.504812+0000","last_became_active":"2024-09-12T02:23:04.786527+0000","last_became_peered":"2024-09-12T02:23:04.786527+0000","last_unstale":"2024-09-12T02:40:23.504812+0000","last_undegraded":"2024-09-12T02:40:23.504812+0000","last_fullsized":"2024-09-12T02:40:23.504812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3821","last_scrub_stamp":"2024-09-12T02:40:23.504689+0000","last_deep_scrub":"28'3821","last_deep_scrub_stamp":"2024-09-12T02:40:23.504689+0000","last_clean_scrub_stamp":"2024-09-12T02:40:23.504689+0000","objects_scrubbed":0,"log_size":3821,"log_dups_size":0,"ondisk_log_size":3821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:47:52.344813+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19788,"num_write_kb":259568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"28'5","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:26.712260+0000","last_change":"2024-09-12T02:40:26.712286+0000","last_active":"2024-09-12T02:40:26.712260+0000","last_peered":"2024-09-12T02:40:26.712260+0000","last_clean":"2024-09-12T02:40:26.712260+0000","last_became_active":"2024-09-12T02:23:03.769444+0000","last_became_peered":"2024-09-12T02:23:03.769444+0000","last_unstale":"2024-09-12T02:40:26.712260+0000","last_undegraded":"2024-09-12T02:40:26.712260+0000","last_fullsized":"2024-09-12T02:40:26.712260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-09-12T02:40:26.712174+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-09-12T02:40:26.712174+0000","last_clean_scrub_stamp":"2024-09-12T02:40:26.712174+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:15.457629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"28'5","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:17.883069+0000","last_change":"2024-09-12T02:40:17.883091+0000","last_active":"2024-09-12T02:40:17.883069+0000","last_peered":"2024-09-12T02:40:17.883069+0000","last_clean":"2024-09-12T02:40:17.883069+0000","last_became_active":"2024-09-12T02:23:15.828256+0000","last_became_peered":"2024-09-12T02:23:15.828256+0000","last_unstale":"2024-09-12T02:40:17.883069+0000","last_undegraded":"2024-09-12T02:40:17.883069+0000","last_fullsized":"2024-09-12T02:40:17.883069+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-09-12T02:40:17.882990+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-09-12T02:40:17.882990+0000","last_clean_scrub_stamp":"2024-09-12T02:40:17.882990+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:50.173392+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"28'4600","reported_seq":4625,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.595249+0000","last_change":"2024-09-12T02:23:16.845710+0000","last_active":"2024-09-12T02:40:04.595249+0000","last_peered":"2024-09-12T02:40:04.595249+0000","last_clean":"2024-09-12T02:40:04.595249+0000","last_became_active":"2024-09-12T02:23:16.845379+0000","last_became_peered":"2024-09-12T02:23:16.845379+0000","last_unstale":"2024-09-12T02:40:04.595249+0000","last_undegraded":"2024-09-12T02:40:04.595249+0000","last_fullsized":"2024-09-12T02:40:04.595249+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4600,"log_dups_size":0,"ondisk_log_size":4600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24241,"num_write_kb":277536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"28'4371","reported_seq":4412,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:27.977584+0000","last_change":"2024-09-12T02:40:27.977610+0000","last_active":"2024-09-12T02:40:27.977584+0000","last_peered":"2024-09-12T02:40:27.977584+0000","last_clean":"2024-09-12T02:40:27.977584+0000","last_became_active":"2024-09-12T02:23:04.786877+0000","last_became_peered":"2024-09-12T02:23:04.786877+0000","last_unstale":"2024-09-12T02:40:27.977584+0000","last_undegraded":"2024-09-12T02:40:27.977584+0000","last_fullsized":"2024-09-12T02:40:27.977584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4371","last_scrub_stamp":"2024-09-12T02:40:27.977465+0000","last_deep_scrub":"28'4371","last_deep_scrub_stamp":"2024-09-12T02:40:27.977465+0000","last_clean_scrub_stamp":"2024-09-12T02:40:27.977465+0000","objects_scrubbed":0,"log_size":4371,"log_dups_size":0,"ondisk_log_size":4371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:36.470278+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23204,"num_write_kb":285450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"28'5","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:32.470137+0000","last_change":"2024-09-12T02:40:32.470215+0000","last_active":"2024-09-12T02:40:32.470137+0000","last_peered":"2024-09-12T02:40:32.470137+0000","last_clean":"2024-09-12T02:40:32.470137+0000","last_became_active":"2024-09-12T02:23:03.771063+0000","last_became_peered":"2024-09-12T02:23:03.771063+0000","last_unstale":"2024-09-12T02:40:32.470137+0000","last_undegraded":"2024-09-12T02:40:32.470137+0000","last_fullsized":"2024-09-12T02:40:32.470137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-09-12T02:40:32.470030+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-09-12T02:40:32.470030+0000","last_clean_scrub_stamp":"2024-09-12T02:40:32.470030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:52.686199+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"28'5","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:14.859962+0000","last_change":"2024-09-12T02:40:14.859985+0000","last_active":"2024-09-12T02:40:14.859962+0000","last_peered":"2024-09-12T02:40:14.859962+0000","last_clean":"2024-09-12T02:40:14.859962+0000","last_became_active":"2024-09-12T02:23:15.826708+0000","last_became_peered":"2024-09-12T02:23:15.826708+0000","last_unstale":"2024-09-12T02:40:14.859962+0000","last_undegraded":"2024-09-12T02:40:14.859962+0000","last_fullsized":"2024-09-12T02:40:14.859962+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-09-12T02:40:14.859876+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-09-12T02:40:14.859876+0000","last_clean_scrub_stamp":"2024-09-12T02:40:14.859876+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:44.796702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'4748","reported_seq":4780,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:27.719552+0000","last_change":"2024-09-12T02:40:27.719578+0000","last_active":"2024-09-12T02:40:27.719552+0000","last_peered":"2024-09-12T02:40:27.719552+0000","last_clean":"2024-09-12T02:40:27.719552+0000","last_became_active":"2024-09-12T02:23:16.849119+0000","last_became_peered":"2024-09-12T02:23:16.849119+0000","last_unstale":"2024-09-12T02:40:27.719552+0000","last_undegraded":"2024-09-12T02:40:27.719552+0000","last_fullsized":"2024-09-12T02:40:27.719552+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4748","last_scrub_stamp":"2024-09-12T02:40:27.719462+0000","last_deep_scrub":"28'4748","last_deep_scrub_stamp":"2024-09-12T02:40:27.719462+0000","last_clean_scrub_stamp":"2024-09-12T02:40:27.719462+0000","objects_scrubbed":0,"log_size":4748,"log_dups_size":0,"ondisk_log_size":4748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:38.364108+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23965,"num_write_kb":268065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"28'4258","reported_seq":4299,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:29.717526+0000","last_change":"2024-09-12T02:40:29.717554+0000","last_active":"2024-09-12T02:40:29.717526+0000","last_peered":"2024-09-12T02:40:29.717526+0000","last_clean":"2024-09-12T02:40:29.717526+0000","last_became_active":"2024-09-12T02:23:04.773360+0000","last_became_peered":"2024-09-12T02:23:04.773360+0000","last_unstale":"2024-09-12T02:40:29.717526+0000","last_undegraded":"2024-09-12T02:40:29.717526+0000","last_fullsized":"2024-09-12T02:40:29.717526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4258","last_scrub_stamp":"2024-09-12T02:40:29.717422+0000","last_deep_scrub":"28'4258","last_deep_scrub_stamp":"2024-09-12T02:40:29.717422+0000","last_clean_scrub_stamp":"2024-09-12T02:40:29.717422+0000","objects_scrubbed":0,"log_size":4258,"log_dups_size":0,"ondisk_log_size":4258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:13:19.250506+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22673,"num_write_kb":283464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'65","reported_seq":170,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:17.742281+0000","last_change":"2024-09-12T02:40:17.742308+0000","last_active":"2024-09-12T02:40:17.742281+0000","last_peered":"2024-09-12T02:40:17.742281+0000","last_clean":"2024-09-12T02:40:17.742281+0000","last_became_active":"2024-09-12T02:23:03.760397+0000","last_became_peered":"2024-09-12T02:23:03.760397+0000","last_unstale":"2024-09-12T02:40:17.742281+0000","last_undegraded":"2024-09-12T02:40:17.742281+0000","last_fullsized":"2024-09-12T02:40:17.742281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'65","last_scrub_stamp":"2024-09-12T02:40:17.742207+0000","last_deep_scrub":"28'65","last_deep_scrub_stamp":"2024-09-12T02:40:17.742207+0000","last_clean_scrub_stamp":"2024-09-12T02:40:17.742207+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:29.965072+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":127,"num_write":62,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"28'5","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:15.891388+0000","last_change":"2024-09-12T02:40:15.891412+0000","last_active":"2024-09-12T02:40:15.891388+0000","last_peered":"2024-09-12T02:40:15.891388+0000","last_clean":"2024-09-12T02:40:15.891388+0000","last_became_active":"2024-09-12T02:23:15.827458+0000","last_became_peered":"2024-09-12T02:23:15.827458+0000","last_unstale":"2024-09-12T02:40:15.891388+0000","last_undegraded":"2024-09-12T02:40:15.891388+0000","last_fullsized":"2024-09-12T02:40:15.891388+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-09-12T02:40:15.891307+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-09-12T02:40:15.891307+0000","last_clean_scrub_stamp":"2024-09-12T02:40:15.891307+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:51.348223+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"28'4979","reported_seq":5003,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.723519+0000","last_change":"2024-09-12T02:23:16.855212+0000","last_active":"2024-09-12T02:40:04.723519+0000","last_peered":"2024-09-12T02:40:04.723519+0000","last_clean":"2024-09-12T02:40:04.723519+0000","last_became_active":"2024-09-12T02:23:16.854938+0000","last_became_peered":"2024-09-12T02:23:16.854938+0000","last_unstale":"2024-09-12T02:40:04.723519+0000","last_undegraded":"2024-09-12T02:40:04.723519+0000","last_fullsized":"2024-09-12T02:40:04.723519+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4979,"log_dups_size":0,"ondisk_log_size":4979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25537,"num_write_kb":303027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"28'4415","reported_seq":4456,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:14.745134+0000","last_change":"2024-09-12T02:40:14.745158+0000","last_active":"2024-09-12T02:40:14.745134+0000","last_peered":"2024-09-12T02:40:14.745134+0000","last_clean":"2024-09-12T02:40:14.745134+0000","last_became_active":"2024-09-12T02:23:04.787523+0000","last_became_peered":"2024-09-12T02:23:04.787523+0000","last_unstale":"2024-09-12T02:40:14.745134+0000","last_undegraded":"2024-09-12T02:40:14.745134+0000","last_fullsized":"2024-09-12T02:40:14.745134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4415","last_scrub_stamp":"2024-09-12T02:40:14.745044+0000","last_deep_scrub":"28'4415","last_deep_scrub_stamp":"2024-09-12T02:40:14.745044+0000","last_clean_scrub_stamp":"2024-09-12T02:40:14.745044+0000","objects_scrubbed":0,"log_size":4415,"log_dups_size":0,"ondisk_log_size":4415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:04.003662+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23022,"num_write_kb":288900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'5","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:47.646306+0000","last_change":"2024-09-12T02:23:03.771625+0000","last_active":"2024-09-12T02:39:47.646306+0000","last_peered":"2024-09-12T02:39:47.646306+0000","last_clean":"2024-09-12T02:39:47.646306+0000","last_became_active":"2024-09-12T02:23:03.771163+0000","last_became_peered":"2024-09-12T02:23:03.771163+0000","last_unstale":"2024-09-12T02:39:47.646306+0000","last_undegraded":"2024-09-12T02:39:47.646306+0000","last_fullsized":"2024-09-12T02:39:47.646306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:02.739281+0000","last_clean_scrub_stamp":"2024-09-12T02:23:02.739281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"28'616","reported_seq":650,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:30.689557+0000","last_change":"2024-09-12T02:40:30.689599+0000","last_active":"2024-09-12T02:40:30.689557+0000","last_peered":"2024-09-12T02:40:30.689557+0000","last_clean":"2024-09-12T02:40:30.689557+0000","last_became_active":"2024-09-12T02:23:15.833587+0000","last_became_peered":"2024-09-12T02:23:15.833587+0000","last_unstale":"2024-09-12T02:40:30.689557+0000","last_undegraded":"2024-09-12T02:40:30.689557+0000","last_fullsized":"2024-09-12T02:40:30.689557+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'616","last_scrub_stamp":"2024-09-12T02:40:30.689464+0000","last_deep_scrub":"28'616","last_deep_scrub_stamp":"2024-09-12T02:40:30.689464+0000","last_clean_scrub_stamp":"2024-09-12T02:40:30.689464+0000","objects_scrubbed":1,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:04.861691+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1484,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"28'5400","reported_seq":5425,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.734404+0000","last_change":"2024-09-12T02:23:16.848864+0000","last_active":"2024-09-12T02:40:04.734404+0000","last_peered":"2024-09-12T02:40:04.734404+0000","last_clean":"2024-09-12T02:40:04.734404+0000","last_became_active":"2024-09-12T02:23:16.848385+0000","last_became_peered":"2024-09-12T02:23:16.848385+0000","last_unstale":"2024-09-12T02:40:04.734404+0000","last_undegraded":"2024-09-12T02:40:04.734404+0000","last_fullsized":"2024-09-12T02:40:04.734404+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5400,"log_dups_size":0,"ondisk_log_size":5400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28350,"num_write_kb":322666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"28'5040","reported_seq":5073,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.808881+0000","last_change":"2024-09-12T02:23:04.781839+0000","last_active":"2024-09-12T02:39:57.808881+0000","last_peered":"2024-09-12T02:39:57.808881+0000","last_clean":"2024-09-12T02:39:57.808881+0000","last_became_active":"2024-09-12T02:23:04.780984+0000","last_became_peered":"2024-09-12T02:23:04.780984+0000","last_unstale":"2024-09-12T02:39:57.808881+0000","last_undegraded":"2024-09-12T02:39:57.808881+0000","last_fullsized":"2024-09-12T02:39:57.808881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5040,"log_dups_size":0,"ondisk_log_size":5040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25643,"num_write_kb":315836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'1","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:29.549609+0000","last_change":"2024-09-12T02:40:29.549650+0000","last_active":"2024-09-12T02:40:29.549609+0000","last_peered":"2024-09-12T02:40:29.549609+0000","last_clean":"2024-09-12T02:40:29.549609+0000","last_became_active":"2024-09-12T02:23:03.764801+0000","last_became_peered":"2024-09-12T02:23:03.764801+0000","last_unstale":"2024-09-12T02:40:29.549609+0000","last_undegraded":"2024-09-12T02:40:29.549609+0000","last_fullsized":"2024-09-12T02:40:29.549609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1","last_scrub_stamp":"2024-09-12T02:40:29.549482+0000","last_deep_scrub":"28'1","last_deep_scrub_stamp":"2024-09-12T02:40:29.549482+0000","last_clean_scrub_stamp":"2024-09-12T02:40:29.549482+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:14.649738+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"28'119","reported_seq":201,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:29.881219+0000","last_change":"2024-09-12T02:40:29.881250+0000","last_active":"2024-09-12T02:40:29.881219+0000","last_peered":"2024-09-12T02:40:29.881219+0000","last_clean":"2024-09-12T02:40:29.881219+0000","last_became_active":"2024-09-12T02:22:55.142784+0000","last_became_peered":"2024-09-12T02:22:55.142784+0000","last_unstale":"2024-09-12T02:40:29.881219+0000","last_undegraded":"2024-09-12T02:40:29.881219+0000","last_fullsized":"2024-09-12T02:40:29.881219+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'119","last_scrub_stamp":"2024-09-12T02:40:29.881130+0000","last_deep_scrub":"28'119","last_deep_scrub_stamp":"2024-09-12T02:40:29.881130+0000","last_clean_scrub_stamp":"2024-09-12T02:40:29.881130+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:54.810068+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"28'4","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:30.919274+0000","last_change":"2024-09-12T02:40:30.919321+0000","last_active":"2024-09-12T02:40:30.919274+0000","last_peered":"2024-09-12T02:40:30.919274+0000","last_clean":"2024-09-12T02:40:30.919274+0000","last_became_active":"2024-09-12T02:23:15.831084+0000","last_became_peered":"2024-09-12T02:23:15.831084+0000","last_unstale":"2024-09-12T02:40:30.919274+0000","last_undegraded":"2024-09-12T02:40:30.919274+0000","last_fullsized":"2024-09-12T02:40:30.919274+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-09-12T02:40:30.919180+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-09-12T02:40:30.919180+0000","last_clean_scrub_stamp":"2024-09-12T02:40:30.919180+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:38.075693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"28'4521","reported_seq":4553,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:15.678056+0000","last_change":"2024-09-12T02:40:15.678078+0000","last_active":"2024-09-12T02:40:15.678056+0000","last_peered":"2024-09-12T02:40:15.678056+0000","last_clean":"2024-09-12T02:40:15.678056+0000","last_became_active":"2024-09-12T02:23:16.838523+0000","last_became_peered":"2024-09-12T02:23:16.838523+0000","last_unstale":"2024-09-12T02:40:15.678056+0000","last_undegraded":"2024-09-12T02:40:15.678056+0000","last_fullsized":"2024-09-12T02:40:15.678056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4521","last_scrub_stamp":"2024-09-12T02:40:15.677976+0000","last_deep_scrub":"28'4521","last_deep_scrub_stamp":"2024-09-12T02:40:15.677976+0000","last_clean_scrub_stamp":"2024-09-12T02:40:15.677976+0000","objects_scrubbed":0,"log_size":4521,"log_dups_size":0,"ondisk_log_size":4521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:21.396118+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22817,"num_write_kb":263525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"28'4994","reported_seq":5034,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:20.890132+0000","last_change":"2024-09-12T02:40:20.890163+0000","last_active":"2024-09-12T02:40:20.890132+0000","last_peered":"2024-09-12T02:40:20.890132+0000","last_clean":"2024-09-12T02:40:20.890132+0000","last_became_active":"2024-09-12T02:23:04.782878+0000","last_became_peered":"2024-09-12T02:23:04.782878+0000","last_unstale":"2024-09-12T02:40:20.890132+0000","last_undegraded":"2024-09-12T02:40:20.890132+0000","last_fullsized":"2024-09-12T02:40:20.890132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4994","last_scrub_stamp":"2024-09-12T02:40:20.890007+0000","last_deep_scrub":"28'4994","last_deep_scrub_stamp":"2024-09-12T02:40:20.890007+0000","last_clean_scrub_stamp":"2024-09-12T02:40:20.890007+0000","objects_scrubbed":0,"log_size":4994,"log_dups_size":0,"ondisk_log_size":4994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:42.666546+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25629,"num_write_kb":307571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'2","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:18.781671+0000","last_change":"2024-09-12T02:40:18.781697+0000","last_active":"2024-09-12T02:40:18.781671+0000","last_peered":"2024-09-12T02:40:18.781671+0000","last_clean":"2024-09-12T02:40:18.781671+0000","last_became_active":"2024-09-12T02:23:03.762164+0000","last_became_peered":"2024-09-12T02:23:03.762164+0000","last_unstale":"2024-09-12T02:40:18.781671+0000","last_undegraded":"2024-09-12T02:40:18.781671+0000","last_fullsized":"2024-09-12T02:40:18.781671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2024-09-12T02:40:18.781584+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2024-09-12T02:40:18.781584+0000","last_clean_scrub_stamp":"2024-09-12T02:40:18.781584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:19.839354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"28'4","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:29.885379+0000","last_change":"2024-09-12T02:40:29.885420+0000","last_active":"2024-09-12T02:40:29.885379+0000","last_peered":"2024-09-12T02:40:29.885379+0000","last_clean":"2024-09-12T02:40:29.885379+0000","last_became_active":"2024-09-12T02:23:15.830471+0000","last_became_peered":"2024-09-12T02:23:15.830471+0000","last_unstale":"2024-09-12T02:40:29.885379+0000","last_undegraded":"2024-09-12T02:40:29.885379+0000","last_fullsized":"2024-09-12T02:40:29.885379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-09-12T02:40:29.885289+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-09-12T02:40:29.885289+0000","last_clean_scrub_stamp":"2024-09-12T02:40:29.885289+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:46.319381+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"28'4580","reported_seq":4612,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:29.728303+0000","last_change":"2024-09-12T02:40:29.728327+0000","last_active":"2024-09-12T02:40:29.728303+0000","last_peered":"2024-09-12T02:40:29.728303+0000","last_clean":"2024-09-12T02:40:29.728303+0000","last_became_active":"2024-09-12T02:23:16.855992+0000","last_became_peered":"2024-09-12T02:23:16.855992+0000","last_unstale":"2024-09-12T02:40:29.728303+0000","last_undegraded":"2024-09-12T02:40:29.728303+0000","last_fullsized":"2024-09-12T02:40:29.728303+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4580","last_scrub_stamp":"2024-09-12T02:40:29.728218+0000","last_deep_scrub":"28'4580","last_deep_scrub_stamp":"2024-09-12T02:40:29.728218+0000","last_clean_scrub_stamp":"2024-09-12T02:40:29.728218+0000","objects_scrubbed":0,"log_size":4580,"log_dups_size":0,"ondisk_log_size":4580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:15.656575+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24326,"num_write_kb":281766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"28'4821","reported_seq":4861,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:33.473412+0000","last_change":"2024-09-12T02:40:33.473442+0000","last_active":"2024-09-12T02:40:33.473412+0000","last_peered":"2024-09-12T02:40:33.473412+0000","last_clean":"2024-09-12T02:40:33.473412+0000","last_became_active":"2024-09-12T02:23:04.784012+0000","last_became_peered":"2024-09-12T02:23:04.784012+0000","last_unstale":"2024-09-12T02:40:33.473412+0000","last_undegraded":"2024-09-12T02:40:33.473412+0000","last_fullsized":"2024-09-12T02:40:33.473412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4821","last_scrub_stamp":"2024-09-12T02:40:33.473299+0000","last_deep_scrub":"28'4821","last_deep_scrub_stamp":"2024-09-12T02:40:33.473299+0000","last_clean_scrub_stamp":"2024-09-12T02:40:33.473299+0000","objects_scrubbed":0,"log_size":4821,"log_dups_size":0,"ondisk_log_size":4821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:17.482788+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24805,"num_write_kb":312357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"28'3","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:23.849273+0000","last_change":"2024-09-12T02:40:23.849306+0000","last_active":"2024-09-12T02:40:23.849273+0000","last_peered":"2024-09-12T02:40:23.849273+0000","last_clean":"2024-09-12T02:40:23.849273+0000","last_became_active":"2024-09-12T02:23:03.765735+0000","last_became_peered":"2024-09-12T02:23:03.765735+0000","last_unstale":"2024-09-12T02:40:23.849273+0000","last_undegraded":"2024-09-12T02:40:23.849273+0000","last_fullsized":"2024-09-12T02:40:23.849273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-09-12T02:40:23.849177+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-09-12T02:40:23.849177+0000","last_clean_scrub_stamp":"2024-09-12T02:40:23.849177+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:32:06.494824+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"28'1087","reported_seq":1121,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:27.633452+0000","last_change":"2024-09-12T02:40:27.633486+0000","last_active":"2024-09-12T02:40:27.633452+0000","last_peered":"2024-09-12T02:40:27.633452+0000","last_clean":"2024-09-12T02:40:27.633452+0000","last_became_active":"2024-09-12T02:23:15.832184+0000","last_became_peered":"2024-09-12T02:23:15.832184+0000","last_unstale":"2024-09-12T02:40:27.633452+0000","last_undegraded":"2024-09-12T02:40:27.633452+0000","last_fullsized":"2024-09-12T02:40:27.633452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1087","last_scrub_stamp":"2024-09-12T02:40:27.633325+0000","last_deep_scrub":"28'1087","last_deep_scrub_stamp":"2024-09-12T02:40:27.633325+0000","last_clean_scrub_stamp":"2024-09-12T02:40:27.633325+0000","objects_scrubbed":2,"log_size":1087,"log_dups_size":0,"ondisk_log_size":1087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:22:02.687618+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1076,"num_write_kb":4403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"28'4868","reported_seq":4892,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.723585+0000","last_change":"2024-09-12T02:23:16.849357+0000","last_active":"2024-09-12T02:40:04.723585+0000","last_peered":"2024-09-12T02:40:04.723585+0000","last_clean":"2024-09-12T02:40:04.723585+0000","last_became_active":"2024-09-12T02:23:16.849067+0000","last_became_peered":"2024-09-12T02:23:16.849067+0000","last_unstale":"2024-09-12T02:40:04.723585+0000","last_undegraded":"2024-09-12T02:40:04.723585+0000","last_fullsized":"2024-09-12T02:40:04.723585+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4868,"log_dups_size":0,"ondisk_log_size":4868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24798,"num_write_kb":291891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"28'5524","reported_seq":5564,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:17.801412+0000","last_change":"2024-09-12T02:40:17.801439+0000","last_active":"2024-09-12T02:40:17.801412+0000","last_peered":"2024-09-12T02:40:17.801412+0000","last_clean":"2024-09-12T02:40:17.801412+0000","last_became_active":"2024-09-12T02:23:04.790707+0000","last_became_peered":"2024-09-12T02:23:04.790707+0000","last_unstale":"2024-09-12T02:40:17.801412+0000","last_undegraded":"2024-09-12T02:40:17.801412+0000","last_fullsized":"2024-09-12T02:40:17.801412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5524","last_scrub_stamp":"2024-09-12T02:40:17.801291+0000","last_deep_scrub":"28'5524","last_deep_scrub_stamp":"2024-09-12T02:40:17.801291+0000","last_clean_scrub_stamp":"2024-09-12T02:40:17.801291+0000","objects_scrubbed":0,"log_size":5524,"log_dups_size":0,"ondisk_log_size":5524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:13.729996+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27879,"num_write_kb":349281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"28'7","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:19.770324+0000","last_change":"2024-09-12T02:40:19.770358+0000","last_active":"2024-09-12T02:40:19.770324+0000","last_peered":"2024-09-12T02:40:19.770324+0000","last_clean":"2024-09-12T02:40:19.770324+0000","last_became_active":"2024-09-12T02:23:03.763005+0000","last_became_peered":"2024-09-12T02:23:03.763005+0000","last_unstale":"2024-09-12T02:40:19.770324+0000","last_undegraded":"2024-09-12T02:40:19.770324+0000","last_fullsized":"2024-09-12T02:40:19.770324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-09-12T02:40:19.770235+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-09-12T02:40:19.770235+0000","last_clean_scrub_stamp":"2024-09-12T02:40:19.770235+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:49.802369+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"28'3","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:20.452407+0000","last_change":"2024-09-12T02:40:20.452435+0000","last_active":"2024-09-12T02:40:20.452407+0000","last_peered":"2024-09-12T02:40:20.452407+0000","last_clean":"2024-09-12T02:40:20.452407+0000","last_became_active":"2024-09-12T02:23:15.819370+0000","last_became_peered":"2024-09-12T02:23:15.819370+0000","last_unstale":"2024-09-12T02:40:20.452407+0000","last_undegraded":"2024-09-12T02:40:20.452407+0000","last_fullsized":"2024-09-12T02:40:20.452407+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-09-12T02:40:20.452317+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-09-12T02:40:20.452317+0000","last_clean_scrub_stamp":"2024-09-12T02:40:20.452317+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:46.128863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"28'5323","reported_seq":5355,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:16.720756+0000","last_change":"2024-09-12T02:40:16.720800+0000","last_active":"2024-09-12T02:40:16.720756+0000","last_peered":"2024-09-12T02:40:16.720756+0000","last_clean":"2024-09-12T02:40:16.720756+0000","last_became_active":"2024-09-12T02:23:16.837942+0000","last_became_peered":"2024-09-12T02:23:16.837942+0000","last_unstale":"2024-09-12T02:40:16.720756+0000","last_undegraded":"2024-09-12T02:40:16.720756+0000","last_fullsized":"2024-09-12T02:40:16.720756+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5323","last_scrub_stamp":"2024-09-12T02:40:16.720650+0000","last_deep_scrub":"28'5323","last_deep_scrub_stamp":"2024-09-12T02:40:16.720650+0000","last_clean_scrub_stamp":"2024-09-12T02:40:16.720650+0000","objects_scrubbed":0,"log_size":5323,"log_dups_size":0,"ondisk_log_size":5323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:43.957111+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28212,"num_write_kb":317995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"28'4432","reported_seq":4472,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:24.860030+0000","last_change":"2024-09-12T02:40:24.860073+0000","last_active":"2024-09-12T02:40:24.860030+0000","last_peered":"2024-09-12T02:40:24.860030+0000","last_clean":"2024-09-12T02:40:24.860030+0000","last_became_active":"2024-09-12T02:23:04.780893+0000","last_became_peered":"2024-09-12T02:23:04.780893+0000","last_unstale":"2024-09-12T02:40:24.860030+0000","last_undegraded":"2024-09-12T02:40:24.860030+0000","last_fullsized":"2024-09-12T02:40:24.860030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4432","last_scrub_stamp":"2024-09-12T02:40:24.859922+0000","last_deep_scrub":"28'4432","last_deep_scrub_stamp":"2024-09-12T02:40:24.859922+0000","last_clean_scrub_stamp":"2024-09-12T02:40:24.859922+0000","objects_scrubbed":0,"log_size":4432,"log_dups_size":0,"ondisk_log_size":4432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:06:34.409840+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22251,"num_write_kb":285885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'6","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:22.993841+0000","last_change":"2024-09-12T02:40:22.993866+0000","last_active":"2024-09-12T02:40:22.993841+0000","last_peered":"2024-09-12T02:40:22.993841+0000","last_clean":"2024-09-12T02:40:22.993841+0000","last_became_active":"2024-09-12T02:23:03.765281+0000","last_became_peered":"2024-09-12T02:23:03.765281+0000","last_unstale":"2024-09-12T02:40:22.993841+0000","last_undegraded":"2024-09-12T02:40:22.993841+0000","last_fullsized":"2024-09-12T02:40:22.993841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-09-12T02:40:22.993752+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-09-12T02:40:22.993752+0000","last_clean_scrub_stamp":"2024-09-12T02:40:22.993752+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:59.988546+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"28'3","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:21.020416+0000","last_change":"2024-09-12T02:40:21.020443+0000","last_active":"2024-09-12T02:40:21.020416+0000","last_peered":"2024-09-12T02:40:21.020416+0000","last_clean":"2024-09-12T02:40:21.020416+0000","last_became_active":"2024-09-12T02:23:15.841380+0000","last_became_peered":"2024-09-12T02:23:15.841380+0000","last_unstale":"2024-09-12T02:40:21.020416+0000","last_undegraded":"2024-09-12T02:40:21.020416+0000","last_fullsized":"2024-09-12T02:40:21.020416+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-09-12T02:40:21.020327+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-09-12T02:40:21.020327+0000","last_clean_scrub_stamp":"2024-09-12T02:40:21.020327+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:15.834118+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"28'4540","reported_seq":4564,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:13.062938+0000","last_change":"2024-09-12T02:23:16.846596+0000","last_active":"2024-09-12T02:40:13.062938+0000","last_peered":"2024-09-12T02:40:13.062938+0000","last_clean":"2024-09-12T02:40:13.062938+0000","last_became_active":"2024-09-12T02:23:16.846273+0000","last_became_peered":"2024-09-12T02:23:16.846273+0000","last_unstale":"2024-09-12T02:40:13.062938+0000","last_undegraded":"2024-09-12T02:40:13.062938+0000","last_fullsized":"2024-09-12T02:40:13.062938+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4540,"log_dups_size":0,"ondisk_log_size":4540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23721,"num_write_kb":271171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"28'4758","reported_seq":4798,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:22.944653+0000","last_change":"2024-09-12T02:40:22.944680+0000","last_active":"2024-09-12T02:40:22.944653+0000","last_peered":"2024-09-12T02:40:22.944653+0000","last_clean":"2024-09-12T02:40:22.944653+0000","last_became_active":"2024-09-12T02:23:04.781575+0000","last_became_peered":"2024-09-12T02:23:04.781575+0000","last_unstale":"2024-09-12T02:40:22.944653+0000","last_undegraded":"2024-09-12T02:40:22.944653+0000","last_fullsized":"2024-09-12T02:40:22.944653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4758","last_scrub_stamp":"2024-09-12T02:40:22.944556+0000","last_deep_scrub":"28'4758","last_deep_scrub_stamp":"2024-09-12T02:40:22.944556+0000","last_clean_scrub_stamp":"2024-09-12T02:40:22.944556+0000","objects_scrubbed":0,"log_size":4758,"log_dups_size":0,"ondisk_log_size":4758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:38.005105+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24728,"num_write_kb":299876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"28'15","reported_seq":57,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:20.729537+0000","last_change":"2024-09-12T02:40:20.729610+0000","last_active":"2024-09-12T02:40:20.729537+0000","last_peered":"2024-09-12T02:40:20.729537+0000","last_clean":"2024-09-12T02:40:20.729537+0000","last_became_active":"2024-09-12T02:23:03.771061+0000","last_became_peered":"2024-09-12T02:23:03.771061+0000","last_unstale":"2024-09-12T02:40:20.729537+0000","last_undegraded":"2024-09-12T02:40:20.729537+0000","last_fullsized":"2024-09-12T02:40:20.729537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'15","last_scrub_stamp":"2024-09-12T02:40:20.729440+0000","last_deep_scrub":"28'15","last_deep_scrub_stamp":"2024-09-12T02:40:20.729440+0000","last_clean_scrub_stamp":"2024-09-12T02:40:20.729440+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:30.145300+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"28'2","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:28.645670+0000","last_change":"2024-09-12T02:40:28.645699+0000","last_active":"2024-09-12T02:40:28.645670+0000","last_peered":"2024-09-12T02:40:28.645670+0000","last_clean":"2024-09-12T02:40:28.645670+0000","last_became_active":"2024-09-12T02:23:15.831707+0000","last_became_peered":"2024-09-12T02:23:15.831707+0000","last_unstale":"2024-09-12T02:40:28.645670+0000","last_undegraded":"2024-09-12T02:40:28.645670+0000","last_fullsized":"2024-09-12T02:40:28.645670+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2024-09-12T02:40:28.645553+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2024-09-12T02:40:28.645553+0000","last_clean_scrub_stamp":"2024-09-12T02:40:28.645553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:10.189800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"28'5063","reported_seq":5087,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:14.631758+0000","last_change":"2024-09-12T02:23:16.858757+0000","last_active":"2024-09-12T02:40:14.631758+0000","last_peered":"2024-09-12T02:40:14.631758+0000","last_clean":"2024-09-12T02:40:14.631758+0000","last_became_active":"2024-09-12T02:23:16.858469+0000","last_became_peered":"2024-09-12T02:23:16.858469+0000","last_unstale":"2024-09-12T02:40:14.631758+0000","last_undegraded":"2024-09-12T02:40:14.631758+0000","last_fullsized":"2024-09-12T02:40:14.631758+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5063,"log_dups_size":0,"ondisk_log_size":5063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25554,"num_write_kb":307334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"28'4968","reported_seq":5008,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:25.950759+0000","last_change":"2024-09-12T02:40:25.950806+0000","last_active":"2024-09-12T02:40:25.950759+0000","last_peered":"2024-09-12T02:40:25.950759+0000","last_clean":"2024-09-12T02:40:25.950759+0000","last_became_active":"2024-09-12T02:23:04.784977+0000","last_became_peered":"2024-09-12T02:23:04.784977+0000","last_unstale":"2024-09-12T02:40:25.950759+0000","last_undegraded":"2024-09-12T02:40:25.950759+0000","last_fullsized":"2024-09-12T02:40:25.950759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4968","last_scrub_stamp":"2024-09-12T02:40:25.950642+0000","last_deep_scrub":"28'4968","last_deep_scrub_stamp":"2024-09-12T02:40:25.950642+0000","last_clean_scrub_stamp":"2024-09-12T02:40:25.950642+0000","objects_scrubbed":0,"log_size":4968,"log_dups_size":0,"ondisk_log_size":4968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:28:10.954447+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25338,"num_write_kb":318642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"28'6","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:20.996192+0000","last_change":"2024-09-12T02:40:20.996215+0000","last_active":"2024-09-12T02:40:20.996192+0000","last_peered":"2024-09-12T02:40:20.996192+0000","last_clean":"2024-09-12T02:40:20.996192+0000","last_became_active":"2024-09-12T02:23:03.767066+0000","last_became_peered":"2024-09-12T02:23:03.767066+0000","last_unstale":"2024-09-12T02:40:20.996192+0000","last_undegraded":"2024-09-12T02:40:20.996192+0000","last_fullsized":"2024-09-12T02:40:20.996192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-09-12T02:40:20.996103+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-09-12T02:40:20.996103+0000","last_clean_scrub_stamp":"2024-09-12T02:40:20.996103+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:29.667425+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"28'2","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:16.926159+0000","last_change":"2024-09-12T02:40:16.926207+0000","last_active":"2024-09-12T02:40:16.926159+0000","last_peered":"2024-09-12T02:40:16.926159+0000","last_clean":"2024-09-12T02:40:16.926159+0000","last_became_active":"2024-09-12T02:23:15.825779+0000","last_became_peered":"2024-09-12T02:23:15.825779+0000","last_unstale":"2024-09-12T02:40:16.926159+0000","last_undegraded":"2024-09-12T02:40:16.926159+0000","last_fullsized":"2024-09-12T02:40:16.926159+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2024-09-12T02:40:16.926073+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2024-09-12T02:40:16.926073+0000","last_clean_scrub_stamp":"2024-09-12T02:40:16.926073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:40.948605+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"28'5278","reported_seq":5302,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:14.631731+0000","last_change":"2024-09-12T02:23:16.856543+0000","last_active":"2024-09-12T02:40:14.631731+0000","last_peered":"2024-09-12T02:40:14.631731+0000","last_clean":"2024-09-12T02:40:14.631731+0000","last_became_active":"2024-09-12T02:23:16.855538+0000","last_became_peered":"2024-09-12T02:23:16.855538+0000","last_unstale":"2024-09-12T02:40:14.631731+0000","last_undegraded":"2024-09-12T02:40:14.631731+0000","last_fullsized":"2024-09-12T02:40:14.631731+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5278,"log_dups_size":0,"ondisk_log_size":5278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27222,"num_write_kb":301662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'5225","reported_seq":5265,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:18.848092+0000","last_change":"2024-09-12T02:40:18.848122+0000","last_active":"2024-09-12T02:40:18.848092+0000","last_peered":"2024-09-12T02:40:18.848092+0000","last_clean":"2024-09-12T02:40:18.848092+0000","last_became_active":"2024-09-12T02:23:04.783399+0000","last_became_peered":"2024-09-12T02:23:04.783399+0000","last_unstale":"2024-09-12T02:40:18.848092+0000","last_undegraded":"2024-09-12T02:40:18.848092+0000","last_fullsized":"2024-09-12T02:40:18.848092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5225","last_scrub_stamp":"2024-09-12T02:40:18.847991+0000","last_deep_scrub":"28'5225","last_deep_scrub_stamp":"2024-09-12T02:40:18.847991+0000","last_clean_scrub_stamp":"2024-09-12T02:40:18.847991+0000","objects_scrubbed":0,"log_size":5225,"log_dups_size":0,"ondisk_log_size":5225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:55.252083+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26678,"num_write_kb":336266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'5","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:30.527397+0000","last_change":"2024-09-12T02:40:30.527426+0000","last_active":"2024-09-12T02:40:30.527397+0000","last_peered":"2024-09-12T02:40:30.527397+0000","last_clean":"2024-09-12T02:40:30.527397+0000","last_became_active":"2024-09-12T02:23:03.766551+0000","last_became_peered":"2024-09-12T02:23:03.766551+0000","last_unstale":"2024-09-12T02:40:30.527397+0000","last_undegraded":"2024-09-12T02:40:30.527397+0000","last_fullsized":"2024-09-12T02:40:30.527397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-09-12T02:40:30.527309+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-09-12T02:40:30.527309+0000","last_clean_scrub_stamp":"2024-09-12T02:40:30.527309+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:35.375498+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"28'302","reported_seq":336,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:19.897746+0000","last_change":"2024-09-12T02:40:19.897779+0000","last_active":"2024-09-12T02:40:19.897746+0000","last_peered":"2024-09-12T02:40:19.897746+0000","last_clean":"2024-09-12T02:40:19.897746+0000","last_became_active":"2024-09-12T02:23:15.832152+0000","last_became_peered":"2024-09-12T02:23:15.832152+0000","last_unstale":"2024-09-12T02:40:19.897746+0000","last_undegraded":"2024-09-12T02:40:19.897746+0000","last_fullsized":"2024-09-12T02:40:19.897746+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'302","last_scrub_stamp":"2024-09-12T02:40:19.897661+0000","last_deep_scrub":"28'302","last_deep_scrub_stamp":"2024-09-12T02:40:19.897661+0000","last_clean_scrub_stamp":"2024-09-12T02:40:19.897661+0000","objects_scrubbed":4,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:05:00.953471+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295,"num_write_kb":4246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"28'6304","reported_seq":6328,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.731488+0000","last_change":"2024-09-12T02:23:16.846920+0000","last_active":"2024-09-12T02:40:04.731488+0000","last_peered":"2024-09-12T02:40:04.731488+0000","last_clean":"2024-09-12T02:40:04.731488+0000","last_became_active":"2024-09-12T02:23:16.846454+0000","last_became_peered":"2024-09-12T02:23:16.846454+0000","last_unstale":"2024-09-12T02:40:04.731488+0000","last_undegraded":"2024-09-12T02:40:04.731488+0000","last_fullsized":"2024-09-12T02:40:04.731488+0000","mapping_epoch":24,"log_start":"28'1100","ondisk_log_start":"28'1100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5204,"log_dups_size":0,"ondisk_log_size":5204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31934,"num_write_kb":398820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"28'4402","reported_seq":4442,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:25.654086+0000","last_change":"2024-09-12T02:40:25.654115+0000","last_active":"2024-09-12T02:40:25.654086+0000","last_peered":"2024-09-12T02:40:25.654086+0000","last_clean":"2024-09-12T02:40:25.654086+0000","last_became_active":"2024-09-12T02:23:04.784094+0000","last_became_peered":"2024-09-12T02:23:04.784094+0000","last_unstale":"2024-09-12T02:40:25.654086+0000","last_undegraded":"2024-09-12T02:40:25.654086+0000","last_fullsized":"2024-09-12T02:40:25.654086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4402","last_scrub_stamp":"2024-09-12T02:40:25.653986+0000","last_deep_scrub":"28'4402","last_deep_scrub_stamp":"2024-09-12T02:40:25.653986+0000","last_clean_scrub_stamp":"2024-09-12T02:40:25.653986+0000","objects_scrubbed":0,"log_size":4402,"log_dups_size":0,"ondisk_log_size":4402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:12.058889+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22399,"num_write_kb":282193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"28'10","reported_seq":52,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:20.726063+0000","last_change":"2024-09-12T02:40:20.726094+0000","last_active":"2024-09-12T02:40:20.726063+0000","last_peered":"2024-09-12T02:40:20.726063+0000","last_clean":"2024-09-12T02:40:20.726063+0000","last_became_active":"2024-09-12T02:23:03.762557+0000","last_became_peered":"2024-09-12T02:23:03.762557+0000","last_unstale":"2024-09-12T02:40:20.726063+0000","last_undegraded":"2024-09-12T02:40:20.726063+0000","last_fullsized":"2024-09-12T02:40:20.726063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'10","last_scrub_stamp":"2024-09-12T02:40:20.725970+0000","last_deep_scrub":"28'10","last_deep_scrub_stamp":"2024-09-12T02:40:20.725970+0000","last_clean_scrub_stamp":"2024-09-12T02:40:20.725970+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:26.834452+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"28'36","reported_seq":70,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:22.453090+0000","last_change":"2024-09-12T02:40:22.453146+0000","last_active":"2024-09-12T02:40:22.453090+0000","last_peered":"2024-09-12T02:40:22.453090+0000","last_clean":"2024-09-12T02:40:22.453090+0000","last_became_active":"2024-09-12T02:23:15.822441+0000","last_became_peered":"2024-09-12T02:23:15.822441+0000","last_unstale":"2024-09-12T02:40:22.453090+0000","last_undegraded":"2024-09-12T02:40:22.453090+0000","last_fullsized":"2024-09-12T02:40:22.453090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'36","last_scrub_stamp":"2024-09-12T02:40:22.452984+0000","last_deep_scrub":"28'36","last_deep_scrub_stamp":"2024-09-12T02:40:22.452984+0000","last_clean_scrub_stamp":"2024-09-12T02:40:22.452984+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:11.810569+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"28'5704","reported_seq":5736,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:27.839735+0000","last_change":"2024-09-12T02:40:27.839760+0000","last_active":"2024-09-12T02:40:27.839735+0000","last_peered":"2024-09-12T02:40:27.839735+0000","last_clean":"2024-09-12T02:40:27.839735+0000","last_became_active":"2024-09-12T02:23:16.838277+0000","last_became_peered":"2024-09-12T02:23:16.838277+0000","last_unstale":"2024-09-12T02:40:27.839735+0000","last_undegraded":"2024-09-12T02:40:27.839735+0000","last_fullsized":"2024-09-12T02:40:27.839735+0000","mapping_epoch":24,"log_start":"28'500","ondisk_log_start":"28'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5704","last_scrub_stamp":"2024-09-12T02:40:27.839629+0000","last_deep_scrub":"28'5704","last_deep_scrub_stamp":"2024-09-12T02:40:27.839629+0000","last_clean_scrub_stamp":"2024-09-12T02:40:27.839629+0000","objects_scrubbed":0,"log_size":5204,"log_dups_size":0,"ondisk_log_size":5204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:24:18.862929+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29050,"num_write_kb":345934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"28'4440","reported_seq":4480,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:26.858097+0000","last_change":"2024-09-12T02:40:26.858123+0000","last_active":"2024-09-12T02:40:26.858097+0000","last_peered":"2024-09-12T02:40:26.858097+0000","last_clean":"2024-09-12T02:40:26.858097+0000","last_became_active":"2024-09-12T02:23:04.780475+0000","last_became_peered":"2024-09-12T02:23:04.780475+0000","last_unstale":"2024-09-12T02:40:26.858097+0000","last_undegraded":"2024-09-12T02:40:26.858097+0000","last_fullsized":"2024-09-12T02:40:26.858097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4440","last_scrub_stamp":"2024-09-12T02:40:26.857993+0000","last_deep_scrub":"28'4440","last_deep_scrub_stamp":"2024-09-12T02:40:26.857993+0000","last_clean_scrub_stamp":"2024-09-12T02:40:26.857993+0000","objects_scrubbed":0,"log_size":4440,"log_dups_size":0,"ondisk_log_size":4440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:06.397140+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22736,"num_write_kb":283554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'343","reported_seq":385,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:23.063830+0000","last_change":"2024-09-12T02:40:23.063860+0000","last_active":"2024-09-12T02:40:23.063830+0000","last_peered":"2024-09-12T02:40:23.063830+0000","last_clean":"2024-09-12T02:40:23.063830+0000","last_became_active":"2024-09-12T02:23:03.768092+0000","last_became_peered":"2024-09-12T02:23:03.768092+0000","last_unstale":"2024-09-12T02:40:23.063830+0000","last_undegraded":"2024-09-12T02:40:23.063830+0000","last_fullsized":"2024-09-12T02:40:23.063830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'343","last_scrub_stamp":"2024-09-12T02:40:23.063748+0000","last_deep_scrub":"28'343","last_deep_scrub_stamp":"2024-09-12T02:40:23.063748+0000","last_clean_scrub_stamp":"2024-09-12T02:40:23.063748+0000","objects_scrubbed":4,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:30.369339+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"28'5","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:19.865912+0000","last_change":"2024-09-12T02:40:19.865941+0000","last_active":"2024-09-12T02:40:19.865912+0000","last_peered":"2024-09-12T02:40:19.865912+0000","last_clean":"2024-09-12T02:40:19.865912+0000","last_became_active":"2024-09-12T02:23:15.827936+0000","last_became_peered":"2024-09-12T02:23:15.827936+0000","last_unstale":"2024-09-12T02:40:19.865912+0000","last_undegraded":"2024-09-12T02:40:19.865912+0000","last_fullsized":"2024-09-12T02:40:19.865912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-09-12T02:40:19.865803+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-09-12T02:40:19.865803+0000","last_clean_scrub_stamp":"2024-09-12T02:40:19.865803+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:55:16.187205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"28'4960","reported_seq":4984,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.685176+0000","last_change":"2024-09-12T02:23:16.854209+0000","last_active":"2024-09-12T02:40:04.685176+0000","last_peered":"2024-09-12T02:40:04.685176+0000","last_clean":"2024-09-12T02:40:04.685176+0000","last_became_active":"2024-09-12T02:23:16.853900+0000","last_became_peered":"2024-09-12T02:23:16.853900+0000","last_unstale":"2024-09-12T02:40:04.685176+0000","last_undegraded":"2024-09-12T02:40:04.685176+0000","last_fullsized":"2024-09-12T02:40:04.685176+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4960,"log_dups_size":0,"ondisk_log_size":4960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25526,"num_write_kb":294821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'6032","reported_seq":6072,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:24.945641+0000","last_change":"2024-09-12T02:40:24.945664+0000","last_active":"2024-09-12T02:40:24.945641+0000","last_peered":"2024-09-12T02:40:24.945641+0000","last_clean":"2024-09-12T02:40:24.945641+0000","last_became_active":"2024-09-12T02:23:04.777081+0000","last_became_peered":"2024-09-12T02:23:04.777081+0000","last_unstale":"2024-09-12T02:40:24.945641+0000","last_undegraded":"2024-09-12T02:40:24.945641+0000","last_fullsized":"2024-09-12T02:40:24.945641+0000","mapping_epoch":20,"log_start":"28'500","ondisk_log_start":"28'500","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6032","last_scrub_stamp":"2024-09-12T02:40:24.945540+0000","last_deep_scrub":"28'6032","last_deep_scrub_stamp":"2024-09-12T02:40:24.945540+0000","last_clean_scrub_stamp":"2024-09-12T02:40:24.945540+0000","objects_scrubbed":0,"log_size":5532,"log_dups_size":0,"ondisk_log_size":5532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:56.794956+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30497,"num_write_kb":392872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'37","reported_seq":79,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:27.697270+0000","last_change":"2024-09-12T02:40:27.697300+0000","last_active":"2024-09-12T02:40:27.697270+0000","last_peered":"2024-09-12T02:40:27.697270+0000","last_clean":"2024-09-12T02:40:27.697270+0000","last_became_active":"2024-09-12T02:23:03.769601+0000","last_became_peered":"2024-09-12T02:23:03.769601+0000","last_unstale":"2024-09-12T02:40:27.697270+0000","last_undegraded":"2024-09-12T02:40:27.697270+0000","last_fullsized":"2024-09-12T02:40:27.697270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'37","last_scrub_stamp":"2024-09-12T02:40:27.697183+0000","last_deep_scrub":"28'37","last_deep_scrub_stamp":"2024-09-12T02:40:27.697183+0000","last_clean_scrub_stamp":"2024-09-12T02:40:27.697183+0000","objects_scrubbed":2,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:32.258338+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"28'10","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:21.992807+0000","last_change":"2024-09-12T02:40:21.992842+0000","last_active":"2024-09-12T02:40:21.992807+0000","last_peered":"2024-09-12T02:40:21.992807+0000","last_clean":"2024-09-12T02:40:21.992807+0000","last_became_active":"2024-09-12T02:23:15.831220+0000","last_became_peered":"2024-09-12T02:23:15.831220+0000","last_unstale":"2024-09-12T02:40:21.992807+0000","last_undegraded":"2024-09-12T02:40:21.992807+0000","last_fullsized":"2024-09-12T02:40:21.992807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'10","last_scrub_stamp":"2024-09-12T02:40:21.992720+0000","last_deep_scrub":"28'10","last_deep_scrub_stamp":"2024-09-12T02:40:21.992720+0000","last_clean_scrub_stamp":"2024-09-12T02:40:21.992720+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:26.531592+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"28'5159","reported_seq":5183,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.732168+0000","last_change":"2024-09-12T02:23:16.858361+0000","last_active":"2024-09-12T02:40:04.732168+0000","last_peered":"2024-09-12T02:40:04.732168+0000","last_clean":"2024-09-12T02:40:04.732168+0000","last_became_active":"2024-09-12T02:23:16.858075+0000","last_became_peered":"2024-09-12T02:23:16.858075+0000","last_unstale":"2024-09-12T02:40:04.732168+0000","last_undegraded":"2024-09-12T02:40:04.732168+0000","last_fullsized":"2024-09-12T02:40:04.732168+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5159,"log_dups_size":0,"ondisk_log_size":5159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27123,"num_write_kb":309496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"28'3733","reported_seq":3773,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:23.708207+0000","last_change":"2024-09-12T02:40:23.708236+0000","last_active":"2024-09-12T02:40:23.708207+0000","last_peered":"2024-09-12T02:40:23.708207+0000","last_clean":"2024-09-12T02:40:23.708207+0000","last_became_active":"2024-09-12T02:23:04.778850+0000","last_became_peered":"2024-09-12T02:23:04.778850+0000","last_unstale":"2024-09-12T02:40:23.708207+0000","last_undegraded":"2024-09-12T02:40:23.708207+0000","last_fullsized":"2024-09-12T02:40:23.708207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3733","last_scrub_stamp":"2024-09-12T02:40:23.708118+0000","last_deep_scrub":"28'3733","last_deep_scrub_stamp":"2024-09-12T02:40:23.708118+0000","last_clean_scrub_stamp":"2024-09-12T02:40:23.708118+0000","objects_scrubbed":0,"log_size":3733,"log_dups_size":0,"ondisk_log_size":3733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:57:49.623600+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19250,"num_write_kb":253251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'2","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:31.481765+0000","last_change":"2024-09-12T02:40:31.481793+0000","last_active":"2024-09-12T02:40:31.481765+0000","last_peered":"2024-09-12T02:40:31.481765+0000","last_clean":"2024-09-12T02:40:31.481765+0000","last_became_active":"2024-09-12T02:23:03.769436+0000","last_became_peered":"2024-09-12T02:23:03.769436+0000","last_unstale":"2024-09-12T02:40:31.481765+0000","last_undegraded":"2024-09-12T02:40:31.481765+0000","last_fullsized":"2024-09-12T02:40:31.481765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2024-09-12T02:40:31.481675+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2024-09-12T02:40:31.481675+0000","last_clean_scrub_stamp":"2024-09-12T02:40:31.481675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:00.700829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"28'16","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:23.869770+0000","last_change":"2024-09-12T02:40:23.869809+0000","last_active":"2024-09-12T02:40:23.869770+0000","last_peered":"2024-09-12T02:40:23.869770+0000","last_clean":"2024-09-12T02:40:23.869770+0000","last_became_active":"2024-09-12T02:23:15.832873+0000","last_became_peered":"2024-09-12T02:23:15.832873+0000","last_unstale":"2024-09-12T02:40:23.869770+0000","last_undegraded":"2024-09-12T02:40:23.869770+0000","last_fullsized":"2024-09-12T02:40:23.869770+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'16","last_scrub_stamp":"2024-09-12T02:40:23.869673+0000","last_deep_scrub":"28'16","last_deep_scrub_stamp":"2024-09-12T02:40:23.869673+0000","last_clean_scrub_stamp":"2024-09-12T02:40:23.869673+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:29.039802+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"28'5308","reported_seq":5332,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.736432+0000","last_change":"2024-09-12T02:23:16.856735+0000","last_active":"2024-09-12T02:40:04.736432+0000","last_peered":"2024-09-12T02:40:04.736432+0000","last_clean":"2024-09-12T02:40:04.736432+0000","last_became_active":"2024-09-12T02:23:16.856455+0000","last_became_peered":"2024-09-12T02:23:16.856455+0000","last_unstale":"2024-09-12T02:40:04.736432+0000","last_undegraded":"2024-09-12T02:40:04.736432+0000","last_fullsized":"2024-09-12T02:40:04.736432+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5308,"log_dups_size":0,"ondisk_log_size":5308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27382,"num_write_kb":326846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"28'4524","reported_seq":4564,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:27.566241+0000","last_change":"2024-09-12T02:40:27.566266+0000","last_active":"2024-09-12T02:40:27.566241+0000","last_peered":"2024-09-12T02:40:27.566241+0000","last_clean":"2024-09-12T02:40:27.566241+0000","last_became_active":"2024-09-12T02:23:04.785795+0000","last_became_peered":"2024-09-12T02:23:04.785795+0000","last_unstale":"2024-09-12T02:40:27.566241+0000","last_undegraded":"2024-09-12T02:40:27.566241+0000","last_fullsized":"2024-09-12T02:40:27.566241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4524","last_scrub_stamp":"2024-09-12T02:40:27.566138+0000","last_deep_scrub":"28'4524","last_deep_scrub_stamp":"2024-09-12T02:40:27.566138+0000","last_clean_scrub_stamp":"2024-09-12T02:40:27.566138+0000","objects_scrubbed":0,"log_size":4524,"log_dups_size":0,"ondisk_log_size":4524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:25.680921+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22689,"num_write_kb":295834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"28'2","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:24.003239+0000","last_change":"2024-09-12T02:40:24.003265+0000","last_active":"2024-09-12T02:40:24.003239+0000","last_peered":"2024-09-12T02:40:24.003239+0000","last_clean":"2024-09-12T02:40:24.003239+0000","last_became_active":"2024-09-12T02:23:03.769302+0000","last_became_peered":"2024-09-12T02:23:03.769302+0000","last_unstale":"2024-09-12T02:40:24.003239+0000","last_undegraded":"2024-09-12T02:40:24.003239+0000","last_fullsized":"2024-09-12T02:40:24.003239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2024-09-12T02:40:24.003157+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2024-09-12T02:40:24.003157+0000","last_clean_scrub_stamp":"2024-09-12T02:40:24.003157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:13.113939+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"28'6","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:18.838303+0000","last_change":"2024-09-12T02:40:18.838331+0000","last_active":"2024-09-12T02:40:18.838303+0000","last_peered":"2024-09-12T02:40:18.838303+0000","last_clean":"2024-09-12T02:40:18.838303+0000","last_became_active":"2024-09-12T02:23:15.825305+0000","last_became_peered":"2024-09-12T02:23:15.825305+0000","last_unstale":"2024-09-12T02:40:18.838303+0000","last_undegraded":"2024-09-12T02:40:18.838303+0000","last_fullsized":"2024-09-12T02:40:18.838303+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-09-12T02:40:18.838207+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-09-12T02:40:18.838207+0000","last_clean_scrub_stamp":"2024-09-12T02:40:18.838207+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:19.521394+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"28'6585","reported_seq":6610,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.697471+0000","last_change":"2024-09-12T02:23:16.852415+0000","last_active":"2024-09-12T02:40:04.697471+0000","last_peered":"2024-09-12T02:40:04.697471+0000","last_clean":"2024-09-12T02:40:04.697471+0000","last_became_active":"2024-09-12T02:23:16.852061+0000","last_became_peered":"2024-09-12T02:23:16.852061+0000","last_unstale":"2024-09-12T02:40:04.697471+0000","last_undegraded":"2024-09-12T02:40:04.697471+0000","last_fullsized":"2024-09-12T02:40:04.697471+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":6585,"log_dups_size":0,"ondisk_log_size":6585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34694,"num_write_kb":385000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"28'8","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:29.686554+0000","last_change":"2024-09-12T02:40:29.686581+0000","last_active":"2024-09-12T02:40:29.686554+0000","last_peered":"2024-09-12T02:40:29.686554+0000","last_clean":"2024-09-12T02:40:29.686554+0000","last_became_active":"2024-09-12T02:23:15.832837+0000","last_became_peered":"2024-09-12T02:23:15.832837+0000","last_unstale":"2024-09-12T02:40:29.686554+0000","last_undegraded":"2024-09-12T02:40:29.686554+0000","last_fullsized":"2024-09-12T02:40:29.686554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-09-12T02:40:29.686446+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-09-12T02:40:29.686446+0000","last_clean_scrub_stamp":"2024-09-12T02:40:29.686446+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:45.460669+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"28'5783","reported_seq":5823,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:22.904666+0000","last_change":"2024-09-12T02:40:22.904695+0000","last_active":"2024-09-12T02:40:22.904666+0000","last_peered":"2024-09-12T02:40:22.904666+0000","last_clean":"2024-09-12T02:40:22.904666+0000","last_became_active":"2024-09-12T02:23:04.776270+0000","last_became_peered":"2024-09-12T02:23:04.776270+0000","last_unstale":"2024-09-12T02:40:22.904666+0000","last_undegraded":"2024-09-12T02:40:22.904666+0000","last_fullsized":"2024-09-12T02:40:22.904666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5783","last_scrub_stamp":"2024-09-12T02:40:22.904548+0000","last_deep_scrub":"28'5783","last_deep_scrub_stamp":"2024-09-12T02:40:22.904548+0000","last_clean_scrub_stamp":"2024-09-12T02:40:22.904548+0000","objects_scrubbed":0,"log_size":5783,"log_dups_size":0,"ondisk_log_size":5783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:42.112392+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29721,"num_write_kb":356762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'3","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:28.549198+0000","last_change":"2024-09-12T02:40:28.549226+0000","last_active":"2024-09-12T02:40:28.549198+0000","last_peered":"2024-09-12T02:40:28.549198+0000","last_clean":"2024-09-12T02:40:28.549198+0000","last_became_active":"2024-09-12T02:23:03.762161+0000","last_became_peered":"2024-09-12T02:23:03.762161+0000","last_unstale":"2024-09-12T02:40:28.549198+0000","last_undegraded":"2024-09-12T02:40:28.549198+0000","last_fullsized":"2024-09-12T02:40:28.549198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-09-12T02:40:28.549110+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-09-12T02:40:28.549110+0000","last_clean_scrub_stamp":"2024-09-12T02:40:28.549110+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:12.038470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"28'5706","reported_seq":5739,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:32.744314+0000","last_change":"2024-09-12T02:40:32.744345+0000","last_active":"2024-09-12T02:40:32.744314+0000","last_peered":"2024-09-12T02:40:32.744314+0000","last_clean":"2024-09-12T02:40:32.744314+0000","last_became_active":"2024-09-12T02:23:16.844248+0000","last_became_peered":"2024-09-12T02:23:16.844248+0000","last_unstale":"2024-09-12T02:40:32.744314+0000","last_undegraded":"2024-09-12T02:40:32.744314+0000","last_fullsized":"2024-09-12T02:40:32.744314+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5706","last_scrub_stamp":"2024-09-12T02:40:32.744207+0000","last_deep_scrub":"28'5706","last_deep_scrub_stamp":"2024-09-12T02:40:32.744207+0000","last_clean_scrub_stamp":"2024-09-12T02:40:32.744207+0000","objects_scrubbed":0,"log_size":5706,"log_dups_size":0,"ondisk_log_size":5706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:42.431070+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29959,"num_write_kb":337330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"28'722","reported_seq":757,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:28.935940+0000","last_change":"2024-09-12T02:40:28.935989+0000","last_active":"2024-09-12T02:40:28.935940+0000","last_peered":"2024-09-12T02:40:28.935940+0000","last_clean":"2024-09-12T02:40:28.935940+0000","last_became_active":"2024-09-12T02:23:15.825730+0000","last_became_peered":"2024-09-12T02:23:15.825730+0000","last_unstale":"2024-09-12T02:40:28.935940+0000","last_undegraded":"2024-09-12T02:40:28.935940+0000","last_fullsized":"2024-09-12T02:40:28.935940+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'722","last_scrub_stamp":"2024-09-12T02:40:28.935816+0000","last_deep_scrub":"28'722","last_deep_scrub_stamp":"2024-09-12T02:40:28.935816+0000","last_clean_scrub_stamp":"2024-09-12T02:40:28.935816+0000","objects_scrubbed":3,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:29.111932+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":717,"num_write_kb":4509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"28'4333","reported_seq":4365,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:03.061839+0000","last_change":"2024-09-12T02:23:04.783317+0000","last_active":"2024-09-12T02:40:03.061839+0000","last_peered":"2024-09-12T02:40:03.061839+0000","last_clean":"2024-09-12T02:40:03.061839+0000","last_became_active":"2024-09-12T02:23:04.783039+0000","last_became_peered":"2024-09-12T02:23:04.783039+0000","last_unstale":"2024-09-12T02:40:03.061839+0000","last_undegraded":"2024-09-12T02:40:03.061839+0000","last_fullsized":"2024-09-12T02:40:03.061839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":4333,"log_dups_size":0,"ondisk_log_size":4333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22422,"num_write_kb":290509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'3","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:31.753834+0000","last_change":"2024-09-12T02:40:31.753862+0000","last_active":"2024-09-12T02:40:31.753834+0000","last_peered":"2024-09-12T02:40:31.753834+0000","last_clean":"2024-09-12T02:40:31.753834+0000","last_became_active":"2024-09-12T02:23:03.768137+0000","last_became_peered":"2024-09-12T02:23:03.768137+0000","last_unstale":"2024-09-12T02:40:31.753834+0000","last_undegraded":"2024-09-12T02:40:31.753834+0000","last_fullsized":"2024-09-12T02:40:31.753834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-09-12T02:40:31.753742+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-09-12T02:40:31.753742+0000","last_clean_scrub_stamp":"2024-09-12T02:40:31.753742+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:26.841882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"28'6357","reported_seq":6380,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.744311+0000","last_change":"2024-09-12T02:23:16.861251+0000","last_active":"2024-09-12T02:40:04.744311+0000","last_peered":"2024-09-12T02:40:04.744311+0000","last_clean":"2024-09-12T02:40:04.744311+0000","last_became_active":"2024-09-12T02:23:16.860980+0000","last_became_peered":"2024-09-12T02:23:16.860980+0000","last_unstale":"2024-09-12T02:40:04.744311+0000","last_undegraded":"2024-09-12T02:40:04.744311+0000","last_fullsized":"2024-09-12T02:40:04.744311+0000","mapping_epoch":24,"log_start":"28'500","ondisk_log_start":"28'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5857,"log_dups_size":0,"ondisk_log_size":5857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32865,"num_write_kb":377625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"28'95","reported_seq":137,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:22.049430+0000","last_change":"2024-09-12T02:40:22.049430+0000","last_active":"2024-09-12T02:40:22.049430+0000","last_peered":"2024-09-12T02:40:22.049430+0000","last_clean":"2024-09-12T02:40:22.049430+0000","last_became_active":"2024-09-12T02:23:03.767916+0000","last_became_peered":"2024-09-12T02:23:03.767916+0000","last_unstale":"2024-09-12T02:40:22.049430+0000","last_undegraded":"2024-09-12T02:40:22.049430+0000","last_fullsized":"2024-09-12T02:40:22.049430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'95","last_scrub_stamp":"2024-09-12T02:40:22.049307+0000","last_deep_scrub":"28'95","last_deep_scrub_stamp":"2024-09-12T02:40:22.049307+0000","last_clean_scrub_stamp":"2024-09-12T02:40:22.049307+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:50.804202+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1333026,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"28'3601","reported_seq":3640,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:15.764997+0000","last_change":"2024-09-12T02:40:15.765020+0000","last_active":"2024-09-12T02:40:15.764997+0000","last_peered":"2024-09-12T02:40:15.764997+0000","last_clean":"2024-09-12T02:40:15.764997+0000","last_became_active":"2024-09-12T02:23:04.793100+0000","last_became_peered":"2024-09-12T02:23:04.793100+0000","last_unstale":"2024-09-12T02:40:15.764997+0000","last_undegraded":"2024-09-12T02:40:15.764997+0000","last_fullsized":"2024-09-12T02:40:15.764997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3601","last_scrub_stamp":"2024-09-12T02:40:15.764903+0000","last_deep_scrub":"28'3601","last_deep_scrub_stamp":"2024-09-12T02:40:15.764903+0000","last_clean_scrub_stamp":"2024-09-12T02:40:15.764903+0000","objects_scrubbed":0,"log_size":3601,"log_dups_size":0,"ondisk_log_size":3601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:10.628567+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18077,"num_write_kb":232187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"28'4","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:23.675145+0000","last_change":"2024-09-12T02:40:23.675173+0000","last_active":"2024-09-12T02:40:23.675145+0000","last_peered":"2024-09-12T02:40:23.675145+0000","last_clean":"2024-09-12T02:40:23.675145+0000","last_became_active":"2024-09-12T02:23:15.830492+0000","last_became_peered":"2024-09-12T02:23:15.830492+0000","last_unstale":"2024-09-12T02:40:23.675145+0000","last_undegraded":"2024-09-12T02:40:23.675145+0000","last_fullsized":"2024-09-12T02:40:23.675145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-09-12T02:40:23.675067+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-09-12T02:40:23.675067+0000","last_clean_scrub_stamp":"2024-09-12T02:40:23.675067+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:57.916379+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"28'3975","reported_seq":4006,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:31.904228+0000","last_change":"2024-09-12T02:40:31.904288+0000","last_active":"2024-09-12T02:40:31.904228+0000","last_peered":"2024-09-12T02:40:31.904228+0000","last_clean":"2024-09-12T02:40:31.904228+0000","last_became_active":"2024-09-12T02:23:16.851558+0000","last_became_peered":"2024-09-12T02:23:16.851558+0000","last_unstale":"2024-09-12T02:40:31.904228+0000","last_undegraded":"2024-09-12T02:40:31.904228+0000","last_fullsized":"2024-09-12T02:40:31.904228+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3975","last_scrub_stamp":"2024-09-12T02:40:31.904137+0000","last_deep_scrub":"28'3975","last_deep_scrub_stamp":"2024-09-12T02:40:31.904137+0000","last_clean_scrub_stamp":"2024-09-12T02:40:31.904137+0000","objects_scrubbed":0,"log_size":3975,"log_dups_size":0,"ondisk_log_size":3975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:22.220821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20293,"num_write_kb":228813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'577","reported_seq":618,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:29.762281+0000","last_change":"2024-09-12T02:40:29.762352+0000","last_active":"2024-09-12T02:40:29.762281+0000","last_peered":"2024-09-12T02:40:29.762281+0000","last_clean":"2024-09-12T02:40:29.762281+0000","last_became_active":"2024-09-12T02:23:03.764020+0000","last_became_peered":"2024-09-12T02:23:03.764020+0000","last_unstale":"2024-09-12T02:40:29.762281+0000","last_undegraded":"2024-09-12T02:40:29.762281+0000","last_fullsized":"2024-09-12T02:40:29.762281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'577","last_scrub_stamp":"2024-09-12T02:40:29.762186+0000","last_deep_scrub":"28'577","last_deep_scrub_stamp":"2024-09-12T02:40:29.762186+0000","last_clean_scrub_stamp":"2024-09-12T02:40:29.762186+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:24.402854+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":574,"num_write_kb":4226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"28'4110","reported_seq":4149,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:23.953211+0000","last_change":"2024-09-12T02:40:23.953237+0000","last_active":"2024-09-12T02:40:23.953211+0000","last_peered":"2024-09-12T02:40:23.953211+0000","last_clean":"2024-09-12T02:40:23.953211+0000","last_became_active":"2024-09-12T02:23:04.771310+0000","last_became_peered":"2024-09-12T02:23:04.771310+0000","last_unstale":"2024-09-12T02:40:23.953211+0000","last_undegraded":"2024-09-12T02:40:23.953211+0000","last_fullsized":"2024-09-12T02:40:23.953211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4110","last_scrub_stamp":"2024-09-12T02:40:23.953118+0000","last_deep_scrub":"28'4110","last_deep_scrub_stamp":"2024-09-12T02:40:23.953118+0000","last_clean_scrub_stamp":"2024-09-12T02:40:23.953118+0000","objects_scrubbed":0,"log_size":4110,"log_dups_size":0,"ondisk_log_size":4110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:15.133521+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20660,"num_write_kb":258850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"28'12","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:21.868828+0000","last_change":"2024-09-12T02:40:21.868871+0000","last_active":"2024-09-12T02:40:21.868828+0000","last_peered":"2024-09-12T02:40:21.868828+0000","last_clean":"2024-09-12T02:40:21.868828+0000","last_became_active":"2024-09-12T02:23:15.832478+0000","last_became_peered":"2024-09-12T02:23:15.832478+0000","last_unstale":"2024-09-12T02:40:21.868828+0000","last_undegraded":"2024-09-12T02:40:21.868828+0000","last_fullsized":"2024-09-12T02:40:21.868828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'12","last_scrub_stamp":"2024-09-12T02:40:21.868741+0000","last_deep_scrub":"28'12","last_deep_scrub_stamp":"2024-09-12T02:40:21.868741+0000","last_clean_scrub_stamp":"2024-09-12T02:40:21.868741+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:18.966540+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"28'4897","reported_seq":4921,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.744554+0000","last_change":"2024-09-12T02:23:16.848437+0000","last_active":"2024-09-12T02:40:04.744554+0000","last_peered":"2024-09-12T02:40:04.744554+0000","last_clean":"2024-09-12T02:40:04.744554+0000","last_became_active":"2024-09-12T02:23:16.847063+0000","last_became_peered":"2024-09-12T02:23:16.847063+0000","last_unstale":"2024-09-12T02:40:04.744554+0000","last_undegraded":"2024-09-12T02:40:04.744554+0000","last_fullsized":"2024-09-12T02:40:04.744554+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4897,"log_dups_size":0,"ondisk_log_size":4897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25246,"num_write_kb":285992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"28'6383","reported_seq":6424,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:27.952009+0000","last_change":"2024-09-12T02:40:27.952044+0000","last_active":"2024-09-12T02:40:27.952009+0000","last_peered":"2024-09-12T02:40:27.952009+0000","last_clean":"2024-09-12T02:40:27.952009+0000","last_became_active":"2024-09-12T02:23:04.788195+0000","last_became_peered":"2024-09-12T02:23:04.788195+0000","last_unstale":"2024-09-12T02:40:27.952009+0000","last_undegraded":"2024-09-12T02:40:27.952009+0000","last_fullsized":"2024-09-12T02:40:27.952009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6383","last_scrub_stamp":"2024-09-12T02:40:27.951919+0000","last_deep_scrub":"28'6383","last_deep_scrub_stamp":"2024-09-12T02:40:27.951919+0000","last_clean_scrub_stamp":"2024-09-12T02:40:27.951919+0000","objects_scrubbed":0,"log_size":6383,"log_dups_size":0,"ondisk_log_size":6383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:51.236428+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32308,"num_write_kb":383454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"28'5756","reported_seq":5788,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:31.784547+0000","last_change":"2024-09-12T02:40:31.784587+0000","last_active":"2024-09-12T02:40:31.784547+0000","last_peered":"2024-09-12T02:40:31.784547+0000","last_clean":"2024-09-12T02:40:31.784547+0000","last_became_active":"2024-09-12T02:23:16.843517+0000","last_became_peered":"2024-09-12T02:23:16.843517+0000","last_unstale":"2024-09-12T02:40:31.784547+0000","last_undegraded":"2024-09-12T02:40:31.784547+0000","last_fullsized":"2024-09-12T02:40:31.784547+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5756","last_scrub_stamp":"2024-09-12T02:40:31.784446+0000","last_deep_scrub":"28'5756","last_deep_scrub_stamp":"2024-09-12T02:40:31.784446+0000","last_clean_scrub_stamp":"2024-09-12T02:40:31.784446+0000","objects_scrubbed":0,"log_size":5756,"log_dups_size":0,"ondisk_log_size":5756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:59.230987+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29883,"num_write_kb":357322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"28'5059","reported_seq":5100,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:21.710494+0000","last_change":"2024-09-12T02:40:21.710524+0000","last_active":"2024-09-12T02:40:21.710494+0000","last_peered":"2024-09-12T02:40:21.710494+0000","last_clean":"2024-09-12T02:40:21.710494+0000","last_became_active":"2024-09-12T02:23:04.780402+0000","last_became_peered":"2024-09-12T02:23:04.780402+0000","last_unstale":"2024-09-12T02:40:21.710494+0000","last_undegraded":"2024-09-12T02:40:21.710494+0000","last_fullsized":"2024-09-12T02:40:21.710494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5059","last_scrub_stamp":"2024-09-12T02:40:21.710387+0000","last_deep_scrub":"28'5059","last_deep_scrub_stamp":"2024-09-12T02:40:21.710387+0000","last_clean_scrub_stamp":"2024-09-12T02:40:21.710387+0000","objects_scrubbed":0,"log_size":5059,"log_dups_size":0,"ondisk_log_size":5059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:10:28.224158+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26551,"num_write_kb":323518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"28'4560","reported_seq":4584,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.704853+0000","last_change":"2024-09-12T02:23:16.852992+0000","last_active":"2024-09-12T02:40:04.704853+0000","last_peered":"2024-09-12T02:40:04.704853+0000","last_clean":"2024-09-12T02:40:04.704853+0000","last_became_active":"2024-09-12T02:23:16.852706+0000","last_became_peered":"2024-09-12T02:23:16.852706+0000","last_unstale":"2024-09-12T02:40:04.704853+0000","last_undegraded":"2024-09-12T02:40:04.704853+0000","last_fullsized":"2024-09-12T02:40:04.704853+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4560,"log_dups_size":0,"ondisk_log_size":4560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23787,"num_write_kb":279744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"28'5935","reported_seq":5968,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:39:57.831442+0000","last_change":"2024-09-12T02:23:04.785920+0000","last_active":"2024-09-12T02:39:57.831442+0000","last_peered":"2024-09-12T02:39:57.831442+0000","last_clean":"2024-09-12T02:39:57.831442+0000","last_became_active":"2024-09-12T02:23:04.785422+0000","last_became_peered":"2024-09-12T02:23:04.785422+0000","last_unstale":"2024-09-12T02:39:57.831442+0000","last_undegraded":"2024-09-12T02:39:57.831442+0000","last_fullsized":"2024-09-12T02:39:57.831442+0000","mapping_epoch":20,"log_start":"28'100","ondisk_log_start":"28'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5835,"log_dups_size":0,"ondisk_log_size":5835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30608,"num_write_kb":368510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"28'5374","reported_seq":5398,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.743792+0000","last_change":"2024-09-12T02:23:16.861939+0000","last_active":"2024-09-12T02:40:04.743792+0000","last_peered":"2024-09-12T02:40:04.743792+0000","last_clean":"2024-09-12T02:40:04.743792+0000","last_became_active":"2024-09-12T02:23:16.861658+0000","last_became_peered":"2024-09-12T02:23:16.861658+0000","last_unstale":"2024-09-12T02:40:04.743792+0000","last_undegraded":"2024-09-12T02:40:04.743792+0000","last_fullsized":"2024-09-12T02:40:04.743792+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5374,"log_dups_size":0,"ondisk_log_size":5374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28055,"num_write_kb":329573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"28'4234","reported_seq":4275,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:21.725986+0000","last_change":"2024-09-12T02:40:21.726017+0000","last_active":"2024-09-12T02:40:21.725986+0000","last_peered":"2024-09-12T02:40:21.725986+0000","last_clean":"2024-09-12T02:40:21.725986+0000","last_became_active":"2024-09-12T02:23:04.776736+0000","last_became_peered":"2024-09-12T02:23:04.776736+0000","last_unstale":"2024-09-12T02:40:21.725986+0000","last_undegraded":"2024-09-12T02:40:21.725986+0000","last_fullsized":"2024-09-12T02:40:21.725986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4234","last_scrub_stamp":"2024-09-12T02:40:21.725878+0000","last_deep_scrub":"28'4234","last_deep_scrub_stamp":"2024-09-12T02:40:21.725878+0000","last_clean_scrub_stamp":"2024-09-12T02:40:21.725878+0000","objects_scrubbed":0,"log_size":4234,"log_dups_size":0,"ondisk_log_size":4234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:45.420257+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21439,"num_write_kb":262018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"28'6314","reported_seq":6347,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:27.872610+0000","last_change":"2024-09-12T02:40:27.872638+0000","last_active":"2024-09-12T02:40:27.872610+0000","last_peered":"2024-09-12T02:40:27.872610+0000","last_clean":"2024-09-12T02:40:27.872610+0000","last_became_active":"2024-09-12T02:23:16.847260+0000","last_became_peered":"2024-09-12T02:23:16.847260+0000","last_unstale":"2024-09-12T02:40:27.872610+0000","last_undegraded":"2024-09-12T02:40:27.872610+0000","last_fullsized":"2024-09-12T02:40:27.872610+0000","mapping_epoch":24,"log_start":"28'500","ondisk_log_start":"28'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6314","last_scrub_stamp":"2024-09-12T02:40:27.872466+0000","last_deep_scrub":"28'6314","last_deep_scrub_stamp":"2024-09-12T02:40:27.872466+0000","last_clean_scrub_stamp":"2024-09-12T02:40:27.872466+0000","objects_scrubbed":0,"log_size":5814,"log_dups_size":0,"ondisk_log_size":5814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:31:54.371570+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32869,"num_write_kb":377542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"28'4066","reported_seq":4107,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:22.902350+0000","last_change":"2024-09-12T02:40:22.902350+0000","last_active":"2024-09-12T02:40:22.902350+0000","last_peered":"2024-09-12T02:40:22.902350+0000","last_clean":"2024-09-12T02:40:22.902350+0000","last_became_active":"2024-09-12T02:23:04.789090+0000","last_became_peered":"2024-09-12T02:23:04.789090+0000","last_unstale":"2024-09-12T02:40:22.902350+0000","last_undegraded":"2024-09-12T02:40:22.902350+0000","last_fullsized":"2024-09-12T02:40:22.902350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4066","last_scrub_stamp":"2024-09-12T02:40:22.902184+0000","last_deep_scrub":"28'4066","last_deep_scrub_stamp":"2024-09-12T02:40:22.902184+0000","last_clean_scrub_stamp":"2024-09-12T02:40:22.902184+0000","objects_scrubbed":0,"log_size":4066,"log_dups_size":0,"ondisk_log_size":4066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:14.564534+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20728,"num_write_kb":267380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"28'3925","reported_seq":3950,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.707184+0000","last_change":"2024-09-12T02:23:16.859000+0000","last_active":"2024-09-12T02:40:04.707184+0000","last_peered":"2024-09-12T02:40:04.707184+0000","last_clean":"2024-09-12T02:40:04.707184+0000","last_became_active":"2024-09-12T02:23:16.858637+0000","last_became_peered":"2024-09-12T02:23:16.858637+0000","last_unstale":"2024-09-12T02:40:04.707184+0000","last_undegraded":"2024-09-12T02:40:04.707184+0000","last_fullsized":"2024-09-12T02:40:04.707184+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":3925,"log_dups_size":0,"ondisk_log_size":3925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20092,"num_write_kb":256658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"28'5046","reported_seq":5087,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:20.839912+0000","last_change":"2024-09-12T02:40:20.839912+0000","last_active":"2024-09-12T02:40:20.839912+0000","last_peered":"2024-09-12T02:40:20.839912+0000","last_clean":"2024-09-12T02:40:20.839912+0000","last_became_active":"2024-09-12T02:23:04.776120+0000","last_became_peered":"2024-09-12T02:23:04.776120+0000","last_unstale":"2024-09-12T02:40:20.839912+0000","last_undegraded":"2024-09-12T02:40:20.839912+0000","last_fullsized":"2024-09-12T02:40:20.839912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5046","last_scrub_stamp":"2024-09-12T02:40:20.839730+0000","last_deep_scrub":"28'5046","last_deep_scrub_stamp":"2024-09-12T02:40:20.839730+0000","last_clean_scrub_stamp":"2024-09-12T02:40:20.839730+0000","objects_scrubbed":0,"log_size":5046,"log_dups_size":0,"ondisk_log_size":5046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:22.973004+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26791,"num_write_kb":324401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"28'6719","reported_seq":6744,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.751633+0000","last_change":"2024-09-12T02:23:16.856477+0000","last_active":"2024-09-12T02:40:04.751633+0000","last_peered":"2024-09-12T02:40:04.751633+0000","last_clean":"2024-09-12T02:40:04.751633+0000","last_became_active":"2024-09-12T02:23:16.855839+0000","last_became_peered":"2024-09-12T02:23:16.855839+0000","last_unstale":"2024-09-12T02:40:04.751633+0000","last_undegraded":"2024-09-12T02:40:04.751633+0000","last_fullsized":"2024-09-12T02:40:04.751633+0000","mapping_epoch":24,"log_start":"28'900","ondisk_log_start":"28'900","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5819,"log_dups_size":0,"ondisk_log_size":5819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34627,"num_write_kb":392862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"28'4165","reported_seq":4206,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:18.009874+0000","last_change":"2024-09-12T02:40:18.009874+0000","last_active":"2024-09-12T02:40:18.009874+0000","last_peered":"2024-09-12T02:40:18.009874+0000","last_clean":"2024-09-12T02:40:18.009874+0000","last_became_active":"2024-09-12T02:23:04.788521+0000","last_became_peered":"2024-09-12T02:23:04.788521+0000","last_unstale":"2024-09-12T02:40:18.009874+0000","last_undegraded":"2024-09-12T02:40:18.009874+0000","last_fullsized":"2024-09-12T02:40:18.009874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4165","last_scrub_stamp":"2024-09-12T02:40:18.009762+0000","last_deep_scrub":"28'4165","last_deep_scrub_stamp":"2024-09-12T02:40:18.009762+0000","last_clean_scrub_stamp":"2024-09-12T02:40:18.009762+0000","objects_scrubbed":0,"log_size":4165,"log_dups_size":0,"ondisk_log_size":4165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:13.630538+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21249,"num_write_kb":269852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"28'5811","reported_seq":5844,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:32.884932+0000","last_change":"2024-09-12T02:40:32.884957+0000","last_active":"2024-09-12T02:40:32.884932+0000","last_peered":"2024-09-12T02:40:32.884932+0000","last_clean":"2024-09-12T02:40:32.884932+0000","last_became_active":"2024-09-12T02:23:16.837606+0000","last_became_peered":"2024-09-12T02:23:16.837606+0000","last_unstale":"2024-09-12T02:40:32.884932+0000","last_undegraded":"2024-09-12T02:40:32.884932+0000","last_fullsized":"2024-09-12T02:40:32.884932+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5811","last_scrub_stamp":"2024-09-12T02:40:32.884837+0000","last_deep_scrub":"28'5811","last_deep_scrub_stamp":"2024-09-12T02:40:32.884837+0000","last_clean_scrub_stamp":"2024-09-12T02:40:32.884837+0000","objects_scrubbed":0,"log_size":5811,"log_dups_size":0,"ondisk_log_size":5811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:51.906443+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30267,"num_write_kb":338418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"28'5427","reported_seq":5453,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:31.788737+0000","last_change":"2024-09-12T02:40:31.788762+0000","last_active":"2024-09-12T02:40:31.788737+0000","last_peered":"2024-09-12T02:40:31.788737+0000","last_clean":"2024-09-12T02:40:31.788737+0000","last_became_active":"2024-09-12T02:23:56.563943+0000","last_became_peered":"2024-09-12T02:23:56.563943+0000","last_unstale":"2024-09-12T02:40:31.788737+0000","last_undegraded":"2024-09-12T02:40:31.788737+0000","last_fullsized":"2024-09-12T02:40:31.788737+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5427","last_scrub_stamp":"2024-09-12T02:40:31.788639+0000","last_deep_scrub":"28'5427","last_deep_scrub_stamp":"2024-09-12T02:40:31.788639+0000","last_clean_scrub_stamp":"2024-09-12T02:40:31.788639+0000","objects_scrubbed":0,"log_size":5427,"log_dups_size":0,"ondisk_log_size":5427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:21.220204+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27382,"num_write_kb":347330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"28'4215","reported_seq":4239,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.746155+0000","last_change":"2024-09-12T02:23:16.845296+0000","last_active":"2024-09-12T02:40:04.746155+0000","last_peered":"2024-09-12T02:40:04.746155+0000","last_clean":"2024-09-12T02:40:04.746155+0000","last_became_active":"2024-09-12T02:23:16.844939+0000","last_became_peered":"2024-09-12T02:23:16.844939+0000","last_unstale":"2024-09-12T02:40:04.746155+0000","last_undegraded":"2024-09-12T02:40:04.746155+0000","last_fullsized":"2024-09-12T02:40:04.746155+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4215,"log_dups_size":0,"ondisk_log_size":4215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21581,"num_write_kb":250408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'4161","reported_seq":4187,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:32.798312+0000","last_change":"2024-09-12T02:40:32.798364+0000","last_active":"2024-09-12T02:40:32.798312+0000","last_peered":"2024-09-12T02:40:32.798312+0000","last_clean":"2024-09-12T02:40:32.798312+0000","last_became_active":"2024-09-12T02:23:56.674143+0000","last_became_peered":"2024-09-12T02:23:56.674143+0000","last_unstale":"2024-09-12T02:40:32.798312+0000","last_undegraded":"2024-09-12T02:40:32.798312+0000","last_fullsized":"2024-09-12T02:40:32.798312+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4161","last_scrub_stamp":"2024-09-12T02:40:32.798196+0000","last_deep_scrub":"28'4161","last_deep_scrub_stamp":"2024-09-12T02:40:32.798196+0000","last_clean_scrub_stamp":"2024-09-12T02:40:32.798196+0000","objects_scrubbed":0,"log_size":4161,"log_dups_size":0,"ondisk_log_size":4161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:55.351042+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21422,"num_write_kb":266111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2f","version":"28'6100","reported_seq":6124,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.685129+0000","last_change":"2024-09-12T02:23:16.849846+0000","last_active":"2024-09-12T02:40:04.685129+0000","last_peered":"2024-09-12T02:40:04.685129+0000","last_clean":"2024-09-12T02:40:04.685129+0000","last_became_active":"2024-09-12T02:23:16.849585+0000","last_became_peered":"2024-09-12T02:23:16.849585+0000","last_unstale":"2024-09-12T02:40:04.685129+0000","last_undegraded":"2024-09-12T02:40:04.685129+0000","last_fullsized":"2024-09-12T02:40:04.685129+0000","mapping_epoch":24,"log_start":"28'300","ondisk_log_start":"28'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5800,"log_dups_size":0,"ondisk_log_size":5800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30891,"num_write_kb":369602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"28'4576","reported_seq":4616,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:24.914876+0000","last_change":"2024-09-12T02:40:24.914908+0000","last_active":"2024-09-12T02:40:24.914876+0000","last_peered":"2024-09-12T02:40:24.914876+0000","last_clean":"2024-09-12T02:40:24.914876+0000","last_became_active":"2024-09-12T02:23:04.788352+0000","last_became_peered":"2024-09-12T02:23:04.788352+0000","last_unstale":"2024-09-12T02:40:24.914876+0000","last_undegraded":"2024-09-12T02:40:24.914876+0000","last_fullsized":"2024-09-12T02:40:24.914876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4576","last_scrub_stamp":"2024-09-12T02:40:24.914773+0000","last_deep_scrub":"28'4576","last_deep_scrub_stamp":"2024-09-12T02:40:24.914773+0000","last_clean_scrub_stamp":"2024-09-12T02:40:24.914773+0000","objects_scrubbed":0,"log_size":4576,"log_dups_size":0,"ondisk_log_size":4576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:06.689096+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23775,"num_write_kb":295982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"28'5142","reported_seq":5174,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:28.746959+0000","last_change":"2024-09-12T02:40:28.746988+0000","last_active":"2024-09-12T02:40:28.746959+0000","last_peered":"2024-09-12T02:40:28.746959+0000","last_clean":"2024-09-12T02:40:28.746959+0000","last_became_active":"2024-09-12T02:23:16.849831+0000","last_became_peered":"2024-09-12T02:23:16.849831+0000","last_unstale":"2024-09-12T02:40:28.746959+0000","last_undegraded":"2024-09-12T02:40:28.746959+0000","last_fullsized":"2024-09-12T02:40:28.746959+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5142","last_scrub_stamp":"2024-09-12T02:40:28.746853+0000","last_deep_scrub":"28'5142","last_deep_scrub_stamp":"2024-09-12T02:40:28.746853+0000","last_clean_scrub_stamp":"2024-09-12T02:40:28.746853+0000","objects_scrubbed":0,"log_size":5142,"log_dups_size":0,"ondisk_log_size":5142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:22.791474+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26862,"num_write_kb":308481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"28'4731","reported_seq":4771,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:34.502225+0000","last_change":"2024-09-12T02:40:34.502266+0000","last_active":"2024-09-12T02:40:34.502225+0000","last_peered":"2024-09-12T02:40:34.502225+0000","last_clean":"2024-09-12T02:40:34.502225+0000","last_became_active":"2024-09-12T02:23:04.784945+0000","last_became_peered":"2024-09-12T02:23:04.784945+0000","last_unstale":"2024-09-12T02:40:34.502225+0000","last_undegraded":"2024-09-12T02:40:34.502225+0000","last_fullsized":"2024-09-12T02:40:34.502225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4731","last_scrub_stamp":"2024-09-12T02:40:34.502125+0000","last_deep_scrub":"28'4731","last_deep_scrub_stamp":"2024-09-12T02:40:34.502125+0000","last_clean_scrub_stamp":"2024-09-12T02:40:34.502125+0000","objects_scrubbed":0,"log_size":4731,"log_dups_size":0,"ondisk_log_size":4731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:35.798866+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24557,"num_write_kb":319695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"28'4794","reported_seq":4818,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.693471+0000","last_change":"2024-09-12T02:23:16.846108+0000","last_active":"2024-09-12T02:40:04.693471+0000","last_peered":"2024-09-12T02:40:04.693471+0000","last_clean":"2024-09-12T02:40:04.693471+0000","last_became_active":"2024-09-12T02:23:16.845793+0000","last_became_peered":"2024-09-12T02:23:16.845793+0000","last_unstale":"2024-09-12T02:40:04.693471+0000","last_undegraded":"2024-09-12T02:40:04.693471+0000","last_fullsized":"2024-09-12T02:40:04.693471+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4794,"log_dups_size":0,"ondisk_log_size":4794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23926,"num_write_kb":300628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"28'4561","reported_seq":4601,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:26.651551+0000","last_change":"2024-09-12T02:40:26.651599+0000","last_active":"2024-09-12T02:40:26.651551+0000","last_peered":"2024-09-12T02:40:26.651551+0000","last_clean":"2024-09-12T02:40:26.651551+0000","last_became_active":"2024-09-12T02:23:04.785511+0000","last_became_peered":"2024-09-12T02:23:04.785511+0000","last_unstale":"2024-09-12T02:40:26.651551+0000","last_undegraded":"2024-09-12T02:40:26.651551+0000","last_fullsized":"2024-09-12T02:40:26.651551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4561","last_scrub_stamp":"2024-09-12T02:40:26.651410+0000","last_deep_scrub":"28'4561","last_deep_scrub_stamp":"2024-09-12T02:40:26.651410+0000","last_clean_scrub_stamp":"2024-09-12T02:40:26.651410+0000","objects_scrubbed":0,"log_size":4561,"log_dups_size":0,"ondisk_log_size":4561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:58.086071+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23484,"num_write_kb":303052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"28'5809","reported_seq":5841,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:32.919778+0000","last_change":"2024-09-12T02:40:32.919820+0000","last_active":"2024-09-12T02:40:32.919778+0000","last_peered":"2024-09-12T02:40:32.919778+0000","last_clean":"2024-09-12T02:40:32.919778+0000","last_became_active":"2024-09-12T02:23:16.855278+0000","last_became_peered":"2024-09-12T02:23:16.855278+0000","last_unstale":"2024-09-12T02:40:32.919778+0000","last_undegraded":"2024-09-12T02:40:32.919778+0000","last_fullsized":"2024-09-12T02:40:32.919778+0000","mapping_epoch":24,"log_start":"28'300","ondisk_log_start":"28'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5809","last_scrub_stamp":"2024-09-12T02:40:32.919675+0000","last_deep_scrub":"28'5809","last_deep_scrub_stamp":"2024-09-12T02:40:32.919675+0000","last_clean_scrub_stamp":"2024-09-12T02:40:32.919675+0000","objects_scrubbed":0,"log_size":5509,"log_dups_size":0,"ondisk_log_size":5509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:21.462789+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30461,"num_write_kb":343399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"28'4620","reported_seq":4660,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:17.051221+0000","last_change":"2024-09-12T02:40:17.051264+0000","last_active":"2024-09-12T02:40:17.051221+0000","last_peered":"2024-09-12T02:40:17.051221+0000","last_clean":"2024-09-12T02:40:17.051221+0000","last_became_active":"2024-09-12T02:23:04.789296+0000","last_became_peered":"2024-09-12T02:23:04.789296+0000","last_unstale":"2024-09-12T02:40:17.051221+0000","last_undegraded":"2024-09-12T02:40:17.051221+0000","last_fullsized":"2024-09-12T02:40:17.051221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4620","last_scrub_stamp":"2024-09-12T02:40:17.051105+0000","last_deep_scrub":"28'4620","last_deep_scrub_stamp":"2024-09-12T02:40:17.051105+0000","last_clean_scrub_stamp":"2024-09-12T02:40:17.051105+0000","objects_scrubbed":0,"log_size":4620,"log_dups_size":0,"ondisk_log_size":4620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:04.465488+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23568,"num_write_kb":295197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"28'5012","reported_seq":5036,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.717971+0000","last_change":"2024-09-12T02:23:16.858045+0000","last_active":"2024-09-12T02:40:04.717971+0000","last_peered":"2024-09-12T02:40:04.717971+0000","last_clean":"2024-09-12T02:40:04.717971+0000","last_became_active":"2024-09-12T02:23:16.857772+0000","last_became_peered":"2024-09-12T02:23:16.857772+0000","last_unstale":"2024-09-12T02:40:04.717971+0000","last_undegraded":"2024-09-12T02:40:04.717971+0000","last_fullsized":"2024-09-12T02:40:04.717971+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5012,"log_dups_size":0,"ondisk_log_size":5012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25770,"num_write_kb":312200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"28'4649","reported_seq":4689,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:28.896841+0000","last_change":"2024-09-12T02:40:28.896866+0000","last_active":"2024-09-12T02:40:28.896841+0000","last_peered":"2024-09-12T02:40:28.896841+0000","last_clean":"2024-09-12T02:40:28.896841+0000","last_became_active":"2024-09-12T02:23:04.776825+0000","last_became_peered":"2024-09-12T02:23:04.776825+0000","last_unstale":"2024-09-12T02:40:28.896841+0000","last_undegraded":"2024-09-12T02:40:28.896841+0000","last_fullsized":"2024-09-12T02:40:28.896841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4649","last_scrub_stamp":"2024-09-12T02:40:28.896744+0000","last_deep_scrub":"28'4649","last_deep_scrub_stamp":"2024-09-12T02:40:28.896744+0000","last_clean_scrub_stamp":"2024-09-12T02:40:28.896744+0000","objects_scrubbed":0,"log_size":4649,"log_dups_size":0,"ondisk_log_size":4649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:58.354382+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22974,"num_write_kb":296824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"28'4733","reported_seq":4765,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:24.463927+0000","last_change":"2024-09-12T02:40:24.463955+0000","last_active":"2024-09-12T02:40:24.463927+0000","last_peered":"2024-09-12T02:40:24.463927+0000","last_clean":"2024-09-12T02:40:24.463927+0000","last_became_active":"2024-09-12T02:23:16.845492+0000","last_became_peered":"2024-09-12T02:23:16.845492+0000","last_unstale":"2024-09-12T02:40:24.463927+0000","last_undegraded":"2024-09-12T02:40:24.463927+0000","last_fullsized":"2024-09-12T02:40:24.463927+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4733","last_scrub_stamp":"2024-09-12T02:40:24.463828+0000","last_deep_scrub":"28'4733","last_deep_scrub_stamp":"2024-09-12T02:40:24.463828+0000","last_clean_scrub_stamp":"2024-09-12T02:40:24.463828+0000","objects_scrubbed":0,"log_size":4733,"log_dups_size":0,"ondisk_log_size":4733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:42.436037+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24040,"num_write_kb":276615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"28'3733","reported_seq":3773,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:22.672422+0000","last_change":"2024-09-12T02:40:22.672454+0000","last_active":"2024-09-12T02:40:22.672422+0000","last_peered":"2024-09-12T02:40:22.672422+0000","last_clean":"2024-09-12T02:40:22.672422+0000","last_became_active":"2024-09-12T02:23:04.790926+0000","last_became_peered":"2024-09-12T02:23:04.790926+0000","last_unstale":"2024-09-12T02:40:22.672422+0000","last_undegraded":"2024-09-12T02:40:22.672422+0000","last_fullsized":"2024-09-12T02:40:22.672422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3733","last_scrub_stamp":"2024-09-12T02:40:22.672315+0000","last_deep_scrub":"28'3733","last_deep_scrub_stamp":"2024-09-12T02:40:22.672315+0000","last_clean_scrub_stamp":"2024-09-12T02:40:22.672315+0000","objects_scrubbed":0,"log_size":3733,"log_dups_size":0,"ondisk_log_size":3733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:39.053509+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18622,"num_write_kb":238300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"28'5122","reported_seq":5146,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.677490+0000","last_change":"2024-09-12T02:23:16.851099+0000","last_active":"2024-09-12T02:40:04.677490+0000","last_peered":"2024-09-12T02:40:04.677490+0000","last_clean":"2024-09-12T02:40:04.677490+0000","last_became_active":"2024-09-12T02:23:16.850747+0000","last_became_peered":"2024-09-12T02:23:16.850747+0000","last_unstale":"2024-09-12T02:40:04.677490+0000","last_undegraded":"2024-09-12T02:40:04.677490+0000","last_fullsized":"2024-09-12T02:40:04.677490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5122,"log_dups_size":0,"ondisk_log_size":5122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26303,"num_write_kb":306134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"28'5815","reported_seq":5855,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:19.448205+0000","last_change":"2024-09-12T02:40:19.448229+0000","last_active":"2024-09-12T02:40:19.448205+0000","last_peered":"2024-09-12T02:40:19.448205+0000","last_clean":"2024-09-12T02:40:19.448205+0000","last_became_active":"2024-09-12T02:23:04.787421+0000","last_became_peered":"2024-09-12T02:23:04.787421+0000","last_unstale":"2024-09-12T02:40:19.448205+0000","last_undegraded":"2024-09-12T02:40:19.448205+0000","last_fullsized":"2024-09-12T02:40:19.448205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5815","last_scrub_stamp":"2024-09-12T02:40:19.448074+0000","last_deep_scrub":"28'5815","last_deep_scrub_stamp":"2024-09-12T02:40:19.448074+0000","last_clean_scrub_stamp":"2024-09-12T02:40:19.448074+0000","objects_scrubbed":0,"log_size":5815,"log_dups_size":0,"ondisk_log_size":5815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:11.305905+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29660,"num_write_kb":364722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"28'5421","reported_seq":5453,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:32.804410+0000","last_change":"2024-09-12T02:40:32.804439+0000","last_active":"2024-09-12T02:40:32.804410+0000","last_peered":"2024-09-12T02:40:32.804410+0000","last_clean":"2024-09-12T02:40:32.804410+0000","last_became_active":"2024-09-12T02:23:16.850609+0000","last_became_peered":"2024-09-12T02:23:16.850609+0000","last_unstale":"2024-09-12T02:40:32.804410+0000","last_undegraded":"2024-09-12T02:40:32.804410+0000","last_fullsized":"2024-09-12T02:40:32.804410+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5421","last_scrub_stamp":"2024-09-12T02:40:32.804309+0000","last_deep_scrub":"28'5421","last_deep_scrub_stamp":"2024-09-12T02:40:32.804309+0000","last_clean_scrub_stamp":"2024-09-12T02:40:32.804309+0000","objects_scrubbed":0,"log_size":5421,"log_dups_size":0,"ondisk_log_size":5421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:11.123034+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28803,"num_write_kb":344817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"28'4311","reported_seq":4351,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:17.374105+0000","last_change":"2024-09-12T02:40:17.374131+0000","last_active":"2024-09-12T02:40:17.374105+0000","last_peered":"2024-09-12T02:40:17.374105+0000","last_clean":"2024-09-12T02:40:17.374105+0000","last_became_active":"2024-09-12T02:23:04.789229+0000","last_became_peered":"2024-09-12T02:23:04.789229+0000","last_unstale":"2024-09-12T02:40:17.374105+0000","last_undegraded":"2024-09-12T02:40:17.374105+0000","last_fullsized":"2024-09-12T02:40:17.374105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4311","last_scrub_stamp":"2024-09-12T02:40:17.374011+0000","last_deep_scrub":"28'4311","last_deep_scrub_stamp":"2024-09-12T02:40:17.374011+0000","last_clean_scrub_stamp":"2024-09-12T02:40:17.374011+0000","objects_scrubbed":0,"log_size":4311,"log_dups_size":0,"ondisk_log_size":4311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:23.079828+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22556,"num_write_kb":270677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"28'6535","reported_seq":6559,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:13.996701+0000","last_change":"2024-09-12T02:23:16.856612+0000","last_active":"2024-09-12T02:40:13.996701+0000","last_peered":"2024-09-12T02:40:13.996701+0000","last_clean":"2024-09-12T02:40:13.996701+0000","last_became_active":"2024-09-12T02:23:16.856290+0000","last_became_peered":"2024-09-12T02:23:16.856290+0000","last_unstale":"2024-09-12T02:40:13.996701+0000","last_undegraded":"2024-09-12T02:40:13.996701+0000","last_fullsized":"2024-09-12T02:40:13.996701+0000","mapping_epoch":24,"log_start":"28'1000","ondisk_log_start":"28'1000","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5535,"log_dups_size":0,"ondisk_log_size":5535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35147,"num_write_kb":386723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"28'4664","reported_seq":4704,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:18.846346+0000","last_change":"2024-09-12T02:40:18.846374+0000","last_active":"2024-09-12T02:40:18.846346+0000","last_peered":"2024-09-12T02:40:18.846346+0000","last_clean":"2024-09-12T02:40:18.846346+0000","last_became_active":"2024-09-12T02:23:04.782183+0000","last_became_peered":"2024-09-12T02:23:04.782183+0000","last_unstale":"2024-09-12T02:40:18.846346+0000","last_undegraded":"2024-09-12T02:40:18.846346+0000","last_fullsized":"2024-09-12T02:40:18.846346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4664","last_scrub_stamp":"2024-09-12T02:40:18.846251+0000","last_deep_scrub":"28'4664","last_deep_scrub_stamp":"2024-09-12T02:40:18.846251+0000","last_clean_scrub_stamp":"2024-09-12T02:40:18.846251+0000","objects_scrubbed":0,"log_size":4664,"log_dups_size":0,"ondisk_log_size":4664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:40.779637+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23511,"num_write_kb":303118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"28'4146","reported_seq":4170,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:14.631700+0000","last_change":"2024-09-12T02:23:16.858100+0000","last_active":"2024-09-12T02:40:14.631700+0000","last_peered":"2024-09-12T02:40:14.631700+0000","last_clean":"2024-09-12T02:40:14.631700+0000","last_became_active":"2024-09-12T02:23:16.857818+0000","last_became_peered":"2024-09-12T02:23:16.857818+0000","last_unstale":"2024-09-12T02:40:14.631700+0000","last_undegraded":"2024-09-12T02:40:14.631700+0000","last_fullsized":"2024-09-12T02:40:14.631700+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4146,"log_dups_size":0,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21288,"num_write_kb":257331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"28'4600","reported_seq":4640,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:16.732937+0000","last_change":"2024-09-12T02:40:16.732981+0000","last_active":"2024-09-12T02:40:16.732937+0000","last_peered":"2024-09-12T02:40:16.732937+0000","last_clean":"2024-09-12T02:40:16.732937+0000","last_became_active":"2024-09-12T02:23:04.786799+0000","last_became_peered":"2024-09-12T02:23:04.786799+0000","last_unstale":"2024-09-12T02:40:16.732937+0000","last_undegraded":"2024-09-12T02:40:16.732937+0000","last_fullsized":"2024-09-12T02:40:16.732937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4600","last_scrub_stamp":"2024-09-12T02:40:16.732810+0000","last_deep_scrub":"28'4600","last_deep_scrub_stamp":"2024-09-12T02:40:16.732810+0000","last_clean_scrub_stamp":"2024-09-12T02:40:16.732810+0000","objects_scrubbed":0,"log_size":4600,"log_dups_size":0,"ondisk_log_size":4600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:49.410167+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23822,"num_write_kb":304357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"28'5170","reported_seq":5202,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:25.894255+0000","last_change":"2024-09-12T02:40:25.894297+0000","last_active":"2024-09-12T02:40:25.894255+0000","last_peered":"2024-09-12T02:40:25.894255+0000","last_clean":"2024-09-12T02:40:25.894255+0000","last_became_active":"2024-09-12T02:23:16.845749+0000","last_became_peered":"2024-09-12T02:23:16.845749+0000","last_unstale":"2024-09-12T02:40:25.894255+0000","last_undegraded":"2024-09-12T02:40:25.894255+0000","last_fullsized":"2024-09-12T02:40:25.894255+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5170","last_scrub_stamp":"2024-09-12T02:40:25.894095+0000","last_deep_scrub":"28'5170","last_deep_scrub_stamp":"2024-09-12T02:40:25.894095+0000","last_clean_scrub_stamp":"2024-09-12T02:40:25.894095+0000","objects_scrubbed":0,"log_size":5170,"log_dups_size":0,"ondisk_log_size":5170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:33.346485+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26244,"num_write_kb":301879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"28'3980","reported_seq":4012,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:03.061898+0000","last_change":"2024-09-12T02:23:04.782128+0000","last_active":"2024-09-12T02:40:03.061898+0000","last_peered":"2024-09-12T02:40:03.061898+0000","last_clean":"2024-09-12T02:40:03.061898+0000","last_became_active":"2024-09-12T02:23:04.781101+0000","last_became_peered":"2024-09-12T02:23:04.781101+0000","last_unstale":"2024-09-12T02:40:03.061898+0000","last_undegraded":"2024-09-12T02:40:03.061898+0000","last_fullsized":"2024-09-12T02:40:03.061898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":3980,"log_dups_size":0,"ondisk_log_size":3980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20651,"num_write_kb":267035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"28'5235","reported_seq":5267,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:25.875123+0000","last_change":"2024-09-12T02:40:25.875152+0000","last_active":"2024-09-12T02:40:25.875123+0000","last_peered":"2024-09-12T02:40:25.875123+0000","last_clean":"2024-09-12T02:40:25.875123+0000","last_became_active":"2024-09-12T02:23:16.836561+0000","last_became_peered":"2024-09-12T02:23:16.836561+0000","last_unstale":"2024-09-12T02:40:25.875123+0000","last_undegraded":"2024-09-12T02:40:25.875123+0000","last_fullsized":"2024-09-12T02:40:25.875123+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5235","last_scrub_stamp":"2024-09-12T02:40:25.875030+0000","last_deep_scrub":"28'5235","last_deep_scrub_stamp":"2024-09-12T02:40:25.875030+0000","last_clean_scrub_stamp":"2024-09-12T02:40:25.875030+0000","objects_scrubbed":0,"log_size":5235,"log_dups_size":0,"ondisk_log_size":5235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:33.745555+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26710,"num_write_kb":316033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"28'3967","reported_seq":4007,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:26.931874+0000","last_change":"2024-09-12T02:40:26.931900+0000","last_active":"2024-09-12T02:40:26.931874+0000","last_peered":"2024-09-12T02:40:26.931874+0000","last_clean":"2024-09-12T02:40:26.931874+0000","last_became_active":"2024-09-12T02:23:04.786044+0000","last_became_peered":"2024-09-12T02:23:04.786044+0000","last_unstale":"2024-09-12T02:40:26.931874+0000","last_undegraded":"2024-09-12T02:40:26.931874+0000","last_fullsized":"2024-09-12T02:40:26.931874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3967","last_scrub_stamp":"2024-09-12T02:40:26.931783+0000","last_deep_scrub":"28'3967","last_deep_scrub_stamp":"2024-09-12T02:40:26.931783+0000","last_clean_scrub_stamp":"2024-09-12T02:40:26.931783+0000","objects_scrubbed":0,"log_size":3967,"log_dups_size":0,"ondisk_log_size":3967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:25.129045+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20368,"num_write_kb":253735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"28'4409","reported_seq":4441,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:26.686029+0000","last_change":"2024-09-12T02:40:26.686054+0000","last_active":"2024-09-12T02:40:26.686029+0000","last_peered":"2024-09-12T02:40:26.686029+0000","last_clean":"2024-09-12T02:40:26.686029+0000","last_became_active":"2024-09-12T02:23:16.845757+0000","last_became_peered":"2024-09-12T02:23:16.845757+0000","last_unstale":"2024-09-12T02:40:26.686029+0000","last_undegraded":"2024-09-12T02:40:26.686029+0000","last_fullsized":"2024-09-12T02:40:26.686029+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4409","last_scrub_stamp":"2024-09-12T02:40:26.685908+0000","last_deep_scrub":"28'4409","last_deep_scrub_stamp":"2024-09-12T02:40:26.685908+0000","last_clean_scrub_stamp":"2024-09-12T02:40:26.685908+0000","objects_scrubbed":0,"log_size":4409,"log_dups_size":0,"ondisk_log_size":4409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:12.123871+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22900,"num_write_kb":275935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"28'4251","reported_seq":4291,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:26.926287+0000","last_change":"2024-09-12T02:40:26.926327+0000","last_active":"2024-09-12T02:40:26.926287+0000","last_peered":"2024-09-12T02:40:26.926287+0000","last_clean":"2024-09-12T02:40:26.926287+0000","last_became_active":"2024-09-12T02:23:04.785375+0000","last_became_peered":"2024-09-12T02:23:04.785375+0000","last_unstale":"2024-09-12T02:40:26.926287+0000","last_undegraded":"2024-09-12T02:40:26.926287+0000","last_fullsized":"2024-09-12T02:40:26.926287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4251","last_scrub_stamp":"2024-09-12T02:40:26.926186+0000","last_deep_scrub":"28'4251","last_deep_scrub_stamp":"2024-09-12T02:40:26.926186+0000","last_clean_scrub_stamp":"2024-09-12T02:40:26.926186+0000","objects_scrubbed":0,"log_size":4251,"log_dups_size":0,"ondisk_log_size":4251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:33.143747+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21731,"num_write_kb":283663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"28'4658","reported_seq":4682,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:05.141428+0000","last_change":"2024-09-12T02:23:16.858175+0000","last_active":"2024-09-12T02:40:05.141428+0000","last_peered":"2024-09-12T02:40:05.141428+0000","last_clean":"2024-09-12T02:40:05.141428+0000","last_became_active":"2024-09-12T02:23:16.857873+0000","last_became_peered":"2024-09-12T02:23:16.857873+0000","last_unstale":"2024-09-12T02:40:05.141428+0000","last_undegraded":"2024-09-12T02:40:05.141428+0000","last_fullsized":"2024-09-12T02:40:05.141428+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4658,"log_dups_size":0,"ondisk_log_size":4658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24616,"num_write_kb":279029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"28'5811","reported_seq":5851,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:19.031639+0000","last_change":"2024-09-12T02:40:19.031665+0000","last_active":"2024-09-12T02:40:19.031639+0000","last_peered":"2024-09-12T02:40:19.031639+0000","last_clean":"2024-09-12T02:40:19.031639+0000","last_became_active":"2024-09-12T02:23:04.791622+0000","last_became_peered":"2024-09-12T02:23:04.791622+0000","last_unstale":"2024-09-12T02:40:19.031639+0000","last_undegraded":"2024-09-12T02:40:19.031639+0000","last_fullsized":"2024-09-12T02:40:19.031639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5811","last_scrub_stamp":"2024-09-12T02:40:19.031534+0000","last_deep_scrub":"28'5811","last_deep_scrub_stamp":"2024-09-12T02:40:19.031534+0000","last_clean_scrub_stamp":"2024-09-12T02:40:19.031534+0000","objects_scrubbed":0,"log_size":5811,"log_dups_size":0,"ondisk_log_size":5811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:27.672797+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30224,"num_write_kb":350457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"28'5106","reported_seq":5138,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:26.557989+0000","last_change":"2024-09-12T02:40:26.558015+0000","last_active":"2024-09-12T02:40:26.557989+0000","last_peered":"2024-09-12T02:40:26.557989+0000","last_clean":"2024-09-12T02:40:26.557989+0000","last_became_active":"2024-09-12T02:23:16.849641+0000","last_became_peered":"2024-09-12T02:23:16.849641+0000","last_unstale":"2024-09-12T02:40:26.557989+0000","last_undegraded":"2024-09-12T02:40:26.557989+0000","last_fullsized":"2024-09-12T02:40:26.557989+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5106","last_scrub_stamp":"2024-09-12T02:40:26.557879+0000","last_deep_scrub":"28'5106","last_deep_scrub_stamp":"2024-09-12T02:40:26.557879+0000","last_clean_scrub_stamp":"2024-09-12T02:40:26.557879+0000","objects_scrubbed":0,"log_size":5106,"log_dups_size":0,"ondisk_log_size":5106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:29.071298+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25610,"num_write_kb":311590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"28'5712","reported_seq":5749,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.478545+0000","last_change":"2024-09-12T02:23:56.084447+0000","last_active":"2024-09-12T02:40:04.478545+0000","last_peered":"2024-09-12T02:40:04.478545+0000","last_clean":"2024-09-12T02:40:04.478545+0000","last_became_active":"2024-09-12T02:23:56.084173+0000","last_became_peered":"2024-09-12T02:23:56.084173+0000","last_unstale":"2024-09-12T02:40:04.478545+0000","last_undegraded":"2024-09-12T02:40:04.478545+0000","last_fullsized":"2024-09-12T02:40:04.478545+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5712,"log_dups_size":0,"ondisk_log_size":5712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30266,"num_write_kb":367055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"28'6924","reported_seq":6949,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.747265+0000","last_change":"2024-09-12T02:23:16.840250+0000","last_active":"2024-09-12T02:40:04.747265+0000","last_peered":"2024-09-12T02:40:04.747265+0000","last_clean":"2024-09-12T02:40:04.747265+0000","last_became_active":"2024-09-12T02:23:16.839914+0000","last_became_peered":"2024-09-12T02:23:16.839914+0000","last_unstale":"2024-09-12T02:40:04.747265+0000","last_undegraded":"2024-09-12T02:40:04.747265+0000","last_fullsized":"2024-09-12T02:40:04.747265+0000","mapping_epoch":24,"log_start":"28'1700","ondisk_log_start":"28'1700","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5224,"log_dups_size":0,"ondisk_log_size":5224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36307,"num_write_kb":403764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"28'4960","reported_seq":4999,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:32.730374+0000","last_change":"2024-09-12T02:40:32.730404+0000","last_active":"2024-09-12T02:40:32.730374+0000","last_peered":"2024-09-12T02:40:32.730374+0000","last_clean":"2024-09-12T02:40:32.730374+0000","last_became_active":"2024-09-12T02:23:04.779384+0000","last_became_peered":"2024-09-12T02:23:04.779384+0000","last_unstale":"2024-09-12T02:40:32.730374+0000","last_undegraded":"2024-09-12T02:40:32.730374+0000","last_fullsized":"2024-09-12T02:40:32.730374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4960","last_scrub_stamp":"2024-09-12T02:40:32.730273+0000","last_deep_scrub":"28'4960","last_deep_scrub_stamp":"2024-09-12T02:40:32.730273+0000","last_clean_scrub_stamp":"2024-09-12T02:40:32.730273+0000","objects_scrubbed":0,"log_size":4960,"log_dups_size":0,"ondisk_log_size":4960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:48.757948+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24704,"num_write_kb":320180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"28'4652","reported_seq":4685,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:33.922280+0000","last_change":"2024-09-12T02:40:33.922306+0000","last_active":"2024-09-12T02:40:33.922280+0000","last_peered":"2024-09-12T02:40:33.922280+0000","last_clean":"2024-09-12T02:40:33.922280+0000","last_became_active":"2024-09-12T02:23:16.849744+0000","last_became_peered":"2024-09-12T02:23:16.849744+0000","last_unstale":"2024-09-12T02:40:33.922280+0000","last_undegraded":"2024-09-12T02:40:33.922280+0000","last_fullsized":"2024-09-12T02:40:33.922280+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4652","last_scrub_stamp":"2024-09-12T02:40:33.922201+0000","last_deep_scrub":"28'4652","last_deep_scrub_stamp":"2024-09-12T02:40:33.922201+0000","last_clean_scrub_stamp":"2024-09-12T02:40:33.922201+0000","objects_scrubbed":0,"log_size":4652,"log_dups_size":0,"ondisk_log_size":4652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:38.630829+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24125,"num_write_kb":272841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"28'4717","reported_seq":4742,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:30.780101+0000","last_change":"2024-09-12T02:40:30.780127+0000","last_active":"2024-09-12T02:40:30.780101+0000","last_peered":"2024-09-12T02:40:30.780101+0000","last_clean":"2024-09-12T02:40:30.780101+0000","last_became_active":"2024-09-12T02:23:55.991300+0000","last_became_peered":"2024-09-12T02:23:55.991300+0000","last_unstale":"2024-09-12T02:40:30.780101+0000","last_undegraded":"2024-09-12T02:40:30.780101+0000","last_fullsized":"2024-09-12T02:40:30.780101+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4717","last_scrub_stamp":"2024-09-12T02:40:30.779997+0000","last_deep_scrub":"28'4717","last_deep_scrub_stamp":"2024-09-12T02:40:30.779997+0000","last_clean_scrub_stamp":"2024-09-12T02:40:30.779997+0000","objects_scrubbed":0,"log_size":4717,"log_dups_size":0,"ondisk_log_size":4717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:10.783997+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24759,"num_write_kb":295935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3c","version":"28'4790","reported_seq":4815,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.669617+0000","last_change":"2024-09-12T02:23:16.862034+0000","last_active":"2024-09-12T02:40:04.669617+0000","last_peered":"2024-09-12T02:40:04.669617+0000","last_clean":"2024-09-12T02:40:04.669617+0000","last_became_active":"2024-09-12T02:23:16.861441+0000","last_became_peered":"2024-09-12T02:23:16.861441+0000","last_unstale":"2024-09-12T02:40:04.669617+0000","last_undegraded":"2024-09-12T02:40:04.669617+0000","last_fullsized":"2024-09-12T02:40:04.669617+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4790,"log_dups_size":0,"ondisk_log_size":4790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25639,"num_write_kb":287197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"28'4345","reported_seq":4385,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:21.454820+0000","last_change":"2024-09-12T02:40:21.454820+0000","last_active":"2024-09-12T02:40:21.454820+0000","last_peered":"2024-09-12T02:40:21.454820+0000","last_clean":"2024-09-12T02:40:21.454820+0000","last_became_active":"2024-09-12T02:23:04.788617+0000","last_became_peered":"2024-09-12T02:23:04.788617+0000","last_unstale":"2024-09-12T02:40:21.454820+0000","last_undegraded":"2024-09-12T02:40:21.454820+0000","last_fullsized":"2024-09-12T02:40:21.454820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4345","last_scrub_stamp":"2024-09-12T02:40:21.454696+0000","last_deep_scrub":"28'4345","last_deep_scrub_stamp":"2024-09-12T02:40:21.454696+0000","last_clean_scrub_stamp":"2024-09-12T02:40:21.454696+0000","objects_scrubbed":0,"log_size":4345,"log_dups_size":0,"ondisk_log_size":4345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:04.580526+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22438,"num_write_kb":266069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"28'5149","reported_seq":5174,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.712673+0000","last_change":"2024-09-12T02:23:16.855853+0000","last_active":"2024-09-12T02:40:04.712673+0000","last_peered":"2024-09-12T02:40:04.712673+0000","last_clean":"2024-09-12T02:40:04.712673+0000","last_became_active":"2024-09-12T02:23:16.855437+0000","last_became_peered":"2024-09-12T02:23:16.855437+0000","last_unstale":"2024-09-12T02:40:04.712673+0000","last_undegraded":"2024-09-12T02:40:04.712673+0000","last_fullsized":"2024-09-12T02:40:04.712673+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":5149,"log_dups_size":0,"ondisk_log_size":5149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26098,"num_write_kb":313495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'5428","reported_seq":5460,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:17.098078+0000","last_change":"2024-09-12T02:23:04.777165+0000","last_active":"2024-09-12T02:40:17.098078+0000","last_peered":"2024-09-12T02:40:17.098078+0000","last_clean":"2024-09-12T02:40:17.098078+0000","last_became_active":"2024-09-12T02:23:04.776857+0000","last_became_peered":"2024-09-12T02:23:04.776857+0000","last_unstale":"2024-09-12T02:40:17.098078+0000","last_undegraded":"2024-09-12T02:40:17.098078+0000","last_fullsized":"2024-09-12T02:40:17.098078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:03.743776+0000","last_clean_scrub_stamp":"2024-09-12T02:23:03.743776+0000","objects_scrubbed":0,"log_size":5428,"log_dups_size":0,"ondisk_log_size":5428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27088,"num_write_kb":350175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"28'4355","reported_seq":4378,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:04.719605+0000","last_change":"2024-09-12T02:23:16.849235+0000","last_active":"2024-09-12T02:40:04.719605+0000","last_peered":"2024-09-12T02:40:04.719605+0000","last_clean":"2024-09-12T02:40:04.719605+0000","last_became_active":"2024-09-12T02:23:16.848936+0000","last_became_peered":"2024-09-12T02:23:16.848936+0000","last_unstale":"2024-09-12T02:40:04.719605+0000","last_undegraded":"2024-09-12T02:40:04.719605+0000","last_fullsized":"2024-09-12T02:40:04.719605+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:23:15.808160+0000","last_clean_scrub_stamp":"2024-09-12T02:23:15.808160+0000","objects_scrubbed":0,"log_size":4355,"log_dups_size":0,"ondisk_log_size":4355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22650,"num_write_kb":266857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"28'3929","reported_seq":3970,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:25.511940+0000","last_change":"2024-09-12T02:40:25.511984+0000","last_active":"2024-09-12T02:40:25.511940+0000","last_peered":"2024-09-12T02:40:25.511940+0000","last_clean":"2024-09-12T02:40:25.511940+0000","last_became_active":"2024-09-12T02:23:04.786509+0000","last_became_peered":"2024-09-12T02:23:04.786509+0000","last_unstale":"2024-09-12T02:40:25.511940+0000","last_undegraded":"2024-09-12T02:40:25.511940+0000","last_fullsized":"2024-09-12T02:40:25.511940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3929","last_scrub_stamp":"2024-09-12T02:40:25.511813+0000","last_deep_scrub":"28'3929","last_deep_scrub_stamp":"2024-09-12T02:40:25.511813+0000","last_clean_scrub_stamp":"2024-09-12T02:40:25.511813+0000","objects_scrubbed":0,"log_size":3929,"log_dups_size":0,"ondisk_log_size":3929,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:47.544909+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20681,"num_write_kb":267297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"28'6034","reported_seq":6065,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:24.713124+0000","last_change":"2024-09-12T02:40:24.713168+0000","last_active":"2024-09-12T02:40:24.713124+0000","last_peered":"2024-09-12T02:40:24.713124+0000","last_clean":"2024-09-12T02:40:24.713124+0000","last_became_active":"2024-09-12T02:23:16.834483+0000","last_became_peered":"2024-09-12T02:23:16.834483+0000","last_unstale":"2024-09-12T02:40:24.713124+0000","last_undegraded":"2024-09-12T02:40:24.713124+0000","last_fullsized":"2024-09-12T02:40:24.713124+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6034","last_scrub_stamp":"2024-09-12T02:40:24.712978+0000","last_deep_scrub":"28'6034","last_deep_scrub_stamp":"2024-09-12T02:40:24.712978+0000","last_clean_scrub_stamp":"2024-09-12T02:40:24.712978+0000","objects_scrubbed":0,"log_size":6034,"log_dups_size":0,"ondisk_log_size":6034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:17.810382+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30335,"num_write_kb":363259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"28'4664","reported_seq":4705,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:22.716044+0000","last_change":"2024-09-12T02:40:22.716113+0000","last_active":"2024-09-12T02:40:22.716044+0000","last_peered":"2024-09-12T02:40:22.716044+0000","last_clean":"2024-09-12T02:40:22.716044+0000","last_became_active":"2024-09-12T02:23:04.778445+0000","last_became_peered":"2024-09-12T02:23:04.778445+0000","last_unstale":"2024-09-12T02:40:22.716044+0000","last_undegraded":"2024-09-12T02:40:22.716044+0000","last_fullsized":"2024-09-12T02:40:22.716044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4664","last_scrub_stamp":"2024-09-12T02:40:22.715910+0000","last_deep_scrub":"28'4664","last_deep_scrub_stamp":"2024-09-12T02:40:22.715910+0000","last_clean_scrub_stamp":"2024-09-12T02:40:22.715910+0000","objects_scrubbed":0,"log_size":4664,"log_dups_size":0,"ondisk_log_size":4664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:35.528944+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23827,"num_write_kb":304439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"28'5564","reported_seq":5595,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:23.905301+0000","last_change":"2024-09-12T02:40:23.905331+0000","last_active":"2024-09-12T02:40:23.905301+0000","last_peered":"2024-09-12T02:40:23.905301+0000","last_clean":"2024-09-12T02:40:23.905301+0000","last_became_active":"2024-09-12T02:23:16.843880+0000","last_became_peered":"2024-09-12T02:23:16.843880+0000","last_unstale":"2024-09-12T02:40:23.905301+0000","last_undegraded":"2024-09-12T02:40:23.905301+0000","last_fullsized":"2024-09-12T02:40:23.905301+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5564","last_scrub_stamp":"2024-09-12T02:40:23.905206+0000","last_deep_scrub":"28'5564","last_deep_scrub_stamp":"2024-09-12T02:40:23.905206+0000","last_clean_scrub_stamp":"2024-09-12T02:40:23.905206+0000","objects_scrubbed":0,"log_size":5564,"log_dups_size":0,"ondisk_log_size":5564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:21.279437+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28051,"num_write_kb":333672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"28'5549","reported_seq":5590,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:16.880288+0000","last_change":"2024-09-12T02:40:16.880311+0000","last_active":"2024-09-12T02:40:16.880288+0000","last_peered":"2024-09-12T02:40:16.880288+0000","last_clean":"2024-09-12T02:40:16.880288+0000","last_became_active":"2024-09-12T02:23:04.785516+0000","last_became_peered":"2024-09-12T02:23:04.785516+0000","last_unstale":"2024-09-12T02:40:16.880288+0000","last_undegraded":"2024-09-12T02:40:16.880288+0000","last_fullsized":"2024-09-12T02:40:16.880288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5549","last_scrub_stamp":"2024-09-12T02:40:16.880195+0000","last_deep_scrub":"28'5549","last_deep_scrub_stamp":"2024-09-12T02:40:16.880195+0000","last_clean_scrub_stamp":"2024-09-12T02:40:16.880195+0000","objects_scrubbed":0,"log_size":5549,"log_dups_size":0,"ondisk_log_size":5549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:06.569173+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28712,"num_write_kb":373148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"28'5101","reported_seq":5132,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:21.928286+0000","last_change":"2024-09-12T02:40:21.928328+0000","last_active":"2024-09-12T02:40:21.928286+0000","last_peered":"2024-09-12T02:40:21.928286+0000","last_clean":"2024-09-12T02:40:21.928286+0000","last_became_active":"2024-09-12T02:23:16.843815+0000","last_became_peered":"2024-09-12T02:23:16.843815+0000","last_unstale":"2024-09-12T02:40:21.928286+0000","last_undegraded":"2024-09-12T02:40:21.928286+0000","last_fullsized":"2024-09-12T02:40:21.928286+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5101","last_scrub_stamp":"2024-09-12T02:40:21.928173+0000","last_deep_scrub":"28'5101","last_deep_scrub_stamp":"2024-09-12T02:40:21.928173+0000","last_clean_scrub_stamp":"2024-09-12T02:40:21.928173+0000","objects_scrubbed":0,"log_size":5101,"log_dups_size":0,"ondisk_log_size":5101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:43.613527+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26856,"num_write_kb":304403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"28'3999","reported_seq":4040,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:19.849177+0000","last_change":"2024-09-12T02:40:19.849204+0000","last_active":"2024-09-12T02:40:19.849177+0000","last_peered":"2024-09-12T02:40:19.849177+0000","last_clean":"2024-09-12T02:40:19.849177+0000","last_became_active":"2024-09-12T02:23:04.790906+0000","last_became_peered":"2024-09-12T02:23:04.790906+0000","last_unstale":"2024-09-12T02:40:19.849177+0000","last_undegraded":"2024-09-12T02:40:19.849177+0000","last_fullsized":"2024-09-12T02:40:19.849177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3999","last_scrub_stamp":"2024-09-12T02:40:19.849084+0000","last_deep_scrub":"28'3999","last_deep_scrub_stamp":"2024-09-12T02:40:19.849084+0000","last_clean_scrub_stamp":"2024-09-12T02:40:19.849084+0000","objects_scrubbed":0,"log_size":3999,"log_dups_size":0,"ondisk_log_size":3999,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:52.252676+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20671,"num_write_kb":258921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1731204,"num_write_kb":20050774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":327719,"ondisk_log_size":327719,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":18273247,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":57,"num_read_kb":123,"num_write":4416,"num_write_kb":19551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36610048,"data_stored":36546494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3659,"ondisk_log_size":3659,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1541207,"num_write_kb":19284974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":299497,"ondisk_log_size":299497,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":18199792,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":62,"num_read_kb":127,"num_write":4449,"num_write_kb":19478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36462592,"data_stored":36399584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3702,"ondisk_log_size":3702,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476952,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1212344,"kb_used_data":13160,"kb_used_omap":1,"kb_used_meta":1199166,"kb_avail":93159496,"statfs":{"total":96636764160,"available":95395323904,"internally_reserved":0,"allocated":13475840,"data_stored":13292277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":1227946442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476954,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":757460,"kb_used_data":9796,"kb_used_omap":1,"kb_used_meta":747646,"kb_avail":93614380,"statfs":{"total":96636764160,"available":95861125120,"internally_reserved":0,"allocated":10031104,"data_stored":9841247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":765589958},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476953,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1147152,"kb_used_data":4480,"kb_used_omap":1,"kb_used_meta":1142654,"kb_avail":93224688,"statfs":{"total":96636764160,"available":95462080512,"internally_reserved":0,"allocated":4587520,"data_stored":4401471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1170078149},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509655,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1232784,"kb_used_data":11264,"kb_used_omap":1,"kb_used_meta":1221502,"kb_avail":93139056,"statfs":{"total":96636764160,"available":95374393344,"internally_reserved":0,"allocated":11534336,"data_stored":11334750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1250818501},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509654,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":757512,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":757118,"kb_avail":93614328,"statfs":{"total":96636764160,"available":95861071872,"internally_reserved":0,"allocated":385024,"data_stored":206475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":775289285},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509657,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1009724,"kb_used_data":9068,"kb_used_omap":1,"kb_used_meta":1000638,"kb_avail":93362116,"statfs":{"total":96636764160,"available":95602806784,"internally_reserved":0,"allocated":9285632,"data_stored":9097939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1024653765},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542360,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1235704,"kb_used_data":18152,"kb_used_omap":1,"kb_used_meta":1217534,"kb_avail":93136136,"statfs":{"total":96636764160,"available":95371403264,"internally_reserved":0,"allocated":18587648,"data_stored":18391468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":1246755271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542359,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1000768,"kb_used_data":8496,"kb_used_omap":1,"kb_used_meta":992254,"kb_avail":93371072,"statfs":{"total":96636764160,"available":95611977728,"internally_reserved":0,"allocated":8699904,"data_stored":8507787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1016068549},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4206592,"data_stored":4194942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":88080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8486912,"data_stored":8477360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5541888,"data_stored":5527456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5537792,"data_stored":5528002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12583494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9809920,"data_stored":9795783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5701632,"data_stored":5688969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4292608,"data_stored":4283056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:40:37.794 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:37.794 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:37.794 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-09-12T02:23:02.739281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:37.794 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:37.794 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:37.794 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:37.795 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:37.795 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:37.795 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:37.795 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:37.795 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:37.796 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-12T02:23:02.739281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:37.796 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:37.796 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:37.796 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:37.796 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:37.796 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:37.797 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:37.797 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:37.797 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:37.797 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:37.797 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:37.797 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:37.798 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:37.798 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:37.798 INFO:tasks.ceph:pgid 5.26 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:37.798 INFO:tasks.ceph:pgid 5.24 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:37.798 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:37.798 INFO:tasks.ceph:pgid 5.25 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:37.799 INFO:tasks.ceph:pgid 5.23 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:37.799 INFO:tasks.ceph:pgid 5.20 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:37.799 INFO:tasks.ceph:pgid 5.2e last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:37.799 INFO:tasks.ceph:pgid 5.2f last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:37.799 INFO:tasks.ceph:pgid 5.2d last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:37.799 INFO:tasks.ceph:pgid 5.2b last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:37.800 INFO:tasks.ceph:pgid 5.29 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:37.800 INFO:tasks.ceph:pgid 5.37 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:37.800 INFO:tasks.ceph:pgid 5.34 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:37.800 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:37.800 INFO:tasks.ceph:pgid 5.30 last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:37.800 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:37.800 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:37.801 INFO:tasks.ceph:pgid 5.3c last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:37.801 INFO:tasks.ceph:pgid 5.3d last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:37.801 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-12T02:23:03.743776+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:37.801 INFO:tasks.ceph:pgid 5.3a last_scrub_stamp 2024-09-12T02:23:15.808160+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=23, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:40:37.801 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T02:40:57.802 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:40:57.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.919+0000 7f3a8f853640 1 Processor -- start 2024-09-12T02:40:57.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.919+0000 7f3a8f853640 1 -- start start 2024-09-12T02:40:57.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.920+0000 7f3a8f853640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3a881578b0 0x7f3a881513f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:57.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.920+0000 7f3a8f853640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a880c9860 0x7f3a88151930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:57.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.920+0000 7f3a8f853640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a880741e0 con 0x7f3a88157c90 2024-09-12T02:40:57.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.920+0000 7f3a8f853640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f3a88073f90 con 0x7f3a881578b0 2024-09-12T02:40:57.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.920+0000 7f3a8f853640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3a88158280 con 0x7f3a880c9860 2024-09-12T02:40:57.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.920+0000 7f3a8d5ef640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3a881578b0 0x7f3a881513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:57.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.920+0000 7f3a8d5ef640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3a881578b0 0x7f3a881513f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50966/0 (socket says 172.21.15.60:50966) 2024-09-12T02:40:57.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.920+0000 7f3a8d5ef640 1 -- 172.21.15.60:0/1541820697 learned_addr learned my addr 172.21.15.60:0/1541820697 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:57.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.920+0000 7f3a8cdee640 1 --2- 172.21.15.60:0/1541820697 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a880c9860 0x7f3a88151930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:57.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.920+0000 7f3a8d5ef640 1 -- 172.21.15.60:0/1541820697 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a880c9860 msgr2=0x7f3a88151930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:57.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.920+0000 7f3a8d5ef640 1 --2- 172.21.15.60:0/1541820697 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a880c9860 0x7f3a88151930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:57.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.920+0000 7f3a8d5ef640 1 -- 172.21.15.60:0/1541820697 >> v1:172.21.15.105:6789/0 conn(0x7f3a88157c90 legacy=0x7f3a880c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:57.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.920+0000 7f3a8d5ef640 1 -- 172.21.15.60:0/1541820697 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a880c4820 con 0x7f3a881578b0 2024-09-12T02:40:57.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.920+0000 7f3a8cdee640 1 --2- 172.21.15.60:0/1541820697 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a880c9860 0x7f3a88151930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:40:57.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.921+0000 7f3a8d5ef640 1 --2- 172.21.15.60:0/1541820697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a881578b0 0x7f3a881513f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3a84009870 tx=0x7f3a8402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7746c839b327879 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:57.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.921+0000 7f3a7ffff640 1 -- 172.21.15.60:0/1541820697 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a84037070 con 0x7f3a881578b0 2024-09-12T02:40:57.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.921+0000 7f3a7ffff640 1 -- 172.21.15.60:0/1541820697 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a8402ae10 con 0x7f3a881578b0 2024-09-12T02:40:57.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.921+0000 7f3a7ffff640 1 -- 172.21.15.60:0/1541820697 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a84032660 con 0x7f3a881578b0 2024-09-12T02:40:57.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.922+0000 7f3a8f853640 1 -- 172.21.15.60:0/1541820697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a881578b0 msgr2=0x7f3a881513f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:57.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.922+0000 7f3a8f853640 1 --2- 172.21.15.60:0/1541820697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a881578b0 0x7f3a881513f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3a84009870 tx=0x7f3a8402a100 comp rx=0 tx=0).stop 2024-09-12T02:40:57.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.922+0000 7f3a8f853640 1 -- 172.21.15.60:0/1541820697 shutdown_connections 2024-09-12T02:40:57.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.922+0000 7f3a8f853640 1 --2- 172.21.15.60:0/1541820697 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a880c9860 0x7f3a88151930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:57.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.922+0000 7f3a8f853640 1 --2- 172.21.15.60:0/1541820697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a881578b0 0x7f3a881513f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:57.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.922+0000 7f3a8f853640 1 -- 172.21.15.60:0/1541820697 >> 172.21.15.60:0/1541820697 conn(0x7f3a880c6880 msgr2=0x7f3a880c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:57.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.922+0000 7f3a8f853640 1 -- 172.21.15.60:0/1541820697 shutdown_connections 2024-09-12T02:40:57.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.922+0000 7f3a8f853640 1 -- 172.21.15.60:0/1541820697 wait complete. 2024-09-12T02:40:57.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.923+0000 7f3a8f853640 1 Processor -- start 2024-09-12T02:40:57.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.923+0000 7f3a8f853640 1 -- start start 2024-09-12T02:40:57.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.924+0000 7f3a8f853640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a880c9860 0x7f3a8806ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:57.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.924+0000 7f3a8f853640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a881578b0 0x7f3a88155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:57.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.924+0000 7f3a8f853640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a88157c90 0x7f3a880c3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:57.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.924+0000 7f3a8f853640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3a880afeb0 con 0x7f3a880c9860 2024-09-12T02:40:57.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.924+0000 7f3a8f853640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3a880afd30 con 0x7f3a88157c90 2024-09-12T02:40:57.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.924+0000 7f3a8f853640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3a880c7550 con 0x7f3a881578b0 2024-09-12T02:40:57.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.924+0000 7f3a8d5ef640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a880c9860 0x7f3a8806ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:57.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.924+0000 7f3a8d5ef640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a880c9860 0x7f3a8806ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50976/0 (socket says 172.21.15.60:50976) 2024-09-12T02:40:57.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.924+0000 7f3a8d5ef640 1 -- 172.21.15.60:0/2699042777 learned_addr learned my addr 172.21.15.60:0/2699042777 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:57.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.924+0000 7f3a8cdee640 1 --2- 172.21.15.60:0/2699042777 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a881578b0 0x7f3a88155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:57.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.924+0000 7f3a8ddf0640 1 --2- 172.21.15.60:0/2699042777 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a88157c90 0x7f3a880c3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:57.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.924+0000 7f3a8d5ef640 1 -- 172.21.15.60:0/2699042777 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a881578b0 msgr2=0x7f3a88155210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:57.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.924+0000 7f3a8d5ef640 1 --2- 172.21.15.60:0/2699042777 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a881578b0 0x7f3a88155210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:57.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.924+0000 7f3a8d5ef640 1 -- 172.21.15.60:0/2699042777 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a88157c90 msgr2=0x7f3a880c3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:57.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.924+0000 7f3a8d5ef640 1 --2- 172.21.15.60:0/2699042777 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a88157c90 0x7f3a880c3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:57.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.924+0000 7f3a8d5ef640 1 -- 172.21.15.60:0/2699042777 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a88147be0 con 0x7f3a880c9860 2024-09-12T02:40:57.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.924+0000 7f3a8ddf0640 1 --2- 172.21.15.60:0/2699042777 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a88157c90 0x7f3a880c3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:40:57.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.925+0000 7f3a8d5ef640 1 --2- 172.21.15.60:0/2699042777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a880c9860 0x7f3a8806ccf0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3a84009870 tx=0x7f3a840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:57.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.925+0000 7f3a7dffb640 1 -- 172.21.15.60:0/2699042777 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a84042070 con 0x7f3a880c9860 2024-09-12T02:40:57.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.925+0000 7f3a7dffb640 1 -- 172.21.15.60:0/2699042777 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a8403e680 con 0x7f3a880c9860 2024-09-12T02:40:57.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.925+0000 7f3a8f853640 1 -- 172.21.15.60:0/2699042777 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a8806e7b0 con 0x7f3a880c9860 2024-09-12T02:40:57.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.925+0000 7f3a7dffb640 1 -- 172.21.15.60:0/2699042777 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a84037040 con 0x7f3a880c9860 2024-09-12T02:40:57.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.925+0000 7f3a8f853640 1 -- 172.21.15.60:0/2699042777 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a8806ea70 con 0x7f3a880c9860 2024-09-12T02:40:57.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.926+0000 7f3a8f853640 1 -- 172.21.15.60:0/2699042777 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a881513f0 con 0x7f3a880c9860 2024-09-12T02:40:57.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.927+0000 7f3a7dffb640 1 -- 172.21.15.60:0/2699042777 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3a84045070 con 0x7f3a880c9860 2024-09-12T02:40:57.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.927+0000 7f3a7dffb640 1 --2- 172.21.15.60:0/2699042777 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3a6c06be30 0x7f3a6c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:57.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.927+0000 7f3a7dffb640 1 -- 172.21.15.60:0/2699042777 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f3a840ab8d0 con 0x7f3a880c9860 2024-09-12T02:40:57.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.927+0000 7f3a8cdee640 1 --2- 172.21.15.60:0/2699042777 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3a6c06be30 0x7f3a6c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:57.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.928+0000 7f3a8cdee640 1 --2- 172.21.15.60:0/2699042777 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3a6c06be30 0x7f3a6c06e2f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f3a88070c80 tx=0x7f3a78008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:57.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:57.932+0000 7f3a7dffb640 1 -- 172.21.15.60:0/2699042777 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3a84079890 con 0x7f3a880c9860 2024-09-12T02:40:58.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.104+0000 7f3a8f853640 1 -- 172.21.15.60:0/2699042777 --> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3a880ab460 con 0x7f3a6c06be30 2024-09-12T02:40:58.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.116+0000 7f3a7dffb640 1 -- 172.21.15.60:0/2699042777 <== mgr.4098 v2:172.21.15.60:6800/3549430091 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+494904 (secure 0 0 0) 0x7f3a880ab460 con 0x7f3a6c06be30 2024-09-12T02:40:58.122 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:40:58.126 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T02:40:58.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.120+0000 7f3a8f853640 1 -- 172.21.15.60:0/2699042777 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3a6c06be30 msgr2=0x7f3a6c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:58.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.120+0000 7f3a8f853640 1 --2- 172.21.15.60:0/2699042777 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3a6c06be30 0x7f3a6c06e2f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f3a88070c80 tx=0x7f3a78008040 comp rx=0 tx=0).stop 2024-09-12T02:40:58.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.120+0000 7f3a8f853640 1 -- 172.21.15.60:0/2699042777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a880c9860 msgr2=0x7f3a8806ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:58.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.120+0000 7f3a8f853640 1 --2- 172.21.15.60:0/2699042777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a880c9860 0x7f3a8806ccf0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3a84009870 tx=0x7f3a840046c0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.120+0000 7f3a8f853640 1 -- 172.21.15.60:0/2699042777 shutdown_connections 2024-09-12T02:40:58.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.120+0000 7f3a8f853640 1 --2- 172.21.15.60:0/2699042777 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f3a6c06be30 0x7f3a6c06e2f0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.120+0000 7f3a8f853640 1 --2- 172.21.15.60:0/2699042777 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a88157c90 0x7f3a880c3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.120+0000 7f3a8f853640 1 --2- 172.21.15.60:0/2699042777 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a881578b0 0x7f3a88155210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.120+0000 7f3a8f853640 1 --2- 172.21.15.60:0/2699042777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a880c9860 0x7f3a8806ccf0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.120+0000 7f3a8f853640 1 -- 172.21.15.60:0/2699042777 >> 172.21.15.60:0/2699042777 conn(0x7f3a880c6880 msgr2=0x7f3a8806ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:58.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.120+0000 7f3a8f853640 1 -- 172.21.15.60:0/2699042777 shutdown_connections 2024-09-12T02:40:58.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.120+0000 7f3a8f853640 1 -- 172.21.15.60:0/2699042777 wait complete. 2024-09-12T02:40:58.132 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":563,"stamp":"2024-09-12T02:40:56.415330+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":37063407,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":235,"num_read_kb":350,"num_write":3281435,"num_write_kb":39377193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":634697,"ondisk_log_size":634697,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8353448,"kb_used_data":74792,"kb_used_omap":12,"kb_used_meta":8278515,"kb_avail":746621272,"statfs":{"total":773094113280,"available":764540182528,"internally_reserved":0,"allocated":76587008,"data_stored":75073414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":8477199920},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004434"},"pg_stats":[{"pgid":"5.18","version":"28'5064","reported_seq":5096,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:30.936679+0000","last_change":"2024-09-12T02:40:30.936704+0000","last_active":"2024-09-12T02:40:30.936679+0000","last_peered":"2024-09-12T02:40:30.936679+0000","last_clean":"2024-09-12T02:40:30.936679+0000","last_became_active":"2024-09-12T02:23:16.851220+0000","last_became_peered":"2024-09-12T02:23:16.851220+0000","last_unstale":"2024-09-12T02:40:30.936679+0000","last_undegraded":"2024-09-12T02:40:30.936679+0000","last_fullsized":"2024-09-12T02:40:30.936679+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5064","last_scrub_stamp":"2024-09-12T02:40:30.936589+0000","last_deep_scrub":"28'5064","last_deep_scrub_stamp":"2024-09-12T02:40:30.936589+0000","last_clean_scrub_stamp":"2024-09-12T02:40:30.936589+0000","objects_scrubbed":0,"log_size":5064,"log_dups_size":0,"ondisk_log_size":5064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:00.973087+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26423,"num_write_kb":306733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"28'713","reported_seq":756,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:19.731843+0000","last_change":"2024-09-12T02:40:19.731893+0000","last_active":"2024-09-12T02:40:19.731843+0000","last_peered":"2024-09-12T02:40:19.731843+0000","last_clean":"2024-09-12T02:40:19.731843+0000","last_became_active":"2024-09-12T02:23:03.757544+0000","last_became_peered":"2024-09-12T02:23:03.757544+0000","last_unstale":"2024-09-12T02:40:19.731843+0000","last_undegraded":"2024-09-12T02:40:19.731843+0000","last_fullsized":"2024-09-12T02:40:19.731843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'713","last_scrub_stamp":"2024-09-12T02:40:19.731752+0000","last_deep_scrub":"28'713","last_deep_scrub_stamp":"2024-09-12T02:40:19.731752+0000","last_clean_scrub_stamp":"2024-09-12T02:40:19.731752+0000","objects_scrubbed":3,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:29.987759+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":4498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"28'5154","reported_seq":5195,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:20.916693+0000","last_change":"2024-09-12T02:40:20.916717+0000","last_active":"2024-09-12T02:40:20.916693+0000","last_peered":"2024-09-12T02:40:20.916693+0000","last_clean":"2024-09-12T02:40:20.916693+0000","last_became_active":"2024-09-12T02:23:04.790187+0000","last_became_peered":"2024-09-12T02:23:04.790187+0000","last_unstale":"2024-09-12T02:40:20.916693+0000","last_undegraded":"2024-09-12T02:40:20.916693+0000","last_fullsized":"2024-09-12T02:40:20.916693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5154","last_scrub_stamp":"2024-09-12T02:40:20.916606+0000","last_deep_scrub":"28'5154","last_deep_scrub_stamp":"2024-09-12T02:40:20.916606+0000","last_clean_scrub_stamp":"2024-09-12T02:40:20.916606+0000","objects_scrubbed":0,"log_size":5154,"log_dups_size":0,"ondisk_log_size":5154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:34:41.131746+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26676,"num_write_kb":324046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"28'3","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:17.881557+0000","last_change":"2024-09-12T02:40:17.881579+0000","last_active":"2024-09-12T02:40:17.881557+0000","last_peered":"2024-09-12T02:40:17.881557+0000","last_clean":"2024-09-12T02:40:17.881557+0000","last_became_active":"2024-09-12T02:23:15.828295+0000","last_became_peered":"2024-09-12T02:23:15.828295+0000","last_unstale":"2024-09-12T02:40:17.881557+0000","last_undegraded":"2024-09-12T02:40:17.881557+0000","last_fullsized":"2024-09-12T02:40:17.881557+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-09-12T02:40:17.881480+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-09-12T02:40:17.881480+0000","last_clean_scrub_stamp":"2024-09-12T02:40:17.881480+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:23.234361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"28'6025","reported_seq":6057,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:34.787081+0000","last_change":"2024-09-12T02:40:34.787104+0000","last_active":"2024-09-12T02:40:34.787081+0000","last_peered":"2024-09-12T02:40:34.787081+0000","last_clean":"2024-09-12T02:40:34.787081+0000","last_became_active":"2024-09-12T02:23:16.853371+0000","last_became_peered":"2024-09-12T02:23:16.853371+0000","last_unstale":"2024-09-12T02:40:34.787081+0000","last_undegraded":"2024-09-12T02:40:34.787081+0000","last_fullsized":"2024-09-12T02:40:34.787081+0000","mapping_epoch":24,"log_start":"28'200","ondisk_log_start":"28'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6025","last_scrub_stamp":"2024-09-12T02:40:34.786994+0000","last_deep_scrub":"28'6025","last_deep_scrub_stamp":"2024-09-12T02:40:34.786994+0000","last_clean_scrub_stamp":"2024-09-12T02:40:34.786994+0000","objects_scrubbed":0,"log_size":5825,"log_dups_size":0,"ondisk_log_size":5825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:42.533326+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30759,"num_write_kb":360986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"28'8","reported_seq":51,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:30.726245+0000","last_change":"2024-09-12T02:40:30.726269+0000","last_active":"2024-09-12T02:40:30.726245+0000","last_peered":"2024-09-12T02:40:30.726245+0000","last_clean":"2024-09-12T02:40:30.726245+0000","last_became_active":"2024-09-12T02:23:03.766686+0000","last_became_peered":"2024-09-12T02:23:03.766686+0000","last_unstale":"2024-09-12T02:40:30.726245+0000","last_undegraded":"2024-09-12T02:40:30.726245+0000","last_fullsized":"2024-09-12T02:40:30.726245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-09-12T02:40:30.726150+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-09-12T02:40:30.726150+0000","last_clean_scrub_stamp":"2024-09-12T02:40:30.726150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:35.564201+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"28'5910","reported_seq":5951,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:24.670426+0000","last_change":"2024-09-12T02:40:24.670453+0000","last_active":"2024-09-12T02:40:24.670426+0000","last_peered":"2024-09-12T02:40:24.670426+0000","last_clean":"2024-09-12T02:40:24.670426+0000","last_became_active":"2024-09-12T02:23:04.781829+0000","last_became_peered":"2024-09-12T02:23:04.781829+0000","last_unstale":"2024-09-12T02:40:24.670426+0000","last_undegraded":"2024-09-12T02:40:24.670426+0000","last_fullsized":"2024-09-12T02:40:24.670426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5910","last_scrub_stamp":"2024-09-12T02:40:24.670324+0000","last_deep_scrub":"28'5910","last_deep_scrub_stamp":"2024-09-12T02:40:24.670324+0000","last_clean_scrub_stamp":"2024-09-12T02:40:24.670324+0000","objects_scrubbed":0,"log_size":5910,"log_dups_size":0,"ondisk_log_size":5910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:13.624050+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31102,"num_write_kb":370468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"28'3","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:28.996359+0000","last_change":"2024-09-12T02:40:28.996384+0000","last_active":"2024-09-12T02:40:28.996359+0000","last_peered":"2024-09-12T02:40:28.996359+0000","last_clean":"2024-09-12T02:40:28.996359+0000","last_became_active":"2024-09-12T02:23:15.828317+0000","last_became_peered":"2024-09-12T02:23:15.828317+0000","last_unstale":"2024-09-12T02:40:28.996359+0000","last_undegraded":"2024-09-12T02:40:28.996359+0000","last_fullsized":"2024-09-12T02:40:28.996359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-09-12T02:40:28.996254+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-09-12T02:40:28.996254+0000","last_clean_scrub_stamp":"2024-09-12T02:40:28.996254+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:13.699518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"28'4662","reported_seq":4694,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:40.810889+0000","last_change":"2024-09-12T02:40:40.810889+0000","last_active":"2024-09-12T02:40:40.810889+0000","last_peered":"2024-09-12T02:40:40.810889+0000","last_clean":"2024-09-12T02:40:40.810889+0000","last_became_active":"2024-09-12T02:23:16.855874+0000","last_became_peered":"2024-09-12T02:23:16.855874+0000","last_unstale":"2024-09-12T02:40:40.810889+0000","last_undegraded":"2024-09-12T02:40:40.810889+0000","last_fullsized":"2024-09-12T02:40:40.810889+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4662","last_scrub_stamp":"2024-09-12T02:40:40.810711+0000","last_deep_scrub":"28'4662","last_deep_scrub_stamp":"2024-09-12T02:40:40.810711+0000","last_clean_scrub_stamp":"2024-09-12T02:40:40.810711+0000","objects_scrubbed":0,"log_size":4662,"log_dups_size":0,"ondisk_log_size":4662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:54.118921+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23657,"num_write_kb":270894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"28'12","reported_seq":54,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:34.898349+0000","last_change":"2024-09-12T02:40:34.898395+0000","last_active":"2024-09-12T02:40:34.898349+0000","last_peered":"2024-09-12T02:40:34.898349+0000","last_clean":"2024-09-12T02:40:34.898349+0000","last_became_active":"2024-09-12T02:23:03.767596+0000","last_became_peered":"2024-09-12T02:23:03.767596+0000","last_unstale":"2024-09-12T02:40:34.898349+0000","last_undegraded":"2024-09-12T02:40:34.898349+0000","last_fullsized":"2024-09-12T02:40:34.898349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'12","last_scrub_stamp":"2024-09-12T02:40:34.898268+0000","last_deep_scrub":"28'12","last_deep_scrub_stamp":"2024-09-12T02:40:34.898268+0000","last_clean_scrub_stamp":"2024-09-12T02:40:34.898268+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:13.557403+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'3398","reported_seq":3438,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:18.410304+0000","last_change":"2024-09-12T02:40:18.410304+0000","last_active":"2024-09-12T02:40:18.410304+0000","last_peered":"2024-09-12T02:40:18.410304+0000","last_clean":"2024-09-12T02:40:18.410304+0000","last_became_active":"2024-09-12T02:23:04.791635+0000","last_became_peered":"2024-09-12T02:23:04.791635+0000","last_unstale":"2024-09-12T02:40:18.410304+0000","last_undegraded":"2024-09-12T02:40:18.410304+0000","last_fullsized":"2024-09-12T02:40:18.410304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3398","last_scrub_stamp":"2024-09-12T02:40:18.410128+0000","last_deep_scrub":"28'3398","last_deep_scrub_stamp":"2024-09-12T02:40:18.410128+0000","last_clean_scrub_stamp":"2024-09-12T02:40:18.410128+0000","objects_scrubbed":0,"log_size":3398,"log_dups_size":0,"ondisk_log_size":3398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:26.401861+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16708,"num_write_kb":214393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"28'617","reported_seq":651,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:16.011449+0000","last_change":"2024-09-12T02:40:16.011449+0000","last_active":"2024-09-12T02:40:16.011449+0000","last_peered":"2024-09-12T02:40:16.011449+0000","last_clean":"2024-09-12T02:40:16.011449+0000","last_became_active":"2024-09-12T02:23:15.833010+0000","last_became_peered":"2024-09-12T02:23:15.833010+0000","last_unstale":"2024-09-12T02:40:16.011449+0000","last_undegraded":"2024-09-12T02:40:16.011449+0000","last_fullsized":"2024-09-12T02:40:16.011449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'617","last_scrub_stamp":"2024-09-12T02:40:16.011287+0000","last_deep_scrub":"28'617","last_deep_scrub_stamp":"2024-09-12T02:40:16.011287+0000","last_clean_scrub_stamp":"2024-09-12T02:40:16.011287+0000","objects_scrubbed":1,"log_size":617,"log_dups_size":0,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:54.252463+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":614,"num_write_kb":4230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"28'4163","reported_seq":4195,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:37.468621+0000","last_change":"2024-09-12T02:40:37.468621+0000","last_active":"2024-09-12T02:40:37.468621+0000","last_peered":"2024-09-12T02:40:37.468621+0000","last_clean":"2024-09-12T02:40:37.468621+0000","last_became_active":"2024-09-12T02:23:16.852698+0000","last_became_peered":"2024-09-12T02:23:16.852698+0000","last_unstale":"2024-09-12T02:40:37.468621+0000","last_undegraded":"2024-09-12T02:40:37.468621+0000","last_fullsized":"2024-09-12T02:40:37.468621+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4163","last_scrub_stamp":"2024-09-12T02:40:37.468490+0000","last_deep_scrub":"28'4163","last_deep_scrub_stamp":"2024-09-12T02:40:37.468490+0000","last_clean_scrub_stamp":"2024-09-12T02:40:37.468490+0000","objects_scrubbed":0,"log_size":4163,"log_dups_size":0,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:46.238351+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21165,"num_write_kb":244679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"28'4","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:31.857646+0000","last_change":"2024-09-12T02:40:31.857646+0000","last_active":"2024-09-12T02:40:31.857646+0000","last_peered":"2024-09-12T02:40:31.857646+0000","last_clean":"2024-09-12T02:40:31.857646+0000","last_became_active":"2024-09-12T02:23:03.762464+0000","last_became_peered":"2024-09-12T02:23:03.762464+0000","last_unstale":"2024-09-12T02:40:31.857646+0000","last_undegraded":"2024-09-12T02:40:31.857646+0000","last_fullsized":"2024-09-12T02:40:31.857646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-09-12T02:40:31.857523+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-09-12T02:40:31.857523+0000","last_clean_scrub_stamp":"2024-09-12T02:40:31.857523+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:35.714715+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"28'5838","reported_seq":5878,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:16.340060+0000","last_change":"2024-09-12T02:40:16.340060+0000","last_active":"2024-09-12T02:40:16.340060+0000","last_peered":"2024-09-12T02:40:16.340060+0000","last_clean":"2024-09-12T02:40:16.340060+0000","last_became_active":"2024-09-12T02:23:04.790201+0000","last_became_peered":"2024-09-12T02:23:04.790201+0000","last_unstale":"2024-09-12T02:40:16.340060+0000","last_undegraded":"2024-09-12T02:40:16.340060+0000","last_fullsized":"2024-09-12T02:40:16.340060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5838","last_scrub_stamp":"2024-09-12T02:40:16.339929+0000","last_deep_scrub":"28'5838","last_deep_scrub_stamp":"2024-09-12T02:40:16.339929+0000","last_clean_scrub_stamp":"2024-09-12T02:40:16.339929+0000","objects_scrubbed":0,"log_size":5838,"log_dups_size":0,"ondisk_log_size":5838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:45.443505+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30329,"num_write_kb":367409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"28'95","reported_seq":129,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:18.949793+0000","last_change":"2024-09-12T02:40:18.949793+0000","last_active":"2024-09-12T02:40:18.949793+0000","last_peered":"2024-09-12T02:40:18.949793+0000","last_clean":"2024-09-12T02:40:18.949793+0000","last_became_active":"2024-09-12T02:23:15.833982+0000","last_became_peered":"2024-09-12T02:23:15.833982+0000","last_unstale":"2024-09-12T02:40:18.949793+0000","last_undegraded":"2024-09-12T02:40:18.949793+0000","last_fullsized":"2024-09-12T02:40:18.949793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'95","last_scrub_stamp":"2024-09-12T02:40:18.949676+0000","last_deep_scrub":"28'95","last_deep_scrub_stamp":"2024-09-12T02:40:18.949676+0000","last_clean_scrub_stamp":"2024-09-12T02:40:18.949676+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:51.516050+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1406481,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":1433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"28'5650","reported_seq":5682,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:36.734401+0000","last_change":"2024-09-12T02:40:36.734432+0000","last_active":"2024-09-12T02:40:36.734401+0000","last_peered":"2024-09-12T02:40:36.734401+0000","last_clean":"2024-09-12T02:40:36.734401+0000","last_became_active":"2024-09-12T02:23:16.861003+0000","last_became_peered":"2024-09-12T02:23:16.861003+0000","last_unstale":"2024-09-12T02:40:36.734401+0000","last_undegraded":"2024-09-12T02:40:36.734401+0000","last_fullsized":"2024-09-12T02:40:36.734401+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5650","last_scrub_stamp":"2024-09-12T02:40:36.734279+0000","last_deep_scrub":"28'5650","last_deep_scrub_stamp":"2024-09-12T02:40:36.734279+0000","last_clean_scrub_stamp":"2024-09-12T02:40:36.734279+0000","objects_scrubbed":0,"log_size":5650,"log_dups_size":0,"ondisk_log_size":5650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:19.032100+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29234,"num_write_kb":330189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"28'4187","reported_seq":4228,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:20.016657+0000","last_change":"2024-09-12T02:40:20.016657+0000","last_active":"2024-09-12T02:40:20.016657+0000","last_peered":"2024-09-12T02:40:20.016657+0000","last_clean":"2024-09-12T02:40:20.016657+0000","last_became_active":"2024-09-12T02:23:04.788350+0000","last_became_peered":"2024-09-12T02:23:04.788350+0000","last_unstale":"2024-09-12T02:40:20.016657+0000","last_undegraded":"2024-09-12T02:40:20.016657+0000","last_fullsized":"2024-09-12T02:40:20.016657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4187","last_scrub_stamp":"2024-09-12T02:40:20.016544+0000","last_deep_scrub":"28'4187","last_deep_scrub_stamp":"2024-09-12T02:40:20.016544+0000","last_clean_scrub_stamp":"2024-09-12T02:40:20.016544+0000","objects_scrubbed":0,"log_size":4187,"log_dups_size":0,"ondisk_log_size":4187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:36.704978+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21964,"num_write_kb":272310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"28'1151","reported_seq":1193,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:30.901424+0000","last_change":"2024-09-12T02:40:30.901464+0000","last_active":"2024-09-12T02:40:30.901424+0000","last_peered":"2024-09-12T02:40:30.901424+0000","last_clean":"2024-09-12T02:40:30.901424+0000","last_became_active":"2024-09-12T02:23:03.762627+0000","last_became_peered":"2024-09-12T02:23:03.762627+0000","last_unstale":"2024-09-12T02:40:30.901424+0000","last_undegraded":"2024-09-12T02:40:30.901424+0000","last_fullsized":"2024-09-12T02:40:30.901424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1151","last_scrub_stamp":"2024-09-12T02:40:30.901320+0000","last_deep_scrub":"28'1151","last_deep_scrub_stamp":"2024-09-12T02:40:30.901320+0000","last_clean_scrub_stamp":"2024-09-12T02:40:30.901320+0000","objects_scrubbed":2,"log_size":1151,"log_dups_size":0,"ondisk_log_size":1151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:26.710599+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1140,"num_write_kb":4413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"28'3","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:19.994389+0000","last_change":"2024-09-12T02:40:19.994438+0000","last_active":"2024-09-12T02:40:19.994389+0000","last_peered":"2024-09-12T02:40:19.994389+0000","last_clean":"2024-09-12T02:40:19.994389+0000","last_became_active":"2024-09-12T02:23:15.831292+0000","last_became_peered":"2024-09-12T02:23:15.831292+0000","last_unstale":"2024-09-12T02:40:19.994389+0000","last_undegraded":"2024-09-12T02:40:19.994389+0000","last_fullsized":"2024-09-12T02:40:19.994389+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-09-12T02:40:19.994284+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-09-12T02:40:19.994284+0000","last_clean_scrub_stamp":"2024-09-12T02:40:19.994284+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:24.583324+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"28'5482","reported_seq":5514,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:25.702392+0000","last_change":"2024-09-12T02:40:25.702421+0000","last_active":"2024-09-12T02:40:25.702392+0000","last_peered":"2024-09-12T02:40:25.702392+0000","last_clean":"2024-09-12T02:40:25.702392+0000","last_became_active":"2024-09-12T02:23:16.842210+0000","last_became_peered":"2024-09-12T02:23:16.842210+0000","last_unstale":"2024-09-12T02:40:25.702392+0000","last_undegraded":"2024-09-12T02:40:25.702392+0000","last_fullsized":"2024-09-12T02:40:25.702392+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5482","last_scrub_stamp":"2024-09-12T02:40:25.702308+0000","last_deep_scrub":"28'5482","last_deep_scrub_stamp":"2024-09-12T02:40:25.702308+0000","last_clean_scrub_stamp":"2024-09-12T02:40:25.702308+0000","objects_scrubbed":0,"log_size":5482,"log_dups_size":0,"ondisk_log_size":5482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:41.539919+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28431,"num_write_kb":318903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"28'3892","reported_seq":3932,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:35.772187+0000","last_change":"2024-09-12T02:40:35.772214+0000","last_active":"2024-09-12T02:40:35.772187+0000","last_peered":"2024-09-12T02:40:35.772187+0000","last_clean":"2024-09-12T02:40:35.772187+0000","last_became_active":"2024-09-12T02:23:04.782472+0000","last_became_peered":"2024-09-12T02:23:04.782472+0000","last_unstale":"2024-09-12T02:40:35.772187+0000","last_undegraded":"2024-09-12T02:40:35.772187+0000","last_fullsized":"2024-09-12T02:40:35.772187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3892","last_scrub_stamp":"2024-09-12T02:40:35.772084+0000","last_deep_scrub":"28'3892","last_deep_scrub_stamp":"2024-09-12T02:40:35.772084+0000","last_clean_scrub_stamp":"2024-09-12T02:40:35.772084+0000","objects_scrubbed":0,"log_size":3892,"log_dups_size":0,"ondisk_log_size":3892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:52.694603+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18989,"num_write_kb":247993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'4","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:28.728698+0000","last_change":"2024-09-12T02:40:28.728728+0000","last_active":"2024-09-12T02:40:28.728698+0000","last_peered":"2024-09-12T02:40:28.728698+0000","last_clean":"2024-09-12T02:40:28.728698+0000","last_became_active":"2024-09-12T02:23:03.769619+0000","last_became_peered":"2024-09-12T02:23:03.769619+0000","last_unstale":"2024-09-12T02:40:28.728698+0000","last_undegraded":"2024-09-12T02:40:28.728698+0000","last_fullsized":"2024-09-12T02:40:28.728698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-09-12T02:40:28.728597+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-09-12T02:40:28.728597+0000","last_clean_scrub_stamp":"2024-09-12T02:40:28.728597+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:53:59.612583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"28'2","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:16.987753+0000","last_change":"2024-09-12T02:40:16.987776+0000","last_active":"2024-09-12T02:40:16.987753+0000","last_peered":"2024-09-12T02:40:16.987753+0000","last_clean":"2024-09-12T02:40:16.987753+0000","last_became_active":"2024-09-12T02:23:15.832995+0000","last_became_peered":"2024-09-12T02:23:15.832995+0000","last_unstale":"2024-09-12T02:40:16.987753+0000","last_undegraded":"2024-09-12T02:40:16.987753+0000","last_fullsized":"2024-09-12T02:40:16.987753+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2024-09-12T02:40:16.987665+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2024-09-12T02:40:16.987665+0000","last_clean_scrub_stamp":"2024-09-12T02:40:16.987665+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:20.081690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"28'4854","reported_seq":4886,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:33.898203+0000","last_change":"2024-09-12T02:40:33.898247+0000","last_active":"2024-09-12T02:40:33.898203+0000","last_peered":"2024-09-12T02:40:33.898203+0000","last_clean":"2024-09-12T02:40:33.898203+0000","last_became_active":"2024-09-12T02:23:16.856166+0000","last_became_peered":"2024-09-12T02:23:16.856166+0000","last_unstale":"2024-09-12T02:40:33.898203+0000","last_undegraded":"2024-09-12T02:40:33.898203+0000","last_fullsized":"2024-09-12T02:40:33.898203+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4854","last_scrub_stamp":"2024-09-12T02:40:33.898100+0000","last_deep_scrub":"28'4854","last_deep_scrub_stamp":"2024-09-12T02:40:33.898100+0000","last_clean_scrub_stamp":"2024-09-12T02:40:33.898100+0000","objects_scrubbed":0,"log_size":4854,"log_dups_size":0,"ondisk_log_size":4854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:21.951148+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24657,"num_write_kb":295553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"28'4675","reported_seq":4716,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:28.798684+0000","last_change":"2024-09-12T02:40:28.798732+0000","last_active":"2024-09-12T02:40:28.798684+0000","last_peered":"2024-09-12T02:40:28.798684+0000","last_clean":"2024-09-12T02:40:28.798684+0000","last_became_active":"2024-09-12T02:23:04.783143+0000","last_became_peered":"2024-09-12T02:23:04.783143+0000","last_unstale":"2024-09-12T02:40:28.798684+0000","last_undegraded":"2024-09-12T02:40:28.798684+0000","last_fullsized":"2024-09-12T02:40:28.798684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4675","last_scrub_stamp":"2024-09-12T02:40:28.798565+0000","last_deep_scrub":"28'4675","last_deep_scrub_stamp":"2024-09-12T02:40:28.798565+0000","last_clean_scrub_stamp":"2024-09-12T02:40:28.798565+0000","objects_scrubbed":0,"log_size":4675,"log_dups_size":0,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:52.357475+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24578,"num_write_kb":303391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'3","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:25.760934+0000","last_change":"2024-09-12T02:40:25.760934+0000","last_active":"2024-09-12T02:40:25.760934+0000","last_peered":"2024-09-12T02:40:25.760934+0000","last_clean":"2024-09-12T02:40:25.760934+0000","last_became_active":"2024-09-12T02:23:03.769406+0000","last_became_peered":"2024-09-12T02:23:03.769406+0000","last_unstale":"2024-09-12T02:40:25.760934+0000","last_undegraded":"2024-09-12T02:40:25.760934+0000","last_fullsized":"2024-09-12T02:40:25.760934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-09-12T02:40:25.760806+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-09-12T02:40:25.760806+0000","last_clean_scrub_stamp":"2024-09-12T02:40:25.760806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:50.077752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"28'6","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:21.875145+0000","last_change":"2024-09-12T02:40:21.875199+0000","last_active":"2024-09-12T02:40:21.875145+0000","last_peered":"2024-09-12T02:40:21.875145+0000","last_clean":"2024-09-12T02:40:21.875145+0000","last_became_active":"2024-09-12T02:23:15.834753+0000","last_became_peered":"2024-09-12T02:23:15.834753+0000","last_unstale":"2024-09-12T02:40:21.875145+0000","last_undegraded":"2024-09-12T02:40:21.875145+0000","last_fullsized":"2024-09-12T02:40:21.875145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-09-12T02:40:21.875045+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-09-12T02:40:21.875045+0000","last_clean_scrub_stamp":"2024-09-12T02:40:21.875045+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:20:45.548152+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"28'5924","reported_seq":5956,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:43.400594+0000","last_change":"2024-09-12T02:40:43.400622+0000","last_active":"2024-09-12T02:40:43.400594+0000","last_peered":"2024-09-12T02:40:43.400594+0000","last_clean":"2024-09-12T02:40:43.400594+0000","last_became_active":"2024-09-12T02:23:16.860656+0000","last_became_peered":"2024-09-12T02:23:16.860656+0000","last_unstale":"2024-09-12T02:40:43.400594+0000","last_undegraded":"2024-09-12T02:40:43.400594+0000","last_fullsized":"2024-09-12T02:40:43.400594+0000","mapping_epoch":24,"log_start":"28'100","ondisk_log_start":"28'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5924","last_scrub_stamp":"2024-09-12T02:40:43.400494+0000","last_deep_scrub":"28'5924","last_deep_scrub_stamp":"2024-09-12T02:40:43.400494+0000","last_clean_scrub_stamp":"2024-09-12T02:40:43.400494+0000","objects_scrubbed":0,"log_size":5824,"log_dups_size":0,"ondisk_log_size":5824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:50.281451+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30048,"num_write_kb":358073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"28'4362","reported_seq":4403,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:25.920301+0000","last_change":"2024-09-12T02:40:25.920301+0000","last_active":"2024-09-12T02:40:25.920301+0000","last_peered":"2024-09-12T02:40:25.920301+0000","last_clean":"2024-09-12T02:40:25.920301+0000","last_became_active":"2024-09-12T02:23:04.779984+0000","last_became_peered":"2024-09-12T02:23:04.779984+0000","last_unstale":"2024-09-12T02:40:25.920301+0000","last_undegraded":"2024-09-12T02:40:25.920301+0000","last_fullsized":"2024-09-12T02:40:25.920301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4362","last_scrub_stamp":"2024-09-12T02:40:25.920153+0000","last_deep_scrub":"28'4362","last_deep_scrub_stamp":"2024-09-12T02:40:25.920153+0000","last_clean_scrub_stamp":"2024-09-12T02:40:25.920153+0000","objects_scrubbed":0,"log_size":4362,"log_dups_size":0,"ondisk_log_size":4362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:54.516440+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22346,"num_write_kb":282099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"28'3","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:33.886146+0000","last_change":"2024-09-12T02:40:33.886173+0000","last_active":"2024-09-12T02:40:33.886146+0000","last_peered":"2024-09-12T02:40:33.886146+0000","last_clean":"2024-09-12T02:40:33.886146+0000","last_became_active":"2024-09-12T02:23:03.764218+0000","last_became_peered":"2024-09-12T02:23:03.764218+0000","last_unstale":"2024-09-12T02:40:33.886146+0000","last_undegraded":"2024-09-12T02:40:33.886146+0000","last_fullsized":"2024-09-12T02:40:33.886146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-09-12T02:40:33.886057+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-09-12T02:40:33.886057+0000","last_clean_scrub_stamp":"2024-09-12T02:40:33.886057+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:25.152808+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"28'7","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:17.971178+0000","last_change":"2024-09-12T02:40:17.971205+0000","last_active":"2024-09-12T02:40:17.971178+0000","last_peered":"2024-09-12T02:40:17.971178+0000","last_clean":"2024-09-12T02:40:17.971178+0000","last_became_active":"2024-09-12T02:23:15.831331+0000","last_became_peered":"2024-09-12T02:23:15.831331+0000","last_unstale":"2024-09-12T02:40:17.971178+0000","last_undegraded":"2024-09-12T02:40:17.971178+0000","last_fullsized":"2024-09-12T02:40:17.971178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-09-12T02:40:17.971087+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-09-12T02:40:17.971087+0000","last_clean_scrub_stamp":"2024-09-12T02:40:17.971087+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:49.270134+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"28'4897","reported_seq":4930,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:42.781430+0000","last_change":"2024-09-12T02:40:42.781482+0000","last_active":"2024-09-12T02:40:42.781430+0000","last_peered":"2024-09-12T02:40:42.781430+0000","last_clean":"2024-09-12T02:40:42.781430+0000","last_became_active":"2024-09-12T02:23:16.845749+0000","last_became_peered":"2024-09-12T02:23:16.845749+0000","last_unstale":"2024-09-12T02:40:42.781430+0000","last_undegraded":"2024-09-12T02:40:42.781430+0000","last_fullsized":"2024-09-12T02:40:42.781430+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4897","last_scrub_stamp":"2024-09-12T02:40:42.781317+0000","last_deep_scrub":"28'4897","last_deep_scrub_stamp":"2024-09-12T02:40:42.781317+0000","last_clean_scrub_stamp":"2024-09-12T02:40:42.781317+0000","objects_scrubbed":0,"log_size":4897,"log_dups_size":0,"ondisk_log_size":4897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:51.392694+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25893,"num_write_kb":296532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"28'3849","reported_seq":3890,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:18.713697+0000","last_change":"2024-09-12T02:40:18.713697+0000","last_active":"2024-09-12T02:40:18.713697+0000","last_peered":"2024-09-12T02:40:18.713697+0000","last_clean":"2024-09-12T02:40:18.713697+0000","last_became_active":"2024-09-12T02:23:04.786591+0000","last_became_peered":"2024-09-12T02:23:04.786591+0000","last_unstale":"2024-09-12T02:40:18.713697+0000","last_undegraded":"2024-09-12T02:40:18.713697+0000","last_fullsized":"2024-09-12T02:40:18.713697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3849","last_scrub_stamp":"2024-09-12T02:40:18.713497+0000","last_deep_scrub":"28'3849","last_deep_scrub_stamp":"2024-09-12T02:40:18.713497+0000","last_clean_scrub_stamp":"2024-09-12T02:40:18.713497+0000","objects_scrubbed":0,"log_size":3849,"log_dups_size":0,"ondisk_log_size":3849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:49.707703+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19665,"num_write_kb":250729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'6","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:24.956292+0000","last_change":"2024-09-12T02:40:24.956317+0000","last_active":"2024-09-12T02:40:24.956292+0000","last_peered":"2024-09-12T02:40:24.956292+0000","last_clean":"2024-09-12T02:40:24.956292+0000","last_became_active":"2024-09-12T02:23:03.770687+0000","last_became_peered":"2024-09-12T02:23:03.770687+0000","last_unstale":"2024-09-12T02:40:24.956292+0000","last_undegraded":"2024-09-12T02:40:24.956292+0000","last_fullsized":"2024-09-12T02:40:24.956292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-09-12T02:40:24.956213+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-09-12T02:40:24.956213+0000","last_clean_scrub_stamp":"2024-09-12T02:40:24.956213+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:52.565555+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"28'60","reported_seq":152,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:29.953518+0000","last_change":"2024-09-12T02:40:29.953563+0000","last_active":"2024-09-12T02:40:29.953518+0000","last_peered":"2024-09-12T02:40:29.953518+0000","last_clean":"2024-09-12T02:40:29.953518+0000","last_became_active":"2024-09-12T02:23:15.829135+0000","last_became_peered":"2024-09-12T02:23:15.829135+0000","last_unstale":"2024-09-12T02:40:29.953518+0000","last_undegraded":"2024-09-12T02:40:29.953518+0000","last_fullsized":"2024-09-12T02:40:29.953518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'60","last_scrub_stamp":"2024-09-12T02:40:29.953405+0000","last_deep_scrub":"28'60","last_deep_scrub_stamp":"2024-09-12T02:40:29.953405+0000","last_clean_scrub_stamp":"2024-09-12T02:40:29.953405+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:27.639407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":57,"num_read_kb":123,"num_write":57,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"28'5530","reported_seq":5563,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:35.921138+0000","last_change":"2024-09-12T02:40:35.921178+0000","last_active":"2024-09-12T02:40:35.921138+0000","last_peered":"2024-09-12T02:40:35.921138+0000","last_clean":"2024-09-12T02:40:35.921138+0000","last_became_active":"2024-09-12T02:23:16.856705+0000","last_became_peered":"2024-09-12T02:23:16.856705+0000","last_unstale":"2024-09-12T02:40:35.921138+0000","last_undegraded":"2024-09-12T02:40:35.921138+0000","last_fullsized":"2024-09-12T02:40:35.921138+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5530","last_scrub_stamp":"2024-09-12T02:40:35.921040+0000","last_deep_scrub":"28'5530","last_deep_scrub_stamp":"2024-09-12T02:40:35.921040+0000","last_clean_scrub_stamp":"2024-09-12T02:40:35.921040+0000","objects_scrubbed":0,"log_size":5530,"log_dups_size":0,"ondisk_log_size":5530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:37.651267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29256,"num_write_kb":314000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"28'4419","reported_seq":4460,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:26.855919+0000","last_change":"2024-09-12T02:40:26.855919+0000","last_active":"2024-09-12T02:40:26.855919+0000","last_peered":"2024-09-12T02:40:26.855919+0000","last_clean":"2024-09-12T02:40:26.855919+0000","last_became_active":"2024-09-12T02:23:04.786136+0000","last_became_peered":"2024-09-12T02:23:04.786136+0000","last_unstale":"2024-09-12T02:40:26.855919+0000","last_undegraded":"2024-09-12T02:40:26.855919+0000","last_fullsized":"2024-09-12T02:40:26.855919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4419","last_scrub_stamp":"2024-09-12T02:40:26.855787+0000","last_deep_scrub":"28'4419","last_deep_scrub_stamp":"2024-09-12T02:40:26.855787+0000","last_clean_scrub_stamp":"2024-09-12T02:40:26.855787+0000","objects_scrubbed":0,"log_size":4419,"log_dups_size":0,"ondisk_log_size":4419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:39.527316+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22653,"num_write_kb":291447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'598","reported_seq":641,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:24.804048+0000","last_change":"2024-09-12T02:40:24.804048+0000","last_active":"2024-09-12T02:40:24.804048+0000","last_peered":"2024-09-12T02:40:24.804048+0000","last_clean":"2024-09-12T02:40:24.804048+0000","last_became_active":"2024-09-12T02:23:03.769410+0000","last_became_peered":"2024-09-12T02:23:03.769410+0000","last_unstale":"2024-09-12T02:40:24.804048+0000","last_undegraded":"2024-09-12T02:40:24.804048+0000","last_fullsized":"2024-09-12T02:40:24.804048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'598","last_scrub_stamp":"2024-09-12T02:40:24.803897+0000","last_deep_scrub":"28'598","last_deep_scrub_stamp":"2024-09-12T02:40:24.803897+0000","last_clean_scrub_stamp":"2024-09-12T02:40:24.803897+0000","objects_scrubbed":1,"log_size":598,"log_dups_size":0,"ondisk_log_size":598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:33.918486+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1455,"num_write_kb":462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"28'5","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:15.918706+0000","last_change":"2024-09-12T02:40:15.918728+0000","last_active":"2024-09-12T02:40:15.918706+0000","last_peered":"2024-09-12T02:40:15.918706+0000","last_clean":"2024-09-12T02:40:15.918706+0000","last_became_active":"2024-09-12T02:23:15.826564+0000","last_became_peered":"2024-09-12T02:23:15.826564+0000","last_unstale":"2024-09-12T02:40:15.918706+0000","last_undegraded":"2024-09-12T02:40:15.918706+0000","last_fullsized":"2024-09-12T02:40:15.918706+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-09-12T02:40:15.918631+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-09-12T02:40:15.918631+0000","last_clean_scrub_stamp":"2024-09-12T02:40:15.918631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:36.543698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"28'5561","reported_seq":5594,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:31.879485+0000","last_change":"2024-09-12T02:40:31.879528+0000","last_active":"2024-09-12T02:40:31.879485+0000","last_peered":"2024-09-12T02:40:31.879485+0000","last_clean":"2024-09-12T02:40:31.879485+0000","last_became_active":"2024-09-12T02:23:16.837162+0000","last_became_peered":"2024-09-12T02:23:16.837162+0000","last_unstale":"2024-09-12T02:40:31.879485+0000","last_undegraded":"2024-09-12T02:40:31.879485+0000","last_fullsized":"2024-09-12T02:40:31.879485+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5561","last_scrub_stamp":"2024-09-12T02:40:31.879372+0000","last_deep_scrub":"28'5561","last_deep_scrub_stamp":"2024-09-12T02:40:31.879372+0000","last_clean_scrub_stamp":"2024-09-12T02:40:31.879372+0000","objects_scrubbed":0,"log_size":5561,"log_dups_size":0,"ondisk_log_size":5561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:57.293741+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28597,"num_write_kb":327668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"28'4780","reported_seq":4821,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:30.743281+0000","last_change":"2024-09-12T02:40:30.743327+0000","last_active":"2024-09-12T02:40:30.743281+0000","last_peered":"2024-09-12T02:40:30.743281+0000","last_clean":"2024-09-12T02:40:30.743281+0000","last_became_active":"2024-09-12T02:23:04.775571+0000","last_became_peered":"2024-09-12T02:23:04.775571+0000","last_unstale":"2024-09-12T02:40:30.743281+0000","last_undegraded":"2024-09-12T02:40:30.743281+0000","last_fullsized":"2024-09-12T02:40:30.743281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4780","last_scrub_stamp":"2024-09-12T02:40:30.743146+0000","last_deep_scrub":"28'4780","last_deep_scrub_stamp":"2024-09-12T02:40:30.743146+0000","last_clean_scrub_stamp":"2024-09-12T02:40:30.743146+0000","objects_scrubbed":0,"log_size":4780,"log_dups_size":0,"ondisk_log_size":4780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:14.168076+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24981,"num_write_kb":308974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"28'4","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:32.879444+0000","last_change":"2024-09-12T02:40:32.879467+0000","last_active":"2024-09-12T02:40:32.879444+0000","last_peered":"2024-09-12T02:40:32.879444+0000","last_clean":"2024-09-12T02:40:32.879444+0000","last_became_active":"2024-09-12T02:23:03.763147+0000","last_became_peered":"2024-09-12T02:23:03.763147+0000","last_unstale":"2024-09-12T02:40:32.879444+0000","last_undegraded":"2024-09-12T02:40:32.879444+0000","last_fullsized":"2024-09-12T02:40:32.879444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-09-12T02:40:32.879345+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-09-12T02:40:32.879345+0000","last_clean_scrub_stamp":"2024-09-12T02:40:32.879345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:45.921507+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"28'1","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:17.740401+0000","last_change":"2024-09-12T02:40:17.740479+0000","last_active":"2024-09-12T02:40:17.740401+0000","last_peered":"2024-09-12T02:40:17.740401+0000","last_clean":"2024-09-12T02:40:17.740401+0000","last_became_active":"2024-09-12T02:23:15.831637+0000","last_became_peered":"2024-09-12T02:23:15.831637+0000","last_unstale":"2024-09-12T02:40:17.740401+0000","last_undegraded":"2024-09-12T02:40:17.740401+0000","last_fullsized":"2024-09-12T02:40:17.740401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1","last_scrub_stamp":"2024-09-12T02:40:17.740261+0000","last_deep_scrub":"28'1","last_deep_scrub_stamp":"2024-09-12T02:40:17.740261+0000","last_clean_scrub_stamp":"2024-09-12T02:40:17.740261+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:46.467057+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"28'5517","reported_seq":5550,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:31.727813+0000","last_change":"2024-09-12T02:40:31.727843+0000","last_active":"2024-09-12T02:40:31.727813+0000","last_peered":"2024-09-12T02:40:31.727813+0000","last_clean":"2024-09-12T02:40:31.727813+0000","last_became_active":"2024-09-12T02:23:16.835520+0000","last_became_peered":"2024-09-12T02:23:16.835520+0000","last_unstale":"2024-09-12T02:40:31.727813+0000","last_undegraded":"2024-09-12T02:40:31.727813+0000","last_fullsized":"2024-09-12T02:40:31.727813+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5517","last_scrub_stamp":"2024-09-12T02:40:31.727715+0000","last_deep_scrub":"28'5517","last_deep_scrub_stamp":"2024-09-12T02:40:31.727715+0000","last_clean_scrub_stamp":"2024-09-12T02:40:31.727715+0000","objects_scrubbed":0,"log_size":5517,"log_dups_size":0,"ondisk_log_size":5517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:44.732297+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29476,"num_write_kb":310838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"28'3821","reported_seq":3862,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:23.504812+0000","last_change":"2024-09-12T02:40:23.504852+0000","last_active":"2024-09-12T02:40:23.504812+0000","last_peered":"2024-09-12T02:40:23.504812+0000","last_clean":"2024-09-12T02:40:23.504812+0000","last_became_active":"2024-09-12T02:23:04.786527+0000","last_became_peered":"2024-09-12T02:23:04.786527+0000","last_unstale":"2024-09-12T02:40:23.504812+0000","last_undegraded":"2024-09-12T02:40:23.504812+0000","last_fullsized":"2024-09-12T02:40:23.504812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3821","last_scrub_stamp":"2024-09-12T02:40:23.504689+0000","last_deep_scrub":"28'3821","last_deep_scrub_stamp":"2024-09-12T02:40:23.504689+0000","last_clean_scrub_stamp":"2024-09-12T02:40:23.504689+0000","objects_scrubbed":0,"log_size":3821,"log_dups_size":0,"ondisk_log_size":3821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:47:52.344813+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19788,"num_write_kb":259568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"28'5","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:26.712260+0000","last_change":"2024-09-12T02:40:26.712286+0000","last_active":"2024-09-12T02:40:26.712260+0000","last_peered":"2024-09-12T02:40:26.712260+0000","last_clean":"2024-09-12T02:40:26.712260+0000","last_became_active":"2024-09-12T02:23:03.769444+0000","last_became_peered":"2024-09-12T02:23:03.769444+0000","last_unstale":"2024-09-12T02:40:26.712260+0000","last_undegraded":"2024-09-12T02:40:26.712260+0000","last_fullsized":"2024-09-12T02:40:26.712260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-09-12T02:40:26.712174+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-09-12T02:40:26.712174+0000","last_clean_scrub_stamp":"2024-09-12T02:40:26.712174+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:15.457629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"28'5","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:17.883069+0000","last_change":"2024-09-12T02:40:17.883091+0000","last_active":"2024-09-12T02:40:17.883069+0000","last_peered":"2024-09-12T02:40:17.883069+0000","last_clean":"2024-09-12T02:40:17.883069+0000","last_became_active":"2024-09-12T02:23:15.828256+0000","last_became_peered":"2024-09-12T02:23:15.828256+0000","last_unstale":"2024-09-12T02:40:17.883069+0000","last_undegraded":"2024-09-12T02:40:17.883069+0000","last_fullsized":"2024-09-12T02:40:17.883069+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-09-12T02:40:17.882990+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-09-12T02:40:17.882990+0000","last_clean_scrub_stamp":"2024-09-12T02:40:17.882990+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:50.173392+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"28'4600","reported_seq":4633,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:33.726383+0000","last_change":"2024-09-12T02:40:33.726427+0000","last_active":"2024-09-12T02:40:33.726383+0000","last_peered":"2024-09-12T02:40:33.726383+0000","last_clean":"2024-09-12T02:40:33.726383+0000","last_became_active":"2024-09-12T02:23:16.845379+0000","last_became_peered":"2024-09-12T02:23:16.845379+0000","last_unstale":"2024-09-12T02:40:33.726383+0000","last_undegraded":"2024-09-12T02:40:33.726383+0000","last_fullsized":"2024-09-12T02:40:33.726383+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4600","last_scrub_stamp":"2024-09-12T02:40:33.726276+0000","last_deep_scrub":"28'4600","last_deep_scrub_stamp":"2024-09-12T02:40:33.726276+0000","last_clean_scrub_stamp":"2024-09-12T02:40:33.726276+0000","objects_scrubbed":0,"log_size":4600,"log_dups_size":0,"ondisk_log_size":4600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:18.278609+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24241,"num_write_kb":277536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"28'4371","reported_seq":4412,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:27.977584+0000","last_change":"2024-09-12T02:40:27.977610+0000","last_active":"2024-09-12T02:40:27.977584+0000","last_peered":"2024-09-12T02:40:27.977584+0000","last_clean":"2024-09-12T02:40:27.977584+0000","last_became_active":"2024-09-12T02:23:04.786877+0000","last_became_peered":"2024-09-12T02:23:04.786877+0000","last_unstale":"2024-09-12T02:40:27.977584+0000","last_undegraded":"2024-09-12T02:40:27.977584+0000","last_fullsized":"2024-09-12T02:40:27.977584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4371","last_scrub_stamp":"2024-09-12T02:40:27.977465+0000","last_deep_scrub":"28'4371","last_deep_scrub_stamp":"2024-09-12T02:40:27.977465+0000","last_clean_scrub_stamp":"2024-09-12T02:40:27.977465+0000","objects_scrubbed":0,"log_size":4371,"log_dups_size":0,"ondisk_log_size":4371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:36.470278+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23204,"num_write_kb":285450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"28'5","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:32.470137+0000","last_change":"2024-09-12T02:40:32.470215+0000","last_active":"2024-09-12T02:40:32.470137+0000","last_peered":"2024-09-12T02:40:32.470137+0000","last_clean":"2024-09-12T02:40:32.470137+0000","last_became_active":"2024-09-12T02:23:03.771063+0000","last_became_peered":"2024-09-12T02:23:03.771063+0000","last_unstale":"2024-09-12T02:40:32.470137+0000","last_undegraded":"2024-09-12T02:40:32.470137+0000","last_fullsized":"2024-09-12T02:40:32.470137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-09-12T02:40:32.470030+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-09-12T02:40:32.470030+0000","last_clean_scrub_stamp":"2024-09-12T02:40:32.470030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:52.686199+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"28'5","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:14.859962+0000","last_change":"2024-09-12T02:40:14.859985+0000","last_active":"2024-09-12T02:40:14.859962+0000","last_peered":"2024-09-12T02:40:14.859962+0000","last_clean":"2024-09-12T02:40:14.859962+0000","last_became_active":"2024-09-12T02:23:15.826708+0000","last_became_peered":"2024-09-12T02:23:15.826708+0000","last_unstale":"2024-09-12T02:40:14.859962+0000","last_undegraded":"2024-09-12T02:40:14.859962+0000","last_fullsized":"2024-09-12T02:40:14.859962+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-09-12T02:40:14.859876+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-09-12T02:40:14.859876+0000","last_clean_scrub_stamp":"2024-09-12T02:40:14.859876+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:44.796702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'4748","reported_seq":4781,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:27.719578+0000","last_change":"2024-09-12T02:40:27.719578+0000","last_active":"2024-09-12T02:40:27.719578+0000","last_peered":"2024-09-12T02:40:27.719578+0000","last_clean":"2024-09-12T02:40:27.719578+0000","last_became_active":"2024-09-12T02:23:16.849119+0000","last_became_peered":"2024-09-12T02:23:16.849119+0000","last_unstale":"2024-09-12T02:40:27.719578+0000","last_undegraded":"2024-09-12T02:40:27.719578+0000","last_fullsized":"2024-09-12T02:40:27.719578+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4748","last_scrub_stamp":"2024-09-12T02:40:27.719462+0000","last_deep_scrub":"28'4748","last_deep_scrub_stamp":"2024-09-12T02:40:27.719462+0000","last_clean_scrub_stamp":"2024-09-12T02:40:27.719462+0000","objects_scrubbed":0,"log_size":4748,"log_dups_size":0,"ondisk_log_size":4748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:38.364108+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23965,"num_write_kb":268065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"28'4258","reported_seq":4299,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:29.717526+0000","last_change":"2024-09-12T02:40:29.717554+0000","last_active":"2024-09-12T02:40:29.717526+0000","last_peered":"2024-09-12T02:40:29.717526+0000","last_clean":"2024-09-12T02:40:29.717526+0000","last_became_active":"2024-09-12T02:23:04.773360+0000","last_became_peered":"2024-09-12T02:23:04.773360+0000","last_unstale":"2024-09-12T02:40:29.717526+0000","last_undegraded":"2024-09-12T02:40:29.717526+0000","last_fullsized":"2024-09-12T02:40:29.717526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4258","last_scrub_stamp":"2024-09-12T02:40:29.717422+0000","last_deep_scrub":"28'4258","last_deep_scrub_stamp":"2024-09-12T02:40:29.717422+0000","last_clean_scrub_stamp":"2024-09-12T02:40:29.717422+0000","objects_scrubbed":0,"log_size":4258,"log_dups_size":0,"ondisk_log_size":4258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:13:19.250506+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22673,"num_write_kb":283464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'65","reported_seq":170,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:17.742281+0000","last_change":"2024-09-12T02:40:17.742308+0000","last_active":"2024-09-12T02:40:17.742281+0000","last_peered":"2024-09-12T02:40:17.742281+0000","last_clean":"2024-09-12T02:40:17.742281+0000","last_became_active":"2024-09-12T02:23:03.760397+0000","last_became_peered":"2024-09-12T02:23:03.760397+0000","last_unstale":"2024-09-12T02:40:17.742281+0000","last_undegraded":"2024-09-12T02:40:17.742281+0000","last_fullsized":"2024-09-12T02:40:17.742281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'65","last_scrub_stamp":"2024-09-12T02:40:17.742207+0000","last_deep_scrub":"28'65","last_deep_scrub_stamp":"2024-09-12T02:40:17.742207+0000","last_clean_scrub_stamp":"2024-09-12T02:40:17.742207+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:29.965072+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":62,"num_read_kb":127,"num_write":62,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"28'5","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:15.891412+0000","last_change":"2024-09-12T02:40:15.891412+0000","last_active":"2024-09-12T02:40:15.891412+0000","last_peered":"2024-09-12T02:40:15.891412+0000","last_clean":"2024-09-12T02:40:15.891412+0000","last_became_active":"2024-09-12T02:23:15.827458+0000","last_became_peered":"2024-09-12T02:23:15.827458+0000","last_unstale":"2024-09-12T02:40:15.891412+0000","last_undegraded":"2024-09-12T02:40:15.891412+0000","last_fullsized":"2024-09-12T02:40:15.891412+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-09-12T02:40:15.891307+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-09-12T02:40:15.891307+0000","last_clean_scrub_stamp":"2024-09-12T02:40:15.891307+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:51.348223+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"28'4979","reported_seq":5012,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:38.437736+0000","last_change":"2024-09-12T02:40:38.437736+0000","last_active":"2024-09-12T02:40:38.437736+0000","last_peered":"2024-09-12T02:40:38.437736+0000","last_clean":"2024-09-12T02:40:38.437736+0000","last_became_active":"2024-09-12T02:23:16.854938+0000","last_became_peered":"2024-09-12T02:23:16.854938+0000","last_unstale":"2024-09-12T02:40:38.437736+0000","last_undegraded":"2024-09-12T02:40:38.437736+0000","last_fullsized":"2024-09-12T02:40:38.437736+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4979","last_scrub_stamp":"2024-09-12T02:40:38.437588+0000","last_deep_scrub":"28'4979","last_deep_scrub_stamp":"2024-09-12T02:40:38.437588+0000","last_clean_scrub_stamp":"2024-09-12T02:40:38.437588+0000","objects_scrubbed":0,"log_size":4979,"log_dups_size":0,"ondisk_log_size":4979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:26.653558+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25537,"num_write_kb":303027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"28'4415","reported_seq":4456,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:14.745134+0000","last_change":"2024-09-12T02:40:14.745158+0000","last_active":"2024-09-12T02:40:14.745134+0000","last_peered":"2024-09-12T02:40:14.745134+0000","last_clean":"2024-09-12T02:40:14.745134+0000","last_became_active":"2024-09-12T02:23:04.787523+0000","last_became_peered":"2024-09-12T02:23:04.787523+0000","last_unstale":"2024-09-12T02:40:14.745134+0000","last_undegraded":"2024-09-12T02:40:14.745134+0000","last_fullsized":"2024-09-12T02:40:14.745134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4415","last_scrub_stamp":"2024-09-12T02:40:14.745044+0000","last_deep_scrub":"28'4415","last_deep_scrub_stamp":"2024-09-12T02:40:14.745044+0000","last_clean_scrub_stamp":"2024-09-12T02:40:14.745044+0000","objects_scrubbed":0,"log_size":4415,"log_dups_size":0,"ondisk_log_size":4415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:04.003662+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23022,"num_write_kb":288900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'5","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:35.877426+0000","last_change":"2024-09-12T02:40:35.877461+0000","last_active":"2024-09-12T02:40:35.877426+0000","last_peered":"2024-09-12T02:40:35.877426+0000","last_clean":"2024-09-12T02:40:35.877426+0000","last_became_active":"2024-09-12T02:23:03.771163+0000","last_became_peered":"2024-09-12T02:23:03.771163+0000","last_unstale":"2024-09-12T02:40:35.877426+0000","last_undegraded":"2024-09-12T02:40:35.877426+0000","last_fullsized":"2024-09-12T02:40:35.877426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-09-12T02:40:35.877352+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-09-12T02:40:35.877352+0000","last_clean_scrub_stamp":"2024-09-12T02:40:35.877352+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:17.179269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"28'616","reported_seq":651,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:30.689599+0000","last_change":"2024-09-12T02:40:30.689599+0000","last_active":"2024-09-12T02:40:30.689599+0000","last_peered":"2024-09-12T02:40:30.689599+0000","last_clean":"2024-09-12T02:40:30.689599+0000","last_became_active":"2024-09-12T02:23:15.833587+0000","last_became_peered":"2024-09-12T02:23:15.833587+0000","last_unstale":"2024-09-12T02:40:30.689599+0000","last_undegraded":"2024-09-12T02:40:30.689599+0000","last_fullsized":"2024-09-12T02:40:30.689599+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'616","last_scrub_stamp":"2024-09-12T02:40:30.689464+0000","last_deep_scrub":"28'616","last_deep_scrub_stamp":"2024-09-12T02:40:30.689464+0000","last_clean_scrub_stamp":"2024-09-12T02:40:30.689464+0000","objects_scrubbed":1,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:04.861691+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1484,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"28'5400","reported_seq":5433,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:37.869126+0000","last_change":"2024-09-12T02:40:37.869196+0000","last_active":"2024-09-12T02:40:37.869126+0000","last_peered":"2024-09-12T02:40:37.869126+0000","last_clean":"2024-09-12T02:40:37.869126+0000","last_became_active":"2024-09-12T02:23:16.848385+0000","last_became_peered":"2024-09-12T02:23:16.848385+0000","last_unstale":"2024-09-12T02:40:37.869126+0000","last_undegraded":"2024-09-12T02:40:37.869126+0000","last_fullsized":"2024-09-12T02:40:37.869126+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5400","last_scrub_stamp":"2024-09-12T02:40:37.869009+0000","last_deep_scrub":"28'5400","last_deep_scrub_stamp":"2024-09-12T02:40:37.869009+0000","last_clean_scrub_stamp":"2024-09-12T02:40:37.869009+0000","objects_scrubbed":0,"log_size":5400,"log_dups_size":0,"ondisk_log_size":5400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:47:24.700751+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28350,"num_write_kb":322666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"28'5040","reported_seq":5081,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:33.744831+0000","last_change":"2024-09-12T02:40:33.744855+0000","last_active":"2024-09-12T02:40:33.744831+0000","last_peered":"2024-09-12T02:40:33.744831+0000","last_clean":"2024-09-12T02:40:33.744831+0000","last_became_active":"2024-09-12T02:23:04.780984+0000","last_became_peered":"2024-09-12T02:23:04.780984+0000","last_unstale":"2024-09-12T02:40:33.744831+0000","last_undegraded":"2024-09-12T02:40:33.744831+0000","last_fullsized":"2024-09-12T02:40:33.744831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5040","last_scrub_stamp":"2024-09-12T02:40:33.744737+0000","last_deep_scrub":"28'5040","last_deep_scrub_stamp":"2024-09-12T02:40:33.744737+0000","last_clean_scrub_stamp":"2024-09-12T02:40:33.744737+0000","objects_scrubbed":0,"log_size":5040,"log_dups_size":0,"ondisk_log_size":5040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:29.128675+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25643,"num_write_kb":315836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'1","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:29.549609+0000","last_change":"2024-09-12T02:40:29.549650+0000","last_active":"2024-09-12T02:40:29.549609+0000","last_peered":"2024-09-12T02:40:29.549609+0000","last_clean":"2024-09-12T02:40:29.549609+0000","last_became_active":"2024-09-12T02:23:03.764801+0000","last_became_peered":"2024-09-12T02:23:03.764801+0000","last_unstale":"2024-09-12T02:40:29.549609+0000","last_undegraded":"2024-09-12T02:40:29.549609+0000","last_fullsized":"2024-09-12T02:40:29.549609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1","last_scrub_stamp":"2024-09-12T02:40:29.549482+0000","last_deep_scrub":"28'1","last_deep_scrub_stamp":"2024-09-12T02:40:29.549482+0000","last_clean_scrub_stamp":"2024-09-12T02:40:29.549482+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:14.649738+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"28'119","reported_seq":201,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:29.881219+0000","last_change":"2024-09-12T02:40:29.881250+0000","last_active":"2024-09-12T02:40:29.881219+0000","last_peered":"2024-09-12T02:40:29.881219+0000","last_clean":"2024-09-12T02:40:29.881219+0000","last_became_active":"2024-09-12T02:22:55.142784+0000","last_became_peered":"2024-09-12T02:22:55.142784+0000","last_unstale":"2024-09-12T02:40:29.881219+0000","last_undegraded":"2024-09-12T02:40:29.881219+0000","last_fullsized":"2024-09-12T02:40:29.881219+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'119","last_scrub_stamp":"2024-09-12T02:40:29.881130+0000","last_deep_scrub":"28'119","last_deep_scrub_stamp":"2024-09-12T02:40:29.881130+0000","last_clean_scrub_stamp":"2024-09-12T02:40:29.881130+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:54.810068+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"28'4","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:30.919274+0000","last_change":"2024-09-12T02:40:30.919321+0000","last_active":"2024-09-12T02:40:30.919274+0000","last_peered":"2024-09-12T02:40:30.919274+0000","last_clean":"2024-09-12T02:40:30.919274+0000","last_became_active":"2024-09-12T02:23:15.831084+0000","last_became_peered":"2024-09-12T02:23:15.831084+0000","last_unstale":"2024-09-12T02:40:30.919274+0000","last_undegraded":"2024-09-12T02:40:30.919274+0000","last_fullsized":"2024-09-12T02:40:30.919274+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-09-12T02:40:30.919180+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-09-12T02:40:30.919180+0000","last_clean_scrub_stamp":"2024-09-12T02:40:30.919180+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:38.075693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"28'4521","reported_seq":4553,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:15.678056+0000","last_change":"2024-09-12T02:40:15.678078+0000","last_active":"2024-09-12T02:40:15.678056+0000","last_peered":"2024-09-12T02:40:15.678056+0000","last_clean":"2024-09-12T02:40:15.678056+0000","last_became_active":"2024-09-12T02:23:16.838523+0000","last_became_peered":"2024-09-12T02:23:16.838523+0000","last_unstale":"2024-09-12T02:40:15.678056+0000","last_undegraded":"2024-09-12T02:40:15.678056+0000","last_fullsized":"2024-09-12T02:40:15.678056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4521","last_scrub_stamp":"2024-09-12T02:40:15.677976+0000","last_deep_scrub":"28'4521","last_deep_scrub_stamp":"2024-09-12T02:40:15.677976+0000","last_clean_scrub_stamp":"2024-09-12T02:40:15.677976+0000","objects_scrubbed":0,"log_size":4521,"log_dups_size":0,"ondisk_log_size":4521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:21.396118+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22817,"num_write_kb":263525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"28'4994","reported_seq":5034,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:20.890132+0000","last_change":"2024-09-12T02:40:20.890163+0000","last_active":"2024-09-12T02:40:20.890132+0000","last_peered":"2024-09-12T02:40:20.890132+0000","last_clean":"2024-09-12T02:40:20.890132+0000","last_became_active":"2024-09-12T02:23:04.782878+0000","last_became_peered":"2024-09-12T02:23:04.782878+0000","last_unstale":"2024-09-12T02:40:20.890132+0000","last_undegraded":"2024-09-12T02:40:20.890132+0000","last_fullsized":"2024-09-12T02:40:20.890132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4994","last_scrub_stamp":"2024-09-12T02:40:20.890007+0000","last_deep_scrub":"28'4994","last_deep_scrub_stamp":"2024-09-12T02:40:20.890007+0000","last_clean_scrub_stamp":"2024-09-12T02:40:20.890007+0000","objects_scrubbed":0,"log_size":4994,"log_dups_size":0,"ondisk_log_size":4994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:42.666546+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25629,"num_write_kb":307571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'2","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:18.781671+0000","last_change":"2024-09-12T02:40:18.781697+0000","last_active":"2024-09-12T02:40:18.781671+0000","last_peered":"2024-09-12T02:40:18.781671+0000","last_clean":"2024-09-12T02:40:18.781671+0000","last_became_active":"2024-09-12T02:23:03.762164+0000","last_became_peered":"2024-09-12T02:23:03.762164+0000","last_unstale":"2024-09-12T02:40:18.781671+0000","last_undegraded":"2024-09-12T02:40:18.781671+0000","last_fullsized":"2024-09-12T02:40:18.781671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2024-09-12T02:40:18.781584+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2024-09-12T02:40:18.781584+0000","last_clean_scrub_stamp":"2024-09-12T02:40:18.781584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:19.839354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"28'4","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:29.885420+0000","last_change":"2024-09-12T02:40:29.885420+0000","last_active":"2024-09-12T02:40:29.885420+0000","last_peered":"2024-09-12T02:40:29.885420+0000","last_clean":"2024-09-12T02:40:29.885420+0000","last_became_active":"2024-09-12T02:23:15.830471+0000","last_became_peered":"2024-09-12T02:23:15.830471+0000","last_unstale":"2024-09-12T02:40:29.885420+0000","last_undegraded":"2024-09-12T02:40:29.885420+0000","last_fullsized":"2024-09-12T02:40:29.885420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-09-12T02:40:29.885289+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-09-12T02:40:29.885289+0000","last_clean_scrub_stamp":"2024-09-12T02:40:29.885289+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:46.319381+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"28'4580","reported_seq":4613,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:29.728327+0000","last_change":"2024-09-12T02:40:29.728327+0000","last_active":"2024-09-12T02:40:29.728327+0000","last_peered":"2024-09-12T02:40:29.728327+0000","last_clean":"2024-09-12T02:40:29.728327+0000","last_became_active":"2024-09-12T02:23:16.855992+0000","last_became_peered":"2024-09-12T02:23:16.855992+0000","last_unstale":"2024-09-12T02:40:29.728327+0000","last_undegraded":"2024-09-12T02:40:29.728327+0000","last_fullsized":"2024-09-12T02:40:29.728327+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4580","last_scrub_stamp":"2024-09-12T02:40:29.728218+0000","last_deep_scrub":"28'4580","last_deep_scrub_stamp":"2024-09-12T02:40:29.728218+0000","last_clean_scrub_stamp":"2024-09-12T02:40:29.728218+0000","objects_scrubbed":0,"log_size":4580,"log_dups_size":0,"ondisk_log_size":4580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:15.656575+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24326,"num_write_kb":281766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"28'4821","reported_seq":4861,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:33.473412+0000","last_change":"2024-09-12T02:40:33.473442+0000","last_active":"2024-09-12T02:40:33.473412+0000","last_peered":"2024-09-12T02:40:33.473412+0000","last_clean":"2024-09-12T02:40:33.473412+0000","last_became_active":"2024-09-12T02:23:04.784012+0000","last_became_peered":"2024-09-12T02:23:04.784012+0000","last_unstale":"2024-09-12T02:40:33.473412+0000","last_undegraded":"2024-09-12T02:40:33.473412+0000","last_fullsized":"2024-09-12T02:40:33.473412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4821","last_scrub_stamp":"2024-09-12T02:40:33.473299+0000","last_deep_scrub":"28'4821","last_deep_scrub_stamp":"2024-09-12T02:40:33.473299+0000","last_clean_scrub_stamp":"2024-09-12T02:40:33.473299+0000","objects_scrubbed":0,"log_size":4821,"log_dups_size":0,"ondisk_log_size":4821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:17.482788+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24805,"num_write_kb":312357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"28'3","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:23.849273+0000","last_change":"2024-09-12T02:40:23.849306+0000","last_active":"2024-09-12T02:40:23.849273+0000","last_peered":"2024-09-12T02:40:23.849273+0000","last_clean":"2024-09-12T02:40:23.849273+0000","last_became_active":"2024-09-12T02:23:03.765735+0000","last_became_peered":"2024-09-12T02:23:03.765735+0000","last_unstale":"2024-09-12T02:40:23.849273+0000","last_undegraded":"2024-09-12T02:40:23.849273+0000","last_fullsized":"2024-09-12T02:40:23.849273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-09-12T02:40:23.849177+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-09-12T02:40:23.849177+0000","last_clean_scrub_stamp":"2024-09-12T02:40:23.849177+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:32:06.494824+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"28'1087","reported_seq":1121,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:27.633452+0000","last_change":"2024-09-12T02:40:27.633486+0000","last_active":"2024-09-12T02:40:27.633452+0000","last_peered":"2024-09-12T02:40:27.633452+0000","last_clean":"2024-09-12T02:40:27.633452+0000","last_became_active":"2024-09-12T02:23:15.832184+0000","last_became_peered":"2024-09-12T02:23:15.832184+0000","last_unstale":"2024-09-12T02:40:27.633452+0000","last_undegraded":"2024-09-12T02:40:27.633452+0000","last_fullsized":"2024-09-12T02:40:27.633452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1087","last_scrub_stamp":"2024-09-12T02:40:27.633325+0000","last_deep_scrub":"28'1087","last_deep_scrub_stamp":"2024-09-12T02:40:27.633325+0000","last_clean_scrub_stamp":"2024-09-12T02:40:27.633325+0000","objects_scrubbed":2,"log_size":1087,"log_dups_size":0,"ondisk_log_size":1087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:22:02.687618+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1076,"num_write_kb":4403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"28'4868","reported_seq":4901,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:38.842940+0000","last_change":"2024-09-12T02:40:38.842940+0000","last_active":"2024-09-12T02:40:38.842940+0000","last_peered":"2024-09-12T02:40:38.842940+0000","last_clean":"2024-09-12T02:40:38.842940+0000","last_became_active":"2024-09-12T02:23:16.849067+0000","last_became_peered":"2024-09-12T02:23:16.849067+0000","last_unstale":"2024-09-12T02:40:38.842940+0000","last_undegraded":"2024-09-12T02:40:38.842940+0000","last_fullsized":"2024-09-12T02:40:38.842940+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4868","last_scrub_stamp":"2024-09-12T02:40:38.842799+0000","last_deep_scrub":"28'4868","last_deep_scrub_stamp":"2024-09-12T02:40:38.842799+0000","last_clean_scrub_stamp":"2024-09-12T02:40:38.842799+0000","objects_scrubbed":0,"log_size":4868,"log_dups_size":0,"ondisk_log_size":4868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:13.291667+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24798,"num_write_kb":291891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"28'5524","reported_seq":5564,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:17.801412+0000","last_change":"2024-09-12T02:40:17.801439+0000","last_active":"2024-09-12T02:40:17.801412+0000","last_peered":"2024-09-12T02:40:17.801412+0000","last_clean":"2024-09-12T02:40:17.801412+0000","last_became_active":"2024-09-12T02:23:04.790707+0000","last_became_peered":"2024-09-12T02:23:04.790707+0000","last_unstale":"2024-09-12T02:40:17.801412+0000","last_undegraded":"2024-09-12T02:40:17.801412+0000","last_fullsized":"2024-09-12T02:40:17.801412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5524","last_scrub_stamp":"2024-09-12T02:40:17.801291+0000","last_deep_scrub":"28'5524","last_deep_scrub_stamp":"2024-09-12T02:40:17.801291+0000","last_clean_scrub_stamp":"2024-09-12T02:40:17.801291+0000","objects_scrubbed":0,"log_size":5524,"log_dups_size":0,"ondisk_log_size":5524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:13.729996+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27879,"num_write_kb":349281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"28'7","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:19.770324+0000","last_change":"2024-09-12T02:40:19.770358+0000","last_active":"2024-09-12T02:40:19.770324+0000","last_peered":"2024-09-12T02:40:19.770324+0000","last_clean":"2024-09-12T02:40:19.770324+0000","last_became_active":"2024-09-12T02:23:03.763005+0000","last_became_peered":"2024-09-12T02:23:03.763005+0000","last_unstale":"2024-09-12T02:40:19.770324+0000","last_undegraded":"2024-09-12T02:40:19.770324+0000","last_fullsized":"2024-09-12T02:40:19.770324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-09-12T02:40:19.770235+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-09-12T02:40:19.770235+0000","last_clean_scrub_stamp":"2024-09-12T02:40:19.770235+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:49.802369+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"28'3","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:20.452435+0000","last_change":"2024-09-12T02:40:20.452435+0000","last_active":"2024-09-12T02:40:20.452435+0000","last_peered":"2024-09-12T02:40:20.452435+0000","last_clean":"2024-09-12T02:40:20.452435+0000","last_became_active":"2024-09-12T02:23:15.819370+0000","last_became_peered":"2024-09-12T02:23:15.819370+0000","last_unstale":"2024-09-12T02:40:20.452435+0000","last_undegraded":"2024-09-12T02:40:20.452435+0000","last_fullsized":"2024-09-12T02:40:20.452435+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-09-12T02:40:20.452317+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-09-12T02:40:20.452317+0000","last_clean_scrub_stamp":"2024-09-12T02:40:20.452317+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:46.128863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"28'5323","reported_seq":5356,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:16.720800+0000","last_change":"2024-09-12T02:40:16.720800+0000","last_active":"2024-09-12T02:40:16.720800+0000","last_peered":"2024-09-12T02:40:16.720800+0000","last_clean":"2024-09-12T02:40:16.720800+0000","last_became_active":"2024-09-12T02:23:16.837942+0000","last_became_peered":"2024-09-12T02:23:16.837942+0000","last_unstale":"2024-09-12T02:40:16.720800+0000","last_undegraded":"2024-09-12T02:40:16.720800+0000","last_fullsized":"2024-09-12T02:40:16.720800+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5323","last_scrub_stamp":"2024-09-12T02:40:16.720650+0000","last_deep_scrub":"28'5323","last_deep_scrub_stamp":"2024-09-12T02:40:16.720650+0000","last_clean_scrub_stamp":"2024-09-12T02:40:16.720650+0000","objects_scrubbed":0,"log_size":5323,"log_dups_size":0,"ondisk_log_size":5323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:43.957111+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28212,"num_write_kb":317995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"28'4432","reported_seq":4472,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:24.860030+0000","last_change":"2024-09-12T02:40:24.860073+0000","last_active":"2024-09-12T02:40:24.860030+0000","last_peered":"2024-09-12T02:40:24.860030+0000","last_clean":"2024-09-12T02:40:24.860030+0000","last_became_active":"2024-09-12T02:23:04.780893+0000","last_became_peered":"2024-09-12T02:23:04.780893+0000","last_unstale":"2024-09-12T02:40:24.860030+0000","last_undegraded":"2024-09-12T02:40:24.860030+0000","last_fullsized":"2024-09-12T02:40:24.860030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4432","last_scrub_stamp":"2024-09-12T02:40:24.859922+0000","last_deep_scrub":"28'4432","last_deep_scrub_stamp":"2024-09-12T02:40:24.859922+0000","last_clean_scrub_stamp":"2024-09-12T02:40:24.859922+0000","objects_scrubbed":0,"log_size":4432,"log_dups_size":0,"ondisk_log_size":4432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:06:34.409840+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22251,"num_write_kb":285885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'6","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:22.993841+0000","last_change":"2024-09-12T02:40:22.993866+0000","last_active":"2024-09-12T02:40:22.993841+0000","last_peered":"2024-09-12T02:40:22.993841+0000","last_clean":"2024-09-12T02:40:22.993841+0000","last_became_active":"2024-09-12T02:23:03.765281+0000","last_became_peered":"2024-09-12T02:23:03.765281+0000","last_unstale":"2024-09-12T02:40:22.993841+0000","last_undegraded":"2024-09-12T02:40:22.993841+0000","last_fullsized":"2024-09-12T02:40:22.993841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-09-12T02:40:22.993752+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-09-12T02:40:22.993752+0000","last_clean_scrub_stamp":"2024-09-12T02:40:22.993752+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:59.988546+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"28'3","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:21.020443+0000","last_change":"2024-09-12T02:40:21.020443+0000","last_active":"2024-09-12T02:40:21.020443+0000","last_peered":"2024-09-12T02:40:21.020443+0000","last_clean":"2024-09-12T02:40:21.020443+0000","last_became_active":"2024-09-12T02:23:15.841380+0000","last_became_peered":"2024-09-12T02:23:15.841380+0000","last_unstale":"2024-09-12T02:40:21.020443+0000","last_undegraded":"2024-09-12T02:40:21.020443+0000","last_fullsized":"2024-09-12T02:40:21.020443+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-09-12T02:40:21.020327+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-09-12T02:40:21.020327+0000","last_clean_scrub_stamp":"2024-09-12T02:40:21.020327+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:15.834118+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"28'4540","reported_seq":4572,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:40.754825+0000","last_change":"2024-09-12T02:40:40.754853+0000","last_active":"2024-09-12T02:40:40.754825+0000","last_peered":"2024-09-12T02:40:40.754825+0000","last_clean":"2024-09-12T02:40:40.754825+0000","last_became_active":"2024-09-12T02:23:16.846273+0000","last_became_peered":"2024-09-12T02:23:16.846273+0000","last_unstale":"2024-09-12T02:40:40.754825+0000","last_undegraded":"2024-09-12T02:40:40.754825+0000","last_fullsized":"2024-09-12T02:40:40.754825+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4540","last_scrub_stamp":"2024-09-12T02:40:40.754713+0000","last_deep_scrub":"28'4540","last_deep_scrub_stamp":"2024-09-12T02:40:40.754713+0000","last_clean_scrub_stamp":"2024-09-12T02:40:40.754713+0000","objects_scrubbed":0,"log_size":4540,"log_dups_size":0,"ondisk_log_size":4540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:53.497565+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23721,"num_write_kb":271171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"28'4758","reported_seq":4798,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:22.944653+0000","last_change":"2024-09-12T02:40:22.944680+0000","last_active":"2024-09-12T02:40:22.944653+0000","last_peered":"2024-09-12T02:40:22.944653+0000","last_clean":"2024-09-12T02:40:22.944653+0000","last_became_active":"2024-09-12T02:23:04.781575+0000","last_became_peered":"2024-09-12T02:23:04.781575+0000","last_unstale":"2024-09-12T02:40:22.944653+0000","last_undegraded":"2024-09-12T02:40:22.944653+0000","last_fullsized":"2024-09-12T02:40:22.944653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4758","last_scrub_stamp":"2024-09-12T02:40:22.944556+0000","last_deep_scrub":"28'4758","last_deep_scrub_stamp":"2024-09-12T02:40:22.944556+0000","last_clean_scrub_stamp":"2024-09-12T02:40:22.944556+0000","objects_scrubbed":0,"log_size":4758,"log_dups_size":0,"ondisk_log_size":4758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:38.005105+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24728,"num_write_kb":299876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"28'15","reported_seq":57,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:20.729537+0000","last_change":"2024-09-12T02:40:20.729610+0000","last_active":"2024-09-12T02:40:20.729537+0000","last_peered":"2024-09-12T02:40:20.729537+0000","last_clean":"2024-09-12T02:40:20.729537+0000","last_became_active":"2024-09-12T02:23:03.771061+0000","last_became_peered":"2024-09-12T02:23:03.771061+0000","last_unstale":"2024-09-12T02:40:20.729537+0000","last_undegraded":"2024-09-12T02:40:20.729537+0000","last_fullsized":"2024-09-12T02:40:20.729537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'15","last_scrub_stamp":"2024-09-12T02:40:20.729440+0000","last_deep_scrub":"28'15","last_deep_scrub_stamp":"2024-09-12T02:40:20.729440+0000","last_clean_scrub_stamp":"2024-09-12T02:40:20.729440+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:30.145300+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"28'2","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:28.645670+0000","last_change":"2024-09-12T02:40:28.645699+0000","last_active":"2024-09-12T02:40:28.645670+0000","last_peered":"2024-09-12T02:40:28.645670+0000","last_clean":"2024-09-12T02:40:28.645670+0000","last_became_active":"2024-09-12T02:23:15.831707+0000","last_became_peered":"2024-09-12T02:23:15.831707+0000","last_unstale":"2024-09-12T02:40:28.645670+0000","last_undegraded":"2024-09-12T02:40:28.645670+0000","last_fullsized":"2024-09-12T02:40:28.645670+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2024-09-12T02:40:28.645553+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2024-09-12T02:40:28.645553+0000","last_clean_scrub_stamp":"2024-09-12T02:40:28.645553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:10.189800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"28'5063","reported_seq":5095,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:42.446902+0000","last_change":"2024-09-12T02:40:42.446941+0000","last_active":"2024-09-12T02:40:42.446902+0000","last_peered":"2024-09-12T02:40:42.446902+0000","last_clean":"2024-09-12T02:40:42.446902+0000","last_became_active":"2024-09-12T02:23:16.858469+0000","last_became_peered":"2024-09-12T02:23:16.858469+0000","last_unstale":"2024-09-12T02:40:42.446902+0000","last_undegraded":"2024-09-12T02:40:42.446902+0000","last_fullsized":"2024-09-12T02:40:42.446902+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5063","last_scrub_stamp":"2024-09-12T02:40:42.446796+0000","last_deep_scrub":"28'5063","last_deep_scrub_stamp":"2024-09-12T02:40:42.446796+0000","last_clean_scrub_stamp":"2024-09-12T02:40:42.446796+0000","objects_scrubbed":0,"log_size":5063,"log_dups_size":0,"ondisk_log_size":5063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:54:52.087059+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25554,"num_write_kb":307334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"28'4968","reported_seq":5008,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:25.950759+0000","last_change":"2024-09-12T02:40:25.950806+0000","last_active":"2024-09-12T02:40:25.950759+0000","last_peered":"2024-09-12T02:40:25.950759+0000","last_clean":"2024-09-12T02:40:25.950759+0000","last_became_active":"2024-09-12T02:23:04.784977+0000","last_became_peered":"2024-09-12T02:23:04.784977+0000","last_unstale":"2024-09-12T02:40:25.950759+0000","last_undegraded":"2024-09-12T02:40:25.950759+0000","last_fullsized":"2024-09-12T02:40:25.950759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4968","last_scrub_stamp":"2024-09-12T02:40:25.950642+0000","last_deep_scrub":"28'4968","last_deep_scrub_stamp":"2024-09-12T02:40:25.950642+0000","last_clean_scrub_stamp":"2024-09-12T02:40:25.950642+0000","objects_scrubbed":0,"log_size":4968,"log_dups_size":0,"ondisk_log_size":4968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:28:10.954447+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25338,"num_write_kb":318642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"28'6","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:20.996192+0000","last_change":"2024-09-12T02:40:20.996215+0000","last_active":"2024-09-12T02:40:20.996192+0000","last_peered":"2024-09-12T02:40:20.996192+0000","last_clean":"2024-09-12T02:40:20.996192+0000","last_became_active":"2024-09-12T02:23:03.767066+0000","last_became_peered":"2024-09-12T02:23:03.767066+0000","last_unstale":"2024-09-12T02:40:20.996192+0000","last_undegraded":"2024-09-12T02:40:20.996192+0000","last_fullsized":"2024-09-12T02:40:20.996192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-09-12T02:40:20.996103+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-09-12T02:40:20.996103+0000","last_clean_scrub_stamp":"2024-09-12T02:40:20.996103+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:29.667425+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"28'2","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:16.926159+0000","last_change":"2024-09-12T02:40:16.926207+0000","last_active":"2024-09-12T02:40:16.926159+0000","last_peered":"2024-09-12T02:40:16.926159+0000","last_clean":"2024-09-12T02:40:16.926159+0000","last_became_active":"2024-09-12T02:23:15.825779+0000","last_became_peered":"2024-09-12T02:23:15.825779+0000","last_unstale":"2024-09-12T02:40:16.926159+0000","last_undegraded":"2024-09-12T02:40:16.926159+0000","last_fullsized":"2024-09-12T02:40:16.926159+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2024-09-12T02:40:16.926073+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2024-09-12T02:40:16.926073+0000","last_clean_scrub_stamp":"2024-09-12T02:40:16.926073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:40.948605+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"28'5278","reported_seq":5310,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:40.447050+0000","last_change":"2024-09-12T02:40:40.447075+0000","last_active":"2024-09-12T02:40:40.447050+0000","last_peered":"2024-09-12T02:40:40.447050+0000","last_clean":"2024-09-12T02:40:40.447050+0000","last_became_active":"2024-09-12T02:23:16.855538+0000","last_became_peered":"2024-09-12T02:23:16.855538+0000","last_unstale":"2024-09-12T02:40:40.447050+0000","last_undegraded":"2024-09-12T02:40:40.447050+0000","last_fullsized":"2024-09-12T02:40:40.447050+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5278","last_scrub_stamp":"2024-09-12T02:40:40.446955+0000","last_deep_scrub":"28'5278","last_deep_scrub_stamp":"2024-09-12T02:40:40.446955+0000","last_clean_scrub_stamp":"2024-09-12T02:40:40.446955+0000","objects_scrubbed":0,"log_size":5278,"log_dups_size":0,"ondisk_log_size":5278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:40.152836+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27222,"num_write_kb":301662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'5225","reported_seq":5265,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:18.848092+0000","last_change":"2024-09-12T02:40:18.848122+0000","last_active":"2024-09-12T02:40:18.848092+0000","last_peered":"2024-09-12T02:40:18.848092+0000","last_clean":"2024-09-12T02:40:18.848092+0000","last_became_active":"2024-09-12T02:23:04.783399+0000","last_became_peered":"2024-09-12T02:23:04.783399+0000","last_unstale":"2024-09-12T02:40:18.848092+0000","last_undegraded":"2024-09-12T02:40:18.848092+0000","last_fullsized":"2024-09-12T02:40:18.848092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5225","last_scrub_stamp":"2024-09-12T02:40:18.847991+0000","last_deep_scrub":"28'5225","last_deep_scrub_stamp":"2024-09-12T02:40:18.847991+0000","last_clean_scrub_stamp":"2024-09-12T02:40:18.847991+0000","objects_scrubbed":0,"log_size":5225,"log_dups_size":0,"ondisk_log_size":5225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:55.252083+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26678,"num_write_kb":336266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'5","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:30.527397+0000","last_change":"2024-09-12T02:40:30.527426+0000","last_active":"2024-09-12T02:40:30.527397+0000","last_peered":"2024-09-12T02:40:30.527397+0000","last_clean":"2024-09-12T02:40:30.527397+0000","last_became_active":"2024-09-12T02:23:03.766551+0000","last_became_peered":"2024-09-12T02:23:03.766551+0000","last_unstale":"2024-09-12T02:40:30.527397+0000","last_undegraded":"2024-09-12T02:40:30.527397+0000","last_fullsized":"2024-09-12T02:40:30.527397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-09-12T02:40:30.527309+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-09-12T02:40:30.527309+0000","last_clean_scrub_stamp":"2024-09-12T02:40:30.527309+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:35.375498+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"28'302","reported_seq":336,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:19.897746+0000","last_change":"2024-09-12T02:40:19.897779+0000","last_active":"2024-09-12T02:40:19.897746+0000","last_peered":"2024-09-12T02:40:19.897746+0000","last_clean":"2024-09-12T02:40:19.897746+0000","last_became_active":"2024-09-12T02:23:15.832152+0000","last_became_peered":"2024-09-12T02:23:15.832152+0000","last_unstale":"2024-09-12T02:40:19.897746+0000","last_undegraded":"2024-09-12T02:40:19.897746+0000","last_fullsized":"2024-09-12T02:40:19.897746+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'302","last_scrub_stamp":"2024-09-12T02:40:19.897661+0000","last_deep_scrub":"28'302","last_deep_scrub_stamp":"2024-09-12T02:40:19.897661+0000","last_clean_scrub_stamp":"2024-09-12T02:40:19.897661+0000","objects_scrubbed":4,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:05:00.953471+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295,"num_write_kb":4246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"28'6304","reported_seq":6336,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:41.748469+0000","last_change":"2024-09-12T02:40:41.748495+0000","last_active":"2024-09-12T02:40:41.748469+0000","last_peered":"2024-09-12T02:40:41.748469+0000","last_clean":"2024-09-12T02:40:41.748469+0000","last_became_active":"2024-09-12T02:23:16.846454+0000","last_became_peered":"2024-09-12T02:23:16.846454+0000","last_unstale":"2024-09-12T02:40:41.748469+0000","last_undegraded":"2024-09-12T02:40:41.748469+0000","last_fullsized":"2024-09-12T02:40:41.748469+0000","mapping_epoch":24,"log_start":"28'1100","ondisk_log_start":"28'1100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6304","last_scrub_stamp":"2024-09-12T02:40:41.748368+0000","last_deep_scrub":"28'6304","last_deep_scrub_stamp":"2024-09-12T02:40:41.748368+0000","last_clean_scrub_stamp":"2024-09-12T02:40:41.748368+0000","objects_scrubbed":0,"log_size":5204,"log_dups_size":0,"ondisk_log_size":5204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:02.470120+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31934,"num_write_kb":398820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"28'4402","reported_seq":4442,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:25.654086+0000","last_change":"2024-09-12T02:40:25.654115+0000","last_active":"2024-09-12T02:40:25.654086+0000","last_peered":"2024-09-12T02:40:25.654086+0000","last_clean":"2024-09-12T02:40:25.654086+0000","last_became_active":"2024-09-12T02:23:04.784094+0000","last_became_peered":"2024-09-12T02:23:04.784094+0000","last_unstale":"2024-09-12T02:40:25.654086+0000","last_undegraded":"2024-09-12T02:40:25.654086+0000","last_fullsized":"2024-09-12T02:40:25.654086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4402","last_scrub_stamp":"2024-09-12T02:40:25.653986+0000","last_deep_scrub":"28'4402","last_deep_scrub_stamp":"2024-09-12T02:40:25.653986+0000","last_clean_scrub_stamp":"2024-09-12T02:40:25.653986+0000","objects_scrubbed":0,"log_size":4402,"log_dups_size":0,"ondisk_log_size":4402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:12.058889+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22399,"num_write_kb":282193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"28'10","reported_seq":52,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:20.726063+0000","last_change":"2024-09-12T02:40:20.726094+0000","last_active":"2024-09-12T02:40:20.726063+0000","last_peered":"2024-09-12T02:40:20.726063+0000","last_clean":"2024-09-12T02:40:20.726063+0000","last_became_active":"2024-09-12T02:23:03.762557+0000","last_became_peered":"2024-09-12T02:23:03.762557+0000","last_unstale":"2024-09-12T02:40:20.726063+0000","last_undegraded":"2024-09-12T02:40:20.726063+0000","last_fullsized":"2024-09-12T02:40:20.726063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'10","last_scrub_stamp":"2024-09-12T02:40:20.725970+0000","last_deep_scrub":"28'10","last_deep_scrub_stamp":"2024-09-12T02:40:20.725970+0000","last_clean_scrub_stamp":"2024-09-12T02:40:20.725970+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:26.834452+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"28'36","reported_seq":70,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:22.453090+0000","last_change":"2024-09-12T02:40:22.453146+0000","last_active":"2024-09-12T02:40:22.453090+0000","last_peered":"2024-09-12T02:40:22.453090+0000","last_clean":"2024-09-12T02:40:22.453090+0000","last_became_active":"2024-09-12T02:23:15.822441+0000","last_became_peered":"2024-09-12T02:23:15.822441+0000","last_unstale":"2024-09-12T02:40:22.453090+0000","last_undegraded":"2024-09-12T02:40:22.453090+0000","last_fullsized":"2024-09-12T02:40:22.453090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'36","last_scrub_stamp":"2024-09-12T02:40:22.452984+0000","last_deep_scrub":"28'36","last_deep_scrub_stamp":"2024-09-12T02:40:22.452984+0000","last_clean_scrub_stamp":"2024-09-12T02:40:22.452984+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:11.810569+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"28'5704","reported_seq":5736,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:27.839735+0000","last_change":"2024-09-12T02:40:27.839760+0000","last_active":"2024-09-12T02:40:27.839735+0000","last_peered":"2024-09-12T02:40:27.839735+0000","last_clean":"2024-09-12T02:40:27.839735+0000","last_became_active":"2024-09-12T02:23:16.838277+0000","last_became_peered":"2024-09-12T02:23:16.838277+0000","last_unstale":"2024-09-12T02:40:27.839735+0000","last_undegraded":"2024-09-12T02:40:27.839735+0000","last_fullsized":"2024-09-12T02:40:27.839735+0000","mapping_epoch":24,"log_start":"28'500","ondisk_log_start":"28'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5704","last_scrub_stamp":"2024-09-12T02:40:27.839629+0000","last_deep_scrub":"28'5704","last_deep_scrub_stamp":"2024-09-12T02:40:27.839629+0000","last_clean_scrub_stamp":"2024-09-12T02:40:27.839629+0000","objects_scrubbed":0,"log_size":5204,"log_dups_size":0,"ondisk_log_size":5204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:24:18.862929+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29050,"num_write_kb":345934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"28'4440","reported_seq":4480,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:26.858097+0000","last_change":"2024-09-12T02:40:26.858123+0000","last_active":"2024-09-12T02:40:26.858097+0000","last_peered":"2024-09-12T02:40:26.858097+0000","last_clean":"2024-09-12T02:40:26.858097+0000","last_became_active":"2024-09-12T02:23:04.780475+0000","last_became_peered":"2024-09-12T02:23:04.780475+0000","last_unstale":"2024-09-12T02:40:26.858097+0000","last_undegraded":"2024-09-12T02:40:26.858097+0000","last_fullsized":"2024-09-12T02:40:26.858097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4440","last_scrub_stamp":"2024-09-12T02:40:26.857993+0000","last_deep_scrub":"28'4440","last_deep_scrub_stamp":"2024-09-12T02:40:26.857993+0000","last_clean_scrub_stamp":"2024-09-12T02:40:26.857993+0000","objects_scrubbed":0,"log_size":4440,"log_dups_size":0,"ondisk_log_size":4440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:06.397140+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22736,"num_write_kb":283554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'343","reported_seq":385,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:23.063830+0000","last_change":"2024-09-12T02:40:23.063860+0000","last_active":"2024-09-12T02:40:23.063830+0000","last_peered":"2024-09-12T02:40:23.063830+0000","last_clean":"2024-09-12T02:40:23.063830+0000","last_became_active":"2024-09-12T02:23:03.768092+0000","last_became_peered":"2024-09-12T02:23:03.768092+0000","last_unstale":"2024-09-12T02:40:23.063830+0000","last_undegraded":"2024-09-12T02:40:23.063830+0000","last_fullsized":"2024-09-12T02:40:23.063830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'343","last_scrub_stamp":"2024-09-12T02:40:23.063748+0000","last_deep_scrub":"28'343","last_deep_scrub_stamp":"2024-09-12T02:40:23.063748+0000","last_clean_scrub_stamp":"2024-09-12T02:40:23.063748+0000","objects_scrubbed":4,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:30.369339+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"28'5","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:19.865912+0000","last_change":"2024-09-12T02:40:19.865941+0000","last_active":"2024-09-12T02:40:19.865912+0000","last_peered":"2024-09-12T02:40:19.865912+0000","last_clean":"2024-09-12T02:40:19.865912+0000","last_became_active":"2024-09-12T02:23:15.827936+0000","last_became_peered":"2024-09-12T02:23:15.827936+0000","last_unstale":"2024-09-12T02:40:19.865912+0000","last_undegraded":"2024-09-12T02:40:19.865912+0000","last_fullsized":"2024-09-12T02:40:19.865912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-09-12T02:40:19.865803+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-09-12T02:40:19.865803+0000","last_clean_scrub_stamp":"2024-09-12T02:40:19.865803+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:55:16.187205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"28'4960","reported_seq":4992,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:33.793982+0000","last_change":"2024-09-12T02:40:33.794011+0000","last_active":"2024-09-12T02:40:33.793982+0000","last_peered":"2024-09-12T02:40:33.793982+0000","last_clean":"2024-09-12T02:40:33.793982+0000","last_became_active":"2024-09-12T02:23:16.853900+0000","last_became_peered":"2024-09-12T02:23:16.853900+0000","last_unstale":"2024-09-12T02:40:33.793982+0000","last_undegraded":"2024-09-12T02:40:33.793982+0000","last_fullsized":"2024-09-12T02:40:33.793982+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4960","last_scrub_stamp":"2024-09-12T02:40:33.793890+0000","last_deep_scrub":"28'4960","last_deep_scrub_stamp":"2024-09-12T02:40:33.793890+0000","last_clean_scrub_stamp":"2024-09-12T02:40:33.793890+0000","objects_scrubbed":0,"log_size":4960,"log_dups_size":0,"ondisk_log_size":4960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:19.904470+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25526,"num_write_kb":294821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'6032","reported_seq":6072,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:24.945641+0000","last_change":"2024-09-12T02:40:24.945664+0000","last_active":"2024-09-12T02:40:24.945641+0000","last_peered":"2024-09-12T02:40:24.945641+0000","last_clean":"2024-09-12T02:40:24.945641+0000","last_became_active":"2024-09-12T02:23:04.777081+0000","last_became_peered":"2024-09-12T02:23:04.777081+0000","last_unstale":"2024-09-12T02:40:24.945641+0000","last_undegraded":"2024-09-12T02:40:24.945641+0000","last_fullsized":"2024-09-12T02:40:24.945641+0000","mapping_epoch":20,"log_start":"28'500","ondisk_log_start":"28'500","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6032","last_scrub_stamp":"2024-09-12T02:40:24.945540+0000","last_deep_scrub":"28'6032","last_deep_scrub_stamp":"2024-09-12T02:40:24.945540+0000","last_clean_scrub_stamp":"2024-09-12T02:40:24.945540+0000","objects_scrubbed":0,"log_size":5532,"log_dups_size":0,"ondisk_log_size":5532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:56.794956+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30497,"num_write_kb":392872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'37","reported_seq":79,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:27.697270+0000","last_change":"2024-09-12T02:40:27.697300+0000","last_active":"2024-09-12T02:40:27.697270+0000","last_peered":"2024-09-12T02:40:27.697270+0000","last_clean":"2024-09-12T02:40:27.697270+0000","last_became_active":"2024-09-12T02:23:03.769601+0000","last_became_peered":"2024-09-12T02:23:03.769601+0000","last_unstale":"2024-09-12T02:40:27.697270+0000","last_undegraded":"2024-09-12T02:40:27.697270+0000","last_fullsized":"2024-09-12T02:40:27.697270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'37","last_scrub_stamp":"2024-09-12T02:40:27.697183+0000","last_deep_scrub":"28'37","last_deep_scrub_stamp":"2024-09-12T02:40:27.697183+0000","last_clean_scrub_stamp":"2024-09-12T02:40:27.697183+0000","objects_scrubbed":2,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:32.258338+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"28'10","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:21.992807+0000","last_change":"2024-09-12T02:40:21.992842+0000","last_active":"2024-09-12T02:40:21.992807+0000","last_peered":"2024-09-12T02:40:21.992807+0000","last_clean":"2024-09-12T02:40:21.992807+0000","last_became_active":"2024-09-12T02:23:15.831220+0000","last_became_peered":"2024-09-12T02:23:15.831220+0000","last_unstale":"2024-09-12T02:40:21.992807+0000","last_undegraded":"2024-09-12T02:40:21.992807+0000","last_fullsized":"2024-09-12T02:40:21.992807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'10","last_scrub_stamp":"2024-09-12T02:40:21.992720+0000","last_deep_scrub":"28'10","last_deep_scrub_stamp":"2024-09-12T02:40:21.992720+0000","last_clean_scrub_stamp":"2024-09-12T02:40:21.992720+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:26.531592+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"28'5159","reported_seq":5191,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:35.978329+0000","last_change":"2024-09-12T02:40:35.978353+0000","last_active":"2024-09-12T02:40:35.978329+0000","last_peered":"2024-09-12T02:40:35.978329+0000","last_clean":"2024-09-12T02:40:35.978329+0000","last_became_active":"2024-09-12T02:23:16.858075+0000","last_became_peered":"2024-09-12T02:23:16.858075+0000","last_unstale":"2024-09-12T02:40:35.978329+0000","last_undegraded":"2024-09-12T02:40:35.978329+0000","last_fullsized":"2024-09-12T02:40:35.978329+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5159","last_scrub_stamp":"2024-09-12T02:40:35.978255+0000","last_deep_scrub":"28'5159","last_deep_scrub_stamp":"2024-09-12T02:40:35.978255+0000","last_clean_scrub_stamp":"2024-09-12T02:40:35.978255+0000","objects_scrubbed":0,"log_size":5159,"log_dups_size":0,"ondisk_log_size":5159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:00.763078+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27123,"num_write_kb":309496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"28'3733","reported_seq":3773,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:23.708207+0000","last_change":"2024-09-12T02:40:23.708236+0000","last_active":"2024-09-12T02:40:23.708207+0000","last_peered":"2024-09-12T02:40:23.708207+0000","last_clean":"2024-09-12T02:40:23.708207+0000","last_became_active":"2024-09-12T02:23:04.778850+0000","last_became_peered":"2024-09-12T02:23:04.778850+0000","last_unstale":"2024-09-12T02:40:23.708207+0000","last_undegraded":"2024-09-12T02:40:23.708207+0000","last_fullsized":"2024-09-12T02:40:23.708207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3733","last_scrub_stamp":"2024-09-12T02:40:23.708118+0000","last_deep_scrub":"28'3733","last_deep_scrub_stamp":"2024-09-12T02:40:23.708118+0000","last_clean_scrub_stamp":"2024-09-12T02:40:23.708118+0000","objects_scrubbed":0,"log_size":3733,"log_dups_size":0,"ondisk_log_size":3733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:57:49.623600+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19250,"num_write_kb":253251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'2","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:31.481765+0000","last_change":"2024-09-12T02:40:31.481793+0000","last_active":"2024-09-12T02:40:31.481765+0000","last_peered":"2024-09-12T02:40:31.481765+0000","last_clean":"2024-09-12T02:40:31.481765+0000","last_became_active":"2024-09-12T02:23:03.769436+0000","last_became_peered":"2024-09-12T02:23:03.769436+0000","last_unstale":"2024-09-12T02:40:31.481765+0000","last_undegraded":"2024-09-12T02:40:31.481765+0000","last_fullsized":"2024-09-12T02:40:31.481765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2024-09-12T02:40:31.481675+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2024-09-12T02:40:31.481675+0000","last_clean_scrub_stamp":"2024-09-12T02:40:31.481675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:00.700829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"28'16","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:23.869770+0000","last_change":"2024-09-12T02:40:23.869809+0000","last_active":"2024-09-12T02:40:23.869770+0000","last_peered":"2024-09-12T02:40:23.869770+0000","last_clean":"2024-09-12T02:40:23.869770+0000","last_became_active":"2024-09-12T02:23:15.832873+0000","last_became_peered":"2024-09-12T02:23:15.832873+0000","last_unstale":"2024-09-12T02:40:23.869770+0000","last_undegraded":"2024-09-12T02:40:23.869770+0000","last_fullsized":"2024-09-12T02:40:23.869770+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'16","last_scrub_stamp":"2024-09-12T02:40:23.869673+0000","last_deep_scrub":"28'16","last_deep_scrub_stamp":"2024-09-12T02:40:23.869673+0000","last_clean_scrub_stamp":"2024-09-12T02:40:23.869673+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:29.039802+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"28'5308","reported_seq":5340,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:42.796835+0000","last_change":"2024-09-12T02:40:42.796863+0000","last_active":"2024-09-12T02:40:42.796835+0000","last_peered":"2024-09-12T02:40:42.796835+0000","last_clean":"2024-09-12T02:40:42.796835+0000","last_became_active":"2024-09-12T02:23:16.856455+0000","last_became_peered":"2024-09-12T02:23:16.856455+0000","last_unstale":"2024-09-12T02:40:42.796835+0000","last_undegraded":"2024-09-12T02:40:42.796835+0000","last_fullsized":"2024-09-12T02:40:42.796835+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5308","last_scrub_stamp":"2024-09-12T02:40:42.796731+0000","last_deep_scrub":"28'5308","last_deep_scrub_stamp":"2024-09-12T02:40:42.796731+0000","last_clean_scrub_stamp":"2024-09-12T02:40:42.796731+0000","objects_scrubbed":0,"log_size":5308,"log_dups_size":0,"ondisk_log_size":5308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:29.047359+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27382,"num_write_kb":326846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"28'4524","reported_seq":4564,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:27.566241+0000","last_change":"2024-09-12T02:40:27.566266+0000","last_active":"2024-09-12T02:40:27.566241+0000","last_peered":"2024-09-12T02:40:27.566241+0000","last_clean":"2024-09-12T02:40:27.566241+0000","last_became_active":"2024-09-12T02:23:04.785795+0000","last_became_peered":"2024-09-12T02:23:04.785795+0000","last_unstale":"2024-09-12T02:40:27.566241+0000","last_undegraded":"2024-09-12T02:40:27.566241+0000","last_fullsized":"2024-09-12T02:40:27.566241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4524","last_scrub_stamp":"2024-09-12T02:40:27.566138+0000","last_deep_scrub":"28'4524","last_deep_scrub_stamp":"2024-09-12T02:40:27.566138+0000","last_clean_scrub_stamp":"2024-09-12T02:40:27.566138+0000","objects_scrubbed":0,"log_size":4524,"log_dups_size":0,"ondisk_log_size":4524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:25.680921+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22689,"num_write_kb":295834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"28'2","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:24.003239+0000","last_change":"2024-09-12T02:40:24.003265+0000","last_active":"2024-09-12T02:40:24.003239+0000","last_peered":"2024-09-12T02:40:24.003239+0000","last_clean":"2024-09-12T02:40:24.003239+0000","last_became_active":"2024-09-12T02:23:03.769302+0000","last_became_peered":"2024-09-12T02:23:03.769302+0000","last_unstale":"2024-09-12T02:40:24.003239+0000","last_undegraded":"2024-09-12T02:40:24.003239+0000","last_fullsized":"2024-09-12T02:40:24.003239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2024-09-12T02:40:24.003157+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2024-09-12T02:40:24.003157+0000","last_clean_scrub_stamp":"2024-09-12T02:40:24.003157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:13.113939+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"28'6","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:18.838303+0000","last_change":"2024-09-12T02:40:18.838331+0000","last_active":"2024-09-12T02:40:18.838303+0000","last_peered":"2024-09-12T02:40:18.838303+0000","last_clean":"2024-09-12T02:40:18.838303+0000","last_became_active":"2024-09-12T02:23:15.825305+0000","last_became_peered":"2024-09-12T02:23:15.825305+0000","last_unstale":"2024-09-12T02:40:18.838303+0000","last_undegraded":"2024-09-12T02:40:18.838303+0000","last_fullsized":"2024-09-12T02:40:18.838303+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-09-12T02:40:18.838207+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-09-12T02:40:18.838207+0000","last_clean_scrub_stamp":"2024-09-12T02:40:18.838207+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:19.521394+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"28'6585","reported_seq":6618,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:34.967254+0000","last_change":"2024-09-12T02:40:34.967278+0000","last_active":"2024-09-12T02:40:34.967254+0000","last_peered":"2024-09-12T02:40:34.967254+0000","last_clean":"2024-09-12T02:40:34.967254+0000","last_became_active":"2024-09-12T02:23:16.852061+0000","last_became_peered":"2024-09-12T02:23:16.852061+0000","last_unstale":"2024-09-12T02:40:34.967254+0000","last_undegraded":"2024-09-12T02:40:34.967254+0000","last_fullsized":"2024-09-12T02:40:34.967254+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6585","last_scrub_stamp":"2024-09-12T02:40:34.967176+0000","last_deep_scrub":"28'6585","last_deep_scrub_stamp":"2024-09-12T02:40:34.967176+0000","last_clean_scrub_stamp":"2024-09-12T02:40:34.967176+0000","objects_scrubbed":0,"log_size":6585,"log_dups_size":0,"ondisk_log_size":6585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:54.484393+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34694,"num_write_kb":385000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"28'8","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:29.686554+0000","last_change":"2024-09-12T02:40:29.686581+0000","last_active":"2024-09-12T02:40:29.686554+0000","last_peered":"2024-09-12T02:40:29.686554+0000","last_clean":"2024-09-12T02:40:29.686554+0000","last_became_active":"2024-09-12T02:23:15.832837+0000","last_became_peered":"2024-09-12T02:23:15.832837+0000","last_unstale":"2024-09-12T02:40:29.686554+0000","last_undegraded":"2024-09-12T02:40:29.686554+0000","last_fullsized":"2024-09-12T02:40:29.686554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-09-12T02:40:29.686446+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-09-12T02:40:29.686446+0000","last_clean_scrub_stamp":"2024-09-12T02:40:29.686446+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:45.460669+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"28'5783","reported_seq":5823,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:22.904666+0000","last_change":"2024-09-12T02:40:22.904695+0000","last_active":"2024-09-12T02:40:22.904666+0000","last_peered":"2024-09-12T02:40:22.904666+0000","last_clean":"2024-09-12T02:40:22.904666+0000","last_became_active":"2024-09-12T02:23:04.776270+0000","last_became_peered":"2024-09-12T02:23:04.776270+0000","last_unstale":"2024-09-12T02:40:22.904666+0000","last_undegraded":"2024-09-12T02:40:22.904666+0000","last_fullsized":"2024-09-12T02:40:22.904666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5783","last_scrub_stamp":"2024-09-12T02:40:22.904548+0000","last_deep_scrub":"28'5783","last_deep_scrub_stamp":"2024-09-12T02:40:22.904548+0000","last_clean_scrub_stamp":"2024-09-12T02:40:22.904548+0000","objects_scrubbed":0,"log_size":5783,"log_dups_size":0,"ondisk_log_size":5783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:42.112392+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29721,"num_write_kb":356762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'3","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:28.549198+0000","last_change":"2024-09-12T02:40:28.549226+0000","last_active":"2024-09-12T02:40:28.549198+0000","last_peered":"2024-09-12T02:40:28.549198+0000","last_clean":"2024-09-12T02:40:28.549198+0000","last_became_active":"2024-09-12T02:23:03.762161+0000","last_became_peered":"2024-09-12T02:23:03.762161+0000","last_unstale":"2024-09-12T02:40:28.549198+0000","last_undegraded":"2024-09-12T02:40:28.549198+0000","last_fullsized":"2024-09-12T02:40:28.549198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-09-12T02:40:28.549110+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-09-12T02:40:28.549110+0000","last_clean_scrub_stamp":"2024-09-12T02:40:28.549110+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:12.038470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"28'5706","reported_seq":5739,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:32.744314+0000","last_change":"2024-09-12T02:40:32.744345+0000","last_active":"2024-09-12T02:40:32.744314+0000","last_peered":"2024-09-12T02:40:32.744314+0000","last_clean":"2024-09-12T02:40:32.744314+0000","last_became_active":"2024-09-12T02:23:16.844248+0000","last_became_peered":"2024-09-12T02:23:16.844248+0000","last_unstale":"2024-09-12T02:40:32.744314+0000","last_undegraded":"2024-09-12T02:40:32.744314+0000","last_fullsized":"2024-09-12T02:40:32.744314+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5706","last_scrub_stamp":"2024-09-12T02:40:32.744207+0000","last_deep_scrub":"28'5706","last_deep_scrub_stamp":"2024-09-12T02:40:32.744207+0000","last_clean_scrub_stamp":"2024-09-12T02:40:32.744207+0000","objects_scrubbed":0,"log_size":5706,"log_dups_size":0,"ondisk_log_size":5706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:42.431070+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29959,"num_write_kb":337330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"28'722","reported_seq":757,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:28.935940+0000","last_change":"2024-09-12T02:40:28.935989+0000","last_active":"2024-09-12T02:40:28.935940+0000","last_peered":"2024-09-12T02:40:28.935940+0000","last_clean":"2024-09-12T02:40:28.935940+0000","last_became_active":"2024-09-12T02:23:15.825730+0000","last_became_peered":"2024-09-12T02:23:15.825730+0000","last_unstale":"2024-09-12T02:40:28.935940+0000","last_undegraded":"2024-09-12T02:40:28.935940+0000","last_fullsized":"2024-09-12T02:40:28.935940+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'722","last_scrub_stamp":"2024-09-12T02:40:28.935816+0000","last_deep_scrub":"28'722","last_deep_scrub_stamp":"2024-09-12T02:40:28.935816+0000","last_clean_scrub_stamp":"2024-09-12T02:40:28.935816+0000","objects_scrubbed":3,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:29.111932+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":717,"num_write_kb":4509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"28'4333","reported_seq":4373,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:36.766220+0000","last_change":"2024-09-12T02:40:36.766262+0000","last_active":"2024-09-12T02:40:36.766220+0000","last_peered":"2024-09-12T02:40:36.766220+0000","last_clean":"2024-09-12T02:40:36.766220+0000","last_became_active":"2024-09-12T02:23:04.783039+0000","last_became_peered":"2024-09-12T02:23:04.783039+0000","last_unstale":"2024-09-12T02:40:36.766220+0000","last_undegraded":"2024-09-12T02:40:36.766220+0000","last_fullsized":"2024-09-12T02:40:36.766220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4333","last_scrub_stamp":"2024-09-12T02:40:36.766113+0000","last_deep_scrub":"28'4333","last_deep_scrub_stamp":"2024-09-12T02:40:36.766113+0000","last_clean_scrub_stamp":"2024-09-12T02:40:36.766113+0000","objects_scrubbed":0,"log_size":4333,"log_dups_size":0,"ondisk_log_size":4333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:01:17.404317+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22422,"num_write_kb":290509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'3","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:31.753834+0000","last_change":"2024-09-12T02:40:31.753862+0000","last_active":"2024-09-12T02:40:31.753834+0000","last_peered":"2024-09-12T02:40:31.753834+0000","last_clean":"2024-09-12T02:40:31.753834+0000","last_became_active":"2024-09-12T02:23:03.768137+0000","last_became_peered":"2024-09-12T02:23:03.768137+0000","last_unstale":"2024-09-12T02:40:31.753834+0000","last_undegraded":"2024-09-12T02:40:31.753834+0000","last_fullsized":"2024-09-12T02:40:31.753834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-09-12T02:40:31.753742+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-09-12T02:40:31.753742+0000","last_clean_scrub_stamp":"2024-09-12T02:40:31.753742+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:26.841882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"28'6357","reported_seq":6389,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:35.745343+0000","last_change":"2024-09-12T02:40:35.745343+0000","last_active":"2024-09-12T02:40:35.745343+0000","last_peered":"2024-09-12T02:40:35.745343+0000","last_clean":"2024-09-12T02:40:35.745343+0000","last_became_active":"2024-09-12T02:23:16.860980+0000","last_became_peered":"2024-09-12T02:23:16.860980+0000","last_unstale":"2024-09-12T02:40:35.745343+0000","last_undegraded":"2024-09-12T02:40:35.745343+0000","last_fullsized":"2024-09-12T02:40:35.745343+0000","mapping_epoch":24,"log_start":"28'500","ondisk_log_start":"28'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6357","last_scrub_stamp":"2024-09-12T02:40:35.745219+0000","last_deep_scrub":"28'6357","last_deep_scrub_stamp":"2024-09-12T02:40:35.745219+0000","last_clean_scrub_stamp":"2024-09-12T02:40:35.745219+0000","objects_scrubbed":0,"log_size":5857,"log_dups_size":0,"ondisk_log_size":5857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:48.829674+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32865,"num_write_kb":377625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"28'95","reported_seq":137,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:22.049430+0000","last_change":"2024-09-12T02:40:22.049430+0000","last_active":"2024-09-12T02:40:22.049430+0000","last_peered":"2024-09-12T02:40:22.049430+0000","last_clean":"2024-09-12T02:40:22.049430+0000","last_became_active":"2024-09-12T02:23:03.767916+0000","last_became_peered":"2024-09-12T02:23:03.767916+0000","last_unstale":"2024-09-12T02:40:22.049430+0000","last_undegraded":"2024-09-12T02:40:22.049430+0000","last_fullsized":"2024-09-12T02:40:22.049430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'95","last_scrub_stamp":"2024-09-12T02:40:22.049307+0000","last_deep_scrub":"28'95","last_deep_scrub_stamp":"2024-09-12T02:40:22.049307+0000","last_clean_scrub_stamp":"2024-09-12T02:40:22.049307+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:50.804202+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1333026,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"28'3601","reported_seq":3641,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:15.765020+0000","last_change":"2024-09-12T02:40:15.765020+0000","last_active":"2024-09-12T02:40:15.765020+0000","last_peered":"2024-09-12T02:40:15.765020+0000","last_clean":"2024-09-12T02:40:15.765020+0000","last_became_active":"2024-09-12T02:23:04.793100+0000","last_became_peered":"2024-09-12T02:23:04.793100+0000","last_unstale":"2024-09-12T02:40:15.765020+0000","last_undegraded":"2024-09-12T02:40:15.765020+0000","last_fullsized":"2024-09-12T02:40:15.765020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3601","last_scrub_stamp":"2024-09-12T02:40:15.764903+0000","last_deep_scrub":"28'3601","last_deep_scrub_stamp":"2024-09-12T02:40:15.764903+0000","last_clean_scrub_stamp":"2024-09-12T02:40:15.764903+0000","objects_scrubbed":0,"log_size":3601,"log_dups_size":0,"ondisk_log_size":3601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:10.628567+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18077,"num_write_kb":232187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"28'4","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:23.675173+0000","last_change":"2024-09-12T02:40:23.675173+0000","last_active":"2024-09-12T02:40:23.675173+0000","last_peered":"2024-09-12T02:40:23.675173+0000","last_clean":"2024-09-12T02:40:23.675173+0000","last_became_active":"2024-09-12T02:23:15.830492+0000","last_became_peered":"2024-09-12T02:23:15.830492+0000","last_unstale":"2024-09-12T02:40:23.675173+0000","last_undegraded":"2024-09-12T02:40:23.675173+0000","last_fullsized":"2024-09-12T02:40:23.675173+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-09-12T02:40:23.675067+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-09-12T02:40:23.675067+0000","last_clean_scrub_stamp":"2024-09-12T02:40:23.675067+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:57.916379+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"28'3975","reported_seq":4007,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:31.904288+0000","last_change":"2024-09-12T02:40:31.904288+0000","last_active":"2024-09-12T02:40:31.904288+0000","last_peered":"2024-09-12T02:40:31.904288+0000","last_clean":"2024-09-12T02:40:31.904288+0000","last_became_active":"2024-09-12T02:23:16.851558+0000","last_became_peered":"2024-09-12T02:23:16.851558+0000","last_unstale":"2024-09-12T02:40:31.904288+0000","last_undegraded":"2024-09-12T02:40:31.904288+0000","last_fullsized":"2024-09-12T02:40:31.904288+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3975","last_scrub_stamp":"2024-09-12T02:40:31.904137+0000","last_deep_scrub":"28'3975","last_deep_scrub_stamp":"2024-09-12T02:40:31.904137+0000","last_clean_scrub_stamp":"2024-09-12T02:40:31.904137+0000","objects_scrubbed":0,"log_size":3975,"log_dups_size":0,"ondisk_log_size":3975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:22.220821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20293,"num_write_kb":228813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'577","reported_seq":619,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:29.762352+0000","last_change":"2024-09-12T02:40:29.762352+0000","last_active":"2024-09-12T02:40:29.762352+0000","last_peered":"2024-09-12T02:40:29.762352+0000","last_clean":"2024-09-12T02:40:29.762352+0000","last_became_active":"2024-09-12T02:23:03.764020+0000","last_became_peered":"2024-09-12T02:23:03.764020+0000","last_unstale":"2024-09-12T02:40:29.762352+0000","last_undegraded":"2024-09-12T02:40:29.762352+0000","last_fullsized":"2024-09-12T02:40:29.762352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'577","last_scrub_stamp":"2024-09-12T02:40:29.762186+0000","last_deep_scrub":"28'577","last_deep_scrub_stamp":"2024-09-12T02:40:29.762186+0000","last_clean_scrub_stamp":"2024-09-12T02:40:29.762186+0000","objects_scrubbed":1,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:24.402854+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":574,"num_write_kb":4226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"28'4110","reported_seq":4150,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:23.953237+0000","last_change":"2024-09-12T02:40:23.953237+0000","last_active":"2024-09-12T02:40:23.953237+0000","last_peered":"2024-09-12T02:40:23.953237+0000","last_clean":"2024-09-12T02:40:23.953237+0000","last_became_active":"2024-09-12T02:23:04.771310+0000","last_became_peered":"2024-09-12T02:23:04.771310+0000","last_unstale":"2024-09-12T02:40:23.953237+0000","last_undegraded":"2024-09-12T02:40:23.953237+0000","last_fullsized":"2024-09-12T02:40:23.953237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4110","last_scrub_stamp":"2024-09-12T02:40:23.953118+0000","last_deep_scrub":"28'4110","last_deep_scrub_stamp":"2024-09-12T02:40:23.953118+0000","last_clean_scrub_stamp":"2024-09-12T02:40:23.953118+0000","objects_scrubbed":0,"log_size":4110,"log_dups_size":0,"ondisk_log_size":4110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:15.133521+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20660,"num_write_kb":258850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"28'12","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:21.868871+0000","last_change":"2024-09-12T02:40:21.868871+0000","last_active":"2024-09-12T02:40:21.868871+0000","last_peered":"2024-09-12T02:40:21.868871+0000","last_clean":"2024-09-12T02:40:21.868871+0000","last_became_active":"2024-09-12T02:23:15.832478+0000","last_became_peered":"2024-09-12T02:23:15.832478+0000","last_unstale":"2024-09-12T02:40:21.868871+0000","last_undegraded":"2024-09-12T02:40:21.868871+0000","last_fullsized":"2024-09-12T02:40:21.868871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'12","last_scrub_stamp":"2024-09-12T02:40:21.868741+0000","last_deep_scrub":"28'12","last_deep_scrub_stamp":"2024-09-12T02:40:21.868741+0000","last_clean_scrub_stamp":"2024-09-12T02:40:21.868741+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:18.966540+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"28'4897","reported_seq":4930,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:43.811110+0000","last_change":"2024-09-12T02:40:43.811154+0000","last_active":"2024-09-12T02:40:43.811110+0000","last_peered":"2024-09-12T02:40:43.811110+0000","last_clean":"2024-09-12T02:40:43.811110+0000","last_became_active":"2024-09-12T02:23:16.847063+0000","last_became_peered":"2024-09-12T02:23:16.847063+0000","last_unstale":"2024-09-12T02:40:43.811110+0000","last_undegraded":"2024-09-12T02:40:43.811110+0000","last_fullsized":"2024-09-12T02:40:43.811110+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4897","last_scrub_stamp":"2024-09-12T02:40:43.810984+0000","last_deep_scrub":"28'4897","last_deep_scrub_stamp":"2024-09-12T02:40:43.810984+0000","last_clean_scrub_stamp":"2024-09-12T02:40:43.810984+0000","objects_scrubbed":0,"log_size":4897,"log_dups_size":0,"ondisk_log_size":4897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:11.155854+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25246,"num_write_kb":285992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"28'6383","reported_seq":6424,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:27.952009+0000","last_change":"2024-09-12T02:40:27.952044+0000","last_active":"2024-09-12T02:40:27.952009+0000","last_peered":"2024-09-12T02:40:27.952009+0000","last_clean":"2024-09-12T02:40:27.952009+0000","last_became_active":"2024-09-12T02:23:04.788195+0000","last_became_peered":"2024-09-12T02:23:04.788195+0000","last_unstale":"2024-09-12T02:40:27.952009+0000","last_undegraded":"2024-09-12T02:40:27.952009+0000","last_fullsized":"2024-09-12T02:40:27.952009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6383","last_scrub_stamp":"2024-09-12T02:40:27.951919+0000","last_deep_scrub":"28'6383","last_deep_scrub_stamp":"2024-09-12T02:40:27.951919+0000","last_clean_scrub_stamp":"2024-09-12T02:40:27.951919+0000","objects_scrubbed":0,"log_size":6383,"log_dups_size":0,"ondisk_log_size":6383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:51.236428+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32308,"num_write_kb":383454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"28'5756","reported_seq":5789,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:31.784587+0000","last_change":"2024-09-12T02:40:31.784587+0000","last_active":"2024-09-12T02:40:31.784587+0000","last_peered":"2024-09-12T02:40:31.784587+0000","last_clean":"2024-09-12T02:40:31.784587+0000","last_became_active":"2024-09-12T02:23:16.843517+0000","last_became_peered":"2024-09-12T02:23:16.843517+0000","last_unstale":"2024-09-12T02:40:31.784587+0000","last_undegraded":"2024-09-12T02:40:31.784587+0000","last_fullsized":"2024-09-12T02:40:31.784587+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5756","last_scrub_stamp":"2024-09-12T02:40:31.784446+0000","last_deep_scrub":"28'5756","last_deep_scrub_stamp":"2024-09-12T02:40:31.784446+0000","last_clean_scrub_stamp":"2024-09-12T02:40:31.784446+0000","objects_scrubbed":0,"log_size":5756,"log_dups_size":0,"ondisk_log_size":5756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:59.230987+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29883,"num_write_kb":357322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"28'5059","reported_seq":5100,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:21.710494+0000","last_change":"2024-09-12T02:40:21.710524+0000","last_active":"2024-09-12T02:40:21.710494+0000","last_peered":"2024-09-12T02:40:21.710494+0000","last_clean":"2024-09-12T02:40:21.710494+0000","last_became_active":"2024-09-12T02:23:04.780402+0000","last_became_peered":"2024-09-12T02:23:04.780402+0000","last_unstale":"2024-09-12T02:40:21.710494+0000","last_undegraded":"2024-09-12T02:40:21.710494+0000","last_fullsized":"2024-09-12T02:40:21.710494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5059","last_scrub_stamp":"2024-09-12T02:40:21.710387+0000","last_deep_scrub":"28'5059","last_deep_scrub_stamp":"2024-09-12T02:40:21.710387+0000","last_clean_scrub_stamp":"2024-09-12T02:40:21.710387+0000","objects_scrubbed":0,"log_size":5059,"log_dups_size":0,"ondisk_log_size":5059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:10:28.224158+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26551,"num_write_kb":323518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"28'4560","reported_seq":4593,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:36.431401+0000","last_change":"2024-09-12T02:40:36.431401+0000","last_active":"2024-09-12T02:40:36.431401+0000","last_peered":"2024-09-12T02:40:36.431401+0000","last_clean":"2024-09-12T02:40:36.431401+0000","last_became_active":"2024-09-12T02:23:16.852706+0000","last_became_peered":"2024-09-12T02:23:16.852706+0000","last_unstale":"2024-09-12T02:40:36.431401+0000","last_undegraded":"2024-09-12T02:40:36.431401+0000","last_fullsized":"2024-09-12T02:40:36.431401+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4560","last_scrub_stamp":"2024-09-12T02:40:36.431303+0000","last_deep_scrub":"28'4560","last_deep_scrub_stamp":"2024-09-12T02:40:36.431303+0000","last_clean_scrub_stamp":"2024-09-12T02:40:36.431303+0000","objects_scrubbed":0,"log_size":4560,"log_dups_size":0,"ondisk_log_size":4560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:42.210490+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23787,"num_write_kb":279744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"28'5935","reported_seq":5976,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:35.470989+0000","last_change":"2024-09-12T02:40:35.471030+0000","last_active":"2024-09-12T02:40:35.470989+0000","last_peered":"2024-09-12T02:40:35.470989+0000","last_clean":"2024-09-12T02:40:35.470989+0000","last_became_active":"2024-09-12T02:23:04.785422+0000","last_became_peered":"2024-09-12T02:23:04.785422+0000","last_unstale":"2024-09-12T02:40:35.470989+0000","last_undegraded":"2024-09-12T02:40:35.470989+0000","last_fullsized":"2024-09-12T02:40:35.470989+0000","mapping_epoch":20,"log_start":"28'100","ondisk_log_start":"28'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5935","last_scrub_stamp":"2024-09-12T02:40:35.470868+0000","last_deep_scrub":"28'5935","last_deep_scrub_stamp":"2024-09-12T02:40:35.470868+0000","last_clean_scrub_stamp":"2024-09-12T02:40:35.470868+0000","objects_scrubbed":0,"log_size":5835,"log_dups_size":0,"ondisk_log_size":5835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:36.009628+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30608,"num_write_kb":368510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"28'5374","reported_seq":5407,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:37.700531+0000","last_change":"2024-09-12T02:40:37.700531+0000","last_active":"2024-09-12T02:40:37.700531+0000","last_peered":"2024-09-12T02:40:37.700531+0000","last_clean":"2024-09-12T02:40:37.700531+0000","last_became_active":"2024-09-12T02:23:16.861658+0000","last_became_peered":"2024-09-12T02:23:16.861658+0000","last_unstale":"2024-09-12T02:40:37.700531+0000","last_undegraded":"2024-09-12T02:40:37.700531+0000","last_fullsized":"2024-09-12T02:40:37.700531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5374","last_scrub_stamp":"2024-09-12T02:40:37.700397+0000","last_deep_scrub":"28'5374","last_deep_scrub_stamp":"2024-09-12T02:40:37.700397+0000","last_clean_scrub_stamp":"2024-09-12T02:40:37.700397+0000","objects_scrubbed":0,"log_size":5374,"log_dups_size":0,"ondisk_log_size":5374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:15.659536+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28055,"num_write_kb":329573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"28'4234","reported_seq":4275,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:21.725986+0000","last_change":"2024-09-12T02:40:21.726017+0000","last_active":"2024-09-12T02:40:21.725986+0000","last_peered":"2024-09-12T02:40:21.725986+0000","last_clean":"2024-09-12T02:40:21.725986+0000","last_became_active":"2024-09-12T02:23:04.776736+0000","last_became_peered":"2024-09-12T02:23:04.776736+0000","last_unstale":"2024-09-12T02:40:21.725986+0000","last_undegraded":"2024-09-12T02:40:21.725986+0000","last_fullsized":"2024-09-12T02:40:21.725986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4234","last_scrub_stamp":"2024-09-12T02:40:21.725878+0000","last_deep_scrub":"28'4234","last_deep_scrub_stamp":"2024-09-12T02:40:21.725878+0000","last_clean_scrub_stamp":"2024-09-12T02:40:21.725878+0000","objects_scrubbed":0,"log_size":4234,"log_dups_size":0,"ondisk_log_size":4234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:45.420257+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21439,"num_write_kb":262018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"28'6314","reported_seq":6347,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:27.872610+0000","last_change":"2024-09-12T02:40:27.872638+0000","last_active":"2024-09-12T02:40:27.872610+0000","last_peered":"2024-09-12T02:40:27.872610+0000","last_clean":"2024-09-12T02:40:27.872610+0000","last_became_active":"2024-09-12T02:23:16.847260+0000","last_became_peered":"2024-09-12T02:23:16.847260+0000","last_unstale":"2024-09-12T02:40:27.872610+0000","last_undegraded":"2024-09-12T02:40:27.872610+0000","last_fullsized":"2024-09-12T02:40:27.872610+0000","mapping_epoch":24,"log_start":"28'500","ondisk_log_start":"28'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6314","last_scrub_stamp":"2024-09-12T02:40:27.872466+0000","last_deep_scrub":"28'6314","last_deep_scrub_stamp":"2024-09-12T02:40:27.872466+0000","last_clean_scrub_stamp":"2024-09-12T02:40:27.872466+0000","objects_scrubbed":0,"log_size":5814,"log_dups_size":0,"ondisk_log_size":5814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:31:54.371570+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32869,"num_write_kb":377542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"28'4066","reported_seq":4107,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:22.902350+0000","last_change":"2024-09-12T02:40:22.902350+0000","last_active":"2024-09-12T02:40:22.902350+0000","last_peered":"2024-09-12T02:40:22.902350+0000","last_clean":"2024-09-12T02:40:22.902350+0000","last_became_active":"2024-09-12T02:23:04.789090+0000","last_became_peered":"2024-09-12T02:23:04.789090+0000","last_unstale":"2024-09-12T02:40:22.902350+0000","last_undegraded":"2024-09-12T02:40:22.902350+0000","last_fullsized":"2024-09-12T02:40:22.902350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4066","last_scrub_stamp":"2024-09-12T02:40:22.902184+0000","last_deep_scrub":"28'4066","last_deep_scrub_stamp":"2024-09-12T02:40:22.902184+0000","last_clean_scrub_stamp":"2024-09-12T02:40:22.902184+0000","objects_scrubbed":0,"log_size":4066,"log_dups_size":0,"ondisk_log_size":4066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:14.564534+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20728,"num_write_kb":267380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"28'3925","reported_seq":3958,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:37.935436+0000","last_change":"2024-09-12T02:40:37.935463+0000","last_active":"2024-09-12T02:40:37.935436+0000","last_peered":"2024-09-12T02:40:37.935436+0000","last_clean":"2024-09-12T02:40:37.935436+0000","last_became_active":"2024-09-12T02:23:16.858637+0000","last_became_peered":"2024-09-12T02:23:16.858637+0000","last_unstale":"2024-09-12T02:40:37.935436+0000","last_undegraded":"2024-09-12T02:40:37.935436+0000","last_fullsized":"2024-09-12T02:40:37.935436+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3925","last_scrub_stamp":"2024-09-12T02:40:37.935307+0000","last_deep_scrub":"28'3925","last_deep_scrub_stamp":"2024-09-12T02:40:37.935307+0000","last_clean_scrub_stamp":"2024-09-12T02:40:37.935307+0000","objects_scrubbed":0,"log_size":3925,"log_dups_size":0,"ondisk_log_size":3925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:39.332237+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20092,"num_write_kb":256658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"28'5046","reported_seq":5087,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:20.839912+0000","last_change":"2024-09-12T02:40:20.839912+0000","last_active":"2024-09-12T02:40:20.839912+0000","last_peered":"2024-09-12T02:40:20.839912+0000","last_clean":"2024-09-12T02:40:20.839912+0000","last_became_active":"2024-09-12T02:23:04.776120+0000","last_became_peered":"2024-09-12T02:23:04.776120+0000","last_unstale":"2024-09-12T02:40:20.839912+0000","last_undegraded":"2024-09-12T02:40:20.839912+0000","last_fullsized":"2024-09-12T02:40:20.839912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5046","last_scrub_stamp":"2024-09-12T02:40:20.839730+0000","last_deep_scrub":"28'5046","last_deep_scrub_stamp":"2024-09-12T02:40:20.839730+0000","last_clean_scrub_stamp":"2024-09-12T02:40:20.839730+0000","objects_scrubbed":0,"log_size":5046,"log_dups_size":0,"ondisk_log_size":5046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:22.973004+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26791,"num_write_kb":324401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"28'6719","reported_seq":6752,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:41.811518+0000","last_change":"2024-09-12T02:40:41.811544+0000","last_active":"2024-09-12T02:40:41.811518+0000","last_peered":"2024-09-12T02:40:41.811518+0000","last_clean":"2024-09-12T02:40:41.811518+0000","last_became_active":"2024-09-12T02:23:16.855839+0000","last_became_peered":"2024-09-12T02:23:16.855839+0000","last_unstale":"2024-09-12T02:40:41.811518+0000","last_undegraded":"2024-09-12T02:40:41.811518+0000","last_fullsized":"2024-09-12T02:40:41.811518+0000","mapping_epoch":24,"log_start":"28'900","ondisk_log_start":"28'900","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6719","last_scrub_stamp":"2024-09-12T02:40:41.811427+0000","last_deep_scrub":"28'6719","last_deep_scrub_stamp":"2024-09-12T02:40:41.811427+0000","last_clean_scrub_stamp":"2024-09-12T02:40:41.811427+0000","objects_scrubbed":0,"log_size":5819,"log_dups_size":0,"ondisk_log_size":5819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:07.896066+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34627,"num_write_kb":392862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"28'4165","reported_seq":4206,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:18.009874+0000","last_change":"2024-09-12T02:40:18.009874+0000","last_active":"2024-09-12T02:40:18.009874+0000","last_peered":"2024-09-12T02:40:18.009874+0000","last_clean":"2024-09-12T02:40:18.009874+0000","last_became_active":"2024-09-12T02:23:04.788521+0000","last_became_peered":"2024-09-12T02:23:04.788521+0000","last_unstale":"2024-09-12T02:40:18.009874+0000","last_undegraded":"2024-09-12T02:40:18.009874+0000","last_fullsized":"2024-09-12T02:40:18.009874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4165","last_scrub_stamp":"2024-09-12T02:40:18.009762+0000","last_deep_scrub":"28'4165","last_deep_scrub_stamp":"2024-09-12T02:40:18.009762+0000","last_clean_scrub_stamp":"2024-09-12T02:40:18.009762+0000","objects_scrubbed":0,"log_size":4165,"log_dups_size":0,"ondisk_log_size":4165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:13.630538+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21249,"num_write_kb":269852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"28'5811","reported_seq":5844,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:32.884932+0000","last_change":"2024-09-12T02:40:32.884957+0000","last_active":"2024-09-12T02:40:32.884932+0000","last_peered":"2024-09-12T02:40:32.884932+0000","last_clean":"2024-09-12T02:40:32.884932+0000","last_became_active":"2024-09-12T02:23:16.837606+0000","last_became_peered":"2024-09-12T02:23:16.837606+0000","last_unstale":"2024-09-12T02:40:32.884932+0000","last_undegraded":"2024-09-12T02:40:32.884932+0000","last_fullsized":"2024-09-12T02:40:32.884932+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5811","last_scrub_stamp":"2024-09-12T02:40:32.884837+0000","last_deep_scrub":"28'5811","last_deep_scrub_stamp":"2024-09-12T02:40:32.884837+0000","last_clean_scrub_stamp":"2024-09-12T02:40:32.884837+0000","objects_scrubbed":0,"log_size":5811,"log_dups_size":0,"ondisk_log_size":5811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:51.906443+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30267,"num_write_kb":338418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"28'5427","reported_seq":5453,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:31.788737+0000","last_change":"2024-09-12T02:40:31.788762+0000","last_active":"2024-09-12T02:40:31.788737+0000","last_peered":"2024-09-12T02:40:31.788737+0000","last_clean":"2024-09-12T02:40:31.788737+0000","last_became_active":"2024-09-12T02:23:56.563943+0000","last_became_peered":"2024-09-12T02:23:56.563943+0000","last_unstale":"2024-09-12T02:40:31.788737+0000","last_undegraded":"2024-09-12T02:40:31.788737+0000","last_fullsized":"2024-09-12T02:40:31.788737+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5427","last_scrub_stamp":"2024-09-12T02:40:31.788639+0000","last_deep_scrub":"28'5427","last_deep_scrub_stamp":"2024-09-12T02:40:31.788639+0000","last_clean_scrub_stamp":"2024-09-12T02:40:31.788639+0000","objects_scrubbed":0,"log_size":5427,"log_dups_size":0,"ondisk_log_size":5427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:21.220204+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27382,"num_write_kb":347330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"28'4215","reported_seq":4247,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:38.734599+0000","last_change":"2024-09-12T02:40:38.734648+0000","last_active":"2024-09-12T02:40:38.734599+0000","last_peered":"2024-09-12T02:40:38.734599+0000","last_clean":"2024-09-12T02:40:38.734599+0000","last_became_active":"2024-09-12T02:23:16.844939+0000","last_became_peered":"2024-09-12T02:23:16.844939+0000","last_unstale":"2024-09-12T02:40:38.734599+0000","last_undegraded":"2024-09-12T02:40:38.734599+0000","last_fullsized":"2024-09-12T02:40:38.734599+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4215","last_scrub_stamp":"2024-09-12T02:40:38.734501+0000","last_deep_scrub":"28'4215","last_deep_scrub_stamp":"2024-09-12T02:40:38.734501+0000","last_clean_scrub_stamp":"2024-09-12T02:40:38.734501+0000","objects_scrubbed":0,"log_size":4215,"log_dups_size":0,"ondisk_log_size":4215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:19.844560+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21581,"num_write_kb":250408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'4161","reported_seq":4187,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:32.798312+0000","last_change":"2024-09-12T02:40:32.798364+0000","last_active":"2024-09-12T02:40:32.798312+0000","last_peered":"2024-09-12T02:40:32.798312+0000","last_clean":"2024-09-12T02:40:32.798312+0000","last_became_active":"2024-09-12T02:23:56.674143+0000","last_became_peered":"2024-09-12T02:23:56.674143+0000","last_unstale":"2024-09-12T02:40:32.798312+0000","last_undegraded":"2024-09-12T02:40:32.798312+0000","last_fullsized":"2024-09-12T02:40:32.798312+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4161","last_scrub_stamp":"2024-09-12T02:40:32.798196+0000","last_deep_scrub":"28'4161","last_deep_scrub_stamp":"2024-09-12T02:40:32.798196+0000","last_clean_scrub_stamp":"2024-09-12T02:40:32.798196+0000","objects_scrubbed":0,"log_size":4161,"log_dups_size":0,"ondisk_log_size":4161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:55.351042+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21422,"num_write_kb":266111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2f","version":"28'6100","reported_seq":6132,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:39.804582+0000","last_change":"2024-09-12T02:40:39.804627+0000","last_active":"2024-09-12T02:40:39.804582+0000","last_peered":"2024-09-12T02:40:39.804582+0000","last_clean":"2024-09-12T02:40:39.804582+0000","last_became_active":"2024-09-12T02:23:16.849585+0000","last_became_peered":"2024-09-12T02:23:16.849585+0000","last_unstale":"2024-09-12T02:40:39.804582+0000","last_undegraded":"2024-09-12T02:40:39.804582+0000","last_fullsized":"2024-09-12T02:40:39.804582+0000","mapping_epoch":24,"log_start":"28'300","ondisk_log_start":"28'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6100","last_scrub_stamp":"2024-09-12T02:40:39.804472+0000","last_deep_scrub":"28'6100","last_deep_scrub_stamp":"2024-09-12T02:40:39.804472+0000","last_clean_scrub_stamp":"2024-09-12T02:40:39.804472+0000","objects_scrubbed":0,"log_size":5800,"log_dups_size":0,"ondisk_log_size":5800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:10:21.901939+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30891,"num_write_kb":369602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"28'4576","reported_seq":4616,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:24.914876+0000","last_change":"2024-09-12T02:40:24.914908+0000","last_active":"2024-09-12T02:40:24.914876+0000","last_peered":"2024-09-12T02:40:24.914876+0000","last_clean":"2024-09-12T02:40:24.914876+0000","last_became_active":"2024-09-12T02:23:04.788352+0000","last_became_peered":"2024-09-12T02:23:04.788352+0000","last_unstale":"2024-09-12T02:40:24.914876+0000","last_undegraded":"2024-09-12T02:40:24.914876+0000","last_fullsized":"2024-09-12T02:40:24.914876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4576","last_scrub_stamp":"2024-09-12T02:40:24.914773+0000","last_deep_scrub":"28'4576","last_deep_scrub_stamp":"2024-09-12T02:40:24.914773+0000","last_clean_scrub_stamp":"2024-09-12T02:40:24.914773+0000","objects_scrubbed":0,"log_size":4576,"log_dups_size":0,"ondisk_log_size":4576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:06.689096+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23775,"num_write_kb":295982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"28'5142","reported_seq":5174,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:28.746959+0000","last_change":"2024-09-12T02:40:28.746988+0000","last_active":"2024-09-12T02:40:28.746959+0000","last_peered":"2024-09-12T02:40:28.746959+0000","last_clean":"2024-09-12T02:40:28.746959+0000","last_became_active":"2024-09-12T02:23:16.849831+0000","last_became_peered":"2024-09-12T02:23:16.849831+0000","last_unstale":"2024-09-12T02:40:28.746959+0000","last_undegraded":"2024-09-12T02:40:28.746959+0000","last_fullsized":"2024-09-12T02:40:28.746959+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5142","last_scrub_stamp":"2024-09-12T02:40:28.746853+0000","last_deep_scrub":"28'5142","last_deep_scrub_stamp":"2024-09-12T02:40:28.746853+0000","last_clean_scrub_stamp":"2024-09-12T02:40:28.746853+0000","objects_scrubbed":0,"log_size":5142,"log_dups_size":0,"ondisk_log_size":5142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:22.791474+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26862,"num_write_kb":308481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"28'4731","reported_seq":4771,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:34.502225+0000","last_change":"2024-09-12T02:40:34.502266+0000","last_active":"2024-09-12T02:40:34.502225+0000","last_peered":"2024-09-12T02:40:34.502225+0000","last_clean":"2024-09-12T02:40:34.502225+0000","last_became_active":"2024-09-12T02:23:04.784945+0000","last_became_peered":"2024-09-12T02:23:04.784945+0000","last_unstale":"2024-09-12T02:40:34.502225+0000","last_undegraded":"2024-09-12T02:40:34.502225+0000","last_fullsized":"2024-09-12T02:40:34.502225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4731","last_scrub_stamp":"2024-09-12T02:40:34.502125+0000","last_deep_scrub":"28'4731","last_deep_scrub_stamp":"2024-09-12T02:40:34.502125+0000","last_clean_scrub_stamp":"2024-09-12T02:40:34.502125+0000","objects_scrubbed":0,"log_size":4731,"log_dups_size":0,"ondisk_log_size":4731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:35.798866+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24557,"num_write_kb":319695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"28'4794","reported_seq":4826,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:39.750369+0000","last_change":"2024-09-12T02:40:39.750394+0000","last_active":"2024-09-12T02:40:39.750369+0000","last_peered":"2024-09-12T02:40:39.750369+0000","last_clean":"2024-09-12T02:40:39.750369+0000","last_became_active":"2024-09-12T02:23:16.845793+0000","last_became_peered":"2024-09-12T02:23:16.845793+0000","last_unstale":"2024-09-12T02:40:39.750369+0000","last_undegraded":"2024-09-12T02:40:39.750369+0000","last_fullsized":"2024-09-12T02:40:39.750369+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4794","last_scrub_stamp":"2024-09-12T02:40:39.750273+0000","last_deep_scrub":"28'4794","last_deep_scrub_stamp":"2024-09-12T02:40:39.750273+0000","last_clean_scrub_stamp":"2024-09-12T02:40:39.750273+0000","objects_scrubbed":0,"log_size":4794,"log_dups_size":0,"ondisk_log_size":4794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:45.909736+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23926,"num_write_kb":300628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"28'4561","reported_seq":4601,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:26.651551+0000","last_change":"2024-09-12T02:40:26.651599+0000","last_active":"2024-09-12T02:40:26.651551+0000","last_peered":"2024-09-12T02:40:26.651551+0000","last_clean":"2024-09-12T02:40:26.651551+0000","last_became_active":"2024-09-12T02:23:04.785511+0000","last_became_peered":"2024-09-12T02:23:04.785511+0000","last_unstale":"2024-09-12T02:40:26.651551+0000","last_undegraded":"2024-09-12T02:40:26.651551+0000","last_fullsized":"2024-09-12T02:40:26.651551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4561","last_scrub_stamp":"2024-09-12T02:40:26.651410+0000","last_deep_scrub":"28'4561","last_deep_scrub_stamp":"2024-09-12T02:40:26.651410+0000","last_clean_scrub_stamp":"2024-09-12T02:40:26.651410+0000","objects_scrubbed":0,"log_size":4561,"log_dups_size":0,"ondisk_log_size":4561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:58.086071+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23484,"num_write_kb":303052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"28'5809","reported_seq":5841,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:32.919778+0000","last_change":"2024-09-12T02:40:32.919820+0000","last_active":"2024-09-12T02:40:32.919778+0000","last_peered":"2024-09-12T02:40:32.919778+0000","last_clean":"2024-09-12T02:40:32.919778+0000","last_became_active":"2024-09-12T02:23:16.855278+0000","last_became_peered":"2024-09-12T02:23:16.855278+0000","last_unstale":"2024-09-12T02:40:32.919778+0000","last_undegraded":"2024-09-12T02:40:32.919778+0000","last_fullsized":"2024-09-12T02:40:32.919778+0000","mapping_epoch":24,"log_start":"28'300","ondisk_log_start":"28'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5809","last_scrub_stamp":"2024-09-12T02:40:32.919675+0000","last_deep_scrub":"28'5809","last_deep_scrub_stamp":"2024-09-12T02:40:32.919675+0000","last_clean_scrub_stamp":"2024-09-12T02:40:32.919675+0000","objects_scrubbed":0,"log_size":5509,"log_dups_size":0,"ondisk_log_size":5509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:21.462789+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30461,"num_write_kb":343399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"28'4620","reported_seq":4660,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:17.051221+0000","last_change":"2024-09-12T02:40:17.051264+0000","last_active":"2024-09-12T02:40:17.051221+0000","last_peered":"2024-09-12T02:40:17.051221+0000","last_clean":"2024-09-12T02:40:17.051221+0000","last_became_active":"2024-09-12T02:23:04.789296+0000","last_became_peered":"2024-09-12T02:23:04.789296+0000","last_unstale":"2024-09-12T02:40:17.051221+0000","last_undegraded":"2024-09-12T02:40:17.051221+0000","last_fullsized":"2024-09-12T02:40:17.051221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4620","last_scrub_stamp":"2024-09-12T02:40:17.051105+0000","last_deep_scrub":"28'4620","last_deep_scrub_stamp":"2024-09-12T02:40:17.051105+0000","last_clean_scrub_stamp":"2024-09-12T02:40:17.051105+0000","objects_scrubbed":0,"log_size":4620,"log_dups_size":0,"ondisk_log_size":4620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:04.465488+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23568,"num_write_kb":295197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"28'5012","reported_seq":5044,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:36.951581+0000","last_change":"2024-09-12T02:40:36.951605+0000","last_active":"2024-09-12T02:40:36.951581+0000","last_peered":"2024-09-12T02:40:36.951581+0000","last_clean":"2024-09-12T02:40:36.951581+0000","last_became_active":"2024-09-12T02:23:16.857772+0000","last_became_peered":"2024-09-12T02:23:16.857772+0000","last_unstale":"2024-09-12T02:40:36.951581+0000","last_undegraded":"2024-09-12T02:40:36.951581+0000","last_fullsized":"2024-09-12T02:40:36.951581+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5012","last_scrub_stamp":"2024-09-12T02:40:36.951502+0000","last_deep_scrub":"28'5012","last_deep_scrub_stamp":"2024-09-12T02:40:36.951502+0000","last_clean_scrub_stamp":"2024-09-12T02:40:36.951502+0000","objects_scrubbed":0,"log_size":5012,"log_dups_size":0,"ondisk_log_size":5012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:09.628719+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25770,"num_write_kb":312200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"28'4649","reported_seq":4689,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:28.896841+0000","last_change":"2024-09-12T02:40:28.896866+0000","last_active":"2024-09-12T02:40:28.896841+0000","last_peered":"2024-09-12T02:40:28.896841+0000","last_clean":"2024-09-12T02:40:28.896841+0000","last_became_active":"2024-09-12T02:23:04.776825+0000","last_became_peered":"2024-09-12T02:23:04.776825+0000","last_unstale":"2024-09-12T02:40:28.896841+0000","last_undegraded":"2024-09-12T02:40:28.896841+0000","last_fullsized":"2024-09-12T02:40:28.896841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4649","last_scrub_stamp":"2024-09-12T02:40:28.896744+0000","last_deep_scrub":"28'4649","last_deep_scrub_stamp":"2024-09-12T02:40:28.896744+0000","last_clean_scrub_stamp":"2024-09-12T02:40:28.896744+0000","objects_scrubbed":0,"log_size":4649,"log_dups_size":0,"ondisk_log_size":4649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:58.354382+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22974,"num_write_kb":296824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"28'4733","reported_seq":4766,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:24.463955+0000","last_change":"2024-09-12T02:40:24.463955+0000","last_active":"2024-09-12T02:40:24.463955+0000","last_peered":"2024-09-12T02:40:24.463955+0000","last_clean":"2024-09-12T02:40:24.463955+0000","last_became_active":"2024-09-12T02:23:16.845492+0000","last_became_peered":"2024-09-12T02:23:16.845492+0000","last_unstale":"2024-09-12T02:40:24.463955+0000","last_undegraded":"2024-09-12T02:40:24.463955+0000","last_fullsized":"2024-09-12T02:40:24.463955+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4733","last_scrub_stamp":"2024-09-12T02:40:24.463828+0000","last_deep_scrub":"28'4733","last_deep_scrub_stamp":"2024-09-12T02:40:24.463828+0000","last_clean_scrub_stamp":"2024-09-12T02:40:24.463828+0000","objects_scrubbed":0,"log_size":4733,"log_dups_size":0,"ondisk_log_size":4733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:42.436037+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24040,"num_write_kb":276615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"28'3733","reported_seq":3773,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:22.672422+0000","last_change":"2024-09-12T02:40:22.672454+0000","last_active":"2024-09-12T02:40:22.672422+0000","last_peered":"2024-09-12T02:40:22.672422+0000","last_clean":"2024-09-12T02:40:22.672422+0000","last_became_active":"2024-09-12T02:23:04.790926+0000","last_became_peered":"2024-09-12T02:23:04.790926+0000","last_unstale":"2024-09-12T02:40:22.672422+0000","last_undegraded":"2024-09-12T02:40:22.672422+0000","last_fullsized":"2024-09-12T02:40:22.672422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3733","last_scrub_stamp":"2024-09-12T02:40:22.672315+0000","last_deep_scrub":"28'3733","last_deep_scrub_stamp":"2024-09-12T02:40:22.672315+0000","last_clean_scrub_stamp":"2024-09-12T02:40:22.672315+0000","objects_scrubbed":0,"log_size":3733,"log_dups_size":0,"ondisk_log_size":3733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:39.053509+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18622,"num_write_kb":238300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"28'5122","reported_seq":5154,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:34.688021+0000","last_change":"2024-09-12T02:40:34.688048+0000","last_active":"2024-09-12T02:40:34.688021+0000","last_peered":"2024-09-12T02:40:34.688021+0000","last_clean":"2024-09-12T02:40:34.688021+0000","last_became_active":"2024-09-12T02:23:16.850747+0000","last_became_peered":"2024-09-12T02:23:16.850747+0000","last_unstale":"2024-09-12T02:40:34.688021+0000","last_undegraded":"2024-09-12T02:40:34.688021+0000","last_fullsized":"2024-09-12T02:40:34.688021+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5122","last_scrub_stamp":"2024-09-12T02:40:34.687918+0000","last_deep_scrub":"28'5122","last_deep_scrub_stamp":"2024-09-12T02:40:34.687918+0000","last_clean_scrub_stamp":"2024-09-12T02:40:34.687918+0000","objects_scrubbed":0,"log_size":5122,"log_dups_size":0,"ondisk_log_size":5122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:33.125838+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26303,"num_write_kb":306134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"28'5815","reported_seq":5855,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:19.448205+0000","last_change":"2024-09-12T02:40:19.448229+0000","last_active":"2024-09-12T02:40:19.448205+0000","last_peered":"2024-09-12T02:40:19.448205+0000","last_clean":"2024-09-12T02:40:19.448205+0000","last_became_active":"2024-09-12T02:23:04.787421+0000","last_became_peered":"2024-09-12T02:23:04.787421+0000","last_unstale":"2024-09-12T02:40:19.448205+0000","last_undegraded":"2024-09-12T02:40:19.448205+0000","last_fullsized":"2024-09-12T02:40:19.448205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5815","last_scrub_stamp":"2024-09-12T02:40:19.448074+0000","last_deep_scrub":"28'5815","last_deep_scrub_stamp":"2024-09-12T02:40:19.448074+0000","last_clean_scrub_stamp":"2024-09-12T02:40:19.448074+0000","objects_scrubbed":0,"log_size":5815,"log_dups_size":0,"ondisk_log_size":5815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:11.305905+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29660,"num_write_kb":364722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"28'5421","reported_seq":5453,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:32.804410+0000","last_change":"2024-09-12T02:40:32.804439+0000","last_active":"2024-09-12T02:40:32.804410+0000","last_peered":"2024-09-12T02:40:32.804410+0000","last_clean":"2024-09-12T02:40:32.804410+0000","last_became_active":"2024-09-12T02:23:16.850609+0000","last_became_peered":"2024-09-12T02:23:16.850609+0000","last_unstale":"2024-09-12T02:40:32.804410+0000","last_undegraded":"2024-09-12T02:40:32.804410+0000","last_fullsized":"2024-09-12T02:40:32.804410+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5421","last_scrub_stamp":"2024-09-12T02:40:32.804309+0000","last_deep_scrub":"28'5421","last_deep_scrub_stamp":"2024-09-12T02:40:32.804309+0000","last_clean_scrub_stamp":"2024-09-12T02:40:32.804309+0000","objects_scrubbed":0,"log_size":5421,"log_dups_size":0,"ondisk_log_size":5421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:11.123034+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28803,"num_write_kb":344817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"28'4311","reported_seq":4351,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:17.374105+0000","last_change":"2024-09-12T02:40:17.374131+0000","last_active":"2024-09-12T02:40:17.374105+0000","last_peered":"2024-09-12T02:40:17.374105+0000","last_clean":"2024-09-12T02:40:17.374105+0000","last_became_active":"2024-09-12T02:23:04.789229+0000","last_became_peered":"2024-09-12T02:23:04.789229+0000","last_unstale":"2024-09-12T02:40:17.374105+0000","last_undegraded":"2024-09-12T02:40:17.374105+0000","last_fullsized":"2024-09-12T02:40:17.374105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4311","last_scrub_stamp":"2024-09-12T02:40:17.374011+0000","last_deep_scrub":"28'4311","last_deep_scrub_stamp":"2024-09-12T02:40:17.374011+0000","last_clean_scrub_stamp":"2024-09-12T02:40:17.374011+0000","objects_scrubbed":0,"log_size":4311,"log_dups_size":0,"ondisk_log_size":4311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:23.079828+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22556,"num_write_kb":270677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"28'6535","reported_seq":6567,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:34.942698+0000","last_change":"2024-09-12T02:40:34.942719+0000","last_active":"2024-09-12T02:40:34.942698+0000","last_peered":"2024-09-12T02:40:34.942698+0000","last_clean":"2024-09-12T02:40:34.942698+0000","last_became_active":"2024-09-12T02:23:16.856290+0000","last_became_peered":"2024-09-12T02:23:16.856290+0000","last_unstale":"2024-09-12T02:40:34.942698+0000","last_undegraded":"2024-09-12T02:40:34.942698+0000","last_fullsized":"2024-09-12T02:40:34.942698+0000","mapping_epoch":24,"log_start":"28'1000","ondisk_log_start":"28'1000","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6535","last_scrub_stamp":"2024-09-12T02:40:34.942612+0000","last_deep_scrub":"28'6535","last_deep_scrub_stamp":"2024-09-12T02:40:34.942612+0000","last_clean_scrub_stamp":"2024-09-12T02:40:34.942612+0000","objects_scrubbed":0,"log_size":5535,"log_dups_size":0,"ondisk_log_size":5535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:49.502547+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35147,"num_write_kb":386723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"28'4664","reported_seq":4704,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:18.846346+0000","last_change":"2024-09-12T02:40:18.846374+0000","last_active":"2024-09-12T02:40:18.846346+0000","last_peered":"2024-09-12T02:40:18.846346+0000","last_clean":"2024-09-12T02:40:18.846346+0000","last_became_active":"2024-09-12T02:23:04.782183+0000","last_became_peered":"2024-09-12T02:23:04.782183+0000","last_unstale":"2024-09-12T02:40:18.846346+0000","last_undegraded":"2024-09-12T02:40:18.846346+0000","last_fullsized":"2024-09-12T02:40:18.846346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4664","last_scrub_stamp":"2024-09-12T02:40:18.846251+0000","last_deep_scrub":"28'4664","last_deep_scrub_stamp":"2024-09-12T02:40:18.846251+0000","last_clean_scrub_stamp":"2024-09-12T02:40:18.846251+0000","objects_scrubbed":0,"log_size":4664,"log_dups_size":0,"ondisk_log_size":4664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:40.779637+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23511,"num_write_kb":303118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"28'4146","reported_seq":4178,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:41.439325+0000","last_change":"2024-09-12T02:40:41.439352+0000","last_active":"2024-09-12T02:40:41.439325+0000","last_peered":"2024-09-12T02:40:41.439325+0000","last_clean":"2024-09-12T02:40:41.439325+0000","last_became_active":"2024-09-12T02:23:16.857818+0000","last_became_peered":"2024-09-12T02:23:16.857818+0000","last_unstale":"2024-09-12T02:40:41.439325+0000","last_undegraded":"2024-09-12T02:40:41.439325+0000","last_fullsized":"2024-09-12T02:40:41.439325+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4146","last_scrub_stamp":"2024-09-12T02:40:41.439212+0000","last_deep_scrub":"28'4146","last_deep_scrub_stamp":"2024-09-12T02:40:41.439212+0000","last_clean_scrub_stamp":"2024-09-12T02:40:41.439212+0000","objects_scrubbed":0,"log_size":4146,"log_dups_size":0,"ondisk_log_size":4146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:27.706318+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21288,"num_write_kb":257331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"28'4600","reported_seq":4640,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:16.732937+0000","last_change":"2024-09-12T02:40:16.732981+0000","last_active":"2024-09-12T02:40:16.732937+0000","last_peered":"2024-09-12T02:40:16.732937+0000","last_clean":"2024-09-12T02:40:16.732937+0000","last_became_active":"2024-09-12T02:23:04.786799+0000","last_became_peered":"2024-09-12T02:23:04.786799+0000","last_unstale":"2024-09-12T02:40:16.732937+0000","last_undegraded":"2024-09-12T02:40:16.732937+0000","last_fullsized":"2024-09-12T02:40:16.732937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4600","last_scrub_stamp":"2024-09-12T02:40:16.732810+0000","last_deep_scrub":"28'4600","last_deep_scrub_stamp":"2024-09-12T02:40:16.732810+0000","last_clean_scrub_stamp":"2024-09-12T02:40:16.732810+0000","objects_scrubbed":0,"log_size":4600,"log_dups_size":0,"ondisk_log_size":4600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:49.410167+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23822,"num_write_kb":304357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"28'5170","reported_seq":5202,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:25.894255+0000","last_change":"2024-09-12T02:40:25.894297+0000","last_active":"2024-09-12T02:40:25.894255+0000","last_peered":"2024-09-12T02:40:25.894255+0000","last_clean":"2024-09-12T02:40:25.894255+0000","last_became_active":"2024-09-12T02:23:16.845749+0000","last_became_peered":"2024-09-12T02:23:16.845749+0000","last_unstale":"2024-09-12T02:40:25.894255+0000","last_undegraded":"2024-09-12T02:40:25.894255+0000","last_fullsized":"2024-09-12T02:40:25.894255+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5170","last_scrub_stamp":"2024-09-12T02:40:25.894095+0000","last_deep_scrub":"28'5170","last_deep_scrub_stamp":"2024-09-12T02:40:25.894095+0000","last_clean_scrub_stamp":"2024-09-12T02:40:25.894095+0000","objects_scrubbed":0,"log_size":5170,"log_dups_size":0,"ondisk_log_size":5170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:33.346485+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26244,"num_write_kb":301879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"28'3980","reported_seq":4020,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:34.760203+0000","last_change":"2024-09-12T02:40:34.760229+0000","last_active":"2024-09-12T02:40:34.760203+0000","last_peered":"2024-09-12T02:40:34.760203+0000","last_clean":"2024-09-12T02:40:34.760203+0000","last_became_active":"2024-09-12T02:23:04.781101+0000","last_became_peered":"2024-09-12T02:23:04.781101+0000","last_unstale":"2024-09-12T02:40:34.760203+0000","last_undegraded":"2024-09-12T02:40:34.760203+0000","last_fullsized":"2024-09-12T02:40:34.760203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3980","last_scrub_stamp":"2024-09-12T02:40:34.760111+0000","last_deep_scrub":"28'3980","last_deep_scrub_stamp":"2024-09-12T02:40:34.760111+0000","last_clean_scrub_stamp":"2024-09-12T02:40:34.760111+0000","objects_scrubbed":0,"log_size":3980,"log_dups_size":0,"ondisk_log_size":3980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:17:44.346984+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20651,"num_write_kb":267035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"28'5235","reported_seq":5267,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:25.875123+0000","last_change":"2024-09-12T02:40:25.875152+0000","last_active":"2024-09-12T02:40:25.875123+0000","last_peered":"2024-09-12T02:40:25.875123+0000","last_clean":"2024-09-12T02:40:25.875123+0000","last_became_active":"2024-09-12T02:23:16.836561+0000","last_became_peered":"2024-09-12T02:23:16.836561+0000","last_unstale":"2024-09-12T02:40:25.875123+0000","last_undegraded":"2024-09-12T02:40:25.875123+0000","last_fullsized":"2024-09-12T02:40:25.875123+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5235","last_scrub_stamp":"2024-09-12T02:40:25.875030+0000","last_deep_scrub":"28'5235","last_deep_scrub_stamp":"2024-09-12T02:40:25.875030+0000","last_clean_scrub_stamp":"2024-09-12T02:40:25.875030+0000","objects_scrubbed":0,"log_size":5235,"log_dups_size":0,"ondisk_log_size":5235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:33.745555+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26710,"num_write_kb":316033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"28'3967","reported_seq":4007,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:26.931874+0000","last_change":"2024-09-12T02:40:26.931900+0000","last_active":"2024-09-12T02:40:26.931874+0000","last_peered":"2024-09-12T02:40:26.931874+0000","last_clean":"2024-09-12T02:40:26.931874+0000","last_became_active":"2024-09-12T02:23:04.786044+0000","last_became_peered":"2024-09-12T02:23:04.786044+0000","last_unstale":"2024-09-12T02:40:26.931874+0000","last_undegraded":"2024-09-12T02:40:26.931874+0000","last_fullsized":"2024-09-12T02:40:26.931874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3967","last_scrub_stamp":"2024-09-12T02:40:26.931783+0000","last_deep_scrub":"28'3967","last_deep_scrub_stamp":"2024-09-12T02:40:26.931783+0000","last_clean_scrub_stamp":"2024-09-12T02:40:26.931783+0000","objects_scrubbed":0,"log_size":3967,"log_dups_size":0,"ondisk_log_size":3967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:25.129045+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20368,"num_write_kb":253735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"28'4409","reported_seq":4441,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:26.686029+0000","last_change":"2024-09-12T02:40:26.686054+0000","last_active":"2024-09-12T02:40:26.686029+0000","last_peered":"2024-09-12T02:40:26.686029+0000","last_clean":"2024-09-12T02:40:26.686029+0000","last_became_active":"2024-09-12T02:23:16.845757+0000","last_became_peered":"2024-09-12T02:23:16.845757+0000","last_unstale":"2024-09-12T02:40:26.686029+0000","last_undegraded":"2024-09-12T02:40:26.686029+0000","last_fullsized":"2024-09-12T02:40:26.686029+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4409","last_scrub_stamp":"2024-09-12T02:40:26.685908+0000","last_deep_scrub":"28'4409","last_deep_scrub_stamp":"2024-09-12T02:40:26.685908+0000","last_clean_scrub_stamp":"2024-09-12T02:40:26.685908+0000","objects_scrubbed":0,"log_size":4409,"log_dups_size":0,"ondisk_log_size":4409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:12.123871+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22900,"num_write_kb":275935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"28'4251","reported_seq":4291,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:26.926287+0000","last_change":"2024-09-12T02:40:26.926327+0000","last_active":"2024-09-12T02:40:26.926287+0000","last_peered":"2024-09-12T02:40:26.926287+0000","last_clean":"2024-09-12T02:40:26.926287+0000","last_became_active":"2024-09-12T02:23:04.785375+0000","last_became_peered":"2024-09-12T02:23:04.785375+0000","last_unstale":"2024-09-12T02:40:26.926287+0000","last_undegraded":"2024-09-12T02:40:26.926287+0000","last_fullsized":"2024-09-12T02:40:26.926287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4251","last_scrub_stamp":"2024-09-12T02:40:26.926186+0000","last_deep_scrub":"28'4251","last_deep_scrub_stamp":"2024-09-12T02:40:26.926186+0000","last_clean_scrub_stamp":"2024-09-12T02:40:26.926186+0000","objects_scrubbed":0,"log_size":4251,"log_dups_size":0,"ondisk_log_size":4251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:33.143747+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21731,"num_write_kb":283663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"28'4658","reported_seq":4690,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:43.760637+0000","last_change":"2024-09-12T02:40:43.760678+0000","last_active":"2024-09-12T02:40:43.760637+0000","last_peered":"2024-09-12T02:40:43.760637+0000","last_clean":"2024-09-12T02:40:43.760637+0000","last_became_active":"2024-09-12T02:23:16.857873+0000","last_became_peered":"2024-09-12T02:23:16.857873+0000","last_unstale":"2024-09-12T02:40:43.760637+0000","last_undegraded":"2024-09-12T02:40:43.760637+0000","last_fullsized":"2024-09-12T02:40:43.760637+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4658","last_scrub_stamp":"2024-09-12T02:40:43.760542+0000","last_deep_scrub":"28'4658","last_deep_scrub_stamp":"2024-09-12T02:40:43.760542+0000","last_clean_scrub_stamp":"2024-09-12T02:40:43.760542+0000","objects_scrubbed":0,"log_size":4658,"log_dups_size":0,"ondisk_log_size":4658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:45.223803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24616,"num_write_kb":279029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"28'5811","reported_seq":5851,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:19.031639+0000","last_change":"2024-09-12T02:40:19.031665+0000","last_active":"2024-09-12T02:40:19.031639+0000","last_peered":"2024-09-12T02:40:19.031639+0000","last_clean":"2024-09-12T02:40:19.031639+0000","last_became_active":"2024-09-12T02:23:04.791622+0000","last_became_peered":"2024-09-12T02:23:04.791622+0000","last_unstale":"2024-09-12T02:40:19.031639+0000","last_undegraded":"2024-09-12T02:40:19.031639+0000","last_fullsized":"2024-09-12T02:40:19.031639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5811","last_scrub_stamp":"2024-09-12T02:40:19.031534+0000","last_deep_scrub":"28'5811","last_deep_scrub_stamp":"2024-09-12T02:40:19.031534+0000","last_clean_scrub_stamp":"2024-09-12T02:40:19.031534+0000","objects_scrubbed":0,"log_size":5811,"log_dups_size":0,"ondisk_log_size":5811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:27.672797+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30224,"num_write_kb":350457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"28'5106","reported_seq":5138,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:26.557989+0000","last_change":"2024-09-12T02:40:26.558015+0000","last_active":"2024-09-12T02:40:26.557989+0000","last_peered":"2024-09-12T02:40:26.557989+0000","last_clean":"2024-09-12T02:40:26.557989+0000","last_became_active":"2024-09-12T02:23:16.849641+0000","last_became_peered":"2024-09-12T02:23:16.849641+0000","last_unstale":"2024-09-12T02:40:26.557989+0000","last_undegraded":"2024-09-12T02:40:26.557989+0000","last_fullsized":"2024-09-12T02:40:26.557989+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5106","last_scrub_stamp":"2024-09-12T02:40:26.557879+0000","last_deep_scrub":"28'5106","last_deep_scrub_stamp":"2024-09-12T02:40:26.557879+0000","last_clean_scrub_stamp":"2024-09-12T02:40:26.557879+0000","objects_scrubbed":0,"log_size":5106,"log_dups_size":0,"ondisk_log_size":5106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:29.071298+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25610,"num_write_kb":311590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"28'5712","reported_seq":5757,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:44.718988+0000","last_change":"2024-09-12T02:40:44.719036+0000","last_active":"2024-09-12T02:40:44.718988+0000","last_peered":"2024-09-12T02:40:44.718988+0000","last_clean":"2024-09-12T02:40:44.718988+0000","last_became_active":"2024-09-12T02:23:56.084173+0000","last_became_peered":"2024-09-12T02:23:56.084173+0000","last_unstale":"2024-09-12T02:40:44.718988+0000","last_undegraded":"2024-09-12T02:40:44.718988+0000","last_fullsized":"2024-09-12T02:40:44.718988+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5712","last_scrub_stamp":"2024-09-12T02:40:44.718845+0000","last_deep_scrub":"28'5712","last_deep_scrub_stamp":"2024-09-12T02:40:44.718845+0000","last_clean_scrub_stamp":"2024-09-12T02:40:44.718845+0000","objects_scrubbed":0,"log_size":5712,"log_dups_size":0,"ondisk_log_size":5712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:37.836332+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30266,"num_write_kb":367055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"28'6924","reported_seq":6957,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:37.764532+0000","last_change":"2024-09-12T02:40:37.764574+0000","last_active":"2024-09-12T02:40:37.764532+0000","last_peered":"2024-09-12T02:40:37.764532+0000","last_clean":"2024-09-12T02:40:37.764532+0000","last_became_active":"2024-09-12T02:23:16.839914+0000","last_became_peered":"2024-09-12T02:23:16.839914+0000","last_unstale":"2024-09-12T02:40:37.764532+0000","last_undegraded":"2024-09-12T02:40:37.764532+0000","last_fullsized":"2024-09-12T02:40:37.764532+0000","mapping_epoch":24,"log_start":"28'1700","ondisk_log_start":"28'1700","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6924","last_scrub_stamp":"2024-09-12T02:40:37.764410+0000","last_deep_scrub":"28'6924","last_deep_scrub_stamp":"2024-09-12T02:40:37.764410+0000","last_clean_scrub_stamp":"2024-09-12T02:40:37.764410+0000","objects_scrubbed":0,"log_size":5224,"log_dups_size":0,"ondisk_log_size":5224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:26.936146+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36307,"num_write_kb":403764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"28'4960","reported_seq":5000,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:32.730404+0000","last_change":"2024-09-12T02:40:32.730404+0000","last_active":"2024-09-12T02:40:32.730404+0000","last_peered":"2024-09-12T02:40:32.730404+0000","last_clean":"2024-09-12T02:40:32.730404+0000","last_became_active":"2024-09-12T02:23:04.779384+0000","last_became_peered":"2024-09-12T02:23:04.779384+0000","last_unstale":"2024-09-12T02:40:32.730404+0000","last_undegraded":"2024-09-12T02:40:32.730404+0000","last_fullsized":"2024-09-12T02:40:32.730404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4960","last_scrub_stamp":"2024-09-12T02:40:32.730273+0000","last_deep_scrub":"28'4960","last_deep_scrub_stamp":"2024-09-12T02:40:32.730273+0000","last_clean_scrub_stamp":"2024-09-12T02:40:32.730273+0000","objects_scrubbed":0,"log_size":4960,"log_dups_size":0,"ondisk_log_size":4960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:48.757948+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24704,"num_write_kb":320180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"28'4652","reported_seq":4685,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:33.922280+0000","last_change":"2024-09-12T02:40:33.922306+0000","last_active":"2024-09-12T02:40:33.922280+0000","last_peered":"2024-09-12T02:40:33.922280+0000","last_clean":"2024-09-12T02:40:33.922280+0000","last_became_active":"2024-09-12T02:23:16.849744+0000","last_became_peered":"2024-09-12T02:23:16.849744+0000","last_unstale":"2024-09-12T02:40:33.922280+0000","last_undegraded":"2024-09-12T02:40:33.922280+0000","last_fullsized":"2024-09-12T02:40:33.922280+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4652","last_scrub_stamp":"2024-09-12T02:40:33.922201+0000","last_deep_scrub":"28'4652","last_deep_scrub_stamp":"2024-09-12T02:40:33.922201+0000","last_clean_scrub_stamp":"2024-09-12T02:40:33.922201+0000","objects_scrubbed":0,"log_size":4652,"log_dups_size":0,"ondisk_log_size":4652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:38.630829+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24125,"num_write_kb":272841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"28'4717","reported_seq":4742,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:30.780101+0000","last_change":"2024-09-12T02:40:30.780127+0000","last_active":"2024-09-12T02:40:30.780101+0000","last_peered":"2024-09-12T02:40:30.780101+0000","last_clean":"2024-09-12T02:40:30.780101+0000","last_became_active":"2024-09-12T02:23:55.991300+0000","last_became_peered":"2024-09-12T02:23:55.991300+0000","last_unstale":"2024-09-12T02:40:30.780101+0000","last_undegraded":"2024-09-12T02:40:30.780101+0000","last_fullsized":"2024-09-12T02:40:30.780101+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4717","last_scrub_stamp":"2024-09-12T02:40:30.779997+0000","last_deep_scrub":"28'4717","last_deep_scrub_stamp":"2024-09-12T02:40:30.779997+0000","last_clean_scrub_stamp":"2024-09-12T02:40:30.779997+0000","objects_scrubbed":0,"log_size":4717,"log_dups_size":0,"ondisk_log_size":4717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:10.783997+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24759,"num_write_kb":295935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3c","version":"28'4790","reported_seq":4823,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:38.724104+0000","last_change":"2024-09-12T02:40:38.724131+0000","last_active":"2024-09-12T02:40:38.724104+0000","last_peered":"2024-09-12T02:40:38.724104+0000","last_clean":"2024-09-12T02:40:38.724104+0000","last_became_active":"2024-09-12T02:23:16.861441+0000","last_became_peered":"2024-09-12T02:23:16.861441+0000","last_unstale":"2024-09-12T02:40:38.724104+0000","last_undegraded":"2024-09-12T02:40:38.724104+0000","last_fullsized":"2024-09-12T02:40:38.724104+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4790","last_scrub_stamp":"2024-09-12T02:40:38.724007+0000","last_deep_scrub":"28'4790","last_deep_scrub_stamp":"2024-09-12T02:40:38.724007+0000","last_clean_scrub_stamp":"2024-09-12T02:40:38.724007+0000","objects_scrubbed":0,"log_size":4790,"log_dups_size":0,"ondisk_log_size":4790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:05.514242+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25639,"num_write_kb":287197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"28'4345","reported_seq":4385,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:21.454820+0000","last_change":"2024-09-12T02:40:21.454820+0000","last_active":"2024-09-12T02:40:21.454820+0000","last_peered":"2024-09-12T02:40:21.454820+0000","last_clean":"2024-09-12T02:40:21.454820+0000","last_became_active":"2024-09-12T02:23:04.788617+0000","last_became_peered":"2024-09-12T02:23:04.788617+0000","last_unstale":"2024-09-12T02:40:21.454820+0000","last_undegraded":"2024-09-12T02:40:21.454820+0000","last_fullsized":"2024-09-12T02:40:21.454820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4345","last_scrub_stamp":"2024-09-12T02:40:21.454696+0000","last_deep_scrub":"28'4345","last_deep_scrub_stamp":"2024-09-12T02:40:21.454696+0000","last_clean_scrub_stamp":"2024-09-12T02:40:21.454696+0000","objects_scrubbed":0,"log_size":4345,"log_dups_size":0,"ondisk_log_size":4345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:04.580526+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22438,"num_write_kb":266069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"28'5149","reported_seq":5182,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:39.461916+0000","last_change":"2024-09-12T02:40:39.461944+0000","last_active":"2024-09-12T02:40:39.461916+0000","last_peered":"2024-09-12T02:40:39.461916+0000","last_clean":"2024-09-12T02:40:39.461916+0000","last_became_active":"2024-09-12T02:23:16.855437+0000","last_became_peered":"2024-09-12T02:23:16.855437+0000","last_unstale":"2024-09-12T02:40:39.461916+0000","last_undegraded":"2024-09-12T02:40:39.461916+0000","last_fullsized":"2024-09-12T02:40:39.461916+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5149","last_scrub_stamp":"2024-09-12T02:40:39.461795+0000","last_deep_scrub":"28'5149","last_deep_scrub_stamp":"2024-09-12T02:40:39.461795+0000","last_clean_scrub_stamp":"2024-09-12T02:40:39.461795+0000","objects_scrubbed":0,"log_size":5149,"log_dups_size":0,"ondisk_log_size":5149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:51.946983+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26098,"num_write_kb":313495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'5428","reported_seq":5468,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:36.851034+0000","last_change":"2024-09-12T02:40:36.851058+0000","last_active":"2024-09-12T02:40:36.851034+0000","last_peered":"2024-09-12T02:40:36.851034+0000","last_clean":"2024-09-12T02:40:36.851034+0000","last_became_active":"2024-09-12T02:23:04.776857+0000","last_became_peered":"2024-09-12T02:23:04.776857+0000","last_unstale":"2024-09-12T02:40:36.851034+0000","last_undegraded":"2024-09-12T02:40:36.851034+0000","last_fullsized":"2024-09-12T02:40:36.851034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5428","last_scrub_stamp":"2024-09-12T02:40:36.850961+0000","last_deep_scrub":"28'5428","last_deep_scrub_stamp":"2024-09-12T02:40:36.850961+0000","last_clean_scrub_stamp":"2024-09-12T02:40:36.850961+0000","objects_scrubbed":0,"log_size":5428,"log_dups_size":0,"ondisk_log_size":5428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:28:19.174374+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27088,"num_write_kb":350175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"28'4355","reported_seq":4387,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:44.794963+0000","last_change":"2024-09-12T02:40:44.794963+0000","last_active":"2024-09-12T02:40:44.794963+0000","last_peered":"2024-09-12T02:40:44.794963+0000","last_clean":"2024-09-12T02:40:44.794963+0000","last_became_active":"2024-09-12T02:23:16.848936+0000","last_became_peered":"2024-09-12T02:23:16.848936+0000","last_unstale":"2024-09-12T02:40:44.794963+0000","last_undegraded":"2024-09-12T02:40:44.794963+0000","last_fullsized":"2024-09-12T02:40:44.794963+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4355","last_scrub_stamp":"2024-09-12T02:40:44.794795+0000","last_deep_scrub":"28'4355","last_deep_scrub_stamp":"2024-09-12T02:40:44.794795+0000","last_clean_scrub_stamp":"2024-09-12T02:40:44.794795+0000","objects_scrubbed":0,"log_size":4355,"log_dups_size":0,"ondisk_log_size":4355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:32.190893+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22650,"num_write_kb":266857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"28'3929","reported_seq":3970,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:25.511940+0000","last_change":"2024-09-12T02:40:25.511984+0000","last_active":"2024-09-12T02:40:25.511940+0000","last_peered":"2024-09-12T02:40:25.511940+0000","last_clean":"2024-09-12T02:40:25.511940+0000","last_became_active":"2024-09-12T02:23:04.786509+0000","last_became_peered":"2024-09-12T02:23:04.786509+0000","last_unstale":"2024-09-12T02:40:25.511940+0000","last_undegraded":"2024-09-12T02:40:25.511940+0000","last_fullsized":"2024-09-12T02:40:25.511940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3929","last_scrub_stamp":"2024-09-12T02:40:25.511813+0000","last_deep_scrub":"28'3929","last_deep_scrub_stamp":"2024-09-12T02:40:25.511813+0000","last_clean_scrub_stamp":"2024-09-12T02:40:25.511813+0000","objects_scrubbed":0,"log_size":3929,"log_dups_size":0,"ondisk_log_size":3929,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:47.544909+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20681,"num_write_kb":267297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"28'6034","reported_seq":6066,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:24.713168+0000","last_change":"2024-09-12T02:40:24.713168+0000","last_active":"2024-09-12T02:40:24.713168+0000","last_peered":"2024-09-12T02:40:24.713168+0000","last_clean":"2024-09-12T02:40:24.713168+0000","last_became_active":"2024-09-12T02:23:16.834483+0000","last_became_peered":"2024-09-12T02:23:16.834483+0000","last_unstale":"2024-09-12T02:40:24.713168+0000","last_undegraded":"2024-09-12T02:40:24.713168+0000","last_fullsized":"2024-09-12T02:40:24.713168+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6034","last_scrub_stamp":"2024-09-12T02:40:24.712978+0000","last_deep_scrub":"28'6034","last_deep_scrub_stamp":"2024-09-12T02:40:24.712978+0000","last_clean_scrub_stamp":"2024-09-12T02:40:24.712978+0000","objects_scrubbed":0,"log_size":6034,"log_dups_size":0,"ondisk_log_size":6034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:17.810382+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30335,"num_write_kb":363259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"28'4664","reported_seq":4705,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:22.716044+0000","last_change":"2024-09-12T02:40:22.716113+0000","last_active":"2024-09-12T02:40:22.716044+0000","last_peered":"2024-09-12T02:40:22.716044+0000","last_clean":"2024-09-12T02:40:22.716044+0000","last_became_active":"2024-09-12T02:23:04.778445+0000","last_became_peered":"2024-09-12T02:23:04.778445+0000","last_unstale":"2024-09-12T02:40:22.716044+0000","last_undegraded":"2024-09-12T02:40:22.716044+0000","last_fullsized":"2024-09-12T02:40:22.716044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4664","last_scrub_stamp":"2024-09-12T02:40:22.715910+0000","last_deep_scrub":"28'4664","last_deep_scrub_stamp":"2024-09-12T02:40:22.715910+0000","last_clean_scrub_stamp":"2024-09-12T02:40:22.715910+0000","objects_scrubbed":0,"log_size":4664,"log_dups_size":0,"ondisk_log_size":4664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:35.528944+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23827,"num_write_kb":304439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"28'5564","reported_seq":5596,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:23.905331+0000","last_change":"2024-09-12T02:40:23.905331+0000","last_active":"2024-09-12T02:40:23.905331+0000","last_peered":"2024-09-12T02:40:23.905331+0000","last_clean":"2024-09-12T02:40:23.905331+0000","last_became_active":"2024-09-12T02:23:16.843880+0000","last_became_peered":"2024-09-12T02:23:16.843880+0000","last_unstale":"2024-09-12T02:40:23.905331+0000","last_undegraded":"2024-09-12T02:40:23.905331+0000","last_fullsized":"2024-09-12T02:40:23.905331+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5564","last_scrub_stamp":"2024-09-12T02:40:23.905206+0000","last_deep_scrub":"28'5564","last_deep_scrub_stamp":"2024-09-12T02:40:23.905206+0000","last_clean_scrub_stamp":"2024-09-12T02:40:23.905206+0000","objects_scrubbed":0,"log_size":5564,"log_dups_size":0,"ondisk_log_size":5564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:21.279437+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28051,"num_write_kb":333672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"28'5549","reported_seq":5590,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:16.880288+0000","last_change":"2024-09-12T02:40:16.880311+0000","last_active":"2024-09-12T02:40:16.880288+0000","last_peered":"2024-09-12T02:40:16.880288+0000","last_clean":"2024-09-12T02:40:16.880288+0000","last_became_active":"2024-09-12T02:23:04.785516+0000","last_became_peered":"2024-09-12T02:23:04.785516+0000","last_unstale":"2024-09-12T02:40:16.880288+0000","last_undegraded":"2024-09-12T02:40:16.880288+0000","last_fullsized":"2024-09-12T02:40:16.880288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5549","last_scrub_stamp":"2024-09-12T02:40:16.880195+0000","last_deep_scrub":"28'5549","last_deep_scrub_stamp":"2024-09-12T02:40:16.880195+0000","last_clean_scrub_stamp":"2024-09-12T02:40:16.880195+0000","objects_scrubbed":0,"log_size":5549,"log_dups_size":0,"ondisk_log_size":5549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:06.569173+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28712,"num_write_kb":373148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"28'5101","reported_seq":5133,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:21.928328+0000","last_change":"2024-09-12T02:40:21.928328+0000","last_active":"2024-09-12T02:40:21.928328+0000","last_peered":"2024-09-12T02:40:21.928328+0000","last_clean":"2024-09-12T02:40:21.928328+0000","last_became_active":"2024-09-12T02:23:16.843815+0000","last_became_peered":"2024-09-12T02:23:16.843815+0000","last_unstale":"2024-09-12T02:40:21.928328+0000","last_undegraded":"2024-09-12T02:40:21.928328+0000","last_fullsized":"2024-09-12T02:40:21.928328+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5101","last_scrub_stamp":"2024-09-12T02:40:21.928173+0000","last_deep_scrub":"28'5101","last_deep_scrub_stamp":"2024-09-12T02:40:21.928173+0000","last_clean_scrub_stamp":"2024-09-12T02:40:21.928173+0000","objects_scrubbed":0,"log_size":5101,"log_dups_size":0,"ondisk_log_size":5101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:43.613527+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26856,"num_write_kb":304403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"28'3999","reported_seq":4040,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-12T02:40:19.849177+0000","last_change":"2024-09-12T02:40:19.849204+0000","last_active":"2024-09-12T02:40:19.849177+0000","last_peered":"2024-09-12T02:40:19.849177+0000","last_clean":"2024-09-12T02:40:19.849177+0000","last_became_active":"2024-09-12T02:23:04.790906+0000","last_became_peered":"2024-09-12T02:23:04.790906+0000","last_unstale":"2024-09-12T02:40:19.849177+0000","last_undegraded":"2024-09-12T02:40:19.849177+0000","last_fullsized":"2024-09-12T02:40:19.849177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3999","last_scrub_stamp":"2024-09-12T02:40:19.849084+0000","last_deep_scrub":"28'3999","last_deep_scrub_stamp":"2024-09-12T02:40:19.849084+0000","last_clean_scrub_stamp":"2024-09-12T02:40:19.849084+0000","objects_scrubbed":0,"log_size":3999,"log_dups_size":0,"ondisk_log_size":3999,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:52.252676+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20671,"num_write_kb":258921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1731204,"num_write_kb":20050774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":327719,"ondisk_log_size":327719,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":18273247,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":57,"num_read_kb":123,"num_write":4416,"num_write_kb":19551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36610048,"data_stored":36546494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3659,"ondisk_log_size":3659,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1541207,"num_write_kb":19284974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":299497,"ondisk_log_size":299497,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":18199792,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":62,"num_read_kb":127,"num_write":4449,"num_write_kb":19478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36462592,"data_stored":36399584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3703,"ondisk_log_size":3703,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476956,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1212344,"kb_used_data":13160,"kb_used_omap":1,"kb_used_meta":1199166,"kb_avail":93159496,"statfs":{"total":96636764160,"available":95395323904,"internally_reserved":0,"allocated":13475840,"data_stored":13292277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":1227946442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476958,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":757460,"kb_used_data":9796,"kb_used_omap":1,"kb_used_meta":747646,"kb_avail":93614380,"statfs":{"total":96636764160,"available":95861125120,"internally_reserved":0,"allocated":10031104,"data_stored":9841247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":765589958},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476957,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1147152,"kb_used_data":4480,"kb_used_omap":1,"kb_used_meta":1142654,"kb_avail":93224688,"statfs":{"total":96636764160,"available":95462080512,"internally_reserved":0,"allocated":4587520,"data_stored":4401471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1170078149},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509659,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1232784,"kb_used_data":11264,"kb_used_omap":1,"kb_used_meta":1221502,"kb_avail":93139056,"statfs":{"total":96636764160,"available":95374393344,"internally_reserved":0,"allocated":11534336,"data_stored":11334750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1250818501},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509658,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":757512,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":757118,"kb_avail":93614328,"statfs":{"total":96636764160,"available":95861071872,"internally_reserved":0,"allocated":385024,"data_stored":206475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":775289285},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509661,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1009724,"kb_used_data":9068,"kb_used_omap":1,"kb_used_meta":1000638,"kb_avail":93362116,"statfs":{"total":96636764160,"available":95602806784,"internally_reserved":0,"allocated":9285632,"data_stored":9097939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1024653765},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542364,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1235704,"kb_used_data":18152,"kb_used_omap":1,"kb_used_meta":1217534,"kb_avail":93136136,"statfs":{"total":96636764160,"available":95371403264,"internally_reserved":0,"allocated":18587648,"data_stored":18391468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":1246755271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542363,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1000768,"kb_used_data":8496,"kb_used_omap":1,"kb_used_meta":992254,"kb_avail":93371072,"statfs":{"total":96636764160,"available":95611977728,"internally_reserved":0,"allocated":8699904,"data_stored":8507787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1016068549},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4206592,"data_stored":4194942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":88080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8486912,"data_stored":8477360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5541888,"data_stored":5527456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5537792,"data_stored":5528002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12583494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9809920,"data_stored":9795783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5701632,"data_stored":5688969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4292608,"data_stored":4283056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:40:58.143 DEBUG:teuthology.orchestra.run.smithi060:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T02:40:58.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.274+0000 7fc0007a6640 1 Processor -- start 2024-09-12T02:40:58.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.274+0000 7fc0007a6640 1 -- start start 2024-09-12T02:40:58.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.275+0000 7fc0007a6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbff8153a40 0x7fbff806c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:58.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.275+0000 7fc0007a6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbff806cbe0 0x7fbff80c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:58.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.275+0000 7fc0007a6640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbff80c80f0 0x7fbff8156310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:58.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.275+0000 7fc0007a6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fbff8159900 con 0x7fbff8153a40 2024-09-12T02:40:58.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.275+0000 7fc0007a6640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fbff8159be0 con 0x7fbff80c80f0 2024-09-12T02:40:58.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.275+0000 7fc0007a6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbff8159ec0 con 0x7fbff806cbe0 2024-09-12T02:40:58.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.276+0000 7fbffe542640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbff8153a40 0x7fbff806c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:58.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.276+0000 7fbffe542640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbff8153a40 0x7fbff806c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50986/0 (socket says 172.21.15.60:50986) 2024-09-12T02:40:58.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.276+0000 7fbffe542640 1 -- 172.21.15.60:0/1254832994 learned_addr learned my addr 172.21.15.60:0/1254832994 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:58.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.276+0000 7fbffed43640 1 --2- 172.21.15.60:0/1254832994 >> v2:172.21.15.105:3300/0 conn(0x7fbff80c80f0 0x7fbff8156310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:58.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.276+0000 7fbffdd41640 1 --2- 172.21.15.60:0/1254832994 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbff806cbe0 0x7fbff80c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:58.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.276+0000 7fbffe542640 1 -- 172.21.15.60:0/1254832994 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbff806cbe0 msgr2=0x7fbff80c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:58.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.276+0000 7fbffe542640 1 --2- 172.21.15.60:0/1254832994 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbff806cbe0 0x7fbff80c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.276+0000 7fbffe542640 1 -- 172.21.15.60:0/1254832994 >> v2:172.21.15.105:3300/0 conn(0x7fbff80c80f0 msgr2=0x7fbff8156310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:58.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.276+0000 7fbffe542640 1 --2- 172.21.15.60:0/1254832994 >> v2:172.21.15.105:3300/0 conn(0x7fbff80c80f0 0x7fbff8156310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.276+0000 7fbffe542640 1 -- 172.21.15.60:0/1254832994 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbff815a1a0 con 0x7fbff8153a40 2024-09-12T02:40:58.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.276+0000 7fbffed43640 1 --2- 172.21.15.60:0/1254832994 >> v2:172.21.15.105:3300/0 conn(0x7fbff80c80f0 0x7fbff8156310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:40:58.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.277+0000 7fbffe542640 1 --2- 172.21.15.60:0/1254832994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbff8153a40 0x7fbff806c6a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbff80c7910 tx=0x7fbfe802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68ec0bbe9e3f946f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:58.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.277+0000 7fbffd540640 1 -- 172.21.15.60:0/1254832994 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe8036070 con 0x7fbff8153a40 2024-09-12T02:40:58.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.277+0000 7fbffd540640 1 -- 172.21.15.60:0/1254832994 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfe8031600 con 0x7fbff8153a40 2024-09-12T02:40:58.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.277+0000 7fbffd540640 1 -- 172.21.15.60:0/1254832994 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe80319d0 con 0x7fbff8153a40 2024-09-12T02:40:58.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.277+0000 7fc0007a6640 1 -- 172.21.15.60:0/1254832994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbff8153a40 msgr2=0x7fbff806c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:58.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.277+0000 7fc0007a6640 1 --2- 172.21.15.60:0/1254832994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbff8153a40 0x7fbff806c6a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbff80c7910 tx=0x7fbfe802a6a0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.277+0000 7fc0007a6640 1 -- 172.21.15.60:0/1254832994 shutdown_connections 2024-09-12T02:40:58.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.277+0000 7fc0007a6640 1 --2- 172.21.15.60:0/1254832994 >> v2:172.21.15.105:3300/0 conn(0x7fbff80c80f0 0x7fbff8156310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.277+0000 7fc0007a6640 1 --2- 172.21.15.60:0/1254832994 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbff806cbe0 0x7fbff80c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.277+0000 7fc0007a6640 1 --2- 172.21.15.60:0/1254832994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbff8153a40 0x7fbff806c6a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.277+0000 7fc0007a6640 1 -- 172.21.15.60:0/1254832994 >> 172.21.15.60:0/1254832994 conn(0x7fbff8073310 msgr2=0x7fbff80736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:58.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.278+0000 7fc0007a6640 1 -- 172.21.15.60:0/1254832994 shutdown_connections 2024-09-12T02:40:58.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.278+0000 7fc0007a6640 1 -- 172.21.15.60:0/1254832994 wait complete. 2024-09-12T02:40:58.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.279+0000 7fc0007a6640 1 Processor -- start 2024-09-12T02:40:58.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.279+0000 7fc0007a6640 1 -- start start 2024-09-12T02:40:58.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.279+0000 7fc0007a6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbff806cbe0 0x7fbff81dfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:58.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.279+0000 7fc0007a6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbff80c80f0 0x7fbff8156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:58.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.279+0000 7fc0007a6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbff8153a40 0x7fbff814d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:58.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.279+0000 7fc0007a6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbff8153e20 con 0x7fbff806cbe0 2024-09-12T02:40:58.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.279+0000 7fc0007a6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbff80c9270 con 0x7fbff8153a40 2024-09-12T02:40:58.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.279+0000 7fc0007a6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbff8153fa0 con 0x7fbff80c80f0 2024-09-12T02:40:58.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.280+0000 7fbffe542640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbff806cbe0 0x7fbff81dfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:58.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.280+0000 7fbffe542640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbff806cbe0 0x7fbff81dfa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50998/0 (socket says 172.21.15.60:50998) 2024-09-12T02:40:58.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.280+0000 7fbffe542640 1 -- 172.21.15.60:0/4148681352 learned_addr learned my addr 172.21.15.60:0/4148681352 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:58.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.280+0000 7fbffed43640 1 --2- 172.21.15.60:0/4148681352 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbff8153a40 0x7fbff814d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:58.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.280+0000 7fbffdd41640 1 --2- 172.21.15.60:0/4148681352 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbff80c80f0 0x7fbff8156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:58.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.280+0000 7fbffe542640 1 -- 172.21.15.60:0/4148681352 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbff80c80f0 msgr2=0x7fbff8156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:58.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.280+0000 7fbffe542640 1 --2- 172.21.15.60:0/4148681352 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbff80c80f0 0x7fbff8156220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.280+0000 7fbffe542640 1 -- 172.21.15.60:0/4148681352 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbff8153a40 msgr2=0x7fbff814d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:58.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.280+0000 7fbffe542640 1 --2- 172.21.15.60:0/4148681352 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbff8153a40 0x7fbff814d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.280+0000 7fbffe542640 1 -- 172.21.15.60:0/4148681352 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbff80b0ce0 con 0x7fbff806cbe0 2024-09-12T02:40:58.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.280+0000 7fbffe542640 1 --2- 172.21.15.60:0/4148681352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbff806cbe0 0x7fbff81dfa00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8000f80 tx=0x7fbfe8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:58.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.280+0000 7fbff6ffd640 1 -- 172.21.15.60:0/4148681352 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe8041020 con 0x7fbff806cbe0 2024-09-12T02:40:58.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.280+0000 7fbff6ffd640 1 -- 172.21.15.60:0/4148681352 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfe8007820 con 0x7fbff806cbe0 2024-09-12T02:40:58.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.280+0000 7fbff6ffd640 1 -- 172.21.15.60:0/4148681352 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe8036040 con 0x7fbff806cbe0 2024-09-12T02:40:58.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.280+0000 7fc0007a6640 1 -- 172.21.15.60:0/4148681352 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbff8155300 con 0x7fbff806cbe0 2024-09-12T02:40:58.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.280+0000 7fc0007a6640 1 -- 172.21.15.60:0/4148681352 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbff81558c0 con 0x7fbff806cbe0 2024-09-12T02:40:58.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.281+0000 7fc0007a6640 1 -- 172.21.15.60:0/4148681352 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbff80c7bb0 con 0x7fbff806cbe0 2024-09-12T02:40:58.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.282+0000 7fbff6ffd640 1 -- 172.21.15.60:0/4148681352 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbfe8044020 con 0x7fbff806cbe0 2024-09-12T02:40:58.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.282+0000 7fbff6ffd640 1 --2- 172.21.15.60:0/4148681352 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbfe406be60 0x7fbfe406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:58.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.282+0000 7fbff6ffd640 1 -- 172.21.15.60:0/4148681352 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fbfe80ac000 con 0x7fbff806cbe0 2024-09-12T02:40:58.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.282+0000 7fbffdd41640 1 --2- 172.21.15.60:0/4148681352 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbfe406be60 0x7fbfe406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:58.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.283+0000 7fbffdd41640 1 --2- 172.21.15.60:0/4148681352 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbfe406be60 0x7fbfe406e320 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fbfec006fd0 tx=0x7fbfec008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:58.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.286+0000 7fbff6ffd640 1 -- 172.21.15.60:0/4148681352 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbfe804b030 con 0x7fbff806cbe0 2024-09-12T02:40:58.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.463+0000 7fc0007a6640 1 -- 172.21.15.60:0/4148681352 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fbff80c6ee0 con 0x7fbff806cbe0 2024-09-12T02:40:58.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.466+0000 7fbff6ffd640 1 -- 172.21.15.60:0/4148681352 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7fbfe807a610 con 0x7fbff806cbe0 2024-09-12T02:40:58.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.467+0000 7fbff6ffd640 1 -- 172.21.15.60:0/4148681352 <== mon.0 v2:172.21.15.60:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fbfe8031600 con 0x7fbff806cbe0 2024-09-12T02:40:58.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.468+0000 7fc0007a6640 1 -- 172.21.15.60:0/4148681352 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbfe406be60 msgr2=0x7fbfe406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:58.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.468+0000 7fc0007a6640 1 --2- 172.21.15.60:0/4148681352 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbfe406be60 0x7fbfe406e320 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fbfec006fd0 tx=0x7fbfec008040 comp rx=0 tx=0).stop 2024-09-12T02:40:58.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.469+0000 7fc0007a6640 1 -- 172.21.15.60:0/4148681352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbff806cbe0 msgr2=0x7fbff81dfa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:58.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.469+0000 7fc0007a6640 1 --2- 172.21.15.60:0/4148681352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbff806cbe0 0x7fbff81dfa00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8000f80 tx=0x7fbfe8004a40 comp rx=0 tx=0).stop 2024-09-12T02:40:58.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.469+0000 7fc0007a6640 1 -- 172.21.15.60:0/4148681352 shutdown_connections 2024-09-12T02:40:58.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.469+0000 7fc0007a6640 1 --2- 172.21.15.60:0/4148681352 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fbfe406be60 0x7fbfe406e320 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.469+0000 7fc0007a6640 1 --2- 172.21.15.60:0/4148681352 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbff8153a40 0x7fbff814d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.469+0000 7fc0007a6640 1 --2- 172.21.15.60:0/4148681352 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbff80c80f0 0x7fbff8156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.469+0000 7fc0007a6640 1 --2- 172.21.15.60:0/4148681352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbff806cbe0 0x7fbff81dfa00 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.469+0000 7fc0007a6640 1 -- 172.21.15.60:0/4148681352 >> 172.21.15.60:0/4148681352 conn(0x7fbff8073310 msgr2=0x7fbff80c9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:58.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.469+0000 7fc0007a6640 1 -- 172.21.15.60:0/4148681352 shutdown_connections 2024-09-12T02:40:58.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.469+0000 7fc0007a6640 1 -- 172.21.15.60:0/4148681352 wait complete. 2024-09-12T02:40:58.481 INFO:tasks.cephfs.filesystem:Destroying file system a and related pools 2024-09-12T02:40:58.481 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:40:58.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.583+0000 7f5b64766640 1 Processor -- start 2024-09-12T02:40:58.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.583+0000 7f5b64766640 1 -- start start 2024-09-12T02:40:58.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.584+0000 7f5b64766640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5b5c153af0 0x7f5b5c1563a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:58.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.584+0000 7f5b64766640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f5b5c0afdd0 0x7f5b5c0c5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:58.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.584+0000 7f5b64766640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b5c0c54e0 con 0x7f5b5c0af870 2024-09-12T02:40:58.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.584+0000 7f5b64766640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f5b5c0c74a0 con 0x7f5b5c153af0 2024-09-12T02:40:58.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.584+0000 7f5b64766640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f5b5c0c7740 con 0x7f5b5c0afdd0 2024-09-12T02:40:58.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.584+0000 7f5b62502640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5b5c153af0 0x7f5b5c1563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:58.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.584+0000 7f5b62502640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5b5c153af0 0x7f5b5c1563a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51008/0 (socket says 172.21.15.60:51008) 2024-09-12T02:40:58.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.584+0000 7f5b62d03640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f5b5c0af870 0x7f5b5c0c4780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55956/0 (socket says 172.21.15.60:55956) 2024-09-12T02:40:58.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.584+0000 7f5b62502640 1 -- 172.21.15.60:0/4009781012 learned_addr learned my addr 172.21.15.60:0/4009781012 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:58.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.584+0000 7f5b61d01640 1 --2- 172.21.15.60:0/4009781012 >> v2:172.21.15.105:3300/0 conn(0x7f5b5c0afdd0 0x7f5b5c0c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:58.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.585+0000 7f5b62502640 1 -- 172.21.15.60:0/4009781012 >> v2:172.21.15.105:3300/0 conn(0x7f5b5c0afdd0 msgr2=0x7f5b5c0c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:58.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.585+0000 7f5b62502640 1 --2- 172.21.15.60:0/4009781012 >> v2:172.21.15.105:3300/0 conn(0x7f5b5c0afdd0 0x7f5b5c0c5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.585+0000 7f5b62502640 1 -- 172.21.15.60:0/4009781012 >> v1:172.21.15.60:6789/0 conn(0x7f5b5c0af870 legacy=0x7f5b5c0c4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:58.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.585+0000 7f5b62502640 1 -- 172.21.15.60:0/4009781012 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b5c15a3c0 con 0x7f5b5c153af0 2024-09-12T02:40:58.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.585+0000 7f5b61500640 1 -- 172.21.15.60:0/4009781012 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3612691545 0 0) 0x7f5b5c0c54e0 con 0x7f5b5c0af870 2024-09-12T02:40:58.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.585+0000 7f5b62502640 1 --2- 172.21.15.60:0/4009781012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b5c153af0 0x7f5b5c1563a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c0c9d30 tx=0x7f5b5402a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39e84f1a9da47ac server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:58.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.585+0000 7f5b61500640 1 -- 172.21.15.60:0/4009781012 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b54037070 con 0x7f5b5c153af0 2024-09-12T02:40:58.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.585+0000 7f5b61500640 1 -- 172.21.15.60:0/4009781012 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5b54032440 con 0x7f5b5c153af0 2024-09-12T02:40:58.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.585+0000 7f5b61500640 1 -- 172.21.15.60:0/4009781012 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b54032830 con 0x7f5b5c153af0 2024-09-12T02:40:58.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.586+0000 7f5b64766640 1 -- 172.21.15.60:0/4009781012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b5c153af0 msgr2=0x7f5b5c1563a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:58.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.586+0000 7f5b64766640 1 --2- 172.21.15.60:0/4009781012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b5c153af0 0x7f5b5c1563a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c0c9d30 tx=0x7f5b5402a150 comp rx=0 tx=0).stop 2024-09-12T02:40:58.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.586+0000 7f5b64766640 1 -- 172.21.15.60:0/4009781012 shutdown_connections 2024-09-12T02:40:58.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.586+0000 7f5b64766640 1 --2- 172.21.15.60:0/4009781012 >> v2:172.21.15.105:3300/0 conn(0x7f5b5c0afdd0 0x7f5b5c0c5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.586+0000 7f5b64766640 1 --2- 172.21.15.60:0/4009781012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b5c153af0 0x7f5b5c1563a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.586+0000 7f5b64766640 1 -- 172.21.15.60:0/4009781012 >> 172.21.15.60:0/4009781012 conn(0x7f5b5c0c6880 msgr2=0x7f5b5c0c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:58.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.586+0000 7f5b64766640 1 -- 172.21.15.60:0/4009781012 shutdown_connections 2024-09-12T02:40:58.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.586+0000 7f5b64766640 1 -- 172.21.15.60:0/4009781012 wait complete. 2024-09-12T02:40:58.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.587+0000 7f5b64766640 1 Processor -- start 2024-09-12T02:40:58.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.587+0000 7f5b64766640 1 -- start start 2024-09-12T02:40:58.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.588+0000 7f5b64766640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5b5c0af870 0x7f5b5c0bf800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:58.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.588+0000 7f5b64766640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b5c0afdd0 0x7f5b5c1455c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:58.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.588+0000 7f5b64766640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b5c153af0 0x7f5b5c06f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:58.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.588+0000 7f5b64766640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5b5c153ed0 con 0x7f5b5c0afdd0 2024-09-12T02:40:58.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.588+0000 7f5b64766640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5b5c0c5e40 con 0x7f5b5c153af0 2024-09-12T02:40:58.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.588+0000 7f5b64766640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5b5c154050 con 0x7f5b5c0af870 2024-09-12T02:40:58.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.588+0000 7f5b61d01640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b5c0afdd0 0x7f5b5c1455c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:58.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.588+0000 7f5b61d01640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b5c0afdd0 0x7f5b5c1455c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51020/0 (socket says 172.21.15.60:51020) 2024-09-12T02:40:58.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.588+0000 7f5b61d01640 1 -- 172.21.15.60:0/508890130 learned_addr learned my addr 172.21.15.60:0/508890130 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:58.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.588+0000 7f5b62d03640 1 --2- 172.21.15.60:0/508890130 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b5c153af0 0x7f5b5c06f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:58.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.588+0000 7f5b62502640 1 --2- 172.21.15.60:0/508890130 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5b5c0af870 0x7f5b5c0bf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:58.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.588+0000 7f5b61d01640 1 -- 172.21.15.60:0/508890130 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5b5c0af870 msgr2=0x7f5b5c0bf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:58.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.588+0000 7f5b61d01640 1 --2- 172.21.15.60:0/508890130 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5b5c0af870 0x7f5b5c0bf800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.588+0000 7f5b61d01640 1 -- 172.21.15.60:0/508890130 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b5c153af0 msgr2=0x7f5b5c06f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:58.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.588+0000 7f5b61d01640 1 --2- 172.21.15.60:0/508890130 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b5c153af0 0x7f5b5c06f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.588+0000 7f5b61d01640 1 -- 172.21.15.60:0/508890130 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b5c0c0c60 con 0x7f5b5c0afdd0 2024-09-12T02:40:58.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.589+0000 7f5b61d01640 1 --2- 172.21.15.60:0/508890130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b5c0afdd0 0x7f5b5c1455c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c00d620 tx=0x7f5b4c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:58.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.589+0000 7f5b52ffd640 1 -- 172.21.15.60:0/508890130 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c00b620 con 0x7f5b5c0afdd0 2024-09-12T02:40:58.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.589+0000 7f5b52ffd640 1 -- 172.21.15.60:0/508890130 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5b4c019070 con 0x7f5b5c0afdd0 2024-09-12T02:40:58.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.589+0000 7f5b52ffd640 1 -- 172.21.15.60:0/508890130 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c00ba20 con 0x7f5b5c0afdd0 2024-09-12T02:40:58.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.589+0000 7f5b64766640 1 -- 172.21.15.60:0/508890130 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b5c0bfe40 con 0x7f5b5c0afdd0 2024-09-12T02:40:58.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.589+0000 7f5b64766640 1 -- 172.21.15.60:0/508890130 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b5c1efcb0 con 0x7f5b5c0afdd0 2024-09-12T02:40:58.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.590+0000 7f5b64766640 1 -- 172.21.15.60:0/508890130 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b5c0c58e0 con 0x7f5b5c0afdd0 2024-09-12T02:40:58.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.590+0000 7f5b52ffd640 1 -- 172.21.15.60:0/508890130 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5b4c00bbc0 con 0x7f5b5c0afdd0 2024-09-12T02:40:58.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.591+0000 7f5b52ffd640 1 --2- 172.21.15.60:0/508890130 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f5b4006be30 0x7f5b4006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:58.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.591+0000 7f5b62502640 1 --2- 172.21.15.60:0/508890130 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f5b4006be30 0x7f5b4006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:58.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.591+0000 7f5b52ffd640 1 -- 172.21.15.60:0/508890130 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f5b4c08b660 con 0x7f5b5c0afdd0 2024-09-12T02:40:58.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.591+0000 7f5b62502640 1 --2- 172.21.15.60:0/508890130 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f5b4006be30 0x7f5b4006e2f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f5b54034000 tx=0x7f5b5402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:58.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.595+0000 7f5b52ffd640 1 -- 172.21.15.60:0/508890130 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5b4c059be0 con 0x7f5b5c0afdd0 2024-09-12T02:40:58.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.805+0000 7f5b64766640 1 -- 172.21.15.60:0/508890130 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5b5c156590 con 0x7f5b5c0afdd0 2024-09-12T02:40:58.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.806+0000 7f5b52ffd640 1 -- 172.21.15.60:0/508890130 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+6524 (secure 0 0 0) 0x7f5b4c0594e0 con 0x7f5b5c0afdd0 2024-09-12T02:40:58.807 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:40:58.807 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":11,"btime":"2024-09-12T02:23:19:846521+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3208837169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3208837169},{"type":"v1","addr":"172.21.15.60:6836","nonce":3208837169}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/664538827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":664538827},{"type":"v1","addr":"172.21.15.60:6837","nonce":664538827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:23:04.113913+0000","modified":"2024-09-12T02:23:07.140885+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/2854563525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2854563525},{"type":"v1","addr":"172.21.15.105:6835","nonce":2854563525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1},{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:23:16.184151+0000","modified":"2024-09-12T02:23:19.195177+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"d","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6834/248466084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":248466084},{"type":"v1","addr":"172.21.15.105:6834","nonce":248466084}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":2}]} 2024-09-12T02:40:58.808 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 11 2024-09-12T02:40:58.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.808+0000 7f5b64766640 1 -- 172.21.15.60:0/508890130 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f5b4006be30 msgr2=0x7f5b4006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:58.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.808+0000 7f5b64766640 1 --2- 172.21.15.60:0/508890130 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f5b4006be30 0x7f5b4006e2f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f5b54034000 tx=0x7f5b5402e000 comp rx=0 tx=0).stop 2024-09-12T02:40:58.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.808+0000 7f5b64766640 1 -- 172.21.15.60:0/508890130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b5c0afdd0 msgr2=0x7f5b5c1455c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:58.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.808+0000 7f5b64766640 1 --2- 172.21.15.60:0/508890130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b5c0afdd0 0x7f5b5c1455c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c00d620 tx=0x7f5b4c00dae0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.808+0000 7f5b64766640 1 -- 172.21.15.60:0/508890130 shutdown_connections 2024-09-12T02:40:58.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.808+0000 7f5b64766640 1 --2- 172.21.15.60:0/508890130 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f5b4006be30 0x7f5b4006e2f0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.808+0000 7f5b64766640 1 --2- 172.21.15.60:0/508890130 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b5c153af0 0x7f5b5c06f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.808+0000 7f5b64766640 1 --2- 172.21.15.60:0/508890130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b5c0afdd0 0x7f5b5c1455c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.808+0000 7f5b64766640 1 --2- 172.21.15.60:0/508890130 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5b5c0af870 0x7f5b5c0bf800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.808+0000 7f5b64766640 1 -- 172.21.15.60:0/508890130 >> 172.21.15.60:0/508890130 conn(0x7f5b5c0c6880 msgr2=0x7f5b5c156b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:58.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.808+0000 7f5b64766640 1 -- 172.21.15.60:0/508890130 shutdown_connections 2024-09-12T02:40:58.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.808+0000 7f5b64766640 1 -- 172.21.15.60:0/508890130 wait complete. 2024-09-12T02:40:58.820 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:40:58.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.923+0000 7f4f89cac640 1 Processor -- start 2024-09-12T02:40:58.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.923+0000 7f4f89cac640 1 -- start start 2024-09-12T02:40:58.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.923+0000 7f4f89cac640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4f8406bbe0 0x7f4f8406c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:58.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.923+0000 7f4f89cac640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4f841598c0 0x7f4f84159d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:58.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.923+0000 7f4f89cac640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f840c6b20 con 0x7f4f84153de0 2024-09-12T02:40:58.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.923+0000 7f4f89cac640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f4f840c9480 con 0x7f4f8406bbe0 2024-09-12T02:40:58.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.924+0000 7f4f89cac640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f4f840cb620 con 0x7f4f841598c0 2024-09-12T02:40:58.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.924+0000 7f4f82ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4f8406bbe0 0x7f4f8406c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:58.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.924+0000 7f4f82ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4f8406bbe0 0x7f4f8406c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51026/0 (socket says 172.21.15.60:51026) 2024-09-12T02:40:58.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.924+0000 7f4f82ffd640 1 -- 172.21.15.60:0/1779762146 learned_addr learned my addr 172.21.15.60:0/1779762146 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:58.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.924+0000 7f4f83fff640 1 --2- 172.21.15.60:0/1779762146 >> v2:172.21.15.105:3300/0 conn(0x7f4f841598c0 0x7f4f84159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:58.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.924+0000 7f4f82ffd640 1 -- 172.21.15.60:0/1779762146 >> v2:172.21.15.105:3300/0 conn(0x7f4f841598c0 msgr2=0x7f4f84159d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:58.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.924+0000 7f4f82ffd640 1 --2- 172.21.15.60:0/1779762146 >> v2:172.21.15.105:3300/0 conn(0x7f4f841598c0 0x7f4f84159d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.924+0000 7f4f82ffd640 1 -- 172.21.15.60:0/1779762146 >> v1:172.21.15.105:6789/0 conn(0x7f4f84153de0 legacy=0x7f4f840ca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:58.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.924+0000 7f4f82ffd640 1 -- 172.21.15.60:0/1779762146 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f840c6e00 con 0x7f4f8406bbe0 2024-09-12T02:40:58.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.924+0000 7f4f83fff640 1 --2- 172.21.15.60:0/1779762146 >> v2:172.21.15.105:3300/0 conn(0x7f4f841598c0 0x7f4f84159d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:40:58.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.925+0000 7f4f82ffd640 1 --2- 172.21.15.60:0/1779762146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f8406bbe0 0x7f4f8406c020 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4f840749b0 tx=0x7f4f7802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fd1c20b08ef62b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:58.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.925+0000 7f4f827fc640 1 -- 172.21.15.60:0/1779762146 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f78037070 con 0x7f4f8406bbe0 2024-09-12T02:40:58.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.925+0000 7f4f827fc640 1 -- 172.21.15.60:0/1779762146 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4f78032440 con 0x7f4f8406bbe0 2024-09-12T02:40:58.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.925+0000 7f4f827fc640 1 -- 172.21.15.60:0/1779762146 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f78032830 con 0x7f4f8406bbe0 2024-09-12T02:40:58.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.925+0000 7f4f89cac640 1 -- 172.21.15.60:0/1779762146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f8406bbe0 msgr2=0x7f4f8406c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:58.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.925+0000 7f4f89cac640 1 --2- 172.21.15.60:0/1779762146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f8406bbe0 0x7f4f8406c020 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4f840749b0 tx=0x7f4f7802a270 comp rx=0 tx=0).stop 2024-09-12T02:40:58.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.925+0000 7f4f89cac640 1 -- 172.21.15.60:0/1779762146 shutdown_connections 2024-09-12T02:40:58.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.926+0000 7f4f89cac640 1 --2- 172.21.15.60:0/1779762146 >> v2:172.21.15.105:3300/0 conn(0x7f4f841598c0 0x7f4f84159d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.926+0000 7f4f89cac640 1 --2- 172.21.15.60:0/1779762146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f8406bbe0 0x7f4f8406c020 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.926+0000 7f4f89cac640 1 -- 172.21.15.60:0/1779762146 >> 172.21.15.60:0/1779762146 conn(0x7f4f840c8800 msgr2=0x7f4f840c8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:58.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.926+0000 7f4f89cac640 1 -- 172.21.15.60:0/1779762146 shutdown_connections 2024-09-12T02:40:58.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.926+0000 7f4f89cac640 1 -- 172.21.15.60:0/1779762146 wait complete. 2024-09-12T02:40:58.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.927+0000 7f4f89cac640 1 Processor -- start 2024-09-12T02:40:58.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.927+0000 7f4f89cac640 1 -- start start 2024-09-12T02:40:58.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.927+0000 7f4f89cac640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4f8406bbe0 0x7f4f841ef760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:58.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.927+0000 7f4f89cac640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f84153de0 0x7f4f84147e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:58.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.928+0000 7f4f89cac640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4f841598c0 0x7f4f84148370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:58.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.928+0000 7f4f89cac640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4f840cbab0 con 0x7f4f84153de0 2024-09-12T02:40:58.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.928+0000 7f4f89cac640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4f8406c560 con 0x7f4f8406bbe0 2024-09-12T02:40:58.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.928+0000 7f4f89cac640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4f8415a290 con 0x7f4f841598c0 2024-09-12T02:40:58.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.928+0000 7f4f82ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f84153de0 0x7f4f84147e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:58.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.928+0000 7f4f82ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f84153de0 0x7f4f84147e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51032/0 (socket says 172.21.15.60:51032) 2024-09-12T02:40:58.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.928+0000 7f4f82ffd640 1 -- 172.21.15.60:0/3059678734 learned_addr learned my addr 172.21.15.60:0/3059678734 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:58.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.928+0000 7f4f837fe640 1 --2- 172.21.15.60:0/3059678734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4f8406bbe0 0x7f4f841ef760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:58.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.928+0000 7f4f83fff640 1 --2- 172.21.15.60:0/3059678734 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4f841598c0 0x7f4f84148370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:58.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.928+0000 7f4f82ffd640 1 -- 172.21.15.60:0/3059678734 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4f841598c0 msgr2=0x7f4f84148370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:58.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.928+0000 7f4f82ffd640 1 --2- 172.21.15.60:0/3059678734 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4f841598c0 0x7f4f84148370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.928+0000 7f4f82ffd640 1 -- 172.21.15.60:0/3059678734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4f8406bbe0 msgr2=0x7f4f841ef760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:58.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.928+0000 7f4f82ffd640 1 --2- 172.21.15.60:0/3059678734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4f8406bbe0 0x7f4f841ef760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:58.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.928+0000 7f4f82ffd640 1 -- 172.21.15.60:0/3059678734 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f841f0270 con 0x7f4f84153de0 2024-09-12T02:40:58.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.928+0000 7f4f82ffd640 1 --2- 172.21.15.60:0/3059678734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f84153de0 0x7f4f84147e30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4f7802a2b0 tx=0x7f4f780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:58.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.928+0000 7f4f6bfff640 1 -- 172.21.15.60:0/3059678734 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f78037040 con 0x7f4f84153de0 2024-09-12T02:40:58.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.928+0000 7f4f6bfff640 1 -- 172.21.15.60:0/3059678734 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4f78042070 con 0x7f4f84153de0 2024-09-12T02:40:58.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.928+0000 7f4f89cac640 1 -- 172.21.15.60:0/3059678734 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f84148c50 con 0x7f4f84153de0 2024-09-12T02:40:58.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.928+0000 7f4f6bfff640 1 -- 172.21.15.60:0/3059678734 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f78030bf0 con 0x7f4f84153de0 2024-09-12T02:40:58.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.928+0000 7f4f89cac640 1 -- 172.21.15.60:0/3059678734 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f841e38b0 con 0x7f4f84153de0 2024-09-12T02:40:58.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.929+0000 7f4f89cac640 1 -- 172.21.15.60:0/3059678734 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f840500d0 con 0x7f4f84153de0 2024-09-12T02:40:58.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.930+0000 7f4f6bfff640 1 -- 172.21.15.60:0/3059678734 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4f78047460 con 0x7f4f84153de0 2024-09-12T02:40:58.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.930+0000 7f4f6bfff640 1 --2- 172.21.15.60:0/3059678734 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4f7006be30 0x7f4f7006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:58.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.930+0000 7f4f6bfff640 1 -- 172.21.15.60:0/3059678734 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f4f780abc40 con 0x7f4f84153de0 2024-09-12T02:40:58.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.931+0000 7f4f837fe640 1 --2- 172.21.15.60:0/3059678734 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4f7006be30 0x7f4f7006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:58.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.931+0000 7f4f837fe640 1 --2- 172.21.15.60:0/3059678734 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4f7006be30 0x7f4f7006e2f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4f74001780 tx=0x7f4f74009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:58.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:58.935+0000 7f4f6bfff640 1 -- 172.21.15.60:0/3059678734 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4f840500d0 con 0x7f4f84153de0 2024-09-12T02:40:59.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.147+0000 7f4f89cac640 1 -- 172.21.15.60:0/3059678734 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4f8406c020 con 0x7f4f84153de0 2024-09-12T02:40:59.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.147+0000 7f4f6bfff640 1 -- 172.21.15.60:0/3059678734 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+6524 (secure 0 0 0) 0x7f4f78032e20 con 0x7f4f84153de0 2024-09-12T02:40:59.148 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:40:59.148 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":11,"btime":"2024-09-12T02:23:19:846521+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3208837169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3208837169},{"type":"v1","addr":"172.21.15.60:6836","nonce":3208837169}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/664538827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":664538827},{"type":"v1","addr":"172.21.15.60:6837","nonce":664538827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:23:04.113913+0000","modified":"2024-09-12T02:23:07.140885+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/2854563525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2854563525},{"type":"v1","addr":"172.21.15.105:6835","nonce":2854563525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1},{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:23:16.184151+0000","modified":"2024-09-12T02:23:19.195177+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"d","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6834/248466084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":248466084},{"type":"v1","addr":"172.21.15.105:6834","nonce":248466084}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":2}]} 2024-09-12T02:40:59.148 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 11 2024-09-12T02:40:59.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.149+0000 7f4f89cac640 1 -- 172.21.15.60:0/3059678734 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4f7006be30 msgr2=0x7f4f7006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:59.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.149+0000 7f4f89cac640 1 --2- 172.21.15.60:0/3059678734 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4f7006be30 0x7f4f7006e2f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4f74001780 tx=0x7f4f74009040 comp rx=0 tx=0).stop 2024-09-12T02:40:59.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.149+0000 7f4f89cac640 1 -- 172.21.15.60:0/3059678734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f84153de0 msgr2=0x7f4f84147e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:59.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.149+0000 7f4f89cac640 1 --2- 172.21.15.60:0/3059678734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f84153de0 0x7f4f84147e30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4f7802a2b0 tx=0x7f4f780046c0 comp rx=0 tx=0).stop 2024-09-12T02:40:59.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.149+0000 7f4f89cac640 1 -- 172.21.15.60:0/3059678734 shutdown_connections 2024-09-12T02:40:59.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.149+0000 7f4f89cac640 1 --2- 172.21.15.60:0/3059678734 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f4f7006be30 0x7f4f7006e2f0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:59.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.149+0000 7f4f89cac640 1 --2- 172.21.15.60:0/3059678734 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4f841598c0 0x7f4f84148370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:59.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.149+0000 7f4f89cac640 1 --2- 172.21.15.60:0/3059678734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f84153de0 0x7f4f84147e30 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:59.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.149+0000 7f4f89cac640 1 --2- 172.21.15.60:0/3059678734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4f8406bbe0 0x7f4f841ef760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:59.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.149+0000 7f4f89cac640 1 -- 172.21.15.60:0/3059678734 >> 172.21.15.60:0/3059678734 conn(0x7f4f840c8800 msgr2=0x7f4f841500f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:59.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.149+0000 7f4f89cac640 1 -- 172.21.15.60:0/3059678734 shutdown_connections 2024-09-12T02:40:59.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.149+0000 7f4f89cac640 1 -- 172.21.15.60:0/3059678734 wait complete. 2024-09-12T02:40:59.161 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:40:59.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.264+0000 7f76adb1a640 1 Processor -- start 2024-09-12T02:40:59.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.264+0000 7f76adb1a640 1 -- start start 2024-09-12T02:40:59.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.265+0000 7f76adb1a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76a8153de0 0x7f76a80ca640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:59.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.265+0000 7f76adb1a640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f76a806bbe0 0x7f76a806c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:59.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.265+0000 7f76adb1a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f76a81598c0 0x7f76a8159d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:59.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.265+0000 7f76adb1a640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f76a80c9480 con 0x7f76a81598c0 2024-09-12T02:40:59.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.265+0000 7f76adb1a640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f76a80cb620 con 0x7f76a806bbe0 2024-09-12T02:40:59.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.265+0000 7f76adb1a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f76a80cab80 con 0x7f76a8153de0 2024-09-12T02:40:59.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.265+0000 7f76a7fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f76a81598c0 0x7f76a8159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:59.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.265+0000 7f76a7fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f76a81598c0 0x7f76a8159d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51040/0 (socket says 172.21.15.60:51040) 2024-09-12T02:40:59.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.265+0000 7f76a7fff640 1 -- 172.21.15.60:0/4280574893 learned_addr learned my addr 172.21.15.60:0/4280574893 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:59.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.265+0000 7f76a77fe640 1 --2- 172.21.15.60:0/4280574893 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76a8153de0 0x7f76a80ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:59.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.265+0000 7f769ffff640 1 --2- 172.21.15.60:0/4280574893 >> v2:172.21.15.105:3300/0 conn(0x7f76a806bbe0 0x7f76a806c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:59.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.265+0000 7f76a7fff640 1 -- 172.21.15.60:0/4280574893 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76a8153de0 msgr2=0x7f76a80ca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:59.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.265+0000 7f76a7fff640 1 --2- 172.21.15.60:0/4280574893 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76a8153de0 0x7f76a80ca640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:59.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.265+0000 7f76a7fff640 1 -- 172.21.15.60:0/4280574893 >> v2:172.21.15.105:3300/0 conn(0x7f76a806bbe0 msgr2=0x7f76a806c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:59.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.265+0000 7f76a7fff640 1 --2- 172.21.15.60:0/4280574893 >> v2:172.21.15.105:3300/0 conn(0x7f76a806bbe0 0x7f76a806c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:59.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.265+0000 7f76a7fff640 1 -- 172.21.15.60:0/4280574893 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76a80c6b20 con 0x7f76a81598c0 2024-09-12T02:40:59.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.265+0000 7f76a77fe640 1 --2- 172.21.15.60:0/4280574893 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76a8153de0 0x7f76a80ca640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:40:59.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.266+0000 7f76a7fff640 1 --2- 172.21.15.60:0/4280574893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76a81598c0 0x7f76a8159d70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f76a806de50 tx=0x7f76a002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3212e18b22e009d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:59.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.266+0000 7f76a6ffd640 1 -- 172.21.15.60:0/4280574893 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a0036070 con 0x7f76a81598c0 2024-09-12T02:40:59.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.266+0000 7f76a6ffd640 1 -- 172.21.15.60:0/4280574893 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f76a0031600 con 0x7f76a81598c0 2024-09-12T02:40:59.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.266+0000 7f76a6ffd640 1 -- 172.21.15.60:0/4280574893 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a00319f0 con 0x7f76a81598c0 2024-09-12T02:40:59.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.267+0000 7f76adb1a640 1 -- 172.21.15.60:0/4280574893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76a81598c0 msgr2=0x7f76a8159d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:59.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.267+0000 7f76adb1a640 1 --2- 172.21.15.60:0/4280574893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76a81598c0 0x7f76a8159d70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f76a806de50 tx=0x7f76a002a6a0 comp rx=0 tx=0).stop 2024-09-12T02:40:59.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.267+0000 7f76adb1a640 1 -- 172.21.15.60:0/4280574893 shutdown_connections 2024-09-12T02:40:59.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.267+0000 7f76adb1a640 1 --2- 172.21.15.60:0/4280574893 >> v2:172.21.15.105:3300/0 conn(0x7f76a806bbe0 0x7f76a806c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:59.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.267+0000 7f76adb1a640 1 --2- 172.21.15.60:0/4280574893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76a81598c0 0x7f76a8159d70 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:59.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.267+0000 7f76adb1a640 1 --2- 172.21.15.60:0/4280574893 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76a8153de0 0x7f76a80ca640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:59.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.267+0000 7f76adb1a640 1 -- 172.21.15.60:0/4280574893 >> 172.21.15.60:0/4280574893 conn(0x7f76a80c8800 msgr2=0x7f76a80c8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:59.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.267+0000 7f76adb1a640 1 -- 172.21.15.60:0/4280574893 shutdown_connections 2024-09-12T02:40:59.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.267+0000 7f76adb1a640 1 -- 172.21.15.60:0/4280574893 wait complete. 2024-09-12T02:40:59.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.268+0000 7f76adb1a640 1 Processor -- start 2024-09-12T02:40:59.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.268+0000 7f76adb1a640 1 -- start start 2024-09-12T02:40:59.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.269+0000 7f76adb1a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76a806bbe0 0x7f76a81ef6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:59.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.269+0000 7f76adb1a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76a8153de0 0x7f76a8157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:59.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.269+0000 7f76adb1a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76a81598c0 0x7f76a81584e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:59.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.269+0000 7f76adb1a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f76a806c560 con 0x7f76a8153de0 2024-09-12T02:40:59.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.269+0000 7f76adb1a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f76a80c70e0 con 0x7f76a806bbe0 2024-09-12T02:40:59.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.269+0000 7f76adb1a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f76a80cbab0 con 0x7f76a81598c0 2024-09-12T02:40:59.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.269+0000 7f769ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76a8153de0 0x7f76a8157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:59.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.269+0000 7f769ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76a8153de0 0x7f76a8157fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51046/0 (socket says 172.21.15.60:51046) 2024-09-12T02:40:59.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.269+0000 7f769ffff640 1 -- 172.21.15.60:0/2540072850 learned_addr learned my addr 172.21.15.60:0/2540072850 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:59.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.269+0000 7f76a77fe640 1 --2- 172.21.15.60:0/2540072850 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76a806bbe0 0x7f76a81ef6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:59.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.269+0000 7f76a7fff640 1 --2- 172.21.15.60:0/2540072850 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76a81598c0 0x7f76a81584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:59.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.269+0000 7f769ffff640 1 -- 172.21.15.60:0/2540072850 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76a81598c0 msgr2=0x7f76a81584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:59.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.269+0000 7f769ffff640 1 --2- 172.21.15.60:0/2540072850 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76a81598c0 0x7f76a81584e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:59.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.269+0000 7f769ffff640 1 -- 172.21.15.60:0/2540072850 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76a806bbe0 msgr2=0x7f76a81ef6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:59.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.269+0000 7f769ffff640 1 --2- 172.21.15.60:0/2540072850 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76a806bbe0 0x7f76a81ef6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:59.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.269+0000 7f769ffff640 1 -- 172.21.15.60:0/2540072850 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76a80af860 con 0x7f76a8153de0 2024-09-12T02:40:59.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.269+0000 7f769ffff640 1 --2- 172.21.15.60:0/2540072850 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76a8153de0 0x7f76a8157fa0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f769000e9b0 tx=0x7f769000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:59.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.270+0000 7f76a4ff9640 1 -- 172.21.15.60:0/2540072850 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7690017070 con 0x7f76a8153de0 2024-09-12T02:40:59.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.270+0000 7f76a4ff9640 1 -- 172.21.15.60:0/2540072850 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f769000c9a0 con 0x7f76a8153de0 2024-09-12T02:40:59.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.270+0000 7f76adb1a640 1 -- 172.21.15.60:0/2540072850 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76a81effa0 con 0x7f76a8153de0 2024-09-12T02:40:59.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.270+0000 7f76a4ff9640 1 -- 172.21.15.60:0/2540072850 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f769000cd90 con 0x7f76a8153de0 2024-09-12T02:40:59.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.270+0000 7f76adb1a640 1 -- 172.21.15.60:0/2540072850 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76a81e1fc0 con 0x7f76a8153de0 2024-09-12T02:40:59.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.271+0000 7f76adb1a640 1 -- 172.21.15.60:0/2540072850 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76a80c7bc0 con 0x7f76a8153de0 2024-09-12T02:40:59.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.271+0000 7f76a4ff9640 1 -- 172.21.15.60:0/2540072850 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f769001a070 con 0x7f76a8153de0 2024-09-12T02:40:59.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.272+0000 7f76a4ff9640 1 --2- 172.21.15.60:0/2540072850 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f768806be30 0x7f768806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:59.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.272+0000 7f76a4ff9640 1 -- 172.21.15.60:0/2540072850 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7f769008b520 con 0x7f76a8153de0 2024-09-12T02:40:59.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.272+0000 7f76a77fe640 1 --2- 172.21.15.60:0/2540072850 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f768806be30 0x7f768806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:59.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.272+0000 7f76a77fe640 1 --2- 172.21.15.60:0/2540072850 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f768806be30 0x7f768806e2f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f7698009560 tx=0x7f7698009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:59.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.276+0000 7f76a4ff9640 1 -- 172.21.15.60:0/2540072850 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f76a80c7bc0 con 0x7f76a8153de0 2024-09-12T02:40:59.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.451+0000 7f76adb1a640 1 -- 172.21.15.60:0/2540072850 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f76a8150c90 con 0x7f76a8153de0 2024-09-12T02:40:59.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.452+0000 7f76a4ff9640 1 -- 172.21.15.60:0/2540072850 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+20689 (secure 0 0 0) 0x7f76900594e0 con 0x7f76a8153de0 2024-09-12T02:40:59.453 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:40:59.454 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":28,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","created":"2024-09-12T02:22:39.869862+0000","modified":"2024-09-12T02:23:55.914182+0000","last_up_change":"2024-09-12T02:22:53.459371+0000","last_in_change":"2024-09-12T02:22:42.817076+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:22:52.130579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-09-12T02:23:01.854763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-09-12T02:23:03.104847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-09-12T02:23:14.175168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-09-12T02:23:15.166293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0f0c7386-002f-47e2-a7a3-6c8a70264cc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6819","nonce":1789465659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6821","nonce":1789465659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6825","nonce":1789465659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6823","nonce":1789465659}]},"public_addr":"172.21.15.60:6819/1789465659","cluster_addr":"172.21.15.60:6821/1789465659","heartbeat_back_addr":"172.21.15.60:6825/1789465659","heartbeat_front_addr":"172.21.15.60:6823/1789465659","state":["exists","up"]},{"osd":1,"uuid":"64be7b84-36fc-43c0-9e70-a617e5b68941","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6811","nonce":1109822408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6813","nonce":1109822408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6817","nonce":1109822408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6815","nonce":1109822408}]},"public_addr":"172.21.15.60:6811/1109822408","cluster_addr":"172.21.15.60:6813/1109822408","heartbeat_back_addr":"172.21.15.60:6817/1109822408","heartbeat_front_addr":"172.21.15.60:6815/1109822408","state":["exists","up"]},{"osd":2,"uuid":"df00caa1-d45e-4b87-ac1e-8bc098d509d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6827","nonce":278470077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6829","nonce":278470077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6833","nonce":278470077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6831","nonce":278470077}]},"public_addr":"172.21.15.60:6827/278470077","cluster_addr":"172.21.15.60:6829/278470077","heartbeat_back_addr":"172.21.15.60:6833/278470077","heartbeat_front_addr":"172.21.15.60:6831/278470077","state":["exists","up"]},{"osd":3,"uuid":"f6453471-893a-490b-b0c7-f196a0f574e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6803","nonce":3606424156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6805","nonce":3606424156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6809","nonce":3606424156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6807","nonce":3606424156}]},"public_addr":"172.21.15.60:6803/3606424156","cluster_addr":"172.21.15.60:6805/3606424156","heartbeat_back_addr":"172.21.15.60:6809/3606424156","heartbeat_front_addr":"172.21.15.60:6807/3606424156","state":["exists","up"]},{"osd":4,"uuid":"96e908b6-ce3e-466c-b02d-08fc71a1dba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6809","nonce":1581641129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6811","nonce":1581641129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6815","nonce":1581641129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6813","nonce":1581641129}]},"public_addr":"172.21.15.105:6809/1581641129","cluster_addr":"172.21.15.105:6811/1581641129","heartbeat_back_addr":"172.21.15.105:6815/1581641129","heartbeat_front_addr":"172.21.15.105:6813/1581641129","state":["exists","up"]},{"osd":5,"uuid":"7ebc26f0-a462-4364-9303-7351f7cba21f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6825","nonce":1392337793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6827","nonce":1392337793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6831","nonce":1392337793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6829","nonce":1392337793}]},"public_addr":"172.21.15.105:6825/1392337793","cluster_addr":"172.21.15.105:6827/1392337793","heartbeat_back_addr":"172.21.15.105:6831/1392337793","heartbeat_front_addr":"172.21.15.105:6829/1392337793","state":["exists","up"]},{"osd":6,"uuid":"49487ea1-9c6d-4090-bbcc-f28b33040eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6801","nonce":50951309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6803","nonce":50951309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6807","nonce":50951309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6805","nonce":50951309}]},"public_addr":"172.21.15.105:6801/50951309","cluster_addr":"172.21.15.105:6803/50951309","heartbeat_back_addr":"172.21.15.105:6807/50951309","heartbeat_front_addr":"172.21.15.105:6805/50951309","state":["exists","up"]},{"osd":7,"uuid":"1e3a0aa9-7e29-4785-8506-6b5d3be2be35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6817","nonce":3745331251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6819","nonce":3745331251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6823","nonce":3745331251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6821","nonce":3745331251}]},"public_addr":"172.21.15.105:6817/3745331251","cluster_addr":"172.21.15.105:6819/3745331251","heartbeat_back_addr":"172.21.15.105:6823/3745331251","heartbeat_front_addr":"172.21.15.105:6821/3745331251","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:50.112629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.307689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.542851+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.334773+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:50.096967+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:50.259633+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.888988+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.917421+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.27","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:40:59.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.454+0000 7f76adb1a640 1 -- 172.21.15.60:0/2540072850 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f768806be30 msgr2=0x7f768806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:59.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.454+0000 7f76adb1a640 1 --2- 172.21.15.60:0/2540072850 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f768806be30 0x7f768806e2f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f7698009560 tx=0x7f7698009190 comp rx=0 tx=0).stop 2024-09-12T02:40:59.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.454+0000 7f76adb1a640 1 -- 172.21.15.60:0/2540072850 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76a8153de0 msgr2=0x7f76a8157fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:59.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.454+0000 7f76adb1a640 1 --2- 172.21.15.60:0/2540072850 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76a8153de0 0x7f76a8157fa0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f769000e9b0 tx=0x7f769000ee70 comp rx=0 tx=0).stop 2024-09-12T02:40:59.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.454+0000 7f76adb1a640 1 -- 172.21.15.60:0/2540072850 shutdown_connections 2024-09-12T02:40:59.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.454+0000 7f76adb1a640 1 --2- 172.21.15.60:0/2540072850 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f768806be30 0x7f768806e2f0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:59.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.454+0000 7f76adb1a640 1 --2- 172.21.15.60:0/2540072850 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76a81598c0 0x7f76a81584e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:59.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.454+0000 7f76adb1a640 1 --2- 172.21.15.60:0/2540072850 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76a8153de0 0x7f76a8157fa0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:59.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.454+0000 7f76adb1a640 1 --2- 172.21.15.60:0/2540072850 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76a806bbe0 0x7f76a81ef6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:59.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.454+0000 7f76adb1a640 1 -- 172.21.15.60:0/2540072850 >> 172.21.15.60:0/2540072850 conn(0x7f76a80c8800 msgr2=0x7f76a80ab980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:59.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.455+0000 7f76adb1a640 1 -- 172.21.15.60:0/2540072850 shutdown_connections 2024-09-12T02:40:59.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.455+0000 7f76adb1a640 1 -- 172.21.15.60:0/2540072850 wait complete. 2024-09-12T02:40:59.467 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail a 2024-09-12T02:40:59.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.570+0000 7fe2a2d5f640 1 Processor -- start 2024-09-12T02:40:59.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.570+0000 7fe2a2d5f640 1 -- start start 2024-09-12T02:40:59.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.571+0000 7fe2a2d5f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe29c150480 0x7fe29c0c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:59.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.571+0000 7fe2a2d5f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe29c0ca390 0x7fe29c0c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:59.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.571+0000 7fe2a2d5f640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe29c15a7c0 con 0x7fe29c06c650 2024-09-12T02:40:59.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.571+0000 7fe2a2d5f640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fe29c06c240 con 0x7fe29c150480 2024-09-12T02:40:59.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.571+0000 7fe2a2d5f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe29c15a330 con 0x7fe29c0ca390 2024-09-12T02:40:59.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.571+0000 7fe2a0afb640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe29c150480 0x7fe29c0c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:59.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.571+0000 7fe2a0afb640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe29c150480 0x7fe29c0c7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60760/0 (socket says 172.21.15.60:60760) 2024-09-12T02:40:59.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.571+0000 7fe2a0afb640 1 -- 172.21.15.60:0/1128711203 learned_addr learned my addr 172.21.15.60:0/1128711203 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:59.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.572+0000 7fe2a12fc640 1 --2- 172.21.15.60:0/1128711203 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe29c0ca390 0x7fe29c0c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:59.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.572+0000 7fe2a0afb640 1 -- 172.21.15.60:0/1128711203 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe29c0ca390 msgr2=0x7fe29c0c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:59.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.572+0000 7fe2a0afb640 1 --2- 172.21.15.60:0/1128711203 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe29c0ca390 0x7fe29c0c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:59.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.572+0000 7fe2a0afb640 1 -- 172.21.15.60:0/1128711203 >> v1:172.21.15.105:6789/0 conn(0x7fe29c06c650 legacy=0x7fe29c0c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:59.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.572+0000 7fe2a0afb640 1 -- 172.21.15.60:0/1128711203 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe29c159a00 con 0x7fe29c150480 2024-09-12T02:40:59.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.572+0000 7fe2a0afb640 1 --2- 172.21.15.60:0/1128711203 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe29c150480 0x7fe29c0c7a90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe294009e50 tx=0x7fe29402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=918b8f857ccb2ded server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:59.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.573+0000 7fe29b7fe640 1 -- 172.21.15.60:0/1128711203 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe294036070 con 0x7fe29c150480 2024-09-12T02:40:59.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.573+0000 7fe29b7fe640 1 -- 172.21.15.60:0/1128711203 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe294031600 con 0x7fe29c150480 2024-09-12T02:40:59.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.573+0000 7fe29b7fe640 1 -- 172.21.15.60:0/1128711203 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2940319f0 con 0x7fe29c150480 2024-09-12T02:40:59.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.573+0000 7fe2a2d5f640 1 -- 172.21.15.60:0/1128711203 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe29c150480 msgr2=0x7fe29c0c7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:59.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.573+0000 7fe2a2d5f640 1 --2- 172.21.15.60:0/1128711203 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe29c150480 0x7fe29c0c7a90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe294009e50 tx=0x7fe29402a6c0 comp rx=0 tx=0).stop 2024-09-12T02:40:59.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.573+0000 7fe2a2d5f640 1 -- 172.21.15.60:0/1128711203 shutdown_connections 2024-09-12T02:40:59.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.573+0000 7fe2a2d5f640 1 --2- 172.21.15.60:0/1128711203 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe29c0ca390 0x7fe29c0c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:59.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.573+0000 7fe2a2d5f640 1 --2- 172.21.15.60:0/1128711203 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe29c150480 0x7fe29c0c7a90 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:59.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.573+0000 7fe2a2d5f640 1 -- 172.21.15.60:0/1128711203 >> 172.21.15.60:0/1128711203 conn(0x7fe29c068030 msgr2=0x7fe29c073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:59.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.573+0000 7fe2a2d5f640 1 -- 172.21.15.60:0/1128711203 shutdown_connections 2024-09-12T02:40:59.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.573+0000 7fe2a2d5f640 1 -- 172.21.15.60:0/1128711203 wait complete. 2024-09-12T02:40:59.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.574+0000 7fe2a2d5f640 1 Processor -- start 2024-09-12T02:40:59.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.574+0000 7fe2a2d5f640 1 -- start start 2024-09-12T02:40:59.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.575+0000 7fe2a2d5f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe29c06c650 0x7fe29c14a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:59.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.575+0000 7fe2a2d5f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe29c0ca390 0x7fe29c158400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:59.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.575+0000 7fe2a2d5f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe29c150480 0x7fe29c0afef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:59.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.575+0000 7fe2a2d5f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe29c06d270 con 0x7fe29c150480 2024-09-12T02:40:59.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.575+0000 7fe2a2d5f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe29c159fc0 con 0x7fe29c0ca390 2024-09-12T02:40:59.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.575+0000 7fe2a2d5f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe29c156270 con 0x7fe29c06c650 2024-09-12T02:40:59.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.575+0000 7fe2a12fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe29c150480 0x7fe29c0afef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:59.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.575+0000 7fe2a12fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe29c150480 0x7fe29c0afef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60778/0 (socket says 172.21.15.60:60778) 2024-09-12T02:40:59.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.575+0000 7fe2a12fc640 1 -- 172.21.15.60:0/923271823 learned_addr learned my addr 172.21.15.60:0/923271823 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:59.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.575+0000 7fe2a0afb640 1 --2- 172.21.15.60:0/923271823 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe29c06c650 0x7fe29c14a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:59.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.575+0000 7fe29bfff640 1 --2- 172.21.15.60:0/923271823 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe29c0ca390 0x7fe29c158400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:59.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.576+0000 7fe2a12fc640 1 -- 172.21.15.60:0/923271823 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe29c06c650 msgr2=0x7fe29c14a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:59.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.576+0000 7fe2a12fc640 1 --2- 172.21.15.60:0/923271823 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe29c06c650 0x7fe29c14a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:59.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.576+0000 7fe2a12fc640 1 -- 172.21.15.60:0/923271823 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe29c0ca390 msgr2=0x7fe29c158400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:59.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.576+0000 7fe2a12fc640 1 --2- 172.21.15.60:0/923271823 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe29c0ca390 0x7fe29c158400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:59.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.576+0000 7fe2a12fc640 1 -- 172.21.15.60:0/923271823 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe29c0af130 con 0x7fe29c150480 2024-09-12T02:40:59.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.576+0000 7fe29bfff640 1 --2- 172.21.15.60:0/923271823 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe29c0ca390 0x7fe29c158400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:40:59.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.576+0000 7fe2a12fc640 1 --2- 172.21.15.60:0/923271823 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe29c150480 0x7fe29c0afef0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe28400d800 tx=0x7fe28400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:59.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.576+0000 7fe2997fa640 1 -- 172.21.15.60:0/923271823 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28400b6c0 con 0x7fe29c150480 2024-09-12T02:40:59.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.576+0000 7fe2997fa640 1 -- 172.21.15.60:0/923271823 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe284019070 con 0x7fe29c150480 2024-09-12T02:40:59.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.576+0000 7fe2a2d5f640 1 -- 172.21.15.60:0/923271823 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe29c0af410 con 0x7fe29c150480 2024-09-12T02:40:59.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.576+0000 7fe2997fa640 1 -- 172.21.15.60:0/923271823 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28400bae0 con 0x7fe29c150480 2024-09-12T02:40:59.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.576+0000 7fe2a2d5f640 1 -- 172.21.15.60:0/923271823 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe29c158940 con 0x7fe29c150480 2024-09-12T02:40:59.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.577+0000 7fe2a2d5f640 1 -- 172.21.15.60:0/923271823 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe29c0c63d0 con 0x7fe29c150480 2024-09-12T02:40:59.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.578+0000 7fe2997fa640 1 -- 172.21.15.60:0/923271823 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe28400bc80 con 0x7fe29c150480 2024-09-12T02:40:59.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.578+0000 7fe2997fa640 1 --2- 172.21.15.60:0/923271823 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe27c06be60 0x7fe27c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:59.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.578+0000 7fe2997fa640 1 -- 172.21.15.60:0/923271823 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6637+0+0 (secure 0 0 0) 0x7fe28408b560 con 0x7fe29c150480 2024-09-12T02:40:59.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.578+0000 7fe2a0afb640 1 --2- 172.21.15.60:0/923271823 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe27c06be60 0x7fe27c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:59.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.579+0000 7fe2a0afb640 1 --2- 172.21.15.60:0/923271823 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe27c06be60 0x7fe27c06e320 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe294033000 tx=0x7fe294009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:59.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.582+0000 7fe2997fa640 1 -- 172.21.15.60:0/923271823 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe29c0c63d0 con 0x7fe29c150480 2024-09-12T02:40:59.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.794+0000 7fe2a2d5f640 1 -- 172.21.15.60:0/923271823 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "a"} v 0) -- 0x7fe29c0c9c80 con 0x7fe29c150480 2024-09-12T02:40:59.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.806+0000 7fe2997fa640 1 -- 172.21.15.60:0/923271823 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "a"}]=0 a marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v12) ==== 151+0+0 (secure 0 0 0) 0x7fe284059c00 con 0x7fe29c150480 2024-09-12T02:40:59.807 INFO:teuthology.orchestra.run.smithi060.stderr:a marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:40:59.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.809+0000 7fe2a2d5f640 1 -- 172.21.15.60:0/923271823 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe27c06be60 msgr2=0x7fe27c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:59.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.809+0000 7fe2a2d5f640 1 --2- 172.21.15.60:0/923271823 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe27c06be60 0x7fe27c06e320 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe294033000 tx=0x7fe294009000 comp rx=0 tx=0).stop 2024-09-12T02:40:59.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.809+0000 7fe2a2d5f640 1 -- 172.21.15.60:0/923271823 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe29c150480 msgr2=0x7fe29c0afef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:59.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.809+0000 7fe2a2d5f640 1 --2- 172.21.15.60:0/923271823 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe29c150480 0x7fe29c0afef0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe28400d800 tx=0x7fe28400dcc0 comp rx=0 tx=0).stop 2024-09-12T02:40:59.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.809+0000 7fe2a2d5f640 1 -- 172.21.15.60:0/923271823 shutdown_connections 2024-09-12T02:40:59.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.809+0000 7fe2a2d5f640 1 --2- 172.21.15.60:0/923271823 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fe27c06be60 0x7fe27c06e320 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:59.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.809+0000 7fe2a2d5f640 1 --2- 172.21.15.60:0/923271823 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe29c150480 0x7fe29c0afef0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:59.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.809+0000 7fe2a2d5f640 1 --2- 172.21.15.60:0/923271823 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe29c0ca390 0x7fe29c158400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:59.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.809+0000 7fe2a2d5f640 1 --2- 172.21.15.60:0/923271823 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe29c06c650 0x7fe29c14a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:59.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.809+0000 7fe2a2d5f640 1 -- 172.21.15.60:0/923271823 >> 172.21.15.60:0/923271823 conn(0x7fe29c068030 msgr2=0x7fe29c155440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:59.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.810+0000 7fe2a2d5f640 1 -- 172.21.15.60:0/923271823 shutdown_connections 2024-09-12T02:40:59.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.810+0000 7fe2a2d5f640 1 -- 172.21.15.60:0/923271823 wait complete. 2024-09-12T02:40:59.823 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm a --yes-i-really-mean-it 2024-09-12T02:40:59.868 INFO:tasks.ceph.mds.b.smithi105.stdout:starting mds.b at 2024-09-12T02:40:59.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.928+0000 7fd23b877640 1 Processor -- start 2024-09-12T02:40:59.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.928+0000 7fd23b877640 1 -- start start 2024-09-12T02:40:59.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.929+0000 7fd23b877640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd23406fc40 0x7fd234070020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:59.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.929+0000 7fd23b877640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd2340c6a10 0x7fd23406bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:59.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.929+0000 7fd23b877640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2340c4020 con 0x7fd2340c8170 2024-09-12T02:40:59.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.929+0000 7fd23b877640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fd23406e280 con 0x7fd23406fc40 2024-09-12T02:40:59.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.929+0000 7fd23b877640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fd2340c8670 con 0x7fd2340c6a10 2024-09-12T02:40:59.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.929+0000 7fd239613640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd23406fc40 0x7fd234070020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:59.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.929+0000 7fd239613640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd23406fc40 0x7fd234070020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60788/0 (socket says 172.21.15.60:60788) 2024-09-12T02:40:59.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.929+0000 7fd239613640 1 -- 172.21.15.60:0/4174185061 learned_addr learned my addr 172.21.15.60:0/4174185061 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:59.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.929+0000 7fd238e12640 1 --2- 172.21.15.60:0/4174185061 >> v2:172.21.15.105:3300/0 conn(0x7fd2340c6a10 0x7fd23406bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:59.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.929+0000 7fd239613640 1 -- 172.21.15.60:0/4174185061 >> v2:172.21.15.105:3300/0 conn(0x7fd2340c6a10 msgr2=0x7fd23406bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:40:59.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.929+0000 7fd239613640 1 --2- 172.21.15.60:0/4174185061 >> v2:172.21.15.105:3300/0 conn(0x7fd2340c6a10 0x7fd23406bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:59.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.929+0000 7fd239613640 1 -- 172.21.15.60:0/4174185061 >> v1:172.21.15.105:6789/0 conn(0x7fd2340c8170 legacy=0x7fd2340c1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:59.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.930+0000 7fd239613640 1 -- 172.21.15.60:0/4174185061 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2340c74f0 con 0x7fd23406fc40 2024-09-12T02:40:59.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.930+0000 7fd239613640 1 --2- 172.21.15.60:0/4174185061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd23406fc40 0x7fd234070020 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd2340c4940 tx=0x7fd23002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b480e90224832d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:59.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.930+0000 7fd22bfff640 1 -- 172.21.15.60:0/4174185061 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd230036070 con 0x7fd23406fc40 2024-09-12T02:40:59.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.930+0000 7fd22bfff640 1 -- 172.21.15.60:0/4174185061 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fd230031600 con 0x7fd23406fc40 2024-09-12T02:40:59.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.931+0000 7fd22bfff640 1 -- 172.21.15.60:0/4174185061 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2300319f0 con 0x7fd23406fc40 2024-09-12T02:40:59.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.931+0000 7fd23b877640 1 -- 172.21.15.60:0/4174185061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd23406fc40 msgr2=0x7fd234070020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:59.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.931+0000 7fd23b877640 1 --2- 172.21.15.60:0/4174185061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd23406fc40 0x7fd234070020 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd2340c4940 tx=0x7fd23002a730 comp rx=0 tx=0).stop 2024-09-12T02:40:59.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.931+0000 7fd23b877640 1 -- 172.21.15.60:0/4174185061 shutdown_connections 2024-09-12T02:40:59.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.931+0000 7fd23b877640 1 --2- 172.21.15.60:0/4174185061 >> v2:172.21.15.105:3300/0 conn(0x7fd2340c6a10 0x7fd23406bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:59.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.931+0000 7fd23b877640 1 --2- 172.21.15.60:0/4174185061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd23406fc40 0x7fd234070020 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:59.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.931+0000 7fd23b877640 1 -- 172.21.15.60:0/4174185061 >> 172.21.15.60:0/4174185061 conn(0x7fd2340c5580 msgr2=0x7fd2340c5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:40:59.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.931+0000 7fd23b877640 1 -- 172.21.15.60:0/4174185061 shutdown_connections 2024-09-12T02:40:59.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.931+0000 7fd23b877640 1 -- 172.21.15.60:0/4174185061 wait complete. 2024-09-12T02:40:59.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.932+0000 7fd23b877640 1 Processor -- start 2024-09-12T02:40:59.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.932+0000 7fd23b877640 1 -- start start 2024-09-12T02:40:59.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.933+0000 7fd23b877640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd23406fc40 0x7fd2341e01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:59.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.933+0000 7fd23b877640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2340c6a10 0x7fd2340a7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:59.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.933+0000 7fd23b877640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2340c8170 0x7fd2341de9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:59.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.933+0000 7fd23b877640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd2340a84c0 con 0x7fd2340c8170 2024-09-12T02:40:59.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.933+0000 7fd23b877640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd2340c7ab0 con 0x7fd23406fc40 2024-09-12T02:40:59.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.933+0000 7fd23b877640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd2340ab640 con 0x7fd2340c6a10 2024-09-12T02:40:59.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.933+0000 7fd239e14640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2340c8170 0x7fd2341de9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:59.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.933+0000 7fd239e14640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2340c8170 0x7fd2341de9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60792/0 (socket says 172.21.15.60:60792) 2024-09-12T02:40:59.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.933+0000 7fd239e14640 1 -- 172.21.15.60:0/1828229194 learned_addr learned my addr 172.21.15.60:0/1828229194 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:40:59.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.933+0000 7fd239613640 1 --2- 172.21.15.60:0/1828229194 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd23406fc40 0x7fd2341e01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:59.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.933+0000 7fd238e12640 1 --2- 172.21.15.60:0/1828229194 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2340c6a10 0x7fd2340a7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:59.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.933+0000 7fd239e14640 1 -- 172.21.15.60:0/1828229194 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2340c6a10 msgr2=0x7fd2340a7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:59.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.933+0000 7fd239e14640 1 --2- 172.21.15.60:0/1828229194 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2340c6a10 0x7fd2340a7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:59.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.933+0000 7fd239e14640 1 -- 172.21.15.60:0/1828229194 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd23406fc40 msgr2=0x7fd2341e01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:40:59.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.933+0000 7fd239e14640 1 --2- 172.21.15.60:0/1828229194 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd23406fc40 0x7fd2341e01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:40:59.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.934+0000 7fd239e14640 1 -- 172.21.15.60:0/1828229194 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2341efd40 con 0x7fd2340c8170 2024-09-12T02:40:59.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.934+0000 7fd239e14640 1 --2- 172.21.15.60:0/1828229194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2340c8170 0x7fd2341de9c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd22c00c3c0 tx=0x7fd22c00c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:59.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.934+0000 7fd229ffb640 1 -- 172.21.15.60:0/1828229194 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd22c017070 con 0x7fd2340c8170 2024-09-12T02:40:59.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.934+0000 7fd229ffb640 1 -- 172.21.15.60:0/1828229194 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fd22c0052d0 con 0x7fd2340c8170 2024-09-12T02:40:59.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.934+0000 7fd23b877640 1 -- 172.21.15.60:0/1828229194 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2341eef80 con 0x7fd2340c8170 2024-09-12T02:40:59.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.934+0000 7fd229ffb640 1 -- 172.21.15.60:0/1828229194 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd22c003850 con 0x7fd2340c8170 2024-09-12T02:40:59.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.934+0000 7fd23b877640 1 -- 172.21.15.60:0/1828229194 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2341ef540 con 0x7fd2340c8170 2024-09-12T02:40:59.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.935+0000 7fd23b877640 1 -- 172.21.15.60:0/1828229194 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2340c6e90 con 0x7fd2340c8170 2024-09-12T02:40:59.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.935+0000 7fd229ffb640 1 -- 172.21.15.60:0/1828229194 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd22c01a070 con 0x7fd2340c8170 2024-09-12T02:40:59.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.936+0000 7fd229ffb640 1 --2- 172.21.15.60:0/1828229194 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd21806be60 0x7fd21806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:40:59.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.936+0000 7fd229ffb640 1 -- 172.21.15.60:0/1828229194 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6723+0+0 (secure 0 0 0) 0x7fd22c08a5a0 con 0x7fd2340c8170 2024-09-12T02:40:59.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.936+0000 7fd239613640 1 --2- 172.21.15.60:0/1828229194 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd21806be60 0x7fd21806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:40:59.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.937+0000 7fd239613640 1 --2- 172.21.15.60:0/1828229194 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd21806be60 0x7fd21806e320 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fd230033000 tx=0x7fd230009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:40:59.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:40:59.941+0000 7fd229ffb640 1 -- 172.21.15.60:0/1828229194 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd2340c6e90 con 0x7fd2340c8170 2024-09-12T02:41:00.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.154+0000 7fd23b877640 1 -- 172.21.15.60:0/1828229194 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "a", "yes_i_really_mean_it": true} v 0) -- 0x7fd2340c6310 con 0x7fd2340c8170 2024-09-12T02:41:00.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.813+0000 7fd229ffb640 1 -- 172.21.15.60:0/1828229194 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "a", "yes_i_really_mean_it": true}]=0 v13) ==== 99+0+0 (secure 0 0 0) 0x7fd22c058470 con 0x7fd2340c8170 2024-09-12T02:41:00.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.817+0000 7fd23b877640 1 -- 172.21.15.60:0/1828229194 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd21806be60 msgr2=0x7fd21806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:00.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.817+0000 7fd23b877640 1 --2- 172.21.15.60:0/1828229194 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd21806be60 0x7fd21806e320 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fd230033000 tx=0x7fd230009000 comp rx=0 tx=0).stop 2024-09-12T02:41:00.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.817+0000 7fd23b877640 1 -- 172.21.15.60:0/1828229194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2340c8170 msgr2=0x7fd2341de9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:00.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.817+0000 7fd23b877640 1 --2- 172.21.15.60:0/1828229194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2340c8170 0x7fd2341de9c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd22c00c3c0 tx=0x7fd22c00c7c0 comp rx=0 tx=0).stop 2024-09-12T02:41:00.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.817+0000 7fd23b877640 1 -- 172.21.15.60:0/1828229194 shutdown_connections 2024-09-12T02:41:00.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.817+0000 7fd23b877640 1 --2- 172.21.15.60:0/1828229194 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd21806be60 0x7fd21806e320 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:00.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.817+0000 7fd23b877640 1 --2- 172.21.15.60:0/1828229194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2340c8170 0x7fd2341de9c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:00.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.817+0000 7fd23b877640 1 --2- 172.21.15.60:0/1828229194 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2340c6a10 0x7fd2340a7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:00.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.817+0000 7fd23b877640 1 --2- 172.21.15.60:0/1828229194 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd23406fc40 0x7fd2341e01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:00.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.817+0000 7fd23b877640 1 -- 172.21.15.60:0/1828229194 >> 172.21.15.60:0/1828229194 conn(0x7fd2340c5580 msgr2=0x7fd23406d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:00.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.817+0000 7fd23b877640 1 -- 172.21.15.60:0/1828229194 shutdown_connections 2024-09-12T02:41:00.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.817+0000 7fd23b877640 1 -- 172.21.15.60:0/1828229194 wait complete. 2024-09-12T02:41:00.832 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm a_metadata a_metadata --yes-i-really-really-mean-it 2024-09-12T02:41:00.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.946+0000 7fcfa4882640 1 Processor -- start 2024-09-12T02:41:00.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.946+0000 7fcfa4882640 1 -- start start 2024-09-12T02:41:00.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.947+0000 7fcfa4882640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcfa00af1b0 0x7fcfa00c6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:00.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.947+0000 7fcfa4882640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfa00ab5a0 0x7fcfa01576a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:00.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.947+0000 7fcfa4882640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfa00c53c0 con 0x7fcfa014e320 2024-09-12T02:41:00.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.947+0000 7fcfa4882640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fcfa00c56a0 con 0x7fcfa00af1b0 2024-09-12T02:41:00.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.947+0000 7fcfa4882640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcfa00c5980 con 0x7fcfa00ab5a0 2024-09-12T02:41:00.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.947+0000 7fcf9dd9b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcfa00af1b0 0x7fcfa00c6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:00.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.947+0000 7fcf9dd9b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcfa00af1b0 0x7fcfa00c6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60798/0 (socket says 172.21.15.60:60798) 2024-09-12T02:41:00.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.947+0000 7fcf9dd9b640 1 -- 172.21.15.60:0/1706652219 learned_addr learned my addr 172.21.15.60:0/1706652219 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:41:00.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.948+0000 7fcf9ed9d640 1 --2- 172.21.15.60:0/1706652219 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfa00ab5a0 0x7fcfa01576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:00.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.948+0000 7fcf9dd9b640 1 -- 172.21.15.60:0/1706652219 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfa00ab5a0 msgr2=0x7fcfa01576a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:00.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.948+0000 7fcf9dd9b640 1 --2- 172.21.15.60:0/1706652219 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfa00ab5a0 0x7fcfa01576a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:00.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.948+0000 7fcf9dd9b640 1 -- 172.21.15.60:0/1706652219 >> v1:172.21.15.105:6789/0 conn(0x7fcfa014e320 legacy=0x7fcfa006ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:00.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.948+0000 7fcf9dd9b640 1 -- 172.21.15.60:0/1706652219 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfa00c5c60 con 0x7fcfa00af1b0 2024-09-12T02:41:00.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.949+0000 7fcf9dd9b640 1 --2- 172.21.15.60:0/1706652219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfa00af1b0 0x7fcfa00c6180 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcf94009870 tx=0x7fcf9402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cddf7a1ade50ec server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:00.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.949+0000 7fcf9d59a640 1 -- 172.21.15.60:0/1706652219 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf94037070 con 0x7fcfa00af1b0 2024-09-12T02:41:00.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.949+0000 7fcf9d59a640 1 -- 172.21.15.60:0/1706652219 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fcf94032440 con 0x7fcfa00af1b0 2024-09-12T02:41:00.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.949+0000 7fcf9d59a640 1 -- 172.21.15.60:0/1706652219 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf94032830 con 0x7fcfa00af1b0 2024-09-12T02:41:00.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.949+0000 7fcfa4882640 1 -- 172.21.15.60:0/1706652219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfa00af1b0 msgr2=0x7fcfa00c6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:00.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.949+0000 7fcfa4882640 1 --2- 172.21.15.60:0/1706652219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfa00af1b0 0x7fcfa00c6180 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcf94009870 tx=0x7fcf9402a1c0 comp rx=0 tx=0).stop 2024-09-12T02:41:00.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.949+0000 7fcfa4882640 1 -- 172.21.15.60:0/1706652219 shutdown_connections 2024-09-12T02:41:00.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.949+0000 7fcfa4882640 1 --2- 172.21.15.60:0/1706652219 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfa00ab5a0 0x7fcfa01576a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:00.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.949+0000 7fcfa4882640 1 --2- 172.21.15.60:0/1706652219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfa00af1b0 0x7fcfa00c6180 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:00.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.949+0000 7fcfa4882640 1 -- 172.21.15.60:0/1706652219 >> 172.21.15.60:0/1706652219 conn(0x7fcfa00c6910 msgr2=0x7fcfa00c6d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:00.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.950+0000 7fcfa4882640 1 -- 172.21.15.60:0/1706652219 shutdown_connections 2024-09-12T02:41:00.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.950+0000 7fcfa4882640 1 -- 172.21.15.60:0/1706652219 wait complete. 2024-09-12T02:41:00.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.951+0000 7fcfa4882640 1 Processor -- start 2024-09-12T02:41:00.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.951+0000 7fcfa4882640 1 -- start start 2024-09-12T02:41:00.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.951+0000 7fcfa4882640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfa00ab5a0 0x7fcfa01ee040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:00.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.951+0000 7fcfa4882640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfa00af1b0 0x7fcfa0154860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:00.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.951+0000 7fcfa4882640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfa014e320 0x7fcfa01e9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:00.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.951+0000 7fcfa4882640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa0157be0 con 0x7fcfa00ab5a0 2024-09-12T02:41:00.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.951+0000 7fcfa4882640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa00ab9d0 con 0x7fcfa00af1b0 2024-09-12T02:41:00.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.951+0000 7fcfa4882640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcfa0157d60 con 0x7fcfa014e320 2024-09-12T02:41:00.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.952+0000 7fcf9e59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfa00ab5a0 0x7fcfa01ee040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:00.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.952+0000 7fcf9e59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfa00ab5a0 0x7fcfa01ee040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60804/0 (socket says 172.21.15.60:60804) 2024-09-12T02:41:00.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.952+0000 7fcf9e59c640 1 -- 172.21.15.60:0/2794204289 learned_addr learned my addr 172.21.15.60:0/2794204289 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:41:00.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.952+0000 7fcf9ed9d640 1 --2- 172.21.15.60:0/2794204289 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfa014e320 0x7fcfa01e9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:00.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.952+0000 7fcf9dd9b640 1 --2- 172.21.15.60:0/2794204289 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfa00af1b0 0x7fcfa0154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:00.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.952+0000 7fcf9e59c640 1 -- 172.21.15.60:0/2794204289 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfa014e320 msgr2=0x7fcfa01e9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:00.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.952+0000 7fcf9e59c640 1 --2- 172.21.15.60:0/2794204289 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfa014e320 0x7fcfa01e9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:00.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.952+0000 7fcf9e59c640 1 -- 172.21.15.60:0/2794204289 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfa00af1b0 msgr2=0x7fcfa0154860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:00.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.952+0000 7fcf9e59c640 1 --2- 172.21.15.60:0/2794204289 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfa00af1b0 0x7fcfa0154860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:00.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.952+0000 7fcf9e59c640 1 -- 172.21.15.60:0/2794204289 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfa0147840 con 0x7fcfa00ab5a0 2024-09-12T02:41:00.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.952+0000 7fcf9ed9d640 1 --2- 172.21.15.60:0/2794204289 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfa014e320 0x7fcfa01e9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:41:00.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.952+0000 7fcf9dd9b640 1 --2- 172.21.15.60:0/2794204289 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfa00af1b0 0x7fcfa0154860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:41:00.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.952+0000 7fcf9e59c640 1 --2- 172.21.15.60:0/2794204289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfa00ab5a0 0x7fcfa01ee040 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcf9000c3c0 tx=0x7fcf9000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:00.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.952+0000 7fcf8effd640 1 -- 172.21.15.60:0/2794204289 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf900052d0 con 0x7fcfa00ab5a0 2024-09-12T02:41:00.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.952+0000 7fcf8effd640 1 -- 172.21.15.60:0/2794204289 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fcf90005490 con 0x7fcfa00ab5a0 2024-09-12T02:41:00.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.952+0000 7fcfa4882640 1 -- 172.21.15.60:0/2794204289 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfa0147560 con 0x7fcfa00ab5a0 2024-09-12T02:41:00.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.952+0000 7fcf8effd640 1 -- 172.21.15.60:0/2794204289 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf90007280 con 0x7fcfa00ab5a0 2024-09-12T02:41:00.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.952+0000 7fcfa4882640 1 -- 172.21.15.60:0/2794204289 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfa01ed840 con 0x7fcfa00ab5a0 2024-09-12T02:41:00.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.953+0000 7fcfa4882640 1 -- 172.21.15.60:0/2794204289 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfa0158150 con 0x7fcfa00ab5a0 2024-09-12T02:41:00.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.954+0000 7fcf8effd640 1 -- 172.21.15.60:0/2794204289 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcf90007420 con 0x7fcfa00ab5a0 2024-09-12T02:41:00.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.954+0000 7fcf8effd640 1 --2- 172.21.15.60:0/2794204289 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcf8006be30 0x7fcf8006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:00.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.954+0000 7fcf8effd640 1 -- 172.21.15.60:0/2794204289 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6723+0+0 (secure 0 0 0) 0x7fcf9008a6b0 con 0x7fcfa00ab5a0 2024-09-12T02:41:00.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.954+0000 7fcf9dd9b640 1 --2- 172.21.15.60:0/2794204289 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcf8006be30 0x7fcf8006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:00.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.955+0000 7fcf9dd9b640 1 --2- 172.21.15.60:0/2794204289 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcf8006be30 0x7fcf8006e2f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fcf94034000 tx=0x7fcf9402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:00.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:00.959+0000 7fcf8effd640 1 -- 172.21.15.60:0/2794204289 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcf90058cf0 con 0x7fcfa00ab5a0 2024-09-12T02:41:01.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.137+0000 7fcfa4882640 1 -- 172.21.15.60:0/2794204289 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "a_metadata", "pool2": "a_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fcfa006f240 con 0x7fcfa00ab5a0 2024-09-12T02:41:01.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.821+0000 7fcf8effd640 1 -- 172.21.15.60:0/2794204289 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "a_metadata", "pool2": "a_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'a_metadata' removed v30) ==== 166+0+0 (secure 0 0 0) 0x7fcf900585f0 con 0x7fcfa00ab5a0 2024-09-12T02:41:01.822 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'a_metadata' removed 2024-09-12T02:41:01.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.824+0000 7fcfa4882640 1 -- 172.21.15.60:0/2794204289 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcf8006be30 msgr2=0x7fcf8006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:01.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.824+0000 7fcfa4882640 1 --2- 172.21.15.60:0/2794204289 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcf8006be30 0x7fcf8006e2f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fcf94034000 tx=0x7fcf9402e000 comp rx=0 tx=0).stop 2024-09-12T02:41:01.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.824+0000 7fcfa4882640 1 -- 172.21.15.60:0/2794204289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfa00ab5a0 msgr2=0x7fcfa01ee040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:01.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.824+0000 7fcfa4882640 1 --2- 172.21.15.60:0/2794204289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfa00ab5a0 0x7fcfa01ee040 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcf9000c3c0 tx=0x7fcf9000c880 comp rx=0 tx=0).stop 2024-09-12T02:41:01.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.824+0000 7fcfa4882640 1 -- 172.21.15.60:0/2794204289 shutdown_connections 2024-09-12T02:41:01.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.824+0000 7fcfa4882640 1 --2- 172.21.15.60:0/2794204289 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fcf8006be30 0x7fcf8006e2f0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:01.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.824+0000 7fcfa4882640 1 --2- 172.21.15.60:0/2794204289 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfa014e320 0x7fcfa01e9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:01.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.824+0000 7fcfa4882640 1 --2- 172.21.15.60:0/2794204289 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfa00af1b0 0x7fcfa0154860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:01.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.824+0000 7fcfa4882640 1 --2- 172.21.15.60:0/2794204289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfa00ab5a0 0x7fcfa01ee040 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:01.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.824+0000 7fcfa4882640 1 -- 172.21.15.60:0/2794204289 >> 172.21.15.60:0/2794204289 conn(0x7fcfa00c6910 msgr2=0x7fcfa0073ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:01.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.824+0000 7fcfa4882640 1 -- 172.21.15.60:0/2794204289 shutdown_connections 2024-09-12T02:41:01.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.824+0000 7fcfa4882640 1 -- 172.21.15.60:0/2794204289 wait complete. 2024-09-12T02:41:01.838 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm a_data a_data --yes-i-really-really-mean-it 2024-09-12T02:41:01.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.951+0000 7fd2deb8d640 1 Processor -- start 2024-09-12T02:41:01.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.951+0000 7fd2deb8d640 1 -- start start 2024-09-12T02:41:01.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.952+0000 7fd2deb8d640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd2d80684f0 0x7fd2d81536d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:01.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.952+0000 7fd2deb8d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd2d8153c10 0x7fd2d8156290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:01.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.952+0000 7fd2deb8d640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2d806c480 con 0x7fd2d80c6960 2024-09-12T02:41:01.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.952+0000 7fd2deb8d640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fd2d806c230 con 0x7fd2d8153c10 2024-09-12T02:41:01.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.952+0000 7fd2deb8d640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fd2d806cdb0 con 0x7fd2d80684f0 2024-09-12T02:41:01.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.952+0000 7fd2dd12a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd2d8153c10 0x7fd2d8156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:01.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.952+0000 7fd2dc929640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fd2d80c6960 0x7fd2d80c9c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45618/0 (socket says 172.21.15.60:45618) 2024-09-12T02:41:01.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.952+0000 7fd2dc929640 1 -- 172.21.15.60:0/3214004880 learned_addr learned my addr 172.21.15.60:0/3214004880 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:41:01.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.952+0000 7fd2dd12a640 1 -- 172.21.15.60:0/3214004880 >> v2:172.21.15.105:3300/0 conn(0x7fd2d80684f0 msgr2=0x7fd2d81536d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:01.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.952+0000 7fd2d7fff640 1 --2- 172.21.15.60:0/3214004880 >> v2:172.21.15.105:3300/0 conn(0x7fd2d80684f0 0x7fd2d81536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:01.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.952+0000 7fd2dd12a640 1 --2- 172.21.15.60:0/3214004880 >> v2:172.21.15.105:3300/0 conn(0x7fd2d80684f0 0x7fd2d81536d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:01.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.952+0000 7fd2dd12a640 1 -- 172.21.15.60:0/3214004880 >> v1:172.21.15.60:6789/0 conn(0x7fd2d80c6960 legacy=0x7fd2d80c9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:01.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.952+0000 7fd2d77fe640 1 -- 172.21.15.60:0/3214004880 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 23981026 0 0) 0x7fd2d806c480 con 0x7fd2d80c6960 2024-09-12T02:41:01.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.952+0000 7fd2dd12a640 1 -- 172.21.15.60:0/3214004880 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2d806c760 con 0x7fd2d8153c10 2024-09-12T02:41:01.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.953+0000 7fd2dd12a640 1 --2- 172.21.15.60:0/3214004880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2d8153c10 0x7fd2d8156290 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd2d80b2060 tx=0x7fd2d002a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c78cb8ccb15c5ae server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:01.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.953+0000 7fd2d77fe640 1 -- 172.21.15.60:0/3214004880 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d0007740 con 0x7fd2d8153c10 2024-09-12T02:41:01.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.953+0000 7fd2d77fe640 1 -- 172.21.15.60:0/3214004880 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fd2d00078e0 con 0x7fd2d8153c10 2024-09-12T02:41:01.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.953+0000 7fd2d77fe640 1 -- 172.21.15.60:0/3214004880 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d0007cd0 con 0x7fd2d8153c10 2024-09-12T02:41:01.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.954+0000 7fd2deb8d640 1 -- 172.21.15.60:0/3214004880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2d8153c10 msgr2=0x7fd2d8156290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:01.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.954+0000 7fd2deb8d640 1 --2- 172.21.15.60:0/3214004880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2d8153c10 0x7fd2d8156290 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd2d80b2060 tx=0x7fd2d002a560 comp rx=0 tx=0).stop 2024-09-12T02:41:01.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.954+0000 7fd2deb8d640 1 -- 172.21.15.60:0/3214004880 shutdown_connections 2024-09-12T02:41:01.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.954+0000 7fd2deb8d640 1 --2- 172.21.15.60:0/3214004880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2d8153c10 0x7fd2d8156290 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:01.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.954+0000 7fd2deb8d640 1 --2- 172.21.15.60:0/3214004880 >> v2:172.21.15.105:3300/0 conn(0x7fd2d80684f0 0x7fd2d81536d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:01.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.954+0000 7fd2deb8d640 1 -- 172.21.15.60:0/3214004880 >> 172.21.15.60:0/3214004880 conn(0x7fd2d80c87f0 msgr2=0x7fd2d80c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:01.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.954+0000 7fd2deb8d640 1 -- 172.21.15.60:0/3214004880 shutdown_connections 2024-09-12T02:41:01.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.954+0000 7fd2deb8d640 1 -- 172.21.15.60:0/3214004880 wait complete. 2024-09-12T02:41:01.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.955+0000 7fd2deb8d640 1 Processor -- start 2024-09-12T02:41:01.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.955+0000 7fd2deb8d640 1 -- start start 2024-09-12T02:41:01.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.956+0000 7fd2deb8d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2d80684f0 0x7fd2d81ef760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:01.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.956+0000 7fd2deb8d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2d80c6960 0x7fd2d8142230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:01.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.956+0000 7fd2deb8d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2d8153c10 0x7fd2d8142770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:01.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.956+0000 7fd2deb8d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d80c6ec0 con 0x7fd2d80684f0 2024-09-12T02:41:01.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.956+0000 7fd2deb8d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d80c6d40 con 0x7fd2d80c6960 2024-09-12T02:41:01.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.956+0000 7fd2deb8d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd2d81567d0 con 0x7fd2d8153c10 2024-09-12T02:41:01.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.956+0000 7fd2dc929640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2d80684f0 0x7fd2d81ef760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:01.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.956+0000 7fd2dd12a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2d8153c10 0x7fd2d8142770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:01.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.956+0000 7fd2d7fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2d80c6960 0x7fd2d8142230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:01.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.956+0000 7fd2dc929640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2d80684f0 0x7fd2d81ef760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60828/0 (socket says 172.21.15.60:60828) 2024-09-12T02:41:01.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.956+0000 7fd2dd12a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2d8153c10 0x7fd2d8142770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:42986/0 (socket says 172.21.15.60:42986) 2024-09-12T02:41:01.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.956+0000 7fd2dc929640 1 -- 172.21.15.60:0/3911738626 learned_addr learned my addr 172.21.15.60:0/3911738626 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:41:01.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.957+0000 7fd2dc929640 1 -- 172.21.15.60:0/3911738626 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2d8153c10 msgr2=0x7fd2d8142770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:01.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.957+0000 7fd2dc929640 1 --2- 172.21.15.60:0/3911738626 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2d8153c10 0x7fd2d8142770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:01.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.957+0000 7fd2dc929640 1 -- 172.21.15.60:0/3911738626 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2d80c6960 msgr2=0x7fd2d8142230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:01.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.957+0000 7fd2dc929640 1 --2- 172.21.15.60:0/3911738626 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2d80c6960 0x7fd2d8142230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:01.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.957+0000 7fd2dc929640 1 -- 172.21.15.60:0/3911738626 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2d8142f00 con 0x7fd2d80684f0 2024-09-12T02:41:01.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.957+0000 7fd2d7fff640 1 --2- 172.21.15.60:0/3911738626 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2d80c6960 0x7fd2d8142230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:41:01.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.957+0000 7fd2dc929640 1 --2- 172.21.15.60:0/3911738626 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2d80684f0 0x7fd2d81ef760 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc00c500 tx=0x7fd2cc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:01.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.957+0000 7fd2d57fa640 1 -- 172.21.15.60:0/3911738626 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc018070 con 0x7fd2d80684f0 2024-09-12T02:41:01.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.957+0000 7fd2d57fa640 1 -- 172.21.15.60:0/3911738626 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fd2cc007580 con 0x7fd2d80684f0 2024-09-12T02:41:01.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.958+0000 7fd2d57fa640 1 -- 172.21.15.60:0/3911738626 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc004a40 con 0x7fd2d80684f0 2024-09-12T02:41:01.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.961+0000 7fd2deb8d640 1 -- 172.21.15.60:0/3911738626 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2d81f0030 con 0x7fd2d80684f0 2024-09-12T02:41:01.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.961+0000 7fd2deb8d640 1 -- 172.21.15.60:0/3911738626 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2d80b13e0 con 0x7fd2d80684f0 2024-09-12T02:41:01.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.964+0000 7fd2deb8d640 1 -- 172.21.15.60:0/3911738626 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2d806c3b0 con 0x7fd2d80684f0 2024-09-12T02:41:01.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.965+0000 7fd2d57fa640 1 -- 172.21.15.60:0/3911738626 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd2cc01b070 con 0x7fd2d80684f0 2024-09-12T02:41:01.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.966+0000 7fd2d57fa640 1 --2- 172.21.15.60:0/3911738626 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd2bc06bea0 0x7fd2bc06e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:01.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.966+0000 7fd2d57fa640 1 -- 172.21.15.60:0/3911738626 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6295+0+0 (secure 0 0 0) 0x7fd2cc08a3a0 con 0x7fd2d80684f0 2024-09-12T02:41:01.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.972+0000 7fd2d7fff640 1 --2- 172.21.15.60:0/3911738626 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd2bc06bea0 0x7fd2bc06e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:01.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.972+0000 7fd2d7fff640 1 --2- 172.21.15.60:0/3911738626 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd2bc06bea0 0x7fd2bc06e360 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8144190 tx=0x7fd2c4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:01.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:01.973+0000 7fd2d57fa640 1 -- 172.21.15.60:0/3911738626 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd2cc04fd50 con 0x7fd2d80684f0 2024-09-12T02:41:02.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:02.150+0000 7fd2deb8d640 1 -- 172.21.15.60:0/3911738626 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "a_data", "pool2": "a_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd2d8151e80 con 0x7fd2d80684f0 2024-09-12T02:41:02.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:02.826+0000 7fd2d57fa640 1 -- 172.21.15.60:0/3911738626 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "a_data", "pool2": "a_data", "yes_i_really_really_mean_it": true}]=0 pool 'a_data' removed v31) ==== 154+0+0 (secure 0 0 0) 0x7fd2d8151e80 con 0x7fd2d80684f0 2024-09-12T02:41:02.827 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'a_data' removed 2024-09-12T02:41:02.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:02.837+0000 7fd2deb8d640 1 -- 172.21.15.60:0/3911738626 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd2bc06bea0 msgr2=0x7fd2bc06e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:02.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:02.837+0000 7fd2deb8d640 1 --2- 172.21.15.60:0/3911738626 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd2bc06bea0 0x7fd2bc06e360 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8144190 tx=0x7fd2c4008040 comp rx=0 tx=0).stop 2024-09-12T02:41:02.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:02.837+0000 7fd2deb8d640 1 -- 172.21.15.60:0/3911738626 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2d80684f0 msgr2=0x7fd2d81ef760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:02.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:02.837+0000 7fd2deb8d640 1 --2- 172.21.15.60:0/3911738626 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2d80684f0 0x7fd2d81ef760 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc00c500 tx=0x7fd2cc00c9c0 comp rx=0 tx=0).stop 2024-09-12T02:41:02.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:02.837+0000 7fd2deb8d640 1 -- 172.21.15.60:0/3911738626 shutdown_connections 2024-09-12T02:41:02.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:02.837+0000 7fd2deb8d640 1 --2- 172.21.15.60:0/3911738626 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fd2bc06bea0 0x7fd2bc06e360 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:02.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:02.837+0000 7fd2deb8d640 1 --2- 172.21.15.60:0/3911738626 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2d8153c10 0x7fd2d8142770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:02.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:02.837+0000 7fd2deb8d640 1 --2- 172.21.15.60:0/3911738626 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2d80c6960 0x7fd2d8142230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:02.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:02.837+0000 7fd2deb8d640 1 --2- 172.21.15.60:0/3911738626 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2d80684f0 0x7fd2d81ef760 secure :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc00c500 tx=0x7fd2cc00c9c0 comp rx=0 tx=0).stop 2024-09-12T02:41:02.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:02.837+0000 7fd2deb8d640 1 -- 172.21.15.60:0/3911738626 >> 172.21.15.60:0/3911738626 conn(0x7fd2d80c87f0 msgr2=0x7fd2d8148d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:02.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:02.840+0000 7fd2deb8d640 1 -- 172.21.15.60:0/3911738626 shutdown_connections 2024-09-12T02:41:02.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:02.841+0000 7fd2deb8d640 1 -- 172.21.15.60:0/3911738626 wait complete. 2024-09-12T02:41:02.864 INFO:tasks.cephfs.filesystem:Destroying file system b and related pools 2024-09-12T02:41:02.865 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:41:03.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:02.999+0000 7fa83b227640 1 Processor -- start 2024-09-12T02:41:03.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:02.999+0000 7fa83b227640 1 -- start start 2024-09-12T02:41:03.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.000+0000 7fa83b227640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8341505f0 0x7fa834153910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:03.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.000+0000 7fa83b227640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8340c5940 con 0x7fa8340c42b0 2024-09-12T02:41:03.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.000+0000 7fa83b227640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8340c5c00 con 0x7fa8340c69c0 2024-09-12T02:41:03.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.000+0000 7fa83b227640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa8340c7860 con 0x7fa8341505f0 2024-09-12T02:41:03.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.000+0000 7fa8397c4640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa8340c42b0 0x7fa8340c46d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45632/0 (socket says 172.21.15.60:45632) 2024-09-12T02:41:03.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.000+0000 7fa8397c4640 1 -- 172.21.15.60:0/927711983 learned_addr learned my addr 172.21.15.60:0/927711983 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:41:03.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.001+0000 7fa838fc3640 1 --2- 172.21.15.60:0/927711983 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8341505f0 0x7fa834153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:03.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.001+0000 7fa8337fe640 1 -- 172.21.15.60:0/927711983 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 890971597 0 0) 0x7fa8340c5940 con 0x7fa8340c42b0 2024-09-12T02:41:03.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.001+0000 7fa8337fe640 1 -- 172.21.15.60:0/927711983 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa81c003520 con 0x7fa8340c42b0 2024-09-12T02:41:03.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.001+0000 7fa8337fe640 1 -- 172.21.15.60:0/927711983 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3949065127 0 0) 0x7fa8340c5c00 con 0x7fa8340c69c0 2024-09-12T02:41:03.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.001+0000 7fa8337fe640 1 -- 172.21.15.60:0/927711983 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8340c5940 con 0x7fa8340c69c0 2024-09-12T02:41:03.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.001+0000 7fa8337fe640 1 -- 172.21.15.60:0/927711983 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 36977591 0 0) 0x7fa81c003520 con 0x7fa8340c42b0 2024-09-12T02:41:03.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.001+0000 7fa8337fe640 1 -- 172.21.15.60:0/927711983 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8341505f0 msgr2=0x7fa834153910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:03.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.001+0000 7fa8337fe640 1 --2- 172.21.15.60:0/927711983 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8341505f0 0x7fa834153910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:03.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.001+0000 7fa8337fe640 1 -- 172.21.15.60:0/927711983 >> v1:172.21.15.105:6789/0 conn(0x7fa8340c69c0 legacy=0x7fa8340c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:03.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.001+0000 7fa8337fe640 1 -- 172.21.15.60:0/927711983 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8340c5ee0 con 0x7fa8340c42b0 2024-09-12T02:41:03.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.001+0000 7fa8337fe640 1 -- 172.21.15.60:0/927711983 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1139158183 0 0) 0x7fa82c0019f0 con 0x7fa8340c42b0 2024-09-12T02:41:03.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.001+0000 7fa8337fe640 1 -- 172.21.15.60:0/927711983 >> v1:172.21.15.60:6789/0 conn(0x7fa8340c42b0 legacy=0x7fa8340c46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:03.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.001+0000 7fa8337fe640 1 --2- 172.21.15.60:0/927711983 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8341505f0 0x7fa81c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:03.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.001+0000 7fa8337fe640 1 --2- 172.21.15.60:0/927711983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa81c0040d0 0x7fa81c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:03.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.001+0000 7fa8337fe640 1 --2- 172.21.15.60:0/927711983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa81c004d40 0x7fa81c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:03.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.001+0000 7fa8337fe640 1 -- 172.21.15.60:0/927711983 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa81c00bb50 con 0x7fa81c004d40 2024-09-12T02:41:03.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.001+0000 7fa8337fe640 1 -- 172.21.15.60:0/927711983 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa81c00bcd0 con 0x7fa81c0040d0 2024-09-12T02:41:03.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.001+0000 7fa8337fe640 1 -- 172.21.15.60:0/927711983 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa81c00e0b0 con 0x7fa8341505f0 2024-09-12T02:41:03.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.001+0000 7fa8397c4640 1 --2- 172.21.15.60:0/927711983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa81c004d40 0x7fa81c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:03.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.001+0000 7fa838fc3640 1 --2- 172.21.15.60:0/927711983 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8341505f0 0x7fa81c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:03.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.001+0000 7fa833fff640 1 --2- 172.21.15.60:0/927711983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa81c0040d0 0x7fa81c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:03.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.001+0000 7fa838fc3640 1 -- 172.21.15.60:0/927711983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa81c0040d0 msgr2=0x7fa81c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:03.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.001+0000 7fa838fc3640 1 --2- 172.21.15.60:0/927711983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa81c0040d0 0x7fa81c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:03.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.001+0000 7fa838fc3640 1 -- 172.21.15.60:0/927711983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa81c004d40 msgr2=0x7fa81c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:03.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.001+0000 7fa838fc3640 1 --2- 172.21.15.60:0/927711983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa81c004d40 0x7fa81c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:03.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.001+0000 7fa838fc3640 1 -- 172.21.15.60:0/927711983 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa81c003520 con 0x7fa8341505f0 2024-09-12T02:41:03.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.001+0000 7fa8397c4640 1 --2- 172.21.15.60:0/927711983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa81c004d40 0x7fa81c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:41:03.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.002+0000 7fa838fc3640 1 --2- 172.21.15.60:0/927711983 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8341505f0 0x7fa81c003b70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa824009ac0 tx=0x7fa81c005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1f1ceb4ccaf751a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:03.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.002+0000 7fa8337fe640 1 -- 172.21.15.60:0/927711983 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa824036070 con 0x7fa8341505f0 2024-09-12T02:41:03.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.002+0000 7fa8337fe640 1 -- 172.21.15.60:0/927711983 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa824031400 con 0x7fa8341505f0 2024-09-12T02:41:03.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.002+0000 7fa8337fe640 1 -- 172.21.15.60:0/927711983 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa824009690 con 0x7fa8341505f0 2024-09-12T02:41:03.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.003+0000 7fa83b227640 1 -- 172.21.15.60:0/927711983 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8341505f0 msgr2=0x7fa81c003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:03.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.003+0000 7fa83b227640 1 --2- 172.21.15.60:0/927711983 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8341505f0 0x7fa81c003b70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa824009ac0 tx=0x7fa81c005830 comp rx=0 tx=0).stop 2024-09-12T02:41:03.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.003+0000 7fa8397c4640 1 -- 172.21.15.60:0/927711983 reap_dead start 2024-09-12T02:41:03.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.003+0000 7fa83b227640 1 -- 172.21.15.60:0/927711983 shutdown_connections 2024-09-12T02:41:03.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.003+0000 7fa83b227640 1 -- 172.21.15.60:0/927711983 >> 172.21.15.60:0/927711983 conn(0x7fa8340c7a40 msgr2=0x7fa8340c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:03.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.003+0000 7fa83b227640 1 -- 172.21.15.60:0/927711983 shutdown_connections 2024-09-12T02:41:03.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.003+0000 7fa83b227640 1 -- 172.21.15.60:0/927711983 wait complete. 2024-09-12T02:41:03.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.004+0000 7fa83b227640 1 Processor -- start 2024-09-12T02:41:03.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.004+0000 7fa83b227640 1 -- start start 2024-09-12T02:41:03.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.005+0000 7fa83b227640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8341505f0 0x7fa8341524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:03.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.005+0000 7fa83b227640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa83414f380 0x7fa8340c0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:03.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.005+0000 7fa83b227640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8340c13b0 0x7fa8341515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:03.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.005+0000 7fa83b227640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa8341509d0 con 0x7fa8341505f0 2024-09-12T02:41:03.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.005+0000 7fa83b227640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa8340c64a0 con 0x7fa83414f380 2024-09-12T02:41:03.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.005+0000 7fa83b227640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa834150b50 con 0x7fa8340c13b0 2024-09-12T02:41:03.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.005+0000 7fa838fc3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8341505f0 0x7fa8341524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:03.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.005+0000 7fa838fc3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8341505f0 0x7fa8341524f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60852/0 (socket says 172.21.15.60:60852) 2024-09-12T02:41:03.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.005+0000 7fa838fc3640 1 -- 172.21.15.60:0/1966122603 learned_addr learned my addr 172.21.15.60:0/1966122603 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:41:03.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.005+0000 7fa833fff640 1 --2- 172.21.15.60:0/1966122603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa83414f380 0x7fa8340c0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:03.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.006+0000 7fa838fc3640 1 -- 172.21.15.60:0/1966122603 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8340c13b0 msgr2=0x7fa8341515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:03.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.006+0000 7fa838fc3640 1 --2- 172.21.15.60:0/1966122603 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8340c13b0 0x7fa8341515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:03.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.006+0000 7fa838fc3640 1 -- 172.21.15.60:0/1966122603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa83414f380 msgr2=0x7fa8340c0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:03.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.006+0000 7fa838fc3640 1 --2- 172.21.15.60:0/1966122603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa83414f380 0x7fa8340c0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:03.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.006+0000 7fa838fc3640 1 -- 172.21.15.60:0/1966122603 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa83414e740 con 0x7fa8341505f0 2024-09-12T02:41:03.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.006+0000 7fa833fff640 1 --2- 172.21.15.60:0/1966122603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa83414f380 0x7fa8340c0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:41:03.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.006+0000 7fa838fc3640 1 --2- 172.21.15.60:0/1966122603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8341505f0 0x7fa8341524f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa82402abe0 tx=0x7fa824004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:03.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.006+0000 7fa8317fa640 1 -- 172.21.15.60:0/1966122603 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82403f020 con 0x7fa8341505f0 2024-09-12T02:41:03.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.006+0000 7fa8317fa640 1 -- 172.21.15.60:0/1966122603 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa824037040 con 0x7fa8341505f0 2024-09-12T02:41:03.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.006+0000 7fa83b227640 1 -- 172.21.15.60:0/1966122603 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8340ada00 con 0x7fa8341505f0 2024-09-12T02:41:03.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.006+0000 7fa8317fa640 1 -- 172.21.15.60:0/1966122603 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa824036070 con 0x7fa8341505f0 2024-09-12T02:41:03.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.006+0000 7fa83b227640 1 -- 172.21.15.60:0/1966122603 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa834152a30 con 0x7fa8341505f0 2024-09-12T02:41:03.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.007+0000 7fa83b227640 1 -- 172.21.15.60:0/1966122603 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa834069840 con 0x7fa8341505f0 2024-09-12T02:41:03.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.007+0000 7fa8317fa640 1 -- 172.21.15.60:0/1966122603 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa824042020 con 0x7fa8341505f0 2024-09-12T02:41:03.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.008+0000 7fa8317fa640 1 --2- 172.21.15.60:0/1966122603 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa82006be60 0x7fa82006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:03.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.008+0000 7fa8317fa640 1 -- 172.21.15.60:0/1966122603 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5775+0+0 (secure 0 0 0) 0x7fa8240aaf90 con 0x7fa8341505f0 2024-09-12T02:41:03.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.008+0000 7fa833fff640 1 --2- 172.21.15.60:0/1966122603 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa82006be60 0x7fa82006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:03.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.008+0000 7fa833fff640 1 --2- 172.21.15.60:0/1966122603 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa82006be60 0x7fa82006e320 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fa8340a7af0 tx=0x7fa828009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:03.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.012+0000 7fa8317fa640 1 -- 172.21.15.60:0/1966122603 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa834069840 con 0x7fa8341505f0 2024-09-12T02:41:03.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.222+0000 7fa83b227640 1 -- 172.21.15.60:0/1966122603 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa834150d00 con 0x7fa8341505f0 2024-09-12T02:41:03.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.223+0000 7fa8317fa640 1 -- 172.21.15.60:0/1966122603 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5213 (secure 0 0 0) 0x7fa834150d00 con 0x7fa8341505f0 2024-09-12T02:41:03.224 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:41:03.224 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":13,"btime":"2024-09-12T02:41:00:808049+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3208837169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3208837169},{"type":"v1","addr":"172.21.15.60:6836","nonce":3208837169}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/664538827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":664538827},{"type":"v1","addr":"172.21.15.60:6837","nonce":664538827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":204280,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/60663665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":60663665},{"type":"v1","addr":"172.21.15.105:6835","nonce":60663665}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:23:16.184151+0000","modified":"2024-09-12T02:23:19.195177+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"d","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6834/248466084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":248466084},{"type":"v1","addr":"172.21.15.105:6834","nonce":248466084}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":2}]} 2024-09-12T02:41:03.224 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 13 2024-09-12T02:41:03.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.224+0000 7fa83b227640 1 -- 172.21.15.60:0/1966122603 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa82006be60 msgr2=0x7fa82006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:03.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.224+0000 7fa83b227640 1 --2- 172.21.15.60:0/1966122603 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa82006be60 0x7fa82006e320 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fa8340a7af0 tx=0x7fa828009040 comp rx=0 tx=0).stop 2024-09-12T02:41:03.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.225+0000 7fa83b227640 1 -- 172.21.15.60:0/1966122603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8341505f0 msgr2=0x7fa8341524f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:03.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.225+0000 7fa83b227640 1 --2- 172.21.15.60:0/1966122603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8341505f0 0x7fa8341524f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa82402abe0 tx=0x7fa824004730 comp rx=0 tx=0).stop 2024-09-12T02:41:03.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.225+0000 7fa83b227640 1 -- 172.21.15.60:0/1966122603 shutdown_connections 2024-09-12T02:41:03.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.225+0000 7fa83b227640 1 --2- 172.21.15.60:0/1966122603 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7fa82006be60 0x7fa82006e320 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:03.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.225+0000 7fa83b227640 1 --2- 172.21.15.60:0/1966122603 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8340c13b0 0x7fa8341515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:03.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.225+0000 7fa83b227640 1 --2- 172.21.15.60:0/1966122603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa83414f380 0x7fa8340c0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:03.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.225+0000 7fa83b227640 1 --2- 172.21.15.60:0/1966122603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8341505f0 0x7fa8341524f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:03.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.225+0000 7fa83b227640 1 -- 172.21.15.60:0/1966122603 >> 172.21.15.60:0/1966122603 conn(0x7fa8340c7a40 msgr2=0x7fa8340a8770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:03.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.225+0000 7fa83b227640 1 -- 172.21.15.60:0/1966122603 shutdown_connections 2024-09-12T02:41:03.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.225+0000 7fa83b227640 1 -- 172.21.15.60:0/1966122603 wait complete. 2024-09-12T02:41:03.237 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:41:03.296 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:41:03.299 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:41:03.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.339+0000 7f2e1a89b640 1 Processor -- start 2024-09-12T02:41:03.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.339+0000 7f2e1a89b640 1 -- start start 2024-09-12T02:41:03.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.340+0000 7f2e1a89b640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2e14153d60 0x7f2e140c5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:03.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.340+0000 7f2e1a89b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2e140c5aa0 0x7f2e140709d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:03.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.340+0000 7f2e1a89b640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e140c4320 con 0x7f2e140c5660 2024-09-12T02:41:03.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.340+0000 7f2e1a89b640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f2e140c4c90 con 0x7f2e140c5aa0 2024-09-12T02:41:03.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.340+0000 7f2e1a89b640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f2e14156f20 con 0x7f2e14153d60 2024-09-12T02:41:03.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.340+0000 7f2e18e38640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2e140c5aa0 0x7f2e140709d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:03.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.340+0000 7f2e18e38640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2e140c5aa0 0x7f2e140709d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60864/0 (socket says 172.21.15.60:60864) 2024-09-12T02:41:03.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.340+0000 7f2e18e38640 1 -- 172.21.15.60:0/2928036315 learned_addr learned my addr 172.21.15.60:0/2928036315 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:41:03.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.341+0000 7f2e13fff640 1 --2- 172.21.15.60:0/2928036315 >> v2:172.21.15.105:3300/0 conn(0x7f2e14153d60 0x7f2e140c5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:03.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.341+0000 7f2e18e38640 1 -- 172.21.15.60:0/2928036315 >> v2:172.21.15.105:3300/0 conn(0x7f2e14153d60 msgr2=0x7f2e140c5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:03.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.341+0000 7f2e18e38640 1 --2- 172.21.15.60:0/2928036315 >> v2:172.21.15.105:3300/0 conn(0x7f2e14153d60 0x7f2e140c5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:03.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.341+0000 7f2e18e38640 1 -- 172.21.15.60:0/2928036315 >> v1:172.21.15.105:6789/0 conn(0x7f2e140c5660 legacy=0x7f2e140702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:03.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.341+0000 7f2e18e38640 1 -- 172.21.15.60:0/2928036315 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e14157200 con 0x7f2e140c5aa0 2024-09-12T02:41:03.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.341+0000 7f2e18e38640 1 --2- 172.21.15.60:0/2928036315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e140c5aa0 0x7f2e140709d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2e140afb50 tx=0x7f2e0c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3b1a2f237bda50d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:03.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.342+0000 7f2e12ffd640 1 -- 172.21.15.60:0/2928036315 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c036070 con 0x7f2e140c5aa0 2024-09-12T02:41:03.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.342+0000 7f2e12ffd640 1 -- 172.21.15.60:0/2928036315 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2e0c031600 con 0x7f2e140c5aa0 2024-09-12T02:41:03.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.342+0000 7f2e12ffd640 1 -- 172.21.15.60:0/2928036315 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c0319f0 con 0x7f2e140c5aa0 2024-09-12T02:41:03.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.342+0000 7f2e1a89b640 1 -- 172.21.15.60:0/2928036315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e140c5aa0 msgr2=0x7f2e140709d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:03.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.342+0000 7f2e1a89b640 1 --2- 172.21.15.60:0/2928036315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e140c5aa0 0x7f2e140709d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2e140afb50 tx=0x7f2e0c02a730 comp rx=0 tx=0).stop 2024-09-12T02:41:03.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.342+0000 7f2e1a89b640 1 -- 172.21.15.60:0/2928036315 shutdown_connections 2024-09-12T02:41:03.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.342+0000 7f2e1a89b640 1 --2- 172.21.15.60:0/2928036315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e140c5aa0 0x7f2e140709d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:03.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.342+0000 7f2e1a89b640 1 --2- 172.21.15.60:0/2928036315 >> v2:172.21.15.105:3300/0 conn(0x7f2e14153d60 0x7f2e140c5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:03.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.342+0000 7f2e1a89b640 1 -- 172.21.15.60:0/2928036315 >> 172.21.15.60:0/2928036315 conn(0x7f2e140c6980 msgr2=0x7f2e140c6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:03.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.342+0000 7f2e1a89b640 1 -- 172.21.15.60:0/2928036315 shutdown_connections 2024-09-12T02:41:03.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.342+0000 7f2e1a89b640 1 -- 172.21.15.60:0/2928036315 wait complete. 2024-09-12T02:41:03.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.343+0000 7f2e1a89b640 1 Processor -- start 2024-09-12T02:41:03.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.344+0000 7f2e1a89b640 1 -- start start 2024-09-12T02:41:03.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.344+0000 7f2e1a89b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e140c5660 0x7f2e14147940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:03.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.344+0000 7f2e1a89b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e140c5aa0 0x7f2e141e1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:03.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.344+0000 7f2e1a89b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e14153d60 0x7f2e141e1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:03.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.344+0000 7f2e1a89b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2e14073ca0 con 0x7f2e140c5aa0 2024-09-12T02:41:03.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.344+0000 7f2e1a89b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2e14070f10 con 0x7f2e140c5660 2024-09-12T02:41:03.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.344+0000 7f2e1a89b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2e14073e20 con 0x7f2e14153d60 2024-09-12T02:41:03.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.344+0000 7f2e137fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e140c5aa0 0x7f2e141e1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:03.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.344+0000 7f2e13fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e140c5660 0x7f2e14147940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:03.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.344+0000 7f2e13fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e140c5660 0x7f2e14147940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:47736/0 (socket says 172.21.15.60:47736) 2024-09-12T02:41:03.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.344+0000 7f2e13fff640 1 -- 172.21.15.60:0/2372212767 learned_addr learned my addr 172.21.15.60:0/2372212767 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:41:03.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.345+0000 7f2e18e38640 1 --2- 172.21.15.60:0/2372212767 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e14153d60 0x7f2e141e1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:03.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.345+0000 7f2e137fe640 1 -- 172.21.15.60:0/2372212767 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e14153d60 msgr2=0x7f2e141e1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:03.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.345+0000 7f2e137fe640 1 --2- 172.21.15.60:0/2372212767 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e14153d60 0x7f2e141e1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:03.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.345+0000 7f2e137fe640 1 -- 172.21.15.60:0/2372212767 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e140c5660 msgr2=0x7f2e14147940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:03.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.345+0000 7f2e137fe640 1 --2- 172.21.15.60:0/2372212767 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e140c5660 0x7f2e14147940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:03.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.345+0000 7f2e137fe640 1 -- 172.21.15.60:0/2372212767 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e141f0420 con 0x7f2e140c5aa0 2024-09-12T02:41:03.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.345+0000 7f2e137fe640 1 --2- 172.21.15.60:0/2372212767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e140c5aa0 0x7f2e141e1220 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2e0800c340 tx=0x7f2e0800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:03.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.345+0000 7f2e10ff9640 1 -- 172.21.15.60:0/2372212767 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e080052d0 con 0x7f2e140c5aa0 2024-09-12T02:41:03.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.345+0000 7f2e10ff9640 1 -- 172.21.15.60:0/2372212767 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2e08005490 con 0x7f2e140c5aa0 2024-09-12T02:41:03.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.345+0000 7f2e1a89b640 1 -- 172.21.15.60:0/2372212767 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e1414ae60 con 0x7f2e140c5aa0 2024-09-12T02:41:03.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.345+0000 7f2e10ff9640 1 -- 172.21.15.60:0/2372212767 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e08007280 con 0x7f2e140c5aa0 2024-09-12T02:41:03.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.345+0000 7f2e1a89b640 1 -- 172.21.15.60:0/2372212767 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e141e0d20 con 0x7f2e140c5aa0 2024-09-12T02:41:03.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.346+0000 7f2e1a89b640 1 -- 172.21.15.60:0/2372212767 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e1406f270 con 0x7f2e140c5aa0 2024-09-12T02:41:03.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.347+0000 7f2e10ff9640 1 -- 172.21.15.60:0/2372212767 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2e08007420 con 0x7f2e140c5aa0 2024-09-12T02:41:03.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.347+0000 7f2e10ff9640 1 --2- 172.21.15.60:0/2372212767 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2e0006be30 0x7f2e0006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:03.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.347+0000 7f2e10ff9640 1 -- 172.21.15.60:0/2372212767 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5775+0+0 (secure 0 0 0) 0x7f2e0808a300 con 0x7f2e140c5aa0 2024-09-12T02:41:03.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.347+0000 7f2e13fff640 1 --2- 172.21.15.60:0/2372212767 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2e0006be30 0x7f2e0006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:03.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.348+0000 7f2e13fff640 1 --2- 172.21.15.60:0/2372212767 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2e0006be30 0x7f2e0006e2f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2e04007a60 tx=0x7f2e04008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:03.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.351+0000 7f2e10ff9640 1 -- 172.21.15.60:0/2372212767 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2e1406f270 con 0x7f2e140c5aa0 2024-09-12T02:41:03.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.565+0000 7f2e1a89b640 1 -- 172.21.15.60:0/2372212767 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2e140c7690 con 0x7f2e140c5aa0 2024-09-12T02:41:03.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.565+0000 7f2e10ff9640 1 -- 172.21.15.60:0/2372212767 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5213 (secure 0 0 0) 0x7f2e140c4320 con 0x7f2e140c5aa0 2024-09-12T02:41:03.566 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:41:03.567 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":13,"btime":"2024-09-12T02:41:00:808049+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3208837169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3208837169},{"type":"v1","addr":"172.21.15.60:6836","nonce":3208837169}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/664538827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":664538827},{"type":"v1","addr":"172.21.15.60:6837","nonce":664538827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":204280,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/60663665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":60663665},{"type":"v1","addr":"172.21.15.105:6835","nonce":60663665}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:23:16.184151+0000","modified":"2024-09-12T02:23:19.195177+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"d","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6834/248466084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":248466084},{"type":"v1","addr":"172.21.15.105:6834","nonce":248466084}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":2}]} 2024-09-12T02:41:03.567 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 13 2024-09-12T02:41:03.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.568+0000 7f2e1a89b640 1 -- 172.21.15.60:0/2372212767 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2e0006be30 msgr2=0x7f2e0006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:03.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.568+0000 7f2e1a89b640 1 --2- 172.21.15.60:0/2372212767 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2e0006be30 0x7f2e0006e2f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2e04007a60 tx=0x7f2e04008040 comp rx=0 tx=0).stop 2024-09-12T02:41:03.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.568+0000 7f2e1a89b640 1 -- 172.21.15.60:0/2372212767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e140c5aa0 msgr2=0x7f2e141e1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:03.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.568+0000 7f2e1a89b640 1 --2- 172.21.15.60:0/2372212767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e140c5aa0 0x7f2e141e1220 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2e0800c340 tx=0x7f2e0800c800 comp rx=0 tx=0).stop 2024-09-12T02:41:03.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.568+0000 7f2e1a89b640 1 -- 172.21.15.60:0/2372212767 shutdown_connections 2024-09-12T02:41:03.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.568+0000 7f2e1a89b640 1 --2- 172.21.15.60:0/2372212767 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f2e0006be30 0x7f2e0006e2f0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:03.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.568+0000 7f2e1a89b640 1 --2- 172.21.15.60:0/2372212767 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e14153d60 0x7f2e141e1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:03.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.568+0000 7f2e1a89b640 1 --2- 172.21.15.60:0/2372212767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e140c5aa0 0x7f2e141e1220 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:03.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.568+0000 7f2e1a89b640 1 --2- 172.21.15.60:0/2372212767 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e140c5660 0x7f2e14147940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:03.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.568+0000 7f2e1a89b640 1 -- 172.21.15.60:0/2372212767 >> 172.21.15.60:0/2372212767 conn(0x7f2e140c6980 msgr2=0x7f2e14154d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:03.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.568+0000 7f2e1a89b640 1 -- 172.21.15.60:0/2372212767 shutdown_connections 2024-09-12T02:41:03.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.568+0000 7f2e1a89b640 1 -- 172.21.15.60:0/2372212767 wait complete. 2024-09-12T02:41:03.579 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:41:03.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.681+0000 7fa00255b640 1 Processor -- start 2024-09-12T02:41:03.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.681+0000 7fa00255b640 1 -- start start 2024-09-12T02:41:03.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.682+0000 7fa00255b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9ffc0c32f0 0x7f9ffc0c3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:03.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.682+0000 7fa00255b640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ffc154330 con 0x7f9ffc15c9b0 2024-09-12T02:41:03.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.682+0000 7fa00255b640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ffc154610 con 0x7f9ffc151840 2024-09-12T02:41:03.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.682+0000 7fa00255b640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f9ffc1550f0 con 0x7f9ffc0c32f0 2024-09-12T02:41:03.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.682+0000 7f9ffb7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9ffc0c32f0 0x7f9ffc0c3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:03.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.682+0000 7fa000af8640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f9ffc15c9b0 0x7f9ffc15eda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45644/0 (socket says 172.21.15.60:45644) 2024-09-12T02:41:03.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.682+0000 7fa000af8640 1 -- 172.21.15.60:0/2501483409 learned_addr learned my addr 172.21.15.60:0/2501483409 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:41:03.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.682+0000 7f9ffb7fe640 1 -- 172.21.15.60:0/2501483409 >> v1:172.21.15.105:6789/0 conn(0x7f9ffc151840 legacy=0x7f9ffc0ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:03.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.682+0000 7f9ffb7fe640 1 -- 172.21.15.60:0/2501483409 >> v1:172.21.15.60:6789/0 conn(0x7f9ffc15c9b0 legacy=0x7f9ffc15eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:03.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.682+0000 7f9ffb7fe640 1 -- 172.21.15.60:0/2501483409 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ffc1548f0 con 0x7f9ffc0c32f0 2024-09-12T02:41:03.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.683+0000 7f9ffb7fe640 1 --2- 172.21.15.60:0/2501483409 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ffc0c32f0 0x7f9ffc0c3740 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9ff00097a0 tx=0x7f9ff002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f4cbc6fd09e3752 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:03.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.683+0000 7f9ffaffd640 1 -- 172.21.15.60:0/2501483409 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff0037070 con 0x7f9ffc0c32f0 2024-09-12T02:41:03.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.683+0000 7f9ffaffd640 1 -- 172.21.15.60:0/2501483409 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9ff002ae50 con 0x7f9ffc0c32f0 2024-09-12T02:41:03.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.683+0000 7f9ffaffd640 1 -- 172.21.15.60:0/2501483409 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff0032680 con 0x7f9ffc0c32f0 2024-09-12T02:41:03.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.684+0000 7fa00255b640 1 -- 172.21.15.60:0/2501483409 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ffc0c32f0 msgr2=0x7f9ffc0c3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:03.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.684+0000 7fa00255b640 1 --2- 172.21.15.60:0/2501483409 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ffc0c32f0 0x7f9ffc0c3740 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9ff00097a0 tx=0x7f9ff002a140 comp rx=0 tx=0).stop 2024-09-12T02:41:03.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.684+0000 7fa00255b640 1 -- 172.21.15.60:0/2501483409 shutdown_connections 2024-09-12T02:41:03.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.684+0000 7fa00255b640 1 --2- 172.21.15.60:0/2501483409 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ffc0c32f0 0x7f9ffc0c3740 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:03.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.684+0000 7fa00255b640 1 -- 172.21.15.60:0/2501483409 >> 172.21.15.60:0/2501483409 conn(0x7f9ffc0c7a40 msgr2=0x7f9ffc0c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:03.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.684+0000 7fa00255b640 1 -- 172.21.15.60:0/2501483409 shutdown_connections 2024-09-12T02:41:03.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.684+0000 7fa00255b640 1 -- 172.21.15.60:0/2501483409 wait complete. 2024-09-12T02:41:03.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.685+0000 7fa00255b640 1 Processor -- start 2024-09-12T02:41:03.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.685+0000 7fa00255b640 1 -- start start 2024-09-12T02:41:03.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.686+0000 7fa00255b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ffc0c32f0 0x7f9ffc071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:03.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.686+0000 7fa00255b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ffc151840 0x7f9ffc072f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:03.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.686+0000 7fa00255b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ffc15c9b0 0x7f9ffc073480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:03.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.686+0000 7fa00255b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9ffc0ad510 con 0x7f9ffc151840 2024-09-12T02:41:03.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.686+0000 7fa00255b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9ffc06dda0 con 0x7f9ffc0c32f0 2024-09-12T02:41:03.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.686+0000 7fa00255b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9ffc0ad690 con 0x7f9ffc15c9b0 2024-09-12T02:41:03.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.686+0000 7f9ffb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ffc151840 0x7f9ffc072f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:03.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.686+0000 7f9ffb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ffc151840 0x7f9ffc072f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60894/0 (socket says 172.21.15.60:60894) 2024-09-12T02:41:03.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.686+0000 7f9ffb7fe640 1 -- 172.21.15.60:0/1957037368 learned_addr learned my addr 172.21.15.60:0/1957037368 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:41:03.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.686+0000 7f9ffbfff640 1 --2- 172.21.15.60:0/1957037368 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ffc0c32f0 0x7f9ffc071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:03.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.686+0000 7f9ffb7fe640 1 -- 172.21.15.60:0/1957037368 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ffc15c9b0 msgr2=0x7f9ffc073480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:03.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.686+0000 7f9ffb7fe640 1 --2- 172.21.15.60:0/1957037368 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ffc15c9b0 0x7f9ffc073480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:03.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.686+0000 7f9ffb7fe640 1 -- 172.21.15.60:0/1957037368 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ffc0c32f0 msgr2=0x7f9ffc071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:03.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.686+0000 7f9ffb7fe640 1 --2- 172.21.15.60:0/1957037368 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ffc0c32f0 0x7f9ffc071390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:03.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.686+0000 7f9ffb7fe640 1 -- 172.21.15.60:0/1957037368 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ffc1e9f40 con 0x7f9ffc151840 2024-09-12T02:41:03.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.686+0000 7f9ffb7fe640 1 --2- 172.21.15.60:0/1957037368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ffc151840 0x7f9ffc072f40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9ff0000c00 tx=0x7f9ff00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:03.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.687+0000 7f9ff8ff9640 1 -- 172.21.15.60:0/1957037368 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff0041020 con 0x7f9ffc151840 2024-09-12T02:41:03.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.687+0000 7f9ff8ff9640 1 -- 172.21.15.60:0/1957037368 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9ff003c870 con 0x7f9ffc151840 2024-09-12T02:41:03.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.687+0000 7fa00255b640 1 -- 172.21.15.60:0/1957037368 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ffc1ea220 con 0x7f9ffc151840 2024-09-12T02:41:03.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.687+0000 7f9ff8ff9640 1 -- 172.21.15.60:0/1957037368 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff0037040 con 0x7f9ffc151840 2024-09-12T02:41:03.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.687+0000 7fa00255b640 1 -- 172.21.15.60:0/1957037368 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ffc0718d0 con 0x7f9ffc151840 2024-09-12T02:41:03.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.688+0000 7fa00255b640 1 -- 172.21.15.60:0/1957037368 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ffc06e030 con 0x7f9ffc151840 2024-09-12T02:41:03.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.688+0000 7f9ff8ff9640 1 -- 172.21.15.60:0/1957037368 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9ff0044020 con 0x7f9ffc151840 2024-09-12T02:41:03.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.689+0000 7f9ff8ff9640 1 --2- 172.21.15.60:0/1957037368 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9fe806be30 0x7f9fe806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:03.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.689+0000 7f9ff8ff9640 1 -- 172.21.15.60:0/1957037368 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5775+0+0 (secure 0 0 0) 0x7f9ff00ab6c0 con 0x7f9ffc151840 2024-09-12T02:41:03.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.689+0000 7f9ffbfff640 1 --2- 172.21.15.60:0/1957037368 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9fe806be30 0x7f9fe806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:03.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.689+0000 7f9ffbfff640 1 --2- 172.21.15.60:0/1957037368 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9fe806be30 0x7f9fe806e2f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f9fec004ea0 tx=0x7f9fec009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:03.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.693+0000 7f9ff8ff9640 1 -- 172.21.15.60:0/1957037368 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9ff004b030 con 0x7f9ffc151840 2024-09-12T02:41:03.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.871+0000 7fa00255b640 1 -- 172.21.15.60:0/1957037368 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9ffc0c6d10 con 0x7f9ffc151840 2024-09-12T02:41:03.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.872+0000 7f9ff8ff9640 1 -- 172.21.15.60:0/1957037368 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16828 (secure 0 0 0) 0x7f9ff007a030 con 0x7f9ffc151840 2024-09-12T02:41:03.873 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T02:41:03.873 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":31,"fsid":"ccd286b2-65c3-49bd-ab6c-b2fe06e20ea1","created":"2024-09-12T02:22:39.869862+0000","modified":"2024-09-12T02:41:02.822154+0000","last_up_change":"2024-09-12T02:22:53.459371+0000","last_in_change":"2024-09-12T02:22:42.817076+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:22:52.130579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-09-12T02:23:14.175168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-09-12T02:23:15.166293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0f0c7386-002f-47e2-a7a3-6c8a70264cc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6819","nonce":1789465659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6821","nonce":1789465659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6825","nonce":1789465659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1789465659},{"type":"v1","addr":"172.21.15.60:6823","nonce":1789465659}]},"public_addr":"172.21.15.60:6819/1789465659","cluster_addr":"172.21.15.60:6821/1789465659","heartbeat_back_addr":"172.21.15.60:6825/1789465659","heartbeat_front_addr":"172.21.15.60:6823/1789465659","state":["exists","up"]},{"osd":1,"uuid":"64be7b84-36fc-43c0-9e70-a617e5b68941","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6811","nonce":1109822408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6813","nonce":1109822408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6817","nonce":1109822408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1109822408},{"type":"v1","addr":"172.21.15.60:6815","nonce":1109822408}]},"public_addr":"172.21.15.60:6811/1109822408","cluster_addr":"172.21.15.60:6813/1109822408","heartbeat_back_addr":"172.21.15.60:6817/1109822408","heartbeat_front_addr":"172.21.15.60:6815/1109822408","state":["exists","up"]},{"osd":2,"uuid":"df00caa1-d45e-4b87-ac1e-8bc098d509d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6827","nonce":278470077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6829","nonce":278470077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6833","nonce":278470077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":278470077},{"type":"v1","addr":"172.21.15.60:6831","nonce":278470077}]},"public_addr":"172.21.15.60:6827/278470077","cluster_addr":"172.21.15.60:6829/278470077","heartbeat_back_addr":"172.21.15.60:6833/278470077","heartbeat_front_addr":"172.21.15.60:6831/278470077","state":["exists","up"]},{"osd":3,"uuid":"f6453471-893a-490b-b0c7-f196a0f574e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6803","nonce":3606424156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6805","nonce":3606424156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6809","nonce":3606424156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":3606424156},{"type":"v1","addr":"172.21.15.60:6807","nonce":3606424156}]},"public_addr":"172.21.15.60:6803/3606424156","cluster_addr":"172.21.15.60:6805/3606424156","heartbeat_back_addr":"172.21.15.60:6809/3606424156","heartbeat_front_addr":"172.21.15.60:6807/3606424156","state":["exists","up"]},{"osd":4,"uuid":"96e908b6-ce3e-466c-b02d-08fc71a1dba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6809","nonce":1581641129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6811","nonce":1581641129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6815","nonce":1581641129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":1581641129},{"type":"v1","addr":"172.21.15.105:6813","nonce":1581641129}]},"public_addr":"172.21.15.105:6809/1581641129","cluster_addr":"172.21.15.105:6811/1581641129","heartbeat_back_addr":"172.21.15.105:6815/1581641129","heartbeat_front_addr":"172.21.15.105:6813/1581641129","state":["exists","up"]},{"osd":5,"uuid":"7ebc26f0-a462-4364-9303-7351f7cba21f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6825","nonce":1392337793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6827","nonce":1392337793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6831","nonce":1392337793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1392337793},{"type":"v1","addr":"172.21.15.105:6829","nonce":1392337793}]},"public_addr":"172.21.15.105:6825/1392337793","cluster_addr":"172.21.15.105:6827/1392337793","heartbeat_back_addr":"172.21.15.105:6831/1392337793","heartbeat_front_addr":"172.21.15.105:6829/1392337793","state":["exists","up"]},{"osd":6,"uuid":"49487ea1-9c6d-4090-bbcc-f28b33040eb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6801","nonce":50951309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6803","nonce":50951309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6807","nonce":50951309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":50951309},{"type":"v1","addr":"172.21.15.105:6805","nonce":50951309}]},"public_addr":"172.21.15.105:6801/50951309","cluster_addr":"172.21.15.105:6803/50951309","heartbeat_back_addr":"172.21.15.105:6807/50951309","heartbeat_front_addr":"172.21.15.105:6805/50951309","state":["exists","up"]},{"osd":7,"uuid":"1e3a0aa9-7e29-4785-8506-6b5d3be2be35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6817","nonce":3745331251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6819","nonce":3745331251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6823","nonce":3745331251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3745331251},{"type":"v1","addr":"172.21.15.105:6821","nonce":3745331251}]},"public_addr":"172.21.15.105:6817/3745331251","cluster_addr":"172.21.15.105:6819/3745331251","heartbeat_back_addr":"172.21.15.105:6823/3745331251","heartbeat_front_addr":"172.21.15.105:6821/3745331251","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:50.112629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.307689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.542851+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.334773+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:50.096967+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:50.259633+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.888988+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:22:49.917421+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.105:6835/2854563525":"2024-09-13T02:40:59.795986+0000","172.21.15.105:6833/2854563525":"2024-09-13T02:40:59.795986+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:41:03.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.874+0000 7fa00255b640 1 -- 172.21.15.60:0/1957037368 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9fe806be30 msgr2=0x7f9fe806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:03.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.874+0000 7fa00255b640 1 --2- 172.21.15.60:0/1957037368 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9fe806be30 0x7f9fe806e2f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f9fec004ea0 tx=0x7f9fec009040 comp rx=0 tx=0).stop 2024-09-12T02:41:03.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.874+0000 7fa00255b640 1 -- 172.21.15.60:0/1957037368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ffc151840 msgr2=0x7f9ffc072f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:03.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.874+0000 7fa00255b640 1 --2- 172.21.15.60:0/1957037368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ffc151840 0x7f9ffc072f40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9ff0000c00 tx=0x7f9ff00046c0 comp rx=0 tx=0).stop 2024-09-12T02:41:03.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.874+0000 7fa00255b640 1 -- 172.21.15.60:0/1957037368 shutdown_connections 2024-09-12T02:41:03.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.874+0000 7fa00255b640 1 --2- 172.21.15.60:0/1957037368 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9fe806be30 0x7f9fe806e2f0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:03.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.874+0000 7fa00255b640 1 --2- 172.21.15.60:0/1957037368 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ffc15c9b0 0x7f9ffc073480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:03.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.874+0000 7fa00255b640 1 --2- 172.21.15.60:0/1957037368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ffc151840 0x7f9ffc072f40 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:03.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.874+0000 7fa00255b640 1 --2- 172.21.15.60:0/1957037368 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ffc0c32f0 0x7f9ffc071390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:03.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.874+0000 7fa00255b640 1 -- 172.21.15.60:0/1957037368 >> 172.21.15.60:0/1957037368 conn(0x7f9ffc0c7a40 msgr2=0x7f9ffc1537b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:03.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.874+0000 7fa00255b640 1 -- 172.21.15.60:0/1957037368 shutdown_connections 2024-09-12T02:41:03.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.874+0000 7fa00255b640 1 -- 172.21.15.60:0/1957037368 wait complete. 2024-09-12T02:41:03.886 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail b 2024-09-12T02:41:03.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.989+0000 7f8ab1245640 1 Processor -- start 2024-09-12T02:41:03.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.989+0000 7f8ab1245640 1 -- start start 2024-09-12T02:41:03.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.990+0000 7f8ab1245640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8aac0ca390 0x7f8aac161c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:03.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.990+0000 7f8ab1245640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8aac15a7c0 con 0x7f8aac06c650 2024-09-12T02:41:03.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.990+0000 7f8ab1245640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8aac159a00 con 0x7f8aac150480 2024-09-12T02:41:03.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.990+0000 7f8ab1245640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f8aac06c240 con 0x7f8aac0ca390 2024-09-12T02:41:03.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.990+0000 7f8aab59e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8aac0ca390 0x7f8aac161c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:03.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.990+0000 7f8aaa59c640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f8aac06c650 0x7f8aac0c9c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45652/0 (socket says 172.21.15.60:45652) 2024-09-12T02:41:03.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.990+0000 7f8aaa59c640 1 -- 172.21.15.60:0/2458378764 learned_addr learned my addr 172.21.15.60:0/2458378764 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:41:03.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.990+0000 7f8aab59e640 1 -- 172.21.15.60:0/2458378764 >> v1:172.21.15.105:6789/0 conn(0x7f8aac150480 legacy=0x7f8aac0c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:03.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.990+0000 7f8aab59e640 1 -- 172.21.15.60:0/2458378764 >> v1:172.21.15.60:6789/0 conn(0x7f8aac06c650 legacy=0x7f8aac0c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:03.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.990+0000 7f8aab59e640 1 -- 172.21.15.60:0/2458378764 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aac159ce0 con 0x7f8aac0ca390 2024-09-12T02:41:03.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.991+0000 7f8aab59e640 1 --2- 172.21.15.60:0/2458378764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8aac0ca390 0x7f8aac161c00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8aa40097a0 tx=0x7f8aa402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff8231dcfb2a591b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:03.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.991+0000 7f8aa9d9b640 1 -- 172.21.15.60:0/2458378764 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa4037070 con 0x7f8aac0ca390 2024-09-12T02:41:03.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.991+0000 7f8aa9d9b640 1 -- 172.21.15.60:0/2458378764 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8aa4032440 con 0x7f8aac0ca390 2024-09-12T02:41:03.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.991+0000 7f8aa9d9b640 1 -- 172.21.15.60:0/2458378764 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa4032830 con 0x7f8aac0ca390 2024-09-12T02:41:03.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.992+0000 7f8ab1245640 1 -- 172.21.15.60:0/2458378764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8aac0ca390 msgr2=0x7f8aac161c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:03.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.992+0000 7f8ab1245640 1 --2- 172.21.15.60:0/2458378764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8aac0ca390 0x7f8aac161c00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8aa40097a0 tx=0x7f8aa402a1e0 comp rx=0 tx=0).stop 2024-09-12T02:41:03.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.992+0000 7f8ab1245640 1 -- 172.21.15.60:0/2458378764 shutdown_connections 2024-09-12T02:41:03.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.992+0000 7f8ab1245640 1 --2- 172.21.15.60:0/2458378764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8aac0ca390 0x7f8aac161c00 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:03.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.992+0000 7f8ab1245640 1 -- 172.21.15.60:0/2458378764 >> 172.21.15.60:0/2458378764 conn(0x7f8aac068030 msgr2=0x7f8aac073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:03.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.992+0000 7f8ab1245640 1 -- 172.21.15.60:0/2458378764 shutdown_connections 2024-09-12T02:41:03.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.992+0000 7f8ab1245640 1 -- 172.21.15.60:0/2458378764 wait complete. 2024-09-12T02:41:03.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.993+0000 7f8ab1245640 1 Processor -- start 2024-09-12T02:41:03.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.993+0000 7f8ab1245640 1 -- start start 2024-09-12T02:41:03.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.994+0000 7f8ab1245640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8aac06c650 0x7f8aac14f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:03.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.994+0000 7f8ab1245640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8aac0ca390 0x7f8aac157430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:03.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.994+0000 7f8ab1245640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8aac150480 0x7f8aac14a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:03.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.994+0000 7f8ab1245640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8aac06d270 con 0x7f8aac0ca390 2024-09-12T02:41:03.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.994+0000 7f8ab1245640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8aac15a330 con 0x7f8aac06c650 2024-09-12T02:41:03.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.994+0000 7f8ab1245640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8aac0c81a0 con 0x7f8aac150480 2024-09-12T02:41:03.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.994+0000 7f8aaa59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8aac0ca390 0x7f8aac157430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:03.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.994+0000 7f8aaa59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8aac0ca390 0x7f8aac157430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60922/0 (socket says 172.21.15.60:60922) 2024-09-12T02:41:03.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.994+0000 7f8aaa59c640 1 -- 172.21.15.60:0/1326102445 learned_addr learned my addr 172.21.15.60:0/1326102445 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:41:03.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.994+0000 7f8aaad9d640 1 --2- 172.21.15.60:0/1326102445 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8aac06c650 0x7f8aac14f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:03.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.994+0000 7f8aab59e640 1 --2- 172.21.15.60:0/1326102445 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8aac150480 0x7f8aac14a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:03.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.995+0000 7f8aaa59c640 1 -- 172.21.15.60:0/1326102445 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8aac150480 msgr2=0x7f8aac14a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:03.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.995+0000 7f8aaa59c640 1 --2- 172.21.15.60:0/1326102445 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8aac150480 0x7f8aac14a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:03.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.995+0000 7f8aaa59c640 1 -- 172.21.15.60:0/1326102445 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8aac06c650 msgr2=0x7f8aac14f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:03.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.995+0000 7f8aaa59c640 1 --2- 172.21.15.60:0/1326102445 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8aac06c650 0x7f8aac14f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:03.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.995+0000 7f8aaa59c640 1 -- 172.21.15.60:0/1326102445 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aac14c4d0 con 0x7f8aac0ca390 2024-09-12T02:41:03.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.995+0000 7f8aaa59c640 1 --2- 172.21.15.60:0/1326102445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8aac0ca390 0x7f8aac157430 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8a9400c400 tx=0x7f8a9400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:03.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.995+0000 7f8aa37fe640 1 -- 172.21.15.60:0/1326102445 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a94017070 con 0x7f8aac0ca390 2024-09-12T02:41:03.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.995+0000 7f8aa37fe640 1 -- 172.21.15.60:0/1326102445 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8a94005ce0 con 0x7f8aac0ca390 2024-09-12T02:41:03.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.995+0000 7f8aa37fe640 1 -- 172.21.15.60:0/1326102445 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a94007310 con 0x7f8aac0ca390 2024-09-12T02:41:03.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.995+0000 7f8ab1245640 1 -- 172.21.15.60:0/1326102445 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8aac1f0200 con 0x7f8aac0ca390 2024-09-12T02:41:03.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.995+0000 7f8ab1245640 1 -- 172.21.15.60:0/1326102445 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8aac14f740 con 0x7f8aac0ca390 2024-09-12T02:41:03.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.996+0000 7f8ab1245640 1 -- 172.21.15.60:0/1326102445 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8aac0500d0 con 0x7f8aac0ca390 2024-09-12T02:41:03.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.997+0000 7f8aa37fe640 1 -- 172.21.15.60:0/1326102445 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8a9401a070 con 0x7f8aac0ca390 2024-09-12T02:41:03.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.997+0000 7f8aa37fe640 1 --2- 172.21.15.60:0/1326102445 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8a8c06be30 0x7f8a8c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:03.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.997+0000 7f8aa37fe640 1 -- 172.21.15.60:0/1326102445 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5775+0+0 (secure 0 0 0) 0x7f8a9408a220 con 0x7f8aac0ca390 2024-09-12T02:41:03.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.997+0000 7f8aaad9d640 1 --2- 172.21.15.60:0/1326102445 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8a8c06be30 0x7f8a8c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:03.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:03.998+0000 7f8aaad9d640 1 --2- 172.21.15.60:0/1326102445 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8a8c06be30 0x7f8a8c06e2f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8aac0ca0f0 tx=0x7f8a9c00d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:04.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.002+0000 7f8aa37fe640 1 -- 172.21.15.60:0/1326102445 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8aac0500d0 con 0x7f8aac0ca390 2024-09-12T02:41:04.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.229+0000 7f8ab1245640 1 -- 172.21.15.60:0/1326102445 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "b"} v 0) -- 0x7f8aac06c430 con 0x7f8aac0ca390 2024-09-12T02:41:04.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.231+0000 7f8aa37fe640 1 -- 172.21.15.60:0/1326102445 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "b"}]=0 b marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v14) ==== 151+0+0 (secure 0 0 0) 0x7f8a94058540 con 0x7f8aac0ca390 2024-09-12T02:41:04.231 INFO:teuthology.orchestra.run.smithi060.stderr:b marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:41:04.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.233+0000 7f8ab1245640 1 -- 172.21.15.60:0/1326102445 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8a8c06be30 msgr2=0x7f8a8c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:04.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.233+0000 7f8ab1245640 1 --2- 172.21.15.60:0/1326102445 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8a8c06be30 0x7f8a8c06e2f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8aac0ca0f0 tx=0x7f8a9c00d040 comp rx=0 tx=0).stop 2024-09-12T02:41:04.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.233+0000 7f8ab1245640 1 -- 172.21.15.60:0/1326102445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8aac0ca390 msgr2=0x7f8aac157430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:04.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.233+0000 7f8ab1245640 1 --2- 172.21.15.60:0/1326102445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8aac0ca390 0x7f8aac157430 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8a9400c400 tx=0x7f8a9400c8c0 comp rx=0 tx=0).stop 2024-09-12T02:41:04.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.233+0000 7f8ab1245640 1 -- 172.21.15.60:0/1326102445 shutdown_connections 2024-09-12T02:41:04.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.233+0000 7f8ab1245640 1 --2- 172.21.15.60:0/1326102445 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f8a8c06be30 0x7f8a8c06e2f0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:04.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.233+0000 7f8ab1245640 1 --2- 172.21.15.60:0/1326102445 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8aac150480 0x7f8aac14a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:04.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.233+0000 7f8ab1245640 1 --2- 172.21.15.60:0/1326102445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8aac0ca390 0x7f8aac157430 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:04.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.233+0000 7f8ab1245640 1 --2- 172.21.15.60:0/1326102445 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8aac06c650 0x7f8aac14f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:04.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.233+0000 7f8ab1245640 1 -- 172.21.15.60:0/1326102445 >> 172.21.15.60:0/1326102445 conn(0x7f8aac068030 msgr2=0x7f8aac0ca770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:04.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.233+0000 7f8ab1245640 1 -- 172.21.15.60:0/1326102445 shutdown_connections 2024-09-12T02:41:04.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.233+0000 7f8ab1245640 1 -- 172.21.15.60:0/1326102445 wait complete. 2024-09-12T02:41:04.248 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm b --yes-i-really-mean-it 2024-09-12T02:41:04.305 INFO:tasks.ceph.mds.d.smithi105.stdout:starting mds.d at 2024-09-12T02:41:04.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.367+0000 7f4025a47640 1 Processor -- start 2024-09-12T02:41:04.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.367+0000 7f4025a47640 1 -- start start 2024-09-12T02:41:04.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.368+0000 7f4025a47640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f40200c59d0 0x7f40201540f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:04.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.368+0000 7f4025a47640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40200ac5e0 con 0x7f40200abfc0 2024-09-12T02:41:04.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.368+0000 7f4025a47640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40200ac8c0 con 0x7f402014e540 2024-09-12T02:41:04.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.368+0000 7f4025a47640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f40200acba0 con 0x7f40200c59d0 2024-09-12T02:41:04.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.368+0000 7f401e7fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f40200c59d0 0x7f40201540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:04.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.368+0000 7f401f7fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f40200abfc0 0x7f40200c4fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45666/0 (socket says 172.21.15.60:45666) 2024-09-12T02:41:04.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.368+0000 7f401e7fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f40200c59d0 0x7f40201540f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60928/0 (socket says 172.21.15.60:60928) 2024-09-12T02:41:04.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.368+0000 7f401f7fe640 1 -- 172.21.15.60:0/1853823639 learned_addr learned my addr 172.21.15.60:0/1853823639 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:41:04.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.369+0000 7f401e7fc640 1 -- 172.21.15.60:0/1853823639 >> v1:172.21.15.105:6789/0 conn(0x7f402014e540 legacy=0x7f4020157e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:04.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.369+0000 7f401e7fc640 1 -- 172.21.15.60:0/1853823639 >> v1:172.21.15.60:6789/0 conn(0x7f40200abfc0 legacy=0x7f40200c4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:04.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.369+0000 7f401e7fc640 1 -- 172.21.15.60:0/1853823639 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40201578f0 con 0x7f40200c59d0 2024-09-12T02:41:04.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.370+0000 7f401e7fc640 1 --2- 172.21.15.60:0/1853823639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40200c59d0 0x7f40201540f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f40140097a0 tx=0x7f401402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=822b672a5658a134 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:04.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.370+0000 7f401dffb640 1 -- 172.21.15.60:0/1853823639 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4014037070 con 0x7f40200c59d0 2024-09-12T02:41:04.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.370+0000 7f401dffb640 1 -- 172.21.15.60:0/1853823639 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4014032440 con 0x7f40200c59d0 2024-09-12T02:41:04.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.370+0000 7f401dffb640 1 -- 172.21.15.60:0/1853823639 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4014032830 con 0x7f40200c59d0 2024-09-12T02:41:04.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.370+0000 7f4025a47640 1 -- 172.21.15.60:0/1853823639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40200c59d0 msgr2=0x7f40201540f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:04.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.370+0000 7f4025a47640 1 --2- 172.21.15.60:0/1853823639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40200c59d0 0x7f40201540f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f40140097a0 tx=0x7f401402a1a0 comp rx=0 tx=0).stop 2024-09-12T02:41:04.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.370+0000 7f4025a47640 1 -- 172.21.15.60:0/1853823639 shutdown_connections 2024-09-12T02:41:04.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.370+0000 7f4025a47640 1 --2- 172.21.15.60:0/1853823639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40200c59d0 0x7f40201540f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:04.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.370+0000 7f4025a47640 1 -- 172.21.15.60:0/1853823639 >> 172.21.15.60:0/1853823639 conn(0x7f40200681e0 msgr2=0x7f40200ab650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:04.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.370+0000 7f4025a47640 1 -- 172.21.15.60:0/1853823639 shutdown_connections 2024-09-12T02:41:04.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.370+0000 7f4025a47640 1 -- 172.21.15.60:0/1853823639 wait complete. 2024-09-12T02:41:04.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.371+0000 7f4025a47640 1 Processor -- start 2024-09-12T02:41:04.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.372+0000 7f4025a47640 1 -- start start 2024-09-12T02:41:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.372+0000 7f4025a47640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40200abfc0 0x7f402014f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.372+0000 7f4025a47640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40200c59d0 0x7f40201e0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.372+0000 7f4025a47640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f402014e540 0x7f40201ead30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.372+0000 7f4025a47640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f40200c56b0 con 0x7f40200abfc0 2024-09-12T02:41:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.372+0000 7f4025a47640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4020158520 con 0x7f402014e540 2024-09-12T02:41:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.372+0000 7f4025a47640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f40200c5830 con 0x7f40200c59d0 2024-09-12T02:41:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.372+0000 7f401effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40200abfc0 0x7f402014f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.372+0000 7f401effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40200abfc0 0x7f402014f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60934/0 (socket says 172.21.15.60:60934) 2024-09-12T02:41:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.372+0000 7f401effd640 1 -- 172.21.15.60:0/1610884848 learned_addr learned my addr 172.21.15.60:0/1610884848 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:41:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.373+0000 7f401f7fe640 1 --2- 172.21.15.60:0/1610884848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f402014e540 0x7f40201ead30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.373+0000 7f401e7fc640 1 --2- 172.21.15.60:0/1610884848 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40200c59d0 0x7f40201e0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.373+0000 7f401effd640 1 -- 172.21.15.60:0/1610884848 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40200c59d0 msgr2=0x7f40201e0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.373+0000 7f401effd640 1 --2- 172.21.15.60:0/1610884848 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40200c59d0 0x7f40201e0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.373+0000 7f401effd640 1 -- 172.21.15.60:0/1610884848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f402014e540 msgr2=0x7f40201ead30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.373+0000 7f401effd640 1 --2- 172.21.15.60:0/1610884848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f402014e540 0x7f40201ead30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.373+0000 7f401effd640 1 -- 172.21.15.60:0/1610884848 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40201e1910 con 0x7f40200abfc0 2024-09-12T02:41:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.373+0000 7f401effd640 1 --2- 172.21.15.60:0/1610884848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40200abfc0 0x7f402014f290 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f401000c870 tx=0x7f401000cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.373+0000 7f4007fff640 1 -- 172.21.15.60:0/1610884848 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4010003b70 con 0x7f40200abfc0 2024-09-12T02:41:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.373+0000 7f4007fff640 1 -- 172.21.15.60:0/1610884848 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4010003d30 con 0x7f40200abfc0 2024-09-12T02:41:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.373+0000 7f4007fff640 1 -- 172.21.15.60:0/1610884848 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f401000aab0 con 0x7f40200abfc0 2024-09-12T02:41:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.373+0000 7f4025a47640 1 -- 172.21.15.60:0/1610884848 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40201ea570 con 0x7f40200abfc0 2024-09-12T02:41:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.373+0000 7f4025a47640 1 -- 172.21.15.60:0/1610884848 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40201ea810 con 0x7f40200abfc0 2024-09-12T02:41:04.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.375+0000 7f4025a47640 1 -- 172.21.15.60:0/1610884848 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40201540f0 con 0x7f40200abfc0 2024-09-12T02:41:04.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.375+0000 7f4007fff640 1 -- 172.21.15.60:0/1610884848 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f401000ac50 con 0x7f40200abfc0 2024-09-12T02:41:04.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.375+0000 7f4007fff640 1 --2- 172.21.15.60:0/1610884848 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f400c06be30 0x7f400c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:04.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.375+0000 7f4007fff640 1 -- 172.21.15.60:0/1610884848 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5861+0+0 (secure 0 0 0) 0x7f401008ae60 con 0x7f40200abfc0 2024-09-12T02:41:04.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.375+0000 7f401e7fc640 1 --2- 172.21.15.60:0/1610884848 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f400c06be30 0x7f400c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:04.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.376+0000 7f401e7fc640 1 --2- 172.21.15.60:0/1610884848 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f400c06be30 0x7f400c06e2f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f4014034000 tx=0x7f401402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:04.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.380+0000 7f4007fff640 1 -- 172.21.15.60:0/1610884848 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4010059770 con 0x7f40200abfc0 2024-09-12T02:41:04.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:04.603+0000 7f4025a47640 1 -- 172.21.15.60:0/1610884848 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "b", "yes_i_really_mean_it": true} v 0) -- 0x7f4020067fc0 con 0x7f40200abfc0 2024-09-12T02:41:05.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.235+0000 7f4007fff640 1 -- 172.21.15.60:0/1610884848 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "b", "yes_i_really_mean_it": true}]=0 v15) ==== 99+0+0 (secure 0 0 0) 0x7f4010059070 con 0x7f40200abfc0 2024-09-12T02:41:05.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.238+0000 7f4025a47640 1 -- 172.21.15.60:0/1610884848 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f400c06be30 msgr2=0x7f400c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:05.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.238+0000 7f4025a47640 1 --2- 172.21.15.60:0/1610884848 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f400c06be30 0x7f400c06e2f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f4014034000 tx=0x7f401402e000 comp rx=0 tx=0).stop 2024-09-12T02:41:05.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.238+0000 7f4025a47640 1 -- 172.21.15.60:0/1610884848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40200abfc0 msgr2=0x7f402014f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:05.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.238+0000 7f4025a47640 1 --2- 172.21.15.60:0/1610884848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40200abfc0 0x7f402014f290 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f401000c870 tx=0x7f401000cd30 comp rx=0 tx=0).stop 2024-09-12T02:41:05.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.238+0000 7f4025a47640 1 -- 172.21.15.60:0/1610884848 shutdown_connections 2024-09-12T02:41:05.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.238+0000 7f4025a47640 1 --2- 172.21.15.60:0/1610884848 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f400c06be30 0x7f400c06e2f0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:05.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.238+0000 7f4025a47640 1 --2- 172.21.15.60:0/1610884848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f402014e540 0x7f40201ead30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:05.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.238+0000 7f4025a47640 1 --2- 172.21.15.60:0/1610884848 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40200c59d0 0x7f40201e0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:05.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.238+0000 7f4025a47640 1 --2- 172.21.15.60:0/1610884848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40200abfc0 0x7f402014f290 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:05.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.238+0000 7f4025a47640 1 -- 172.21.15.60:0/1610884848 >> 172.21.15.60:0/1610884848 conn(0x7f40200681e0 msgr2=0x7f40200c4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:05.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.238+0000 7f4025a47640 1 -- 172.21.15.60:0/1610884848 shutdown_connections 2024-09-12T02:41:05.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.238+0000 7f4025a47640 1 -- 172.21.15.60:0/1610884848 wait complete. 2024-09-12T02:41:05.253 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm b_metadata b_metadata --yes-i-really-really-mean-it 2024-09-12T02:41:05.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.364+0000 7f9d2598d640 1 Processor -- start 2024-09-12T02:41:05.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.364+0000 7f9d2598d640 1 -- start start 2024-09-12T02:41:05.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.365+0000 7f9d2598d640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9d200c8b10 0x7f9d2015a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:05.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.365+0000 7f9d2598d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9d2006cd80 0x7f9d201534d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:05.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.365+0000 7f9d2598d640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d200c7070 con 0x7f9d20153a10 2024-09-12T02:41:05.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.365+0000 7f9d2598d640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f9d2006d210 con 0x7f9d2006cd80 2024-09-12T02:41:05.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.365+0000 7f9d2598d640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f9d200c69b0 con 0x7f9d200c8b10 2024-09-12T02:41:05.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.365+0000 7f9d1e7fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9d2006cd80 0x7f9d201534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:05.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.365+0000 7f9d1e7fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9d2006cd80 0x7f9d201534d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60946/0 (socket says 172.21.15.60:60946) 2024-09-12T02:41:05.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.365+0000 7f9d1e7fc640 1 -- 172.21.15.60:0/466018413 learned_addr learned my addr 172.21.15.60:0/466018413 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:41:05.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.365+0000 7f9d1effd640 1 --2- 172.21.15.60:0/466018413 >> v2:172.21.15.105:3300/0 conn(0x7f9d200c8b10 0x7f9d2015a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:05.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.366+0000 7f9d1e7fc640 1 -- 172.21.15.60:0/466018413 >> v2:172.21.15.105:3300/0 conn(0x7f9d200c8b10 msgr2=0x7f9d2015a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:05.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.366+0000 7f9d1e7fc640 1 --2- 172.21.15.60:0/466018413 >> v2:172.21.15.105:3300/0 conn(0x7f9d200c8b10 0x7f9d2015a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:05.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.366+0000 7f9d1e7fc640 1 -- 172.21.15.60:0/466018413 >> v1:172.21.15.105:6789/0 conn(0x7f9d20153a10 legacy=0x7f9d20156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:05.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.366+0000 7f9d1e7fc640 1 -- 172.21.15.60:0/466018413 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d200c6c90 con 0x7f9d2006cd80 2024-09-12T02:41:05.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.366+0000 7f9d1e7fc640 1 --2- 172.21.15.60:0/466018413 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d2006cd80 0x7f9d201534d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9d200ae760 tx=0x7f9d0802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7173df6a16d38f42 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:05.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.366+0000 7f9d1dffb640 1 -- 172.21.15.60:0/466018413 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d08037070 con 0x7f9d2006cd80 2024-09-12T02:41:05.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.366+0000 7f9d1dffb640 1 -- 172.21.15.60:0/466018413 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9d08032440 con 0x7f9d2006cd80 2024-09-12T02:41:05.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.367+0000 7f9d1dffb640 1 -- 172.21.15.60:0/466018413 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d08032830 con 0x7f9d2006cd80 2024-09-12T02:41:05.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.367+0000 7f9d2598d640 1 -- 172.21.15.60:0/466018413 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d2006cd80 msgr2=0x7f9d201534d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:05.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.367+0000 7f9d2598d640 1 --2- 172.21.15.60:0/466018413 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d2006cd80 0x7f9d201534d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9d200ae760 tx=0x7f9d0802a1e0 comp rx=0 tx=0).stop 2024-09-12T02:41:05.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.367+0000 7f9d2598d640 1 -- 172.21.15.60:0/466018413 shutdown_connections 2024-09-12T02:41:05.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.367+0000 7f9d2598d640 1 --2- 172.21.15.60:0/466018413 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d2006cd80 0x7f9d201534d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:05.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.367+0000 7f9d2598d640 1 --2- 172.21.15.60:0/466018413 >> v2:172.21.15.105:3300/0 conn(0x7f9d200c8b10 0x7f9d2015a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:05.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.367+0000 7f9d2598d640 1 -- 172.21.15.60:0/466018413 >> 172.21.15.60:0/466018413 conn(0x7f9d200adb80 msgr2=0x7f9d200adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:05.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.367+0000 7f9d2598d640 1 -- 172.21.15.60:0/466018413 shutdown_connections 2024-09-12T02:41:05.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.367+0000 7f9d2598d640 1 -- 172.21.15.60:0/466018413 wait complete. 2024-09-12T02:41:05.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.368+0000 7f9d2598d640 1 Processor -- start 2024-09-12T02:41:05.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.369+0000 7f9d2598d640 1 -- start start 2024-09-12T02:41:05.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.369+0000 7f9d2598d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d200c8b10 0x7f9d200ac010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:05.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.369+0000 7f9d2598d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d20153a10 0x7f9d201ef7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:05.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.369+0000 7f9d2598d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d201efd20 0x7f9d201465d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:05.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.369+0000 7f9d2598d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9d20154020 con 0x7f9d201efd20 2024-09-12T02:41:05.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.369+0000 7f9d2598d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9d20153ea0 con 0x7f9d200c8b10 2024-09-12T02:41:05.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.369+0000 7f9d2598d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9d200c8ef0 con 0x7f9d20153a10 2024-09-12T02:41:05.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.369+0000 7f9d1f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d201efd20 0x7f9d201465d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:05.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.369+0000 7f9d1f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d201efd20 0x7f9d201465d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60948/0 (socket says 172.21.15.60:60948) 2024-09-12T02:41:05.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.369+0000 7f9d1f7fe640 1 -- 172.21.15.60:0/1176026125 learned_addr learned my addr 172.21.15.60:0/1176026125 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:41:05.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.369+0000 7f9d1effd640 1 --2- 172.21.15.60:0/1176026125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d200c8b10 0x7f9d200ac010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:05.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.369+0000 7f9d1e7fc640 1 --2- 172.21.15.60:0/1176026125 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d20153a10 0x7f9d201ef7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:05.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.370+0000 7f9d1f7fe640 1 -- 172.21.15.60:0/1176026125 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d20153a10 msgr2=0x7f9d201ef7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:05.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.370+0000 7f9d1f7fe640 1 --2- 172.21.15.60:0/1176026125 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d20153a10 0x7f9d201ef7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:05.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.370+0000 7f9d1f7fe640 1 -- 172.21.15.60:0/1176026125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d200c8b10 msgr2=0x7f9d200ac010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:05.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.370+0000 7f9d1f7fe640 1 --2- 172.21.15.60:0/1176026125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d200c8b10 0x7f9d200ac010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:05.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.370+0000 7f9d1f7fe640 1 -- 172.21.15.60:0/1176026125 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d201ebe90 con 0x7f9d201efd20 2024-09-12T02:41:05.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.370+0000 7f9d1f7fe640 1 --2- 172.21.15.60:0/1176026125 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d201efd20 0x7f9d201465d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9d1000c6b0 tx=0x7f9d1000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:05.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.370+0000 7f9d17fff640 1 -- 172.21.15.60:0/1176026125 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d10003b70 con 0x7f9d201efd20 2024-09-12T02:41:05.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.370+0000 7f9d17fff640 1 -- 172.21.15.60:0/1176026125 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9d10003d30 con 0x7f9d201efd20 2024-09-12T02:41:05.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.370+0000 7f9d2598d640 1 -- 172.21.15.60:0/1176026125 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d200acbb0 con 0x7f9d201efd20 2024-09-12T02:41:05.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.370+0000 7f9d17fff640 1 -- 172.21.15.60:0/1176026125 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d10005330 con 0x7f9d201efd20 2024-09-12T02:41:05.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.370+0000 7f9d2598d640 1 -- 172.21.15.60:0/1176026125 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d201e22f0 con 0x7f9d201efd20 2024-09-12T02:41:05.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.371+0000 7f9d2598d640 1 -- 172.21.15.60:0/1176026125 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d200c5fd0 con 0x7f9d201efd20 2024-09-12T02:41:05.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.372+0000 7f9d17fff640 1 -- 172.21.15.60:0/1176026125 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9d100054d0 con 0x7f9d201efd20 2024-09-12T02:41:05.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.372+0000 7f9d17fff640 1 --2- 172.21.15.60:0/1176026125 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9d0006be60 0x7f9d0006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:05.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.373+0000 7f9d17fff640 1 -- 172.21.15.60:0/1176026125 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5861+0+0 (secure 0 0 0) 0x7f9d1008ac10 con 0x7f9d201efd20 2024-09-12T02:41:05.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.373+0000 7f9d1effd640 1 --2- 172.21.15.60:0/1176026125 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9d0006be60 0x7f9d0006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:05.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.373+0000 7f9d1effd640 1 --2- 172.21.15.60:0/1176026125 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9d0006be60 0x7f9d0006e320 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f9d18009b40 tx=0x7f9d18009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:05.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.377+0000 7f9d17fff640 1 -- 172.21.15.60:0/1176026125 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9d200c5fd0 con 0x7f9d201efd20 2024-09-12T02:41:05.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:05.556+0000 7f9d2598d640 1 -- 172.21.15.60:0/1176026125 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "b_metadata", "pool2": "b_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9d201534d0 con 0x7f9d201efd20 2024-09-12T02:41:06.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.236+0000 7f9d17fff640 1 -- 172.21.15.60:0/1176026125 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "b_metadata", "pool2": "b_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'b_metadata' removed v33) ==== 166+0+0 (secure 0 0 0) 0x7f9d10058ed0 con 0x7f9d201efd20 2024-09-12T02:41:06.237 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'b_metadata' removed 2024-09-12T02:41:06.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.241+0000 7f9d2598d640 1 -- 172.21.15.60:0/1176026125 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9d0006be60 msgr2=0x7f9d0006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:06.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.241+0000 7f9d2598d640 1 --2- 172.21.15.60:0/1176026125 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9d0006be60 0x7f9d0006e320 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f9d18009b40 tx=0x7f9d18009190 comp rx=0 tx=0).stop 2024-09-12T02:41:06.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.241+0000 7f9d2598d640 1 -- 172.21.15.60:0/1176026125 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d201efd20 msgr2=0x7f9d201465d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:06.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.241+0000 7f9d2598d640 1 --2- 172.21.15.60:0/1176026125 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d201efd20 0x7f9d201465d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9d1000c6b0 tx=0x7f9d1000cb70 comp rx=0 tx=0).stop 2024-09-12T02:41:06.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.241+0000 7f9d2598d640 1 -- 172.21.15.60:0/1176026125 shutdown_connections 2024-09-12T02:41:06.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.241+0000 7f9d2598d640 1 --2- 172.21.15.60:0/1176026125 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f9d0006be60 0x7f9d0006e320 secure :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f9d18009b40 tx=0x7f9d18009190 comp rx=0 tx=0).stop 2024-09-12T02:41:06.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.241+0000 7f9d2598d640 1 --2- 172.21.15.60:0/1176026125 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d201efd20 0x7f9d201465d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:06.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.241+0000 7f9d2598d640 1 --2- 172.21.15.60:0/1176026125 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d20153a10 0x7f9d201ef7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:06.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.241+0000 7f9d2598d640 1 --2- 172.21.15.60:0/1176026125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d200c8b10 0x7f9d200ac010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:06.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.241+0000 7f9d2598d640 1 -- 172.21.15.60:0/1176026125 >> 172.21.15.60:0/1176026125 conn(0x7f9d200adb80 msgr2=0x7f9d2006bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:06.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.242+0000 7f9d2598d640 1 -- 172.21.15.60:0/1176026125 shutdown_connections 2024-09-12T02:41:06.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.242+0000 7f9d2598d640 1 -- 172.21.15.60:0/1176026125 wait complete. 2024-09-12T02:41:06.258 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm b_data b_data --yes-i-really-really-mean-it 2024-09-12T02:41:06.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.367+0000 7f6acd5c0640 1 Processor -- start 2024-09-12T02:41:06.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.367+0000 7f6acd5c0640 1 -- start start 2024-09-12T02:41:06.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.368+0000 7f6acd5c0640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6ac806cd80 0x7f6ac8153be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:06.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.368+0000 7f6acd5c0640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ac80c7070 con 0x7f6ac80c8b10 2024-09-12T02:41:06.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.368+0000 7f6acd5c0640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ac806d210 con 0x7f6ac815a4a0 2024-09-12T02:41:06.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.368+0000 7f6acd5c0640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f6ac80c69b0 con 0x7f6ac806cd80 2024-09-12T02:41:06.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.368+0000 7f6ac67fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6ac806cd80 0x7f6ac8153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:06.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.368+0000 7f6ac6ffd640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f6ac80c8b10 0x7f6ac81534d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45670/0 (socket says 172.21.15.60:45670) 2024-09-12T02:41:06.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.368+0000 7f6ac6ffd640 1 -- 172.21.15.60:0/2693460162 learned_addr learned my addr 172.21.15.60:0/2693460162 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T02:41:06.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.368+0000 7f6ac67fc640 1 -- 172.21.15.60:0/2693460162 >> v1:172.21.15.105:6789/0 conn(0x7f6ac815a4a0 legacy=0x7f6ac8156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:41:06.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.368+0000 7f6ac67fc640 1 -- 172.21.15.60:0/2693460162 >> v1:172.21.15.60:6789/0 conn(0x7f6ac80c8b10 legacy=0x7f6ac81534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:06.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.368+0000 7f6ac67fc640 1 -- 172.21.15.60:0/2693460162 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac80c6c90 con 0x7f6ac806cd80 2024-09-12T02:41:06.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.368+0000 7f6ac5ffb640 1 -- 172.21.15.60:0/2693460162 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2125777294 0 0) 0x7f6ac80c7070 con 0x7f6ac80c8b10 2024-09-12T02:41:06.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.369+0000 7f6ac67fc640 1 --2- 172.21.15.60:0/2693460162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ac806cd80 0x7f6ac8153be0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6ab00097a0 tx=0x7f6ab002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f654b2c78bfb92fa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:06.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.369+0000 7f6ac5ffb640 1 -- 172.21.15.60:0/2693460162 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab0037070 con 0x7f6ac806cd80 2024-09-12T02:41:06.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.369+0000 7f6ac5ffb640 1 -- 172.21.15.60:0/2693460162 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6ab002ae50 con 0x7f6ac806cd80 2024-09-12T02:41:06.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.369+0000 7f6ac5ffb640 1 -- 172.21.15.60:0/2693460162 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab0032680 con 0x7f6ac806cd80 2024-09-12T02:41:06.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.370+0000 7f6acd5c0640 1 -- 172.21.15.60:0/2693460162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ac806cd80 msgr2=0x7f6ac8153be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:06.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.370+0000 7f6acd5c0640 1 --2- 172.21.15.60:0/2693460162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ac806cd80 0x7f6ac8153be0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6ab00097a0 tx=0x7f6ab002a140 comp rx=0 tx=0).stop 2024-09-12T02:41:06.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.370+0000 7f6acd5c0640 1 -- 172.21.15.60:0/2693460162 shutdown_connections 2024-09-12T02:41:06.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.370+0000 7f6acd5c0640 1 --2- 172.21.15.60:0/2693460162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ac806cd80 0x7f6ac8153be0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:06.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.370+0000 7f6acd5c0640 1 -- 172.21.15.60:0/2693460162 >> 172.21.15.60:0/2693460162 conn(0x7f6ac80adb80 msgr2=0x7f6ac80adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:06.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.370+0000 7f6acd5c0640 1 -- 172.21.15.60:0/2693460162 shutdown_connections 2024-09-12T02:41:06.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.370+0000 7f6acd5c0640 1 -- 172.21.15.60:0/2693460162 wait complete. 2024-09-12T02:41:06.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.371+0000 7f6acd5c0640 1 Processor -- start 2024-09-12T02:41:06.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.371+0000 7f6acd5c0640 1 -- start start 2024-09-12T02:41:06.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.372+0000 7f6acd5c0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ac80c8b10 0x7f6ac8149ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:06.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.372+0000 7f6acd5c0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ac815a4a0 0x7f6ac8158150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:06.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.372+0000 7f6acd5c0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ac8150680 0x7f6ac814b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:06.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.372+0000 7f6acd5c0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac80c9070 con 0x7f6ac8150680 2024-09-12T02:41:06.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.372+0000 7f6acd5c0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac80c8ef0 con 0x7f6ac80c8b10 2024-09-12T02:41:06.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.372+0000 7f6acd5c0640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6ac8156d70 con 0x7f6ac815a4a0 2024-09-12T02:41:06.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.372+0000 7f6ac77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ac8150680 0x7f6ac814b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:06.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.372+0000 7f6ac77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ac8150680 0x7f6ac814b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60978/0 (socket says 172.21.15.60:60978) 2024-09-12T02:41:06.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.372+0000 7f6ac77fe640 1 -- 172.21.15.60:0/559806955 learned_addr learned my addr 172.21.15.60:0/559806955 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T02:41:06.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.372+0000 7f6ac6ffd640 1 --2- 172.21.15.60:0/559806955 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ac80c8b10 0x7f6ac8149ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:06.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.372+0000 7f6ac67fc640 1 --2- 172.21.15.60:0/559806955 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ac815a4a0 0x7f6ac8158150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:06.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.372+0000 7f6ac77fe640 1 -- 172.21.15.60:0/559806955 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ac815a4a0 msgr2=0x7f6ac8158150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:06.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.372+0000 7f6ac77fe640 1 --2- 172.21.15.60:0/559806955 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ac815a4a0 0x7f6ac8158150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:06.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.372+0000 7f6ac77fe640 1 -- 172.21.15.60:0/559806955 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ac80c8b10 msgr2=0x7f6ac8149ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:06.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.372+0000 7f6ac77fe640 1 --2- 172.21.15.60:0/559806955 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ac80c8b10 0x7f6ac8149ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:06.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.372+0000 7f6ac77fe640 1 -- 172.21.15.60:0/559806955 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac814dfc0 con 0x7f6ac8150680 2024-09-12T02:41:06.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.372+0000 7f6ac77fe640 1 --2- 172.21.15.60:0/559806955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ac8150680 0x7f6ac814b290 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6ab800b9c0 tx=0x7f6ab800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:06.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.373+0000 7f6abf7fe640 1 -- 172.21.15.60:0/559806955 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab8019070 con 0x7f6ac8150680 2024-09-12T02:41:06.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.373+0000 7f6abf7fe640 1 -- 172.21.15.60:0/559806955 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6ab800cba0 con 0x7f6ac8150680 2024-09-12T02:41:06.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.373+0000 7f6acd5c0640 1 -- 172.21.15.60:0/559806955 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ac8158ea0 con 0x7f6ac8150680 2024-09-12T02:41:06.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.373+0000 7f6abf7fe640 1 -- 172.21.15.60:0/559806955 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab8014440 con 0x7f6ac8150680 2024-09-12T02:41:06.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.373+0000 7f6acd5c0640 1 -- 172.21.15.60:0/559806955 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ac814e260 con 0x7f6ac8150680 2024-09-12T02:41:06.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.374+0000 7f6acd5c0640 1 -- 172.21.15.60:0/559806955 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ac81571d0 con 0x7f6ac8150680 2024-09-12T02:41:06.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.374+0000 7f6abf7fe640 1 -- 172.21.15.60:0/559806955 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6ab80145e0 con 0x7f6ac8150680 2024-09-12T02:41:06.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.375+0000 7f6abf7fe640 1 --2- 172.21.15.60:0/559806955 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f6aa806be60 0x7f6aa806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:41:06.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.375+0000 7f6abf7fe640 1 -- 172.21.15.60:0/559806955 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5433+0+0 (secure 0 0 0) 0x7f6ab808aa20 con 0x7f6ac8150680 2024-09-12T02:41:06.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.375+0000 7f6ac6ffd640 1 --2- 172.21.15.60:0/559806955 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f6aa806be60 0x7f6aa806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:41:06.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.376+0000 7f6ac6ffd640 1 --2- 172.21.15.60:0/559806955 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f6aa806be60 0x7f6aa806e320 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0000f60 tx=0x7f6ac0007b50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:41:06.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.379+0000 7f6abf7fe640 1 -- 172.21.15.60:0/559806955 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6ab80594d0 con 0x7f6ac8150680 2024-09-12T02:41:06.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:06.554+0000 7f6acd5c0640 1 -- 172.21.15.60:0/559806955 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "b_data", "pool2": "b_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6ac80c9d90 con 0x7f6ac8150680 2024-09-12T02:41:07.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:07.240+0000 7f6abf7fe640 1 -- 172.21.15.60:0/559806955 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "b_data", "pool2": "b_data", "yes_i_really_really_mean_it": true}]=0 pool 'b_data' removed v34) ==== 154+0+0 (secure 0 0 0) 0x7f6ab8058dd0 con 0x7f6ac8150680 2024-09-12T02:41:07.241 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'b_data' removed 2024-09-12T02:41:07.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:07.244+0000 7f6acd5c0640 1 -- 172.21.15.60:0/559806955 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f6aa806be60 msgr2=0x7f6aa806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:07.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:07.244+0000 7f6acd5c0640 1 --2- 172.21.15.60:0/559806955 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f6aa806be60 0x7f6aa806e320 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0000f60 tx=0x7f6ac0007b50 comp rx=0 tx=0).stop 2024-09-12T02:41:07.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:07.244+0000 7f6acd5c0640 1 -- 172.21.15.60:0/559806955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ac8150680 msgr2=0x7f6ac814b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:41:07.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:07.244+0000 7f6acd5c0640 1 --2- 172.21.15.60:0/559806955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ac8150680 0x7f6ac814b290 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6ab800b9c0 tx=0x7f6ab800be80 comp rx=0 tx=0).stop 2024-09-12T02:41:07.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:07.244+0000 7f6acd5c0640 1 -- 172.21.15.60:0/559806955 shutdown_connections 2024-09-12T02:41:07.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:07.244+0000 7f6acd5c0640 1 --2- 172.21.15.60:0/559806955 >> [v2:172.21.15.60:6800/3549430091,v1:172.21.15.60:6801/3549430091] conn(0x7f6aa806be60 0x7f6aa806e320 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:07.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:07.244+0000 7f6acd5c0640 1 --2- 172.21.15.60:0/559806955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ac8150680 0x7f6ac814b290 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:07.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:07.244+0000 7f6acd5c0640 1 --2- 172.21.15.60:0/559806955 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ac815a4a0 0x7f6ac8158150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:07.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:07.244+0000 7f6acd5c0640 1 --2- 172.21.15.60:0/559806955 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ac80c8b10 0x7f6ac8149ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:41:07.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:07.244+0000 7f6acd5c0640 1 -- 172.21.15.60:0/559806955 >> 172.21.15.60:0/559806955 conn(0x7f6ac80adb80 msgr2=0x7f6ac80adf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:41:07.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:07.244+0000 7f6acd5c0640 1 -- 172.21.15.60:0/559806955 shutdown_connections 2024-09-12T02:41:07.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T02:41:07.244+0000 7f6acd5c0640 1 -- 172.21.15.60:0/559806955 wait complete. 2024-09-12T02:41:07.268 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T02:41:07.269 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T02:41:07.269 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:41:07.284 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T02:41:07.284 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T02:41:07.284 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:41:07.334 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T02:41:07.335 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T02:41:07.335 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:41:07.344 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T02:41:07.344 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T02:41:07.344 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:41:07.394 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T02:41:07.394 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T02:41:07.395 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T02:41:07.395 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:41:07.467 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T02:41:07.468 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T02:41:07.468 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:41:07.545 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T02:41:07.545 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T02:41:07.545 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:41:07.606 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T02:41:07.606 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-12T02:41:07.606 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:41:07.663 INFO:tasks.ceph.osd.3:Stopped 2024-09-12T02:41:07.738 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-12T02:41:07.738 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:41:07.800 INFO:tasks.ceph.osd.4:Stopped 2024-09-12T02:41:07.800 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-12T02:41:07.800 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:41:07.876 INFO:tasks.ceph.osd.5:Stopped 2024-09-12T02:41:07.876 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-12T02:41:07.876 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:41:07.941 INFO:tasks.ceph.osd.6:Stopped 2024-09-12T02:41:07.941 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-12T02:41:07.941 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:41:08.001 INFO:tasks.ceph.osd.7:Stopped 2024-09-12T02:41:08.001 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T02:41:08.002 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-12T02:41:08.002 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:41:08.033 INFO:tasks.ceph.mgr.y:Stopped 2024-09-12T02:41:08.033 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T02:41:08.033 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:41:08.058 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T02:41:08.058 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T02:41:08.058 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T02:41:08.058 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:41:08.084 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T02:41:08.084 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T02:41:08.084 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:41:08.109 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T02:41:08.109 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T02:41:08.109 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:41:08.159 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T02:41:08.159 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T02:41:08.160 DEBUG:teuthology.orchestra.run.smithi060:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | egrep -v 'overall HEALTH_' | egrep -v '\(MON_DOWN\)' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-12T02:41:08.254 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi060.front.sepia.ceph.com 2024-09-12T02:41:08.254 DEBUG:teuthology.orchestra.run.smithi060:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T02:41:08.656 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi060.front.sepia.ceph.com 2024-09-12T02:41:08.656 DEBUG:teuthology.orchestra.run.smithi060:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T02:41:08.786 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi060.front.sepia.ceph.com 2024-09-12T02:41:08.786 DEBUG:teuthology.orchestra.run.smithi060:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T02:41:08.883 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi060.front.sepia.ceph.com 2024-09-12T02:41:08.883 DEBUG:teuthology.orchestra.run.smithi060:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-12T02:41:09.014 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi105.front.sepia.ceph.com 2024-09-12T02:41:09.014 DEBUG:teuthology.orchestra.run.smithi105:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-12T02:41:09.380 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi105.front.sepia.ceph.com 2024-09-12T02:41:09.380 DEBUG:teuthology.orchestra.run.smithi105:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-12T02:41:09.517 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi105.front.sepia.ceph.com 2024-09-12T02:41:09.517 DEBUG:teuthology.orchestra.run.smithi105:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-12T02:41:09.625 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi105.front.sepia.ceph.com 2024-09-12T02:41:09.625 DEBUG:teuthology.orchestra.run.smithi105:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-12T02:41:09.753 INFO:tasks.ceph:Archiving mon data... 2024-09-12T02:41:09.754 DEBUG:teuthology.misc:Transferring archived files from smithi060:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901613/data/mon.a.tgz 2024-09-12T02:41:09.754 DEBUG:teuthology.orchestra.run.smithi060:> mktemp 2024-09-12T02:41:09.787 INFO:teuthology.orchestra.run.smithi060.stdout:/tmp/tmp.VW3gk5aQhV 2024-09-12T02:41:09.788 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.VW3gk5aQhV 2024-09-12T02:41:09.969 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 0666 /tmp/tmp.VW3gk5aQhV 2024-09-12T02:41:10.069 DEBUG:teuthology.orchestra.remote:smithi060:/tmp/tmp.VW3gk5aQhV is 452KB 2024-09-12T02:41:10.167 DEBUG:teuthology.orchestra.run.smithi060:> rm -fr /tmp/tmp.VW3gk5aQhV 2024-09-12T02:41:10.182 DEBUG:teuthology.misc:Transferring archived files from smithi105:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901613/data/mon.b.tgz 2024-09-12T02:41:10.182 DEBUG:teuthology.orchestra.run.smithi105:> mktemp 2024-09-12T02:41:10.204 INFO:teuthology.orchestra.run.smithi105.stdout:/tmp/tmp.4Hq85QIPFM 2024-09-12T02:41:10.205 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.4Hq85QIPFM 2024-09-12T02:41:10.363 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 0666 /tmp/tmp.4Hq85QIPFM 2024-09-12T02:41:10.475 DEBUG:teuthology.orchestra.remote:smithi105:/tmp/tmp.4Hq85QIPFM is 456KB 2024-09-12T02:41:10.571 DEBUG:teuthology.orchestra.run.smithi105:> rm -fr /tmp/tmp.4Hq85QIPFM 2024-09-12T02:41:10.586 DEBUG:teuthology.misc:Transferring archived files from smithi105:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901613/data/mon.c.tgz 2024-09-12T02:41:10.586 DEBUG:teuthology.orchestra.run.smithi105:> mktemp 2024-09-12T02:41:10.640 INFO:teuthology.orchestra.run.smithi105.stdout:/tmp/tmp.oFwXlmaaqd 2024-09-12T02:41:10.641 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.oFwXlmaaqd 2024-09-12T02:41:10.784 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 0666 /tmp/tmp.oFwXlmaaqd 2024-09-12T02:41:10.867 DEBUG:teuthology.orchestra.remote:smithi105:/tmp/tmp.oFwXlmaaqd is 456KB 2024-09-12T02:41:10.935 DEBUG:teuthology.orchestra.run.smithi105:> rm -fr /tmp/tmp.oFwXlmaaqd 2024-09-12T02:41:10.950 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T02:41:10.951 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T02:41:10.953 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T02:41:11.036 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T02:41:11.069 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T02:41:11.069 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T02:41:11.071 DEBUG:teuthology.misc:Transferring archived files from smithi060:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901613/remote/smithi060/crash 2024-09-12T02:41:11.071 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T02:41:11.103 DEBUG:teuthology.misc:Transferring archived files from smithi105:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901613/remote/smithi105/crash 2024-09-12T02:41:11.104 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T02:41:11.132 INFO:tasks.ceph:Shutting down logrotate 2024-09-12T02:41:11.133 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:41:11.148 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:41:11.220 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-12T02:41:11.246 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-12T02:41:11.271 INFO:tasks.ceph:Compressing logs... 2024-09-12T02:41:11.271 DEBUG:teuthology.orchestra.run.smithi060:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T02:41:11.289 DEBUG:teuthology.orchestra.run.smithi105:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T02:41:11.312 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T02:41:11.318 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46256.log 2024-09-12T02:41:11.318 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101492.log 2024-09-12T02:41:11.318 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.46256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46168.log 2024-09-12T02:41:11.318 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.101492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54220.log 2024-09-12T02:41:11.318 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51133.log 2024-09-12T02:41:11.318 INFO:teuthology.orchestra.run.smithi060.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.101492.log.gz 2024-09-12T02:41:11.318 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.54220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55712.log 2024-09-12T02:41:11.318 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45447.log 2024-09-12T02:41:11.319 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.55712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56587.log 2024-09-12T02:41:11.319 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60820.log 2024-09-12T02:41:11.319 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.56587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81343.log 2024-09-12T02:41:11.319 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51133.log.gz 2024-09-12T02:41:11.319 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.60820.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56587.log.gz 2024-09-12T02:41:11.319 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42616.log 2024-09-12T02:41:11.319 INFO:teuthology.orchestra.run.smithi060.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.60820.log.gz 2024-09-12T02:41:11.319 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93275.log 2024-09-12T02:41:11.319 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.81343.log: /var/log/ceph/ceph-client.admin.42616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106391.log 2024-09-12T02:41:11.319 INFO:teuthology.orchestra.run.smithi060.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.81343.log.gz 2024-09-12T02:41:11.319 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.93275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79246.log 2024-09-12T02:41:11.319 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.93275.log.gz 2024-09-12T02:41:11.319 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.106391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52616.log 2024-09-12T02:41:11.319 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.79246.log: gzip -5 89.9% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.106391.log.gz 2024-09-12T02:41:11.320 INFO:teuthology.orchestra.run.smithi060.stderr: /var/log/ceph/ceph-client.admin.107703.log 2024-09-12T02:41:11.320 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53221.log 2024-09-12T02:41:11.320 INFO:teuthology.orchestra.run.smithi060.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.79246.log.gz 2024-09-12T02:41:11.320 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.107703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54262.log 2024-09-12T02:41:11.320 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.107703.log.gz 2024-09-12T02:41:11.320 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.53221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70457.log 2024-09-12T02:41:11.320 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41228.log 2024-09-12T02:41:11.320 INFO:teuthology.orchestra.run.smithi060.stderr: 88.4%/var/log/ceph/ceph-client.admin.54262.log: -- replaced with /var/log/ceph/ceph-client.admin.52616.log.gz 2024-09-12T02:41:11.320 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.70457.log: -- /var/log/ceph/ceph-client.admin.54094.log 2024-09-12T02:41:11.343 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.70457.log.gz/var/log/ceph/ceph-client.admin.41228.log: 2024-09-12T02:41:11.344 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42448.log 2024-09-12T02:41:11.344 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.54094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50349.log 2024-09-12T02:41:11.344 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107156.log 2024-09-12T02:41:11.344 INFO:teuthology.orchestra.run.smithi060.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55712.log.gz 2024-09-12T02:41:11.344 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.50349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44119.log 2024-09-12T02:41:11.344 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.107156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54659.log 2024-09-12T02:41:11.344 INFO:teuthology.orchestra.run.smithi060.stderr: 89.1%/var/log/ceph/ceph-client.admin.44119.log: -- replaced with /var/log/ceph/ceph-client.admin.107156.log.gz 2024-09-12T02:41:11.344 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52237.log 2024-09-12T02:41:11.344 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72119.log 2024-09-12T02:41:11.344 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.54659.log: gzip -5 --verbose/var/log/ceph/ceph-client.admin.52237.log: -- /var/log/ceph/ceph-client.admin.42784.log 2024-09-12T02:41:11.344 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44482.log 2024-09-12T02:41:11.344 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.72119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51403.log 2024-09-12T02:41:11.344 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42784.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.72119.log.gz 2024-09-12T02:41:11.345 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43424.log 2024-09-12T02:41:11.345 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43088.log 2024-09-12T02:41:11.345 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43424.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41228.log.gz 2024-09-12T02:41:11.345 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41772.log 2024-09-12T02:41:11.345 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43423.log 2024-09-12T02:41:11.345 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43088.log: /var/log/ceph/ceph-client.admin.41772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106211.log 2024-09-12T02:41:11.345 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49810.log 2024-09-12T02:41:11.345 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.106211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41814.log 2024-09-12T02:41:11.345 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.49810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56882.log 2024-09-12T02:41:11.345 INFO:teuthology.orchestra.run.smithi060.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.106211.log.gz 2024-09-12T02:41:11.345 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46843.log 2024-09-12T02:41:11.345 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.41814.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51403.log.gz 2024-09-12T02:41:11.345 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.56882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107930.log 2024-09-12T02:41:11.345 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81433.log 2024-09-12T02:41:11.346 INFO:teuthology.orchestra.run.smithi060.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.56882.log.gz 2024-09-12T02:41:11.346 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50779.log 2024-09-12T02:41:11.346 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.107930.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54659.log.gz 2024-09-12T02:41:11.346 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.81433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58855.log 2024-09-12T02:41:11.346 INFO:teuthology.orchestra.run.smithi060.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.107930.log.gz 2024-09-12T02:41:11.346 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.81433.log.gz 2024-09-12T02:41:11.346 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41772.log.gz 2024-09-12T02:41:11.346 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.50779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37054.log 2024-09-12T02:41:11.346 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.58855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107112.log 2024-09-12T02:41:11.346 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.37054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107619.log 2024-09-12T02:41:11.346 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.58855.log.gz 2024-09-12T02:41:11.346 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.107112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101315.log 2024-09-12T02:41:11.346 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.107619.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.107112.log.gz 2024-09-12T02:41:11.346 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99178.log 2024-09-12T02:41:11.347 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.107619.log.gz 2024-09-12T02:41:11.347 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41516.log 2024-09-12T02:41:11.347 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.101315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42066.log 2024-09-12T02:41:11.347 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.99178.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.101315.log.gz 2024-09-12T02:41:11.347 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.41516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43428.log 2024-09-12T02:41:11.347 INFO:teuthology.orchestra.run.smithi060.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.99178.log.gz 2024-09-12T02:41:11.347 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76288.log 2024-09-12T02:41:11.347 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42910.log 2024-09-12T02:41:11.347 INFO:teuthology.orchestra.run.smithi060.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41814.log.gz 2024-09-12T02:41:11.347 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.76288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55016.log 2024-09-12T02:41:11.347 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42910.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T02:41:11.347 INFO:teuthology.orchestra.run.smithi060.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.76288.log.gz 2024-09-12T02:41:11.347 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.55016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46573.log 2024-09-12T02:41:11.347 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54178.log 2024-09-12T02:41:11.348 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55856.log 2024-09-12T02:41:11.348 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41516.log.gz 2024-09-12T02:41:11.348 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.54178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52406.log 2024-09-12T02:41:11.348 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.55856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46041.log 2024-09-12T02:41:11.348 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53137.log 2024-09-12T02:41:11.348 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52406.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.49810.log.gz 2024-09-12T02:41:11.348 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62129.log 2024-09-12T02:41:11.348 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.53137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46759.log 2024-09-12T02:41:11.348 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.62129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44902.log 2024-09-12T02:41:11.348 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.62129.log.gz 2024-09-12T02:41:11.348 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107787.log 2024-09-12T02:41:11.348 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56966.log 2024-09-12T02:41:11.348 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44902.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46168.log.gz 2024-09-12T02:41:11.349 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106788.log 2024-09-12T02:41:11.349 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.107787.log: /var/log/ceph/ceph-client.admin.56966.log: gzip -5 91.9% --verbose -- replaced with /var/log/ceph/ceph-client.admin.46256.log.gz -- 2024-09-12T02:41:11.349 INFO:teuthology.orchestra.run.smithi060.stderr: /var/log/ceph/ceph-client.admin.45817.log 2024-09-12T02:41:11.349 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.107787.log.gz 2024-09-12T02:41:11.349 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.106788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81641.log 2024-09-12T02:41:11.349 INFO:teuthology.orchestra.run.smithi060.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52406.log.gz 2024-09-12T02:41:11.349 INFO:teuthology.orchestra.run.smithi060.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.56966.log.gz 2024-09-12T02:41:11.349 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.106788.log.gz 2024-09-12T02:41:11.349 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91780.log 2024-09-12T02:41:11.349 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.81641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42700.log 2024-09-12T02:41:11.349 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.81641.log.gz 2024-09-12T02:41:11.349 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.91780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42826.log 2024-09-12T02:41:11.349 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42150.log 2024-09-12T02:41:11.349 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42700.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.91780.log.gz 2024-09-12T02:41:11.350 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89441.log 2024-09-12T02:41:11.350 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108266.log 2024-09-12T02:41:11.350 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50349.log.gz 2024-09-12T02:41:11.350 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.89441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53617.log 2024-09-12T02:41:11.350 INFO:teuthology.orchestra.run.smithi060.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.89441.log.gz 2024-09-12T02:41:11.350 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62716.log 2024-09-12T02:41:11.350 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.108266.log: /var/log/ceph/ceph-client.admin.53617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108056.log 2024-09-12T02:41:11.350 INFO:teuthology.orchestra.run.smithi060.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.108266.log.gz 2024-09-12T02:41:11.350 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.62716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92586.log 2024-09-12T02:41:11.350 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.108056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51301.log 2024-09-12T02:41:11.350 INFO:teuthology.orchestra.run.smithi060.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.62716.log.gz 2024-09-12T02:41:11.350 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50391.log 2024-09-12T02:41:11.350 INFO:teuthology.orchestra.run.smithi060.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.108056.log.gz 2024-09-12T02:41:11.350 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.92586.log: /var/log/ceph/ceph-client.admin.51301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56364.log 2024-09-12T02:41:11.351 INFO:teuthology.orchestra.run.smithi060.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.92586.log.gz 2024-09-12T02:41:11.351 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.50391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54533.log 2024-09-12T02:41:11.351 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.56364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56629.log 2024-09-12T02:41:11.351 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55856.log.gz 2024-09-12T02:41:11.351 INFO:teuthology.orchestra.run.smithi060.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56364.log.gz 2024-09-12T02:41:11.351 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107972.log 2024-09-12T02:41:11.351 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.54533.log: /var/log/ceph/ceph-client.admin.56629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55238.log 2024-09-12T02:41:11.351 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.107972.log: gzip -5 --verbose -- 88.8% /var/log/ceph/ceph-client.admin.107409.log 2024-09-12T02:41:11.351 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56629.log.gz 2024-09-12T02:41:11.351 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.107972.log.gz 2024-09-12T02:41:11.351 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.55238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54575.log 2024-09-12T02:41:11.351 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.107409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107535.log 2024-09-12T02:41:11.351 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.54575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107451.log 2024-09-12T02:41:11.352 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.107409.log.gz 2024-09-12T02:41:11.352 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.107535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89590.log 2024-09-12T02:41:11.352 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.107451.log: gzip -5 --verbose -- 88.4% /var/log/ceph/ceph-client.admin.63315.log 2024-09-12T02:41:11.352 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.107535.log.gz 2024-09-12T02:41:11.352 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.107451.log.gz 2024-09-12T02:41:11.352 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47142.log 2024-09-12T02:41:11.352 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.89590.log: /var/log/ceph/ceph-client.admin.63315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91532.log 2024-09-12T02:41:11.352 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.89590.log.gz 2024-09-12T02:41:11.352 INFO:teuthology.orchestra.run.smithi060.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46041.log.gz 2024-09-12T02:41:11.352 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47142.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.63315.log.gz 2024-09-12T02:41:11.352 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44758.log 2024-09-12T02:41:11.352 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.91532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42742.log 2024-09-12T02:41:11.352 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50307.log 2024-09-12T02:41:11.352 INFO:teuthology.orchestra.run.smithi060.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.91532.log.gz 2024-09-12T02:41:11.353 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43998.log 2024-09-12T02:41:11.353 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42742.log: /var/log/ceph/ceph-client.admin.50307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104580.log 2024-09-12T02:41:11.353 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52828.log 2024-09-12T02:41:11.353 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52009.log 2024-09-12T02:41:11.353 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.104580.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42066.log.gz 2024-09-12T02:41:11.353 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53769.log 2024-09-12T02:41:11.353 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52828.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.104580.log.gz 2024-09-12T02:41:11.353 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60903.log 2024-09-12T02:41:11.353 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.53769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52448.log 2024-09-12T02:41:11.353 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.60903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41982.log 2024-09-12T02:41:11.353 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108452.log 2024-09-12T02:41:11.353 INFO:teuthology.orchestra.run.smithi060.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.60903.log.gz 2024-09-12T02:41:11.353 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54533.log.gz 2024-09-12T02:41:11.354 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54575.log.gz 2024-09-12T02:41:11.354 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.41982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53853.log 2024-09-12T02:41:11.354 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.108452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44566.log 2024-09-12T02:41:11.354 INFO:teuthology.orchestra.run.smithi060.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.52237.log.gz 2024-09-12T02:41:11.354 INFO:teuthology.orchestra.run.smithi060.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.108452.log.gz 2024-09-12T02:41:11.354 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.53853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54890.log 2024-09-12T02:41:11.354 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43092.log 2024-09-12T02:41:11.354 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.54890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44120.log 2024-09-12T02:41:11.365 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36516.log 2024-09-12T02:41:11.365 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36316.log 2024-09-12T02:41:11.365 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.36516.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-12T02:41:11.365 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.36316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36396.log 2024-09-12T02:41:11.366 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-12T02:41:11.366 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.36396.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-12T02:41:11.366 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T02:41:11.366 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42685.log 2024-09-12T02:41:11.366 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36556.log 2024-09-12T02:41:11.366 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.1.42685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36436.log 2024-09-12T02:41:11.366 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.36556.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-12T02:41:11.366 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.36436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36476.log 2024-09-12T02:41:11.366 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36267.log 2024-09-12T02:41:11.366 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.36476.log: /var/log/ceph/ceph-osd.6.log 2024-09-12T02:41:11.366 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.36267.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-12T02:41:11.366 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T02:41:11.366 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-12T02:41:11.366 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T02:41:11.367 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-12T02:41:11.367 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36356.log 2024-09-12T02:41:11.367 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.36356.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36516.log.gz 2024-09-12T02:41:11.367 INFO:teuthology.orchestra.run.smithi105.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.36556.log.gz 2024-09-12T02:41:11.367 INFO:teuthology.orchestra.run.smithi105.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.36436.log.gz 2024-09-12T02:41:11.367 INFO:teuthology.orchestra.run.smithi105.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36476.log.gz 2024-09-12T02:41:11.456 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55196.log 2024-09-12T02:41:11.456 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55016.log.gz 2024-09-12T02:41:11.456 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52490.log 2024-09-12T02:41:11.456 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44120.log: /var/log/ceph/ceph-client.admin.55196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45733.log 2024-09-12T02:41:11.456 INFO:teuthology.orchestra.run.smithi060.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42150.log.gz 2024-09-12T02:41:11.456 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51925.log 2024-09-12T02:41:11.456 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63245.log 2024-09-12T02:41:11.456 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81175.log 2024-09-12T02:41:11.457 INFO:teuthology.orchestra.run.smithi060.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.51301.log.gz 2024-09-12T02:41:11.457 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.63245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43425.log 2024-09-12T02:41:11.457 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.81175.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.63245.log.gz 2024-09-12T02:41:11.457 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106559.log 2024-09-12T02:41:11.457 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99106.log 88.5% 2024-09-12T02:41:11.457 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.81175.log.gz 2024-09-12T02:41:11.457 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43425.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37054.log.gz 2024-09-12T02:41:11.457 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.106559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61573.log 2024-09-12T02:41:11.457 INFO:teuthology.orchestra.run.smithi060.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.106559.log.gz 2024-09-12T02:41:11.457 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.99106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43091.log 2024-09-12T02:41:11.457 INFO:teuthology.orchestra.run.smithi060.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.99106.log.gz 2024-09-12T02:41:11.457 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66435.log 2024-09-12T02:41:11.457 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.61573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67910.log 2024-09-12T02:41:11.458 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43091.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61573.log.gz 2024-09-12T02:41:11.458 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56260.log 2024-09-12T02:41:11.458 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.66435.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46573.log.gz 2024-09-12T02:41:11.458 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.67910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52321.log 2024-09-12T02:41:11.458 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.66435.log.gz 2024-09-12T02:41:11.458 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.56260.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.67910.log.gz 2024-09-12T02:41:11.458 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67553.log 2024-09-12T02:41:11.458 INFO:teuthology.orchestra.run.smithi060.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54890.log.gz 2024-09-12T02:41:11.458 INFO:teuthology.orchestra.run.smithi060.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.56260.log.gz 2024-09-12T02:41:11.458 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43763.log 2024-09-12T02:41:11.458 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.67553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44800.log 2024-09-12T02:41:11.458 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43763.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.67553.log.gz 2024-09-12T02:41:11.458 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45691.log 2024-09-12T02:41:11.459 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44111.log 2024-09-12T02:41:11.459 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44800.log: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.53617.log.gz 2024-09-12T02:41:11.459 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44116.log 2024-09-12T02:41:11.459 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55940.log 2024-09-12T02:41:11.459 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56924.log 2024-09-12T02:41:11.459 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.55940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42868.log 2024-09-12T02:41:11.459 INFO:teuthology.orchestra.run.smithi060.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.50391.log.gz 2024-09-12T02:41:11.459 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.56924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44524.log 2024-09-12T02:41:11.459 INFO:teuthology.orchestra.run.smithi060.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.55940.log.gz 2024-09-12T02:41:11.459 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42868.log: gzip -5 --verbose 88.7% -- -- replaced with /var/log/ceph/ceph-client.admin.56924.log.gz /var/log/ceph/ceph-client.admin.42406.log 2024-09-12T02:41:11.459 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-09-12T02:41:11.459 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51487.log 2024-09-12T02:41:11.459 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41644.log 2024-09-12T02:41:11.459 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98958.log 2024-09-12T02:41:11.460 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.41644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55670.log 2024-09-12T02:41:11.460 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51091.log 2024-09-12T02:41:11.460 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.98958.log: /var/log/ceph/ceph-client.admin.55670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56755.log 2024-09-12T02:41:11.460 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98958.log.gz 2024-09-12T02:41:11.460 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55796.log 2024-09-12T02:41:11.460 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51091.log: /var/log/ceph/ceph-client.admin.56755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54136.log 2024-09-12T02:41:11.460 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.55796.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.56755.log.gz -5 2024-09-12T02:41:11.460 INFO:teuthology.orchestra.run.smithi060.stderr: --verbose -- /var/log/ceph/ceph-client.admin.79428.log 2024-09-12T02:41:11.460 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53811.log 2024-09-12T02:41:11.460 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.54136.log: /var/log/ceph/ceph-client.admin.79428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46489.log 2024-09-12T02:41:11.460 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.53811.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.79428.log.gz 2024-09-12T02:41:11.460 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T02:41:11.460 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52574.log 2024-09-12T02:41:11.461 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69919.log 2024-09-12T02:41:11.461 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46405.log 2024-09-12T02:41:11.461 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108368.log 2024-09-12T02:41:11.461 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.69919.log: /var/log/ceph/ceph-client.admin.46405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55354.log 2024-09-12T02:41:11.461 INFO:teuthology.orchestra.run.smithi060.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.69919.log.gz 2024-09-12T02:41:11.461 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58375.log 2024-09-12T02:41:11.461 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.108368.log: /var/log/ceph/ceph-client.admin.55354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69826.log 2024-09-12T02:41:11.461 INFO:teuthology.orchestra.run.smithi060.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.108368.log.gz 2024-09-12T02:41:11.461 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5/var/log/ceph/ceph-client.admin.58375.log: --verbose -- /var/log/ceph/ceph-client.admin.51217.log 2024-09-12T02:41:11.461 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.69826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43427.log 2024-09-12T02:41:11.461 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.58375.log.gz 2024-09-12T02:41:11.461 INFO:teuthology.orchestra.run.smithi060.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42448.log.gz 2024-09-12T02:41:11.461 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.51217.log: /var/log/ceph/ceph-client.admin.53179.log 2024-09-12T02:41:11.461 INFO:teuthology.orchestra.run.smithi060.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.69826.log.gz 2024-09-12T02:41:11.462 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61045.log 2024-09-12T02:41:11.462 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42616.log.gz 2024-09-12T02:41:11.462 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42700.log.gz 2024-09-12T02:41:11.462 INFO:teuthology.orchestra.run.smithi060.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42742.log.gz 2024-09-12T02:41:11.462 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97784.log/var/log/ceph/ceph-client.admin.53179.log: 2024-09-12T02:41:11.462 INFO:teuthology.orchestra.run.smithi060.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42784.log.gz 2024-09-12T02:41:11.462 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42826.log.gz 2024-09-12T02:41:11.462 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.61045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41558.log 2024-09-12T02:41:11.462 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.97784.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61045.log.gz 2024-09-12T02:41:11.462 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99335.log 2024-09-12T02:41:11.462 INFO:teuthology.orchestra.run.smithi060.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.97784.log.gz 2024-09-12T02:41:11.462 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.41558.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42910.log.gz 2024-09-12T02:41:11.462 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52363.log 2024-09-12T02:41:11.462 INFO:teuthology.orchestra.run.smithi060.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43088.log.gz 2024-09-12T02:41:11.463 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.99335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107577.log 2024-09-12T02:41:11.463 INFO:teuthology.orchestra.run.smithi060.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43091.log.gz 2024-09-12T02:41:11.463 INFO:teuthology.orchestra.run.smithi060.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43092.log.gz 2024-09-12T02:41:11.463 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.99335.log.gz 2024-09-12T02:41:11.463 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51175.log 2024-09-12T02:41:11.463 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43423.log.gz 2024-09-12T02:41:11.463 INFO:teuthology.orchestra.run.smithi060.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43424.log.gz 2024-09-12T02:41:11.463 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.107577.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43425.log.gz 2024-09-12T02:41:11.463 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54974.log 2024-09-12T02:41:11.463 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43428.log.gz 2024-09-12T02:41:11.463 INFO:teuthology.orchestra.run.smithi060.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.107577.log.gz 2024-09-12T02:41:11.463 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43759.log 2024-09-12T02:41:11.463 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43763.log.gz 2024-09-12T02:41:11.464 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.54974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50863.log 2024-09-12T02:41:11.464 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55058.log 2024-09-12T02:41:11.464 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108140.log 2024-09-12T02:41:11.464 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1%/var/log/ceph/ceph-client.admin.50863.log: -- replaced with /var/log/ceph/ceph-client.admin.43998.log.gz 2024-09-12T02:41:11.464 INFO:teuthology.orchestra.run.smithi060.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44120.log.gz 2024-09-12T02:41:11.464 INFO:teuthology.orchestra.run.smithi060.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44116.log.gz 2024-09-12T02:41:11.464 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44111.log.gz 2024-09-12T02:41:11.464 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.55058.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30659.log 2024-09-12T02:41:11.464 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.108140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36681.log 2024-09-12T02:41:11.464 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.108140.log.gz 2024-09-12T02:41:11.464 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph.tmp-client.admin.30659.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44566.log.gz 2024-09-12T02:41:11.464 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54848.log 2024-09-12T02:41:11.464 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30659.log.gz 2024-09-12T02:41:11.465 INFO:teuthology.orchestra.run.smithi060.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44524.log.gz 2024-09-12T02:41:11.465 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.36681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45565.log 2024-09-12T02:41:11.465 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.54848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53449.log 2024-09-12T02:41:11.465 INFO:teuthology.orchestra.run.smithi060.stderr:gzip/var/log/ceph/ceph-client.admin.45565.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.83994.log 2024-09-12T02:41:11.465 INFO:teuthology.orchestra.run.smithi060.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44758.log.gz 2024-09-12T02:41:11.465 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.53449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49578.log 2024-09-12T02:41:11.465 INFO:teuthology.orchestra.run.smithi060.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.44800.log.gz 2024-09-12T02:41:11.465 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.83994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51967.log 2024-09-12T02:41:11.465 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.49578.log: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56671.log 2024-09-12T02:41:11.465 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.83994.log.gz 2024-09-12T02:41:11.465 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50307.log.gz 2024-09-12T02:41:11.465 INFO:teuthology.orchestra.run.smithi060.stderr: 88.9% 91.0%/var/log/ceph/ceph-client.admin.51967.log: -- replaced with /var/log/ceph/ceph-client.admin.51217.log.gz 2024-09-12T02:41:11.465 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52828.log.gz 2024-09-12T02:41:11.465 INFO:teuthology.orchestra.run.smithi060.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55796.log.gz 2024-09-12T02:41:11.466 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.56671.log: /var/log/ceph/ceph-client.admin.45523.log 2024-09-12T02:41:11.466 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41558.log.gz 2024-09-12T02:41:11.466 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41644.log.gz 89.7% -- replaced with /var/log/ceph/ceph-client.admin.56671.log.gz 2024-09-12T02:41:11.466 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41434.log 2024-09-12T02:41:11.466 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41982.log.gz 2024-09-12T02:41:11.466 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-09-12T02:41:11.466 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52195.log 2024-09-12T02:41:11.466 INFO:teuthology.orchestra.run.smithi060.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46405.log.gz 2024-09-12T02:41:11.466 INFO:teuthology.orchestra.run.smithi060.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46489.log.gz 2024-09-12T02:41:11.466 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.41434.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51091.log.gz 2024-09-12T02:41:11.466 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52195.log: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106977.log 2024-09-12T02:41:11.466 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51175.log.gz 2024-09-12T02:41:11.466 INFO:teuthology.orchestra.run.smithi060.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.52321.log.gz 2024-09-12T02:41:11.467 INFO:teuthology.orchestra.run.smithi060.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52363.log.gz 2024-09-12T02:41:11.467 INFO:teuthology.orchestra.run.smithi060.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54848.log.gz 2024-09-12T02:41:11.467 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94694.log 2024-09-12T02:41:11.467 INFO:teuthology.orchestra.run.smithi060.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.54974.log.gz 2024-09-12T02:41:11.467 INFO:teuthology.orchestra.run.smithi060.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.47142.log.gz 2024-09-12T02:41:11.467 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.106977.log: -- /var/log/ceph/ceph-client.admin.53323.log 2024-09-12T02:41:11.467 INFO:teuthology.orchestra.run.smithi060.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.36681.log.gz 2024-09-12T02:41:11.467 INFO:teuthology.orchestra.run.smithi060.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52195.log.gz 2024-09-12T02:41:11.467 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.94694.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.106977.log.gz 2024-09-12T02:41:11.467 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50737.log 2024-09-12T02:41:11.467 INFO:teuthology.orchestra.run.smithi060.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.94694.log.gz 2024-09-12T02:41:11.467 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.53323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78217.log 2024-09-12T02:41:11.467 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.50737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108410.log 2024-09-12T02:41:11.467 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52532.log 2024-09-12T02:41:11.468 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.78217.log: /var/log/ceph/ceph-client.admin.108410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53533.log 2024-09-12T02:41:11.468 INFO:teuthology.orchestra.run.smithi060.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.78217.log.gz 2024-09-12T02:41:11.468 INFO:teuthology.orchestra.run.smithi060.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.108410.log.gz 2024-09-12T02:41:11.468 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54932.log 2024-09-12T02:41:11.468 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52532.log: /var/log/ceph/ceph-client.admin.53533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101142.log 2024-09-12T02:41:11.468 INFO:teuthology.orchestra.run.smithi060.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42406.log.gz 2024-09-12T02:41:11.468 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.54932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107325.log 2024-09-12T02:41:11.468 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42868.log.gz 2024-09-12T02:41:11.468 INFO:teuthology.orchestra.run.smithi060.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43427.log.gz 2024-09-12T02:41:11.468 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.101142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107890.log 2024-09-12T02:41:11.468 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43759.log.gz 2024-09-12T02:41:11.468 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101142.log.gz 2024-09-12T02:41:11.468 INFO:teuthology.orchestra.run.smithi060.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41434.log.gz 2024-09-12T02:41:11.469 INFO:teuthology.orchestra.run.smithi060.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49578.log.gz/var/log/ceph/ceph-client.admin.107325.log: 2024-09-12T02:41:11.469 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89363.log 2024-09-12T02:41:11.469 INFO:teuthology.orchestra.run.smithi060.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54932.log.gz 2024-09-12T02:41:11.469 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.107325.log.gz 2024-09-12T02:41:11.469 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.107890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50577.log 2024-09-12T02:41:11.469 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.107890.log.gz 2024-09-12T02:41:11.469 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.89363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98338.log 2024-09-12T02:41:11.469 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.89363.log.gz 2024-09-12T02:41:11.469 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.50577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45956.log 2024-09-12T02:41:11.469 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106433.log 2024-09-12T02:41:11.469 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.98338.log: /var/log/ceph/ceph-client.admin.45956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54788.log 2024-09-12T02:41:11.469 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98338.log.gz 2024-09-12T02:41:11.469 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.106433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52676.log 2024-09-12T02:41:11.469 INFO:teuthology.orchestra.run.smithi060.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.106433.log.gz/var/log/ceph/ceph-client.admin.54788.log: 2024-09-12T02:41:11.470 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51883.log 2024-09-12T02:41:11.470 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51781.log 2024-09-12T02:41:11.470 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71010.log 2024-09-12T02:41:11.470 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51883.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45817.log.gz 2024-09-12T02:41:11.470 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56490.log 2024-09-12T02:41:11.470 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.71010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41600.log 2024-09-12T02:41:11.470 INFO:teuthology.orchestra.run.smithi060.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.71010.log.gz 2024-09-12T02:41:11.470 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.56490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54304.log 2024-09-12T02:41:11.470 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.41600.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.56490.log.gz 2024-09-12T02:41:11.470 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106349.log 2024-09-12T02:41:11.470 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.54304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56797.log 2024-09-12T02:41:11.470 INFO:teuthology.orchestra.run.smithi060.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45447.log.gz 2024-09-12T02:41:11.470 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.106349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102220.log 2024-09-12T02:41:11.471 INFO:teuthology.orchestra.run.smithi060.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.106349.log.gz 2024-09-12T02:41:11.471 INFO:teuthology.orchestra.run.smithi060.stderr: 87.6% 88.1%/var/log/ceph/ceph-client.admin.56797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60976.log -- replaced with /var/log/ceph/ceph-client.admin.45523.log.gz 2024-09-12T02:41:11.471 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-09-12T02:41:11.471 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45956.log.gz 2024-09-12T02:41:11.471 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45565.log.gz 2024-09-12T02:41:11.471 INFO:teuthology.orchestra.run.smithi060.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.50577.log.gz 2024-09-12T02:41:11.471 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.102220.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56797.log.gz 2024-09-12T02:41:11.471 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107283.log 2024-09-12T02:41:11.471 INFO:teuthology.orchestra.run.smithi060.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.52676.log.gz 2024-09-12T02:41:11.471 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.102220.log.gz 2024-09-12T02:41:11.471 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.60976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55396.log 2024-09-12T02:41:11.471 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.107283.log: 87.9% 89.2% -- replaced with /var/log/ceph/ceph-client.admin.60976.log.gz 2024-09-12T02:41:11.471 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54304.log.gz 2024-09-12T02:41:11.471 INFO:teuthology.orchestra.run.smithi060.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52574.log.gz 89.0% 2024-09-12T02:41:11.472 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52448.log.gz 2024-09-12T02:41:11.472 INFO:teuthology.orchestra.run.smithi060.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.52490.log.gz 2024-09-12T02:41:11.472 INFO:teuthology.orchestra.run.smithi060.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52532.log.gz 2024-09-12T02:41:11.472 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.55396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53701.log 2024-09-12T02:41:11.472 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.107283.log.gz 2024-09-12T02:41:11.472 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103453.log 2024-09-12T02:41:11.472 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.53701.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-12T02:41:11.472 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.103453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50821.log 2024-09-12T02:41:11.472 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42490.log 2024-09-12T02:41:11.472 INFO:teuthology.orchestra.run.smithi060.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.103453.log.gz 2024-09-12T02:41:11.472 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.50821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46968.log 2024-09-12T02:41:11.472 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42490.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.52009.log.gzgzip 2024-09-12T02:41:11.472 INFO:teuthology.orchestra.run.smithi060.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44674.log 2024-09-12T02:41:11.473 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43090.log 2024-09-12T02:41:11.473 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59050.log 2024-09-12T02:41:11.473 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107367.log 2024-09-12T02:41:11.473 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.59050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45999.log 2024-09-12T02:41:11.473 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.107367.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.59050.log.gz 2024-09-12T02:41:11.473 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108014.log 2024-09-12T02:41:11.473 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.107367.log.gz 2024-09-12T02:41:11.473 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78811.log 2024-09-12T02:41:11.473 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.108014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44314.log 2024-09-12T02:41:11.473 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.108014.log.gz 2024-09-12T02:41:11.473 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.78811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94624.log 2024-09-12T02:41:11.473 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107198.log 2024-09-12T02:41:11.473 INFO:teuthology.orchestra.run.smithi060.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.78811.log.gz 2024-09-12T02:41:11.474 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.94624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56532.log 2024-09-12T02:41:11.474 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.107198.log: gzip 89.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.94624.log.gz --verbose 2024-09-12T02:41:11.474 INFO:teuthology.orchestra.run.smithi060.stderr: -- /var/log/ceph/ceph-client.admin.53011.log 2024-09-12T02:41:11.474 INFO:teuthology.orchestra.run.smithi060.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.107198.log.gz 2024-09-12T02:41:11.474 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.56532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59137.log 2024-09-12T02:41:11.474 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.53011.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56532.log.gz 2024-09-12T02:41:11.474 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49768.log 2024-09-12T02:41:11.474 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.59137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107847.log 2024-09-12T02:41:11.474 INFO:teuthology.orchestra.run.smithi060.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.59137.log.gz 2024-09-12T02:41:11.474 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.49768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54743.log 2024-09-12T02:41:11.474 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.107847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45775.log 2024-09-12T02:41:11.474 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.107847.log.gz 2024-09-12T02:41:11.474 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.54743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42234.log 2024-09-12T02:41:11.474 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49852.log 2024-09-12T02:41:11.474 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45340.log 2024-09-12T02:41:11.475 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.49852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93984.log 2024-09-12T02:41:11.475 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.0.45340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44115.log 2024-09-12T02:41:11.475 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54220.log.gz 2024-09-12T02:41:11.475 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.93984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53937.log 2024-09-12T02:41:11.475 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54262.log.gz 2024-09-12T02:41:11.475 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44115.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53179.log.gz 2024-09-12T02:41:11.475 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43416.log 2024-09-12T02:41:11.475 INFO:teuthology.orchestra.run.smithi060.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.93984.log.gz 2024-09-12T02:41:11.475 INFO:teuthology.orchestra.run.smithi060.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.53221.log.gz 2024-09-12T02:41:11.475 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46531.log 2024-09-12T02:41:11.475 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.53937.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54094.log.gz 2024-09-12T02:41:11.475 INFO:teuthology.orchestra.run.smithi060.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54136.log.gz 2024-09-12T02:41:11.475 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56087.log 2024-09-12T02:41:11.475 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43761.log 2024-09-12T02:41:11.476 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.56087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42658.log 2024-09-12T02:41:11.476 INFO:teuthology.orchestra.run.smithi060.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54178.log.gz 2024-09-12T02:41:11.476 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79338.log 2024-09-12T02:41:11.476 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56087.log.gz 2024-09-12T02:41:11.476 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43761.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55670.log.gz 2024-09-12T02:41:11.476 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56218.log 2024-09-12T02:41:11.476 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.79338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46615.log 2024-09-12T02:41:11.476 INFO:teuthology.orchestra.run.smithi060.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42490.log.gz 2024-09-12T02:41:11.476 INFO:teuthology.orchestra.run.smithi060.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.79338.log.gz 2024-09-12T02:41:11.476 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51739.log 2024-09-12T02:41:11.476 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.56218.log: /var/log/ceph/ceph-client.admin.46615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108494.log 2024-09-12T02:41:11.476 INFO:teuthology.orchestra.run.smithi060.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.56218.log.gz 2024-09-12T02:41:11.476 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51445.log 2024-09-12T02:41:11.476 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.108494.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-12T02:41:11.477 INFO:teuthology.orchestra.run.smithi060.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.108494.log.gz 2024-09-12T02:41:11.477 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55312.log 2024-09-12T02:41:11.477 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51445.log: /var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82896.log 2024-09-12T02:41:11.477 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43090.log.gz 2024-09-12T02:41:11.477 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.55312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106271.log 2024-09-12T02:41:11.477 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41338.log 2024-09-12T02:41:11.477 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.82896.log: /var/log/ceph/ceph-client.admin.106271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46214.log 2024-09-12T02:41:11.477 INFO:teuthology.orchestra.run.smithi060.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.106271.log.gz 2024-09-12T02:41:11.477 INFO:teuthology.orchestra.run.smithi060.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.82896.log.gz 2024-09-12T02:41:11.477 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.41338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52051.log 2024-09-12T02:41:11.477 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55522.log 2024-09-12T02:41:11.477 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43416.log.gz 2024-09-12T02:41:11.477 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43762.log 2024-09-12T02:41:11.478 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52051.log: /var/log/ceph/ceph-client.admin.55522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82235.log 2024-09-12T02:41:11.478 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57068.log 2024-09-12T02:41:11.478 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52153.log 2024-09-12T02:41:11.478 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.82235.log: /var/log/ceph/ceph-client.admin.57068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54389.log 2024-09-12T02:41:11.478 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.82235.log.gz 2024-09-12T02:41:11.478 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose 89.0% -- -- replaced with /var/log/ceph/ceph-client.admin.57068.log.gz /var/log/ceph/ceph-client.admin.54701.log 2024-09-12T02:41:11.478 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-09-12T02:41:11.478 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52153.log: /var/log/ceph/ceph-client.admin.54389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69505.log 2024-09-12T02:41:11.478 INFO:teuthology.orchestra.run.smithi060.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43761.log.gz 2024-09-12T02:41:11.478 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50433.log 2024-09-12T02:41:11.478 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.54701.log: 88.6%/var/log/ceph/ceph-client.admin.69505.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44314.log.gz 2024-09-12T02:41:11.478 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44115.log.gz 89.2% 2024-09-12T02:41:11.478 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44674.log.gz 2024-09-12T02:41:11.478 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.69505.log.gz 2024-09-12T02:41:11.479 INFO:teuthology.orchestra.run.smithi060.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.51781.log.gz 2024-09-12T02:41:11.479 INFO:teuthology.orchestra.run.smithi060.stderr: 90.3%/var/log/ceph/ceph-client.admin.50433.log: -- replaced with /var/log/ceph/ceph-client.admin.51739.log.gz 2024-09-12T02:41:11.479 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67693.log 2024-09-12T02:41:11.479 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51259.log 2024-09-12T02:41:11.479 INFO:teuthology.orchestra.run.smithi060.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51883.log.gz 2024-09-12T02:41:11.479 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.67693.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T02:41:11.479 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.67693.log.gz 2024-09-12T02:41:11.479 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52969.log 2024-09-12T02:41:11.479 INFO:teuthology.orchestra.run.smithi060.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.52051.log.gz 2024-09-12T02:41:11.479 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84073.log 2024-09-12T02:41:11.479 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72032.log 2024-09-12T02:41:11.479 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.84073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41898.log 2024-09-12T02:41:11.479 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.72032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42532.log 2024-09-12T02:41:11.480 INFO:teuthology.orchestra.run.smithi060.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.84073.log.gz 2024-09-12T02:41:11.480 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.41898.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.72032.log.gz 2024-09-12T02:41:11.480 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42108.log 2024-09-12T02:41:11.480 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55112.log 2024-09-12T02:41:11.480 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51031.log 2024-09-12T02:41:11.480 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41856.log 2024-09-12T02:41:11.480 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.55112.log: /var/log/ceph/ceph-client.admin.51031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79171.log 2024-09-12T02:41:11.480 INFO:teuthology.orchestra.run.smithi060.stderr:gzip/var/log/ceph/ceph-client.admin.41856.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.45649.log 2024-09-12T02:41:11.480 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.79171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71543.log 2024-09-12T02:41:11.480 INFO:teuthology.orchestra.run.smithi060.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.79171.log.gz 2024-09-12T02:41:11.480 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53659.log 2024-09-12T02:41:11.480 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41338.log.gz 2024-09-12T02:41:11.480 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.71543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51529.log 2024-09-12T02:41:11.481 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.53659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106691.log 2024-09-12T02:41:11.481 INFO:teuthology.orchestra.run.smithi060.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.71543.log.gz 2024-09-12T02:41:11.481 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67842.log 2024-09-12T02:41:11.481 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.106691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106830.log 2024-09-12T02:41:11.481 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.67842.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.106691.log.gz 2024-09-12T02:41:11.481 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53895.log 2024-09-12T02:41:11.481 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.106830.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.67842.log.gz 2024-09-12T02:41:11.481 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43089.log 2024-09-12T02:41:11.481 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.53895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42192.log 2024-09-12T02:41:11.481 INFO:teuthology.orchestra.run.smithi060.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.106830.log.gz 2024-09-12T02:41:11.481 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42362.log 2024-09-12T02:41:11.481 INFO:teuthology.orchestra.run.smithi060.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53853.log.gz 2024-09-12T02:41:11.481 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42192.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-12T02:41:11.481 INFO:teuthology.orchestra.run.smithi060.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41600.log.gz 2024-09-12T02:41:11.482 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44118.log 2024-09-12T02:41:11.482 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108308.log 2024-09-12T02:41:11.482 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41730.log 2024-09-12T02:41:11.482 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.108308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102829.log 2024-09-12T02:41:11.482 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.108308.log.gz 2024-09-12T02:41:11.482 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.41730.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T02:41:11.482 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.102829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54617.log 2024-09-12T02:41:11.482 INFO:teuthology.orchestra.run.smithi060.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54788.log.gz 2024-09-12T02:41:11.482 INFO:teuthology.orchestra.run.smithi060.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46531.log.gz 2024-09-12T02:41:11.482 INFO:teuthology.orchestra.run.smithi060.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.102829.log.gz 2024-09-12T02:41:11.482 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52724.log 2024-09-12T02:41:11.482 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42234.log.gz 2024-09-12T02:41:11.482 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.54617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46447.log 2024-09-12T02:41:11.482 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52724.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45775.log.gz 2024-09-12T02:41:11.483 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43757.log 2024-09-12T02:41:11.483 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42574.log 2024-09-12T02:41:11.483 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69754.log 2024-09-12T02:41:11.483 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43757.log: /var/log/ceph/ceph-client.admin.42574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55754.log 2024-09-12T02:41:11.483 INFO:teuthology.orchestra.run.smithi060.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45999.log.gz 2024-09-12T02:41:11.483 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.69754.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46214.log.gz 2024-09-12T02:41:11.483 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.55754.log: /var/log/ceph/ceph-client.admin.67018.log 2024-09-12T02:41:11.483 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.69754.log.gz 2024-09-12T02:41:11.483 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107241.log 2024-09-12T02:41:11.483 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55058.log.gz 2024-09-12T02:41:11.483 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.67018.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55354.log.gz 2024-09-12T02:41:11.483 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89512.log 2024-09-12T02:41:11.483 INFO:teuthology.orchestra.run.smithi060.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.67018.log.gz 2024-09-12T02:41:11.483 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42318.log 2024-09-12T02:41:11.483 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.107241.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49768.log.gz 2024-09-12T02:41:11.484 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.89512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106475.log 2024-09-12T02:41:11.484 INFO:teuthology.orchestra.run.smithi060.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.107241.log.gz 2024-09-12T02:41:11.484 INFO:teuthology.orchestra.run.smithi060.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.89512.log.gz 2024-09-12T02:41:11.484 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51655.log 2024-09-12T02:41:11.484 INFO:teuthology.orchestra.run.smithi060.stderr: 87.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T02:41:11.484 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.106475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54021.log 2024-09-12T02:41:11.484 INFO:teuthology.orchestra.run.smithi060.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.106475.log.gz 2024-09-12T02:41:11.484 INFO:teuthology.orchestra.run.smithi060.stderr:gzip/var/log/ceph/ceph-client.admin.51655.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.41940.log 2024-09-12T02:41:11.484 INFO:teuthology.orchestra.run.smithi060.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51445.log.gz 2024-09-12T02:41:11.484 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51487.log.gz 2024-09-12T02:41:11.484 INFO:teuthology.orchestra.run.smithi060.stderr: -- /var/log/ceph/ceph-client.admin.106517.log 2024-09-12T02:41:11.484 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.54021.log: /var/log/ceph/ceph-client.admin.41940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88448.log 2024-09-12T02:41:11.484 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.106517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55982.log 88.8% -- replaced with /var/log/ceph/ceph-client.admin.106517.log.gz 2024-09-12T02:41:11.484 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-09-12T02:41:11.485 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.88448.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53811.log.gz 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49852.log.gz 2024-09-12T02:41:11.485 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-09-12T02:41:11.485 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose 92.0% -- replaced with /var/log/ceph/ceph-client.admin.88448.log.gz 2024-09-12T02:41:11.485 INFO:teuthology.orchestra.run.smithi060.stderr: -- 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53701.log.gz 2024-09-12T02:41:11.485 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53895.log.gz 2024-09-12T02:41:11.485 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53659.log.gz 2024-09-12T02:41:11.485 INFO:teuthology.orchestra.run.smithi060.stderr: /var/log/ceph/ceph-client.admin.104663.log/var/log/ceph/ceph-client.admin.55982.log: 2024-09-12T02:41:11.485 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53937.log.gz 2024-09-12T02:41:11.485 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55982.log.gz 2024-09-12T02:41:11.485 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49726.log 2024-09-12T02:41:11.485 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.104663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44440.log 2024-09-12T02:41:11.485 INFO:teuthology.orchestra.run.smithi060.stderr: 89.3%/var/log/ceph/ceph-client.admin.49726.log: -- replaced with /var/log/ceph/ceph-client.admin.104663.log.gzgzip 89.3% 2024-09-12T02:41:11.485 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51031.log.gz 2024-09-12T02:41:11.486 INFO:teuthology.orchestra.run.smithi060.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.106633.log 2024-09-12T02:41:11.486 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53095.log 2024-09-12T02:41:11.486 INFO:teuthology.orchestra.run.smithi060.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51259.log.gz 2024-09-12T02:41:11.486 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.106633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41688.log 2024-09-12T02:41:11.486 INFO:teuthology.orchestra.run.smithi060.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.106633.log.gz 2024-09-12T02:41:11.486 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.53095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55438.log 2024-09-12T02:41:11.486 INFO:teuthology.orchestra.run.smithi060.stderr:gzip 90.9% -- replaced with /var/log/ceph/ceph-client.admin.54743.log.gz 2024-09-12T02:41:11.486 INFO:teuthology.orchestra.run.smithi060.stderr: -5 --verbose 89.6% -- replaced with /var/log/ceph/ceph-client.admin.54701.log.gz 2024-09-12T02:41:11.486 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.41688.log: -- /var/log/ceph/ceph-client.admin.56713.log 2024-09-12T02:41:11.486 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.55438.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.52969.log.gz 2024-09-12T02:41:11.486 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107062.log 2024-09-12T02:41:11.486 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.56713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45607.log 2024-09-12T02:41:11.486 INFO:teuthology.orchestra.run.smithi060.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.56713.log.gz 2024-09-12T02:41:11.486 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.107062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42276.log 2024-09-12T02:41:11.487 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.107062.log.gz 2024-09-12T02:41:11.487 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56303.log 2024-09-12T02:41:11.487 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45607.log: /var/log/ceph/ceph-client.admin.42276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55154.log 2024-09-12T02:41:11.487 INFO:teuthology.orchestra.run.smithi060.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.51967.log.gz 2024-09-12T02:41:11.487 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.56303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56840.log 2024-09-12T02:41:11.487 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54021.log.gz 2024-09-12T02:41:11.487 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50947.log 2024-09-12T02:41:11.487 INFO:teuthology.orchestra.run.smithi060.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.56303.log.gz 2024-09-12T02:41:11.487 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.55154.log: /var/log/ceph/ceph-client.admin.56840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67769.log 2024-09-12T02:41:11.487 INFO:teuthology.orchestra.run.smithi060.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.56840.log.gz 2024-09-12T02:41:11.487 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.50947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43421.log 2024-09-12T02:41:11.487 INFO:teuthology.orchestra.run.smithi060.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55312.log.gz 2024-09-12T02:41:11.487 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.67769.log: 87.7% 91.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.54389.log.gz 2024-09-12T02:41:11.488 INFO:teuthology.orchestra.run.smithi060.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.51823.log 2024-09-12T02:41:11.488 INFO:teuthology.orchestra.run.smithi060.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42532.log.gz 2024-09-12T02:41:11.488 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42574.log.gz 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42658.log.gz 2024-09-12T02:41:11.488 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-09-12T02:41:11.488 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.67769.log.gz 2024-09-12T02:41:11.488 INFO:teuthology.orchestra.run.smithi060.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43089.log.gz 2024-09-12T02:41:11.488 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43421.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43762.log.gz 2024-09-12T02:41:11.488 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108182.log 2024-09-12T02:41:11.488 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43757.log.gz 2024-09-12T02:41:11.488 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51823.log: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56168.log 2024-09-12T02:41:11.488 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44440.log.gz 2024-09-12T02:41:11.488 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44118.log.gz 2024-09-12T02:41:11.488 INFO:teuthology.orchestra.run.smithi060.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.50433.log.gz 2024-09-12T02:41:11.488 INFO:teuthology.orchestra.run.smithi060.stderr: 87.6%/var/log/ceph/ceph-client.admin.108182.log: -- replaced with /var/log/ceph/ceph-client.admin.51655.log.gz 2024-09-12T02:41:11.489 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55112.log.gz 2024-09-12T02:41:11.489 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54617.log.gz 2024-09-12T02:41:11.489 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52766.log 2024-09-12T02:41:11.489 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.108182.log.gz 2024-09-12T02:41:11.489 INFO:teuthology.orchestra.run.smithi060.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55754.log.gz 2024-09-12T02:41:11.489 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.56168.log: 88.6% 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41688.log.gz -- replaced with /var/log/ceph/ceph-client.admin.41730.log.gz 2024-09-12T02:41:11.489 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-09-12T02:41:11.489 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51613.log 2024-09-12T02:41:11.489 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52766.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.56168.log.gz 2024-09-12T02:41:11.489 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44608.log 2024-09-12T02:41:11.489 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50989.log 2024-09-12T02:41:11.489 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108536.log 2024-09-12T02:41:11.489 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107493.log 2024-09-12T02:41:11.489 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.50989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42024.log 2024-09-12T02:41:11.490 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.108536.log: /var/log/ceph/ceph-client.admin.107493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75044.log 2024-09-12T02:41:11.490 INFO:teuthology.orchestra.run.smithi060.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.108536.log.gz 2024-09-12T02:41:11.490 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42024.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.107493.log.gz 2024-09-12T02:41:11.490 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43087.log 2024-09-12T02:41:11.490 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53053.log 2024-09-12T02:41:11.490 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.75044.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41898.log.gz 2024-09-12T02:41:11.490 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41940.log.gz 2024-09-12T02:41:11.490 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41856.log.gz 2024-09-12T02:41:11.490 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44356.log 2024-09-12T02:41:11.490 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42108.log.gz -- replaced with /var/log/ceph/ceph-client.admin.75044.log.gz 2024-09-12T02:41:11.490 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-09-12T02:41:11.490 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.53053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91855.log 2024-09-12T02:41:11.490 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53979.log 2024-09-12T02:41:11.491 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46447.log.gz 2024-09-12T02:41:11.491 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.91855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69664.log 2024-09-12T02:41:11.491 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.53979.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.91855.log.gz 2024-09-12T02:41:11.491 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43624.log 2024-09-12T02:41:11.491 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.69664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108224.log 2024-09-12T02:41:11.491 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43624.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.69664.log.gz 2024-09-12T02:41:11.491 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101597.log 2024-09-12T02:41:11.491 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42192.log.gz 2024-09-12T02:41:11.491 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.108224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44716.log 2024-09-12T02:41:11.491 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.108224.log.gz 2024-09-12T02:41:11.491 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.101597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91685.log 2024-09-12T02:41:11.491 INFO:teuthology.orchestra.run.smithi060.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.52724.log.gz 2024-09-12T02:41:11.491 INFO:teuthology.orchestra.run.smithi060.stderr: 89.4% 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42318.log.gz 2024-09-12T02:41:11.492 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42276.log.gz 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42362.log.gz 2024-09-12T02:41:11.492 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44716.log: gzip 2024-09-12T02:41:11.492 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45607.log.gz 2024-09-12T02:41:11.492 INFO:teuthology.orchestra.run.smithi060.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.81536.log 2024-09-12T02:41:11.492 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45649.log.gz 2024-09-12T02:41:11.492 INFO:teuthology.orchestra.run.smithi060.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.49726.log.gz 2024-09-12T02:41:11.492 INFO:teuthology.orchestra.run.smithi060.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.101597.log.gz 2024-09-12T02:41:11.492 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52279.log 2024-09-12T02:41:11.492 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.91685.log: /var/log/ceph/ceph-client.admin.81536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55586.log 2024-09-12T02:41:11.492 INFO:teuthology.orchestra.run.smithi060.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.51529.log.gz 2024-09-12T02:41:11.492 INFO:teuthology.orchestra.run.smithi060.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.91685.log.gz 2024-09-12T02:41:11.492 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.81536.log.gz 2024-09-12T02:41:11.492 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108098.log 2024-09-12T02:41:11.492 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.55586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43079.log 2024-09-12T02:41:11.493 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.108098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57435.log 2024-09-12T02:41:11.493 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51571.log 2024-09-12T02:41:11.493 INFO:teuthology.orchestra.run.smithi060.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53095.log.gz 2024-09-12T02:41:11.493 INFO:teuthology.orchestra.run.smithi060.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.108098.log.gz 2024-09-12T02:41:11.493 INFO:teuthology.orchestra.run.smithi060.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.53053.log.gz 2024-09-12T02:41:11.493 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.57435.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.53979.log.gz 2024-09-12T02:41:11.493 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101407.log 2024-09-12T02:41:11.493 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50695.log 2024-09-12T02:41:11.493 INFO:teuthology.orchestra.run.smithi060.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.57435.log.gz 2024-09-12T02:41:11.493 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.101407.log: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43085.log 2024-09-12T02:41:11.493 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45691.log.gz 2024-09-12T02:41:11.493 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45733.log.gz 2024-09-12T02:41:11.493 INFO:teuthology.orchestra.run.smithi060.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.50989.log.gz 2024-09-12T02:41:11.493 INFO:teuthology.orchestra.run.smithi060.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50947.log.gz 2024-09-12T02:41:11.494 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.50695.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.101407.log.gz 2024-09-12T02:41:11.494 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55898.log 2024-09-12T02:41:11.494 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54473.log 2024-09-12T02:41:11.494 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52279.log.gz 2024-09-12T02:41:11.494 INFO:teuthology.orchestra.run.smithi060.stderr:gzip/var/log/ceph/ceph-client.admin.55898.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.53575.log 2024-09-12T02:41:11.494 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.54473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50535.log 2024-09-12T02:41:11.494 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.53575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56448.log 2024-09-12T02:41:11.494 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46341.log 2024-09-12T02:41:11.494 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.50535.log: /var/log/ceph/ceph-client.admin.56448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107745.log 2024-09-12T02:41:11.494 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87827.log 2024-09-12T02:41:11.494 INFO:teuthology.orchestra.run.smithi060.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56448.log.gz 2024-09-12T02:41:11.494 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60675.log 2024-09-12T02:41:11.494 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.107745.log: /var/log/ceph/ceph-client.admin.87827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55628.log 2024-09-12T02:41:11.494 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.107745.log.gz 2024-09-12T02:41:11.495 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46717.log 2024-09-12T02:41:11.495 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.87827.log.gz 2024-09-12T02:41:11.495 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.60675.log: /var/log/ceph/ceph-client.admin.55628.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.60675.log.gz 2024-09-12T02:41:11.495 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43764.log 2024-09-12T02:41:11.495 INFO:teuthology.orchestra.run.smithi060.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.46968.log.gz 2024-09-12T02:41:11.495 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54347.log 2024-09-12T02:41:11.495 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51361.log 2024-09-12T02:41:11.495 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.54347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46125.log 2024-09-12T02:41:11.495 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43960.log 2024-09-12T02:41:11.495 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46299.log 2024-09-12T02:41:11.495 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58987.log 2024-09-12T02:41:11.495 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50493.log 2024-09-12T02:41:11.495 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.58987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46083.log 2024-09-12T02:41:11.495 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.50493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53263.log 2024-09-12T02:41:11.496 INFO:teuthology.orchestra.run.smithi060.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.58987.log.gz 2024-09-12T02:41:11.496 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53407.log 2024-09-12T02:41:11.496 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46083.log: /var/log/ceph/ceph-client.admin.53263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47100.log 2024-09-12T02:41:11.496 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.53407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91932.log 2024-09-12T02:41:11.496 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47100.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-12T02:41:11.496 INFO:teuthology.orchestra.run.smithi060.stderr:gzip/var/log/ceph/ceph-client.admin.91932.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.50905.log 2024-09-12T02:41:11.496 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53491.log 2024-09-12T02:41:11.496 INFO:teuthology.orchestra.run.smithi060.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.91932.log.gz 2024-09-12T02:41:11.496 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.50905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107661.log 2024-09-12T02:41:11.496 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.53491.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-12T02:41:11.496 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.107661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56406.log 2024-09-12T02:41:11.496 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-mds.c.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.107661.log.gz 2024-09-12T02:41:11.496 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106935.log 2024-09-12T02:41:11.496 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43409.log 2024-09-12T02:41:11.497 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.56406.log: /var/log/ceph/ceph-client.admin.106935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52927.log 2024-09-12T02:41:11.497 INFO:teuthology.orchestra.run.smithi060.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.56406.log.gz 2024-09-12T02:41:11.497 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43409.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.106935.log.gz 2024-09-12T02:41:11.497 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55480.log 2024-09-12T02:41:11.497 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87203.log 2024-09-12T02:41:11.497 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.55480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46675.log 2024-09-12T02:41:11.497 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36950.log 2024-09-12T02:41:11.497 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.87203.log: /var/log/ceph/ceph-client.admin.46675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107019.log 2024-09-12T02:41:11.497 INFO:teuthology.orchestra.run.smithi060.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55628.log.gz 2024-09-12T02:41:11.497 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.36950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54431.log 2024-09-12T02:41:11.497 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.87203.log.gz 2024-09-12T02:41:11.497 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.107019.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.47100.log.gz 2024-09-12T02:41:11.497 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99251.log 2024-09-12T02:41:11.498 INFO:teuthology.orchestra.run.smithi060.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53575.log.gz 2024-09-12T02:41:11.498 INFO:teuthology.orchestra.run.smithi060.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.50493.log.gz 2024-09-12T02:41:11.498 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.107019.log.gz 2024-09-12T02:41:11.498 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.54431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46885.log 2024-09-12T02:41:11.498 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.99251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59208.log 2024-09-12T02:41:11.498 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46885.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.99251.log.gz 2024-09-12T02:41:11.498 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44398.log 2024-09-12T02:41:11.498 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.59208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51697.log 2024-09-12T02:41:11.498 INFO:teuthology.orchestra.run.smithi060.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59208.log.gz 2024-09-12T02:41:11.498 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53365.log 2024-09-12T02:41:11.498 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43758.log 2024-09-12T02:41:11.498 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.53365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57149.log 2024-09-12T02:41:11.498 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46801.log 2024-09-12T02:41:11.498 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43758.log: /var/log/ceph/ceph-client.admin.57149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75670.log 2024-09-12T02:41:11.499 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45875.log 2024-09-12T02:41:11.499 INFO:teuthology.orchestra.run.smithi060.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.57149.log.gz 2024-09-12T02:41:11.499 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.75670.log: /var/log/ceph/ceph-client.admin.52111.log 2024-09-12T02:41:11.499 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45875.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.75670.log.gz 2024-09-12T02:41:11.499 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44119.log.gz 2024-09-12T02:41:11.499 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52111.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44482.log.gz 2024-09-12T02:41:11.499 INFO:teuthology.orchestra.run.smithi060.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44902.log.gz 2024-09-12T02:41:11.499 INFO:teuthology.orchestra.run.smithi060.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43079.log.gz 2024-09-12T02:41:11.499 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43085.log.gz 2024-09-12T02:41:11.499 INFO:teuthology.orchestra.run.smithi060.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50695.log.gz 2024-09-12T02:41:11.499 INFO:teuthology.orchestra.run.smithi060.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50821.log.gz 2024-09-12T02:41:11.499 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50863.log.gz 2024-09-12T02:41:11.499 INFO:teuthology.orchestra.run.smithi060.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53137.log.gz 2024-09-12T02:41:11.505 INFO:teuthology.orchestra.run.smithi060.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46759.log.gz 2024-09-12T02:41:11.505 INFO:teuthology.orchestra.run.smithi060.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51613.log.gz 2024-09-12T02:41:11.505 INFO:teuthology.orchestra.run.smithi060.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.51697.log.gz 2024-09-12T02:41:11.505 INFO:teuthology.orchestra.run.smithi060.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51823.log.gz 2024-09-12T02:41:11.505 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46843.log.gz 2024-09-12T02:41:11.505 INFO:teuthology.orchestra.run.smithi060.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.50737.log.gz 2024-09-12T02:41:11.505 INFO:teuthology.orchestra.run.smithi060.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50779.log.gz 2024-09-12T02:41:11.505 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51925.log.gz 2024-09-12T02:41:11.505 INFO:teuthology.orchestra.run.smithi060.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52153.log.gz 2024-09-12T02:41:11.505 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53323.log.gz 2024-09-12T02:41:11.506 INFO:teuthology.orchestra.run.smithi060.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.53011.log.gz 2024-09-12T02:41:11.506 INFO:teuthology.orchestra.run.smithi060.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53449.log.gz 2024-09-12T02:41:11.506 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53533.log.gz 2024-09-12T02:41:11.506 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53769.log.gz 2024-09-12T02:41:11.506 INFO:teuthology.orchestra.run.smithi060.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.55154.log.gz 2024-09-12T02:41:11.506 INFO:teuthology.orchestra.run.smithi060.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.55238.log.gz 2024-09-12T02:41:11.506 INFO:teuthology.orchestra.run.smithi060.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.55196.log.gz 2024-09-12T02:41:11.506 INFO:teuthology.orchestra.run.smithi060.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55438.log.gz 2024-09-12T02:41:11.506 INFO:teuthology.orchestra.run.smithi060.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.55586.log.gz 2024-09-12T02:41:11.506 INFO:teuthology.orchestra.run.smithi060.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.55522.log.gz 2024-09-12T02:41:11.506 INFO:teuthology.orchestra.run.smithi060.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.52766.log.gz 2024-09-12T02:41:11.506 INFO:teuthology.orchestra.run.smithi060.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43087.log.gz 2024-09-12T02:41:11.506 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43409.log.gz 2024-09-12T02:41:11.506 INFO:teuthology.orchestra.run.smithi060.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43421.log.gz 2024-09-12T02:41:11.506 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43624.log.gz 2024-09-12T02:41:11.507 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43758.log.gz 2024-09-12T02:41:11.507 INFO:teuthology.orchestra.run.smithi060.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43960.log.gz 2024-09-12T02:41:11.507 INFO:teuthology.orchestra.run.smithi060.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43764.log.gz 2024-09-12T02:41:11.507 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44356.log.gz 2024-09-12T02:41:11.507 INFO:teuthology.orchestra.run.smithi060.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44398.log.gz 2024-09-12T02:41:11.507 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44716.log.gz 2024-09-12T02:41:11.507 INFO:teuthology.orchestra.run.smithi060.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.44608.log.gz 2024-09-12T02:41:11.507 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53263.log.gz 2024-09-12T02:41:11.507 INFO:teuthology.orchestra.run.smithi060.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42024.log.gz 2024-09-12T02:41:11.507 INFO:teuthology.orchestra.run.smithi060.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45875.log.gz 2024-09-12T02:41:11.507 INFO:teuthology.orchestra.run.smithi060.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.55898.log.gz 2024-09-12T02:41:11.507 INFO:teuthology.orchestra.run.smithi060.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.51571.log.gz 2024-09-12T02:41:11.507 INFO:teuthology.orchestra.run.smithi060.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54473.log.gz 2024-09-12T02:41:11.507 INFO:teuthology.orchestra.run.smithi060.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54431.log.gz 2024-09-12T02:41:11.507 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50535.log.gz 2024-09-12T02:41:11.508 INFO:teuthology.orchestra.run.smithi060.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50905.log.gz 2024-09-12T02:41:11.508 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46801.log.gz 2024-09-12T02:41:11.508 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% 90.2% -- replaced with /var/log/ceph/ceph-client.admin.46885.log.gz -- replaced with /var/log/ceph/ceph-client.admin.52927.log.gz 2024-09-12T02:41:11.508 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-09-12T02:41:11.508 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51361.log.gz 2024-09-12T02:41:11.508 INFO:teuthology.orchestra.run.smithi060.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53407.log.gz 2024-09-12T02:41:11.508 INFO:teuthology.orchestra.run.smithi060.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53365.log.gz 2024-09-12T02:41:11.508 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54347.log.gz 2024-09-12T02:41:11.508 INFO:teuthology.orchestra.run.smithi060.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53491.log.gz 2024-09-12T02:41:11.508 INFO:teuthology.orchestra.run.smithi060.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.55480.log.gz 2024-09-12T02:41:11.508 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52111.log.gz 2024-09-12T02:41:11.508 INFO:teuthology.orchestra.run.smithi060.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46083.log.gz 2024-09-12T02:41:11.508 INFO:teuthology.orchestra.run.smithi060.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46125.log.gz 2024-09-12T02:41:11.508 INFO:teuthology.orchestra.run.smithi060.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46341.log.gz 2024-09-12T02:41:11.509 INFO:teuthology.orchestra.run.smithi060.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46299.log.gz 2024-09-12T02:41:11.509 INFO:teuthology.orchestra.run.smithi060.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55396.log.gz 2024-09-12T02:41:11.509 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46615.log.gz 2024-09-12T02:41:11.509 INFO:teuthology.orchestra.run.smithi060.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46675.log.gz 2024-09-12T02:41:11.509 INFO:teuthology.orchestra.run.smithi060.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46717.log.gz 2024-09-12T02:41:11.509 INFO:teuthology.orchestra.run.smithi060.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36950.log.gz 2024-09-12T02:41:11.557 INFO:teuthology.orchestra.run.smithi105.stderr: 94.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T02:41:11.669 INFO:teuthology.orchestra.run.smithi105.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.36267.log.gz 2024-09-12T02:41:11.669 INFO:teuthology.orchestra.run.smithi105.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36316.log.gz 2024-09-12T02:41:11.669 INFO:teuthology.orchestra.run.smithi105.stderr: 92.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T02:41:11.670 INFO:teuthology.orchestra.run.smithi105.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36356.log.gz 2024-09-12T02:41:11.670 INFO:teuthology.orchestra.run.smithi105.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36396.log.gz 2024-09-12T02:41:12.226 INFO:teuthology.orchestra.run.smithi060.stderr: 89.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T02:41:12.296 INFO:teuthology.orchestra.run.smithi060.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-12T02:41:12.297 INFO:teuthology.orchestra.run.smithi060.stderr: 93.2% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-12T02:41:12.951 INFO:teuthology.orchestra.run.smithi105.stderr: 94.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T02:41:13.744 INFO:teuthology.orchestra.run.smithi105.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-12T02:41:13.884 INFO:teuthology.orchestra.run.smithi060.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-12T02:41:15.384 INFO:teuthology.orchestra.run.smithi105.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-12T02:41:16.074 INFO:teuthology.orchestra.run.smithi060.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T02:41:38.961 INFO:teuthology.orchestra.run.smithi105.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-12T02:41:40.596 INFO:teuthology.orchestra.run.smithi105.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-12T02:41:41.339 INFO:teuthology.orchestra.run.smithi105.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-12T02:41:43.239 INFO:teuthology.orchestra.run.smithi060.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T02:41:43.677 INFO:teuthology.orchestra.run.smithi060.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T02:41:46.064 INFO:teuthology.orchestra.run.smithi060.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T02:41:49.061 INFO:teuthology.orchestra.run.smithi105.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-12T02:41:51.478 INFO:teuthology.orchestra.run.smithi105.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-12T02:41:55.199 INFO:teuthology.orchestra.run.smithi060.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-12T02:41:55.847 INFO:teuthology.orchestra.run.smithi105.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-12T02:44:18.342 INFO:teuthology.orchestra.run.smithi060.stderr: 95.9% -- replaced with /var/log/ceph/ceph-client.0.45340.log.gz 2024-09-12T02:44:18.343 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-09-12T02:44:18.343 INFO:teuthology.orchestra.run.smithi060.stderr:real 3m7.041s 2024-09-12T02:44:18.343 INFO:teuthology.orchestra.run.smithi060.stderr:user 4m25.688s 2024-09-12T02:44:18.344 INFO:teuthology.orchestra.run.smithi060.stderr:sys 0m10.927s 2024-09-12T02:44:21.040 INFO:teuthology.orchestra.run.smithi105.stderr: 95.8% -- replaced with /var/log/ceph/ceph-client.1.42685.log.gz 2024-09-12T02:44:21.042 INFO:teuthology.orchestra.run.smithi105.stderr: 2024-09-12T02:44:21.042 INFO:teuthology.orchestra.run.smithi105.stderr:real 3m9.716s 2024-09-12T02:44:21.042 INFO:teuthology.orchestra.run.smithi105.stderr:user 4m35.468s 2024-09-12T02:44:21.042 INFO:teuthology.orchestra.run.smithi105.stderr:sys 0m11.753s 2024-09-12T02:44:21.042 INFO:tasks.ceph:Archiving logs... 2024-09-12T02:44:21.043 DEBUG:teuthology.misc:Transferring archived files from smithi060:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901613/remote/smithi060/log 2024-09-12T02:44:21.044 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T02:44:54.704 DEBUG:teuthology.misc:Transferring archived files from smithi105:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901613/remote/smithi105/log 2024-09-12T02:44:54.705 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T02:45:31.590 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T02:45:31.599 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T02:45:31.600 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T02:45:31.603 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T02:45:31.977 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T02:45:31.986 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T02:45:31.987 DEBUG:teuthology.orchestra.run.smithi060:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:45:31.990 DEBUG:teuthology.orchestra.run.smithi105:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:45:32.005 INFO:teuthology.orchestra.run.smithi060.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:45:32.007 INFO:teuthology.orchestra.run.smithi105.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:45:32.025 INFO:teuthology.orchestra.run.smithi105.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:45:32.025 INFO:teuthology.orchestra.run.smithi105.stdout:=============================================================================== 2024-09-12T02:45:32.025 INFO:teuthology.orchestra.run.smithi105.stdout:^* hv01.front.sepia.ceph.com 3 6 377 61 -3186us[-3175us] +/- 45ms 2024-09-12T02:45:32.025 INFO:teuthology.orchestra.run.smithi105.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 57 +1588us[+1588us] +/- 55ms 2024-09-12T02:45:32.025 INFO:teuthology.orchestra.run.smithi105.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 61 +3358us[+3358us] +/- 82ms 2024-09-12T02:45:32.025 INFO:teuthology.orchestra.run.smithi105.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:45:32.026 INFO:teuthology.orchestra.run.smithi060.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:45:32.027 INFO:teuthology.orchestra.run.smithi060.stdout:=============================================================================== 2024-09-12T02:45:32.027 INFO:teuthology.orchestra.run.smithi060.stdout:^* hv01.front.sepia.ceph.com 3 6 377 58 -3178us[-3176us] +/- 45ms 2024-09-12T02:45:32.027 INFO:teuthology.orchestra.run.smithi060.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 60 +1581us[+1583us] +/- 55ms 2024-09-12T02:45:32.027 INFO:teuthology.orchestra.run.smithi060.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 59 +3327us[+3329us] +/- 82ms 2024-09-12T02:45:32.027 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:45:32.027 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T02:45:32.087 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T02:45:32.088 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T02:45:32.171 DEBUG:teuthology.orchestra.run.smithi060:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T02:45:32.285 DEBUG:teuthology.orchestra.run.smithi105:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T02:45:32.415 DEBUG:teuthology.orchestra.run.smithi060:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:45:32.447 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:45:32.448 DEBUG:teuthology.orchestra.run.smithi105:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:45:32.477 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:45:32.478 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T02:45:32.487 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T02:45:32.549 INFO:teuthology.task.internal:Duration was 1778.865355 seconds 2024-09-12T02:45:32.550 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T02:45:32.635 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T02:45:32.635 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T02:45:32.641 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T02:45:32.707 INFO:teuthology.orchestra.run.smithi060.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:45:32.718 INFO:teuthology.orchestra.run.smithi105.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:45:33.198 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T02:45:33.198 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi060.front.sepia.ceph.com 2024-09-12T02:45:33.198 DEBUG:teuthology.orchestra.run.smithi060:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T02:45:33.224 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi105.front.sepia.ceph.com 2024-09-12T02:45:33.225 DEBUG:teuthology.orchestra.run.smithi105:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T02:45:33.254 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T02:45:33.255 DEBUG:teuthology.orchestra.run.smithi060:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T02:45:33.267 DEBUG:teuthology.orchestra.run.smithi105:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T02:45:33.324 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T02:45:33.325 DEBUG:teuthology.orchestra.run.smithi060:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T02:45:33.338 DEBUG:teuthology.orchestra.run.smithi105:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T02:45:33.483 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T02:45:33.496 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T02:45:33.496 DEBUG:teuthology.orchestra.run.smithi060:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T02:45:33.536 DEBUG:teuthology.orchestra.run.smithi105:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T02:45:33.576 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T02:45:33.757 DEBUG:teuthology.orchestra.run.smithi060:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:45:33.760 DEBUG:teuthology.orchestra.run.smithi105:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:45:33.793 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern = core 2024-09-12T02:45:33.802 INFO:teuthology.orchestra.run.smithi105.stdout:kernel.core_pattern = core 2024-09-12T02:45:33.816 DEBUG:teuthology.orchestra.run.smithi060:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:45:33.863 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:45:33.864 DEBUG:teuthology.orchestra.run.smithi105:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:45:33.878 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:45:33.879 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T02:45:33.890 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T02:45:33.891 DEBUG:teuthology.misc:Transferring archived files from smithi060:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901613/remote/smithi060 2024-09-12T02:45:33.891 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T02:45:33.945 DEBUG:teuthology.misc:Transferring archived files from smithi105:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901613/remote/smithi105 2024-09-12T02:45:33.946 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T02:45:33.979 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T02:45:33.979 DEBUG:teuthology.orchestra.run.smithi060:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T02:45:33.983 DEBUG:teuthology.orchestra.run.smithi105:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T02:45:34.030 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T02:45:34.042 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T02:45:34.042 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T02:45:34.141 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T02:45:34.142 DEBUG:teuthology.orchestra.run.smithi060:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T02:45:34.144 DEBUG:teuthology.orchestra.run.smithi105:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T02:45:34.157 INFO:teuthology.orchestra.run.smithi060.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 02:45 /home/ubuntu/cephtest 2024-09-12T02:45:34.159 INFO:teuthology.orchestra.run.smithi105.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 02:45 /home/ubuntu/cephtest 2024-09-12T02:45:34.161 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T02:45:34.233 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T02:45:34.343 INFO:teuthology.run:Summary data: description: fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/ffsb}} duration: 1778.865355014801 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-12T02:45:34.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T02:45:34.468 INFO:teuthology.run:pass